-- Logs begin at Sat 2022-07-16 20:01:20 UTC, end at Sat 2022-07-16 22:45:02 UTC. -- Jul 16 20:43:39.732384 ncdv-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Jul 16 20:43:39.743627 ncdv-master-1 devstack@keystone.service[98185]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 16 20:43:39.745302 ncdv-master-1 devstack@keystone.service[98185]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jul 16 20:43:39 2022] *** Jul 16 20:43:39.745302 ncdv-master-1 devstack@keystone.service[98185]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 16 20:43:39.745302 ncdv-master-1 devstack@keystone.service[98185]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 16 20:43:39.745302 ncdv-master-1 devstack@keystone.service[98185]: nodename: ncdv-master-1 Jul 16 20:43:39.745302 ncdv-master-1 devstack@keystone.service[98185]: machine: x86_64 Jul 16 20:43:39.745302 ncdv-master-1 devstack@keystone.service[98185]: clock source: unix Jul 16 20:43:39.745302 ncdv-master-1 devstack@keystone.service[98185]: pcre jit disabled Jul 16 20:43:39.745302 ncdv-master-1 devstack@keystone.service[98185]: detected number of CPU cores: 4 Jul 16 20:43:39.745302 ncdv-master-1 devstack@keystone.service[98185]: current working directory: / Jul 16 20:43:39.745302 ncdv-master-1 devstack@keystone.service[98185]: detected binary path: /usr/bin/uwsgi-core Jul 16 20:43:39.745302 ncdv-master-1 devstack@keystone.service[98185]: your processes number limit is 47680 Jul 16 20:43:39.745302 ncdv-master-1 devstack@keystone.service[98185]: your memory page size is 4096 bytes Jul 16 20:43:39.745302 ncdv-master-1 devstack@keystone.service[98185]: detected max file descriptor number: 2048 Jul 16 20:43:39.745302 ncdv-master-1 devstack@keystone.service[98185]: lock engine: pthread robust mutexes Jul 16 20:43:39.746289 ncdv-master-1 devstack@keystone.service[98185]: thunder lock: enabled Jul 16 20:43:39.746289 ncdv-master-1 devstack@keystone.service[98185]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 16 20:43:39.746289 ncdv-master-1 devstack@keystone.service[98185]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 16 20:43:39.791420 ncdv-master-1 devstack@keystone.service[98185]: Python main interpreter initialized at 0x555ff93c79c0 Jul 16 20:43:39.791420 ncdv-master-1 devstack@keystone.service[98185]: python threads support enabled Jul 16 20:43:39.791420 ncdv-master-1 devstack@keystone.service[98185]: your server socket listen backlog is limited to 100 connections Jul 16 20:43:39.791420 ncdv-master-1 devstack@keystone.service[98185]: your mercy for graceful operations on workers is 90 seconds Jul 16 20:43:39.791811 ncdv-master-1 devstack@keystone.service[98185]: mapped 403077 bytes (393 KB) for 2 cores Jul 16 20:43:39.791885 ncdv-master-1 devstack@keystone.service[98185]: *** Operational MODE: preforking *** Jul 16 20:43:39.792124 ncdv-master-1 devstack@keystone.service[98185]: *** uWSGI is running in multiple interpreter mode *** Jul 16 20:43:39.792124 ncdv-master-1 devstack@keystone.service[98185]: spawned uWSGI master process (pid: 98185) Jul 16 20:43:39.792337 ncdv-master-1 systemd[1]: Started Devstack devstack@keystone.service. Jul 16 20:43:39.793465 ncdv-master-1 devstack@keystone.service[98185]: spawned uWSGI worker 1 (pid: 98195, cores: 1) Jul 16 20:43:39.793465 ncdv-master-1 devstack@keystone.service[98185]: spawned uWSGI worker 2 (pid: 98196, cores: 1) Jul 16 20:43:39.793465 ncdv-master-1 devstack@keystone.service[98185]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 16 20:43:45.704413 ncdv-master-1 devstack@keystone.service[98195]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 16 20:43:45.704413 ncdv-master-1 devstack@keystone.service[98195]: from cryptography.utils import int_from_bytes Jul 16 20:43:45.705344 ncdv-master-1 devstack@keystone.service[98195]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 16 20:43:45.705344 ncdv-master-1 devstack@keystone.service[98195]: from cryptography.utils import int_from_bytes Jul 16 20:43:45.733075 ncdv-master-1 devstack@keystone.service[98196]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 16 20:43:45.733075 ncdv-master-1 devstack@keystone.service[98196]: from cryptography.utils import int_from_bytes Jul 16 20:43:45.733734 ncdv-master-1 devstack@keystone.service[98196]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 16 20:43:45.733734 ncdv-master-1 devstack@keystone.service[98196]: from cryptography.utils import int_from_bytes Jul 16 20:43:45.755307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 16 20:43:45.755512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 16 20:43:45.755677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] command line args: [] {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 16 20:43:45.755953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 16 20:43:45.756128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ================================================================================ {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 16 20:43:45.756383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] admin_token = **** {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.756640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] config_dir = [] {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.756824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.757007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] config_source = [] {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.757188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] debug = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.757399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.757761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.757952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] insecure_debug = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.758214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.758465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.758701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] list_limit = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.758886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] log_config_append = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.759101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.759339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] log_dir = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.759467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] log_file = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.759687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.759949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.760197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.760451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.760633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.760815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.761067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.761320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.761559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.761795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.762033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.762271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.762635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.762891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] notification_format = cadf {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.763199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.763707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.763894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] publish_errors = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.764138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.764375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.764560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.764812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.765055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.765299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] standard_threads = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.765570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] strict_password_check = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.765824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.766007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] use_eventlog = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.766190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] use_journal = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.766373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] use_json = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.766554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] use_stderr = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.766735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] use_syslog = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.766975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] watch_log_file = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.767276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.767524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.767793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.768047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.768304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.768551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.768810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.769055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.769311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.769564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.769821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.770063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.770315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.770559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.770812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.771091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.771337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.771601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.771933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.772240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.772488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.772753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.773026 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.773289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.773546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.773785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.774024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.774259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.774504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.774761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.775032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.775281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.775517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.775775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.776030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.776275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.776531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.776768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.777013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.777256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.777493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.777729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.777973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.778210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.778455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.778713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.778951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.779220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.779461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.779705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.779945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.780206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.780440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.780683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.780929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.781253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.781499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.781701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 16 20:43:45.781914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 16 20:43:45.782118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.782318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] command line args: [] {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 16 20:43:45.782510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.782706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 16 20:43:45.782706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ================================================================================ {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 16 20:43:45.783193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.783391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] admin_token = **** {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.783566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.783732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] config_dir = [] {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.783908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.784084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.784266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.784435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] config_source = [] {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.784435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] debug = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.784772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.784903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.785094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.785290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.785483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.785675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] insecure_debug = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.785865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.786057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.786248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.786445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.786637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.786818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] list_limit = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.786818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] log_config_append = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.787169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.787422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.787607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.787797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] log_dir = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.787797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] log_file = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.788131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.788300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.788478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.788671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.788852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.789031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.789216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.789397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.789607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.enabled = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.789790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.789973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.790154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.790332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.790514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.790714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.790907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.791108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.791228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.791351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.791468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.791590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.791707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.791818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.791927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.792042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.792157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.792279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.792395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] notification_format = cadf {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.792510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.792621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.792739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.792739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.792986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.793108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.793225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] publish_errors = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.793343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.793454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.793564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.793675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.793785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.793895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.794013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.794125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.794236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.794351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.794463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.794580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] standard_threads = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.794698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.794827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] strict_password_check = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.794950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.795081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.795081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] use_eventlog = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.795290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.795411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] use_journal = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.795524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.795642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] use_json = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.795759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.795876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] use_stderr = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.795876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] use_syslog = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.796097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.796209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] watch_log_file = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 20:43:45.796331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.796443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.796558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.796669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.797391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.797544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.797742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] auth.external = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.797939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.798123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] auth.mapped = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.798303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.798434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.798562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.798675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.798785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.798896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] auth.password = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.799091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.799219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] auth.token = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.799344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.799455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.799571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.799682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] catalog.caching = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.799947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.800060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.800164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.800276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.800387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.800496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.800606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.800715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.800833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.800950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.801062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.801178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] credential.caching = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.801294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.801406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] credential.driver = sql {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.801527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.801643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.801643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.801858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.801858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.802054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.802219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.802337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.802449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.802559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.802670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.802789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.802908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.803046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.803162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.803279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.803389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.803499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.803609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.803729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.803846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.803958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.804068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.804179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.804296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.804415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.804532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.804532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.804745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.804860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.804976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] federation.caching = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.804976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.805161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.805255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] federation.driver = sql {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.805347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.805347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.805533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.805533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.805799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.805799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.805979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.806074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.806165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.806270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.806364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.806463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.806562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.806654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.806752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.806858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.806960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.807122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.807217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.807311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.807409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] identity.caching = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.814124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.814285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.814409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.814560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.814699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.814835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.814959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.815069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.815147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.815218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] identity.driver = sql {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.815288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.815357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.815445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.815577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.815669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.815797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.815885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.815957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.816037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.816110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.816179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.816248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.816345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.816429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.816535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.816662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.816808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.816934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.817015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.817085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.817155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.817225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.817305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.817377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.817448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.817561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.817703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.817839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.817941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.818017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.818092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.818164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.818233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.818303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.818433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.818622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.818763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.818876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.818984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.819115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.819228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.819328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.819423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.819518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.819614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.819710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.819874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.820000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.820107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.820211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.820309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.enabled = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.820410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.820633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.820804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.820938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.821039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.821175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.821297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.821473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.821648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.821815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.821977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.password = **** {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.822083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.822179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.822284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.822383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.822510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.822612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.822707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.822802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.822802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.822996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.822996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.823202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.823303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.823398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.823508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.823610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.823610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.823896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.823896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.824166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.824573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.824701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.824778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.824849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.824918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.825025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.825193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.825272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.825344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.825413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.user = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.825514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.825685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.825769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.825877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.826057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.826184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.826310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.826628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.826758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.826901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.826995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.827141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.827213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.827302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.827378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.827455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.827541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] auth.external = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.827664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.827794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] auth.mapped = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.827959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.827959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.828107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.828180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.828254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.828325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.828393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] auth.password = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.828487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.828587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] auth.token = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.828740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.828891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.828891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] catalog.caching = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.829150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.829237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.829309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.829379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.829450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.829520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.829599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.829599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.829729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.829800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.829870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.829939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.830017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] credential.caching = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.830089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.830159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] credential.driver = sql {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.830229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.830299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.830370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.830468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.830647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.830732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.830852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] policy.driver = sql {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.830928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.831022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.831154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.831233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.831366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.831491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.831621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.831751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] receipt.caching = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.831893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.832023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.832153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.832286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.832376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.832466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.832605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.832704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.832827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.832908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.832980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.833061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] resource.caching = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.833142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.833215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.833285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] federation.caching = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.833361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] resource.driver = sql {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.833433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.833555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.833640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] federation.driver = sql {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.833713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.833783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.833889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.834014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.834272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] revoke.caching = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.834428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.834537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.834612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.834684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.834754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.834838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] role.cache_time = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.834912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.834982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] role.caching = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.835070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.835252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] role.driver = sql {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.835389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.835503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] role.list_limit = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.835587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.835667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.835789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] identity.caching = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.835865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.835981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.836066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.836183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.836258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.836388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.836474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.836576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.836701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.836779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] identity.driver = sql {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.836893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.836968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.837072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.837150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.837272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.837349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.837462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.837537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.837650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.837725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.837873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.837956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.838077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.838153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.838267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.838346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.838481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.838562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.838676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.838751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.838865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.838940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.839090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.839168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.839284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.839360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.839473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.839549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.839763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.839888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.839967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.840038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.840108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.840230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.840307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.840421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.840496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.840609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.840725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.840892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.840969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.841086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.841161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.841275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.841349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.841471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.841548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.841662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.841737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.841850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.841933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] token.cache_time = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.842061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.842138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] token.caching = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.842252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.842327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.842444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.842521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] token.provider = fernet {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.842642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.842719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.842833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.842908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.843105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.password = **** {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.843183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.843312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.843391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.843512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.843631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.843694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.843752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.843819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.843819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.843925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] trust.driver = sql {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.843982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.844044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.844107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.844176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.844235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.844291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.844347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.844403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.844459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.844523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.844581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.844638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.844694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.844751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.844854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.844941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.845015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.845085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] database.connection = **** {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.845209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.user = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.845293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.845409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.845483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.845597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.845680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.845795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.845870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.845983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.846058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.846180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.846257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.846372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.846446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.846561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.846635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.846757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.846840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.846955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.847044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.847107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.847232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.847317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.847433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.847518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.847636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.847712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.847826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.847909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.848024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.848100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.848215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.848293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.848408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.848491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.848606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.848681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.848795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 16 20:43:45.848870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.848870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.848870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.848870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.848870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.848870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.848870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.848870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.848870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] policy.driver = sql {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.849593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.849593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.849593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.849593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] receipt.caching = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.849593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.849593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.849593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.849593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.849593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.850332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] resource.caching = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.850332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.850332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] resource.driver = sql {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.850332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.850332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.850332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.850834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] revoke.caching = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.850834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.851101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.851179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] role.cache_time = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.851410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] role.caching = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.851661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] role.driver = sql {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.851895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] role.list_limit = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.852146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.852414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.852650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.852900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.853149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.853400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.853656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.853908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.854144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.854429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.854654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.854906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.855211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.855615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.855857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.856113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.856368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.856623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.856877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.857117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.857376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.857631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.857873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.858108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.858344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.858578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.858832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.859127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.859899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.860143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.860387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.860673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] token.cache_time = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.860862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] token.caching = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.861106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.861359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] token.provider = fernet {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.861600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.861861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.862113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.862356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.862605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.862854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.863144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] trust.driver = sql {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.863389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.863639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.863879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.865796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.865796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.865796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.865796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.865796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.865796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] database.connection = **** {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.865796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.867340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.867340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.867340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.867340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.867340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.867340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.867340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.868077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.868077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.868077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.868403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.868403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.868683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.868892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.869127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.869372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.869611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 20:43:45.869784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 16 20:43:45.877216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:45.877447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:45.877684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:45.886573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:45.897304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:45.897552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:45.897749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:45.906936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:45.915735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:45.915967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:45.926033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:45.926504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:45.970703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:45.971575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.023623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.023870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.024437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.024682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.092499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.092781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.092914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.093040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.093166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.093324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.093441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.094050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.094171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.094290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.094422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.094546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.119077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.119269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.119378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.119457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.119556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.119697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.119798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.119924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.120021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.120105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.120215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.120336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.120419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.120547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.134090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.134826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.147134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.147367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.147460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.147598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.147695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.147805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.147888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.148027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.148122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.148259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.148341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.148461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98195) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.148540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.148687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98196) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 16 20:43:46.166553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.166781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 16 20:43:46.166968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.166968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 16 20:43:46.167271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.167271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 16 20:43:46.167484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.167484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 16 20:43:46.167624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.167764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.167877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.168008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.168106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.168260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.168345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.168512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.180474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.180691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.180784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.180915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.181025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.181125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.181312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.181453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.189892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=98196) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.190035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=98195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.193270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=98196) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.193424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=98195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.193551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.193687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.193819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.193951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.194081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.194230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.194364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.194498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.194629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.194760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.194969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.195146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.195282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.195413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.195544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.195697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.195832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.195966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.196099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.196236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.223687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.223888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.225411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=98196) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.225618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=98195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.225707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.225902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.231106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=98196) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.231369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=98195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.231516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.231658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.231749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.231846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.239846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=98196) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.239999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=98195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.240138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.240253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.244692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=98196) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.244828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=98195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.245102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.245188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.245385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.245515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.245663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.245797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.245937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.246056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.246204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.246338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.246481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.246571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.246749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.246841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.266759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.267106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.267809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.268105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.271746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=98195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.272847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=98196) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.275404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.275694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.276526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.276818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.280705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=98195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.281914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=98196) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.284385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=98195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.285654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=98196) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.288163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.288463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.288753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.289041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.289324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.289485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.289628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.289817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.290112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.290439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.290719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.291036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.308852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=98195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.309147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.309419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.309683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.310813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=98196) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.311161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.311433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.311698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.318612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.320344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.320464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.320646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.322086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.322365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.323722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=98195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.324009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.324302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.324599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.324882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.325447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=98196) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.325730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.326018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.326298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.326587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.339199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=98195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.339487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.339777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.340058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.340361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.340610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.340711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=98196) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.340891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.340988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.341241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.341527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.341819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.342092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.342361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.359517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=98195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.360594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=98196) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.362898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=98195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.363892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=98196) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.366241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.367241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.367885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.368860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.369514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=98195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.369791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.370072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.370489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=98196) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.370763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.371063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.378109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.379097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.379768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=98195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.380730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=98196) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.383182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.383481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.383767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.384022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.384174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.384315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.384590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.384861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.393898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=98195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.394195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.394637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=98196) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.394938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.395730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.396459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.403734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=98195) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.404015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.404310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.404473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=98196) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 16 20:43:46.404595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.404747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.404868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.404991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.405144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.405232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.405415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.405497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.405686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.405814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.405950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.406075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.406308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.406440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.406575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.406809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.406882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.407120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.407246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.407392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.407590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.407699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.407817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=98195) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.407898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=98196) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 16 20:43:46.446771 ncdv-master-1 devstack@keystone.service[98196]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x555ff93c79c0 pid: 98196 (default app) Jul 16 20:43:46.446983 ncdv-master-1 devstack@keystone.service[98195]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x555ff93c79c0 pid: 98195 (default app) Jul 16 20:43:46.450258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a4875-6a76-4bab-bbfb-8154332ce15d None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:43:46.450547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a4875-6a76-4bab-bbfb-8154332ce15d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:43:46.450825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a4875-6a76-4bab-bbfb-8154332ce15d None None] PATH_INFO: `/v3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:43:46.455929 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Sat Jul 16 20:43:46 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:43:55.924699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae429f-1a60-4b92-afa2-3b7e13e99790 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:43:55.925242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae429f-1a60-4b92-afa2-3b7e13e99790 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:43:55.925327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae429f-1a60-4b92-afa2-3b7e13e99790 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:43:55.930662 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:43:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:43:55.937887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae0f0e-9cf9-439d-9cb8-6ea48a7701ea None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:43:55.938391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae0f0e-9cf9-439d-9cb8-6ea48a7701ea None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:43:55.938813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae0f0e-9cf9-439d-9cb8-6ea48a7701ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:43:56.016110 ncdv-master-1 devstack@keystone.service[98196]: INFO dbcounter [None req-86ae0f0e-9cf9-439d-9cb8-6ea48a7701ea None None] Registered counter for database keystone Jul 16 20:43:56.039349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG oslo_db.sqlalchemy.engines [None req-86ae0f0e-9cf9-439d-9cb8-6ea48a7701ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98196) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 20:43:56.046038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writer thread running {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 20:43:56.245425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG passlib.handlers.bcrypt [None req-86ae0f0e-9cf9-439d-9cb8-6ea48a7701ea None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=98196) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 16 20:43:56.245776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG passlib.handlers.bcrypt [None req-86ae0f0e-9cf9-439d-9cb8-6ea48a7701ea None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=98196) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 16 20:43:56.302579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-86ae0f0e-9cf9-439d-9cb8-6ea48a7701ea None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:43:56.304268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-86ae0f0e-9cf9-439d-9cb8-6ea48a7701ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:43:56.448763 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:43:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 16 20:43:56.624698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae429f-1a60-4b92-afa2-3b7e13e99790 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:43:56.705758 ncdv-master-1 devstack@keystone.service[98195]: INFO dbcounter [None req-bbae429f-1a60-4b92-afa2-3b7e13e99790 None None] Registered counter for database keystone Jul 16 20:43:56.726393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG oslo_db.sqlalchemy.engines [None req-bbae429f-1a60-4b92-afa2-3b7e13e99790 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98195) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 20:43:56.733279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writer thread running {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 20:43:56.866199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae429f-1a60-4b92-afa2-3b7e13e99790 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:43:56.870938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c22df-cf4f-4bc0-9c0a-5abdea393bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:43:56.871671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c22df-cf4f-4bc0-9c0a-5abdea393bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:43:56.871953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c22df-cf4f-4bc0-9c0a-5abdea393bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:43:56.872258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c22df-cf4f-4bc0-9c0a-5abdea393bd9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:43:56.882794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c22df-cf4f-4bc0-9c0a-5abdea393bd9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:43:56.938721 ncdv-master-1 devstack@keystone.service[98195]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5a0c22df-cf4f-4bc0-9c0a-5abdea393bd9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 16 20:43:56.939488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c22df-cf4f-4bc0-9c0a-5abdea393bd9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:43:56.949882 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Sat Jul 16 20:43:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 20:43:56.957198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae0f0e-9cf9-439d-9cb8-6ea48a7701ea None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:43:56.972950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae0f0e-9cf9-439d-9cb8-6ea48a7701ea None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:43:56.977487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881f062-3241-4fea-ad02-e64aaddf5fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:43:56.978620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881f062-3241-4fea-ad02-e64aaddf5fab admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:43:56.978906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881f062-3241-4fea-ad02-e64aaddf5fab admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:43:56.979213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881f062-3241-4fea-ad02-e64aaddf5fab admin admin] PATH_INFO: `/v3/projects/455f5961d0804544b3b78f843a889637` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:43:56.980883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881f062-3241-4fea-ad02-e64aaddf5fab admin admin] RBAC: Authorizing `identity:get_project(project_id=455f5961d0804544b3b78f843a889637)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:43:57.034775 ncdv-master-1 devstack@keystone.service[98196]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7881f062-3241-4fea-ad02-e64aaddf5fab admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 16 20:43:57.035152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881f062-3241-4fea-ad02-e64aaddf5fab admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:43:57.039981 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Sat Jul 16 20:43:56 2022] GET /identity/v3/projects/455f5961d0804544b3b78f843a889637 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:43:59.375862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62147d-8f88-4b21-8060-7ea8abcfb378 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:43:59.376481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62147d-8f88-4b21-8060-7ea8abcfb378 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:43:59.376481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62147d-8f88-4b21-8060-7ea8abcfb378 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:43:59.380735 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:43:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:43:59.390651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee5af1-2a21-44f5-b72a-39b1a4ddbd60 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:43:59.391197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee5af1-2a21-44f5-b72a-39b1a4ddbd60 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:43:59.391902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee5af1-2a21-44f5-b72a-39b1a4ddbd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:43:59.424495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-77ee5af1-2a21-44f5-b72a-39b1a4ddbd60 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:43:59.427191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-77ee5af1-2a21-44f5-b72a-39b1a4ddbd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:43:59.441192 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:43:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 16 20:43:59.483766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62147d-8f88-4b21-8060-7ea8abcfb378 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:43:59.496753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62147d-8f88-4b21-8060-7ea8abcfb378 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:43:59.501917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0098c-8bef-4d1d-9aa6-f9c48dc6e46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:43:59.502580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0098c-8bef-4d1d-9aa6-f9c48dc6e46a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:43:59.502869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0098c-8bef-4d1d-9aa6-f9c48dc6e46a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:43:59.503247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0098c-8bef-4d1d-9aa6-f9c48dc6e46a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:43:59.512217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0098c-8bef-4d1d-9aa6-f9c48dc6e46a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:43:59.514025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0098c-8bef-4d1d-9aa6-f9c48dc6e46a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:43:59.524737 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Sat Jul 16 20:43:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 20:43:59.530746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee5af1-2a21-44f5-b72a-39b1a4ddbd60 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:43:59.541185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee5af1-2a21-44f5-b72a-39b1a4ddbd60 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:43:59.546011 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f8a2f-edc2-4672-a631-330f428e22b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:43:59.547573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f8a2f-edc2-4672-a631-330f428e22b0 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:43:59.547858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f8a2f-edc2-4672-a631-330f428e22b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:43:59.548136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f8a2f-edc2-4672-a631-330f428e22b0 admin admin] PATH_INFO: `/v3/users/d6cd66b16dc14b84918d5f636a683873` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:43:59.549599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f8a2f-edc2-4672-a631-330f428e22b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=d6cd66b16dc14b84918d5f636a683873)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:43:59.551508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f8a2f-edc2-4672-a631-330f428e22b0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:43:59.553179 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Sat Jul 16 20:43:59 2022] GET /identity/v3/users/d6cd66b16dc14b84918d5f636a683873 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:01.960107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded276c4-080e-44a6-acda-6eef37567727 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:01.960854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded276c4-080e-44a6-acda-6eef37567727 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:01.960854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded276c4-080e-44a6-acda-6eef37567727 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:01.962038 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:01.969888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dd16c-4e34-4969-b116-7a70277b8ad4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:01.970403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dd16c-4e34-4969-b116-7a70277b8ad4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:01.970537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dd16c-4e34-4969-b116-7a70277b8ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:01.989342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-250dd16c-4e34-4969-b116-7a70277b8ad4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:01.990558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-250dd16c-4e34-4969-b116-7a70277b8ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:02.027047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b933eb-c2d9-4993-a703-053c458cff1e None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:02.027468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b933eb-c2d9-4993-a703-053c458cff1e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:02.027802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b933eb-c2d9-4993-a703-053c458cff1e None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:02.029816 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:44:02.036225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c0b36-c731-4644-8c56-1e02aa7fe769 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:02.036496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c0b36-c731-4644-8c56-1e02aa7fe769 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:02.036773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c0b36-c731-4644-8c56-1e02aa7fe769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:02.079424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG passlib.handlers.bcrypt [None req-e92c0b36-c731-4644-8c56-1e02aa7fe769 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=98195) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 16 20:44:02.079857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG passlib.handlers.bcrypt [None req-e92c0b36-c731-4644-8c56-1e02aa7fe769 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=98195) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 16 20:44:02.115325 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:02.127128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e92c0b36-c731-4644-8c56-1e02aa7fe769 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:02.128754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e92c0b36-c731-4644-8c56-1e02aa7fe769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:02.141746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dd16c-4e34-4969-b116-7a70277b8ad4 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:02.172056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:02.242956 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 16 20:44:02.268405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c0b36-c731-4644-8c56-1e02aa7fe769 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:02.399533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dd16c-4e34-4969-b116-7a70277b8ad4 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:02.404003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c0b36-c731-4644-8c56-1e02aa7fe769 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:02.408726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:02.457359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25949a5-068e-400c-a00b-fb061a04a3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:02.458462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25949a5-068e-400c-a00b-fb061a04a3ab None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:02.458749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25949a5-068e-400c-a00b-fb061a04a3ab None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:02.459056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25949a5-068e-400c-a00b-fb061a04a3ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:02.470808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e535e-9d87-4642-9bbb-9a335c7ef3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:02.472074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e535e-9d87-4642-9bbb-9a335c7ef3ae None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:02.472462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e535e-9d87-4642-9bbb-9a335c7ef3ae None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:02.472586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25949a5-068e-400c-a00b-fb061a04a3ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:02.472905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e535e-9d87-4642-9bbb-9a335c7ef3ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:02.483911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-a25949a5-068e-400c-a00b-fb061a04a3ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:44:02.483911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:02.483911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:02.483911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:02.483911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:02.483911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:02.483911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:02.483911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:02.483911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:02.483911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:02.483911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:02.483911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:02.483911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:02.483911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:02.483911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:02.483911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:02.485907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:02.485907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:02.485907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:02.485907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:02.485907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:02.485907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:02.485907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:02.485907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:02.485907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:02.485907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:02.485907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:02.485907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:02.485907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:02.485907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:02.485907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:02.485907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:02.487776 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:02.487776 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:02.487776 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:02.487776 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:02.487776 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:02.487776 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:02.487776 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:02.487776 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:02.487776 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:02.487776 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:02.487776 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:44:02.487776 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:02.487776 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:44:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:44:02.491383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25949a5-068e-400c-a00b-fb061a04a3ab None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:02.578488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e535e-9d87-4642-9bbb-9a335c7ef3ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:02.580165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e535e-9d87-4642-9bbb-9a335c7ef3ae None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:02.616845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:02.640855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25949a5-068e-400c-a00b-fb061a04a3ab None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:02.709487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923cedd-12f0-46e1-a98f-9491caebeb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:02.710405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923cedd-12f0-46e1-a98f-9491caebeb02 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:02.710863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923cedd-12f0-46e1-a98f-9491caebeb02 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:02.711301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923cedd-12f0-46e1-a98f-9491caebeb02 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:02.712662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923cedd-12f0-46e1-a98f-9491caebeb02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:02.716266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923cedd-12f0-46e1-a98f-9491caebeb02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:02.716266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923cedd-12f0-46e1-a98f-9491caebeb02 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:02.722556 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 8/15] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:44:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 16 20:44:02.731066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e535e-9d87-4642-9bbb-9a335c7ef3ae None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:02.734355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:02.736761 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 8/16] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:02.742677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923cedd-12f0-46e1-a98f-9491caebeb02 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:02.875632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e535e-9d87-4642-9bbb-9a335c7ef3ae None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:02.886051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923cedd-12f0-46e1-a98f-9491caebeb02 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:02.928737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf154fe-f692-44ca-882a-acae5998a3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:02.929343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea152d-d5ec-4762-8a57-b54f4d1c6967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:02.930144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf154fe-f692-44ca-882a-acae5998a3f1 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:02.930273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea152d-d5ec-4762-8a57-b54f4d1c6967 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:02.930642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf154fe-f692-44ca-882a-acae5998a3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:02.930801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea152d-d5ec-4762-8a57-b54f4d1c6967 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:02.931147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf154fe-f692-44ca-882a-acae5998a3f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:02.931538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea152d-d5ec-4762-8a57-b54f4d1c6967 None admin] PATH_INFO: `/v3/users/d6cd66b16dc14b84918d5f636a683873` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:02.933516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea152d-d5ec-4762-8a57-b54f4d1c6967 None admin] RBAC: Authorizing `identity:get_user(user_id=d6cd66b16dc14b84918d5f636a683873)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:02.936321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea152d-d5ec-4762-8a57-b54f4d1c6967 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:02.938679 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:02 2022] GET /identity/v3/users/d6cd66b16dc14b84918d5f636a683873 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:02.944711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea152d-d5ec-4762-8a57-b54f4d1c6967 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:02.962914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:02.969355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf154fe-f692-44ca-882a-acae5998a3f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:02.972283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf154fe-f692-44ca-882a-acae5998a3f1 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:03.002813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-5cf154fe-f692-44ca-882a-acae5998a3f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:44:03.002813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:03.002813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:03.002813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:03.002813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:03.002813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:03.002813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:03.002813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:03.002813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:03.002813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:03.002813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:03.002813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:03.002813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:44:03.002813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:44:03.002813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:44:03.004482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:44:03.004482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:03.004482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:03.004482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:03.004482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:03.004482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:03.004482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:03.004482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:03.004482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:03.004482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:03.004482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:03.004482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:03.004482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:03.004482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:03.004482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:03.004482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:03.004482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:03.006672 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:44:03.006672 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:44:03.006672 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:44:03.006672 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:44:03.006672 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:44:03.010598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf154fe-f692-44ca-882a-acae5998a3f1 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:03.077413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea152d-d5ec-4762-8a57-b54f4d1c6967 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:03.089451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:03.116972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02867c13-ef77-455b-93c3-ed68b787324a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:03.117776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02867c13-ef77-455b-93c3-ed68b787324a None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:03.118058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02867c13-ef77-455b-93c3-ed68b787324a None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:03.118334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02867c13-ef77-455b-93c3-ed68b787324a None admin] PATH_INFO: `/v3/domains/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:03.119685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02867c13-ef77-455b-93c3-ed68b787324a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:03.122158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02867c13-ef77-455b-93c3-ed68b787324a None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:03.123892 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:44:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:03.131887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02867c13-ef77-455b-93c3-ed68b787324a None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:03.143933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf154fe-f692-44ca-882a-acae5998a3f1 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:03.182525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4704a1c-5464-4245-823f-e46369e9e138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:03.183388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4704a1c-5464-4245-823f-e46369e9e138 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:03.183710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4704a1c-5464-4245-823f-e46369e9e138 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:03.183989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4704a1c-5464-4245-823f-e46369e9e138 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:03.185103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4704a1c-5464-4245-823f-e46369e9e138 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:03.185507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4704a1c-5464-4245-823f-e46369e9e138 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:03.188528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4704a1c-5464-4245-823f-e46369e9e138 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:03.242841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:03.270290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02867c13-ef77-455b-93c3-ed68b787324a None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:03.309951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad55161-abf2-44cc-9cff-62560da6513a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:03.310670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad55161-abf2-44cc-9cff-62560da6513a None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:03.310897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad55161-abf2-44cc-9cff-62560da6513a None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:03.311195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad55161-abf2-44cc-9cff-62560da6513a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:03.312042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad55161-abf2-44cc-9cff-62560da6513a None admin] RBAC: Adding query filter params (role.id=bd33b827674a4d4db30c164cab416056, scope.domain.id=default, user.id=d6cd66b16dc14b84918d5f636a683873) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:03.312402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad55161-abf2-44cc-9cff-62560da6513a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:03.314307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad55161-abf2-44cc-9cff-62560da6513a None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:03.321968 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Sat Jul 16 20:44:03 2022] GET /identity/v3/role_assignments?user.id=d6cd66b16dc14b84918d5f636a683873&scope.domain.id=default&role.id=bd33b827674a4d4db30c164cab416056 => generated 233 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:03.336887 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:06.352650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000a5e1-82b0-4be7-8399-f4a8da422724 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:06.353695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000a5e1-82b0-4be7-8399-f4a8da422724 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:06.354183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000a5e1-82b0-4be7-8399-f4a8da422724 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:06.355793 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:44:06.361702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4e23f-8342-4430-bdcf-1788f0a19414 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:06.362622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4e23f-8342-4430-bdcf-1788f0a19414 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:06.363143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4e23f-8342-4430-bdcf-1788f0a19414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:06.396336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-90d4e23f-8342-4430-bdcf-1788f0a19414 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:06.397907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-90d4e23f-8342-4430-bdcf-1788f0a19414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:06.490825 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 16 20:44:06.533741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000a5e1-82b0-4be7-8399-f4a8da422724 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:06.668753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000a5e1-82b0-4be7-8399-f4a8da422724 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:06.715124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077efea0-5f15-499f-868b-c3ac7452c72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:06.716277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077efea0-5f15-499f-868b-c3ac7452c72f None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:06.716758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077efea0-5f15-499f-868b-c3ac7452c72f None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:06.717278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077efea0-5f15-499f-868b-c3ac7452c72f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:06.734527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077efea0-5f15-499f-868b-c3ac7452c72f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:06.736496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077efea0-5f15-499f-868b-c3ac7452c72f None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:06.757681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:06.766052 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-077efea0-5f15-499f-868b-c3ac7452c72f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:44:06.766052 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:06.766052 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:06.766052 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:06.766052 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:06.766052 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:06.766052 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:06.766052 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:06.766052 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:06.766052 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:06.766052 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:06.766052 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:06.766052 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:44:06.766052 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:44:06.766052 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:44:06.767643 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:44:06.767643 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:06.767643 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:06.767643 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:06.767643 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:06.767643 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:06.767643 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:06.767643 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:06.767643 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:06.767643 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:06.767643 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:06.767643 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:06.767643 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:06.767643 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:06.767643 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:06.767643 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:06.767643 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:06.769178 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:44:06.769178 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:44:06.769178 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:44:06.769178 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:06.769178 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 13/24] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:44:06.778954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4e23f-8342-4430-bdcf-1788f0a19414 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:06.839412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:06.881975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e80b06-ce6f-4916-8f40-496bceef3d87 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:06.882384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e80b06-ce6f-4916-8f40-496bceef3d87 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:06.882604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e80b06-ce6f-4916-8f40-496bceef3d87 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:06.883946 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 14/25] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:44:06.896522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d83ee-4e14-4f54-9549-7ce8c4489b74 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:06.896879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d83ee-4e14-4f54-9549-7ce8c4489b74 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:06.897108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d83ee-4e14-4f54-9549-7ce8c4489b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:06.935600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7b9d83ee-4e14-4f54-9549-7ce8c4489b74 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:06.936731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7b9d83ee-4e14-4f54-9549-7ce8c4489b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:06.960813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4e23f-8342-4430-bdcf-1788f0a19414 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:07.065039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4254f6-e86e-4974-adf3-a7fc6fc7ed82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:07.065783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4254f6-e86e-4974-adf3-a7fc6fc7ed82 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:07.066076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4254f6-e86e-4974-adf3-a7fc6fc7ed82 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:07.066353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4254f6-e86e-4974-adf3-a7fc6fc7ed82 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:07.067123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4254f6-e86e-4974-adf3-a7fc6fc7ed82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:07.067436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4254f6-e86e-4974-adf3-a7fc6fc7ed82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:07.068854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4254f6-e86e-4974-adf3-a7fc6fc7ed82 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:07.109569 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 12/26] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:07.117984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4254f6-e86e-4974-adf3-a7fc6fc7ed82 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:07.118348 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 15/27] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:07.185184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d83ee-4e14-4f54-9549-7ce8c4489b74 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:07.363138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d83ee-4e14-4f54-9549-7ce8c4489b74 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:07.425659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:07.436766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a65e77-3526-45be-934b-b2c2cce7f95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:07.437489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4254f6-e86e-4974-adf3-a7fc6fc7ed82 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:07.438094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a65e77-3526-45be-934b-b2c2cce7f95e None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:07.438094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a65e77-3526-45be-934b-b2c2cce7f95e None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:07.438094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a65e77-3526-45be-934b-b2c2cce7f95e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:07.463484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a65e77-3526-45be-934b-b2c2cce7f95e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:07.467402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:07.475948 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-b2a65e77-3526-45be-934b-b2c2cce7f95e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:44:07.475948 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:07.475948 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:07.475948 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:07.475948 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:07.475948 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:07.475948 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:07.475948 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:07.475948 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:07.475948 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:07.475948 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:07.475948 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:07.475948 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:07.475948 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:07.475948 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:07.475948 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:07.476866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:07.476866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:07.476866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:07.476866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:07.476866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:07.476866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:07.476866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:07.476866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:07.476866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:07.476866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:07.476866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:07.476866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:07.476866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:07.476866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:07.476866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:07.476866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:07.477578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:07.477578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:07.477578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:07.477578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:07.477578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:07.477578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:07.477578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:07.477578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:07.477578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:07.477578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:07.477578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:44:07.477578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:07.478477 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 16/28] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:44:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:07.486211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a65e77-3526-45be-934b-b2c2cce7f95e None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:07.552922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8584285-59f6-4160-9ace-99aaf7eadce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:07.554037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8584285-59f6-4160-9ace-99aaf7eadce4 None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:07.554539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8584285-59f6-4160-9ace-99aaf7eadce4 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:07.555049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8584285-59f6-4160-9ace-99aaf7eadce4 None admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:07.556851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8584285-59f6-4160-9ace-99aaf7eadce4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:07.559516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8584285-59f6-4160-9ace-99aaf7eadce4 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:07.670297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a65e77-3526-45be-934b-b2c2cce7f95e None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:07.712737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a824a1-855e-435c-9144-3822167e62e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:07.713766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a824a1-855e-435c-9144-3822167e62e4 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:07.714250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a824a1-855e-435c-9144-3822167e62e4 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:07.714780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a824a1-855e-435c-9144-3822167e62e4 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:07.715820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a824a1-855e-435c-9144-3822167e62e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:07.716358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a824a1-855e-435c-9144-3822167e62e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:07.718824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a824a1-855e-435c-9144-3822167e62e4 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:07.729344 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 17/29] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:07.730963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0280a-a11d-4378-b881-95ab39cf5abe None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:07.731467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0280a-a11d-4378-b881-95ab39cf5abe None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:07.734982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0280a-a11d-4378-b881-95ab39cf5abe None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:07.734982 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 18/30] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:07.734982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e1e59-e0ad-4e17-8690-baa34f104008 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:07.735638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e1e59-e0ad-4e17-8690-baa34f104008 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:07.736130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e1e59-e0ad-4e17-8690-baa34f104008 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:07.737730 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 19/31] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:07.742860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e1e59-e0ad-4e17-8690-baa34f104008 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:07.809979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:07.845458 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 13/32] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Jul 16 20:44:07 2022] POST /identity/v3/projects => generated 301 bytes in 728 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 20:44:07.847388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15ab20-80b6-4e60-b682-9884c01d1c5e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:07.847894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15ab20-80b6-4e60-b682-9884c01d1c5e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:07.848411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15ab20-80b6-4e60-b682-9884c01d1c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:07.868242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0c15ab20-80b6-4e60-b682-9884c01d1c5e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:07.870180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0c15ab20-80b6-4e60-b682-9884c01d1c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:07.893045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e1e59-e0ad-4e17-8690-baa34f104008 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:07.967330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a06d1e-285c-44c7-918d-7881d4a2e2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:07.969777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a06d1e-285c-44c7-918d-7881d4a2e2e8 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:07.970635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a06d1e-285c-44c7-918d-7881d4a2e2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:07.971574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a06d1e-285c-44c7-918d-7881d4a2e2e8 None admin] PATH_INFO: `/v3/users/d6cd66b16dc14b84918d5f636a683873` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:07.976197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a06d1e-285c-44c7-918d-7881d4a2e2e8 None admin] RBAC: Authorizing `identity:get_user(user_id=d6cd66b16dc14b84918d5f636a683873)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:07.978159 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 14/33] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:07.979428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a06d1e-285c-44c7-918d-7881d4a2e2e8 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:07.979684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ad13d-30f9-4796-8ea9-ef42de294def None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:07.980028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ad13d-30f9-4796-8ea9-ef42de294def None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:07.980312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ad13d-30f9-4796-8ea9-ef42de294def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:07.985523 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 20/34] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:07 2022] GET /identity/v3/users/d6cd66b16dc14b84918d5f636a683873 => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:07.991962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a06d1e-285c-44c7-918d-7881d4a2e2e8 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:08.038443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c06ad13d-30f9-4796-8ea9-ef42de294def None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:08.041143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c06ad13d-30f9-4796-8ea9-ef42de294def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:08.146702 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 15/35] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:08.148621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ad13d-30f9-4796-8ea9-ef42de294def None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:08.178022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:08.214251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a06d1e-285c-44c7-918d-7881d4a2e2e8 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:08.237560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:08.260710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12deb1e9-f422-45ea-843c-2e37c3b01820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:08.261612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12deb1e9-f422-45ea-843c-2e37c3b01820 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:08.261898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12deb1e9-f422-45ea-843c-2e37c3b01820 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:08.262183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12deb1e9-f422-45ea-843c-2e37c3b01820 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:08.263481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12deb1e9-f422-45ea-843c-2e37c3b01820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:08.265483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12deb1e9-f422-45ea-843c-2e37c3b01820 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:08.267629 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 21/36] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:44:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:08.269096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e39fc-5fd1-44ec-bac3-b95e773272a0 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:08.269850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e39fc-5fd1-44ec-bac3-b95e773272a0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:08.270470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e39fc-5fd1-44ec-bac3-b95e773272a0 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:08.272510 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 22/37] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:08.273145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e39fc-5fd1-44ec-bac3-b95e773272a0 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:08.291753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ad13d-30f9-4796-8ea9-ef42de294def None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:08.332128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce74ac-97ba-4fe2-8e7e-19582df5886d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:08.333655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce74ac-97ba-4fe2-8e7e-19582df5886d None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:08.334152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce74ac-97ba-4fe2-8e7e-19582df5886d None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:08.334667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce74ac-97ba-4fe2-8e7e-19582df5886d None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:08.335472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce74ac-97ba-4fe2-8e7e-19582df5886d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:08.337532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce74ac-97ba-4fe2-8e7e-19582df5886d None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:08.390605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e39fc-5fd1-44ec-bac3-b95e773272a0 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:08.429371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34384e5e-5c49-4088-a4a8-ef8d849c6237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:08.430126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34384e5e-5c49-4088-a4a8-ef8d849c6237 None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:08.430417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34384e5e-5c49-4088-a4a8-ef8d849c6237 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:08.431577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34384e5e-5c49-4088-a4a8-ef8d849c6237 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:08.431577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34384e5e-5c49-4088-a4a8-ef8d849c6237 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:08.432992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34384e5e-5c49-4088-a4a8-ef8d849c6237 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:08.451140 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 16/38] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Jul 16 20:44:08 2022] POST /identity/v3/roles => generated 219 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:44:08.454884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b7a07-188a-4a19-aaad-ba9a4d53ae92 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:08.455440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b7a07-188a-4a19-aaad-ba9a4d53ae92 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:08.455992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b7a07-188a-4a19-aaad-ba9a4d53ae92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:08.486826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0e6b7a07-188a-4a19-aaad-ba9a4d53ae92 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:08.489178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0e6b7a07-188a-4a19-aaad-ba9a4d53ae92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:08.611706 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 17/39] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:08.612691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b7a07-188a-4a19-aaad-ba9a4d53ae92 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:08.625361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:08.707448 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 23/40] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Jul 16 20:44:08 2022] POST /identity/v3/roles => generated 225 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:44:08.707448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34384e5e-5c49-4088-a4a8-ef8d849c6237 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:08.750601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b7a07-188a-4a19-aaad-ba9a4d53ae92 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:08.780817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:08.807347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507adf56-aade-426a-a3cf-d4abe9207292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:08.808689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507adf56-aade-426a-a3cf-d4abe9207292 None admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:08.809248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507adf56-aade-426a-a3cf-d4abe9207292 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:08.809930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507adf56-aade-426a-a3cf-d4abe9207292 None admin] PATH_INFO: `/v3/domains/default/users/d6cd66b16dc14b84918d5f636a683873/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:08.816025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507adf56-aade-426a-a3cf-d4abe9207292 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d6cd66b16dc14b84918d5f636a683873, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:08.817814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507adf56-aade-426a-a3cf-d4abe9207292 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:08.860280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34384e5e-5c49-4088-a4a8-ef8d849c6237 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:08.904185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1c456-872d-418f-ab20-b35e6ee1c17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:08.905035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1c456-872d-418f-ab20-b35e6ee1c17b None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:08.905349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1c456-872d-418f-ab20-b35e6ee1c17b None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:08.906227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1c456-872d-418f-ab20-b35e6ee1c17b None admin] PATH_INFO: `/v3/domains/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:08.907640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1c456-872d-418f-ab20-b35e6ee1c17b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:08.909284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1c456-872d-418f-ab20-b35e6ee1c17b None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:08.911119 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 24/41] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:44:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:08.912514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d20ee0-ef23-4e00-97a5-53f065f28131 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:08.912809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d20ee0-ef23-4e00-97a5-53f065f28131 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:08.913083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d20ee0-ef23-4e00-97a5-53f065f28131 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:08.914592 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 25/42] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:08.917366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d20ee0-ef23-4e00-97a5-53f065f28131 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:08.938791 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 18/43] 10.222.0.16 () {58 vars in 1361 bytes} [Sat Jul 16 20:44:08 2022] PUT /identity/v3/domains/default/users/d6cd66b16dc14b84918d5f636a683873/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:44:08.940587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690847e-4a4c-4a0f-bf71-309d76757f81 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:08.941109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690847e-4a4c-4a0f-bf71-309d76757f81 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:08.941631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690847e-4a4c-4a0f-bf71-309d76757f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:08.961256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a690847e-4a4c-4a0f-bf71-309d76757f81 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:08.962263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a690847e-4a4c-4a0f-bf71-309d76757f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:09.059880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:09.070669 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 19/44] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:09.079284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d20ee0-ef23-4e00-97a5-53f065f28131 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:09.096872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690847e-4a4c-4a0f-bf71-309d76757f81 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:09.098363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:09.126508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ecefa-2753-459b-990b-0ce043ef012a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:09.127830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ecefa-2753-459b-990b-0ce043ef012a None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:09.128456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ecefa-2753-459b-990b-0ce043ef012a None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:09.128853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ecefa-2753-459b-990b-0ce043ef012a None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:09.129974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ecefa-2753-459b-990b-0ce043ef012a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:09.132241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ecefa-2753-459b-990b-0ce043ef012a None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:09.215773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690847e-4a4c-4a0f-bf71-309d76757f81 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:09.238150 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 26/45] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Jul 16 20:44:08 2022] POST /identity/v3/projects => generated 312 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 20:44:09.263426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a132df9-afe4-4f91-a829-46a9f4ca92aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:09.264551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a132df9-afe4-4f91-a829-46a9f4ca92aa None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:09.264997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a132df9-afe4-4f91-a829-46a9f4ca92aa None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:09.265278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a132df9-afe4-4f91-a829-46a9f4ca92aa None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:09.266336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a132df9-afe4-4f91-a829-46a9f4ca92aa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:09.267842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a132df9-afe4-4f91-a829-46a9f4ca92aa None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:09.352288 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 20/46] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Jul 16 20:44:09 2022] POST /identity/v3/roles => generated 223 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 20:44:11.266148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b992d-f3f6-4ade-853b-01d2cb4629e0 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:11.266648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b992d-f3f6-4ade-853b-01d2cb4629e0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:11.266747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b992d-f3f6-4ade-853b-01d2cb4629e0 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:11.268199 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 27/47] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:11.273795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab0dcb-0b49-4e3b-9cd6-4d1d0fba37df None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:11.274255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab0dcb-0b49-4e3b-9cd6-4d1d0fba37df None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:11.274436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab0dcb-0b49-4e3b-9cd6-4d1d0fba37df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:11.292299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-59ab0dcb-0b49-4e3b-9cd6-4d1d0fba37df None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:11.293594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-59ab0dcb-0b49-4e3b-9cd6-4d1d0fba37df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:11.354149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:11.367796 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 21/48] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 16 20:44:11.393199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b992d-f3f6-4ade-853b-01d2cb4629e0 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:11.512551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b992d-f3f6-4ade-853b-01d2cb4629e0 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:11.553685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdeee5e-b4cd-40e5-8261-78eed6bb58dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:11.554514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeee5e-b4cd-40e5-8261-78eed6bb58dd None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:11.554799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeee5e-b4cd-40e5-8261-78eed6bb58dd None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:11.555110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeee5e-b4cd-40e5-8261-78eed6bb58dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:11.567846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdeee5e-b4cd-40e5-8261-78eed6bb58dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:11.575528 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-ecdeee5e-b4cd-40e5-8261-78eed6bb58dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:44:11.575528 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:11.575528 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:11.575528 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:11.575528 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:11.575528 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:11.575528 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:11.575528 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:11.575528 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:11.575528 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:11.575528 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:11.575528 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:11.575528 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:11.575528 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:11.575528 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:11.575528 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:11.576440 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:11.576440 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:11.576440 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:11.576440 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:11.576440 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:11.576440 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:11.576440 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:11.576440 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:11.576440 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:11.576440 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:11.576440 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:11.576440 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:11.576440 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:11.576440 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:11.576440 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:11.576440 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:11.577168 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:11.577168 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:11.577168 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:11.577168 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:11.577168 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:11.577168 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:11.577168 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:11.577168 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:11.577168 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:11.577168 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:11.577168 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:44:11.577168 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:11.577168 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 28/49] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:44:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:11.584148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdeee5e-b4cd-40e5-8261-78eed6bb58dd None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:11.584318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38142f4-e00e-44ec-b8b1-098b53c38abb None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:11.584318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38142f4-e00e-44ec-b8b1-098b53c38abb None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:11.584318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38142f4-e00e-44ec-b8b1-098b53c38abb None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:11.586809 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 22/50] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:11.591190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafc4bb-c407-4e5e-8ef0-177031406556 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:11.591482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafc4bb-c407-4e5e-8ef0-177031406556 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:11.591769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafc4bb-c407-4e5e-8ef0-177031406556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:11.610144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-fdafc4bb-c407-4e5e-8ef0-177031406556 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:11.611558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fdafc4bb-c407-4e5e-8ef0-177031406556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:11.614164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:11.684302 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 23/51] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 16 20:44:11.709960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdeee5e-b4cd-40e5-8261-78eed6bb58dd None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:11.710399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafc4bb-c407-4e5e-8ef0-177031406556 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:11.747967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d62d27-6ac7-4495-9ca0-5f85e06aadda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:11.748645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d62d27-6ac7-4495-9ca0-5f85e06aadda None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:11.748931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d62d27-6ac7-4495-9ca0-5f85e06aadda None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:11.749262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d62d27-6ac7-4495-9ca0-5f85e06aadda None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:11.750088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d62d27-6ac7-4495-9ca0-5f85e06aadda None admin] RBAC: Adding query filter params (name=admin) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:11.750399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d62d27-6ac7-4495-9ca0-5f85e06aadda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:11.751995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d62d27-6ac7-4495-9ca0-5f85e06aadda None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:11.761231 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 29/52] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:11.767595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d62d27-6ac7-4495-9ca0-5f85e06aadda None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:11.831871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafc4bb-c407-4e5e-8ef0-177031406556 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:11.850588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:11.869071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9dddd-504d-4d81-927d-7921141acdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:11.869888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9dddd-504d-4d81-927d-7921141acdff None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:11.870176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9dddd-504d-4d81-927d-7921141acdff None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:11.870485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9dddd-504d-4d81-927d-7921141acdff None admin] PATH_INFO: `/v3/domains/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:11.871744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9dddd-504d-4d81-927d-7921141acdff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:11.873226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9dddd-504d-4d81-927d-7921141acdff None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:11.874934 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 24/53] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:44:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:11.877363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:11.882994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9dddd-504d-4d81-927d-7921141acdff None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:11.893735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d62d27-6ac7-4495-9ca0-5f85e06aadda None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:11.933763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517624b-78f2-40de-b11e-6e637355a8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:11.934920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517624b-78f2-40de-b11e-6e637355a8fa None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:11.935415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517624b-78f2-40de-b11e-6e637355a8fa None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:11.935545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517624b-78f2-40de-b11e-6e637355a8fa None admin] PATH_INFO: `/v3/users/d6cd66b16dc14b84918d5f636a683873` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:11.936870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517624b-78f2-40de-b11e-6e637355a8fa None admin] RBAC: Authorizing `identity:get_user(user_id=d6cd66b16dc14b84918d5f636a683873)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:11.938357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517624b-78f2-40de-b11e-6e637355a8fa None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:11.940078 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 30/54] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:11 2022] GET /identity/v3/users/d6cd66b16dc14b84918d5f636a683873 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:11.945770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517624b-78f2-40de-b11e-6e637355a8fa None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:12.013443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9dddd-504d-4d81-927d-7921141acdff None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:12.057399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13d29f-2c01-4582-ab84-0de8b0048aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:12.058085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13d29f-2c01-4582-ab84-0de8b0048aec None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:12.058365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13d29f-2c01-4582-ab84-0de8b0048aec None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:12.058646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13d29f-2c01-4582-ab84-0de8b0048aec None admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:12.059433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13d29f-2c01-4582-ab84-0de8b0048aec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:12.061256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13d29f-2c01-4582-ab84-0de8b0048aec None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:12.068851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517624b-78f2-40de-b11e-6e637355a8fa None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:12.111268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea0936-66dd-4de2-984f-a95e67403e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:12.112217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea0936-66dd-4de2-984f-a95e67403e8b None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:12.112499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea0936-66dd-4de2-984f-a95e67403e8b None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:12.112821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea0936-66dd-4de2-984f-a95e67403e8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:12.114202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea0936-66dd-4de2-984f-a95e67403e8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:12.115761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea0936-66dd-4de2-984f-a95e67403e8b None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:12.117526 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 31/55] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:44:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:12.123845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea0936-66dd-4de2-984f-a95e67403e8b None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:12.152450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:12.186280 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 25/56] 10.222.0.16 () {60 vars in 1140 bytes} [Sat Jul 16 20:44:11 2022] POST /identity/v3/projects => generated 298 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 20:44:12.242903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea0936-66dd-4de2-984f-a95e67403e8b None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:12.292634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cef6a-9a78-4800-9379-abfcde27c114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:12.293351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cef6a-9a78-4800-9379-abfcde27c114 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:12.293598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cef6a-9a78-4800-9379-abfcde27c114 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:12.293875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cef6a-9a78-4800-9379-abfcde27c114 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:12.294756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343cef6a-9a78-4800-9379-abfcde27c114 None admin] RBAC: Adding query filter params (role.id=bd33b827674a4d4db30c164cab416056, scope.domain.id=default, user.id=d6cd66b16dc14b84918d5f636a683873) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:12.295108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343cef6a-9a78-4800-9379-abfcde27c114 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:12.296714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343cef6a-9a78-4800-9379-abfcde27c114 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:12.303532 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 32/57] 10.222.0.16 () {56 vars in 1322 bytes} [Sat Jul 16 20:44:12 2022] GET /identity/v3/role_assignments?user.id=d6cd66b16dc14b84918d5f636a683873&scope.domain.id=default&role.id=bd33b827674a4d4db30c164cab416056 => generated 530 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:14.501841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87f8c7-489a-4b08-9277-2f1e1cba7777 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:14.502432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87f8c7-489a-4b08-9277-2f1e1cba7777 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:14.502432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87f8c7-489a-4b08-9277-2f1e1cba7777 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:14.503820 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 26/58] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:14.509234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb86e8c-f8b9-43e3-881b-76096afc8a42 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:14.509686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb86e8c-f8b9-43e3-881b-76096afc8a42 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:14.509843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb86e8c-f8b9-43e3-881b-76096afc8a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:14.527466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6eb86e8c-f8b9-43e3-881b-76096afc8a42 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:14.529018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6eb86e8c-f8b9-43e3-881b-76096afc8a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:14.599674 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 33/59] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:14.626270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87f8c7-489a-4b08-9277-2f1e1cba7777 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:14.668542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:14.733131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87f8c7-489a-4b08-9277-2f1e1cba7777 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:14.769939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b80dda-6aae-4f2a-b433-d44aad5dff73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:14.770665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b80dda-6aae-4f2a-b433-d44aad5dff73 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:14.770951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b80dda-6aae-4f2a-b433-d44aad5dff73 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:14.771271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b80dda-6aae-4f2a-b433-d44aad5dff73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:14.772534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b80dda-6aae-4f2a-b433-d44aad5dff73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:14.774078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b80dda-6aae-4f2a-b433-d44aad5dff73 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:14.775868 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 27/60] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:44:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:14.781629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb86e8c-f8b9-43e3-881b-76096afc8a42 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:14.799769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:14.888539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb86e8c-f8b9-43e3-881b-76096afc8a42 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:14.926007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b6bc9-a56e-494b-ba90-a93b506d21e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:14.926686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b6bc9-a56e-494b-ba90-a93b506d21e6 None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:14.926975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b6bc9-a56e-494b-ba90-a93b506d21e6 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:14.927288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b6bc9-a56e-494b-ba90-a93b506d21e6 None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:14.928044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b6bc9-a56e-494b-ba90-a93b506d21e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:14.929508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b6bc9-a56e-494b-ba90-a93b506d21e6 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:15.093207 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 34/61] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Jul 16 20:44:14 2022] POST /identity/v3/users => generated 275 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:44:18.565557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9bd31-acc8-4ff5-b2b0-7d223723c48a None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:18.566140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9bd31-acc8-4ff5-b2b0-7d223723c48a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:18.566222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9bd31-acc8-4ff5-b2b0-7d223723c48a None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:18.567966 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 28/62] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:18.574154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18b82f-e302-4256-b6e8-ae0eec6f088b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:18.575223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18b82f-e302-4256-b6e8-ae0eec6f088b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:18.575718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18b82f-e302-4256-b6e8-ae0eec6f088b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:18.600383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ad18b82f-e302-4256-b6e8-ae0eec6f088b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:18.601979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ad18b82f-e302-4256-b6e8-ae0eec6f088b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:18.615270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d5c81-3fb4-4a26-9ecf-5a1ef5f2983a None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:18.615588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d5c81-3fb4-4a26-9ecf-5a1ef5f2983a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:18.615849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d5c81-3fb4-4a26-9ecf-5a1ef5f2983a None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:18.617264 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 29/63] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:44:18.630575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b6c2c-d7ad-45d5-89f3-d6e813cfa39b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:18.634133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b6c2c-d7ad-45d5-89f3-d6e813cfa39b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:18.634672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b6c2c-d7ad-45d5-89f3-d6e813cfa39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:18.666299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a94b6c2c-d7ad-45d5-89f3-d6e813cfa39b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:18.669327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a94b6c2c-d7ad-45d5-89f3-d6e813cfa39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:18.728579 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 35/64] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:18.762945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18b82f-e302-4256-b6e8-ae0eec6f088b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:18.767414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:18.820264 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 30/65] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 16 20:44:18.868777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b6c2c-d7ad-45d5-89f3-d6e813cfa39b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:18.933276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18b82f-e302-4256-b6e8-ae0eec6f088b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:18.977878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48ab29-856a-4d2f-8324-ef737c2293a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:18.979211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48ab29-856a-4d2f-8324-ef737c2293a9 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:18.979513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48ab29-856a-4d2f-8324-ef737c2293a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:18.979796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48ab29-856a-4d2f-8324-ef737c2293a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:18.985136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:18.994462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48ab29-856a-4d2f-8324-ef737c2293a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:19.004600 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-ef48ab29-856a-4d2f-8324-ef737c2293a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:19.004600 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:19.004600 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:19.004600 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:19.004600 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:19.004600 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:19.004600 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:19.004600 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:19.004600 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:19.004600 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:19.004600 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:19.004600 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:19.004600 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:19.004600 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:19.004600 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:19.004600 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:19.005525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:19.005525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:19.005525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:19.005525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:19.005525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:19.005525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:19.005525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:19.005525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:19.005525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:19.005525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:19.005525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:19.005525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:19.005525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:19.005525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:19.005525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:19.005525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:19.006280 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:19.006280 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:19.006280 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:19.006280 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:19.006280 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:19.006280 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:19.006280 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:19.006280 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:19.006280 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:19.006280 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:19.006280 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:19.006280 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:19.007457 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 36/66] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:44:19.011157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ccdda-a22a-4088-bb7b-f9dd4366939a None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:19.011528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ccdda-a22a-4088-bb7b-f9dd4366939a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:19.011805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ccdda-a22a-4088-bb7b-f9dd4366939a None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:19.019184 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 37/67] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:19 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:19.020164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ccdda-a22a-4088-bb7b-f9dd4366939a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:19.056853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b6c2c-d7ad-45d5-89f3-d6e813cfa39b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:19.099519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9f063-3e38-4208-8adc-32b5c80bb639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:19.100249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9f063-3e38-4208-8adc-32b5c80bb639 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:19.100536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9f063-3e38-4208-8adc-32b5c80bb639 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:19.100914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9f063-3e38-4208-8adc-32b5c80bb639 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:19.104401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:19.121334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9f063-3e38-4208-8adc-32b5c80bb639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:19.134240 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-bca9f063-3e38-4208-8adc-32b5c80bb639 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:44:19.134240 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:19.134240 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:19.134240 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:19.134240 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:19.134240 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:19.134240 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:19.134240 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:19.134240 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:19.134240 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:19.134240 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:19.134240 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:19.134240 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:19.134240 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:19.134240 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:19.134240 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:19.135181 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:19.135181 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:19.135181 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:19.135181 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:19.135181 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:19.135181 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:19.135181 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:19.135181 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:19.135181 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:19.135181 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:19.135181 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:19.135181 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:19.135181 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:19.135181 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:19.135181 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:19.135181 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:19.135910 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:19.135910 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:19.135910 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:19.135910 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:19.135910 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:19.135910 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:19.135910 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:19.135910 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:19.135910 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:19.135910 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:19.135910 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:44:19.135910 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:44:19.138637 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 31/68] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:44:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:44:19.145556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44761ba1-b0bb-447f-9ca9-d613589567a2 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:19.146617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44761ba1-b0bb-447f-9ca9-d613589567a2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:19.146904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44761ba1-b0bb-447f-9ca9-d613589567a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:19.159570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ccdda-a22a-4088-bb7b-f9dd4366939a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:19.171395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-44761ba1-b0bb-447f-9ca9-d613589567a2 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:19.172808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-44761ba1-b0bb-447f-9ca9-d613589567a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:19.204146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eeab71-870a-4aac-8b22-ba648f76b165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:19.205332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeab71-870a-4aac-8b22-ba648f76b165 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:19.206215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeab71-870a-4aac-8b22-ba648f76b165 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:19.206968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeab71-870a-4aac-8b22-ba648f76b165 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:19.208122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eeab71-870a-4aac-8b22-ba648f76b165 None admin] RBAC: Adding query filter params (name=member) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:19.208631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eeab71-870a-4aac-8b22-ba648f76b165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:19.211034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eeab71-870a-4aac-8b22-ba648f76b165 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:19.223738 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 38/69] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:44:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:19.228755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eeab71-870a-4aac-8b22-ba648f76b165 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:19.272897 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 32/70] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:19.273698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44761ba1-b0bb-447f-9ca9-d613589567a2 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:19.307607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:19.377121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eeab71-870a-4aac-8b22-ba648f76b165 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:19.409670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44761ba1-b0bb-447f-9ca9-d613589567a2 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:19.413846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:19.429592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83329e5b-66be-4dd1-977e-a17f04929165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:19.430647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83329e5b-66be-4dd1-977e-a17f04929165 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:19.431179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83329e5b-66be-4dd1-977e-a17f04929165 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:19.432192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83329e5b-66be-4dd1-977e-a17f04929165 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:19.433433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83329e5b-66be-4dd1-977e-a17f04929165 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:19.434009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83329e5b-66be-4dd1-977e-a17f04929165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:19.437399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83329e5b-66be-4dd1-977e-a17f04929165 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:19.447372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee47e24-5175-4626-9f21-25b0ee7ae83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:19.448259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee47e24-5175-4626-9f21-25b0ee7ae83b None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:19.448540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee47e24-5175-4626-9f21-25b0ee7ae83b None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:19.448818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee47e24-5175-4626-9f21-25b0ee7ae83b None admin] PATH_INFO: `/v3/users/1bde7f2d8d764aa8a711e0cf7801a350` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:19.451111 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 39/71] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:19.453733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83329e5b-66be-4dd1-977e-a17f04929165 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:19.465791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee47e24-5175-4626-9f21-25b0ee7ae83b None admin] RBAC: Authorizing `identity:get_user(user_id=1bde7f2d8d764aa8a711e0cf7801a350)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:19.467297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee47e24-5175-4626-9f21-25b0ee7ae83b None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:19.469226 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 33/72] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:19 2022] GET /identity/v3/users/1bde7f2d8d764aa8a711e0cf7801a350 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:19.470599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44d4bf-95a6-4c3b-a74b-212fdc8fe2e6 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:19.470964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44d4bf-95a6-4c3b-a74b-212fdc8fe2e6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:19.471240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44d4bf-95a6-4c3b-a74b-212fdc8fe2e6 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:19.475137 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 34/73] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:19.475137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44d4bf-95a6-4c3b-a74b-212fdc8fe2e6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:19.569457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:19.581877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83329e5b-66be-4dd1-977e-a17f04929165 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:19.587451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44d4bf-95a6-4c3b-a74b-212fdc8fe2e6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:19.617090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043195a-b8a6-467b-b3a8-a6353895ab03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:19.617930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043195a-b8a6-467b-b3a8-a6353895ab03 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:19.618171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043195a-b8a6-467b-b3a8-a6353895ab03 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:19.618446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043195a-b8a6-467b-b3a8-a6353895ab03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:19.624893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72bcc6-e510-4eab-be1d-fe5165ca89b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:19.625767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72bcc6-e510-4eab-be1d-fe5165ca89b9 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:19.626133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72bcc6-e510-4eab-be1d-fe5165ca89b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:19.626417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72bcc6-e510-4eab-be1d-fe5165ca89b9 None admin] PATH_INFO: `/v3/users/d6cd66b16dc14b84918d5f636a683873` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:19.628041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72bcc6-e510-4eab-be1d-fe5165ca89b9 None admin] RBAC: Authorizing `identity:get_user(user_id=d6cd66b16dc14b84918d5f636a683873)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:19.629527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72bcc6-e510-4eab-be1d-fe5165ca89b9 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:19.629992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043195a-b8a6-467b-b3a8-a6353895ab03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:19.631248 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 35/74] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:19 2022] GET /identity/v3/users/d6cd66b16dc14b84918d5f636a683873 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:19.632122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72bcc6-e510-4eab-be1d-fe5165ca89b9 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:19.638645 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-4043195a-b8a6-467b-b3a8-a6353895ab03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:44:19.638645 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:19.638645 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:19.638645 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:19.638645 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:19.638645 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:19.638645 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:19.638645 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:19.638645 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:19.638645 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:19.638645 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:19.638645 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:19.638645 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:19.638645 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:19.638645 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:19.638645 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:19.647112 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:19.647112 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:19.647112 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:19.647112 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:19.647112 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:19.647112 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:19.647112 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:19.647112 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:19.647112 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:19.647112 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:19.647112 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:19.647112 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:19.647112 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:19.647112 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:19.647112 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:19.647112 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:19.647921 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:19.647921 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:19.647921 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:19.647921 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:19.647921 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:19.647921 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:19.647921 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:19.647921 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:19.647921 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:19.647921 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:19.647921 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:44:19.647921 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:19.647921 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 40/75] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Jul 16 20:44:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:19.647921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c4925-50df-4803-a2f7-2d93b6dfcc12 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:19.648624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c4925-50df-4803-a2f7-2d93b6dfcc12 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:19.648624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c4925-50df-4803-a2f7-2d93b6dfcc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:19.661511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-452c4925-50df-4803-a2f7-2d93b6dfcc12 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:19.662730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-452c4925-50df-4803-a2f7-2d93b6dfcc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:19.710759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:19.736344 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 41/76] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:19.737860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaa634-9180-4b85-a90e-fa66234afd00 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:19.738163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaa634-9180-4b85-a90e-fa66234afd00 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:19.738445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaa634-9180-4b85-a90e-fa66234afd00 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:19.739807 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 42/77] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:19.740513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adaa634-9180-4b85-a90e-fa66234afd00 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:19.761897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72bcc6-e510-4eab-be1d-fe5165ca89b9 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:19.798301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d4476-7494-4ea6-baa2-3da60a3a3382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:19.798954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d4476-7494-4ea6-baa2-3da60a3a3382 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:19.799273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d4476-7494-4ea6-baa2-3da60a3a3382 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:19.799558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d4476-7494-4ea6-baa2-3da60a3a3382 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:19.822195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:19.847338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adaa634-9180-4b85-a90e-fa66234afd00 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:19.869944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d4476-7494-4ea6-baa2-3da60a3a3382 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:19.871442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d4476-7494-4ea6-baa2-3da60a3a3382 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:19.887319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724b134-3fea-446c-98cb-bfac504243d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:19.888190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724b134-3fea-446c-98cb-bfac504243d5 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:19.888645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724b134-3fea-446c-98cb-bfac504243d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:19.889092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724b134-3fea-446c-98cb-bfac504243d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:19.937011 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:19.959522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724b134-3fea-446c-98cb-bfac504243d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:19.960998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724b134-3fea-446c-98cb-bfac504243d5 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:19.978528 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 36/78] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:44:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:44:19.979759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d4476-7494-4ea6-baa2-3da60a3a3382 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:20.032215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:20.060411 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 43/79] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:44:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:44:20.062226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454794f-780e-40d5-8f9c-c4e8ff0a800e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:20.062510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454794f-780e-40d5-8f9c-c4e8ff0a800e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:20.062789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454794f-780e-40d5-8f9c-c4e8ff0a800e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:20.079470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5454794f-780e-40d5-8f9c-c4e8ff0a800e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:20.080675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5454794f-780e-40d5-8f9c-c4e8ff0a800e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:20.081076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d4476-7494-4ea6-baa2-3da60a3a3382 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:20.114504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f271202-186e-4983-8b8f-1cdeeb9521cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:20.115210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f271202-186e-4983-8b8f-1cdeeb9521cc None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:20.115503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f271202-186e-4983-8b8f-1cdeeb9521cc None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:20.115788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f271202-186e-4983-8b8f-1cdeeb9521cc None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:20.116540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f271202-186e-4983-8b8f-1cdeeb9521cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:20.116860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f271202-186e-4983-8b8f-1cdeeb9521cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:20.118259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f271202-186e-4983-8b8f-1cdeeb9521cc None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:20.130917 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 37/80] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:44:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:20.131810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f271202-186e-4983-8b8f-1cdeeb9521cc None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:20.151215 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 44/81] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:20.151983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454794f-780e-40d5-8f9c-c4e8ff0a800e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:20.160820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:20.253704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f271202-186e-4983-8b8f-1cdeeb9521cc None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:20.260552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454794f-780e-40d5-8f9c-c4e8ff0a800e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:20.268269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:20.289098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb87f7-e45d-439f-841c-ca54613b4a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:20.289896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb87f7-e45d-439f-841c-ca54613b4a90 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:20.290183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb87f7-e45d-439f-841c-ca54613b4a90 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:20.290457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb87f7-e45d-439f-841c-ca54613b4a90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:20.291669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb87f7-e45d-439f-841c-ca54613b4a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:20.293132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb87f7-e45d-439f-841c-ca54613b4a90 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:20.294831 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 38/82] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:44:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:20.295631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb87f7-e45d-439f-841c-ca54613b4a90 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:20.306505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c1939-7a06-4aad-9e30-568ca4e8f0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:20.307413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c1939-7a06-4aad-9e30-568ca4e8f0fd None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:20.307701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c1939-7a06-4aad-9e30-568ca4e8f0fd None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:20.307976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c1939-7a06-4aad-9e30-568ca4e8f0fd None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:20.309174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c1939-7a06-4aad-9e30-568ca4e8f0fd None admin] RBAC: Authorizing `identity:get_project(project_id=2ab6547ffe6648bd8a4ac2a99e702240)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:20.310886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c1939-7a06-4aad-9e30-568ca4e8f0fd None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:20.312866 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 45/83] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:20 2022] GET /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:20.313545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c1939-7a06-4aad-9e30-568ca4e8f0fd None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:20.390277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:20.399830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb87f7-e45d-439f-841c-ca54613b4a90 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:20.416811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c1939-7a06-4aad-9e30-568ca4e8f0fd None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:20.435148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d564d32-2afc-4f6b-a56d-8b6a3bfa9945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:20.435918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d564d32-2afc-4f6b-a56d-8b6a3bfa9945 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:20.436198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d564d32-2afc-4f6b-a56d-8b6a3bfa9945 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:20.436579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d564d32-2afc-4f6b-a56d-8b6a3bfa9945 None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:20.437977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d564d32-2afc-4f6b-a56d-8b6a3bfa9945 None admin] RBAC: Authorizing `identity:get_project(project_id=2ab6547ffe6648bd8a4ac2a99e702240)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:20.439472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d564d32-2afc-4f6b-a56d-8b6a3bfa9945 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:20.441206 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 39/84] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:20 2022] GET /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:20.441985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d564d32-2afc-4f6b-a56d-8b6a3bfa9945 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:20.453055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d333196-4acb-4ca8-bae0-b24a22e341a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:20.453923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d333196-4acb-4ca8-bae0-b24a22e341a8 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:20.454209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d333196-4acb-4ca8-bae0-b24a22e341a8 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:20.454486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d333196-4acb-4ca8-bae0-b24a22e341a8 None admin] PATH_INFO: `/v3/users/1bde7f2d8d764aa8a711e0cf7801a350` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:20.455740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d333196-4acb-4ca8-bae0-b24a22e341a8 None admin] RBAC: Authorizing `identity:get_user(user_id=1bde7f2d8d764aa8a711e0cf7801a350)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:20.457211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d333196-4acb-4ca8-bae0-b24a22e341a8 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:20.458886 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 46/85] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:20 2022] GET /identity/v3/users/1bde7f2d8d764aa8a711e0cf7801a350 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:20.463653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d333196-4acb-4ca8-bae0-b24a22e341a8 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:20.501038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:20.553311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d564d32-2afc-4f6b-a56d-8b6a3bfa9945 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:20.564700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d333196-4acb-4ca8-bae0-b24a22e341a8 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:20.588385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266092b-396c-4188-86bb-7eb6d5fa3f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:20.589191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266092b-396c-4188-86bb-7eb6d5fa3f78 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:20.589480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266092b-396c-4188-86bb-7eb6d5fa3f78 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:20.589760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266092b-396c-4188-86bb-7eb6d5fa3f78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:20.600452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f09b81-c1ad-432b-b782-d03f814a4b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:20.601150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f09b81-c1ad-432b-b782-d03f814a4b32 None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:20.601430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266092b-396c-4188-86bb-7eb6d5fa3f78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:20.601540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f09b81-c1ad-432b-b782-d03f814a4b32 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:20.601707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f09b81-c1ad-432b-b782-d03f814a4b32 None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:20.602443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f09b81-c1ad-432b-b782-d03f814a4b32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:20.604031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f09b81-c1ad-432b-b782-d03f814a4b32 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:20.609748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-e266092b-396c-4188-86bb-7eb6d5fa3f78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:20.609748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:20.609748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:20.609748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:20.609748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:20.609748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:20.609748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:20.609748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:20.609748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:20.609748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:20.609748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:20.609748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:20.609748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:20.609748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:20.609748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:20.609748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:20.610885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:20.610885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:20.610885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:20.610885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:20.610885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:20.610885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:20.610885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:20.610885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:20.610885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:20.610885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:20.610885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:20.610885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:20.610885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:20.610885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:20.610885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:20.610885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:20.612485 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:20.612485 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:20.612485 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:20.612485 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:20.612485 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:20.612485 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:20.612485 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:20.612485 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:20.612485 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:20.612485 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:20.612485 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:20.612485 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:44:20.612485 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 40/86] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:20.612485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266092b-396c-4188-86bb-7eb6d5fa3f78 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:20.688044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:20.693447 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 47/87] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Jul 16 20:44:20 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:44:20.694321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f09b81-c1ad-432b-b782-d03f814a4b32 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:20.742093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266092b-396c-4188-86bb-7eb6d5fa3f78 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:20.757679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:20.796076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769d7be-40dc-4a6f-8b2b-1ccf568c9296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:20.797065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769d7be-40dc-4a6f-8b2b-1ccf568c9296 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:20.797359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769d7be-40dc-4a6f-8b2b-1ccf568c9296 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:20.798296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769d7be-40dc-4a6f-8b2b-1ccf568c9296 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:20.799542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769d7be-40dc-4a6f-8b2b-1ccf568c9296 None admin] RBAC: Adding query filter params (role.id=c352110df5bc449b9134928abd20c032, scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240, user.id=1bde7f2d8d764aa8a711e0cf7801a350) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:20.799866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769d7be-40dc-4a6f-8b2b-1ccf568c9296 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:20.802016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769d7be-40dc-4a6f-8b2b-1ccf568c9296 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:20.814974 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 41/88] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:44:20 2022] GET /identity/v3/role_assignments?user.id=1bde7f2d8d764aa8a711e0cf7801a350&scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240&role.id=c352110df5bc449b9134928abd20c032 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:20.816886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769d7be-40dc-4a6f-8b2b-1ccf568c9296 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:20.835225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f09b81-c1ad-432b-b782-d03f814a4b32 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:20.900654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49413e8a-4733-4d08-bc58-015572b01168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:20.903138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49413e8a-4733-4d08-bc58-015572b01168 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:20.903658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49413e8a-4733-4d08-bc58-015572b01168 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:20.904321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49413e8a-4733-4d08-bc58-015572b01168 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:20.907244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49413e8a-4733-4d08-bc58-015572b01168 None admin] RBAC: Adding query filter params (role.id=bd33b827674a4d4db30c164cab416056, scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240, user.id=d6cd66b16dc14b84918d5f636a683873) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:20.907687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49413e8a-4733-4d08-bc58-015572b01168 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:20.909342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49413e8a-4733-4d08-bc58-015572b01168 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:20.915943 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 48/89] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:44:20 2022] GET /identity/v3/role_assignments?user.id=d6cd66b16dc14b84918d5f636a683873&scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240&role.id=bd33b827674a4d4db30c164cab416056 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:20.916920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49413e8a-4733-4d08-bc58-015572b01168 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:20.992596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769d7be-40dc-4a6f-8b2b-1ccf568c9296 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:21.035050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:21.060395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22673ae-fceb-4626-8513-fb9674b83344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:21.061142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22673ae-fceb-4626-8513-fb9674b83344 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:21.061536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22673ae-fceb-4626-8513-fb9674b83344 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:21.061827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22673ae-fceb-4626-8513-fb9674b83344 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:21.099196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49413e8a-4733-4d08-bc58-015572b01168 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:21.130138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:21.153606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da7788-0d6a-4baa-86c4-89f2acf9857e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:21.154292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da7788-0d6a-4baa-86c4-89f2acf9857e None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:21.154576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da7788-0d6a-4baa-86c4-89f2acf9857e None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:21.154850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da7788-0d6a-4baa-86c4-89f2acf9857e None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:21.156487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da7788-0d6a-4baa-86c4-89f2acf9857e None admin] RBAC: Adding query filter params (name=member) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:21.156796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da7788-0d6a-4baa-86c4-89f2acf9857e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:21.158339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da7788-0d6a-4baa-86c4-89f2acf9857e None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:21.168371 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 49/90] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:44:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:21.175000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da7788-0d6a-4baa-86c4-89f2acf9857e None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:21.183918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22673ae-fceb-4626-8513-fb9674b83344 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:21.187514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22673ae-fceb-4626-8513-fb9674b83344 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:21.357265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da7788-0d6a-4baa-86c4-89f2acf9857e None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:21.367065 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 42/91] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:44:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:44:21.375165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22673ae-fceb-4626-8513-fb9674b83344 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:21.400452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:21.414420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dec39-f81f-4da5-871d-3f77ad85839a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:21.415332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dec39-f81f-4da5-871d-3f77ad85839a None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:21.415624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dec39-f81f-4da5-871d-3f77ad85839a None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:21.415910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dec39-f81f-4da5-871d-3f77ad85839a None admin] PATH_INFO: `/v3/users/1bde7f2d8d764aa8a711e0cf7801a350` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:21.417339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57dec39-f81f-4da5-871d-3f77ad85839a None admin] RBAC: Authorizing `identity:get_user(user_id=1bde7f2d8d764aa8a711e0cf7801a350)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:21.418880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57dec39-f81f-4da5-871d-3f77ad85839a None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:21.420657 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 50/92] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:21 2022] GET /identity/v3/users/1bde7f2d8d764aa8a711e0cf7801a350 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:21.427140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dec39-f81f-4da5-871d-3f77ad85839a None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:21.474718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:21.505445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22673ae-fceb-4626-8513-fb9674b83344 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:21.547979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6af576-dc17-4eef-9f78-a655416d7ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:21.548288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dec39-f81f-4da5-871d-3f77ad85839a None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:21.549287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6af576-dc17-4eef-9f78-a655416d7ba6 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:21.549716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6af576-dc17-4eef-9f78-a655416d7ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:21.550242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6af576-dc17-4eef-9f78-a655416d7ba6 None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:21.551824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6af576-dc17-4eef-9f78-a655416d7ba6 None admin] RBAC: Authorizing `identity:get_project(project_id=2ab6547ffe6648bd8a4ac2a99e702240)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:21.553652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6af576-dc17-4eef-9f78-a655416d7ba6 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:21.555719 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 43/93] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:21 2022] GET /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:21.564795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6af576-dc17-4eef-9f78-a655416d7ba6 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:21.600060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3493d-fc9c-458a-ad23-13dceb8d5bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:21.600060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3493d-fc9c-458a-ad23-13dceb8d5bb3 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:21.600060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3493d-fc9c-458a-ad23-13dceb8d5bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:21.600060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3493d-fc9c-458a-ad23-13dceb8d5bb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:21.667796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:21.676823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3493d-fc9c-458a-ad23-13dceb8d5bb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:21.678579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3493d-fc9c-458a-ad23-13dceb8d5bb3 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:21.753270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6af576-dc17-4eef-9f78-a655416d7ba6 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:21.790584 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 51/94] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:44:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 16 20:44:21.797330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3493d-fc9c-458a-ad23-13dceb8d5bb3 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:21.870253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d85d4-136c-49e2-8c65-279a4b25ff34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:21.871325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d85d4-136c-49e2-8c65-279a4b25ff34 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:21.871780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d85d4-136c-49e2-8c65-279a4b25ff34 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:21.872221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d85d4-136c-49e2-8c65-279a4b25ff34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:21.873635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d85d4-136c-49e2-8c65-279a4b25ff34 None admin] RBAC: Adding query filter params (role.id=b9444da176484ccfa45d6b85220ce558, scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240, user.id=1bde7f2d8d764aa8a711e0cf7801a350) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:21.874798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d85d4-136c-49e2-8c65-279a4b25ff34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:21.877433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d85d4-136c-49e2-8c65-279a4b25ff34 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:21.896128 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 44/95] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:44:21 2022] GET /identity/v3/role_assignments?user.id=1bde7f2d8d764aa8a711e0cf7801a350&scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240&role.id=b9444da176484ccfa45d6b85220ce558 => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:21.943534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3493d-fc9c-458a-ad23-13dceb8d5bb3 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:21.957186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:21.988015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3c05f-0982-45c6-a8e8-4c888fc327fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:21.988906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3c05f-0982-45c6-a8e8-4c888fc327fd None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:21.989189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3c05f-0982-45c6-a8e8-4c888fc327fd None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:21.989485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3c05f-0982-45c6-a8e8-4c888fc327fd None admin] PATH_INFO: `/v3/projects/cf0c1379a3514566bd875783e3192946` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:21.990933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3c05f-0982-45c6-a8e8-4c888fc327fd None admin] RBAC: Authorizing `identity:get_project(project_id=cf0c1379a3514566bd875783e3192946)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:21.992493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3c05f-0982-45c6-a8e8-4c888fc327fd None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:21.999163 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 52/96] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:21 2022] GET /identity/v3/projects/cf0c1379a3514566bd875783e3192946 => generated 312 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:22.001834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d85d4-136c-49e2-8c65-279a4b25ff34 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:22.025832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:22.203536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d85d4-136c-49e2-8c65-279a4b25ff34 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:22.251292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e70dc6-2e32-4037-83bd-2bf55b890120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:22.251961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e70dc6-2e32-4037-83bd-2bf55b890120 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:22.252250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e70dc6-2e32-4037-83bd-2bf55b890120 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:22.252528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e70dc6-2e32-4037-83bd-2bf55b890120 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:22.253370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e70dc6-2e32-4037-83bd-2bf55b890120 None admin] RBAC: Adding query filter params (role.id=c352110df5bc449b9134928abd20c032, scope.project.id=cf0c1379a3514566bd875783e3192946, user.id=1bde7f2d8d764aa8a711e0cf7801a350) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:22.253683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e70dc6-2e32-4037-83bd-2bf55b890120 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:22.255163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e70dc6-2e32-4037-83bd-2bf55b890120 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:22.266715 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 45/97] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:44:22 2022] GET /identity/v3/role_assignments?user.id=1bde7f2d8d764aa8a711e0cf7801a350&scope.project.id=cf0c1379a3514566bd875783e3192946&role.id=c352110df5bc449b9134928abd20c032 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:24.171983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fe3df-d7e1-4c48-8d8f-aeb58e393086 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:24.172964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fe3df-d7e1-4c48-8d8f-aeb58e393086 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:24.173445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fe3df-d7e1-4c48-8d8f-aeb58e393086 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:24.175411 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 53/98] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:24.182707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37355e-5041-4720-a01f-ddcc93014297 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:24.183602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37355e-5041-4720-a01f-ddcc93014297 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:24.184076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37355e-5041-4720-a01f-ddcc93014297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:24.207591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-df37355e-5041-4720-a01f-ddcc93014297 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:24.209158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-df37355e-5041-4720-a01f-ddcc93014297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:24.290311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:24.294724 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 46/99] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:24.331782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fe3df-d7e1-4c48-8d8f-aeb58e393086 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:24.353762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb62587-e21c-4b71-b16b-89277c243d9b None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:24.354060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb62587-e21c-4b71-b16b-89277c243d9b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:24.354319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb62587-e21c-4b71-b16b-89277c243d9b None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:24.356507 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 47/100] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:44:24.366209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5e2c6-67f1-485a-a004-2436fe8883b0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:24.366495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5e2c6-67f1-485a-a004-2436fe8883b0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:24.366879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5e2c6-67f1-485a-a004-2436fe8883b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:24.396489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-54a5e2c6-67f1-485a-a004-2436fe8883b0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:24.397701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-54a5e2c6-67f1-485a-a004-2436fe8883b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:24.569746 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 48/101] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:24.576700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b81c5-a950-4d0c-9f90-ba606a244705 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:24.578107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b81c5-a950-4d0c-9f90-ba606a244705 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:24.578770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b81c5-a950-4d0c-9f90-ba606a244705 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:24.580696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fe3df-d7e1-4c48-8d8f-aeb58e393086 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:24.582183 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 49/102] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:24 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:24.589042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3f078-1a3a-43af-aadf-6804b71de179 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:24.589809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3f078-1a3a-43af-aadf-6804b71de179 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:24.590424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3f078-1a3a-43af-aadf-6804b71de179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:24.641473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d9f3f078-1a3a-43af-aadf-6804b71de179 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:24.643823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d9f3f078-1a3a-43af-aadf-6804b71de179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:24.656284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c66c48-e242-4b38-bcfb-7b9954f7fbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:24.657097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c66c48-e242-4b38-bcfb-7b9954f7fbb7 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:24.657382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c66c48-e242-4b38-bcfb-7b9954f7fbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:24.657721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c66c48-e242-4b38-bcfb-7b9954f7fbb7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:24.681218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c66c48-e242-4b38-bcfb-7b9954f7fbb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:24.694773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-88c66c48-e242-4b38-bcfb-7b9954f7fbb7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:24.694773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:24.694773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:24.694773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:24.694773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:24.694773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:24.694773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:24.694773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:24.694773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:24.694773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:24.694773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:24.694773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:24.694773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:24.694773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:24.694773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:24.694773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:24.695701 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:24.695701 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:24.695701 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:24.695701 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:24.695701 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:24.695701 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:24.695701 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:24.695701 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:24.695701 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:24.695701 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:24.695701 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:24.695701 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:24.695701 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:24.695701 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:24.695701 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:24.695701 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:24.696423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:24.696423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:24.696423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:24.696423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:24.696423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:24.696423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:24.696423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:24.696423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:24.696423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:24.696423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:24.696423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:24.696423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:24.696423 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 54/103] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:24.697037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c66c48-e242-4b38-bcfb-7b9954f7fbb7 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:24.743589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:24.745365 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 50/104] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:24.749519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3f078-1a3a-43af-aadf-6804b71de179 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:24.894371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:25.007958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c66c48-e242-4b38-bcfb-7b9954f7fbb7 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:25.036350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3f078-1a3a-43af-aadf-6804b71de179 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:25.097438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02b1df-b647-4c6b-9f75-0f7b7f319647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:25.098300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02b1df-b647-4c6b-9f75-0f7b7f319647 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:25.098590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02b1df-b647-4c6b-9f75-0f7b7f319647 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:25.098857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02b1df-b647-4c6b-9f75-0f7b7f319647 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:25.099756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cc63d-2a12-43c7-9f2b-fba41d83bc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:25.100435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cc63d-2a12-43c7-9f2b-fba41d83bc77 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:25.100719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cc63d-2a12-43c7-9f2b-fba41d83bc77 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:25.100989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cc63d-2a12-43c7-9f2b-fba41d83bc77 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:25.101951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cc63d-2a12-43c7-9f2b-fba41d83bc77 None admin] RBAC: Adding query filter params (name=member) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:25.102260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cc63d-2a12-43c7-9f2b-fba41d83bc77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:25.103724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cc63d-2a12-43c7-9f2b-fba41d83bc77 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:25.112543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02b1df-b647-4c6b-9f75-0f7b7f319647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:25.120317 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 51/105] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:44:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:25.121210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cc63d-2a12-43c7-9f2b-fba41d83bc77 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:25.122055 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-0f02b1df-b647-4c6b-9f75-0f7b7f319647 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:44:25.122055 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:25.122055 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:25.122055 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:25.122055 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:25.122055 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:25.122055 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:25.122055 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:25.122055 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:25.122055 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:25.122055 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:25.122055 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:25.122055 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:25.122055 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:25.122055 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:25.122055 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:25.123340 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:25.123340 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:25.123340 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:25.123340 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:25.123340 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:25.123340 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:25.123340 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:25.123340 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:25.123340 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:25.123340 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:25.123340 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:25.123340 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:25.123340 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:25.123340 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:25.123340 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:25.123340 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:25.125009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:25.125009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:25.125009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:25.125009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:25.125009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:25.125009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:25.125009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:25.125009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:25.125009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:25.125009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:25.125009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:44:25.125009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:25.125009 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 55/106] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:44:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:25.125851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c68ae-81d7-4c07-934f-63cc85056685 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:25.126221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c68ae-81d7-4c07-934f-63cc85056685 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:25.126311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c68ae-81d7-4c07-934f-63cc85056685 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:25.127980 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 56/107] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:25.128731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c68ae-81d7-4c07-934f-63cc85056685 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:25.233749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:25.240887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cc63d-2a12-43c7-9f2b-fba41d83bc77 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:25.261184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c68ae-81d7-4c07-934f-63cc85056685 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:25.269173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:25.284141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a707cd-e5f1-401d-b832-dedf3e09520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:25.284946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a707cd-e5f1-401d-b832-dedf3e09520b None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:25.285229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a707cd-e5f1-401d-b832-dedf3e09520b None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:25.285506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a707cd-e5f1-401d-b832-dedf3e09520b None admin] PATH_INFO: `/v3/domains/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:25.286738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a707cd-e5f1-401d-b832-dedf3e09520b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:25.288371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a707cd-e5f1-401d-b832-dedf3e09520b None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:25.290325 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 52/108] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:44:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:25.291156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a707cd-e5f1-401d-b832-dedf3e09520b None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:25.302478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2308da1-5f39-4b02-af9b-28cc8310b2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:25.303797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2308da1-5f39-4b02-af9b-28cc8310b2ea None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:25.304272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2308da1-5f39-4b02-af9b-28cc8310b2ea None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:25.304737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2308da1-5f39-4b02-af9b-28cc8310b2ea None admin] PATH_INFO: `/v3/users/1bde7f2d8d764aa8a711e0cf7801a350` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:25.306216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2308da1-5f39-4b02-af9b-28cc8310b2ea None admin] RBAC: Authorizing `identity:get_user(user_id=1bde7f2d8d764aa8a711e0cf7801a350)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:25.307902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2308da1-5f39-4b02-af9b-28cc8310b2ea None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:25.310020 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 57/109] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:25 2022] GET /identity/v3/users/1bde7f2d8d764aa8a711e0cf7801a350 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:25.315632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc449fe6-cac6-48f3-81a3-3b67448616ea None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:25.316176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc449fe6-cac6-48f3-81a3-3b67448616ea None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:25.316643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc449fe6-cac6-48f3-81a3-3b67448616ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:25.336317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-cc449fe6-cac6-48f3-81a3-3b67448616ea None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:25.337618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cc449fe6-cac6-48f3-81a3-3b67448616ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:25.408674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a707cd-e5f1-401d-b832-dedf3e09520b None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:25.427045 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 58/110] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:25.427045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc449fe6-cac6-48f3-81a3-3b67448616ea None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:25.457101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b7189-bcee-4aa2-84da-e29543a1e138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:25.457557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b7189-bcee-4aa2-84da-e29543a1e138 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:25.457847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b7189-bcee-4aa2-84da-e29543a1e138 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:25.458124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b7189-bcee-4aa2-84da-e29543a1e138 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:25.458878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b7189-bcee-4aa2-84da-e29543a1e138 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:25.459267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b7189-bcee-4aa2-84da-e29543a1e138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:25.460666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b7189-bcee-4aa2-84da-e29543a1e138 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:25.474235 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 53/111] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:25.474235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b7189-bcee-4aa2-84da-e29543a1e138 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:25.528491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:25.532242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:25.555343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc449fe6-cac6-48f3-81a3-3b67448616ea None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:25.591248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b7189-bcee-4aa2-84da-e29543a1e138 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:25.607265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a571a3-a7cb-410d-aa83-a8e314cbd0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:25.607967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a571a3-a7cb-410d-aa83-a8e314cbd0f2 None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:25.608381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a571a3-a7cb-410d-aa83-a8e314cbd0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:25.608662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a571a3-a7cb-410d-aa83-a8e314cbd0f2 None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:25.609851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a571a3-a7cb-410d-aa83-a8e314cbd0f2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:25.612613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a571a3-a7cb-410d-aa83-a8e314cbd0f2 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:25.632413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776c15b-4f94-403a-9c0a-209069f90ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:25.633283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776c15b-4f94-403a-9c0a-209069f90ff4 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:25.633570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776c15b-4f94-403a-9c0a-209069f90ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:25.633855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776c15b-4f94-403a-9c0a-209069f90ff4 None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:25.635130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776c15b-4f94-403a-9c0a-209069f90ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=2ab6547ffe6648bd8a4ac2a99e702240)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:25.636590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776c15b-4f94-403a-9c0a-209069f90ff4 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:25.638326 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 54/112] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:25 2022] GET /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:25.640975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe72f8-6299-446e-9046-6c30f103cbfd None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:25.641473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe72f8-6299-446e-9046-6c30f103cbfd None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:25.641944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe72f8-6299-446e-9046-6c30f103cbfd None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:25.646271 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 55/113] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:25.646271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe72f8-6299-446e-9046-6c30f103cbfd None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:25.727394 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 59/114] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Jul 16 20:44:25 2022] POST /identity/v3/projects => generated 302 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:44:25.729119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a571a3-a7cb-410d-aa83-a8e314cbd0f2 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:25.807314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe72f8-6299-446e-9046-6c30f103cbfd None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:25.844926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:25.863694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac9fc8-183b-412d-b360-584c126c63aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:25.864573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac9fc8-183b-412d-b360-584c126c63aa None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:25.864856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac9fc8-183b-412d-b360-584c126c63aa None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:25.865130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac9fc8-183b-412d-b360-584c126c63aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:25.881190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac9fc8-183b-412d-b360-584c126c63aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:25.893846 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-c5ac9fc8-183b-412d-b360-584c126c63aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 16 20:44:25.893846 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:25.893846 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:25.893846 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:25.893846 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:25.893846 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:25.893846 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:25.893846 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:25.893846 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:25.893846 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:25.893846 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:25.893846 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:25.893846 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:25.893846 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:25.893846 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:25.893846 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:25.894928 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:25.894928 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:25.894928 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:25.894928 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:25.894928 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:25.894928 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:25.894928 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:25.894928 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:25.894928 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:25.894928 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:25.894928 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:25.894928 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:25.894928 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:25.894928 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:25.894928 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:25.894928 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:25.895822 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:25.895822 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:25.895822 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:25.895822 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:25.895822 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:25.895822 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:25.895822 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:25.895822 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:25.895822 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:25.895822 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:25.895822 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 16 20:44:25.895822 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:44:25.906652 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 56/115] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:25.907475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac9fc8-183b-412d-b360-584c126c63aa None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:25.913117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a571a3-a7cb-410d-aa83-a8e314cbd0f2 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:25.954029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:25.962532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d8d1e-624d-416b-a28d-58f32dd6a312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:25.963460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d8d1e-624d-416b-a28d-58f32dd6a312 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:25.963746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d8d1e-624d-416b-a28d-58f32dd6a312 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:25.964012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d8d1e-624d-416b-a28d-58f32dd6a312 None admin] PATH_INFO: `/v3/users/d6cd66b16dc14b84918d5f636a683873` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:25.965377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d8d1e-624d-416b-a28d-58f32dd6a312 None admin] RBAC: Authorizing `identity:get_user(user_id=d6cd66b16dc14b84918d5f636a683873)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:25.966938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d8d1e-624d-416b-a28d-58f32dd6a312 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:25.969143 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 60/116] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:25 2022] GET /identity/v3/users/d6cd66b16dc14b84918d5f636a683873 => generated 247 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:25.970908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e67ab-2e2e-4c60-b433-4f91ab677ff0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:25.971226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e67ab-2e2e-4c60-b433-4f91ab677ff0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:25.971505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e67ab-2e2e-4c60-b433-4f91ab677ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:25.990099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5d3e67ab-2e2e-4c60-b433-4f91ab677ff0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:25.992062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5d3e67ab-2e2e-4c60-b433-4f91ab677ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:26.048874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac9fc8-183b-412d-b360-584c126c63aa None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:26.081886 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 61/117] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:26.081886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8460b56-4a90-4970-a9f9-5f8c006aa251 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:26.081886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8460b56-4a90-4970-a9f9-5f8c006aa251 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:26.081886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8460b56-4a90-4970-a9f9-5f8c006aa251 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:26.081886 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 62/118] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:26.085608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8460b56-4a90-4970-a9f9-5f8c006aa251 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:26.103195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6a994-a971-4c40-9ea0-6223ffed5c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:26.104326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6a994-a971-4c40-9ea0-6223ffed5c69 None admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:26.104818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6a994-a971-4c40-9ea0-6223ffed5c69 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:26.105198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6a994-a971-4c40-9ea0-6223ffed5c69 None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240/users/1bde7f2d8d764aa8a711e0cf7801a350/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:26.107604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6a994-a971-4c40-9ea0-6223ffed5c69 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ab6547ffe6648bd8a4ac2a99e702240, user_id=1bde7f2d8d764aa8a711e0cf7801a350, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:26.111809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6a994-a971-4c40-9ea0-6223ffed5c69 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:26.191414 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 57/119] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:44:25 2022] PUT /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240/users/1bde7f2d8d764aa8a711e0cf7801a350/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:44:26.192315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6a994-a971-4c40-9ea0-6223ffed5c69 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:26.213942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8460b56-4a90-4970-a9f9-5f8c006aa251 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:26.249951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:26.254987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:26.266109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b926931-0a6e-480a-8d2e-54601b4f8e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:26.267949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b926931-0a6e-480a-8d2e-54601b4f8e26 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:26.267949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b926931-0a6e-480a-8d2e-54601b4f8e26 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:26.268421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b926931-0a6e-480a-8d2e-54601b4f8e26 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:26.269599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b926931-0a6e-480a-8d2e-54601b4f8e26 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:26.270127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b926931-0a6e-480a-8d2e-54601b4f8e26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:26.271884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b926931-0a6e-480a-8d2e-54601b4f8e26 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:26.283801 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 63/120] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:44:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:26.290477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193d5cd-0b16-4c3f-80ab-865355f66383 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:26.291424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193d5cd-0b16-4c3f-80ab-865355f66383 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:26.292028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193d5cd-0b16-4c3f-80ab-865355f66383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:26.315934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2193d5cd-0b16-4c3f-80ab-865355f66383 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:26.317541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2193d5cd-0b16-4c3f-80ab-865355f66383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:26.320424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6a994-a971-4c40-9ea0-6223ffed5c69 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:26.369507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79dfb76-3368-4253-b71f-e06275fdea77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:26.370430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dfb76-3368-4253-b71f-e06275fdea77 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:26.370712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dfb76-3368-4253-b71f-e06275fdea77 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:26.370987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dfb76-3368-4253-b71f-e06275fdea77 None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:26.372383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79dfb76-3368-4253-b71f-e06275fdea77 None admin] RBAC: Authorizing `identity:get_project(project_id=2ab6547ffe6648bd8a4ac2a99e702240)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:26.374625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79dfb76-3368-4253-b71f-e06275fdea77 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:26.377076 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 58/121] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:26 2022] GET /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:26.382230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79dfb76-3368-4253-b71f-e06275fdea77 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:26.422076 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 64/122] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:26.422076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193d5cd-0b16-4c3f-80ab-865355f66383 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:26.518487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79dfb76-3368-4253-b71f-e06275fdea77 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:26.528838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:26.553766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193d5cd-0b16-4c3f-80ab-865355f66383 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:26.557535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612e6c6-2816-48df-a196-1b50a6960caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:26.558323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612e6c6-2816-48df-a196-1b50a6960caa None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:26.558734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612e6c6-2816-48df-a196-1b50a6960caa None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:26.559146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612e6c6-2816-48df-a196-1b50a6960caa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:26.571833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612e6c6-2816-48df-a196-1b50a6960caa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:26.579096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:26.582712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-3612e6c6-2816-48df-a196-1b50a6960caa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:44:26.582712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:26.582712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:26.582712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:26.582712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:26.582712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:26.582712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:26.582712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:26.582712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:26.582712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:26.582712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:26.582712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:26.582712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:26.582712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:26.582712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:26.582712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:26.583627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:26.583627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:26.583627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:26.583627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:26.583627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:26.583627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:26.583627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:26.583627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:26.583627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:26.583627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:26.583627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:26.583627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:26.583627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:26.583627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:26.583627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:26.583627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:26.584349 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:26.584349 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:26.584349 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:26.584349 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:26.584349 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:26.584349 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:26.584349 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:26.584349 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:26.584349 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:26.584349 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:26.584349 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:44:26.584349 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:44:26.586705 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 59/123] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Jul 16 20:44:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:26.587693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612e6c6-2816-48df-a196-1b50a6960caa None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:26.596887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7a2ca-75c1-4839-a6a1-09290048b290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:26.603149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7a2ca-75c1-4839-a6a1-09290048b290 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:26.603149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7a2ca-75c1-4839-a6a1-09290048b290 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:26.603149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7a2ca-75c1-4839-a6a1-09290048b290 None admin] PATH_INFO: `/v3/users/db34ffe5b44e441db17d98a64507a812` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:26.615875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7a2ca-75c1-4839-a6a1-09290048b290 None admin] RBAC: Authorizing `identity:get_user(user_id=db34ffe5b44e441db17d98a64507a812)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:26.617483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7a2ca-75c1-4839-a6a1-09290048b290 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:26.619497 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 65/124] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:26 2022] GET /identity/v3/users/db34ffe5b44e441db17d98a64507a812 => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:26.624435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7a2ca-75c1-4839-a6a1-09290048b290 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:26.707717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612e6c6-2816-48df-a196-1b50a6960caa None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:26.745945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7a2ca-75c1-4839-a6a1-09290048b290 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:26.766885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca79b3-5dea-44f6-95eb-0ea1ce4b6376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:26.768152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca79b3-5dea-44f6-95eb-0ea1ce4b6376 None admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:26.768581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca79b3-5dea-44f6-95eb-0ea1ce4b6376 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:26.768931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca79b3-5dea-44f6-95eb-0ea1ce4b6376 None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240/users/d6cd66b16dc14b84918d5f636a683873/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:26.771793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca79b3-5dea-44f6-95eb-0ea1ce4b6376 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ab6547ffe6648bd8a4ac2a99e702240, user_id=d6cd66b16dc14b84918d5f636a683873, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:26.773383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca79b3-5dea-44f6-95eb-0ea1ce4b6376 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:26.790955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8c9ad-3a1c-4491-b8ac-84d779f1cae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:26.791983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8c9ad-3a1c-4491-b8ac-84d779f1cae8 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:26.792272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8c9ad-3a1c-4491-b8ac-84d779f1cae8 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:26.792544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8c9ad-3a1c-4491-b8ac-84d779f1cae8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:26.804385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8c9ad-3a1c-4491-b8ac-84d779f1cae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:26.813278 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-13d8c9ad-3a1c-4491-b8ac-84d779f1cae8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:26.813278 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:26.813278 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:26.813278 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:26.813278 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:26.813278 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:26.813278 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:26.813278 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:26.813278 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:26.813278 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:26.813278 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:26.813278 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:26.813278 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:26.813278 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:26.813278 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:26.813278 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:26.814215 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:26.814215 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:26.814215 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:26.814215 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:26.814215 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:26.814215 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:26.814215 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:26.814215 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:26.814215 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:26.814215 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:26.814215 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:26.814215 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:26.814215 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:26.814215 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:26.814215 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:26.814215 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:26.814998 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:26.814998 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:26.814998 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:26.814998 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:26.814998 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:26.814998 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:26.814998 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:26.814998 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:26.814998 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:26.814998 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:26.814998 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:26.814998 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:26.814998 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 66/125] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:26.821303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8c9ad-3a1c-4491-b8ac-84d779f1cae8 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:26.871208 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 60/126] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:44:26 2022] PUT /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240/users/d6cd66b16dc14b84918d5f636a683873/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:44:26.871862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca79b3-5dea-44f6-95eb-0ea1ce4b6376 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:26.874274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:26.911810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:26.965690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8c9ad-3a1c-4491-b8ac-84d779f1cae8 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:27.005051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca79b3-5dea-44f6-95eb-0ea1ce4b6376 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:27.009260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cf9ca-455c-46f7-a243-c2f58011c454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:27.009725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cf9ca-455c-46f7-a243-c2f58011c454 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:27.010106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cf9ca-455c-46f7-a243-c2f58011c454 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:27.010643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cf9ca-455c-46f7-a243-c2f58011c454 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:27.011570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cf9ca-455c-46f7-a243-c2f58011c454 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:27.011983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cf9ca-455c-46f7-a243-c2f58011c454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:27.013654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cf9ca-455c-46f7-a243-c2f58011c454 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:27.023466 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 67/127] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:44:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:27.024453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cf9ca-455c-46f7-a243-c2f58011c454 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:27.054046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f88d8-4160-4cdb-9c6d-12698eb64fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:27.055244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f88d8-4160-4cdb-9c6d-12698eb64fb8 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:27.056135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f88d8-4160-4cdb-9c6d-12698eb64fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:27.056563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f88d8-4160-4cdb-9c6d-12698eb64fb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:27.165642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f88d8-4160-4cdb-9c6d-12698eb64fb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:27.167531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f88d8-4160-4cdb-9c6d-12698eb64fb8 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:27.193646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:27.205033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cf9ca-455c-46f7-a243-c2f58011c454 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:27.206170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:27.253605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a933f-e6de-4e4b-82ad-01bc3a839132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:27.254862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a933f-e6de-4e4b-82ad-01bc3a839132 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:27.255498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a933f-e6de-4e4b-82ad-01bc3a839132 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:27.257408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a933f-e6de-4e4b-82ad-01bc3a839132 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:27.258371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a933f-e6de-4e4b-82ad-01bc3a839132 None admin] RBAC: Adding query filter params (name=member) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:27.258836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a933f-e6de-4e4b-82ad-01bc3a839132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:27.261317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a933f-e6de-4e4b-82ad-01bc3a839132 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:27.274912 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 68/128] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:44:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:27.276572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a933f-e6de-4e4b-82ad-01bc3a839132 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:27.328080 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 61/129] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:44:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:44:27.328955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f88d8-4160-4cdb-9c6d-12698eb64fb8 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:27.452650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a933f-e6de-4e4b-82ad-01bc3a839132 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:27.513753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e244b26-2b8b-45b0-b76a-c0ae54073c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:27.515860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e244b26-2b8b-45b0-b76a-c0ae54073c97 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:27.516346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e244b26-2b8b-45b0-b76a-c0ae54073c97 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:27.516819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e244b26-2b8b-45b0-b76a-c0ae54073c97 None admin] PATH_INFO: `/v3/users/1bde7f2d8d764aa8a711e0cf7801a350` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:27.518471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e244b26-2b8b-45b0-b76a-c0ae54073c97 None admin] RBAC: Authorizing `identity:get_user(user_id=1bde7f2d8d764aa8a711e0cf7801a350)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:27.520240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e244b26-2b8b-45b0-b76a-c0ae54073c97 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:27.522128 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 69/130] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:27 2022] GET /identity/v3/users/1bde7f2d8d764aa8a711e0cf7801a350 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:27.523116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e244b26-2b8b-45b0-b76a-c0ae54073c97 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:27.532921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f88d8-4160-4cdb-9c6d-12698eb64fb8 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:27.558329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:27.587465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:27.607566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bcd08-06f1-445d-9c88-0ef659d83d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:27.609008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bcd08-06f1-445d-9c88-0ef659d83d71 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:27.609304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bcd08-06f1-445d-9c88-0ef659d83d71 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:27.609615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bcd08-06f1-445d-9c88-0ef659d83d71 None admin] PATH_INFO: `/v3/users/1bde7f2d8d764aa8a711e0cf7801a350` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:27.615877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bcd08-06f1-445d-9c88-0ef659d83d71 None admin] RBAC: Authorizing `identity:get_user(user_id=1bde7f2d8d764aa8a711e0cf7801a350)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:27.617430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bcd08-06f1-445d-9c88-0ef659d83d71 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:27.619539 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 62/131] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:27 2022] GET /identity/v3/users/1bde7f2d8d764aa8a711e0cf7801a350 => generated 275 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:27.620362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bcd08-06f1-445d-9c88-0ef659d83d71 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:27.651097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e244b26-2b8b-45b0-b76a-c0ae54073c97 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:27.694691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d6078-be36-454d-ae14-b4a144b56749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:27.696000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d6078-be36-454d-ae14-b4a144b56749 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:27.696702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d6078-be36-454d-ae14-b4a144b56749 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:27.697225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d6078-be36-454d-ae14-b4a144b56749 None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:27.698804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d6078-be36-454d-ae14-b4a144b56749 None admin] RBAC: Authorizing `identity:get_project(project_id=2ab6547ffe6648bd8a4ac2a99e702240)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:27.700941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d6078-be36-454d-ae14-b4a144b56749 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:27.704355 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 70/132] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:27 2022] GET /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:27.705462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d6078-be36-454d-ae14-b4a144b56749 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:27.848191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bcd08-06f1-445d-9c88-0ef659d83d71 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:27.875043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:27.882193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d6078-be36-454d-ae14-b4a144b56749 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:27.917805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ef6f3-a574-49a0-987a-6bc2ed9b17f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:27.918997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ef6f3-a574-49a0-987a-6bc2ed9b17f7 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:27.919145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ef6f3-a574-49a0-987a-6bc2ed9b17f7 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:27.919373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ef6f3-a574-49a0-987a-6bc2ed9b17f7 None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:27.927032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ef6f3-a574-49a0-987a-6bc2ed9b17f7 None admin] RBAC: Authorizing `identity:get_project(project_id=2ab6547ffe6648bd8a4ac2a99e702240)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:27.927032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ef6f3-a574-49a0-987a-6bc2ed9b17f7 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:27.927032 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 63/133] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:27 2022] GET /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240 => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:27.927881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ef6f3-a574-49a0-987a-6bc2ed9b17f7 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:27.944723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0df878-ac74-45ee-914b-4c4ccf43f526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:27.945734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0df878-ac74-45ee-914b-4c4ccf43f526 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:27.946298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0df878-ac74-45ee-914b-4c4ccf43f526 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:27.946673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0df878-ac74-45ee-914b-4c4ccf43f526 None admin] PATH_INFO: `/v3/projects/cf0c1379a3514566bd875783e3192946` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:27.950641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0df878-ac74-45ee-914b-4c4ccf43f526 None admin] RBAC: Authorizing `identity:get_project(project_id=cf0c1379a3514566bd875783e3192946)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:27.953937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0df878-ac74-45ee-914b-4c4ccf43f526 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:27.958716 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 71/134] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:27 2022] GET /identity/v3/projects/cf0c1379a3514566bd875783e3192946 => generated 312 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:27.960046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0df878-ac74-45ee-914b-4c4ccf43f526 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:28.057465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:28.130479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ef6f3-a574-49a0-987a-6bc2ed9b17f7 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:28.146540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0df878-ac74-45ee-914b-4c4ccf43f526 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:28.201333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9456c-4522-4d6e-b179-40d51b63520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:28.202886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9456c-4522-4d6e-b179-40d51b63520b None admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:28.203202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9456c-4522-4d6e-b179-40d51b63520b None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:28.203478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9456c-4522-4d6e-b179-40d51b63520b None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240/users/1bde7f2d8d764aa8a711e0cf7801a350/roles/b9444da176484ccfa45d6b85220ce558` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:28.205930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9456c-4522-4d6e-b179-40d51b63520b None admin] RBAC: Authorizing `identity:create_grant(project_id=2ab6547ffe6648bd8a4ac2a99e702240, user_id=1bde7f2d8d764aa8a711e0cf7801a350, role_id=b9444da176484ccfa45d6b85220ce558)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:28.207469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9456c-4522-4d6e-b179-40d51b63520b None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:28.209063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad8ab0-107a-4f0b-9759-a789bfd58c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:28.209761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad8ab0-107a-4f0b-9759-a789bfd58c25 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:28.210159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad8ab0-107a-4f0b-9759-a789bfd58c25 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:28.210533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad8ab0-107a-4f0b-9759-a789bfd58c25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:28.211431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad8ab0-107a-4f0b-9759-a789bfd58c25 None admin] RBAC: Adding query filter params (role.id=4f9686ee5911427e8cca34c19a1b7513, scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240, user.id=db34ffe5b44e441db17d98a64507a812) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:28.211746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad8ab0-107a-4f0b-9759-a789bfd58c25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:28.213385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad8ab0-107a-4f0b-9759-a789bfd58c25 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:28.220083 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 64/135] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:44:27 2022] GET /identity/v3/role_assignments?user.id=db34ffe5b44e441db17d98a64507a812&scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240&role.id=4f9686ee5911427e8cca34c19a1b7513 => generated 259 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:28.220925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad8ab0-107a-4f0b-9759-a789bfd58c25 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:28.294171 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 72/136] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:44:27 2022] PUT /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240/users/1bde7f2d8d764aa8a711e0cf7801a350/roles/b9444da176484ccfa45d6b85220ce558 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:44:28.414987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad8ab0-107a-4f0b-9759-a789bfd58c25 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:28.460257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:28.471244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621edbc-951d-4a70-971c-345b04b173b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:28.472164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621edbc-951d-4a70-971c-345b04b173b9 None admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:28.472445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621edbc-951d-4a70-971c-345b04b173b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:28.472795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621edbc-951d-4a70-971c-345b04b173b9 None admin] PATH_INFO: `/v3/projects/cf0c1379a3514566bd875783e3192946/users/1bde7f2d8d764aa8a711e0cf7801a350/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:28.475158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621edbc-951d-4a70-971c-345b04b173b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf0c1379a3514566bd875783e3192946, user_id=1bde7f2d8d764aa8a711e0cf7801a350, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:28.476634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621edbc-951d-4a70-971c-345b04b173b9 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:28.540029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25139f-3615-4777-97cf-4c60d51de332 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:28.540318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25139f-3615-4777-97cf-4c60d51de332 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:28.540600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25139f-3615-4777-97cf-4c60d51de332 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:28.541985 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 73/137] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:28.548465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257d77f-82e5-4927-a021-34f522d0cb31 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:28.548792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257d77f-82e5-4927-a021-34f522d0cb31 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:28.549037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257d77f-82e5-4927-a021-34f522d0cb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:28.571447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7257d77f-82e5-4927-a021-34f522d0cb31 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:28.572480 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 65/138] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:44:28 2022] PUT /identity/v3/projects/cf0c1379a3514566bd875783e3192946/users/1bde7f2d8d764aa8a711e0cf7801a350/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:44:28.572745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7257d77f-82e5-4927-a021-34f522d0cb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:28.599700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:28.671205 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 74/139] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 16 20:44:28.697748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621edbc-951d-4a70-971c-345b04b173b9 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:28.840127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621edbc-951d-4a70-971c-345b04b173b9 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:28.891790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0870f21-25a6-4ab1-8eef-b3021e606fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:28.892625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0870f21-25a6-4ab1-8eef-b3021e606fe7 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:28.893024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0870f21-25a6-4ab1-8eef-b3021e606fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:28.893312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0870f21-25a6-4ab1-8eef-b3021e606fe7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:28.894633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0870f21-25a6-4ab1-8eef-b3021e606fe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:28.896142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0870f21-25a6-4ab1-8eef-b3021e606fe7 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:28.897829 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 66/140] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:44:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:28.903347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257d77f-82e5-4927-a021-34f522d0cb31 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:29.024625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257d77f-82e5-4927-a021-34f522d0cb31 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:29.080077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c07636-5c3e-426b-9568-c0657cbe82db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:29.080881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c07636-5c3e-426b-9568-c0657cbe82db None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:29.081226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c07636-5c3e-426b-9568-c0657cbe82db None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:29.081509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c07636-5c3e-426b-9568-c0657cbe82db None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:29.082240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c07636-5c3e-426b-9568-c0657cbe82db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:29.083745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c07636-5c3e-426b-9568-c0657cbe82db None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:29.160982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0a352-17c3-4422-a97e-63a4b2913f7b None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:29.161427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0a352-17c3-4422-a97e-63a4b2913f7b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:29.161722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0a352-17c3-4422-a97e-63a4b2913f7b None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:29.163362 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 67/141] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:44:29.169612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d87fd-c217-4f2c-bb99-6af68dcb4965 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:29.169906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d87fd-c217-4f2c-bb99-6af68dcb4965 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:29.170193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d87fd-c217-4f2c-bb99-6af68dcb4965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:29.194382 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 75/142] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Jul 16 20:44:28 2022] POST /identity/v3/users => generated 283 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:44:29.202528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8e1d87fd-c217-4f2c-bb99-6af68dcb4965 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:29.203886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8e1d87fd-c217-4f2c-bb99-6af68dcb4965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:29.267690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:29.298150 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 68/143] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:29.328802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c07636-5c3e-426b-9568-c0657cbe82db None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:29.350214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:29.473902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c07636-5c3e-426b-9568-c0657cbe82db None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:29.526712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76292149-0491-4f80-bc39-9776d0d50bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:29.527570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76292149-0491-4f80-bc39-9776d0d50bd4 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:29.527852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76292149-0491-4f80-bc39-9776d0d50bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:29.528122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76292149-0491-4f80-bc39-9776d0d50bd4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:29.540801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76292149-0491-4f80-bc39-9776d0d50bd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:29.549644 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-76292149-0491-4f80-bc39-9776d0d50bd4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:29.549644 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:29.549644 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:29.549644 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:29.549644 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:29.549644 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:29.549644 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:29.549644 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:29.549644 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:29.549644 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:29.549644 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:29.549644 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:29.549644 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:29.549644 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:29.549644 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:29.549644 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:29.551740 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:29.551740 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:29.551740 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:29.551740 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:29.551740 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:29.551740 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:29.551740 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:29.551740 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:29.551740 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:29.551740 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:29.551740 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:29.551740 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:29.551740 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:29.551740 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:29.551740 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:29.551740 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:29.553617 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:29.553617 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:29.553617 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:29.553617 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:29.553617 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:29.553617 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:29.553617 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:29.553617 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:29.553617 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:29.553617 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:29.553617 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:29.553617 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:29.553617 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 76/144] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:29.557128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d87fd-c217-4f2c-bb99-6af68dcb4965 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:29.680463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d87fd-c217-4f2c-bb99-6af68dcb4965 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:29.720686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63692af-9cb2-4d6e-82e5-0a0fe0d5dc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:29.721379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63692af-9cb2-4d6e-82e5-0a0fe0d5dc8b None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:29.721671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63692af-9cb2-4d6e-82e5-0a0fe0d5dc8b None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:29.721952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63692af-9cb2-4d6e-82e5-0a0fe0d5dc8b None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:29.722721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63692af-9cb2-4d6e-82e5-0a0fe0d5dc8b None admin] RBAC: Adding query filter params (name=member) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:29.723064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63692af-9cb2-4d6e-82e5-0a0fe0d5dc8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:29.727774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63692af-9cb2-4d6e-82e5-0a0fe0d5dc8b None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:29.734312 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 69/145] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:44:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:29.740014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76292149-0491-4f80-bc39-9776d0d50bd4 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:29.828065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:29.853927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76292149-0491-4f80-bc39-9776d0d50bd4 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:29.891865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c669f1-c75b-42ae-8edd-fc108b4bec50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:29.892754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c669f1-c75b-42ae-8edd-fc108b4bec50 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:29.893035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c669f1-c75b-42ae-8edd-fc108b4bec50 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:29.893307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c669f1-c75b-42ae-8edd-fc108b4bec50 None admin] PATH_INFO: `/v3/users/1bde7f2d8d764aa8a711e0cf7801a350` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:29.894535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c669f1-c75b-42ae-8edd-fc108b4bec50 None admin] RBAC: Authorizing `identity:get_user(user_id=1bde7f2d8d764aa8a711e0cf7801a350)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:29.896078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c669f1-c75b-42ae-8edd-fc108b4bec50 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:29.898316 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 77/146] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:29 2022] GET /identity/v3/users/1bde7f2d8d764aa8a711e0cf7801a350 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:29.903964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63692af-9cb2-4d6e-82e5-0a0fe0d5dc8b None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:29.961013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:30.017783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63692af-9cb2-4d6e-82e5-0a0fe0d5dc8b None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:30.055203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c05cf-8640-4a07-88bb-90774e79b05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:30.055908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c05cf-8640-4a07-88bb-90774e79b05b None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:30.056264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c05cf-8640-4a07-88bb-90774e79b05b None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:30.056553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c05cf-8640-4a07-88bb-90774e79b05b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:30.138129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c05cf-8640-4a07-88bb-90774e79b05b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:30.140391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c05cf-8640-4a07-88bb-90774e79b05b None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:30.210797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:30.260900 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 70/147] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:44:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:44:30.267443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c669f1-c75b-42ae-8edd-fc108b4bec50 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:30.323536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be2d68-4a10-44b7-a466-5a11c8b6b306 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:30.324012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be2d68-4a10-44b7-a466-5a11c8b6b306 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:30.324303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be2d68-4a10-44b7-a466-5a11c8b6b306 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:30.326270 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 71/148] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:44:30.333394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb15ff6-0d67-49e4-b391-3668dca3bc86 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:30.333688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb15ff6-0d67-49e4-b391-3668dca3bc86 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:30.334644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb15ff6-0d67-49e4-b391-3668dca3bc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:30.355969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2cb15ff6-0d67-49e4-b391-3668dca3bc86 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:30.358157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2cb15ff6-0d67-49e4-b391-3668dca3bc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:30.406590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c669f1-c75b-42ae-8edd-fc108b4bec50 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:30.446664 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 72/149] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 16 20:44:30.471855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bdbeba-c985-4af9-a802-6370295cecf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:30.473040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdbeba-c985-4af9-a802-6370295cecf0 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:30.473465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdbeba-c985-4af9-a802-6370295cecf0 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:30.473881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdbeba-c985-4af9-a802-6370295cecf0 None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:30.475499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bdbeba-c985-4af9-a802-6370295cecf0 None admin] RBAC: Authorizing `identity:get_project(project_id=2ab6547ffe6648bd8a4ac2a99e702240)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:30.477237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bdbeba-c985-4af9-a802-6370295cecf0 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:30.477381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb15ff6-0d67-49e4-b391-3668dca3bc86 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:30.479435 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 78/150] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:30 2022] GET /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:30.513349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bdbeba-c985-4af9-a802-6370295cecf0 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:30.537615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:30.575809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:30.604446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb15ff6-0d67-49e4-b391-3668dca3bc86 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:30.648910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698456a-5823-4bef-8b28-70fce84912ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:30.649790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698456a-5823-4bef-8b28-70fce84912ae None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:30.651134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698456a-5823-4bef-8b28-70fce84912ae None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:30.651431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698456a-5823-4bef-8b28-70fce84912ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:30.664407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698456a-5823-4bef-8b28-70fce84912ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:30.674370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-f698456a-5823-4bef-8b28-70fce84912ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:44:30.674370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:30.674370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:30.674370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:30.674370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:30.674370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:30.674370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:30.674370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:30.674370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:30.674370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:30.674370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:30.674370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:30.674370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:30.674370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:30.674370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:30.674370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:30.675478 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:30.675478 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:30.675478 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:30.675478 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:30.675478 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:30.675478 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:30.675478 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:30.675478 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:30.675478 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:30.675478 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:30.675478 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:30.675478 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:30.675478 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:30.675478 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:30.675478 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:30.675478 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:30.676333 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:30.676333 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:30.676333 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:30.676333 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:30.676333 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:30.676333 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:30.676333 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:30.676333 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:30.676333 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:30.676333 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:30.676333 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:44:30.676333 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:44:30.676333 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 73/151] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:44:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:44:30.681908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698456a-5823-4bef-8b28-70fce84912ae None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:30.699290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bdbeba-c985-4af9-a802-6370295cecf0 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:30.740469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8443c08-6a22-4fd8-9188-7e7c126caad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:30.741458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8443c08-6a22-4fd8-9188-7e7c126caad1 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:30.741920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8443c08-6a22-4fd8-9188-7e7c126caad1 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:30.742368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8443c08-6a22-4fd8-9188-7e7c126caad1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:30.743508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8443c08-6a22-4fd8-9188-7e7c126caad1 None admin] RBAC: Adding query filter params (role.id=c352110df5bc449b9134928abd20c032, scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240, user.id=1bde7f2d8d764aa8a711e0cf7801a350) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:30.743990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8443c08-6a22-4fd8-9188-7e7c126caad1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:30.745640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8443c08-6a22-4fd8-9188-7e7c126caad1 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:30.753522 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 79/152] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:44:30 2022] GET /identity/v3/role_assignments?user.id=1bde7f2d8d764aa8a711e0cf7801a350&scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240&role.id=c352110df5bc449b9134928abd20c032 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:30.821079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698456a-5823-4bef-8b28-70fce84912ae None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:30.873757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908bc6f-d73c-4b46-8f5b-36cd7f813543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:30.878184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908bc6f-d73c-4b46-8f5b-36cd7f813543 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:30.878184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908bc6f-d73c-4b46-8f5b-36cd7f813543 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:30.878184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908bc6f-d73c-4b46-8f5b-36cd7f813543 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:30.878184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908bc6f-d73c-4b46-8f5b-36cd7f813543 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:30.878184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908bc6f-d73c-4b46-8f5b-36cd7f813543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:30.878184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908bc6f-d73c-4b46-8f5b-36cd7f813543 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:30.888625 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 74/153] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:30.889833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:30.895161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8443c08-6a22-4fd8-9188-7e7c126caad1 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:30.991512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:31.026443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8443c08-6a22-4fd8-9188-7e7c126caad1 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:31.069584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a86f19-254f-4cb5-83f7-6cfeda7341c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:31.070474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a86f19-254f-4cb5-83f7-6cfeda7341c0 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:31.070755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a86f19-254f-4cb5-83f7-6cfeda7341c0 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:31.071079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a86f19-254f-4cb5-83f7-6cfeda7341c0 None admin] PATH_INFO: `/v3/users/d6cd66b16dc14b84918d5f636a683873` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:31.072359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a86f19-254f-4cb5-83f7-6cfeda7341c0 None admin] RBAC: Authorizing `identity:get_user(user_id=d6cd66b16dc14b84918d5f636a683873)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:31.073853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a86f19-254f-4cb5-83f7-6cfeda7341c0 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:31.075686 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 80/154] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:30 2022] GET /identity/v3/users/d6cd66b16dc14b84918d5f636a683873 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:31.082017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908bc6f-d73c-4b46-8f5b-36cd7f813543 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:31.212144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908bc6f-d73c-4b46-8f5b-36cd7f813543 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:31.252637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e0f13-890b-4e8a-91a9-83f34348d417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:31.253299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e0f13-890b-4e8a-91a9-83f34348d417 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:31.253586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e0f13-890b-4e8a-91a9-83f34348d417 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:31.253861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e0f13-890b-4e8a-91a9-83f34348d417 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:31.330448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:31.333357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e0f13-890b-4e8a-91a9-83f34348d417 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:31.334953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e0f13-890b-4e8a-91a9-83f34348d417 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:31.449938 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 75/155] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:44:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:44:31.456490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a86f19-254f-4cb5-83f7-6cfeda7341c0 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:31.578048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a86f19-254f-4cb5-83f7-6cfeda7341c0 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:31.618571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13172d72-8520-438d-94cb-1d3ac5b7c648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:31.619474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13172d72-8520-438d-94cb-1d3ac5b7c648 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:31.619783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13172d72-8520-438d-94cb-1d3ac5b7c648 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:31.620124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13172d72-8520-438d-94cb-1d3ac5b7c648 None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:31.621468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13172d72-8520-438d-94cb-1d3ac5b7c648 None admin] RBAC: Authorizing `identity:get_project(project_id=2ab6547ffe6648bd8a4ac2a99e702240)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:31.622958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13172d72-8520-438d-94cb-1d3ac5b7c648 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:31.625544 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 81/156] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:31 2022] GET /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:31.631817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e0f13-890b-4e8a-91a9-83f34348d417 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:31.819923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:31.825068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e0f13-890b-4e8a-91a9-83f34348d417 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:31.892573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279c4e3-e275-4dc4-a194-582867dc0293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:31.893609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279c4e3-e275-4dc4-a194-582867dc0293 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:31.894044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279c4e3-e275-4dc4-a194-582867dc0293 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:31.894477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279c4e3-e275-4dc4-a194-582867dc0293 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:31.895958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279c4e3-e275-4dc4-a194-582867dc0293 None admin] RBAC: Adding query filter params (role.id=bd33b827674a4d4db30c164cab416056, scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240, user.id=d6cd66b16dc14b84918d5f636a683873) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:31.896467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279c4e3-e275-4dc4-a194-582867dc0293 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:31.898922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279c4e3-e275-4dc4-a194-582867dc0293 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:31.910796 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 76/157] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:44:31 2022] GET /identity/v3/role_assignments?user.id=d6cd66b16dc14b84918d5f636a683873&scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240&role.id=bd33b827674a4d4db30c164cab416056 => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:32.414101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94ee98-2579-4f40-a3e5-d89f0f505bed None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:32.414433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94ee98-2579-4f40-a3e5-d89f0f505bed None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:32.414665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94ee98-2579-4f40-a3e5-d89f0f505bed None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:32.416097 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 82/158] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:32.417667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae775311-978a-4b76-8a60-c994785a493b None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:32.417964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae775311-978a-4b76-8a60-c994785a493b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:32.418238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae775311-978a-4b76-8a60-c994785a493b None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:32.419649 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 77/159] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:32.422474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1ad8f-26f9-4f1d-a5a3-590aa57148ba None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:32.422756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1ad8f-26f9-4f1d-a5a3-590aa57148ba None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:32.423052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1ad8f-26f9-4f1d-a5a3-590aa57148ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:32.430541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdef3d6-7b27-4d19-af9b-fe41c5e2f965 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:32.430848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdef3d6-7b27-4d19-af9b-fe41c5e2f965 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:32.431143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdef3d6-7b27-4d19-af9b-fe41c5e2f965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:32.454711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-74a1ad8f-26f9-4f1d-a5a3-590aa57148ba None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:32.463851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-74a1ad8f-26f9-4f1d-a5a3-590aa57148ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:32.467351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:32.477919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-bfdef3d6-7b27-4d19-af9b-fe41c5e2f965 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:32.479178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bfdef3d6-7b27-4d19-af9b-fe41c5e2f965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:32.605998 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 83/160] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:32.633375 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 78/161] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:32.651406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1ad8f-26f9-4f1d-a5a3-590aa57148ba None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:32.678149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdef3d6-7b27-4d19-af9b-fe41c5e2f965 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:32.821428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1ad8f-26f9-4f1d-a5a3-590aa57148ba None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:32.877732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef4e66-db56-44c3-88c4-c826cd123f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:32.878820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef4e66-db56-44c3-88c4-c826cd123f62 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:32.879275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef4e66-db56-44c3-88c4-c826cd123f62 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:32.879719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef4e66-db56-44c3-88c4-c826cd123f62 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:32.897242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:32.902353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef4e66-db56-44c3-88c4-c826cd123f62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:32.905501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:32.917654 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-a0ef4e66-db56-44c3-88c4-c826cd123f62 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 16 20:44:32.917654 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:32.917654 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:32.917654 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:32.917654 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:32.917654 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:32.917654 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:32.917654 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:32.917654 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:32.917654 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:32.917654 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:32.917654 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:32.917654 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:32.917654 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:32.917654 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:32.917654 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:32.918579 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:32.918579 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:32.918579 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:32.918579 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:32.918579 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:32.918579 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:32.918579 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:32.918579 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:32.918579 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:32.918579 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:32.918579 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:32.918579 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:32.918579 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:32.918579 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:32.918579 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:32.918579 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:32.919416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:32.919416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:32.919416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:32.919416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:32.919416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:32.919416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:32.919416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:32.919416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:32.919416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:32.919416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:32.919416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 16 20:44:32.919416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:32.920072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdef3d6-7b27-4d19-af9b-fe41c5e2f965 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:32.928774 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 84/162] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:32.930026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef4e66-db56-44c3-88c4-c826cd123f62 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:33.004002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82398f-1753-4db0-9552-39c9c939f5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:33.004846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82398f-1753-4db0-9552-39c9c939f5ce None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:33.005133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82398f-1753-4db0-9552-39c9c939f5ce None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:33.005475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82398f-1753-4db0-9552-39c9c939f5ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:33.031038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82398f-1753-4db0-9552-39c9c939f5ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:33.040861 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-ac82398f-1753-4db0-9552-39c9c939f5ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:33.040861 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:33.040861 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:33.040861 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:33.040861 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:33.040861 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:33.040861 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:33.040861 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:33.040861 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:33.040861 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:33.040861 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:33.040861 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:33.040861 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:33.040861 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:33.040861 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:33.040861 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:33.041792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:33.041792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:33.041792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:33.041792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:33.041792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:33.041792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:33.041792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:33.041792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:33.041792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:33.041792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:33.041792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:33.041792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:33.041792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:33.041792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:33.041792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:33.041792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:33.042544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:33.042544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:33.042544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:33.042544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:33.042544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:33.042544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:33.042544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:33.042544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:33.042544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:33.042544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:33.042544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:33.042544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:44:33.042544 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 79/163] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:44:33.049298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82398f-1753-4db0-9552-39c9c939f5ce None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:33.122358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef4e66-db56-44c3-88c4-c826cd123f62 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:33.179345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d307a2-467b-4c62-a7da-a21682cece3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:33.180427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d307a2-467b-4c62-a7da-a21682cece3e None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:33.180850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d307a2-467b-4c62-a7da-a21682cece3e None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:33.181285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d307a2-467b-4c62-a7da-a21682cece3e None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:33.182188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d307a2-467b-4c62-a7da-a21682cece3e None admin] RBAC: Adding query filter params (name=reader) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:33.182639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d307a2-467b-4c62-a7da-a21682cece3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:33.184589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d307a2-467b-4c62-a7da-a21682cece3e None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:33.202089 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 85/164] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:44:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:33.208244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d307a2-467b-4c62-a7da-a21682cece3e None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:33.291515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82398f-1753-4db0-9552-39c9c939f5ce None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:33.331996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee808f-c7e0-4360-91ea-94ff427bbcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:33.333076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee808f-c7e0-4360-91ea-94ff427bbcc1 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:33.333560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee808f-c7e0-4360-91ea-94ff427bbcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:33.334033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee808f-c7e0-4360-91ea-94ff427bbcc1 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:33.335053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee808f-c7e0-4360-91ea-94ff427bbcc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:33.335567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee808f-c7e0-4360-91ea-94ff427bbcc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:33.337177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee808f-c7e0-4360-91ea-94ff427bbcc1 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:33.349677 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 80/165] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:44:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:33.352763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1adbb-b86b-43a8-9a67-8f73f2d51905 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:33.354184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1adbb-b86b-43a8-9a67-8f73f2d51905 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:33.355361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1adbb-b86b-43a8-9a67-8f73f2d51905 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:33.355480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:33.362480 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 81/166] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:33 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:33.364026 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1adbb-b86b-43a8-9a67-8f73f2d51905 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:33.388465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:33.460777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d307a2-467b-4c62-a7da-a21682cece3e None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:33.540751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07ec96-f71f-48b4-aada-e14502ec9f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:33.542455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07ec96-f71f-48b4-aada-e14502ec9f56 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:33.542963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07ec96-f71f-48b4-aada-e14502ec9f56 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:33.543459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07ec96-f71f-48b4-aada-e14502ec9f56 None admin] PATH_INFO: `/v3/users/db34ffe5b44e441db17d98a64507a812` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:33.546722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07ec96-f71f-48b4-aada-e14502ec9f56 None admin] RBAC: Authorizing `identity:get_user(user_id=db34ffe5b44e441db17d98a64507a812)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:33.548550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07ec96-f71f-48b4-aada-e14502ec9f56 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:33.555050 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 86/167] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:33 2022] GET /identity/v3/users/db34ffe5b44e441db17d98a64507a812 => generated 289 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:33.556746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab9780-18d1-45ec-9896-e30a25aa3a51 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:33.559287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab9780-18d1-45ec-9896-e30a25aa3a51 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:33.562162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab9780-18d1-45ec-9896-e30a25aa3a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:33.566251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1adbb-b86b-43a8-9a67-8f73f2d51905 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:33.596049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1dab9780-18d1-45ec-9896-e30a25aa3a51 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:33.600660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1dab9780-18d1-45ec-9896-e30a25aa3a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:33.644916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1ff37-2b5f-46e8-94c2-00d19cd2c991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:33.646002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1ff37-2b5f-46e8-94c2-00d19cd2c991 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:33.646290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1ff37-2b5f-46e8-94c2-00d19cd2c991 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:33.646567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1ff37-2b5f-46e8-94c2-00d19cd2c991 None admin] PATH_INFO: `/v3/users/1bde7f2d8d764aa8a711e0cf7801a350` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:33.649927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba1ff37-2b5f-46e8-94c2-00d19cd2c991 None admin] RBAC: Authorizing `identity:get_user(user_id=1bde7f2d8d764aa8a711e0cf7801a350)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:33.651571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba1ff37-2b5f-46e8-94c2-00d19cd2c991 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:33.653425 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 82/168] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:33 2022] GET /identity/v3/users/1bde7f2d8d764aa8a711e0cf7801a350 => generated 275 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:33.654381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1ff37-2b5f-46e8-94c2-00d19cd2c991 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:33.685520 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 87/169] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:33.687604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab9780-18d1-45ec-9896-e30a25aa3a51 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:33.813295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:33.829992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:33.865093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1ff37-2b5f-46e8-94c2-00d19cd2c991 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:33.893755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab9780-18d1-45ec-9896-e30a25aa3a51 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:33.914050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea3eb0-b6aa-4c1b-abe3-194472e98b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:33.915102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea3eb0-b6aa-4c1b-abe3-194472e98b01 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:33.917660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea3eb0-b6aa-4c1b-abe3-194472e98b01 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:33.917660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea3eb0-b6aa-4c1b-abe3-194472e98b01 None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:33.917996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea3eb0-b6aa-4c1b-abe3-194472e98b01 None admin] RBAC: Authorizing `identity:get_project(project_id=2ab6547ffe6648bd8a4ac2a99e702240)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:33.919598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea3eb0-b6aa-4c1b-abe3-194472e98b01 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:33.923155 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 83/170] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:33 2022] GET /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:33.924211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea3eb0-b6aa-4c1b-abe3-194472e98b01 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:33.939405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afddddd-60f8-4568-a522-41bfe279f302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:33.940792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afddddd-60f8-4568-a522-41bfe279f302 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:33.941257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afddddd-60f8-4568-a522-41bfe279f302 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:33.941710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afddddd-60f8-4568-a522-41bfe279f302 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:34.027972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afddddd-60f8-4568-a522-41bfe279f302 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:34.029967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afddddd-60f8-4568-a522-41bfe279f302 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:34.065986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea3eb0-b6aa-4c1b-abe3-194472e98b01 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:34.100475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:34.113364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de8e44-ebbb-40a8-ace0-30961354b3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:34.121348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de8e44-ebbb-40a8-ace0-30961354b3cd None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:34.121348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de8e44-ebbb-40a8-ace0-30961354b3cd None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:34.121348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de8e44-ebbb-40a8-ace0-30961354b3cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:34.129408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de8e44-ebbb-40a8-ace0-30961354b3cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:34.140842 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-60de8e44-ebbb-40a8-ace0-30961354b3cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:44:34.140842 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:34.140842 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:34.140842 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:34.140842 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:34.140842 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:34.140842 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:34.140842 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:34.140842 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:34.140842 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:34.140842 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:34.140842 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:34.140842 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:34.140842 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:34.140842 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:34.140842 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:34.141888 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:34.141888 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:34.141888 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:34.141888 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:34.141888 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:34.141888 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:34.141888 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:34.141888 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:34.141888 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:34.141888 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:34.141888 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:34.141888 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:34.141888 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:34.141888 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:34.141888 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:34.141888 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:34.142813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:34.142813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:34.142813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:34.142813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:34.142813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:34.142813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:34.142813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:34.142813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:34.142813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:34.142813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:34.142813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:44:34.142813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:44:34.142813 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 84/171] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Jul 16 20:44:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:34.143717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f56e19-8d56-491e-90e3-2cec58cfbf92 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:34.144153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f56e19-8d56-491e-90e3-2cec58cfbf92 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:34.144652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f56e19-8d56-491e-90e3-2cec58cfbf92 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:34.146390 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 85/172] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:34.147256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f56e19-8d56-491e-90e3-2cec58cfbf92 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:34.169688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:34.171331 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 88/173] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:44:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:44:34.172653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afddddd-60f8-4568-a522-41bfe279f302 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:34.294520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f56e19-8d56-491e-90e3-2cec58cfbf92 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:34.297545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afddddd-60f8-4568-a522-41bfe279f302 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:34.341333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc3b50-1eeb-4ba0-a20b-39b8ed48854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:34.341706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f474d-200d-4fd3-b2bb-8f0fb57f5be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:34.341912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc3b50-1eeb-4ba0-a20b-39b8ed48854c None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:34.342195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc3b50-1eeb-4ba0-a20b-39b8ed48854c None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:34.342503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc3b50-1eeb-4ba0-a20b-39b8ed48854c None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:34.343324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc3b50-1eeb-4ba0-a20b-39b8ed48854c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:34.343632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc3b50-1eeb-4ba0-a20b-39b8ed48854c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:34.344666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f474d-200d-4fd3-b2bb-8f0fb57f5be7 None admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:34.344952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f474d-200d-4fd3-b2bb-8f0fb57f5be7 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:34.345056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc3b50-1eeb-4ba0-a20b-39b8ed48854c None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:34.345227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f474d-200d-4fd3-b2bb-8f0fb57f5be7 None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240/users/db34ffe5b44e441db17d98a64507a812/roles/4f9686ee5911427e8cca34c19a1b7513` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:34.347545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f474d-200d-4fd3-b2bb-8f0fb57f5be7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ab6547ffe6648bd8a4ac2a99e702240, user_id=db34ffe5b44e441db17d98a64507a812, role_id=4f9686ee5911427e8cca34c19a1b7513)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:34.348933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f474d-200d-4fd3-b2bb-8f0fb57f5be7 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:34.354995 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 89/174] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:44:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:34.356344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1503bff-c3ed-460b-8984-a8449b38ec2b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:34.356638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1503bff-c3ed-460b-8984-a8449b38ec2b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:34.356931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1503bff-c3ed-460b-8984-a8449b38ec2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:34.375514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f1503bff-c3ed-460b-8984-a8449b38ec2b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:34.376739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f1503bff-c3ed-460b-8984-a8449b38ec2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:34.392514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:34.422195 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 86/175] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:44:34 2022] PUT /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240/users/db34ffe5b44e441db17d98a64507a812/roles/4f9686ee5911427e8cca34c19a1b7513 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:44:34.422839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f474d-200d-4fd3-b2bb-8f0fb57f5be7 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:34.459422 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 90/176] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:34.461228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e798d-5202-4aba-a034-4f2c05ff0a97 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:34.461525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e798d-5202-4aba-a034-4f2c05ff0a97 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:34.461805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e798d-5202-4aba-a034-4f2c05ff0a97 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:34.463402 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 91/177] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:34.467801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e798d-5202-4aba-a034-4f2c05ff0a97 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:34.524182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:34.560006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f474d-200d-4fd3-b2bb-8f0fb57f5be7 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:34.600371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e798d-5202-4aba-a034-4f2c05ff0a97 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:34.606364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802911fd-f1d0-44aa-8115-4d997b0af406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:34.607238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802911fd-f1d0-44aa-8115-4d997b0af406 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:34.607542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802911fd-f1d0-44aa-8115-4d997b0af406 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:34.607902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802911fd-f1d0-44aa-8115-4d997b0af406 None admin] PATH_INFO: `/v3/projects/cf0c1379a3514566bd875783e3192946` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:34.613740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802911fd-f1d0-44aa-8115-4d997b0af406 None admin] RBAC: Authorizing `identity:get_project(project_id=cf0c1379a3514566bd875783e3192946)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:34.615051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802911fd-f1d0-44aa-8115-4d997b0af406 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:34.617939 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 87/178] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:34 2022] GET /identity/v3/projects/cf0c1379a3514566bd875783e3192946 => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:34.620476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567aa12-3ca0-4d95-bb9e-0a932677ce50 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:34.623480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567aa12-3ca0-4d95-bb9e-0a932677ce50 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:34.624331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567aa12-3ca0-4d95-bb9e-0a932677ce50 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:34.626374 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 88/179] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:34.627511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d53d13-40a9-4409-870c-dd7b5f0abf6a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:34.627791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d53d13-40a9-4409-870c-dd7b5f0abf6a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:34.628129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d53d13-40a9-4409-870c-dd7b5f0abf6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:34.646640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c3d53d13-40a9-4409-870c-dd7b5f0abf6a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:34.647904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c3d53d13-40a9-4409-870c-dd7b5f0abf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:34.650671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed575efe-e692-4818-babb-e730c4fa101b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:34.651689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed575efe-e692-4818-babb-e730c4fa101b None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:34.653629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed575efe-e692-4818-babb-e730c4fa101b None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:34.653629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed575efe-e692-4818-babb-e730c4fa101b None admin] PATH_INFO: `/v3/users/1bde7f2d8d764aa8a711e0cf7801a350` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:34.653629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed575efe-e692-4818-babb-e730c4fa101b None admin] RBAC: Authorizing `identity:get_user(user_id=1bde7f2d8d764aa8a711e0cf7801a350)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:34.654856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed575efe-e692-4818-babb-e730c4fa101b None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:34.656779 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 92/180] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:34 2022] GET /identity/v3/users/1bde7f2d8d764aa8a711e0cf7801a350 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:34.657361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed575efe-e692-4818-babb-e730c4fa101b None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:34.682669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:34.729769 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 89/181] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:34.731453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537c8db-bb91-46ac-98aa-c80962db1d28 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:34.731942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537c8db-bb91-46ac-98aa-c80962db1d28 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:34.732421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537c8db-bb91-46ac-98aa-c80962db1d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:34.756651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5537c8db-bb91-46ac-98aa-c80962db1d28 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:34.759119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5537c8db-bb91-46ac-98aa-c80962db1d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:34.783911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed575efe-e692-4818-babb-e730c4fa101b None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:34.825481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a132ecd-5f80-499a-b36a-de623c4d6f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:34.826338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a132ecd-5f80-499a-b36a-de623c4d6f5d None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:34.826646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a132ecd-5f80-499a-b36a-de623c4d6f5d None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:34.826932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a132ecd-5f80-499a-b36a-de623c4d6f5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:34.830581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:34.835489 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 90/182] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:34.843742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537c8db-bb91-46ac-98aa-c80962db1d28 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:34.849862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a132ecd-5f80-499a-b36a-de623c4d6f5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:34.861509 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-7a132ecd-5f80-499a-b36a-de623c4d6f5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:44:34.861509 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:34.861509 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:34.861509 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:34.861509 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:34.861509 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:34.861509 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:34.861509 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:34.861509 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:34.861509 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:34.861509 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:34.861509 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:34.861509 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:34.861509 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:34.861509 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:34.861509 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:34.862388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:34.862388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:34.862388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:34.862388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:34.862388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:34.862388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:34.862388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:34.862388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:34.862388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:34.862388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:34.862388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:34.862388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:34.862388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:34.862388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:34.862388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:34.862388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:34.863204 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:34.863204 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:34.863204 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:34.863204 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:34.863204 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:34.863204 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:34.863204 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:34.863204 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:34.863204 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:34.863204 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:34.863204 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:44:34.863204 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:34.867811 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 93/183] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:44:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:34.868719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a132ecd-5f80-499a-b36a-de623c4d6f5d None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:34.961672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537c8db-bb91-46ac-98aa-c80962db1d28 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:34.965856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:34.992412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a132ecd-5f80-499a-b36a-de623c4d6f5d None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:35.003428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e2683-be0a-4a60-9473-8ad32aeda1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:35.004087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e2683-be0a-4a60-9473-8ad32aeda1c4 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:35.004372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e2683-be0a-4a60-9473-8ad32aeda1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:35.004648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e2683-be0a-4a60-9473-8ad32aeda1c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:35.005613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e2683-be0a-4a60-9473-8ad32aeda1c4 None admin] RBAC: Adding query filter params (role.id=c352110df5bc449b9134928abd20c032, scope.project.id=cf0c1379a3514566bd875783e3192946, user.id=1bde7f2d8d764aa8a711e0cf7801a350) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:35.005930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e2683-be0a-4a60-9473-8ad32aeda1c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:35.007398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e2683-be0a-4a60-9473-8ad32aeda1c4 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:35.021150 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 91/184] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:44:34 2022] GET /identity/v3/role_assignments?user.id=1bde7f2d8d764aa8a711e0cf7801a350&scope.project.id=cf0c1379a3514566bd875783e3192946&role.id=c352110df5bc449b9134928abd20c032 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:35.021150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e2683-be0a-4a60-9473-8ad32aeda1c4 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:35.044730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759f71c-d03e-46a3-9f4c-780a56518588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:35.045590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759f71c-d03e-46a3-9f4c-780a56518588 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:35.045871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759f71c-d03e-46a3-9f4c-780a56518588 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:35.046141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759f71c-d03e-46a3-9f4c-780a56518588 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:35.107608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:35.152876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e2683-be0a-4a60-9473-8ad32aeda1c4 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:35.153632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759f71c-d03e-46a3-9f4c-780a56518588 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:35.155300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759f71c-d03e-46a3-9f4c-780a56518588 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:35.192573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a286b-d5f2-459f-b2cb-1b8287d352c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:35.193398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a286b-d5f2-459f-b2cb-1b8287d352c1 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:35.193695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a286b-d5f2-459f-b2cb-1b8287d352c1 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:35.193940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a286b-d5f2-459f-b2cb-1b8287d352c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:35.207225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a286b-d5f2-459f-b2cb-1b8287d352c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:35.215661 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-178a286b-d5f2-459f-b2cb-1b8287d352c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:44:35.215661 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:35.215661 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:35.215661 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:35.215661 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:35.215661 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:35.215661 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:35.215661 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:35.215661 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:35.215661 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:35.215661 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:35.215661 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:35.215661 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:35.215661 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:35.215661 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:35.215661 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:35.216592 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:35.216592 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:35.216592 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:35.216592 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:35.216592 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:35.216592 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:35.216592 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:35.216592 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:35.216592 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:35.216592 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:35.216592 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:35.216592 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:35.216592 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:35.216592 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:35.216592 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:35.216592 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:35.217585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:35.217585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:35.217585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:35.217585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:35.217585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:35.217585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:35.217585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:35.217585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:35.217585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:35.217585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:35.217585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:44:35.217585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:44:35.222112 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 92/185] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Jul 16 20:44:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:35.223176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a286b-d5f2-459f-b2cb-1b8287d352c1 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:35.251498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:35.284610 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 94/186] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:44:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:44:35.286542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759f71c-d03e-46a3-9f4c-780a56518588 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:35.354042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a286b-d5f2-459f-b2cb-1b8287d352c1 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:35.382313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:35.393160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a4d3c-31b0-4566-b44f-0dbfaf54c6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:35.395760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a4d3c-31b0-4566-b44f-0dbfaf54c6c1 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:35.395760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a4d3c-31b0-4566-b44f-0dbfaf54c6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:35.395760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a4d3c-31b0-4566-b44f-0dbfaf54c6c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:35.395997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a4d3c-31b0-4566-b44f-0dbfaf54c6c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:35.397383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a4d3c-31b0-4566-b44f-0dbfaf54c6c1 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:35.403591 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 93/187] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:44:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:35.403591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a4d3c-31b0-4566-b44f-0dbfaf54c6c1 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:35.417937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759f71c-d03e-46a3-9f4c-780a56518588 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:35.459079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a731b8a-da67-4102-825c-44185f2fb7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:35.459746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a731b8a-da67-4102-825c-44185f2fb7f4 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:35.460025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a731b8a-da67-4102-825c-44185f2fb7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:35.460298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a731b8a-da67-4102-825c-44185f2fb7f4 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:35.461044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a731b8a-da67-4102-825c-44185f2fb7f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:35.461344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a731b8a-da67-4102-825c-44185f2fb7f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:35.462721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a731b8a-da67-4102-825c-44185f2fb7f4 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:35.471684 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 95/188] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:35.477409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a731b8a-da67-4102-825c-44185f2fb7f4 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:35.523807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a4d3c-31b0-4566-b44f-0dbfaf54c6c1 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:35.524009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:35.561378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9b346-9d7f-4277-a709-75e6ec7feb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:35.562040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9b346-9d7f-4277-a709-75e6ec7feb35 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:35.562323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9b346-9d7f-4277-a709-75e6ec7feb35 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:35.562605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9b346-9d7f-4277-a709-75e6ec7feb35 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:35.563383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9b346-9d7f-4277-a709-75e6ec7feb35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:35.563734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9b346-9d7f-4277-a709-75e6ec7feb35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:35.565204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9b346-9d7f-4277-a709-75e6ec7feb35 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:35.574708 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 94/189] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:44:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:35.575572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9b346-9d7f-4277-a709-75e6ec7feb35 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:35.592324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a731b8a-da67-4102-825c-44185f2fb7f4 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:35.632876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e7a9a-ceab-48a0-b7d6-fb76e5da4323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:35.634539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e7a9a-ceab-48a0-b7d6-fb76e5da4323 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:35.635053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e7a9a-ceab-48a0-b7d6-fb76e5da4323 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:35.635507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e7a9a-ceab-48a0-b7d6-fb76e5da4323 None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:35.636899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e7a9a-ceab-48a0-b7d6-fb76e5da4323 None admin] RBAC: Authorizing `identity:get_project(project_id=2ab6547ffe6648bd8a4ac2a99e702240)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:35.638532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e7a9a-ceab-48a0-b7d6-fb76e5da4323 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:35.641153 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 96/190] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:35 2022] GET /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:35.646431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:35.646536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e7a9a-ceab-48a0-b7d6-fb76e5da4323 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:35.699089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9b346-9d7f-4277-a709-75e6ec7feb35 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:35.740911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362e061-33d4-4b98-a189-83d0ca35a303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:35.741575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362e061-33d4-4b98-a189-83d0ca35a303 None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:35.741860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362e061-33d4-4b98-a189-83d0ca35a303 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:35.742122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362e061-33d4-4b98-a189-83d0ca35a303 None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:35.742922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362e061-33d4-4b98-a189-83d0ca35a303 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:35.744398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362e061-33d4-4b98-a189-83d0ca35a303 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:35.758016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e7a9a-ceab-48a0-b7d6-fb76e5da4323 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:35.768450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:35.798944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b101066-0544-40fb-a721-ee6b2b36afa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:35.799851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b101066-0544-40fb-a721-ee6b2b36afa7 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:35.800131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b101066-0544-40fb-a721-ee6b2b36afa7 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:35.800405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b101066-0544-40fb-a721-ee6b2b36afa7 None admin] PATH_INFO: `/v3/users/882661b19038409aadb0df7da22f35a3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:35.814305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b101066-0544-40fb-a721-ee6b2b36afa7 None admin] RBAC: Authorizing `identity:get_user(user_id=882661b19038409aadb0df7da22f35a3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:35.815828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b101066-0544-40fb-a721-ee6b2b36afa7 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:35.817533 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 97/191] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:35 2022] GET /identity/v3/users/882661b19038409aadb0df7da22f35a3 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:35.818296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b101066-0544-40fb-a721-ee6b2b36afa7 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:35.890669 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 95/192] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Jul 16 20:44:35 2022] POST /identity/v3/users => generated 297 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:44:35.899444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362e061-33d4-4b98-a189-83d0ca35a303 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:35.954035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b101066-0544-40fb-a721-ee6b2b36afa7 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:36.002400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd37a56-9374-47c9-9db3-e6bd35d5bc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:36.003456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd37a56-9374-47c9-9db3-e6bd35d5bc0c None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:36.003814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd37a56-9374-47c9-9db3-e6bd35d5bc0c None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:36.004162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd37a56-9374-47c9-9db3-e6bd35d5bc0c None admin] PATH_INFO: `/v3/users/882661b19038409aadb0df7da22f35a3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:36.005599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd37a56-9374-47c9-9db3-e6bd35d5bc0c None admin] RBAC: Authorizing `identity:get_user(user_id=882661b19038409aadb0df7da22f35a3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:36.007254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd37a56-9374-47c9-9db3-e6bd35d5bc0c None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:36.009222 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 98/193] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:35 2022] GET /identity/v3/users/882661b19038409aadb0df7da22f35a3 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:36.009966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd37a56-9374-47c9-9db3-e6bd35d5bc0c None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:36.046367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362e061-33d4-4b98-a189-83d0ca35a303 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:36.060083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:36.063193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:36.090146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8b650-eaf6-4b6b-99e2-ebf05fb824bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:36.090827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8b650-eaf6-4b6b-99e2-ebf05fb824bd None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:36.091163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8b650-eaf6-4b6b-99e2-ebf05fb824bd None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:36.091482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8b650-eaf6-4b6b-99e2-ebf05fb824bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:36.092966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8b650-eaf6-4b6b-99e2-ebf05fb824bd None admin] RBAC: Adding query filter params (role.id=b9444da176484ccfa45d6b85220ce558, scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240, user.id=1bde7f2d8d764aa8a711e0cf7801a350) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:36.094125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8b650-eaf6-4b6b-99e2-ebf05fb824bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:36.095078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8b650-eaf6-4b6b-99e2-ebf05fb824bd None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:36.103458 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 96/194] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:44:35 2022] GET /identity/v3/role_assignments?user.id=1bde7f2d8d764aa8a711e0cf7801a350&scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240&role.id=b9444da176484ccfa45d6b85220ce558 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:36.104404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8b650-eaf6-4b6b-99e2-ebf05fb824bd None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:36.161056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd37a56-9374-47c9-9db3-e6bd35d5bc0c None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:36.221499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efe8d1-8ec7-4a36-aaa5-30e207813b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:36.222565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efe8d1-8ec7-4a36-aaa5-30e207813b2e None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:36.223715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efe8d1-8ec7-4a36-aaa5-30e207813b2e None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:36.224142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efe8d1-8ec7-4a36-aaa5-30e207813b2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:36.238692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8b650-eaf6-4b6b-99e2-ebf05fb824bd None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:36.284556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b9e56-91a9-41b4-8e34-9ad7ba047f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:36.285431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b9e56-91a9-41b4-8e34-9ad7ba047f8c None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:36.285820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b9e56-91a9-41b4-8e34-9ad7ba047f8c None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:36.286218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b9e56-91a9-41b4-8e34-9ad7ba047f8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:36.328273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efe8d1-8ec7-4a36-aaa5-30e207813b2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:36.330588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efe8d1-8ec7-4a36-aaa5-30e207813b2e None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:36.346372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:36.372882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:36.378559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b9e56-91a9-41b4-8e34-9ad7ba047f8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:36.380243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b9e56-91a9-41b4-8e34-9ad7ba047f8c None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:36.487123 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 99/195] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:44:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:44:36.494834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efe8d1-8ec7-4a36-aaa5-30e207813b2e None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:36.551296 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 97/196] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:44:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:44:36.557367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b9e56-91a9-41b4-8e34-9ad7ba047f8c None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:36.641461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efe8d1-8ec7-4a36-aaa5-30e207813b2e None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:36.668713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:36.720905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15c03a-940a-419c-97a4-4f72e157794e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:36.723337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c03a-940a-419c-97a4-4f72e157794e None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:36.723614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c03a-940a-419c-97a4-4f72e157794e None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:36.723890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c03a-940a-419c-97a4-4f72e157794e None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:36.726648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b9e56-91a9-41b4-8e34-9ad7ba047f8c None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:36.727576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15c03a-940a-419c-97a4-4f72e157794e None admin] RBAC: Authorizing `identity:get_project(project_id=10517c754ba94c1d893d97627d31b9f0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:36.730882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15c03a-940a-419c-97a4-4f72e157794e None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:36.733455 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 100/197] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:36 2022] GET /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:36.742201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15c03a-940a-419c-97a4-4f72e157794e None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:36.748311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:36.787584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab720d3-55dd-4172-adee-53d82af582ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:36.788679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab720d3-55dd-4172-adee-53d82af582ac None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:36.788989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab720d3-55dd-4172-adee-53d82af582ac None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:36.789267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab720d3-55dd-4172-adee-53d82af582ac None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:36.790681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab720d3-55dd-4172-adee-53d82af582ac None admin] RBAC: Authorizing `identity:get_project(project_id=10517c754ba94c1d893d97627d31b9f0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:36.795038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab720d3-55dd-4172-adee-53d82af582ac None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:36.795038 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 98/198] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:36 2022] GET /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:36.801728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab720d3-55dd-4172-adee-53d82af582ac None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:36.926672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab720d3-55dd-4172-adee-53d82af582ac None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:36.951832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15c03a-940a-419c-97a4-4f72e157794e None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:36.975854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73b136-9dcb-45a6-a3b9-c967982a844c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:36.977160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73b136-9dcb-45a6-a3b9-c967982a844c None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:36.981937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73b136-9dcb-45a6-a3b9-c967982a844c None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:36.981937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73b136-9dcb-45a6-a3b9-c967982a844c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:36.981937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73b136-9dcb-45a6-a3b9-c967982a844c None admin] RBAC: Adding query filter params (role.id=b9444da176484ccfa45d6b85220ce558, scope.project.id=10517c754ba94c1d893d97627d31b9f0, user.id=882661b19038409aadb0df7da22f35a3) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:36.981937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73b136-9dcb-45a6-a3b9-c967982a844c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:36.981937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73b136-9dcb-45a6-a3b9-c967982a844c None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:36.996663 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 99/199] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:44:36 2022] GET /identity/v3/role_assignments?user.id=882661b19038409aadb0df7da22f35a3&scope.project.id=10517c754ba94c1d893d97627d31b9f0&role.id=b9444da176484ccfa45d6b85220ce558 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:36.998170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba64375-0e00-4e98-9fa7-2541e0babca7 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:36.999494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba64375-0e00-4e98-9fa7-2541e0babca7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:36.999999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba64375-0e00-4e98-9fa7-2541e0babca7 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:37.001511 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 100/200] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:37.008017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f3e5-ebbf-4fe0-9d9d-5813862dd003 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:37.008334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f3e5-ebbf-4fe0-9d9d-5813862dd003 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:37.008581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f3e5-ebbf-4fe0-9d9d-5813862dd003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:37.010980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e1777-4215-4652-ada0-37c69d626106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:37.011775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e1777-4215-4652-ada0-37c69d626106 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:37.012055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e1777-4215-4652-ada0-37c69d626106 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:37.012322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e1777-4215-4652-ada0-37c69d626106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:37.013234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e1777-4215-4652-ada0-37c69d626106 None admin] RBAC: Adding query filter params (role.id=bd33b827674a4d4db30c164cab416056, scope.project.id=10517c754ba94c1d893d97627d31b9f0, user.id=882661b19038409aadb0df7da22f35a3) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:37.013553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e1777-4215-4652-ada0-37c69d626106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:37.016139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e1777-4215-4652-ada0-37c69d626106 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:37.033309 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 101/201] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:44:36 2022] GET /identity/v3/role_assignments?user.id=882661b19038409aadb0df7da22f35a3&scope.project.id=10517c754ba94c1d893d97627d31b9f0&role.id=bd33b827674a4d4db30c164cab416056 => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:37.034148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:37.049464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d053f3e5-ebbf-4fe0-9d9d-5813862dd003 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:37.051569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d053f3e5-ebbf-4fe0-9d9d-5813862dd003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:37.183469 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 101/202] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:37.221403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e1777-4215-4652-ada0-37c69d626106 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:37.302800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:37.364641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e1777-4215-4652-ada0-37c69d626106 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:37.422341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a850694-f695-451f-be14-0d1b707dd03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:37.423170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a850694-f695-451f-be14-0d1b707dd03f None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:37.423449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a850694-f695-451f-be14-0d1b707dd03f None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:37.423716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a850694-f695-451f-be14-0d1b707dd03f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:37.435318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a850694-f695-451f-be14-0d1b707dd03f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:37.444041 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-5a850694-f695-451f-be14-0d1b707dd03f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 16 20:44:37.444041 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:37.444041 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:37.444041 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:37.444041 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:37.444041 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:37.444041 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:37.444041 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:37.444041 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:37.444041 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:37.444041 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:37.444041 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:37.444041 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:37.444041 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:37.444041 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:37.444041 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:37.444922 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:37.444922 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:37.444922 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:37.444922 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:37.444922 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:37.444922 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:37.444922 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:37.444922 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:37.444922 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:37.444922 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:37.444922 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:37.444922 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:37.444922 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:37.444922 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:37.444922 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:37.444922 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:37.445767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:37.445767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:37.445767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:37.445767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:37.445767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:37.445767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:37.445767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:37.445767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:37.445767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:37.445767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:37.445767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 16 20:44:37.445767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:37.446349 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 102/203] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:37.452460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053f3e5-ebbf-4fe0-9d9d-5813862dd003 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:37.583002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053f3e5-ebbf-4fe0-9d9d-5813862dd003 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:37.632370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d679a-9e8f-4977-aa4a-1466a085a16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:37.633054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d679a-9e8f-4977-aa4a-1466a085a16b None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:37.633332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d679a-9e8f-4977-aa4a-1466a085a16b None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:37.633603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d679a-9e8f-4977-aa4a-1466a085a16b None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:37.634357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d679a-9e8f-4977-aa4a-1466a085a16b None admin] RBAC: Adding query filter params (name=reader) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:37.634660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d679a-9e8f-4977-aa4a-1466a085a16b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:37.636065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d679a-9e8f-4977-aa4a-1466a085a16b None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:37.640836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:37.647651 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 102/204] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:44:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:37.653445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a850694-f695-451f-be14-0d1b707dd03f None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:37.784015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a850694-f695-451f-be14-0d1b707dd03f None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:37.827591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:37.834628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c369d2-ba0f-48a5-994d-b646cbcae94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:37.835463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c369d2-ba0f-48a5-994d-b646cbcae94f None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:37.835743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c369d2-ba0f-48a5-994d-b646cbcae94f None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:37.836021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c369d2-ba0f-48a5-994d-b646cbcae94f None admin] PATH_INFO: `/v3/users/db34ffe5b44e441db17d98a64507a812` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:37.841281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c369d2-ba0f-48a5-994d-b646cbcae94f None admin] RBAC: Authorizing `identity:get_user(user_id=db34ffe5b44e441db17d98a64507a812)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:37.841281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c369d2-ba0f-48a5-994d-b646cbcae94f None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:37.843831 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 103/205] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:37 2022] GET /identity/v3/users/db34ffe5b44e441db17d98a64507a812 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:37.849148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d679a-9e8f-4977-aa4a-1466a085a16b None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:38.003176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d679a-9e8f-4977-aa4a-1466a085a16b None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:38.054468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8b37b-56ac-4ab0-a4b1-176b09c0ab2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:38.055163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8b37b-56ac-4ab0-a4b1-176b09c0ab2b None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:38.055443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8b37b-56ac-4ab0-a4b1-176b09c0ab2b None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:38.055719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8b37b-56ac-4ab0-a4b1-176b09c0ab2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:38.137629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:38.143614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8b37b-56ac-4ab0-a4b1-176b09c0ab2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:38.145091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8b37b-56ac-4ab0-a4b1-176b09c0ab2b None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:38.274977 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 103/206] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:44:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:44:38.280988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c369d2-ba0f-48a5-994d-b646cbcae94f None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:38.423304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c369d2-ba0f-48a5-994d-b646cbcae94f None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:38.474525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e65efc-b0f9-4690-bda2-5a59953e5178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:38.475414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e65efc-b0f9-4690-bda2-5a59953e5178 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:38.475697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e65efc-b0f9-4690-bda2-5a59953e5178 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:38.475969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e65efc-b0f9-4690-bda2-5a59953e5178 None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:38.477175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e65efc-b0f9-4690-bda2-5a59953e5178 None admin] RBAC: Authorizing `identity:get_project(project_id=2ab6547ffe6648bd8a4ac2a99e702240)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:38.478632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e65efc-b0f9-4690-bda2-5a59953e5178 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:38.480722 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 104/207] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:38 2022] GET /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:38.486958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8b37b-56ac-4ab0-a4b1-176b09c0ab2b None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:38.626739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:38.630939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8b37b-56ac-4ab0-a4b1-176b09c0ab2b None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:38.688842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e69f58-7a1c-4b94-b4d5-4d50281bda4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:38.689432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e69f58-7a1c-4b94-b4d5-4d50281bda4d None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:38.689718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e69f58-7a1c-4b94-b4d5-4d50281bda4d None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:38.689993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e69f58-7a1c-4b94-b4d5-4d50281bda4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:38.690838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e69f58-7a1c-4b94-b4d5-4d50281bda4d None admin] RBAC: Adding query filter params (role.id=4f9686ee5911427e8cca34c19a1b7513, scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240, user.id=db34ffe5b44e441db17d98a64507a812) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:38.691173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e69f58-7a1c-4b94-b4d5-4d50281bda4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:38.692636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e69f58-7a1c-4b94-b4d5-4d50281bda4d None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:38.704833 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 104/208] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:44:38 2022] GET /identity/v3/role_assignments?user.id=db34ffe5b44e441db17d98a64507a812&scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240&role.id=4f9686ee5911427e8cca34c19a1b7513 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:39.061825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2adecc-0b9e-4a00-bd0b-f073c610136a None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:39.062596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2adecc-0b9e-4a00-bd0b-f073c610136a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:39.062596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2adecc-0b9e-4a00-bd0b-f073c610136a None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:39.064113 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 105/209] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:39.070528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171e342-0860-45a6-89bc-f51e5ccc36b6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:39.070966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171e342-0860-45a6-89bc-f51e5ccc36b6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:39.071101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171e342-0860-45a6-89bc-f51e5ccc36b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:39.089800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8171e342-0860-45a6-89bc-f51e5ccc36b6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:39.091097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8171e342-0860-45a6-89bc-f51e5ccc36b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:39.179090 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 105/210] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:39.208699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2adecc-0b9e-4a00-bd0b-f073c610136a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:39.289598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:39.339000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2adecc-0b9e-4a00-bd0b-f073c610136a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:39.382265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef5120-5703-4511-aa99-a6549ee26667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:39.383113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef5120-5703-4511-aa99-a6549ee26667 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:39.383398 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef5120-5703-4511-aa99-a6549ee26667 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:39.383669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef5120-5703-4511-aa99-a6549ee26667 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:39.396458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef5120-5703-4511-aa99-a6549ee26667 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:39.400906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f3261-18df-4868-a8d0-436849d2756d None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:39.401200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f3261-18df-4868-a8d0-436849d2756d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:39.401485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f3261-18df-4868-a8d0-436849d2756d None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:39.403169 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 106/211] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:39.405079 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-00ef5120-5703-4511-aa99-a6549ee26667 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:39.405079 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:39.405079 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:39.405079 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:39.405079 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:39.405079 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:39.405079 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:39.405079 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:39.405079 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:39.405079 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:39.405079 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:39.405079 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:39.405079 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:39.405079 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:39.405079 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:39.405079 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:39.405908 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:39.405908 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:39.405908 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:39.405908 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:39.405908 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:39.405908 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:39.405908 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:39.405908 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:39.405908 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:39.405908 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:39.405908 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:39.405908 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:39.405908 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:39.405908 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:39.405908 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:39.405908 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:39.406669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:39.406669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:39.406669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:39.406669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:39.406669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:39.406669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:39.406669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:39.406669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:39.406669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:39.406669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:39.406669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:39.406669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:39.410841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9c24e-fea8-4330-a610-f14d3edec96e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:39.411178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9c24e-fea8-4330-a610-f14d3edec96e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:39.411355 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 106/212] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:39.411848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9c24e-fea8-4330-a610-f14d3edec96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:39.412488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef5120-5703-4511-aa99-a6549ee26667 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:39.429046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-42b9c24e-fea8-4330-a610-f14d3edec96e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:39.430250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-42b9c24e-fea8-4330-a610-f14d3edec96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:39.506343 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 107/213] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 16 20:44:39.521465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef5120-5703-4511-aa99-a6549ee26667 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:39.533017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9c24e-fea8-4330-a610-f14d3edec96e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:39.547395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:39.558401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85131230-0145-4c50-a5b3-ce865ad8541b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:39.559112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85131230-0145-4c50-a5b3-ce865ad8541b None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:39.559652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85131230-0145-4c50-a5b3-ce865ad8541b None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:39.559928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85131230-0145-4c50-a5b3-ce865ad8541b None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:39.560462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:39.560766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85131230-0145-4c50-a5b3-ce865ad8541b None admin] RBAC: Adding query filter params (name=member) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:39.561600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85131230-0145-4c50-a5b3-ce865ad8541b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:39.563073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85131230-0145-4c50-a5b3-ce865ad8541b None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:39.573481 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 107/214] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:44:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:39.580853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85131230-0145-4c50-a5b3-ce865ad8541b None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:39.647596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9c24e-fea8-4330-a610-f14d3edec96e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:39.685615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f072372-89ce-4b4c-8072-5a5879a9a104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:39.687564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f072372-89ce-4b4c-8072-5a5879a9a104 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:39.687929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f072372-89ce-4b4c-8072-5a5879a9a104 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:39.688234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f072372-89ce-4b4c-8072-5a5879a9a104 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:39.689591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f072372-89ce-4b4c-8072-5a5879a9a104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:39.691303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f072372-89ce-4b4c-8072-5a5879a9a104 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:39.692037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85131230-0145-4c50-a5b3-ce865ad8541b None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:39.697996 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 108/215] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:44:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:39.698920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f072372-89ce-4b4c-8072-5a5879a9a104 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:39.730664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b156b48-0349-4fae-a002-b86481a2c812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:39.731544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b156b48-0349-4fae-a002-b86481a2c812 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:39.731825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b156b48-0349-4fae-a002-b86481a2c812 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:39.732105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b156b48-0349-4fae-a002-b86481a2c812 None admin] PATH_INFO: `/v3/users/45aab6c3983f4f77b4a759c9d4e0a718` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:39.750007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b156b48-0349-4fae-a002-b86481a2c812 None admin] RBAC: Authorizing `identity:get_user(user_id=45aab6c3983f4f77b4a759c9d4e0a718)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:39.751725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b156b48-0349-4fae-a002-b86481a2c812 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:39.753754 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 108/216] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:39 2022] GET /identity/v3/users/45aab6c3983f4f77b4a759c9d4e0a718 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:39.759557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b156b48-0349-4fae-a002-b86481a2c812 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:39.803478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:39.815455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:39.815647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f072372-89ce-4b4c-8072-5a5879a9a104 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:39.854784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b1c41-63a4-4885-84ee-7e813a176847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:39.855595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b1c41-63a4-4885-84ee-7e813a176847 None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:39.855950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b1c41-63a4-4885-84ee-7e813a176847 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:39.856299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b1c41-63a4-4885-84ee-7e813a176847 None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:39.857131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b1c41-63a4-4885-84ee-7e813a176847 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:39.859231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b1c41-63a4-4885-84ee-7e813a176847 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:39.876723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b156b48-0349-4fae-a002-b86481a2c812 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:39.914738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a4b51-1494-4575-a5d5-3f0ffbf4244a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:39.915317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a4b51-1494-4575-a5d5-3f0ffbf4244a None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:39.915600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a4b51-1494-4575-a5d5-3f0ffbf4244a None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:39.915894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a4b51-1494-4575-a5d5-3f0ffbf4244a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:39.976465 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 109/217] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Jul 16 20:44:39 2022] POST /identity/v3/users => generated 297 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:44:39.977826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bd726-42f3-483a-aacb-97690e84ed7c None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:39.978298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bd726-42f3-483a-aacb-97690e84ed7c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:39.978461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bd726-42f3-483a-aacb-97690e84ed7c None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:39.980146 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 110/218] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:39.986241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8246f-c9c9-4c0d-9680-a803b4ee3a85 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:39.986529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8246f-c9c9-4c0d-9680-a803b4ee3a85 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:39.986998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8246f-c9c9-4c0d-9680-a803b4ee3a85 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:39.988717 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 111/219] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:39.989864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef342ce-5231-49a2-8f62-28d773fa4bbe None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:39.990147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef342ce-5231-49a2-8f62-28d773fa4bbe None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:39.990410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef342ce-5231-49a2-8f62-28d773fa4bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:39.996513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a4b51-1494-4575-a5d5-3f0ffbf4244a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:39.998498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a4b51-1494-4575-a5d5-3f0ffbf4244a None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:40.014720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7ef342ce-5231-49a2-8f62-28d773fa4bbe None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:40.016095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7ef342ce-5231-49a2-8f62-28d773fa4bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:40.058788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:40.096521 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 112/220] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:40.097884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e18b6-5401-4c9a-9a94-678f57178c12 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:40.098173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e18b6-5401-4c9a-9a94-678f57178c12 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:40.098540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e18b6-5401-4c9a-9a94-678f57178c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:40.121741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-446e18b6-5401-4c9a-9a94-678f57178c12 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:40.122974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-446e18b6-5401-4c9a-9a94-678f57178c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:40.147320 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 109/221] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:44:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 16 20:44:40.148877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a4b51-1494-4575-a5d5-3f0ffbf4244a None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:40.224293 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 113/222] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:40.231033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e18b6-5401-4c9a-9a94-678f57178c12 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:40.235105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:40.263770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a4b51-1494-4575-a5d5-3f0ffbf4244a None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:40.318652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299975c-96b8-469b-a299-3b3bad7b355f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:40.319498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299975c-96b8-469b-a299-3b3bad7b355f None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:40.319815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299975c-96b8-469b-a299-3b3bad7b355f None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:40.320083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299975c-96b8-469b-a299-3b3bad7b355f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:40.334950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299975c-96b8-469b-a299-3b3bad7b355f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:40.344199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-b299975c-96b8-469b-a299-3b3bad7b355f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:44:40.344199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:40.344199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:40.344199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:40.344199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:40.344199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:40.344199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:40.344199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:40.344199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:40.344199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:40.344199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:40.344199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:40.344199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:40.344199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:40.344199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:40.344199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:40.345304 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:40.345304 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:40.345304 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:40.345304 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:40.345304 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:40.345304 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:40.345304 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:40.345304 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:40.345304 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:40.345304 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:40.345304 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:40.345304 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:40.345304 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:40.345304 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:40.345304 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:40.345304 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:40.346387 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:40.346387 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:40.346387 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:40.346387 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:40.346387 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:40.346387 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:40.346387 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:40.346387 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:40.346387 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:40.346387 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:40.346387 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:44:40.346387 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:40.346387 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 110/223] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Jul 16 20:44:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:40.347535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299975c-96b8-469b-a299-3b3bad7b355f None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:40.350659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:40.371321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e18b6-5401-4c9a-9a94-678f57178c12 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:40.425588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649e0b5-6ce6-4773-877c-4f14d6657a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:40.426607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649e0b5-6ce6-4773-877c-4f14d6657a34 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:40.426887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649e0b5-6ce6-4773-877c-4f14d6657a34 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:40.427508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649e0b5-6ce6-4773-877c-4f14d6657a34 None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:40.429747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649e0b5-6ce6-4773-877c-4f14d6657a34 None admin] RBAC: Authorizing `identity:get_project(project_id=10517c754ba94c1d893d97627d31b9f0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:40.432157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649e0b5-6ce6-4773-877c-4f14d6657a34 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:40.435146 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 114/224] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:40 2022] GET /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:40.437343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649e0b5-6ce6-4773-877c-4f14d6657a34 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:40.489588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299975c-96b8-469b-a299-3b3bad7b355f None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:40.532070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:40.533416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6762c-ee73-4882-bc8f-82a48fffe952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:40.534243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6762c-ee73-4882-bc8f-82a48fffe952 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:40.534594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6762c-ee73-4882-bc8f-82a48fffe952 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:40.534870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6762c-ee73-4882-bc8f-82a48fffe952 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:40.549693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6762c-ee73-4882-bc8f-82a48fffe952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:40.557804 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-51c6762c-ee73-4882-bc8f-82a48fffe952 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:44:40.557804 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:40.557804 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:40.557804 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:40.557804 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:40.557804 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:40.557804 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:40.557804 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:40.557804 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:40.557804 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:40.557804 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:40.557804 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:40.557804 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:40.557804 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:40.557804 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:40.557804 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:40.558764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:40.558764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:40.558764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:40.558764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:40.558764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:40.558764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:40.558764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:40.558764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:40.558764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:40.558764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:40.558764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:40.558764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:40.558764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:40.558764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:40.558764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:40.558764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:40.560647 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:40.560647 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:40.560647 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:40.560647 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:40.560647 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:40.560647 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:40.560647 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:40.560647 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:40.560647 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:40.560647 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:40.560647 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:44:40.560647 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:40.560647 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 111/225] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:44:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:40.560647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6762c-ee73-4882-bc8f-82a48fffe952 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:40.565532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649e0b5-6ce6-4773-877c-4f14d6657a34 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:40.604927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b62854-f500-4917-aebd-ebe7d56afc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:40.605606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b62854-f500-4917-aebd-ebe7d56afc27 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:40.605883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b62854-f500-4917-aebd-ebe7d56afc27 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:40.606155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b62854-f500-4917-aebd-ebe7d56afc27 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:40.606971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b62854-f500-4917-aebd-ebe7d56afc27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:40.607310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b62854-f500-4917-aebd-ebe7d56afc27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:40.609687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b62854-f500-4917-aebd-ebe7d56afc27 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:40.619617 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 115/226] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:44:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:40.620590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b62854-f500-4917-aebd-ebe7d56afc27 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:40.647176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:40.715435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6762c-ee73-4882-bc8f-82a48fffe952 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:40.765051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31135314-436e-44dc-ba4e-0275af17ea0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:40.766327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31135314-436e-44dc-ba4e-0275af17ea0c None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:40.766643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31135314-436e-44dc-ba4e-0275af17ea0c None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:40.766918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31135314-436e-44dc-ba4e-0275af17ea0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:40.767864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31135314-436e-44dc-ba4e-0275af17ea0c None admin] RBAC: Adding query filter params (role.id=c352110df5bc449b9134928abd20c032, scope.project.id=10517c754ba94c1d893d97627d31b9f0, user.id=45aab6c3983f4f77b4a759c9d4e0a718) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:40.768178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31135314-436e-44dc-ba4e-0275af17ea0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:40.770307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31135314-436e-44dc-ba4e-0275af17ea0c None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:40.779467 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 112/227] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:44:40 2022] GET /identity/v3/role_assignments?user.id=45aab6c3983f4f77b4a759c9d4e0a718&scope.project.id=10517c754ba94c1d893d97627d31b9f0&role.id=c352110df5bc449b9134928abd20c032 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:40.780927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31135314-436e-44dc-ba4e-0275af17ea0c None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:40.789363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b62854-f500-4917-aebd-ebe7d56afc27 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:40.883839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5694ce-f499-46b6-838c-e5b6a569b7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:40.884630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5694ce-f499-46b6-838c-e5b6a569b7ef None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:40.885216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5694ce-f499-46b6-838c-e5b6a569b7ef None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:40.885216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5694ce-f499-46b6-838c-e5b6a569b7ef None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:40.886008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5694ce-f499-46b6-838c-e5b6a569b7ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:40.886389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5694ce-f499-46b6-838c-e5b6a569b7ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:40.887761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5694ce-f499-46b6-838c-e5b6a569b7ef None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:40.891652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:40.909704 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 116/228] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:40.915905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5694ce-f499-46b6-838c-e5b6a569b7ef None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:40.947331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31135314-436e-44dc-ba4e-0275af17ea0c None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:41.003618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:41.017010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0723f-071f-45fb-bead-12af2df8e944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:41.018201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0723f-071f-45fb-bead-12af2df8e944 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:41.018623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0723f-071f-45fb-bead-12af2df8e944 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:41.019100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0723f-071f-45fb-bead-12af2df8e944 None admin] PATH_INFO: `/v3/users/882661b19038409aadb0df7da22f35a3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:41.020482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0723f-071f-45fb-bead-12af2df8e944 None admin] RBAC: Authorizing `identity:get_user(user_id=882661b19038409aadb0df7da22f35a3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:41.022120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0723f-071f-45fb-bead-12af2df8e944 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:41.024114 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 113/229] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:40 2022] GET /identity/v3/users/882661b19038409aadb0df7da22f35a3 => generated 283 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:41.032001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0723f-071f-45fb-bead-12af2df8e944 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:41.059688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5694ce-f499-46b6-838c-e5b6a569b7ef None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:41.107938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a3b3a-d6c5-4fed-abb6-5772285d7e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:41.109114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a3b3a-d6c5-4fed-abb6-5772285d7e1e None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:41.109400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a3b3a-d6c5-4fed-abb6-5772285d7e1e None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:41.109678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a3b3a-d6c5-4fed-abb6-5772285d7e1e None admin] PATH_INFO: `/v3/users/882661b19038409aadb0df7da22f35a3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:41.111191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a3b3a-d6c5-4fed-abb6-5772285d7e1e None admin] RBAC: Authorizing `identity:get_user(user_id=882661b19038409aadb0df7da22f35a3)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:41.113133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a3b3a-d6c5-4fed-abb6-5772285d7e1e None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:41.115134 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 117/230] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:40 2022] GET /identity/v3/users/882661b19038409aadb0df7da22f35a3 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:41.121344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a3b3a-d6c5-4fed-abb6-5772285d7e1e None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:41.199440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:41.241938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0723f-071f-45fb-bead-12af2df8e944 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:41.242450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a3b3a-d6c5-4fed-abb6-5772285d7e1e None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:41.283725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93a544-6c8d-47f8-b6a2-c800d1a20101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:41.284520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93a544-6c8d-47f8-b6a2-c800d1a20101 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:41.284804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93a544-6c8d-47f8-b6a2-c800d1a20101 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:41.285077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93a544-6c8d-47f8-b6a2-c800d1a20101 None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:41.286304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93a544-6c8d-47f8-b6a2-c800d1a20101 None admin] RBAC: Authorizing `identity:get_project(project_id=10517c754ba94c1d893d97627d31b9f0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:41.288013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93a544-6c8d-47f8-b6a2-c800d1a20101 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:41.290370 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 118/231] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:41 2022] GET /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:41.296598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93a544-6c8d-47f8-b6a2-c800d1a20101 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:41.355762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd61f8c-385b-4140-a6a0-2d88b0f5b9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:41.356652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd61f8c-385b-4140-a6a0-2d88b0f5b9e5 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:41.356936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd61f8c-385b-4140-a6a0-2d88b0f5b9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:41.357218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd61f8c-385b-4140-a6a0-2d88b0f5b9e5 None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:41.358553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd61f8c-385b-4140-a6a0-2d88b0f5b9e5 None admin] RBAC: Authorizing `identity:get_project(project_id=10517c754ba94c1d893d97627d31b9f0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:41.360086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd61f8c-385b-4140-a6a0-2d88b0f5b9e5 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:41.362147 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 114/232] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:41 2022] GET /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0 => generated 302 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:41.368310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd61f8c-385b-4140-a6a0-2d88b0f5b9e5 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:41.413469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93a544-6c8d-47f8-b6a2-c800d1a20101 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:41.452603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23c702-e3af-496c-8e54-6921e43b6bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:41.453532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23c702-e3af-496c-8e54-6921e43b6bf6 None admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:41.453812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23c702-e3af-496c-8e54-6921e43b6bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:41.454083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23c702-e3af-496c-8e54-6921e43b6bf6 None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0/users/882661b19038409aadb0df7da22f35a3/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:41.459033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23c702-e3af-496c-8e54-6921e43b6bf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=10517c754ba94c1d893d97627d31b9f0, user_id=882661b19038409aadb0df7da22f35a3, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:41.459033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23c702-e3af-496c-8e54-6921e43b6bf6 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:41.460201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:41.484778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:41.533295 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 119/233] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:44:41 2022] PUT /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0/users/882661b19038409aadb0df7da22f35a3/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:44:41.543387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd61f8c-385b-4140-a6a0-2d88b0f5b9e5 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:41.588431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4623be2-f1ac-4179-8ded-b6d32abd4a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:41.589796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4623be2-f1ac-4179-8ded-b6d32abd4a46 None admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:41.590305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4623be2-f1ac-4179-8ded-b6d32abd4a46 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:41.590784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4623be2-f1ac-4179-8ded-b6d32abd4a46 None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0/users/882661b19038409aadb0df7da22f35a3/roles/b9444da176484ccfa45d6b85220ce558` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:41.594393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4623be2-f1ac-4179-8ded-b6d32abd4a46 None admin] RBAC: Authorizing `identity:create_grant(project_id=10517c754ba94c1d893d97627d31b9f0, user_id=882661b19038409aadb0df7da22f35a3, role_id=b9444da176484ccfa45d6b85220ce558)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:41.596539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4623be2-f1ac-4179-8ded-b6d32abd4a46 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:41.705654 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 115/234] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:44:41 2022] PUT /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0/users/882661b19038409aadb0df7da22f35a3/roles/b9444da176484ccfa45d6b85220ce558 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:44:42.663860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955302cd-dbcc-4d32-b62c-5289273db139 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:42.664417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955302cd-dbcc-4d32-b62c-5289273db139 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:42.664417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955302cd-dbcc-4d32-b62c-5289273db139 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:42.666006 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 120/235] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:42.672153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a87712-6bc3-4d44-90a8-b287e5179ad8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:42.672734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a87712-6bc3-4d44-90a8-b287e5179ad8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:42.672734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a87712-6bc3-4d44-90a8-b287e5179ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:42.700368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-45a87712-6bc3-4d44-90a8-b287e5179ad8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:42.702098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-45a87712-6bc3-4d44-90a8-b287e5179ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:42.801747 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 116/236] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:42.847811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955302cd-dbcc-4d32-b62c-5289273db139 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:43.013274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04b8c6-21e0-4b3d-9a8e-15c26cf27e87 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:43.013575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04b8c6-21e0-4b3d-9a8e-15c26cf27e87 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:43.014370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04b8c6-21e0-4b3d-9a8e-15c26cf27e87 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:43.015799 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 117/237] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:44:43.030344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5665635-6a87-4a45-a82e-a5c2296f3152 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:43.030800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5665635-6a87-4a45-a82e-a5c2296f3152 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:43.031307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5665635-6a87-4a45-a82e-a5c2296f3152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:43.032810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955302cd-dbcc-4d32-b62c-5289273db139 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:43.063138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f5665635-6a87-4a45-a82e-a5c2296f3152 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:43.064861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f5665635-6a87-4a45-a82e-a5c2296f3152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:43.104383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b72ff5-217e-4777-8c64-c85c68f62ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:43.105544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b72ff5-217e-4777-8c64-c85c68f62ab3 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:43.106050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b72ff5-217e-4777-8c64-c85c68f62ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:43.106553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b72ff5-217e-4777-8c64-c85c68f62ab3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:43.136974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b72ff5-217e-4777-8c64-c85c68f62ab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:43.146200 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-88b72ff5-217e-4777-8c64-c85c68f62ab3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 16 20:44:43.146200 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:43.146200 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:43.146200 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:43.146200 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:43.146200 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:43.146200 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:43.146200 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:43.146200 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:43.146200 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:43.146200 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:43.146200 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:43.146200 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:43.146200 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:43.146200 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:43.146200 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:43.147196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:43.147196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:43.147196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:43.147196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:43.147196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:43.147196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:43.147196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:43.147196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:43.147196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:43.147196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:43.147196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:43.147196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:43.147196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:43.147196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:43.147196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:43.147196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:43.147992 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:43.147992 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:43.147992 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:43.147992 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:43.147992 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:43.147992 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:43.147992 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:43.147992 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:43.147992 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:43.147992 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:43.147992 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 16 20:44:43.147992 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:44:43.150777 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 121/238] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:43.158950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b72ff5-217e-4777-8c64-c85c68f62ab3 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:43.167477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:43.209530 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 118/239] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:43.240120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:43.252401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5665635-6a87-4a45-a82e-a5c2296f3152 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:43.307153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b72ff5-217e-4777-8c64-c85c68f62ab3 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:43.344080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ec44e-238b-4cda-9d2e-a09d15b1e26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:43.344987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ec44e-238b-4cda-9d2e-a09d15b1e26b None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:43.345097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ec44e-238b-4cda-9d2e-a09d15b1e26b None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:43.345295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ec44e-238b-4cda-9d2e-a09d15b1e26b None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:43.346051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ec44e-238b-4cda-9d2e-a09d15b1e26b None admin] RBAC: Adding query filter params (name=reader) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:43.346356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ec44e-238b-4cda-9d2e-a09d15b1e26b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:43.347772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ec44e-238b-4cda-9d2e-a09d15b1e26b None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:43.357699 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 122/240] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:44:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:43.363610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ec44e-238b-4cda-9d2e-a09d15b1e26b None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:43.403189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5665635-6a87-4a45-a82e-a5c2296f3152 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:43.445059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219e74e-4d13-4f85-abbb-b5ae2c61ba6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:43.446350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219e74e-4d13-4f85-abbb-b5ae2c61ba6b None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:43.446888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219e74e-4d13-4f85-abbb-b5ae2c61ba6b None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:43.447409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219e74e-4d13-4f85-abbb-b5ae2c61ba6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:43.449035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219e74e-4d13-4f85-abbb-b5ae2c61ba6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:43.450862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219e74e-4d13-4f85-abbb-b5ae2c61ba6b None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:43.453662 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 119/241] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:44:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:43.459547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219e74e-4d13-4f85-abbb-b5ae2c61ba6b None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:43.522475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:43.583865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219e74e-4d13-4f85-abbb-b5ae2c61ba6b None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:43.593941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ec44e-238b-4cda-9d2e-a09d15b1e26b None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:43.624308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:43.634034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd9020-ff9c-4e8d-b48b-40234915e486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:43.635495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd9020-ff9c-4e8d-b48b-40234915e486 None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:43.636164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd9020-ff9c-4e8d-b48b-40234915e486 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:43.636715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd9020-ff9c-4e8d-b48b-40234915e486 None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:43.637824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd9020-ff9c-4e8d-b48b-40234915e486 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:43.640721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd9020-ff9c-4e8d-b48b-40234915e486 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:43.643824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19900539-8942-45ea-a376-771335068f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:43.644771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19900539-8942-45ea-a376-771335068f17 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:43.645124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19900539-8942-45ea-a376-771335068f17 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:43.645472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19900539-8942-45ea-a376-771335068f17 None admin] PATH_INFO: `/v3/users/5c44f44a6c5843e9b60d133ef83af453` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:43.661209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19900539-8942-45ea-a376-771335068f17 None admin] RBAC: Authorizing `identity:get_user(user_id=5c44f44a6c5843e9b60d133ef83af453)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:43.662779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19900539-8942-45ea-a376-771335068f17 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:43.664796 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 123/242] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:43 2022] GET /identity/v3/users/5c44f44a6c5843e9b60d133ef83af453 => generated 297 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:43.666287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d07f98-8d12-4ea9-9fa8-66c8498574d0 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:43.666621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d07f98-8d12-4ea9-9fa8-66c8498574d0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:43.671086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d07f98-8d12-4ea9-9fa8-66c8498574d0 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:43.671086 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 124/243] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:43.671269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d07f98-8d12-4ea9-9fa8-66c8498574d0 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:43.786327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d07f98-8d12-4ea9-9fa8-66c8498574d0 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:43.813711 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 120/244] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Jul 16 20:44:43 2022] POST /identity/v3/users => generated 293 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 20:44:43.814938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a04a4d-7f54-4eeb-a7e4-aab124381b02 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:43.815562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a04a4d-7f54-4eeb-a7e4-aab124381b02 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:43.815562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a04a4d-7f54-4eeb-a7e4-aab124381b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:43.839657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06128b1f-78c1-42ed-81c8-8cceb287a38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:43.840257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06128b1f-78c1-42ed-81c8-8cceb287a38c None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:43.840526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06128b1f-78c1-42ed-81c8-8cceb287a38c None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:43.840838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06128b1f-78c1-42ed-81c8-8cceb287a38c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:43.848075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-31a04a4d-7f54-4eeb-a7e4-aab124381b02 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:43.849731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-31a04a4d-7f54-4eeb-a7e4-aab124381b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:43.948931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:43.956876 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 121/245] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:43.988335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06128b1f-78c1-42ed-81c8-8cceb287a38c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:43.991424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06128b1f-78c1-42ed-81c8-8cceb287a38c None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:43.996653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a04a4d-7f54-4eeb-a7e4-aab124381b02 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:44.171909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:44.258177 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 125/246] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:44:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 16 20:44:44.259254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06128b1f-78c1-42ed-81c8-8cceb287a38c None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:44.273911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a04a4d-7f54-4eeb-a7e4-aab124381b02 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:44.326089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa53e35-a2e2-4e01-8247-ab950eb4fb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:44.327125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa53e35-a2e2-4e01-8247-ab950eb4fb27 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:44.327514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa53e35-a2e2-4e01-8247-ab950eb4fb27 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:44.328012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa53e35-a2e2-4e01-8247-ab950eb4fb27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:44.344615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa53e35-a2e2-4e01-8247-ab950eb4fb27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:44.355792 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-ffa53e35-a2e2-4e01-8247-ab950eb4fb27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:44.355792 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:44.355792 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:44.355792 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:44.355792 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:44.355792 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:44.355792 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:44.355792 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:44.355792 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:44.355792 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:44.355792 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:44.355792 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:44.355792 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:44.355792 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:44.355792 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:44.355792 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:44.356729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:44.356729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:44.356729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:44.356729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:44.356729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:44.356729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:44.356729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:44.356729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:44.356729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:44.356729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:44.356729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:44.356729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:44.356729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:44.356729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:44.356729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:44.356729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:44.357484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:44.357484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:44.357484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:44.357484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:44.357484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:44.357484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:44.357484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:44.357484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:44.357484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:44.357484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:44.357484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:44.357484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:44.358857 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 122/247] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:44.364588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:44.365540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa53e35-a2e2-4e01-8247-ab950eb4fb27 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:44.412957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06128b1f-78c1-42ed-81c8-8cceb287a38c None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:44.496249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa53e35-a2e2-4e01-8247-ab950eb4fb27 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:44.499890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:44.538787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa72752-79bc-496d-9196-0d6e2b29a005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:44.539497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa72752-79bc-496d-9196-0d6e2b29a005 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:44.539780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa72752-79bc-496d-9196-0d6e2b29a005 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:44.540450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa72752-79bc-496d-9196-0d6e2b29a005 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:44.541225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa72752-79bc-496d-9196-0d6e2b29a005 None admin] RBAC: Adding query filter params (name=member) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:44.541536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa72752-79bc-496d-9196-0d6e2b29a005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:44.543299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa72752-79bc-496d-9196-0d6e2b29a005 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:44.553775 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 123/248] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:44:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:44.554935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55269437-202d-4293-84fe-2b1687002dec None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:44.560034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55269437-202d-4293-84fe-2b1687002dec None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:44.560461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55269437-202d-4293-84fe-2b1687002dec None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:44.562924 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 124/249] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:44.563926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55269437-202d-4293-84fe-2b1687002dec None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:44.567830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0acb95-ef81-4569-830f-a4f796d81488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:44.568805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0acb95-ef81-4569-830f-a4f796d81488 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:44.569135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0acb95-ef81-4569-830f-a4f796d81488 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:44.569452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0acb95-ef81-4569-830f-a4f796d81488 None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:44.575860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0acb95-ef81-4569-830f-a4f796d81488 None admin] RBAC: Authorizing `identity:get_project(project_id=10517c754ba94c1d893d97627d31b9f0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:44.577978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0acb95-ef81-4569-830f-a4f796d81488 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:44.579879 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 126/250] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:44 2022] GET /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0 => generated 302 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:44.581146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18582866-5645-4766-a040-54689a876201 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:44.581484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18582866-5645-4766-a040-54689a876201 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:44.581794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18582866-5645-4766-a040-54689a876201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:44.624757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-18582866-5645-4766-a040-54689a876201 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:44.625978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-18582866-5645-4766-a040-54689a876201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:44.696249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55269437-202d-4293-84fe-2b1687002dec None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:44.737016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57ef78-3c2d-4491-b799-84e397997719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:44.738278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57ef78-3c2d-4491-b799-84e397997719 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:44.738615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57ef78-3c2d-4491-b799-84e397997719 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:44.738896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57ef78-3c2d-4491-b799-84e397997719 None admin] PATH_INFO: `/v3/users/45aab6c3983f4f77b4a759c9d4e0a718` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:44.740225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b57ef78-3c2d-4491-b799-84e397997719 None admin] RBAC: Authorizing `identity:get_user(user_id=45aab6c3983f4f77b4a759c9d4e0a718)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:44.741866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b57ef78-3c2d-4491-b799-84e397997719 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:44.745678 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 125/251] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:44 2022] GET /identity/v3/users/45aab6c3983f4f77b4a759c9d4e0a718 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:44.745678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57ef78-3c2d-4491-b799-84e397997719 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:44.796671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:44.797634 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 127/252] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:44.799069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18582866-5645-4766-a040-54689a876201 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:44.912984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57ef78-3c2d-4491-b799-84e397997719 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:44.923290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:44.953444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a177c-e572-436c-be10-05949501b63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:44.956187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a177c-e572-436c-be10-05949501b63a None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:44.956695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a177c-e572-436c-be10-05949501b63a None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:44.957162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a177c-e572-436c-be10-05949501b63a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:44.958364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a177c-e572-436c-be10-05949501b63a None admin] RBAC: Adding query filter params (role.id=4f9686ee5911427e8cca34c19a1b7513, scope.project.id=10517c754ba94c1d893d97627d31b9f0, user.id=5c44f44a6c5843e9b60d133ef83af453) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:44.958919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a177c-e572-436c-be10-05949501b63a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:44.960739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a177c-e572-436c-be10-05949501b63a None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:44.965308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18582866-5645-4766-a040-54689a876201 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:44.975331 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 126/253] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:44:44 2022] GET /identity/v3/role_assignments?user.id=5c44f44a6c5843e9b60d133ef83af453&scope.project.id=10517c754ba94c1d893d97627d31b9f0&role.id=4f9686ee5911427e8cca34c19a1b7513 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:44.977318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e2ed6-add7-470a-9475-14bb7b44784c None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:44.977833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e2ed6-add7-470a-9475-14bb7b44784c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:44.978320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e2ed6-add7-470a-9475-14bb7b44784c None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:44.982817 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 127/254] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:44.984034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e2ed6-add7-470a-9475-14bb7b44784c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:45.009536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd96633-4e20-4331-858d-bf04f71bdd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:45.010589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd96633-4e20-4331-858d-bf04f71bdd05 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:45.010971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd96633-4e20-4331-858d-bf04f71bdd05 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:45.011807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd96633-4e20-4331-858d-bf04f71bdd05 None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:45.019038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd96633-4e20-4331-858d-bf04f71bdd05 None admin] RBAC: Authorizing `identity:get_project(project_id=10517c754ba94c1d893d97627d31b9f0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:45.019038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd96633-4e20-4331-858d-bf04f71bdd05 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:45.020867 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 128/255] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:44 2022] GET /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:45.022335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b56fb-15d2-4b20-955e-e70e03bae9a6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:45.026931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b56fb-15d2-4b20-955e-e70e03bae9a6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:45.026931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b56fb-15d2-4b20-955e-e70e03bae9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:45.064186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2d4b56fb-15d2-4b20-955e-e70e03bae9a6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:45.065709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2d4b56fb-15d2-4b20-955e-e70e03bae9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:45.178031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:45.192881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e2ed6-add7-470a-9475-14bb7b44784c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:45.225819 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 129/256] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:45.226472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b56fb-15d2-4b20-955e-e70e03bae9a6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:45.234538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483c643-b596-4387-9613-9d9ca6b5c577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:45.236485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483c643-b596-4387-9613-9d9ca6b5c577 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:45.236772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483c643-b596-4387-9613-9d9ca6b5c577 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:45.237050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483c643-b596-4387-9613-9d9ca6b5c577 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:45.251707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483c643-b596-4387-9613-9d9ca6b5c577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:45.260341 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-7483c643-b596-4387-9613-9d9ca6b5c577 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:44:45.260341 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:45.260341 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:45.260341 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:45.260341 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:45.260341 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:45.260341 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:45.260341 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:45.260341 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:45.260341 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:45.260341 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:45.260341 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:45.260341 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:45.260341 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:45.260341 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:45.260341 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:45.261270 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:45.261270 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:45.261270 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:45.261270 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:45.261270 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:45.261270 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:45.261270 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:45.261270 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:45.261270 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:45.261270 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:45.261270 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:45.261270 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:45.261270 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:45.261270 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:45.261270 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:45.261270 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:45.262477 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:45.262477 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:45.262477 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:45.262477 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:45.262477 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:45.262477 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:45.262477 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:45.262477 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:45.262477 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:45.262477 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:45.262477 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:44:45.262477 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:45.262477 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 128/257] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:44:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:45.268996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483c643-b596-4387-9613-9d9ca6b5c577 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:45.338237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:45.374736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b56fb-15d2-4b20-955e-e70e03bae9a6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:45.378874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483c643-b596-4387-9613-9d9ca6b5c577 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:45.419034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ec22a-56a1-40bf-9776-ecbb8aab0378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:45.419034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ec22a-56a1-40bf-9776-ecbb8aab0378 None admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:45.419034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ec22a-56a1-40bf-9776-ecbb8aab0378 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:45.419034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ec22a-56a1-40bf-9776-ecbb8aab0378 None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0/users/45aab6c3983f4f77b4a759c9d4e0a718/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:45.419793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ec22a-56a1-40bf-9776-ecbb8aab0378 None admin] RBAC: Authorizing `identity:create_grant(project_id=10517c754ba94c1d893d97627d31b9f0, user_id=45aab6c3983f4f77b4a759c9d4e0a718, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:45.421515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ec22a-56a1-40bf-9776-ecbb8aab0378 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:45.428431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e004acf-4174-4d7f-acb1-727fb580d697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:45.429304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e004acf-4174-4d7f-acb1-727fb580d697 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:45.429587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e004acf-4174-4d7f-acb1-727fb580d697 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:45.429915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e004acf-4174-4d7f-acb1-727fb580d697 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:45.443098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e004acf-4174-4d7f-acb1-727fb580d697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:45.452947 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-0e004acf-4174-4d7f-acb1-727fb580d697 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:44:45.452947 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:45.452947 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:45.452947 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:45.452947 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:45.452947 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:45.452947 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:45.452947 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:45.452947 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:45.452947 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:45.452947 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:45.452947 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:45.452947 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:45.452947 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:45.452947 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:45.452947 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:45.453943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:45.453943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:45.453943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:45.453943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:45.453943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:45.453943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:45.453943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:45.453943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:45.453943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:45.453943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:45.453943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:45.453943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:45.453943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:45.453943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:45.453943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:45.453943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:45.456616 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:45.456616 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:45.456616 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:45.456616 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:45.456616 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:45.456616 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:45.456616 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:45.456616 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:45.456616 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:45.456616 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:45.456616 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:44:45.456616 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:45.456616 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 129/258] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Jul 16 20:44:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:44:45.456616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e004acf-4174-4d7f-acb1-727fb580d697 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:45.477721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:45.557361 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 130/259] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:44:45 2022] PUT /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0/users/45aab6c3983f4f77b4a759c9d4e0a718/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:44:45.558271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ec22a-56a1-40bf-9776-ecbb8aab0378 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:45.584781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e004acf-4174-4d7f-acb1-727fb580d697 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:45.642295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f17f3-d6f8-49cf-a310-bf26e24f4dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:45.642905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f17f3-d6f8-49cf-a310-bf26e24f4dd6 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:45.643308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f17f3-d6f8-49cf-a310-bf26e24f4dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:45.643589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f17f3-d6f8-49cf-a310-bf26e24f4dd6 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:45.644360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f17f3-d6f8-49cf-a310-bf26e24f4dd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:45.644668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f17f3-d6f8-49cf-a310-bf26e24f4dd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:45.646135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f17f3-d6f8-49cf-a310-bf26e24f4dd6 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:45.669287 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 130/260] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:45.676342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f17f3-d6f8-49cf-a310-bf26e24f4dd6 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:45.773101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ec22a-56a1-40bf-9776-ecbb8aab0378 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:45.824638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:45.844079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a388d-4be0-4390-a241-342cd4032485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:45.845792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a388d-4be0-4390-a241-342cd4032485 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:45.845792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a388d-4be0-4390-a241-342cd4032485 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:45.845792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a388d-4be0-4390-a241-342cd4032485 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:45.846534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a388d-4be0-4390-a241-342cd4032485 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:45.846848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a388d-4be0-4390-a241-342cd4032485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:45.848730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a388d-4be0-4390-a241-342cd4032485 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:45.851605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:45.879176 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 131/261] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:44:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:45.885068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a388d-4be0-4390-a241-342cd4032485 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:45.917582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f17f3-d6f8-49cf-a310-bf26e24f4dd6 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:45.969198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140dd18-90bb-4e5d-ab92-409f9c755d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:45.970988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140dd18-90bb-4e5d-ab92-409f9c755d49 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:45.971769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140dd18-90bb-4e5d-ab92-409f9c755d49 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:45.972243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140dd18-90bb-4e5d-ab92-409f9c755d49 None admin] PATH_INFO: `/v3/users/882661b19038409aadb0df7da22f35a3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:45.974149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140dd18-90bb-4e5d-ab92-409f9c755d49 None admin] RBAC: Authorizing `identity:get_user(user_id=882661b19038409aadb0df7da22f35a3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:45.976285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140dd18-90bb-4e5d-ab92-409f9c755d49 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:45.979348 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 131/262] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:45 2022] GET /identity/v3/users/882661b19038409aadb0df7da22f35a3 => generated 283 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:45.991000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140dd18-90bb-4e5d-ab92-409f9c755d49 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:46.024024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a388d-4be0-4390-a241-342cd4032485 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:46.060465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e1a75-423f-483e-bdc0-b9cfd471a628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:46.061941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e1a75-423f-483e-bdc0-b9cfd471a628 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:46.062251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e1a75-423f-483e-bdc0-b9cfd471a628 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:46.062535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e1a75-423f-483e-bdc0-b9cfd471a628 None admin] PATH_INFO: `/v3/users/882661b19038409aadb0df7da22f35a3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:46.063865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e1a75-423f-483e-bdc0-b9cfd471a628 None admin] RBAC: Authorizing `identity:get_user(user_id=882661b19038409aadb0df7da22f35a3)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:46.065432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e1a75-423f-483e-bdc0-b9cfd471a628 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:46.067544 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 132/263] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:45 2022] GET /identity/v3/users/882661b19038409aadb0df7da22f35a3 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:46.076118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e1a75-423f-483e-bdc0-b9cfd471a628 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:46.196401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e1a75-423f-483e-bdc0-b9cfd471a628 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:46.235327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9afeb0-191d-417f-9049-658f91beb8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:46.236088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9afeb0-191d-417f-9049-658f91beb8a7 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:46.236443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9afeb0-191d-417f-9049-658f91beb8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:46.237624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9afeb0-191d-417f-9049-658f91beb8a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:46.260361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140dd18-90bb-4e5d-ab92-409f9c755d49 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:46.301555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:46.315333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9afeb0-191d-417f-9049-658f91beb8a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:46.316964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9afeb0-191d-417f-9049-658f91beb8a7 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:46.332380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f412f-09b0-4fd7-8728-d2e774afc598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:46.333149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f412f-09b0-4fd7-8728-d2e774afc598 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:46.333453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f412f-09b0-4fd7-8728-d2e774afc598 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:46.333793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f412f-09b0-4fd7-8728-d2e774afc598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:46.365063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:46.434097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:46.508834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f412f-09b0-4fd7-8728-d2e774afc598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:46.512396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f412f-09b0-4fd7-8728-d2e774afc598 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:46.526882 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 133/264] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:44:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:44:46.536056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9afeb0-191d-417f-9049-658f91beb8a7 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:46.749362 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 132/265] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:44:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 759 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:44:46.755963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f412f-09b0-4fd7-8728-d2e774afc598 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:46.784353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9afeb0-191d-417f-9049-658f91beb8a7 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:46.833825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:46.857127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e17750-43aa-4bb4-b5bf-cd581fd2fcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:46.858763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e17750-43aa-4bb4-b5bf-cd581fd2fcd4 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:46.864928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e17750-43aa-4bb4-b5bf-cd581fd2fcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:46.865445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e17750-43aa-4bb4-b5bf-cd581fd2fcd4 None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:46.872093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e17750-43aa-4bb4-b5bf-cd581fd2fcd4 None admin] RBAC: Authorizing `identity:get_project(project_id=10517c754ba94c1d893d97627d31b9f0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:46.874676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e17750-43aa-4bb4-b5bf-cd581fd2fcd4 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:46.877300 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 134/266] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:46 2022] GET /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0 => generated 302 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:46.883808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e17750-43aa-4bb4-b5bf-cd581fd2fcd4 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:46.947183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:46.980064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f412f-09b0-4fd7-8728-d2e774afc598 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:47.055583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c835f5-db1b-459e-9c93-3fd84ae241a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:47.056794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c835f5-db1b-459e-9c93-3fd84ae241a6 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:47.057363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c835f5-db1b-459e-9c93-3fd84ae241a6 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:47.059406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c835f5-db1b-459e-9c93-3fd84ae241a6 None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:47.061601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c835f5-db1b-459e-9c93-3fd84ae241a6 None admin] RBAC: Authorizing `identity:get_project(project_id=10517c754ba94c1d893d97627d31b9f0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:47.064308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c835f5-db1b-459e-9c93-3fd84ae241a6 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:47.068441 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 133/267] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:46 2022] GET /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0 => generated 302 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:47.074014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c835f5-db1b-459e-9c93-3fd84ae241a6 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:47.109153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e17750-43aa-4bb4-b5bf-cd581fd2fcd4 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:47.183498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239682b-95b5-4710-b2f9-b3489359a734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:47.184411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239682b-95b5-4710-b2f9-b3489359a734 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:47.184704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239682b-95b5-4710-b2f9-b3489359a734 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:47.184980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239682b-95b5-4710-b2f9-b3489359a734 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:47.186377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239682b-95b5-4710-b2f9-b3489359a734 None admin] RBAC: Adding query filter params (role.id=b9444da176484ccfa45d6b85220ce558, scope.project.id=10517c754ba94c1d893d97627d31b9f0, user.id=882661b19038409aadb0df7da22f35a3) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:47.186694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239682b-95b5-4710-b2f9-b3489359a734 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:47.188515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239682b-95b5-4710-b2f9-b3489359a734 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:47.198655 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 135/268] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:44:46 2022] GET /identity/v3/role_assignments?user.id=882661b19038409aadb0df7da22f35a3&scope.project.id=10517c754ba94c1d893d97627d31b9f0&role.id=b9444da176484ccfa45d6b85220ce558 => generated 608 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:47.274967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c835f5-db1b-459e-9c93-3fd84ae241a6 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:47.292581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:47.316953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace61489-96a3-4e88-8cea-cf7a0fb1811e None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:47.317139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace61489-96a3-4e88-8cea-cf7a0fb1811e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:47.317421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace61489-96a3-4e88-8cea-cf7a0fb1811e None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:47.319044 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 136/269] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:47.324638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35521741-7da2-4700-bf5f-3a9852be431d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:47.325288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35521741-7da2-4700-bf5f-3a9852be431d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:47.325798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35521741-7da2-4700-bf5f-3a9852be431d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:47.331063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893a111-f3e3-4ffc-b767-b9db39e480b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:47.331063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893a111-f3e3-4ffc-b767-b9db39e480b2 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:47.331063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893a111-f3e3-4ffc-b767-b9db39e480b2 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:47.331063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893a111-f3e3-4ffc-b767-b9db39e480b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:47.331505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893a111-f3e3-4ffc-b767-b9db39e480b2 None admin] RBAC: Adding query filter params (role.id=bd33b827674a4d4db30c164cab416056, scope.project.id=10517c754ba94c1d893d97627d31b9f0, user.id=882661b19038409aadb0df7da22f35a3) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:47.331505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893a111-f3e3-4ffc-b767-b9db39e480b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:47.331505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893a111-f3e3-4ffc-b767-b9db39e480b2 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:47.338561 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 134/270] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:44:47 2022] GET /identity/v3/role_assignments?user.id=882661b19038409aadb0df7da22f35a3&scope.project.id=10517c754ba94c1d893d97627d31b9f0&role.id=bd33b827674a4d4db30c164cab416056 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:47.364321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-35521741-7da2-4700-bf5f-3a9852be431d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:47.366100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-35521741-7da2-4700-bf5f-3a9852be431d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:47.490980 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 137/271] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:47.545419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893a111-f3e3-4ffc-b767-b9db39e480b2 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:47.669412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893a111-f3e3-4ffc-b767-b9db39e480b2 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:47.724736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b25388-af14-40df-bf45-81620f9626d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:47.725567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b25388-af14-40df-bf45-81620f9626d0 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:47.725853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b25388-af14-40df-bf45-81620f9626d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:47.726129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b25388-af14-40df-bf45-81620f9626d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:47.727537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b25388-af14-40df-bf45-81620f9626d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:47.729058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b25388-af14-40df-bf45-81620f9626d0 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:47.732085 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 135/272] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:44:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:47.738364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35521741-7da2-4700-bf5f-3a9852be431d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:47.746769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dff8d-6dc6-4876-a79e-8076ef6e746c None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:47.746963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dff8d-6dc6-4876-a79e-8076ef6e746c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:47.747244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dff8d-6dc6-4876-a79e-8076ef6e746c None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:47.750006 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 136/273] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:44:47.756691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac074d9-3371-4e33-971c-136285f9a3d5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:47.757004 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac074d9-3371-4e33-971c-136285f9a3d5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:47.757814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac074d9-3371-4e33-971c-136285f9a3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:47.778504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5ac074d9-3371-4e33-971c-136285f9a3d5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:47.779895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5ac074d9-3371-4e33-971c-136285f9a3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:47.788751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:47.832831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:47.894091 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 137/274] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 16 20:44:47.929093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac074d9-3371-4e33-971c-136285f9a3d5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:47.929698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35521741-7da2-4700-bf5f-3a9852be431d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:47.979667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75065742-691b-4f39-b02b-8217d3369333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:47.980539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75065742-691b-4f39-b02b-8217d3369333 None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:47.980829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75065742-691b-4f39-b02b-8217d3369333 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:47.981106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75065742-691b-4f39-b02b-8217d3369333 None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:47.981852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75065742-691b-4f39-b02b-8217d3369333 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:47.983975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75065742-691b-4f39-b02b-8217d3369333 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:48.072737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac074d9-3371-4e33-971c-136285f9a3d5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:48.113304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c6fd7-d7f3-4d54-a61a-4d58825173b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:48.114119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c6fd7-d7f3-4d54-a61a-4d58825173b4 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:48.114397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c6fd7-d7f3-4d54-a61a-4d58825173b4 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:48.114665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c6fd7-d7f3-4d54-a61a-4d58825173b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:48.127367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c6fd7-d7f3-4d54-a61a-4d58825173b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:48.128065 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 138/275] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Jul 16 20:44:47 2022] POST /identity/v3/users => generated 293 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:44:48.130640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941734e-ea5e-4d21-ab2c-27744fd7b5c7 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:48.131549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941734e-ea5e-4d21-ab2c-27744fd7b5c7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:48.132109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941734e-ea5e-4d21-ab2c-27744fd7b5c7 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:48.134491 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 139/276] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:48.134911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-5d4c6fd7-d7f3-4d54-a61a-4d58825173b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:48.134911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:48.134911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:48.134911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:48.134911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:48.134911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:48.134911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:48.134911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:48.134911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:48.134911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:48.134911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:48.134911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:48.134911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:48.134911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:48.134911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:48.134911 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:48.136060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:48.136060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:48.136060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:48.136060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:48.136060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:48.136060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:48.136060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:48.136060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:48.136060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:48.136060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:48.136060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:48.136060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:48.136060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:48.136060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:48.136060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:48.136060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:48.136930 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:48.136930 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:48.136930 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:48.136930 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:48.136930 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:48.136930 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:48.136930 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:48.136930 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:48.136930 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:48.136930 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:48.136930 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:48.136930 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:48.141153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120feee-d53e-4b82-a3e1-02d768499660 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:48.145164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120feee-d53e-4b82-a3e1-02d768499660 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:48.145164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120feee-d53e-4b82-a3e1-02d768499660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:48.145356 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 138/277] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:44:48.150521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c6fd7-d7f3-4d54-a61a-4d58825173b4 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:48.162328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8120feee-d53e-4b82-a3e1-02d768499660 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:48.163685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8120feee-d53e-4b82-a3e1-02d768499660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:48.202351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:48.255875 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 140/278] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 16 20:44:48.275535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120feee-d53e-4b82-a3e1-02d768499660 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:48.288753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:48.306912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c6fd7-d7f3-4d54-a61a-4d58825173b4 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:48.361578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c96d51-2f39-4f23-ab0a-45b935f72d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:48.361777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c96d51-2f39-4f23-ab0a-45b935f72d96 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:48.362067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c96d51-2f39-4f23-ab0a-45b935f72d96 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:48.362350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c96d51-2f39-4f23-ab0a-45b935f72d96 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:48.363156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c96d51-2f39-4f23-ab0a-45b935f72d96 None admin] RBAC: Adding query filter params (name=member) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:48.363544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c96d51-2f39-4f23-ab0a-45b935f72d96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:48.364964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c96d51-2f39-4f23-ab0a-45b935f72d96 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:48.379068 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 139/279] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:44:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:48.381856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c96d51-2f39-4f23-ab0a-45b935f72d96 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:48.413267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120feee-d53e-4b82-a3e1-02d768499660 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:48.465928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20515d-d34a-481f-a75a-0e851929c2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:48.468768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20515d-d34a-481f-a75a-0e851929c2b9 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:48.469297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20515d-d34a-481f-a75a-0e851929c2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:48.469794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20515d-d34a-481f-a75a-0e851929c2b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:48.486196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20515d-d34a-481f-a75a-0e851929c2b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:48.494658 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-4f20515d-d34a-481f-a75a-0e851929c2b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 16 20:44:48.494658 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:48.494658 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:48.494658 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:48.494658 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:48.494658 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:48.494658 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:48.494658 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:48.494658 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:48.494658 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:48.494658 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:48.494658 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:48.494658 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:48.494658 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:48.494658 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:48.494658 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:48.495696 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:48.495696 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:48.495696 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:48.495696 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:48.495696 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:48.495696 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:48.495696 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:48.495696 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:48.495696 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:48.495696 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:48.495696 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:48.495696 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:48.495696 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:48.495696 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:48.495696 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:48.495696 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:48.497257 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:48.497257 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:48.497257 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:48.497257 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:48.497257 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:48.497257 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:48.497257 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:48.497257 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:48.497257 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:48.497257 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:48.497257 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 16 20:44:48.497257 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:44:48.497257 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 141/280] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:44:48.505674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:48.506396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20515d-d34a-481f-a75a-0e851929c2b9 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:48.515505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c96d51-2f39-4f23-ab0a-45b935f72d96 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:48.559805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3775a-d90f-48dd-b618-9db3037c3aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:48.561234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3775a-d90f-48dd-b618-9db3037c3aad None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:48.561544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3775a-d90f-48dd-b618-9db3037c3aad None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:48.561793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3775a-d90f-48dd-b618-9db3037c3aad None admin] PATH_INFO: `/v3/users/728a55a6c6d541fb823f58251bdccfd8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:48.578616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3775a-d90f-48dd-b618-9db3037c3aad None admin] RBAC: Authorizing `identity:get_user(user_id=728a55a6c6d541fb823f58251bdccfd8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:48.580335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3775a-d90f-48dd-b618-9db3037c3aad None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:48.582500 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 140/281] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:48 2022] GET /identity/v3/users/728a55a6c6d541fb823f58251bdccfd8 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:48.586664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c46c7-7c44-4c26-90e8-b4de8f8ee151 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:48.587090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c46c7-7c44-4c26-90e8-b4de8f8ee151 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:48.587376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c46c7-7c44-4c26-90e8-b4de8f8ee151 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:48.588811 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 141/282] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:48.592255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c46c7-7c44-4c26-90e8-b4de8f8ee151 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:48.599485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:48.642818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20515d-d34a-481f-a75a-0e851929c2b9 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:48.691251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7671d23-d1ab-4400-bfc8-00da7191d844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:48.692989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7671d23-d1ab-4400-bfc8-00da7191d844 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:48.693388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7671d23-d1ab-4400-bfc8-00da7191d844 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:48.693760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7671d23-d1ab-4400-bfc8-00da7191d844 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:48.695105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7671d23-d1ab-4400-bfc8-00da7191d844 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:48.695503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7671d23-d1ab-4400-bfc8-00da7191d844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:48.697000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7671d23-d1ab-4400-bfc8-00da7191d844 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:48.710669 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 142/283] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:44:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:48.712476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486147d7-c0fe-4c05-9883-c2ca10f5b102 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:48.713263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486147d7-c0fe-4c05-9883-c2ca10f5b102 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:48.713623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486147d7-c0fe-4c05-9883-c2ca10f5b102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:48.735400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c46c7-7c44-4c26-90e8-b4de8f8ee151 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:48.736932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-486147d7-c0fe-4c05-9883-c2ca10f5b102 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:48.738498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-486147d7-c0fe-4c05-9883-c2ca10f5b102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:48.782996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9506d-560d-4d8e-88e1-ff21013035fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:48.783820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9506d-560d-4d8e-88e1-ff21013035fb None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:48.784170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9506d-560d-4d8e-88e1-ff21013035fb None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:48.784644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9506d-560d-4d8e-88e1-ff21013035fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:48.786378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9506d-560d-4d8e-88e1-ff21013035fb None admin] RBAC: Adding query filter params (role.id=c352110df5bc449b9134928abd20c032, user.id=728a55a6c6d541fb823f58251bdccfd8, scope.system=all) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:48.786701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9506d-560d-4d8e-88e1-ff21013035fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:48.788271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9506d-560d-4d8e-88e1-ff21013035fb None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:48.795837 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 142/284] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Jul 16 20:44:48 2022] GET /identity/v3/role_assignments?user.id=728a55a6c6d541fb823f58251bdccfd8&scope.system=all&role.id=c352110df5bc449b9134928abd20c032 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:48.797027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9506d-560d-4d8e-88e1-ff21013035fb None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:48.821241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:48.830934 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 143/285] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:48.869859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486147d7-c0fe-4c05-9883-c2ca10f5b102 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:48.940545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9506d-560d-4d8e-88e1-ff21013035fb None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:48.992178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742eb3c-245e-463e-9c55-22390aa48f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:48.992994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742eb3c-245e-463e-9c55-22390aa48f2f None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:48.993274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742eb3c-245e-463e-9c55-22390aa48f2f None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:48.993549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742eb3c-245e-463e-9c55-22390aa48f2f None admin] PATH_INFO: `/v3/users/5c44f44a6c5843e9b60d133ef83af453` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:48.999884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742eb3c-245e-463e-9c55-22390aa48f2f None admin] RBAC: Authorizing `identity:get_user(user_id=5c44f44a6c5843e9b60d133ef83af453)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:49.001403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742eb3c-245e-463e-9c55-22390aa48f2f None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:49.009994 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 143/286] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:48 2022] GET /identity/v3/users/5c44f44a6c5843e9b60d133ef83af453 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:49.011072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742eb3c-245e-463e-9c55-22390aa48f2f None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:49.015401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:49.073400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486147d7-c0fe-4c05-9883-c2ca10f5b102 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:49.150508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1eea61-64ae-424b-b390-1367b6ea0751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:49.151338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1eea61-64ae-424b-b390-1367b6ea0751 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:49.151615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1eea61-64ae-424b-b390-1367b6ea0751 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:49.151884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1eea61-64ae-424b-b390-1367b6ea0751 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:49.178801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1eea61-64ae-424b-b390-1367b6ea0751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:49.191161 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-7f1eea61-64ae-424b-b390-1367b6ea0751 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:49.191161 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:49.191161 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:49.191161 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:49.191161 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:49.191161 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:49.191161 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:49.191161 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:49.191161 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:49.191161 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:49.191161 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:49.191161 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:49.191161 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:49.191161 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:49.191161 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:49.191161 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:49.192101 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:49.192101 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:49.192101 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:49.192101 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:49.192101 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:49.192101 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:49.192101 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:49.192101 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:49.192101 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:49.192101 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:49.192101 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:49.192101 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:49.192101 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:49.192101 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:49.192101 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:49.192101 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:49.192857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:49.192857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:49.192857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:49.192857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:49.192857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:49.192857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:49.192857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:49.192857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:49.192857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:49.192857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:49.192857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:49.192857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:44:49.200049 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 144/287] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:49.205156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1eea61-64ae-424b-b390-1367b6ea0751 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:49.209034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:49.254047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742eb3c-245e-463e-9c55-22390aa48f2f None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:49.329353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dbd71-a664-41ff-9f4d-58b62c2244df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:49.330212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dbd71-a664-41ff-9f4d-58b62c2244df None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:49.330486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dbd71-a664-41ff-9f4d-58b62c2244df None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:49.330795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dbd71-a664-41ff-9f4d-58b62c2244df None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:49.332725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762dbd71-a664-41ff-9f4d-58b62c2244df None admin] RBAC: Authorizing `identity:get_project(project_id=10517c754ba94c1d893d97627d31b9f0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:49.334174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762dbd71-a664-41ff-9f4d-58b62c2244df None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:49.336128 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 144/288] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:49 2022] GET /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0 => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:49.343660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dbd71-a664-41ff-9f4d-58b62c2244df None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:49.395558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1eea61-64ae-424b-b390-1367b6ea0751 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:49.424245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:49.452828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629805f1-d98c-453d-a63d-4e8ea6a09d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:49.453504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629805f1-d98c-453d-a63d-4e8ea6a09d1a None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:49.453799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629805f1-d98c-453d-a63d-4e8ea6a09d1a None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:49.454216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629805f1-d98c-453d-a63d-4e8ea6a09d1a None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:49.455352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629805f1-d98c-453d-a63d-4e8ea6a09d1a None admin] RBAC: Adding query filter params (name=member) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:49.455666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629805f1-d98c-453d-a63d-4e8ea6a09d1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:49.457657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629805f1-d98c-453d-a63d-4e8ea6a09d1a None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:49.473275 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 145/289] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:44:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:49.477648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629805f1-d98c-453d-a63d-4e8ea6a09d1a None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:49.556664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dbd71-a664-41ff-9f4d-58b62c2244df None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:49.640385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc95dd-8589-441b-8930-f37825031684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:49.641673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc95dd-8589-441b-8930-f37825031684 None admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:49.642150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc95dd-8589-441b-8930-f37825031684 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:49.642641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc95dd-8589-441b-8930-f37825031684 None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0/users/5c44f44a6c5843e9b60d133ef83af453/roles/4f9686ee5911427e8cca34c19a1b7513` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:49.647790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc95dd-8589-441b-8930-f37825031684 None admin] RBAC: Authorizing `identity:create_grant(project_id=10517c754ba94c1d893d97627d31b9f0, user_id=5c44f44a6c5843e9b60d133ef83af453, role_id=4f9686ee5911427e8cca34c19a1b7513)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:49.649472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc95dd-8589-441b-8930-f37825031684 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:49.676535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629805f1-d98c-453d-a63d-4e8ea6a09d1a None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:49.714898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48697c-7555-4480-83da-6f73a0a43721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:49.716241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48697c-7555-4480-83da-6f73a0a43721 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:49.716721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48697c-7555-4480-83da-6f73a0a43721 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:49.717285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48697c-7555-4480-83da-6f73a0a43721 None admin] PATH_INFO: `/v3/users/45aab6c3983f4f77b4a759c9d4e0a718` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:49.718841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48697c-7555-4480-83da-6f73a0a43721 None admin] RBAC: Authorizing `identity:get_user(user_id=45aab6c3983f4f77b4a759c9d4e0a718)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:49.720727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48697c-7555-4480-83da-6f73a0a43721 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:49.722676 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 146/290] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:49 2022] GET /identity/v3/users/45aab6c3983f4f77b4a759c9d4e0a718 => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:49.728580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48697c-7555-4480-83da-6f73a0a43721 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:49.750802 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 145/291] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:44:49 2022] PUT /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0/users/5c44f44a6c5843e9b60d133ef83af453/roles/4f9686ee5911427e8cca34c19a1b7513 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:44:49.818558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:49.928107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48697c-7555-4480-83da-6f73a0a43721 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:49.991167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88659093-772a-4e15-8fd9-392fe8330cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:49.991852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88659093-772a-4e15-8fd9-392fe8330cb8 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:49.992138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88659093-772a-4e15-8fd9-392fe8330cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:49.992416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88659093-772a-4e15-8fd9-392fe8330cb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:50.078976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88659093-772a-4e15-8fd9-392fe8330cb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:50.080412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88659093-772a-4e15-8fd9-392fe8330cb8 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:50.140190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:50.203374 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 147/292] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:44:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 16 20:44:50.209220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc95dd-8589-441b-8930-f37825031684 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:50.230836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:50.365153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc95dd-8589-441b-8930-f37825031684 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:50.417538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beaecf7-6425-4b72-af12-f53cc0920ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:50.418408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beaecf7-6425-4b72-af12-f53cc0920ae1 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:50.418687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beaecf7-6425-4b72-af12-f53cc0920ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:50.418958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beaecf7-6425-4b72-af12-f53cc0920ae1 None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:50.421573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beaecf7-6425-4b72-af12-f53cc0920ae1 None admin] RBAC: Authorizing `identity:get_project(project_id=10517c754ba94c1d893d97627d31b9f0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:50.423116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beaecf7-6425-4b72-af12-f53cc0920ae1 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:50.424835 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 146/293] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:50 2022] GET /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:50.431403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88659093-772a-4e15-8fd9-392fe8330cb8 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:50.591231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88659093-772a-4e15-8fd9-392fe8330cb8 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:50.650632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9948f1-1176-429a-987b-b857956e3cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:50.651239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9948f1-1176-429a-987b-b857956e3cdb None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:50.651519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9948f1-1176-429a-987b-b857956e3cdb None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:50.651790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9948f1-1176-429a-987b-b857956e3cdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:50.652625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9948f1-1176-429a-987b-b857956e3cdb None admin] RBAC: Adding query filter params (role.id=c352110df5bc449b9134928abd20c032, scope.project.id=10517c754ba94c1d893d97627d31b9f0, user.id=45aab6c3983f4f77b4a759c9d4e0a718) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:50.652932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9948f1-1176-429a-987b-b857956e3cdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:50.654411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9948f1-1176-429a-987b-b857956e3cdb None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:50.664039 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 148/294] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:44:50 2022] GET /identity/v3/role_assignments?user.id=45aab6c3983f4f77b4a759c9d4e0a718&scope.project.id=10517c754ba94c1d893d97627d31b9f0&role.id=c352110df5bc449b9134928abd20c032 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:51.134742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112667a9-0503-45b5-8c7b-f8fe463dcd1d None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:51.135141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112667a9-0503-45b5-8c7b-f8fe463dcd1d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:51.135319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112667a9-0503-45b5-8c7b-f8fe463dcd1d None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:51.137076 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 147/295] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:51.143345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670726e-2abd-4bed-afa5-ab21f1518335 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:51.143820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670726e-2abd-4bed-afa5-ab21f1518335 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:51.143922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670726e-2abd-4bed-afa5-ab21f1518335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:51.164750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2670726e-2abd-4bed-afa5-ab21f1518335 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:51.166034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2670726e-2abd-4bed-afa5-ab21f1518335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:51.180083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:51.271165 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 149/296] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:51.292622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112667a9-0503-45b5-8c7b-f8fe463dcd1d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:51.382117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba9220-7c7b-46fb-90e6-4c26c7c4d92c None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:51.382604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba9220-7c7b-46fb-90e6-4c26c7c4d92c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:51.382986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba9220-7c7b-46fb-90e6-4c26c7c4d92c None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:51.389644 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 150/297] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:44:51.391565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1620b5-ec29-4ff6-9e35-4c889f94d48f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:51.391969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1620b5-ec29-4ff6-9e35-4c889f94d48f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:51.392370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1620b5-ec29-4ff6-9e35-4c889f94d48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:51.411566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1e1620b5-ec29-4ff6-9e35-4c889f94d48f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:51.412957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1e1620b5-ec29-4ff6-9e35-4c889f94d48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:51.423435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:51.440948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112667a9-0503-45b5-8c7b-f8fe463dcd1d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:51.489570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4435f-f0fe-4b07-a3fc-c8693c67f6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:51.490946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4435f-f0fe-4b07-a3fc-c8693c67f6d6 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:51.491446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4435f-f0fe-4b07-a3fc-c8693c67f6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:51.491903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4435f-f0fe-4b07-a3fc-c8693c67f6d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:51.499533 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 151/298] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 16 20:44:51.505730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4435f-f0fe-4b07-a3fc-c8693c67f6d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:51.515186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5057d3-8b6d-4b79-81d5-4c580979b5ab None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:51.515456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5057d3-8b6d-4b79-81d5-4c580979b5ab None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:51.515680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5057d3-8b6d-4b79-81d5-4c580979b5ab None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:51.516229 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-eab4435f-f0fe-4b07-a3fc-c8693c67f6d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 16 20:44:51.516229 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:51.516229 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:51.516229 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:51.516229 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:51.516229 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:51.516229 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:51.516229 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:51.516229 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:51.516229 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:51.516229 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:51.516229 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:51.516229 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:51.516229 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:51.516229 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:51.516229 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:51.517051 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:51.517051 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:51.517051 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:51.517051 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:51.517051 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:51.517051 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:51.517051 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:51.517051 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:51.517051 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:51.517051 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:51.517051 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:51.517051 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:51.517051 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:51.517051 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:51.517051 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:51.517051 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:51.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:51.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:51.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:51.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:51.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:51.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:51.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:51.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:51.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:51.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:51.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 16 20:44:51.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:51.518428 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 152/299] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:51.520003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5057d3-8b6d-4b79-81d5-4c580979b5ab None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:51.520556 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 148/300] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:51.523962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19764c-6df0-4adb-8e36-f09fe1697afc None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:51.524244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19764c-6df0-4adb-8e36-f09fe1697afc None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:51.524517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19764c-6df0-4adb-8e36-f09fe1697afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:51.546729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4f19764c-6df0-4adb-8e36-f09fe1697afc None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:51.548007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4f19764c-6df0-4adb-8e36-f09fe1697afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:51.615201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:51.643397 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 149/301] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:51.643397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19764c-6df0-4adb-8e36-f09fe1697afc None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:51.654017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5057d3-8b6d-4b79-81d5-4c580979b5ab None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:51.698820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430036d-abee-4847-b09f-4505c9233488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:51.699989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430036d-abee-4847-b09f-4505c9233488 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:51.699989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430036d-abee-4847-b09f-4505c9233488 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:51.700337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430036d-abee-4847-b09f-4505c9233488 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:51.702370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430036d-abee-4847-b09f-4505c9233488 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:51.704003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430036d-abee-4847-b09f-4505c9233488 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:51.710437 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 153/302] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:44:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:51.710437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430036d-abee-4847-b09f-4505c9233488 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:51.731776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:51.771148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19764c-6df0-4adb-8e36-f09fe1697afc None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:51.816223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481f3e6-4683-4fb0-a265-1dccd5b3d204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:51.817152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481f3e6-4683-4fb0-a265-1dccd5b3d204 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:51.817437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481f3e6-4683-4fb0-a265-1dccd5b3d204 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:51.817700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481f3e6-4683-4fb0-a265-1dccd5b3d204 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:51.818474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481f3e6-4683-4fb0-a265-1dccd5b3d204 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:51.818779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481f3e6-4683-4fb0-a265-1dccd5b3d204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:51.820261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481f3e6-4683-4fb0-a265-1dccd5b3d204 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:51.830345 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 150/303] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:44:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:51.831250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481f3e6-4683-4fb0-a265-1dccd5b3d204 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:51.837596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430036d-abee-4847-b09f-4505c9233488 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:51.880048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ee8b0-5272-493e-a75b-e5d329959f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:51.880901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee8b0-5272-493e-a75b-e5d329959f25 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:51.881129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee8b0-5272-493e-a75b-e5d329959f25 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:51.881400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee8b0-5272-493e-a75b-e5d329959f25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:51.893223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ee8b0-5272-493e-a75b-e5d329959f25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:51.901141 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-1d9ee8b0-5272-493e-a75b-e5d329959f25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:51.901141 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:51.901141 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:51.901141 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:51.901141 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:51.901141 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:51.901141 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:51.901141 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:51.901141 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:51.901141 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:51.901141 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:51.901141 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:51.901141 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:51.901141 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:51.901141 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:51.901141 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:51.902127 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:51.902127 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:51.902127 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:51.902127 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:51.902127 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:51.902127 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:51.902127 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:51.902127 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:51.902127 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:51.902127 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:51.902127 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:51.902127 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:51.902127 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:51.902127 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:51.902127 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:51.902127 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:51.902894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:51.902894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:51.902894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:51.902894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:51.902894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:51.902894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:51.902894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:51.902894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:51.902894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:51.902894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:51.902894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:51.902894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:44:51.902894 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 154/304] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:51.904518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ee8b0-5272-493e-a75b-e5d329959f25 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:51.906152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:51.953092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481f3e6-4683-4fb0-a265-1dccd5b3d204 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:52.000469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:52.006920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb7309-df46-473d-810c-cb0ad8b05687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:52.007648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb7309-df46-473d-810c-cb0ad8b05687 None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:52.011695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb7309-df46-473d-810c-cb0ad8b05687 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:52.011695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb7309-df46-473d-810c-cb0ad8b05687 None admin] PATH_INFO: `/v3/groups` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:52.011695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb7309-df46-473d-810c-cb0ad8b05687 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:52.011695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb7309-df46-473d-810c-cb0ad8b05687 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:52.041301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ee8b0-5272-493e-a75b-e5d329959f25 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:52.076825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f32fe9-0044-4bc9-bc53-fd00b6e296c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:52.077741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f32fe9-0044-4bc9-bc53-fd00b6e296c3 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:52.078022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f32fe9-0044-4bc9-bc53-fd00b6e296c3 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:52.078295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f32fe9-0044-4bc9-bc53-fd00b6e296c3 None admin] PATH_INFO: `/v3/users/2986f5d6e5154540b1388ab9629b371a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:52.085126 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 151/305] 10.222.0.16 () {60 vars in 1134 bytes} [Sat Jul 16 20:44:51 2022] POST /identity/v3/groups => generated 229 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:44:52.093136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f32fe9-0044-4bc9-bc53-fd00b6e296c3 None admin] RBAC: Authorizing `identity:get_user(user_id=2986f5d6e5154540b1388ab9629b371a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:52.094738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f32fe9-0044-4bc9-bc53-fd00b6e296c3 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:52.096327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb7309-df46-473d-810c-cb0ad8b05687 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:52.096628 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 155/306] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:51 2022] GET /identity/v3/users/2986f5d6e5154540b1388ab9629b371a => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:52.109277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f32fe9-0044-4bc9-bc53-fd00b6e296c3 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:52.190939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:52.239240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f32fe9-0044-4bc9-bc53-fd00b6e296c3 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:52.261078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb7309-df46-473d-810c-cb0ad8b05687 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:52.284364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5e3b5-193e-4327-9b60-67661b1bb788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:52.284364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5e3b5-193e-4327-9b60-67661b1bb788 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:52.284364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5e3b5-193e-4327-9b60-67661b1bb788 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:52.284725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5e3b5-193e-4327-9b60-67661b1bb788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:52.285921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5e3b5-193e-4327-9b60-67661b1bb788 None admin] RBAC: Adding query filter params (role.id=4f9686ee5911427e8cca34c19a1b7513, user.id=2986f5d6e5154540b1388ab9629b371a, scope.system=all) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:52.285921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5e3b5-193e-4327-9b60-67661b1bb788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:52.289302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5e3b5-193e-4327-9b60-67661b1bb788 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:52.299930 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 156/307] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Jul 16 20:44:52 2022] GET /identity/v3/role_assignments?user.id=2986f5d6e5154540b1388ab9629b371a&scope.system=all&role.id=4f9686ee5911427e8cca34c19a1b7513 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:52.312448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7eb20d-0702-44b7-83a5-d6033b7894cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:52.313154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7eb20d-0702-44b7-83a5-d6033b7894cf None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:52.313438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7eb20d-0702-44b7-83a5-d6033b7894cf None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:52.313711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7eb20d-0702-44b7-83a5-d6033b7894cf None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:52.314489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7eb20d-0702-44b7-83a5-d6033b7894cf None admin] RBAC: Adding query filter params (name=member) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:52.314796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7eb20d-0702-44b7-83a5-d6033b7894cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:52.316292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7eb20d-0702-44b7-83a5-d6033b7894cf None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:52.328468 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 152/308] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:44:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:52.334225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5e3b5-193e-4327-9b60-67661b1bb788 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:52.433326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c3697-c34b-49f6-8d47-8dfc52fa3c89 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:52.434019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c3697-c34b-49f6-8d47-8dfc52fa3c89 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:52.434749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c3697-c34b-49f6-8d47-8dfc52fa3c89 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:52.437480 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 153/309] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:44:52.444885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a3919-d198-410b-9e41-be4dda391f70 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:52.445192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a3919-d198-410b-9e41-be4dda391f70 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:52.445509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a3919-d198-410b-9e41-be4dda391f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:52.458968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5e3b5-193e-4327-9b60-67661b1bb788 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:52.468291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-364a3919-d198-410b-9e41-be4dda391f70 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:52.474966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-364a3919-d198-410b-9e41-be4dda391f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:52.488560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:52.501810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ed574-8376-4d97-932b-552daf53c7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:52.502688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ed574-8376-4d97-932b-552daf53c7b8 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:52.502970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ed574-8376-4d97-932b-552daf53c7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:52.504988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ed574-8376-4d97-932b-552daf53c7b8 None admin] PATH_INFO: `/v3/users/728a55a6c6d541fb823f58251bdccfd8` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:52.505975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ed574-8376-4d97-932b-552daf53c7b8 None admin] RBAC: Authorizing `identity:get_user(user_id=728a55a6c6d541fb823f58251bdccfd8)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:52.507630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ed574-8376-4d97-932b-552daf53c7b8 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:52.513616 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 157/310] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:52 2022] GET /identity/v3/users/728a55a6c6d541fb823f58251bdccfd8 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:52.515689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ed574-8376-4d97-932b-552daf53c7b8 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:52.539098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:52.571044 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 154/311] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:52.592717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a3919-d198-410b-9e41-be4dda391f70 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:52.659948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ed574-8376-4d97-932b-552daf53c7b8 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:52.699811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1d823-ef0f-4852-a688-5e1f8624fcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:52.700694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1d823-ef0f-4852-a688-5e1f8624fcaa None admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:52.701072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1d823-ef0f-4852-a688-5e1f8624fcaa None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:52.701422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1d823-ef0f-4852-a688-5e1f8624fcaa None admin] PATH_INFO: `/v3/system/users/728a55a6c6d541fb823f58251bdccfd8/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:52.703448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1d823-ef0f-4852-a688-5e1f8624fcaa None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=728a55a6c6d541fb823f58251bdccfd8, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:52.704942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1d823-ef0f-4852-a688-5e1f8624fcaa None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:52.729730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a3919-d198-410b-9e41-be4dda391f70 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:52.778073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc148986-cd07-40c0-9316-46d5553650cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:52.779329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc148986-cd07-40c0-9316-46d5553650cc None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:52.780023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc148986-cd07-40c0-9316-46d5553650cc None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:52.780474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc148986-cd07-40c0-9316-46d5553650cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:52.792323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc148986-cd07-40c0-9316-46d5553650cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:52.801334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-bc148986-cd07-40c0-9316-46d5553650cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 16 20:44:52.801334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:52.801334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:52.801334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:52.801334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:52.801334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:52.801334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:52.801334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:52.801334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:52.801334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:52.801334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:52.801334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:52.801334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:52.801334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:52.801334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:52.801334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:52.802235 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:52.802235 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:52.802235 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:52.802235 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:52.802235 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:52.802235 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:52.802235 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:52.802235 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:52.802235 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:52.802235 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:52.802235 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:52.802235 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:52.802235 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:52.802235 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:52.802235 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:52.802235 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:52.803096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:52.803096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:52.803096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:52.803096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:52.803096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:52.803096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:52.803096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:52.803096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:52.803096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:52.803096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:52.803096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 16 20:44:52.803096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:52.805201 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 155/312] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:44:52.812387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc148986-cd07-40c0-9316-46d5553650cc None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:52.814284 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 158/313] 10.222.0.16 () {58 vars in 1334 bytes} [Sat Jul 16 20:44:52 2022] PUT /identity/v3/system/users/728a55a6c6d541fb823f58251bdccfd8/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 20:44:52.870087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:52.940858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc148986-cd07-40c0-9316-46d5553650cc None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:52.981806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0149375-71f5-40c2-ac81-79eac07932d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:52.982511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0149375-71f5-40c2-ac81-79eac07932d9 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:52.982797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0149375-71f5-40c2-ac81-79eac07932d9 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:52.983102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0149375-71f5-40c2-ac81-79eac07932d9 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:52.983872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0149375-71f5-40c2-ac81-79eac07932d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:52.984180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0149375-71f5-40c2-ac81-79eac07932d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:52.985623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0149375-71f5-40c2-ac81-79eac07932d9 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:52.996149 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 156/314] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:44:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:53.002537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1d823-ef0f-4852-a688-5e1f8624fcaa None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:53.067217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:53.118108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1d823-ef0f-4852-a688-5e1f8624fcaa None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:53.155081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c6f5a-ac4d-47e6-80ec-08c2ff7bac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:53.155969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c6f5a-ac4d-47e6-80ec-08c2ff7bac23 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:53.156246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c6f5a-ac4d-47e6-80ec-08c2ff7bac23 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:53.156517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c6f5a-ac4d-47e6-80ec-08c2ff7bac23 None admin] PATH_INFO: `/v3/users/5c44f44a6c5843e9b60d133ef83af453` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:53.157746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c6f5a-ac4d-47e6-80ec-08c2ff7bac23 None admin] RBAC: Authorizing `identity:get_user(user_id=5c44f44a6c5843e9b60d133ef83af453)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:53.159213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c6f5a-ac4d-47e6-80ec-08c2ff7bac23 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:53.161173 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 159/315] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:53 2022] GET /identity/v3/users/5c44f44a6c5843e9b60d133ef83af453 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:53.166835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0149375-71f5-40c2-ac81-79eac07932d9 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:53.283719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0149375-71f5-40c2-ac81-79eac07932d9 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:53.286517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:53.319844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797f375-adee-4750-aabc-c327fa5473fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:53.321289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797f375-adee-4750-aabc-c327fa5473fb None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:53.321766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797f375-adee-4750-aabc-c327fa5473fb None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:53.322237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797f375-adee-4750-aabc-c327fa5473fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:53.401500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797f375-adee-4750-aabc-c327fa5473fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:53.403331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797f375-adee-4750-aabc-c327fa5473fb None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:53.513291 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 157/316] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:44:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:44:53.523607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c6f5a-ac4d-47e6-80ec-08c2ff7bac23 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:53.628464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c6f5a-ac4d-47e6-80ec-08c2ff7bac23 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:53.653964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:53.665027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf217a-6fd4-4893-b1eb-f56ae56ab2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:53.665887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf217a-6fd4-4893-b1eb-f56ae56ab2dc None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:53.666167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf217a-6fd4-4893-b1eb-f56ae56ab2dc None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:53.666444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf217a-6fd4-4893-b1eb-f56ae56ab2dc None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:53.667661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf217a-6fd4-4893-b1eb-f56ae56ab2dc None admin] RBAC: Authorizing `identity:get_project(project_id=10517c754ba94c1d893d97627d31b9f0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:53.669158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf217a-6fd4-4893-b1eb-f56ae56ab2dc None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:53.671258 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 160/317] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:53 2022] GET /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:53.677371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797f375-adee-4750-aabc-c327fa5473fb None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:53.680938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:53.785889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797f375-adee-4750-aabc-c327fa5473fb None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:53.822946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9be02-039b-4699-a05c-c9a441f3f868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:53.823918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9be02-039b-4699-a05c-c9a441f3f868 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:53.824402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9be02-039b-4699-a05c-c9a441f3f868 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:53.824851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9be02-039b-4699-a05c-c9a441f3f868 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:53.825861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9be02-039b-4699-a05c-c9a441f3f868 None admin] RBAC: Adding query filter params (role.id=4f9686ee5911427e8cca34c19a1b7513, scope.project.id=10517c754ba94c1d893d97627d31b9f0, user.id=5c44f44a6c5843e9b60d133ef83af453) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:53.826979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9be02-039b-4699-a05c-c9a441f3f868 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:53.828626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9be02-039b-4699-a05c-c9a441f3f868 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:53.835732 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 158/318] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:44:53 2022] GET /identity/v3/role_assignments?user.id=5c44f44a6c5843e9b60d133ef83af453&scope.project.id=10517c754ba94c1d893d97627d31b9f0&role.id=4f9686ee5911427e8cca34c19a1b7513 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:54.546288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd327084-b40d-45e6-a6fa-ac30d3dd9451 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:54.546842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd327084-b40d-45e6-a6fa-ac30d3dd9451 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:54.546842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd327084-b40d-45e6-a6fa-ac30d3dd9451 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:54.548409 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 161/319] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:54.553894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c086cfa-44ac-4157-a859-01f311ba8251 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:54.554344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c086cfa-44ac-4157-a859-01f311ba8251 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:54.554543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c086cfa-44ac-4157-a859-01f311ba8251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:54.572618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3c086cfa-44ac-4157-a859-01f311ba8251 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:54.573813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3c086cfa-44ac-4157-a859-01f311ba8251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:54.644570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:54.650328 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 159/320] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:54.661606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26130a9c-f79e-442c-951a-8392589d5082 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:54.662215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26130a9c-f79e-442c-951a-8392589d5082 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:54.662710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26130a9c-f79e-442c-951a-8392589d5082 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:54.664611 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 162/321] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:54.669547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1556f-6424-4788-88e8-3e76ce778ca6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:54.669863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1556f-6424-4788-88e8-3e76ce778ca6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:54.670138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1556f-6424-4788-88e8-3e76ce778ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:54.675498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26130a9c-f79e-442c-951a-8392589d5082 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:54.688194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-41e1556f-6424-4788-88e8-3e76ce778ca6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:54.689371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-41e1556f-6424-4788-88e8-3e76ce778ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:54.768493 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 160/322] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:54.790278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26130a9c-f79e-442c-951a-8392589d5082 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:54.791974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1556f-6424-4788-88e8-3e76ce778ca6 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:54.838022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af0892-6455-42c0-914c-9c33ac3fae0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:54.839682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af0892-6455-42c0-914c-9c33ac3fae0e None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:54.840421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af0892-6455-42c0-914c-9c33ac3fae0e None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:54.841196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af0892-6455-42c0-914c-9c33ac3fae0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:54.842846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af0892-6455-42c0-914c-9c33ac3fae0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:54.845412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af0892-6455-42c0-914c-9c33ac3fae0e None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:54.848375 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 163/323] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:44:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:54.854091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af0892-6455-42c0-914c-9c33ac3fae0e None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:54.900716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1556f-6424-4788-88e8-3e76ce778ca6 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:54.931598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:54.933151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:54.942387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958b13f-ead4-447a-81b6-106a05740b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:54.943220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958b13f-ead4-447a-81b6-106a05740b0e None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:54.943502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958b13f-ead4-447a-81b6-106a05740b0e None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:54.943774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958b13f-ead4-447a-81b6-106a05740b0e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:54.957631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958b13f-ead4-447a-81b6-106a05740b0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:54.965505 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-6958b13f-ead4-447a-81b6-106a05740b0e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 16 20:44:54.965505 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:54.965505 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:54.965505 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:54.965505 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:54.965505 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:54.965505 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:54.965505 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:54.965505 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:54.965505 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:54.965505 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:54.965505 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:54.965505 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:54.965505 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:54.965505 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:54.965505 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:54.966535 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:54.966535 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:54.966535 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:54.966535 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:54.966535 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:54.966535 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:54.966535 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:54.966535 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:54.966535 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:54.966535 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:54.966535 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:54.966535 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:54.966535 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:54.966535 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:54.966535 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:54.966535 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:54.972424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:54.972424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:54.972424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:54.972424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:54.972424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:54.972424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:54.972424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:54.972424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:54.972424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:54.972424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:54.972424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 16 20:44:54.972424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:44:54.972424 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 161/324] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:44:54.973149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958b13f-ead4-447a-81b6-106a05740b0e None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:54.989160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af0892-6455-42c0-914c-9c33ac3fae0e None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:55.036061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2aa1a-c044-4a2f-bc0b-8eaa589196ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:55.036866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2aa1a-c044-4a2f-bc0b-8eaa589196ea None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:55.037149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2aa1a-c044-4a2f-bc0b-8eaa589196ea None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:55.037539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2aa1a-c044-4a2f-bc0b-8eaa589196ea None admin] PATH_INFO: `/v3/groups` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:55.038248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2aa1a-c044-4a2f-bc0b-8eaa589196ea None admin] RBAC: Authorizing `identity:create_group()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:55.040009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2aa1a-c044-4a2f-bc0b-8eaa589196ea None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:55.094655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958b13f-ead4-447a-81b6-106a05740b0e None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:55.131714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442f64e-be34-418d-9694-2643a1da3d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:55.132469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442f64e-be34-418d-9694-2643a1da3d84 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:55.132785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442f64e-be34-418d-9694-2643a1da3d84 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:55.133055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442f64e-be34-418d-9694-2643a1da3d84 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:55.133801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442f64e-be34-418d-9694-2643a1da3d84 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:55.134103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442f64e-be34-418d-9694-2643a1da3d84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:55.135538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442f64e-be34-418d-9694-2643a1da3d84 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:55.144432 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 162/325] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:44:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:55.150237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442f64e-be34-418d-9694-2643a1da3d84 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:55.209896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:55.220132 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 164/326] 10.222.0.16 () {60 vars in 1134 bytes} [Sat Jul 16 20:44:54 2022] POST /identity/v3/groups => generated 226 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 20:44:55.247215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52203e93-9f66-4098-8796-897223397209 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:55.247553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52203e93-9f66-4098-8796-897223397209 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:55.248555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52203e93-9f66-4098-8796-897223397209 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:55.250309 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 165/327] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:44:55.256890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492245e-e7ba-484f-a631-81228f2f6d72 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:55.257241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492245e-e7ba-484f-a631-81228f2f6d72 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:55.257465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492245e-e7ba-484f-a631-81228f2f6d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:55.276012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f492245e-e7ba-484f-a631-81228f2f6d72 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:55.277295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f492245e-e7ba-484f-a631-81228f2f6d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:55.278552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442f64e-be34-418d-9694-2643a1da3d84 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:55.325139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5683bc-b057-4808-9224-e134ec003c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:55.326141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5683bc-b057-4808-9224-e134ec003c3f None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:55.326429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5683bc-b057-4808-9224-e134ec003c3f None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:55.326707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5683bc-b057-4808-9224-e134ec003c3f None admin] PATH_INFO: `/v3/users/2986f5d6e5154540b1388ab9629b371a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:55.328244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5683bc-b057-4808-9224-e134ec003c3f None admin] RBAC: Authorizing `identity:get_user(user_id=2986f5d6e5154540b1388ab9629b371a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:55.329780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5683bc-b057-4808-9224-e134ec003c3f None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:55.331858 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 163/328] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:55 2022] GET /identity/v3/users/2986f5d6e5154540b1388ab9629b371a => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:55.337838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5683bc-b057-4808-9224-e134ec003c3f None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:55.363390 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 166/329] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 16 20:44:55.388255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492245e-e7ba-484f-a631-81228f2f6d72 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:55.450861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:55.478745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5683bc-b057-4808-9224-e134ec003c3f None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:55.501463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:55.512138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492245e-e7ba-484f-a631-81228f2f6d72 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:55.532028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953a43a-aa1c-4dbc-ad83-6eb006d52beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:55.532985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953a43a-aa1c-4dbc-ad83-6eb006d52beb None admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:55.533852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953a43a-aa1c-4dbc-ad83-6eb006d52beb None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:55.537176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953a43a-aa1c-4dbc-ad83-6eb006d52beb None admin] PATH_INFO: `/v3/system/users/2986f5d6e5154540b1388ab9629b371a/roles/4f9686ee5911427e8cca34c19a1b7513` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:55.540921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953a43a-aa1c-4dbc-ad83-6eb006d52beb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2986f5d6e5154540b1388ab9629b371a, role_id=4f9686ee5911427e8cca34c19a1b7513)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:55.540921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953a43a-aa1c-4dbc-ad83-6eb006d52beb None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:55.565910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584ecab-68d1-4a2d-a2b2-dd8401cb25c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:55.567365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584ecab-68d1-4a2d-a2b2-dd8401cb25c2 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:55.567645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584ecab-68d1-4a2d-a2b2-dd8401cb25c2 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:55.567944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584ecab-68d1-4a2d-a2b2-dd8401cb25c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:55.580190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584ecab-68d1-4a2d-a2b2-dd8401cb25c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:55.588142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-c584ecab-68d1-4a2d-a2b2-dd8401cb25c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:55.588142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:55.588142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:55.588142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:55.588142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:55.588142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:55.588142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:55.588142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:55.588142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:55.588142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:55.588142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:55.588142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:55.588142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:55.588142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:55.588142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:55.588142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:55.593234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:55.593234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:55.593234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:55.593234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:55.593234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:55.593234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:55.593234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:55.593234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:55.593234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:55.593234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:55.593234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:55.593234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:55.593234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:55.593234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:55.593234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:55.593234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:55.594158 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:55.594158 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:55.594158 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:55.594158 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:55.594158 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:55.594158 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:55.594158 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:55.594158 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:55.594158 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:55.594158 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:55.594158 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:55.594158 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:44:55.594158 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 167/330] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:44:55.595906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584ecab-68d1-4a2d-a2b2-dd8401cb25c2 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:55.616344 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 164/331] 10.222.0.16 () {58 vars in 1334 bytes} [Sat Jul 16 20:44:55 2022] PUT /identity/v3/system/users/2986f5d6e5154540b1388ab9629b371a/roles/4f9686ee5911427e8cca34c19a1b7513 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 20:44:55.736511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584ecab-68d1-4a2d-a2b2-dd8401cb25c2 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:55.749731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:55.782379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa5d89-1e6f-4446-aa6f-4c27706dbaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:55.783084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa5d89-1e6f-4446-aa6f-4c27706dbaa6 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:55.783372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa5d89-1e6f-4446-aa6f-4c27706dbaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:55.783647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa5d89-1e6f-4446-aa6f-4c27706dbaa6 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:55.784549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa5d89-1e6f-4446-aa6f-4c27706dbaa6 None admin] RBAC: Adding query filter params (name=member) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:55.784856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa5d89-1e6f-4446-aa6f-4c27706dbaa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:55.786285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa5d89-1e6f-4446-aa6f-4c27706dbaa6 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:55.796681 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 168/332] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:44:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:44:55.802384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953a43a-aa1c-4dbc-ad83-6eb006d52beb None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:55.927813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953a43a-aa1c-4dbc-ad83-6eb006d52beb None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:55.973095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a9f3e-5d5a-4e90-9fae-b89abcf42c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:55.973993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a9f3e-5d5a-4e90-9fae-b89abcf42c0f None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:55.974269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a9f3e-5d5a-4e90-9fae-b89abcf42c0f None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:55.974539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a9f3e-5d5a-4e90-9fae-b89abcf42c0f None admin] PATH_INFO: `/v3/users/728a55a6c6d541fb823f58251bdccfd8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:55.975864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a9f3e-5d5a-4e90-9fae-b89abcf42c0f None admin] RBAC: Authorizing `identity:get_user(user_id=728a55a6c6d541fb823f58251bdccfd8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:55.977403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a9f3e-5d5a-4e90-9fae-b89abcf42c0f None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:55.979428 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 165/333] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:55 2022] GET /identity/v3/users/728a55a6c6d541fb823f58251bdccfd8 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:55.985098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa5d89-1e6f-4446-aa6f-4c27706dbaa6 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:56.135195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa5d89-1e6f-4446-aa6f-4c27706dbaa6 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:56.179365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e57eb-d9e1-49d9-9a51-c89e2592bd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:56.180397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e57eb-d9e1-49d9-9a51-c89e2592bd0f None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:56.180892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e57eb-d9e1-49d9-9a51-c89e2592bd0f None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:56.181424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e57eb-d9e1-49d9-9a51-c89e2592bd0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:56.182604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e57eb-d9e1-49d9-9a51-c89e2592bd0f None admin] RBAC: Adding query filter params (role.id=c352110df5bc449b9134928abd20c032, user.id=728a55a6c6d541fb823f58251bdccfd8, scope.system=all) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:56.183184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e57eb-d9e1-49d9-9a51-c89e2592bd0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:56.185116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e57eb-d9e1-49d9-9a51-c89e2592bd0f None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:56.201834 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 169/334] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Jul 16 20:44:55 2022] GET /identity/v3/role_assignments?user.id=728a55a6c6d541fb823f58251bdccfd8&scope.system=all&role.id=c352110df5bc449b9134928abd20c032 => generated 510 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:58.391235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e29bf-9dd3-4148-998d-3be5f7a693f3 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:58.392275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e29bf-9dd3-4148-998d-3be5f7a693f3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:58.392769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e29bf-9dd3-4148-998d-3be5f7a693f3 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:58.394703 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 166/335] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:58.400665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0e49a-d7ec-4b6c-99dc-938c6bff8b97 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:58.401175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0e49a-d7ec-4b6c-99dc-938c6bff8b97 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:58.401289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0e49a-d7ec-4b6c-99dc-938c6bff8b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:58.429162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-16a0e49a-d7ec-4b6c-99dc-938c6bff8b97 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:58.430381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-16a0e49a-d7ec-4b6c-99dc-938c6bff8b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:58.467425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:58.520597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c6342-6c98-45a4-ac6c-9d9633c1dd87 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:58.520925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c6342-6c98-45a4-ac6c-9d9633c1dd87 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:58.521165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c6342-6c98-45a4-ac6c-9d9633c1dd87 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:58.523877 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 167/336] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:58.528849 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 170/337] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:58.530860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735792fb-ed28-49aa-bf06-efda36ef0e6c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:58.531270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735792fb-ed28-49aa-bf06-efda36ef0e6c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:58.531454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735792fb-ed28-49aa-bf06-efda36ef0e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:58.568210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-735792fb-ed28-49aa-bf06-efda36ef0e6c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:58.569425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-735792fb-ed28-49aa-bf06-efda36ef0e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:58.571761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0e49a-d7ec-4b6c-99dc-938c6bff8b97 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:58.650302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:58.678148 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 168/338] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:44:58.679791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1577fa8-91b3-4c41-b634-b22b8adfe399 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:58.680110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1577fa8-91b3-4c41-b634-b22b8adfe399 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:58.680455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1577fa8-91b3-4c41-b634-b22b8adfe399 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:58.682172 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 169/339] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:44:58.688703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113a86c-4173-4a90-a75c-16abd7650f41 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:58.688988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113a86c-4173-4a90-a75c-16abd7650f41 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:58.689246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113a86c-4173-4a90-a75c-16abd7650f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:58.717666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0e49a-d7ec-4b6c-99dc-938c6bff8b97 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:58.719599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f113a86c-4173-4a90-a75c-16abd7650f41 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:44:58.720992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f113a86c-4173-4a90-a75c-16abd7650f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:44:58.759648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfc38c-8014-4cb8-bc53-5d69d9f8c262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:58.760516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfc38c-8014-4cb8-bc53-5d69d9f8c262 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:58.760810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfc38c-8014-4cb8-bc53-5d69d9f8c262 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:58.761090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfc38c-8014-4cb8-bc53-5d69d9f8c262 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:58.783912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfc38c-8014-4cb8-bc53-5d69d9f8c262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:58.792235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-3cdfc38c-8014-4cb8-bc53-5d69d9f8c262 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:58.792235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:58.792235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:58.792235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:58.792235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:58.792235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:58.792235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:58.792235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:58.792235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:58.792235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:58.792235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:58.792235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:58.792235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:58.792235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:58.792235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:58.792235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:58.798627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:58.798627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:58.798627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:58.798627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:58.798627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:58.798627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:58.798627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:58.798627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:58.798627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:58.798627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:58.798627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:58.798627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:58.798627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:58.798627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:58.798627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:58.798627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:58.799456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:58.799456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:58.799456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:58.799456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:58.799456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:58.799456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:58.799456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:58.799456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:58.799456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:58.799456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:58.799456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:44:58.799456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:44:58.799456 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 171/340] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:44:58.799456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfc38c-8014-4cb8-bc53-5d69d9f8c262 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:58.823406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:58.899216 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 170/341] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 16 20:44:58.905206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113a86c-4173-4a90-a75c-16abd7650f41 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:58.927554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfc38c-8014-4cb8-bc53-5d69d9f8c262 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:58.973234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be0e68-cc00-4ecf-8a28-8c62de5b7850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:58.974452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be0e68-cc00-4ecf-8a28-8c62de5b7850 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:58.977656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be0e68-cc00-4ecf-8a28-8c62de5b7850 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:58.977656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be0e68-cc00-4ecf-8a28-8c62de5b7850 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:58.994052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be0e68-cc00-4ecf-8a28-8c62de5b7850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:59.005645 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-40be0e68-cc00-4ecf-8a28-8c62de5b7850 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:44:59.005645 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:59.005645 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:59.005645 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:59.005645 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:59.005645 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:59.005645 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:59.005645 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:59.005645 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:59.005645 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:59.005645 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:59.005645 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:59.005645 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:59.005645 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:59.005645 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:59.005645 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:59.006577 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:59.006577 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:59.006577 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:59.006577 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:59.006577 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:59.006577 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:59.006577 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:59.006577 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:59.006577 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:59.006577 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:59.006577 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:59.006577 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:59.006577 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:59.006577 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:59.006577 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:59.006577 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:59.007368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:59.007368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:59.007368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:59.007368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:59.007368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:59.007368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:59.007368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:59.007368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:59.007368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:59.007368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:59.007368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:44:59.007368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:44:59.010632 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 172/342] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Jul 16 20:44:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:59.011550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be0e68-cc00-4ecf-8a28-8c62de5b7850 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:59.073320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113a86c-4173-4a90-a75c-16abd7650f41 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:59.089442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:59.111448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:59.121775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd6feb-0515-463f-b119-84bf7e50d9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:59.123739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd6feb-0515-463f-b119-84bf7e50d9f4 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:59.124293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd6feb-0515-463f-b119-84bf7e50d9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:59.124727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd6feb-0515-463f-b119-84bf7e50d9f4 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:59.125991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd6feb-0515-463f-b119-84bf7e50d9f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:59.126444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd6feb-0515-463f-b119-84bf7e50d9f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:59.128973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd6feb-0515-463f-b119-84bf7e50d9f4 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:59.134846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be0e68-cc00-4ecf-8a28-8c62de5b7850 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:59.141552 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 171/343] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:44:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:59.144622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd6feb-0515-463f-b119-84bf7e50d9f4 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:59.186959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e427b91-51fc-4d40-bde2-752698cb0cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:59.188570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e427b91-51fc-4d40-bde2-752698cb0cc2 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:59.188999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e427b91-51fc-4d40-bde2-752698cb0cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:59.189417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e427b91-51fc-4d40-bde2-752698cb0cc2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:59.206778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e427b91-51fc-4d40-bde2-752698cb0cc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:44:59.217897 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-9e427b91-51fc-4d40-bde2-752698cb0cc2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 16 20:44:59.217897 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:44:59.217897 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:44:59.217897 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:44:59.217897 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:44:59.217897 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:44:59.217897 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:44:59.217897 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:44:59.217897 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:44:59.217897 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:44:59.217897 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:44:59.217897 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:44:59.217897 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:44:59.217897 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:44:59.217897 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:44:59.217897 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:44:59.218840 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:44:59.218840 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:44:59.218840 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:44:59.218840 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:44:59.218840 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:44:59.218840 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:44:59.218840 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:44:59.218840 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:44:59.218840 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:44:59.218840 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:44:59.218840 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:44:59.218840 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:44:59.218840 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:44:59.218840 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:44:59.218840 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:44:59.218840 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:44:59.219739 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:44:59.219739 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:44:59.219739 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:44:59.219739 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:44:59.219739 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:44:59.219739 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:44:59.219739 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:44:59.219739 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:44:59.219739 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:44:59.219739 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:44:59.219739 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 16 20:44:59.219739 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:44:59.219739 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 173/344] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:44:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:44:59.220449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e427b91-51fc-4d40-bde2-752698cb0cc2 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:59.301984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd6feb-0515-463f-b119-84bf7e50d9f4 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:59.356170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fb789-ca1d-45c0-a5b5-e7c8ad2fc456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:59.357689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fb789-ca1d-45c0-a5b5-e7c8ad2fc456 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:59.358736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fb789-ca1d-45c0-a5b5-e7c8ad2fc456 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:59.359283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fb789-ca1d-45c0-a5b5-e7c8ad2fc456 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:59.360661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fb789-ca1d-45c0-a5b5-e7c8ad2fc456 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:59.361199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fb789-ca1d-45c0-a5b5-e7c8ad2fc456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:59.363822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fb789-ca1d-45c0-a5b5-e7c8ad2fc456 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:59.365773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e427b91-51fc-4d40-bde2-752698cb0cc2 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:59.380517 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 172/345] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:44:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:59.380517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fb789-ca1d-45c0-a5b5-e7c8ad2fc456 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:59.422732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df0c0d-cdd4-4c3d-94c9-bc43c68851a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:59.425215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df0c0d-cdd4-4c3d-94c9-bc43c68851a0 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:59.425215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df0c0d-cdd4-4c3d-94c9-bc43c68851a0 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:59.425215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df0c0d-cdd4-4c3d-94c9-bc43c68851a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:59.432427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:59.451854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:59.532611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fb789-ca1d-45c0-a5b5-e7c8ad2fc456 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:59.540549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df0c0d-cdd4-4c3d-94c9-bc43c68851a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:59.542386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df0c0d-cdd4-4c3d-94c9-bc43c68851a0 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:59.582306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2778e-2014-482a-b754-b946a489bd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:59.582985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2778e-2014-482a-b754-b946a489bd0d None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:59.583300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2778e-2014-482a-b754-b946a489bd0d None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:59.583581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2778e-2014-482a-b754-b946a489bd0d None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:59.584350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2778e-2014-482a-b754-b946a489bd0d None admin] RBAC: Adding query filter params (name=reader) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:44:59.584648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2778e-2014-482a-b754-b946a489bd0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:59.586074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2778e-2014-482a-b754-b946a489bd0d None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:59.599890 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 173/346] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:44:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:59.600771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2778e-2014-482a-b754-b946a489bd0d None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:59.688937 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 174/347] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:44:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:44:59.690166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df0c0d-cdd4-4c3d-94c9-bc43c68851a0 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:44:59.733473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:59.742113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2778e-2014-482a-b754-b946a489bd0d None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:59.757119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:44:59.794466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7c2ec-f790-48ab-b430-846104f1e495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:59.795177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c2ec-f790-48ab-b430-846104f1e495 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:59.795459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c2ec-f790-48ab-b430-846104f1e495 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:59.795921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c2ec-f790-48ab-b430-846104f1e495 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:59.850779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df0c0d-cdd4-4c3d-94c9-bc43c68851a0 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:44:59.893967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7c2ec-f790-48ab-b430-846104f1e495 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:59.896572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7c2ec-f790-48ab-b430-846104f1e495 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:59.905421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178449e-5af0-4480-8c30-db1781aba348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:44:59.906329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178449e-5af0-4480-8c30-db1781aba348 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:44:59.906604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178449e-5af0-4480-8c30-db1781aba348 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:44:59.906872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178449e-5af0-4480-8c30-db1781aba348 None admin] PATH_INFO: `/v3/users/2986f5d6e5154540b1388ab9629b371a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:44:59.908637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178449e-5af0-4480-8c30-db1781aba348 None admin] RBAC: Authorizing `identity:get_user(user_id=2986f5d6e5154540b1388ab9629b371a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:44:59.909812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178449e-5af0-4480-8c30-db1781aba348 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:44:59.916445 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 175/348] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:44:59 2022] GET /identity/v3/users/2986f5d6e5154540b1388ab9629b371a => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:44:59.916445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178449e-5af0-4480-8c30-db1781aba348 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:00.028101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:00.039839 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 174/349] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:44:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:45:00.040695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7c2ec-f790-48ab-b430-846104f1e495 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:00.051678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178449e-5af0-4480-8c30-db1781aba348 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:00.065679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:00.099177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf6eee-5c73-4715-95f5-01a342f31019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:00.101051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf6eee-5c73-4715-95f5-01a342f31019 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:00.101547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf6eee-5c73-4715-95f5-01a342f31019 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:00.102011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf6eee-5c73-4715-95f5-01a342f31019 None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:00.104070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf6eee-5c73-4715-95f5-01a342f31019 None admin] RBAC: Authorizing `identity:get_project(project_id=2ab6547ffe6648bd8a4ac2a99e702240)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:00.106029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf6eee-5c73-4715-95f5-01a342f31019 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:00.109660 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 176/350] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:44:59 2022] GET /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:00.111315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144367dc-624e-49b3-bd3e-9192fb4c4b40 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:00.111791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144367dc-624e-49b3-bd3e-9192fb4c4b40 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:00.112315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144367dc-624e-49b3-bd3e-9192fb4c4b40 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:00.114122 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 177/351] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:00.115197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144367dc-624e-49b3-bd3e-9192fb4c4b40 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:00.192938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7c2ec-f790-48ab-b430-846104f1e495 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:00.238700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33878868-b3c8-4931-8d7c-524f61bc9776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:00.239393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33878868-b3c8-4931-8d7c-524f61bc9776 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:00.239738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33878868-b3c8-4931-8d7c-524f61bc9776 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:00.239940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33878868-b3c8-4931-8d7c-524f61bc9776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:00.240780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33878868-b3c8-4931-8d7c-524f61bc9776 None admin] RBAC: Adding query filter params (role.id=4f9686ee5911427e8cca34c19a1b7513, user.id=2986f5d6e5154540b1388ab9629b371a, scope.system=all) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:00.241302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33878868-b3c8-4931-8d7c-524f61bc9776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:00.242656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33878868-b3c8-4931-8d7c-524f61bc9776 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:00.265273 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 175/352] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Jul 16 20:45:00 2022] GET /identity/v3/role_assignments?user.id=2986f5d6e5154540b1388ab9629b371a&scope.system=all&role.id=4f9686ee5911427e8cca34c19a1b7513 => generated 510 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:00.265273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd49354-44d7-4a0c-b272-17c2db776a29 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:00.265273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd49354-44d7-4a0c-b272-17c2db776a29 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:00.265273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd49354-44d7-4a0c-b272-17c2db776a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:00.267599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144367dc-624e-49b3-bd3e-9192fb4c4b40 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:00.290209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-bbd49354-44d7-4a0c-b272-17c2db776a29 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:00.292473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bbd49354-44d7-4a0c-b272-17c2db776a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:00.337614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f176c6-7d0d-42a9-b8ea-91e98939192e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:00.338555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f176c6-7d0d-42a9-b8ea-91e98939192e None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:00.338767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f176c6-7d0d-42a9-b8ea-91e98939192e None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:00.339057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f176c6-7d0d-42a9-b8ea-91e98939192e None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:00.340570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f176c6-7d0d-42a9-b8ea-91e98939192e None admin] RBAC: Authorizing `identity:get_project(project_id=2ab6547ffe6648bd8a4ac2a99e702240)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:00.342648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f176c6-7d0d-42a9-b8ea-91e98939192e None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:00.344887 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 178/353] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:45:00 2022] GET /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:00.345922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f176c6-7d0d-42a9-b8ea-91e98939192e None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:00.381098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:00.422491 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 176/354] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:00.423641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:00.426653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f392e6-bd1c-4171-bb10-97b8a9315e60 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:00.427221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f392e6-bd1c-4171-bb10-97b8a9315e60 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:00.427857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f392e6-bd1c-4171-bb10-97b8a9315e60 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:00.430061 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 177/355] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:00.432204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f392e6-bd1c-4171-bb10-97b8a9315e60 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:00.532311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f176c6-7d0d-42a9-b8ea-91e98939192e None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:00.589964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79c8e0-1b65-4c58-8173-d7d1e10be3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:00.590962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79c8e0-1b65-4c58-8173-d7d1e10be3f7 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:00.591278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79c8e0-1b65-4c58-8173-d7d1e10be3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:00.592153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79c8e0-1b65-4c58-8173-d7d1e10be3f7 None admin] PATH_INFO: `/v3/groups/dbba2478141243a2b03206f43ecf1339` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:00.603430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79c8e0-1b65-4c58-8173-d7d1e10be3f7 None admin] RBAC: Authorizing `identity:get_group(group_id=dbba2478141243a2b03206f43ecf1339)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:00.603614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f392e6-bd1c-4171-bb10-97b8a9315e60 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:00.604912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79c8e0-1b65-4c58-8173-d7d1e10be3f7 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:00.609819 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 179/356] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Jul 16 20:45:00 2022] GET /identity/v3/groups/dbba2478141243a2b03206f43ecf1339 => generated 226 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:00.611775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030e0ee-c7a7-400d-b287-795b7bfcb7af None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:00.612469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030e0ee-c7a7-400d-b287-795b7bfcb7af None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:00.612953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030e0ee-c7a7-400d-b287-795b7bfcb7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:00.639393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8030e0ee-c7a7-400d-b287-795b7bfcb7af None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:00.641543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8030e0ee-c7a7-400d-b287-795b7bfcb7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:00.653638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb15834-837a-401e-aae3-c5b3112931bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:00.655094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb15834-837a-401e-aae3-c5b3112931bd None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:00.655382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb15834-837a-401e-aae3-c5b3112931bd None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:00.655652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb15834-837a-401e-aae3-c5b3112931bd None admin] PATH_INFO: `/v3/groups/dbba2478141243a2b03206f43ecf1339` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:00.657403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb15834-837a-401e-aae3-c5b3112931bd None admin] RBAC: Authorizing `identity:get_group(group_id=dbba2478141243a2b03206f43ecf1339)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:00.659484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb15834-837a-401e-aae3-c5b3112931bd None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:00.661306 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 178/357] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Jul 16 20:45:00 2022] GET /identity/v3/groups/dbba2478141243a2b03206f43ecf1339 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:00.662092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb15834-837a-401e-aae3-c5b3112931bd None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:00.733252 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 180/358] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:00.734343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:00.734459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030e0ee-c7a7-400d-b287-795b7bfcb7af None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:00.784754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:00.794460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb15834-837a-401e-aae3-c5b3112931bd None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:00.842748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb74f3e-cd5f-4d9d-9156-43ebb875bf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:00.843511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb74f3e-cd5f-4d9d-9156-43ebb875bf8c None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:00.843787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb74f3e-cd5f-4d9d-9156-43ebb875bf8c None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:00.844053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb74f3e-cd5f-4d9d-9156-43ebb875bf8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:00.858062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb74f3e-cd5f-4d9d-9156-43ebb875bf8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:00.858321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030e0ee-c7a7-400d-b287-795b7bfcb7af None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:00.866774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-2fb74f3e-cd5f-4d9d-9156-43ebb875bf8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:45:00.866774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:00.866774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:00.866774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:00.866774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:00.866774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:00.866774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:00.866774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:00.866774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:00.866774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:00.866774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:00.866774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:00.866774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:00.866774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:00.866774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:00.866774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:00.867699 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:00.867699 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:00.867699 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:00.867699 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:00.867699 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:00.867699 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:00.867699 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:00.867699 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:00.867699 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:00.867699 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:00.867699 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:00.867699 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:00.867699 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:00.867699 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:00.867699 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:00.867699 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:00.868530 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:00.868530 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:00.868530 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:00.868530 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:00.868530 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:00.868530 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:00.868530 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:00.868530 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:00.868530 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:00.868530 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:00.868530 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:45:00.868530 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:00.869533 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 179/359] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:45:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:00.870844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297fa95-d5ba-4aac-bab3-276c4bd4b165 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:00.872090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297fa95-d5ba-4aac-bab3-276c4bd4b165 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:00.872090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297fa95-d5ba-4aac-bab3-276c4bd4b165 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:00.873402 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 180/360] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:00.877738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297fa95-d5ba-4aac-bab3-276c4bd4b165 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:00.914442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873c50b-6fa9-46a2-9cfb-c3cf39f47fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:00.915302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873c50b-6fa9-46a2-9cfb-c3cf39f47fd3 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:00.915591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873c50b-6fa9-46a2-9cfb-c3cf39f47fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:00.915874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873c50b-6fa9-46a2-9cfb-c3cf39f47fd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:00.916741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873c50b-6fa9-46a2-9cfb-c3cf39f47fd3 None admin] RBAC: Adding query filter params (group.id=dbba2478141243a2b03206f43ecf1339, role.id=c352110df5bc449b9134928abd20c032, scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:00.917063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873c50b-6fa9-46a2-9cfb-c3cf39f47fd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:00.918570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873c50b-6fa9-46a2-9cfb-c3cf39f47fd3 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:00.930927 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 181/361] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Jul 16 20:45:00 2022] GET /identity/v3/role_assignments?group.id=dbba2478141243a2b03206f43ecf1339&scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240&role.id=c352110df5bc449b9134928abd20c032 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:00.930927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873c50b-6fa9-46a2-9cfb-c3cf39f47fd3 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:01.034836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297fa95-d5ba-4aac-bab3-276c4bd4b165 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:01.053062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:01.075409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873c50b-6fa9-46a2-9cfb-c3cf39f47fd3 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:01.079600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:01.083574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91213d5a-63fa-469d-a1bc-fe216f924859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:01.084247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91213d5a-63fa-469d-a1bc-fe216f924859 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:01.084531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91213d5a-63fa-469d-a1bc-fe216f924859 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:01.084813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91213d5a-63fa-469d-a1bc-fe216f924859 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:01.085771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91213d5a-63fa-469d-a1bc-fe216f924859 None admin] RBAC: Adding query filter params (group.id=dbba2478141243a2b03206f43ecf1339, role.id=b9444da176484ccfa45d6b85220ce558, scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:01.086117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91213d5a-63fa-469d-a1bc-fe216f924859 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:01.087800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91213d5a-63fa-469d-a1bc-fe216f924859 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:01.101772 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 181/362] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Jul 16 20:45:00 2022] GET /identity/v3/role_assignments?group.id=dbba2478141243a2b03206f43ecf1339&scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240&role.id=b9444da176484ccfa45d6b85220ce558 => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:01.102633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91213d5a-63fa-469d-a1bc-fe216f924859 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:01.132032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9524540-bb8e-491f-aba3-d0af7582bd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:01.133231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9524540-bb8e-491f-aba3-d0af7582bd13 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:01.133747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9524540-bb8e-491f-aba3-d0af7582bd13 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:01.134325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9524540-bb8e-491f-aba3-d0af7582bd13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:01.151708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9524540-bb8e-491f-aba3-d0af7582bd13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:01.160913 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-f9524540-bb8e-491f-aba3-d0af7582bd13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:45:01.160913 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:01.160913 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:01.160913 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:01.160913 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:01.160913 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:01.160913 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:01.160913 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:01.160913 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:01.160913 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:01.160913 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:01.160913 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:01.160913 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:01.160913 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:01.160913 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:01.160913 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:01.161973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:01.161973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:01.161973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:01.161973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:01.161973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:01.161973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:01.161973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:01.161973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:01.161973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:01.161973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:01.161973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:01.161973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:01.161973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:01.161973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:01.161973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:01.161973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:01.162756 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:01.162756 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:01.162756 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:01.162756 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:01.162756 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:01.162756 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:01.162756 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:01.162756 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:01.162756 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:01.162756 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:01.162756 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:45:01.162756 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:01.164574 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 182/363] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Jul 16 20:45:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:01.165128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08faece-7cc8-471a-a020-c281d8b75130 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:01.165474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08faece-7cc8-471a-a020-c281d8b75130 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:01.165751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08faece-7cc8-471a-a020-c281d8b75130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:01.189819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d08faece-7cc8-471a-a020-c281d8b75130 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:01.191622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d08faece-7cc8-471a-a020-c281d8b75130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:01.268733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91213d5a-63fa-469d-a1bc-fe216f924859 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:01.301328 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 183/364] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:01.303418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08faece-7cc8-471a-a020-c281d8b75130 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:01.316865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c21b69-23dd-4531-8a52-fe72cc48511e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:01.317720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c21b69-23dd-4531-8a52-fe72cc48511e None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:01.318100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c21b69-23dd-4531-8a52-fe72cc48511e None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:01.318918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c21b69-23dd-4531-8a52-fe72cc48511e None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:01.319501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c21b69-23dd-4531-8a52-fe72cc48511e None admin] RBAC: Adding query filter params (name=member) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:01.327132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c21b69-23dd-4531-8a52-fe72cc48511e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:01.327132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c21b69-23dd-4531-8a52-fe72cc48511e None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:01.332263 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 182/365] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:45:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:01.338544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c21b69-23dd-4531-8a52-fe72cc48511e None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:01.396676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:01.471261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:01.479304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c21b69-23dd-4531-8a52-fe72cc48511e None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:01.489804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08faece-7cc8-471a-a020-c281d8b75130 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:01.531166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6e521-e73b-4174-b74f-beee62457c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:01.531846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6e521-e73b-4174-b74f-beee62457c62 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:01.532124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6e521-e73b-4174-b74f-beee62457c62 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:01.532402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6e521-e73b-4174-b74f-beee62457c62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:01.536051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b837a27-d572-4530-96af-cfcbc3badcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:01.537080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b837a27-d572-4530-96af-cfcbc3badcf4 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:01.537568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b837a27-d572-4530-96af-cfcbc3badcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:01.538042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b837a27-d572-4530-96af-cfcbc3badcf4 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:01.539048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b837a27-d572-4530-96af-cfcbc3badcf4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:01.539564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b837a27-d572-4530-96af-cfcbc3badcf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:01.541221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b837a27-d572-4530-96af-cfcbc3badcf4 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:01.556694 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 184/366] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:01.557382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b837a27-d572-4530-96af-cfcbc3badcf4 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:01.625705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6e521-e73b-4174-b74f-beee62457c62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:01.627860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6e521-e73b-4174-b74f-beee62457c62 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:01.692371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:01.697259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b837a27-d572-4530-96af-cfcbc3badcf4 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:01.749566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f9670-0f99-4cf6-87dd-37ca56a526f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:01.749566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f9670-0f99-4cf6-87dd-37ca56a526f6 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:01.749566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f9670-0f99-4cf6-87dd-37ca56a526f6 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:01.749566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f9670-0f99-4cf6-87dd-37ca56a526f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:01.764139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f9670-0f99-4cf6-87dd-37ca56a526f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:01.767962 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 183/367] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:45:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:45:01.773632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6e521-e73b-4174-b74f-beee62457c62 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:01.773858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-5c9f9670-0f99-4cf6-87dd-37ca56a526f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:45:01.773858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:01.773858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:01.773858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:01.773858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:01.773858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:01.773858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:01.773858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:01.773858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:01.773858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:01.773858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:01.773858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:01.773858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:01.773858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:01.773858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:01.773858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:01.775190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:01.775190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:01.775190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:01.775190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:01.775190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:01.775190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:01.775190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:01.775190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:01.775190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:01.775190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:01.775190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:01.775190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:01.775190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:01.775190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:01.775190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:01.775190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:01.775965 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:01.775965 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:01.775965 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:01.775965 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:01.775965 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:01.775965 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:01.775965 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:01.775965 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:01.775965 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:01.775965 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:01.775965 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:45:01.775965 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:01.775965 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 185/368] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:45:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:01.783622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f9670-0f99-4cf6-87dd-37ca56a526f6 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:01.806145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:01.930890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6e521-e73b-4174-b74f-beee62457c62 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:01.931949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f9670-0f99-4cf6-87dd-37ca56a526f6 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:01.976234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cc6fd-5454-4f6e-aab4-0afc1504b90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:01.977293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cc6fd-5454-4f6e-aab4-0afc1504b90d None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:01.977794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cc6fd-5454-4f6e-aab4-0afc1504b90d None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:01.978295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cc6fd-5454-4f6e-aab4-0afc1504b90d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:01.985559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d622e6-7a60-4f40-8c28-1725ea0a3711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:01.986239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d622e6-7a60-4f40-8c28-1725ea0a3711 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:01.986522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d622e6-7a60-4f40-8c28-1725ea0a3711 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:01.986794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d622e6-7a60-4f40-8c28-1725ea0a3711 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:01.988548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d622e6-7a60-4f40-8c28-1725ea0a3711 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:01.988859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d622e6-7a60-4f40-8c28-1725ea0a3711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:01.990267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d622e6-7a60-4f40-8c28-1725ea0a3711 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:02.005863 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 186/369] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:45:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:45:02.005863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d622e6-7a60-4f40-8c28-1725ea0a3711 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:02.006919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:02.074922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154cc6fd-5454-4f6e-aab4-0afc1504b90d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:02.077675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154cc6fd-5454-4f6e-aab4-0afc1504b90d None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:02.091824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:02.119725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d622e6-7a60-4f40-8c28-1725ea0a3711 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:02.158959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd165b1-e986-4959-807c-f1c09ae03bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:02.159851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd165b1-e986-4959-807c-f1c09ae03bcd None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:02.160134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd165b1-e986-4959-807c-f1c09ae03bcd None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:02.160478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd165b1-e986-4959-807c-f1c09ae03bcd None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:02.162492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd165b1-e986-4959-807c-f1c09ae03bcd None admin] RBAC: Authorizing `identity:get_project(project_id=10517c754ba94c1d893d97627d31b9f0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:02.164043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd165b1-e986-4959-807c-f1c09ae03bcd None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:02.166091 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 187/370] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:45:02 2022] GET /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:02.170975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd165b1-e986-4959-807c-f1c09ae03bcd None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:02.207558 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 184/371] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:45:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:45:02.208798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cc6fd-5454-4f6e-aab4-0afc1504b90d None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:02.262552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:02.280235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd165b1-e986-4959-807c-f1c09ae03bcd None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:02.320063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f3af6-2a51-41b5-975c-90b14154e59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:02.320725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f3af6-2a51-41b5-975c-90b14154e59f None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:02.321009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f3af6-2a51-41b5-975c-90b14154e59f None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:02.321410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f3af6-2a51-41b5-975c-90b14154e59f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:02.332370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cc6fd-5454-4f6e-aab4-0afc1504b90d None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:02.337928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:02.381592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92953f99-f663-4b67-948f-969d889fe601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:02.382953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92953f99-f663-4b67-948f-969d889fe601 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:02.384131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92953f99-f663-4b67-948f-969d889fe601 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:02.384699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92953f99-f663-4b67-948f-969d889fe601 None admin] PATH_INFO: `/v3/groups/dbba2478141243a2b03206f43ecf1339` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:02.386307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92953f99-f663-4b67-948f-969d889fe601 None admin] RBAC: Authorizing `identity:get_group(group_id=dbba2478141243a2b03206f43ecf1339)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:02.389863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92953f99-f663-4b67-948f-969d889fe601 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:02.393435 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 185/372] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Jul 16 20:45:02 2022] GET /identity/v3/groups/dbba2478141243a2b03206f43ecf1339 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:02.395142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92953f99-f663-4b67-948f-969d889fe601 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:02.412735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f3af6-2a51-41b5-975c-90b14154e59f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:02.415936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f3af6-2a51-41b5-975c-90b14154e59f None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:02.548096 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 188/373] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:45:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:45:02.548953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f3af6-2a51-41b5-975c-90b14154e59f None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:02.565759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92953f99-f663-4b67-948f-969d889fe601 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:02.578118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:02.620250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:02.621441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c4053-8425-4933-bc13-ddb52292ca17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:02.623519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c4053-8425-4933-bc13-ddb52292ca17 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:02.623805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c4053-8425-4933-bc13-ddb52292ca17 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:02.624079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c4053-8425-4933-bc13-ddb52292ca17 None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:02.626481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c4053-8425-4933-bc13-ddb52292ca17 None admin] RBAC: Authorizing `identity:get_project(project_id=10517c754ba94c1d893d97627d31b9f0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:02.630027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c4053-8425-4933-bc13-ddb52292ca17 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:02.637493 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 186/374] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:45:02 2022] GET /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:02.639090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c4053-8425-4933-bc13-ddb52292ca17 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:02.722048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f3af6-2a51-41b5-975c-90b14154e59f None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:02.772808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c4053-8425-4933-bc13-ddb52292ca17 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:02.791768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a733d9-7104-45d2-9741-4e7ef1c53894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:02.793017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a733d9-7104-45d2-9741-4e7ef1c53894 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:02.793516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a733d9-7104-45d2-9741-4e7ef1c53894 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:02.793994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a733d9-7104-45d2-9741-4e7ef1c53894 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:02.796085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a733d9-7104-45d2-9741-4e7ef1c53894 None admin] RBAC: Adding query filter params (group.id=dbba2478141243a2b03206f43ecf1339, role.id=c352110df5bc449b9134928abd20c032, scope.project.id=10517c754ba94c1d893d97627d31b9f0) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:02.796637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a733d9-7104-45d2-9741-4e7ef1c53894 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:02.799864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a733d9-7104-45d2-9741-4e7ef1c53894 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:02.815040 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 189/375] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Jul 16 20:45:02 2022] GET /identity/v3/role_assignments?group.id=dbba2478141243a2b03206f43ecf1339&scope.project.id=10517c754ba94c1d893d97627d31b9f0&role.id=c352110df5bc449b9134928abd20c032 => generated 260 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:02.815040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a733d9-7104-45d2-9741-4e7ef1c53894 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:02.822260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec36b28-3766-4634-b35a-ece1fac291a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:02.822560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec36b28-3766-4634-b35a-ece1fac291a9 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:02.822980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec36b28-3766-4634-b35a-ece1fac291a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:02.823508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec36b28-3766-4634-b35a-ece1fac291a9 None admin] PATH_INFO: `/v3/projects/455f5961d0804544b3b78f843a889637` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:02.832000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec36b28-3766-4634-b35a-ece1fac291a9 None admin] RBAC: Authorizing `identity:get_project(project_id=455f5961d0804544b3b78f843a889637)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:02.833828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec36b28-3766-4634-b35a-ece1fac291a9 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:02.836198 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 187/376] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:45:02 2022] GET /identity/v3/projects/455f5961d0804544b3b78f843a889637 => generated 344 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:02.841998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec36b28-3766-4634-b35a-ece1fac291a9 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:02.951866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:02.977260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a733d9-7104-45d2-9741-4e7ef1c53894 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:02.993088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:03.057912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1d5c5-33b0-4af9-8401-dbdbcc8e4219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:03.058790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1d5c5-33b0-4af9-8401-dbdbcc8e4219 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:03.059353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1d5c5-33b0-4af9-8401-dbdbcc8e4219 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:03.059629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1d5c5-33b0-4af9-8401-dbdbcc8e4219 None admin] PATH_INFO: `/v3/groups/dbba2478141243a2b03206f43ecf1339` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:03.061227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1d5c5-33b0-4af9-8401-dbdbcc8e4219 None admin] RBAC: Authorizing `identity:get_group(group_id=dbba2478141243a2b03206f43ecf1339)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:03.062811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1d5c5-33b0-4af9-8401-dbdbcc8e4219 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:03.064573 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 190/377] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Jul 16 20:45:02 2022] GET /identity/v3/groups/dbba2478141243a2b03206f43ecf1339 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:03.070616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1d5c5-33b0-4af9-8401-dbdbcc8e4219 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:03.078274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec36b28-3766-4634-b35a-ece1fac291a9 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:03.136560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fe319-b746-4e65-9dc3-8bb7e3e75834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:03.137438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fe319-b746-4e65-9dc3-8bb7e3e75834 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:03.137720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fe319-b746-4e65-9dc3-8bb7e3e75834 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:03.137996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fe319-b746-4e65-9dc3-8bb7e3e75834 None admin] PATH_INFO: `/v3/groups/c39664b5afd24bbead8f976f675f8870` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:03.147318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fe319-b746-4e65-9dc3-8bb7e3e75834 None admin] RBAC: Authorizing `identity:get_group(group_id=c39664b5afd24bbead8f976f675f8870)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:03.148575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fe319-b746-4e65-9dc3-8bb7e3e75834 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:03.151399 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 188/378] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Jul 16 20:45:02 2022] GET /identity/v3/groups/c39664b5afd24bbead8f976f675f8870 => generated 229 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:03.160480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fe319-b746-4e65-9dc3-8bb7e3e75834 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:03.227250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1d5c5-33b0-4af9-8401-dbdbcc8e4219 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:03.269207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd78e3-2380-4145-baa1-c9b6c40e1844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:03.270111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd78e3-2380-4145-baa1-c9b6c40e1844 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:03.270536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd78e3-2380-4145-baa1-c9b6c40e1844 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:03.270952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd78e3-2380-4145-baa1-c9b6c40e1844 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:03.271991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd78e3-2380-4145-baa1-c9b6c40e1844 None admin] RBAC: Adding query filter params (group.id=dbba2478141243a2b03206f43ecf1339, role.id=b9444da176484ccfa45d6b85220ce558, scope.project.id=10517c754ba94c1d893d97627d31b9f0) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:03.272453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd78e3-2380-4145-baa1-c9b6c40e1844 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:03.274042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd78e3-2380-4145-baa1-c9b6c40e1844 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:03.281508 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 191/379] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Jul 16 20:45:03 2022] GET /identity/v3/role_assignments?group.id=dbba2478141243a2b03206f43ecf1339&scope.project.id=10517c754ba94c1d893d97627d31b9f0&role.id=b9444da176484ccfa45d6b85220ce558 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:03.292270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fe319-b746-4e65-9dc3-8bb7e3e75834 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:03.302348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:03.338449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4601f7-044f-4d20-9f43-f33d9633bd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:03.339266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4601f7-044f-4d20-9f43-f33d9633bd0b None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:03.339767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4601f7-044f-4d20-9f43-f33d9633bd0b None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:03.340151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4601f7-044f-4d20-9f43-f33d9633bd0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:03.341205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4601f7-044f-4d20-9f43-f33d9633bd0b None admin] RBAC: Adding query filter params (group.id=c39664b5afd24bbead8f976f675f8870, role.id=bd33b827674a4d4db30c164cab416056, scope.project.id=455f5961d0804544b3b78f843a889637) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:03.342178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4601f7-044f-4d20-9f43-f33d9633bd0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:03.343952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4601f7-044f-4d20-9f43-f33d9633bd0b None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:03.357940 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 189/380] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Jul 16 20:45:03 2022] GET /identity/v3/role_assignments?group.id=c39664b5afd24bbead8f976f675f8870&scope.project.id=455f5961d0804544b3b78f843a889637&role.id=bd33b827674a4d4db30c164cab416056 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:03.817616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f2d38-9556-41fc-9c7a-d683cea920c5 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:03.818173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f2d38-9556-41fc-9c7a-d683cea920c5 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:03.818448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f2d38-9556-41fc-9c7a-d683cea920c5 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:03.821785 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 192/381] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:03.826996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15bbb0-103c-4a87-af81-c0ae7afe57ea None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:03.827505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15bbb0-103c-4a87-af81-c0ae7afe57ea None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:03.827787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15bbb0-103c-4a87-af81-c0ae7afe57ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:03.853162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0db554-e362-4bc1-9613-779238ef92fa None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:03.853513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0db554-e362-4bc1-9613-779238ef92fa None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:03.853706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0db554-e362-4bc1-9613-779238ef92fa None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:03.855402 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 193/382] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:45:03.856500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-fd15bbb0-103c-4a87-af81-c0ae7afe57ea None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:03.858511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fd15bbb0-103c-4a87-af81-c0ae7afe57ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:03.866072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6a7df-190d-48a9-bd5c-7294eb1afd39 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:03.866576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6a7df-190d-48a9-bd5c-7294eb1afd39 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:03.867138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6a7df-190d-48a9-bd5c-7294eb1afd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:03.895082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-62d6a7df-190d-48a9-bd5c-7294eb1afd39 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:03.895082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-62d6a7df-190d-48a9-bd5c-7294eb1afd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:03.968106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:03.976645 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 190/383] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:04.008599 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 194/384] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:04.016769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15bbb0-103c-4a87-af81-c0ae7afe57ea None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:04.034552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6a7df-190d-48a9-bd5c-7294eb1afd39 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:04.142018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15bbb0-103c-4a87-af81-c0ae7afe57ea None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:04.155504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:04.175073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6a7df-190d-48a9-bd5c-7294eb1afd39 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:04.195276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cbd15-8615-407a-9dc1-6637954a0a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:04.196100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cbd15-8615-407a-9dc1-6637954a0a1f None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:04.196380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cbd15-8615-407a-9dc1-6637954a0a1f None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:04.196653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cbd15-8615-407a-9dc1-6637954a0a1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:04.222939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cbd15-8615-407a-9dc1-6637954a0a1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:04.227520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac00150-5362-4a80-972e-a5e712f84da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:04.228352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac00150-5362-4a80-972e-a5e712f84da5 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:04.228691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac00150-5362-4a80-972e-a5e712f84da5 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:04.228969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac00150-5362-4a80-972e-a5e712f84da5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:04.242306 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-4e9cbd15-8615-407a-9dc1-6637954a0a1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:45:04.242306 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:04.242306 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:04.242306 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:04.242306 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:04.242306 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:04.242306 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:04.242306 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:04.242306 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:04.242306 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:04.242306 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:04.242306 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:04.242306 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:04.242306 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:04.242306 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:04.242306 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:04.243287 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:04.243287 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:04.243287 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:04.243287 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:04.243287 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:04.243287 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:04.243287 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:04.243287 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:04.243287 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:04.243287 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:04.243287 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:04.243287 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:04.243287 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:04.243287 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:04.243287 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:04.243287 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:04.244069 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:04.244069 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:04.244069 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:04.244069 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:04.244069 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:04.244069 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:04.244069 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:04.244069 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:04.244069 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:04.244069 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:04.244069 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:45:04.244069 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:04.244069 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 191/385] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:45:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:04.251468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cbd15-8615-407a-9dc1-6637954a0a1f None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:04.256804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac00150-5362-4a80-972e-a5e712f84da5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:04.272588 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-fac00150-5362-4a80-972e-a5e712f84da5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:45:04.272588 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:04.272588 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:04.272588 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:04.272588 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:04.272588 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:04.272588 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:04.272588 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:04.272588 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:04.272588 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:04.272588 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:04.272588 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:04.272588 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:04.272588 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:04.272588 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:04.272588 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:04.274139 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:04.274139 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:04.274139 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:04.274139 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:04.274139 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:04.274139 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:04.274139 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:04.274139 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:04.274139 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:04.274139 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:04.274139 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:04.274139 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:04.274139 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:04.274139 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:04.274139 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:04.274139 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:04.276116 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:04.276116 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:04.276116 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:04.276116 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:04.276116 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:04.276116 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:04.276116 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:04.276116 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:04.276116 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:04.276116 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:04.276116 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:45:04.276116 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:04.277967 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 195/386] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Jul 16 20:45:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:45:04.283725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac00150-5362-4a80-972e-a5e712f84da5 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:04.356846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:04.450093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cbd15-8615-407a-9dc1-6637954a0a1f None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:04.494868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0e861-c439-498f-a3fe-b9e48326a88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:04.495593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0e861-c439-498f-a3fe-b9e48326a88f None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:04.495873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0e861-c439-498f-a3fe-b9e48326a88f None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:04.496148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0e861-c439-498f-a3fe-b9e48326a88f None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:04.499037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0e861-c439-498f-a3fe-b9e48326a88f None admin] RBAC: Adding query filter params (name=member) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:04.499037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0e861-c439-498f-a3fe-b9e48326a88f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:04.499359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0e861-c439-498f-a3fe-b9e48326a88f None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:04.510597 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 192/387] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:45:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:04.517079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0e861-c439-498f-a3fe-b9e48326a88f None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:04.529356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac00150-5362-4a80-972e-a5e712f84da5 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:04.547506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:04.613207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b89b99-b7d8-4b41-aa21-ff83f8d42100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:04.614274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b89b99-b7d8-4b41-aa21-ff83f8d42100 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:04.614811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b89b99-b7d8-4b41-aa21-ff83f8d42100 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:04.615576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b89b99-b7d8-4b41-aa21-ff83f8d42100 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:04.616840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b89b99-b7d8-4b41-aa21-ff83f8d42100 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:04.617374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b89b99-b7d8-4b41-aa21-ff83f8d42100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:04.623768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b89b99-b7d8-4b41-aa21-ff83f8d42100 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:04.634238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0e861-c439-498f-a3fe-b9e48326a88f None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:04.639034 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 196/388] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:04.645458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b89b99-b7d8-4b41-aa21-ff83f8d42100 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:04.678963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b214bfd-3fc4-4a62-af14-e361c30b04b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:04.680236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b214bfd-3fc4-4a62-af14-e361c30b04b7 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:04.680743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b214bfd-3fc4-4a62-af14-e361c30b04b7 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:04.681217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b214bfd-3fc4-4a62-af14-e361c30b04b7 None admin] PATH_INFO: `/v3/groups/dbba2478141243a2b03206f43ecf1339` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:04.682629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b214bfd-3fc4-4a62-af14-e361c30b04b7 None admin] RBAC: Authorizing `identity:get_group(group_id=dbba2478141243a2b03206f43ecf1339)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:04.684596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b214bfd-3fc4-4a62-af14-e361c30b04b7 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:04.686743 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 193/389] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Jul 16 20:45:04 2022] GET /identity/v3/groups/dbba2478141243a2b03206f43ecf1339 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:45:04.693626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b214bfd-3fc4-4a62-af14-e361c30b04b7 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:04.832095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:04.851909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:04.868419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b214bfd-3fc4-4a62-af14-e361c30b04b7 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:04.869916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b89b99-b7d8-4b41-aa21-ff83f8d42100 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:04.939978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a92df-b04c-4cc3-ba3e-52daadd13312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:04.941911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a92df-b04c-4cc3-ba3e-52daadd13312 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:04.942721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a92df-b04c-4cc3-ba3e-52daadd13312 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:04.943670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a92df-b04c-4cc3-ba3e-52daadd13312 None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:04.945911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a92df-b04c-4cc3-ba3e-52daadd13312 None admin] RBAC: Authorizing `identity:get_project(project_id=2ab6547ffe6648bd8a4ac2a99e702240)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:04.947942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a92df-b04c-4cc3-ba3e-52daadd13312 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:04.950399 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 194/390] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:45:04 2022] GET /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:04.951952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2142fb0-6ba9-47b9-8a22-3d3e6738f8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:04.953071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2142fb0-6ba9-47b9-8a22-3d3e6738f8b1 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:04.953528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2142fb0-6ba9-47b9-8a22-3d3e6738f8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:04.953987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2142fb0-6ba9-47b9-8a22-3d3e6738f8b1 None admin] PATH_INFO: `/v3/groups/dbba2478141243a2b03206f43ecf1339` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:04.959064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a92df-b04c-4cc3-ba3e-52daadd13312 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:04.960068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2142fb0-6ba9-47b9-8a22-3d3e6738f8b1 None admin] RBAC: Authorizing `identity:get_group(group_id=dbba2478141243a2b03206f43ecf1339)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:04.961726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2142fb0-6ba9-47b9-8a22-3d3e6738f8b1 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:04.963998 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 197/391] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Jul 16 20:45:04 2022] GET /identity/v3/groups/dbba2478141243a2b03206f43ecf1339 => generated 226 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:45:04.969926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2142fb0-6ba9-47b9-8a22-3d3e6738f8b1 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:05.081811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a92df-b04c-4cc3-ba3e-52daadd13312 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:05.122311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142971e-2465-4413-812f-26dde5e9d0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:05.123249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142971e-2465-4413-812f-26dde5e9d0d6 None admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:05.123572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142971e-2465-4413-812f-26dde5e9d0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:05.123848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142971e-2465-4413-812f-26dde5e9d0d6 None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240/groups/dbba2478141243a2b03206f43ecf1339/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:05.125980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142971e-2465-4413-812f-26dde5e9d0d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ab6547ffe6648bd8a4ac2a99e702240, group_id=dbba2478141243a2b03206f43ecf1339, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:05.131035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142971e-2465-4413-812f-26dde5e9d0d6 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:05.133831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2142fb0-6ba9-47b9-8a22-3d3e6738f8b1 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:05.176434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca48708-515a-4828-af34-39bd5e5cdaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:05.177297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca48708-515a-4828-af34-39bd5e5cdaa2 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:05.177574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca48708-515a-4828-af34-39bd5e5cdaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:05.177835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca48708-515a-4828-af34-39bd5e5cdaa2 None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:05.181893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca48708-515a-4828-af34-39bd5e5cdaa2 None admin] RBAC: Authorizing `identity:get_project(project_id=2ab6547ffe6648bd8a4ac2a99e702240)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:05.183357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca48708-515a-4828-af34-39bd5e5cdaa2 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:05.185818 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 198/392] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:45:04 2022] GET /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:05.191281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca48708-515a-4828-af34-39bd5e5cdaa2 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:05.219188 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 195/393] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Jul 16 20:45:04 2022] PUT /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240/groups/dbba2478141243a2b03206f43ecf1339/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:45:05.226563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:05.310585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca48708-515a-4828-af34-39bd5e5cdaa2 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:05.351047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37760af-b07a-4190-b500-128ed457e33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:05.351920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37760af-b07a-4190-b500-128ed457e33d None admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:05.352485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37760af-b07a-4190-b500-128ed457e33d None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:05.352764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37760af-b07a-4190-b500-128ed457e33d None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240/groups/dbba2478141243a2b03206f43ecf1339/roles/b9444da176484ccfa45d6b85220ce558` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:05.355034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37760af-b07a-4190-b500-128ed457e33d None admin] RBAC: Authorizing `identity:create_grant(project_id=2ab6547ffe6648bd8a4ac2a99e702240, group_id=dbba2478141243a2b03206f43ecf1339, role_id=b9444da176484ccfa45d6b85220ce558)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:05.356592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37760af-b07a-4190-b500-128ed457e33d None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:05.440697 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 199/394] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Jul 16 20:45:05 2022] PUT /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240/groups/dbba2478141243a2b03206f43ecf1339/roles/b9444da176484ccfa45d6b85220ce558 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 20:45:06.177184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101feeaa-cdf7-4b3a-b5d0-1e66e5200fd0 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:06.178208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101feeaa-cdf7-4b3a-b5d0-1e66e5200fd0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:06.178707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101feeaa-cdf7-4b3a-b5d0-1e66e5200fd0 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:06.180587 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 196/395] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:06.186665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecb164-21ec-4a51-a8c5-8c17d4d959b9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:06.187171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecb164-21ec-4a51-a8c5-8c17d4d959b9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:06.187244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecb164-21ec-4a51-a8c5-8c17d4d959b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:06.205002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6aecb164-21ec-4a51-a8c5-8c17d4d959b9 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:06.206237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6aecb164-21ec-4a51-a8c5-8c17d4d959b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:06.228491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bfaa4-f5b5-46f0-b3a1-589c2814313f None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:06.229124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bfaa4-f5b5-46f0-b3a1-589c2814313f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:06.229692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bfaa4-f5b5-46f0-b3a1-589c2814313f None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:06.231669 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 197/396] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:06.237490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603c314-461c-4242-bdfe-67f17d1c9b18 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:06.238040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603c314-461c-4242-bdfe-67f17d1c9b18 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:06.238574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603c314-461c-4242-bdfe-67f17d1c9b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:06.268284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6603c314-461c-4242-bdfe-67f17d1c9b18 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:06.269879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6603c314-461c-4242-bdfe-67f17d1c9b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:06.282832 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 200/397] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:06.289553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dd0f2-05d5-4c9f-9223-0a8209c949e4 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:06.289837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dd0f2-05d5-4c9f-9223-0a8209c949e4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:06.290122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dd0f2-05d5-4c9f-9223-0a8209c949e4 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:06.291836 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 201/398] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:45:06.303033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:06.303214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a923fa-ee72-4220-a44a-83bb04ef5cd2 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:06.303214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a923fa-ee72-4220-a44a-83bb04ef5cd2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:06.303214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a923fa-ee72-4220-a44a-83bb04ef5cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:06.317209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c4a923fa-ee72-4220-a44a-83bb04ef5cd2 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:06.318463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c4a923fa-ee72-4220-a44a-83bb04ef5cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:06.333483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:06.379061 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 198/399] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:06.380072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603c314-461c-4242-bdfe-67f17d1c9b18 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:06.427113 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 202/400] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 16 20:45:06.428096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a923fa-ee72-4220-a44a-83bb04ef5cd2 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:06.520295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603c314-461c-4242-bdfe-67f17d1c9b18 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:06.561633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1d279-74f9-485e-af9f-77c4478ecd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:06.562567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1d279-74f9-485e-af9f-77c4478ecd59 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:06.562675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a923fa-ee72-4220-a44a-83bb04ef5cd2 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:06.562852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1d279-74f9-485e-af9f-77c4478ecd59 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:06.563158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1d279-74f9-485e-af9f-77c4478ecd59 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:06.574790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1d279-74f9-485e-af9f-77c4478ecd59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:06.584725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-2df1d279-74f9-485e-af9f-77c4478ecd59 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:45:06.584725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:06.584725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:06.584725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:06.584725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:06.584725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:06.584725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:06.584725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:06.584725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:06.584725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:06.584725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:06.584725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:06.584725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:06.584725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:06.584725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:06.584725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:06.585753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:06.585753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:06.585753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:06.585753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:06.585753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:06.585753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:06.585753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:06.585753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:06.585753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:06.585753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:06.585753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:06.585753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:06.585753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:06.585753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:06.585753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:06.585753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:06.586537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:06.586537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:06.586537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:06.586537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:06.586537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:06.586537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:06.586537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:06.586537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:06.586537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:06.586537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:06.586537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:45:06.586537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:06.586537 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 199/401] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Jul 16 20:45:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:06.587703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1d279-74f9-485e-af9f-77c4478ecd59 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:06.599747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:06.610321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142815c-58fe-4ee5-af4b-be5e9e45e543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:06.611404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142815c-58fe-4ee5-af4b-be5e9e45e543 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:06.611831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142815c-58fe-4ee5-af4b-be5e9e45e543 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:06.612279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142815c-58fe-4ee5-af4b-be5e9e45e543 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:06.624548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142815c-58fe-4ee5-af4b-be5e9e45e543 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:06.633884 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-e142815c-58fe-4ee5-af4b-be5e9e45e543 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:45:06.633884 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:06.633884 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:06.633884 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:06.633884 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:06.633884 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:06.633884 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:06.633884 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:06.633884 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:06.633884 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:06.633884 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:06.633884 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:06.633884 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:06.633884 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:06.633884 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:06.633884 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:06.634986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:06.634986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:06.634986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:06.634986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:06.634986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:06.634986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:06.634986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:06.634986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:06.634986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:06.634986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:06.634986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:06.634986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:06.634986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:06.634986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:06.634986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:06.634986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:06.635808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:06.635808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:06.635808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:06.635808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:06.635808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:06.635808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:06.635808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:06.635808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:06.635808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:06.635808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:06.635808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:45:06.635808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:06.643380 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 203/402] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:45:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:06.644505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142815c-58fe-4ee5-af4b-be5e9e45e543 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:06.656718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:06.716151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1d279-74f9-485e-af9f-77c4478ecd59 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:06.761156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c0f92-afa6-4cb9-867e-597fbfade4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:06.761954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c0f92-afa6-4cb9-867e-597fbfade4da None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:06.762231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c0f92-afa6-4cb9-867e-597fbfade4da None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:06.762514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c0f92-afa6-4cb9-867e-597fbfade4da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:06.767189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142815c-58fe-4ee5-af4b-be5e9e45e543 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:06.775845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c0f92-afa6-4cb9-867e-597fbfade4da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:06.784220 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-e05c0f92-afa6-4cb9-867e-597fbfade4da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:45:06.784220 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:06.784220 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:06.784220 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:06.784220 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:06.784220 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:06.784220 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:06.784220 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:06.784220 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:06.784220 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:06.784220 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:06.784220 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:06.784220 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:06.784220 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:06.784220 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:06.784220 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:06.785363 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:06.785363 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:06.785363 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:06.785363 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:06.785363 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:06.785363 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:06.785363 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:06.785363 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:06.785363 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:06.785363 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:06.785363 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:06.785363 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:06.785363 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:06.785363 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:06.785363 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:06.785363 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:06.786202 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:06.786202 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:06.786202 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:06.786202 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:06.786202 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:06.786202 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:06.786202 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:06.786202 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:06.786202 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:06.786202 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:06.786202 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:45:06.786202 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:06.786202 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 200/403] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:45:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:06.786846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c0f92-afa6-4cb9-867e-597fbfade4da None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:06.824733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628b78a-2f0d-43ee-af20-a399dc771f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:06.825802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628b78a-2f0d-43ee-af20-a399dc771f13 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:06.826288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628b78a-2f0d-43ee-af20-a399dc771f13 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:06.826776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628b78a-2f0d-43ee-af20-a399dc771f13 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:06.828775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628b78a-2f0d-43ee-af20-a399dc771f13 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:06.829251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628b78a-2f0d-43ee-af20-a399dc771f13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:06.831381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628b78a-2f0d-43ee-af20-a399dc771f13 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:06.843900 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 204/404] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:06.845070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628b78a-2f0d-43ee-af20-a399dc771f13 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:06.878818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:06.918755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c0f92-afa6-4cb9-867e-597fbfade4da None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:06.947927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:06.968098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcc7ed-3c67-4c0d-b9e4-47ec04360a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:06.969291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcc7ed-3c67-4c0d-b9e4-47ec04360a0a None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:06.969720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcc7ed-3c67-4c0d-b9e4-47ec04360a0a None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:06.970192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcc7ed-3c67-4c0d-b9e4-47ec04360a0a None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:06.971142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcc7ed-3c67-4c0d-b9e4-47ec04360a0a None admin] RBAC: Adding query filter params (name=member) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:06.971629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcc7ed-3c67-4c0d-b9e4-47ec04360a0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:06.973202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcc7ed-3c67-4c0d-b9e4-47ec04360a0a None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:06.985526 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 201/405] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:45:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:06.986671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcc7ed-3c67-4c0d-b9e4-47ec04360a0a None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:06.992857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628b78a-2f0d-43ee-af20-a399dc771f13 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:07.054747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35956f-95b3-4d4c-9507-d730ab458c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:07.055901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35956f-95b3-4d4c-9507-d730ab458c63 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:07.056279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35956f-95b3-4d4c-9507-d730ab458c63 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:07.056654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35956f-95b3-4d4c-9507-d730ab458c63 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:07.057786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35956f-95b3-4d4c-9507-d730ab458c63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:07.058199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35956f-95b3-4d4c-9507-d730ab458c63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:07.061101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35956f-95b3-4d4c-9507-d730ab458c63 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:07.074709 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 205/406] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:45:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:07.076888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35956f-95b3-4d4c-9507-d730ab458c63 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:07.127627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcc7ed-3c67-4c0d-b9e4-47ec04360a0a None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:07.166057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:07.192577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0637cf-83cc-4435-a185-2547a6901810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:07.193505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0637cf-83cc-4435-a185-2547a6901810 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:07.193786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0637cf-83cc-4435-a185-2547a6901810 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:07.194061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0637cf-83cc-4435-a185-2547a6901810 None admin] PATH_INFO: `/v3/groups/dbba2478141243a2b03206f43ecf1339` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:07.203789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0637cf-83cc-4435-a185-2547a6901810 None admin] RBAC: Authorizing `identity:get_group(group_id=dbba2478141243a2b03206f43ecf1339)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:07.203789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0637cf-83cc-4435-a185-2547a6901810 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:07.203789 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 202/407] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Jul 16 20:45:06 2022] GET /identity/v3/groups/dbba2478141243a2b03206f43ecf1339 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:07.203789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0637cf-83cc-4435-a185-2547a6901810 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:07.236098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35956f-95b3-4d4c-9507-d730ab458c63 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:07.268091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:07.273583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ed5d6-56dc-433f-92e6-2b89641bfb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:07.279396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ed5d6-56dc-433f-92e6-2b89641bfb6e None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:07.279396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ed5d6-56dc-433f-92e6-2b89641bfb6e None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:07.279396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ed5d6-56dc-433f-92e6-2b89641bfb6e None admin] PATH_INFO: `/v3/groups/dbba2478141243a2b03206f43ecf1339` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:07.279396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ed5d6-56dc-433f-92e6-2b89641bfb6e None admin] RBAC: Authorizing `identity:get_group(group_id=dbba2478141243a2b03206f43ecf1339)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:07.279396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ed5d6-56dc-433f-92e6-2b89641bfb6e None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:07.285888 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 206/408] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Jul 16 20:45:07 2022] GET /identity/v3/groups/dbba2478141243a2b03206f43ecf1339 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:07.287035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ed5d6-56dc-433f-92e6-2b89641bfb6e None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:07.338468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0637cf-83cc-4435-a185-2547a6901810 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:07.384535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ee59f-fc59-4d30-965b-2a4e436c1e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:07.385465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ee59f-fc59-4d30-965b-2a4e436c1e77 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:07.386588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ee59f-fc59-4d30-965b-2a4e436c1e77 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:07.387143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ee59f-fc59-4d30-965b-2a4e436c1e77 None admin] PATH_INFO: `/v3/groups/c39664b5afd24bbead8f976f675f8870` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:07.389815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ee59f-fc59-4d30-965b-2a4e436c1e77 None admin] RBAC: Authorizing `identity:get_group(group_id=c39664b5afd24bbead8f976f675f8870)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:07.391890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ee59f-fc59-4d30-965b-2a4e436c1e77 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:07.399071 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 203/409] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Jul 16 20:45:07 2022] GET /identity/v3/groups/c39664b5afd24bbead8f976f675f8870 => generated 229 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:07.399071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ee59f-fc59-4d30-965b-2a4e436c1e77 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:07.417783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ed5d6-56dc-433f-92e6-2b89641bfb6e None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:07.456329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd3ffd-d074-4ece-8f98-684bc3888092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:07.457111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd3ffd-d074-4ece-8f98-684bc3888092 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:07.457396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd3ffd-d074-4ece-8f98-684bc3888092 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:07.457673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd3ffd-d074-4ece-8f98-684bc3888092 None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:07.458912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd3ffd-d074-4ece-8f98-684bc3888092 None admin] RBAC: Authorizing `identity:get_project(project_id=10517c754ba94c1d893d97627d31b9f0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:07.460542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd3ffd-d074-4ece-8f98-684bc3888092 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:07.462337 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 207/410] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:45:07 2022] GET /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:07.463129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd3ffd-d074-4ece-8f98-684bc3888092 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:07.478591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:07.519121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ee59f-fc59-4d30-965b-2a4e436c1e77 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:07.537824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:07.562949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba5696-31b8-4fe4-b233-3659bc4ebfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:07.566521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba5696-31b8-4fe4-b233-3659bc4ebfa8 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:07.566521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba5696-31b8-4fe4-b233-3659bc4ebfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:07.566521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba5696-31b8-4fe4-b233-3659bc4ebfa8 None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:07.566521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba5696-31b8-4fe4-b233-3659bc4ebfa8 None admin] RBAC: Authorizing `identity:get_project(project_id=10517c754ba94c1d893d97627d31b9f0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:07.567925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba5696-31b8-4fe4-b233-3659bc4ebfa8 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:07.569913 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 204/411] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:45:07 2022] GET /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:07.574588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd3ffd-d074-4ece-8f98-684bc3888092 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:07.576353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba5696-31b8-4fe4-b233-3659bc4ebfa8 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:07.614488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e0164-b273-4cfd-b51f-96c0d5fdc5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:07.615529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e0164-b273-4cfd-b51f-96c0d5fdc5d1 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:07.615748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e0164-b273-4cfd-b51f-96c0d5fdc5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:07.616215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e0164-b273-4cfd-b51f-96c0d5fdc5d1 None admin] PATH_INFO: `/v3/projects/455f5961d0804544b3b78f843a889637` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:07.617505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e0164-b273-4cfd-b51f-96c0d5fdc5d1 None admin] RBAC: Authorizing `identity:get_project(project_id=455f5961d0804544b3b78f843a889637)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:07.619057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e0164-b273-4cfd-b51f-96c0d5fdc5d1 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:07.626284 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 208/412] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:45:07 2022] GET /identity/v3/projects/455f5961d0804544b3b78f843a889637 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:07.626284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e0164-b273-4cfd-b51f-96c0d5fdc5d1 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:07.718962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba5696-31b8-4fe4-b233-3659bc4ebfa8 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:07.780182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e0164-b273-4cfd-b51f-96c0d5fdc5d1 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:07.789449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce825d-ec03-46d0-9a55-4657fc294d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:07.790970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce825d-ec03-46d0-9a55-4657fc294d77 None admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:07.791427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce825d-ec03-46d0-9a55-4657fc294d77 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:07.791837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce825d-ec03-46d0-9a55-4657fc294d77 None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0/groups/dbba2478141243a2b03206f43ecf1339/roles/b9444da176484ccfa45d6b85220ce558` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:07.795669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce825d-ec03-46d0-9a55-4657fc294d77 None admin] RBAC: Authorizing `identity:create_grant(project_id=10517c754ba94c1d893d97627d31b9f0, group_id=dbba2478141243a2b03206f43ecf1339, role_id=b9444da176484ccfa45d6b85220ce558)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:07.798221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce825d-ec03-46d0-9a55-4657fc294d77 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:07.802414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:07.829678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bad8e8-d6d2-429e-88dc-74244c921ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:07.830790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bad8e8-d6d2-429e-88dc-74244c921ffc None admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:07.831252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bad8e8-d6d2-429e-88dc-74244c921ffc None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:07.831560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bad8e8-d6d2-429e-88dc-74244c921ffc None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0/groups/dbba2478141243a2b03206f43ecf1339/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:07.833717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bad8e8-d6d2-429e-88dc-74244c921ffc None admin] RBAC: Authorizing `identity:create_grant(project_id=10517c754ba94c1d893d97627d31b9f0, group_id=dbba2478141243a2b03206f43ecf1339, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:07.835372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bad8e8-d6d2-429e-88dc-74244c921ffc None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:07.839640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:07.974304 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 209/413] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Jul 16 20:45:07 2022] PUT /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0/groups/dbba2478141243a2b03206f43ecf1339/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:45:07.975534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bad8e8-d6d2-429e-88dc-74244c921ffc None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:07.980176 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 205/414] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Jul 16 20:45:07 2022] PUT /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0/groups/dbba2478141243a2b03206f43ecf1339/roles/b9444da176484ccfa45d6b85220ce558 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:45:08.086200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a50a8-90dd-427a-84af-6c8d71fbb55d None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:08.086415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a50a8-90dd-427a-84af-6c8d71fbb55d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:08.087055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a50a8-90dd-427a-84af-6c8d71fbb55d None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:08.090573 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 206/415] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:08.111906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9732a-0263-45e6-9b6c-4a2318d6e654 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:08.112240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9732a-0263-45e6-9b6c-4a2318d6e654 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:08.112462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9732a-0263-45e6-9b6c-4a2318d6e654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:08.137771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-74f9732a-0263-45e6-9b6c-4a2318d6e654 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:08.140011 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-74f9732a-0263-45e6-9b6c-4a2318d6e654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:08.145371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bad8e8-d6d2-429e-88dc-74244c921ffc None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:08.205369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cff48-8744-4d9d-ac3d-bcc86ca75679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:08.206284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cff48-8744-4d9d-ac3d-bcc86ca75679 None admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:08.206569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cff48-8744-4d9d-ac3d-bcc86ca75679 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:08.206844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cff48-8744-4d9d-ac3d-bcc86ca75679 None admin] PATH_INFO: `/v3/projects/455f5961d0804544b3b78f843a889637/groups/c39664b5afd24bbead8f976f675f8870/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:08.209318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cff48-8744-4d9d-ac3d-bcc86ca75679 None admin] RBAC: Authorizing `identity:create_grant(project_id=455f5961d0804544b3b78f843a889637, group_id=c39664b5afd24bbead8f976f675f8870, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:08.210518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cff48-8744-4d9d-ac3d-bcc86ca75679 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:08.252586 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 207/416] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:08.254052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723d523-8d3a-43b1-ac4f-617212fd9310 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:08.254373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723d523-8d3a-43b1-ac4f-617212fd9310 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:08.254668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723d523-8d3a-43b1-ac4f-617212fd9310 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:08.256156 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 208/417] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:08.261403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bab8f-82e5-4c2d-81e1-1745c1eda629 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:08.261718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bab8f-82e5-4c2d-81e1-1745c1eda629 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:08.262026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bab8f-82e5-4c2d-81e1-1745c1eda629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:08.281855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e08bab8f-82e5-4c2d-81e1-1745c1eda629 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:08.282710 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 210/418] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Jul 16 20:45:07 2022] PUT /identity/v3/projects/455f5961d0804544b3b78f843a889637/groups/c39664b5afd24bbead8f976f675f8870/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:45:08.283205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e08bab8f-82e5-4c2d-81e1-1745c1eda629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:08.283414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cff48-8744-4d9d-ac3d-bcc86ca75679 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:08.365777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:08.406756 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 209/419] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 16 20:45:08.438653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08bab8f-82e5-4c2d-81e1-1745c1eda629 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:08.452959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cff48-8744-4d9d-ac3d-bcc86ca75679 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:08.515070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e59a1c-8754-45d8-a21a-6d55c025bf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:08.515911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e59a1c-8754-45d8-a21a-6d55c025bf72 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:08.516196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e59a1c-8754-45d8-a21a-6d55c025bf72 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:08.516472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e59a1c-8754-45d8-a21a-6d55c025bf72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:08.534938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e59a1c-8754-45d8-a21a-6d55c025bf72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:08.543680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-03e59a1c-8754-45d8-a21a-6d55c025bf72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:45:08.543680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:08.543680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:08.543680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:08.543680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:08.543680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:08.543680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:08.543680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:08.543680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:08.543680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:08.543680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:08.543680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:08.543680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:08.543680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:08.543680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:08.543680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:08.544674 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:08.544674 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:08.544674 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:08.544674 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:08.544674 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:08.544674 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:08.544674 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:08.544674 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:08.544674 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:08.544674 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:08.544674 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:08.544674 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:08.544674 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:08.544674 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:08.544674 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:08.544674 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:08.545613 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:08.545613 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:08.545613 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:08.545613 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:08.545613 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:08.545613 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:08.545613 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:08.545613 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:08.545613 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:08.545613 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:08.545613 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:45:08.545613 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:08.545613 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 211/420] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:45:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:08.552655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e59a1c-8754-45d8-a21a-6d55c025bf72 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:08.553605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:08.613739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08bab8f-82e5-4c2d-81e1-1745c1eda629 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:08.667736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060067f-c38f-4697-8552-fc6ccc40332f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:08.668475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060067f-c38f-4697-8552-fc6ccc40332f None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:08.668750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060067f-c38f-4697-8552-fc6ccc40332f None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:08.669021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060067f-c38f-4697-8552-fc6ccc40332f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:08.687001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e59a1c-8754-45d8-a21a-6d55c025bf72 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:08.700328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060067f-c38f-4697-8552-fc6ccc40332f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:08.709566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-2060067f-c38f-4697-8552-fc6ccc40332f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:45:08.709566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:08.709566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:08.709566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:08.709566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:08.709566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:08.709566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:08.709566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:08.709566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:08.709566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:08.709566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:08.709566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:08.709566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:08.709566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:08.709566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:08.709566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:08.710539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:08.710539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:08.710539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:08.710539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:08.710539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:08.710539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:08.710539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:08.710539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:08.710539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:08.710539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:08.710539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:08.710539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:08.710539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:08.710539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:08.710539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:08.710539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:08.711330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:08.711330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:08.711330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:08.711330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:08.711330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:08.711330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:08.711330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:08.711330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:08.711330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:08.711330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:08.711330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:45:08.711330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:08.711330 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 210/421] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Jul 16 20:45:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:45:08.720088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060067f-c38f-4697-8552-fc6ccc40332f None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:08.723558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:08.745257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c71554-8b09-4cf0-b6fc-b0daee0236de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:08.745885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c71554-8b09-4cf0-b6fc-b0daee0236de None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:08.746165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c71554-8b09-4cf0-b6fc-b0daee0236de None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:08.746439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c71554-8b09-4cf0-b6fc-b0daee0236de None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:08.747221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c71554-8b09-4cf0-b6fc-b0daee0236de None admin] RBAC: Adding query filter params (name=member) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:08.748052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c71554-8b09-4cf0-b6fc-b0daee0236de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:08.749863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c71554-8b09-4cf0-b6fc-b0daee0236de None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:08.759962 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 212/422] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:45:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:45:08.766889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c71554-8b09-4cf0-b6fc-b0daee0236de None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:08.913080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c71554-8b09-4cf0-b6fc-b0daee0236de None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:08.928676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060067f-c38f-4697-8552-fc6ccc40332f None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:08.961841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:08.990973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f5f50-eeb2-4571-ae26-0bda626ed865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:08.992239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c697b-72bc-4c8a-8210-7af48dc1cd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:08.992708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f5f50-eeb2-4571-ae26-0bda626ed865 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:08.999122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c697b-72bc-4c8a-8210-7af48dc1cd47 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:08.999122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c697b-72bc-4c8a-8210-7af48dc1cd47 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:08.999122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c697b-72bc-4c8a-8210-7af48dc1cd47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:08.999395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f5f50-eeb2-4571-ae26-0bda626ed865 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:08.999395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f5f50-eeb2-4571-ae26-0bda626ed865 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:08.999395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f5f50-eeb2-4571-ae26-0bda626ed865 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:08.999395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f5f50-eeb2-4571-ae26-0bda626ed865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:09.001301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f5f50-eeb2-4571-ae26-0bda626ed865 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:09.023199 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 211/423] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:09.030436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f5f50-eeb2-4571-ae26-0bda626ed865 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:09.064784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:09.103443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c697b-72bc-4c8a-8210-7af48dc1cd47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:09.105178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c697b-72bc-4c8a-8210-7af48dc1cd47 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:09.176717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f5f50-eeb2-4571-ae26-0bda626ed865 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:09.214841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638615d-e936-4b9d-8f8f-f58864eb6666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:09.215469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638615d-e936-4b9d-8f8f-f58864eb6666 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:09.216017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638615d-e936-4b9d-8f8f-f58864eb6666 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:09.216377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638615d-e936-4b9d-8f8f-f58864eb6666 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:09.303368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:09.334460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638615d-e936-4b9d-8f8f-f58864eb6666 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:09.336370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638615d-e936-4b9d-8f8f-f58864eb6666 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:09.363829 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 213/424] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:45:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:45:09.373574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c697b-72bc-4c8a-8210-7af48dc1cd47 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:09.453991 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 212/425] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:45:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:45:09.460528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638615d-e936-4b9d-8f8f-f58864eb6666 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:09.551791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:09.580128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638615d-e936-4b9d-8f8f-f58864eb6666 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:09.591171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:09.625393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40483a2-9c1b-4e3e-9cb9-c2069f34c6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:09.627124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40483a2-9c1b-4e3e-9cb9-c2069f34c6b2 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:09.627683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40483a2-9c1b-4e3e-9cb9-c2069f34c6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:09.628151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40483a2-9c1b-4e3e-9cb9-c2069f34c6b2 None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:09.629658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40483a2-9c1b-4e3e-9cb9-c2069f34c6b2 None admin] RBAC: Authorizing `identity:get_project(project_id=2ab6547ffe6648bd8a4ac2a99e702240)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:09.632183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40483a2-9c1b-4e3e-9cb9-c2069f34c6b2 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:09.634498 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 213/426] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:45:09 2022] GET /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:45:09.640845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c697b-72bc-4c8a-8210-7af48dc1cd47 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:09.641453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40483a2-9c1b-4e3e-9cb9-c2069f34c6b2 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:09.680039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976ee28-72e9-460f-a564-5dd1e300dfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:09.681051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976ee28-72e9-460f-a564-5dd1e300dfbc None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:09.682154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976ee28-72e9-460f-a564-5dd1e300dfbc None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:09.682154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976ee28-72e9-460f-a564-5dd1e300dfbc None admin] PATH_INFO: `/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:09.683104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976ee28-72e9-460f-a564-5dd1e300dfbc None admin] RBAC: Authorizing `identity:get_project(project_id=2ab6547ffe6648bd8a4ac2a99e702240)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:09.685476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976ee28-72e9-460f-a564-5dd1e300dfbc None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:09.687766 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 214/427] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:45:09 2022] GET /identity/v3/projects/2ab6547ffe6648bd8a4ac2a99e702240 => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:45:09.695217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976ee28-72e9-460f-a564-5dd1e300dfbc None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:09.761035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40483a2-9c1b-4e3e-9cb9-c2069f34c6b2 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:09.838243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976ee28-72e9-460f-a564-5dd1e300dfbc None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:09.878666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e414c87-2577-43c2-9327-25e0851c6f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:09.879686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e414c87-2577-43c2-9327-25e0851c6f30 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:09.880101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e414c87-2577-43c2-9327-25e0851c6f30 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:09.880447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e414c87-2577-43c2-9327-25e0851c6f30 None admin] PATH_INFO: `/v3/groups/dbba2478141243a2b03206f43ecf1339` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:09.881748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e414c87-2577-43c2-9327-25e0851c6f30 None admin] RBAC: Authorizing `identity:get_group(group_id=dbba2478141243a2b03206f43ecf1339)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:09.883300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e414c87-2577-43c2-9327-25e0851c6f30 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:09.885417 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 215/428] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Jul 16 20:45:09 2022] GET /identity/v3/groups/dbba2478141243a2b03206f43ecf1339 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:09.888913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8152ee-b612-45e2-8188-0a3c43072eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:09.889897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8152ee-b612-45e2-8188-0a3c43072eed None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:09.890181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8152ee-b612-45e2-8188-0a3c43072eed None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:09.890457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8152ee-b612-45e2-8188-0a3c43072eed None admin] PATH_INFO: `/v3/groups/dbba2478141243a2b03206f43ecf1339` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:09.895473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e414c87-2577-43c2-9327-25e0851c6f30 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:09.896411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8152ee-b612-45e2-8188-0a3c43072eed None admin] RBAC: Authorizing `identity:get_group(group_id=dbba2478141243a2b03206f43ecf1339)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:09.897974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8152ee-b612-45e2-8188-0a3c43072eed None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:09.899837 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 214/429] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Jul 16 20:45:09 2022] GET /identity/v3/groups/dbba2478141243a2b03206f43ecf1339 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:45:09.911351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8152ee-b612-45e2-8188-0a3c43072eed None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:09.932282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:09.949541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:10.083350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e414c87-2577-43c2-9327-25e0851c6f30 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:10.124022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31280a8-50cb-4b36-b3ae-f529cd314d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:10.124612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31280a8-50cb-4b36-b3ae-f529cd314d88 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:10.124903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31280a8-50cb-4b36-b3ae-f529cd314d88 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:10.125168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31280a8-50cb-4b36-b3ae-f529cd314d88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:10.126021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31280a8-50cb-4b36-b3ae-f529cd314d88 None admin] RBAC: Adding query filter params (group.id=dbba2478141243a2b03206f43ecf1339, role.id=c352110df5bc449b9134928abd20c032, scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:10.126336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31280a8-50cb-4b36-b3ae-f529cd314d88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:10.127898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31280a8-50cb-4b36-b3ae-f529cd314d88 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:10.135471 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 216/430] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Jul 16 20:45:09 2022] GET /identity/v3/role_assignments?group.id=dbba2478141243a2b03206f43ecf1339&scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240&role.id=c352110df5bc449b9134928abd20c032 => generated 611 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:45:10.160714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8152ee-b612-45e2-8188-0a3c43072eed None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:10.204127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b737e4-481e-4e9d-bb69-20bdb221d880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:10.204813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b737e4-481e-4e9d-bb69-20bdb221d880 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:10.205097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b737e4-481e-4e9d-bb69-20bdb221d880 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:10.205373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b737e4-481e-4e9d-bb69-20bdb221d880 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:10.206238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b737e4-481e-4e9d-bb69-20bdb221d880 None admin] RBAC: Adding query filter params (group.id=dbba2478141243a2b03206f43ecf1339, role.id=b9444da176484ccfa45d6b85220ce558, scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:10.206548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b737e4-481e-4e9d-bb69-20bdb221d880 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:10.208097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b737e4-481e-4e9d-bb69-20bdb221d880 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:10.215088 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 215/431] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Jul 16 20:45:09 2022] GET /identity/v3/role_assignments?group.id=dbba2478141243a2b03206f43ecf1339&scope.project.id=2ab6547ffe6648bd8a4ac2a99e702240&role.id=b9444da176484ccfa45d6b85220ce558 => generated 611 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:10.948031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e0f4f-63a9-4c83-b5fb-ab215bf17943 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:10.949049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e0f4f-63a9-4c83-b5fb-ab215bf17943 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:10.949550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e0f4f-63a9-4c83-b5fb-ab215bf17943 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:10.952216 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 217/432] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:10.958536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb636c-d09e-4ab4-8f61-37368e149588 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:10.959567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb636c-d09e-4ab4-8f61-37368e149588 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:10.960320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb636c-d09e-4ab4-8f61-37368e149588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:10.975446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81407d1-96ee-46fd-a773-6821925a26b9 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:10.976087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81407d1-96ee-46fd-a773-6821925a26b9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:10.976572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81407d1-96ee-46fd-a773-6821925a26b9 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:10.978584 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 218/433] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:45:10.983394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1ecb636c-d09e-4ab4-8f61-37368e149588 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:10.987069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1ecb636c-d09e-4ab4-8f61-37368e149588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:10.987274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6b4c7-bd0d-4aeb-a220-319926ee9e89 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:10.987274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6b4c7-bd0d-4aeb-a220-319926ee9e89 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:10.987274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6b4c7-bd0d-4aeb-a220-319926ee9e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:11.008611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1de6b4c7-bd0d-4aeb-a220-319926ee9e89 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:11.009818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1de6b4c7-bd0d-4aeb-a220-319926ee9e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:11.081346 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 216/434] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:11.107116 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 219/435] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:11.107311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb636c-d09e-4ab4-8f61-37368e149588 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:11.115366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:11.123259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bce02-145f-48ca-bcfe-aa3b0f03db12 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:11.130852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bce02-145f-48ca-bcfe-aa3b0f03db12 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:11.130852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bce02-145f-48ca-bcfe-aa3b0f03db12 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:11.130852 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 220/436] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:11.130852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bce02-145f-48ca-bcfe-aa3b0f03db12 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:11.139433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:11.230699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb636c-d09e-4ab4-8f61-37368e149588 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:11.250957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bce02-145f-48ca-bcfe-aa3b0f03db12 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:11.277176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734c2a9-23d2-4704-bd11-45baca57b603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:11.278300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734c2a9-23d2-4704-bd11-45baca57b603 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:11.279362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734c2a9-23d2-4704-bd11-45baca57b603 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:11.279738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734c2a9-23d2-4704-bd11-45baca57b603 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:11.291392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f7cb6-e506-490e-916f-715195de5167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:11.292422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f7cb6-e506-490e-916f-715195de5167 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:11.292564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f7cb6-e506-490e-916f-715195de5167 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:11.292881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f7cb6-e506-490e-916f-715195de5167 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:11.298434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734c2a9-23d2-4704-bd11-45baca57b603 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:11.304164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f7cb6-e506-490e-916f-715195de5167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:11.312978 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-d78f7cb6-e506-490e-916f-715195de5167 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:45:11.312978 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:11.312978 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:11.312978 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:11.312978 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:11.312978 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:11.312978 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:11.312978 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:11.312978 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:11.312978 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:11.312978 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:11.312978 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:11.312978 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:11.312978 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:11.312978 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:11.312978 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:11.313925 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:11.313925 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:11.313925 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:11.313925 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:11.313925 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:11.313925 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:11.313925 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:11.313925 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:11.313925 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:11.313925 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:11.313925 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:11.313925 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:11.313925 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:11.313925 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:11.313925 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:11.313925 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:11.314723 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:11.314723 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:11.314723 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:11.314723 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:11.314723 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:11.314723 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:11.314723 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:11.314723 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:11.314723 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:11.314723 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:11.314723 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:45:11.314723 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:11.314723 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 221/437] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Jul 16 20:45:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:11.315914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23128f78-3882-4882-af70-ab0fc2217d25 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:11.316009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23128f78-3882-4882-af70-ab0fc2217d25 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:11.316223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23128f78-3882-4882-af70-ab0fc2217d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:11.318773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-a734c2a9-23d2-4704-bd11-45baca57b603 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:45:11.318773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:11.318773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:11.318773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:11.318773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:11.318773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:11.318773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:11.318773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:11.318773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:11.318773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:11.318773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:11.318773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:11.318773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:11.318773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:11.318773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:11.318773 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:11.319833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:11.319833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:11.319833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:11.319833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:11.319833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:11.319833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:11.319833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:11.319833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:11.319833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:11.319833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:11.319833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:11.319833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:11.319833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:11.319833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:11.319833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:11.319833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:11.320606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:11.320606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:11.320606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:11.320606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:11.320606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:11.320606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:11.320606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:11.320606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:11.320606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:11.320606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:11.320606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 16 20:45:11.320606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:11.325347 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 217/438] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:45:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:11.326754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734c2a9-23d2-4704-bd11-45baca57b603 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:11.338181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-23128f78-3882-4882-af70-ab0fc2217d25 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:11.339465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-23128f78-3882-4882-af70-ab0fc2217d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:11.397237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:11.432272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:11.440376 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 222/439] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:11.441676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23128f78-3882-4882-af70-ab0fc2217d25 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:11.462128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734c2a9-23d2-4704-bd11-45baca57b603 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:11.507721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16817e-2357-48ae-84e1-237a2614db72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:11.508701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16817e-2357-48ae-84e1-237a2614db72 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:11.508982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16817e-2357-48ae-84e1-237a2614db72 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:11.509260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16817e-2357-48ae-84e1-237a2614db72 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:11.510005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16817e-2357-48ae-84e1-237a2614db72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:11.510378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16817e-2357-48ae-84e1-237a2614db72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:11.512370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16817e-2357-48ae-84e1-237a2614db72 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:11.522845 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 218/440] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:11.523691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16817e-2357-48ae-84e1-237a2614db72 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:11.566809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23128f78-3882-4882-af70-ab0fc2217d25 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:11.614596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3233c3-7f84-4f9e-82df-028f4aa3a408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:11.615354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3233c3-7f84-4f9e-82df-028f4aa3a408 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:11.615639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3233c3-7f84-4f9e-82df-028f4aa3a408 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:11.615913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3233c3-7f84-4f9e-82df-028f4aa3a408 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:11.616677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3233c3-7f84-4f9e-82df-028f4aa3a408 None admin] RBAC: Adding query filter params (name=member) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:11.617581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3233c3-7f84-4f9e-82df-028f4aa3a408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:11.618388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3233c3-7f84-4f9e-82df-028f4aa3a408 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:11.628479 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 223/441] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:45:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:11.629425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3233c3-7f84-4f9e-82df-028f4aa3a408 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:11.645406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16817e-2357-48ae-84e1-237a2614db72 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:11.675637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:11.685593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3155a-dc23-4dae-bbb4-6359de8bbfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:11.686633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3155a-dc23-4dae-bbb4-6359de8bbfec None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:11.686866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3155a-dc23-4dae-bbb4-6359de8bbfec None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:11.696723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3155a-dc23-4dae-bbb4-6359de8bbfec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:11.696926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:11.698461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3155a-dc23-4dae-bbb4-6359de8bbfec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:11.706851 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-f7a3155a-dc23-4dae-bbb4-6359de8bbfec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:45:11.706851 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:11.706851 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:11.706851 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:11.706851 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:11.706851 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:11.706851 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:11.706851 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:11.706851 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:11.706851 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:11.706851 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:11.706851 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:11.706851 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:11.706851 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:11.706851 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:11.706851 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:11.708496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:11.708496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:11.708496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:11.708496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:11.708496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:11.708496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:11.708496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:11.708496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:11.708496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:11.708496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:11.708496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:11.708496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:11.708496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:11.708496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:11.708496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:11.708496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:11.709383 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:11.709383 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:11.709383 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:11.709383 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:11.709383 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:11.709383 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:11.709383 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:11.709383 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:11.709383 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:11.709383 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:11.709383 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:45:11.709383 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:11.709383 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 219/442] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:45:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:11.709383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3155a-dc23-4dae-bbb4-6359de8bbfec None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:11.737772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3233c3-7f84-4f9e-82df-028f4aa3a408 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:11.787660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e06e7-10a8-40f3-aa68-492f0eec8639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:11.788336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e06e7-10a8-40f3-aa68-492f0eec8639 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:11.788615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e06e7-10a8-40f3-aa68-492f0eec8639 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:11.788894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e06e7-10a8-40f3-aa68-492f0eec8639 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:11.826446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3155a-dc23-4dae-bbb4-6359de8bbfec None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:11.868260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6cad8-01aa-4674-bb5d-0e86882ca4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:11.868915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6cad8-01aa-4674-bb5d-0e86882ca4d1 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:11.869194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6cad8-01aa-4674-bb5d-0e86882ca4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:11.869467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6cad8-01aa-4674-bb5d-0e86882ca4d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:11.872135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e06e7-10a8-40f3-aa68-492f0eec8639 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:11.873810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e06e7-10a8-40f3-aa68-492f0eec8639 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:11.936354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:11.943976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:11.948923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6cad8-01aa-4674-bb5d-0e86882ca4d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:11.950414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6cad8-01aa-4674-bb5d-0e86882ca4d1 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:11.989521 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 224/443] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:45:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:45:11.990386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e06e7-10a8-40f3-aa68-492f0eec8639 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:12.062179 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 220/444] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:45:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:45:12.063809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6cad8-01aa-4674-bb5d-0e86882ca4d1 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:12.103968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e06e7-10a8-40f3-aa68-492f0eec8639 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:12.140954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8e20d-877f-49fd-9442-2fd6afece4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:12.141622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8e20d-877f-49fd-9442-2fd6afece4bd None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:12.141893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8e20d-877f-49fd-9442-2fd6afece4bd None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:12.142158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8e20d-877f-49fd-9442-2fd6afece4bd None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:12.142904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8e20d-877f-49fd-9442-2fd6afece4bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:12.143238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8e20d-877f-49fd-9442-2fd6afece4bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:12.144617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8e20d-877f-49fd-9442-2fd6afece4bd None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:12.153233 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 225/445] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:45:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:12.155255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8e20d-877f-49fd-9442-2fd6afece4bd None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:12.172055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:12.182434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:12.189504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6cad8-01aa-4674-bb5d-0e86882ca4d1 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:12.225056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f953e5-f475-4a14-b58f-b4e3aea47595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:12.226238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f953e5-f475-4a14-b58f-b4e3aea47595 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:12.226515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f953e5-f475-4a14-b58f-b4e3aea47595 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:12.226844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f953e5-f475-4a14-b58f-b4e3aea47595 None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:12.228520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f953e5-f475-4a14-b58f-b4e3aea47595 None admin] RBAC: Authorizing `identity:get_project(project_id=10517c754ba94c1d893d97627d31b9f0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:12.230377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f953e5-f475-4a14-b58f-b4e3aea47595 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:12.234268 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 221/446] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:45:12 2022] GET /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:12.234268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f953e5-f475-4a14-b58f-b4e3aea47595 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:12.263670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8e20d-877f-49fd-9442-2fd6afece4bd None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:12.301705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdf513-f025-46bc-b2c6-19171cc6d40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:12.302634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdf513-f025-46bc-b2c6-19171cc6d40d None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:12.302917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdf513-f025-46bc-b2c6-19171cc6d40d None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:12.303217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdf513-f025-46bc-b2c6-19171cc6d40d None admin] PATH_INFO: `/v3/projects/10517c754ba94c1d893d97627d31b9f0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:12.304506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdf513-f025-46bc-b2c6-19171cc6d40d None admin] RBAC: Authorizing `identity:get_project(project_id=10517c754ba94c1d893d97627d31b9f0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:12.305985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdf513-f025-46bc-b2c6-19171cc6d40d None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:12.307908 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 226/447] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:45:12 2022] GET /identity/v3/projects/10517c754ba94c1d893d97627d31b9f0 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:12.308611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdf513-f025-46bc-b2c6-19171cc6d40d None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:12.361165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f953e5-f475-4a14-b58f-b4e3aea47595 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:12.402657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff6764-f903-4817-9957-2d685dd264ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:12.403338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff6764-f903-4817-9957-2d685dd264ff None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:12.403758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff6764-f903-4817-9957-2d685dd264ff None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:12.404168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff6764-f903-4817-9957-2d685dd264ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:12.415567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:12.427877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdf513-f025-46bc-b2c6-19171cc6d40d None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:12.438216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:12.478153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151500a-9939-4c88-9e78-4fff6fe93642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:12.478934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151500a-9939-4c88-9e78-4fff6fe93642 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:12.479919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151500a-9939-4c88-9e78-4fff6fe93642 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:12.479919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151500a-9939-4c88-9e78-4fff6fe93642 None admin] PATH_INFO: `/v3/groups/dbba2478141243a2b03206f43ecf1339` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:12.480928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151500a-9939-4c88-9e78-4fff6fe93642 None admin] RBAC: Authorizing `identity:get_group(group_id=dbba2478141243a2b03206f43ecf1339)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:12.482374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151500a-9939-4c88-9e78-4fff6fe93642 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:12.484105 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 227/448] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Jul 16 20:45:12 2022] GET /identity/v3/groups/dbba2478141243a2b03206f43ecf1339 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:12.484894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151500a-9939-4c88-9e78-4fff6fe93642 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:12.489474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff6764-f903-4817-9957-2d685dd264ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:12.492380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff6764-f903-4817-9957-2d685dd264ff None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:12.605753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151500a-9939-4c88-9e78-4fff6fe93642 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:12.610510 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 222/449] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:45:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:45:12.611384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff6764-f903-4817-9957-2d685dd264ff None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:12.652526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d52fd-949c-4425-9090-c2df5a76cfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:12.653929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d52fd-949c-4425-9090-c2df5a76cfab None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:12.654235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d52fd-949c-4425-9090-c2df5a76cfab None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:12.654502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d52fd-949c-4425-9090-c2df5a76cfab None admin] PATH_INFO: `/v3/groups/dbba2478141243a2b03206f43ecf1339` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:12.655778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d52fd-949c-4425-9090-c2df5a76cfab None admin] RBAC: Authorizing `identity:get_group(group_id=dbba2478141243a2b03206f43ecf1339)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:12.657320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d52fd-949c-4425-9090-c2df5a76cfab None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:12.658960 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 228/450] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Jul 16 20:45:12 2022] GET /identity/v3/groups/dbba2478141243a2b03206f43ecf1339 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:12.659744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d52fd-949c-4425-9090-c2df5a76cfab None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:12.678144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:12.690366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:12.726967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff6764-f903-4817-9957-2d685dd264ff None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:12.767782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d52fd-949c-4425-9090-c2df5a76cfab None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:12.776081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0f799-1195-42ec-afa6-f61041b3037c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:12.776750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0f799-1195-42ec-afa6-f61041b3037c None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:12.777032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0f799-1195-42ec-afa6-f61041b3037c None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:12.777303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0f799-1195-42ec-afa6-f61041b3037c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:12.778142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0f799-1195-42ec-afa6-f61041b3037c None admin] RBAC: Adding query filter params (group.id=dbba2478141243a2b03206f43ecf1339, role.id=b9444da176484ccfa45d6b85220ce558, scope.project.id=10517c754ba94c1d893d97627d31b9f0) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:12.778450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0f799-1195-42ec-afa6-f61041b3037c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:12.780116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0f799-1195-42ec-afa6-f61041b3037c None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:12.786374 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 223/451] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Jul 16 20:45:12 2022] GET /identity/v3/role_assignments?group.id=dbba2478141243a2b03206f43ecf1339&scope.project.id=10517c754ba94c1d893d97627d31b9f0&role.id=b9444da176484ccfa45d6b85220ce558 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:12.787239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0f799-1195-42ec-afa6-f61041b3037c None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:12.812801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32290958-397f-414f-9e22-0bc1ace593c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:12.813724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32290958-397f-414f-9e22-0bc1ace593c9 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:12.814032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32290958-397f-414f-9e22-0bc1ace593c9 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:12.814277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32290958-397f-414f-9e22-0bc1ace593c9 None admin] PATH_INFO: `/v3/projects/455f5961d0804544b3b78f843a889637` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:12.815688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32290958-397f-414f-9e22-0bc1ace593c9 None admin] RBAC: Authorizing `identity:get_project(project_id=455f5961d0804544b3b78f843a889637)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:12.817178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32290958-397f-414f-9e22-0bc1ace593c9 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:12.822167 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 229/452] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:45:12 2022] GET /identity/v3/projects/455f5961d0804544b3b78f843a889637 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:12.827839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32290958-397f-414f-9e22-0bc1ace593c9 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:12.937330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0f799-1195-42ec-afa6-f61041b3037c None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:12.960431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:12.975729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a602c09-2236-434f-9d05-ea63710a643f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:12.976502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a602c09-2236-434f-9d05-ea63710a643f None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:12.976766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a602c09-2236-434f-9d05-ea63710a643f None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:12.977629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a602c09-2236-434f-9d05-ea63710a643f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:12.977965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a602c09-2236-434f-9d05-ea63710a643f None admin] RBAC: Adding query filter params (group.id=dbba2478141243a2b03206f43ecf1339, role.id=c352110df5bc449b9134928abd20c032, scope.project.id=10517c754ba94c1d893d97627d31b9f0) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:12.978384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a602c09-2236-434f-9d05-ea63710a643f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:12.979452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:12.980011 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a602c09-2236-434f-9d05-ea63710a643f None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:12.987780 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 224/453] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Jul 16 20:45:12 2022] GET /identity/v3/role_assignments?group.id=dbba2478141243a2b03206f43ecf1339&scope.project.id=10517c754ba94c1d893d97627d31b9f0&role.id=c352110df5bc449b9134928abd20c032 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:12.990757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32290958-397f-414f-9e22-0bc1ace593c9 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:13.042585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471aa93e-fc62-4777-9811-46ab72f76959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:13.043403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471aa93e-fc62-4777-9811-46ab72f76959 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:13.043684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471aa93e-fc62-4777-9811-46ab72f76959 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:13.043957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471aa93e-fc62-4777-9811-46ab72f76959 None admin] PATH_INFO: `/v3/groups/c39664b5afd24bbead8f976f675f8870` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:13.046124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471aa93e-fc62-4777-9811-46ab72f76959 None admin] RBAC: Authorizing `identity:get_group(group_id=c39664b5afd24bbead8f976f675f8870)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:13.047828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471aa93e-fc62-4777-9811-46ab72f76959 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:13.051112 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 230/454] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Jul 16 20:45:12 2022] GET /identity/v3/groups/c39664b5afd24bbead8f976f675f8870 => generated 229 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:13.056662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a602c09-2236-434f-9d05-ea63710a643f None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:13.176648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a602c09-2236-434f-9d05-ea63710a643f None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:13.214753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fac46b-389e-4517-8b0f-7d7460c6cccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:13.215449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fac46b-389e-4517-8b0f-7d7460c6cccc None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:13.215732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fac46b-389e-4517-8b0f-7d7460c6cccc None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:13.216536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fac46b-389e-4517-8b0f-7d7460c6cccc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:13.217396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fac46b-389e-4517-8b0f-7d7460c6cccc None admin] RBAC: Adding query filter params (group.id=c39664b5afd24bbead8f976f675f8870, role.id=bd33b827674a4d4db30c164cab416056, scope.project.id=455f5961d0804544b3b78f843a889637) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:13.217708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fac46b-389e-4517-8b0f-7d7460c6cccc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:13.219188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fac46b-389e-4517-8b0f-7d7460c6cccc None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:13.228136 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 225/455] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Jul 16 20:45:13 2022] GET /identity/v3/role_assignments?group.id=c39664b5afd24bbead8f976f675f8870&scope.project.id=455f5961d0804544b3b78f843a889637&role.id=bd33b827674a4d4db30c164cab416056 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:16.292354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8622ec-c205-4193-9ceb-05b05a8f41fb None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:16.292868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8622ec-c205-4193-9ceb-05b05a8f41fb None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:16.293117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8622ec-c205-4193-9ceb-05b05a8f41fb None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:16.295489 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 231/456] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:16.301499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588681ad-2285-47bf-8db8-0d1ce85dc6c0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:16.302569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588681ad-2285-47bf-8db8-0d1ce85dc6c0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:16.303076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588681ad-2285-47bf-8db8-0d1ce85dc6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:16.324053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-588681ad-2285-47bf-8db8-0d1ce85dc6c0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:16.325951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-588681ad-2285-47bf-8db8-0d1ce85dc6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:16.392873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:16.425486 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 226/457] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:16.469510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8622ec-c205-4193-9ceb-05b05a8f41fb None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:16.501423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe7887-01f1-4992-887d-68b0fff97853 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:16.501758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe7887-01f1-4992-887d-68b0fff97853 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:16.501983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe7887-01f1-4992-887d-68b0fff97853 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:16.503388 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 227/458] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:16.519259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a0034-1cb4-4379-8790-51fe0c5efbcd None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:16.519558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a0034-1cb4-4379-8790-51fe0c5efbcd None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:16.519820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a0034-1cb4-4379-8790-51fe0c5efbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:16.564182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-bf2a0034-1cb4-4379-8790-51fe0c5efbcd None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:16.564182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bf2a0034-1cb4-4379-8790-51fe0c5efbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:16.603753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8622ec-c205-4193-9ceb-05b05a8f41fb None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:16.632538 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 228/459] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:16.634834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58706956-73fa-4912-90bb-b39cd715b1d1 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:16.635295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58706956-73fa-4912-90bb-b39cd715b1d1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:16.635721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58706956-73fa-4912-90bb-b39cd715b1d1 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:16.638533 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 229/460] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:16.643754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b647d-fdad-4106-8585-947a5d863492 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:16.644419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b647d-fdad-4106-8585-947a5d863492 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:16.645250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b647d-fdad-4106-8585-947a5d863492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:16.654309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecee6de-c904-430f-bb6e-93c1e640e9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:16.659754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecee6de-c904-430f-bb6e-93c1e640e9ab None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:16.659754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecee6de-c904-430f-bb6e-93c1e640e9ab None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:16.659754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecee6de-c904-430f-bb6e-93c1e640e9ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:16.675547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecee6de-c904-430f-bb6e-93c1e640e9ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:16.676485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9c5b647d-fdad-4106-8585-947a5d863492 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:16.677016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecee6de-c904-430f-bb6e-93c1e640e9ab None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:16.678124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9c5b647d-fdad-4106-8585-947a5d863492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:16.697011 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-0ecee6de-c904-430f-bb6e-93c1e640e9ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:16.697011 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:16.697011 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:16.697011 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:16.697011 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:16.697011 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:16.697011 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:16.697011 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:16.697011 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:16.697011 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:16.697011 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:16.697011 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:16.697011 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:16.697011 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:16.697011 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:16.697969 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:16.697969 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:16.697969 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:16.697969 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:16.697969 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:16.697969 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:16.697969 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:16.697969 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:16.697969 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:16.697969 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:16.697969 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:16.697969 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:16.697969 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:16.697969 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:16.697969 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:16.697969 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:16.697969 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:16.698813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:16.698813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:16.698813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:16.698813 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:16.698813 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 232/461] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:16.699407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecee6de-c904-430f-bb6e-93c1e640e9ab None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:16.722628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:16.768367 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 230/462] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:16.769542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b647d-fdad-4106-8585-947a5d863492 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:16.823290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:16.855451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecee6de-c904-430f-bb6e-93c1e640e9ab None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:16.902103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe374bcb-5d10-4419-90e8-cb0831382bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:16.903124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b647d-fdad-4106-8585-947a5d863492 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:16.904123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe374bcb-5d10-4419-90e8-cb0831382bf6 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:16.904687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe374bcb-5d10-4419-90e8-cb0831382bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:16.905200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe374bcb-5d10-4419-90e8-cb0831382bf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:16.918484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe374bcb-5d10-4419-90e8-cb0831382bf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:16.921094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe374bcb-5d10-4419-90e8-cb0831382bf6 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:16.941858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-fe374bcb-5d10-4419-90e8-cb0831382bf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:16.941858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:16.941858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:16.941858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:16.941858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:16.941858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:16.941858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:16.941858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:16.941858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:16.941858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:16.941858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:16.941858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:16.941858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:16.941858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:16.941858 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:16.942760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:16.942760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:16.942760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:16.942760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:16.942760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:16.942760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:16.942760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:16.942760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:16.942760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:16.942760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:16.942760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:16.942760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:16.942760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:16.942760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:16.942760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:16.942760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:16.942760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:16.943626 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:16.943626 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:16.943626 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:16.943626 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:16.945817 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 233/463] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:16.946859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe374bcb-5d10-4419-90e8-cb0831382bf6 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:16.954218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc9182-73ef-4151-bdde-705f756fc803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:16.954893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc9182-73ef-4151-bdde-705f756fc803 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:16.955196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc9182-73ef-4151-bdde-705f756fc803 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:16.955467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc9182-73ef-4151-bdde-705f756fc803 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:16.956192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc9182-73ef-4151-bdde-705f756fc803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:16.956493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc9182-73ef-4151-bdde-705f756fc803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:16.957883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc9182-73ef-4151-bdde-705f756fc803 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:16.986462 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 231/464] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:16.986462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc9182-73ef-4151-bdde-705f756fc803 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:17.027057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:17.065016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe374bcb-5d10-4419-90e8-cb0831382bf6 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:17.097040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:17.100735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc9182-73ef-4151-bdde-705f756fc803 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:17.102312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df3eab-3b0a-46ac-8fb9-10814af7baaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:17.103139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df3eab-3b0a-46ac-8fb9-10814af7baaf None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:17.115550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df3eab-3b0a-46ac-8fb9-10814af7baaf None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:17.115550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df3eab-3b0a-46ac-8fb9-10814af7baaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:17.115550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df3eab-3b0a-46ac-8fb9-10814af7baaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:17.116863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df3eab-3b0a-46ac-8fb9-10814af7baaf None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:17.135168 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-49df3eab-3b0a-46ac-8fb9-10814af7baaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:17.135168 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:17.135168 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:17.135168 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:17.135168 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:17.135168 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:17.135168 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:17.135168 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:17.135168 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:17.135168 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:17.135168 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:17.135168 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:17.135168 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:17.135168 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:17.135168 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:17.136066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:17.136066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:17.136066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:17.136066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:17.136066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:17.136066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:17.136066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:17.136066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:17.136066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:17.136066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:17.136066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:17.136066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:17.136066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:17.136066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:17.136066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:17.136066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:17.136066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:17.143145 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:17.143145 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:17.143145 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:17.143145 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:17.143145 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 234/465] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:17.143145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bae682-40c3-47dd-8920-297aee37190a None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:17.143145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bae682-40c3-47dd-8920-297aee37190a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:17.143145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bae682-40c3-47dd-8920-297aee37190a None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:17.144210 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 235/466] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:17.145055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bae682-40c3-47dd-8920-297aee37190a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:17.145874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e293517-9a21-4671-8162-f97e66029952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:17.146553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e293517-9a21-4671-8162-f97e66029952 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:17.146833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e293517-9a21-4671-8162-f97e66029952 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:17.147145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e293517-9a21-4671-8162-f97e66029952 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:17.147877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e293517-9a21-4671-8162-f97e66029952 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:17.148181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e293517-9a21-4671-8162-f97e66029952 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:17.149594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e293517-9a21-4671-8162-f97e66029952 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:17.162084 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 232/467] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:17.162931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e293517-9a21-4671-8162-f97e66029952 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:17.266928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bae682-40c3-47dd-8920-297aee37190a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:17.277834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e293517-9a21-4671-8162-f97e66029952 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:17.285317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:17.302964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5d15a-e151-4e09-8454-3080cb93b9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:17.303634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5d15a-e151-4e09-8454-3080cb93b9c8 None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:17.303928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5d15a-e151-4e09-8454-3080cb93b9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:17.304200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5d15a-e151-4e09-8454-3080cb93b9c8 None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:17.304898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5d15a-e151-4e09-8454-3080cb93b9c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:17.306402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5d15a-e151-4e09-8454-3080cb93b9c8 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:17.320278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca1f74-2df4-4957-8fd6-3be313388d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:17.320972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca1f74-2df4-4957-8fd6-3be313388d03 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:17.321250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca1f74-2df4-4957-8fd6-3be313388d03 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:17.321519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca1f74-2df4-4957-8fd6-3be313388d03 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:17.322277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca1f74-2df4-4957-8fd6-3be313388d03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:17.322553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca1f74-2df4-4957-8fd6-3be313388d03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:17.323940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca1f74-2df4-4957-8fd6-3be313388d03 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:17.337266 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 233/468] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:17.338540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506a001-a206-4cf5-a68b-2bfedff68523 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:17.338824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506a001-a206-4cf5-a68b-2bfedff68523 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:17.339185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506a001-a206-4cf5-a68b-2bfedff68523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:17.358715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d506a001-a206-4cf5-a68b-2bfedff68523 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:17.359923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d506a001-a206-4cf5-a68b-2bfedff68523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:17.376294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:17.435312 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 236/469] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Jul 16 20:45:17 2022] POST /identity/v3/users => generated 246 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:45:17.435312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5d15a-e151-4e09-8454-3080cb93b9c8 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:17.440637 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 234/470] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:17.441567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506a001-a206-4cf5-a68b-2bfedff68523 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:17.576492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5d15a-e151-4e09-8454-3080cb93b9c8 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:17.589309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506a001-a206-4cf5-a68b-2bfedff68523 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:17.618428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9939d1-14da-48a5-8880-5d85ec257562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:17.618996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9939d1-14da-48a5-8880-5d85ec257562 None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:17.619632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9939d1-14da-48a5-8880-5d85ec257562 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:17.619749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9939d1-14da-48a5-8880-5d85ec257562 None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:17.620593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9939d1-14da-48a5-8880-5d85ec257562 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:17.622074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9939d1-14da-48a5-8880-5d85ec257562 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:17.628877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35201262-26a4-42d2-adaa-7f1fb552f10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:17.629544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35201262-26a4-42d2-adaa-7f1fb552f10f None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:17.629824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35201262-26a4-42d2-adaa-7f1fb552f10f None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:17.630095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35201262-26a4-42d2-adaa-7f1fb552f10f None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:17.630795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35201262-26a4-42d2-adaa-7f1fb552f10f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:17.632347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35201262-26a4-42d2-adaa-7f1fb552f10f None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:17.741531 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 237/471] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Jul 16 20:45:17 2022] POST /identity/v3/users => generated 248 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:45:17.742372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9939d1-14da-48a5-8880-5d85ec257562 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:17.777819 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 235/472] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Jul 16 20:45:17 2022] POST /identity/v3/users => generated 248 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:45:17.779507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b9df8-0744-4998-8388-16f1da01c85f None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:17.779784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b9df8-0744-4998-8388-16f1da01c85f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:17.780040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b9df8-0744-4998-8388-16f1da01c85f None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:17.781651 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 236/473] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:17.790266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24125d0-848c-40a6-bc69-fdd770285342 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:17.790564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24125d0-848c-40a6-bc69-fdd770285342 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:17.790820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24125d0-848c-40a6-bc69-fdd770285342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:17.793802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:17.808387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:17.836861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c24125d0-848c-40a6-bc69-fdd770285342 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:17.844652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c24125d0-848c-40a6-bc69-fdd770285342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:17.929379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9939d1-14da-48a5-8880-5d85ec257562 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:17.975136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d78b5-18ce-4f3b-bfee-73d35fc54285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:17.976715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d78b5-18ce-4f3b-bfee-73d35fc54285 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:17.977262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d78b5-18ce-4f3b-bfee-73d35fc54285 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:17.977751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d78b5-18ce-4f3b-bfee-73d35fc54285 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:17.994048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d78b5-18ce-4f3b-bfee-73d35fc54285 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:17.996958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d78b5-18ce-4f3b-bfee-73d35fc54285 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:18.012281 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 237/474] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:18.022975 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-ba9d78b5-18ce-4f3b-bfee-73d35fc54285 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:18.022975 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:18.022975 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:18.022975 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:18.022975 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:18.022975 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:18.022975 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:18.022975 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:18.022975 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:18.022975 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:18.022975 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:18.022975 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:18.022975 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:18.022975 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:18.022975 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:18.029143 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:18.029143 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:18.029143 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:18.029143 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:18.029143 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:18.029143 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:18.029143 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:18.029143 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:18.029143 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:18.029143 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:18.029143 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:18.029143 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:18.029143 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:18.029143 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:18.029143 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:18.029143 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:18.029143 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:18.030334 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:18.030334 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:18.030334 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:18.030334 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:18.030334 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 238/475] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:18.031236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24125d0-848c-40a6-bc69-fdd770285342 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:18.041830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d78b5-18ce-4f3b-bfee-73d35fc54285 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:18.155435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:18.177142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d78b5-18ce-4f3b-bfee-73d35fc54285 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:18.182298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24125d0-848c-40a6-bc69-fdd770285342 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:18.224124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361fe0e-1d26-4737-8ca8-a5d939c02aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:18.225109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361fe0e-1d26-4737-8ca8-a5d939c02aaf None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:18.225700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361fe0e-1d26-4737-8ca8-a5d939c02aaf None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:18.226011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc496f6b-f2d7-4966-bff5-0f2a523d50f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:18.226400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361fe0e-1d26-4737-8ca8-a5d939c02aaf None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:18.226681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc496f6b-f2d7-4966-bff5-0f2a523d50f4 None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:18.226962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc496f6b-f2d7-4966-bff5-0f2a523d50f4 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:18.227269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc496f6b-f2d7-4966-bff5-0f2a523d50f4 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:18.228009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361fe0e-1d26-4737-8ca8-a5d939c02aaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:18.228120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc496f6b-f2d7-4966-bff5-0f2a523d50f4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:18.228609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361fe0e-1d26-4737-8ca8-a5d939c02aaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:18.229380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc496f6b-f2d7-4966-bff5-0f2a523d50f4 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:18.230415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361fe0e-1d26-4737-8ca8-a5d939c02aaf None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:18.233201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:18.251305 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 238/476] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:18.256435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361fe0e-1d26-4737-8ca8-a5d939c02aaf None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:18.308679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.sql.core [None req-dc496f6b-f2d7-4966-bff5-0f2a523d50f4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 16 20:45:18.308679 ncdv-master-1 devstack@keystone.service[98195]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 16 20:45:18.308679 ncdv-master-1 devstack@keystone.service[98195]: [parameters: {'id': 'd8ec97723bf144e5909d008f9f01f63e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 16 20:45:18.308679 ncdv-master-1 devstack@keystone.service[98195]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98195) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 16 20:45:18.328234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-dc496f6b-f2d7-4966-bff5-0f2a523d50f4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 16 20:45:18.328234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:18.328234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 16 20:45:18.328234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 16 20:45:18.328234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 16 20:45:18.328234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 16 20:45:18.328234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 16 20:45:18.328234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application result = self._query(query) Jul 16 20:45:18.328234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 16 20:45:18.328234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application conn.query(q) Jul 16 20:45:18.328234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 16 20:45:18.328234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 16 20:45:18.328234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 16 20:45:18.328234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application result.read() Jul 16 20:45:18.328234 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 16 20:45:18.329178 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 16 20:45:18.329178 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 16 20:45:18.329178 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 16 20:45:18.329178 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 16 20:45:18.329178 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 16 20:45:18.329178 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 16 20:45:18.329178 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 16 20:45:18.329178 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 16 20:45:18.329178 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:18.329178 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 16 20:45:18.329178 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:18.329178 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:18.329178 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 16 20:45:18.329178 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 16 20:45:18.329178 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 16 20:45:18.329178 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return ref.to_dict() Jul 16 20:45:18.329178 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 16 20:45:18.329178 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application next(self.gen) Jul 16 20:45:18.330126 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 16 20:45:18.330126 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application yield resource Jul 16 20:45:18.330126 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 16 20:45:18.330126 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application next(self.gen) Jul 16 20:45:18.330126 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 16 20:45:18.330126 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self.session.rollback() Jul 16 20:45:18.330126 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 16 20:45:18.330126 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self.force_reraise() Jul 16 20:45:18.330126 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 16 20:45:18.330126 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise self.value Jul 16 20:45:18.330126 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 16 20:45:18.330126 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 16 20:45:18.330126 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 16 20:45:18.330126 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application session.commit() Jul 16 20:45:18.330126 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 16 20:45:18.330126 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 16 20:45:18.330126 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 16 20:45:18.330986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._prepare_impl() Jul 16 20:45:18.330986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 16 20:45:18.330986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self.session.flush() Jul 16 20:45:18.330986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 16 20:45:18.330986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._flush(objects) Jul 16 20:45:18.330986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 16 20:45:18.330986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 16 20:45:18.330986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 16 20:45:18.330986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application compat.raise_( Jul 16 20:45:18.330986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 16 20:45:18.330986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception Jul 16 20:45:18.330986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 16 20:45:18.330986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application flush_context.execute() Jul 16 20:45:18.330986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 16 20:45:18.330986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rec.execute(self) Jul 16 20:45:18.330986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 16 20:45:18.330986 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 16 20:45:18.331950 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 16 20:45:18.331950 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 16 20:45:18.331950 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 16 20:45:18.331950 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 16 20:45:18.331950 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 16 20:45:18.331950 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 16 20:45:18.331950 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 16 20:45:18.331950 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 16 20:45:18.331950 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 16 20:45:18.331950 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 16 20:45:18.331950 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 16 20:45:18.331950 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 16 20:45:18.331950 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 16 20:45:18.331950 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 16 20:45:18.331950 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 16 20:45:18.331950 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception Jul 16 20:45:18.332803 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 16 20:45:18.332803 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 16 20:45:18.332803 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 16 20:45:18.332803 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 16 20:45:18.332803 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 16 20:45:18.332803 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application result = self._query(query) Jul 16 20:45:18.332803 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 16 20:45:18.332803 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application conn.query(q) Jul 16 20:45:18.332803 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 16 20:45:18.332803 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 16 20:45:18.332803 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 16 20:45:18.332803 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application result.read() Jul 16 20:45:18.332803 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 16 20:45:18.332803 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 16 20:45:18.332803 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 16 20:45:18.332803 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 16 20:45:18.333573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 16 20:45:18.333573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 16 20:45:18.333573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 16 20:45:18.333573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 16 20:45:18.333573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 16 20:45:18.333573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 16 20:45:18.333573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [parameters: {'id': 'd8ec97723bf144e5909d008f9f01f63e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 16 20:45:18.333573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 16 20:45:18.333573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:18.333573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:45:18.333573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:18.333573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:18.333573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:18.333573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:18.333573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:18.333573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:18.334338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:18.334338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:18.334338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:18.334338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:18.334338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:18.334338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:18.334338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 16 20:45:18.334338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 16 20:45:18.334338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:18.334338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:18.334338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 16 20:45:18.334338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 16 20:45:18.334338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 16 20:45:18.334338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 16 20:45:18.334338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 16 20:45:18.334338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:18.338911 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 239/477] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Jul 16 20:45:18 2022] POST /identity/v3/roles => generated 144 bytes in 298 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:45:18.345913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc496f6b-f2d7-4966-bff5-0f2a523d50f4 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:18.389195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361fe0e-1d26-4737-8ca8-a5d939c02aaf None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:18.430301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041008a-e71d-4e09-94a3-0f8dcdc24e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:18.430983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041008a-e71d-4e09-94a3-0f8dcdc24e92 None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:18.431309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041008a-e71d-4e09-94a3-0f8dcdc24e92 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:18.431584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041008a-e71d-4e09-94a3-0f8dcdc24e92 None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:18.432289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041008a-e71d-4e09-94a3-0f8dcdc24e92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:18.434242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041008a-e71d-4e09-94a3-0f8dcdc24e92 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:18.501889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc496f6b-f2d7-4966-bff5-0f2a523d50f4 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:18.539135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b565378-ee87-4572-b4fa-e9ae1c0bd864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:18.547740 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 239/478] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Jul 16 20:45:18 2022] POST /identity/v3/users => generated 249 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:45:18.548417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b565378-ee87-4572-b4fa-e9ae1c0bd864 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:18.548914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b565378-ee87-4572-b4fa-e9ae1c0bd864 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:18.549433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b565378-ee87-4572-b4fa-e9ae1c0bd864 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:18.563563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b565378-ee87-4572-b4fa-e9ae1c0bd864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:18.572789 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-4b565378-ee87-4572-b4fa-e9ae1c0bd864 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:45:18.572789 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:18.572789 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:18.572789 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:18.572789 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:18.572789 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:18.572789 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:18.572789 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:18.572789 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:18.572789 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:18.572789 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:18.572789 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:18.572789 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:18.572789 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:18.572789 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:18.572789 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:18.573788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:18.573788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:18.573788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:18.573788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:18.573788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:18.573788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:18.573788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:18.573788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:18.573788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:18.573788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:18.573788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:18.573788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:18.573788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:18.573788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:18.573788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:18.573788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:18.574911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:18.574911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:18.574911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:18.574911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:18.574911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:18.574911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:18.574911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:18.574911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:18.574911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:18.574911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:18.574911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 16 20:45:18.574911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:18.574911 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 240/479] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Jul 16 20:45:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:18.581728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041008a-e71d-4e09-94a3-0f8dcdc24e92 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:18.643640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:18.727587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041008a-e71d-4e09-94a3-0f8dcdc24e92 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:18.779401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875b8a8-174c-40f5-bfd6-80930c43ab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:18.780103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875b8a8-174c-40f5-bfd6-80930c43ab40 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:18.780388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875b8a8-174c-40f5-bfd6-80930c43ab40 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:18.780663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875b8a8-174c-40f5-bfd6-80930c43ab40 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:18.781448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875b8a8-174c-40f5-bfd6-80930c43ab40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:18.781758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875b8a8-174c-40f5-bfd6-80930c43ab40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:18.784015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875b8a8-174c-40f5-bfd6-80930c43ab40 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:18.794491 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 240/480] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:20.129306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e345bf-ca47-408d-bebc-a5341a09b468 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:20.129815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e345bf-ca47-408d-bebc-a5341a09b468 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:20.129815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e345bf-ca47-408d-bebc-a5341a09b468 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:20.131689 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 241/481] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:20.137429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc02ba-c0b0-4bfb-b622-3843952df161 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:20.138652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc02ba-c0b0-4bfb-b622-3843952df161 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:20.138870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc02ba-c0b0-4bfb-b622-3843952df161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:20.168457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-05cc02ba-c0b0-4bfb-b622-3843952df161 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:20.169932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-05cc02ba-c0b0-4bfb-b622-3843952df161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:20.300033 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 241/482] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:20.339540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e345bf-ca47-408d-bebc-a5341a09b468 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:20.352117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:20.513104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e345bf-ca47-408d-bebc-a5341a09b468 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:20.568240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1403ba-9bfc-4858-b588-1337800f53af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:20.569491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1403ba-9bfc-4858-b588-1337800f53af None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:20.570108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1403ba-9bfc-4858-b588-1337800f53af None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:20.570583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1403ba-9bfc-4858-b588-1337800f53af None admin] PATH_INFO: `/v3/roles/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:20.592433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1403ba-9bfc-4858-b588-1337800f53af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:20.601108 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-2b1403ba-9bfc-4858-b588-1337800f53af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:20.601108 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:20.601108 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:20.601108 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:20.601108 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:20.601108 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:20.601108 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:20.601108 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:20.601108 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:20.601108 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:20.601108 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:20.601108 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:20.601108 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:20.601108 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:20.601108 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:20.601108 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:20.602060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:20.602060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:20.602060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:20.602060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:20.602060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:20.602060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:20.602060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:20.602060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:20.602060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:20.602060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:20.602060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:20.602060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:20.602060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:20.602060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:20.602060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:20.602060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:20.602824 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:20.602824 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:20.602824 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:20.602824 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:20.602824 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:20.602824 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:20.602824 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:20.602824 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:20.602824 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:20.602824 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:20.602824 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:20.602824 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:20.605395 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 242/483] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:45:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:20.612000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc02ba-c0b0-4bfb-b622-3843952df161 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:20.687792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:20.721569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8752c32-bb35-40ef-9352-a78758550b03 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:20.721861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8752c32-bb35-40ef-9352-a78758550b03 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:20.722424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8752c32-bb35-40ef-9352-a78758550b03 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:20.725354 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 243/484] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:45:20.733347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed3409-ea2a-4318-a1b9-83dbe7549512 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:20.738671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed3409-ea2a-4318-a1b9-83dbe7549512 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:20.739275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed3409-ea2a-4318-a1b9-83dbe7549512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:20.773060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d8ed3409-ea2a-4318-a1b9-83dbe7549512 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:20.775222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d8ed3409-ea2a-4318-a1b9-83dbe7549512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:20.801328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc02ba-c0b0-4bfb-b622-3843952df161 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:20.855430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:20.858785 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 244/485] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:20.878369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed3409-ea2a-4318-a1b9-83dbe7549512 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:20.908475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771ae27-792d-44c9-ab1e-b00549a5eca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:20.909499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771ae27-792d-44c9-ab1e-b00549a5eca9 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:20.909954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771ae27-792d-44c9-ab1e-b00549a5eca9 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:20.910397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771ae27-792d-44c9-ab1e-b00549a5eca9 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:20.911523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771ae27-792d-44c9-ab1e-b00549a5eca9 None admin] RBAC: Adding query filter params (name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:20.912086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771ae27-792d-44c9-ab1e-b00549a5eca9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:20.913754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771ae27-792d-44c9-ab1e-b00549a5eca9 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:20.927998 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 242/486] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Jul 16 20:45:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:20.929840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c9850-6a59-4916-9c54-6a14db9895cb None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:20.929840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c9850-6a59-4916-9c54-6a14db9895cb None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:20.930037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c9850-6a59-4916-9c54-6a14db9895cb None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:20.936668 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 243/487] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:20.937559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c9850-6a59-4916-9c54-6a14db9895cb None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:20.990024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed3409-ea2a-4318-a1b9-83dbe7549512 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:21.031082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d5649-f347-48eb-9a68-45434212bec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:21.031810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d5649-f347-48eb-9a68-45434212bec3 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:21.032094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d5649-f347-48eb-9a68-45434212bec3 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:21.032373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d5649-f347-48eb-9a68-45434212bec3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:21.044810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d5649-f347-48eb-9a68-45434212bec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:21.052762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c9850-6a59-4916-9c54-6a14db9895cb None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:21.057056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:21.059156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-b64d5649-f347-48eb-9a68-45434212bec3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:21.059156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:21.059156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:21.059156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:21.059156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:21.059156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:21.059156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:21.059156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:21.059156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:21.059156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:21.059156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:21.059156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:21.059156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:21.059156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:21.059156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:21.059156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:21.060035 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:21.060035 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:21.060035 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:21.060035 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:21.060035 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:21.060035 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:21.060035 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:21.060035 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:21.060035 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:21.060035 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:21.060035 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:21.060035 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:21.060035 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:21.060035 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:21.060035 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:21.060035 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:21.060836 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:21.060836 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:21.060836 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:21.060836 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:21.060836 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:21.060836 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:21.060836 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:21.060836 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:21.060836 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:21.060836 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:21.060836 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:21.060836 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:21.068212 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 245/488] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:45:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:45:21.070048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c68dce-5f9d-458e-82c0-0304f71c1f76 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:21.070547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c68dce-5f9d-458e-82c0-0304f71c1f76 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:21.071140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c68dce-5f9d-458e-82c0-0304f71c1f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:21.092471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772088b-096c-4c13-91a6-79444f2b4845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:21.093368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772088b-096c-4c13-91a6-79444f2b4845 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:21.093624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b0c68dce-5f9d-458e-82c0-0304f71c1f76 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:21.093749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772088b-096c-4c13-91a6-79444f2b4845 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:21.093915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772088b-096c-4c13-91a6-79444f2b4845 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:21.095605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b0c68dce-5f9d-458e-82c0-0304f71c1f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:21.105739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772088b-096c-4c13-91a6-79444f2b4845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:21.107905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772088b-096c-4c13-91a6-79444f2b4845 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:21.128030 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-a772088b-096c-4c13-91a6-79444f2b4845 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:21.128030 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:21.128030 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:21.128030 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:21.128030 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:21.128030 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:21.128030 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:21.128030 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:21.128030 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:21.128030 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:21.128030 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:21.128030 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:21.128030 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:21.128030 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:21.128030 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:21.134880 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:21.134880 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:21.134880 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:21.134880 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:21.134880 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:21.134880 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:21.134880 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:21.134880 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:21.134880 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:21.134880 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:21.134880 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:21.134880 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:21.134880 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:21.134880 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:21.134880 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:21.134880 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:21.134880 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:21.135758 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:21.135758 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:21.135758 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:21.135758 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:21.135758 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 244/489] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:21.136021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772088b-096c-4c13-91a6-79444f2b4845 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:21.167172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:21.195788 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 246/490] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:21.197023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c68dce-5f9d-458e-82c0-0304f71c1f76 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:21.279166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772088b-096c-4c13-91a6-79444f2b4845 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:21.336112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c68dce-5f9d-458e-82c0-0304f71c1f76 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:21.338624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc590f-664c-40cc-b786-97f577343a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:21.341233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc590f-664c-40cc-b786-97f577343a3a None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:21.341233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc590f-664c-40cc-b786-97f577343a3a None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:21.341233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc590f-664c-40cc-b786-97f577343a3a None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:21.341775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc590f-664c-40cc-b786-97f577343a3a None admin] RBAC: Adding query filter params (name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:21.342538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc590f-664c-40cc-b786-97f577343a3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:21.344202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc590f-664c-40cc-b786-97f577343a3a None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:21.353553 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 245/491] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Jul 16 20:45:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:21.354724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc590f-664c-40cc-b786-97f577343a3a None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:21.376792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:21.378077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689b8c5-c4fb-4c8f-8595-c754c823d4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:21.378751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689b8c5-c4fb-4c8f-8595-c754c823d4af None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:21.379152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689b8c5-c4fb-4c8f-8595-c754c823d4af None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:21.379502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689b8c5-c4fb-4c8f-8595-c754c823d4af None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:21.380317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689b8c5-c4fb-4c8f-8595-c754c823d4af None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:21.380695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689b8c5-c4fb-4c8f-8595-c754c823d4af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:21.382511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689b8c5-c4fb-4c8f-8595-c754c823d4af None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:21.396699 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 247/492] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:21.396883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689b8c5-c4fb-4c8f-8595-c754c823d4af None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:21.460565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:21.469949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc590f-664c-40cc-b786-97f577343a3a None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:21.508613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc189b6-d00b-435d-84e9-b56b7b94c1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:21.509797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc189b6-d00b-435d-84e9-b56b7b94c1b0 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:21.510460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc189b6-d00b-435d-84e9-b56b7b94c1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:21.510933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc189b6-d00b-435d-84e9-b56b7b94c1b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:21.523730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc189b6-d00b-435d-84e9-b56b7b94c1b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:21.523918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689b8c5-c4fb-4c8f-8595-c754c823d4af None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:21.532524 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-ebc189b6-d00b-435d-84e9-b56b7b94c1b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:21.532524 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:21.532524 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:21.532524 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:21.532524 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:21.532524 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:21.532524 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:21.532524 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:21.532524 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:21.532524 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:21.532524 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:21.532524 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:21.532524 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:21.532524 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:21.532524 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:21.532524 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:21.533883 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:21.533883 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:21.533883 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:21.533883 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:21.533883 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:21.533883 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:21.533883 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:21.533883 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:21.533883 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:21.533883 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:21.533883 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:21.533883 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:21.533883 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:21.533883 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:21.533883 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:21.533883 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:21.534659 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:21.534659 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:21.534659 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:21.534659 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:21.534659 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:21.534659 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:21.534659 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:21.534659 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:21.534659 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:21.534659 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:21.534659 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:21.534659 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:21.536820 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 246/493] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:45:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:21.538089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc189b6-d00b-435d-84e9-b56b7b94c1b0 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:21.564537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fe6cb-0f67-455d-878d-a5eb7f8ddcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:21.566610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fe6cb-0f67-455d-878d-a5eb7f8ddcce None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:21.566610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fe6cb-0f67-455d-878d-a5eb7f8ddcce None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:21.566610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fe6cb-0f67-455d-878d-a5eb7f8ddcce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:21.578601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862fe6cb-0f67-455d-878d-a5eb7f8ddcce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:21.580086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862fe6cb-0f67-455d-878d-a5eb7f8ddcce None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:21.604748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-862fe6cb-0f67-455d-878d-a5eb7f8ddcce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:21.604748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:21.604748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:21.604748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:21.604748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:21.604748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:21.604748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:21.604748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:21.604748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:21.604748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:21.604748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:21.604748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:21.604748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:21.604748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:21.604748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:21.605651 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:21.605651 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:21.605651 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:21.605651 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:21.605651 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:21.605651 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:21.605651 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:21.605651 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:21.605651 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:21.605651 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:21.605651 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:21.605651 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:21.605651 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:21.605651 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:21.605651 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:21.605651 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:21.605651 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:21.607296 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:21.607296 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:21.607296 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:21.607296 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:21.607296 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 248/494] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:21.608628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fe6cb-0f67-455d-878d-a5eb7f8ddcce None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:21.636266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:21.664036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc189b6-d00b-435d-84e9-b56b7b94c1b0 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:21.703860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226aa6f1-45b0-4e45-9138-470260af7475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:21.704992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aa6f1-45b0-4e45-9138-470260af7475 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:21.705479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aa6f1-45b0-4e45-9138-470260af7475 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:21.705964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aa6f1-45b0-4e45-9138-470260af7475 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:21.715160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226aa6f1-45b0-4e45-9138-470260af7475 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:21.716991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226aa6f1-45b0-4e45-9138-470260af7475 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:21.725451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:21.730189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fe6cb-0f67-455d-878d-a5eb7f8ddcce None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:21.734669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-226aa6f1-45b0-4e45-9138-470260af7475 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 16 20:45:21.734669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:21.734669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:21.734669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:21.734669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:21.734669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:21.734669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:21.734669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:21.734669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:21.734669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:21.734669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:21.734669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:21.734669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:45:21.734669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:45:21.734669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:45:21.734669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:45:21.740609 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:21.740609 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:21.740609 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:45:21.740609 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:21.740609 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:45:21.740609 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:21.740609 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:21.740609 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:21.740609 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:21.740609 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:21.740609 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:21.740609 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:21.740609 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:21.740609 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:21.740609 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:21.740609 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:21.740609 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:21.740609 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:21.741496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:21.741496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:21.741496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:45:21.741496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:45:21.741496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:45:21.741496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:45:21.741496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:45:21.741496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:45:21.741496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 16 20:45:21.741496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:21.741496 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 247/495] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Jul 16 20:45:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:21.741496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226aa6f1-45b0-4e45-9138-470260af7475 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:21.774565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd86593-befc-4122-aae1-6a66cb8f9656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:21.775540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd86593-befc-4122-aae1-6a66cb8f9656 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:21.776216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd86593-befc-4122-aae1-6a66cb8f9656 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:21.776393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd86593-befc-4122-aae1-6a66cb8f9656 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:21.777242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd86593-befc-4122-aae1-6a66cb8f9656 None admin] RBAC: Adding query filter params (name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:21.777615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd86593-befc-4122-aae1-6a66cb8f9656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:21.779736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd86593-befc-4122-aae1-6a66cb8f9656 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:21.788972 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 249/496] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Jul 16 20:45:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:21.789825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd86593-befc-4122-aae1-6a66cb8f9656 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:21.852531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226aa6f1-45b0-4e45-9138-470260af7475 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:21.892266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92b142-6c4e-418c-b60b-c44a54f31cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:21.892922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92b142-6c4e-418c-b60b-c44a54f31cc9 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:21.893204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92b142-6c4e-418c-b60b-c44a54f31cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:21.893477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92b142-6c4e-418c-b60b-c44a54f31cc9 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:21.894240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92b142-6c4e-418c-b60b-c44a54f31cc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:21.894523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd86593-befc-4122-aae1-6a66cb8f9656 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:21.894617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92b142-6c4e-418c-b60b-c44a54f31cc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:21.895971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92b142-6c4e-418c-b60b-c44a54f31cc9 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:21.905040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:21.910299 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 248/497] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:21.914987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4fcbf-cbe8-4b10-8643-3949c1534b15 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:21.914987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4fcbf-cbe8-4b10-8643-3949c1534b15 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:21.914987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4fcbf-cbe8-4b10-8643-3949c1534b15 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:21.914987 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 249/498] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:21.914987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4fcbf-cbe8-4b10-8643-3949c1534b15 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:21.930579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ea0de-f3d5-4819-a455-270790546d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:21.931281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ea0de-f3d5-4819-a455-270790546d6f None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:21.931561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ea0de-f3d5-4819-a455-270790546d6f None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:21.931835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ea0de-f3d5-4819-a455-270790546d6f None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:21.932676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ea0de-f3d5-4819-a455-270790546d6f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:21.932984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ea0de-f3d5-4819-a455-270790546d6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:21.934781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ea0de-f3d5-4819-a455-270790546d6f None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:21.974399 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 250/499] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Jul 16 20:45:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:21.975764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e8ccf-deb6-45b1-8ddb-d2bd7c48a6d1 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:21.976053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e8ccf-deb6-45b1-8ddb-d2bd7c48a6d1 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:21.976337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e8ccf-deb6-45b1-8ddb-d2bd7c48a6d1 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:21.977738 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 251/500] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:21.978610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cdc8a-86bd-424c-bbc5-477616a957f4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:21.978957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cdc8a-86bd-424c-bbc5-477616a957f4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:21.979381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cdc8a-86bd-424c-bbc5-477616a957f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:21.995671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-868cdc8a-86bd-424c-bbc5-477616a957f4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:21.996938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-868cdc8a-86bd-424c-bbc5-477616a957f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:22.010616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:22.026783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4fcbf-cbe8-4b10-8643-3949c1534b15 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:22.062510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211ce66-0415-413a-9f00-828223178349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:22.063325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211ce66-0415-413a-9f00-828223178349 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:22.063609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211ce66-0415-413a-9f00-828223178349 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:22.063879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211ce66-0415-413a-9f00-828223178349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:22.066897 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 252/501] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:22.067767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cdc8a-86bd-424c-bbc5-477616a957f4 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:22.082351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211ce66-0415-413a-9f00-828223178349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:22.083989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211ce66-0415-413a-9f00-828223178349 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:22.103444 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-e211ce66-0415-413a-9f00-828223178349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:22.103444 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:22.103444 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:22.103444 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:22.103444 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:22.103444 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:22.103444 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:22.103444 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:22.103444 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:22.103444 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:22.103444 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:22.103444 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:22.103444 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:22.103444 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:22.103444 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:22.104394 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:22.104394 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:22.104394 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:22.104394 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:22.104394 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:22.104394 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:22.104394 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:22.104394 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:22.104394 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:22.104394 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:22.104394 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:22.104394 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:22.104394 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:22.104394 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:22.104394 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:22.104394 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:22.104394 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:22.105491 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:22.105491 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:22.105491 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:22.105491 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:22.105491 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 250/502] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:22.105491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211ce66-0415-413a-9f00-828223178349 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:22.159726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:22.179451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cdc8a-86bd-424c-bbc5-477616a957f4 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:22.210854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211ce66-0415-413a-9f00-828223178349 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:22.215536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a371c62-46d6-4aaa-9f48-28cb40e68d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:22.216374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a371c62-46d6-4aaa-9f48-28cb40e68d0b None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:22.216657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a371c62-46d6-4aaa-9f48-28cb40e68d0b None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:22.216932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a371c62-46d6-4aaa-9f48-28cb40e68d0b None admin] PATH_INFO: `/v3/users/glance` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:22.224392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a371c62-46d6-4aaa-9f48-28cb40e68d0b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:22.225853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a371c62-46d6-4aaa-9f48-28cb40e68d0b None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:22.242512 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-2a371c62-46d6-4aaa-9f48-28cb40e68d0b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 16 20:45:22.242512 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:22.242512 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:22.242512 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:22.242512 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:22.242512 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:22.242512 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:22.242512 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:22.242512 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:22.242512 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:22.242512 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:22.242512 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:22.242512 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:45:22.242512 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:45:22.242512 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:45:22.242512 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:45:22.243615 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:22.243615 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:22.243615 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:45:22.243615 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:22.243615 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:45:22.243615 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:22.243615 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:22.243615 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:22.243615 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:22.243615 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:22.243615 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:22.243615 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:22.243615 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:22.243615 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:22.243615 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:22.243615 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:22.243615 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:22.243615 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:22.244536 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:22.244536 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:22.244536 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:45:22.244536 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:45:22.244536 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:45:22.244536 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:45:22.244536 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:45:22.244536 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:45:22.244536 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 16 20:45:22.244536 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:22.244536 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 253/503] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:45:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:22.245557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dccacb-5895-4938-aa03-3d1974d3ce1b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:22.245557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dccacb-5895-4938-aa03-3d1974d3ce1b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:22.245710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dccacb-5895-4938-aa03-3d1974d3ce1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:22.250123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027d5e8-b8fe-4f94-ad9b-be79ab3e94be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:22.250869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027d5e8-b8fe-4f94-ad9b-be79ab3e94be None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:22.251173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027d5e8-b8fe-4f94-ad9b-be79ab3e94be None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:22.251450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027d5e8-b8fe-4f94-ad9b-be79ab3e94be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:22.265000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-69dccacb-5895-4938-aa03-3d1974d3ce1b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:22.266523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-69dccacb-5895-4938-aa03-3d1974d3ce1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:22.269337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:22.324104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027d5e8-b8fe-4f94-ad9b-be79ab3e94be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:22.326192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027d5e8-b8fe-4f94-ad9b-be79ab3e94be None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:22.341300 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 254/504] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:22.342286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dccacb-5895-4938-aa03-3d1974d3ce1b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:22.380683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:22.436030 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 251/505] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:45:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:45:22.436807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027d5e8-b8fe-4f94-ad9b-be79ab3e94be None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:22.450775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dccacb-5895-4938-aa03-3d1974d3ce1b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:22.485602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527d2b8-3faa-4fee-9ab6-38a33d441cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:22.486390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527d2b8-3faa-4fee-9ab6-38a33d441cd0 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:22.486670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527d2b8-3faa-4fee-9ab6-38a33d441cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:22.486954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527d2b8-3faa-4fee-9ab6-38a33d441cd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:22.493794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:22.498424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527d2b8-3faa-4fee-9ab6-38a33d441cd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:22.499930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527d2b8-3faa-4fee-9ab6-38a33d441cd0 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:22.517872 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-f527d2b8-3faa-4fee-9ab6-38a33d441cd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:22.517872 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:22.517872 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:22.517872 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:22.517872 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:22.517872 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:22.517872 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:22.517872 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:22.517872 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:22.517872 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:22.517872 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:22.517872 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:22.517872 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:22.517872 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:22.517872 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:22.518815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:22.518815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:22.518815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:22.518815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:22.518815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:22.518815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:22.518815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:22.518815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:22.518815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:22.518815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:22.518815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:22.518815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:22.518815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:22.518815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:22.518815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:22.518815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:22.518815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:22.519850 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:22.519850 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:22.519850 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:22.519850 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:22.519850 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 255/506] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:22.520110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527d2b8-3faa-4fee-9ab6-38a33d441cd0 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:22.539634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027d5e8-b8fe-4f94-ad9b-be79ab3e94be None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:22.577145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f59bb2-3c34-4dfc-8e58-824029f31671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:22.577848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f59bb2-3c34-4dfc-8e58-824029f31671 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:22.578164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f59bb2-3c34-4dfc-8e58-824029f31671 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:22.578471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f59bb2-3c34-4dfc-8e58-824029f31671 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:22.579265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f59bb2-3c34-4dfc-8e58-824029f31671 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:22.579592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f59bb2-3c34-4dfc-8e58-824029f31671 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:22.580997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f59bb2-3c34-4dfc-8e58-824029f31671 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:22.593332 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 252/507] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:22.599183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f59bb2-3c34-4dfc-8e58-824029f31671 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:22.607921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:22.626466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527d2b8-3faa-4fee-9ab6-38a33d441cd0 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:22.662286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d4f7b-773c-4067-a207-b402ed682344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:22.662940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d4f7b-773c-4067-a207-b402ed682344 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:22.663255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d4f7b-773c-4067-a207-b402ed682344 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:22.663525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d4f7b-773c-4067-a207-b402ed682344 None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:22.664346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d4f7b-773c-4067-a207-b402ed682344 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:22.664652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d4f7b-773c-4067-a207-b402ed682344 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:22.666055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d4f7b-773c-4067-a207-b402ed682344 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:22.684160 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 256/508] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Jul 16 20:45:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:22.685686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d4f7b-773c-4067-a207-b402ed682344 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:22.701801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f59bb2-3c34-4dfc-8e58-824029f31671 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:22.736506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:22.738523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ab119-de58-4be6-bf0d-73bb288badff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:22.739340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ab119-de58-4be6-bf0d-73bb288badff None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:22.739616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ab119-de58-4be6-bf0d-73bb288badff None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:22.739885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ab119-de58-4be6-bf0d-73bb288badff None admin] PATH_INFO: `/v3/roles/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:22.751384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ab119-de58-4be6-bf0d-73bb288badff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:22.759049 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-4d1ab119-de58-4be6-bf0d-73bb288badff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:22.759049 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:22.759049 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:22.759049 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:22.759049 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:22.759049 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:22.759049 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:22.759049 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:22.759049 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:22.759049 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:22.759049 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:22.759049 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:22.759049 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:22.759049 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:22.759049 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:22.759049 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:22.762320 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:22.762320 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:22.762320 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:22.762320 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:22.762320 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:22.762320 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:22.762320 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:22.762320 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:22.762320 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:22.762320 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:22.762320 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:22.762320 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:22.762320 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:22.762320 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:22.762320 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:22.762320 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:22.763196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:22.763196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:22.763196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:22.763196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:22.763196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:22.763196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:22.763196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:22.763196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:22.763196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:22.763196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:22.763196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:22.763196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:22.763196 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 253/509] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:45:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:22.763196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ab119-de58-4be6-bf0d-73bb288badff None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:22.790078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d4f7b-773c-4067-a207-b402ed682344 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:22.830213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efcb96-3148-4754-8db8-0c452362d25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:22.831221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efcb96-3148-4754-8db8-0c452362d25a None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:22.831505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efcb96-3148-4754-8db8-0c452362d25a None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:22.831779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efcb96-3148-4754-8db8-0c452362d25a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:22.843862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efcb96-3148-4754-8db8-0c452362d25a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:22.845338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efcb96-3148-4754-8db8-0c452362d25a None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:22.850944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:22.864449 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-22efcb96-3148-4754-8db8-0c452362d25a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:22.864449 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:22.864449 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:22.864449 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:22.864449 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:22.864449 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:22.864449 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:22.864449 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:22.864449 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:22.864449 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:22.864449 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:22.864449 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:22.864449 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:22.864449 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:22.864449 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:22.865444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:22.865444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:22.865444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:22.865444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:22.865444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:22.865444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:22.865444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:22.865444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:22.865444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:22.865444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:22.865444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:22.865444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:22.865444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:22.865444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:22.865444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:22.865444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:22.865444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:22.866355 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:22.866355 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:22.866355 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:22.866355 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:22.866355 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 257/510] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:22.866613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efcb96-3148-4754-8db8-0c452362d25a None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:22.888314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ab119-de58-4be6-bf0d-73bb288badff None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:22.926029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5368cb-236b-474c-a54e-d4c4f84a09d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:22.926687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5368cb-236b-474c-a54e-d4c4f84a09d1 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:22.926966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5368cb-236b-474c-a54e-d4c4f84a09d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:22.927287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5368cb-236b-474c-a54e-d4c4f84a09d1 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:22.928007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5368cb-236b-474c-a54e-d4c4f84a09d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:22.928310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5368cb-236b-474c-a54e-d4c4f84a09d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:22.929692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5368cb-236b-474c-a54e-d4c4f84a09d1 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:22.942818 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 254/511] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:22.943713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5368cb-236b-474c-a54e-d4c4f84a09d1 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:22.969403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:22.972336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efcb96-3148-4754-8db8-0c452362d25a None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:23.007465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb14311-11bb-4c79-a69a-7df2fc2f2b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:23.008266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb14311-11bb-4c79-a69a-7df2fc2f2b28 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:23.008573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb14311-11bb-4c79-a69a-7df2fc2f2b28 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:23.008844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb14311-11bb-4c79-a69a-7df2fc2f2b28 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:23.016340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb14311-11bb-4c79-a69a-7df2fc2f2b28 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:23.017891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb14311-11bb-4c79-a69a-7df2fc2f2b28 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:23.033479 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-3eb14311-11bb-4c79-a69a-7df2fc2f2b28 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 16 20:45:23.033479 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:23.033479 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:23.033479 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:23.033479 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:23.033479 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:23.033479 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:23.033479 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:23.033479 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:23.033479 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:23.033479 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:23.033479 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:23.033479 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:45:23.033479 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:45:23.033479 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:45:23.033479 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:45:23.034483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:23.034483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:23.034483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:45:23.034483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:23.034483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:45:23.034483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:23.034483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:23.034483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:23.034483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:23.034483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:23.034483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:23.034483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:23.034483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:23.034483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:23.034483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:23.034483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:23.034483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:23.034483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:23.035680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:23.035680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:23.035680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:45:23.035680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:45:23.035680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:45:23.035680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:45:23.035680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:45:23.035680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:45:23.035680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 16 20:45:23.035680 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:23.035680 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 258/512] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:45:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:23.035680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb14311-11bb-4c79-a69a-7df2fc2f2b28 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:23.049097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5368cb-236b-474c-a54e-d4c4f84a09d1 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:23.083768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:23.090626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9794a8-d45a-4e4a-934f-5f69db24bcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:23.096873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9794a8-d45a-4e4a-934f-5f69db24bcf0 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:23.096873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9794a8-d45a-4e4a-934f-5f69db24bcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:23.096873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9794a8-d45a-4e4a-934f-5f69db24bcf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:23.143878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb14311-11bb-4c79-a69a-7df2fc2f2b28 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:23.161391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9794a8-d45a-4e4a-934f-5f69db24bcf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:23.163445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9794a8-d45a-4e4a-934f-5f69db24bcf0 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:23.179439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c167da8-86cb-4995-9c10-e58a9e29de17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:23.180106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c167da8-86cb-4995-9c10-e58a9e29de17 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:23.180649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c167da8-86cb-4995-9c10-e58a9e29de17 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:23.180649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c167da8-86cb-4995-9c10-e58a9e29de17 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:23.181378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c167da8-86cb-4995-9c10-e58a9e29de17 None admin] RBAC: Adding query filter params (name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:23.181682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c167da8-86cb-4995-9c10-e58a9e29de17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:23.183082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c167da8-86cb-4995-9c10-e58a9e29de17 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:23.192263 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 259/513] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Jul 16 20:45:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:23.193089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c167da8-86cb-4995-9c10-e58a9e29de17 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:23.220564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:23.271605 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 255/514] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:45:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:45:23.272869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9794a8-d45a-4e4a-934f-5f69db24bcf0 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:23.299133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c167da8-86cb-4995-9c10-e58a9e29de17 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:23.305437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:23.335983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fdeec-9859-4238-a4db-97bddac41a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:23.336650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fdeec-9859-4238-a4db-97bddac41a63 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:23.336951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fdeec-9859-4238-a4db-97bddac41a63 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:23.337195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fdeec-9859-4238-a4db-97bddac41a63 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:23.337915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fdeec-9859-4238-a4db-97bddac41a63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:23.338219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fdeec-9859-4238-a4db-97bddac41a63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:23.339624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fdeec-9859-4238-a4db-97bddac41a63 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:23.353088 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 260/515] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:23.353919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fdeec-9859-4238-a4db-97bddac41a63 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:23.377382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9794a8-d45a-4e4a-934f-5f69db24bcf0 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:23.412805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890a678-b372-4f80-ab26-016c8500b560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:23.413471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890a678-b372-4f80-ab26-016c8500b560 None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:23.413751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890a678-b372-4f80-ab26-016c8500b560 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:23.414025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890a678-b372-4f80-ab26-016c8500b560 None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:23.414716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890a678-b372-4f80-ab26-016c8500b560 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:23.416195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890a678-b372-4f80-ab26-016c8500b560 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:23.442633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:23.461066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fdeec-9859-4238-a4db-97bddac41a63 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:23.502954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369adbe-8148-40e0-ab04-f706e80dc51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:23.503582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369adbe-8148-40e0-ab04-f706e80dc51d None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:23.503861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369adbe-8148-40e0-ab04-f706e80dc51d None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:23.504130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369adbe-8148-40e0-ab04-f706e80dc51d None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:23.505024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369adbe-8148-40e0-ab04-f706e80dc51d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:23.505329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369adbe-8148-40e0-ab04-f706e80dc51d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:23.506812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369adbe-8148-40e0-ab04-f706e80dc51d None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:23.526978 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 261/516] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Jul 16 20:45:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:23.527876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369adbe-8148-40e0-ab04-f706e80dc51d None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:23.538685 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 256/517] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Jul 16 20:45:23 2022] POST /identity/v3/users => generated 247 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:45:23.541135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890a678-b372-4f80-ab26-016c8500b560 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:23.656721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:23.675512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890a678-b372-4f80-ab26-016c8500b560 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:23.676861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369adbe-8148-40e0-ab04-f706e80dc51d None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:23.725651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62139445-2cee-4e97-9560-9123c3b36667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:23.727178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62139445-2cee-4e97-9560-9123c3b36667 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:23.727465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62139445-2cee-4e97-9560-9123c3b36667 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:23.727730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62139445-2cee-4e97-9560-9123c3b36667 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:23.735875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19411184-33f2-4833-b60a-9a5c570619fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:23.749800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19411184-33f2-4833-b60a-9a5c570619fb None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:23.749800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19411184-33f2-4833-b60a-9a5c570619fb None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:23.750147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:23.750281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19411184-33f2-4833-b60a-9a5c570619fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:23.750422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62139445-2cee-4e97-9560-9123c3b36667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:23.750422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62139445-2cee-4e97-9560-9123c3b36667 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:23.754249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19411184-33f2-4833-b60a-9a5c570619fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:23.756569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19411184-33f2-4833-b60a-9a5c570619fb None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:23.766162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-62139445-2cee-4e97-9560-9123c3b36667 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:23.766162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:23.766162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:23.766162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:23.766162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:23.766162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:23.766162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:23.766162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:23.766162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:23.766162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:23.766162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:23.766162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:23.766162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:23.766162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:23.766162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:23.767716 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:23.767716 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:23.767716 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:23.767716 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:23.767716 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:23.767716 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:23.767716 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:23.767716 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:23.767716 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:23.767716 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:23.767716 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:23.767716 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:23.767716 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:23.767716 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:23.767716 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:23.767716 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:23.767716 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:23.770581 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:23.770581 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:23.770581 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:23.770581 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:23.770581 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 262/518] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:23.770581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62139445-2cee-4e97-9560-9123c3b36667 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:23.784799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-19411184-33f2-4833-b60a-9a5c570619fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:23.784799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:23.784799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:23.784799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:23.784799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:23.784799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:23.784799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:23.784799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:23.784799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:23.784799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:23.784799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:23.784799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:23.784799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:23.784799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:23.784799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:23.790180 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:23.790180 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:23.790180 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:23.790180 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:23.790180 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:23.790180 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:23.790180 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:23.790180 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:23.790180 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:23.790180 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:23.790180 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:23.790180 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:23.790180 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:23.790180 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:23.790180 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:23.790180 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:23.790180 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:23.790998 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:23.790998 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:23.790998 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:23.790998 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:23.790998 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 257/519] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:23.790998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19411184-33f2-4833-b60a-9a5c570619fb None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:23.915520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62139445-2cee-4e97-9560-9123c3b36667 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:23.938723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19411184-33f2-4833-b60a-9a5c570619fb None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:23.956403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e2c0a-82e6-4c38-bb41-2106c77cff80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:23.957314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e2c0a-82e6-4c38-bb41-2106c77cff80 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:23.957593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e2c0a-82e6-4c38-bb41-2106c77cff80 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:23.957867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e2c0a-82e6-4c38-bb41-2106c77cff80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:23.965719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e2c0a-82e6-4c38-bb41-2106c77cff80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:23.968037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e2c0a-82e6-4c38-bb41-2106c77cff80 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:23.982514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44aae6-df90-49b9-9483-349ff59d4d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:23.983206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44aae6-df90-49b9-9483-349ff59d4d97 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:23.983491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44aae6-df90-49b9-9483-349ff59d4d97 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:23.983772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44aae6-df90-49b9-9483-349ff59d4d97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:23.984401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-722e2c0a-82e6-4c38-bb41-2106c77cff80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:23.984401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:23.984401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:23.984401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:23.984401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:23.984401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:23.984401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:23.984401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:23.984401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:23.984401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:23.984401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:23.984401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:23.984401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:45:23.984401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:45:23.984401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:45:23.985411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:45:23.985411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:23.985411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:23.985411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:23.985411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:23.985411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:23.985411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:23.985411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:23.985411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:23.985411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:23.985411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:23.985411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:23.985411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:23.985411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:23.985411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:23.985411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:23.985411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:23.986501 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:45:23.986501 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:45:23.986501 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:45:23.986501 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:45:23.986501 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:45:23.986501 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:45:23.986501 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:23.986501 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:23.990551 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 263/520] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:23.991658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e2c0a-82e6-4c38-bb41-2106c77cff80 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:23.998821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:24.062270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:24.066835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44aae6-df90-49b9-9483-349ff59d4d97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:24.068364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44aae6-df90-49b9-9483-349ff59d4d97 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:24.121796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e2c0a-82e6-4c38-bb41-2106c77cff80 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:24.162657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc3c33-66a5-4a64-8c2a-d61186730cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:24.163348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc3c33-66a5-4a64-8c2a-d61186730cde None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:24.163630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc3c33-66a5-4a64-8c2a-d61186730cde None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:24.163910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc3c33-66a5-4a64-8c2a-d61186730cde None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:24.164627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc3c33-66a5-4a64-8c2a-d61186730cde None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:24.164934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc3c33-66a5-4a64-8c2a-d61186730cde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:24.166287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc3c33-66a5-4a64-8c2a-d61186730cde None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:24.185626 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 264/521] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:24.185626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc3c33-66a5-4a64-8c2a-d61186730cde None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:24.200661 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 258/522] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:45:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:45:24.200661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44aae6-df90-49b9-9483-349ff59d4d97 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:24.242377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:24.303410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc3c33-66a5-4a64-8c2a-d61186730cde None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:24.312080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44aae6-df90-49b9-9483-349ff59d4d97 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:24.320022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:24.343640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a4887-2985-4679-b10a-49f3840edf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:24.344299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a4887-2985-4679-b10a-49f3840edf31 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:24.344576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a4887-2985-4679-b10a-49f3840edf31 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:24.344865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a4887-2985-4679-b10a-49f3840edf31 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:24.345629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a4887-2985-4679-b10a-49f3840edf31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:24.346005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a4887-2985-4679-b10a-49f3840edf31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:24.347332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a4887-2985-4679-b10a-49f3840edf31 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:24.352442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d9e4d-6804-4a51-b4e5-35d453ca72e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:24.353173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d9e4d-6804-4a51-b4e5-35d453ca72e3 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:24.353533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d9e4d-6804-4a51-b4e5-35d453ca72e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:24.353821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d9e4d-6804-4a51-b4e5-35d453ca72e3 None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:24.354647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d9e4d-6804-4a51-b4e5-35d453ca72e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:24.355265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d9e4d-6804-4a51-b4e5-35d453ca72e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:24.357082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d9e4d-6804-4a51-b4e5-35d453ca72e3 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:24.363539 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 265/523] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:24.367945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a4887-2985-4679-b10a-49f3840edf31 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:24.383114 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 259/524] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:45:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:24.383114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d9e4d-6804-4a51-b4e5-35d453ca72e3 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:24.500635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a4887-2985-4679-b10a-49f3840edf31 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:24.511675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:24.516793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d9e4d-6804-4a51-b4e5-35d453ca72e3 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:24.536703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09c99b-e1f3-44f3-8efb-34f5359d1f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:24.537502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09c99b-e1f3-44f3-8efb-34f5359d1f4c None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:24.537781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09c99b-e1f3-44f3-8efb-34f5359d1f4c None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:24.538052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09c99b-e1f3-44f3-8efb-34f5359d1f4c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:24.546868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09c99b-e1f3-44f3-8efb-34f5359d1f4c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:24.548448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09c99b-e1f3-44f3-8efb-34f5359d1f4c None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:24.552686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac6421-d54d-40bc-9be8-569528e0be2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:24.553493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac6421-d54d-40bc-9be8-569528e0be2d None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:24.553841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac6421-d54d-40bc-9be8-569528e0be2d None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:24.554121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac6421-d54d-40bc-9be8-569528e0be2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:24.567975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac6421-d54d-40bc-9be8-569528e0be2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:24.574598 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-3c09c99b-e1f3-44f3-8efb-34f5359d1f4c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 16 20:45:24.574598 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:24.574598 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:24.574598 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:24.574598 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:24.574598 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:24.574598 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:24.574598 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:24.574598 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:24.574598 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:24.574598 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:24.574598 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:24.574598 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:45:24.574598 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:45:24.574598 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:45:24.574598 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:45:24.576503 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:24.576503 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:24.576503 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:45:24.576503 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:24.576503 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:45:24.576503 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:24.576503 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:24.576503 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:24.576503 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:24.576503 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:24.576503 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:24.576503 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:24.576503 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:24.576503 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:24.576503 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:24.576503 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:24.576503 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:24.576503 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:24.577394 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:24.577394 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:24.577394 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:45:24.577394 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:45:24.577394 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:45:24.577394 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:45:24.577394 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:45:24.577394 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:45:24.577394 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 16 20:45:24.577394 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:24.577983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac6421-d54d-40bc-9be8-569528e0be2d None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:24.578053 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 266/525] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:45:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:24.578053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09c99b-e1f3-44f3-8efb-34f5359d1f4c None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:24.597098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-a6ac6421-d54d-40bc-9be8-569528e0be2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:24.597098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:24.597098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:24.597098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:24.597098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:24.597098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:24.597098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:24.597098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:24.597098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:24.597098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:24.597098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:24.597098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:24.597098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:24.597098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:24.597098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:24.598042 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:24.598042 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:24.598042 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:24.598042 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:24.598042 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:24.598042 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:24.598042 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:24.598042 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:24.598042 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:24.598042 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:24.598042 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:24.598042 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:24.598042 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:24.598042 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:24.598042 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:24.598042 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:24.598042 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:24.598874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:24.598874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:24.598874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:24.598874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:24.598874 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 260/526] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:24.599832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac6421-d54d-40bc-9be8-569528e0be2d None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:24.619982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:24.714269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09c99b-e1f3-44f3-8efb-34f5359d1f4c None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:24.734029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac6421-d54d-40bc-9be8-569528e0be2d None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:24.754222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97615a76-e279-48b2-9436-68786edacfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:24.755032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97615a76-e279-48b2-9436-68786edacfba None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:24.755333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97615a76-e279-48b2-9436-68786edacfba None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:24.755675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97615a76-e279-48b2-9436-68786edacfba None admin] PATH_INFO: `/v3/projects/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:24.763969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97615a76-e279-48b2-9436-68786edacfba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:24.765473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97615a76-e279-48b2-9436-68786edacfba None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:24.781393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de12de3-a726-45e0-b510-ed6e3809df01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:24.782117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de12de3-a726-45e0-b510-ed6e3809df01 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:24.782225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-97615a76-e279-48b2-9436-68786edacfba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:24.782225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:24.782225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:24.782225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:24.782225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:24.782225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:24.782225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:24.782225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:24.782225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:24.782225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:24.782225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:24.782225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:24.782225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:45:24.782225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:45:24.782225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:45:24.783414 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:45:24.783414 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:24.783414 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:24.783414 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:24.783414 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:24.783414 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:24.783414 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:24.783414 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:24.783414 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:24.783414 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:24.783414 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:24.783414 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:24.783414 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:24.783414 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:24.783414 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:24.783414 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:24.783414 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:24.784366 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:45:24.784366 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:45:24.784366 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:45:24.784366 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:45:24.784366 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:45:24.784366 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:45:24.784366 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:24.784366 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:24.784820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de12de3-a726-45e0-b510-ed6e3809df01 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:24.784820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de12de3-a726-45e0-b510-ed6e3809df01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:24.784820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de12de3-a726-45e0-b510-ed6e3809df01 None admin] RBAC: Adding query filter params (role.id=99a4e0ec120f4163a419b2775afb8a41, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=d5f515bfe2094b41afe82b4bc57e4b9a) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:24.784820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de12de3-a726-45e0-b510-ed6e3809df01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:24.785502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de12de3-a726-45e0-b510-ed6e3809df01 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:24.788411 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 267/527] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:24.789392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97615a76-e279-48b2-9436-68786edacfba None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:24.792287 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 261/528] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:45:24 2022] GET /identity/v3/role_assignments?user.id=d5f515bfe2094b41afe82b4bc57e4b9a&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=99a4e0ec120f4163a419b2775afb8a41 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:24.793229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de12de3-a726-45e0-b510-ed6e3809df01 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:24.826445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:24.948169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:24.958996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97615a76-e279-48b2-9436-68786edacfba None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:24.961139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de12de3-a726-45e0-b510-ed6e3809df01 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:25.008527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fa899-3cd9-41d8-9e4a-13b81fcd3336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:25.009510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fa899-3cd9-41d8-9e4a-13b81fcd3336 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:25.009904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fa899-3cd9-41d8-9e4a-13b81fcd3336 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:25.010470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fa899-3cd9-41d8-9e4a-13b81fcd3336 None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:25.011601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fa899-3cd9-41d8-9e4a-13b81fcd3336 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:25.011921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fa899-3cd9-41d8-9e4a-13b81fcd3336 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:25.014303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fa899-3cd9-41d8-9e4a-13b81fcd3336 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:25.018737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8708ba-cd3c-48b8-9bba-864c6e29b74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:25.019691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8708ba-cd3c-48b8-9bba-864c6e29b74b None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:25.020111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8708ba-cd3c-48b8-9bba-864c6e29b74b None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:25.020539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8708ba-cd3c-48b8-9bba-864c6e29b74b None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:25.021470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8708ba-cd3c-48b8-9bba-864c6e29b74b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:25.021929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8708ba-cd3c-48b8-9bba-864c6e29b74b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:25.023506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8708ba-cd3c-48b8-9bba-864c6e29b74b None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:25.041718 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 262/529] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:25.042597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8708ba-cd3c-48b8-9bba-864c6e29b74b None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:25.049182 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 268/530] 10.222.0.16 () {56 vars in 1139 bytes} [Sat Jul 16 20:45:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:25.050182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fa899-3cd9-41d8-9e4a-13b81fcd3336 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:25.127669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:25.156660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8708ba-cd3c-48b8-9bba-864c6e29b74b None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:25.160883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fa899-3cd9-41d8-9e4a-13b81fcd3336 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:25.197593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48904243-5464-4c41-be22-93be595fefa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:25.198005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48904243-5464-4c41-be22-93be595fefa3 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:25.198169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48904243-5464-4c41-be22-93be595fefa3 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:25.198438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48904243-5464-4c41-be22-93be595fefa3 None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:25.199297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48904243-5464-4c41-be22-93be595fefa3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:25.199613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48904243-5464-4c41-be22-93be595fefa3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:25.201171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48904243-5464-4c41-be22-93be595fefa3 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:25.201365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e26a99-7c95-4291-9db3-2e55c2eb04e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:25.202055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e26a99-7c95-4291-9db3-2e55c2eb04e5 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:25.202406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e26a99-7c95-4291-9db3-2e55c2eb04e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:25.202682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e26a99-7c95-4291-9db3-2e55c2eb04e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:25.210744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e26a99-7c95-4291-9db3-2e55c2eb04e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:25.212381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e26a99-7c95-4291-9db3-2e55c2eb04e5 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:25.217813 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 263/531] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:45:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:25.218305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48904243-5464-4c41-be22-93be595fefa3 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:25.229057 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-57e26a99-7c95-4291-9db3-2e55c2eb04e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:25.229057 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:25.229057 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:25.229057 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:25.229057 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:25.229057 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:25.229057 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:25.229057 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:25.229057 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:25.229057 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:25.229057 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:25.229057 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:25.229057 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:45:25.229057 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:45:25.229057 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:45:25.232660 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:45:25.232660 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:25.232660 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:25.232660 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:25.232660 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:25.232660 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:25.232660 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:25.232660 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:25.232660 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:25.232660 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:25.232660 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:25.232660 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:25.232660 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:25.232660 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:25.232660 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:25.232660 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:25.232660 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:25.234051 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:45:25.234051 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:45:25.234051 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:45:25.234051 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:45:25.234051 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:45:25.234051 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:45:25.234051 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:25.234051 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:25.234051 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 269/532] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:25.234051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e26a99-7c95-4291-9db3-2e55c2eb04e5 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:25.251111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:25.358514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48904243-5464-4c41-be22-93be595fefa3 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:25.387832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e26a99-7c95-4291-9db3-2e55c2eb04e5 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:25.408280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e794210-039f-42ef-a31a-2d18c8070100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:25.409094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e794210-039f-42ef-a31a-2d18c8070100 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:25.409449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e794210-039f-42ef-a31a-2d18c8070100 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:25.409798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e794210-039f-42ef-a31a-2d18c8070100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:25.413308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:25.431596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ff2fb-a505-434a-8bee-2ff790a62b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:25.432254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ff2fb-a505-434a-8bee-2ff790a62b5b None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:25.432539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ff2fb-a505-434a-8bee-2ff790a62b5b None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:25.432815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ff2fb-a505-434a-8bee-2ff790a62b5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:25.434006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ff2fb-a505-434a-8bee-2ff790a62b5b None admin] RBAC: Adding query filter params (role.id=99a4e0ec120f4163a419b2775afb8a41, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=78ec461b4719448597c99fd9368fa740) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:25.434920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ff2fb-a505-434a-8bee-2ff790a62b5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:25.436539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ff2fb-a505-434a-8bee-2ff790a62b5b None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:25.445497 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 270/533] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:45:25 2022] GET /identity/v3/role_assignments?user.id=78ec461b4719448597c99fd9368fa740&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=99a4e0ec120f4163a419b2775afb8a41 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:25.446465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ff2fb-a505-434a-8bee-2ff790a62b5b None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:25.525124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e794210-039f-42ef-a31a-2d18c8070100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:25.527504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e794210-039f-42ef-a31a-2d18c8070100 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:25.595088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:25.649882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ff2fb-a505-434a-8bee-2ff790a62b5b None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:25.713756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99fd3e-8e32-477a-b528-385c04b131b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:25.715247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99fd3e-8e32-477a-b528-385c04b131b7 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:25.715996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99fd3e-8e32-477a-b528-385c04b131b7 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:25.716330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99fd3e-8e32-477a-b528-385c04b131b7 None admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:25.717541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99fd3e-8e32-477a-b528-385c04b131b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:25.717853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99fd3e-8e32-477a-b528-385c04b131b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:25.720610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99fd3e-8e32-477a-b528-385c04b131b7 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:25.735511 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 264/534] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:45:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:45:25.744098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e794210-039f-42ef-a31a-2d18c8070100 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:25.760511 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 271/535] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:45:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:25.768252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99fd3e-8e32-477a-b528-385c04b131b7 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:25.813482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:25.918624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e794210-039f-42ef-a31a-2d18c8070100 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:25.965156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe68c75-a365-42d5-badc-aacc4360219c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:25.967168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe68c75-a365-42d5-badc-aacc4360219c None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:25.967699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe68c75-a365-42d5-badc-aacc4360219c None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:25.968108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe68c75-a365-42d5-badc-aacc4360219c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:25.984695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe68c75-a365-42d5-badc-aacc4360219c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:25.986369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe68c75-a365-42d5-badc-aacc4360219c None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:26.006096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-dfe68c75-a365-42d5-badc-aacc4360219c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:26.006096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:26.006096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:26.006096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:26.006096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:26.006096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:26.006096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:26.006096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:26.006096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:26.006096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:26.006096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:26.006096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:26.006096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:26.006096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:26.006096 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:26.006969 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:26.006969 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:26.006969 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:26.006969 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:26.006969 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:26.006969 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:26.006969 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:26.006969 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:26.006969 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:26.006969 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:26.006969 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:26.006969 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:26.006969 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:26.006969 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:26.006969 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:26.006969 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:26.006969 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:26.007847 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:26.007847 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:26.007847 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:26.007847 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:26.007847 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 265/536] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:26.013921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe68c75-a365-42d5-badc-aacc4360219c None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:26.056996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99fd3e-8e32-477a-b528-385c04b131b7 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:26.109969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90105b05-b9b1-4b10-95b2-ddb34146fe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:26.111833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90105b05-b9b1-4b10-95b2-ddb34146fe1d None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:26.112726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90105b05-b9b1-4b10-95b2-ddb34146fe1d None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:26.113058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90105b05-b9b1-4b10-95b2-ddb34146fe1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:26.114373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90105b05-b9b1-4b10-95b2-ddb34146fe1d None admin] RBAC: Adding query filter params (role.id=99a4e0ec120f4163a419b2775afb8a41, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=6dcc74f579e447938a2477e253e5d36e) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:26.114689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90105b05-b9b1-4b10-95b2-ddb34146fe1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:26.117318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90105b05-b9b1-4b10-95b2-ddb34146fe1d None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:26.120080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:26.121204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:26.126492 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 272/537] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:45:25 2022] GET /identity/v3/role_assignments?user.id=6dcc74f579e447938a2477e253e5d36e&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=99a4e0ec120f4163a419b2775afb8a41 => generated 259 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:26.132114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b7e56-cb2a-46e1-b5d9-f773782c32e2 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:26.132408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b7e56-cb2a-46e1-b5d9-f773782c32e2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:26.132743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b7e56-cb2a-46e1-b5d9-f773782c32e2 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:26.140495 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 273/538] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:26.143632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443731c1-c0ae-40a7-b341-72993750c971 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:26.143906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443731c1-c0ae-40a7-b341-72993750c971 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:26.144445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443731c1-c0ae-40a7-b341-72993750c971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:26.159934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe68c75-a365-42d5-badc-aacc4360219c None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:26.175132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-443731c1-c0ae-40a7-b341-72993750c971 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:26.176427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-443731c1-c0ae-40a7-b341-72993750c971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:26.207480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12219c-fd4f-435d-83f7-83fea6a505df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:26.208188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12219c-fd4f-435d-83f7-83fea6a505df None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:26.208472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12219c-fd4f-435d-83f7-83fea6a505df None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:26.208800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12219c-fd4f-435d-83f7-83fea6a505df None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:26.209607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12219c-fd4f-435d-83f7-83fea6a505df None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:26.209920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12219c-fd4f-435d-83f7-83fea6a505df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:26.211615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12219c-fd4f-435d-83f7-83fea6a505df None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:26.226432 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 266/539] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:26.234033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12219c-fd4f-435d-83f7-83fea6a505df None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:26.369282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12219c-fd4f-435d-83f7-83fea6a505df None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:26.398323 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 274/540] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:26.436104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443731c1-c0ae-40a7-b341-72993750c971 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:26.438382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4e964-3387-45ec-a963-d5043c42c48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:26.439832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4e964-3387-45ec-a963-d5043c42c48b None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:26.440178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4e964-3387-45ec-a963-d5043c42c48b None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:26.440672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4e964-3387-45ec-a963-d5043c42c48b None admin] PATH_INFO: `/v3/projects/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:26.460245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4e964-3387-45ec-a963-d5043c42c48b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:26.461842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4e964-3387-45ec-a963-d5043c42c48b None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:26.488214 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-f1e4e964-3387-45ec-a963-d5043c42c48b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:26.488214 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:26.488214 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:26.488214 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:26.488214 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:26.488214 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:26.488214 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:26.488214 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:26.488214 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:26.488214 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:26.488214 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:26.488214 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:26.488214 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:45:26.488214 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:45:26.488214 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:45:26.490407 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:45:26.490407 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:26.490407 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:26.490407 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:26.490407 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:26.490407 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:26.490407 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:26.490407 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:26.490407 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:26.490407 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:26.490407 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:26.490407 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:26.490407 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:26.490407 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:26.490407 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:26.490407 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:26.490407 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:26.492835 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:45:26.492835 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:45:26.492835 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:45:26.492835 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:45:26.492835 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:45:26.492835 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:45:26.492835 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:26.492835 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:26.492835 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 267/541] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:26.497158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4e964-3387-45ec-a963-d5043c42c48b None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:26.510441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:26.552558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443731c1-c0ae-40a7-b341-72993750c971 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:26.585932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:26.595640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328426a9-a779-4c19-b18a-6b87a845bfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:26.596726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328426a9-a779-4c19-b18a-6b87a845bfc9 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:26.596987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328426a9-a779-4c19-b18a-6b87a845bfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:26.597261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328426a9-a779-4c19-b18a-6b87a845bfc9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:26.609644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328426a9-a779-4c19-b18a-6b87a845bfc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:26.618668 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-328426a9-a779-4c19-b18a-6b87a845bfc9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:26.618668 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:26.618668 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:26.618668 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:26.618668 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:26.618668 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:26.618668 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:26.618668 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:26.618668 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:26.618668 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:26.618668 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:26.618668 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:26.618668 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:26.618668 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:26.618668 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:26.618668 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:26.620987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:26.620987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:26.620987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:26.620987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:26.620987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:26.620987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:26.620987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:26.620987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:26.620987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:26.620987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:26.620987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:26.620987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:26.620987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:26.620987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:26.620987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:26.620987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:26.623673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:26.623673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:26.623673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:26.623673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:26.623673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:26.623673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:26.623673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:26.623673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:26.623673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:26.623673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:26.623673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:26.623673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:26.623673 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 275/542] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:45:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:26.631031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328426a9-a779-4c19-b18a-6b87a845bfc9 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:26.756907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328426a9-a779-4c19-b18a-6b87a845bfc9 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:26.771726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4e964-3387-45ec-a963-d5043c42c48b None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:26.802023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a05196-e2af-4cf1-bdb4-4d0cdd9fc81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:26.802699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a05196-e2af-4cf1-bdb4-4d0cdd9fc81d None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:26.802985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a05196-e2af-4cf1-bdb4-4d0cdd9fc81d None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:26.803292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a05196-e2af-4cf1-bdb4-4d0cdd9fc81d None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:26.804230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a05196-e2af-4cf1-bdb4-4d0cdd9fc81d None admin] RBAC: Adding query filter params (name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:26.804770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a05196-e2af-4cf1-bdb4-4d0cdd9fc81d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:26.808904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a05196-e2af-4cf1-bdb4-4d0cdd9fc81d None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:26.824737 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 276/543] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Jul 16 20:45:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:26.831031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a05196-e2af-4cf1-bdb4-4d0cdd9fc81d None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:26.865457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4276f-032f-4acd-ab4d-c9fa7d3f1ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:26.865457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4276f-032f-4acd-ab4d-c9fa7d3f1ac5 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:26.865457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4276f-032f-4acd-ab4d-c9fa7d3f1ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:26.865457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4276f-032f-4acd-ab4d-c9fa7d3f1ac5 None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:26.866795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4276f-032f-4acd-ab4d-c9fa7d3f1ac5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:26.866795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4276f-032f-4acd-ab4d-c9fa7d3f1ac5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:26.870465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4276f-032f-4acd-ab4d-c9fa7d3f1ac5 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:26.883852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:26.897865 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 268/544] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:45:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:26.904274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4276f-032f-4acd-ab4d-c9fa7d3f1ac5 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:26.941949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a05196-e2af-4cf1-bdb4-4d0cdd9fc81d None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:26.982416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dac51-3e0a-419b-b3e2-a5a4f8a2d691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:26.983350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dac51-3e0a-419b-b3e2-a5a4f8a2d691 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:26.983675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dac51-3e0a-419b-b3e2-a5a4f8a2d691 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:26.984025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dac51-3e0a-419b-b3e2-a5a4f8a2d691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:26.997915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6dac51-3e0a-419b-b3e2-a5a4f8a2d691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:26.999603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6dac51-3e0a-419b-b3e2-a5a4f8a2d691 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:27.020517 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-0d6dac51-3e0a-419b-b3e2-a5a4f8a2d691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:27.020517 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:27.020517 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:27.020517 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:27.020517 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:27.020517 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:27.020517 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:27.020517 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:27.020517 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:27.020517 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:27.020517 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:27.020517 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:27.020517 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:27.020517 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:27.020517 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:27.022519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:27.022519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:27.022519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:27.022519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:27.022519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:27.022519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:27.022519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:27.022519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:27.022519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:27.022519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:27.022519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:27.022519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:27.022519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:27.022519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:27.022519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:27.022519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:27.022519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:27.024669 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:27.024669 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:27.024669 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:27.024669 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:27.024669 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 277/545] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:27.027543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dac51-3e0a-419b-b3e2-a5a4f8a2d691 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:27.142702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dac51-3e0a-419b-b3e2-a5a4f8a2d691 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:27.144978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:27.165949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:27.189300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e89b8d-7aec-4aa3-b77f-805714c958f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:27.195109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e89b8d-7aec-4aa3-b77f-805714c958f6 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:27.195109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e89b8d-7aec-4aa3-b77f-805714c958f6 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:27.195109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e89b8d-7aec-4aa3-b77f-805714c958f6 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:27.195109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e89b8d-7aec-4aa3-b77f-805714c958f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:27.195109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e89b8d-7aec-4aa3-b77f-805714c958f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:27.195109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e89b8d-7aec-4aa3-b77f-805714c958f6 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:27.208430 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 278/546] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:27.215579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e89b8d-7aec-4aa3-b77f-805714c958f6 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:27.256954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4276f-032f-4acd-ab4d-c9fa7d3f1ac5 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:27.330423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e89b8d-7aec-4aa3-b77f-805714c958f6 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:27.371567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5733e2-dab2-4ea4-b462-8b4bf9853329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:27.373110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5733e2-dab2-4ea4-b462-8b4bf9853329 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:27.373332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5733e2-dab2-4ea4-b462-8b4bf9853329 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:27.379041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5733e2-dab2-4ea4-b462-8b4bf9853329 None admin] PATH_INFO: `/v3/users/swift` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:27.382505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5733e2-dab2-4ea4-b462-8b4bf9853329 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:27.384243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5733e2-dab2-4ea4-b462-8b4bf9853329 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:27.401727 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-5e5733e2-dab2-4ea4-b462-8b4bf9853329 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 16 20:45:27.401727 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:27.401727 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:27.401727 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:27.401727 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:27.401727 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:27.401727 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:27.401727 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:27.401727 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:27.401727 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:27.401727 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:27.401727 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:27.401727 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:45:27.401727 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:45:27.401727 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:45:27.401727 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:45:27.404538 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:27.404538 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:27.404538 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:45:27.404538 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:27.404538 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:45:27.404538 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:27.404538 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:27.404538 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:27.404538 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:27.404538 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:27.404538 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:27.404538 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:27.404538 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:27.404538 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:27.404538 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:27.404538 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:27.404538 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:27.404538 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:27.406721 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:27.406721 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:27.406721 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:45:27.406721 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:45:27.406721 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:45:27.406721 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:45:27.406721 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:45:27.406721 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:45:27.406721 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 16 20:45:27.406721 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:27.408024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5889e-0920-4ddf-87b1-4deada550ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:27.408024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5889e-0920-4ddf-87b1-4deada550ce7 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:27.408024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5889e-0920-4ddf-87b1-4deada550ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:27.408024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5889e-0920-4ddf-87b1-4deada550ce7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:27.408590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5889e-0920-4ddf-87b1-4deada550ce7 None admin] RBAC: Adding query filter params (role.id=99a4e0ec120f4163a419b2775afb8a41, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=fbd858f3e6ba4523b056bbdc2af427b0) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:27.408590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5889e-0920-4ddf-87b1-4deada550ce7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:27.408854 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 279/547] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:45:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:27.408990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5889e-0920-4ddf-87b1-4deada550ce7 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:27.409142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5733e2-dab2-4ea4-b462-8b4bf9853329 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:27.433188 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 269/548] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:45:26 2022] GET /identity/v3/role_assignments?user.id=fbd858f3e6ba4523b056bbdc2af427b0&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=99a4e0ec120f4163a419b2775afb8a41 => generated 259 bytes in 530 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:45:27.461398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:27.595487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5733e2-dab2-4ea4-b462-8b4bf9853329 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:27.603288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331cb0c-05f6-4497-9ea2-f5680a647ca9 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:27.603896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331cb0c-05f6-4497-9ea2-f5680a647ca9 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:27.603896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331cb0c-05f6-4497-9ea2-f5680a647ca9 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:27.605537 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 270/549] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:27.611573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2804933-50d8-4bd0-9082-5735c90aef10 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:27.611869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2804933-50d8-4bd0-9082-5735c90aef10 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:27.612135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2804933-50d8-4bd0-9082-5735c90aef10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:27.631452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b2804933-50d8-4bd0-9082-5735c90aef10 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:27.632694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b2804933-50d8-4bd0-9082-5735c90aef10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:27.660927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e274679-b2fd-4641-8c23-817616ea9582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:27.661688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e274679-b2fd-4641-8c23-817616ea9582 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:27.661967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e274679-b2fd-4641-8c23-817616ea9582 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:27.662239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e274679-b2fd-4641-8c23-817616ea9582 None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:27.663205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e274679-b2fd-4641-8c23-817616ea9582 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:27.663524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e274679-b2fd-4641-8c23-817616ea9582 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:27.665010 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e274679-b2fd-4641-8c23-817616ea9582 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:27.709850 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 280/550] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Jul 16 20:45:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:27.716949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e274679-b2fd-4641-8c23-817616ea9582 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:27.723688 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 271/551] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 16 20:45:27.751100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2804933-50d8-4bd0-9082-5735c90aef10 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:27.827035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:27.841465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:27.866063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e274679-b2fd-4641-8c23-817616ea9582 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:27.874964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2804933-50d8-4bd0-9082-5735c90aef10 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:27.911282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2f9c2-ccd1-49db-bad8-efb21c59bdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:27.912171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2f9c2-ccd1-49db-bad8-efb21c59bdb4 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:27.912457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2f9c2-ccd1-49db-bad8-efb21c59bdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:27.912737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2f9c2-ccd1-49db-bad8-efb21c59bdb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:27.913223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b61355-290c-4328-b546-3fe4da92321b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:27.915583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b61355-290c-4328-b546-3fe4da92321b None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:27.915939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b61355-290c-4328-b546-3fe4da92321b None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:27.919531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b61355-290c-4328-b546-3fe4da92321b None admin] PATH_INFO: `/v3/roles/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:27.929412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b61355-290c-4328-b546-3fe4da92321b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:27.938641 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-b0b61355-290c-4328-b546-3fe4da92321b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:27.938641 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:27.938641 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:27.938641 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:27.938641 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:27.938641 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:27.938641 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:27.938641 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:27.938641 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:27.938641 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:27.938641 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:27.938641 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:27.938641 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:27.938641 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:27.938641 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:27.938641 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:27.940369 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:27.940369 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:27.940369 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:27.940369 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:27.940369 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:27.940369 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:27.940369 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:27.940369 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:27.940369 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:27.940369 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:27.940369 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:27.940369 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:27.940369 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:27.940369 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:27.940369 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:27.940369 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:27.942009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:27.942009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:27.942009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:27.942009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:27.942009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:27.942009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:27.942009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:27.942009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:27.942009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:27.942009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:27.942009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:27.942009 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:27.942009 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 272/552] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:45:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:45:27.947063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b61355-290c-4328-b546-3fe4da92321b None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:28.036785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2f9c2-ccd1-49db-bad8-efb21c59bdb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:28.038281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2f9c2-ccd1-49db-bad8-efb21c59bdb4 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:28.073707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b61355-290c-4328-b546-3fe4da92321b None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:28.099762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:28.116880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828bdc7-7c59-41ef-a95b-1207ebd001ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:28.117901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828bdc7-7c59-41ef-a95b-1207ebd001ee None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:28.118349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828bdc7-7c59-41ef-a95b-1207ebd001ee None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:28.118864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828bdc7-7c59-41ef-a95b-1207ebd001ee None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:28.119804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828bdc7-7c59-41ef-a95b-1207ebd001ee None admin] RBAC: Adding query filter params (name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:28.120279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828bdc7-7c59-41ef-a95b-1207ebd001ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:28.122536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828bdc7-7c59-41ef-a95b-1207ebd001ee None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:28.133701 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 273/553] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Jul 16 20:45:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:28.139928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828bdc7-7c59-41ef-a95b-1207ebd001ee None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:28.195103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:28.252506 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 281/554] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:45:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:45:28.260788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2f9c2-ccd1-49db-bad8-efb21c59bdb4 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:28.268656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828bdc7-7c59-41ef-a95b-1207ebd001ee None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:28.307888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003d11c-80fb-4887-b86a-a46cf58135a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:28.309827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003d11c-80fb-4887-b86a-a46cf58135a0 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:28.310282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003d11c-80fb-4887-b86a-a46cf58135a0 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:28.310824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003d11c-80fb-4887-b86a-a46cf58135a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:28.322589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003d11c-80fb-4887-b86a-a46cf58135a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:28.324456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003d11c-80fb-4887-b86a-a46cf58135a0 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:28.354035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-5003d11c-80fb-4887-b86a-a46cf58135a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:28.354035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:28.354035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:28.354035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:28.354035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:28.354035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:28.354035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:28.354035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:28.354035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:28.354035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:28.354035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:28.354035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:28.354035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:28.354035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:28.354035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:28.355275 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:28.355275 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:28.355275 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:28.355275 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:28.355275 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:28.355275 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:28.355275 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:28.355275 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:28.355275 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:28.355275 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:28.355275 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:28.355275 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:28.355275 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:28.355275 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:28.355275 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:28.355275 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:28.355275 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:28.356467 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:28.356467 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:28.356467 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:28.356467 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:28.358893 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 274/555] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:45:28.364801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6f08f-ce19-4e00-bb2b-ad04bcc87530 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:28.365496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6f08f-ce19-4e00-bb2b-ad04bcc87530 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:28.366046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6f08f-ce19-4e00-bb2b-ad04bcc87530 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:28.368281 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 275/556] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:28.369251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6f08f-ce19-4e00-bb2b-ad04bcc87530 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:28.420958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:28.450144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2f9c2-ccd1-49db-bad8-efb21c59bdb4 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:28.491524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db307484-c693-4687-9fe8-359a7f04ae82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:28.492429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db307484-c693-4687-9fe8-359a7f04ae82 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:28.492721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db307484-c693-4687-9fe8-359a7f04ae82 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:28.493067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db307484-c693-4687-9fe8-359a7f04ae82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:28.502699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6f08f-ce19-4e00-bb2b-ad04bcc87530 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:28.506236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db307484-c693-4687-9fe8-359a7f04ae82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:28.507755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db307484-c693-4687-9fe8-359a7f04ae82 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:28.529075 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-db307484-c693-4687-9fe8-359a7f04ae82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:28.529075 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:28.529075 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:28.529075 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:28.529075 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:28.529075 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:28.529075 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:28.529075 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:28.529075 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:28.529075 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:28.529075 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:28.529075 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:28.529075 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:28.529075 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:28.529075 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:28.530009 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:28.530009 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:28.530009 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:28.530009 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:28.530009 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:28.530009 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:28.530009 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:28.530009 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:28.530009 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:28.530009 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:28.530009 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:28.530009 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:28.530009 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:28.530009 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:28.530009 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:28.530009 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:28.530009 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:28.531392 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:28.531392 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:28.531392 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:28.531392 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:28.531392 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 282/557] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:45:28.533856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa0b67-8a76-4d6e-a2ca-38196e85c93f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:28.533856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa0b67-8a76-4d6e-a2ca-38196e85c93f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:28.533856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa0b67-8a76-4d6e-a2ca-38196e85c93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:28.544558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eeca3d-a0ff-4377-9f5c-5646bf84de03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:28.545282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eeca3d-a0ff-4377-9f5c-5646bf84de03 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:28.545568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eeca3d-a0ff-4377-9f5c-5646bf84de03 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:28.545842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eeca3d-a0ff-4377-9f5c-5646bf84de03 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:28.546583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eeca3d-a0ff-4377-9f5c-5646bf84de03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:28.547030 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eeca3d-a0ff-4377-9f5c-5646bf84de03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:28.548473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eeca3d-a0ff-4377-9f5c-5646bf84de03 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:28.553709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d3fa0b67-8a76-4d6e-a2ca-38196e85c93f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:28.555145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d3fa0b67-8a76-4d6e-a2ca-38196e85c93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:28.562768 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 276/558] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:28.563696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eeca3d-a0ff-4377-9f5c-5646bf84de03 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:28.589754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:28.641578 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 283/559] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:28.642607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa0b67-8a76-4d6e-a2ca-38196e85c93f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:28.680040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:28.689262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eeca3d-a0ff-4377-9f5c-5646bf84de03 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:28.731893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b687c-d934-4e56-9085-b5f261aed04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:28.733044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b687c-d934-4e56-9085-b5f261aed04b None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:28.733484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b687c-d934-4e56-9085-b5f261aed04b None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:28.733911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b687c-d934-4e56-9085-b5f261aed04b None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:28.734807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b687c-d934-4e56-9085-b5f261aed04b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:28.735309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b687c-d934-4e56-9085-b5f261aed04b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:28.737035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b687c-d934-4e56-9085-b5f261aed04b None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:28.751138 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 277/560] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:28.752356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b687c-d934-4e56-9085-b5f261aed04b None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:28.771694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa0b67-8a76-4d6e-a2ca-38196e85c93f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:28.815643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608b144-5f9d-4b60-a215-1572a933062b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:28.816446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608b144-5f9d-4b60-a215-1572a933062b None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:28.816737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608b144-5f9d-4b60-a215-1572a933062b None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:28.817020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608b144-5f9d-4b60-a215-1572a933062b None admin] PATH_INFO: `/v3/users/nova` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:28.826169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608b144-5f9d-4b60-a215-1572a933062b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:28.827857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608b144-5f9d-4b60-a215-1572a933062b None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:28.844898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-9608b144-5f9d-4b60-a215-1572a933062b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 16 20:45:28.844898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:28.844898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:28.844898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:28.844898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:28.844898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:28.844898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:28.844898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:28.844898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:28.844898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:28.844898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:28.844898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:28.844898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:45:28.844898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:45:28.844898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:45:28.844898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:45:28.846133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:28.846133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:28.846133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:45:28.846133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:28.846133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:45:28.846133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:28.846133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:28.846133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:28.846133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:28.846133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:28.846133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:28.846133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:28.846133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:28.846133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:28.846133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:28.846133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:28.846133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:28.846133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:28.847121 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:28.847121 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:28.847121 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:45:28.847121 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:45:28.847121 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:45:28.847121 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:45:28.847121 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:45:28.847121 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:45:28.847121 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 16 20:45:28.847121 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:28.847121 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 284/561] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Jul 16 20:45:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:28.847708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608b144-5f9d-4b60-a215-1572a933062b None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:28.875234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:28.893095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b687c-d934-4e56-9085-b5f261aed04b None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:28.933439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1ccf3-ac86-4a3d-a8bb-99b1ce33d128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:28.935550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1ccf3-ac86-4a3d-a8bb-99b1ce33d128 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:28.936199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1ccf3-ac86-4a3d-a8bb-99b1ce33d128 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:28.936660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1ccf3-ac86-4a3d-a8bb-99b1ce33d128 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:28.949572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1ccf3-ac86-4a3d-a8bb-99b1ce33d128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:28.958578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-e1d1ccf3-ac86-4a3d-a8bb-99b1ce33d128 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:28.958578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:28.958578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:28.958578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:28.958578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:28.958578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:28.958578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:28.958578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:28.958578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:28.958578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:28.958578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:28.958578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:28.958578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:28.958578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:28.958578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:28.958578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:28.959874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:28.959874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:28.959874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:28.959874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:28.959874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:28.959874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:28.959874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:28.959874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:28.959874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:28.959874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:28.959874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:28.959874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:28.959874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:28.959874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:28.959874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:28.959874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:28.960853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:28.960853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:28.960853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:28.960853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:28.960853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:28.960853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:28.960853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:28.960853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:28.960853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:28.960853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:28.960853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:28.960853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:28.963163 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 278/562] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:45:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:28.968806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608b144-5f9d-4b60-a215-1572a933062b None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:28.968966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1ccf3-ac86-4a3d-a8bb-99b1ce33d128 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:28.983478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:29.004776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b22b7-4cca-4f57-b8e8-d440f16875ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:29.005858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b22b7-4cca-4f57-b8e8-d440f16875ed None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:29.006330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b22b7-4cca-4f57-b8e8-d440f16875ed None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:29.006757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b22b7-4cca-4f57-b8e8-d440f16875ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:29.015267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b22b7-4cca-4f57-b8e8-d440f16875ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:29.017006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b22b7-4cca-4f57-b8e8-d440f16875ed None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:29.034148 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-2c9b22b7-4cca-4f57-b8e8-d440f16875ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:29.034148 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:29.034148 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:29.034148 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:29.034148 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:29.034148 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:29.034148 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:29.034148 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:29.034148 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:29.034148 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:29.034148 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:29.034148 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:29.034148 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:45:29.034148 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:45:29.034148 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:45:29.035156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:45:29.035156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:29.035156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:29.035156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:29.035156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:29.035156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:29.035156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:29.035156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:29.035156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:29.035156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:29.035156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:29.035156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:29.035156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:29.035156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:29.035156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:29.035156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:29.035156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:29.036068 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:45:29.036068 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:45:29.036068 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:45:29.036068 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:45:29.036068 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:45:29.036068 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:45:29.036068 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:29.036068 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:29.036068 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 285/563] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:29.037007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b22b7-4cca-4f57-b8e8-d440f16875ed None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:29.103704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1ccf3-ac86-4a3d-a8bb-99b1ce33d128 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:29.151552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7bc64-e22a-4f1f-97e7-1f1d0e6fcf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:29.152887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7bc64-e22a-4f1f-97e7-1f1d0e6fcf4b None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:29.153694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7bc64-e22a-4f1f-97e7-1f1d0e6fcf4b None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:29.153974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7bc64-e22a-4f1f-97e7-1f1d0e6fcf4b None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:29.154829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7bc64-e22a-4f1f-97e7-1f1d0e6fcf4b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:29.155164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7bc64-e22a-4f1f-97e7-1f1d0e6fcf4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:29.157582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7bc64-e22a-4f1f-97e7-1f1d0e6fcf4b None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:29.161740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:29.187313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b22b7-4cca-4f57-b8e8-d440f16875ed None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:29.211135 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 279/564] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Jul 16 20:45:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:29.212731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7bc64-e22a-4f1f-97e7-1f1d0e6fcf4b None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:29.235318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d94095-52ff-4dc1-ac24-066d7e3a166b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:29.236170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d94095-52ff-4dc1-ac24-066d7e3a166b None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:29.236456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d94095-52ff-4dc1-ac24-066d7e3a166b None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:29.236765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d94095-52ff-4dc1-ac24-066d7e3a166b None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:29.237841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d94095-52ff-4dc1-ac24-066d7e3a166b None admin] RBAC: Adding query filter params (name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:29.238154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d94095-52ff-4dc1-ac24-066d7e3a166b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:29.239636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d94095-52ff-4dc1-ac24-066d7e3a166b None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:29.259098 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 286/565] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Jul 16 20:45:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:29.259098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d94095-52ff-4dc1-ac24-066d7e3a166b None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:29.311674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:29.344870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7bc64-e22a-4f1f-97e7-1f1d0e6fcf4b None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:29.384334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14976c0b-f824-4add-b17c-019a6be5ea46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:29.385046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14976c0b-f824-4add-b17c-019a6be5ea46 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:29.385377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14976c0b-f824-4add-b17c-019a6be5ea46 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:29.385657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14976c0b-f824-4add-b17c-019a6be5ea46 None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:29.386505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14976c0b-f824-4add-b17c-019a6be5ea46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:29.386889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14976c0b-f824-4add-b17c-019a6be5ea46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:29.389487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14976c0b-f824-4add-b17c-019a6be5ea46 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:29.403854 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 280/566] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:45:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:29.405458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797d9d6-6070-459f-aa38-aeb88fb6a625 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:29.405815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797d9d6-6070-459f-aa38-aeb88fb6a625 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:29.406123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797d9d6-6070-459f-aa38-aeb88fb6a625 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:29.407661 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 281/567] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:29.408169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797d9d6-6070-459f-aa38-aeb88fb6a625 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:29.421466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d94095-52ff-4dc1-ac24-066d7e3a166b None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:29.463830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33042505-b3d5-49c2-b96a-e882d5072402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:29.465053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33042505-b3d5-49c2-b96a-e882d5072402 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:29.465618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33042505-b3d5-49c2-b96a-e882d5072402 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:29.466024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33042505-b3d5-49c2-b96a-e882d5072402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:29.481694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33042505-b3d5-49c2-b96a-e882d5072402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:29.484337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33042505-b3d5-49c2-b96a-e882d5072402 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:29.489660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:29.515792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-33042505-b3d5-49c2-b96a-e882d5072402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:29.515792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:29.515792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:29.515792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:29.515792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:29.515792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:29.515792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:29.515792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:29.515792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:29.515792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:29.515792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:29.515792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:29.515792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:29.515792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:29.515792 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:29.517594 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:29.517594 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:29.517594 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:29.517594 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:29.517594 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:29.517594 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:29.517594 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:29.517594 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:29.517594 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:29.517594 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:29.517594 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:29.517594 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:29.517594 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:29.517594 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:29.517594 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:29.517594 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:29.517594 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:29.520167 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:29.520167 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:29.520167 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:29.520167 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:29.520167 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 287/568] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:29.520167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33042505-b3d5-49c2-b96a-e882d5072402 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:29.568831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797d9d6-6070-459f-aa38-aeb88fb6a625 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:29.620282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:29.628863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6aee2-d694-443e-ad48-ff7ad67ddd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:29.638084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6aee2-d694-443e-ad48-ff7ad67ddd0f None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:29.638084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6aee2-d694-443e-ad48-ff7ad67ddd0f None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:29.638084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6aee2-d694-443e-ad48-ff7ad67ddd0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:29.648986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6aee2-d694-443e-ad48-ff7ad67ddd0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:29.651603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6aee2-d694-443e-ad48-ff7ad67ddd0f None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:29.679338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-4de6aee2-d694-443e-ad48-ff7ad67ddd0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:29.679338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:29.679338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:29.679338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:29.679338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:29.679338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:29.679338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:29.679338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:29.679338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:29.679338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:29.679338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:29.679338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:29.679338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:29.679338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:29.679338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:29.681943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:29.681943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:29.681943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:29.681943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:29.681943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:29.681943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:29.681943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:29.681943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:29.681943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:29.681943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:29.681943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:29.681943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:29.681943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:29.681943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:29.681943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:29.681943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:29.681943 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:29.685694 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:29.685694 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:29.685694 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:29.685694 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:29.685694 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 282/569] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:29.686700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacdbd0-cde5-4f03-8ca6-397ef342ba71 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:29.686700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacdbd0-cde5-4f03-8ca6-397ef342ba71 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:29.687175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacdbd0-cde5-4f03-8ca6-397ef342ba71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:29.690116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33042505-b3d5-49c2-b96a-e882d5072402 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:29.708937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5eacdbd0-cde5-4f03-8ca6-397ef342ba71 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:29.710341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5eacdbd0-cde5-4f03-8ca6-397ef342ba71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:29.738279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6026fc-b9d0-4fcb-96e7-e022e11cf25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:29.739409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6026fc-b9d0-4fcb-96e7-e022e11cf25f None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:29.739880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6026fc-b9d0-4fcb-96e7-e022e11cf25f None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:29.740442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6026fc-b9d0-4fcb-96e7-e022e11cf25f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:29.742506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6026fc-b9d0-4fcb-96e7-e022e11cf25f None admin] RBAC: Adding query filter params (role.id=99a4e0ec120f4163a419b2775afb8a41, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=9a66df01ea414b34a8842488b145974f) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:29.743107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6026fc-b9d0-4fcb-96e7-e022e11cf25f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:29.745145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6026fc-b9d0-4fcb-96e7-e022e11cf25f None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:29.754354 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 288/570] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:45:29 2022] GET /identity/v3/role_assignments?user.id=9a66df01ea414b34a8842488b145974f&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=99a4e0ec120f4163a419b2775afb8a41 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:29.756014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6026fc-b9d0-4fcb-96e7-e022e11cf25f None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:29.817610 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 283/571] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:29.825869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacdbd0-cde5-4f03-8ca6-397ef342ba71 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:29.889326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:29.955484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6026fc-b9d0-4fcb-96e7-e022e11cf25f None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:29.979126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacdbd0-cde5-4f03-8ca6-397ef342ba71 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:30.004637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:30.034603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cbbe3-4520-4666-a161-a41fabbaff18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:30.035487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cbbe3-4520-4666-a161-a41fabbaff18 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:30.035847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cbbe3-4520-4666-a161-a41fabbaff18 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:30.036241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cbbe3-4520-4666-a161-a41fabbaff18 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:30.037047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cbbe3-4520-4666-a161-a41fabbaff18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:30.037425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cbbe3-4520-4666-a161-a41fabbaff18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:30.038912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cbbe3-4520-4666-a161-a41fabbaff18 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:30.046660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e6f59-5bf6-41a5-b24f-3ed73a752285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:30.048260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e6f59-5bf6-41a5-b24f-3ed73a752285 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:30.048260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e6f59-5bf6-41a5-b24f-3ed73a752285 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:30.048260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e6f59-5bf6-41a5-b24f-3ed73a752285 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:30.048642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e6f59-5bf6-41a5-b24f-3ed73a752285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:30.048939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e6f59-5bf6-41a5-b24f-3ed73a752285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:30.050331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e6f59-5bf6-41a5-b24f-3ed73a752285 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:30.067436 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 284/572] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:30.069122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cbbe3-4520-4666-a161-a41fabbaff18 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:30.073939 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 289/573] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:30.075287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e6f59-5bf6-41a5-b24f-3ed73a752285 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:30.232055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cbbe3-4520-4666-a161-a41fabbaff18 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:30.258267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e6f59-5bf6-41a5-b24f-3ed73a752285 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:30.294611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc7fac-b5f7-4455-b987-272c884e1bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:30.295453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc7fac-b5f7-4455-b987-272c884e1bd4 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:30.295842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc7fac-b5f7-4455-b987-272c884e1bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:30.296015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc7fac-b5f7-4455-b987-272c884e1bd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:30.302705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:30.310241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc7fac-b5f7-4455-b987-272c884e1bd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:30.318418 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-f9dc7fac-b5f7-4455-b987-272c884e1bd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:30.318418 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:30.318418 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:30.318418 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:30.318418 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:30.318418 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:30.318418 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:30.318418 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:30.318418 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:30.318418 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:30.318418 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:30.318418 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:30.318418 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:30.318418 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:30.318418 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:30.318418 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:30.319853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:30.319853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:30.319853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:30.319853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:30.319853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:30.319853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:30.319853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:30.319853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:30.319853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:30.319853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:30.319853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:30.319853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:30.319853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:30.319853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:30.319853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:30.319853 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:30.320667 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:30.320667 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:30.320667 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:30.320667 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:30.320667 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:30.320667 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:30.320667 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:30.320667 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:30.320667 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:30.320667 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:30.320667 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:30.320667 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:30.320667 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 285/574] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:45:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:30.321488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc7fac-b5f7-4455-b987-272c884e1bd4 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:30.325860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cba0b-ba01-4947-b831-91e361ef0e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:30.325860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cba0b-ba01-4947-b831-91e361ef0e5a None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:30.326098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cba0b-ba01-4947-b831-91e361ef0e5a None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:30.326498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cba0b-ba01-4947-b831-91e361ef0e5a None admin] PATH_INFO: `/v3/users/glance` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:30.337979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cba0b-ba01-4947-b831-91e361ef0e5a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:30.339717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cba0b-ba01-4947-b831-91e361ef0e5a None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:30.358424 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-440cba0b-ba01-4947-b831-91e361ef0e5a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 16 20:45:30.358424 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:30.358424 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:30.358424 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:30.358424 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:30.358424 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:30.358424 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:30.358424 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:30.358424 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:30.358424 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:30.358424 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:30.358424 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:30.358424 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:45:30.358424 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:45:30.358424 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:45:30.358424 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:45:30.359833 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:30.359833 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:30.359833 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:45:30.359833 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:30.359833 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:45:30.359833 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:30.359833 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:30.359833 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:30.359833 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:30.359833 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:30.359833 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:30.359833 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:30.359833 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:30.359833 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:30.359833 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:30.359833 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:30.359833 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:30.359833 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:30.360787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:30.360787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:30.360787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:45:30.360787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:45:30.360787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:45:30.360787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:45:30.360787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:45:30.360787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:45:30.360787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 16 20:45:30.360787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:30.360787 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 290/575] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:45:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:30.361450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1dc21-e552-4b5a-a331-9380edbd86f9 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:30.362594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1dc21-e552-4b5a-a331-9380edbd86f9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:30.362594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1dc21-e552-4b5a-a331-9380edbd86f9 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:30.367952 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 291/576] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:30.367952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1dc21-e552-4b5a-a331-9380edbd86f9 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:30.376957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:30.466572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc7fac-b5f7-4455-b987-272c884e1bd4 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:30.522621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffa073-912e-4406-a04b-8ee2e467ce06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:30.523777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffa073-912e-4406-a04b-8ee2e467ce06 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:30.524232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffa073-912e-4406-a04b-8ee2e467ce06 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:30.524679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffa073-912e-4406-a04b-8ee2e467ce06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:30.536517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffa073-912e-4406-a04b-8ee2e467ce06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:30.536820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1dc21-e552-4b5a-a331-9380edbd86f9 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:30.538973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffa073-912e-4406-a04b-8ee2e467ce06 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:30.564423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-ddffa073-912e-4406-a04b-8ee2e467ce06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:30.564423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:30.564423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:30.564423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:30.564423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:30.564423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:30.564423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:30.564423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:30.564423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:30.564423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:30.564423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:30.564423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:30.564423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:45:30.564423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:45:30.564423 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:45:30.565421 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:45:30.565421 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:30.565421 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:30.565421 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:30.565421 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:30.565421 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:30.565421 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:30.565421 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:30.565421 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:30.565421 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:30.565421 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:30.565421 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:30.565421 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:30.565421 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:30.565421 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:30.565421 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:30.565421 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:30.566334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:45:30.566334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:45:30.566334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:45:30.566334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:45:30.566334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:45:30.566334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:45:30.566334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:30.566334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:30.566334 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 286/577] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:30.568172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa45249-f4b6-4c42-917e-53db4cada03b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:30.568648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa45249-f4b6-4c42-917e-53db4cada03b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:30.569119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa45249-f4b6-4c42-917e-53db4cada03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:30.595600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8aa45249-f4b6-4c42-917e-53db4cada03b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:30.597338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8aa45249-f4b6-4c42-917e-53db4cada03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:30.603086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97314fda-76a6-4a42-942d-93865acb24b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:30.604134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97314fda-76a6-4a42-942d-93865acb24b1 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:30.604585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97314fda-76a6-4a42-942d-93865acb24b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:30.605083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97314fda-76a6-4a42-942d-93865acb24b1 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:30.606993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97314fda-76a6-4a42-942d-93865acb24b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:30.607517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97314fda-76a6-4a42-942d-93865acb24b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:30.609854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97314fda-76a6-4a42-942d-93865acb24b1 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:30.630690 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 292/578] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Jul 16 20:45:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:30.630690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97314fda-76a6-4a42-942d-93865acb24b1 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:30.688077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:30.722977 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 287/579] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:30.722977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa45249-f4b6-4c42-917e-53db4cada03b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:30.766388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:30.769511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97314fda-76a6-4a42-942d-93865acb24b1 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:30.808815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94cfdf-91f9-408d-81ce-424252c4edde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:30.810264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94cfdf-91f9-408d-81ce-424252c4edde None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:30.810892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94cfdf-91f9-408d-81ce-424252c4edde None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:30.811255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94cfdf-91f9-408d-81ce-424252c4edde None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:30.812108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94cfdf-91f9-408d-81ce-424252c4edde None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:30.812422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94cfdf-91f9-408d-81ce-424252c4edde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:30.813866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94cfdf-91f9-408d-81ce-424252c4edde None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:30.837907 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 293/580] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Jul 16 20:45:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:30.837907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94cfdf-91f9-408d-81ce-424252c4edde None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:30.883331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa45249-f4b6-4c42-917e-53db4cada03b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:30.930570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5be3c0-bcad-4143-8454-8a64f578dce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:30.931286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5be3c0-bcad-4143-8454-8a64f578dce7 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:30.931567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5be3c0-bcad-4143-8454-8a64f578dce7 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:30.931865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5be3c0-bcad-4143-8454-8a64f578dce7 None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:30.934968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5be3c0-bcad-4143-8454-8a64f578dce7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:30.934968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5be3c0-bcad-4143-8454-8a64f578dce7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:30.935341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5be3c0-bcad-4143-8454-8a64f578dce7 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:30.948164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:30.951243 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 288/581] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:45:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:30.952149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94cfdf-91f9-408d-81ce-424252c4edde None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:30.953440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5be3c0-bcad-4143-8454-8a64f578dce7 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:30.992450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca996c51-f1d4-4fec-89f4-52c41c04d5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:30.993267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca996c51-f1d4-4fec-89f4-52c41c04d5ff None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:30.993545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca996c51-f1d4-4fec-89f4-52c41c04d5ff None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:30.993819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca996c51-f1d4-4fec-89f4-52c41c04d5ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:31.006112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca996c51-f1d4-4fec-89f4-52c41c04d5ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:31.007633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca996c51-f1d4-4fec-89f4-52c41c04d5ff None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:31.026070 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-ca996c51-f1d4-4fec-89f4-52c41c04d5ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:31.026070 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:31.026070 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:31.026070 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:31.026070 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:31.026070 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:31.026070 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:31.026070 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:31.026070 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:31.026070 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:31.026070 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:31.026070 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:31.026070 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:31.026070 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:31.026070 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:31.027132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:31.027132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:31.027132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:31.027132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:31.027132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:31.027132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:31.027132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:31.027132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:31.027132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:31.027132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:31.027132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:31.027132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:31.027132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:31.027132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:31.027132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:31.027132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:31.027132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:31.032633 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:31.032633 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:31.032633 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:31.032633 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:31.032633 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 294/582] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:31.032633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca996c51-f1d4-4fec-89f4-52c41c04d5ff None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:31.069337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:31.089494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5be3c0-bcad-4143-8454-8a64f578dce7 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:31.128793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a1fd8-bb37-4315-b577-ecd88a64224c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:31.129593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a1fd8-bb37-4315-b577-ecd88a64224c None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:31.130242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a1fd8-bb37-4315-b577-ecd88a64224c None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:31.130527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a1fd8-bb37-4315-b577-ecd88a64224c None admin] PATH_INFO: `/v3/roles/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:31.143543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a1fd8-bb37-4315-b577-ecd88a64224c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:31.151403 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-913a1fd8-bb37-4315-b577-ecd88a64224c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:31.151403 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:31.151403 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:31.151403 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:31.151403 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:31.151403 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:31.151403 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:31.151403 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:31.151403 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:31.151403 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:31.151403 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:31.151403 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:31.151403 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:31.151403 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:31.151403 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:31.151403 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:31.152529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:31.152529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:31.152529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:31.152529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:31.152529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:31.152529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:31.152529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:31.152529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:31.152529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:31.152529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:31.152529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:31.152529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:31.152529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:31.152529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:31.152529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:31.152529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:31.153449 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:31.153449 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:31.153449 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:31.153449 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:31.153449 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:31.153449 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:31.153449 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:31.153449 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:31.153449 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:31.153449 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:31.153449 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:31.153449 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:31.153449 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 289/583] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:45:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:31.153449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a1fd8-bb37-4315-b577-ecd88a64224c None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:31.165595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca996c51-f1d4-4fec-89f4-52c41c04d5ff None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:31.206741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95c15f-257a-4775-a0bf-e35c7c61a3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:31.207564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95c15f-257a-4775-a0bf-e35c7c61a3c4 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:31.207848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95c15f-257a-4775-a0bf-e35c7c61a3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:31.208250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95c15f-257a-4775-a0bf-e35c7c61a3c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:31.220705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95c15f-257a-4775-a0bf-e35c7c61a3c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:31.222349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95c15f-257a-4775-a0bf-e35c7c61a3c4 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:31.241537 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-6f95c15f-257a-4775-a0bf-e35c7c61a3c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:31.241537 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:31.241537 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:31.241537 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:31.241537 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:31.241537 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:31.241537 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:31.241537 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:31.241537 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:31.241537 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:31.241537 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:31.241537 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:31.241537 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:31.241537 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:31.241537 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:31.242683 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:31.242683 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:31.242683 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:31.242683 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:31.242683 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:31.242683 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:31.242683 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:31.242683 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:31.242683 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:31.242683 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:31.242683 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:31.242683 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:31.242683 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:31.242683 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:31.242683 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:31.242683 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:31.242683 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:31.243822 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:31.243822 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:31.243822 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:31.243822 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:31.243822 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 295/584] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:31.243822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95c15f-257a-4775-a0bf-e35c7c61a3c4 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:31.251055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:31.275756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a1fd8-bb37-4315-b577-ecd88a64224c None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:31.320441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ebf3a-210f-4b6e-929b-8427524f28eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:31.322000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ebf3a-210f-4b6e-929b-8427524f28eb None admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:31.322286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ebf3a-210f-4b6e-929b-8427524f28eb None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:31.322833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ebf3a-210f-4b6e-929b-8427524f28eb None admin] PATH_INFO: `/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/d5f515bfe2094b41afe82b4bc57e4b9a/roles/99a4e0ec120f4163a419b2775afb8a41` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:31.345491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ebf3a-210f-4b6e-929b-8427524f28eb None admin] RBAC: Authorizing `identity:create_grant(project_id=c3045a89835d4e879a0ddc2557b831a3, user_id=d5f515bfe2094b41afe82b4bc57e4b9a, role_id=99a4e0ec120f4163a419b2775afb8a41)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:31.347080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ebf3a-210f-4b6e-929b-8427524f28eb None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:31.349715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:31.370439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95c15f-257a-4775-a0bf-e35c7c61a3c4 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:31.406416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d88b62-0a49-4ff0-9bd4-635d79e323bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:31.407116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d88b62-0a49-4ff0-9bd4-635d79e323bf None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:31.407398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d88b62-0a49-4ff0-9bd4-635d79e323bf None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:31.407668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d88b62-0a49-4ff0-9bd4-635d79e323bf None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:31.408397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d88b62-0a49-4ff0-9bd4-635d79e323bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:31.408698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d88b62-0a49-4ff0-9bd4-635d79e323bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:31.410088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d88b62-0a49-4ff0-9bd4-635d79e323bf None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:31.423556 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 296/585] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:31.424409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d88b62-0a49-4ff0-9bd4-635d79e323bf None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:31.457173 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 290/586] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:45:31 2022] PUT /identity/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/d5f515bfe2094b41afe82b4bc57e4b9a/roles/99a4e0ec120f4163a419b2775afb8a41 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:45:31.468089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ebf3a-210f-4b6e-929b-8427524f28eb None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:31.508528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:31.571552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d88b62-0a49-4ff0-9bd4-635d79e323bf None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:31.605260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ebf3a-210f-4b6e-929b-8427524f28eb None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:31.626089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed32d9-8907-4ce6-ba14-bfc640a15b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:31.627455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed32d9-8907-4ce6-ba14-bfc640a15b8c None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:31.627936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed32d9-8907-4ce6-ba14-bfc640a15b8c None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:31.628725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed32d9-8907-4ce6-ba14-bfc640a15b8c None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:31.630291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed32d9-8907-4ce6-ba14-bfc640a15b8c None admin] RBAC: Adding query filter params (name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:31.631085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed32d9-8907-4ce6-ba14-bfc640a15b8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:31.632976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed32d9-8907-4ce6-ba14-bfc640a15b8c None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:31.650137 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 297/587] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Jul 16 20:45:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:31.652030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed32d9-8907-4ce6-ba14-bfc640a15b8c None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:31.657028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190bd36-71a0-46c1-a3db-96172e538978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:31.658246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190bd36-71a0-46c1-a3db-96172e538978 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:31.658625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190bd36-71a0-46c1-a3db-96172e538978 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:31.658997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190bd36-71a0-46c1-a3db-96172e538978 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:31.660947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190bd36-71a0-46c1-a3db-96172e538978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:31.661262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190bd36-71a0-46c1-a3db-96172e538978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:31.662699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190bd36-71a0-46c1-a3db-96172e538978 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:31.682065 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 291/588] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:31.682065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190bd36-71a0-46c1-a3db-96172e538978 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:31.762708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:31.804567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed32d9-8907-4ce6-ba14-bfc640a15b8c None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:31.824499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190bd36-71a0-46c1-a3db-96172e538978 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:31.848546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:31.864850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531b563-d8bd-4773-bd18-a3214e1b33d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:31.866010 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b563-d8bd-4773-bd18-a3214e1b33d8 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:31.866433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b563-d8bd-4773-bd18-a3214e1b33d8 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:31.866847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b563-d8bd-4773-bd18-a3214e1b33d8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:31.868566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395feae-ee95-46e0-a74e-89674bfcfac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:31.869493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395feae-ee95-46e0-a74e-89674bfcfac7 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:31.869719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395feae-ee95-46e0-a74e-89674bfcfac7 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:31.870023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395feae-ee95-46e0-a74e-89674bfcfac7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:31.878094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531b563-d8bd-4773-bd18-a3214e1b33d8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:31.879835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531b563-d8bd-4773-bd18-a3214e1b33d8 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:31.882802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395feae-ee95-46e0-a74e-89674bfcfac7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:31.884303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395feae-ee95-46e0-a74e-89674bfcfac7 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:31.904059 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-b395feae-ee95-46e0-a74e-89674bfcfac7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:31.904059 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:31.904059 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:31.904059 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:31.904059 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:31.904059 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:31.904059 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:31.904059 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:31.904059 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:31.904059 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:31.904059 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:31.904059 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:31.904059 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:31.904059 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:31.904059 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:31.905151 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:31.905151 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:31.905151 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:31.905151 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:31.905151 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:31.905151 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:31.905151 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:31.905151 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:31.905151 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:31.905151 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:31.905151 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:31.905151 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:31.905151 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:31.905151 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:31.905151 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:31.905151 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:31.905151 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:31.906041 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:31.906041 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:31.906041 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:31.906041 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:31.909854 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 292/589] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:31.910748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395feae-ee95-46e0-a74e-89674bfcfac7 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:31.914411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-3531b563-d8bd-4773-bd18-a3214e1b33d8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 16 20:45:31.914411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:31.914411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:31.914411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:31.914411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:31.914411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:31.914411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:31.914411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:31.914411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:31.914411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:31.914411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:31.914411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:31.914411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:45:31.914411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:45:31.914411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:45:31.914411 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:45:31.916476 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:31.916476 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:31.916476 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:45:31.916476 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:31.916476 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:45:31.916476 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:31.916476 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:31.916476 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:31.916476 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:31.916476 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:31.916476 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:31.916476 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:31.916476 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:31.916476 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:31.916476 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:31.916476 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:31.916476 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:31.916476 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:31.918444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:31.918444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:31.918444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:45:31.918444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:45:31.918444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:45:31.918444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:45:31.918444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:45:31.918444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:45:31.918444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 16 20:45:31.918444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:31.924351 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 298/590] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:45:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:31.930919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531b563-d8bd-4773-bd18-a3214e1b33d8 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:32.032170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395feae-ee95-46e0-a74e-89674bfcfac7 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:32.040172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:32.070963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da4fb5-92c7-4fbf-a21e-d10b34c66a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:32.072164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da4fb5-92c7-4fbf-a21e-d10b34c66a43 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:32.072590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da4fb5-92c7-4fbf-a21e-d10b34c66a43 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:32.073002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da4fb5-92c7-4fbf-a21e-d10b34c66a43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:32.082235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da4fb5-92c7-4fbf-a21e-d10b34c66a43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:32.083971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da4fb5-92c7-4fbf-a21e-d10b34c66a43 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:32.095360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531b563-d8bd-4773-bd18-a3214e1b33d8 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:32.099338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-06da4fb5-92c7-4fbf-a21e-d10b34c66a43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:32.099338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:32.099338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:32.099338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:32.099338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:32.099338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:32.099338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:32.099338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:32.099338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:32.099338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:32.099338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:32.099338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:32.099338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:45:32.099338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:45:32.099338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:45:32.100271 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:45:32.100271 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:32.100271 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:32.100271 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:32.100271 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:32.100271 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:32.100271 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:32.100271 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:32.100271 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:32.100271 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:32.100271 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:32.100271 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:32.100271 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:32.100271 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:32.100271 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:32.100271 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:32.100271 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:32.101111 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:45:32.101111 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:45:32.101111 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:45:32.101111 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:45:32.101111 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:45:32.101111 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:45:32.101111 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:32.101111 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:32.103904 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 293/591] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:32.105089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da4fb5-92c7-4fbf-a21e-d10b34c66a43 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:32.142230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496fcc5-6c67-452f-a8ed-20ec9618a3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:32.143479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496fcc5-6c67-452f-a8ed-20ec9618a3a2 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:32.143894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496fcc5-6c67-452f-a8ed-20ec9618a3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:32.144370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496fcc5-6c67-452f-a8ed-20ec9618a3a2 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:32.145765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496fcc5-6c67-452f-a8ed-20ec9618a3a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:32.146288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496fcc5-6c67-452f-a8ed-20ec9618a3a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:32.149132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496fcc5-6c67-452f-a8ed-20ec9618a3a2 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:32.169941 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 299/592] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:32.169941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496fcc5-6c67-452f-a8ed-20ec9618a3a2 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:32.228277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:32.230693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da4fb5-92c7-4fbf-a21e-d10b34c66a43 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:32.268999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f69936-8d88-4af4-8ee7-d9fcda9ab55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:32.269978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f69936-8d88-4af4-8ee7-d9fcda9ab55a None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:32.270434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f69936-8d88-4af4-8ee7-d9fcda9ab55a None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:32.270875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f69936-8d88-4af4-8ee7-d9fcda9ab55a None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:32.271938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f69936-8d88-4af4-8ee7-d9fcda9ab55a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:32.272420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f69936-8d88-4af4-8ee7-d9fcda9ab55a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:32.274037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f69936-8d88-4af4-8ee7-d9fcda9ab55a None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:32.291641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496fcc5-6c67-452f-a8ed-20ec9618a3a2 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:32.294161 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 294/593] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Jul 16 20:45:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:32.295295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f69936-8d88-4af4-8ee7-d9fcda9ab55a None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:32.331713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:32.339370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00d627-26bf-4de7-8589-e6827fc3dcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:32.340063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00d627-26bf-4de7-8589-e6827fc3dcf5 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:32.340344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00d627-26bf-4de7-8589-e6827fc3dcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:32.341193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00d627-26bf-4de7-8589-e6827fc3dcf5 None admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:32.342284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00d627-26bf-4de7-8589-e6827fc3dcf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:32.342595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00d627-26bf-4de7-8589-e6827fc3dcf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:32.345292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00d627-26bf-4de7-8589-e6827fc3dcf5 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:32.361257 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 300/594] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:45:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:32.363157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00d627-26bf-4de7-8589-e6827fc3dcf5 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:32.424833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f69936-8d88-4af4-8ee7-d9fcda9ab55a None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:32.462690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ee8eb-7827-4a74-b778-f0c6f3c96dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:32.463835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ee8eb-7827-4a74-b778-f0c6f3c96dba None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:32.464289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ee8eb-7827-4a74-b778-f0c6f3c96dba None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:32.464758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ee8eb-7827-4a74-b778-f0c6f3c96dba None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:32.473510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ee8eb-7827-4a74-b778-f0c6f3c96dba None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:32.475341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ee8eb-7827-4a74-b778-f0c6f3c96dba None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:32.483798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00d627-26bf-4de7-8589-e6827fc3dcf5 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:32.490893 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-fa6ee8eb-7827-4a74-b778-f0c6f3c96dba None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 16 20:45:32.490893 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:32.490893 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:32.490893 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:32.490893 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:32.490893 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:32.490893 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:32.490893 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:32.490893 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:32.490893 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:32.490893 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:32.490893 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:32.490893 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:45:32.490893 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:45:32.490893 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:45:32.490893 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:45:32.492961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:32.492961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:32.492961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:45:32.492961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:32.492961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:45:32.492961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:32.492961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:32.492961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:32.492961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:32.492961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:32.492961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:32.492961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:32.492961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:32.492961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:32.492961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:32.492961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:32.492961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:32.492961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:32.495796 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:32.495796 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:32.495796 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:45:32.495796 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:45:32.495796 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:45:32.495796 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:45:32.495796 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:45:32.495796 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:45:32.495796 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 16 20:45:32.495796 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:32.495796 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 295/595] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:45:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:32.498949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ee8eb-7827-4a74-b778-f0c6f3c96dba None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:32.499302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:32.526483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86732e-5af4-4ab3-a490-43fddea24713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:32.527509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86732e-5af4-4ab3-a490-43fddea24713 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:32.527926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86732e-5af4-4ab3-a490-43fddea24713 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:32.528937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86732e-5af4-4ab3-a490-43fddea24713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:32.540544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86732e-5af4-4ab3-a490-43fddea24713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:32.542140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86732e-5af4-4ab3-a490-43fddea24713 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:32.562448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-5c86732e-5af4-4ab3-a490-43fddea24713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:32.562448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:32.562448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:32.562448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:32.562448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:32.562448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:32.562448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:32.562448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:32.562448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:32.562448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:32.562448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:32.562448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:32.562448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:32.562448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:32.562448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:32.564896 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:32.564896 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:32.564896 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:32.564896 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:32.564896 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:32.564896 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:32.564896 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:32.564896 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:32.564896 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:32.564896 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:32.564896 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:32.564896 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:32.564896 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:32.564896 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:32.564896 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:32.564896 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:32.564896 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:32.567050 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:32.567050 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:32.567050 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:32.567050 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:32.568936 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 301/596] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:32.570377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be05a93-3c6c-41fd-b715-276ed76fe029 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:32.570663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be05a93-3c6c-41fd-b715-276ed76fe029 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:32.570939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be05a93-3c6c-41fd-b715-276ed76fe029 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:32.572681 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 302/597] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:32.573530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be05a93-3c6c-41fd-b715-276ed76fe029 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:32.609075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:32.628262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ee8eb-7827-4a74-b778-f0c6f3c96dba None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:32.669776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1526d1-3e5d-4fdf-b959-cdb0d03ec7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:32.670785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1526d1-3e5d-4fdf-b959-cdb0d03ec7c9 None admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:32.671180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1526d1-3e5d-4fdf-b959-cdb0d03ec7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:32.671820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1526d1-3e5d-4fdf-b959-cdb0d03ec7c9 None admin] PATH_INFO: `/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/78ec461b4719448597c99fd9368fa740/roles/99a4e0ec120f4163a419b2775afb8a41` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:32.689764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be05a93-3c6c-41fd-b715-276ed76fe029 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:32.693608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1526d1-3e5d-4fdf-b959-cdb0d03ec7c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3045a89835d4e879a0ddc2557b831a3, user_id=78ec461b4719448597c99fd9368fa740, role_id=99a4e0ec120f4163a419b2775afb8a41)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:32.695333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1526d1-3e5d-4fdf-b959-cdb0d03ec7c9 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:32.724955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789bb0f-891a-46ac-a6e4-54be43ab6076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:32.725630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789bb0f-891a-46ac-a6e4-54be43ab6076 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:32.725911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789bb0f-891a-46ac-a6e4-54be43ab6076 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:32.726186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789bb0f-891a-46ac-a6e4-54be43ab6076 None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:32.727029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789bb0f-891a-46ac-a6e4-54be43ab6076 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:32.727360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789bb0f-891a-46ac-a6e4-54be43ab6076 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:32.728783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789bb0f-891a-46ac-a6e4-54be43ab6076 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:32.748167 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 303/598] 10.222.0.16 () {56 vars in 1139 bytes} [Sat Jul 16 20:45:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:32.748599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789bb0f-891a-46ac-a6e4-54be43ab6076 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:32.772604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:32.789047 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 296/599] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:45:32 2022] PUT /identity/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/78ec461b4719448597c99fd9368fa740/roles/99a4e0ec120f4163a419b2775afb8a41 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:45:32.790877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671a616-abf0-47e5-bec7-be576f590cc5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:32.791324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671a616-abf0-47e5-bec7-be576f590cc5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:32.791739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671a616-abf0-47e5-bec7-be576f590cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:32.816507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b671a616-abf0-47e5-bec7-be576f590cc5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:32.818536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b671a616-abf0-47e5-bec7-be576f590cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:32.901610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789bb0f-891a-46ac-a6e4-54be43ab6076 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:32.931689 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 297/600] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:32.931689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671a616-abf0-47e5-bec7-be576f590cc5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:32.963447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f9657-606e-4228-aaa5-8c0ae3778ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:32.966693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f9657-606e-4228-aaa5-8c0ae3778ce3 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:32.966693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f9657-606e-4228-aaa5-8c0ae3778ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:32.966693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f9657-606e-4228-aaa5-8c0ae3778ce3 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:32.966693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f9657-606e-4228-aaa5-8c0ae3778ce3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:32.967131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f9657-606e-4228-aaa5-8c0ae3778ce3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:32.969358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f9657-606e-4228-aaa5-8c0ae3778ce3 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:32.986915 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 304/601] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:32.992018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f9657-606e-4228-aaa5-8c0ae3778ce3 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:33.023529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:33.071032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671a616-abf0-47e5-bec7-be576f590cc5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:33.095385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:33.120025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f9657-606e-4228-aaa5-8c0ae3778ce3 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:33.123344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b46546-0ea0-40cd-868d-dfce2e05061b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:33.124042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b46546-0ea0-40cd-868d-dfce2e05061b None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:33.124327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b46546-0ea0-40cd-868d-dfce2e05061b None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:33.124601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b46546-0ea0-40cd-868d-dfce2e05061b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:33.142871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b46546-0ea0-40cd-868d-dfce2e05061b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:33.145096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b46546-0ea0-40cd-868d-dfce2e05061b None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:33.160683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcff1b-9fe0-4db7-b84d-4d7ec83c8226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:33.161485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcff1b-9fe0-4db7-b84d-4d7ec83c8226 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:33.161768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcff1b-9fe0-4db7-b84d-4d7ec83c8226 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:33.162044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcff1b-9fe0-4db7-b84d-4d7ec83c8226 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:33.172359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-69b46546-0ea0-40cd-868d-dfce2e05061b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:33.172359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:33.172359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:33.172359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:33.172359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:33.172359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:33.172359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:33.172359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:33.172359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:33.172359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:33.172359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:33.172359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:33.172359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:33.172359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:33.172359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:33.173484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:33.173484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:33.173484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:33.173484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:33.173484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:33.173484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:33.173484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:33.173484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:33.173484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:33.173484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:33.173484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:33.173484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:33.173484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:33.173484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:33.173484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:33.173484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:33.173484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:33.174536 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:33.174536 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:33.174536 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:33.174536 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:33.176172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bcff1b-9fe0-4db7-b84d-4d7ec83c8226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:33.177081 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 298/602] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:33.178060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b46546-0ea0-40cd-868d-dfce2e05061b None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:33.192659 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-e1bcff1b-9fe0-4db7-b84d-4d7ec83c8226 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:33.192659 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:33.192659 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:33.192659 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:33.192659 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:33.192659 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:33.192659 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:33.192659 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:33.192659 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:33.192659 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:33.192659 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:33.192659 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:33.192659 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:33.192659 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:33.192659 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:33.192659 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:33.193857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:33.193857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:33.193857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:33.193857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:33.193857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:33.193857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:33.193857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:33.193857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:33.193857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:33.193857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:33.193857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:33.193857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:33.193857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:33.193857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:33.193857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:33.193857 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:33.194750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:33.194750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:33.194750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:33.194750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:33.194750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:33.194750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:33.194750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:33.194750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:33.194750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:33.194750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:33.194750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:33.194750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:33.199158 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 305/603] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:45:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:33.200844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcff1b-9fe0-4db7-b84d-4d7ec83c8226 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:33.336047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b46546-0ea0-40cd-868d-dfce2e05061b None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:33.336537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcff1b-9fe0-4db7-b84d-4d7ec83c8226 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:33.365442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:33.384549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331a13c-a320-4105-8f65-afe7f85e6ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:33.385141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331a13c-a320-4105-8f65-afe7f85e6ec1 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:33.385425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331a13c-a320-4105-8f65-afe7f85e6ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:33.385701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331a13c-a320-4105-8f65-afe7f85e6ec1 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:33.386424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331a13c-a320-4105-8f65-afe7f85e6ec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:33.386732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331a13c-a320-4105-8f65-afe7f85e6ec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:33.388844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331a13c-a320-4105-8f65-afe7f85e6ec1 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:33.392471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:33.397520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4c07b-a807-4ac6-a3f2-fb67a7f0eced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:33.400713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4c07b-a807-4ac6-a3f2-fb67a7f0eced None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:33.401523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4c07b-a807-4ac6-a3f2-fb67a7f0eced None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:33.402020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4c07b-a807-4ac6-a3f2-fb67a7f0eced None admin] PATH_INFO: `/v3/projects/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:33.408142 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 306/604] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:33.409091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331a13c-a320-4105-8f65-afe7f85e6ec1 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:33.412687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4c07b-a807-4ac6-a3f2-fb67a7f0eced None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:33.415142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4c07b-a807-4ac6-a3f2-fb67a7f0eced None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:33.438099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-b9c4c07b-a807-4ac6-a3f2-fb67a7f0eced None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:33.438099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:33.438099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:33.438099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:33.438099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:33.438099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:33.438099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:33.438099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:33.438099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:33.438099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:33.438099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:33.438099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:33.438099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:45:33.438099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:45:33.438099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:45:33.439184 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:45:33.439184 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:33.439184 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:33.439184 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:33.439184 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:33.439184 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:33.439184 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:33.439184 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:33.439184 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:33.439184 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:33.439184 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:33.439184 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:33.439184 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:33.439184 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:33.439184 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:33.439184 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:33.439184 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:33.440116 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:45:33.440116 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:45:33.440116 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:45:33.440116 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:45:33.440116 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:45:33.440116 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:45:33.440116 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:33.440116 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:33.446292 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 299/605] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:33.446292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4c07b-a807-4ac6-a3f2-fb67a7f0eced None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:33.564737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4c07b-a807-4ac6-a3f2-fb67a7f0eced None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:33.566690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331a13c-a320-4105-8f65-afe7f85e6ec1 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:33.604381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b33a7-9059-4552-a704-6a17a884b457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:33.605180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b33a7-9059-4552-a704-6a17a884b457 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:33.605463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b33a7-9059-4552-a704-6a17a884b457 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:33.605738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b33a7-9059-4552-a704-6a17a884b457 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:33.614667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b33a7-9059-4552-a704-6a17a884b457 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:33.616209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b33a7-9059-4552-a704-6a17a884b457 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:33.619602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72370ff9-393a-4589-89ff-0c773ed321d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:33.620831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72370ff9-393a-4589-89ff-0c773ed321d2 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:33.621307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72370ff9-393a-4589-89ff-0c773ed321d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:33.621874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72370ff9-393a-4589-89ff-0c773ed321d2 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:33.623828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72370ff9-393a-4589-89ff-0c773ed321d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:33.624347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72370ff9-393a-4589-89ff-0c773ed321d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:33.626113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72370ff9-393a-4589-89ff-0c773ed321d2 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:33.631463 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-8a0b33a7-9059-4552-a704-6a17a884b457 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:33.631463 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:33.631463 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:33.631463 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:33.631463 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:33.631463 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:33.631463 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:33.631463 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:33.631463 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:33.631463 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:33.631463 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:33.631463 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:33.631463 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:45:33.631463 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:45:33.631463 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:45:33.632324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:45:33.632324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:33.632324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:33.632324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:33.632324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:33.632324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:33.632324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:33.632324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:33.632324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:33.632324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:33.632324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:33.632324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:33.632324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:33.632324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:33.632324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:33.632324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:33.632324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:33.633167 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:45:33.633167 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:45:33.633167 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:45:33.633167 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:45:33.633167 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:45:33.633167 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:45:33.633167 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:33.633167 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:33.638118 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 300/606] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:33.638498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b33a7-9059-4552-a704-6a17a884b457 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:33.639701 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 307/607] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Jul 16 20:45:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:33.646315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72370ff9-393a-4589-89ff-0c773ed321d2 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:33.690771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:33.714225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:33.766300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72370ff9-393a-4589-89ff-0c773ed321d2 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:33.791290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b33a7-9059-4552-a704-6a17a884b457 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:33.813655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a1966-e01e-4d28-9f88-db0d29928d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:33.815234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a1966-e01e-4d28-9f88-db0d29928d5c None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:33.815844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a1966-e01e-4d28-9f88-db0d29928d5c None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:33.816399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a1966-e01e-4d28-9f88-db0d29928d5c None admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:33.817632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a1966-e01e-4d28-9f88-db0d29928d5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:33.818531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a1966-e01e-4d28-9f88-db0d29928d5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:33.820818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a1966-e01e-4d28-9f88-db0d29928d5c None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:33.830280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7201c-037e-4f29-9682-78d8547227dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:33.831097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7201c-037e-4f29-9682-78d8547227dd None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:33.831445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7201c-037e-4f29-9682-78d8547227dd None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:33.831788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7201c-037e-4f29-9682-78d8547227dd None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:33.833278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7201c-037e-4f29-9682-78d8547227dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:33.833278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7201c-037e-4f29-9682-78d8547227dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:33.834625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7201c-037e-4f29-9682-78d8547227dd None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:33.840271 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 308/608] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:45:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:33.842100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a1966-e01e-4d28-9f88-db0d29928d5c None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:33.860137 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 301/609] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:45:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:33.860914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7201c-037e-4f29-9682-78d8547227dd None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:33.965169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a1966-e01e-4d28-9f88-db0d29928d5c None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:33.970334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:33.976530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7201c-037e-4f29-9682-78d8547227dd None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:33.984163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:34.003872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8761bc-a553-4935-a325-5e500d555c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:34.004910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8761bc-a553-4935-a325-5e500d555c8b None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:34.005289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8761bc-a553-4935-a325-5e500d555c8b None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:34.005692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8761bc-a553-4935-a325-5e500d555c8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:34.012886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538adc66-4049-4d90-af59-516ee95c9ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:34.014214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538adc66-4049-4d90-af59-516ee95c9ef4 None admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:34.014566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538adc66-4049-4d90-af59-516ee95c9ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:34.014908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538adc66-4049-4d90-af59-516ee95c9ef4 None admin] PATH_INFO: `/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/fbd858f3e6ba4523b056bbdc2af427b0/roles/99a4e0ec120f4163a419b2775afb8a41` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:34.017855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8761bc-a553-4935-a325-5e500d555c8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:34.019717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8761bc-a553-4935-a325-5e500d555c8b None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:34.032294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538adc66-4049-4d90-af59-516ee95c9ef4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3045a89835d4e879a0ddc2557b831a3, user_id=fbd858f3e6ba4523b056bbdc2af427b0, role_id=99a4e0ec120f4163a419b2775afb8a41)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:34.033950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538adc66-4049-4d90-af59-516ee95c9ef4 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:34.042008 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-3e8761bc-a553-4935-a325-5e500d555c8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:34.042008 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:34.042008 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:34.042008 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:34.042008 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:34.042008 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:34.042008 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:34.042008 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:34.042008 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:34.042008 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:34.042008 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:34.042008 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:34.042008 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:34.042008 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:34.042008 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:34.043229 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:34.043229 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:34.043229 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:34.043229 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:34.043229 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:34.043229 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:34.043229 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:34.043229 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:34.043229 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:34.043229 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:34.043229 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:34.043229 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:34.043229 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:34.043229 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:34.043229 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:34.043229 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:34.043229 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:34.048462 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:34.048462 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:34.048462 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:34.048462 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:34.048462 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 309/610] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:34.048462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8761bc-a553-4935-a325-5e500d555c8b None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:34.135380 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 302/611] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:45:33 2022] PUT /identity/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/fbd858f3e6ba4523b056bbdc2af427b0/roles/99a4e0ec120f4163a419b2775afb8a41 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:45:34.136784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd40d0a-ef3f-415f-a8a5-cf326422e0d4 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:34.137076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd40d0a-ef3f-415f-a8a5-cf326422e0d4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:34.137996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd40d0a-ef3f-415f-a8a5-cf326422e0d4 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:34.143155 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 303/612] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:34.143155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd40d0a-ef3f-415f-a8a5-cf326422e0d4 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:34.174954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8761bc-a553-4935-a325-5e500d555c8b None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:34.220868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e84930-bcea-459b-9643-d027b9a9ca2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:34.221741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e84930-bcea-459b-9643-d027b9a9ca2c None admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:34.222124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e84930-bcea-459b-9643-d027b9a9ca2c None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:34.222407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e84930-bcea-459b-9643-d027b9a9ca2c None admin] PATH_INFO: `/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/6dcc74f579e447938a2477e253e5d36e/roles/99a4e0ec120f4163a419b2775afb8a41` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:34.241754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e84930-bcea-459b-9643-d027b9a9ca2c None admin] RBAC: Authorizing `identity:create_grant(project_id=c3045a89835d4e879a0ddc2557b831a3, user_id=6dcc74f579e447938a2477e253e5d36e, role_id=99a4e0ec120f4163a419b2775afb8a41)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:34.243322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e84930-bcea-459b-9643-d027b9a9ca2c None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:34.289745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd40d0a-ef3f-415f-a8a5-cf326422e0d4 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:34.335535 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 310/613] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:45:34 2022] PUT /identity/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/6dcc74f579e447938a2477e253e5d36e/roles/99a4e0ec120f4163a419b2775afb8a41 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:45:34.337273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c06ec8-f5b1-4342-a94c-c2576c5aa501 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:34.337624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c06ec8-f5b1-4342-a94c-c2576c5aa501 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:34.337998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c06ec8-f5b1-4342-a94c-c2576c5aa501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:34.338147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439013b5-6198-426f-b619-8f7c36e65c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:34.338866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439013b5-6198-426f-b619-8f7c36e65c7b None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:34.339176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439013b5-6198-426f-b619-8f7c36e65c7b None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:34.339453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439013b5-6198-426f-b619-8f7c36e65c7b None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:34.340677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439013b5-6198-426f-b619-8f7c36e65c7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:34.341266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439013b5-6198-426f-b619-8f7c36e65c7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:34.342878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439013b5-6198-426f-b619-8f7c36e65c7b None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:34.358914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-97c06ec8-f5b1-4342-a94c-c2576c5aa501 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:34.359938 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 304/614] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:34.360600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-97c06ec8-f5b1-4342-a94c-c2576c5aa501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:34.372593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439013b5-6198-426f-b619-8f7c36e65c7b None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:34.386984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:34.392652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:34.464651 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 311/615] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:34.490842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c06ec8-f5b1-4342-a94c-c2576c5aa501 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:34.578385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439013b5-6198-426f-b619-8f7c36e65c7b None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:34.629981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fae67-c106-4602-8e0e-dfc2f120ac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:34.630781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fae67-c106-4602-8e0e-dfc2f120ac23 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:34.631197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fae67-c106-4602-8e0e-dfc2f120ac23 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:34.631539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fae67-c106-4602-8e0e-dfc2f120ac23 None admin] PATH_INFO: `/v3/users/swift` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:34.632503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c06ec8-f5b1-4342-a94c-c2576c5aa501 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:34.641213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fae67-c106-4602-8e0e-dfc2f120ac23 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:34.642243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fae67-c106-4602-8e0e-dfc2f120ac23 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:34.667447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-671fae67-c106-4602-8e0e-dfc2f120ac23 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 16 20:45:34.667447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:34.667447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:34.667447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:34.667447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:34.667447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:34.667447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:34.667447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:34.667447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:34.667447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:34.667447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:34.667447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:34.667447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:45:34.667447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:45:34.667447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:45:34.667447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:45:34.668928 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:34.668928 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:34.668928 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:45:34.668928 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:34.668928 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:45:34.668928 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:34.668928 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:34.668928 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:34.668928 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:34.668928 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:34.668928 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:34.668928 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:34.668928 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:34.668928 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:34.668928 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:34.668928 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:34.668928 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:34.668928 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:34.670510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:34.670510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:34.670510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:45:34.670510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:45:34.670510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:45:34.670510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:45:34.670510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:45:34.670510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:45:34.670510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 16 20:45:34.670510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:34.670510 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 305/616] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:45:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:34.676307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fae67-c106-4602-8e0e-dfc2f120ac23 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:34.696243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc3872-67a1-4477-bd15-1769c32552bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:34.697166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc3872-67a1-4477-bd15-1769c32552bb None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:34.697448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc3872-67a1-4477-bd15-1769c32552bb None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:34.697722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc3872-67a1-4477-bd15-1769c32552bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:34.727148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc3872-67a1-4477-bd15-1769c32552bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:34.741435 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-70bc3872-67a1-4477-bd15-1769c32552bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:34.741435 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:34.741435 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:34.741435 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:34.741435 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:34.741435 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:34.741435 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:34.741435 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:34.741435 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:34.741435 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:34.741435 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:34.741435 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:34.741435 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:34.741435 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:34.741435 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:34.741435 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:34.743706 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:34.743706 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:34.743706 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:34.743706 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:34.743706 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:34.743706 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:34.743706 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:34.743706 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:34.743706 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:34.743706 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:34.743706 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:34.743706 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:34.743706 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:34.743706 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:34.743706 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:34.743706 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:34.745073 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:34.745073 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:34.745073 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:34.745073 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:34.745073 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:34.745073 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:34.745073 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:34.745073 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:34.745073 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:34.745073 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:34.745073 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:34.745073 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:34.745073 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 312/617] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:45:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:45:34.758156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc3872-67a1-4477-bd15-1769c32552bb None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:34.782896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:34.796129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:34.881218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fae67-c106-4602-8e0e-dfc2f120ac23 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:34.926994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb7a64-b0e3-423f-889e-4eb9c28ea3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:34.927855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb7a64-b0e3-423f-889e-4eb9c28ea3d4 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:34.928134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb7a64-b0e3-423f-889e-4eb9c28ea3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:34.928406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb7a64-b0e3-423f-889e-4eb9c28ea3d4 None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:34.929255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb7a64-b0e3-423f-889e-4eb9c28ea3d4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:34.929561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb7a64-b0e3-423f-889e-4eb9c28ea3d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:34.931038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb7a64-b0e3-423f-889e-4eb9c28ea3d4 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:34.981732 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 306/618] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Jul 16 20:45:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:34.987808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb7a64-b0e3-423f-889e-4eb9c28ea3d4 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:34.994953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc3872-67a1-4477-bd15-1769c32552bb None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:35.046686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19299b43-e43f-4cda-9974-a7a32f2ad0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:35.047948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19299b43-e43f-4cda-9974-a7a32f2ad0c3 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:35.048418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19299b43-e43f-4cda-9974-a7a32f2ad0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:35.048879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19299b43-e43f-4cda-9974-a7a32f2ad0c3 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:35.050543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19299b43-e43f-4cda-9974-a7a32f2ad0c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:35.051128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19299b43-e43f-4cda-9974-a7a32f2ad0c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:35.052758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19299b43-e43f-4cda-9974-a7a32f2ad0c3 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:35.063375 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 313/619] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Jul 16 20:45:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:35.069208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19299b43-e43f-4cda-9974-a7a32f2ad0c3 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:35.152549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:35.165917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb7a64-b0e3-423f-889e-4eb9c28ea3d4 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:35.195212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19299b43-e43f-4cda-9974-a7a32f2ad0c3 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:35.234143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c199452-e122-4b40-9f7b-1ed5d8ac103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:35.235328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c199452-e122-4b40-9f7b-1ed5d8ac103c None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:35.235836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c199452-e122-4b40-9f7b-1ed5d8ac103c None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:35.236467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c199452-e122-4b40-9f7b-1ed5d8ac103c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:35.248364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:35.249968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c199452-e122-4b40-9f7b-1ed5d8ac103c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:35.252078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c199452-e122-4b40-9f7b-1ed5d8ac103c None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:35.260286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc869b6-a933-4b45-bc85-e6dc78c129da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:35.261036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc869b6-a933-4b45-bc85-e6dc78c129da None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:35.261315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc869b6-a933-4b45-bc85-e6dc78c129da None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:35.261584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc869b6-a933-4b45-bc85-e6dc78c129da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:35.272458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc869b6-a933-4b45-bc85-e6dc78c129da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:35.273946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc869b6-a933-4b45-bc85-e6dc78c129da None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:35.274338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-7c199452-e122-4b40-9f7b-1ed5d8ac103c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:35.274338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:35.274338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:35.274338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:35.274338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:35.274338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:35.274338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:35.274338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:35.274338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:35.274338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:35.274338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:35.274338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:35.274338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:35.274338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:35.274338 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:35.275228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:35.275228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:35.275228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:35.275228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:35.275228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:35.275228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:35.275228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:35.275228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:35.275228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:35.275228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:35.275228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:35.275228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:35.275228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:35.275228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:35.275228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:35.275228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:35.275228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:35.276100 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:35.276100 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:35.276100 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:35.276100 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:35.278945 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 314/620] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:35.285355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad84f8-a97a-4bd8-962b-0ae2dfe56240 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:35.286219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad84f8-a97a-4bd8-962b-0ae2dfe56240 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:35.286662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad84f8-a97a-4bd8-962b-0ae2dfe56240 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:35.288746 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 315/621] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:35.289606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad84f8-a97a-4bd8-962b-0ae2dfe56240 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:35.298205 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-bbc869b6-a933-4b45-bc85-e6dc78c129da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:35.298205 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:35.298205 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:35.298205 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:35.298205 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:35.298205 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:35.298205 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:35.298205 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:35.298205 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:35.298205 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:35.298205 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:35.298205 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:35.298205 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:35.298205 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:35.298205 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:35.299284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:35.299284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:35.299284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:35.299284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:35.299284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:35.299284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:35.299284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:35.299284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:35.299284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:35.299284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:35.299284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:35.299284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:35.299284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:35.299284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:35.299284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:35.299284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:35.299284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:35.300321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:35.300321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:35.300321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:35.300321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:35.303023 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 307/622] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:35.304384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e45d64-13af-4779-ab50-6d62529d5f7f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:35.304813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e45d64-13af-4779-ab50-6d62529d5f7f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:35.305247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e45d64-13af-4779-ab50-6d62529d5f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:35.328570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-49e45d64-13af-4779-ab50-6d62529d5f7f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:35.330288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-49e45d64-13af-4779-ab50-6d62529d5f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:35.413611 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 308/623] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:35.414757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e45d64-13af-4779-ab50-6d62529d5f7f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:35.425860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad84f8-a97a-4bd8-962b-0ae2dfe56240 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:35.456483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:35.471712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf11007-fce0-4a68-9a43-4497aa8536b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:35.472373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf11007-fce0-4a68-9a43-4497aa8536b7 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:35.472656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf11007-fce0-4a68-9a43-4497aa8536b7 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:35.473214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf11007-fce0-4a68-9a43-4497aa8536b7 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:35.473656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf11007-fce0-4a68-9a43-4497aa8536b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:35.473961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf11007-fce0-4a68-9a43-4497aa8536b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:35.475430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf11007-fce0-4a68-9a43-4497aa8536b7 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:35.488981 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 316/624] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:35.489616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf11007-fce0-4a68-9a43-4497aa8536b7 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:35.560624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e45d64-13af-4779-ab50-6d62529d5f7f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:35.570149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:35.603619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35ec97-c6e8-4507-8a92-a25e6064e24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:35.604653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35ec97-c6e8-4507-8a92-a25e6064e24b None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:35.604979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf11007-fce0-4a68-9a43-4497aa8536b7 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:35.605373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35ec97-c6e8-4507-8a92-a25e6064e24b None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:35.605924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35ec97-c6e8-4507-8a92-a25e6064e24b None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:35.607500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35ec97-c6e8-4507-8a92-a25e6064e24b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:35.608951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35ec97-c6e8-4507-8a92-a25e6064e24b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:35.610545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35ec97-c6e8-4507-8a92-a25e6064e24b None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:35.625130 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 309/625] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:35.626259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35ec97-c6e8-4507-8a92-a25e6064e24b None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:35.641812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09754fd-8dd1-483a-aac4-f97fd0a48efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:35.642671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09754fd-8dd1-483a-aac4-f97fd0a48efb None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:35.642962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09754fd-8dd1-483a-aac4-f97fd0a48efb None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:35.643261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09754fd-8dd1-483a-aac4-f97fd0a48efb None admin] PATH_INFO: `/v3/roles/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:35.655428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09754fd-8dd1-483a-aac4-f97fd0a48efb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:35.663221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-c09754fd-8dd1-483a-aac4-f97fd0a48efb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:35.663221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:35.663221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:35.663221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:35.663221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:35.663221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:35.663221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:35.663221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:35.663221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:35.663221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:35.663221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:35.663221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:35.663221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:35.663221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:35.663221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:35.663221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:35.664182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:35.664182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:35.664182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:35.664182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:35.664182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:35.664182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:35.664182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:35.664182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:35.664182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:35.664182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:35.664182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:35.664182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:35.664182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:35.664182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:35.664182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:35.664182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:35.671280 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:35.671280 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:35.671280 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:35.671280 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:35.671280 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:35.671280 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:35.671280 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:35.671280 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:35.671280 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:35.671280 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:35.671280 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:35.671280 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:35.671280 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 317/626] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:45:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:35.671280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09754fd-8dd1-483a-aac4-f97fd0a48efb None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:35.720776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:35.758537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35ec97-c6e8-4507-8a92-a25e6064e24b None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:35.776105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09754fd-8dd1-483a-aac4-f97fd0a48efb None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:35.801414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d783d-83b0-4261-b24a-f3ce23b27d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:35.802979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d783d-83b0-4261-b24a-f3ce23b27d6d None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:35.803503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d783d-83b0-4261-b24a-f3ce23b27d6d None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:35.803976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d783d-83b0-4261-b24a-f3ce23b27d6d None admin] PATH_INFO: `/v3/users/nova` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:35.813744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d783d-83b0-4261-b24a-f3ce23b27d6d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:35.815765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d783d-83b0-4261-b24a-f3ce23b27d6d None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:35.826784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51116baa-b64b-4c6b-ab5c-499892ac57da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:35.827618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51116baa-b64b-4c6b-ab5c-499892ac57da None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:35.827897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51116baa-b64b-4c6b-ab5c-499892ac57da None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:35.828169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51116baa-b64b-4c6b-ab5c-499892ac57da None admin] PATH_INFO: `/v3/projects/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:35.833177 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-8a3d783d-83b0-4261-b24a-f3ce23b27d6d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 16 20:45:35.833177 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:35.833177 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:35.833177 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:35.833177 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:35.833177 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:35.833177 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:35.833177 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:35.833177 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:35.833177 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:35.833177 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:35.833177 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:35.833177 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:45:35.833177 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:45:35.833177 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:45:35.833177 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:45:35.834137 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:35.834137 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:35.834137 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:45:35.834137 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:35.834137 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:45:35.834137 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:35.834137 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:35.834137 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:35.834137 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:35.834137 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:35.834137 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:35.834137 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:35.834137 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:35.834137 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:35.834137 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:35.834137 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:35.834137 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:35.834137 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:35.835115 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:35.835115 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:35.835115 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:45:35.835115 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:45:35.835115 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:45:35.835115 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:45:35.835115 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:45:35.835115 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:45:35.835115 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 16 20:45:35.835115 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:35.835739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51116baa-b64b-4c6b-ab5c-499892ac57da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:35.837015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51116baa-b64b-4c6b-ab5c-499892ac57da None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:35.838296 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 310/627] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Jul 16 20:45:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:35.839461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d783d-83b0-4261-b24a-f3ce23b27d6d None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:35.866020 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-51116baa-b64b-4c6b-ab5c-499892ac57da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:35.866020 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:35.866020 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:35.866020 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:35.866020 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:35.866020 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:35.866020 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:35.866020 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:35.866020 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:35.866020 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:35.866020 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:35.866020 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:35.866020 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:45:35.866020 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:45:35.866020 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:45:35.866898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:45:35.866898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:35.866898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:35.866898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:35.866898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:35.866898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:35.866898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:35.866898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:35.866898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:35.866898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:35.866898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:35.866898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:35.866898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:35.866898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:35.866898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:35.866898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:35.866898 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:35.867808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:45:35.867808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:45:35.867808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:45:35.867808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:45:35.867808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:45:35.867808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:45:35.867808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:35.867808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:35.867808 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 318/628] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:35.868308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51116baa-b64b-4c6b-ab5c-499892ac57da None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:35.875258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:35.958825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d783d-83b0-4261-b24a-f3ce23b27d6d None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:35.973503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51116baa-b64b-4c6b-ab5c-499892ac57da None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:35.975853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:35.998905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7859daa-9764-4649-8e99-dc2df9bfd5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:35.999932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7859daa-9764-4649-8e99-dc2df9bfd5fe None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:36.000479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7859daa-9764-4649-8e99-dc2df9bfd5fe None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:36.000955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7859daa-9764-4649-8e99-dc2df9bfd5fe None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:36.001996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7859daa-9764-4649-8e99-dc2df9bfd5fe None admin] RBAC: Adding query filter params (name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:36.002506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7859daa-9764-4649-8e99-dc2df9bfd5fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:36.004149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7859daa-9764-4649-8e99-dc2df9bfd5fe None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:36.009214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7970031-d4aa-45d1-ab72-ad5823df16cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:36.009874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7970031-d4aa-45d1-ab72-ad5823df16cf None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:36.010686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7970031-d4aa-45d1-ab72-ad5823df16cf None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:36.011236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7970031-d4aa-45d1-ab72-ad5823df16cf None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:36.013125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7970031-d4aa-45d1-ab72-ad5823df16cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:36.013861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7970031-d4aa-45d1-ab72-ad5823df16cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:36.015022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7970031-d4aa-45d1-ab72-ad5823df16cf None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:36.022373 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 311/629] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Jul 16 20:45:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:36.023715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7859daa-9764-4649-8e99-dc2df9bfd5fe None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:36.039851 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 319/630] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Jul 16 20:45:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:36.040636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7970031-d4aa-45d1-ab72-ad5823df16cf None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:36.126041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:36.139874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7859daa-9764-4649-8e99-dc2df9bfd5fe None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:36.144190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7970031-d4aa-45d1-ab72-ad5823df16cf None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:36.178280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47babd0-2e72-404d-a72c-2af3999f9589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:36.179212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47babd0-2e72-404d-a72c-2af3999f9589 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:36.179661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47babd0-2e72-404d-a72c-2af3999f9589 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:36.180068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47babd0-2e72-404d-a72c-2af3999f9589 None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:36.180892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1694a67-361d-4bc7-a754-1a8e0c744492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:36.181177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47babd0-2e72-404d-a72c-2af3999f9589 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:36.181621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47babd0-2e72-404d-a72c-2af3999f9589 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:36.181730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1694a67-361d-4bc7-a754-1a8e0c744492 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:36.181952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1694a67-361d-4bc7-a754-1a8e0c744492 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:36.182406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1694a67-361d-4bc7-a754-1a8e0c744492 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:36.183890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47babd0-2e72-404d-a72c-2af3999f9589 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:36.194040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1694a67-361d-4bc7-a754-1a8e0c744492 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:36.195519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1694a67-361d-4bc7-a754-1a8e0c744492 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:36.202991 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 312/631] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:45:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:36.204239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47babd0-2e72-404d-a72c-2af3999f9589 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:36.214973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-c1694a67-361d-4bc7-a754-1a8e0c744492 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:36.214973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:36.214973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:36.214973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:36.214973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:36.214973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:36.214973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:36.214973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:36.214973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:36.214973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:36.214973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:36.214973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:36.214973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:36.214973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:36.214973 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:36.216649 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:36.216649 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:36.216649 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:36.216649 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:36.216649 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:36.216649 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:36.216649 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:36.216649 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:36.216649 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:36.216649 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:36.216649 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:36.216649 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:36.216649 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:36.216649 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:36.216649 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:36.216649 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:36.216649 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:36.217669 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:36.217669 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:36.217669 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:36.217669 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:36.217669 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 320/632] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:36.217669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1694a67-361d-4bc7-a754-1a8e0c744492 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:36.234785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:36.322622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47babd0-2e72-404d-a72c-2af3999f9589 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:36.324448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1694a67-361d-4bc7-a754-1a8e0c744492 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:36.361337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681999ad-6b57-4034-b363-582cfe6e3900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:36.362095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025959c-68bf-4647-bb4c-41509cdf0906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:36.362227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681999ad-6b57-4034-b363-582cfe6e3900 None admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:36.362488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681999ad-6b57-4034-b363-582cfe6e3900 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:36.362762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681999ad-6b57-4034-b363-582cfe6e3900 None admin] PATH_INFO: `/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/9a66df01ea414b34a8842488b145974f/roles/99a4e0ec120f4163a419b2775afb8a41` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:36.363423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025959c-68bf-4647-bb4c-41509cdf0906 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:36.363838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025959c-68bf-4647-bb4c-41509cdf0906 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:36.364247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025959c-68bf-4647-bb4c-41509cdf0906 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:36.379409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681999ad-6b57-4034-b363-582cfe6e3900 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3045a89835d4e879a0ddc2557b831a3, user_id=9a66df01ea414b34a8842488b145974f, role_id=99a4e0ec120f4163a419b2775afb8a41)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:36.380781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681999ad-6b57-4034-b363-582cfe6e3900 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:36.386504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:36.439351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025959c-68bf-4647-bb4c-41509cdf0906 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:36.440832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025959c-68bf-4647-bb4c-41509cdf0906 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:36.459585 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 321/633] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:45:36 2022] PUT /identity/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/9a66df01ea414b34a8842488b145974f/roles/99a4e0ec120f4163a419b2775afb8a41 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:45:36.461268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681999ad-6b57-4034-b363-582cfe6e3900 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:36.625861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:36.635828 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 313/634] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:45:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:45:36.641589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025959c-68bf-4647-bb4c-41509cdf0906 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:36.696254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:36.704283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681999ad-6b57-4034-b363-582cfe6e3900 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:36.743465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6001d-1064-4271-b8a0-d7b834af88c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:36.744816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6001d-1064-4271-b8a0-d7b834af88c7 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:36.745547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6001d-1064-4271-b8a0-d7b834af88c7 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:36.746002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6001d-1064-4271-b8a0-d7b834af88c7 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:36.748461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6001d-1064-4271-b8a0-d7b834af88c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:36.749287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6001d-1064-4271-b8a0-d7b834af88c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:36.751389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6001d-1064-4271-b8a0-d7b834af88c7 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:36.753794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025959c-68bf-4647-bb4c-41509cdf0906 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:36.767487 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 322/635] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:36.773292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6001d-1064-4271-b8a0-d7b834af88c7 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:36.796678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcadecc-e3aa-4532-8bc9-38e321f7ec0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:36.797375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcadecc-e3aa-4532-8bc9-38e321f7ec0a None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:36.797688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcadecc-e3aa-4532-8bc9-38e321f7ec0a None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:36.797963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcadecc-e3aa-4532-8bc9-38e321f7ec0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:36.811260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcadecc-e3aa-4532-8bc9-38e321f7ec0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:36.812814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcadecc-e3aa-4532-8bc9-38e321f7ec0a None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:36.836957 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-cdcadecc-e3aa-4532-8bc9-38e321f7ec0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:36.836957 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:36.836957 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:36.836957 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:36.836957 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:36.836957 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:36.836957 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:36.836957 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:36.836957 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:36.836957 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:36.836957 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:36.836957 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:36.836957 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:36.836957 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:36.836957 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:36.837898 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:36.837898 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:36.837898 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:36.837898 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:36.837898 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:36.837898 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:36.837898 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:36.837898 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:36.837898 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:36.837898 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:36.837898 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:36.837898 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:36.837898 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:36.837898 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:36.837898 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:36.837898 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:36.837898 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:36.838760 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:36.838760 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:36.838760 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:36.838760 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:36.838760 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 314/636] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:45:36.844501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8b67e-8946-496b-a1bd-7a9f39684118 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:36.844787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8b67e-8946-496b-a1bd-7a9f39684118 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:36.849357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8b67e-8946-496b-a1bd-7a9f39684118 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:36.849357 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 315/637] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:36.849357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8b67e-8946-496b-a1bd-7a9f39684118 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:36.910568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6001d-1064-4271-b8a0-d7b834af88c7 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:36.939339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:36.952209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ff9e3-47b2-4fcf-a671-34f5fd1550fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:36.953073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ff9e3-47b2-4fcf-a671-34f5fd1550fb None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:36.953357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ff9e3-47b2-4fcf-a671-34f5fd1550fb None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:36.953636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ff9e3-47b2-4fcf-a671-34f5fd1550fb None admin] PATH_INFO: `/v3/users/glance` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:36.964026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:36.964469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ff9e3-47b2-4fcf-a671-34f5fd1550fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:36.966820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ff9e3-47b2-4fcf-a671-34f5fd1550fb None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:36.968420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8b67e-8946-496b-a1bd-7a9f39684118 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:36.983288 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-616ff9e3-47b2-4fcf-a671-34f5fd1550fb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 16 20:45:36.983288 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:36.983288 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:36.983288 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:36.983288 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:36.983288 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:36.983288 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:36.983288 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:36.983288 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:36.983288 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:36.983288 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:36.983288 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:36.983288 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:45:36.983288 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:45:36.983288 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:45:36.983288 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:45:36.984443 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:36.984443 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:36.984443 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:45:36.984443 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:36.984443 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:45:36.984443 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:36.984443 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:36.984443 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:36.984443 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:36.984443 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:36.984443 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:36.984443 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:36.984443 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:36.984443 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:36.984443 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:36.984443 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:36.984443 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:36.984443 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:36.985421 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:36.985421 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:36.985421 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:45:36.985421 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:45:36.985421 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:45:36.985421 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:45:36.985421 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:45:36.985421 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:45:36.985421 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 16 20:45:36.985421 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:36.987741 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 323/638] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:45:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:45:36.989258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df1f30-e0f7-40e7-9192-5e014cccdd69 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:36.989759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df1f30-e0f7-40e7-9192-5e014cccdd69 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:36.990205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df1f30-e0f7-40e7-9192-5e014cccdd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:37.005961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85100255-4f29-45ac-9fef-49a9c7557dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:37.006625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85100255-4f29-45ac-9fef-49a9c7557dd8 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:37.006950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85100255-4f29-45ac-9fef-49a9c7557dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:37.007258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85100255-4f29-45ac-9fef-49a9c7557dd8 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:37.007984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85100255-4f29-45ac-9fef-49a9c7557dd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:37.008341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85100255-4f29-45ac-9fef-49a9c7557dd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:37.009872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85100255-4f29-45ac-9fef-49a9c7557dd8 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:37.010677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a0df1f30-e0f7-40e7-9192-5e014cccdd69 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:37.012134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a0df1f30-e0f7-40e7-9192-5e014cccdd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:37.027177 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 316/639] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:37.028162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85100255-4f29-45ac-9fef-49a9c7557dd8 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:37.086752 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 324/640] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:37.087784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df1f30-e0f7-40e7-9192-5e014cccdd69 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:37.156671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85100255-4f29-45ac-9fef-49a9c7557dd8 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:37.198796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea551c-ac1d-4a84-9eb5-51e7f57079ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:37.199595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea551c-ac1d-4a84-9eb5-51e7f57079ff None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:37.200550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea551c-ac1d-4a84-9eb5-51e7f57079ff None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:37.201163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea551c-ac1d-4a84-9eb5-51e7f57079ff None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:37.202207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea551c-ac1d-4a84-9eb5-51e7f57079ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:37.202597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea551c-ac1d-4a84-9eb5-51e7f57079ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:37.204139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea551c-ac1d-4a84-9eb5-51e7f57079ff None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:37.214907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df1f30-e0f7-40e7-9192-5e014cccdd69 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:37.225261 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 317/641] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Jul 16 20:45:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:37.226797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dae99-d51f-4c4b-a67a-7b2d104fb30f None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:37.227174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dae99-d51f-4c4b-a67a-7b2d104fb30f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:37.227513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dae99-d51f-4c4b-a67a-7b2d104fb30f None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:37.228923 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 318/642] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:37.229555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765dae99-d51f-4c4b-a67a-7b2d104fb30f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:37.237004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:37.250912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:37.259065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03006b-90dd-492d-a49d-fb80a99aed45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:37.259946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03006b-90dd-492d-a49d-fb80a99aed45 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:37.260251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03006b-90dd-492d-a49d-fb80a99aed45 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:37.260821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03006b-90dd-492d-a49d-fb80a99aed45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:37.268649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03006b-90dd-492d-a49d-fb80a99aed45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:37.271789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03006b-90dd-492d-a49d-fb80a99aed45 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:37.286440 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-cd03006b-90dd-492d-a49d-fb80a99aed45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:37.286440 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:37.286440 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:37.286440 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:37.286440 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:37.286440 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:37.286440 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:37.286440 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:37.286440 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:37.286440 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:37.286440 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:37.286440 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:37.286440 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:45:37.286440 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:45:37.286440 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:45:37.287475 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:45:37.287475 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:37.287475 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:37.287475 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:37.287475 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:37.287475 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:37.287475 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:37.287475 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:37.287475 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:37.287475 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:37.287475 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:37.287475 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:37.287475 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:37.287475 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:37.287475 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:37.287475 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:37.287475 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:37.288423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:45:37.288423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:45:37.288423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:45:37.288423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:45:37.288423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:45:37.288423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:45:37.288423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:37.288423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:37.288423 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 325/643] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:37.289481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e22aed-57e0-419a-bb38-2aead9371b47 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:37.289651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e22aed-57e0-419a-bb38-2aead9371b47 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:37.290370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e22aed-57e0-419a-bb38-2aead9371b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:37.306936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-30e22aed-57e0-419a-bb38-2aead9371b47 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:37.308153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-30e22aed-57e0-419a-bb38-2aead9371b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:37.349362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765dae99-d51f-4c4b-a67a-7b2d104fb30f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:37.383062 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 326/644] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:37.383914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e22aed-57e0-419a-bb38-2aead9371b47 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:37.395158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd2687-3b5d-4f33-9b4f-ea57673dd3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:37.396779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd2687-3b5d-4f33-9b4f-ea57673dd3d1 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:37.397232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd2687-3b5d-4f33-9b4f-ea57673dd3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:37.397653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd2687-3b5d-4f33-9b4f-ea57673dd3d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:37.412684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd2687-3b5d-4f33-9b4f-ea57673dd3d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:37.420767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-41dd2687-3b5d-4f33-9b4f-ea57673dd3d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:37.420767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:37.420767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:37.420767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:37.420767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:37.420767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:37.420767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:37.420767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:37.420767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:37.420767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:37.420767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:37.420767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:37.420767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:37.420767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:37.420767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:37.420767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:37.421689 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:37.421689 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:37.421689 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:37.421689 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:37.421689 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:37.421689 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:37.421689 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:37.421689 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:37.421689 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:37.421689 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:37.421689 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:37.421689 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:37.421689 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:37.421689 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:37.421689 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:37.421689 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:37.422618 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:37.422618 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:37.422618 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:37.422618 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:37.422618 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:37.422618 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:37.422618 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:37.422618 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:37.422618 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:37.422618 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:37.422618 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:37.422618 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:37.426833 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 319/645] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:45:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:37.427738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd2687-3b5d-4f33-9b4f-ea57673dd3d1 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:37.491631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e22aed-57e0-419a-bb38-2aead9371b47 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:37.494654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:37.510945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:37.530334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d548338-84c2-4295-ae2e-ba0e2c4d7fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:37.530982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d548338-84c2-4295-ae2e-ba0e2c4d7fb2 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:37.531287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d548338-84c2-4295-ae2e-ba0e2c4d7fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:37.531557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d548338-84c2-4295-ae2e-ba0e2c4d7fb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:37.534741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd2687-3b5d-4f33-9b4f-ea57673dd3d1 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:37.574083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e8e85-93a6-4c68-a9b8-23025665fc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:37.575529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e8e85-93a6-4c68-a9b8-23025665fc3d None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:37.575820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e8e85-93a6-4c68-a9b8-23025665fc3d None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:37.576098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e8e85-93a6-4c68-a9b8-23025665fc3d None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:37.576883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e8e85-93a6-4c68-a9b8-23025665fc3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:37.577204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e8e85-93a6-4c68-a9b8-23025665fc3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:37.578641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e8e85-93a6-4c68-a9b8-23025665fc3d None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:37.596702 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 320/646] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:45:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:37.596702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e8e85-93a6-4c68-a9b8-23025665fc3d None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:37.611613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d548338-84c2-4295-ae2e-ba0e2c4d7fb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:37.613499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d548338-84c2-4295-ae2e-ba0e2c4d7fb2 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:37.701428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e8e85-93a6-4c68-a9b8-23025665fc3d None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:37.733175 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 327/647] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:45:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:45:37.734586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d548338-84c2-4295-ae2e-ba0e2c4d7fb2 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:37.739417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:37.751824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c66c85-d99d-4bd3-a46c-5dfdb87ebb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:37.751824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c66c85-d99d-4bd3-a46c-5dfdb87ebb92 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:37.751824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c66c85-d99d-4bd3-a46c-5dfdb87ebb92 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:37.751824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c66c85-d99d-4bd3-a46c-5dfdb87ebb92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:37.759533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:37.764866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c66c85-d99d-4bd3-a46c-5dfdb87ebb92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:37.773033 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-40c66c85-d99d-4bd3-a46c-5dfdb87ebb92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:37.773033 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:37.773033 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:37.773033 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:37.773033 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:37.773033 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:37.773033 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:37.773033 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:37.773033 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:37.773033 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:37.773033 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:37.773033 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:37.773033 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:37.773033 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:37.773033 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:37.773033 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:37.774045 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:37.774045 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:37.774045 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:37.774045 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:37.774045 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:37.774045 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:37.774045 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:37.774045 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:37.774045 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:37.774045 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:37.774045 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:37.774045 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:37.774045 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:37.774045 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:37.774045 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:37.774045 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:37.778790 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:37.778790 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:37.778790 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:37.778790 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:37.778790 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:37.778790 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:37.778790 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:37.778790 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:37.778790 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:37.778790 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:37.778790 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:37.778790 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:37.778790 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 321/648] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:45:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:37.778790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c66c85-d99d-4bd3-a46c-5dfdb87ebb92 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:37.860393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d548338-84c2-4295-ae2e-ba0e2c4d7fb2 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:37.902918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c66c85-d99d-4bd3-a46c-5dfdb87ebb92 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:37.905186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5eb70-9817-46be-9913-62c51005a8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:37.906743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5eb70-9817-46be-9913-62c51005a8a7 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:37.907042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5eb70-9817-46be-9913-62c51005a8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:37.907333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5eb70-9817-46be-9913-62c51005a8a7 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:37.908093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5eb70-9817-46be-9913-62c51005a8a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:37.908395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5eb70-9817-46be-9913-62c51005a8a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:37.909784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5eb70-9817-46be-9913-62c51005a8a7 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:37.926363 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 328/649] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Jul 16 20:45:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:37.926363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5eb70-9817-46be-9913-62c51005a8a7 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:37.942820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b852fc-e43e-47be-aa1f-299ce2e252a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:37.943602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b852fc-e43e-47be-aa1f-299ce2e252a5 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:37.943891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b852fc-e43e-47be-aa1f-299ce2e252a5 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:37.944170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b852fc-e43e-47be-aa1f-299ce2e252a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:37.945000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b852fc-e43e-47be-aa1f-299ce2e252a5 None admin] RBAC: Adding query filter params (role.id=99a4e0ec120f4163a419b2775afb8a41, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=d5f515bfe2094b41afe82b4bc57e4b9a) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:37.945317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b852fc-e43e-47be-aa1f-299ce2e252a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:37.946839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b852fc-e43e-47be-aa1f-299ce2e252a5 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:37.954098 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 322/650] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:45:37 2022] GET /identity/v3/role_assignments?user.id=d5f515bfe2094b41afe82b4bc57e4b9a&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=99a4e0ec120f4163a419b2775afb8a41 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:37.954815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b852fc-e43e-47be-aa1f-299ce2e252a5 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:38.012337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:38.035518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:38.066460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5eb70-9817-46be-9913-62c51005a8a7 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:38.088145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b852fc-e43e-47be-aa1f-299ce2e252a5 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:38.110415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48494553-66e8-4adf-af4e-8285568fc4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:38.111402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48494553-66e8-4adf-af4e-8285568fc4e6 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:38.111762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48494553-66e8-4adf-af4e-8285568fc4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:38.112113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48494553-66e8-4adf-af4e-8285568fc4e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:38.128517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48494553-66e8-4adf-af4e-8285568fc4e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:38.130102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48494553-66e8-4adf-af4e-8285568fc4e6 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:38.131920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1b471-0d13-467f-bf5c-e0a34d9b2d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:38.132860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1b471-0d13-467f-bf5c-e0a34d9b2d89 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:38.133549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1b471-0d13-467f-bf5c-e0a34d9b2d89 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:38.134014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1b471-0d13-467f-bf5c-e0a34d9b2d89 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:38.134966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1b471-0d13-467f-bf5c-e0a34d9b2d89 None admin] RBAC: Adding query filter params (name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:38.135503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1b471-0d13-467f-bf5c-e0a34d9b2d89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:38.137264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1b471-0d13-467f-bf5c-e0a34d9b2d89 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:38.147490 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 323/651] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Jul 16 20:45:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:38.148729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1b471-0d13-467f-bf5c-e0a34d9b2d89 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:38.151076 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-48494553-66e8-4adf-af4e-8285568fc4e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:38.151076 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:38.151076 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:38.151076 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:38.151076 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:38.151076 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:38.151076 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:38.151076 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:38.151076 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:38.151076 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:38.151076 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:38.151076 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:38.151076 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:38.151076 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:38.151076 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:38.152132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:38.152132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:38.152132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:38.152132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:38.152132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:38.152132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:38.152132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:38.152132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:38.152132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:38.152132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:38.152132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:38.152132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:38.152132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:38.152132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:38.152132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:38.152132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:38.152132 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:38.153621 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:38.153621 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:38.153621 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:38.153621 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:38.153621 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 329/652] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:38.154485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48494553-66e8-4adf-af4e-8285568fc4e6 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:38.306786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48494553-66e8-4adf-af4e-8285568fc4e6 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:38.306978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1b471-0d13-467f-bf5c-e0a34d9b2d89 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:38.328334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:38.346745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:38.347999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a5214-ff5f-4213-bd42-b1a3e136f68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:38.349011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a5214-ff5f-4213-bd42-b1a3e136f68b None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:38.349474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a5214-ff5f-4213-bd42-b1a3e136f68b None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:38.349924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a5214-ff5f-4213-bd42-b1a3e136f68b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:38.359938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8b0cf-68a6-4f67-b2f8-835a31876383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:38.361107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8b0cf-68a6-4f67-b2f8-835a31876383 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:38.361466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8b0cf-68a6-4f67-b2f8-835a31876383 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:38.362079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a5214-ff5f-4213-bd42-b1a3e136f68b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:38.362561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8b0cf-68a6-4f67-b2f8-835a31876383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:38.364288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a5214-ff5f-4213-bd42-b1a3e136f68b None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:38.378192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8b0cf-68a6-4f67-b2f8-835a31876383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:38.379743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8b0cf-68a6-4f67-b2f8-835a31876383 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:38.386347 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-c72a5214-ff5f-4213-bd42-b1a3e136f68b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:38.386347 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:38.386347 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:38.386347 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:38.386347 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:38.386347 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:38.386347 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:38.386347 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:38.386347 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:38.386347 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:38.386347 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:38.386347 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:38.386347 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:38.386347 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:38.386347 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:38.388041 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:38.388041 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:38.388041 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:38.388041 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:38.388041 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:38.388041 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:38.388041 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:38.388041 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:38.388041 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:38.388041 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:38.388041 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:38.388041 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:38.388041 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:38.388041 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:38.388041 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:38.388041 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:38.388041 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:38.389018 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:38.389018 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:38.389018 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:38.389018 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:38.391370 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 330/653] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:38.392547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a5214-ff5f-4213-bd42-b1a3e136f68b None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:38.400767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-81e8b0cf-68a6-4f67-b2f8-835a31876383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:38.400767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:38.400767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:38.400767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:38.400767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:38.400767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:38.400767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:38.400767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:38.400767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:38.400767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:38.400767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:38.400767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:38.400767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:38.400767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:38.400767 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:38.401700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:38.401700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:38.401700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:38.401700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:38.401700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:38.401700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:38.401700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:38.401700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:38.401700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:38.401700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:38.401700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:38.401700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:38.401700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:38.401700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:38.401700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:38.401700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:38.401700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:38.403541 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:38.403541 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:38.403541 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:38.403541 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:38.403541 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 324/654] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:38.408211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8b0cf-68a6-4f67-b2f8-835a31876383 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:38.520236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a5214-ff5f-4213-bd42-b1a3e136f68b None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:38.552191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8b0cf-68a6-4f67-b2f8-835a31876383 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:38.563640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b11aba-aff3-445d-aaec-80a7bd160d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:38.564676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b11aba-aff3-445d-aaec-80a7bd160d72 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:38.565197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b11aba-aff3-445d-aaec-80a7bd160d72 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:38.565677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b11aba-aff3-445d-aaec-80a7bd160d72 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:38.566706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b11aba-aff3-445d-aaec-80a7bd160d72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:38.567250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b11aba-aff3-445d-aaec-80a7bd160d72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:38.574154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b11aba-aff3-445d-aaec-80a7bd160d72 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:38.583325 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 331/655] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:38.584513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b11aba-aff3-445d-aaec-80a7bd160d72 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:38.597485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a1858-2db4-4e29-84fc-c7e08956a851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:38.598158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a1858-2db4-4e29-84fc-c7e08956a851 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:38.598444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a1858-2db4-4e29-84fc-c7e08956a851 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:38.598721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a1858-2db4-4e29-84fc-c7e08956a851 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:38.600099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a1858-2db4-4e29-84fc-c7e08956a851 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:38.600416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a1858-2db4-4e29-84fc-c7e08956a851 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:38.601877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a1858-2db4-4e29-84fc-c7e08956a851 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:38.621929 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 325/656] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:38.623132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a1858-2db4-4e29-84fc-c7e08956a851 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:38.626854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:38.670637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:38.705604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b11aba-aff3-445d-aaec-80a7bd160d72 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:38.743672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7cfb5f-6c0d-4733-9437-76d9cddedcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:38.744856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a1858-2db4-4e29-84fc-c7e08956a851 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:38.745485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7cfb5f-6c0d-4733-9437-76d9cddedcac None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:38.745974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7cfb5f-6c0d-4733-9437-76d9cddedcac None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:38.747069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7cfb5f-6c0d-4733-9437-76d9cddedcac None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:38.748372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7cfb5f-6c0d-4733-9437-76d9cddedcac None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:38.748920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7cfb5f-6c0d-4733-9437-76d9cddedcac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:38.750587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7cfb5f-6c0d-4733-9437-76d9cddedcac None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:38.765107 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 332/657] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:38.766491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7cfb5f-6c0d-4733-9437-76d9cddedcac None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:38.792806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583a2e4-3050-442f-9bbf-acd81221a0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:38.793455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583a2e4-3050-442f-9bbf-acd81221a0c7 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:38.794233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583a2e4-3050-442f-9bbf-acd81221a0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:38.794514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583a2e4-3050-442f-9bbf-acd81221a0c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:38.802481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583a2e4-3050-442f-9bbf-acd81221a0c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:38.804107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583a2e4-3050-442f-9bbf-acd81221a0c7 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:38.821073 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-b583a2e4-3050-442f-9bbf-acd81221a0c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:38.821073 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:38.821073 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:38.821073 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:38.821073 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:38.821073 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:38.821073 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:38.821073 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:38.821073 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:38.821073 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:38.821073 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:38.821073 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:38.821073 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:45:38.821073 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:45:38.821073 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:45:38.822004 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:45:38.822004 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:38.822004 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:38.822004 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:38.822004 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:38.822004 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:38.822004 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:38.822004 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:38.822004 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:38.822004 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:38.822004 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:38.822004 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:38.822004 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:38.822004 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:38.822004 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:38.822004 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:38.822004 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:38.822931 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:45:38.822931 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:45:38.822931 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:45:38.822931 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:45:38.822931 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:45:38.822931 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:45:38.822931 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:38.822931 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:38.825052 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 326/658] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:38.826007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583a2e4-3050-442f-9bbf-acd81221a0c7 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:38.874318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:38.884779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7cfb5f-6c0d-4733-9437-76d9cddedcac None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:38.923204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a079515-93ce-481d-89d0-d6e0c9b1e5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:38.924005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a079515-93ce-481d-89d0-d6e0c9b1e5ec None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:38.924288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a079515-93ce-481d-89d0-d6e0c9b1e5ec None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:38.924557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a079515-93ce-481d-89d0-d6e0c9b1e5ec None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:38.934777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a079515-93ce-481d-89d0-d6e0c9b1e5ec None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:38.936273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a079515-93ce-481d-89d0-d6e0c9b1e5ec None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:38.937082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:38.943447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583a2e4-3050-442f-9bbf-acd81221a0c7 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:38.951328 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-0a079515-93ce-481d-89d0-d6e0c9b1e5ec None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 16 20:45:38.951328 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:38.951328 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:38.951328 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:38.951328 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:38.951328 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:38.951328 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:38.951328 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:38.951328 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:38.951328 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:38.951328 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:38.951328 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:38.951328 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:45:38.951328 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:45:38.951328 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:45:38.951328 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:45:38.952483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:38.952483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:38.952483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:45:38.952483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:38.952483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:45:38.952483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:38.952483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:38.952483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:38.952483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:38.952483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:38.952483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:38.952483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:38.952483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:38.952483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:38.952483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:38.952483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:38.952483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:38.952483 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:38.954220 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:38.954220 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:38.954220 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:45:38.954220 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:45:38.954220 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:45:38.954220 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:45:38.954220 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:45:38.954220 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:45:38.954220 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 16 20:45:38.954220 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:38.954220 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 333/659] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:45:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:38.954220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a079515-93ce-481d-89d0-d6e0c9b1e5ec None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:38.991100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04857550-c9ca-4bf4-acf7-81623dcaad50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:38.992013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04857550-c9ca-4bf4-acf7-81623dcaad50 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:38.992368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04857550-c9ca-4bf4-acf7-81623dcaad50 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:38.992711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04857550-c9ca-4bf4-acf7-81623dcaad50 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:39.000507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04857550-c9ca-4bf4-acf7-81623dcaad50 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:39.001975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04857550-c9ca-4bf4-acf7-81623dcaad50 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:39.017798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-04857550-c9ca-4bf4-acf7-81623dcaad50 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 16 20:45:39.017798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:39.017798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:39.017798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:39.017798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:39.017798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:39.017798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:39.017798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:39.017798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:39.017798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:39.017798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:39.017798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:39.017798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:45:39.017798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:45:39.017798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:45:39.017798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:45:39.018759 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:39.018759 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:39.018759 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:45:39.018759 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:39.018759 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:45:39.018759 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:39.018759 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:39.018759 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:39.018759 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:39.018759 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:39.018759 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:39.018759 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:39.018759 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:39.018759 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:39.018759 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:39.018759 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:39.018759 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:39.018759 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:39.019742 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:39.019742 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:39.019742 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:45:39.019742 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:45:39.019742 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:45:39.019742 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:45:39.019742 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:45:39.019742 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:45:39.019742 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 16 20:45:39.019742 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:39.019742 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 327/660] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:45:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:39.020338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533127b-18fc-430f-aa3b-9f71ad26e36c None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:39.020470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533127b-18fc-430f-aa3b-9f71ad26e36c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:39.020740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533127b-18fc-430f-aa3b-9f71ad26e36c None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:39.025574 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 328/661] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:39.025574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533127b-18fc-430f-aa3b-9f71ad26e36c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:39.076340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a079515-93ce-481d-89d0-d6e0c9b1e5ec None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:39.115256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a859aad-53eb-4efe-b996-97d0e2063671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:39.115921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a859aad-53eb-4efe-b996-97d0e2063671 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:39.116207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a859aad-53eb-4efe-b996-97d0e2063671 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:39.116483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a859aad-53eb-4efe-b996-97d0e2063671 None admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:39.117272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a859aad-53eb-4efe-b996-97d0e2063671 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:39.117579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a859aad-53eb-4efe-b996-97d0e2063671 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:39.119022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a859aad-53eb-4efe-b996-97d0e2063671 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:39.137807 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 334/662] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:45:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:39.138792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a859aad-53eb-4efe-b996-97d0e2063671 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:39.139303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533127b-18fc-430f-aa3b-9f71ad26e36c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:39.151932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:39.176420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6a274-6697-4573-b3f1-9e7cbc12252a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:39.177507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6a274-6697-4573-b3f1-9e7cbc12252a None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:39.177507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6a274-6697-4573-b3f1-9e7cbc12252a None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:39.177681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6a274-6697-4573-b3f1-9e7cbc12252a None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:39.178453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6a274-6697-4573-b3f1-9e7cbc12252a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:39.178762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6a274-6697-4573-b3f1-9e7cbc12252a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:39.180254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6a274-6697-4573-b3f1-9e7cbc12252a None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:39.206631 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 329/663] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Jul 16 20:45:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:39.207879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e050131-7a57-4965-b517-fea7843cabc0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:39.208339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e050131-7a57-4965-b517-fea7843cabc0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:39.208466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e050131-7a57-4965-b517-fea7843cabc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:39.227682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0e050131-7a57-4965-b517-fea7843cabc0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:39.228874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0e050131-7a57-4965-b517-fea7843cabc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:39.240151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:39.254467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a859aad-53eb-4efe-b996-97d0e2063671 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:39.302235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fdbab-314b-4f15-b573-9c9e98fd61b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:39.303057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fdbab-314b-4f15-b573-9c9e98fd61b0 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:39.303351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fdbab-314b-4f15-b573-9c9e98fd61b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:39.303632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fdbab-314b-4f15-b573-9c9e98fd61b0 None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:39.304481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599fdbab-314b-4f15-b573-9c9e98fd61b0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:39.304795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599fdbab-314b-4f15-b573-9c9e98fd61b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:39.311471 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 330/664] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:39.311634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599fdbab-314b-4f15-b573-9c9e98fd61b0 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:39.311711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e050131-7a57-4965-b517-fea7843cabc0 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:39.339216 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 335/665] 10.222.0.16 () {56 vars in 1139 bytes} [Sat Jul 16 20:45:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:39.339980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fdbab-314b-4f15-b573-9c9e98fd61b0 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:39.417368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:39.424623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e050131-7a57-4965-b517-fea7843cabc0 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:39.455226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fdbab-314b-4f15-b573-9c9e98fd61b0 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:39.461418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a086784-74ae-499c-9f5b-edc824452b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:39.462164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a086784-74ae-499c-9f5b-edc824452b75 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:39.462451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a086784-74ae-499c-9f5b-edc824452b75 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:39.462848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a086784-74ae-499c-9f5b-edc824452b75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:39.463735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a086784-74ae-499c-9f5b-edc824452b75 None admin] RBAC: Adding query filter params (role.id=99a4e0ec120f4163a419b2775afb8a41, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=78ec461b4719448597c99fd9368fa740) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:39.464047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a086784-74ae-499c-9f5b-edc824452b75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:39.465549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a086784-74ae-499c-9f5b-edc824452b75 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:39.483039 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 331/666] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:45:39 2022] GET /identity/v3/role_assignments?user.id=78ec461b4719448597c99fd9368fa740&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=99a4e0ec120f4163a419b2775afb8a41 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:39.483039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a086784-74ae-499c-9f5b-edc824452b75 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:39.485307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:39.512823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5f99d-3985-4679-a246-b30ddc226b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:39.513672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5f99d-3985-4679-a246-b30ddc226b59 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:39.514013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5f99d-3985-4679-a246-b30ddc226b59 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:39.514295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5f99d-3985-4679-a246-b30ddc226b59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:39.594420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a086784-74ae-499c-9f5b-edc824452b75 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:39.611582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5f99d-3985-4679-a246-b30ddc226b59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:39.614117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5f99d-3985-4679-a246-b30ddc226b59 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:39.637515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f67f9-b51a-4816-a90c-852b620f7010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:39.639298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f67f9-b51a-4816-a90c-852b620f7010 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:39.639737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f67f9-b51a-4816-a90c-852b620f7010 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:39.640454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f67f9-b51a-4816-a90c-852b620f7010 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:39.657651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f67f9-b51a-4816-a90c-852b620f7010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:39.666471 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-da9f67f9-b51a-4816-a90c-852b620f7010 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:39.666471 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:39.666471 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:39.666471 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:39.666471 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:39.666471 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:39.666471 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:39.666471 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:39.666471 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:39.666471 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:39.666471 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:39.666471 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:39.666471 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:39.666471 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:39.666471 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:39.666471 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:39.667708 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:39.667708 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:39.667708 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:39.667708 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:39.667708 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:39.667708 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:39.667708 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:39.667708 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:39.667708 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:39.667708 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:39.667708 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:39.667708 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:39.667708 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:39.667708 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:39.667708 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:39.667708 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:39.670022 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:39.670022 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:39.670022 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:39.670022 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:39.670022 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:39.670022 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:39.670022 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:39.670022 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:39.670022 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:39.670022 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:39.670022 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:39.670022 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:39.676356 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 332/667] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:45:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:39.677543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f67f9-b51a-4816-a90c-852b620f7010 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:39.716129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:39.761258 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 336/668] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:45:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:45:39.761862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5f99d-3985-4679-a246-b30ddc226b59 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:39.767762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:39.818817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f67f9-b51a-4816-a90c-852b620f7010 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:39.867394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8cd59-26d8-4048-9357-b940dcd8dcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:39.868164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8cd59-26d8-4048-9357-b940dcd8dcca None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:39.868583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8cd59-26d8-4048-9357-b940dcd8dcca None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:39.868959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8cd59-26d8-4048-9357-b940dcd8dcca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:39.905038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5f99d-3985-4679-a246-b30ddc226b59 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:39.950611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f0677-9aaa-4d41-a9a7-1249bd2e5bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:39.951601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f0677-9aaa-4d41-a9a7-1249bd2e5bea None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:39.952027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f0677-9aaa-4d41-a9a7-1249bd2e5bea None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:39.952446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f0677-9aaa-4d41-a9a7-1249bd2e5bea None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:39.953544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f0677-9aaa-4d41-a9a7-1249bd2e5bea None admin] RBAC: Adding query filter params (name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:39.954001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f0677-9aaa-4d41-a9a7-1249bd2e5bea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:39.956275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f0677-9aaa-4d41-a9a7-1249bd2e5bea None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:39.957244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8cd59-26d8-4048-9357-b940dcd8dcca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:39.958990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8cd59-26d8-4048-9357-b940dcd8dcca None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:39.968148 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 337/669] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Jul 16 20:45:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:39.969310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f0677-9aaa-4d41-a9a7-1249bd2e5bea None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:40.009682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:40.049233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:40.086303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f0677-9aaa-4d41-a9a7-1249bd2e5bea None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:40.104260 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 333/670] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:45:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:45:40.104260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8cd59-26d8-4048-9357-b940dcd8dcca None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:40.133983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb614c8-760d-48ba-9eb8-e76394696380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:40.134733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb614c8-760d-48ba-9eb8-e76394696380 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:40.135038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb614c8-760d-48ba-9eb8-e76394696380 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:40.135321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb614c8-760d-48ba-9eb8-e76394696380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:40.150784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb614c8-760d-48ba-9eb8-e76394696380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:40.152291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb614c8-760d-48ba-9eb8-e76394696380 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:40.176196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-dfb614c8-760d-48ba-9eb8-e76394696380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:40.176196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:40.176196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:40.176196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:40.176196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:40.176196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:40.176196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:40.176196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:40.176196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:40.176196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:40.176196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:40.176196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:40.176196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:40.176196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:40.176196 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:40.177142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:40.177142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:40.177142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:40.177142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:40.177142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:40.177142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:40.177142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:40.177142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:40.177142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:40.177142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:40.177142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:40.177142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:40.177142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:40.177142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:40.177142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:40.177142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:40.177142 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:40.178008 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:40.178008 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:40.178008 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:40.178008 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:40.182523 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 338/671] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:40.183723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb614c8-760d-48ba-9eb8-e76394696380 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:40.241309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8cd59-26d8-4048-9357-b940dcd8dcca None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:40.284118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0ceb2-8521-43fb-8038-108f93965400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:40.285323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0ceb2-8521-43fb-8038-108f93965400 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:40.285810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0ceb2-8521-43fb-8038-108f93965400 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:40.286283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0ceb2-8521-43fb-8038-108f93965400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:40.298301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0ceb2-8521-43fb-8038-108f93965400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:40.300161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0ceb2-8521-43fb-8038-108f93965400 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:40.308658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:40.320496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-8ac0ceb2-8521-43fb-8038-108f93965400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:40.320496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:40.320496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:40.320496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:40.320496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:40.320496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:40.320496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:40.320496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:40.320496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:40.320496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:40.320496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:40.320496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:40.320496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:40.320496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:40.320496 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:40.321614 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:40.321614 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:40.321614 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:40.321614 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:40.321614 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:40.321614 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:40.321614 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:40.321614 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:40.321614 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:40.321614 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:40.321614 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:40.321614 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:40.321614 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:40.321614 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:40.321614 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:40.321614 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:40.321614 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:40.322499 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:40.322499 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:40.322499 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:40.322499 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:40.325440 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 334/672] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:40.326525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0ceb2-8521-43fb-8038-108f93965400 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:40.331433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb614c8-760d-48ba-9eb8-e76394696380 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:40.356814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:40.376289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdabb8f-e7c8-41bc-8379-476dfd56bfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:40.378020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdabb8f-e7c8-41bc-8379-476dfd56bfae None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:40.378378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdabb8f-e7c8-41bc-8379-476dfd56bfae None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:40.378729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdabb8f-e7c8-41bc-8379-476dfd56bfae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:40.394003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdabb8f-e7c8-41bc-8379-476dfd56bfae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:40.396009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdabb8f-e7c8-41bc-8379-476dfd56bfae None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:40.417323 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-bfdabb8f-e7c8-41bc-8379-476dfd56bfae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:40.417323 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:40.417323 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:40.417323 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:40.417323 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:40.417323 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:40.417323 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:40.417323 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:40.417323 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:40.417323 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:40.417323 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:40.417323 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:40.417323 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:40.417323 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:40.417323 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:40.419066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:40.419066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:40.419066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:40.419066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:40.419066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:40.419066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:40.419066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:40.419066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:40.419066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:40.419066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:40.419066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:40.419066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:40.419066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:40.419066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:40.419066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:40.419066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:40.419066 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:40.420069 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:40.420069 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:40.420069 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:40.420069 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:40.426592 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 339/673] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:40.427807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdabb8f-e7c8-41bc-8379-476dfd56bfae None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:40.460448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0ceb2-8521-43fb-8038-108f93965400 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:40.496541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8cf71-1f50-43fc-ac84-350922398410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:40.497195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8cf71-1f50-43fc-ac84-350922398410 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:40.497468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8cf71-1f50-43fc-ac84-350922398410 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:40.497738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8cf71-1f50-43fc-ac84-350922398410 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:40.498445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8cf71-1f50-43fc-ac84-350922398410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:40.498747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8cf71-1f50-43fc-ac84-350922398410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:40.500152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8cf71-1f50-43fc-ac84-350922398410 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:40.518025 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 335/674] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:40.518025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b7d18-ca81-4254-abfe-02e15ee2d668 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:40.518025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b7d18-ca81-4254-abfe-02e15ee2d668 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:40.518025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b7d18-ca81-4254-abfe-02e15ee2d668 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:40.518025 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 336/675] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:40.518025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b7d18-ca81-4254-abfe-02e15ee2d668 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:40.545446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdabb8f-e7c8-41bc-8379-476dfd56bfae None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:40.589474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865e24b-989c-473b-9c34-4c0853341706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:40.590228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865e24b-989c-473b-9c34-4c0853341706 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:40.591232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865e24b-989c-473b-9c34-4c0853341706 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:40.591700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865e24b-989c-473b-9c34-4c0853341706 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:40.592477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865e24b-989c-473b-9c34-4c0853341706 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:40.592785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865e24b-989c-473b-9c34-4c0853341706 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:40.594167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865e24b-989c-473b-9c34-4c0853341706 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:40.595633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:40.612603 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 340/676] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:40.613352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865e24b-989c-473b-9c34-4c0853341706 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:40.614972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:40.636055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b7d18-ca81-4254-abfe-02e15ee2d668 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:40.674016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e00ad2-b720-41ac-b649-121b8c555b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:40.675024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e00ad2-b720-41ac-b649-121b8c555b70 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:40.675447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e00ad2-b720-41ac-b649-121b8c555b70 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:40.675922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e00ad2-b720-41ac-b649-121b8c555b70 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:40.676801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e00ad2-b720-41ac-b649-121b8c555b70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:40.677243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e00ad2-b720-41ac-b649-121b8c555b70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:40.678977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e00ad2-b720-41ac-b649-121b8c555b70 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:40.691784 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 337/677] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:40.693340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea17b6-f85c-4449-9cc4-fae1c15844c6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:40.693780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea17b6-f85c-4449-9cc4-fae1c15844c6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:40.694194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea17b6-f85c-4449-9cc4-fae1c15844c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:40.714108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c0ea17b6-f85c-4449-9cc4-fae1c15844c6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:40.716394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c0ea17b6-f85c-4449-9cc4-fae1c15844c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:40.722375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865e24b-989c-473b-9c34-4c0853341706 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:40.759599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc736a1-28c0-4463-af66-1972e63e5432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:40.760433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc736a1-28c0-4463-af66-1972e63e5432 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:40.760758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc736a1-28c0-4463-af66-1972e63e5432 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:40.761039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc736a1-28c0-4463-af66-1972e63e5432 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:40.769428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc736a1-28c0-4463-af66-1972e63e5432 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:40.771145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc736a1-28c0-4463-af66-1972e63e5432 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:40.786750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-bbc736a1-28c0-4463-af66-1972e63e5432 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:40.786750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:40.786750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:40.786750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:40.786750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:40.786750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:40.786750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:40.786750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:40.786750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:40.786750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:40.786750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:40.786750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:40.786750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:45:40.786750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:45:40.786750 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:45:40.787735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:45:40.787735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:40.787735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:40.787735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:40.787735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:40.787735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:40.787735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:40.787735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:40.787735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:40.787735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:40.787735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:40.787735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:40.787735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:40.787735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:40.787735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:40.787735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:40.787735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:40.788932 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:45:40.788932 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:45:40.788932 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:45:40.788932 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:45:40.788932 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:45:40.788932 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:45:40.788932 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:40.788932 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:40.788932 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 341/678] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:40.788932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc736a1-28c0-4463-af66-1972e63e5432 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:40.798664 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 338/679] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:40.799544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea17b6-f85c-4449-9cc4-fae1c15844c6 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:40.870284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:40.889697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:40.920913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea17b6-f85c-4449-9cc4-fae1c15844c6 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:40.921111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc736a1-28c0-4463-af66-1972e63e5432 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:40.959082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ec99b-f702-46a1-bfa9-c47fc94e018f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:40.959792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ec99b-f702-46a1-bfa9-c47fc94e018f None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:40.960069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ec99b-f702-46a1-bfa9-c47fc94e018f None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:40.960341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ec99b-f702-46a1-bfa9-c47fc94e018f None admin] PATH_INFO: `/v3/users/swift` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:40.961302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78d9a1-094e-4a22-bff4-c2cf512bf4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:40.962271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78d9a1-094e-4a22-bff4-c2cf512bf4e5 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:40.962562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78d9a1-094e-4a22-bff4-c2cf512bf4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:40.963388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78d9a1-094e-4a22-bff4-c2cf512bf4e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:40.968281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ec99b-f702-46a1-bfa9-c47fc94e018f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:40.969713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ec99b-f702-46a1-bfa9-c47fc94e018f None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:40.970810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78d9a1-094e-4a22-bff4-c2cf512bf4e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:40.972313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78d9a1-094e-4a22-bff4-c2cf512bf4e5 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:40.984273 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-8f8ec99b-f702-46a1-bfa9-c47fc94e018f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 16 20:45:40.984273 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:40.984273 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:40.984273 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:40.984273 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:40.984273 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:40.984273 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:40.984273 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:40.984273 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:40.984273 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:40.984273 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:40.984273 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:40.984273 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:45:40.984273 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:45:40.984273 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:45:40.984273 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:45:40.985201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:40.985201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:40.985201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:45:40.985201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:40.985201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:45:40.985201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:40.985201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:40.985201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:40.985201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:40.985201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:40.985201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:40.985201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:40.985201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:40.985201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:40.985201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:40.985201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:40.985201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:40.985201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:40.986110 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:40.986110 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:40.986110 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:45:40.986110 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:45:40.986110 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:45:40.986110 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:45:40.986110 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:45:40.986110 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:45:40.986110 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 16 20:45:40.986110 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:40.986638 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-8b78d9a1-094e-4a22-bff4-c2cf512bf4e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:40.986638 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:40.986638 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:40.986638 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:40.986638 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:40.986638 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:40.986638 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:40.986638 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:40.986638 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:40.986638 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:40.986638 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:40.986638 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:40.986638 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:45:40.986638 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:45:40.986638 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:45:40.992646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:45:40.992646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:40.992646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:40.992646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:40.992646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:40.992646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:40.992646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:40.992646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:40.992646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:40.992646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:40.992646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:40.992646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:40.992646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:40.992646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:40.992646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:40.992646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:40.992646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:40.993991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:45:40.993991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:45:40.993991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:45:40.993991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:45:40.993991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:45:40.993991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:45:40.993991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:40.993991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:40.993991 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 339/680] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:40.993991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78d9a1-094e-4a22-bff4-c2cf512bf4e5 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:40.996938 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 342/681] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:45:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:40.996938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ec99b-f702-46a1-bfa9-c47fc94e018f None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:41.098442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ec99b-f702-46a1-bfa9-c47fc94e018f None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:41.108226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78d9a1-094e-4a22-bff4-c2cf512bf4e5 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:41.114575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:41.139691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6696f80-5353-481b-bbe3-5f3b1a6c745f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:41.140078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:41.140537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6696f80-5353-481b-bbe3-5f3b1a6c745f None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:41.141136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6696f80-5353-481b-bbe3-5f3b1a6c745f None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:41.141426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6696f80-5353-481b-bbe3-5f3b1a6c745f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:41.146194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f2a5c-da41-4638-acc5-ce7584838c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:41.146845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f2a5c-da41-4638-acc5-ce7584838c21 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:41.147161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f2a5c-da41-4638-acc5-ce7584838c21 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:41.147436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f2a5c-da41-4638-acc5-ce7584838c21 None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:41.148221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f2a5c-da41-4638-acc5-ce7584838c21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:41.148522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f2a5c-da41-4638-acc5-ce7584838c21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:41.149939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f2a5c-da41-4638-acc5-ce7584838c21 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:41.154633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6696f80-5353-481b-bbe3-5f3b1a6c745f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:41.163297 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 340/682] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:45:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:41.163843 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-e6696f80-5353-481b-bbe3-5f3b1a6c745f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:45:41.163843 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:41.163843 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:41.163843 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:41.163843 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:41.163843 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:41.163843 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:41.163843 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:41.163843 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:41.163843 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:41.163843 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:41.163843 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:41.163843 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:41.163843 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:41.163843 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:41.163843 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:41.164783 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:41.164783 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:41.164783 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:41.164783 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:41.164783 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:41.164783 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:41.164783 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:41.164783 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:41.164783 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:41.164783 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:41.164783 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:41.164783 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:41.164783 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:41.164783 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:41.164783 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:41.164783 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:41.165605 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:41.165605 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:41.165605 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:41.165605 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:41.165605 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:41.165605 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:41.165605 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:41.165605 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:41.165605 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:41.165605 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:41.165605 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:45:41.165605 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:41.166231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f2a5c-da41-4638-acc5-ce7584838c21 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:41.173102 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 343/683] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:45:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:41.173102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6696f80-5353-481b-bbe3-5f3b1a6c745f None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:41.280318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6696f80-5353-481b-bbe3-5f3b1a6c745f None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:41.280505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f2a5c-da41-4638-acc5-ce7584838c21 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:41.318808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3df76-b5bd-4416-b682-168ba2c88b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:41.319497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3df76-b5bd-4416-b682-168ba2c88b79 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:41.319753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9270ee-5dbd-476f-bd3e-5b5707dac423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:41.319873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3df76-b5bd-4416-b682-168ba2c88b79 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:41.320051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3df76-b5bd-4416-b682-168ba2c88b79 None admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:41.320430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9270ee-5dbd-476f-bd3e-5b5707dac423 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:41.320706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9270ee-5dbd-476f-bd3e-5b5707dac423 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:41.320804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3df76-b5bd-4416-b682-168ba2c88b79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:41.320995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9270ee-5dbd-476f-bd3e-5b5707dac423 None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:41.321093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3df76-b5bd-4416-b682-168ba2c88b79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:41.321804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9270ee-5dbd-476f-bd3e-5b5707dac423 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:41.322181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9270ee-5dbd-476f-bd3e-5b5707dac423 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:41.322558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3df76-b5bd-4416-b682-168ba2c88b79 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:41.323749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9270ee-5dbd-476f-bd3e-5b5707dac423 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:41.335905 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 344/684] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:45:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:41.339957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3df76-b5bd-4416-b682-168ba2c88b79 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:41.345023 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 341/685] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Jul 16 20:45:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:41.346633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9270ee-5dbd-476f-bd3e-5b5707dac423 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:41.380859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:41.406987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:41.454341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3df76-b5bd-4416-b682-168ba2c88b79 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:41.459625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9270ee-5dbd-476f-bd3e-5b5707dac423 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:41.490830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94b02a-8e44-41e2-8e42-a163083cb1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:41.491781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94b02a-8e44-41e2-8e42-a163083cb1b1 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:41.492067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94b02a-8e44-41e2-8e42-a163083cb1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:41.492435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94b02a-8e44-41e2-8e42-a163083cb1b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:41.493444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94b02a-8e44-41e2-8e42-a163083cb1b1 None admin] RBAC: Adding query filter params (role.id=99a4e0ec120f4163a419b2775afb8a41, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=6dcc74f579e447938a2477e253e5d36e) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:41.493764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94b02a-8e44-41e2-8e42-a163083cb1b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:41.495363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94b02a-8e44-41e2-8e42-a163083cb1b1 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:41.495469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda9e00-0a47-4cc3-933b-04468216bb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:41.496060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda9e00-0a47-4cc3-933b-04468216bb12 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:41.496367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda9e00-0a47-4cc3-933b-04468216bb12 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:41.497819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda9e00-0a47-4cc3-933b-04468216bb12 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:41.498570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda9e00-0a47-4cc3-933b-04468216bb12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:41.498877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda9e00-0a47-4cc3-933b-04468216bb12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:41.500274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda9e00-0a47-4cc3-933b-04468216bb12 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:41.503695 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 345/686] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:45:41 2022] GET /identity/v3/role_assignments?user.id=6dcc74f579e447938a2477e253e5d36e&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=99a4e0ec120f4163a419b2775afb8a41 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:41.504721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94b02a-8e44-41e2-8e42-a163083cb1b1 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:41.513457 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 342/687] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:45:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:41.513457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda9e00-0a47-4cc3-933b-04468216bb12 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:41.639431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:41.644773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94b02a-8e44-41e2-8e42-a163083cb1b1 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:41.659954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda9e00-0a47-4cc3-933b-04468216bb12 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:41.676148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:41.687581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07ebac-2868-493c-ae15-1e28b5794b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:41.688246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07ebac-2868-493c-ae15-1e28b5794b8f None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:41.688531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07ebac-2868-493c-ae15-1e28b5794b8f None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:41.688823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07ebac-2868-493c-ae15-1e28b5794b8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:41.689638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07ebac-2868-493c-ae15-1e28b5794b8f None admin] RBAC: Adding query filter params (role.id=99a4e0ec120f4163a419b2775afb8a41, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=fbd858f3e6ba4523b056bbdc2af427b0) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:41.689952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07ebac-2868-493c-ae15-1e28b5794b8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:41.691426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07ebac-2868-493c-ae15-1e28b5794b8f None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:41.698111 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 346/688] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:45:41 2022] GET /identity/v3/role_assignments?user.id=fbd858f3e6ba4523b056bbdc2af427b0&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=99a4e0ec120f4163a419b2775afb8a41 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:41.702449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07ebac-2868-493c-ae15-1e28b5794b8f None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:41.713136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898ec1b-a089-445f-bd6e-81b4fc0b2455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:41.713136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898ec1b-a089-445f-bd6e-81b4fc0b2455 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:41.713136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898ec1b-a089-445f-bd6e-81b4fc0b2455 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:41.713136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898ec1b-a089-445f-bd6e-81b4fc0b2455 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:41.816824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898ec1b-a089-445f-bd6e-81b4fc0b2455 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:41.818386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898ec1b-a089-445f-bd6e-81b4fc0b2455 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:41.865859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07ebac-2868-493c-ae15-1e28b5794b8f None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:41.912406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d900137-4f08-4ce4-b194-878ae3662525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:41.913172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d900137-4f08-4ce4-b194-878ae3662525 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:41.913455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d900137-4f08-4ce4-b194-878ae3662525 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:41.913733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d900137-4f08-4ce4-b194-878ae3662525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:41.927103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d900137-4f08-4ce4-b194-878ae3662525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:41.928697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d900137-4f08-4ce4-b194-878ae3662525 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:41.953089 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-3d900137-4f08-4ce4-b194-878ae3662525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:41.953089 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:41.953089 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:41.953089 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:41.953089 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:41.953089 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:41.953089 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:41.953089 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:41.953089 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:41.953089 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:41.953089 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:41.953089 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:41.953089 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:41.953089 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:41.953089 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:41.954015 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:41.954015 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:41.954015 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:41.954015 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:41.954015 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:41.954015 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:41.954015 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:41.954015 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:41.954015 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:41.954015 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:41.954015 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:41.954015 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:41.954015 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:41.954015 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:41.954015 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:41.954015 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:41.954015 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:41.954865 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:41.954865 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:41.954865 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:41.954865 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:41.959465 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 347/689] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:41.960714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d900137-4f08-4ce4-b194-878ae3662525 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:41.961467 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 343/690] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:45:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:45:41.971529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898ec1b-a089-445f-bd6e-81b4fc0b2455 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:41.984427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:41.986503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:42.103142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898ec1b-a089-445f-bd6e-81b4fc0b2455 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:42.104015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d900137-4f08-4ce4-b194-878ae3662525 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:42.141619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4a1a9-2efb-4b61-a3e6-a8ab4556f8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:42.142698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4a1a9-2efb-4b61-a3e6-a8ab4556f8bf None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:42.143158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4a1a9-2efb-4b61-a3e6-a8ab4556f8bf None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:42.143587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4a1a9-2efb-4b61-a3e6-a8ab4556f8bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:42.149253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89699231-a1ed-4f04-a590-f1a761b4cb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:42.149922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89699231-a1ed-4f04-a590-f1a761b4cb61 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:42.150203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89699231-a1ed-4f04-a590-f1a761b4cb61 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:42.150477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89699231-a1ed-4f04-a590-f1a761b4cb61 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:42.151234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89699231-a1ed-4f04-a590-f1a761b4cb61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:42.151540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89699231-a1ed-4f04-a590-f1a761b4cb61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:42.154078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89699231-a1ed-4f04-a590-f1a761b4cb61 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:42.157816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4a1a9-2efb-4b61-a3e6-a8ab4556f8bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:42.159860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4a1a9-2efb-4b61-a3e6-a8ab4556f8bf None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:42.174803 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 348/691] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:42.174803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b545232-b976-4ede-ae69-10863dfcd91f None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:42.174803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b545232-b976-4ede-ae69-10863dfcd91f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:42.174803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b545232-b976-4ede-ae69-10863dfcd91f None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:42.174803 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 349/692] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:42.177528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b545232-b976-4ede-ae69-10863dfcd91f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:42.187545 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-c6e4a1a9-2efb-4b61-a3e6-a8ab4556f8bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:42.187545 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:42.187545 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:42.187545 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:42.187545 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:42.187545 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:42.187545 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:42.187545 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:42.187545 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:42.187545 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:42.187545 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:42.187545 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:42.187545 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:42.187545 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:42.187545 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:42.188557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:42.188557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:42.188557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:42.188557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:42.188557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:42.188557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:42.188557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:42.188557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:42.188557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:42.188557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:42.188557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:42.188557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:42.188557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:42.188557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:42.188557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:42.188557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:42.188557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:42.190007 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:42.190007 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:42.190007 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:42.190007 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:42.190007 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 344/693] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:42.190404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a033405-d397-4370-a0a1-10198944f9f2 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:42.191257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a033405-d397-4370-a0a1-10198944f9f2 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:42.191544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a033405-d397-4370-a0a1-10198944f9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:42.214084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6a033405-d397-4370-a0a1-10198944f9f2 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:42.215899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6a033405-d397-4370-a0a1-10198944f9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:42.280437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:42.284304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:42.292556 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 345/694] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:42.294393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a033405-d397-4370-a0a1-10198944f9f2 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:42.325380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b545232-b976-4ede-ae69-10863dfcd91f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:42.375621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced83c7-e6ba-4163-b285-28fcd530259d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:42.376717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced83c7-e6ba-4163-b285-28fcd530259d None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:42.377014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced83c7-e6ba-4163-b285-28fcd530259d None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:42.377291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced83c7-e6ba-4163-b285-28fcd530259d None admin] PATH_INFO: `/v3/users/nova` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:42.388344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced83c7-e6ba-4163-b285-28fcd530259d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:42.389990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced83c7-e6ba-4163-b285-28fcd530259d None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:42.409787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-5ced83c7-e6ba-4163-b285-28fcd530259d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 16 20:45:42.409787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:42.409787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:42.409787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:42.409787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:42.409787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:42.409787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:42.409787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:42.409787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:42.409787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:42.409787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:42.409787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:42.409787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:45:42.409787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:45:42.409787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:45:42.409787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:45:42.410976 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:42.410976 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:42.410976 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:45:42.410976 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:42.410976 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:45:42.410976 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:42.410976 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:42.410976 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:42.410976 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:42.410976 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:42.410976 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:42.410976 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:42.410976 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:42.410976 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:42.410976 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:42.410976 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:42.410976 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:42.410976 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:42.412084 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:42.412084 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:42.412084 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:45:42.412084 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:45:42.412084 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:45:42.412084 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:45:42.412084 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:45:42.412084 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:45:42.412084 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 16 20:45:42.412084 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:42.414739 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 350/695] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Jul 16 20:45:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:42.415753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced83c7-e6ba-4163-b285-28fcd530259d None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:42.435488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a033405-d397-4370-a0a1-10198944f9f2 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:42.476086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af317a-de51-4654-a48f-51af7306ff71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:42.476907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af317a-de51-4654-a48f-51af7306ff71 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:42.477290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af317a-de51-4654-a48f-51af7306ff71 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:42.477666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af317a-de51-4654-a48f-51af7306ff71 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:42.478920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af317a-de51-4654-a48f-51af7306ff71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:42.478920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af317a-de51-4654-a48f-51af7306ff71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:42.480590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af317a-de51-4654-a48f-51af7306ff71 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:42.495216 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 346/696] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:42.496835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af317a-de51-4654-a48f-51af7306ff71 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:42.530678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced83c7-e6ba-4163-b285-28fcd530259d None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:42.557031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:42.567405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51754fe6-312b-4d2a-9143-31b2482aea73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:42.568448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51754fe6-312b-4d2a-9143-31b2482aea73 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:42.577201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51754fe6-312b-4d2a-9143-31b2482aea73 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:42.577201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51754fe6-312b-4d2a-9143-31b2482aea73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:42.577201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:42.616851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af317a-de51-4654-a48f-51af7306ff71 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:42.660348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71eb40-060a-4ac6-b1b5-5115938d88e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:42.661197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71eb40-060a-4ac6-b1b5-5115938d88e3 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:42.661559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71eb40-060a-4ac6-b1b5-5115938d88e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:42.661923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71eb40-060a-4ac6-b1b5-5115938d88e3 None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:42.662838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71eb40-060a-4ac6-b1b5-5115938d88e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:42.663229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71eb40-060a-4ac6-b1b5-5115938d88e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:42.664925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71eb40-060a-4ac6-b1b5-5115938d88e3 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:42.692822 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 347/697] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Jul 16 20:45:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:42.693829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71eb40-060a-4ac6-b1b5-5115938d88e3 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:42.705252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51754fe6-312b-4d2a-9143-31b2482aea73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:42.707048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51754fe6-312b-4d2a-9143-31b2482aea73 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:42.725187 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-51754fe6-312b-4d2a-9143-31b2482aea73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:42.725187 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:42.725187 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:42.725187 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:42.725187 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:42.725187 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:42.725187 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:42.725187 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:42.725187 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:42.725187 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:42.725187 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:42.725187 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:42.725187 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:42.725187 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:42.725187 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:42.726115 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:42.726115 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:42.726115 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:42.726115 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:42.726115 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:42.726115 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:42.726115 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:42.726115 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:42.726115 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:42.726115 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:42.726115 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:42.726115 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:42.726115 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:42.726115 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:42.726115 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:42.726115 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:42.726115 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:42.726972 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:42.726972 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:42.726972 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:42.726972 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:42.734392 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 351/698] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:42.735571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51754fe6-312b-4d2a-9143-31b2482aea73 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:42.809700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71eb40-060a-4ac6-b1b5-5115938d88e3 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:42.821957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:42.845880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51754fe6-312b-4d2a-9143-31b2482aea73 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:42.850687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad3ea6-4c4f-46ea-8ff0-775e84cc6d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:42.851686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad3ea6-4c4f-46ea-8ff0-775e84cc6d66 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:42.852110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad3ea6-4c4f-46ea-8ff0-775e84cc6d66 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:42.852549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad3ea6-4c4f-46ea-8ff0-775e84cc6d66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:42.861290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad3ea6-4c4f-46ea-8ff0-775e84cc6d66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:42.863213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad3ea6-4c4f-46ea-8ff0-775e84cc6d66 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:42.880179 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-b2ad3ea6-4c4f-46ea-8ff0-775e84cc6d66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:42.880179 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:42.880179 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:42.880179 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:42.880179 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:42.880179 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:42.880179 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:42.880179 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:42.880179 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:42.880179 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:42.880179 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:42.880179 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:42.880179 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:45:42.880179 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:45:42.880179 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:45:42.881408 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:45:42.881408 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:42.881408 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:42.881408 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:42.881408 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:42.881408 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:42.881408 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:42.881408 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:42.881408 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:42.881408 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:42.881408 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:42.881408 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:42.881408 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:42.881408 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:42.881408 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:42.881408 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:42.881408 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:42.882469 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:45:42.882469 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:45:42.882469 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:45:42.882469 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:45:42.882469 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:45:42.882469 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:45:42.882469 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:42.882469 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:42.884880 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 348/699] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:42.886090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad3ea6-4c4f-46ea-8ff0-775e84cc6d66 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:42.889717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa24f2-3ec8-44d1-83c1-8ea00476f992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:42.890504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa24f2-3ec8-44d1-83c1-8ea00476f992 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:42.890854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa24f2-3ec8-44d1-83c1-8ea00476f992 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:42.892063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa24f2-3ec8-44d1-83c1-8ea00476f992 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:42.951264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:42.965242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa24f2-3ec8-44d1-83c1-8ea00476f992 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:42.966766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa24f2-3ec8-44d1-83c1-8ea00476f992 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:43.014945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad3ea6-4c4f-46ea-8ff0-775e84cc6d66 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:43.054519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ecfda-8ea1-44b4-8102-678b377d802e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:43.055552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ecfda-8ea1-44b4-8102-678b377d802e None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:43.056026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ecfda-8ea1-44b4-8102-678b377d802e None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:43.056519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ecfda-8ea1-44b4-8102-678b377d802e None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:43.057471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ecfda-8ea1-44b4-8102-678b377d802e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:43.058064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ecfda-8ea1-44b4-8102-678b377d802e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:43.060617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ecfda-8ea1-44b4-8102-678b377d802e None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:43.076383 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 349/700] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:43.077727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ecfda-8ea1-44b4-8102-678b377d802e None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:43.102110 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 352/701] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:45:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:45:43.103359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa24f2-3ec8-44d1-83c1-8ea00476f992 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:43.114127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:43.189831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ecfda-8ea1-44b4-8102-678b377d802e None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:43.202219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:43.224143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa24f2-3ec8-44d1-83c1-8ea00476f992 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:43.229606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce985f-cb6d-4b8a-a0b3-6b633e367c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:43.230295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce985f-cb6d-4b8a-a0b3-6b633e367c0d None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:43.230576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce985f-cb6d-4b8a-a0b3-6b633e367c0d None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:43.231400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce985f-cb6d-4b8a-a0b3-6b633e367c0d None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:43.232457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce985f-cb6d-4b8a-a0b3-6b633e367c0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:43.232861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce985f-cb6d-4b8a-a0b3-6b633e367c0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:43.234774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce985f-cb6d-4b8a-a0b3-6b633e367c0d None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:43.250749 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 350/702] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:45:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:43.252070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce985f-cb6d-4b8a-a0b3-6b633e367c0d None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:43.262728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9374719-39da-410b-816f-8851251f3de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:43.263646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9374719-39da-410b-816f-8851251f3de6 None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:43.264026 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9374719-39da-410b-816f-8851251f3de6 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:43.264440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9374719-39da-410b-816f-8851251f3de6 None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:43.265277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9374719-39da-410b-816f-8851251f3de6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:43.266801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9374719-39da-410b-816f-8851251f3de6 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:43.352656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:43.363632 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 353/703] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Jul 16 20:45:43 2022] POST /identity/v3/users => generated 254 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:45:43.365612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9374719-39da-410b-816f-8851251f3de6 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:43.376589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce985f-cb6d-4b8a-a0b3-6b633e367c0d None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:43.462243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74995fe6-c26b-428b-ac7b-47df485d318a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:43.463000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74995fe6-c26b-428b-ac7b-47df485d318a None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:43.463301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74995fe6-c26b-428b-ac7b-47df485d318a None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:43.463571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74995fe6-c26b-428b-ac7b-47df485d318a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:43.484224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74995fe6-c26b-428b-ac7b-47df485d318a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:43.485704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74995fe6-c26b-428b-ac7b-47df485d318a None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:43.518050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9374719-39da-410b-816f-8851251f3de6 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:43.520234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-74995fe6-c26b-428b-ac7b-47df485d318a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:43.520234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:43.520234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:43.520234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:43.520234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:43.520234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:43.520234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:43.520234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:43.520234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:43.520234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:43.520234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:43.520234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:43.520234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:43.520234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:43.520234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:43.521121 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:43.521121 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:43.521121 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:43.521121 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:43.521121 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:43.521121 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:43.521121 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:43.521121 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:43.521121 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:43.521121 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:43.521121 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:43.521121 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:43.521121 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:43.521121 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:43.521121 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:43.521121 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:43.521121 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:43.522028 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:43.522028 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:43.522028 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:43.522028 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:43.531537 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 351/704] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:43.536955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74995fe6-c26b-428b-ac7b-47df485d318a None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:43.563044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55e5c2-f87f-4c61-93c4-de5973b5856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:43.564157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55e5c2-f87f-4c61-93c4-de5973b5856e None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:43.564640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55e5c2-f87f-4c61-93c4-de5973b5856e None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:43.565122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55e5c2-f87f-4c61-93c4-de5973b5856e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:43.566172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55e5c2-f87f-4c61-93c4-de5973b5856e None admin] RBAC: Adding query filter params (role.id=99a4e0ec120f4163a419b2775afb8a41, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=9a66df01ea414b34a8842488b145974f) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:43.566686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55e5c2-f87f-4c61-93c4-de5973b5856e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:43.568397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55e5c2-f87f-4c61-93c4-de5973b5856e None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:43.576856 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 354/705] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:45:43 2022] GET /identity/v3/role_assignments?user.id=9a66df01ea414b34a8842488b145974f&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=99a4e0ec120f4163a419b2775afb8a41 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:43.682184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74995fe6-c26b-428b-ac7b-47df485d318a None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:43.729972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f2e2e-9506-4d33-bdee-1822cc6978f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:43.730621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f2e2e-9506-4d33-bdee-1822cc6978f8 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:43.731458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f2e2e-9506-4d33-bdee-1822cc6978f8 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:43.731729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f2e2e-9506-4d33-bdee-1822cc6978f8 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:43.732476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f2e2e-9506-4d33-bdee-1822cc6978f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:43.732782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f2e2e-9506-4d33-bdee-1822cc6978f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:43.734317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f2e2e-9506-4d33-bdee-1822cc6978f8 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:43.753749 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 352/706] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:45:43.759540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55e5c2-f87f-4c61-93c4-de5973b5856e None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:43.774965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:43.881722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55e5c2-f87f-4c61-93c4-de5973b5856e None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:43.922584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f6765-afe8-4898-807c-6831eccd01ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:43.925011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f6765-afe8-4898-807c-6831eccd01ac None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:43.925011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f6765-afe8-4898-807c-6831eccd01ac None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:43.925011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f6765-afe8-4898-807c-6831eccd01ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:43.935439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f6765-afe8-4898-807c-6831eccd01ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:43.936896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f6765-afe8-4898-807c-6831eccd01ac None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:43.954805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-836f6765-afe8-4898-807c-6831eccd01ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:43.954805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:43.954805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:43.954805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:43.954805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:43.954805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:43.954805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:43.954805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:43.954805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:43.954805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:43.954805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:43.954805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:43.954805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:45:43.954805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:45:43.954805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:45:43.955802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:45:43.955802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:43.955802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:43.955802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:43.955802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:43.955802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:43.955802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:43.955802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:43.955802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:43.955802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:43.955802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:43.955802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:43.955802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:43.955802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:43.955802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:43.955802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:43.955802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:43.956712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:45:43.956712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:45:43.956712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:45:43.956712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:45:43.956712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:45:43.956712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:45:43.956712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:43.956712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:43.960893 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 355/707] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:43.962262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f2e2e-9506-4d33-bdee-1822cc6978f8 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:43.965335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:44.168260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f2e2e-9506-4d33-bdee-1822cc6978f8 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:44.220364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da59ad4-0b5a-474f-856a-dd286b4e7ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:44.221036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da59ad4-0b5a-474f-856a-dd286b4e7ada None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:44.221318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da59ad4-0b5a-474f-856a-dd286b4e7ada None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:44.221592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da59ad4-0b5a-474f-856a-dd286b4e7ada None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:44.222383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da59ad4-0b5a-474f-856a-dd286b4e7ada None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:44.222689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da59ad4-0b5a-474f-856a-dd286b4e7ada None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:44.224159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da59ad4-0b5a-474f-856a-dd286b4e7ada None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:44.238464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60b849-284c-415e-bfe9-0f039cf5ed33 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:44.238790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60b849-284c-415e-bfe9-0f039cf5ed33 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:44.239041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60b849-284c-415e-bfe9-0f039cf5ed33 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:44.240705 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 356/708] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:45:44.245962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f1841-dd4d-41d8-9020-d0bda21621e3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:44.246899 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f1841-dd4d-41d8-9020-d0bda21621e3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:44.247185 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 353/709] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:45:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:44.248736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f1841-dd4d-41d8-9020-d0bda21621e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:44.254876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da59ad4-0b5a-474f-856a-dd286b4e7ada None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:44.273900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3b7f1841-dd4d-41d8-9020-d0bda21621e3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:44.276167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3b7f1841-dd4d-41d8-9020-d0bda21621e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:44.349323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:44.371159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:44.385708 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 357/710] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 16 20:45:44.387987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b69ab5-cd19-41ff-acaf-55565168330e None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:44.388458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b69ab5-cd19-41ff-acaf-55565168330e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:44.388923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b69ab5-cd19-41ff-acaf-55565168330e None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:44.394777 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 358/711] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:44.396287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64e372-86a0-41ad-a8fb-3811f447ffde None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:44.396780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64e372-86a0-41ad-a8fb-3811f447ffde None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:44.397208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64e372-86a0-41ad-a8fb-3811f447ffde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:44.402308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da59ad4-0b5a-474f-856a-dd286b4e7ada None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:44.415790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2d64e372-86a0-41ad-a8fb-3811f447ffde None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:44.417246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2d64e372-86a0-41ad-a8fb-3811f447ffde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:44.441106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2282b-0a7e-4421-ab30-68f028ce5224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:44.441677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2282b-0a7e-4421-ab30-68f028ce5224 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:44.441976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2282b-0a7e-4421-ab30-68f028ce5224 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:44.442501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2282b-0a7e-4421-ab30-68f028ce5224 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:44.443056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2282b-0a7e-4421-ab30-68f028ce5224 None admin] RBAC: Adding query filter params (role.id=bd33b827674a4d4db30c164cab416056, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=d5f515bfe2094b41afe82b4bc57e4b9a) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:44.443368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2282b-0a7e-4421-ab30-68f028ce5224 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:44.444798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2282b-0a7e-4421-ab30-68f028ce5224 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:44.451306 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 354/712] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:45:44 2022] GET /identity/v3/role_assignments?user.id=d5f515bfe2094b41afe82b4bc57e4b9a&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=bd33b827674a4d4db30c164cab416056 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:44.452145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2282b-0a7e-4421-ab30-68f028ce5224 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:44.497735 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 359/713] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:44.522559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64e372-86a0-41ad-a8fb-3811f447ffde None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:44.569160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2282b-0a7e-4421-ab30-68f028ce5224 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:44.598859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:44.609907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc370a5d-2de0-4221-8e02-a279090711aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:44.610136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc370a5d-2de0-4221-8e02-a279090711aa None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:44.610231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc370a5d-2de0-4221-8e02-a279090711aa None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:44.610790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc370a5d-2de0-4221-8e02-a279090711aa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:44.611372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc370a5d-2de0-4221-8e02-a279090711aa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:44.612760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc370a5d-2de0-4221-8e02-a279090711aa None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:44.628432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-cc370a5d-2de0-4221-8e02-a279090711aa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 16 20:45:44.628432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:44.628432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:45:44.628432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:45:44.628432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:45:44.628432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:45:44.628432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:45:44.628432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:45:44.628432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 16 20:45:44.628432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:44.628432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:45:44.628432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:44.628432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:44.628432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:44.628432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:44.628432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:44.629468 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:44.629468 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:44.629468 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:44.629468 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:44.629468 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:44.629468 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:44.629468 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:44.629468 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:45:44.629468 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:45:44.629468 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:45:44.629468 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:45:44.629468 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:44.629468 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:44.629468 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:44.629468 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:44.629468 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:44.630412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:44.630412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:44.630412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:44.630412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:44.630412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:44.630412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:44.630412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:44.630412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:44.630412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:44.630412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:44.630412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:44.630412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:45:44.630412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:45:44.630412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 16 20:45:44.630412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:44.630412 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 355/714] 10.222.0.16 () {56 vars in 1129 bytes} [Sat Jul 16 20:45:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:44.635806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc370a5d-2de0-4221-8e02-a279090711aa None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:44.649573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64e372-86a0-41ad-a8fb-3811f447ffde None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:44.679754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:44.694953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d0bb1-360a-489d-bfe5-f46ef7255f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:44.694953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d0bb1-360a-489d-bfe5-f46ef7255f42 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:44.694953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d0bb1-360a-489d-bfe5-f46ef7255f42 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:44.694953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d0bb1-360a-489d-bfe5-f46ef7255f42 None admin] PATH_INFO: `/v3/services/network` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:44.697695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d0bb1-360a-489d-bfe5-f46ef7255f42 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:44.700911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d0bb1-360a-489d-bfe5-f46ef7255f42 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:44.732079 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-692d0bb1-360a-489d-bfe5-f46ef7255f42 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 16 20:45:44.732079 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:44.732079 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:45:44.732079 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:45:44.732079 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:45:44.732079 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:45:44.732079 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:45:44.732079 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:45:44.732079 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 16 20:45:44.732079 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:44.732079 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:45:44.732079 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:44.732079 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:44.732079 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:44.732079 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:44.732079 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:44.732079 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:44.733138 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:44.733138 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:44.733138 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:44.733138 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:44.733138 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:44.733138 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:44.733138 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:45:44.733138 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:45:44.733138 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:45:44.733138 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:45:44.733138 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:44.733138 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:44.733138 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:44.733138 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:44.733138 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:44.733138 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:44.734068 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:44.734068 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:44.734068 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:44.734068 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:44.734068 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:44.734068 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:44.734068 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:44.734068 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:44.734068 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:44.734068 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:44.734068 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:45:44.734068 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:45:44.734068 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 16 20:45:44.734068 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:44.737025 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 360/715] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:44 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:44.742678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d0bb1-360a-489d-bfe5-f46ef7255f42 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:44.843324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc370a5d-2de0-4221-8e02-a279090711aa None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:44.851926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d0bb1-360a-489d-bfe5-f46ef7255f42 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:44.888885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dd8b0-ad6e-4558-95f8-7a8ce6e9605e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:44.889860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dd8b0-ad6e-4558-95f8-7a8ce6e9605e None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:44.890307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dd8b0-ad6e-4558-95f8-7a8ce6e9605e None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:44.890684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dd8b0-ad6e-4558-95f8-7a8ce6e9605e None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:44.891543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82dd8b0-ad6e-4558-95f8-7a8ce6e9605e None admin] RBAC: Adding query filter params (name=network) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:44.891956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82dd8b0-ad6e-4558-95f8-7a8ce6e9605e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:44.893445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82dd8b0-ad6e-4558-95f8-7a8ce6e9605e None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:44.899357 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 361/716] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Jul 16 20:45:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:45:44.905362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dd8b0-ad6e-4558-95f8-7a8ce6e9605e None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:44.975504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:44.976107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd192b-8653-484d-9c09-57844ca39ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:44.976401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd192b-8653-484d-9c09-57844ca39ee2 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:44.976685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd192b-8653-484d-9c09-57844ca39ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:44.976959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd192b-8653-484d-9c09-57844ca39ee2 None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:44.977788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd192b-8653-484d-9c09-57844ca39ee2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:44.978113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd192b-8653-484d-9c09-57844ca39ee2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:44.979537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd192b-8653-484d-9c09-57844ca39ee2 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:45.005235 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 356/717] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Jul 16 20:45:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:45.016137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd192b-8653-484d-9c09-57844ca39ee2 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:45.028676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dd8b0-ad6e-4558-95f8-7a8ce6e9605e None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:45.071207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e23f6a-6e62-48d7-90b0-d3dcd8c70466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:45.072524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e23f6a-6e62-48d7-90b0-d3dcd8c70466 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:45.073052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e23f6a-6e62-48d7-90b0-d3dcd8c70466 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:45.073689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e23f6a-6e62-48d7-90b0-d3dcd8c70466 None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:45.074973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e23f6a-6e62-48d7-90b0-d3dcd8c70466 None admin] RBAC: Adding query filter params (type=network) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:45.075522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e23f6a-6e62-48d7-90b0-d3dcd8c70466 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:45.077089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e23f6a-6e62-48d7-90b0-d3dcd8c70466 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:45.084441 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 362/718] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Jul 16 20:45:44 2022] GET /identity/v3/services?type=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:45.146275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:45.229854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd192b-8653-484d-9c09-57844ca39ee2 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:45.271268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48afe7-b943-44e8-adcb-6eee733f0d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:45.271878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48afe7-b943-44e8-adcb-6eee733f0d5e None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:45.272163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48afe7-b943-44e8-adcb-6eee733f0d5e None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:45.272440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48afe7-b943-44e8-adcb-6eee733f0d5e None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:45.273153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48afe7-b943-44e8-adcb-6eee733f0d5e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:45.273461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48afe7-b943-44e8-adcb-6eee733f0d5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:45.274859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48afe7-b943-44e8-adcb-6eee733f0d5e None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:45.281730 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 357/719] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Jul 16 20:45:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:46.423483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a246f7-840c-49a0-b440-355cb832b920 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:46.424120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a246f7-840c-49a0-b440-355cb832b920 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:46.424120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a246f7-840c-49a0-b440-355cb832b920 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:46.425678 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 363/720] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:46.430917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31231a83-53f1-4037-854c-4f83be123438 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:46.431409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31231a83-53f1-4037-854c-4f83be123438 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:46.431488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31231a83-53f1-4037-854c-4f83be123438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:46.453960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-31231a83-53f1-4037-854c-4f83be123438 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:46.455170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-31231a83-53f1-4037-854c-4f83be123438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:46.548963 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 358/721] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:46.573945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a246f7-840c-49a0-b440-355cb832b920 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:46.618344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec00906-af06-4774-b8e1-6904be6d1c8c None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:46.618686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec00906-af06-4774-b8e1-6904be6d1c8c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:46.618906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec00906-af06-4774-b8e1-6904be6d1c8c None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:46.620530 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 359/722] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:45:46.626713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921523d-1b37-4c5e-9fcd-fcbd9fa64726 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:46.627038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921523d-1b37-4c5e-9fcd-fcbd9fa64726 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:46.627406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921523d-1b37-4c5e-9fcd-fcbd9fa64726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:46.648111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1921523d-1b37-4c5e-9fcd-fcbd9fa64726 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:46.649324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1921523d-1b37-4c5e-9fcd-fcbd9fa64726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:46.710339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:46.738586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a246f7-840c-49a0-b440-355cb832b920 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:46.757336 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 360/723] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:46.772175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:46.787751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921523d-1b37-4c5e-9fcd-fcbd9fa64726 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:46.800761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dc181-0e76-43da-8531-13fdb168f0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:46.801993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dc181-0e76-43da-8531-13fdb168f0b1 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:46.802455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dc181-0e76-43da-8531-13fdb168f0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:46.802914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dc181-0e76-43da-8531-13fdb168f0b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:46.834412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dc181-0e76-43da-8531-13fdb168f0b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:46.843630 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-343dc181-0e76-43da-8531-13fdb168f0b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:45:46.843630 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:46.843630 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:46.843630 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:46.843630 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:46.843630 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:46.843630 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:46.843630 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:46.843630 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:46.843630 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:46.843630 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:46.843630 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:46.843630 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:46.843630 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:46.843630 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:46.843630 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:46.844554 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:46.844554 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:46.844554 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:46.844554 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:46.844554 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:46.844554 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:46.844554 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:46.844554 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:46.844554 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:46.844554 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:46.844554 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:46.844554 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:46.844554 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:46.844554 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:46.844554 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:46.844554 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:46.845383 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:46.845383 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:46.845383 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:46.845383 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:46.845383 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:46.845383 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:46.845383 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:46.845383 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:46.845383 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:46.845383 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:46.845383 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:45:46.845383 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:46.848153 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 364/724] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:45:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:46.854091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dc181-0e76-43da-8531-13fdb168f0b1 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:46.946763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921523d-1b37-4c5e-9fcd-fcbd9fa64726 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:46.986790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759bf42-0a30-4a54-9e61-fe880e5de853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:46.987715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759bf42-0a30-4a54-9e61-fe880e5de853 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:46.988001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759bf42-0a30-4a54-9e61-fe880e5de853 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:46.988280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759bf42-0a30-4a54-9e61-fe880e5de853 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:46.999948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759bf42-0a30-4a54-9e61-fe880e5de853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:47.007752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-1759bf42-0a30-4a54-9e61-fe880e5de853 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:47.007752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:47.007752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:47.007752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:47.007752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:47.007752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:47.007752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:47.007752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:47.007752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:47.007752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:47.007752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:47.007752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:47.007752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:47.007752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:47.007752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:47.007752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:47.008657 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:47.008657 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:47.008657 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:47.008657 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:47.008657 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:47.008657 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:47.008657 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:47.008657 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:47.008657 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:47.008657 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:47.008657 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:47.008657 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:47.008657 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:47.008657 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:47.008657 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:47.008657 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:47.009554 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:47.009554 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:47.009554 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:47.009554 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:47.009554 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:47.009554 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:47.009554 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:47.009554 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:47.009554 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:47.009554 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:47.009554 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:47.009554 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:47.009554 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 361/725] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:45:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:45:47.016311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759bf42-0a30-4a54-9e61-fe880e5de853 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:47.064528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dc181-0e76-43da-8531-13fdb168f0b1 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:47.096837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:47.123207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4a8f0-942c-4434-b022-22105e52d73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:47.123875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4a8f0-942c-4434-b022-22105e52d73a None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:47.124157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4a8f0-942c-4434-b022-22105e52d73a None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:47.124470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4a8f0-942c-4434-b022-22105e52d73a None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:47.125213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4a8f0-942c-4434-b022-22105e52d73a None admin] RBAC: Adding query filter params (name=admin) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:47.125514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4a8f0-942c-4434-b022-22105e52d73a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:47.129138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4a8f0-942c-4434-b022-22105e52d73a None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:47.135702 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 365/726] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:45:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:45:47.141947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4a8f0-942c-4434-b022-22105e52d73a None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:47.204911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759bf42-0a30-4a54-9e61-fe880e5de853 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:47.215509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:47.281455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448a640-22e1-4592-b4ee-bddcb529649d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:47.282722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448a640-22e1-4592-b4ee-bddcb529649d None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:47.283347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448a640-22e1-4592-b4ee-bddcb529649d None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:47.283868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448a640-22e1-4592-b4ee-bddcb529649d None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:47.284808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448a640-22e1-4592-b4ee-bddcb529649d None admin] RBAC: Adding query filter params (name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:47.285273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448a640-22e1-4592-b4ee-bddcb529649d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:47.286856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448a640-22e1-4592-b4ee-bddcb529649d None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:47.302110 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 362/727] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Jul 16 20:45:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:47.309296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448a640-22e1-4592-b4ee-bddcb529649d None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:47.335232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4a8f0-942c-4434-b022-22105e52d73a None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:47.397176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22707bb-e4ee-4fd5-b262-48152c15d5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:47.398278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22707bb-e4ee-4fd5-b262-48152c15d5e5 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:47.398717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22707bb-e4ee-4fd5-b262-48152c15d5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:47.399265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22707bb-e4ee-4fd5-b262-48152c15d5e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:47.416924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22707bb-e4ee-4fd5-b262-48152c15d5e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:47.420399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22707bb-e4ee-4fd5-b262-48152c15d5e5 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:47.448380 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-a22707bb-e4ee-4fd5-b262-48152c15d5e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:47.448380 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:47.448380 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:47.448380 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:47.448380 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:47.448380 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:47.448380 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:47.448380 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:47.448380 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:47.448380 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:47.448380 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:47.448380 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:47.448380 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:47.448380 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:47.448380 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:47.450002 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:47.450002 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:47.450002 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:47.450002 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:47.450002 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:47.450002 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:47.450002 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:47.450002 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:47.450002 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:47.450002 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:47.450002 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:47.450002 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:47.450002 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:47.450002 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:47.450002 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:47.450002 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:47.450002 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:47.451077 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:47.451077 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:47.451077 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:47.451077 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:47.452943 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 366/728] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:47.458721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f2993-ac7b-4035-ba02-ad00325e4e2b None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:47.459539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f2993-ac7b-4035-ba02-ad00325e4e2b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:47.460021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f2993-ac7b-4035-ba02-ad00325e4e2b None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:47.461829 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 367/729] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:47.462817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f2993-ac7b-4035-ba02-ad00325e4e2b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:47.477220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:47.480218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448a640-22e1-4592-b4ee-bddcb529649d None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:47.522302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677e12a-3898-40af-b6d4-645f85a3ea3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:47.523465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677e12a-3898-40af-b6d4-645f85a3ea3b None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:47.523962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677e12a-3898-40af-b6d4-645f85a3ea3b None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:47.524423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677e12a-3898-40af-b6d4-645f85a3ea3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:47.539605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677e12a-3898-40af-b6d4-645f85a3ea3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:47.541530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677e12a-3898-40af-b6d4-645f85a3ea3b None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:47.565924 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-0677e12a-3898-40af-b6d4-645f85a3ea3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:47.565924 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:47.565924 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:47.565924 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:47.565924 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:47.565924 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:47.565924 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:47.565924 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:47.565924 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:47.565924 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:47.565924 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:47.565924 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:47.565924 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:47.565924 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:47.565924 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:47.566909 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:47.566909 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:47.566909 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:47.566909 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:47.566909 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:47.566909 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:47.566909 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:47.566909 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:47.566909 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:47.566909 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:47.566909 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:47.566909 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:47.566909 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:47.566909 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:47.566909 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:47.566909 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:47.566909 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:47.568133 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:47.568133 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:47.568133 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:47.568133 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:47.568133 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 363/730] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:47.569286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ca2f4-cb05-4af4-abbf-ef8daad712f8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:47.569655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ca2f4-cb05-4af4-abbf-ef8daad712f8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:47.570102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ca2f4-cb05-4af4-abbf-ef8daad712f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:47.580958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:47.589423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b67ca2f4-cb05-4af4-abbf-ef8daad712f8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:47.592056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b67ca2f4-cb05-4af4-abbf-ef8daad712f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:47.592552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f2993-ac7b-4035-ba02-ad00325e4e2b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:47.632620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7e1fe-fac9-42c7-815c-aba4d10c0207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:47.633489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7e1fe-fac9-42c7-815c-aba4d10c0207 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:47.633944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7e1fe-fac9-42c7-815c-aba4d10c0207 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:47.634324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7e1fe-fac9-42c7-815c-aba4d10c0207 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:47.635187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7e1fe-fac9-42c7-815c-aba4d10c0207 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:47.635646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7e1fe-fac9-42c7-815c-aba4d10c0207 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:47.637730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7e1fe-fac9-42c7-815c-aba4d10c0207 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:47.655633 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 368/731] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:47.656826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7e1fe-fac9-42c7-815c-aba4d10c0207 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:47.668920 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 364/732] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:47.670457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ca2f4-cb05-4af4-abbf-ef8daad712f8 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:47.802751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7e1fe-fac9-42c7-815c-aba4d10c0207 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:47.851465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2ca97-566d-471d-bd0d-32ab4497fa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:47.852861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2ca97-566d-471d-bd0d-32ab4497fa9e None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:47.853206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2ca97-566d-471d-bd0d-32ab4497fa9e None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:47.853529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2ca97-566d-471d-bd0d-32ab4497fa9e None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:47.854417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2ca97-566d-471d-bd0d-32ab4497fa9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:47.854900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2ca97-566d-471d-bd0d-32ab4497fa9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:47.857399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2ca97-566d-471d-bd0d-32ab4497fa9e None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:47.878265 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 369/733] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:47.879181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2ca97-566d-471d-bd0d-32ab4497fa9e None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:47.902925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:47.907871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:47.926905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ca2f4-cb05-4af4-abbf-ef8daad712f8 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:47.972057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538f5cd-e819-40a9-8235-1b31162c6880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:47.972866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538f5cd-e819-40a9-8235-1b31162c6880 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:47.973151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538f5cd-e819-40a9-8235-1b31162c6880 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:47.973468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538f5cd-e819-40a9-8235-1b31162c6880 None admin] PATH_INFO: `/v3/users/swift` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:47.983320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538f5cd-e819-40a9-8235-1b31162c6880 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:47.985240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538f5cd-e819-40a9-8235-1b31162c6880 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:48.000696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-d538f5cd-e819-40a9-8235-1b31162c6880 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 16 20:45:48.000696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:48.000696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:48.000696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:48.000696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:48.000696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:48.000696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:48.000696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:48.000696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:48.000696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:48.000696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:48.000696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:48.000696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:45:48.000696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:45:48.000696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:45:48.000696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:45:48.001757 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:48.001757 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:48.001757 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:45:48.001757 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:48.001757 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:45:48.001757 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:48.001757 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:48.001757 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:48.001757 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:48.001757 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:48.001757 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:48.001757 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:48.001757 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:48.001757 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:48.001757 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:48.001757 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:48.001757 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:48.001757 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:48.003560 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:48.003560 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:48.003560 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:45:48.003560 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:45:48.003560 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:45:48.003560 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:45:48.003560 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:45:48.003560 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:45:48.003560 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 16 20:45:48.003560 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:48.003560 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 365/734] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:45:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:48.003560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538f5cd-e819-40a9-8235-1b31162c6880 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:48.015486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2ca97-566d-471d-bd0d-32ab4497fa9e None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:48.061665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b11c9ec-7c6c-403d-8803-47faf6b20c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:48.062448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11c9ec-7c6c-403d-8803-47faf6b20c5e None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:48.062738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11c9ec-7c6c-403d-8803-47faf6b20c5e None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:48.063035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11c9ec-7c6c-403d-8803-47faf6b20c5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:48.074884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b11c9ec-7c6c-403d-8803-47faf6b20c5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:48.083134 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-6b11c9ec-7c6c-403d-8803-47faf6b20c5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:45:48.083134 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:48.083134 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:48.083134 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:48.083134 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:48.083134 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:48.083134 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:48.083134 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:48.083134 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:48.083134 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:48.083134 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:48.083134 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:48.083134 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:48.083134 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:48.083134 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:48.083134 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:48.084184 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:48.084184 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:48.084184 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:48.084184 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:48.084184 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:48.084184 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:48.084184 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:48.084184 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:48.084184 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:48.084184 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:48.084184 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:48.084184 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:48.084184 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:48.084184 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:48.084184 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:48.084184 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:48.085258 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:48.085258 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:48.085258 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:48.085258 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:48.085258 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:48.085258 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:48.085258 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:48.085258 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:48.085258 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:48.085258 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:48.085258 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:45:48.085258 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:48.085258 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 370/735] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:45:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:48.088322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdaaf4-09e7-4c40-a218-c285514ebf8a None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:48.088612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdaaf4-09e7-4c40-a218-c285514ebf8a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:48.088890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdaaf4-09e7-4c40-a218-c285514ebf8a None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:48.091875 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 371/736] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:48.092003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bdaaf4-09e7-4c40-a218-c285514ebf8a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:48.123681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538f5cd-e819-40a9-8235-1b31162c6880 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:48.159832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a0a3a-88e7-4af6-ac54-04b816a6f248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:48.160979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a0a3a-88e7-4af6-ac54-04b816a6f248 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:48.161428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a0a3a-88e7-4af6-ac54-04b816a6f248 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:48.161857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a0a3a-88e7-4af6-ac54-04b816a6f248 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:48.170159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a0a3a-88e7-4af6-ac54-04b816a6f248 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:48.171999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a0a3a-88e7-4af6-ac54-04b816a6f248 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:48.174085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:48.189598 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-361a0a3a-88e7-4af6-ac54-04b816a6f248 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 16 20:45:48.189598 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:48.189598 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:48.189598 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:48.189598 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:48.189598 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:48.189598 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:48.189598 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:48.189598 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:48.189598 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:48.189598 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:48.189598 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:48.189598 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:45:48.189598 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:45:48.189598 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:45:48.189598 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:45:48.190692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:48.190692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:48.190692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:45:48.190692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:48.190692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:45:48.190692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:48.190692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:48.190692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:48.190692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:48.190692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:48.190692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:48.190692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:48.190692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:48.190692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:48.190692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:48.190692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:48.190692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:48.190692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:48.191637 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:48.191637 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:48.191637 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:45:48.191637 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:45:48.191637 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:45:48.191637 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:45:48.191637 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:45:48.191637 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:45:48.191637 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 16 20:45:48.191637 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:48.191637 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 366/737] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Jul 16 20:45:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:48.192207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a0a3a-88e7-4af6-ac54-04b816a6f248 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:48.197922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:48.209763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bdaaf4-09e7-4c40-a218-c285514ebf8a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:48.243814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c5b72-aa39-4515-bee4-3551b4f80657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:48.244490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c5b72-aa39-4515-bee4-3551b4f80657 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:48.244772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c5b72-aa39-4515-bee4-3551b4f80657 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:48.245052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c5b72-aa39-4515-bee4-3551b4f80657 None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:48.245886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c5b72-aa39-4515-bee4-3551b4f80657 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:48.246224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c5b72-aa39-4515-bee4-3551b4f80657 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:48.247698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c5b72-aa39-4515-bee4-3551b4f80657 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:48.265641 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 372/738] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Jul 16 20:45:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:48.266922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496c65b-6b6d-42b2-a615-9cf670182397 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:48.267342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496c65b-6b6d-42b2-a615-9cf670182397 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:48.267627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496c65b-6b6d-42b2-a615-9cf670182397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:48.284074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5496c65b-6b6d-42b2-a615-9cf670182397 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:48.285288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5496c65b-6b6d-42b2-a615-9cf670182397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:48.299426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a0a3a-88e7-4af6-ac54-04b816a6f248 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:48.333726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98aac29-80e4-4a20-9247-ad72db1d4647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:48.334307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aac29-80e4-4a20-9247-ad72db1d4647 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:48.334592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aac29-80e4-4a20-9247-ad72db1d4647 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:48.334864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aac29-80e4-4a20-9247-ad72db1d4647 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:48.335744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98aac29-80e4-4a20-9247-ad72db1d4647 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:48.335966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98aac29-80e4-4a20-9247-ad72db1d4647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:48.337330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98aac29-80e4-4a20-9247-ad72db1d4647 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:48.346260 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 367/739] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:45:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:48.347623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a292db9-c91f-4ddf-821d-1b58a34c4674 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:48.347912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a292db9-c91f-4ddf-821d-1b58a34c4674 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:48.348303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a292db9-c91f-4ddf-821d-1b58a34c4674 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:48.349406 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 368/740] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:48.350087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a292db9-c91f-4ddf-821d-1b58a34c4674 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:48.362362 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 373/741] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:48.363472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496c65b-6b6d-42b2-a615-9cf670182397 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:48.425290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:48.430727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:48.465523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a292db9-c91f-4ddf-821d-1b58a34c4674 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:48.470784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496c65b-6b6d-42b2-a615-9cf670182397 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:48.500294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efca65-d84e-4b18-9201-5d935bc5d2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:48.500958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efca65-d84e-4b18-9201-5d935bc5d2ed None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:48.501234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efca65-d84e-4b18-9201-5d935bc5d2ed None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:48.501508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efca65-d84e-4b18-9201-5d935bc5d2ed None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:48.502335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efca65-d84e-4b18-9201-5d935bc5d2ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:48.502640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efca65-d84e-4b18-9201-5d935bc5d2ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:48.504099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efca65-d84e-4b18-9201-5d935bc5d2ed None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:48.506266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aea415-0ede-4e8f-9996-de5c9f0df853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:48.506913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aea415-0ede-4e8f-9996-de5c9f0df853 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:48.507310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aea415-0ede-4e8f-9996-de5c9f0df853 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:48.507572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aea415-0ede-4e8f-9996-de5c9f0df853 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:48.521978 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 369/742] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Jul 16 20:45:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:48.522818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efca65-d84e-4b18-9201-5d935bc5d2ed None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:48.580166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aea415-0ede-4e8f-9996-de5c9f0df853 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:48.581605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aea415-0ede-4e8f-9996-de5c9f0df853 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:48.626784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efca65-d84e-4b18-9201-5d935bc5d2ed None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:48.641827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:48.652500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:48.664226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea82124-582b-4425-9396-b9b1cfa2d057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:48.665015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea82124-582b-4425-9396-b9b1cfa2d057 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:48.665291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea82124-582b-4425-9396-b9b1cfa2d057 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:48.665564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea82124-582b-4425-9396-b9b1cfa2d057 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:48.675620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea82124-582b-4425-9396-b9b1cfa2d057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:48.677070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea82124-582b-4425-9396-b9b1cfa2d057 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:48.685035 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 374/743] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:45:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:45:48.686204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb02243-1e91-4e53-b28e-1714c6491322 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:48.686492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb02243-1e91-4e53-b28e-1714c6491322 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:48.686766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb02243-1e91-4e53-b28e-1714c6491322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:48.696102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-aea82124-582b-4425-9396-b9b1cfa2d057 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:48.696102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:48.696102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:48.696102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:48.696102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:48.696102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:48.696102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:48.696102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:48.696102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:48.696102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:48.696102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:48.696102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:48.696102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:48.696102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:48.696102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:48.697187 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:48.697187 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:48.697187 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:48.697187 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:48.697187 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:48.697187 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:48.697187 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:48.697187 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:48.697187 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:48.697187 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:48.697187 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:48.697187 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:48.697187 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:48.697187 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:48.697187 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:48.697187 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:48.697187 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:48.698052 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:48.698052 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:48.698052 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:48.698052 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:48.698052 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 370/744] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:48.698523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea82124-582b-4425-9396-b9b1cfa2d057 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:48.708442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-cbb02243-1e91-4e53-b28e-1714c6491322 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:48.709703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cbb02243-1e91-4e53-b28e-1714c6491322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:48.778822 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 375/745] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 20:45:48.779709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb02243-1e91-4e53-b28e-1714c6491322 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:48.803734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea82124-582b-4425-9396-b9b1cfa2d057 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:48.842750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff1258-f9e9-4906-a615-d0b870cfc9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:48.843435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff1258-f9e9-4906-a615-d0b870cfc9f2 None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:48.843718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff1258-f9e9-4906-a615-d0b870cfc9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:48.843990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff1258-f9e9-4906-a615-d0b870cfc9f2 None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:48.844704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff1258-f9e9-4906-a615-d0b870cfc9f2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:48.846069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff1258-f9e9-4906-a615-d0b870cfc9f2 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:48.872088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:48.881441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb02243-1e91-4e53-b28e-1714c6491322 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:48.914052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe3616-e759-4b29-837a-1a877888ef58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:48.914696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe3616-e759-4b29-837a-1a877888ef58 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:48.914977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe3616-e759-4b29-837a-1a877888ef58 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:48.915289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe3616-e759-4b29-837a-1a877888ef58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:48.943477 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 371/746] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Jul 16 20:45:48 2022] POST /identity/v3/services => generated 240 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:45:48.944341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff1258-f9e9-4906-a615-d0b870cfc9f2 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:48.997587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe3616-e759-4b29-837a-1a877888ef58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:48.999226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe3616-e759-4b29-837a-1a877888ef58 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:49.004364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:49.095993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff1258-f9e9-4906-a615-d0b870cfc9f2 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:49.114582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:49.127606 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 376/747] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:45:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 20:45:49.128549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe3616-e759-4b29-837a-1a877888ef58 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:49.138751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76f497-9243-468d-ab24-1ddf7fd530a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:49.139591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76f497-9243-468d-ab24-1ddf7fd530a1 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:49.140954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76f497-9243-468d-ab24-1ddf7fd530a1 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:49.140954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76f497-9243-468d-ab24-1ddf7fd530a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:49.153375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76f497-9243-468d-ab24-1ddf7fd530a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:49.155112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76f497-9243-468d-ab24-1ddf7fd530a1 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:49.175807 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-1d76f497-9243-468d-ab24-1ddf7fd530a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:49.175807 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:49.175807 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:49.175807 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:49.175807 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:49.175807 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:49.175807 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:49.175807 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:49.175807 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:49.175807 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:49.175807 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:49.175807 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:49.175807 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:49.175807 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:49.175807 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:49.176746 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:49.176746 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:49.176746 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:49.176746 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:49.176746 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:49.176746 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:49.176746 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:49.176746 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:49.176746 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:49.176746 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:49.176746 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:49.176746 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:49.176746 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:49.176746 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:49.176746 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:49.176746 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:49.176746 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:49.177611 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:49.177611 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:49.177611 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:49.177611 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:49.177611 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 372/748] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:49.178086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76f497-9243-468d-ab24-1ddf7fd530a1 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:49.241738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe3616-e759-4b29-837a-1a877888ef58 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:49.269800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:49.280975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa167391-8844-4eeb-b68f-3c9e9d107a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:49.281666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa167391-8844-4eeb-b68f-3c9e9d107a65 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:49.281991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa167391-8844-4eeb-b68f-3c9e9d107a65 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:49.285811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa167391-8844-4eeb-b68f-3c9e9d107a65 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:49.285811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa167391-8844-4eeb-b68f-3c9e9d107a65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:49.285811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa167391-8844-4eeb-b68f-3c9e9d107a65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:49.285811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa167391-8844-4eeb-b68f-3c9e9d107a65 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:49.288332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76f497-9243-468d-ab24-1ddf7fd530a1 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:49.304907 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 377/749] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:49.304907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa167391-8844-4eeb-b68f-3c9e9d107a65 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:49.332083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d215b-ef7d-4c81-ab4e-eaf76c35a528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:49.332744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d215b-ef7d-4c81-ab4e-eaf76c35a528 None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:49.333024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d215b-ef7d-4c81-ab4e-eaf76c35a528 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:49.333298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d215b-ef7d-4c81-ab4e-eaf76c35a528 None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:49.334015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d215b-ef7d-4c81-ab4e-eaf76c35a528 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:49.335439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d215b-ef7d-4c81-ab4e-eaf76c35a528 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:49.359105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:49.408239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa167391-8844-4eeb-b68f-3c9e9d107a65 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:49.412234 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 373/750] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Jul 16 20:45:49 2022] POST /identity/v3/services => generated 251 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:45:49.420093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d215b-ef7d-4c81-ab4e-eaf76c35a528 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:49.472169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad2e7a-a21c-4d83-9a0c-899399aae911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:49.472996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad2e7a-a21c-4d83-9a0c-899399aae911 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:49.473297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad2e7a-a21c-4d83-9a0c-899399aae911 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:49.473572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad2e7a-a21c-4d83-9a0c-899399aae911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:49.487112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad2e7a-a21c-4d83-9a0c-899399aae911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:49.488660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad2e7a-a21c-4d83-9a0c-899399aae911 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:49.510480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-83ad2e7a-a21c-4d83-9a0c-899399aae911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:49.510480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:49.510480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:49.510480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:49.510480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:49.510480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:49.510480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:49.510480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:49.510480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:49.510480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:49.510480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:49.510480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:49.510480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:49.510480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:49.510480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:49.511519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:49.511519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:49.511519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:49.511519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:49.511519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:49.511519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:49.511519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:49.511519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:49.511519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:49.511519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:49.511519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:49.511519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:49.511519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:49.511519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:49.511519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:49.511519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:49.511519 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:49.512449 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:49.512449 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:49.512449 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:49.512449 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:49.516845 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 378/751] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:49.517837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad2e7a-a21c-4d83-9a0c-899399aae911 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:49.584161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d215b-ef7d-4c81-ab4e-eaf76c35a528 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:49.636566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:49.637275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdaa56-191f-4e47-a3df-83f8412a7824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:49.637783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdaa56-191f-4e47-a3df-83f8412a7824 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:49.638074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdaa56-191f-4e47-a3df-83f8412a7824 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:49.638345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdaa56-191f-4e47-a3df-83f8412a7824 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:49.639192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdaa56-191f-4e47-a3df-83f8412a7824 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:49.639504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdaa56-191f-4e47-a3df-83f8412a7824 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:49.640925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdaa56-191f-4e47-a3df-83f8412a7824 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:49.644120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad2e7a-a21c-4d83-9a0c-899399aae911 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:49.657159 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 374/752] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:49.658555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdaa56-191f-4e47-a3df-83f8412a7824 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:49.662126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:49.688234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb52f0-56bb-4020-b8f9-c27aa9885da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:49.689360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb52f0-56bb-4020-b8f9-c27aa9885da9 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:49.689649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb52f0-56bb-4020-b8f9-c27aa9885da9 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:49.689986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb52f0-56bb-4020-b8f9-c27aa9885da9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:49.701479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb52f0-56bb-4020-b8f9-c27aa9885da9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:49.703138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb52f0-56bb-4020-b8f9-c27aa9885da9 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:49.720544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-73bb52f0-56bb-4020-b8f9-c27aa9885da9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 16 20:45:49.720544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:49.720544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:49.720544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:49.720544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:49.720544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:49.720544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:49.720544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:49.720544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:49.720544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:49.720544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:49.720544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:49.720544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:45:49.720544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:45:49.720544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:45:49.720544 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:45:49.721672 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:49.721672 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:49.721672 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:45:49.721672 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:49.721672 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:45:49.721672 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:49.721672 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:49.721672 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:49.721672 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:49.721672 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:49.721672 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:49.721672 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:49.721672 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:49.721672 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:49.721672 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:49.721672 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:49.721672 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:49.721672 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:49.722815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:49.722815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:49.722815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:45:49.722815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:45:49.722815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:45:49.722815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:45:49.722815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:45:49.722815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:45:49.722815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 16 20:45:49.722815 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:49.726491 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 379/753] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Jul 16 20:45:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:49.727390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb52f0-56bb-4020-b8f9-c27aa9885da9 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:49.787855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdaa56-191f-4e47-a3df-83f8412a7824 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:49.836276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d51e58-48df-4ff4-9d7a-a2b19bb1261d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:49.837190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d51e58-48df-4ff4-9d7a-a2b19bb1261d None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:49.837567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d51e58-48df-4ff4-9d7a-a2b19bb1261d None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:49.837941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d51e58-48df-4ff4-9d7a-a2b19bb1261d None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:49.838287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb52f0-56bb-4020-b8f9-c27aa9885da9 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:49.838848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d51e58-48df-4ff4-9d7a-a2b19bb1261d None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:49.839270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d51e58-48df-4ff4-9d7a-a2b19bb1261d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:49.842592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d51e58-48df-4ff4-9d7a-a2b19bb1261d None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:49.859448 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 375/754] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:49.865480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d51e58-48df-4ff4-9d7a-a2b19bb1261d None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:49.882762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d0ae7-2d3c-4540-9808-4d7ff37ef37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:49.883924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d0ae7-2d3c-4540-9808-4d7ff37ef37e None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:49.884353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d0ae7-2d3c-4540-9808-4d7ff37ef37e None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:49.884800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d0ae7-2d3c-4540-9808-4d7ff37ef37e None admin] PATH_INFO: `/v3/projects/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:49.892440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d0ae7-2d3c-4540-9808-4d7ff37ef37e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:49.894288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d0ae7-2d3c-4540-9808-4d7ff37ef37e None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:49.910372 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-ed0d0ae7-2d3c-4540-9808-4d7ff37ef37e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:49.910372 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:49.910372 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:49.910372 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:49.910372 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:49.910372 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:49.910372 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:49.910372 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:49.910372 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:49.910372 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:49.910372 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:49.910372 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:49.910372 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:45:49.910372 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:45:49.910372 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:45:49.911518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:45:49.911518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:49.911518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:49.911518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:49.911518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:49.911518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:49.911518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:49.911518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:49.911518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:49.911518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:49.911518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:49.911518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:49.911518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:49.911518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:49.911518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:49.911518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:49.911518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:49.912601 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:45:49.912601 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:45:49.912601 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:45:49.912601 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:45:49.912601 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:45:49.912601 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:45:49.912601 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:49.912601 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:49.919368 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 380/755] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:49.920473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d0ae7-2d3c-4540-9808-4d7ff37ef37e None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:49.936874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:49.943302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:49.980483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d51e58-48df-4ff4-9d7a-a2b19bb1261d None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:50.018973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8938d8-ba5c-43d8-819c-063256a393d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:50.019941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8938d8-ba5c-43d8-819c-063256a393d9 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:50.020368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8938d8-ba5c-43d8-819c-063256a393d9 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:50.020812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8938d8-ba5c-43d8-819c-063256a393d9 None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:50.021795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8938d8-ba5c-43d8-819c-063256a393d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:50.022258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8938d8-ba5c-43d8-819c-063256a393d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:50.023872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8938d8-ba5c-43d8-819c-063256a393d9 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:50.035383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d0ae7-2d3c-4540-9808-4d7ff37ef37e None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:50.044786 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 376/756] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Jul 16 20:45:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:50.045993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8938d8-ba5c-43d8-819c-063256a393d9 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:50.083839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17760e-3282-48c4-965a-bae7725cc119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:50.084780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17760e-3282-48c4-965a-bae7725cc119 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:50.085168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17760e-3282-48c4-965a-bae7725cc119 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:50.085559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17760e-3282-48c4-965a-bae7725cc119 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:50.097823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17760e-3282-48c4-965a-bae7725cc119 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:50.099794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17760e-3282-48c4-965a-bae7725cc119 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:50.120779 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-af17760e-3282-48c4-965a-bae7725cc119 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:50.120779 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:50.120779 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:50.120779 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:50.120779 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:50.120779 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:50.120779 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:50.120779 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:50.120779 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:50.120779 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:50.120779 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:50.120779 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:50.120779 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:45:50.120779 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:45:50.120779 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:45:50.121835 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:45:50.121835 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:50.121835 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:50.121835 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:50.121835 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:50.121835 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:50.121835 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:50.121835 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:50.121835 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:50.121835 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:50.121835 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:50.121835 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:50.121835 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:50.121835 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:50.121835 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:50.121835 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:50.121835 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:50.122885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:45:50.122885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:45:50.122885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:45:50.122885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:45:50.122885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:45:50.122885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:45:50.122885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:50.122885 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:50.129237 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 381/757] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:50.129237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17760e-3282-48c4-965a-bae7725cc119 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:50.186075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8938d8-ba5c-43d8-819c-063256a393d9 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:50.214164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:50.233295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:50.236301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391647e-3172-4e69-a893-2c7f3b5bb308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:50.237157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391647e-3172-4e69-a893-2c7f3b5bb308 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:50.237438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391647e-3172-4e69-a893-2c7f3b5bb308 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:50.237709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391647e-3172-4e69-a893-2c7f3b5bb308 None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:50.239063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391647e-3172-4e69-a893-2c7f3b5bb308 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:50.239382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391647e-3172-4e69-a893-2c7f3b5bb308 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:50.241124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391647e-3172-4e69-a893-2c7f3b5bb308 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:50.258602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17760e-3282-48c4-965a-bae7725cc119 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:50.263040 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 377/758] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:45:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:50.263040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391647e-3172-4e69-a893-2c7f3b5bb308 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:50.300924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378f201-005b-495d-8be6-f90e9ba6a090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:50.302147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378f201-005b-495d-8be6-f90e9ba6a090 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:50.302655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378f201-005b-495d-8be6-f90e9ba6a090 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:50.303194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378f201-005b-495d-8be6-f90e9ba6a090 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:50.315838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378f201-005b-495d-8be6-f90e9ba6a090 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:50.317678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378f201-005b-495d-8be6-f90e9ba6a090 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:50.336777 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-c378f201-005b-495d-8be6-f90e9ba6a090 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:50.336777 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:50.336777 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:50.336777 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:50.336777 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:50.336777 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:50.336777 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:50.336777 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:50.336777 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:50.336777 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:50.336777 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:50.336777 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:50.336777 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:50.336777 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:50.336777 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:50.337712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:50.337712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:50.337712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:50.337712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:50.337712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:50.337712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:50.337712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:50.337712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:50.337712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:50.337712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:50.337712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:50.337712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:50.337712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:50.337712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:50.337712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:50.337712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:50.337712 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:50.338560 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:50.338560 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:50.338560 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:50.338560 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:50.342355 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 382/759] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:50.343613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378f201-005b-495d-8be6-f90e9ba6a090 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:50.389515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391647e-3172-4e69-a893-2c7f3b5bb308 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:50.430378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f933d51-57dc-4343-a8d7-cc254d8d7ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:50.431519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f933d51-57dc-4343-a8d7-cc254d8d7ed9 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:50.432014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f933d51-57dc-4343-a8d7-cc254d8d7ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:50.432525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f933d51-57dc-4343-a8d7-cc254d8d7ed9 None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:50.434274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f933d51-57dc-4343-a8d7-cc254d8d7ed9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:50.434879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f933d51-57dc-4343-a8d7-cc254d8d7ed9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:50.437398 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f933d51-57dc-4343-a8d7-cc254d8d7ed9 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:50.459748 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 378/760] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:45:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:50.460995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f933d51-57dc-4343-a8d7-cc254d8d7ed9 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:50.462154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378f201-005b-495d-8be6-f90e9ba6a090 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:50.497121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:50.504324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b63733-9701-4060-b908-e5cd8da5a530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:50.508038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b63733-9701-4060-b908-e5cd8da5a530 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:50.508038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b63733-9701-4060-b908-e5cd8da5a530 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:50.508038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b63733-9701-4060-b908-e5cd8da5a530 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:50.508038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b63733-9701-4060-b908-e5cd8da5a530 None admin] RBAC: Adding query filter params (role.id=bd33b827674a4d4db30c164cab416056, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=9a66df01ea414b34a8842488b145974f) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:50.508038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b63733-9701-4060-b908-e5cd8da5a530 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:50.509333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b63733-9701-4060-b908-e5cd8da5a530 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:50.523373 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 383/761] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:45:50 2022] GET /identity/v3/role_assignments?user.id=9a66df01ea414b34a8842488b145974f&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=bd33b827674a4d4db30c164cab416056 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:50.524832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b63733-9701-4060-b908-e5cd8da5a530 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:50.526909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:50.608906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f933d51-57dc-4343-a8d7-cc254d8d7ed9 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:50.657346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fcecd-7139-42c7-b449-524137935020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:50.658218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fcecd-7139-42c7-b449-524137935020 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:50.658498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fcecd-7139-42c7-b449-524137935020 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:50.658771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fcecd-7139-42c7-b449-524137935020 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:50.659547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2fcecd-7139-42c7-b449-524137935020 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:50.659851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2fcecd-7139-42c7-b449-524137935020 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:50.661742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2fcecd-7139-42c7-b449-524137935020 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:50.678719 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 379/762] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:50.685782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fcecd-7139-42c7-b449-524137935020 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:50.779755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b63733-9701-4060-b908-e5cd8da5a530 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:50.832976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac43cfd-c846-44e9-b10f-6b8e24fcd9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:50.834012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac43cfd-c846-44e9-b10f-6b8e24fcd9ea None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:50.834309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac43cfd-c846-44e9-b10f-6b8e24fcd9ea None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:50.834585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac43cfd-c846-44e9-b10f-6b8e24fcd9ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:50.835702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac43cfd-c846-44e9-b10f-6b8e24fcd9ea None admin] RBAC: Adding query filter params (role.id=99a4e0ec120f4163a419b2775afb8a41, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=2b154ad257954b53a13730b4a9f60570) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:50.836013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac43cfd-c846-44e9-b10f-6b8e24fcd9ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:50.838291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac43cfd-c846-44e9-b10f-6b8e24fcd9ea None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:50.847650 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 384/763] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:45:50 2022] GET /identity/v3/role_assignments?user.id=2b154ad257954b53a13730b4a9f60570&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=99a4e0ec120f4163a419b2775afb8a41 => generated 259 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:50.858258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:50.862869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fcecd-7139-42c7-b449-524137935020 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:50.902040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72273d0e-0966-42d9-bd06-705ef4cc6839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:50.903832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72273d0e-0966-42d9-bd06-705ef4cc6839 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:50.904183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72273d0e-0966-42d9-bd06-705ef4cc6839 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:50.904484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72273d0e-0966-42d9-bd06-705ef4cc6839 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:50.913267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72273d0e-0966-42d9-bd06-705ef4cc6839 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:50.914727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72273d0e-0966-42d9-bd06-705ef4cc6839 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:50.931869 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-72273d0e-0966-42d9-bd06-705ef4cc6839 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:50.931869 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:50.931869 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:50.931869 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:50.931869 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:50.931869 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:50.931869 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:50.931869 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:50.931869 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:50.931869 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:50.931869 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:50.931869 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:50.931869 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:45:50.931869 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:45:50.931869 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:45:50.937233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:45:50.937233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:50.937233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:50.937233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:50.937233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:50.937233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:50.937233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:50.937233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:50.937233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:50.937233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:50.937233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:50.937233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:50.937233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:50.937233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:50.937233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:50.937233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:50.937233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:50.938084 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:45:50.938084 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:45:50.938084 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:45:50.938084 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:45:50.938084 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:45:50.938084 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:45:50.938084 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:50.938084 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:50.938084 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 380/764] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:45:50.941172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac43cfd-c846-44e9-b10f-6b8e24fcd9ea None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:51.044458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:51.112710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac43cfd-c846-44e9-b10f-6b8e24fcd9ea None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:51.171674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111afb8-b305-4c03-aed5-5d8d02e4857e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:51.172380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111afb8-b305-4c03-aed5-5d8d02e4857e None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:51.172659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111afb8-b305-4c03-aed5-5d8d02e4857e None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:51.172936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111afb8-b305-4c03-aed5-5d8d02e4857e None admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:51.173759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111afb8-b305-4c03-aed5-5d8d02e4857e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:51.174075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111afb8-b305-4c03-aed5-5d8d02e4857e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:51.175628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111afb8-b305-4c03-aed5-5d8d02e4857e None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:51.197672 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 385/765] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:45:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:51.203679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72273d0e-0966-42d9-bd06-705ef4cc6839 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:51.381214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72273d0e-0966-42d9-bd06-705ef4cc6839 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:51.435766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5951cd6-7628-43e3-bad0-24702d85ab17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:51.436745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5951cd6-7628-43e3-bad0-24702d85ab17 None admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:51.437033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5951cd6-7628-43e3-bad0-24702d85ab17 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:51.437310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5951cd6-7628-43e3-bad0-24702d85ab17 None admin] PATH_INFO: `/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/d5f515bfe2094b41afe82b4bc57e4b9a/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:51.439460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5951cd6-7628-43e3-bad0-24702d85ab17 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3045a89835d4e879a0ddc2557b831a3, user_id=d5f515bfe2094b41afe82b4bc57e4b9a, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:51.440918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5951cd6-7628-43e3-bad0-24702d85ab17 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:51.497618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896e02f-e6b6-48b5-93c0-0272bdfacfe7 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:51.498593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896e02f-e6b6-48b5-93c0-0272bdfacfe7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:51.499140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896e02f-e6b6-48b5-93c0-0272bdfacfe7 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:51.501039 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 386/766] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:45:51.506852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5f615-99ba-48a6-9253-cf059a398ef3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:51.507485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5f615-99ba-48a6-9253-cf059a398ef3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:51.507929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5f615-99ba-48a6-9253-cf059a398ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:51.527534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-01a5f615-99ba-48a6-9253-cf059a398ef3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:51.529343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-01a5f615-99ba-48a6-9253-cf059a398ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:51.540959 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 381/767] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:45:51 2022] PUT /identity/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/d5f515bfe2094b41afe82b4bc57e4b9a/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:45:51.654161 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 387/768] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:45:51.691979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5951cd6-7628-43e3-bad0-24702d85ab17 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:51.726335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:51.833987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5951cd6-7628-43e3-bad0-24702d85ab17 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:51.874068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb4c2d-fae4-4d91-8c77-2a8e66da42e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:51.875514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb4c2d-fae4-4d91-8c77-2a8e66da42e9 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:51.875927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb4c2d-fae4-4d91-8c77-2a8e66da42e9 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:51.876374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb4c2d-fae4-4d91-8c77-2a8e66da42e9 None admin] PATH_INFO: `/v3/services/network` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:51.877314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb4c2d-fae4-4d91-8c77-2a8e66da42e9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:51.878776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb4c2d-fae4-4d91-8c77-2a8e66da42e9 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:51.892677 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-f3fb4c2d-fae4-4d91-8c77-2a8e66da42e9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 16 20:45:51.892677 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:51.892677 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:45:51.892677 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:45:51.892677 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:45:51.892677 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:45:51.892677 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:45:51.892677 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:45:51.892677 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 16 20:45:51.892677 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:51.892677 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:45:51.892677 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:51.892677 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:51.892677 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:51.892677 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:51.892677 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:51.892677 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:51.893753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:51.893753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:51.893753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:51.893753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:51.893753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:51.893753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:51.893753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:45:51.893753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:45:51.893753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:45:51.893753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:45:51.893753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:51.893753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:51.893753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:51.893753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:51.893753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:51.893753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:51.894567 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:51.894567 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:51.894567 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:51.894567 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:51.894567 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:51.894567 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:51.894567 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:51.894567 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:51.894567 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:51.894567 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:51.894567 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:45:51.894567 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:45:51.894567 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 16 20:45:51.894567 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:51.894567 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 382/769] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:51 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:51.906638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5f615-99ba-48a6-9253-cf059a398ef3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:51.973046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:51.980817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617024e-6fb5-4c02-aa39-2cbeeabec63c None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:51.981118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617024e-6fb5-4c02-aa39-2cbeeabec63c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:51.981480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617024e-6fb5-4c02-aa39-2cbeeabec63c None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:51.983212 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 383/770] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:45:52.004393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0c88b-d64a-44da-8842-24f5a21c8402 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:52.004691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0c88b-d64a-44da-8842-24f5a21c8402 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:52.004963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0c88b-d64a-44da-8842-24f5a21c8402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:52.044469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0db0c88b-d64a-44da-8842-24f5a21c8402 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:52.045681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0db0c88b-d64a-44da-8842-24f5a21c8402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:52.051633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5f615-99ba-48a6-9253-cf059a398ef3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:52.127278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5334c0d-c823-48ee-9a45-4264ad6edaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:52.127965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5334c0d-c823-48ee-9a45-4264ad6edaa7 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:52.128249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5334c0d-c823-48ee-9a45-4264ad6edaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:52.128528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5334c0d-c823-48ee-9a45-4264ad6edaa7 None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:52.129252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5334c0d-c823-48ee-9a45-4264ad6edaa7 None admin] RBAC: Adding query filter params (name=network) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:52.129595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5334c0d-c823-48ee-9a45-4264ad6edaa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:52.130983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5334c0d-c823-48ee-9a45-4264ad6edaa7 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:52.149185 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 388/771] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Jul 16 20:45:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:52.152533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5334c0d-c823-48ee-9a45-4264ad6edaa7 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:52.232931 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 384/772] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:45:52.265484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5334c0d-c823-48ee-9a45-4264ad6edaa7 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:52.268945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0c88b-d64a-44da-8842-24f5a21c8402 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:52.282512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:52.300301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:52.319296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5899346-e2bf-4917-bad6-aea0cda4b494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:52.319978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5899346-e2bf-4917-bad6-aea0cda4b494 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:52.320269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5899346-e2bf-4917-bad6-aea0cda4b494 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:52.320543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5899346-e2bf-4917-bad6-aea0cda4b494 None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:52.321265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5899346-e2bf-4917-bad6-aea0cda4b494 None admin] RBAC: Adding query filter params (type=network) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:52.321573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5899346-e2bf-4917-bad6-aea0cda4b494 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:52.323044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5899346-e2bf-4917-bad6-aea0cda4b494 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:52.333581 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 389/773] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Jul 16 20:45:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:52.338580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5899346-e2bf-4917-bad6-aea0cda4b494 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:52.458892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5899346-e2bf-4917-bad6-aea0cda4b494 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:52.499398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429dbe1-24fb-4311-8e64-e0d1a952c8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:52.501063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429dbe1-24fb-4311-8e64-e0d1a952c8fc None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:52.501588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429dbe1-24fb-4311-8e64-e0d1a952c8fc None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:52.502089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429dbe1-24fb-4311-8e64-e0d1a952c8fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:52.503126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429dbe1-24fb-4311-8e64-e0d1a952c8fc None admin] RBAC: Adding query filter params (interface=public, service_id=ab60cb8350274ffeb0c84b897c180899, region_id=RegionOne) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:52.503665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429dbe1-24fb-4311-8e64-e0d1a952c8fc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:52.506264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429dbe1-24fb-4311-8e64-e0d1a952c8fc None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:52.515552 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 390/774] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Jul 16 20:45:52 2022] GET /identity/v3/endpoints?service_id=ab60cb8350274ffeb0c84b897c180899&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:45:52.521934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429dbe1-24fb-4311-8e64-e0d1a952c8fc None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:52.571538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:52.633062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0c88b-d64a-44da-8842-24f5a21c8402 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:52.641547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429dbe1-24fb-4311-8e64-e0d1a952c8fc None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:52.680438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3dca28-1f21-44ef-9ec0-2c6628a0de46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:52.681473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3dca28-1f21-44ef-9ec0-2c6628a0de46 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:52.681991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3dca28-1f21-44ef-9ec0-2c6628a0de46 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:52.682496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3dca28-1f21-44ef-9ec0-2c6628a0de46 None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:52.684253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3dca28-1f21-44ef-9ec0-2c6628a0de46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:52.686005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3dca28-1f21-44ef-9ec0-2c6628a0de46 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:52.692217 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 391/775] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Jul 16 20:45:52 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:52.742027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad3aa7-24e7-4c3d-a751-5b13f3e748d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:52.743625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad3aa7-24e7-4c3d-a751-5b13f3e748d3 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:52.744091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad3aa7-24e7-4c3d-a751-5b13f3e748d3 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:52.744567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad3aa7-24e7-4c3d-a751-5b13f3e748d3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:52.745405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad3aa7-24e7-4c3d-a751-5b13f3e748d3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:52.747562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad3aa7-24e7-4c3d-a751-5b13f3e748d3 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:52.764589 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-16ad3aa7-24e7-4c3d-a751-5b13f3e748d3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 16 20:45:52.764589 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:52.764589 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:45:52.764589 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:45:52.764589 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:45:52.764589 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:45:52.764589 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:45:52.764589 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:45:52.764589 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 16 20:45:52.764589 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:52.764589 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:45:52.764589 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:52.764589 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:52.764589 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:52.764589 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:52.764589 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:52.765568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:52.765568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:52.765568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:52.765568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:52.765568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:52.765568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:52.765568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:52.765568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:45:52.765568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:45:52.765568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:45:52.765568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:45:52.765568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:52.765568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:52.765568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:52.765568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:52.765568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:52.766422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:52.766422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:52.766422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:52.766422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:52.766422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:52.766422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:52.766422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:52.766422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:52.766422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:52.766422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:52.766422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:52.766422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:45:52.766422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:45:52.766422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 16 20:45:52.766422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:52.769217 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 385/776] 10.222.0.16 () {56 vars in 1129 bytes} [Sat Jul 16 20:45:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 501 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:45:52.776802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3dca28-1f21-44ef-9ec0-2c6628a0de46 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:52.930392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3dca28-1f21-44ef-9ec0-2c6628a0de46 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:52.935435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:52.985971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943fad0-1be8-422d-8728-b9eea4fdcc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:52.986696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943fad0-1be8-422d-8728-b9eea4fdcc54 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:52.986984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943fad0-1be8-422d-8728-b9eea4fdcc54 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:52.987294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943fad0-1be8-422d-8728-b9eea4fdcc54 None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:52.988029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943fad0-1be8-422d-8728-b9eea4fdcc54 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:52.988336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943fad0-1be8-422d-8728-b9eea4fdcc54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:52.989866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943fad0-1be8-422d-8728-b9eea4fdcc54 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:53.000289 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 392/777] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Jul 16 20:45:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:53.006155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad3aa7-24e7-4c3d-a751-5b13f3e748d3 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:53.103183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:53.130749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad3aa7-24e7-4c3d-a751-5b13f3e748d3 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:53.169796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad4888-6e16-422a-9e62-373e70f533e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:53.170673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad4888-6e16-422a-9e62-373e70f533e8 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:53.171500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad4888-6e16-422a-9e62-373e70f533e8 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:53.171792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad4888-6e16-422a-9e62-373e70f533e8 None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:53.172531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad4888-6e16-422a-9e62-373e70f533e8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:53.172934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad4888-6e16-422a-9e62-373e70f533e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:53.174332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad4888-6e16-422a-9e62-373e70f533e8 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:53.180546 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 386/778] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Jul 16 20:45:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:53.187600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943fad0-1be8-422d-8728-b9eea4fdcc54 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:53.311976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943fad0-1be8-422d-8728-b9eea4fdcc54 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:53.367548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0025d57-4423-45e8-b09e-2bb47900d7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:53.368152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0025d57-4423-45e8-b09e-2bb47900d7d2 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:53.368437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0025d57-4423-45e8-b09e-2bb47900d7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:53.368782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0025d57-4423-45e8-b09e-2bb47900d7d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:53.369694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0025d57-4423-45e8-b09e-2bb47900d7d2 None admin] RBAC: Adding query filter params (interface=public, service_id=4abe4bf263de410599cc72c87b93bf00, region_id=RegionOne) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:53.370011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0025d57-4423-45e8-b09e-2bb47900d7d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:53.371571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0025d57-4423-45e8-b09e-2bb47900d7d2 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:53.384114 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 393/779] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Jul 16 20:45:53 2022] GET /identity/v3/endpoints?service_id=4abe4bf263de410599cc72c87b93bf00&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:45:53.391299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad4888-6e16-422a-9e62-373e70f533e8 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:53.434428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99e661-2261-4613-9006-a0161e725c32 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:53.434763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99e661-2261-4613-9006-a0161e725c32 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:53.435072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99e661-2261-4613-9006-a0161e725c32 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:53.437179 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 394/780] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:53.442585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ef969-a893-4fbd-89cd-74f6ef1b19bd None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:53.442874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ef969-a893-4fbd-89cd-74f6ef1b19bd None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:53.443184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ef969-a893-4fbd-89cd-74f6ef1b19bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:53.474133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-073ef969-a893-4fbd-89cd-74f6ef1b19bd None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:53.475385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-073ef969-a893-4fbd-89cd-74f6ef1b19bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:53.535217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:53.591797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad4888-6e16-422a-9e62-373e70f533e8 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:53.617968 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 395/781] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:45:53.631623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fedebd-9954-429b-bf79-7aa2520b474c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:53.632296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fedebd-9954-429b-bf79-7aa2520b474c None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:53.632642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fedebd-9954-429b-bf79-7aa2520b474c None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:53.632932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fedebd-9954-429b-bf79-7aa2520b474c None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:53.633618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fedebd-9954-429b-bf79-7aa2520b474c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:53.635433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fedebd-9954-429b-bf79-7aa2520b474c None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:53.642407 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 387/782] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Jul 16 20:45:53 2022] GET /identity/v3/services => generated 772 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:53.656702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ef969-a893-4fbd-89cd-74f6ef1b19bd None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:53.706542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd39035-c550-4fbd-ba73-b6695ef8a3bc None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:53.706903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd39035-c550-4fbd-ba73-b6695ef8a3bc None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:53.707181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd39035-c550-4fbd-ba73-b6695ef8a3bc None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:53.708959 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 388/783] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:45:53.714284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfdde2-0844-4ca3-88e5-3a5194d72bb1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:53.714643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfdde2-0844-4ca3-88e5-3a5194d72bb1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:53.714918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfdde2-0844-4ca3-88e5-3a5194d72bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:53.736287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:53.752416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b8dfdde2-0844-4ca3-88e5-3a5194d72bb1 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:53.754814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b8dfdde2-0844-4ca3-88e5-3a5194d72bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:53.837482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ef969-a893-4fbd-89cd-74f6ef1b19bd None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:53.884168 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 389/784] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:45:53.910582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918f765-05d1-4ef9-ae60-fc9cc537a734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:53.912046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918f765-05d1-4ef9-ae60-fc9cc537a734 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:53.912554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918f765-05d1-4ef9-ae60-fc9cc537a734 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:53.913058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918f765-05d1-4ef9-ae60-fc9cc537a734 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:53.915296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfdde2-0844-4ca3-88e5-3a5194d72bb1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:53.936414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918f765-05d1-4ef9-ae60-fc9cc537a734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:53.952399 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-4918f765-05d1-4ef9-ae60-fc9cc537a734 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:45:53.952399 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:53.952399 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:53.952399 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:53.952399 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:53.952399 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:53.952399 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:53.952399 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:53.952399 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:53.952399 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:53.952399 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:53.952399 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:53.952399 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:53.952399 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:53.952399 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:53.952399 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:53.953415 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:53.953415 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:53.953415 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:53.953415 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:53.953415 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:53.953415 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:53.953415 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:53.953415 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:53.953415 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:53.953415 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:53.953415 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:53.953415 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:53.953415 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:53.953415 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:53.953415 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:53.953415 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:53.954296 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:53.954296 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:53.954296 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:53.954296 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:53.954296 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:53.954296 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:53.954296 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:53.954296 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:53.954296 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:53.954296 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:53.954296 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:45:53.954296 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:53.959762 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 396/785] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:45:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:53.965792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918f765-05d1-4ef9-ae60-fc9cc537a734 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:54.029599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:54.080591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfdde2-0844-4ca3-88e5-3a5194d72bb1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:54.164190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33135980-5b24-4c20-b874-4d34a0bcf2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:54.166775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33135980-5b24-4c20-b874-4d34a0bcf2ca None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:54.169338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33135980-5b24-4c20-b874-4d34a0bcf2ca None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:54.171335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918f765-05d1-4ef9-ae60-fc9cc537a734 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:54.171875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33135980-5b24-4c20-b874-4d34a0bcf2ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:54.184295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:54.200153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33135980-5b24-4c20-b874-4d34a0bcf2ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:54.209780 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-33135980-5b24-4c20-b874-4d34a0bcf2ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:54.209780 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:54.209780 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:54.209780 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:54.209780 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:54.209780 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:54.209780 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:54.209780 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:54.209780 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:54.209780 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:54.209780 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:54.209780 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:54.209780 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:54.209780 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:54.209780 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:54.209780 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:54.210764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:54.210764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:54.210764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:54.210764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:54.210764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:54.210764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:54.210764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:54.210764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:54.210764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:54.210764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:54.210764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:54.210764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:54.210764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:54.210764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:54.210764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:54.210764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:54.211604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:54.211604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:54.211604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:54.211604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:54.211604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:54.211604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:54.211604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:54.211604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:54.211604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:54.211604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:54.211604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:45:54.211604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:54.211604 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 390/786] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:45:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:45:54.219163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33135980-5b24-4c20-b874-4d34a0bcf2ca None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:54.288071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55429c20-a47f-4ad2-9803-387574531c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:54.288755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55429c20-a47f-4ad2-9803-387574531c26 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:54.289040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55429c20-a47f-4ad2-9803-387574531c26 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:54.289319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55429c20-a47f-4ad2-9803-387574531c26 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:54.290075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55429c20-a47f-4ad2-9803-387574531c26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:54.290382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55429c20-a47f-4ad2-9803-387574531c26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:54.291799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55429c20-a47f-4ad2-9803-387574531c26 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:54.313616 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 397/787] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:45:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:54.319731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55429c20-a47f-4ad2-9803-387574531c26 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:54.386805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33135980-5b24-4c20-b874-4d34a0bcf2ca None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:54.431195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:54.450820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb07d4-4b36-4def-9e18-e711d9e03877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:54.452358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55429c20-a47f-4ad2-9803-387574531c26 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:54.463174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb07d4-4b36-4def-9e18-e711d9e03877 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:54.463507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb07d4-4b36-4def-9e18-e711d9e03877 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:54.463740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb07d4-4b36-4def-9e18-e711d9e03877 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:54.465453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb07d4-4b36-4def-9e18-e711d9e03877 None admin] RBAC: Adding query filter params (name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:54.465453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb07d4-4b36-4def-9e18-e711d9e03877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:54.466937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb07d4-4b36-4def-9e18-e711d9e03877 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:54.485402 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 391/788] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Jul 16 20:45:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:45:54.490194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf85af4-074c-498c-a0c6-b82a83f3c59a None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:54.491397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf85af4-074c-498c-a0c6-b82a83f3c59a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:54.492251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf85af4-074c-498c-a0c6-b82a83f3c59a None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:54.495782 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 392/789] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:54.498220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf85af4-074c-498c-a0c6-b82a83f3c59a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:54.507911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb03322-6d24-4484-8446-c1298a178512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:54.509609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb03322-6d24-4484-8446-c1298a178512 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:54.510232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb03322-6d24-4484-8446-c1298a178512 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:54.510853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb03322-6d24-4484-8446-c1298a178512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:54.524219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb03322-6d24-4484-8446-c1298a178512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:54.526264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb03322-6d24-4484-8446-c1298a178512 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:54.550904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-3bb03322-6d24-4484-8446-c1298a178512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:54.550904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:54.550904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:54.550904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:54.550904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:54.550904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:54.550904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:54.550904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:54.550904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:54.550904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:54.550904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:54.550904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:54.550904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:54.550904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:54.550904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:54.552324 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:54.552324 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:54.552324 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:54.552324 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:54.552324 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:54.552324 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:54.552324 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:54.552324 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:54.552324 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:54.552324 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:54.552324 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:54.552324 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:54.552324 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:54.552324 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:54.552324 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:54.552324 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:54.552324 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:54.553177 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:54.553177 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:54.553177 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:54.553177 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:54.553177 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 398/790] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:54.556545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0b40b-c91d-4252-a7e8-468895b78ff7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:54.556837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0b40b-c91d-4252-a7e8-468895b78ff7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:54.557102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0b40b-c91d-4252-a7e8-468895b78ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:54.579903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6ea0b40b-c91d-4252-a7e8-468895b78ff7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:54.581710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6ea0b40b-c91d-4252-a7e8-468895b78ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:54.611626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:54.658315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf85af4-074c-498c-a0c6-b82a83f3c59a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:54.687177 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 399/791] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:45:54.687177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0b40b-c91d-4252-a7e8-468895b78ff7 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:54.730126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b14bfa-bad9-4bc7-9e7f-db2464d8cbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:54.731808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b14bfa-bad9-4bc7-9e7f-db2464d8cbef None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:54.732104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b14bfa-bad9-4bc7-9e7f-db2464d8cbef None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:54.732374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b14bfa-bad9-4bc7-9e7f-db2464d8cbef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:54.750394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b14bfa-bad9-4bc7-9e7f-db2464d8cbef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:54.752788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b14bfa-bad9-4bc7-9e7f-db2464d8cbef None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:54.773961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:54.779243 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-c3b14bfa-bad9-4bc7-9e7f-db2464d8cbef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:54.779243 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:54.779243 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:54.779243 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:54.779243 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:54.779243 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:54.779243 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:54.779243 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:54.779243 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:54.779243 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:54.779243 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:54.779243 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:54.779243 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:54.779243 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:54.779243 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:54.780277 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:54.780277 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:54.780277 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:54.780277 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:54.780277 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:54.780277 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:54.780277 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:54.780277 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:54.780277 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:54.780277 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:54.780277 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:54.780277 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:54.780277 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:54.780277 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:54.780277 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:54.780277 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:54.780277 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:54.781138 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:54.781138 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:54.781138 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:54.781138 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:54.781138 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 393/792] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:54.782471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b14bfa-bad9-4bc7-9e7f-db2464d8cbef None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:54.814785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0b40b-c91d-4252-a7e8-468895b78ff7 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:54.858583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece41546-eab6-4dfc-bdb1-38af6404a8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:54.865861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece41546-eab6-4dfc-bdb1-38af6404a8a1 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:54.866559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece41546-eab6-4dfc-bdb1-38af6404a8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:54.867239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece41546-eab6-4dfc-bdb1-38af6404a8a1 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:54.868198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece41546-eab6-4dfc-bdb1-38af6404a8a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:54.868703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece41546-eab6-4dfc-bdb1-38af6404a8a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:54.870312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece41546-eab6-4dfc-bdb1-38af6404a8a1 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:54.883598 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 400/793] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:54.884799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece41546-eab6-4dfc-bdb1-38af6404a8a1 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:54.896755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b14bfa-bad9-4bc7-9e7f-db2464d8cbef None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:54.908029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:54.935298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c365150-6a9a-4482-85c9-ec5c99d8c17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:54.936468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c365150-6a9a-4482-85c9-ec5c99d8c17c None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:54.936954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c365150-6a9a-4482-85c9-ec5c99d8c17c None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:54.941012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c365150-6a9a-4482-85c9-ec5c99d8c17c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:54.950938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c365150-6a9a-4482-85c9-ec5c99d8c17c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:45:54.959753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-7c365150-6a9a-4482-85c9-ec5c99d8c17c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:45:54.959753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:54.959753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:54.959753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:54.959753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:54.959753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:54.959753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:54.959753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:54.959753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:54.959753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:54.959753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:54.959753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:54.959753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:45:54.959753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:45:54.959753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:45:54.959753 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:45:54.960675 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:45:54.960675 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:45:54.960675 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:45:54.960675 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:45:54.960675 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:54.960675 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:54.960675 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:54.960675 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:54.960675 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:54.960675 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:54.960675 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:54.960675 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:54.960675 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:54.960675 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:54.960675 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:54.960675 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:54.961606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:54.961606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:54.961606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:54.961606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:54.961606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:45:54.961606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:45:54.961606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:45:54.961606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:45:54.961606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:45:54.961606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:45:54.961606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:45:54.961606 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:54.964608 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 394/794] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:45:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:54.965938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c365150-6a9a-4482-85c9-ec5c99d8c17c None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:55.001767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece41546-eab6-4dfc-bdb1-38af6404a8a1 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:55.030610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:55.039537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d04b28-4c3c-45cc-9b83-c5b9eb3e5651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:55.040194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d04b28-4c3c-45cc-9b83-c5b9eb3e5651 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:55.040476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d04b28-4c3c-45cc-9b83-c5b9eb3e5651 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:55.040765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d04b28-4c3c-45cc-9b83-c5b9eb3e5651 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:55.041621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d04b28-4c3c-45cc-9b83-c5b9eb3e5651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:55.041930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d04b28-4c3c-45cc-9b83-c5b9eb3e5651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:55.043604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d04b28-4c3c-45cc-9b83-c5b9eb3e5651 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:55.063238 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 401/795] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:55.063238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d04b28-4c3c-45cc-9b83-c5b9eb3e5651 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:55.088658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c365150-6a9a-4482-85c9-ec5c99d8c17c None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:55.126434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfeece-1f4a-4f6d-8216-0b3170bccc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:55.133388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfeece-1f4a-4f6d-8216-0b3170bccc41 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:55.133388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfeece-1f4a-4f6d-8216-0b3170bccc41 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:55.133388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfeece-1f4a-4f6d-8216-0b3170bccc41 None admin] PATH_INFO: `/v3/users/swift` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:55.137465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfeece-1f4a-4f6d-8216-0b3170bccc41 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:55.139224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfeece-1f4a-4f6d-8216-0b3170bccc41 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:55.155367 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-74cfeece-1f4a-4f6d-8216-0b3170bccc41 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 16 20:45:55.155367 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:55.155367 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:55.155367 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:55.155367 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:55.155367 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:55.155367 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:55.155367 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:55.155367 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:55.155367 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:55.155367 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:55.155367 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:55.155367 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:45:55.155367 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:45:55.155367 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:45:55.155367 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:45:55.156359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:55.156359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:55.156359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:45:55.156359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:55.156359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:45:55.156359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:55.156359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:55.156359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:55.156359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:55.156359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:55.156359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:55.156359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:55.156359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:55.156359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:55.156359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:55.156359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:55.156359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:55.156359 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:55.157273 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:55.157273 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:55.157273 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:45:55.157273 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:45:55.157273 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:45:55.157273 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:45:55.157273 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:45:55.157273 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:45:55.157273 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 16 20:45:55.157273 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:55.160064 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 395/796] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:45:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:55.161359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfeece-1f4a-4f6d-8216-0b3170bccc41 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:55.201181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:55.201493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d04b28-4c3c-45cc-9b83-c5b9eb3e5651 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:55.240197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4e681-1ecd-464c-9d4f-63fdbfc8b213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:55.241010 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4e681-1ecd-464c-9d4f-63fdbfc8b213 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:55.241209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4e681-1ecd-464c-9d4f-63fdbfc8b213 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:55.241542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4e681-1ecd-464c-9d4f-63fdbfc8b213 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:55.243028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4e681-1ecd-464c-9d4f-63fdbfc8b213 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:55.243028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4e681-1ecd-464c-9d4f-63fdbfc8b213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:55.244214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4e681-1ecd-464c-9d4f-63fdbfc8b213 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:55.259503 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 402/797] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:45:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:55.260444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4e681-1ecd-464c-9d4f-63fdbfc8b213 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:55.276959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfeece-1f4a-4f6d-8216-0b3170bccc41 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:55.316590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cfbcc3-ab85-4093-b381-d46bdf65521c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:55.317919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfbcc3-ab85-4093-b381-d46bdf65521c None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:55.318096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:55.318525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfbcc3-ab85-4093-b381-d46bdf65521c None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:55.318999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfbcc3-ab85-4093-b381-d46bdf65521c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:55.327129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cfbcc3-ab85-4093-b381-d46bdf65521c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:55.328818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cfbcc3-ab85-4093-b381-d46bdf65521c None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:55.346682 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-47cfbcc3-ab85-4093-b381-d46bdf65521c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 16 20:45:55.346682 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:55.346682 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:55.346682 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:55.346682 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:55.346682 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:55.346682 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:55.346682 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:55.346682 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:55.346682 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:55.346682 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:55.346682 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:55.346682 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:45:55.346682 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:45:55.346682 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:45:55.346682 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:45:55.348174 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:55.348174 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:55.348174 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:45:55.348174 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:55.348174 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:45:55.348174 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:55.348174 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:55.348174 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:55.348174 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:55.348174 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:55.348174 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:55.348174 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:55.348174 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:55.348174 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:55.348174 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:55.348174 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:55.348174 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:55.348174 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:55.349321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:55.349321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:55.349321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:45:55.349321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:45:55.349321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:45:55.349321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:45:55.349321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:45:55.349321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:45:55.349321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 16 20:45:55.349321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:55.355240 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 396/798] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Jul 16 20:45:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:55.356746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cfbcc3-ab85-4093-b381-d46bdf65521c None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:55.384921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4e681-1ecd-464c-9d4f-63fdbfc8b213 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:55.427097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150cd7b-3a5c-40b4-92a2-4fe98fb4d88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:55.428159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150cd7b-3a5c-40b4-92a2-4fe98fb4d88d None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:55.428620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150cd7b-3a5c-40b4-92a2-4fe98fb4d88d None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:55.429078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150cd7b-3a5c-40b4-92a2-4fe98fb4d88d None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:55.430219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150cd7b-3a5c-40b4-92a2-4fe98fb4d88d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:55.430746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150cd7b-3a5c-40b4-92a2-4fe98fb4d88d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:55.432468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150cd7b-3a5c-40b4-92a2-4fe98fb4d88d None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:55.461415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:55.465276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cfbcc3-ab85-4093-b381-d46bdf65521c None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:55.493094 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 403/799] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Jul 16 20:45:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:55.494003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150cd7b-3a5c-40b4-92a2-4fe98fb4d88d None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:55.529302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f674807-b6fe-437a-b817-65d680d49958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:55.529540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f674807-b6fe-437a-b817-65d680d49958 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:55.529857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f674807-b6fe-437a-b817-65d680d49958 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:55.530133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f674807-b6fe-437a-b817-65d680d49958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:55.553240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f674807-b6fe-437a-b817-65d680d49958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:55.555098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f674807-b6fe-437a-b817-65d680d49958 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:55.577669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-9f674807-b6fe-437a-b817-65d680d49958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:55.577669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:55.577669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:55.577669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:55.577669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:55.577669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:55.577669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:55.577669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:55.577669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:55.577669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:55.577669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:55.577669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:55.577669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:55.577669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:55.577669 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:55.578604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:55.578604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:55.578604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:55.578604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:55.578604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:55.578604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:55.578604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:55.578604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:55.578604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:55.578604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:55.578604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:55.578604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:55.578604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:55.578604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:55.578604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:55.578604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:55.578604 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:55.579513 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:55.579513 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:55.579513 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:55.579513 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:55.586765 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 397/800] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:55.588075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f674807-b6fe-437a-b817-65d680d49958 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:55.645368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150cd7b-3a5c-40b4-92a2-4fe98fb4d88d None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:55.656369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:55.702097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d1a80-b70c-4cb1-a37f-875f573895f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:55.703282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d1a80-b70c-4cb1-a37f-875f573895f0 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:55.703793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d1a80-b70c-4cb1-a37f-875f573895f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:55.704286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d1a80-b70c-4cb1-a37f-875f573895f0 None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:55.705342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d1a80-b70c-4cb1-a37f-875f573895f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:55.705858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d1a80-b70c-4cb1-a37f-875f573895f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:55.707568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d1a80-b70c-4cb1-a37f-875f573895f0 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:55.724538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f674807-b6fe-437a-b817-65d680d49958 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:55.729143 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 404/801] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Jul 16 20:45:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:55.730469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d1a80-b70c-4cb1-a37f-875f573895f0 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:55.775895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7702379-aa40-4e64-a0ac-01b6cf02b77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:55.776719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7702379-aa40-4e64-a0ac-01b6cf02b77c None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:55.778200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7702379-aa40-4e64-a0ac-01b6cf02b77c None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:55.778482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7702379-aa40-4e64-a0ac-01b6cf02b77c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:55.791380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7702379-aa40-4e64-a0ac-01b6cf02b77c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:55.793427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7702379-aa40-4e64-a0ac-01b6cf02b77c None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:55.796004 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:55.814895 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-b7702379-aa40-4e64-a0ac-01b6cf02b77c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:55.814895 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:55.814895 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:55.814895 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:55.814895 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:55.814895 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:55.814895 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:55.814895 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:55.814895 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:55.814895 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:55.814895 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:55.814895 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:55.814895 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:55.814895 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:55.814895 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:55.815912 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:55.815912 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:55.815912 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:55.815912 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:55.815912 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:55.815912 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:55.815912 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:55.815912 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:55.815912 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:55.815912 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:55.815912 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:55.815912 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:55.815912 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:55.815912 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:55.815912 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:55.815912 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:55.815912 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:55.816817 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:55.816817 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:55.816817 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:55.816817 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:55.822734 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 398/802] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:55.824551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7702379-aa40-4e64-a0ac-01b6cf02b77c None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:55.858543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d1a80-b70c-4cb1-a37f-875f573895f0 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:55.900448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53268b92-0128-45c3-b64a-7b0bc64c486b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:55.901369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53268b92-0128-45c3-b64a-7b0bc64c486b None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:55.901656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53268b92-0128-45c3-b64a-7b0bc64c486b None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:55.902045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53268b92-0128-45c3-b64a-7b0bc64c486b None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:55.902736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53268b92-0128-45c3-b64a-7b0bc64c486b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:55.903323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53268b92-0128-45c3-b64a-7b0bc64c486b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:55.904456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53268b92-0128-45c3-b64a-7b0bc64c486b None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:55.917044 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 405/803] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:55.918110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53268b92-0128-45c3-b64a-7b0bc64c486b None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:55.947495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:55.953082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7702379-aa40-4e64-a0ac-01b6cf02b77c None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:55.989563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0b1b1-c5b8-406d-8c52-2d452df6eb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:55.990224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0b1b1-c5b8-406d-8c52-2d452df6eb40 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:55.990504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0b1b1-c5b8-406d-8c52-2d452df6eb40 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:55.990777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0b1b1-c5b8-406d-8c52-2d452df6eb40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:56.002133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0b1b1-c5b8-406d-8c52-2d452df6eb40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:56.003639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0b1b1-c5b8-406d-8c52-2d452df6eb40 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:56.022652 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-dbd0b1b1-c5b8-406d-8c52-2d452df6eb40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:56.022652 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:56.022652 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:56.022652 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:56.022652 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:56.022652 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:56.022652 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:56.022652 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:56.022652 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:56.022652 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:56.022652 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:56.022652 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:56.022652 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:56.022652 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:56.022652 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:56.023806 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:56.023806 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:56.023806 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:56.023806 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:56.023806 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:56.023806 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:56.023806 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:56.023806 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:56.023806 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:56.023806 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:56.023806 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:56.023806 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:56.023806 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:56.023806 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:56.023806 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:56.023806 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:56.023806 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:56.024930 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:56.024930 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:56.024930 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:56.024930 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:56.024930 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 399/804] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:56.025264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eba705-84b0-4486-a433-11156c95b3ce None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:56.025399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eba705-84b0-4486-a433-11156c95b3ce None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:56.030366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eba705-84b0-4486-a433-11156c95b3ce None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:56.030366 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 400/805] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:56.030366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eba705-84b0-4486-a433-11156c95b3ce None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:56.044612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53268b92-0128-45c3-b64a-7b0bc64c486b None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:56.082003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:56.082977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a4dea-2f80-43c9-8cad-6eae3c6fda5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:56.083671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a4dea-2f80-43c9-8cad-6eae3c6fda5a None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:56.083959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a4dea-2f80-43c9-8cad-6eae3c6fda5a None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:56.084232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a4dea-2f80-43c9-8cad-6eae3c6fda5a None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:56.084962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a4dea-2f80-43c9-8cad-6eae3c6fda5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:56.085262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a4dea-2f80-43c9-8cad-6eae3c6fda5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:56.086636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a4dea-2f80-43c9-8cad-6eae3c6fda5a None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:56.100211 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 406/806] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:56.101189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a4dea-2f80-43c9-8cad-6eae3c6fda5a None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:56.155126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eba705-84b0-4486-a433-11156c95b3ce None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:56.194575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f55ce1-e9fe-4531-8a02-7d82acc5e9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:56.195398 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f55ce1-e9fe-4531-8a02-7d82acc5e9da None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:56.195679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f55ce1-e9fe-4531-8a02-7d82acc5e9da None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:56.195946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f55ce1-e9fe-4531-8a02-7d82acc5e9da None admin] PATH_INFO: `/v3/users/nova` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:56.202577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:56.205337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f55ce1-e9fe-4531-8a02-7d82acc5e9da None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:56.206795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f55ce1-e9fe-4531-8a02-7d82acc5e9da None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:56.219187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a4dea-2f80-43c9-8cad-6eae3c6fda5a None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:56.223186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-e3f55ce1-e9fe-4531-8a02-7d82acc5e9da None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 16 20:45:56.223186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:56.223186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:56.223186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:56.223186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:56.223186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:56.223186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:56.223186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:56.223186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:56.223186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:56.223186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:56.223186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:56.223186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:45:56.223186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:45:56.223186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:45:56.223186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:45:56.224199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:56.224199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:56.224199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:45:56.224199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:56.224199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:45:56.224199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:45:56.224199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:56.224199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:56.224199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:56.224199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:56.224199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:56.224199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:56.224199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:56.224199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:56.224199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:56.224199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:56.224199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:56.224199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:56.225860 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:56.225860 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:56.225860 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:45:56.225860 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:45:56.225860 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:45:56.225860 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:45:56.225860 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:45:56.225860 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:45:56.225860 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 16 20:45:56.225860 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:56.225860 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 401/807] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Jul 16 20:45:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:56.226474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec51476-3f68-482d-9ac6-52ae414dfc01 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:56.226474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec51476-3f68-482d-9ac6-52ae414dfc01 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:56.226602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec51476-3f68-482d-9ac6-52ae414dfc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:56.245006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-fec51476-3f68-482d-9ac6-52ae414dfc01 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:56.247235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fec51476-3f68-482d-9ac6-52ae414dfc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:56.265168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2785d-a857-4e93-b4ba-7108f3385ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:56.265842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2785d-a857-4e93-b4ba-7108f3385ab3 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:56.266235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2785d-a857-4e93-b4ba-7108f3385ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:56.266411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2785d-a857-4e93-b4ba-7108f3385ab3 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:56.267157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2785d-a857-4e93-b4ba-7108f3385ab3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:56.267470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2785d-a857-4e93-b4ba-7108f3385ab3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:56.268872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2785d-a857-4e93-b4ba-7108f3385ab3 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:56.282119 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 407/808] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:56.282807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2785d-a857-4e93-b4ba-7108f3385ab3 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:56.323720 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 402/809] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:45:56.325347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec51476-3f68-482d-9ac6-52ae414dfc01 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:56.362321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:56.388320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2785d-a857-4e93-b4ba-7108f3385ab3 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:56.423451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622eda62-eba1-4ef2-a26f-68e2cbc43775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:56.424118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eda62-eba1-4ef2-a26f-68e2cbc43775 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:56.424404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eda62-eba1-4ef2-a26f-68e2cbc43775 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:56.424674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eda62-eba1-4ef2-a26f-68e2cbc43775 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:56.428641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec51476-3f68-482d-9ac6-52ae414dfc01 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:56.431661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622eda62-eba1-4ef2-a26f-68e2cbc43775 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:56.433525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622eda62-eba1-4ef2-a26f-68e2cbc43775 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:56.448542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-622eda62-eba1-4ef2-a26f-68e2cbc43775 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:56.448542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:56.448542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:56.448542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:56.448542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:56.448542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:56.448542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:56.448542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:56.448542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:56.448542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:56.448542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:56.448542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:56.448542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:45:56.448542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:45:56.448542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:45:56.450719 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:45:56.450719 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:56.450719 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:56.450719 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:56.450719 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:56.450719 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:56.450719 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:56.450719 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:56.450719 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:56.450719 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:56.450719 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:56.450719 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:56.450719 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:56.450719 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:56.450719 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:56.450719 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:56.450719 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:56.451627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:45:56.451627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:45:56.451627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:45:56.451627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:45:56.451627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:45:56.451627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:45:56.451627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:56.451627 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:56.451627 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 408/810] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:56.451627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf8415-b464-4411-938f-aa2874f983f0 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:56.452153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf8415-b464-4411-938f-aa2874f983f0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:56.452153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf8415-b464-4411-938f-aa2874f983f0 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:56.453325 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 409/811] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:56.454001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf8415-b464-4411-938f-aa2874f983f0 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:56.457920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:56.470815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b1bf0-767d-4397-905b-535ed0672a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:56.471532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b1bf0-767d-4397-905b-535ed0672a67 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:56.481208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b1bf0-767d-4397-905b-535ed0672a67 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:56.481208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b1bf0-767d-4397-905b-535ed0672a67 None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:56.481208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b1bf0-767d-4397-905b-535ed0672a67 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:56.481208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b1bf0-767d-4397-905b-535ed0672a67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:56.481208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b1bf0-767d-4397-905b-535ed0672a67 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:56.493292 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 403/812] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Jul 16 20:45:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:56.494353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b1bf0-767d-4397-905b-535ed0672a67 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:56.565789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf8415-b464-4411-938f-aa2874f983f0 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:56.595744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:56.601743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18743a-6ba2-4e3e-802a-b55395f38498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:56.602353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b1bf0-767d-4397-905b-535ed0672a67 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:56.602540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18743a-6ba2-4e3e-802a-b55395f38498 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:56.602892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18743a-6ba2-4e3e-802a-b55395f38498 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:56.603257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18743a-6ba2-4e3e-802a-b55395f38498 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:56.610539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18743a-6ba2-4e3e-802a-b55395f38498 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:56.612572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18743a-6ba2-4e3e-802a-b55395f38498 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:56.628162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-3e18743a-6ba2-4e3e-802a-b55395f38498 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:56.628162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:56.628162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:56.628162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:56.628162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:56.628162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:56.628162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:56.628162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:56.628162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:56.628162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:56.628162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:56.628162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:56.628162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:45:56.628162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:45:56.628162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:45:56.637802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:45:56.637802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:56.637802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:56.637802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:56.637802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:56.637802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:56.637802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:56.637802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:56.637802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:56.637802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:56.637802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:56.637802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:56.637802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:56.637802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:56.637802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:56.637802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:56.637802 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:56.639782 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:45:56.639782 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:45:56.639782 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:45:56.639782 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:45:56.639782 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:45:56.639782 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:45:56.639782 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:56.639782 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:56.639782 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 410/813] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:56.639782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18743a-6ba2-4e3e-802a-b55395f38498 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:56.647079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffdc56-b5d5-4a24-b770-8c50ca498b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:56.647933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffdc56-b5d5-4a24-b770-8c50ca498b03 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:56.648213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffdc56-b5d5-4a24-b770-8c50ca498b03 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:56.648486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffdc56-b5d5-4a24-b770-8c50ca498b03 None admin] PATH_INFO: `/v3/services/network` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:56.649145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffdc56-b5d5-4a24-b770-8c50ca498b03 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:56.650544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffdc56-b5d5-4a24-b770-8c50ca498b03 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:56.662946 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-f9ffdc56-b5d5-4a24-b770-8c50ca498b03 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 16 20:45:56.662946 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:56.662946 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:45:56.662946 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:45:56.662946 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:45:56.662946 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:45:56.662946 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:45:56.662946 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:45:56.662946 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 16 20:45:56.662946 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:56.662946 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:45:56.662946 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:56.662946 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:56.662946 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:56.662946 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:56.662946 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:56.662946 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:56.664267 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:56.664267 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:56.664267 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:56.664267 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:56.664267 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:56.664267 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:56.664267 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:45:56.664267 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:45:56.664267 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:45:56.664267 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:45:56.664267 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:56.664267 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:56.664267 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:56.664267 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:56.664267 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:56.664267 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:56.665284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:56.665284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:56.665284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:56.665284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:56.665284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:56.665284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:56.665284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:56.665284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:56.665284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:56.665284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:56.665284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:45:56.665284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:45:56.665284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 16 20:45:56.665284 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:56.665284 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 404/814] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:56 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:56.666239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ef9a1-f880-4ef4-819b-87fe666d3279 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:56.666239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ef9a1-f880-4ef4-819b-87fe666d3279 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:56.666239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ef9a1-f880-4ef4-819b-87fe666d3279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:56.682832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-500ef9a1-f880-4ef4-819b-87fe666d3279 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:56.684817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-500ef9a1-f880-4ef4-819b-87fe666d3279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:56.709857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:56.749809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18743a-6ba2-4e3e-802a-b55395f38498 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:56.754829 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 405/815] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:45:56.755531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ef9a1-f880-4ef4-819b-87fe666d3279 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:56.791042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665240a7-d322-4901-8e49-7777e70f0c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:56.791805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665240a7-d322-4901-8e49-7777e70f0c9a None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:56.792088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665240a7-d322-4901-8e49-7777e70f0c9a None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:56.792361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665240a7-d322-4901-8e49-7777e70f0c9a None admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:56.793379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665240a7-d322-4901-8e49-7777e70f0c9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:56.793879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665240a7-d322-4901-8e49-7777e70f0c9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:56.795629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665240a7-d322-4901-8e49-7777e70f0c9a None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:56.809146 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 411/816] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:45:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:56.810423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665240a7-d322-4901-8e49-7777e70f0c9a None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:56.861958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:56.877922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ef9a1-f880-4ef4-819b-87fe666d3279 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:56.914311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb29c58-eb76-48ee-b127-7ef2d47bfb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:56.914965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb29c58-eb76-48ee-b127-7ef2d47bfb72 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:56.915344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb29c58-eb76-48ee-b127-7ef2d47bfb72 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:56.915641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb29c58-eb76-48ee-b127-7ef2d47bfb72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:56.917090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665240a7-d322-4901-8e49-7777e70f0c9a None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:56.942670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:56.954617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987d00b-e609-4540-9d7b-9463722701e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:56.955520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987d00b-e609-4540-9d7b-9463722701e8 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:56.955776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987d00b-e609-4540-9d7b-9463722701e8 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:56.956052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987d00b-e609-4540-9d7b-9463722701e8 None admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:56.956880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987d00b-e609-4540-9d7b-9463722701e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:56.957197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987d00b-e609-4540-9d7b-9463722701e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:56.958631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987d00b-e609-4540-9d7b-9463722701e8 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:56.971690 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 412/817] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:45:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:56.972536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987d00b-e609-4540-9d7b-9463722701e8 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:57.001039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb29c58-eb76-48ee-b127-7ef2d47bfb72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:57.002618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb29c58-eb76-48ee-b127-7ef2d47bfb72 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:57.089434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987d00b-e609-4540-9d7b-9463722701e8 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:57.102879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:57.116765 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 406/818] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:45:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 16 20:45:57.117539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb29c58-eb76-48ee-b127-7ef2d47bfb72 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:57.130944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24223b5a-914a-44cb-b78c-60a34dbfec45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:57.132250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24223b5a-914a-44cb-b78c-60a34dbfec45 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:57.132537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24223b5a-914a-44cb-b78c-60a34dbfec45 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:57.132874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24223b5a-914a-44cb-b78c-60a34dbfec45 None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:57.133643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24223b5a-914a-44cb-b78c-60a34dbfec45 None admin] RBAC: Adding query filter params (name=network) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:57.134000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24223b5a-914a-44cb-b78c-60a34dbfec45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:57.135416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24223b5a-914a-44cb-b78c-60a34dbfec45 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:57.141383 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 413/819] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Jul 16 20:45:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:57.142199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24223b5a-914a-44cb-b78c-60a34dbfec45 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:57.193113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:57.236366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb29c58-eb76-48ee-b127-7ef2d47bfb72 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:57.253477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24223b5a-914a-44cb-b78c-60a34dbfec45 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:57.274403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7ec8a-6e8b-44e1-9d79-1e2b624ddd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:57.275226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7ec8a-6e8b-44e1-9d79-1e2b624ddd43 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:57.275503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7ec8a-6e8b-44e1-9d79-1e2b624ddd43 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:57.275770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7ec8a-6e8b-44e1-9d79-1e2b624ddd43 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:57.276414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7ec8a-6e8b-44e1-9d79-1e2b624ddd43 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:57.278337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7ec8a-6e8b-44e1-9d79-1e2b624ddd43 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:57.290599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-14b7ec8a-6e8b-44e1-9d79-1e2b624ddd43 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 16 20:45:57.290599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:57.290599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:45:57.290599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:45:57.290599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:45:57.290599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:45:57.290599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:45:57.290599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:45:57.290599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 16 20:45:57.290599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:57.290599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:45:57.290599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:57.290599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:57.290599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:57.290599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:57.290599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:57.291889 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:57.291889 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:57.291889 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:57.291889 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:57.291889 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:57.291889 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:57.291889 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:57.291889 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:45:57.291889 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:45:57.291889 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:45:57.291889 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:45:57.291889 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:57.291889 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:57.291889 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:57.291889 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:57.291889 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:57.293020 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:57.293020 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:57.293020 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:57.293020 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:57.293020 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:57.293020 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:57.293020 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:57.293020 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:57.293020 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:57.293020 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:57.293020 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:57.293020 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:45:57.293020 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:45:57.293020 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 16 20:45:57.293020 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:57.293817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65f90a-cc4e-4e55-a905-94d03cd6bd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:57.293817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65f90a-cc4e-4e55-a905-94d03cd6bd61 None admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:57.293817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65f90a-cc4e-4e55-a905-94d03cd6bd61 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:57.293817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65f90a-cc4e-4e55-a905-94d03cd6bd61 None admin] PATH_INFO: `/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/9a66df01ea414b34a8842488b145974f/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:57.294100 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 407/820] 10.222.0.16 () {56 vars in 1129 bytes} [Sat Jul 16 20:45:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:57.294100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7ec8a-6e8b-44e1-9d79-1e2b624ddd43 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:57.294820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65f90a-cc4e-4e55-a905-94d03cd6bd61 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3045a89835d4e879a0ddc2557b831a3, user_id=9a66df01ea414b34a8842488b145974f, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:57.296314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65f90a-cc4e-4e55-a905-94d03cd6bd61 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:57.348937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:57.375823 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 414/821] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:45:57 2022] PUT /identity/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/9a66df01ea414b34a8842488b145974f/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:45:57.376591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65f90a-cc4e-4e55-a905-94d03cd6bd61 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:57.413356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7ec8a-6e8b-44e1-9d79-1e2b624ddd43 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:57.460896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecc869-fac9-4234-a0e0-30dc691406ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:57.462044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecc869-fac9-4234-a0e0-30dc691406ac None admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:57.462389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecc869-fac9-4234-a0e0-30dc691406ac None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:57.462734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecc869-fac9-4234-a0e0-30dc691406ac None admin] PATH_INFO: `/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/2b154ad257954b53a13730b4a9f60570/roles/99a4e0ec120f4163a419b2775afb8a41` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:57.483746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecc869-fac9-4234-a0e0-30dc691406ac None admin] RBAC: Authorizing `identity:create_grant(project_id=c3045a89835d4e879a0ddc2557b831a3, user_id=2b154ad257954b53a13730b4a9f60570, role_id=99a4e0ec120f4163a419b2775afb8a41)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:57.485232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecc869-fac9-4234-a0e0-30dc691406ac None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:57.517348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65f90a-cc4e-4e55-a905-94d03cd6bd61 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:57.527895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:57.555273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e5ab7-26ea-498e-8644-d68227fdbaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:57.556152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e5ab7-26ea-498e-8644-d68227fdbaa9 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:57.556152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e5ab7-26ea-498e-8644-d68227fdbaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:57.556345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e5ab7-26ea-498e-8644-d68227fdbaa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:57.572828 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 408/822] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:45:57 2022] PUT /identity/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/2b154ad257954b53a13730b4a9f60570/roles/99a4e0ec120f4163a419b2775afb8a41 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:45:57.573035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecc869-fac9-4234-a0e0-30dc691406ac None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:57.573424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e5ab7-26ea-498e-8644-d68227fdbaa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:57.575847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e5ab7-26ea-498e-8644-d68227fdbaa9 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:57.597170 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-6f2e5ab7-26ea-498e-8644-d68227fdbaa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:57.597170 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:57.597170 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:57.597170 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:57.597170 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:57.597170 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:57.597170 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:57.597170 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:57.597170 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:57.597170 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:57.597170 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:57.597170 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:57.597170 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:45:57.597170 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:45:57.597170 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:45:57.598166 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:45:57.598166 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:57.598166 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:57.598166 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:57.598166 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:57.598166 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:57.598166 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:57.598166 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:57.598166 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:57.598166 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:57.598166 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:57.598166 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:57.598166 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:57.598166 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:57.598166 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:57.598166 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:57.598166 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:57.599152 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:45:57.599152 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:45:57.599152 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:45:57.599152 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:45:57.603177 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 415/823] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:45:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:57.604679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e5ab7-26ea-498e-8644-d68227fdbaa9 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:57.723776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecc869-fac9-4234-a0e0-30dc691406ac None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:57.726034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:57.746689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e5ab7-26ea-498e-8644-d68227fdbaa9 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:57.766083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8a4c8-4d0e-49f0-a095-cadfb0fb5971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:57.767165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8a4c8-4d0e-49f0-a095-cadfb0fb5971 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:57.767730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8a4c8-4d0e-49f0-a095-cadfb0fb5971 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:57.768255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8a4c8-4d0e-49f0-a095-cadfb0fb5971 None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:57.769213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8a4c8-4d0e-49f0-a095-cadfb0fb5971 None admin] RBAC: Adding query filter params (type=network) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:57.769912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8a4c8-4d0e-49f0-a095-cadfb0fb5971 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:57.771602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8a4c8-4d0e-49f0-a095-cadfb0fb5971 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:57.777981 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 409/824] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Jul 16 20:45:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:57.784296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8a4c8-4d0e-49f0-a095-cadfb0fb5971 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:57.796829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46187370-6800-4cfb-85f4-be8ee3efb9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:57.797511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46187370-6800-4cfb-85f4-be8ee3efb9a5 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:57.797795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46187370-6800-4cfb-85f4-be8ee3efb9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:57.798070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46187370-6800-4cfb-85f4-be8ee3efb9a5 None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:57.798797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46187370-6800-4cfb-85f4-be8ee3efb9a5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:57.799187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46187370-6800-4cfb-85f4-be8ee3efb9a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:57.800579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46187370-6800-4cfb-85f4-be8ee3efb9a5 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:57.806836 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 416/825] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Jul 16 20:45:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:57.807720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46187370-6800-4cfb-85f4-be8ee3efb9a5 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:57.848914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:57.921381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8a4c8-4d0e-49f0-a095-cadfb0fb5971 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:57.963824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46187370-6800-4cfb-85f4-be8ee3efb9a5 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:57.966035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26859b80-4a35-4fc7-9b25-d27a69912c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:57.966879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26859b80-4a35-4fc7-9b25-d27a69912c95 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:57.967212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26859b80-4a35-4fc7-9b25-d27a69912c95 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:57.967490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26859b80-4a35-4fc7-9b25-d27a69912c95 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:57.969203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26859b80-4a35-4fc7-9b25-d27a69912c95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:57.969528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26859b80-4a35-4fc7-9b25-d27a69912c95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:57.971046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26859b80-4a35-4fc7-9b25-d27a69912c95 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:57.987915 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 410/826] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:57.988117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26859b80-4a35-4fc7-9b25-d27a69912c95 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:58.011852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105bffb-dcf8-49ca-9a90-174a13e0d6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:58.012879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105bffb-dcf8-49ca-9a90-174a13e0d6fe None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:58.013373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105bffb-dcf8-49ca-9a90-174a13e0d6fe None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:58.013854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105bffb-dcf8-49ca-9a90-174a13e0d6fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:58.014971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105bffb-dcf8-49ca-9a90-174a13e0d6fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:58.017053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105bffb-dcf8-49ca-9a90-174a13e0d6fe None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:58.025702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:58.112573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26859b80-4a35-4fc7-9b25-d27a69912c95 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:58.153880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899fba9-dec5-406a-bbbe-15dd8d367a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:58.154558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899fba9-dec5-406a-bbbe-15dd8d367a47 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:58.154837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899fba9-dec5-406a-bbbe-15dd8d367a47 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:58.155140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899fba9-dec5-406a-bbbe-15dd8d367a47 None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:58.155846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899fba9-dec5-406a-bbbe-15dd8d367a47 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:58.156151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899fba9-dec5-406a-bbbe-15dd8d367a47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:58.157520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899fba9-dec5-406a-bbbe-15dd8d367a47 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:58.164125 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 411/827] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Jul 16 20:45:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:58.164307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899fba9-dec5-406a-bbbe-15dd8d367a47 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:58.180750 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 417/828] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Jul 16 20:45:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:45:58.188734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105bffb-dcf8-49ca-9a90-174a13e0d6fe None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:58.368627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:58.372074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:58.400248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899fba9-dec5-406a-bbbe-15dd8d367a47 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:58.455166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105bffb-dcf8-49ca-9a90-174a13e0d6fe None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:58.475297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb482e-5a10-44da-b865-f657cf2c250e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:58.476538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb482e-5a10-44da-b865-f657cf2c250e None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:58.477185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb482e-5a10-44da-b865-f657cf2c250e None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:58.477749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb482e-5a10-44da-b865-f657cf2c250e None admin] PATH_INFO: `/v3/projects/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:58.491033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb482e-5a10-44da-b865-f657cf2c250e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:58.494106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb482e-5a10-44da-b865-f657cf2c250e None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:58.497811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468eaae6-edd8-474f-beb5-860b87157799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:58.498721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468eaae6-edd8-474f-beb5-860b87157799 None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:58.499138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468eaae6-edd8-474f-beb5-860b87157799 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:58.499504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468eaae6-edd8-474f-beb5-860b87157799 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:58.500346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468eaae6-edd8-474f-beb5-860b87157799 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:58.501911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468eaae6-edd8-474f-beb5-860b87157799 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:58.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-6bbb482e-5a10-44da-b865-f657cf2c250e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:58.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:45:58.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:45:58.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:45:58.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:45:58.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:45:58.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:45:58.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:45:58.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:45:58.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:45:58.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:45:58.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:45:58.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:45:58.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:45:58.517858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:45:58.518918 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:45:58.518918 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:45:58.518918 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:45:58.518918 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:45:58.518918 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:45:58.518918 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:45:58.518918 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:45:58.518918 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:45:58.518918 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:45:58.518918 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:45:58.518918 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:45:58.518918 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:45:58.518918 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:45:58.518918 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:45:58.518918 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:45:58.518918 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:45:58.518918 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:45:58.519892 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:45:58.519892 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:45:58.519892 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:45:58.519892 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:45:58.519892 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:45:58.519892 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:45:58.519892 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:45:58.519892 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:45:58.519892 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 412/829] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:45:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:45:58.528231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb482e-5a10-44da-b865-f657cf2c250e None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:58.640477 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 418/830] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Jul 16 20:45:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:45:58.667077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb482e-5a10-44da-b865-f657cf2c250e None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:58.720089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef3349-9544-43bd-ba12-08db07d1730c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:58.721212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef3349-9544-43bd-ba12-08db07d1730c None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:58.721715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef3349-9544-43bd-ba12-08db07d1730c None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:58.722184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef3349-9544-43bd-ba12-08db07d1730c None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:58.723309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef3349-9544-43bd-ba12-08db07d1730c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:58.723856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef3349-9544-43bd-ba12-08db07d1730c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:58.725575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef3349-9544-43bd-ba12-08db07d1730c None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:58.741029 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 413/831] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:45:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:58.748005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468eaae6-edd8-474f-beb5-860b87157799 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:58.870336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468eaae6-edd8-474f-beb5-860b87157799 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:45:58.906716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:45:58.911774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edcf3f-a67a-4b8e-8af1-f43a35cc60c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:45:58.912454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edcf3f-a67a-4b8e-8af1-f43a35cc60c7 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:58.912729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edcf3f-a67a-4b8e-8af1-f43a35cc60c7 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:58.913000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edcf3f-a67a-4b8e-8af1-f43a35cc60c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:58.913836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66edcf3f-a67a-4b8e-8af1-f43a35cc60c7 None admin] RBAC: Adding query filter params (role.id=bd33b827674a4d4db30c164cab416056, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=d5f515bfe2094b41afe82b4bc57e4b9a) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:45:58.914206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66edcf3f-a67a-4b8e-8af1-f43a35cc60c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:45:58.915688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66edcf3f-a67a-4b8e-8af1-f43a35cc60c7 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:45:58.923684 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 419/832] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:45:58 2022] GET /identity/v3/role_assignments?user.id=d5f515bfe2094b41afe82b4bc57e4b9a&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=bd33b827674a4d4db30c164cab416056 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:45:59.814603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508f39e-d837-4875-a12c-933bdce8e2ef None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:59.815189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508f39e-d837-4875-a12c-933bdce8e2ef None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:59.815189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508f39e-d837-4875-a12c-933bdce8e2ef None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:59.825291 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 414/833] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:45:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:45:59.830477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4a592-8311-49bc-9d3f-519687e0061e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:45:59.830993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4a592-8311-49bc-9d3f-519687e0061e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:45:59.831116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4a592-8311-49bc-9d3f-519687e0061e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:45:59.850541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-65e4a592-8311-49bc-9d3f-519687e0061e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:45:59.851818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-65e4a592-8311-49bc-9d3f-519687e0061e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:45:59.932366 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 420/834] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:45:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:45:59.960503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508f39e-d837-4875-a12c-933bdce8e2ef None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:45:59.971319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:00.015427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1107c22-9f03-4799-9f9c-df075b8d095b None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:00.015845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1107c22-9f03-4799-9f9c-df075b8d095b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:00.016383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1107c22-9f03-4799-9f9c-df075b8d095b None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:00.017860 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 421/835] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:46:00.023431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ee4dd-a56a-4898-bb5c-2260af89187c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:00.023726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ee4dd-a56a-4898-bb5c-2260af89187c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:00.024008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ee4dd-a56a-4898-bb5c-2260af89187c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:00.042273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-024ee4dd-a56a-4898-bb5c-2260af89187c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:00.043563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-024ee4dd-a56a-4898-bb5c-2260af89187c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:00.081658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508f39e-d837-4875-a12c-933bdce8e2ef None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:00.119661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07722286-b186-40da-aef2-8d3ddc95c4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:00.120473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07722286-b186-40da-aef2-8d3ddc95c4b9 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:00.121293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07722286-b186-40da-aef2-8d3ddc95c4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:00.121640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07722286-b186-40da-aef2-8d3ddc95c4b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:00.123187 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 422/836] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:00.139915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07722286-b186-40da-aef2-8d3ddc95c4b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:46:00.146975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ee4dd-a56a-4898-bb5c-2260af89187c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:00.156354 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-07722286-b186-40da-aef2-8d3ddc95c4b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:46:00.156354 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:00.156354 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:00.156354 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:00.156354 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:00.156354 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:00.156354 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:00.156354 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:00.156354 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:00.156354 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:00.156354 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:00.156354 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:00.156354 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:46:00.156354 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:46:00.156354 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:46:00.156354 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:46:00.157337 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:46:00.157337 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:46:00.157337 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:46:00.157337 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:46:00.157337 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:00.157337 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:00.157337 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:00.157337 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:00.157337 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:00.157337 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:00.157337 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:00.157337 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:00.157337 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:00.157337 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:00.157337 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:00.157337 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:00.158153 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:00.158153 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:00.158153 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:00.158153 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:00.158153 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:46:00.158153 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:46:00.158153 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:46:00.158153 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:46:00.158153 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:46:00.158153 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:46:00.158153 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:46:00.158153 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:00.158153 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 415/837] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:45:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:00.164477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07722286-b186-40da-aef2-8d3ddc95c4b9 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:00.227798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:00.263570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:00.278920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ee4dd-a56a-4898-bb5c-2260af89187c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:00.302723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07722286-b186-40da-aef2-8d3ddc95c4b9 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:00.325603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be993121-7b88-4c95-9516-91d02f0146bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:00.326708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be993121-7b88-4c95-9516-91d02f0146bb None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:00.327191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be993121-7b88-4c95-9516-91d02f0146bb None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:00.328261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be993121-7b88-4c95-9516-91d02f0146bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:00.343276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f181656-7547-4790-abe4-d17f6692b9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:00.343958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f181656-7547-4790-abe4-d17f6692b9d8 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:00.344251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be993121-7b88-4c95-9516-91d02f0146bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:46:00.344356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f181656-7547-4790-abe4-d17f6692b9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:00.344705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f181656-7547-4790-abe4-d17f6692b9d8 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:00.346112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f181656-7547-4790-abe4-d17f6692b9d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:00.346507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f181656-7547-4790-abe4-d17f6692b9d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:00.348041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f181656-7547-4790-abe4-d17f6692b9d8 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:00.354609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-be993121-7b88-4c95-9516-91d02f0146bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:46:00.354609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:00.354609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:00.354609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:00.354609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:00.354609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:00.354609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:00.354609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:00.354609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:00.354609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:00.354609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:00.354609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:00.354609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:46:00.354609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:46:00.354609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:46:00.354609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:46:00.355844 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:46:00.355844 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:46:00.355844 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:46:00.355844 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:46:00.355844 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:00.355844 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:00.355844 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:00.355844 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:00.355844 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:00.355844 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:00.355844 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:00.355844 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:00.355844 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:00.355844 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:00.355844 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:00.355844 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:00.356647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:00.356647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:00.356647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:00.356647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:00.356647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:46:00.356647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:46:00.356647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:46:00.356647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:46:00.356647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:46:00.356647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:46:00.356647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:46:00.356647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:00.359328 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 423/838] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:46:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:46:00.360654 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 416/839] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:46:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:00.366176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be993121-7b88-4c95-9516-91d02f0146bb None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:00.366305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f181656-7547-4790-abe4-d17f6692b9d8 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:00.485345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f181656-7547-4790-abe4-d17f6692b9d8 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:00.504949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be993121-7b88-4c95-9516-91d02f0146bb None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:00.522869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:00.523190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:00.533707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57f863-a04a-4e79-9b34-1495928ab49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:00.534514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57f863-a04a-4e79-9b34-1495928ab49f None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:00.540318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57f863-a04a-4e79-9b34-1495928ab49f None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:00.540318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57f863-a04a-4e79-9b34-1495928ab49f None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:00.540318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57f863-a04a-4e79-9b34-1495928ab49f None admin] RBAC: Adding query filter params (name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:00.540318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57f863-a04a-4e79-9b34-1495928ab49f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:00.540318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57f863-a04a-4e79-9b34-1495928ab49f None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:00.543504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933d0fd-9b5a-4b7c-b5a5-dcd45bc696fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:00.544531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933d0fd-9b5a-4b7c-b5a5-dcd45bc696fa None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:00.544991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933d0fd-9b5a-4b7c-b5a5-dcd45bc696fa None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:00.545440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933d0fd-9b5a-4b7c-b5a5-dcd45bc696fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:00.555184 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 417/840] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Jul 16 20:46:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:00.556372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57f863-a04a-4e79-9b34-1495928ab49f None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:00.560858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933d0fd-9b5a-4b7c-b5a5-dcd45bc696fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:00.563326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933d0fd-9b5a-4b7c-b5a5-dcd45bc696fa None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:00.586003 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-7933d0fd-9b5a-4b7c-b5a5-dcd45bc696fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:00.586003 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:00.586003 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:00.586003 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:00.586003 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:00.586003 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:00.586003 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:00.586003 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:00.586003 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:00.586003 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:00.586003 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:00.586003 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:00.586003 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:46:00.586003 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:46:00.586003 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:46:00.586946 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:46:00.586946 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:00.586946 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:00.586946 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:00.586946 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:00.586946 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:00.586946 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:00.586946 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:00.586946 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:00.586946 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:00.586946 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:00.586946 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:00.586946 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:00.586946 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:00.586946 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:00.586946 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:00.586946 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:00.587988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:46:00.587988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:46:00.587988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:00.587988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:00.591473 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 424/841] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:46:00.595852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933d0fd-9b5a-4b7c-b5a5-dcd45bc696fa None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:00.681055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57f863-a04a-4e79-9b34-1495928ab49f None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:00.707836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933d0fd-9b5a-4b7c-b5a5-dcd45bc696fa None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:00.721727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb057e3-2c12-4d7b-879b-251a759b3f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:00.723106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb057e3-2c12-4d7b-879b-251a759b3f93 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:00.723777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb057e3-2c12-4d7b-879b-251a759b3f93 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:00.724299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb057e3-2c12-4d7b-879b-251a759b3f93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:00.737935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb057e3-2c12-4d7b-879b-251a759b3f93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:00.739853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb057e3-2c12-4d7b-879b-251a759b3f93 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:00.747223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb7a69-98bb-46e5-8faa-bd7240e716b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:00.747974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb7a69-98bb-46e5-8faa-bd7240e716b2 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:00.748257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb7a69-98bb-46e5-8faa-bd7240e716b2 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:00.748531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb7a69-98bb-46e5-8faa-bd7240e716b2 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:00.749411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb7a69-98bb-46e5-8faa-bd7240e716b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:00.749666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb7a69-98bb-46e5-8faa-bd7240e716b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:00.751038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb7a69-98bb-46e5-8faa-bd7240e716b2 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:00.762026 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-9eb057e3-2c12-4d7b-879b-251a759b3f93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:00.762026 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:00.762026 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:00.762026 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:00.762026 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:00.762026 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:00.762026 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:00.762026 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:00.762026 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:00.762026 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:00.762026 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:00.762026 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:00.762026 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:46:00.762026 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:46:00.762026 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:46:00.770209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:46:00.770209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:00.770209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:00.770209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:00.770209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:00.770209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:00.770209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:00.770209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:00.770209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:00.770209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:00.770209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:00.770209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:00.770209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:00.770209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:00.770209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:00.770209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:00.770209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:00.771483 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:46:00.771483 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:46:00.771483 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:00.771483 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:00.771717 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 425/842] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:00.771795 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 418/843] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:00.771875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb7a69-98bb-46e5-8faa-bd7240e716b2 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:00.772549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb057e3-2c12-4d7b-879b-251a759b3f93 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:00.801589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:00.827496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:00.879705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb7a69-98bb-46e5-8faa-bd7240e716b2 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:00.891369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb057e3-2c12-4d7b-879b-251a759b3f93 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:00.916183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457d34c-e4d6-45cb-a520-4e75939269d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:00.916975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457d34c-e4d6-45cb-a520-4e75939269d8 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:00.917257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457d34c-e4d6-45cb-a520-4e75939269d8 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:00.918045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457d34c-e4d6-45cb-a520-4e75939269d8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:00.926125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457d34c-e4d6-45cb-a520-4e75939269d8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:00.927755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457d34c-e4d6-45cb-a520-4e75939269d8 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:00.932068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e5022-9c2d-4bc0-9fdb-86ae6c94cd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:00.932751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e5022-9c2d-4bc0-9fdb-86ae6c94cd23 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:00.933314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e5022-9c2d-4bc0-9fdb-86ae6c94cd23 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:00.934130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e5022-9c2d-4bc0-9fdb-86ae6c94cd23 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:00.935318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e5022-9c2d-4bc0-9fdb-86ae6c94cd23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:00.935712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e5022-9c2d-4bc0-9fdb-86ae6c94cd23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:00.937146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e5022-9c2d-4bc0-9fdb-86ae6c94cd23 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:00.945962 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-b457d34c-e4d6-45cb-a520-4e75939269d8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 16 20:46:00.945962 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:00.945962 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:00.945962 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:00.945962 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:00.945962 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:00.945962 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:00.945962 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:00.945962 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:00.945962 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:00.945962 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:00.945962 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:00.945962 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:46:00.945962 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:46:00.945962 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:46:00.945962 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:46:00.948278 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:00.948278 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:00.948278 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:46:00.948278 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:46:00.948278 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:46:00.948278 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:46:00.948278 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:00.948278 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:00.948278 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:00.948278 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:00.948278 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:00.948278 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:00.948278 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:00.948278 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:00.948278 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:00.948278 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:00.948278 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:00.948278 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:00.950755 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:00.950755 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:00.950755 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:46:00.950755 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:46:00.950755 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:46:00.950755 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:46:00.950755 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:46:00.950755 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:46:00.950755 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 16 20:46:00.950755 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:00.952015 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 426/844] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:46:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:00.959043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457d34c-e4d6-45cb-a520-4e75939269d8 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:00.961039 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 419/845] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:00.962119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e5022-9c2d-4bc0-9fdb-86ae6c94cd23 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:01.052751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:01.066384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457d34c-e4d6-45cb-a520-4e75939269d8 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:01.080648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e5022-9c2d-4bc0-9fdb-86ae6c94cd23 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:01.083350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:01.104476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41fc82-46d5-4cc8-af76-794c6be6d2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:01.105291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41fc82-46d5-4cc8-af76-794c6be6d2c3 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:01.105817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41fc82-46d5-4cc8-af76-794c6be6d2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:01.106388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41fc82-46d5-4cc8-af76-794c6be6d2c3 None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:01.107459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41fc82-46d5-4cc8-af76-794c6be6d2c3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:01.107845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41fc82-46d5-4cc8-af76-794c6be6d2c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:01.109524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41fc82-46d5-4cc8-af76-794c6be6d2c3 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:01.124170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c7421-3baa-4b74-809b-4b94d9d5b910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:01.124170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c7421-3baa-4b74-809b-4b94d9d5b910 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:01.124170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c7421-3baa-4b74-809b-4b94d9d5b910 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:01.124170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c7421-3baa-4b74-809b-4b94d9d5b910 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:01.130038 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 427/846] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Jul 16 20:46:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:01.134837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe594c7b-f21e-4769-9217-63ea4001d108 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:01.134837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe594c7b-f21e-4769-9217-63ea4001d108 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:01.134837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe594c7b-f21e-4769-9217-63ea4001d108 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:01.135382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c7421-3baa-4b74-809b-4b94d9d5b910 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:01.135559 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 428/847] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:01.135720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c7421-3baa-4b74-809b-4b94d9d5b910 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:01.135908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe594c7b-f21e-4769-9217-63ea4001d108 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:01.152541 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-e66c7421-3baa-4b74-809b-4b94d9d5b910 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 16 20:46:01.152541 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:01.152541 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:01.152541 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:01.152541 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:01.152541 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:01.152541 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:01.152541 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:01.152541 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:01.152541 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:01.152541 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:01.152541 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:01.152541 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:46:01.152541 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:46:01.152541 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:46:01.152541 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:46:01.155424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:01.155424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:01.155424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:46:01.155424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:46:01.155424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:46:01.155424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:46:01.155424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:01.155424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:01.155424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:01.155424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:01.155424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:01.155424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:01.155424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:01.155424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:01.155424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:01.155424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:01.155424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:01.155424 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:01.157800 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:01.157800 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:01.157800 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:46:01.157800 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:46:01.157800 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:46:01.157800 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:46:01.157800 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:46:01.157800 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:46:01.157800 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 16 20:46:01.157800 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:01.157800 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 420/848] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Jul 16 20:46:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:01.157800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da043832-1397-4dbe-9a4c-3aa5def095df None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:01.157800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da043832-1397-4dbe-9a4c-3aa5def095df None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:01.159766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da043832-1397-4dbe-9a4c-3aa5def095df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:01.181650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-da043832-1397-4dbe-9a4c-3aa5def095df None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:01.182908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-da043832-1397-4dbe-9a4c-3aa5def095df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:01.260503 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 421/849] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:01.262382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da043832-1397-4dbe-9a4c-3aa5def095df None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:01.274235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe594c7b-f21e-4769-9217-63ea4001d108 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:01.315057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e4a4c-03c7-4fe0-81d2-1323402f2f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:01.315709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e4a4c-03c7-4fe0-81d2-1323402f2f2e None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:01.315987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e4a4c-03c7-4fe0-81d2-1323402f2f2e None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:01.316259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e4a4c-03c7-4fe0-81d2-1323402f2f2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:01.334380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:01.369054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:01.382619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da043832-1397-4dbe-9a4c-3aa5def095df None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:01.392499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e4a4c-03c7-4fe0-81d2-1323402f2f2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:01.393945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e4a4c-03c7-4fe0-81d2-1323402f2f2e None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:01.421902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15dc3a0-7227-48b7-b4ff-3a609e0e6d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:01.422568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dc3a0-7227-48b7-b4ff-3a609e0e6d93 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:01.422847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dc3a0-7227-48b7-b4ff-3a609e0e6d93 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:01.423152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dc3a0-7227-48b7-b4ff-3a609e0e6d93 None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:01.423981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15dc3a0-7227-48b7-b4ff-3a609e0e6d93 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:01.424289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15dc3a0-7227-48b7-b4ff-3a609e0e6d93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:01.425721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15dc3a0-7227-48b7-b4ff-3a609e0e6d93 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:01.449428 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 422/850] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Jul 16 20:46:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:01.451435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15dc3a0-7227-48b7-b4ff-3a609e0e6d93 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:01.503129 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 429/851] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:46:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 16 20:46:01.504764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37376d1-8360-4cad-92c2-3c9ced87ae16 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:01.505048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37376d1-8360-4cad-92c2-3c9ced87ae16 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:01.505321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37376d1-8360-4cad-92c2-3c9ced87ae16 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:01.506637 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 430/852] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:01.507364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37376d1-8360-4cad-92c2-3c9ced87ae16 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:01.558243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:01.566467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15dc3a0-7227-48b7-b4ff-3a609e0e6d93 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:01.603200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852c0cc-e948-4fe2-a148-2ab5e568569e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:01.603996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852c0cc-e948-4fe2-a148-2ab5e568569e None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:01.604274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852c0cc-e948-4fe2-a148-2ab5e568569e None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:01.604544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852c0cc-e948-4fe2-a148-2ab5e568569e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:01.605241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852c0cc-e948-4fe2-a148-2ab5e568569e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:01.607097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852c0cc-e948-4fe2-a148-2ab5e568569e None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:01.615792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37376d1-8360-4cad-92c2-3c9ced87ae16 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:01.619360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-9852c0cc-e948-4fe2-a148-2ab5e568569e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 16 20:46:01.619360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:01.619360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:46:01.619360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:46:01.619360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:46:01.619360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:46:01.619360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:46:01.619360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:01.619360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 16 20:46:01.619360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:01.619360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:46:01.619360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:01.619360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:01.619360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:01.619360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:01.619360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:01.619360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:01.620779 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:01.620779 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:01.620779 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:01.620779 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:01.620779 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:01.620779 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:01.620779 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:46:01.620779 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:46:01.620779 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:46:01.620779 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:46:01.620779 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:01.620779 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:01.620779 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:01.620779 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:01.620779 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:01.620779 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:01.621603 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:01.621603 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:01.621603 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:01.621603 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:01.621603 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:01.621603 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:01.621603 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:01.621603 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:01.621603 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:01.621603 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:01.621603 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:46:01.621603 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:01.621603 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 16 20:46:01.621603 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:01.621603 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 423/853] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Jul 16 20:46:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:01.622477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468bafa-8b7f-4406-9471-f0ce8c54a50a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:01.622477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468bafa-8b7f-4406-9471-f0ce8c54a50a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:01.622477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468bafa-8b7f-4406-9471-f0ce8c54a50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:01.640098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c468bafa-8b7f-4406-9471-f0ce8c54a50a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:01.641215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c468bafa-8b7f-4406-9471-f0ce8c54a50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:01.651370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:01.652695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddc7bb-faa2-4dd1-ab19-4c39dff7ebfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:01.653720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddc7bb-faa2-4dd1-ab19-4c39dff7ebfe None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:01.654005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddc7bb-faa2-4dd1-ab19-4c39dff7ebfe None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:01.654281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddc7bb-faa2-4dd1-ab19-4c39dff7ebfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:01.716694 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 424/854] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:01.717623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468bafa-8b7f-4406-9471-f0ce8c54a50a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:01.726599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddc7bb-faa2-4dd1-ab19-4c39dff7ebfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:01.728092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddc7bb-faa2-4dd1-ab19-4c39dff7ebfe None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:01.780451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:01.844607 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 431/855] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:46:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 16 20:46:01.844607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddc7bb-faa2-4dd1-ab19-4c39dff7ebfe None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:01.844888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468bafa-8b7f-4406-9471-f0ce8c54a50a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:01.882914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b434d4-3f87-4eb7-a047-0b935bdc3b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:01.883844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b434d4-3f87-4eb7-a047-0b935bdc3b8c None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:01.884231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b434d4-3f87-4eb7-a047-0b935bdc3b8c None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:01.884742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b434d4-3f87-4eb7-a047-0b935bdc3b8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:01.896877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b434d4-3f87-4eb7-a047-0b935bdc3b8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:01.898259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b434d4-3f87-4eb7-a047-0b935bdc3b8c None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:01.900946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:01.919346 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-f5b434d4-3f87-4eb7-a047-0b935bdc3b8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:01.919346 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:01.919346 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:01.919346 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:01.919346 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:01.919346 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:01.919346 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:01.919346 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:01.919346 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:01.919346 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:01.919346 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:01.919346 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:01.919346 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:46:01.919346 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:46:01.919346 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:46:01.920323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:46:01.920323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:01.920323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:01.920323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:01.920323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:01.920323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:01.920323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:01.920323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:01.920323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:01.920323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:01.920323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:01.920323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:01.920323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:01.920323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:01.920323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:01.920323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:01.920323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:01.921209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:46:01.921209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:46:01.921209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:01.921209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:01.921209 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 425/856] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:01.921784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b434d4-3f87-4eb7-a047-0b935bdc3b8c None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:01.957155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddc7bb-faa2-4dd1-ab19-4c39dff7ebfe None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:02.011689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e10d04-9b5c-4057-b14f-b269e3915fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:02.012357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e10d04-9b5c-4057-b14f-b269e3915fa0 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:02.012738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e10d04-9b5c-4057-b14f-b269e3915fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:02.013018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e10d04-9b5c-4057-b14f-b269e3915fa0 None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:02.013738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e10d04-9b5c-4057-b14f-b269e3915fa0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:02.014045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e10d04-9b5c-4057-b14f-b269e3915fa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:02.015454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e10d04-9b5c-4057-b14f-b269e3915fa0 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:02.020410 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 432/857] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Jul 16 20:46:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:02.021052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e10d04-9b5c-4057-b14f-b269e3915fa0 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:02.031709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b434d4-3f87-4eb7-a047-0b935bdc3b8c None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:02.035058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:02.075222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c449fb-8cef-4f88-a4e2-9d6e5e64a356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:02.076498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c449fb-8cef-4f88-a4e2-9d6e5e64a356 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:02.076960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c449fb-8cef-4f88-a4e2-9d6e5e64a356 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:02.077386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c449fb-8cef-4f88-a4e2-9d6e5e64a356 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:02.078483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c449fb-8cef-4f88-a4e2-9d6e5e64a356 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:02.080570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c449fb-8cef-4f88-a4e2-9d6e5e64a356 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:02.101508 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-d9c449fb-8cef-4f88-a4e2-9d6e5e64a356 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 16 20:46:02.101508 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:02.101508 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:46:02.101508 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:46:02.101508 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:46:02.101508 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:46:02.101508 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:46:02.101508 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:02.101508 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 16 20:46:02.101508 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:02.101508 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:46:02.101508 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:02.101508 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:02.101508 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:02.101508 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:02.101508 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:02.102547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:02.102547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:02.102547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:02.102547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:02.102547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:02.102547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:02.102547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:02.102547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:46:02.102547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:46:02.102547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:46:02.102547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:46:02.102547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:02.102547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:02.102547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:02.102547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:02.102547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:02.103415 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:02.103415 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:02.103415 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:02.103415 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:02.103415 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:02.103415 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:02.103415 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:02.103415 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:02.103415 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:02.103415 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:02.103415 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:02.103415 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:46:02.103415 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:02.103415 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 16 20:46:02.103415 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:02.104211 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 426/858] 10.222.0.16 () {56 vars in 1132 bytes} [Sat Jul 16 20:46:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:02.104742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c449fb-8cef-4f88-a4e2-9d6e5e64a356 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:02.148419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e10d04-9b5c-4057-b14f-b269e3915fa0 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:02.171947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:02.188766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be4b05-7400-4b76-a891-99b2f478d064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:02.189567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be4b05-7400-4b76-a891-99b2f478d064 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:02.189848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be4b05-7400-4b76-a891-99b2f478d064 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:02.190217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be4b05-7400-4b76-a891-99b2f478d064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:02.202609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be4b05-7400-4b76-a891-99b2f478d064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:02.204824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be4b05-7400-4b76-a891-99b2f478d064 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:02.220006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c449fb-8cef-4f88-a4e2-9d6e5e64a356 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:02.224285 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-75be4b05-7400-4b76-a891-99b2f478d064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:02.224285 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:02.224285 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:02.224285 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:02.224285 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:02.224285 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:02.224285 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:02.224285 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:02.224285 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:02.224285 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:02.224285 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:02.224285 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:02.224285 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:46:02.224285 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:46:02.224285 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:46:02.225225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:46:02.225225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:02.225225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:02.225225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:02.225225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:02.225225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:02.225225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:02.225225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:02.225225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:02.225225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:02.225225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:02.225225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:02.225225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:02.225225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:02.225225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:02.225225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:02.225225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:02.226091 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:46:02.226091 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:46:02.226091 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:02.226091 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:02.226091 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 433/859] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:02.226375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be4b05-7400-4b76-a891-99b2f478d064 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:02.258414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047acf43-b00f-4d9e-b683-252f6fbc1b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:02.259104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047acf43-b00f-4d9e-b683-252f6fbc1b45 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:02.259390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047acf43-b00f-4d9e-b683-252f6fbc1b45 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:02.259667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047acf43-b00f-4d9e-b683-252f6fbc1b45 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:02.260394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047acf43-b00f-4d9e-b683-252f6fbc1b45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:02.260696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047acf43-b00f-4d9e-b683-252f6fbc1b45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:02.262672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047acf43-b00f-4d9e-b683-252f6fbc1b45 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:02.274926 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 427/860] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:02.275795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047acf43-b00f-4d9e-b683-252f6fbc1b45 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:02.296482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:02.338155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be4b05-7400-4b76-a891-99b2f478d064 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:02.379106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047acf43-b00f-4d9e-b683-252f6fbc1b45 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:02.383649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4d16a-35b1-4f08-9818-3097f9f39624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:02.384314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4d16a-35b1-4f08-9818-3097f9f39624 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:02.384597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4d16a-35b1-4f08-9818-3097f9f39624 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:02.384870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4d16a-35b1-4f08-9818-3097f9f39624 None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:02.385597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4d16a-35b1-4f08-9818-3097f9f39624 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:02.385900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4d16a-35b1-4f08-9818-3097f9f39624 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:02.388193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4d16a-35b1-4f08-9818-3097f9f39624 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:02.392930 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 434/861] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Jul 16 20:46:02 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:02.393729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4d16a-35b1-4f08-9818-3097f9f39624 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:02.419380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:02.436632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0301af-75bb-4e2e-8d2a-13ded6ced796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:02.437408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0301af-75bb-4e2e-8d2a-13ded6ced796 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:02.437695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0301af-75bb-4e2e-8d2a-13ded6ced796 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:02.437974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0301af-75bb-4e2e-8d2a-13ded6ced796 None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:02.438692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0301af-75bb-4e2e-8d2a-13ded6ced796 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:02.438995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0301af-75bb-4e2e-8d2a-13ded6ced796 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:02.440431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0301af-75bb-4e2e-8d2a-13ded6ced796 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:02.446836 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 428/862] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Jul 16 20:46:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:02.447674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0301af-75bb-4e2e-8d2a-13ded6ced796 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:02.538285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4d16a-35b1-4f08-9818-3097f9f39624 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:02.572655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:02.584943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01a7fa-f3ea-441b-9b48-6b68df66a744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:02.585425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01a7fa-f3ea-441b-9b48-6b68df66a744 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:02.585707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01a7fa-f3ea-441b-9b48-6b68df66a744 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:02.586737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01a7fa-f3ea-441b-9b48-6b68df66a744 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:02.586737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01a7fa-f3ea-441b-9b48-6b68df66a744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:02.587041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01a7fa-f3ea-441b-9b48-6b68df66a744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:02.588485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01a7fa-f3ea-441b-9b48-6b68df66a744 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:02.592204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0301af-75bb-4e2e-8d2a-13ded6ced796 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:02.602369 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 435/863] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:02.603415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01a7fa-f3ea-441b-9b48-6b68df66a744 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:02.640807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9b79d-e900-4f0e-909d-462efa699edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:02.641618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9b79d-e900-4f0e-909d-462efa699edd None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:02.641884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9b79d-e900-4f0e-909d-462efa699edd None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:02.642207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9b79d-e900-4f0e-909d-462efa699edd None admin] PATH_INFO: `/v3/projects/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:02.650512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9b79d-e900-4f0e-909d-462efa699edd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:02.652064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9b79d-e900-4f0e-909d-462efa699edd None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:02.667553 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-e4f9b79d-e900-4f0e-909d-462efa699edd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:46:02.667553 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:02.667553 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:02.667553 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:02.667553 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:02.667553 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:02.667553 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:02.667553 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:02.667553 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:02.667553 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:02.667553 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:02.667553 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:02.667553 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:46:02.667553 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:46:02.667553 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:46:02.670176 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:46:02.670176 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:02.670176 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:02.670176 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:02.670176 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:02.670176 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:02.670176 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:02.670176 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:02.670176 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:02.670176 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:02.670176 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:02.670176 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:02.670176 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:02.670176 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:02.670176 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:02.670176 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:02.670176 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:02.672075 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:46:02.672075 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:46:02.672075 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:46:02.672075 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:46:02.672075 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:46:02.672075 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:46:02.672075 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:46:02.672075 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:02.672075 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 429/864] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:46:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:02.672075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9b79d-e900-4f0e-909d-462efa699edd None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:02.731891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:02.749822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01a7fa-f3ea-441b-9b48-6b68df66a744 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:02.789057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922f4a8-fd6a-4413-92c8-9b8c056b7c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:02.789741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922f4a8-fd6a-4413-92c8-9b8c056b7c3a None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:02.790094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922f4a8-fd6a-4413-92c8-9b8c056b7c3a None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:02.790378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922f4a8-fd6a-4413-92c8-9b8c056b7c3a None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:02.791159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922f4a8-fd6a-4413-92c8-9b8c056b7c3a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:02.791475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922f4a8-fd6a-4413-92c8-9b8c056b7c3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:02.792900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922f4a8-fd6a-4413-92c8-9b8c056b7c3a None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:02.797404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9b79d-e900-4f0e-909d-462efa699edd None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:02.798384 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 436/865] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Jul 16 20:46:02 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:02.799991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922f4a8-fd6a-4413-92c8-9b8c056b7c3a None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:02.850994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede7e45-cb45-4ccd-b24e-d5d3fb8419de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:02.853315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede7e45-cb45-4ccd-b24e-d5d3fb8419de None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:02.854076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede7e45-cb45-4ccd-b24e-d5d3fb8419de None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:02.854570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede7e45-cb45-4ccd-b24e-d5d3fb8419de None admin] PATH_INFO: `/v3/projects/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:02.865830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede7e45-cb45-4ccd-b24e-d5d3fb8419de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:02.868261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede7e45-cb45-4ccd-b24e-d5d3fb8419de None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:02.879713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:02.891840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-cede7e45-cb45-4ccd-b24e-d5d3fb8419de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:46:02.891840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:02.891840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:02.891840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:02.891840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:02.891840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:02.891840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:02.891840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:02.891840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:02.891840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:02.891840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:02.891840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:02.891840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:46:02.891840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:46:02.891840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:46:02.899993 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:46:02.899993 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:02.899993 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:02.899993 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:02.899993 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:02.899993 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:02.899993 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:02.899993 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:02.899993 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:02.899993 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:02.899993 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:02.899993 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:02.899993 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:02.899993 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:02.899993 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:02.899993 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:02.899993 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:02.900862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:46:02.900862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:46:02.900862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:46:02.900862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:46:02.900862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:46:02.900862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:46:02.900862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:46:02.900862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:02.900862 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 430/866] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:46:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:02.904154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede7e45-cb45-4ccd-b24e-d5d3fb8419de None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:02.955204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922f4a8-fd6a-4413-92c8-9b8c056b7c3a None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:03.002110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf28ea-fc41-465b-9b83-c301b258f22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:03.003688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf28ea-fc41-465b-9b83-c301b258f22b None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:03.004176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf28ea-fc41-465b-9b83-c301b258f22b None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:03.004663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf28ea-fc41-465b-9b83-c301b258f22b None admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:03.005675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf28ea-fc41-465b-9b83-c301b258f22b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:03.006053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf28ea-fc41-465b-9b83-c301b258f22b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:03.007727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf28ea-fc41-465b-9b83-c301b258f22b None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:03.026675 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 437/867] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:46:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:03.035183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf28ea-fc41-465b-9b83-c301b258f22b None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:03.044836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede7e45-cb45-4ccd-b24e-d5d3fb8419de None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:03.048611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:03.083084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08800c-9a35-47ce-8232-ec3dc373594d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:03.083732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08800c-9a35-47ce-8232-ec3dc373594d None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:03.084020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08800c-9a35-47ce-8232-ec3dc373594d None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:03.084267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08800c-9a35-47ce-8232-ec3dc373594d None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:03.085062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08800c-9a35-47ce-8232-ec3dc373594d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:03.085366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08800c-9a35-47ce-8232-ec3dc373594d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:03.087098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08800c-9a35-47ce-8232-ec3dc373594d None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:03.106267 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 431/868] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:46:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:03.114390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08800c-9a35-47ce-8232-ec3dc373594d None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:03.178614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf28ea-fc41-465b-9b83-c301b258f22b None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:03.190812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:03.218584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d35a9b-1a77-4177-81cb-ed760a6183af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:03.219611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d35a9b-1a77-4177-81cb-ed760a6183af None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:03.220125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d35a9b-1a77-4177-81cb-ed760a6183af None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:03.220545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d35a9b-1a77-4177-81cb-ed760a6183af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:03.221564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d35a9b-1a77-4177-81cb-ed760a6183af None admin] RBAC: Adding query filter params (role.id=bd33b827674a4d4db30c164cab416056, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=9a66df01ea414b34a8842488b145974f) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:03.222050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d35a9b-1a77-4177-81cb-ed760a6183af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:03.223786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d35a9b-1a77-4177-81cb-ed760a6183af None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:03.232117 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 438/869] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:46:03 2022] GET /identity/v3/role_assignments?user.id=9a66df01ea414b34a8842488b145974f&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=bd33b827674a4d4db30c164cab416056 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:03.246605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08800c-9a35-47ce-8232-ec3dc373594d None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:03.296544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b6a22-391f-425b-a92d-8b3703e5d026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:03.297501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b6a22-391f-425b-a92d-8b3703e5d026 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:03.298174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b6a22-391f-425b-a92d-8b3703e5d026 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:03.298630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b6a22-391f-425b-a92d-8b3703e5d026 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:03.299702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b6a22-391f-425b-a92d-8b3703e5d026 None admin] RBAC: Adding query filter params (role.id=99a4e0ec120f4163a419b2775afb8a41, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=2b154ad257954b53a13730b4a9f60570) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:03.300263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b6a22-391f-425b-a92d-8b3703e5d026 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:03.301921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b6a22-391f-425b-a92d-8b3703e5d026 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:03.310896 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 432/870] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:46:03 2022] GET /identity/v3/role_assignments?user.id=2b154ad257954b53a13730b4a9f60570&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=99a4e0ec120f4163a419b2775afb8a41 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:04.757566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4de82-8945-47eb-9d9d-c2bad94e370f None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:04.758125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4de82-8945-47eb-9d9d-c2bad94e370f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:04.758125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4de82-8945-47eb-9d9d-c2bad94e370f None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:04.759641 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 439/871] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:04.765707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ff3cb-e06c-4705-aad8-567ac225617b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:04.766522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ff3cb-e06c-4705-aad8-567ac225617b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:04.766965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ff3cb-e06c-4705-aad8-567ac225617b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:04.785567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-029ff3cb-e06c-4705-aad8-567ac225617b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:04.787136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-029ff3cb-e06c-4705-aad8-567ac225617b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:04.812165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:04.873838 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 433/872] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 16 20:46:04.903115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4de82-8945-47eb-9d9d-c2bad94e370f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:05.016169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4de82-8945-47eb-9d9d-c2bad94e370f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:05.052686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c9fb2-dc7e-4c35-aeae-3fa4c579451e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:05.053729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c9fb2-dc7e-4c35-aeae-3fa4c579451e None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:05.054214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c9fb2-dc7e-4c35-aeae-3fa4c579451e None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:05.054788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c9fb2-dc7e-4c35-aeae-3fa4c579451e None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:05.055781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c9fb2-dc7e-4c35-aeae-3fa4c579451e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:05.057378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c9fb2-dc7e-4c35-aeae-3fa4c579451e None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:05.135956 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 440/873] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Jul 16 20:46:04 2022] POST /identity/v3/services => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:46:05.683928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6fa14-a38b-4079-8970-e06564d351fd None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:05.684727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6fa14-a38b-4079-8970-e06564d351fd None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:05.685227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6fa14-a38b-4079-8970-e06564d351fd None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:05.687102 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 434/874] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:46:05.692725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cedb1-6a0b-4348-a110-a64701d9374f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:05.693389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cedb1-6a0b-4348-a110-a64701d9374f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:05.693875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cedb1-6a0b-4348-a110-a64701d9374f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:05.712380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-386cedb1-6a0b-4348-a110-a64701d9374f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:05.713937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-386cedb1-6a0b-4348-a110-a64701d9374f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:05.749700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:05.756158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc12342-b625-4fa7-b8fb-499faf90fa7f None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:05.757080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc12342-b625-4fa7-b8fb-499faf90fa7f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:05.757878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc12342-b625-4fa7-b8fb-499faf90fa7f None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:05.760912 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 435/875] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:05.770336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf9802-3856-43b4-97fe-ac7c341f131e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:05.772087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf9802-3856-43b4-97fe-ac7c341f131e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:05.772873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf9802-3856-43b4-97fe-ac7c341f131e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:05.794172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-33bf9802-3856-43b4-97fe-ac7c341f131e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:05.795592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-33bf9802-3856-43b4-97fe-ac7c341f131e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:05.802950 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 441/876] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:05 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:05.804242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d5372-28c3-4653-8f89-60eb03b5c721 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:05.804750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d5372-28c3-4653-8f89-60eb03b5c721 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:05.805184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d5372-28c3-4653-8f89-60eb03b5c721 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:05.806848 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 442/877] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:05.814482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912dd0a-2f4d-49d9-898c-9ab7a9bd7d8c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:05.815578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912dd0a-2f4d-49d9-898c-9ab7a9bd7d8c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:05.815578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912dd0a-2f4d-49d9-898c-9ab7a9bd7d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:05.836165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7912dd0a-2f4d-49d9-898c-9ab7a9bd7d8c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:05.837403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7912dd0a-2f4d-49d9-898c-9ab7a9bd7d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:05.882508 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 436/878] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:05 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:05.883778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf9802-3856-43b4-97fe-ac7c341f131e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:05.940639 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 443/879] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:05 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 16 20:46:05.941405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912dd0a-2f4d-49d9-898c-9ab7a9bd7d8c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:05.991051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:06.005502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf9802-3856-43b4-97fe-ac7c341f131e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:06.043635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1241b42-da2b-464c-8b21-bc12e61334f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:06.044535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1241b42-da2b-464c-8b21-bc12e61334f5 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:06.044903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1241b42-da2b-464c-8b21-bc12e61334f5 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:06.045182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1241b42-da2b-464c-8b21-bc12e61334f5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:06.046074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1241b42-da2b-464c-8b21-bc12e61334f5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:06.047506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1241b42-da2b-464c-8b21-bc12e61334f5 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:06.055112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:06.060712 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-b1241b42-da2b-464c-8b21-bc12e61334f5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 16 20:46:06.060712 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:06.060712 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:46:06.060712 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:46:06.060712 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:46:06.060712 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:46:06.060712 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:46:06.060712 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:06.060712 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 16 20:46:06.060712 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:06.060712 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:46:06.060712 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:06.060712 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:06.060712 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:06.060712 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:06.060712 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:06.060712 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:06.061696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:06.061696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:06.061696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:06.061696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:06.061696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:06.061696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:06.061696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:46:06.061696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:46:06.061696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:46:06.061696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:46:06.061696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:06.061696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:06.061696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:06.061696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:06.061696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:06.061696 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:06.062599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:06.062599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:06.062599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:06.062599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:06.062599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:06.062599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:06.062599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:06.062599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:06.062599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:06.062599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:06.062599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:46:06.062599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:06.062599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 16 20:46:06.062599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:06.062599 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 437/880] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Jul 16 20:46:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:06.063426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1241b42-da2b-464c-8b21-bc12e61334f5 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:06.069274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912dd0a-2f4d-49d9-898c-9ab7a9bd7d8c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:06.110714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5b562-79dd-4d81-b82f-a087cad178e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:06.111416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5b562-79dd-4d81-b82f-a087cad178e1 None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:06.111773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5b562-79dd-4d81-b82f-a087cad178e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:06.112333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5b562-79dd-4d81-b82f-a087cad178e1 None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:06.112719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5b562-79dd-4d81-b82f-a087cad178e1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:06.114221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5b562-79dd-4d81-b82f-a087cad178e1 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:06.174370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1241b42-da2b-464c-8b21-bc12e61334f5 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:06.208568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb6192-a96a-4d4f-867e-e9966defae9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:06.209299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb6192-a96a-4d4f-867e-e9966defae9e None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:06.209584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb6192-a96a-4d4f-867e-e9966defae9e None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:06.209859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb6192-a96a-4d4f-867e-e9966defae9e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:06.220783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb6192-a96a-4d4f-867e-e9966defae9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:46:06.229060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-caeb6192-a96a-4d4f-867e-e9966defae9e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 16 20:46:06.229060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:06.229060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:06.229060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:06.229060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:06.229060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:06.229060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:06.229060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:06.229060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:06.229060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:06.229060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:06.229060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:06.229060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:46:06.229060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:46:06.229060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:46:06.229060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:46:06.269419 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:46:06.269419 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:46:06.269419 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:46:06.269419 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:46:06.269419 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:06.269419 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:06.269419 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:06.269419 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:06.269419 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:06.269419 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:06.269419 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:06.269419 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:06.269419 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:06.269419 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:06.269419 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:06.269419 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:06.270234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:06.270234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:06.270234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:06.270234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:06.270234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:46:06.270234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:46:06.270234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:46:06.270234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:46:06.270234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:46:06.270234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:46:06.270234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 16 20:46:06.270234 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:06.270234 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 438/881] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Jul 16 20:46:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:06.270234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb6192-a96a-4d4f-867e-e9966defae9e None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:06.270987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:06.306842 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 444/882] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Jul 16 20:46:05 2022] POST /identity/v3/services => generated 269 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:46:06.309079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5b562-79dd-4d81-b82f-a087cad178e1 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:06.344887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb6192-a96a-4d4f-867e-e9966defae9e None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:06.400583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e0210-809f-4608-8f61-9d7e2fb1add0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:06.401818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e0210-809f-4608-8f61-9d7e2fb1add0 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:06.402409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e0210-809f-4608-8f61-9d7e2fb1add0 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:06.403095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e0210-809f-4608-8f61-9d7e2fb1add0 None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:06.404224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e0210-809f-4608-8f61-9d7e2fb1add0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:06.404744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e0210-809f-4608-8f61-9d7e2fb1add0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:06.406569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e0210-809f-4608-8f61-9d7e2fb1add0 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:06.412998 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 439/883] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Jul 16 20:46:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:06.418798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e0210-809f-4608-8f61-9d7e2fb1add0 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:06.474991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5b562-79dd-4d81-b82f-a087cad178e1 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:06.503772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:06.519973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827aa03b-3a76-4eda-8ffe-2a51263dcde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:06.520963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aa03b-3a76-4eda-8ffe-2a51263dcde0 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:06.521244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aa03b-3a76-4eda-8ffe-2a51263dcde0 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:06.521520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aa03b-3a76-4eda-8ffe-2a51263dcde0 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:06.522381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827aa03b-3a76-4eda-8ffe-2a51263dcde0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:06.522882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827aa03b-3a76-4eda-8ffe-2a51263dcde0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:06.524479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827aa03b-3a76-4eda-8ffe-2a51263dcde0 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:06.534052 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 445/884] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Jul 16 20:46:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:06.540409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827aa03b-3a76-4eda-8ffe-2a51263dcde0 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:06.546959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e0210-809f-4608-8f61-9d7e2fb1add0 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:06.567891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:06.587359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c4170-3f60-41d1-8ada-e1689fb25e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:06.588399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c4170-3f60-41d1-8ada-e1689fb25e6b None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:06.588884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c4170-3f60-41d1-8ada-e1689fb25e6b None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:06.590059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c4170-3f60-41d1-8ada-e1689fb25e6b None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:06.591156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c4170-3f60-41d1-8ada-e1689fb25e6b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:06.591673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c4170-3f60-41d1-8ada-e1689fb25e6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:06.593252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c4170-3f60-41d1-8ada-e1689fb25e6b None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:06.599917 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 440/885] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Jul 16 20:46:06 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:06.681642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827aa03b-3a76-4eda-8ffe-2a51263dcde0 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:06.723537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11fd99-0759-4394-b9a0-44570e664973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:06.724357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11fd99-0759-4394-b9a0-44570e664973 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:06.724730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11fd99-0759-4394-b9a0-44570e664973 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:06.725075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11fd99-0759-4394-b9a0-44570e664973 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:06.738278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11fd99-0759-4394-b9a0-44570e664973 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:06.739806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11fd99-0759-4394-b9a0-44570e664973 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:06.760156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-af11fd99-0759-4394-b9a0-44570e664973 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:06.760156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:06.760156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:06.760156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:06.760156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:06.760156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:06.760156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:06.760156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:06.760156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:06.760156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:06.760156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:06.760156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:06.760156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:46:06.760156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:46:06.760156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:46:06.761228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:46:06.761228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:06.761228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:06.761228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:06.761228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:06.761228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:06.761228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:06.761228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:06.761228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:06.761228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:06.761228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:06.761228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:06.761228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:06.761228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:06.761228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:06.761228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:06.761228 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:06.762380 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:46:06.762380 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:46:06.762380 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:06.762380 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:06.762380 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 446/886] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:46:06.767989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c4170-3f60-41d1-8ada-e1689fb25e6b None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:06.888822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c4170-3f60-41d1-8ada-e1689fb25e6b None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:06.926885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fedea4b-ab6c-41d2-8ac3-31787dda6947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:06.927643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedea4b-ab6c-41d2-8ac3-31787dda6947 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:06.927921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedea4b-ab6c-41d2-8ac3-31787dda6947 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:06.928194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedea4b-ab6c-41d2-8ac3-31787dda6947 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:06.928915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fedea4b-ab6c-41d2-8ac3-31787dda6947 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:06.929220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fedea4b-ab6c-41d2-8ac3-31787dda6947 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:06.930580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fedea4b-ab6c-41d2-8ac3-31787dda6947 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:06.939246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:06.949842 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 441/887] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:06.955771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11fd99-0759-4394-b9a0-44570e664973 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:07.025672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:07.068038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11fd99-0759-4394-b9a0-44570e664973 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:07.107689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038e4dc-799e-4278-802e-97b462bc6b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:07.108514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038e4dc-799e-4278-802e-97b462bc6b24 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:07.108795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038e4dc-799e-4278-802e-97b462bc6b24 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:07.109069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038e4dc-799e-4278-802e-97b462bc6b24 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:07.117702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038e4dc-799e-4278-802e-97b462bc6b24 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:07.119204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038e4dc-799e-4278-802e-97b462bc6b24 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:07.135153 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-b038e4dc-799e-4278-802e-97b462bc6b24 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 16 20:46:07.135153 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:07.135153 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:07.135153 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:07.135153 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:07.135153 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:07.135153 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:07.135153 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:07.135153 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:07.135153 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:07.135153 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:07.135153 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:07.135153 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:46:07.135153 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:46:07.135153 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:46:07.135153 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:46:07.139774 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:07.139774 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:07.139774 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:46:07.139774 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:46:07.139774 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:46:07.139774 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:46:07.139774 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:07.139774 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:07.139774 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:07.139774 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:07.139774 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:07.139774 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:07.139774 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:07.139774 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:07.139774 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:07.139774 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:07.139774 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:07.139774 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:07.140876 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:07.140876 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:07.140876 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:46:07.140876 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:46:07.140876 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:46:07.140876 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:46:07.140876 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:46:07.140876 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:46:07.140876 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 16 20:46:07.140876 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:07.140876 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 447/888] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Jul 16 20:46:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:07.142725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fedea4b-ab6c-41d2-8ac3-31787dda6947 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:07.270625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fedea4b-ab6c-41d2-8ac3-31787dda6947 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:07.310975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eeabcf-fff5-4057-bcd6-4e0f4d3fe38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:07.312064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeabcf-fff5-4057-bcd6-4e0f4d3fe38a None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:07.312552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeabcf-fff5-4057-bcd6-4e0f4d3fe38a None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:07.313053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeabcf-fff5-4057-bcd6-4e0f4d3fe38a None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:07.314125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eeabcf-fff5-4057-bcd6-4e0f4d3fe38a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:07.314637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eeabcf-fff5-4057-bcd6-4e0f4d3fe38a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:07.316333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eeabcf-fff5-4057-bcd6-4e0f4d3fe38a None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:07.337527 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 442/889] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Jul 16 20:46:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:07.343798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038e4dc-799e-4278-802e-97b462bc6b24 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:07.471047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038e4dc-799e-4278-802e-97b462bc6b24 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:07.508898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:07.523634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7344a3-a236-4c19-a0d4-f1ac750baa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:07.524272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7344a3-a236-4c19-a0d4-f1ac750baa6f None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:07.524556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7344a3-a236-4c19-a0d4-f1ac750baa6f None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:07.524838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7344a3-a236-4c19-a0d4-f1ac750baa6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:07.542993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab5338-cea8-4461-aafd-efb256e88df7 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:07.543375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab5338-cea8-4461-aafd-efb256e88df7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:07.543655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab5338-cea8-4461-aafd-efb256e88df7 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:07.545224 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 443/890] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:07.552240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69479c1-e231-4461-8a78-0f94348c0a21 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:07.552559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69479c1-e231-4461-8a78-0f94348c0a21 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:07.553209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69479c1-e231-4461-8a78-0f94348c0a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:07.571600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a69479c1-e231-4461-8a78-0f94348c0a21 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:07.572766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a69479c1-e231-4461-8a78-0f94348c0a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:07.608154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7344a3-a236-4c19-a0d4-f1ac750baa6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:07.609875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7344a3-a236-4c19-a0d4-f1ac750baa6f None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:07.633693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:07.653673 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 444/891] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:07.686003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69479c1-e231-4461-8a78-0f94348c0a21 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:07.751640 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 448/892] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:46:07 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 16 20:46:07.757227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7344a3-a236-4c19-a0d4-f1ac750baa6f None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:07.789048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:07.816954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69479c1-e231-4461-8a78-0f94348c0a21 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:07.868218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53285c0d-8004-4efb-9908-e7f1983d5d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:07.869399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53285c0d-8004-4efb-9908-e7f1983d5d59 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:07.869750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53285c0d-8004-4efb-9908-e7f1983d5d59 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:07.870099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53285c0d-8004-4efb-9908-e7f1983d5d59 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:07.871686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53285c0d-8004-4efb-9908-e7f1983d5d59 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:07.873831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53285c0d-8004-4efb-9908-e7f1983d5d59 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:07.890157 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-53285c0d-8004-4efb-9908-e7f1983d5d59 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 16 20:46:07.890157 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:07.890157 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:46:07.890157 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:46:07.890157 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:46:07.890157 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:46:07.890157 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:46:07.890157 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:07.890157 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 16 20:46:07.890157 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:07.890157 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:46:07.890157 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:07.890157 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:07.890157 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:07.890157 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:07.890157 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:07.890157 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:07.892830 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:07.892830 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:07.892830 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:07.892830 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:07.892830 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:07.892830 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:07.892830 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:46:07.892830 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:46:07.892830 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:46:07.892830 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:46:07.892830 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:07.892830 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:07.892830 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:07.892830 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:07.892830 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:07.892830 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:07.894150 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:07.894150 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:07.894150 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:07.894150 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:07.894150 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:07.894150 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:07.894150 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:07.894150 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:07.894150 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:07.894150 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:07.894150 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:46:07.894150 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:07.894150 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 16 20:46:07.894150 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:07.896680 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 445/893] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Jul 16 20:46:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:46:07.898584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53285c0d-8004-4efb-9908-e7f1983d5d59 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:07.901295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7344a3-a236-4c19-a0d4-f1ac750baa6f None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:07.952202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50771a5f-ece1-4539-9534-49f9276b7dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:07.954021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50771a5f-ece1-4539-9534-49f9276b7dab None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:07.954545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50771a5f-ece1-4539-9534-49f9276b7dab None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:07.955173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50771a5f-ece1-4539-9534-49f9276b7dab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:07.965387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:07.970959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50771a5f-ece1-4539-9534-49f9276b7dab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:07.974254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50771a5f-ece1-4539-9534-49f9276b7dab None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:08.001737 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-50771a5f-ece1-4539-9534-49f9276b7dab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:08.001737 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:08.001737 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:08.001737 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:08.001737 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:08.001737 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:08.001737 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:08.001737 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:08.001737 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:08.001737 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:08.001737 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:08.001737 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:08.001737 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:46:08.001737 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:46:08.001737 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:46:08.002735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:46:08.002735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:08.002735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:08.002735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:08.002735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:08.002735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:08.002735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:08.002735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:08.002735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:08.002735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:08.002735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:08.002735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:08.002735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:08.002735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:08.002735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:08.002735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:08.002735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:08.003678 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:46:08.003678 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:46:08.003678 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:08.003678 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:08.006267 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 449/894] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:46:08.013376 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50771a5f-ece1-4539-9534-49f9276b7dab None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:08.040821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53285c0d-8004-4efb-9908-e7f1983d5d59 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:08.088450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae8ae6-e4d2-4e2a-b77e-b95f59889e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:08.090215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae8ae6-e4d2-4e2a-b77e-b95f59889e33 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:08.091087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae8ae6-e4d2-4e2a-b77e-b95f59889e33 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:08.091578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae8ae6-e4d2-4e2a-b77e-b95f59889e33 None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:08.092982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae8ae6-e4d2-4e2a-b77e-b95f59889e33 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:08.093777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae8ae6-e4d2-4e2a-b77e-b95f59889e33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:08.095513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae8ae6-e4d2-4e2a-b77e-b95f59889e33 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:08.103881 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 446/895] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Jul 16 20:46:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:08.109710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae8ae6-e4d2-4e2a-b77e-b95f59889e33 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:08.131473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:08.148684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50771a5f-ece1-4539-9534-49f9276b7dab None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:08.195798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098b997-521d-4e57-8e84-34cdb79d8cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:08.197138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098b997-521d-4e57-8e84-34cdb79d8cc2 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:08.197620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098b997-521d-4e57-8e84-34cdb79d8cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:08.198088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098b997-521d-4e57-8e84-34cdb79d8cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:08.200309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098b997-521d-4e57-8e84-34cdb79d8cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:08.200812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098b997-521d-4e57-8e84-34cdb79d8cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:08.203459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098b997-521d-4e57-8e84-34cdb79d8cc2 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:08.229151 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 450/896] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:08.231356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098b997-521d-4e57-8e84-34cdb79d8cc2 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:08.265074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae8ae6-e4d2-4e2a-b77e-b95f59889e33 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:08.283964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:08.314830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb44dc-fa15-4062-b4fd-23bf89ca2c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:08.316816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb44dc-fa15-4062-b4fd-23bf89ca2c76 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:08.317270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb44dc-fa15-4062-b4fd-23bf89ca2c76 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:08.317685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb44dc-fa15-4062-b4fd-23bf89ca2c76 None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:08.318540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb44dc-fa15-4062-b4fd-23bf89ca2c76 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:08.318986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb44dc-fa15-4062-b4fd-23bf89ca2c76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:08.321112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb44dc-fa15-4062-b4fd-23bf89ca2c76 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:08.330230 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 447/897] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Jul 16 20:46:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:08.336440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb44dc-fa15-4062-b4fd-23bf89ca2c76 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:08.373340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098b997-521d-4e57-8e84-34cdb79d8cc2 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:08.431053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d50db-53b4-49e5-9505-e2ef75f24ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:08.432481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d50db-53b4-49e5-9505-e2ef75f24ca1 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:08.432785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d50db-53b4-49e5-9505-e2ef75f24ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:08.433879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d50db-53b4-49e5-9505-e2ef75f24ca1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:08.438714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:08.444348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d50db-53b4-49e5-9505-e2ef75f24ca1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:08.446738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d50db-53b4-49e5-9505-e2ef75f24ca1 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:08.467456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-5e0d50db-53b4-49e5-9505-e2ef75f24ca1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:46:08.467456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:08.467456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:08.467456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:08.467456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:08.467456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:08.467456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:08.467456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:08.467456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:08.467456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:08.467456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:08.467456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:08.467456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:46:08.467456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:46:08.467456 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:46:08.468553 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:46:08.468553 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:08.468553 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:08.468553 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:08.468553 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:08.468553 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:08.468553 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:08.468553 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:08.468553 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:08.468553 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:08.468553 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:08.468553 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:08.468553 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:08.468553 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:08.468553 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:08.468553 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:08.468553 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:08.469609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:46:08.469609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:46:08.469609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:46:08.469609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:46:08.469609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:46:08.469609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:46:08.469609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:46:08.469609 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:08.471480 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 451/898] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:46:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:08.471674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb44dc-fa15-4062-b4fd-23bf89ca2c76 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:08.477194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d50db-53b4-49e5-9505-e2ef75f24ca1 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:08.516021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c12e0-5f03-4cc4-a304-3bcfec3fac72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:08.516718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c12e0-5f03-4cc4-a304-3bcfec3fac72 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:08.517001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c12e0-5f03-4cc4-a304-3bcfec3fac72 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:08.517282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c12e0-5f03-4cc4-a304-3bcfec3fac72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:08.518081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c12e0-5f03-4cc4-a304-3bcfec3fac72 None admin] RBAC: Adding query filter params (interface=public, service_id=2dc392418f734adfac26a7e1a408709b, region_id=RegionOne) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:08.518398 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c12e0-5f03-4cc4-a304-3bcfec3fac72 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:08.519999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c12e0-5f03-4cc4-a304-3bcfec3fac72 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:08.534607 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 448/899] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Jul 16 20:46:08 2022] GET /identity/v3/endpoints?service_id=2dc392418f734adfac26a7e1a408709b&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:08.535422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c12e0-5f03-4cc4-a304-3bcfec3fac72 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:08.584330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:08.649531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c12e0-5f03-4cc4-a304-3bcfec3fac72 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:08.660040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d50db-53b4-49e5-9505-e2ef75f24ca1 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:08.688993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c167a7-ae48-4b72-8040-2161d67aef0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:08.689606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c167a7-ae48-4b72-8040-2161d67aef0f None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:08.689895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c167a7-ae48-4b72-8040-2161d67aef0f None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:08.690173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c167a7-ae48-4b72-8040-2161d67aef0f None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:08.691045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c167a7-ae48-4b72-8040-2161d67aef0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:08.693389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c167a7-ae48-4b72-8040-2161d67aef0f None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:08.703810 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 449/900] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Jul 16 20:46:08 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 20:46:08.707875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d41ea-75f2-4953-9e61-87fdeea18f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:08.708996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d41ea-75f2-4953-9e61-87fdeea18f00 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:08.709553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d41ea-75f2-4953-9e61-87fdeea18f00 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:08.710047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d41ea-75f2-4953-9e61-87fdeea18f00 None admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:08.711500 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d41ea-75f2-4953-9e61-87fdeea18f00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:08.712104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d41ea-75f2-4953-9e61-87fdeea18f00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:08.713881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d41ea-75f2-4953-9e61-87fdeea18f00 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:08.736167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c167a7-ae48-4b72-8040-2161d67aef0f None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:08.736952 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 452/901] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:46:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:08.861685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddc06c-5f59-40ca-b822-6b5de652ace6 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:08.862331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddc06c-5f59-40ca-b822-6b5de652ace6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:08.862852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddc06c-5f59-40ca-b822-6b5de652ace6 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:08.864015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c167a7-ae48-4b72-8040-2161d67aef0f None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:08.869115 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 453/902] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:08.870970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e85f3-98f5-492c-8da6-e792b35833cb None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:08.871352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e85f3-98f5-492c-8da6-e792b35833cb None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:08.871784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e85f3-98f5-492c-8da6-e792b35833cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:08.874250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:08.894434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6d2e85f3-98f5-492c-8da6-e792b35833cb None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:08.895706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6d2e85f3-98f5-492c-8da6-e792b35833cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:08.913949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb602974-9c8f-4e52-a751-c6876740145e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:08.915399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb602974-9c8f-4e52-a751-c6876740145e None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:08.915908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb602974-9c8f-4e52-a751-c6876740145e None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:08.916605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb602974-9c8f-4e52-a751-c6876740145e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:08.918214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb602974-9c8f-4e52-a751-c6876740145e None admin] RBAC: Adding query filter params (role.id=b7c95212d9564da9ba2366086bf22e5d, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=2b154ad257954b53a13730b4a9f60570) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:08.918927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb602974-9c8f-4e52-a751-c6876740145e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:08.920634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb602974-9c8f-4e52-a751-c6876740145e None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:08.927730 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 450/903] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:46:08 2022] GET /identity/v3/role_assignments?user.id=2b154ad257954b53a13730b4a9f60570&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=b7c95212d9564da9ba2366086bf22e5d => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:08.985002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:09.006364 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 454/904] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:09.030714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb602974-9c8f-4e52-a751-c6876740145e None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:09.117378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32743d84-a809-40fa-96f2-4f957c0b9ce7 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:09.117657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32743d84-a809-40fa-96f2-4f957c0b9ce7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:09.117932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32743d84-a809-40fa-96f2-4f957c0b9ce7 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:09.119675 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 455/905] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:46:09.128806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce303653-f1b0-41d1-baa1-c696feff9113 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:09.129234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce303653-f1b0-41d1-baa1-c696feff9113 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:09.129617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce303653-f1b0-41d1-baa1-c696feff9113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:09.151401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ce303653-f1b0-41d1-baa1-c696feff9113 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:09.153416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ce303653-f1b0-41d1-baa1-c696feff9113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:09.155473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb602974-9c8f-4e52-a751-c6876740145e None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:09.205930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf3460-cfe0-40be-90c6-71aa5c6b4d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:09.206749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf3460-cfe0-40be-90c6-71aa5c6b4d3e None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:09.207047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf3460-cfe0-40be-90c6-71aa5c6b4d3e None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:09.207322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf3460-cfe0-40be-90c6-71aa5c6b4d3e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:09.207981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf3460-cfe0-40be-90c6-71aa5c6b4d3e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:09.209918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf3460-cfe0-40be-90c6-71aa5c6b4d3e None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:09.229552 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-38bf3460-cfe0-40be-90c6-71aa5c6b4d3e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 16 20:46:09.229552 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:09.229552 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:46:09.229552 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:46:09.229552 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:46:09.229552 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:46:09.229552 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:46:09.229552 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:09.229552 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 16 20:46:09.229552 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:09.229552 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:46:09.229552 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:09.229552 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:09.229552 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:09.229552 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:09.229552 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:09.230575 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:09.230575 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:09.230575 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:09.230575 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:09.230575 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:09.230575 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:09.230575 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:09.230575 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:46:09.230575 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:46:09.230575 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:46:09.230575 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:46:09.230575 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:09.230575 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:09.230575 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:09.230575 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:09.230575 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:09.231452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:09.231452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:09.231452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:09.231452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:09.231452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:09.231452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:09.231452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:09.231452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:09.231452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:09.231452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:09.231452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:09.231452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:46:09.231452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:09.231452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 16 20:46:09.231452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:09.231452 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 451/906] 10.222.0.16 () {56 vars in 1132 bytes} [Sat Jul 16 20:46:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:09.237663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf3460-cfe0-40be-90c6-71aa5c6b4d3e None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:09.255117 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 456/907] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 16 20:46:09.274953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce303653-f1b0-41d1-baa1-c696feff9113 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:09.287993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:09.385302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf3460-cfe0-40be-90c6-71aa5c6b4d3e None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:09.410084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce303653-f1b0-41d1-baa1-c696feff9113 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:09.426011 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c249b-84d7-4906-ab45-ac49d97a1e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:09.426685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c249b-84d7-4906-ab45-ac49d97a1e51 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:09.426969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c249b-84d7-4906-ab45-ac49d97a1e51 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:09.427283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c249b-84d7-4906-ab45-ac49d97a1e51 None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:09.427988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c249b-84d7-4906-ab45-ac49d97a1e51 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:09.428293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c249b-84d7-4906-ab45-ac49d97a1e51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:09.429792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c249b-84d7-4906-ab45-ac49d97a1e51 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:09.435917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:09.441703 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 452/908] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Jul 16 20:46:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:09.442874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c249b-84d7-4906-ab45-ac49d97a1e51 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:09.463969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f8ef5-95f4-4d2b-a785-676532e5d9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:09.465260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f8ef5-95f4-4d2b-a785-676532e5d9cd None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:09.465529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f8ef5-95f4-4d2b-a785-676532e5d9cd None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:09.465948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f8ef5-95f4-4d2b-a785-676532e5d9cd None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:09.467050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f8ef5-95f4-4d2b-a785-676532e5d9cd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:09.468828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f8ef5-95f4-4d2b-a785-676532e5d9cd None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:09.567516 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 457/909] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Jul 16 20:46:09 2022] POST /identity/v3/services => generated 241 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 20:46:09.580357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:09.588283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c249b-84d7-4906-ab45-ac49d97a1e51 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:09.638527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985766c4-4af5-430e-a6b9-4109d389a378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:09.639683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985766c4-4af5-430e-a6b9-4109d389a378 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:09.640301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985766c4-4af5-430e-a6b9-4109d389a378 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:09.640789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985766c4-4af5-430e-a6b9-4109d389a378 None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:09.641844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985766c4-4af5-430e-a6b9-4109d389a378 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:09.642415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985766c4-4af5-430e-a6b9-4109d389a378 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:09.644278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985766c4-4af5-430e-a6b9-4109d389a378 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:09.650930 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 453/910] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Jul 16 20:46:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:09.657673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f8ef5-95f4-4d2b-a785-676532e5d9cd None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:09.788022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f8ef5-95f4-4d2b-a785-676532e5d9cd None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:09.835363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3e4e8-64e8-43a2-b46b-0dbe785ffbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:09.835958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3e4e8-64e8-43a2-b46b-0dbe785ffbd2 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:09.836237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3e4e8-64e8-43a2-b46b-0dbe785ffbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:09.836511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3e4e8-64e8-43a2-b46b-0dbe785ffbd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:09.837317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3e4e8-64e8-43a2-b46b-0dbe785ffbd2 None admin] RBAC: Adding query filter params (interface=public, service_id=5a57894aa2784f84ac4d5fc7f6fdd23b, region_id=RegionOne) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:09.837631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3e4e8-64e8-43a2-b46b-0dbe785ffbd2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:09.839063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3e4e8-64e8-43a2-b46b-0dbe785ffbd2 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:09.846054 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 458/911] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Jul 16 20:46:09 2022] GET /identity/v3/endpoints?service_id=5a57894aa2784f84ac4d5fc7f6fdd23b&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:09.851834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985766c4-4af5-430e-a6b9-4109d389a378 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:09.973333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985766c4-4af5-430e-a6b9-4109d389a378 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:10.013038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08def1f9-5cb6-430f-96d8-fa22fdf31aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:10.014137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08def1f9-5cb6-430f-96d8-fa22fdf31aef None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:10.014622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08def1f9-5cb6-430f-96d8-fa22fdf31aef None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:10.015161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08def1f9-5cb6-430f-96d8-fa22fdf31aef None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:10.016261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08def1f9-5cb6-430f-96d8-fa22fdf31aef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:10.017945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08def1f9-5cb6-430f-96d8-fa22fdf31aef None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:10.025640 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 454/912] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Jul 16 20:46:09 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 20:46:11.181902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fca316-db90-4714-9025-95712d27c9e7 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:11.182416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fca316-db90-4714-9025-95712d27c9e7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:11.182416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fca316-db90-4714-9025-95712d27c9e7 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:11.184997 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 459/913] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:11.191293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57383ee-5280-4984-94aa-ff9e0e4e53da None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:11.192332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57383ee-5280-4984-94aa-ff9e0e4e53da None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:11.192826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57383ee-5280-4984-94aa-ff9e0e4e53da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:11.212340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f57383ee-5280-4984-94aa-ff9e0e4e53da None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:11.213956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f57383ee-5280-4984-94aa-ff9e0e4e53da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:11.232243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:11.288959 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 455/914] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:11.314687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fca316-db90-4714-9025-95712d27c9e7 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:11.363042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:11.364693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01d193-3b75-472e-b16d-e9ead169e6c6 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:11.365231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01d193-3b75-472e-b16d-e9ead169e6c6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:11.365791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01d193-3b75-472e-b16d-e9ead169e6c6 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:11.367645 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 456/915] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:46:11.376884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e264e76-6b21-4e3b-abf7-68d0c6e25cc7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:11.377436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e264e76-6b21-4e3b-abf7-68d0c6e25cc7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:11.377878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e264e76-6b21-4e3b-abf7-68d0c6e25cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:11.399069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7e264e76-6b21-4e3b-abf7-68d0c6e25cc7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:11.400616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7e264e76-6b21-4e3b-abf7-68d0c6e25cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:11.439809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fca316-db90-4714-9025-95712d27c9e7 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:11.478257 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 457/916] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:11.491480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698a7cd-385c-4cf5-85d7-a1585147a374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:11.492683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698a7cd-385c-4cf5-85d7-a1585147a374 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:11.493157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698a7cd-385c-4cf5-85d7-a1585147a374 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:11.493621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698a7cd-385c-4cf5-85d7-a1585147a374 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:11.494463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698a7cd-385c-4cf5-85d7-a1585147a374 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:11.496483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698a7cd-385c-4cf5-85d7-a1585147a374 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:11.502610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e264e76-6b21-4e3b-abf7-68d0c6e25cc7 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:11.513790 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-9698a7cd-385c-4cf5-85d7-a1585147a374 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 16 20:46:11.513790 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:11.513790 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:46:11.513790 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:46:11.513790 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:46:11.513790 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:46:11.513790 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:46:11.513790 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:11.513790 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 16 20:46:11.513790 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:11.513790 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:46:11.513790 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:11.513790 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:11.513790 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:11.513790 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:11.513790 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:11.513790 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:11.514812 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:11.514812 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:11.514812 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:11.514812 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:11.514812 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:11.514812 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:11.514812 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:46:11.514812 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:46:11.514812 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:46:11.514812 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:46:11.514812 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:11.514812 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:11.514812 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:11.514812 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:11.514812 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:11.514812 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:11.515693 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:11.515693 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:11.515693 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:11.515693 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:11.515693 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:11.515693 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:11.515693 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:11.515693 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:11.515693 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:11.515693 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:11.515693 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:46:11.515693 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:11.515693 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 16 20:46:11.515693 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:11.515693 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 460/917] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Jul 16 20:46:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:11.522287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698a7cd-385c-4cf5-85d7-a1585147a374 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:11.606399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:11.630776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e264e76-6b21-4e3b-abf7-68d0c6e25cc7 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:11.698389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b6ed9-4f60-4db5-a54d-68ee304f0f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:11.700142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b6ed9-4f60-4db5-a54d-68ee304f0f78 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:11.700731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b6ed9-4f60-4db5-a54d-68ee304f0f78 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:11.701210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b6ed9-4f60-4db5-a54d-68ee304f0f78 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:11.722673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698a7cd-385c-4cf5-85d7-a1585147a374 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:11.724639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b6ed9-4f60-4db5-a54d-68ee304f0f78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:46:11.726797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:11.734441 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-527b6ed9-4f60-4db5-a54d-68ee304f0f78 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 16 20:46:11.734441 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:11.734441 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:11.734441 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:11.734441 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:11.734441 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:11.734441 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:11.734441 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:11.734441 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:11.734441 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:11.734441 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:11.734441 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:11.734441 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:46:11.734441 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:46:11.734441 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:46:11.734441 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:46:11.735443 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:46:11.735443 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:46:11.735443 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:46:11.735443 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:46:11.735443 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:11.735443 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:11.735443 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:11.735443 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:11.735443 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:11.735443 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:11.735443 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:11.735443 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:11.735443 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:11.735443 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:11.735443 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:11.735443 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:11.736259 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:11.736259 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:11.736259 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:11.736259 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:11.736259 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:46:11.736259 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:46:11.736259 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:46:11.736259 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:46:11.736259 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:46:11.736259 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:46:11.736259 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 16 20:46:11.736259 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:11.750078 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 458/918] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Jul 16 20:46:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:46:11.751380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b6ed9-4f60-4db5-a54d-68ee304f0f78 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:11.818057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16179cd6-d6c2-45e9-ad59-d7d6e866a6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:11.818642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16179cd6-d6c2-45e9-ad59-d7d6e866a6cb None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:11.818927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16179cd6-d6c2-45e9-ad59-d7d6e866a6cb None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:11.819240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16179cd6-d6c2-45e9-ad59-d7d6e866a6cb None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:11.819952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16179cd6-d6c2-45e9-ad59-d7d6e866a6cb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:11.820262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16179cd6-d6c2-45e9-ad59-d7d6e866a6cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:11.821647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16179cd6-d6c2-45e9-ad59-d7d6e866a6cb None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:11.836165 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 461/919] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Jul 16 20:46:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:11.837603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16179cd6-d6c2-45e9-ad59-d7d6e866a6cb None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:11.896586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b6ed9-4f60-4db5-a54d-68ee304f0f78 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:11.942081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e274b1-b447-4d20-a27a-03115f9fbaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:11.943221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e274b1-b447-4d20-a27a-03115f9fbaed None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:11.944236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e274b1-b447-4d20-a27a-03115f9fbaed None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:11.944736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e274b1-b447-4d20-a27a-03115f9fbaed None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:11.946717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e274b1-b447-4d20-a27a-03115f9fbaed None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:11.949146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e274b1-b447-4d20-a27a-03115f9fbaed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:11.952182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e274b1-b447-4d20-a27a-03115f9fbaed None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:11.975436 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 459/920] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Jul 16 20:46:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:11.978760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e274b1-b447-4d20-a27a-03115f9fbaed None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:12.004460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:12.052472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16179cd6-d6c2-45e9-ad59-d7d6e866a6cb None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:12.091743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e274b1-b447-4d20-a27a-03115f9fbaed None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:12.095647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c839c-c810-474b-a404-11bbecd268f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:12.096684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c839c-c810-474b-a404-11bbecd268f8 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:12.096684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c839c-c810-474b-a404-11bbecd268f8 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:12.096874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c839c-c810-474b-a404-11bbecd268f8 None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:12.097567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c839c-c810-474b-a404-11bbecd268f8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:12.097877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c839c-c810-474b-a404-11bbecd268f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:12.099280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c839c-c810-474b-a404-11bbecd268f8 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:12.105596 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 462/921] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Jul 16 20:46:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:12.106933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de2f99-354c-47a3-adeb-61c63fc92022 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:12.107299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de2f99-354c-47a3-adeb-61c63fc92022 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:12.107583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de2f99-354c-47a3-adeb-61c63fc92022 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:12.108910 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 463/922] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:12.111242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de2f99-354c-47a3-adeb-61c63fc92022 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:12.142392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d028072-617a-485f-ba0a-d9df8e629343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:12.144835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d028072-617a-485f-ba0a-d9df8e629343 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:12.144835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d028072-617a-485f-ba0a-d9df8e629343 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:12.144835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d028072-617a-485f-ba0a-d9df8e629343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:12.153761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:12.158425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d028072-617a-485f-ba0a-d9df8e629343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:12.159942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d028072-617a-485f-ba0a-d9df8e629343 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:12.179783 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-5d028072-617a-485f-ba0a-d9df8e629343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:12.179783 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:12.179783 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:12.179783 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:12.179783 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:12.179783 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:12.179783 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:12.179783 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:12.179783 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:12.179783 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:12.179783 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:12.179783 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:12.179783 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:46:12.179783 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:46:12.179783 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:46:12.180862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:46:12.180862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:12.180862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:12.180862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:12.180862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:12.180862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:12.180862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:12.180862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:12.180862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:12.180862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:12.180862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:12.180862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:12.180862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:12.180862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:12.180862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:12.180862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:12.180862 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:12.181925 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:46:12.181925 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:46:12.181925 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:12.181925 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:12.186753 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 460/923] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:12.188152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64261a-6163-4f10-93c4-0564c2a71c36 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:12.188450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64261a-6163-4f10-93c4-0564c2a71c36 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:12.188746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64261a-6163-4f10-93c4-0564c2a71c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:12.206143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3d64261a-6163-4f10-93c4-0564c2a71c36 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:12.207407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3d64261a-6163-4f10-93c4-0564c2a71c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:12.259575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de2f99-354c-47a3-adeb-61c63fc92022 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:12.264600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:12.291114 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 461/924] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:12.291114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64261a-6163-4f10-93c4-0564c2a71c36 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:12.319506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e8687-22f6-494b-8e11-682324b11ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:12.320722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e8687-22f6-494b-8e11-682324b11ab1 None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:12.321102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e8687-22f6-494b-8e11-682324b11ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:12.321478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e8687-22f6-494b-8e11-682324b11ab1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:12.322219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e8687-22f6-494b-8e11-682324b11ab1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:12.324382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e8687-22f6-494b-8e11-682324b11ab1 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:12.400191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64261a-6163-4f10-93c4-0564c2a71c36 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:12.416113 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 464/925] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Jul 16 20:46:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:46:12.417020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e8687-22f6-494b-8e11-682324b11ab1 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:12.472024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb5f7d-3f25-4aaa-82a1-aeccb1a9df98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:12.472621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb5f7d-3f25-4aaa-82a1-aeccb1a9df98 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:12.472896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb5f7d-3f25-4aaa-82a1-aeccb1a9df98 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:12.473167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb5f7d-3f25-4aaa-82a1-aeccb1a9df98 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:12.473918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb5f7d-3f25-4aaa-82a1-aeccb1a9df98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:12.474222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb5f7d-3f25-4aaa-82a1-aeccb1a9df98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:12.475685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb5f7d-3f25-4aaa-82a1-aeccb1a9df98 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:12.494395 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 462/926] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:12.494395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d7ba7-e318-45f6-9d51-f9526febdd30 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:12.494395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d7ba7-e318-45f6-9d51-f9526febdd30 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:12.494395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d7ba7-e318-45f6-9d51-f9526febdd30 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:12.494395 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 463/927] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:12.497782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d7ba7-e318-45f6-9d51-f9526febdd30 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:12.542493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:12.560849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e8687-22f6-494b-8e11-682324b11ab1 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:12.567202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:12.617683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737963f-7a70-4262-8edf-28ac1e75fe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:12.618501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737963f-7a70-4262-8edf-28ac1e75fe66 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:12.618773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737963f-7a70-4262-8edf-28ac1e75fe66 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:12.619085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737963f-7a70-4262-8edf-28ac1e75fe66 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:12.619743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737963f-7a70-4262-8edf-28ac1e75fe66 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:12.621743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737963f-7a70-4262-8edf-28ac1e75fe66 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:12.646221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-4737963f-7a70-4262-8edf-28ac1e75fe66 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 16 20:46:12.646221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:12.646221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:46:12.646221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:46:12.646221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:46:12.646221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:46:12.646221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:46:12.646221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:12.646221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 16 20:46:12.646221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:12.646221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:46:12.646221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:12.646221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:12.646221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:12.646221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:12.646221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:12.646221 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:12.647794 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:12.647794 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:12.647794 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:12.647794 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:12.647794 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:12.647794 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:12.647794 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:46:12.647794 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:46:12.647794 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:46:12.647794 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:46:12.647794 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:12.647794 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:12.647794 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:12.647794 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:12.647794 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:12.647794 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:12.650025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:12.650025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:12.650025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:12.650025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:12.650025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:12.650025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:12.650025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:12.650025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:12.650025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:12.650025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:12.650025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:46:12.650025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:12.650025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 16 20:46:12.650025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:12.650763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d7ba7-e318-45f6-9d51-f9526febdd30 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:12.650837 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 465/928] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Jul 16 20:46:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:12.654156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38c87a-5d97-4f11-b83d-b5c625398dd4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:12.654156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38c87a-5d97-4f11-b83d-b5c625398dd4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:12.654156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38c87a-5d97-4f11-b83d-b5c625398dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:12.675710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2d38c87a-5d97-4f11-b83d-b5c625398dd4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:12.676910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2d38c87a-5d97-4f11-b83d-b5c625398dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:12.704440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9807978-443a-46cb-8b7f-3a15d53e091b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:12.705694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9807978-443a-46cb-8b7f-3a15d53e091b None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:12.705694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9807978-443a-46cb-8b7f-3a15d53e091b None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:12.705979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9807978-443a-46cb-8b7f-3a15d53e091b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:12.715524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9807978-443a-46cb-8b7f-3a15d53e091b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:12.716996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9807978-443a-46cb-8b7f-3a15d53e091b None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:12.733173 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-c9807978-443a-46cb-8b7f-3a15d53e091b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 16 20:46:12.733173 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:12.733173 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:12.733173 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:12.733173 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:12.733173 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:12.733173 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:12.733173 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:12.733173 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:12.733173 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:12.733173 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:12.733173 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:12.733173 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:46:12.733173 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:46:12.733173 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:46:12.733173 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:46:12.734128 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:12.734128 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:12.734128 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:46:12.734128 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:46:12.734128 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:46:12.734128 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:46:12.734128 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:12.734128 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:12.734128 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:12.734128 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:12.734128 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:12.734128 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:12.734128 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:12.734128 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:12.734128 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:12.734128 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:12.734128 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:12.734128 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:12.735098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:12.735098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:12.735098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:46:12.735098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:46:12.735098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:46:12.735098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:46:12.735098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:46:12.735098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:46:12.735098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 16 20:46:12.735098 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:12.735098 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 464/929] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Jul 16 20:46:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:12.735704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9807978-443a-46cb-8b7f-3a15d53e091b None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:12.762917 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 466/930] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:12.763999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38c87a-5d97-4f11-b83d-b5c625398dd4 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:12.879491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:12.880677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:12.882675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9807978-443a-46cb-8b7f-3a15d53e091b None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:12.899764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38c87a-5d97-4f11-b83d-b5c625398dd4 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:12.924366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8e03e-caa0-4eec-b0df-8a13b1078f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:12.925031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8e03e-caa0-4eec-b0df-8a13b1078f8b None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:12.925309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8e03e-caa0-4eec-b0df-8a13b1078f8b None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:12.925578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8e03e-caa0-4eec-b0df-8a13b1078f8b None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:12.926279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8e03e-caa0-4eec-b0df-8a13b1078f8b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:12.926577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8e03e-caa0-4eec-b0df-8a13b1078f8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:12.928030 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8e03e-caa0-4eec-b0df-8a13b1078f8b None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:12.935431 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 465/931] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Jul 16 20:46:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:12.935671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8e03e-caa0-4eec-b0df-8a13b1078f8b None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:12.950220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04640c84-6995-4077-b5b3-8daa6a149401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:12.950914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04640c84-6995-4077-b5b3-8daa6a149401 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:12.951381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04640c84-6995-4077-b5b3-8daa6a149401 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:12.951562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04640c84-6995-4077-b5b3-8daa6a149401 None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:12.952406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04640c84-6995-4077-b5b3-8daa6a149401 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:12.952775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04640c84-6995-4077-b5b3-8daa6a149401 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:12.954232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04640c84-6995-4077-b5b3-8daa6a149401 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:12.981447 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 467/932] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Jul 16 20:46:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:12.982680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04640c84-6995-4077-b5b3-8daa6a149401 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:13.069505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8e03e-caa0-4eec-b0df-8a13b1078f8b None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:13.109654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82617b80-7f60-419d-891a-9f00cbc5c3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:13.110457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82617b80-7f60-419d-891a-9f00cbc5c3a8 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:13.110743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82617b80-7f60-419d-891a-9f00cbc5c3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:13.111033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82617b80-7f60-419d-891a-9f00cbc5c3a8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:13.111677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82617b80-7f60-419d-891a-9f00cbc5c3a8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:13.113070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82617b80-7f60-419d-891a-9f00cbc5c3a8 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:13.114103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04640c84-6995-4077-b5b3-8daa6a149401 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:13.128920 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-82617b80-7f60-419d-891a-9f00cbc5c3a8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 16 20:46:13.128920 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:13.128920 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:46:13.128920 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:46:13.128920 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:46:13.128920 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:46:13.128920 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:46:13.128920 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:13.128920 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 16 20:46:13.128920 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:13.128920 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:46:13.128920 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:13.128920 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:13.128920 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:13.128920 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:13.128920 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:13.129940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:13.129940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:13.129940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:13.129940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:13.129940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:13.129940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:13.129940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:13.129940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:46:13.129940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:46:13.129940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:46:13.129940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:46:13.129940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:13.129940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:13.129940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:13.129940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:13.129940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:13.130848 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:13.130848 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:13.130848 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:13.130848 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:13.130848 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:13.130848 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:13.130848 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:13.130848 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:13.130848 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:13.130848 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:13.130848 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:13.130848 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:46:13.130848 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:13.130848 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 16 20:46:13.130848 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:13.130848 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 466/933] 10.222.0.16 () {56 vars in 1132 bytes} [Sat Jul 16 20:46:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:13.131720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82617b80-7f60-419d-891a-9f00cbc5c3a8 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:13.162857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e50f5-c69e-4356-bc04-2cbf51db3c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:13.163568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e50f5-c69e-4356-bc04-2cbf51db3c56 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:13.163858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e50f5-c69e-4356-bc04-2cbf51db3c56 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:13.164113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e50f5-c69e-4356-bc04-2cbf51db3c56 None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:13.164828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e50f5-c69e-4356-bc04-2cbf51db3c56 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:13.165139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e50f5-c69e-4356-bc04-2cbf51db3c56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:13.166510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e50f5-c69e-4356-bc04-2cbf51db3c56 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:13.168084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:13.173756 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 468/934] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Jul 16 20:46:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:13.174583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e50f5-c69e-4356-bc04-2cbf51db3c56 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:13.182055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:13.253834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82617b80-7f60-419d-891a-9f00cbc5c3a8 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:13.298445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e50f5-c69e-4356-bc04-2cbf51db3c56 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:13.302602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995b257-dba9-4442-b6f0-11e2c94dd4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:13.303626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995b257-dba9-4442-b6f0-11e2c94dd4dc None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:13.304052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995b257-dba9-4442-b6f0-11e2c94dd4dc None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:13.304467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995b257-dba9-4442-b6f0-11e2c94dd4dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:13.317086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995b257-dba9-4442-b6f0-11e2c94dd4dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:13.319084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995b257-dba9-4442-b6f0-11e2c94dd4dc None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:13.336597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3db72-9aa4-47b8-a3bc-d3ea0555187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:13.337172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3db72-9aa4-47b8-a3bc-d3ea0555187d None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:13.337451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3db72-9aa4-47b8-a3bc-d3ea0555187d None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:13.337731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3db72-9aa4-47b8-a3bc-d3ea0555187d None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:13.338530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3db72-9aa4-47b8-a3bc-d3ea0555187d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:13.338834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3db72-9aa4-47b8-a3bc-d3ea0555187d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:13.340378 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-6995b257-dba9-4442-b6f0-11e2c94dd4dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:13.340378 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:13.340378 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:13.340378 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:13.340378 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:13.340378 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:13.340378 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:13.340378 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:13.340378 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:13.340378 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:13.340378 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:13.340378 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:13.340378 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:46:13.340378 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:46:13.340378 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:46:13.341416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:46:13.341416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:13.341416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:13.341416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:13.341416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:13.341416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:13.341416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:13.341416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:13.341416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:13.341416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:13.341416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:13.341416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:13.341416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:13.341416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:13.341416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:13.341416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:13.341416 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:13.342388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:46:13.342388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:46:13.342388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:13.342388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:13.342644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3db72-9aa4-47b8-a3bc-d3ea0555187d None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:13.344257 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 467/935] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:13.345390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995b257-dba9-4442-b6f0-11e2c94dd4dc None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:13.354810 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 469/936] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Jul 16 20:46:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:13.355776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3db72-9aa4-47b8-a3bc-d3ea0555187d None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:13.441458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:13.469759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:13.480093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3db72-9aa4-47b8-a3bc-d3ea0555187d None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:13.491589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995b257-dba9-4442-b6f0-11e2c94dd4dc None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:13.517791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304818da-992a-4cf1-ba9a-c5e42c8c0194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:13.518542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304818da-992a-4cf1-ba9a-c5e42c8c0194 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:13.518820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304818da-992a-4cf1-ba9a-c5e42c8c0194 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:13.519112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304818da-992a-4cf1-ba9a-c5e42c8c0194 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:13.519842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304818da-992a-4cf1-ba9a-c5e42c8c0194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:13.520587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304818da-992a-4cf1-ba9a-c5e42c8c0194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:13.521612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304818da-992a-4cf1-ba9a-c5e42c8c0194 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:13.533062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b756225-0acd-4447-99b8-9d3fb7fc9b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:13.538503 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 470/937] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:13.538664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b756225-0acd-4447-99b8-9d3fb7fc9b36 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:13.538664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b756225-0acd-4447-99b8-9d3fb7fc9b36 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:13.538664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b756225-0acd-4447-99b8-9d3fb7fc9b36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:13.538879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304818da-992a-4cf1-ba9a-c5e42c8c0194 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:13.538948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b756225-0acd-4447-99b8-9d3fb7fc9b36 None admin] RBAC: Adding query filter params (interface=public, service_id=59f41423173f4933b06c156190d73677, region_id=RegionOne) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:13.538948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b756225-0acd-4447-99b8-9d3fb7fc9b36 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:13.538948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b756225-0acd-4447-99b8-9d3fb7fc9b36 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:13.544581 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 468/938] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Jul 16 20:46:13 2022] GET /identity/v3/endpoints?service_id=59f41423173f4933b06c156190d73677&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:13.549337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b756225-0acd-4447-99b8-9d3fb7fc9b36 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:13.659981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304818da-992a-4cf1-ba9a-c5e42c8c0194 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:13.690357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b756225-0acd-4447-99b8-9d3fb7fc9b36 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:13.692588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:13.700744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8f11b-56cc-4ad6-ac69-c27f2b968fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:13.701428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8f11b-56cc-4ad6-ac69-c27f2b968fe0 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:13.702131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8f11b-56cc-4ad6-ac69-c27f2b968fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:13.702131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8f11b-56cc-4ad6-ac69-c27f2b968fe0 None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:13.702688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8f11b-56cc-4ad6-ac69-c27f2b968fe0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:13.702998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8f11b-56cc-4ad6-ac69-c27f2b968fe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:13.704459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8f11b-56cc-4ad6-ac69-c27f2b968fe0 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:13.709625 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 471/939] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Jul 16 20:46:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:13.715446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8f11b-56cc-4ad6-ac69-c27f2b968fe0 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:13.739524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985603cc-de34-4021-81e5-1a130953a12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:13.740328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985603cc-de34-4021-81e5-1a130953a12f None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:13.740612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985603cc-de34-4021-81e5-1a130953a12f None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:13.740889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985603cc-de34-4021-81e5-1a130953a12f None admin] PATH_INFO: `/v3/projects/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:13.748807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985603cc-de34-4021-81e5-1a130953a12f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:13.750309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985603cc-de34-4021-81e5-1a130953a12f None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:13.765068 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-985603cc-de34-4021-81e5-1a130953a12f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:46:13.765068 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:13.765068 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:13.765068 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:13.765068 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:13.765068 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:13.765068 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:13.765068 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:13.765068 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:13.765068 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:13.765068 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:13.765068 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:13.765068 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:46:13.765068 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:46:13.765068 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:46:13.766028 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:46:13.766028 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:13.766028 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:13.766028 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:13.766028 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:13.766028 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:13.766028 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:13.766028 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:13.766028 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:13.766028 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:13.766028 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:13.766028 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:13.766028 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:13.766028 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:13.766028 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:13.766028 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:13.766028 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:13.766944 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:46:13.766944 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:46:13.766944 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:46:13.766944 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:46:13.766944 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:46:13.766944 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:46:13.766944 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:46:13.766944 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:13.766944 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 469/940] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:46:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:13.767453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985603cc-de34-4021-81e5-1a130953a12f None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:13.772551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:13.849473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8f11b-56cc-4ad6-ac69-c27f2b968fe0 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:13.893178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985603cc-de34-4021-81e5-1a130953a12f None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:13.905343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedaa69-c319-4779-9d39-1c19b922376b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:13.906663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedaa69-c319-4779-9d39-1c19b922376b None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:13.907440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedaa69-c319-4779-9d39-1c19b922376b None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:13.907997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedaa69-c319-4779-9d39-1c19b922376b None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:13.909392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cedaa69-c319-4779-9d39-1c19b922376b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:13.912111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cedaa69-c319-4779-9d39-1c19b922376b None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:13.924363 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 472/941] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Jul 16 20:46:13 2022] GET /identity/v3/services => generated 1497 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 20:46:13.925921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedaa69-c319-4779-9d39-1c19b922376b None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:13.942092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fcdce-7cba-43e1-985b-3d327e20fee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:13.943306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fcdce-7cba-43e1-985b-3d327e20fee7 None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:13.943836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fcdce-7cba-43e1-985b-3d327e20fee7 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:13.945102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fcdce-7cba-43e1-985b-3d327e20fee7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:13.946127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fcdce-7cba-43e1-985b-3d327e20fee7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:13.952862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fcdce-7cba-43e1-985b-3d327e20fee7 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:14.015965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:14.071644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedaa69-c319-4779-9d39-1c19b922376b None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:14.078069 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 470/942] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Jul 16 20:46:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:46:14.151570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d565ef-7fa1-4452-9fa4-802af9aa21ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:14.152668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d565ef-7fa1-4452-9fa4-802af9aa21ca None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:14.153261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d565ef-7fa1-4452-9fa4-802af9aa21ca None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:14.153859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d565ef-7fa1-4452-9fa4-802af9aa21ca None admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:14.155538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d565ef-7fa1-4452-9fa4-802af9aa21ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:14.156186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d565ef-7fa1-4452-9fa4-802af9aa21ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:14.158806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d565ef-7fa1-4452-9fa4-802af9aa21ca None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:14.185501 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 473/943] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:46:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:14.191033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fcdce-7cba-43e1-985b-3d327e20fee7 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:14.271255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:14.336205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fcdce-7cba-43e1-985b-3d327e20fee7 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:14.398250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95e94c-027a-4059-aa1e-a35378ab7fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:14.399833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95e94c-027a-4059-aa1e-a35378ab7fcd None admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:14.400338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95e94c-027a-4059-aa1e-a35378ab7fcd None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:14.400839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95e94c-027a-4059-aa1e-a35378ab7fcd None admin] PATH_INFO: `/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/2b154ad257954b53a13730b4a9f60570/roles/b7c95212d9564da9ba2366086bf22e5d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:14.404495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95e94c-027a-4059-aa1e-a35378ab7fcd None admin] RBAC: Authorizing `identity:create_grant(project_id=c3045a89835d4e879a0ddc2557b831a3, user_id=2b154ad257954b53a13730b4a9f60570, role_id=b7c95212d9564da9ba2366086bf22e5d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:14.405986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95e94c-027a-4059-aa1e-a35378ab7fcd None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:14.485450 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 471/944] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:46:14 2022] PUT /identity/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/2b154ad257954b53a13730b4a9f60570/roles/b7c95212d9564da9ba2366086bf22e5d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:46:14.833119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af5bc4-ec39-40f0-bba5-69cc713a6ac5 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:14.833646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af5bc4-ec39-40f0-bba5-69cc713a6ac5 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:14.833724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af5bc4-ec39-40f0-bba5-69cc713a6ac5 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:14.835429 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 474/945] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:14.841302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ae6fc-fb01-4f80-b32c-264fb1d5fd95 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:14.841628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ae6fc-fb01-4f80-b32c-264fb1d5fd95 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:14.841907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ae6fc-fb01-4f80-b32c-264fb1d5fd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:14.866399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ba3ae6fc-fb01-4f80-b32c-264fb1d5fd95 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:14.867661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ba3ae6fc-fb01-4f80-b32c-264fb1d5fd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:14.959586 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 472/946] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:14.985004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af5bc4-ec39-40f0-bba5-69cc713a6ac5 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:15.109559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af5bc4-ec39-40f0-bba5-69cc713a6ac5 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:15.124708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:15.148113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afded2-3349-4ff6-88e5-32b652b9d013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:15.148766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afded2-3349-4ff6-88e5-32b652b9d013 None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:15.149045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afded2-3349-4ff6-88e5-32b652b9d013 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:15.149316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afded2-3349-4ff6-88e5-32b652b9d013 None admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:15.150027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afded2-3349-4ff6-88e5-32b652b9d013 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:15.152911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afded2-3349-4ff6-88e5-32b652b9d013 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:15.154364 ncdv-master-1 devstack@keystone.service[98195]: WARNING keystone.server.flask.common [None req-c5afded2-3349-4ff6-88e5-32b652b9d013 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 16 20:46:15.245725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.sql.core [None req-c5afded2-3349-4ff6-88e5-32b652b9d013 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 16 20:46:15.245725 ncdv-master-1 devstack@keystone.service[98195]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 16 20:46:15.245725 ncdv-master-1 devstack@keystone.service[98195]: [parameters: {'id': '57df77afb6c04cc59e184561090f3262', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 16 20:46:15.245725 ncdv-master-1 devstack@keystone.service[98195]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98195) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 16 20:46:15.253931 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-c5afded2-3349-4ff6-88e5-32b652b9d013 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 57df77afb6c04cc59e184561090f3262.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 57df77afb6c04cc59e184561090f3262. Jul 16 20:46:15.253931 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:15.253931 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 16 20:46:15.253931 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 16 20:46:15.253931 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 16 20:46:15.253931 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 16 20:46:15.253931 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 16 20:46:15.253931 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application result = self._query(query) Jul 16 20:46:15.253931 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 16 20:46:15.253931 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application conn.query(q) Jul 16 20:46:15.253931 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 16 20:46:15.253931 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 16 20:46:15.253931 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 16 20:46:15.254785 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application result.read() Jul 16 20:46:15.254785 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 16 20:46:15.254785 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 16 20:46:15.254785 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 16 20:46:15.254785 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 16 20:46:15.254785 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 16 20:46:15.254785 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 16 20:46:15.254785 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 16 20:46:15.254785 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 16 20:46:15.254785 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 16 20:46:15.254785 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:15.254785 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 16 20:46:15.254785 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:15.254785 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:15.254785 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 16 20:46:15.254785 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 16 20:46:15.254785 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 16 20:46:15.254785 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 16 20:46:15.255818 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 16 20:46:15.255818 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application next(self.gen) Jul 16 20:46:15.255818 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 16 20:46:15.255818 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application yield resource Jul 16 20:46:15.255818 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 16 20:46:15.255818 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application next(self.gen) Jul 16 20:46:15.255818 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 16 20:46:15.255818 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self.session.rollback() Jul 16 20:46:15.255818 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 16 20:46:15.255818 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self.force_reraise() Jul 16 20:46:15.255818 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 16 20:46:15.255818 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise self.value Jul 16 20:46:15.255818 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 16 20:46:15.255818 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 16 20:46:15.255818 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 16 20:46:15.255818 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application session.commit() Jul 16 20:46:15.255818 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 16 20:46:15.256684 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 16 20:46:15.256684 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 16 20:46:15.256684 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._prepare_impl() Jul 16 20:46:15.256684 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 16 20:46:15.256684 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self.session.flush() Jul 16 20:46:15.256684 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 16 20:46:15.256684 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._flush(objects) Jul 16 20:46:15.256684 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 16 20:46:15.256684 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 16 20:46:15.256684 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 16 20:46:15.256684 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application compat.raise_( Jul 16 20:46:15.256684 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 16 20:46:15.256684 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception Jul 16 20:46:15.256684 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 16 20:46:15.256684 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application flush_context.execute() Jul 16 20:46:15.256684 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 16 20:46:15.256684 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rec.execute(self) Jul 16 20:46:15.257548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 16 20:46:15.257548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 16 20:46:15.257548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 16 20:46:15.257548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 16 20:46:15.257548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 16 20:46:15.257548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 16 20:46:15.257548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 16 20:46:15.257548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 16 20:46:15.257548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 16 20:46:15.257548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 16 20:46:15.257548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 16 20:46:15.257548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 16 20:46:15.257548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 16 20:46:15.257548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 16 20:46:15.257548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 16 20:46:15.258335 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 16 20:46:15.258335 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 16 20:46:15.258335 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception Jul 16 20:46:15.258335 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 16 20:46:15.258335 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 16 20:46:15.258335 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 16 20:46:15.258335 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 16 20:46:15.258335 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 16 20:46:15.258335 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application result = self._query(query) Jul 16 20:46:15.258335 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 16 20:46:15.258335 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application conn.query(q) Jul 16 20:46:15.258335 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 16 20:46:15.258335 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 16 20:46:15.258335 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 16 20:46:15.258335 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application result.read() Jul 16 20:46:15.258335 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 16 20:46:15.258335 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 16 20:46:15.260576 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 16 20:46:15.260576 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 16 20:46:15.260576 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 16 20:46:15.260576 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 16 20:46:15.260576 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 16 20:46:15.260576 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 16 20:46:15.260576 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 16 20:46:15.260576 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 16 20:46:15.260576 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [parameters: {'id': '57df77afb6c04cc59e184561090f3262', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 16 20:46:15.260576 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 16 20:46:15.260576 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:15.260576 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:46:15.260576 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:15.260576 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:15.260576 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 16 20:46:15.262949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 16 20:46:15.262949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 16 20:46:15.262949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 16 20:46:15.262949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 16 20:46:15.262949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:15.262949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:46:15.262949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:15.262949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:15.262949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:15.262949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:15.262949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:15.262949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:15.262949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:15.262949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:15.262949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:15.262949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:15.262949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:15.265162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:15.265162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 16 20:46:15.265162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 16 20:46:15.265162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:15.265162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:15.265162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 16 20:46:15.265162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 16 20:46:15.265162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 57df77afb6c04cc59e184561090f3262. Jul 16 20:46:15.265162 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:15.265162 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 475/947] 10.222.0.16 () {60 vars in 1140 bytes} [Sat Jul 16 20:46:14 2022] POST /identity/v3/projects => generated 262 bytes in 271 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:15.265972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ae6fc-fb01-4f80-b32c-264fb1d5fd95 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:15.324093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:15.379800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ae6fc-fb01-4f80-b32c-264fb1d5fd95 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:15.419694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602cd1d-ee3b-414d-9378-ed7a6fbfbd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:15.420514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602cd1d-ee3b-414d-9378-ed7a6fbfbd8e None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:15.420794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602cd1d-ee3b-414d-9378-ed7a6fbfbd8e None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:15.421069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602cd1d-ee3b-414d-9378-ed7a6fbfbd8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:15.428439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602cd1d-ee3b-414d-9378-ed7a6fbfbd8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:15.429896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602cd1d-ee3b-414d-9378-ed7a6fbfbd8e None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:15.444465 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-7602cd1d-ee3b-414d-9378-ed7a6fbfbd8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:46:15.444465 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:15.444465 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:15.444465 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:15.444465 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:15.444465 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:15.444465 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:15.444465 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:15.444465 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:15.444465 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:15.444465 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:15.444465 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:15.444465 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:46:15.444465 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:46:15.444465 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:46:15.446564 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:46:15.446564 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:15.446564 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:15.446564 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:15.446564 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:15.446564 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:15.446564 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:15.446564 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:15.446564 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:15.446564 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:15.446564 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:15.446564 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:15.446564 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:15.446564 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:15.446564 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:15.446564 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:15.446564 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:15.447729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:46:15.447729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:46:15.447729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:46:15.447729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:46:15.447729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:46:15.447729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:46:15.447729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:46:15.447729 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:15.447729 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 473/948] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:46:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:15.452689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afded2-3349-4ff6-88e5-32b652b9d013 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:15.564461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afded2-3349-4ff6-88e5-32b652b9d013 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:15.604187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4654e1-900d-43de-b173-a1a300ce61c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:15.604880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4654e1-900d-43de-b173-a1a300ce61c7 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:15.605163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4654e1-900d-43de-b173-a1a300ce61c7 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:15.605440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4654e1-900d-43de-b173-a1a300ce61c7 None admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:15.606196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4654e1-900d-43de-b173-a1a300ce61c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:15.606503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4654e1-900d-43de-b173-a1a300ce61c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:15.608170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4654e1-900d-43de-b173-a1a300ce61c7 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:15.630839 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 476/949] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Jul 16 20:46:15 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:16.390305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4154de0-d2a8-4e4a-bc55-0b6db133e778 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:16.390967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4154de0-d2a8-4e4a-bc55-0b6db133e778 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:16.390967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4154de0-d2a8-4e4a-bc55-0b6db133e778 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:16.392967 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 474/950] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:16.398965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c2f4b-9a01-4a2a-be62-3453e61cc18e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:16.400053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c2f4b-9a01-4a2a-be62-3453e61cc18e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:16.400557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c2f4b-9a01-4a2a-be62-3453e61cc18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:16.419569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a97c2f4b-9a01-4a2a-be62-3453e61cc18e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:16.421545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a97c2f4b-9a01-4a2a-be62-3453e61cc18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:16.452138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:16.511208 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 477/951] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:16.529305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4154de0-d2a8-4e4a-bc55-0b6db133e778 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:16.619587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950713b-fdba-4dba-8230-e97817a6877f None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:16.619916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950713b-fdba-4dba-8230-e97817a6877f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:16.620171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950713b-fdba-4dba-8230-e97817a6877f None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:16.622658 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 478/952] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:46:16.627981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa76a5a-7716-4728-aa38-629428a8e559 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:16.628264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa76a5a-7716-4728-aa38-629428a8e559 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:16.628539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa76a5a-7716-4728-aa38-629428a8e559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:16.645872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4154de0-d2a8-4e4a-bc55-0b6db133e778 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:16.648048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-bfa76a5a-7716-4728-aa38-629428a8e559 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:16.649552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bfa76a5a-7716-4728-aa38-629428a8e559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:16.658946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:16.684567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dc41e-d01e-409a-9346-a8441d6332fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:16.685729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dc41e-d01e-409a-9346-a8441d6332fb None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:16.686237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dc41e-d01e-409a-9346-a8441d6332fb None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:16.686760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dc41e-d01e-409a-9346-a8441d6332fb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:16.687685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9dc41e-d01e-409a-9346-a8441d6332fb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:16.689264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9dc41e-d01e-409a-9346-a8441d6332fb None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:16.708321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-aa9dc41e-d01e-409a-9346-a8441d6332fb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 16 20:46:16.708321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:16.708321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:46:16.708321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:46:16.708321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:46:16.708321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:46:16.708321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:46:16.708321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:16.708321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 16 20:46:16.708321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:16.708321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:46:16.708321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:16.708321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:16.708321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:16.708321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:16.708321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:16.708321 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:16.709648 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:16.709648 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:16.709648 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:16.709648 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:16.709648 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:16.709648 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:16.709648 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:46:16.709648 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:46:16.709648 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:46:16.709648 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:46:16.709648 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:16.709648 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:16.709648 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:16.709648 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:16.709648 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:16.709648 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:16.710706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:16.710706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:16.710706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:16.710706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:16.710706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:16.710706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:16.710706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:16.710706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:16.710706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:16.710706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:16.710706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:46:16.710706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:16.710706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 16 20:46:16.710706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:16.718778 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 475/953] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Jul 16 20:46:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:16.720378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dc41e-d01e-409a-9346-a8441d6332fb None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:16.739309 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 479/954] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 16 20:46:16.758612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa76a5a-7716-4728-aa38-629428a8e559 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:16.854926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dc41e-d01e-409a-9346-a8441d6332fb None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:16.889696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:16.902374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566cdfc-3dcc-49d3-98f2-a0a6079bb85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:16.902374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566cdfc-3dcc-49d3-98f2-a0a6079bb85d None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:16.902374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566cdfc-3dcc-49d3-98f2-a0a6079bb85d None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:16.902374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566cdfc-3dcc-49d3-98f2-a0a6079bb85d None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:16.902772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566cdfc-3dcc-49d3-98f2-a0a6079bb85d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:16.903397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566cdfc-3dcc-49d3-98f2-a0a6079bb85d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:16.905090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566cdfc-3dcc-49d3-98f2-a0a6079bb85d None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:16.906871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa76a5a-7716-4728-aa38-629428a8e559 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:16.912401 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 476/955] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Jul 16 20:46:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:16.913716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa6142-fd16-4747-8566-66251ef52643 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:16.914000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa6142-fd16-4747-8566-66251ef52643 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:16.914275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa6142-fd16-4747-8566-66251ef52643 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:16.915622 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 477/956] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:16.918793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa6142-fd16-4747-8566-66251ef52643 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:16.952779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0de127-ca3e-48cb-b8cc-c3f5c7ba08e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:16.953716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0de127-ca3e-48cb-b8cc-c3f5c7ba08e0 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:16.953996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0de127-ca3e-48cb-b8cc-c3f5c7ba08e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:16.954270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0de127-ca3e-48cb-b8cc-c3f5c7ba08e0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:16.954920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0de127-ca3e-48cb-b8cc-c3f5c7ba08e0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:16.956333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0de127-ca3e-48cb-b8cc-c3f5c7ba08e0 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:16.969006 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-2f0de127-ca3e-48cb-b8cc-c3f5c7ba08e0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 16 20:46:16.969006 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:16.969006 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:46:16.969006 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:46:16.969006 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:46:16.969006 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:46:16.969006 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:46:16.969006 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:16.969006 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 16 20:46:16.969006 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:16.969006 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:46:16.969006 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:16.969006 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:16.969006 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:16.969006 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:16.969006 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:16.969006 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:16.970136 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:16.970136 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:16.970136 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:16.970136 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:16.970136 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:16.970136 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:16.970136 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:46:16.970136 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:46:16.970136 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:46:16.970136 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:46:16.970136 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:16.970136 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:16.970136 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:16.970136 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:16.970136 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:16.970136 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:16.970971 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:16.970971 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:16.970971 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:16.970971 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:16.970971 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:16.970971 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:16.970971 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:16.970971 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:16.970971 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:16.970971 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:16.970971 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:46:16.970971 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:16.970971 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 16 20:46:16.970971 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:16.970971 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 480/957] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:46:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:16.972354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139885ed-aae2-4b9d-91d5-7fca71aa62fc None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:16.972354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139885ed-aae2-4b9d-91d5-7fca71aa62fc None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:16.972354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139885ed-aae2-4b9d-91d5-7fca71aa62fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:16.973549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:16.989386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-139885ed-aae2-4b9d-91d5-7fca71aa62fc None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:16.990573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-139885ed-aae2-4b9d-91d5-7fca71aa62fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:17.047037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa6142-fd16-4747-8566-66251ef52643 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:17.073002 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 481/958] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:17.074766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139885ed-aae2-4b9d-91d5-7fca71aa62fc None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:17.101323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99291a62-e814-49fa-8a4b-e0c13a66c7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:17.102239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99291a62-e814-49fa-8a4b-e0c13a66c7b5 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:17.102672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99291a62-e814-49fa-8a4b-e0c13a66c7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:17.103129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99291a62-e814-49fa-8a4b-e0c13a66c7b5 None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:17.105101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99291a62-e814-49fa-8a4b-e0c13a66c7b5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:17.105949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99291a62-e814-49fa-8a4b-e0c13a66c7b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:17.107981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99291a62-e814-49fa-8a4b-e0c13a66c7b5 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:17.115559 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 478/959] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Jul 16 20:46:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:17.116779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99291a62-e814-49fa-8a4b-e0c13a66c7b5 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:17.169566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:17.188442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139885ed-aae2-4b9d-91d5-7fca71aa62fc None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:17.228062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506d88d-d1ff-49e7-a8b4-a5cfeda612ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:17.228730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506d88d-d1ff-49e7-a8b4-a5cfeda612ac None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:17.229008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506d88d-d1ff-49e7-a8b4-a5cfeda612ac None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:17.229285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506d88d-d1ff-49e7-a8b4-a5cfeda612ac None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:17.230576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506d88d-d1ff-49e7-a8b4-a5cfeda612ac None admin] RBAC: Adding query filter params (name=compute) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:17.230883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506d88d-d1ff-49e7-a8b4-a5cfeda612ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:17.232321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506d88d-d1ff-49e7-a8b4-a5cfeda612ac None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:17.237866 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 482/960] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Jul 16 20:46:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:17.238669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506d88d-d1ff-49e7-a8b4-a5cfeda612ac None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:17.261326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99291a62-e814-49fa-8a4b-e0c13a66c7b5 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:17.262997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:17.305466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26010070-5148-4730-8ec7-4f60002606fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:17.306456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26010070-5148-4730-8ec7-4f60002606fb None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:17.306741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26010070-5148-4730-8ec7-4f60002606fb None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:17.307038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26010070-5148-4730-8ec7-4f60002606fb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:17.320695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26010070-5148-4730-8ec7-4f60002606fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:46:17.329529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-26010070-5148-4730-8ec7-4f60002606fb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 16 20:46:17.329529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:17.329529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:17.329529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:17.329529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:17.329529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:17.329529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:17.329529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:17.329529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:17.329529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:17.329529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:17.329529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:17.329529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:46:17.329529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:46:17.329529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:46:17.329529 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:46:17.330599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:46:17.330599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:46:17.330599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:46:17.330599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:46:17.330599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:17.330599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:17.330599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:17.330599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:17.330599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:17.330599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:17.330599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:17.330599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:17.330599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:17.330599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:17.330599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:17.330599 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:17.331674 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:17.331674 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:17.331674 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:17.331674 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:17.331674 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:46:17.331674 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:46:17.331674 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:46:17.331674 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:46:17.331674 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:46:17.331674 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:46:17.331674 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 16 20:46:17.331674 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:17.331674 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 479/961] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Jul 16 20:46:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:17.332445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26010070-5148-4730-8ec7-4f60002606fb None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:17.365820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506d88d-d1ff-49e7-a8b4-a5cfeda612ac None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:17.419163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3905a-abc4-4f05-b928-3563e6d826d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:17.419985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3905a-abc4-4f05-b928-3563e6d826d3 None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:17.420244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3905a-abc4-4f05-b928-3563e6d826d3 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:17.420466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3905a-abc4-4f05-b928-3563e6d826d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:17.421206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3905a-abc4-4f05-b928-3563e6d826d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:17.422713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3905a-abc4-4f05-b928-3563e6d826d3 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:17.466173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26010070-5148-4730-8ec7-4f60002606fb None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:17.515043 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 483/962] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Jul 16 20:46:17 2022] POST /identity/v3/endpoints => generated 349 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:46:17.515043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3905a-abc4-4f05-b928-3563e6d826d3 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:17.518457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:17.523525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5457c-5306-4021-96e2-3da456911aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:17.524267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5457c-5306-4021-96e2-3da456911aba None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:17.524599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5457c-5306-4021-96e2-3da456911aba None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:17.524935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5457c-5306-4021-96e2-3da456911aba None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:17.525803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5457c-5306-4021-96e2-3da456911aba None admin] RBAC: Adding query filter params (type=compute) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:17.526120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5457c-5306-4021-96e2-3da456911aba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:17.528027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5457c-5306-4021-96e2-3da456911aba None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:17.533934 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 480/963] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Jul 16 20:46:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:17.650894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3905a-abc4-4f05-b928-3563e6d826d3 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:17.696944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8ef48-7931-4826-825f-53b9c8655fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:17.697911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ef48-7931-4826-825f-53b9c8655fa9 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:17.698373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ef48-7931-4826-825f-53b9c8655fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:17.698967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ef48-7931-4826-825f-53b9c8655fa9 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:17.700231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8ef48-7931-4826-825f-53b9c8655fa9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:17.700727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8ef48-7931-4826-825f-53b9c8655fa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:17.702323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8ef48-7931-4826-825f-53b9c8655fa9 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:17.712726 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 484/964] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Jul 16 20:46:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:17.720035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5457c-5306-4021-96e2-3da456911aba None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:17.751475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:17.850581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5457c-5306-4021-96e2-3da456911aba None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:17.892474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cad4f-f95e-44ef-8306-f489b7590940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:17.893290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cad4f-f95e-44ef-8306-f489b7590940 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:17.893571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cad4f-f95e-44ef-8306-f489b7590940 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:17.893849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cad4f-f95e-44ef-8306-f489b7590940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:17.906642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cad4f-f95e-44ef-8306-f489b7590940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:17.908173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cad4f-f95e-44ef-8306-f489b7590940 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:17.927422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-fa4cad4f-f95e-44ef-8306-f489b7590940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:17.927422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:17.927422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:17.927422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:17.927422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:17.927422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:17.927422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:17.927422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:17.927422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:17.927422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:17.927422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:17.927422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:17.927422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:46:17.927422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:46:17.927422 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:46:17.928371 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:46:17.928371 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:17.928371 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:17.928371 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:17.928371 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:17.928371 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:17.928371 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:17.928371 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:17.928371 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:17.928371 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:17.928371 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:17.928371 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:17.928371 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:17.928371 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:17.928371 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:17.928371 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:17.928371 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:17.929267 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:46:17.929267 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:46:17.929267 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:17.929267 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:17.929267 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 481/965] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:17.935390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8ef48-7931-4826-825f-53b9c8655fa9 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:18.014400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:18.044063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99b63-0736-4a0f-aa9a-2844e6366feb None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:18.044420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99b63-0736-4a0f-aa9a-2844e6366feb None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:18.044621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99b63-0736-4a0f-aa9a-2844e6366feb None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:18.046331 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 482/966] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:46:18.053554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a62f22-4317-4464-a473-6c323443eac0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:18.053971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a62f22-4317-4464-a473-6c323443eac0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:18.054348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a62f22-4317-4464-a473-6c323443eac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:18.054482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8ef48-7931-4826-825f-53b9c8655fa9 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:18.076093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-30a62f22-4317-4464-a473-6c323443eac0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:18.077445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-30a62f22-4317-4464-a473-6c323443eac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:18.118148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ddc99-d524-4a86-9a1d-5660e948c55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:18.119784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ddc99-d524-4a86-9a1d-5660e948c55a None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:18.120875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ddc99-d524-4a86-9a1d-5660e948c55a None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:18.121395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ddc99-d524-4a86-9a1d-5660e948c55a None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:18.123124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ddc99-d524-4a86-9a1d-5660e948c55a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:18.123821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ddc99-d524-4a86-9a1d-5660e948c55a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:18.125984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ddc99-d524-4a86-9a1d-5660e948c55a None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:18.154428 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 485/967] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:18.156434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ddc99-d524-4a86-9a1d-5660e948c55a None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:18.162122 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 483/968] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:18.196375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a62f22-4317-4464-a473-6c323443eac0 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:18.199761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:18.295118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ddc99-d524-4a86-9a1d-5660e948c55a None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:18.325566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:18.337086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38e878-fdec-453e-9991-7b80ae4dc9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:18.340043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38e878-fdec-453e-9991-7b80ae4dc9fc None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:18.340043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38e878-fdec-453e-9991-7b80ae4dc9fc None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:18.340043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38e878-fdec-453e-9991-7b80ae4dc9fc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:18.341645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a62f22-4317-4464-a473-6c323443eac0 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:18.346856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38e878-fdec-453e-9991-7b80ae4dc9fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:18.348361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38e878-fdec-453e-9991-7b80ae4dc9fc None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:18.367423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-0f38e878-fdec-453e-9991-7b80ae4dc9fc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 16 20:46:18.367423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:18.367423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:18.367423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:18.367423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:18.367423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:18.367423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:18.367423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:18.367423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:18.367423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:18.367423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:18.367423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:18.367423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:46:18.367423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:46:18.367423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:46:18.367423 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:46:18.368715 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:18.368715 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:18.368715 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:46:18.368715 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:46:18.368715 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:46:18.368715 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:46:18.368715 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:18.368715 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:18.368715 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:18.368715 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:18.368715 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:18.368715 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:18.368715 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:18.368715 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:18.368715 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:18.368715 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:18.368715 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:18.368715 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:18.369866 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:18.369866 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:18.369866 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:46:18.369866 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:46:18.369866 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:46:18.369866 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:46:18.369866 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:46:18.369866 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:46:18.369866 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 16 20:46:18.369866 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:18.374010 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 486/969] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Jul 16 20:46:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:18.375850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38e878-fdec-453e-9991-7b80ae4dc9fc None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:18.390267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b4f89-579a-405b-b347-e9ceb91f7e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:18.391393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b4f89-579a-405b-b347-e9ceb91f7e4c None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:18.391858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b4f89-579a-405b-b347-e9ceb91f7e4c None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:18.392740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b4f89-579a-405b-b347-e9ceb91f7e4c None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:18.394067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b4f89-579a-405b-b347-e9ceb91f7e4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:18.396517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b4f89-579a-405b-b347-e9ceb91f7e4c None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:18.398921 ncdv-master-1 devstack@keystone.service[98196]: WARNING keystone.server.flask.common [None req-f80b4f89-579a-405b-b347-e9ceb91f7e4c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 16 20:46:18.451557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.sql.core [None req-f80b4f89-579a-405b-b347-e9ceb91f7e4c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 16 20:46:18.451557 ncdv-master-1 devstack@keystone.service[98196]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 16 20:46:18.451557 ncdv-master-1 devstack@keystone.service[98196]: [parameters: {'user_id': '05190231c09b415284df3a8ec6de7881', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 16 20:46:18.451557 ncdv-master-1 devstack@keystone.service[98196]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98196) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 16 20:46:18.477484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-f80b4f89-579a-405b-b347-e9ceb91f7e4c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 16 20:46:18.477484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:18.477484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 16 20:46:18.477484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 16 20:46:18.477484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 16 20:46:18.477484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 16 20:46:18.477484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 16 20:46:18.477484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application result = self._query(query) Jul 16 20:46:18.477484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 16 20:46:18.477484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application conn.query(q) Jul 16 20:46:18.477484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 16 20:46:18.477484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 16 20:46:18.477484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 16 20:46:18.477484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application result.read() Jul 16 20:46:18.477484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 16 20:46:18.478881 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 16 20:46:18.478881 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 16 20:46:18.478881 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 16 20:46:18.478881 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 16 20:46:18.478881 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 16 20:46:18.478881 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 16 20:46:18.478881 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 16 20:46:18.478881 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 16 20:46:18.478881 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:18.478881 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 16 20:46:18.478881 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:18.478881 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:18.478881 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 16 20:46:18.478881 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 16 20:46:18.478881 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 16 20:46:18.478881 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 16 20:46:18.478881 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 16 20:46:18.478881 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application next(self.gen) Jul 16 20:46:18.480483 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 16 20:46:18.480483 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application yield resource Jul 16 20:46:18.480483 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 16 20:46:18.480483 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application next(self.gen) Jul 16 20:46:18.480483 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 16 20:46:18.480483 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self.session.rollback() Jul 16 20:46:18.480483 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 16 20:46:18.480483 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self.force_reraise() Jul 16 20:46:18.480483 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 16 20:46:18.480483 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise self.value Jul 16 20:46:18.480483 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 16 20:46:18.480483 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 16 20:46:18.480483 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 16 20:46:18.480483 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application session.commit() Jul 16 20:46:18.480483 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 16 20:46:18.480483 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 16 20:46:18.480483 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 16 20:46:18.481362 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._prepare_impl() Jul 16 20:46:18.481362 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 16 20:46:18.481362 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self.session.flush() Jul 16 20:46:18.481362 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 16 20:46:18.481362 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._flush(objects) Jul 16 20:46:18.481362 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 16 20:46:18.481362 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 16 20:46:18.481362 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 16 20:46:18.481362 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application compat.raise_( Jul 16 20:46:18.481362 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 16 20:46:18.481362 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception Jul 16 20:46:18.481362 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 16 20:46:18.481362 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application flush_context.execute() Jul 16 20:46:18.481362 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 16 20:46:18.481362 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rec.execute(self) Jul 16 20:46:18.481362 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 16 20:46:18.481362 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 16 20:46:18.483035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 16 20:46:18.483035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 16 20:46:18.483035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 16 20:46:18.483035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 16 20:46:18.483035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 16 20:46:18.483035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 16 20:46:18.483035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 16 20:46:18.483035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 16 20:46:18.483035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 16 20:46:18.483035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 16 20:46:18.483035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 16 20:46:18.483035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 16 20:46:18.483035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 16 20:46:18.483035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 16 20:46:18.483035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 16 20:46:18.483035 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception Jul 16 20:46:18.484199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 16 20:46:18.484199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 16 20:46:18.484199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 16 20:46:18.484199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 16 20:46:18.484199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 16 20:46:18.484199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application result = self._query(query) Jul 16 20:46:18.484199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 16 20:46:18.484199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application conn.query(q) Jul 16 20:46:18.484199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 16 20:46:18.484199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 16 20:46:18.484199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 16 20:46:18.484199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application result.read() Jul 16 20:46:18.484199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 16 20:46:18.484199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 16 20:46:18.484199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 16 20:46:18.484199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 16 20:46:18.485227 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 16 20:46:18.485227 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 16 20:46:18.485227 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 16 20:46:18.485227 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 16 20:46:18.485227 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 16 20:46:18.485227 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 16 20:46:18.485227 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [parameters: {'user_id': '05190231c09b415284df3a8ec6de7881', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 16 20:46:18.485227 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 16 20:46:18.485227 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:18.485227 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:46:18.485227 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:18.485227 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:18.485227 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:18.485227 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:18.485227 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:18.486201 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:18.486201 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:18.486201 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:18.486201 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:18.486201 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:18.486201 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:18.486201 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:18.486201 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 16 20:46:18.486201 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 16 20:46:18.486201 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:18.486201 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:18.486201 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:46:18.486201 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:46:18.486201 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:46:18.486201 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:46:18.486201 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 16 20:46:18.486201 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 16 20:46:18.489499 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 16 20:46:18.489499 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 16 20:46:18.489499 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 16 20:46:18.489499 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 16 20:46:18.489499 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 16 20:46:18.489499 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:18.490774 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 484/970] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Jul 16 20:46:18 2022] POST /identity/v3/users => generated 160 bytes in 295 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:46:18.496599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b4f89-579a-405b-b347-e9ceb91f7e4c None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:18.525926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38e878-fdec-453e-9991-7b80ae4dc9fc None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:18.575609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f574f50-91dc-4f87-93a9-57f998c39d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:18.576792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f574f50-91dc-4f87-93a9-57f998c39d50 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:18.577253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f574f50-91dc-4f87-93a9-57f998c39d50 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:18.577765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f574f50-91dc-4f87-93a9-57f998c39d50 None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:18.578789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f574f50-91dc-4f87-93a9-57f998c39d50 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:18.579320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f574f50-91dc-4f87-93a9-57f998c39d50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:18.581610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f574f50-91dc-4f87-93a9-57f998c39d50 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:18.584936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:18.608176 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 487/971] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Jul 16 20:46:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:18.609811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f574f50-91dc-4f87-93a9-57f998c39d50 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:18.624144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b4f89-579a-405b-b347-e9ceb91f7e4c None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:18.662691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1021de3-254d-4eff-9da2-56240f215584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:18.664111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1021de3-254d-4eff-9da2-56240f215584 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:18.665066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1021de3-254d-4eff-9da2-56240f215584 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:18.665444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:18.665564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1021de3-254d-4eff-9da2-56240f215584 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:18.674997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1021de3-254d-4eff-9da2-56240f215584 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:18.676946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1021de3-254d-4eff-9da2-56240f215584 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:18.694374 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-b1021de3-254d-4eff-9da2-56240f215584 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 16 20:46:18.694374 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:18.694374 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:18.694374 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:18.694374 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:18.694374 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:18.694374 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:18.694374 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:18.694374 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:18.694374 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:18.694374 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:18.694374 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:18.694374 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:46:18.694374 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:46:18.694374 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:46:18.694374 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:46:18.695447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:18.695447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:18.695447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:46:18.695447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:46:18.695447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:46:18.695447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:46:18.695447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:18.695447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:18.695447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:18.695447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:18.695447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:18.695447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:18.695447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:18.695447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:18.695447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:18.695447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:18.695447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:18.695447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:18.701674 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:18.701674 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:18.701674 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:46:18.701674 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:46:18.701674 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:46:18.701674 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:46:18.701674 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:46:18.701674 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:46:18.701674 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 16 20:46:18.701674 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:18.701674 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 485/972] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:46:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:18.706176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1021de3-254d-4eff-9da2-56240f215584 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:18.746791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f574f50-91dc-4f87-93a9-57f998c39d50 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:18.795658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294db59-f2d2-4e70-8b4f-37f48a4f3035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:18.796995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294db59-f2d2-4e70-8b4f-37f48a4f3035 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:18.797289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294db59-f2d2-4e70-8b4f-37f48a4f3035 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:18.797566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294db59-f2d2-4e70-8b4f-37f48a4f3035 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:18.882095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294db59-f2d2-4e70-8b4f-37f48a4f3035 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:18.883778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294db59-f2d2-4e70-8b4f-37f48a4f3035 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:18.884857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1021de3-254d-4eff-9da2-56240f215584 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:18.929171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:18.933794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:18.949865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef38f2a-5008-4b5f-966f-a676d22e3c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:18.951028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef38f2a-5008-4b5f-966f-a676d22e3c48 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:18.951548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef38f2a-5008-4b5f-966f-a676d22e3c48 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:18.951897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef38f2a-5008-4b5f-966f-a676d22e3c48 None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:18.953451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef38f2a-5008-4b5f-966f-a676d22e3c48 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:18.954015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef38f2a-5008-4b5f-966f-a676d22e3c48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:18.956700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef38f2a-5008-4b5f-966f-a676d22e3c48 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:19.002190 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 488/973] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:46:18 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 16 20:46:19.003679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294db59-f2d2-4e70-8b4f-37f48a4f3035 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:19.030704 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 486/974] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Jul 16 20:46:18 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:19.139674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294db59-f2d2-4e70-8b4f-37f48a4f3035 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:19.179963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736b635-1b98-4dab-bc64-072cb5c6a70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:19.180787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736b635-1b98-4dab-bc64-072cb5c6a70a None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:19.181063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736b635-1b98-4dab-bc64-072cb5c6a70a None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:19.181342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736b635-1b98-4dab-bc64-072cb5c6a70a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:19.194192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736b635-1b98-4dab-bc64-072cb5c6a70a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:19.195827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736b635-1b98-4dab-bc64-072cb5c6a70a None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:19.197955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:19.217881 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-c736b635-1b98-4dab-bc64-072cb5c6a70a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:19.217881 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:19.217881 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:19.217881 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:19.217881 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:19.217881 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:19.217881 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:19.217881 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:19.217881 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:19.217881 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:19.217881 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:19.217881 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:19.217881 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:46:19.217881 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:46:19.217881 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:46:19.218862 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:46:19.218862 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:19.218862 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:19.218862 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:19.218862 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:19.218862 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:19.218862 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:19.218862 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:19.218862 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:19.218862 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:19.218862 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:19.218862 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:19.218862 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:19.218862 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:19.218862 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:19.218862 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:19.218862 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:19.219810 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:46:19.219810 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:46:19.219810 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:19.219810 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:19.223171 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 489/975] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:46:19.225527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef38f2a-5008-4b5f-966f-a676d22e3c48 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:19.348941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef38f2a-5008-4b5f-966f-a676d22e3c48 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:19.389934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206a584-8b8d-426c-bcbb-2c123cbefebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:19.390497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206a584-8b8d-426c-bcbb-2c123cbefebf None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:19.390764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206a584-8b8d-426c-bcbb-2c123cbefebf None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:19.391105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206a584-8b8d-426c-bcbb-2c123cbefebf None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:19.391922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206a584-8b8d-426c-bcbb-2c123cbefebf None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:19.392223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206a584-8b8d-426c-bcbb-2c123cbefebf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:19.393802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206a584-8b8d-426c-bcbb-2c123cbefebf None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:19.413381 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 487/976] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:19.414651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736b635-1b98-4dab-bc64-072cb5c6a70a None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:19.525138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736b635-1b98-4dab-bc64-072cb5c6a70a None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:19.583145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd6e43-b3bd-4710-9737-23fc445bbb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:19.584182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd6e43-b3bd-4710-9737-23fc445bbb1a None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:19.584470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd6e43-b3bd-4710-9737-23fc445bbb1a None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:19.584802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd6e43-b3bd-4710-9737-23fc445bbb1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:19.593035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd6e43-b3bd-4710-9737-23fc445bbb1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:19.594474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd6e43-b3bd-4710-9737-23fc445bbb1a None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:19.609133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-58cd6e43-b3bd-4710-9737-23fc445bbb1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:46:19.609133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:19.609133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:19.609133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:19.609133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:19.609133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:19.609133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:19.609133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:19.609133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:19.609133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:19.609133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:19.609133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:19.609133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:46:19.609133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:46:19.609133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:46:19.610155 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:46:19.610155 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:19.610155 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:19.610155 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:19.610155 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:19.610155 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:19.610155 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:19.610155 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:19.610155 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:19.610155 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:19.610155 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:19.610155 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:19.610155 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:19.610155 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:19.610155 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:19.610155 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:19.610155 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:19.615688 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:46:19.615688 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:46:19.615688 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:46:19.615688 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:46:19.615688 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:46:19.615688 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:46:19.615688 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:46:19.615688 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:19.615688 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 490/977] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:46:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:19.618191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206a584-8b8d-426c-bcbb-2c123cbefebf None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:19.668994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:19.725531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206a584-8b8d-426c-bcbb-2c123cbefebf None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:19.784691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2c11b-a91e-4236-a123-6a16d5ef4d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:19.785375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2c11b-a91e-4236-a123-6a16d5ef4d8f None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:19.785708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2c11b-a91e-4236-a123-6a16d5ef4d8f None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:19.785936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2c11b-a91e-4236-a123-6a16d5ef4d8f None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:19.786770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2c11b-a91e-4236-a123-6a16d5ef4d8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:19.787207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2c11b-a91e-4236-a123-6a16d5ef4d8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:19.788767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2c11b-a91e-4236-a123-6a16d5ef4d8f None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:19.805099 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 488/978] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:46:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:19.812510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd6e43-b3bd-4710-9737-23fc445bbb1a None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:19.883615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:19.937690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd6e43-b3bd-4710-9737-23fc445bbb1a None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:19.968384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b80b21-c02d-4f39-ab97-304b63c05d7f None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:19.968693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b80b21-c02d-4f39-ab97-304b63c05d7f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:19.968938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b80b21-c02d-4f39-ab97-304b63c05d7f None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:19.970305 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 489/979] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:46:19.975552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402609b-b12d-4b0a-bd4f-50c9cfb14eaa None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:19.975992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402609b-b12d-4b0a-bd4f-50c9cfb14eaa None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:19.976405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402609b-b12d-4b0a-bd4f-50c9cfb14eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:19.979238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111186d8-fc07-4f74-96ac-c6309bc60f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:19.980173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111186d8-fc07-4f74-96ac-c6309bc60f24 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:19.980481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111186d8-fc07-4f74-96ac-c6309bc60f24 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:19.980726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111186d8-fc07-4f74-96ac-c6309bc60f24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:19.981965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111186d8-fc07-4f74-96ac-c6309bc60f24 None admin] RBAC: Adding query filter params (role.id=b7c95212d9564da9ba2366086bf22e5d, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=2b154ad257954b53a13730b4a9f60570) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:19.982280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111186d8-fc07-4f74-96ac-c6309bc60f24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:19.984944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111186d8-fc07-4f74-96ac-c6309bc60f24 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:19.999078 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 491/980] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:46:19 2022] GET /identity/v3/role_assignments?user.id=2b154ad257954b53a13730b4a9f60570&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=b7c95212d9564da9ba2366086bf22e5d => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:19.999322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2402609b-b12d-4b0a-bd4f-50c9cfb14eaa None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:19.999322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2402609b-b12d-4b0a-bd4f-50c9cfb14eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:20.087332 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 490/981] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 16 20:46:20.110980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111186d8-fc07-4f74-96ac-c6309bc60f24 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:20.157709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c786b-4626-4d2d-9201-2b3966b9fb42 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:20.158058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c786b-4626-4d2d-9201-2b3966b9fb42 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:20.158317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c786b-4626-4d2d-9201-2b3966b9fb42 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:20.159958 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 491/982] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:46:20.165678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89968245-87dc-402f-aa06-ae793cce5cb1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:20.165970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89968245-87dc-402f-aa06-ae793cce5cb1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:20.166244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89968245-87dc-402f-aa06-ae793cce5cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:20.186609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-89968245-87dc-402f-aa06-ae793cce5cb1 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:20.187910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-89968245-87dc-402f-aa06-ae793cce5cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:20.222378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:20.235176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111186d8-fc07-4f74-96ac-c6309bc60f24 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:20.256146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:20.273859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0c2c4-8e10-4fca-a41e-5c1863fcb702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:20.274527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0c2c4-8e10-4fca-a41e-5c1863fcb702 None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:20.279219 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 492/983] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 16 20:46:20.279358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0c2c4-8e10-4fca-a41e-5c1863fcb702 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:20.279358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0c2c4-8e10-4fca-a41e-5c1863fcb702 None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:20.279358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0c2c4-8e10-4fca-a41e-5c1863fcb702 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:20.279358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0c2c4-8e10-4fca-a41e-5c1863fcb702 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:20.300230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89968245-87dc-402f-aa06-ae793cce5cb1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:20.361664 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 492/984] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Jul 16 20:46:20 2022] POST /identity/v3/services => generated 242 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:46:20.421228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89968245-87dc-402f-aa06-ae793cce5cb1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:20.478187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a8e64-be1e-4a86-9eb3-6a5b3a08467d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:20.478970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a8e64-be1e-4a86-9eb3-6a5b3a08467d None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:20.479261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a8e64-be1e-4a86-9eb3-6a5b3a08467d None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:20.479653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a8e64-be1e-4a86-9eb3-6a5b3a08467d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:20.481016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a8e64-be1e-4a86-9eb3-6a5b3a08467d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:20.482435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a8e64-be1e-4a86-9eb3-6a5b3a08467d None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:20.496388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-b77a8e64-be1e-4a86-9eb3-6a5b3a08467d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 16 20:46:20.496388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:20.496388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:46:20.496388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:46:20.496388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:46:20.496388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:46:20.496388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:46:20.496388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:20.496388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 16 20:46:20.496388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:20.496388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:46:20.496388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:20.496388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:20.496388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:20.496388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:20.496388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:20.496388 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:20.497569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:20.497569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:20.497569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:20.497569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:20.497569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:20.497569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:20.497569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:46:20.497569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:46:20.497569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:46:20.497569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:46:20.497569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:20.497569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:20.497569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:20.497569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:20.497569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:20.497569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:20.505019 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:20.505019 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:20.505019 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:20.505019 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:20.505019 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:20.505019 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:20.505019 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:20.505019 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:20.505019 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:20.505019 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:20.505019 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:46:20.505019 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:20.505019 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 16 20:46:20.505019 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:20.505019 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 493/985] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Jul 16 20:46:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:46:20.508127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0c2c4-8e10-4fca-a41e-5c1863fcb702 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:20.621323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0c2c4-8e10-4fca-a41e-5c1863fcb702 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:20.658885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e24b20-4084-4874-b9db-1b42baf815dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:20.659597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e24b20-4084-4874-b9db-1b42baf815dd None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:20.659876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e24b20-4084-4874-b9db-1b42baf815dd None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:20.660149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e24b20-4084-4874-b9db-1b42baf815dd None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:20.660866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e24b20-4084-4874-b9db-1b42baf815dd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:20.661173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e24b20-4084-4874-b9db-1b42baf815dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:20.662550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e24b20-4084-4874-b9db-1b42baf815dd None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:20.669916 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 493/986] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Jul 16 20:46:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:20.675955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a8e64-be1e-4a86-9eb3-6a5b3a08467d None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:20.704964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:20.788673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a8e64-be1e-4a86-9eb3-6a5b3a08467d None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:20.828760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f959f-2692-49d4-b8a4-838d4a31feb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:20.829432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f959f-2692-49d4-b8a4-838d4a31feb5 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:20.829758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f959f-2692-49d4-b8a4-838d4a31feb5 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:20.830018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f959f-2692-49d4-b8a4-838d4a31feb5 None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:20.830687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f959f-2692-49d4-b8a4-838d4a31feb5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:20.830994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f959f-2692-49d4-b8a4-838d4a31feb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:20.832385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f959f-2692-49d4-b8a4-838d4a31feb5 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:20.838233 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 494/987] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Jul 16 20:46:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:20.845062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e24b20-4084-4874-b9db-1b42baf815dd None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:20.900395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:20.962497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e24b20-4084-4874-b9db-1b42baf815dd None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:21.001410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3a385-bffd-4dcd-a27e-b5cf2a625c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:21.002070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3a385-bffd-4dcd-a27e-b5cf2a625c80 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:21.002359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3a385-bffd-4dcd-a27e-b5cf2a625c80 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:21.002632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3a385-bffd-4dcd-a27e-b5cf2a625c80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:21.003854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3a385-bffd-4dcd-a27e-b5cf2a625c80 None admin] RBAC: Adding query filter params (interface=admin, service_id=59f41423173f4933b06c156190d73677, region_id=RegionOne) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:21.003854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3a385-bffd-4dcd-a27e-b5cf2a625c80 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:21.005204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3a385-bffd-4dcd-a27e-b5cf2a625c80 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:21.010777 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 494/988] 10.222.0.16 () {56 vars in 1249 bytes} [Sat Jul 16 20:46:20 2022] GET /identity/v3/endpoints?service_id=59f41423173f4933b06c156190d73677&interface=admin®ion_id=RegionOne => generated 193 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:21.016394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f959f-2692-49d4-b8a4-838d4a31feb5 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:21.116094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:21.129531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f959f-2692-49d4-b8a4-838d4a31feb5 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:21.165679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3c3cd-7784-4c7c-8456-65f3bf3ef02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:21.166870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3c3cd-7784-4c7c-8456-65f3bf3ef02a None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:21.167307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3c3cd-7784-4c7c-8456-65f3bf3ef02a None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:21.167783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3c3cd-7784-4c7c-8456-65f3bf3ef02a None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:21.168960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca3c3cd-7784-4c7c-8456-65f3bf3ef02a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:21.169991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca3c3cd-7784-4c7c-8456-65f3bf3ef02a None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:21.183085 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 495/989] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Jul 16 20:46:21 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 20:46:22.427952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d261f9c-2d8e-486b-954f-a604f65859f6 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:22.428517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d261f9c-2d8e-486b-954f-a604f65859f6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:22.428517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d261f9c-2d8e-486b-954f-a604f65859f6 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:22.430386 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 495/990] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:22.436552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec1a08-637a-41e5-9927-0bac8c26bbf8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:22.437109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec1a08-637a-41e5-9927-0bac8c26bbf8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:22.437109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec1a08-637a-41e5-9927-0bac8c26bbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:22.455583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-dbec1a08-637a-41e5-9927-0bac8c26bbf8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:22.456800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dbec1a08-637a-41e5-9927-0bac8c26bbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:22.552066 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 496/991] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:22.576946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d261f9c-2d8e-486b-954f-a604f65859f6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:22.675381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaad6b8-95bc-4d8c-82f1-a6aa01734e78 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:22.675672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaad6b8-95bc-4d8c-82f1-a6aa01734e78 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:22.675946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaad6b8-95bc-4d8c-82f1-a6aa01734e78 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:22.677329 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 497/992] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:46:22.683576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0348d-5060-4bc6-890c-c861460c05b5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:22.683778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0348d-5060-4bc6-890c-c861460c05b5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:22.684071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0348d-5060-4bc6-890c-c861460c05b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:22.700283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d261f9c-2d8e-486b-954f-a604f65859f6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:22.701874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1cd0348d-5060-4bc6-890c-c861460c05b5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:22.703066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1cd0348d-5060-4bc6-890c-c861460c05b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:22.709611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:22.748406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fbc81-b28e-4091-9f62-076880d559f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:22.749813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fbc81-b28e-4091-9f62-076880d559f2 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:22.750253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fbc81-b28e-4091-9f62-076880d559f2 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:22.750676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fbc81-b28e-4091-9f62-076880d559f2 None admin] PATH_INFO: `/v3/services/image` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:22.751790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fbc81-b28e-4091-9f62-076880d559f2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:22.753206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fbc81-b28e-4091-9f62-076880d559f2 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:22.766232 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-710fbc81-b28e-4091-9f62-076880d559f2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 16 20:46:22.766232 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:22.766232 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:46:22.766232 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:46:22.766232 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:46:22.766232 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:46:22.766232 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:46:22.766232 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:22.766232 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 16 20:46:22.766232 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:22.766232 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:46:22.766232 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:22.766232 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:22.766232 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:22.766232 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:22.766232 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:22.766232 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:22.767370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:22.767370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:22.767370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:22.767370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:22.767370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:22.767370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:22.767370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:46:22.767370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:46:22.767370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:46:22.767370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:46:22.767370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:22.767370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:22.767370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:22.767370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:22.767370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:22.767370 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:22.768188 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:22.768188 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:22.768188 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:22.768188 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:22.768188 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:22.768188 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:22.768188 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:22.768188 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:22.768188 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:22.768188 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:22.768188 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:46:22.768188 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:22.768188 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 16 20:46:22.768188 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:22.768188 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 496/993] 10.222.0.16 () {56 vars in 1105 bytes} [Sat Jul 16 20:46:22 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:46:22.775620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fbc81-b28e-4091-9f62-076880d559f2 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:22.788497 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 498/994] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 16 20:46:22.813115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0348d-5060-4bc6-890c-c861460c05b5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:22.831912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:22.891109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fbc81-b28e-4091-9f62-076880d559f2 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:22.943861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0348d-5060-4bc6-890c-c861460c05b5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:22.951567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c4110-852a-48ad-a15b-0e81f650a4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:22.952259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c4110-852a-48ad-a15b-0e81f650a4e6 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:22.952597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c4110-852a-48ad-a15b-0e81f650a4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:22.952910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c4110-852a-48ad-a15b-0e81f650a4e6 None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:22.953712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c4110-852a-48ad-a15b-0e81f650a4e6 None admin] RBAC: Adding query filter params (name=image) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:22.954020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c4110-852a-48ad-a15b-0e81f650a4e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:22.955413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c4110-852a-48ad-a15b-0e81f650a4e6 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:22.961213 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 497/995] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:22.969437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c4110-852a-48ad-a15b-0e81f650a4e6 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:22.992283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05ddd4-fad4-4969-84be-cc5fe3c3a4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:22.993246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05ddd4-fad4-4969-84be-cc5fe3c3a4ed None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:22.993529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05ddd4-fad4-4969-84be-cc5fe3c3a4ed None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:22.993811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05ddd4-fad4-4969-84be-cc5fe3c3a4ed None admin] PATH_INFO: `/v3/services/compute` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:22.994467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05ddd4-fad4-4969-84be-cc5fe3c3a4ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:22.996007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05ddd4-fad4-4969-84be-cc5fe3c3a4ed None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:23.008827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-ce05ddd4-fad4-4969-84be-cc5fe3c3a4ed None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 16 20:46:23.008827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:23.008827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:46:23.008827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:46:23.008827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:46:23.008827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:46:23.008827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:46:23.008827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:23.008827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 16 20:46:23.008827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:23.008827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:46:23.008827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:23.008827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:23.008827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:23.008827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:23.008827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:23.008827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:23.010097 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:23.010097 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:23.010097 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:23.010097 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:23.010097 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:23.010097 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:23.010097 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:46:23.010097 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:46:23.010097 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:46:23.010097 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:46:23.010097 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:23.010097 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:23.010097 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:23.010097 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:23.010097 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:23.010097 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:23.010976 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:23.010976 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:23.010976 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:23.010976 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:23.010976 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:23.010976 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:23.010976 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:23.010976 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:23.010976 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:23.010976 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:23.010976 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:46:23.010976 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:23.010976 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 16 20:46:23.010976 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:23.010976 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 499/996] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:46:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:46:23.022778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05ddd4-fad4-4969-84be-cc5fe3c3a4ed None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:23.023739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:23.102844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c4110-852a-48ad-a15b-0e81f650a4e6 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:23.112039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:23.140205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05ddd4-fad4-4969-84be-cc5fe3c3a4ed None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:23.142818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f98cd-71ff-4e2d-8612-e1185ea02004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:23.143551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f98cd-71ff-4e2d-8612-e1185ea02004 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:23.143831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f98cd-71ff-4e2d-8612-e1185ea02004 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:23.144143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f98cd-71ff-4e2d-8612-e1185ea02004 None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:23.144854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f98cd-71ff-4e2d-8612-e1185ea02004 None admin] RBAC: Adding query filter params (type=image) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:23.145153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f98cd-71ff-4e2d-8612-e1185ea02004 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:23.146525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f98cd-71ff-4e2d-8612-e1185ea02004 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:23.163047 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 498/997] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:22 2022] GET /identity/v3/services?type=image => generated 122 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:23.200363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab766ea-26eb-4e9b-b3a9-0e2936e5fefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:23.200966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab766ea-26eb-4e9b-b3a9-0e2936e5fefa None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:23.201252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab766ea-26eb-4e9b-b3a9-0e2936e5fefa None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:23.201531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab766ea-26eb-4e9b-b3a9-0e2936e5fefa None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:23.202253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab766ea-26eb-4e9b-b3a9-0e2936e5fefa None admin] RBAC: Adding query filter params (name=compute) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:23.202561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab766ea-26eb-4e9b-b3a9-0e2936e5fefa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:23.204006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab766ea-26eb-4e9b-b3a9-0e2936e5fefa None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:23.210204 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 500/998] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Jul 16 20:46:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:23.217586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f98cd-71ff-4e2d-8612-e1185ea02004 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:23.336080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:23.342527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f98cd-71ff-4e2d-8612-e1185ea02004 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:23.391931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea69e9c-c2f4-49f4-ae3e-ad59de750d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:23.393083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea69e9c-c2f4-49f4-ae3e-ad59de750d34 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:23.393583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea69e9c-c2f4-49f4-ae3e-ad59de750d34 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:23.394068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea69e9c-c2f4-49f4-ae3e-ad59de750d34 None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:23.395432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea69e9c-c2f4-49f4-ae3e-ad59de750d34 None admin] RBAC: Adding query filter params (type=compute) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:23.396479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea69e9c-c2f4-49f4-ae3e-ad59de750d34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:23.398126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea69e9c-c2f4-49f4-ae3e-ad59de750d34 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:23.404369 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 499/999] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Jul 16 20:46:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:23.410504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab766ea-26eb-4e9b-b3a9-0e2936e5fefa None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:23.525066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b33e3-0f3e-4967-b0d7-cbdac74b7681 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:23.525632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b33e3-0f3e-4967-b0d7-cbdac74b7681 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:23.525632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b33e3-0f3e-4967-b0d7-cbdac74b7681 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:23.527176 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 500/1000] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:46:23.532429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e183fb8-ca49-41d9-85bd-32453267cb9a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:23.532722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e183fb8-ca49-41d9-85bd-32453267cb9a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:23.533004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e183fb8-ca49-41d9-85bd-32453267cb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:23.544844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab766ea-26eb-4e9b-b3a9-0e2936e5fefa None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:23.550980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6e183fb8-ca49-41d9-85bd-32453267cb9a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:23.552205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6e183fb8-ca49-41d9-85bd-32453267cb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:23.595929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d88372-15dd-436c-bab0-c827d52d47d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:23.596632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d88372-15dd-436c-bab0-c827d52d47d7 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:23.596915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d88372-15dd-436c-bab0-c827d52d47d7 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:23.597215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d88372-15dd-436c-bab0-c827d52d47d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:23.598012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d88372-15dd-436c-bab0-c827d52d47d7 None admin] RBAC: Adding query filter params (interface=public, service_id=a87a7203ecec4c749aade75f00349712, region_id=RegionOne) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:23.598325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d88372-15dd-436c-bab0-c827d52d47d7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:23.599763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d88372-15dd-436c-bab0-c827d52d47d7 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:23.606532 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 501/1001] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Jul 16 20:46:23 2022] GET /identity/v3/endpoints?service_id=a87a7203ecec4c749aade75f00349712&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:23.613093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d88372-15dd-436c-bab0-c827d52d47d7 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:23.618311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:23.633083 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 501/1002] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 16 20:46:23.658092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e183fb8-ca49-41d9-85bd-32453267cb9a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:23.732186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d88372-15dd-436c-bab0-c827d52d47d7 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:23.762538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:23.777467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e183fb8-ca49-41d9-85bd-32453267cb9a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:23.785252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f779bb0-7c94-44a7-8735-d78cee272a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:23.785937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f779bb0-7c94-44a7-8735-d78cee272a21 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:23.786274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f779bb0-7c94-44a7-8735-d78cee272a21 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:23.786616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f779bb0-7c94-44a7-8735-d78cee272a21 None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:23.787438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f779bb0-7c94-44a7-8735-d78cee272a21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:23.788853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f779bb0-7c94-44a7-8735-d78cee272a21 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:23.797682 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 502/1003] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Jul 16 20:46:23 2022] GET /identity/v3/services => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 20:46:23.826610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e7fa2-7e68-4d8e-ba57-8542ec9b8742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:23.827886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e7fa2-7e68-4d8e-ba57-8542ec9b8742 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:23.828369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e7fa2-7e68-4d8e-ba57-8542ec9b8742 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:23.828824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e7fa2-7e68-4d8e-ba57-8542ec9b8742 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:23.829683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e7fa2-7e68-4d8e-ba57-8542ec9b8742 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:23.831322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e7fa2-7e68-4d8e-ba57-8542ec9b8742 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:23.850887 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-188e7fa2-7e68-4d8e-ba57-8542ec9b8742 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 16 20:46:23.850887 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:23.850887 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:46:23.850887 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:46:23.850887 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:46:23.850887 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:46:23.850887 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:46:23.850887 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:23.850887 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 16 20:46:23.850887 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:23.850887 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:46:23.850887 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:23.850887 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:23.850887 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:23.850887 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:23.850887 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:23.850887 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:23.852030 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:23.852030 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:23.852030 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:23.852030 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:23.852030 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:23.852030 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:23.852030 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:46:23.852030 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:46:23.852030 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:46:23.852030 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:46:23.852030 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:23.852030 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:23.852030 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:23.852030 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:23.852030 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:23.852030 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:23.858695 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:23.858695 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:23.858695 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:23.858695 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:23.858695 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:23.858695 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:23.858695 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:23.858695 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:23.858695 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:23.858695 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:23.858695 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:46:23.858695 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:23.858695 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 16 20:46:23.858695 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:23.858695 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 502/1004] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Jul 16 20:46:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:46:23.861600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f779bb0-7c94-44a7-8735-d78cee272a21 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:23.946354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:23.992281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f779bb0-7c94-44a7-8735-d78cee272a21 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:24.031923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a724d8-880a-4c86-b9f2-16d359207551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:24.032669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a724d8-880a-4c86-b9f2-16d359207551 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:24.032913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a724d8-880a-4c86-b9f2-16d359207551 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:24.033145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a724d8-880a-4c86-b9f2-16d359207551 None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:24.033844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a724d8-880a-4c86-b9f2-16d359207551 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:24.034153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a724d8-880a-4c86-b9f2-16d359207551 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:24.035573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a724d8-880a-4c86-b9f2-16d359207551 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:24.041406 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 503/1005] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Jul 16 20:46:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:24.048024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e7fa2-7e68-4d8e-ba57-8542ec9b8742 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:24.167254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e7fa2-7e68-4d8e-ba57-8542ec9b8742 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:24.208975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333abba-661c-4ee1-a43a-a27e322d2604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:24.209826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333abba-661c-4ee1-a43a-a27e322d2604 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:24.210233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333abba-661c-4ee1-a43a-a27e322d2604 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:24.210802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333abba-661c-4ee1-a43a-a27e322d2604 None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:24.211701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333abba-661c-4ee1-a43a-a27e322d2604 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:24.212134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333abba-661c-4ee1-a43a-a27e322d2604 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:24.214360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333abba-661c-4ee1-a43a-a27e322d2604 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:24.221038 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 503/1006] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Jul 16 20:46:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:24.227555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a724d8-880a-4c86-b9f2-16d359207551 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:24.355036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a724d8-880a-4c86-b9f2-16d359207551 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:24.390013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:24.398824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609989c-5ad4-449a-a81e-337d59d36803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:24.399968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609989c-5ad4-449a-a81e-337d59d36803 None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:24.406543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609989c-5ad4-449a-a81e-337d59d36803 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:24.406543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609989c-5ad4-449a-a81e-337d59d36803 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:24.406543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609989c-5ad4-449a-a81e-337d59d36803 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:24.406543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609989c-5ad4-449a-a81e-337d59d36803 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:24.499115 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 504/1007] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Jul 16 20:46:24 2022] POST /identity/v3/endpoints => generated 325 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 20:46:25.504890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3af395-d1ab-410f-bcec-7caf985d250a None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:25.505423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3af395-d1ab-410f-bcec-7caf985d250a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:25.505423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3af395-d1ab-410f-bcec-7caf985d250a None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:25.506864 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 504/1008] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:25.512483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d946c4b-fcbe-48c4-b7ca-a64508c2436f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:25.512961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d946c4b-fcbe-48c4-b7ca-a64508c2436f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:25.513061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d946c4b-fcbe-48c4-b7ca-a64508c2436f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:25.531822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3d946c4b-fcbe-48c4-b7ca-a64508c2436f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:25.533049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3d946c4b-fcbe-48c4-b7ca-a64508c2436f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:25.615030 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 505/1009] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:25 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 16 20:46:25.640696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3af395-d1ab-410f-bcec-7caf985d250a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:25.664758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:25.752964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3af395-d1ab-410f-bcec-7caf985d250a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:25.790750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae271b5-4dea-46cd-a156-9728f1016b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:25.791355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae271b5-4dea-46cd-a156-9728f1016b50 None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:25.791671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae271b5-4dea-46cd-a156-9728f1016b50 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:25.791949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae271b5-4dea-46cd-a156-9728f1016b50 None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:25.792719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae271b5-4dea-46cd-a156-9728f1016b50 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:25.794132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae271b5-4dea-46cd-a156-9728f1016b50 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:25.901795 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 505/1010] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Jul 16 20:46:25 2022] POST /identity/v3/services => generated 242 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:46:26.180279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14534d-f5b5-4a34-ace0-8ff2a46c3c6f None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:26.180562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14534d-f5b5-4a34-ace0-8ff2a46c3c6f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:26.180980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14534d-f5b5-4a34-ace0-8ff2a46c3c6f None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:26.183269 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 506/1011] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:26.190495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4ea35-5fc3-4366-b27f-3c075507fbad None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:26.191249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4ea35-5fc3-4366-b27f-3c075507fbad None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:26.191792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4ea35-5fc3-4366-b27f-3c075507fbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:26.211451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ccd4ea35-5fc3-4366-b27f-3c075507fbad None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:26.213071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ccd4ea35-5fc3-4366-b27f-3c075507fbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:26.302663 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 506/1012] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:26 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:26.327976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14534d-f5b5-4a34-ace0-8ff2a46c3c6f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:26.451672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14534d-f5b5-4a34-ace0-8ff2a46c3c6f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:26.469666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:26.488282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d94e89-c833-4a67-999c-939b038043c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:26.489082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d94e89-c833-4a67-999c-939b038043c8 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:26.489367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d94e89-c833-4a67-999c-939b038043c8 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:26.489638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d94e89-c833-4a67-999c-939b038043c8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:26.490305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d94e89-c833-4a67-999c-939b038043c8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:26.491690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d94e89-c833-4a67-999c-939b038043c8 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:26.504351 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-61d94e89-c833-4a67-999c-939b038043c8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 16 20:46:26.504351 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:26.504351 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:46:26.504351 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:46:26.504351 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:46:26.504351 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:46:26.504351 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:46:26.504351 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:26.504351 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 16 20:46:26.504351 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:26.504351 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:46:26.504351 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:26.504351 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:26.504351 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:26.504351 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:26.504351 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:26.504351 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:26.505454 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:26.505454 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:26.505454 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:26.505454 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:26.505454 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:26.505454 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:26.505454 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:46:26.505454 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:46:26.505454 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:46:26.505454 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:46:26.505454 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:26.505454 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:26.505454 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:26.505454 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:26.505454 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:26.505454 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:26.506338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:26.506338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:26.506338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:26.506338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:26.506338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:26.506338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:26.506338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:26.506338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:26.506338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:26.506338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:26.506338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:46:26.506338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:26.506338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 16 20:46:26.506338 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:26.513918 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 507/1013] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:46:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:26.514511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4ea35-5fc3-4366-b27f-3c075507fbad None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:26.521510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:26.632459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4ea35-5fc3-4366-b27f-3c075507fbad None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:26.673253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1915eb4-7853-4029-98ae-59334cae94a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:26.674907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1915eb4-7853-4029-98ae-59334cae94a6 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:26.675427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1915eb4-7853-4029-98ae-59334cae94a6 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:26.675855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1915eb4-7853-4029-98ae-59334cae94a6 None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:26.676763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1915eb4-7853-4029-98ae-59334cae94a6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:26.677220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1915eb4-7853-4029-98ae-59334cae94a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:26.678844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1915eb4-7853-4029-98ae-59334cae94a6 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:26.686537 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 507/1014] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Jul 16 20:46:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:26.693511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d94e89-c833-4a67-999c-939b038043c8 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:26.824064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d94e89-c833-4a67-999c-939b038043c8 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:26.848310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2f711-60fc-4acb-b937-d69db098286f None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:26.848581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2f711-60fc-4acb-b937-d69db098286f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:26.849072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2f711-60fc-4acb-b937-d69db098286f None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:26.850569 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 508/1015] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:26.856731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14740826-1f83-4853-83e2-6b35f6d1a016 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:26.857024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14740826-1f83-4853-83e2-6b35f6d1a016 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:26.857306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14740826-1f83-4853-83e2-6b35f6d1a016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:26.866477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e34aa5-6df4-472e-bb26-e913d6fa3b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:26.867170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e34aa5-6df4-472e-bb26-e913d6fa3b28 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:26.867452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e34aa5-6df4-472e-bb26-e913d6fa3b28 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:26.867726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e34aa5-6df4-472e-bb26-e913d6fa3b28 None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:26.868434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e34aa5-6df4-472e-bb26-e913d6fa3b28 None admin] RBAC: Adding query filter params (type=compute) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:26.868743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e34aa5-6df4-472e-bb26-e913d6fa3b28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:26.870755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e34aa5-6df4-472e-bb26-e913d6fa3b28 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:26.879041 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 508/1016] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Jul 16 20:46:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:26.881726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-14740826-1f83-4853-83e2-6b35f6d1a016 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:26.882938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-14740826-1f83-4853-83e2-6b35f6d1a016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:26.883455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e34aa5-6df4-472e-bb26-e913d6fa3b28 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:26.942413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:26.968105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:26.972808 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 509/1017] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:26 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 16 20:46:26.999859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14740826-1f83-4853-83e2-6b35f6d1a016 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:27.010060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e34aa5-6df4-472e-bb26-e913d6fa3b28 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:27.052173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0808b-467a-47fb-8cd0-1b38083d1b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:27.052833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0808b-467a-47fb-8cd0-1b38083d1b0c None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:27.053120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0808b-467a-47fb-8cd0-1b38083d1b0c None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:27.053397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0808b-467a-47fb-8cd0-1b38083d1b0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:27.054141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0808b-467a-47fb-8cd0-1b38083d1b0c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:27.055596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0808b-467a-47fb-8cd0-1b38083d1b0c None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:27.118697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14740826-1f83-4853-83e2-6b35f6d1a016 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:27.142603 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 509/1018] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Jul 16 20:46:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:46:27.173840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680b60e-ebd2-4fd3-ae35-a09a9f498eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:27.174693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680b60e-ebd2-4fd3-ae35-a09a9f498eac None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:27.174973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680b60e-ebd2-4fd3-ae35-a09a9f498eac None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:27.175308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680b60e-ebd2-4fd3-ae35-a09a9f498eac None admin] PATH_INFO: `/v3/domains/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:27.176760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680b60e-ebd2-4fd3-ae35-a09a9f498eac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:27.178728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680b60e-ebd2-4fd3-ae35-a09a9f498eac None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:27.181356 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 510/1019] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:27.188612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0808b-467a-47fb-8cd0-1b38083d1b0c None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:27.333985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0808b-467a-47fb-8cd0-1b38083d1b0c None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:27.335845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:27.378546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0848f-ddff-41dd-a0cb-a529c0119401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:27.379547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0848f-ddff-41dd-a0cb-a529c0119401 None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:27.379898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0848f-ddff-41dd-a0cb-a529c0119401 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:27.380178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0848f-ddff-41dd-a0cb-a529c0119401 None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:27.380900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0848f-ddff-41dd-a0cb-a529c0119401 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:27.382444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0848f-ddff-41dd-a0cb-a529c0119401 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:27.525271 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 510/1020] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Jul 16 20:46:27 2022] POST /identity/v3/projects => generated 311 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:46:28.399424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ce113-747d-414c-9075-b2f42edf7c37 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:28.400004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ce113-747d-414c-9075-b2f42edf7c37 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:28.400004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ce113-747d-414c-9075-b2f42edf7c37 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:28.402165 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 511/1021] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:28.407615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae876ccd-224a-4c78-894b-c73f536ab269 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:28.407904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae876ccd-224a-4c78-894b-c73f536ab269 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:28.408181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae876ccd-224a-4c78-894b-c73f536ab269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:28.426105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ae876ccd-224a-4c78-894b-c73f536ab269 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:28.427324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ae876ccd-224a-4c78-894b-c73f536ab269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:28.507172 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 511/1022] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:28.527753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ce113-747d-414c-9075-b2f42edf7c37 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:28.597039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:28.636852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ce113-747d-414c-9075-b2f42edf7c37 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:28.674351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b0271-d46d-429c-9a32-df2a2dc4e9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:28.675115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b0271-d46d-429c-9a32-df2a2dc4e9c3 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:28.675471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b0271-d46d-429c-9a32-df2a2dc4e9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:28.675754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b0271-d46d-429c-9a32-df2a2dc4e9c3 None admin] PATH_INFO: `/v3/services/image` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:28.676804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b0271-d46d-429c-9a32-df2a2dc4e9c3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:28.678693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b0271-d46d-429c-9a32-df2a2dc4e9c3 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:28.691673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-532b0271-d46d-429c-9a32-df2a2dc4e9c3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 16 20:46:28.691673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:28.691673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:46:28.691673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:46:28.691673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:46:28.691673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:46:28.691673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:46:28.691673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:28.691673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 16 20:46:28.691673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:28.691673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:46:28.691673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:28.691673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:28.691673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:28.691673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:28.691673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:28.691673 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:28.692938 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:28.692938 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:28.692938 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:28.692938 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:28.692938 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:28.692938 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:28.692938 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:46:28.692938 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:46:28.692938 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:46:28.692938 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:46:28.692938 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:28.692938 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:28.692938 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:28.692938 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:28.692938 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:28.692938 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:28.699911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:28.699911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:28.699911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:28.699911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:28.699911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:28.699911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:28.699911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:28.699911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:28.699911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:28.699911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:28.699911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:46:28.699911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:28.699911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 16 20:46:28.699911 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:28.699911 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 512/1023] 10.222.0.16 () {56 vars in 1105 bytes} [Sat Jul 16 20:46:28 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:28.700682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae876ccd-224a-4c78-894b-c73f536ab269 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:28.799568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:28.816559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae876ccd-224a-4c78-894b-c73f536ab269 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:28.854873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cdded-1cd4-4721-a8db-73097cce2b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:28.855575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cdded-1cd4-4721-a8db-73097cce2b69 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:28.855912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cdded-1cd4-4721-a8db-73097cce2b69 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:28.856199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cdded-1cd4-4721-a8db-73097cce2b69 None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:28.856894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cdded-1cd4-4721-a8db-73097cce2b69 None admin] RBAC: Adding query filter params (name=image) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:28.857199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cdded-1cd4-4721-a8db-73097cce2b69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:28.858559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cdded-1cd4-4721-a8db-73097cce2b69 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:28.871215 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 512/1024] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:28.872425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b0271-d46d-429c-9a32-df2a2dc4e9c3 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:28.981438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b0271-d46d-429c-9a32-df2a2dc4e9c3 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:29.009610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:29.018184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0551494-18a5-471d-8a2e-782c0150374e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:29.018885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0551494-18a5-471d-8a2e-782c0150374e None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:29.019199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0551494-18a5-471d-8a2e-782c0150374e None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:29.019472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0551494-18a5-471d-8a2e-782c0150374e None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:29.020170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0551494-18a5-471d-8a2e-782c0150374e None admin] RBAC: Adding query filter params (type=image) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:29.020473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0551494-18a5-471d-8a2e-782c0150374e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:29.021894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0551494-18a5-471d-8a2e-782c0150374e None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:29.031930 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 513/1025] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:29.039355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cdded-1cd4-4721-a8db-73097cce2b69 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:29.153441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cdded-1cd4-4721-a8db-73097cce2b69 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:29.189909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b6f61-a3e8-4b0a-a708-4417d11343b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:29.190566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b6f61-a3e8-4b0a-a708-4417d11343b3 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:29.190845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b6f61-a3e8-4b0a-a708-4417d11343b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:29.191147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b6f61-a3e8-4b0a-a708-4417d11343b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:29.191943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b6f61-a3e8-4b0a-a708-4417d11343b3 None admin] RBAC: Adding query filter params (interface=public, service_id=021f1fe5e04248b08a14c4581def96c9, region_id=RegionOne) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:29.192251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b6f61-a3e8-4b0a-a708-4417d11343b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:29.193617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b6f61-a3e8-4b0a-a708-4417d11343b3 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:29.200151 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 513/1026] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Jul 16 20:46:29 2022] GET /identity/v3/endpoints?service_id=021f1fe5e04248b08a14c4581def96c9&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:29.205516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0551494-18a5-471d-8a2e-782c0150374e None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:29.318348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0551494-18a5-471d-8a2e-782c0150374e None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:29.353744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d1b97-8dfd-42e9-b60f-68a1d9803f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:29.354581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d1b97-8dfd-42e9-b60f-68a1d9803f5a None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:29.355123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d1b97-8dfd-42e9-b60f-68a1d9803f5a None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:29.355376 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d1b97-8dfd-42e9-b60f-68a1d9803f5a None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:29.356066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d1b97-8dfd-42e9-b60f-68a1d9803f5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:29.357423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d1b97-8dfd-42e9-b60f-68a1d9803f5a None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:29.364454 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 514/1027] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Jul 16 20:46:29 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 20:46:29.629541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577774f1-ea37-4cc7-a80a-c20d2bc5799f None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:29.629766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577774f1-ea37-4cc7-a80a-c20d2bc5799f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:29.630006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577774f1-ea37-4cc7-a80a-c20d2bc5799f None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:29.631985 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 514/1028] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:29.637802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2335eb9-d18d-4b80-91fe-c3e5b677d47d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:29.638274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2335eb9-d18d-4b80-91fe-c3e5b677d47d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:29.638371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2335eb9-d18d-4b80-91fe-c3e5b677d47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:29.655667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a2335eb9-d18d-4b80-91fe-c3e5b677d47d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:29.656872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a2335eb9-d18d-4b80-91fe-c3e5b677d47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:29.714140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:29.731668 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 515/1029] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:29.757394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577774f1-ea37-4cc7-a80a-c20d2bc5799f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:29.775542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:29.888050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577774f1-ea37-4cc7-a80a-c20d2bc5799f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:29.898540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fb344-72f5-4e14-9a69-962a4400fe6f None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:29.898824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fb344-72f5-4e14-9a69-962a4400fe6f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:29.899445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fb344-72f5-4e14-9a69-962a4400fe6f None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:29.901336 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 516/1030] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:46:29.906635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d11d24-0306-4a2a-a29f-b1493e1ee62f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:29.906922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d11d24-0306-4a2a-a29f-b1493e1ee62f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:29.907241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d11d24-0306-4a2a-a29f-b1493e1ee62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:29.924970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c3d11d24-0306-4a2a-a29f-b1493e1ee62f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:29.926185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c3d11d24-0306-4a2a-a29f-b1493e1ee62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:29.929100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032d5ee-dfb2-47e3-af65-d2b4f0ee9f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:29.929893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032d5ee-dfb2-47e3-af65-d2b4f0ee9f4c None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:29.930173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032d5ee-dfb2-47e3-af65-d2b4f0ee9f4c None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:29.930442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032d5ee-dfb2-47e3-af65-d2b4f0ee9f4c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:29.942665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032d5ee-dfb2-47e3-af65-d2b4f0ee9f4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:46:29.951799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-8032d5ee-dfb2-47e3-af65-d2b4f0ee9f4c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 16 20:46:29.951799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:29.951799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:29.951799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:29.951799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:29.951799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:29.951799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:29.951799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:29.951799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:29.951799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:29.951799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:29.951799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:29.951799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:46:29.951799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:46:29.951799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:46:29.951799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:46:29.952774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:46:29.952774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:46:29.952774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:46:29.952774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:46:29.952774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:29.952774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:29.952774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:29.952774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:29.952774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:29.952774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:29.952774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:29.952774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:29.952774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:29.952774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:29.952774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:29.952774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:29.953797 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:29.953797 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:29.953797 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:29.953797 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:29.953797 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:46:29.953797 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:46:29.953797 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:46:29.953797 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:46:29.953797 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:46:29.953797 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:46:29.953797 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 16 20:46:29.953797 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:29.953797 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 515/1031] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Jul 16 20:46:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:29.959236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032d5ee-dfb2-47e3-af65-d2b4f0ee9f4c None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:30.007137 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 517/1032] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:30.034884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d11d24-0306-4a2a-a29f-b1493e1ee62f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:30.037411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:30.074516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032d5ee-dfb2-47e3-af65-d2b4f0ee9f4c None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:30.116215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4bb25-c9a6-427f-b695-45f0497c51cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:30.116918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4bb25-c9a6-427f-b695-45f0497c51cd None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:30.117196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4bb25-c9a6-427f-b695-45f0497c51cd None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:30.117468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4bb25-c9a6-427f-b695-45f0497c51cd None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:30.118211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4bb25-c9a6-427f-b695-45f0497c51cd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:30.118517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4bb25-c9a6-427f-b695-45f0497c51cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:30.120558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4bb25-c9a6-427f-b695-45f0497c51cd None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:30.135399 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 516/1033] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Jul 16 20:46:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:30.136939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4bb25-c9a6-427f-b695-45f0497c51cd None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:30.153263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d11d24-0306-4a2a-a29f-b1493e1ee62f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:30.172381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:30.195639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e346c-abec-4268-9df8-fa4e2d136dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:30.196434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e346c-abec-4268-9df8-fa4e2d136dcf None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:30.196712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e346c-abec-4268-9df8-fa4e2d136dcf None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:30.196981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e346c-abec-4268-9df8-fa4e2d136dcf None admin] PATH_INFO: `/v3/domains/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:30.198192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e346c-abec-4268-9df8-fa4e2d136dcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:30.199672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e346c-abec-4268-9df8-fa4e2d136dcf None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:30.206475 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 518/1034] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:30.207890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e346c-abec-4268-9df8-fa4e2d136dcf None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:30.260917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4bb25-c9a6-427f-b695-45f0497c51cd None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:30.301049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43d61b-c3c0-4e0d-8cc1-bc5b2f2e2b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:30.301844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43d61b-c3c0-4e0d-8cc1-bc5b2f2e2b4c None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:30.302125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43d61b-c3c0-4e0d-8cc1-bc5b2f2e2b4c None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:30.302400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43d61b-c3c0-4e0d-8cc1-bc5b2f2e2b4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:30.304565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:30.315808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43d61b-c3c0-4e0d-8cc1-bc5b2f2e2b4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:30.321569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43d61b-c3c0-4e0d-8cc1-bc5b2f2e2b4c None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:30.331143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e346c-abec-4268-9df8-fa4e2d136dcf None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:30.336171 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-cb43d61b-c3c0-4e0d-8cc1-bc5b2f2e2b4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:30.336171 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:30.336171 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:30.336171 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:30.336171 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:30.336171 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:30.336171 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:30.336171 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:30.336171 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:30.336171 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:30.336171 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:30.336171 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:30.336171 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:46:30.336171 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:46:30.336171 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:46:30.337087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:46:30.337087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:30.337087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:30.337087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:30.337087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:30.337087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:30.337087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:30.337087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:30.337087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:30.337087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:30.337087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:30.337087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:30.337087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:30.337087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:30.337087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:30.337087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:30.337087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:30.338001 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:46:30.338001 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:46:30.338001 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:30.338001 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:30.343187 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 517/1035] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:30.344590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43d61b-c3c0-4e0d-8cc1-bc5b2f2e2b4c None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:30.368818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81606d5-5660-4456-a4ad-ec6b325bb234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:30.370572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81606d5-5660-4456-a4ad-ec6b325bb234 None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:30.370857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81606d5-5660-4456-a4ad-ec6b325bb234 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:30.371452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81606d5-5660-4456-a4ad-ec6b325bb234 None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:30.372213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81606d5-5660-4456-a4ad-ec6b325bb234 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:30.374239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81606d5-5660-4456-a4ad-ec6b325bb234 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:30.453275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43d61b-c3c0-4e0d-8cc1-bc5b2f2e2b4c None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:30.491357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653a55d-84a5-4690-b87f-7e2ee14bd5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:30.491357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653a55d-84a5-4690-b87f-7e2ee14bd5a4 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:30.491673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653a55d-84a5-4690-b87f-7e2ee14bd5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:30.492525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653a55d-84a5-4690-b87f-7e2ee14bd5a4 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:30.492646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653a55d-84a5-4690-b87f-7e2ee14bd5a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:30.492858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653a55d-84a5-4690-b87f-7e2ee14bd5a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:30.494275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653a55d-84a5-4690-b87f-7e2ee14bd5a4 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:30.499827 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 519/1036] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Jul 16 20:46:30 2022] POST /identity/v3/users => generated 285 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 20:46:30.514327 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 518/1037] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:30.516528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81606d5-5660-4456-a4ad-ec6b325bb234 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:30.570199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:30.653322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81606d5-5660-4456-a4ad-ec6b325bb234 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:30.708733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc3564-b3a1-48c5-8328-01f8604fa680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:30.709470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc3564-b3a1-48c5-8328-01f8604fa680 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:30.709754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc3564-b3a1-48c5-8328-01f8604fa680 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:30.710028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc3564-b3a1-48c5-8328-01f8604fa680 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:30.720430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc3564-b3a1-48c5-8328-01f8604fa680 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:30.721901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc3564-b3a1-48c5-8328-01f8604fa680 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:30.738610 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-0ecc3564-b3a1-48c5-8328-01f8604fa680 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 16 20:46:30.738610 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:30.738610 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:30.738610 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:30.738610 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:30.738610 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:30.738610 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:30.738610 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:30.738610 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:30.738610 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:30.738610 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:30.738610 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:30.738610 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:46:30.738610 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:46:30.738610 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:46:30.738610 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:46:30.739826 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:30.739826 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:30.739826 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:46:30.739826 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:46:30.739826 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:46:30.739826 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:46:30.739826 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:30.739826 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:30.739826 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:30.739826 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:30.739826 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:30.739826 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:30.739826 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:30.739826 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:30.739826 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:30.739826 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:30.739826 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:30.739826 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:30.740766 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:30.740766 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:30.740766 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:46:30.740766 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:46:30.740766 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:46:30.740766 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:46:30.740766 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:46:30.740766 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:46:30.740766 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 16 20:46:30.740766 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:30.740766 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 520/1038] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Jul 16 20:46:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:46:30.748639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653a55d-84a5-4690-b87f-7e2ee14bd5a4 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:30.807855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:30.878363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653a55d-84a5-4690-b87f-7e2ee14bd5a4 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:30.914749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fef33-52d7-4e29-b096-5d55a56c36e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:30.915444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fef33-52d7-4e29-b096-5d55a56c36e5 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:30.915722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fef33-52d7-4e29-b096-5d55a56c36e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:30.915999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fef33-52d7-4e29-b096-5d55a56c36e5 None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:30.917356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fef33-52d7-4e29-b096-5d55a56c36e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:30.917721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fef33-52d7-4e29-b096-5d55a56c36e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:30.919500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fef33-52d7-4e29-b096-5d55a56c36e5 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:30.938442 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 519/1039] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Jul 16 20:46:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:30.944765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc3564-b3a1-48c5-8328-01f8604fa680 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:31.053516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:31.056662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc3564-b3a1-48c5-8328-01f8604fa680 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:31.092751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86e36c-aee1-43cf-b8cb-a3cea05cdd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:31.093382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86e36c-aee1-43cf-b8cb-a3cea05cdd14 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:31.102101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86e36c-aee1-43cf-b8cb-a3cea05cdd14 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:31.102101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86e36c-aee1-43cf-b8cb-a3cea05cdd14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:31.167190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86e36c-aee1-43cf-b8cb-a3cea05cdd14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:31.169175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86e36c-aee1-43cf-b8cb-a3cea05cdd14 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:31.273028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:31.278155 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 521/1040] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:46:30 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 16 20:46:31.284314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fef33-52d7-4e29-b096-5d55a56c36e5 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:31.397795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fef33-52d7-4e29-b096-5d55a56c36e5 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:31.400266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:31.435770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dd9e4-098d-463f-ba64-22ce231e5f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:31.436573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd9e4-098d-463f-ba64-22ce231e5f99 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:31.436887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd9e4-098d-463f-ba64-22ce231e5f99 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:31.437167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd9e4-098d-463f-ba64-22ce231e5f99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:31.449659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dd9e4-098d-463f-ba64-22ce231e5f99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:31.451139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dd9e4-098d-463f-ba64-22ce231e5f99 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:31.469787 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-270dd9e4-098d-463f-ba64-22ce231e5f99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:31.469787 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:31.469787 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:31.469787 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:31.469787 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:31.469787 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:31.469787 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:31.469787 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:31.469787 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:31.469787 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:31.469787 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:31.469787 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:31.469787 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:46:31.469787 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:46:31.469787 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:46:31.470732 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:46:31.470732 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:31.470732 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:31.470732 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:31.470732 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:31.470732 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:31.470732 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:31.470732 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:31.470732 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:31.470732 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:31.470732 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:31.470732 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:31.470732 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:31.470732 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:31.470732 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:31.470732 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:31.470732 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:31.471634 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:46:31.471634 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:46:31.471634 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:31.471634 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:31.472547 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 520/1041] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:31.476795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86e36c-aee1-43cf-b8cb-a3cea05cdd14 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:31.586228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86e36c-aee1-43cf-b8cb-a3cea05cdd14 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:31.621840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cf397-1476-407c-8c37-15f84bb4f187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:31.622505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cf397-1476-407c-8c37-15f84bb4f187 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:31.622783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cf397-1476-407c-8c37-15f84bb4f187 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:31.623081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cf397-1476-407c-8c37-15f84bb4f187 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:31.623798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cf397-1476-407c-8c37-15f84bb4f187 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:31.624102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cf397-1476-407c-8c37-15f84bb4f187 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:31.625447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cf397-1476-407c-8c37-15f84bb4f187 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:31.643067 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 522/1042] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:31.644303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dd9e4-098d-463f-ba64-22ce231e5f99 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:31.665900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda03dc-054a-497b-9b5f-55aafa7c7fa1 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:31.666469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda03dc-054a-497b-9b5f-55aafa7c7fa1 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:31.666469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda03dc-054a-497b-9b5f-55aafa7c7fa1 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:31.668014 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 523/1043] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:46:31.672959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681d98e-9b29-43ae-8231-c26807b58c23 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:31.673248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681d98e-9b29-43ae-8231-c26807b58c23 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:31.673532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681d98e-9b29-43ae-8231-c26807b58c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:31.692678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6681d98e-9b29-43ae-8231-c26807b58c23 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:31.694050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6681d98e-9b29-43ae-8231-c26807b58c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:31.754672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:31.767861 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 524/1044] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 16 20:46:31.768656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dd9e4-098d-463f-ba64-22ce231e5f99 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:31.795021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681d98e-9b29-43ae-8231-c26807b58c23 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:31.813889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48dbad-7b44-41d2-8917-30b7e80e0209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:31.814781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48dbad-7b44-41d2-8917-30b7e80e0209 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:31.815094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48dbad-7b44-41d2-8917-30b7e80e0209 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:31.815479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48dbad-7b44-41d2-8917-30b7e80e0209 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:31.823923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48dbad-7b44-41d2-8917-30b7e80e0209 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:31.825587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48dbad-7b44-41d2-8917-30b7e80e0209 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:31.841400 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-cf48dbad-7b44-41d2-8917-30b7e80e0209 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:46:31.841400 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:31.841400 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:31.841400 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:31.841400 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:31.841400 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:31.841400 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:31.841400 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:31.841400 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:31.841400 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:31.841400 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:31.841400 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:31.841400 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:46:31.841400 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:46:31.841400 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:46:31.842525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:46:31.842525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:31.842525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:31.842525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:31.842525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:31.842525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:31.842525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:31.842525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:31.842525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:31.842525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:31.842525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:31.842525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:31.842525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:31.842525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:31.842525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:31.842525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:31.842525 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:31.843655 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:46:31.843655 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:46:31.843655 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:46:31.843655 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:46:31.843655 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:46:31.843655 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:46:31.843655 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:46:31.843655 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:31.850371 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 521/1045] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:46:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:31.851474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48dbad-7b44-41d2-8917-30b7e80e0209 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:31.874966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:31.911673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681d98e-9b29-43ae-8231-c26807b58c23 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:31.951778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bfd1d-cbae-4efb-8c64-a1349c06f942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:31.952488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bfd1d-cbae-4efb-8c64-a1349c06f942 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:31.953204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bfd1d-cbae-4efb-8c64-a1349c06f942 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:31.953491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bfd1d-cbae-4efb-8c64-a1349c06f942 None admin] PATH_INFO: `/v3/services/image` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:31.954241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bfd1d-cbae-4efb-8c64-a1349c06f942 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:31.955600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bfd1d-cbae-4efb-8c64-a1349c06f942 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:31.965544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48dbad-7b44-41d2-8917-30b7e80e0209 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:31.968810 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-843bfd1d-cbae-4efb-8c64-a1349c06f942 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 16 20:46:31.968810 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:31.968810 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:46:31.968810 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:46:31.968810 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:46:31.968810 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:46:31.968810 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:46:31.968810 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:31.968810 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 16 20:46:31.968810 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:31.968810 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:46:31.968810 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:31.968810 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:31.968810 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:31.968810 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:31.968810 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:31.968810 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:31.970025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:31.970025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:31.970025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:31.970025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:31.970025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:31.970025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:31.970025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:46:31.970025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:46:31.970025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:46:31.970025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:46:31.970025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:31.970025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:31.970025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:31.970025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:31.970025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:31.970025 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:31.970854 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:31.970854 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:31.970854 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:31.970854 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:31.970854 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:31.970854 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:31.970854 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:31.970854 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:31.970854 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:31.970854 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:31.970854 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:46:31.970854 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:46:31.970854 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 16 20:46:31.970854 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:31.970854 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 525/1046] 10.222.0.16 () {56 vars in 1105 bytes} [Sat Jul 16 20:46:31 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:46:31.975928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bfd1d-cbae-4efb-8c64-a1349c06f942 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:32.010030 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ff7ad-7d7d-47ed-84e1-1e73a42ae9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:32.011220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ff7ad-7d7d-47ed-84e1-1e73a42ae9df None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:32.011617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ff7ad-7d7d-47ed-84e1-1e73a42ae9df None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:32.011903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ff7ad-7d7d-47ed-84e1-1e73a42ae9df None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:32.012688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ff7ad-7d7d-47ed-84e1-1e73a42ae9df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:32.012997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ff7ad-7d7d-47ed-84e1-1e73a42ae9df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:32.015508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ff7ad-7d7d-47ed-84e1-1e73a42ae9df None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:32.030129 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 522/1047] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:46:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:32.035962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ff7ad-7d7d-47ed-84e1-1e73a42ae9df None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:32.036619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:32.089335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bfd1d-cbae-4efb-8c64-a1349c06f942 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:32.121341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:32.125915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ea9eb-e779-48a9-b3a3-021899b789af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:32.126583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ea9eb-e779-48a9-b3a3-021899b789af None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:32.126864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ea9eb-e779-48a9-b3a3-021899b789af None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:32.127174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ea9eb-e779-48a9-b3a3-021899b789af None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:32.127880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ea9eb-e779-48a9-b3a3-021899b789af None admin] RBAC: Adding query filter params (name=image) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:32.128185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ea9eb-e779-48a9-b3a3-021899b789af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:32.129555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ea9eb-e779-48a9-b3a3-021899b789af None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:32.134868 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 526/1048] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:32.141359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ea9eb-e779-48a9-b3a3-021899b789af None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:32.145734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ff7ad-7d7d-47ed-84e1-1e73a42ae9df None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:32.180532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9b38c-4a81-4b57-82a4-6a08c89a2d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:32.181237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9b38c-4a81-4b57-82a4-6a08c89a2d16 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:32.181529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9b38c-4a81-4b57-82a4-6a08c89a2d16 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:32.181809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9b38c-4a81-4b57-82a4-6a08c89a2d16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:32.183404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9b38c-4a81-4b57-82a4-6a08c89a2d16 None admin] RBAC: Adding query filter params (role.id=b7c95212d9564da9ba2366086bf22e5d, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=d5f515bfe2094b41afe82b4bc57e4b9a) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:32.183880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9b38c-4a81-4b57-82a4-6a08c89a2d16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:32.185338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9b38c-4a81-4b57-82a4-6a08c89a2d16 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:32.191605 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 523/1049] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:46:32 2022] GET /identity/v3/role_assignments?user.id=d5f515bfe2094b41afe82b4bc57e4b9a&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=b7c95212d9564da9ba2366086bf22e5d => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:32.256627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ea9eb-e779-48a9-b3a3-021899b789af None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:32.275706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:32.296914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec1ffb-c199-4c07-9e0a-34dcf48c1466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:32.297598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec1ffb-c199-4c07-9e0a-34dcf48c1466 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:32.297881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec1ffb-c199-4c07-9e0a-34dcf48c1466 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:32.299046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec1ffb-c199-4c07-9e0a-34dcf48c1466 None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:32.299046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec1ffb-c199-4c07-9e0a-34dcf48c1466 None admin] RBAC: Adding query filter params (type=image) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:32.299219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec1ffb-c199-4c07-9e0a-34dcf48c1466 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:32.300676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec1ffb-c199-4c07-9e0a-34dcf48c1466 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:32.308465 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 527/1050] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:32.314928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9b38c-4a81-4b57-82a4-6a08c89a2d16 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:32.433581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9b38c-4a81-4b57-82a4-6a08c89a2d16 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:32.469612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6062db-a284-4d22-8e1c-3adaac683b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:32.470274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6062db-a284-4d22-8e1c-3adaac683b1a None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:32.470555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6062db-a284-4d22-8e1c-3adaac683b1a None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:32.470830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6062db-a284-4d22-8e1c-3adaac683b1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:32.471606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6062db-a284-4d22-8e1c-3adaac683b1a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:32.473008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6062db-a284-4d22-8e1c-3adaac683b1a None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:32.482541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:32.643036 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 524/1051] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Jul 16 20:46:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:46:32.911492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de3d48-afff-4f67-9686-9da8aed7861f None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:32.912089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de3d48-afff-4f67-9686-9da8aed7861f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:32.912089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de3d48-afff-4f67-9686-9da8aed7861f None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:32.913373 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 528/1052] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:32.919476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60e57e-bb27-42d6-a691-e5083b8e936a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:32.919919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60e57e-bb27-42d6-a691-e5083b8e936a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:32.920099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60e57e-bb27-42d6-a691-e5083b8e936a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:32.938871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ec60e57e-bb27-42d6-a691-e5083b8e936a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:32.945365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ec60e57e-bb27-42d6-a691-e5083b8e936a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:33.022251 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 525/1053] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:33.046974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de3d48-afff-4f67-9686-9da8aed7861f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:33.159353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de3d48-afff-4f67-9686-9da8aed7861f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:33.198236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf4541-a7e5-4b02-8c37-cf581ad4d6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:33.198992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf4541-a7e5-4b02-8c37-cf581ad4d6ad None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:33.199379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf4541-a7e5-4b02-8c37-cf581ad4d6ad None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:33.199658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf4541-a7e5-4b02-8c37-cf581ad4d6ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:33.211651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf4541-a7e5-4b02-8c37-cf581ad4d6ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:46:33.220410 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-f3cf4541-a7e5-4b02-8c37-cf581ad4d6ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:46:33.220410 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:33.220410 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:33.220410 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:33.220410 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:33.220410 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:33.220410 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:33.220410 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:33.220410 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:33.220410 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:33.220410 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:33.220410 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:33.220410 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:46:33.220410 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:46:33.220410 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:46:33.220410 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:46:33.221355 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:46:33.221355 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:46:33.221355 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:46:33.221355 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:46:33.221355 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:33.221355 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:33.221355 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:33.221355 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:33.221355 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:33.221355 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:33.221355 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:33.221355 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:33.221355 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:33.221355 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:33.221355 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:33.221355 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:33.222209 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:33.222209 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:33.222209 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:33.222209 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:33.222209 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:46:33.222209 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:46:33.222209 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:46:33.222209 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:46:33.222209 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:46:33.222209 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:46:33.222209 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:46:33.222209 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:33.222209 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 529/1054] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:46:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:33.227721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60e57e-bb27-42d6-a691-e5083b8e936a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:33.337534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60e57e-bb27-42d6-a691-e5083b8e936a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:33.367761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:33.381598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14d603-05e4-494d-8a14-6e57a6137185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:33.382210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14d603-05e4-494d-8a14-6e57a6137185 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:33.382489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14d603-05e4-494d-8a14-6e57a6137185 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:33.386954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14d603-05e4-494d-8a14-6e57a6137185 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:33.386954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14d603-05e4-494d-8a14-6e57a6137185 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:33.386954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14d603-05e4-494d-8a14-6e57a6137185 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:33.386954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14d603-05e4-494d-8a14-6e57a6137185 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:33.400855 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 526/1055] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:46:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:33.402662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf4541-a7e5-4b02-8c37-cf581ad4d6ad None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:33.457236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:33.518271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf4541-a7e5-4b02-8c37-cf581ad4d6ad None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:33.553780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a0cd4-8647-4f1f-b6ab-3cc5baad2c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:33.554787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a0cd4-8647-4f1f-b6ab-3cc5baad2c0b None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:33.555149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a0cd4-8647-4f1f-b6ab-3cc5baad2c0b None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:33.555398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a0cd4-8647-4f1f-b6ab-3cc5baad2c0b None admin] PATH_INFO: `/v3/users/86a43e52cde34b0aa7ec6249a0a37272` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:33.574313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a0cd4-8647-4f1f-b6ab-3cc5baad2c0b None admin] RBAC: Authorizing `identity:get_user(user_id=86a43e52cde34b0aa7ec6249a0a37272)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:33.580421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a0cd4-8647-4f1f-b6ab-3cc5baad2c0b None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:33.580421 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 530/1056] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:46:33 2022] GET /identity/v3/users/86a43e52cde34b0aa7ec6249a0a37272 => generated 285 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:33.583395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14d603-05e4-494d-8a14-6e57a6137185 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:33.689863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14d603-05e4-494d-8a14-6e57a6137185 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:33.727072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af1521-9926-4015-81fc-77f1cc7d7226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:33.727677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af1521-9926-4015-81fc-77f1cc7d7226 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:33.727957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af1521-9926-4015-81fc-77f1cc7d7226 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:33.728229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af1521-9926-4015-81fc-77f1cc7d7226 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:33.799826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:33.825076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af1521-9926-4015-81fc-77f1cc7d7226 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:33.826624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af1521-9926-4015-81fc-77f1cc7d7226 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:33.952574 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 527/1057] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:46:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 16 20:46:33.958519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a0cd4-8647-4f1f-b6ab-3cc5baad2c0b None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:34.061604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:34.065342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a0cd4-8647-4f1f-b6ab-3cc5baad2c0b None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:34.102002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a785a-cae4-4bc0-8eb9-f72d23b20855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:34.102867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a785a-cae4-4bc0-8eb9-f72d23b20855 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:34.103197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a785a-cae4-4bc0-8eb9-f72d23b20855 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:34.103473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a785a-cae4-4bc0-8eb9-f72d23b20855 None admin] PATH_INFO: `/v3/projects/dd9d0e89ddfc4d8599c2ae2601e1a5c0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:34.104777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a785a-cae4-4bc0-8eb9-f72d23b20855 None admin] RBAC: Authorizing `identity:get_project(project_id=dd9d0e89ddfc4d8599c2ae2601e1a5c0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:34.106212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a785a-cae4-4bc0-8eb9-f72d23b20855 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:34.113276 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 531/1058] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:46:33 2022] GET /identity/v3/projects/dd9d0e89ddfc4d8599c2ae2601e1a5c0 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:34.114184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af1521-9926-4015-81fc-77f1cc7d7226 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:34.204454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:34.221317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af1521-9926-4015-81fc-77f1cc7d7226 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:34.257436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179881a-ded4-4c67-af56-089b4ba887ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:34.258086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179881a-ded4-4c67-af56-089b4ba887ba None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:34.258369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179881a-ded4-4c67-af56-089b4ba887ba None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:34.258642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179881a-ded4-4c67-af56-089b4ba887ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:34.259497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179881a-ded4-4c67-af56-089b4ba887ba None admin] RBAC: Adding query filter params (role.id=bd33b827674a4d4db30c164cab416056, scope.project.id=dd9d0e89ddfc4d8599c2ae2601e1a5c0, user.id=86a43e52cde34b0aa7ec6249a0a37272) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:34.259806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179881a-ded4-4c67-af56-089b4ba887ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:34.261850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179881a-ded4-4c67-af56-089b4ba887ba None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:34.275125 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 528/1059] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:46:34 2022] GET /identity/v3/role_assignments?user.id=86a43e52cde34b0aa7ec6249a0a37272&scope.project.id=dd9d0e89ddfc4d8599c2ae2601e1a5c0&role.id=bd33b827674a4d4db30c164cab416056 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:34.505649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1489241-0b3a-4b38-a074-c74a8ccc9673 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:34.505883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1489241-0b3a-4b38-a074-c74a8ccc9673 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:34.506195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1489241-0b3a-4b38-a074-c74a8ccc9673 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:34.507712 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 532/1060] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:34.513809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12b82f-a76a-428c-b991-61d367ee8b66 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:34.514079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12b82f-a76a-428c-b991-61d367ee8b66 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:34.514353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12b82f-a76a-428c-b991-61d367ee8b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:34.532387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7c12b82f-a76a-428c-b991-61d367ee8b66 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:34.533571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7c12b82f-a76a-428c-b991-61d367ee8b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:34.606827 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 529/1061] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:34.630522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1489241-0b3a-4b38-a074-c74a8ccc9673 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:34.740742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1489241-0b3a-4b38-a074-c74a8ccc9673 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:34.781867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80990e74-94aa-4858-a7df-811d7ae8c4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:34.782602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80990e74-94aa-4858-a7df-811d7ae8c4d3 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:34.782879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80990e74-94aa-4858-a7df-811d7ae8c4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:34.783180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80990e74-94aa-4858-a7df-811d7ae8c4d3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:34.794410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80990e74-94aa-4858-a7df-811d7ae8c4d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:46:34.802522 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-80990e74-94aa-4858-a7df-811d7ae8c4d3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 16 20:46:34.802522 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:34.802522 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:34.802522 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:34.802522 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:34.802522 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:34.802522 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:34.802522 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:34.802522 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:34.802522 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:34.802522 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:34.802522 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:34.802522 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:46:34.802522 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:46:34.802522 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:46:34.802522 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:46:34.803579 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:46:34.803579 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:46:34.803579 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:46:34.803579 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:46:34.803579 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:34.803579 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:34.803579 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:34.803579 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:34.803579 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:34.803579 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:34.803579 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:34.803579 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:34.803579 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:34.803579 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:34.803579 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:34.803579 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:34.804422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:34.804422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:34.804422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:34.804422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:34.804422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:46:34.804422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:46:34.804422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:46:34.804422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:46:34.804422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:46:34.804422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:46:34.804422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 16 20:46:34.804422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:34.809598 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 533/1062] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Jul 16 20:46:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:34.810903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12b82f-a76a-428c-b991-61d367ee8b66 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:34.901784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:34.926731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12b82f-a76a-428c-b991-61d367ee8b66 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:34.965194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64650dfe-f67d-4634-9d06-186d73eaf0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:34.965967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64650dfe-f67d-4634-9d06-186d73eaf0b1 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:34.966152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64650dfe-f67d-4634-9d06-186d73eaf0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:34.966420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64650dfe-f67d-4634-9d06-186d73eaf0b1 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:34.967250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64650dfe-f67d-4634-9d06-186d73eaf0b1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:34.967560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64650dfe-f67d-4634-9d06-186d73eaf0b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:34.968943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64650dfe-f67d-4634-9d06-186d73eaf0b1 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:34.978470 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 530/1063] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Jul 16 20:46:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:34.984216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80990e74-94aa-4858-a7df-811d7ae8c4d3 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:34.986881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3943e-c932-411e-831d-445788bacbb3 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:34.987249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3943e-c932-411e-831d-445788bacbb3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:34.987530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3943e-c932-411e-831d-445788bacbb3 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:34.989232 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 531/1064] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:46:34.994225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6f2fb-e6ac-468c-b08d-f02991d15bd1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:34.995156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6f2fb-e6ac-468c-b08d-f02991d15bd1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:34.995720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6f2fb-e6ac-468c-b08d-f02991d15bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:35.014037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a3e6f2fb-e6ac-468c-b08d-f02991d15bd1 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:35.015420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a3e6f2fb-e6ac-468c-b08d-f02991d15bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:35.018254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:35.093291 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 532/1065] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 16 20:46:35.101410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80990e74-94aa-4858-a7df-811d7ae8c4d3 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:35.116762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6f2fb-e6ac-468c-b08d-f02991d15bd1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:35.142953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce31e3-f415-4291-875f-97c3e478f9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:35.143858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce31e3-f415-4291-875f-97c3e478f9c5 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:35.144141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce31e3-f415-4291-875f-97c3e478f9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:35.144423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce31e3-f415-4291-875f-97c3e478f9c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:35.155597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce31e3-f415-4291-875f-97c3e478f9c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:35.157094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce31e3-f415-4291-875f-97c3e478f9c5 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:35.175078 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-39ce31e3-f415-4291-875f-97c3e478f9c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:35.175078 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:35.175078 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:35.175078 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:35.175078 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:35.175078 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:35.175078 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:35.175078 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:35.175078 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:35.175078 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:35.175078 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:35.175078 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:35.175078 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:46:35.175078 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:46:35.175078 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:46:35.176216 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:46:35.176216 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:35.176216 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:35.176216 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:35.176216 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:35.176216 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:35.176216 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:35.176216 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:35.176216 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:35.176216 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:35.176216 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:35.176216 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:35.176216 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:35.176216 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:35.176216 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:35.176216 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:35.176216 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:35.177231 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:46:35.177231 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:46:35.177231 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:35.177231 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:35.177231 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 534/1066] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:35.182916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce31e3-f415-4291-875f-97c3e478f9c5 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:35.202017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:35.236662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6f2fb-e6ac-468c-b08d-f02991d15bd1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:35.269882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:35.281696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506771d-3ea9-4d2c-bf84-1b606de511cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:35.282349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506771d-3ea9-4d2c-bf84-1b606de511cb None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:35.282644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506771d-3ea9-4d2c-bf84-1b606de511cb None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:35.282907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506771d-3ea9-4d2c-bf84-1b606de511cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:35.290740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce31e3-f415-4291-875f-97c3e478f9c5 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:35.330427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762cd2c-aa76-4031-9aa3-9af6d60a2d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:35.331124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762cd2c-aa76-4031-9aa3-9af6d60a2d29 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:35.331407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762cd2c-aa76-4031-9aa3-9af6d60a2d29 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:35.331681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762cd2c-aa76-4031-9aa3-9af6d60a2d29 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:35.332406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762cd2c-aa76-4031-9aa3-9af6d60a2d29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:35.332711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762cd2c-aa76-4031-9aa3-9af6d60a2d29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:35.334082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762cd2c-aa76-4031-9aa3-9af6d60a2d29 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:35.353079 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 535/1067] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:35.354827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762cd2c-aa76-4031-9aa3-9af6d60a2d29 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:35.366072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506771d-3ea9-4d2c-bf84-1b606de511cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:35.367696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506771d-3ea9-4d2c-bf84-1b606de511cb None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:35.449166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:35.470269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762cd2c-aa76-4031-9aa3-9af6d60a2d29 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:35.483457 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 533/1068] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:46:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 16 20:46:35.489478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506771d-3ea9-4d2c-bf84-1b606de511cb None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:35.506571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb38402-096d-4a82-888b-4e8d91a5bf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:35.507385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb38402-096d-4a82-888b-4e8d91a5bf9d None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:35.507664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb38402-096d-4a82-888b-4e8d91a5bf9d None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:35.507936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb38402-096d-4a82-888b-4e8d91a5bf9d None admin] PATH_INFO: `/v3/users/nova` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:35.516379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb38402-096d-4a82-888b-4e8d91a5bf9d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:35.517836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb38402-096d-4a82-888b-4e8d91a5bf9d None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:35.521457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:35.535574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-ddb38402-096d-4a82-888b-4e8d91a5bf9d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 16 20:46:35.535574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:35.535574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:35.535574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:35.535574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:35.535574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:35.535574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:35.535574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:35.535574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:35.535574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:35.535574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:35.535574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:35.535574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:46:35.535574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:46:35.535574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:46:35.535574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:46:35.538312 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:35.538312 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:35.538312 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:46:35.538312 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:46:35.538312 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:46:35.538312 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:46:35.538312 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:35.538312 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:35.538312 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:35.538312 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:35.538312 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:35.538312 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:35.538312 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:35.538312 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:35.538312 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:35.538312 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:35.538312 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:35.538312 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:35.539306 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:35.539306 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:35.539306 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:46:35.539306 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:46:35.539306 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:46:35.539306 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:46:35.539306 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:46:35.539306 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:46:35.539306 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 16 20:46:35.539306 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:35.540977 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 536/1069] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Jul 16 20:46:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:46:35.543317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb38402-096d-4a82-888b-4e8d91a5bf9d None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:35.611384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506771d-3ea9-4d2c-bf84-1b606de511cb None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:35.651455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7016f-6d1b-49bb-bdb8-610243cc1cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:35.652324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb38402-096d-4a82-888b-4e8d91a5bf9d None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:35.652457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7016f-6d1b-49bb-bdb8-610243cc1cd3 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:35.652617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7016f-6d1b-49bb-bdb8-610243cc1cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:35.652871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7016f-6d1b-49bb-bdb8-610243cc1cd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:35.664040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7016f-6d1b-49bb-bdb8-610243cc1cd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:35.665490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7016f-6d1b-49bb-bdb8-610243cc1cd3 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:35.687185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-efb7016f-6d1b-49bb-bdb8-610243cc1cd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:35.687185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:35.687185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:35.687185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:35.687185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:35.687185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:35.687185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:35.687185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:35.687185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:35.687185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:35.687185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:35.687185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:35.687185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:46:35.687185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:46:35.687185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:46:35.688170 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:46:35.688170 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:35.688170 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:35.688170 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:35.688170 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:35.688170 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:35.688170 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:35.688170 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:35.688170 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:35.688170 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:35.688170 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:35.688170 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:35.688170 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:35.688170 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:35.688170 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:35.688170 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:35.688170 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:35.689060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:46:35.689060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:46:35.689060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:35.689060 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:35.689060 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 534/1070] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:46:35.694437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7016f-6d1b-49bb-bdb8-610243cc1cd3 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:35.694866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d779b6-5168-4ea1-ae91-83d3608d4826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:35.695573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d779b6-5168-4ea1-ae91-83d3608d4826 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:35.695850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d779b6-5168-4ea1-ae91-83d3608d4826 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:35.696250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d779b6-5168-4ea1-ae91-83d3608d4826 None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:35.697152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d779b6-5168-4ea1-ae91-83d3608d4826 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:35.697388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d779b6-5168-4ea1-ae91-83d3608d4826 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:35.700099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d779b6-5168-4ea1-ae91-83d3608d4826 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:35.718713 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 537/1071] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Jul 16 20:46:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:35.722054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:35.724232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d779b6-5168-4ea1-ae91-83d3608d4826 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:35.794095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:35.811608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7016f-6d1b-49bb-bdb8-610243cc1cd3 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:35.843453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d779b6-5168-4ea1-ae91-83d3608d4826 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:35.857503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacffda-69ae-4399-8d4d-b72c0a2a6411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:35.858172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacffda-69ae-4399-8d4d-b72c0a2a6411 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:35.858453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacffda-69ae-4399-8d4d-b72c0a2a6411 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:35.858729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacffda-69ae-4399-8d4d-b72c0a2a6411 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:35.859494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacffda-69ae-4399-8d4d-b72c0a2a6411 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:35.859806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacffda-69ae-4399-8d4d-b72c0a2a6411 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:35.861185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacffda-69ae-4399-8d4d-b72c0a2a6411 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:35.877615 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 535/1072] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:35.888804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdda218-c35c-4b22-86e2-a4a5f943b7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:35.889667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdda218-c35c-4b22-86e2-a4a5f943b7d2 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:35.889988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdda218-c35c-4b22-86e2-a4a5f943b7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:35.890217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdda218-c35c-4b22-86e2-a4a5f943b7d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:35.903574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdda218-c35c-4b22-86e2-a4a5f943b7d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:35.905130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdda218-c35c-4b22-86e2-a4a5f943b7d2 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:35.925541 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-0fdda218-c35c-4b22-86e2-a4a5f943b7d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:35.925541 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:35.925541 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:35.925541 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:35.925541 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:35.925541 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:35.925541 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:35.925541 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:35.925541 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:35.925541 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:35.925541 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:35.925541 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:35.925541 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:46:35.925541 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:46:35.925541 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:46:35.926502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:46:35.926502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:35.926502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:35.926502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:35.926502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:35.926502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:35.926502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:35.926502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:35.926502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:35.926502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:35.926502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:35.926502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:35.926502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:35.926502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:35.926502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:35.926502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:35.926502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:35.927823 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:46:35.927823 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:46:35.927823 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:35.927823 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:35.931378 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 538/1073] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:46:35.933884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacffda-69ae-4399-8d4d-b72c0a2a6411 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:36.029431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:36.051247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacffda-69ae-4399-8d4d-b72c0a2a6411 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:36.094934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a0465-30a6-43ab-8dcf-e4294907dfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:36.096175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a0465-30a6-43ab-8dcf-e4294907dfcd None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:36.096725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a0465-30a6-43ab-8dcf-e4294907dfcd None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:36.097208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a0465-30a6-43ab-8dcf-e4294907dfcd None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:36.098555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a0465-30a6-43ab-8dcf-e4294907dfcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:36.099124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a0465-30a6-43ab-8dcf-e4294907dfcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:36.101680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a0465-30a6-43ab-8dcf-e4294907dfcd None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:36.116859 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 536/1074] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:36.123386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdda218-c35c-4b22-86e2-a4a5f943b7d2 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:36.249428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdda218-c35c-4b22-86e2-a4a5f943b7d2 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:36.265110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:36.295768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ffc46-e2a6-45a8-aa0b-16aae235bfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:36.415732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ffc46-e2a6-45a8-aa0b-16aae235bfe8 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:36.415732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ffc46-e2a6-45a8-aa0b-16aae235bfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:36.415732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ffc46-e2a6-45a8-aa0b-16aae235bfe8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:36.415732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ffc46-e2a6-45a8-aa0b-16aae235bfe8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:36.415732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ffc46-e2a6-45a8-aa0b-16aae235bfe8 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:36.415732 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-a16ffc46-e2a6-45a8-aa0b-16aae235bfe8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:46:36.415732 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:36.416368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:36.416368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:36.416368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:36.416368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:36.416368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:36.416368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:36.416368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:36.416368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:36.416368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:36.416368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:36.416368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:46:36.416368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:46:36.416368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:46:36.416368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:46:36.416368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:36.416368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:36.417464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:36.417464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:36.417464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:36.417464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:36.417464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:36.417464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:36.417464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:36.417464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:36.417464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:36.417464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:36.417464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:36.417464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:36.417464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:36.417464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:36.417464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:46:36.417464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:46:36.417464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:46:36.418427 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:46:36.418427 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:46:36.418427 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:46:36.418427 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:46:36.418427 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:36.418427 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 539/1075] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:46:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:46:36.418784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a0465-30a6-43ab-8dcf-e4294907dfcd None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:36.447373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a0465-30a6-43ab-8dcf-e4294907dfcd None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:36.486589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf03356-067d-432b-9a69-5e75e86d10ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:36.487370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf03356-067d-432b-9a69-5e75e86d10ca None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:36.487648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf03356-067d-432b-9a69-5e75e86d10ca None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:36.487917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf03356-067d-432b-9a69-5e75e86d10ca None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:36.488703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf03356-067d-432b-9a69-5e75e86d10ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:36.489052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf03356-067d-432b-9a69-5e75e86d10ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:36.491142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf03356-067d-432b-9a69-5e75e86d10ca None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:36.506188 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 537/1076] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:46:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:36.516835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ffc46-e2a6-45a8-aa0b-16aae235bfe8 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:36.582468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24f80d-2746-4c72-a124-e03f02d3c00b None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:36.582731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24f80d-2746-4c72-a124-e03f02d3c00b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:36.583036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24f80d-2746-4c72-a124-e03f02d3c00b None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:36.584417 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 538/1077] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:46:36.589685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53e11d-2ffb-422d-897e-7c4cf492cde9 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:36.589937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53e11d-2ffb-422d-897e-7c4cf492cde9 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:36.590209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53e11d-2ffb-422d-897e-7c4cf492cde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:36.595191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:36.608010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6f53e11d-2ffb-422d-897e-7c4cf492cde9 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:36.609225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6f53e11d-2ffb-422d-897e-7c4cf492cde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:36.617589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ffc46-e2a6-45a8-aa0b-16aae235bfe8 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:36.655106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f1030-d8e8-4772-b131-9266d75e23b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:36.655106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f1030-d8e8-4772-b131-9266d75e23b6 None admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:36.655106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f1030-d8e8-4772-b131-9266d75e23b6 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:36.655106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f1030-d8e8-4772-b131-9266d75e23b6 None admin] PATH_INFO: `/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/d5f515bfe2094b41afe82b4bc57e4b9a/roles/b7c95212d9564da9ba2366086bf22e5d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:36.657172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f1030-d8e8-4772-b131-9266d75e23b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3045a89835d4e879a0ddc2557b831a3, user_id=d5f515bfe2094b41afe82b4bc57e4b9a, role_id=b7c95212d9564da9ba2366086bf22e5d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:36.658628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f1030-d8e8-4772-b131-9266d75e23b6 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:36.682932 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 539/1078] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 16 20:46:36.707342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53e11d-2ffb-422d-897e-7c4cf492cde9 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:36.746479 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 540/1079] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:46:36 2022] PUT /identity/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/d5f515bfe2094b41afe82b4bc57e4b9a/roles/b7c95212d9564da9ba2366086bf22e5d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:46:36.821201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53e11d-2ffb-422d-897e-7c4cf492cde9 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:36.856316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:36.862513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036efb4-cd60-4083-befa-db6b44d16c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:36.862513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036efb4-cd60-4083-befa-db6b44d16c26 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:36.862827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036efb4-cd60-4083-befa-db6b44d16c26 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:36.862904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036efb4-cd60-4083-befa-db6b44d16c26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:36.876980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036efb4-cd60-4083-befa-db6b44d16c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:46:36.885495 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-f036efb4-cd60-4083-befa-db6b44d16c26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:46:36.885495 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:36.885495 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:36.885495 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:36.885495 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:36.885495 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:36.885495 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:36.885495 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:36.885495 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:36.885495 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:36.885495 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:36.885495 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:36.885495 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:46:36.885495 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:46:36.885495 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:46:36.885495 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:46:36.886840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:46:36.886840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:46:36.886840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:46:36.886840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:46:36.886840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:36.886840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:36.886840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:36.886840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:36.886840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:36.886840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:36.886840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:36.886840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:36.886840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:36.886840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:36.886840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:36.886840 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:36.887799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:36.887799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:36.887799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:36.887799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:36.887799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:46:36.887799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:46:36.887799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:46:36.887799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:46:36.887799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:46:36.887799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:46:36.887799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:46:36.887799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:36.887799 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 540/1080] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:46:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:46:36.894290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f1030-d8e8-4772-b131-9266d75e23b6 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:36.931223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:37.012437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f1030-d8e8-4772-b131-9266d75e23b6 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:37.052818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d058752-cd26-4a3d-883d-5429bc02b4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:37.053493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d058752-cd26-4a3d-883d-5429bc02b4b2 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:37.053780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d058752-cd26-4a3d-883d-5429bc02b4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:37.054058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d058752-cd26-4a3d-883d-5429bc02b4b2 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:37.054819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d058752-cd26-4a3d-883d-5429bc02b4b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:37.055153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d058752-cd26-4a3d-883d-5429bc02b4b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:37.056555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d058752-cd26-4a3d-883d-5429bc02b4b2 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:37.066014 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 541/1081] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:46:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:37.071992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036efb4-cd60-4083-befa-db6b44d16c26 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:37.178056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036efb4-cd60-4083-befa-db6b44d16c26 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:37.212748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44792e-e98b-4126-b408-6278874c4e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:37.213828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44792e-e98b-4126-b408-6278874c4e16 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:37.214108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44792e-e98b-4126-b408-6278874c4e16 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:37.214380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44792e-e98b-4126-b408-6278874c4e16 None admin] PATH_INFO: `/v3/users/86a43e52cde34b0aa7ec6249a0a37272` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:37.215607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44792e-e98b-4126-b408-6278874c4e16 None admin] RBAC: Authorizing `identity:get_user(user_id=86a43e52cde34b0aa7ec6249a0a37272)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:37.217045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44792e-e98b-4126-b408-6278874c4e16 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:37.218674 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 541/1082] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:46:37 2022] GET /identity/v3/users/86a43e52cde34b0aa7ec6249a0a37272 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:37.224515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d058752-cd26-4a3d-883d-5429bc02b4b2 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:37.317182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:37.326430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d058752-cd26-4a3d-883d-5429bc02b4b2 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:37.359878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c7b06-f27b-4f1e-9e35-8395c15e9f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:37.360728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c7b06-f27b-4f1e-9e35-8395c15e9f0a None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:37.361014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c7b06-f27b-4f1e-9e35-8395c15e9f0a None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:37.361287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c7b06-f27b-4f1e-9e35-8395c15e9f0a None admin] PATH_INFO: `/v3/projects/dd9d0e89ddfc4d8599c2ae2601e1a5c0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:37.362514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c7b06-f27b-4f1e-9e35-8395c15e9f0a None admin] RBAC: Authorizing `identity:get_project(project_id=dd9d0e89ddfc4d8599c2ae2601e1a5c0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:37.363976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c7b06-f27b-4f1e-9e35-8395c15e9f0a None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:37.365685 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 542/1083] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:46:37 2022] GET /identity/v3/projects/dd9d0e89ddfc4d8599c2ae2601e1a5c0 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:37.372257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44792e-e98b-4126-b408-6278874c4e16 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:37.431356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:37.474994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44792e-e98b-4126-b408-6278874c4e16 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:37.510868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8e00b-a72f-4ad2-8d69-5f8c06a266da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:37.511776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8e00b-a72f-4ad2-8d69-5f8c06a266da None admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:37.512078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8e00b-a72f-4ad2-8d69-5f8c06a266da None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:37.512349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8e00b-a72f-4ad2-8d69-5f8c06a266da None admin] PATH_INFO: `/v3/projects/dd9d0e89ddfc4d8599c2ae2601e1a5c0/users/86a43e52cde34b0aa7ec6249a0a37272/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:37.514535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8e00b-a72f-4ad2-8d69-5f8c06a266da None admin] RBAC: Authorizing `identity:create_grant(project_id=dd9d0e89ddfc4d8599c2ae2601e1a5c0, user_id=86a43e52cde34b0aa7ec6249a0a37272, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:37.516661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8e00b-a72f-4ad2-8d69-5f8c06a266da None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:37.588182 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 542/1084] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:46:37 2022] PUT /identity/v3/projects/dd9d0e89ddfc4d8599c2ae2601e1a5c0/users/86a43e52cde34b0aa7ec6249a0a37272/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:46:39.018579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6eaf0-f170-4ec2-8efb-959a2b15f2e2 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:39.019123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6eaf0-f170-4ec2-8efb-959a2b15f2e2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:39.019318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6eaf0-f170-4ec2-8efb-959a2b15f2e2 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:39.020838 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 543/1085] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:39.026200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da38194-cb4f-4516-aca2-b1f71564ca12 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:39.026806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da38194-cb4f-4516-aca2-b1f71564ca12 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:39.026806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da38194-cb4f-4516-aca2-b1f71564ca12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:39.044624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8da38194-cb4f-4516-aca2-b1f71564ca12 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:39.046545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8da38194-cb4f-4516-aca2-b1f71564ca12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:39.123261 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 543/1086] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:39.148193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6eaf0-f170-4ec2-8efb-959a2b15f2e2 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:39.249932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6eaf0-f170-4ec2-8efb-959a2b15f2e2 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:39.283751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c77108-a4cd-4ebd-b1e3-54c16e4c4851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:39.284549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c77108-a4cd-4ebd-b1e3-54c16e4c4851 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:39.284824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c77108-a4cd-4ebd-b1e3-54c16e4c4851 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:39.285094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c77108-a4cd-4ebd-b1e3-54c16e4c4851 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:39.295875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c77108-a4cd-4ebd-b1e3-54c16e4c4851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:46:39.303979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-97c77108-a4cd-4ebd-b1e3-54c16e4c4851 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 16 20:46:39.303979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:39.303979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:39.303979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:39.303979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:39.303979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:39.303979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:39.303979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:39.303979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:39.303979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:39.303979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:39.303979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:39.303979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:46:39.303979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:46:39.303979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:46:39.303979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:46:39.305055 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:46:39.305055 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:46:39.305055 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:46:39.305055 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:46:39.305055 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:39.305055 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:39.305055 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:39.305055 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:39.305055 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:39.305055 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:39.305055 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:39.305055 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:39.305055 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:39.305055 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:39.305055 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:39.305055 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:39.306401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:39.306401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:39.306401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:39.306401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:39.306401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:46:39.306401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:46:39.306401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:46:39.306401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:46:39.306401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:46:39.306401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:46:39.306401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 16 20:46:39.306401 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:39.306401 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 544/1087] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Jul 16 20:46:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:39.311796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da38194-cb4f-4516-aca2-b1f71564ca12 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:39.361812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:39.412172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da38194-cb4f-4516-aca2-b1f71564ca12 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:39.448283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41633e6b-178f-4eae-a21f-0482d3a3926e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:39.448950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41633e6b-178f-4eae-a21f-0482d3a3926e None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:39.449227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41633e6b-178f-4eae-a21f-0482d3a3926e None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:39.449497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41633e6b-178f-4eae-a21f-0482d3a3926e None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:39.450235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41633e6b-178f-4eae-a21f-0482d3a3926e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:39.450540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41633e6b-178f-4eae-a21f-0482d3a3926e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:39.451932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41633e6b-178f-4eae-a21f-0482d3a3926e None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:39.460085 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 544/1088] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Jul 16 20:46:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:39.466752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c77108-a4cd-4ebd-b1e3-54c16e4c4851 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:39.488826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:39.566732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c77108-a4cd-4ebd-b1e3-54c16e4c4851 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:39.600330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34068963-5048-4262-8141-9167c02740ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:39.601102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34068963-5048-4262-8141-9167c02740ba None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:39.601380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34068963-5048-4262-8141-9167c02740ba None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:39.601652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34068963-5048-4262-8141-9167c02740ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:39.612207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34068963-5048-4262-8141-9167c02740ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:39.613639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34068963-5048-4262-8141-9167c02740ba None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:39.631185 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-34068963-5048-4262-8141-9167c02740ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:39.631185 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:39.631185 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:39.631185 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:39.631185 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:39.631185 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:39.631185 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:39.631185 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:39.631185 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:39.631185 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:39.631185 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:39.631185 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:39.631185 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:46:39.631185 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:46:39.631185 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:46:39.632203 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:46:39.632203 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:39.632203 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:39.632203 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:39.632203 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:39.632203 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:39.632203 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:39.632203 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:39.632203 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:39.632203 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:39.632203 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:39.632203 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:39.632203 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:39.632203 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:39.632203 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:39.632203 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:39.632203 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:39.633133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:46:39.633133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:46:39.633133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:39.633133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:39.633133 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 545/1089] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:39.638373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41633e6b-178f-4eae-a21f-0482d3a3926e None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:39.743466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41633e6b-178f-4eae-a21f-0482d3a3926e None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:39.756186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:39.778147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3240fa-2a60-451c-ab94-a9929eb627e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:39.778924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3240fa-2a60-451c-ab94-a9929eb627e8 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:39.779238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3240fa-2a60-451c-ab94-a9929eb627e8 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:39.779509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3240fa-2a60-451c-ab94-a9929eb627e8 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:39.780355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3240fa-2a60-451c-ab94-a9929eb627e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:39.780627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3240fa-2a60-451c-ab94-a9929eb627e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:39.782019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3240fa-2a60-451c-ab94-a9929eb627e8 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:39.795270 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 545/1090] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:39.799675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34068963-5048-4262-8141-9167c02740ba None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:39.860023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf6263-50af-4135-aa9f-80be72e6317b None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:39.860345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf6263-50af-4135-aa9f-80be72e6317b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:39.860579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf6263-50af-4135-aa9f-80be72e6317b None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:39.862086 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 546/1091] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:46:39.867202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23efad7-7ded-4c54-9713-61634a24d3ca None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:39.867487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23efad7-7ded-4c54-9713-61634a24d3ca None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:39.867760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23efad7-7ded-4c54-9713-61634a24d3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:39.873800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:39.884383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c23efad7-7ded-4c54-9713-61634a24d3ca None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:39.886217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c23efad7-7ded-4c54-9713-61634a24d3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:39.905020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34068963-5048-4262-8141-9167c02740ba None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:39.938608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bc248-5fca-4cb4-b457-9ee51e51e2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:39.939454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bc248-5fca-4cb4-b457-9ee51e51e2ba None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:39.939785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bc248-5fca-4cb4-b457-9ee51e51e2ba None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:39.940061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bc248-5fca-4cb4-b457-9ee51e51e2ba None admin] PATH_INFO: `/v3/users/nova` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:39.948156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4bc248-5fca-4cb4-b457-9ee51e51e2ba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:39.949756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4bc248-5fca-4cb4-b457-9ee51e51e2ba None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:39.952819 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 547/1092] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 16 20:46:39.964635 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-7d4bc248-5fca-4cb4-b457-9ee51e51e2ba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 16 20:46:39.964635 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:39.964635 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:39.964635 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:39.964635 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:39.964635 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:39.964635 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:39.964635 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:39.964635 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:39.964635 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:39.964635 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:39.964635 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:39.964635 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:46:39.964635 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:46:39.964635 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:46:39.964635 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:46:39.971060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:39.971060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:39.971060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:46:39.971060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:46:39.971060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:46:39.971060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:46:39.971060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:39.971060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:39.971060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:39.971060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:39.971060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:39.971060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:39.971060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:39.971060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:39.971060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:39.971060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:39.971060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:39.971060 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:39.972016 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:39.972016 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:39.972016 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:46:39.972016 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:46:39.972016 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:46:39.972016 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:46:39.972016 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:46:39.972016 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:46:39.972016 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 16 20:46:39.972016 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:39.972016 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 546/1093] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Jul 16 20:46:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:46:39.972628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23efad7-7ded-4c54-9713-61634a24d3ca None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:39.978275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bc248-5fca-4cb4-b457-9ee51e51e2ba None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:40.072923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23efad7-7ded-4c54-9713-61634a24d3ca None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:40.074550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:40.079506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bc248-5fca-4cb4-b457-9ee51e51e2ba None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:40.108044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c0985-22f5-4468-984b-eca4c6ddd44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:40.108723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c0985-22f5-4468-984b-eca4c6ddd44e None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:40.108849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:40.109005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c0985-22f5-4468-984b-eca4c6ddd44e None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:40.109284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c0985-22f5-4468-984b-eca4c6ddd44e None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:40.110113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c0985-22f5-4468-984b-eca4c6ddd44e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:40.110419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c0985-22f5-4468-984b-eca4c6ddd44e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:40.111874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c0985-22f5-4468-984b-eca4c6ddd44e None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:40.113524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fcc90-a686-4a0d-b439-dbe4f9ff9601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:40.114302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fcc90-a686-4a0d-b439-dbe4f9ff9601 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:40.114578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fcc90-a686-4a0d-b439-dbe4f9ff9601 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:40.114850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fcc90-a686-4a0d-b439-dbe4f9ff9601 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:40.127547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fcc90-a686-4a0d-b439-dbe4f9ff9601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:46:40.135760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-305fcc90-a686-4a0d-b439-dbe4f9ff9601 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:46:40.135760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:40.135760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:40.135760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:40.135760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:40.135760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:40.135760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:40.135760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:40.135760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:40.135760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:40.135760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:40.135760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:40.135760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:46:40.135760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:46:40.135760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:46:40.135760 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:46:40.136850 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:46:40.136850 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:46:40.136850 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:46:40.136850 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:46:40.136850 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:40.136850 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:40.136850 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:40.136850 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:40.136850 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:40.136850 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:40.136850 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:40.136850 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:40.136850 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:40.136850 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:40.136850 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:40.136850 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:40.137805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:40.137805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:40.137805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:40.137805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:40.137805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:46:40.137805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:46:40.137805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:46:40.137805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:46:40.137805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:46:40.137805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:46:40.137805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:46:40.137805 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:46:40.137805 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 547/1094] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:46:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:46:40.143418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fcc90-a686-4a0d-b439-dbe4f9ff9601 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:40.202174 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 548/1095] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Jul 16 20:46:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:40.208080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c0985-22f5-4468-984b-eca4c6ddd44e None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:40.241335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fcc90-a686-4a0d-b439-dbe4f9ff9601 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:40.276466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64188a5-da10-48ab-abb0-1742a68ffb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:40.282752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64188a5-da10-48ab-abb0-1742a68ffb78 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:40.282752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64188a5-da10-48ab-abb0-1742a68ffb78 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:40.282752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64188a5-da10-48ab-abb0-1742a68ffb78 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:40.282752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64188a5-da10-48ab-abb0-1742a68ffb78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:40.282752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64188a5-da10-48ab-abb0-1742a68ffb78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:40.282752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64188a5-da10-48ab-abb0-1742a68ffb78 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:40.288558 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 548/1096] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:46:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:40.294747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64188a5-da10-48ab-abb0-1742a68ffb78 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:40.308733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c0985-22f5-4468-984b-eca4c6ddd44e None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:40.344017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afb789-4d40-40fa-b057-39a2d8183c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:40.344578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afb789-4d40-40fa-b057-39a2d8183c1e None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:40.344858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afb789-4d40-40fa-b057-39a2d8183c1e None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:40.345132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afb789-4d40-40fa-b057-39a2d8183c1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:40.351534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:40.374116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:40.397319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64188a5-da10-48ab-abb0-1742a68ffb78 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:40.413672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afb789-4d40-40fa-b057-39a2d8183c1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:40.415374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afb789-4d40-40fa-b057-39a2d8183c1e None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:40.431438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee640b-ff19-45a3-9e72-4d1a5951e40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:40.433116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee640b-ff19-45a3-9e72-4d1a5951e40b None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:40.433819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee640b-ff19-45a3-9e72-4d1a5951e40b None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:40.433819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee640b-ff19-45a3-9e72-4d1a5951e40b None admin] PATH_INFO: `/v3/users/86a43e52cde34b0aa7ec6249a0a37272` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:40.434884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee640b-ff19-45a3-9e72-4d1a5951e40b None admin] RBAC: Authorizing `identity:get_user(user_id=86a43e52cde34b0aa7ec6249a0a37272)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:40.436349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee640b-ff19-45a3-9e72-4d1a5951e40b None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:40.438067 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 549/1097] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:46:40 2022] GET /identity/v3/users/86a43e52cde34b0aa7ec6249a0a37272 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:40.444023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee640b-ff19-45a3-9e72-4d1a5951e40b None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:40.515998 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 549/1098] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:46:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 16 20:46:40.521765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afb789-4d40-40fa-b057-39a2d8183c1e None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:40.545490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee640b-ff19-45a3-9e72-4d1a5951e40b None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:40.568735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:40.580339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:40.580493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bd040-1ee6-4630-b5b2-9bbb28ae6699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:40.581014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bd040-1ee6-4630-b5b2-9bbb28ae6699 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:40.581268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bd040-1ee6-4630-b5b2-9bbb28ae6699 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:40.581541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bd040-1ee6-4630-b5b2-9bbb28ae6699 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:40.621333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afb789-4d40-40fa-b057-39a2d8183c1e None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:40.653717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14bd040-1ee6-4630-b5b2-9bbb28ae6699 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:40.655251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14bd040-1ee6-4630-b5b2-9bbb28ae6699 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:40.656152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3f5e0-a0c3-4096-83a5-4c859582e3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:40.656938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3f5e0-a0c3-4096-83a5-4c859582e3b1 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:40.657215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3f5e0-a0c3-4096-83a5-4c859582e3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:40.657487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3f5e0-a0c3-4096-83a5-4c859582e3b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:40.667964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3f5e0-a0c3-4096-83a5-4c859582e3b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:40.669879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3f5e0-a0c3-4096-83a5-4c859582e3b1 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:40.687896 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-34c3f5e0-a0c3-4096-83a5-4c859582e3b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:40.687896 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:40.687896 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:40.687896 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:40.687896 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:40.687896 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:40.687896 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:40.687896 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:40.687896 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:40.687896 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:40.687896 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:40.687896 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:40.687896 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:46:40.687896 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:46:40.687896 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:46:40.689315 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:46:40.689315 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:40.689315 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:40.689315 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:40.689315 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:40.689315 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:40.689315 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:40.689315 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:40.689315 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:40.689315 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:40.689315 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:40.689315 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:40.689315 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:40.689315 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:40.689315 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:40.689315 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:40.689315 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:40.690435 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:46:40.690435 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:46:40.690435 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:46:40.690435 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:40.690435 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 550/1099] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:46:40.694936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3f5e0-a0c3-4096-83a5-4c859582e3b1 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:40.760599 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 550/1100] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:46:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 16 20:46:40.766654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bd040-1ee6-4630-b5b2-9bbb28ae6699 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:40.790666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:40.798973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3f5e0-a0c3-4096-83a5-4c859582e3b1 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:40.812715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:40.833898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ba9c8-0c3b-4546-99a9-bab932c85b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:40.834555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ba9c8-0c3b-4546-99a9-bab932c85b0d None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:40.834834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ba9c8-0c3b-4546-99a9-bab932c85b0d None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:40.835144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ba9c8-0c3b-4546-99a9-bab932c85b0d None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:40.835861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ba9c8-0c3b-4546-99a9-bab932c85b0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:40.836166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ba9c8-0c3b-4546-99a9-bab932c85b0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:40.837535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ba9c8-0c3b-4546-99a9-bab932c85b0d None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:40.849807 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 551/1101] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:40.855621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ba9c8-0c3b-4546-99a9-bab932c85b0d None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:40.871682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bd040-1ee6-4630-b5b2-9bbb28ae6699 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:40.907377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e38f46-238a-493a-a5e0-8419a3ad65e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:40.908232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e38f46-238a-493a-a5e0-8419a3ad65e0 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:40.908516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e38f46-238a-493a-a5e0-8419a3ad65e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:40.908903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e38f46-238a-493a-a5e0-8419a3ad65e0 None admin] PATH_INFO: `/v3/projects/dd9d0e89ddfc4d8599c2ae2601e1a5c0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:40.910540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e38f46-238a-493a-a5e0-8419a3ad65e0 None admin] RBAC: Authorizing `identity:get_project(project_id=dd9d0e89ddfc4d8599c2ae2601e1a5c0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:40.912070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e38f46-238a-493a-a5e0-8419a3ad65e0 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:40.913788 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 551/1102] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:46:40 2022] GET /identity/v3/projects/dd9d0e89ddfc4d8599c2ae2601e1a5c0 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:40.952429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e38f46-238a-493a-a5e0-8419a3ad65e0 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:40.958527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ba9c8-0c3b-4546-99a9-bab932c85b0d None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:40.992172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a90139-b1dc-4122-a4ba-a763ed1a6679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:40.992952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a90139-b1dc-4122-a4ba-a763ed1a6679 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:40.993227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a90139-b1dc-4122-a4ba-a763ed1a6679 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:40.993492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a90139-b1dc-4122-a4ba-a763ed1a6679 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:41.000947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a90139-b1dc-4122-a4ba-a763ed1a6679 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:41.002410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a90139-b1dc-4122-a4ba-a763ed1a6679 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:41.016075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:41.017256 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-85a90139-b1dc-4122-a4ba-a763ed1a6679 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:46:41.017256 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:46:41.017256 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:46:41.017256 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:46:41.017256 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:46:41.017256 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:46:41.017256 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:46:41.017256 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:46:41.017256 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:46:41.017256 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:46:41.017256 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:46:41.017256 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:46:41.017256 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:46:41.017256 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:46:41.017256 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:46:41.018186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:46:41.018186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:46:41.018186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:46:41.018186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:46:41.018186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:46:41.018186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:46:41.018186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:46:41.018186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:46:41.018186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:46:41.018186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:46:41.018186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:46:41.018186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:46:41.018186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:46:41.018186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:46:41.018186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:46:41.018186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:46:41.018186 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:46:41.019071 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:46:41.019071 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:46:41.019071 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:46:41.019071 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:46:41.019071 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:46:41.019071 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:46:41.019071 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:46:41.019071 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:46:41.019071 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 552/1103] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:46:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 20:46:41.024367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a90139-b1dc-4122-a4ba-a763ed1a6679 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:41.026186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e38f46-238a-493a-a5e0-8419a3ad65e0 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:41.054203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:41.060981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b81da2-6ce5-40ca-96b0-509e64fec4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:41.065596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b81da2-6ce5-40ca-96b0-509e64fec4b5 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:41.065596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b81da2-6ce5-40ca-96b0-509e64fec4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:41.065596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b81da2-6ce5-40ca-96b0-509e64fec4b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:41.065596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b81da2-6ce5-40ca-96b0-509e64fec4b5 None admin] RBAC: Adding query filter params (role.id=bd33b827674a4d4db30c164cab416056, scope.project.id=dd9d0e89ddfc4d8599c2ae2601e1a5c0, user.id=86a43e52cde34b0aa7ec6249a0a37272) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:41.065596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b81da2-6ce5-40ca-96b0-509e64fec4b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:41.065596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b81da2-6ce5-40ca-96b0-509e64fec4b5 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:41.070728 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 552/1104] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:46:40 2022] GET /identity/v3/role_assignments?user.id=86a43e52cde34b0aa7ec6249a0a37272&scope.project.id=dd9d0e89ddfc4d8599c2ae2601e1a5c0&role.id=bd33b827674a4d4db30c164cab416056 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:41.129613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a90139-b1dc-4122-a4ba-a763ed1a6679 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:41.167249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018b5b5-438b-43ae-847b-2a41f1b19811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:41.167924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018b5b5-438b-43ae-847b-2a41f1b19811 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:41.168204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018b5b5-438b-43ae-847b-2a41f1b19811 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:41.168475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018b5b5-438b-43ae-847b-2a41f1b19811 None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:41.169336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018b5b5-438b-43ae-847b-2a41f1b19811 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:41.169644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018b5b5-438b-43ae-847b-2a41f1b19811 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:41.171237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018b5b5-438b-43ae-847b-2a41f1b19811 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:41.184912 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 553/1105] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:46:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:41.191309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b81da2-6ce5-40ca-96b0-509e64fec4b5 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:41.300159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b81da2-6ce5-40ca-96b0-509e64fec4b5 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:41.336055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b08d0-b786-493a-a411-99e1880a017a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:41.336704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b08d0-b786-493a-a411-99e1880a017a None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:41.336985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b08d0-b786-493a-a411-99e1880a017a None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:41.337257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b08d0-b786-493a-a411-99e1880a017a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:41.338709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b08d0-b786-493a-a411-99e1880a017a None admin] RBAC: Adding query filter params (role.id=b7c95212d9564da9ba2366086bf22e5d, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=d5f515bfe2094b41afe82b4bc57e4b9a) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:41.339119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b08d0-b786-493a-a411-99e1880a017a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:41.340528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b08d0-b786-493a-a411-99e1880a017a None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:41.346634 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 553/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:46:41 2022] GET /identity/v3/role_assignments?user.id=d5f515bfe2094b41afe82b4bc57e4b9a&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=b7c95212d9564da9ba2366086bf22e5d => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:43.394877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720edad-a1df-4985-908c-9b6a5b5ad712 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:43.395446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720edad-a1df-4985-908c-9b6a5b5ad712 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:43.395446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720edad-a1df-4985-908c-9b6a5b5ad712 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:43.396827 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 554/1107] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:43.402720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b43d38-cd0e-4366-a903-33061e9a7a44 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:43.403213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b43d38-cd0e-4366-a903-33061e9a7a44 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:43.403425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b43d38-cd0e-4366-a903-33061e9a7a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:43.420526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b7b43d38-cd0e-4366-a903-33061e9a7a44 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:43.421741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b7b43d38-cd0e-4366-a903-33061e9a7a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:43.435447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:43.488487 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 554/1108] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:43.514848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720edad-a1df-4985-908c-9b6a5b5ad712 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:43.605949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:43.615152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720edad-a1df-4985-908c-9b6a5b5ad712 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:43.649109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6151cb-2a2b-4822-aa6d-f4f975964e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:43.649836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6151cb-2a2b-4822-aa6d-f4f975964e0c None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:43.650115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6151cb-2a2b-4822-aa6d-f4f975964e0c None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:43.650446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6151cb-2a2b-4822-aa6d-f4f975964e0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:43.651656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6151cb-2a2b-4822-aa6d-f4f975964e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:43.653078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6151cb-2a2b-4822-aa6d-f4f975964e0c None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:43.654700 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 555/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:43.660574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b43d38-cd0e-4366-a903-33061e9a7a44 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:43.758885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b43d38-cd0e-4366-a903-33061e9a7a44 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:43.792918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8152f-a190-41ee-93e3-5814e922ddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:43.793594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8152f-a190-41ee-93e3-5814e922ddf4 None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:43.793877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8152f-a190-41ee-93e3-5814e922ddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:43.794152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8152f-a190-41ee-93e3-5814e922ddf4 None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:43.794864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8152f-a190-41ee-93e3-5814e922ddf4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:43.796352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8152f-a190-41ee-93e3-5814e922ddf4 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:43.897314 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 555/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Jul 16 20:46:43 2022] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 20:46:46.182906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb798481-c549-4a4c-b27c-67e0f4d77cdf None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:46.183440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb798481-c549-4a4c-b27c-67e0f4d77cdf None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:46.183440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb798481-c549-4a4c-b27c-67e0f4d77cdf None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:46.184769 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 556/1111] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:46.190915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea00f1-c9dd-4b12-a3b6-195f501b9bac None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:46.191354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea00f1-c9dd-4b12-a3b6-195f501b9bac None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:46.191499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea00f1-c9dd-4b12-a3b6-195f501b9bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:46.197654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:46.225438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-81ea00f1-c9dd-4b12-a3b6-195f501b9bac None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:46.226640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-81ea00f1-c9dd-4b12-a3b6-195f501b9bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:46.295071 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 556/1112] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:46.319954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb798481-c549-4a4c-b27c-67e0f4d77cdf None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:46.424215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb798481-c549-4a4c-b27c-67e0f4d77cdf None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:46.459548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972439e-d2e0-49f5-bc73-aa2255d9d994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:46.460333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972439e-d2e0-49f5-bc73-aa2255d9d994 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:46.460629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972439e-d2e0-49f5-bc73-aa2255d9d994 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:46.460913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972439e-d2e0-49f5-bc73-aa2255d9d994 None admin] PATH_INFO: `/v3/roles/b9444da176484ccfa45d6b85220ce558` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:46.462458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972439e-d2e0-49f5-bc73-aa2255d9d994 None admin] RBAC: Authorizing `identity:get_role(role_id=b9444da176484ccfa45d6b85220ce558)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:46.464046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972439e-d2e0-49f5-bc73-aa2255d9d994 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:46.465429 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 557/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:46:46 2022] GET /identity/v3/roles/b9444da176484ccfa45d6b85220ce558 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:46.471510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea00f1-c9dd-4b12-a3b6-195f501b9bac None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:46.570753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea00f1-c9dd-4b12-a3b6-195f501b9bac None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:46.604597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd74bd7-9423-4d3b-94cc-035c1e408c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:46.605398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd74bd7-9423-4d3b-94cc-035c1e408c34 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:46.605680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd74bd7-9423-4d3b-94cc-035c1e408c34 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:46.605950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd74bd7-9423-4d3b-94cc-035c1e408c34 None admin] PATH_INFO: `/v3/users/830c855c4c7a4c8684fa2b267aeb3abe` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:46.607847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:46.620578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd74bd7-9423-4d3b-94cc-035c1e408c34 None admin] RBAC: Authorizing `identity:get_user(user_id=830c855c4c7a4c8684fa2b267aeb3abe)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:46.622027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd74bd7-9423-4d3b-94cc-035c1e408c34 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:46.623715 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 557/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:46:46 2022] GET /identity/v3/users/830c855c4c7a4c8684fa2b267aeb3abe => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:46.629499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972439e-d2e0-49f5-bc73-aa2255d9d994 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:46.657857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:46.729304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972439e-d2e0-49f5-bc73-aa2255d9d994 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:46.763502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e39f1f-d75e-48f0-9006-6dea69931b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:46.764133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e39f1f-d75e-48f0-9006-6dea69931b84 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:46.764414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e39f1f-d75e-48f0-9006-6dea69931b84 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:46.764687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e39f1f-d75e-48f0-9006-6dea69931b84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:46.833361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e39f1f-d75e-48f0-9006-6dea69931b84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:46.834821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e39f1f-d75e-48f0-9006-6dea69931b84 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:46.861765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:46.933503 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 558/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:46:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 16 20:46:46.939644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd74bd7-9423-4d3b-94cc-035c1e408c34 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:47.036767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd74bd7-9423-4d3b-94cc-035c1e408c34 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:47.070630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3f2a4-0b69-4b60-b6bd-a0f001ed4df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:47.071509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3f2a4-0b69-4b60-b6bd-a0f001ed4df1 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:47.071787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3f2a4-0b69-4b60-b6bd-a0f001ed4df1 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:47.072256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3f2a4-0b69-4b60-b6bd-a0f001ed4df1 None admin] PATH_INFO: `/v3/projects/dd9d0e89ddfc4d8599c2ae2601e1a5c0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:47.073431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3f2a4-0b69-4b60-b6bd-a0f001ed4df1 None admin] RBAC: Authorizing `identity:get_project(project_id=dd9d0e89ddfc4d8599c2ae2601e1a5c0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:47.074860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3f2a4-0b69-4b60-b6bd-a0f001ed4df1 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:47.076602 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 558/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:46:46 2022] GET /identity/v3/projects/dd9d0e89ddfc4d8599c2ae2601e1a5c0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:47.082853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e39f1f-d75e-48f0-9006-6dea69931b84 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:47.183953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e39f1f-d75e-48f0-9006-6dea69931b84 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:47.210309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:47.218641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3d162-497d-4331-8584-46712ce020d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:47.219316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3d162-497d-4331-8584-46712ce020d0 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:47.220813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3d162-497d-4331-8584-46712ce020d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:47.220813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3d162-497d-4331-8584-46712ce020d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:47.220813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3d162-497d-4331-8584-46712ce020d0 None admin] RBAC: Adding query filter params (role.id=b9444da176484ccfa45d6b85220ce558, scope.project.id=dd9d0e89ddfc4d8599c2ae2601e1a5c0, user.id=830c855c4c7a4c8684fa2b267aeb3abe) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:47.221122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3d162-497d-4331-8584-46712ce020d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:47.222558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3d162-497d-4331-8584-46712ce020d0 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:47.228013 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 559/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:46:47 2022] GET /identity/v3/role_assignments?user.id=830c855c4c7a4c8684fa2b267aeb3abe&scope.project.id=dd9d0e89ddfc4d8599c2ae2601e1a5c0&role.id=b9444da176484ccfa45d6b85220ce558 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:49.448570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0f136-6e19-4e2b-9bb7-046872d1296d None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:49.449162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0f136-6e19-4e2b-9bb7-046872d1296d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:49.449162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0f136-6e19-4e2b-9bb7-046872d1296d None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:49.450477 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 559/1118] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:49.455671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391261f7-ae8e-4a0d-a6b5-a8457c94a2d1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:49.456070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391261f7-ae8e-4a0d-a6b5-a8457c94a2d1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:49.456212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391261f7-ae8e-4a0d-a6b5-a8457c94a2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:49.473272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-391261f7-ae8e-4a0d-a6b5-a8457c94a2d1 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:49.474461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-391261f7-ae8e-4a0d-a6b5-a8457c94a2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:49.538832 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 560/1119] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:49.562901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0f136-6e19-4e2b-9bb7-046872d1296d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:49.623505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:49.662902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0f136-6e19-4e2b-9bb7-046872d1296d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:49.697129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a43ca6-4288-4cff-b52b-294857bbfcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:49.697977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a43ca6-4288-4cff-b52b-294857bbfcd0 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:49.698255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a43ca6-4288-4cff-b52b-294857bbfcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:49.698526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a43ca6-4288-4cff-b52b-294857bbfcd0 None admin] PATH_INFO: `/v3/roles/b9444da176484ccfa45d6b85220ce558` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:49.700104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a43ca6-4288-4cff-b52b-294857bbfcd0 None admin] RBAC: Authorizing `identity:get_role(role_id=b9444da176484ccfa45d6b85220ce558)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:49.701412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a43ca6-4288-4cff-b52b-294857bbfcd0 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:49.702782 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 560/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:46:49 2022] GET /identity/v3/roles/b9444da176484ccfa45d6b85220ce558 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:49.708679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391261f7-ae8e-4a0d-a6b5-a8457c94a2d1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:49.805593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391261f7-ae8e-4a0d-a6b5-a8457c94a2d1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:49.828780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:49.840923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1fff9-1305-4aaa-a322-6e4dd9898ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:49.844686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1fff9-1305-4aaa-a322-6e4dd9898ed4 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:49.844686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1fff9-1305-4aaa-a322-6e4dd9898ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:49.844686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1fff9-1305-4aaa-a322-6e4dd9898ed4 None admin] PATH_INFO: `/v3/users/830c855c4c7a4c8684fa2b267aeb3abe` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:49.844686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1fff9-1305-4aaa-a322-6e4dd9898ed4 None admin] RBAC: Authorizing `identity:get_user(user_id=830c855c4c7a4c8684fa2b267aeb3abe)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:49.845037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1fff9-1305-4aaa-a322-6e4dd9898ed4 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:49.846594 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 561/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:46:49 2022] GET /identity/v3/users/830c855c4c7a4c8684fa2b267aeb3abe => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:49.852398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a43ca6-4288-4cff-b52b-294857bbfcd0 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:49.951556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a43ca6-4288-4cff-b52b-294857bbfcd0 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:49.977603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:49.985984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287651b-7817-4000-9c4e-aaa85d91b5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:49.993568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287651b-7817-4000-9c4e-aaa85d91b5e2 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:49.993568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287651b-7817-4000-9c4e-aaa85d91b5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:49.993568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287651b-7817-4000-9c4e-aaa85d91b5e2 None admin] PATH_INFO: `/v3/projects/dd9d0e89ddfc4d8599c2ae2601e1a5c0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:49.993568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287651b-7817-4000-9c4e-aaa85d91b5e2 None admin] RBAC: Authorizing `identity:get_project(project_id=dd9d0e89ddfc4d8599c2ae2601e1a5c0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:49.993568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287651b-7817-4000-9c4e-aaa85d91b5e2 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:49.993568 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 561/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:46:49 2022] GET /identity/v3/projects/dd9d0e89ddfc4d8599c2ae2601e1a5c0 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:49.998134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1fff9-1305-4aaa-a322-6e4dd9898ed4 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:50.095893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1fff9-1305-4aaa-a322-6e4dd9898ed4 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:50.129684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933b1c2-ef0d-4c62-9808-2cbc0cb26b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:50.130553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933b1c2-ef0d-4c62-9808-2cbc0cb26b0a None admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:50.130832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933b1c2-ef0d-4c62-9808-2cbc0cb26b0a None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:50.131134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933b1c2-ef0d-4c62-9808-2cbc0cb26b0a None admin] PATH_INFO: `/v3/projects/dd9d0e89ddfc4d8599c2ae2601e1a5c0/users/830c855c4c7a4c8684fa2b267aeb3abe/roles/b9444da176484ccfa45d6b85220ce558` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:50.133586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933b1c2-ef0d-4c62-9808-2cbc0cb26b0a None admin] RBAC: Authorizing `identity:create_grant(project_id=dd9d0e89ddfc4d8599c2ae2601e1a5c0, user_id=830c855c4c7a4c8684fa2b267aeb3abe, role_id=b9444da176484ccfa45d6b85220ce558)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:50.135072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933b1c2-ef0d-4c62-9808-2cbc0cb26b0a None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:50.214350 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 562/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:46:49 2022] PUT /identity/v3/projects/dd9d0e89ddfc4d8599c2ae2601e1a5c0/users/830c855c4c7a4c8684fa2b267aeb3abe/roles/b9444da176484ccfa45d6b85220ce558 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:46:52.435074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bf798-06dc-4425-9d40-5f2b395a83b8 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:52.435667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bf798-06dc-4425-9d40-5f2b395a83b8 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:52.435667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bf798-06dc-4425-9d40-5f2b395a83b8 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:52.436971 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 562/1124] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:52.442215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf41c94-42f7-4378-beac-1b9790b7bca9 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:52.442600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf41c94-42f7-4378-beac-1b9790b7bca9 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:52.442771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf41c94-42f7-4378-beac-1b9790b7bca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:52.459642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5bf41c94-42f7-4378-beac-1b9790b7bca9 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:52.460818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5bf41c94-42f7-4378-beac-1b9790b7bca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:52.505700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:52.527339 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 563/1125] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:52.551754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bf798-06dc-4425-9d40-5f2b395a83b8 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:52.652735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bf798-06dc-4425-9d40-5f2b395a83b8 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:52.685987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e9b4c-c41d-441a-abfa-d753f547ff14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:52.686753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e9b4c-c41d-441a-abfa-d753f547ff14 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:52.687111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e9b4c-c41d-441a-abfa-d753f547ff14 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:52.687387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e9b4c-c41d-441a-abfa-d753f547ff14 None admin] PATH_INFO: `/v3/roles/b9444da176484ccfa45d6b85220ce558` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:52.688844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e9b4c-c41d-441a-abfa-d753f547ff14 None admin] RBAC: Authorizing `identity:get_role(role_id=b9444da176484ccfa45d6b85220ce558)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:52.690205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e9b4c-c41d-441a-abfa-d753f547ff14 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:52.691590 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 563/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:46:52 2022] GET /identity/v3/roles/b9444da176484ccfa45d6b85220ce558 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:52.697378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf41c94-42f7-4378-beac-1b9790b7bca9 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:52.795315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf41c94-42f7-4378-beac-1b9790b7bca9 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:52.830022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bb5b0-e7f7-4b61-adcc-7d7dc1b6f978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:52.830878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bb5b0-e7f7-4b61-adcc-7d7dc1b6f978 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:52.831192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bb5b0-e7f7-4b61-adcc-7d7dc1b6f978 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:52.831467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bb5b0-e7f7-4b61-adcc-7d7dc1b6f978 None admin] PATH_INFO: `/v3/users/830c855c4c7a4c8684fa2b267aeb3abe` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:52.832657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bb5b0-e7f7-4b61-adcc-7d7dc1b6f978 None admin] RBAC: Authorizing `identity:get_user(user_id=830c855c4c7a4c8684fa2b267aeb3abe)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:52.834094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bb5b0-e7f7-4b61-adcc-7d7dc1b6f978 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:52.835808 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 564/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:46:52 2022] GET /identity/v3/users/830c855c4c7a4c8684fa2b267aeb3abe => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:52.842146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e9b4c-c41d-441a-abfa-d753f547ff14 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:52.904967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:52.942162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e9b4c-c41d-441a-abfa-d753f547ff14 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:52.975975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60685664-3f2c-4b4e-b8cf-feaedb58f377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:52.976611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60685664-3f2c-4b4e-b8cf-feaedb58f377 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:52.976893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60685664-3f2c-4b4e-b8cf-feaedb58f377 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:52.977165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60685664-3f2c-4b4e-b8cf-feaedb58f377 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:53.043985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60685664-3f2c-4b4e-b8cf-feaedb58f377 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:53.045408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60685664-3f2c-4b4e-b8cf-feaedb58f377 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:53.105123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:53.143421 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 564/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:46:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 16 20:46:53.149317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bb5b0-e7f7-4b61-adcc-7d7dc1b6f978 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:53.199850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:53.250887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bb5b0-e7f7-4b61-adcc-7d7dc1b6f978 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:53.284215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23e4ad-18a7-48e5-8f71-65d2fa5b3ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:53.285057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23e4ad-18a7-48e5-8f71-65d2fa5b3ff0 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:53.285336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23e4ad-18a7-48e5-8f71-65d2fa5b3ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:53.285610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23e4ad-18a7-48e5-8f71-65d2fa5b3ff0 None admin] PATH_INFO: `/v3/projects/dd9d0e89ddfc4d8599c2ae2601e1a5c0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:53.286786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23e4ad-18a7-48e5-8f71-65d2fa5b3ff0 None admin] RBAC: Authorizing `identity:get_project(project_id=dd9d0e89ddfc4d8599c2ae2601e1a5c0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:53.288260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23e4ad-18a7-48e5-8f71-65d2fa5b3ff0 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:53.289997 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 565/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:46:53 2022] GET /identity/v3/projects/dd9d0e89ddfc4d8599c2ae2601e1a5c0 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:53.297037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60685664-3f2c-4b4e-b8cf-feaedb58f377 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:53.393132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60685664-3f2c-4b4e-b8cf-feaedb58f377 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:53.426691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5121f1-b0ed-4fec-934b-5bef2b7c525c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:53.427347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5121f1-b0ed-4fec-934b-5bef2b7c525c None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:53.427624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5121f1-b0ed-4fec-934b-5bef2b7c525c None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:53.427893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5121f1-b0ed-4fec-934b-5bef2b7c525c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:53.428829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5121f1-b0ed-4fec-934b-5bef2b7c525c None admin] RBAC: Adding query filter params (role.id=b9444da176484ccfa45d6b85220ce558, scope.project.id=dd9d0e89ddfc4d8599c2ae2601e1a5c0, user.id=830c855c4c7a4c8684fa2b267aeb3abe) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:46:53.429137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5121f1-b0ed-4fec-934b-5bef2b7c525c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:53.430551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5121f1-b0ed-4fec-934b-5bef2b7c525c None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:53.437059 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 565/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:46:53 2022] GET /identity/v3/role_assignments?user.id=830c855c4c7a4c8684fa2b267aeb3abe&scope.project.id=dd9d0e89ddfc4d8599c2ae2601e1a5c0&role.id=b9444da176484ccfa45d6b85220ce558 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:55.717426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdedb2-0012-47c1-970d-f7a419bab11d None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:55.717980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdedb2-0012-47c1-970d-f7a419bab11d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:55.718080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdedb2-0012-47c1-970d-f7a419bab11d None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:55.719430 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 566/1131] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:55.724539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200eb0f-f547-437a-9f7e-10be8950a6d4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:55.724966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200eb0f-f547-437a-9f7e-10be8950a6d4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:55.725081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200eb0f-f547-437a-9f7e-10be8950a6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:55.742142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7200eb0f-f547-437a-9f7e-10be8950a6d4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:55.749442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7200eb0f-f547-437a-9f7e-10be8950a6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:55.766482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:55.812563 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 566/1132] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:55.836850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdedb2-0012-47c1-970d-f7a419bab11d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:55.937755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdedb2-0012-47c1-970d-f7a419bab11d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:55.953543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:55.971228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13de60-6d78-4473-9314-b68d9037b5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:55.972044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13de60-6d78-4473-9314-b68d9037b5cf None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:55.972257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13de60-6d78-4473-9314-b68d9037b5cf None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:55.972526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13de60-6d78-4473-9314-b68d9037b5cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:55.973667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13de60-6d78-4473-9314-b68d9037b5cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:55.975108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13de60-6d78-4473-9314-b68d9037b5cf None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:55.976711 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 567/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:46:55.983798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200eb0f-f547-437a-9f7e-10be8950a6d4 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:56.079180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200eb0f-f547-437a-9f7e-10be8950a6d4 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:56.113082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749c5d0-86bf-401b-87b8-caf2f0e2f51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:56.113731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749c5d0-86bf-401b-87b8-caf2f0e2f51e None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:56.114009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749c5d0-86bf-401b-87b8-caf2f0e2f51e None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:56.114283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749c5d0-86bf-401b-87b8-caf2f0e2f51e None admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:56.115044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749c5d0-86bf-401b-87b8-caf2f0e2f51e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:56.116452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749c5d0-86bf-401b-87b8-caf2f0e2f51e None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:56.215493 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 567/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Jul 16 20:46:55 2022] POST /identity/v3/projects => generated 311 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:46:58.510212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e3569-c001-4316-825b-55c717efea25 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:58.510775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e3569-c001-4316-825b-55c717efea25 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:58.510775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e3569-c001-4316-825b-55c717efea25 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:58.513088 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 568/1135] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:46:58.517646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb9b11-be68-4d47-bc10-472340b2fcdb None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:58.518074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb9b11-be68-4d47-bc10-472340b2fcdb None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:58.518195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb9b11-be68-4d47-bc10-472340b2fcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:58.534872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0bcb9b11-be68-4d47-bc10-472340b2fcdb None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:46:58.536063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0bcb9b11-be68-4d47-bc10-472340b2fcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:46:58.538776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:58.602574 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 568/1136] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:46:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:46:58.629894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e3569-c001-4316-825b-55c717efea25 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:58.731486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e3569-c001-4316-825b-55c717efea25 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:58.764947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9778be-ef1e-47cc-9833-c10800efcfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:58.765647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9778be-ef1e-47cc-9833-c10800efcfa3 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:58.766006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9778be-ef1e-47cc-9833-c10800efcfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:58.766235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9778be-ef1e-47cc-9833-c10800efcfa3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:58.767408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9778be-ef1e-47cc-9833-c10800efcfa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:58.768835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9778be-ef1e-47cc-9833-c10800efcfa3 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:58.770444 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 569/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:46:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:46:58.777226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb9b11-be68-4d47-bc10-472340b2fcdb None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:46:58.875482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb9b11-be68-4d47-bc10-472340b2fcdb None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:46:58.909306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf8e86-bc6e-42e0-a58c-cdc0466b0c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:46:58.909988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf8e86-bc6e-42e0-a58c-cdc0466b0c8b None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:46:58.910293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf8e86-bc6e-42e0-a58c-cdc0466b0c8b None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:46:58.910575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf8e86-bc6e-42e0-a58c-cdc0466b0c8b None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:46:58.911327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf8e86-bc6e-42e0-a58c-cdc0466b0c8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:46:58.912756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf8e86-bc6e-42e0-a58c-cdc0466b0c8b None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:46:58.922879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:46:59.097708 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 569/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Jul 16 20:46:58 2022] POST /identity/v3/users => generated 286 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 20:47:01.385130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f81e11-bc9a-4aa4-bf23-122a66f4f3bf None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:01.385666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f81e11-bc9a-4aa4-bf23-122a66f4f3bf None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:01.385666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f81e11-bc9a-4aa4-bf23-122a66f4f3bf None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:01.387876 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 570/1139] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:47:01.393165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243571f-dd3a-47c0-b324-08d4552f59e0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:01.393571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243571f-dd3a-47c0-b324-08d4552f59e0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:01.393719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243571f-dd3a-47c0-b324-08d4552f59e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:01.410853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1243571f-dd3a-47c0-b324-08d4552f59e0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:47:01.412065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1243571f-dd3a-47c0-b324-08d4552f59e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:47:01.476567 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 570/1140] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:47:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 16 20:47:01.502047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f81e11-bc9a-4aa4-bf23-122a66f4f3bf None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:01.555585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:01.604144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f81e11-bc9a-4aa4-bf23-122a66f4f3bf None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:01.639254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b397caa-6a87-41f9-ad8c-1c0c07193022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:01.639963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b397caa-6a87-41f9-ad8c-1c0c07193022 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:01.640247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b397caa-6a87-41f9-ad8c-1c0c07193022 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:01.640552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b397caa-6a87-41f9-ad8c-1c0c07193022 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:01.650678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b397caa-6a87-41f9-ad8c-1c0c07193022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:47:01.658510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-9b397caa-6a87-41f9-ad8c-1c0c07193022 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:47:01.658510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:47:01.658510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:47:01.658510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:47:01.658510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:47:01.658510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:47:01.658510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:47:01.658510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:47:01.658510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:47:01.658510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:47:01.658510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:47:01.658510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:47:01.658510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:47:01.658510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:47:01.658510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:47:01.658510 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:47:01.659706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:47:01.659706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:47:01.659706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:47:01.659706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:47:01.659706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:47:01.659706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:47:01.659706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:47:01.659706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:47:01.659706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:47:01.659706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:47:01.659706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:47:01.659706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:47:01.659706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:47:01.659706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:47:01.659706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:47:01.659706 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:47:01.660605 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:47:01.660605 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:47:01.660605 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:47:01.660605 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:47:01.660605 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:47:01.660605 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:47:01.660605 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:47:01.660605 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:47:01.660605 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:47:01.660605 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:47:01.660605 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:47:01.660605 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:47:01.660605 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 571/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:47:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:47:01.665912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243571f-dd3a-47c0-b324-08d4552f59e0 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:01.767593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243571f-dd3a-47c0-b324-08d4552f59e0 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:01.794268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:01.802793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb4386-9db7-4db6-936f-2bed759631da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:01.803499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb4386-9db7-4db6-936f-2bed759631da None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:01.803777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb4386-9db7-4db6-936f-2bed759631da None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:01.804050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb4386-9db7-4db6-936f-2bed759631da None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:01.804785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb4386-9db7-4db6-936f-2bed759631da None admin] RBAC: Adding query filter params (name=admin) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:47:01.805116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb4386-9db7-4db6-936f-2bed759631da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:01.806510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb4386-9db7-4db6-936f-2bed759631da None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:01.814750 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 571/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:47:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:01.820720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b397caa-6a87-41f9-ad8c-1c0c07193022 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:01.921966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b397caa-6a87-41f9-ad8c-1c0c07193022 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:01.935221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:01.955380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fb27e-98ab-4593-a6e8-95c7bebb0dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:01.956236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fb27e-98ab-4593-a6e8-95c7bebb0dec None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:01.956517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fb27e-98ab-4593-a6e8-95c7bebb0dec None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:01.956791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fb27e-98ab-4593-a6e8-95c7bebb0dec None admin] PATH_INFO: `/v3/users/3f8b86020b3d49c9a9e4d675b6b5fcab` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:01.970356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5fb27e-98ab-4593-a6e8-95c7bebb0dec None admin] RBAC: Authorizing `identity:get_user(user_id=3f8b86020b3d49c9a9e4d675b6b5fcab)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:01.971810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5fb27e-98ab-4593-a6e8-95c7bebb0dec None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:01.973454 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 572/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:47:01 2022] GET /identity/v3/users/3f8b86020b3d49c9a9e4d675b6b5fcab => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:01.979386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb4386-9db7-4db6-936f-2bed759631da None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:02.076502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb4386-9db7-4db6-936f-2bed759631da None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:02.109313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810a707-2439-403e-a820-a84588838ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:02.109944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810a707-2439-403e-a820-a84588838ff4 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:02.110223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810a707-2439-403e-a820-a84588838ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:02.110495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810a707-2439-403e-a820-a84588838ff4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:02.163728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:02.182200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810a707-2439-403e-a820-a84588838ff4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:02.182200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810a707-2439-403e-a820-a84588838ff4 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:02.273784 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 572/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:47:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 16 20:47:02.280374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fb27e-98ab-4593-a6e8-95c7bebb0dec None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:02.378758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fb27e-98ab-4593-a6e8-95c7bebb0dec None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:02.413659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd0a11-d459-4ff4-84ee-b9e6ee126677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:02.414493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd0a11-d459-4ff4-84ee-b9e6ee126677 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:02.414767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd0a11-d459-4ff4-84ee-b9e6ee126677 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:02.415067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd0a11-d459-4ff4-84ee-b9e6ee126677 None admin] PATH_INFO: `/v3/projects/9d0c8d9789eb429f890cb319c8db110d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:02.416215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd0a11-d459-4ff4-84ee-b9e6ee126677 None admin] RBAC: Authorizing `identity:get_project(project_id=9d0c8d9789eb429f890cb319c8db110d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:02.418149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd0a11-d459-4ff4-84ee-b9e6ee126677 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:02.419862 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 573/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:47:02 2022] GET /identity/v3/projects/9d0c8d9789eb429f890cb319c8db110d => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:02.426032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810a707-2439-403e-a820-a84588838ff4 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:02.510996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:02.523239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810a707-2439-403e-a820-a84588838ff4 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:02.559148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551c529-93f2-49dd-9471-8cf05b2e7618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:02.559795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551c529-93f2-49dd-9471-8cf05b2e7618 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:02.560078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551c529-93f2-49dd-9471-8cf05b2e7618 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:02.560353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551c529-93f2-49dd-9471-8cf05b2e7618 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:02.561178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551c529-93f2-49dd-9471-8cf05b2e7618 None admin] RBAC: Adding query filter params (role.id=bd33b827674a4d4db30c164cab416056, scope.project.id=9d0c8d9789eb429f890cb319c8db110d, user.id=3f8b86020b3d49c9a9e4d675b6b5fcab) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:47:02.561488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551c529-93f2-49dd-9471-8cf05b2e7618 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:02.562899 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551c529-93f2-49dd-9471-8cf05b2e7618 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:02.568270 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 573/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:47:02 2022] GET /identity/v3/role_assignments?user.id=3f8b86020b3d49c9a9e4d675b6b5fcab&scope.project.id=9d0c8d9789eb429f890cb319c8db110d&role.id=bd33b827674a4d4db30c164cab416056 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:04.807810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4b37c-f952-4f9f-9930-eb486738752b None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:04.809153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4b37c-f952-4f9f-9930-eb486738752b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:04.809153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4b37c-f952-4f9f-9930-eb486738752b None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:04.810454 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 574/1147] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:47:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:47:04.815844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afd16e-a5f7-4e6b-a2b3-0c25943be9d9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:04.816260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afd16e-a5f7-4e6b-a2b3-0c25943be9d9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:04.816394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afd16e-a5f7-4e6b-a2b3-0c25943be9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:04.833687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-74afd16e-a5f7-4e6b-a2b3-0c25943be9d9 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:47:04.835030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-74afd16e-a5f7-4e6b-a2b3-0c25943be9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:47:04.902908 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 574/1148] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:47:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:47:04.927155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4b37c-f952-4f9f-9930-eb486738752b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:04.968277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:05.026476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4b37c-f952-4f9f-9930-eb486738752b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:05.060402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe8eeb-3be2-4303-ad39-d95b54661823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:05.061109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe8eeb-3be2-4303-ad39-d95b54661823 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:05.061390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe8eeb-3be2-4303-ad39-d95b54661823 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:05.061663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe8eeb-3be2-4303-ad39-d95b54661823 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:05.071692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe8eeb-3be2-4303-ad39-d95b54661823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:47:05.079428 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-e4fe8eeb-3be2-4303-ad39-d95b54661823 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:47:05.079428 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:47:05.079428 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:47:05.079428 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:47:05.079428 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:47:05.079428 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:47:05.079428 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:47:05.079428 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:47:05.079428 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:47:05.079428 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:47:05.079428 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:47:05.079428 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:47:05.079428 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:47:05.079428 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:47:05.079428 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:47:05.079428 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:47:05.080373 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:47:05.080373 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:47:05.080373 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:47:05.080373 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:47:05.080373 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:47:05.080373 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:47:05.080373 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:47:05.080373 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:47:05.080373 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:47:05.080373 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:47:05.080373 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:47:05.080373 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:47:05.080373 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:47:05.080373 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:47:05.080373 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:47:05.080373 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:47:05.081233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:47:05.081233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:47:05.081233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:47:05.081233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:47:05.081233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:47:05.081233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:47:05.081233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:47:05.081233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:47:05.081233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:47:05.081233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:47:05.081233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:47:05.081233 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:47:05.081233 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 575/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:47:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:47:05.086871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afd16e-a5f7-4e6b-a2b3-0c25943be9d9 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:05.168226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:05.185862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afd16e-a5f7-4e6b-a2b3-0c25943be9d9 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:05.220162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae8ee2-8b36-4a44-abb0-1b3383702a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:05.220816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae8ee2-8b36-4a44-abb0-1b3383702a04 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:05.221092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae8ee2-8b36-4a44-abb0-1b3383702a04 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:05.221362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae8ee2-8b36-4a44-abb0-1b3383702a04 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:05.222092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae8ee2-8b36-4a44-abb0-1b3383702a04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:47:05.222392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae8ee2-8b36-4a44-abb0-1b3383702a04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:05.223778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae8ee2-8b36-4a44-abb0-1b3383702a04 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:05.231729 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 575/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:47:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:05.237668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe8eeb-3be2-4303-ad39-d95b54661823 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:05.332700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:05.336284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe8eeb-3be2-4303-ad39-d95b54661823 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:05.369430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a428773-0520-4c7c-aac3-3febfcfeeac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:05.370286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a428773-0520-4c7c-aac3-3febfcfeeac1 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:05.370600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a428773-0520-4c7c-aac3-3febfcfeeac1 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:05.370865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a428773-0520-4c7c-aac3-3febfcfeeac1 None admin] PATH_INFO: `/v3/users/3f8b86020b3d49c9a9e4d675b6b5fcab` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:05.372081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a428773-0520-4c7c-aac3-3febfcfeeac1 None admin] RBAC: Authorizing `identity:get_user(user_id=3f8b86020b3d49c9a9e4d675b6b5fcab)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:05.373505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a428773-0520-4c7c-aac3-3febfcfeeac1 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:05.375139 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 576/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:47:05 2022] GET /identity/v3/users/3f8b86020b3d49c9a9e4d675b6b5fcab => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:05.380937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae8ee2-8b36-4a44-abb0-1b3383702a04 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:05.479720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae8ee2-8b36-4a44-abb0-1b3383702a04 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:05.513820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3f34d-9d5a-4700-9ffc-ab98d2bbdf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:05.514638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3f34d-9d5a-4700-9ffc-ab98d2bbdf0e None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:05.514916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3f34d-9d5a-4700-9ffc-ab98d2bbdf0e None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:05.515216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3f34d-9d5a-4700-9ffc-ab98d2bbdf0e None admin] PATH_INFO: `/v3/projects/9d0c8d9789eb429f890cb319c8db110d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:05.516383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3f34d-9d5a-4700-9ffc-ab98d2bbdf0e None admin] RBAC: Authorizing `identity:get_project(project_id=9d0c8d9789eb429f890cb319c8db110d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:05.517807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3f34d-9d5a-4700-9ffc-ab98d2bbdf0e None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:05.519540 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 576/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:47:05 2022] GET /identity/v3/projects/9d0c8d9789eb429f890cb319c8db110d => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:05.525554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a428773-0520-4c7c-aac3-3febfcfeeac1 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:05.624747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a428773-0520-4c7c-aac3-3febfcfeeac1 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:05.658622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333ae7e-ff89-4cd5-8bd9-1bb828416bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:05.659517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333ae7e-ff89-4cd5-8bd9-1bb828416bb1 None admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:05.659794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333ae7e-ff89-4cd5-8bd9-1bb828416bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:05.660062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333ae7e-ff89-4cd5-8bd9-1bb828416bb1 None admin] PATH_INFO: `/v3/projects/9d0c8d9789eb429f890cb319c8db110d/users/3f8b86020b3d49c9a9e4d675b6b5fcab/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:05.661988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333ae7e-ff89-4cd5-8bd9-1bb828416bb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d0c8d9789eb429f890cb319c8db110d, user_id=3f8b86020b3d49c9a9e4d675b6b5fcab, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:05.663433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333ae7e-ff89-4cd5-8bd9-1bb828416bb1 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:05.814772 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 577/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:47:05 2022] PUT /identity/v3/projects/9d0c8d9789eb429f890cb319c8db110d/users/3f8b86020b3d49c9a9e4d675b6b5fcab/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 20:47:08.080053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414d853-c58f-443f-a2e7-bd6b0b395850 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:08.080604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414d853-c58f-443f-a2e7-bd6b0b395850 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:08.080604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414d853-c58f-443f-a2e7-bd6b0b395850 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:08.081984 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 577/1154] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:47:08.087408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5571e0-5c69-49ec-8c69-1f23fdac0f05 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:08.087782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5571e0-5c69-49ec-8c69-1f23fdac0f05 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:08.087995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5571e0-5c69-49ec-8c69-1f23fdac0f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:08.104632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8c5571e0-5c69-49ec-8c69-1f23fdac0f05 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:47:08.105812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8c5571e0-5c69-49ec-8c69-1f23fdac0f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:47:08.126227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:08.172433 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 578/1155] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:47:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:47:08.198025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414d853-c58f-443f-a2e7-bd6b0b395850 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:08.213163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:08.300357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414d853-c58f-443f-a2e7-bd6b0b395850 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:08.335470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd876c-6508-4181-93da-a6d9b9353d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:08.336249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd876c-6508-4181-93da-a6d9b9353d1f None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:08.336529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd876c-6508-4181-93da-a6d9b9353d1f None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:08.336799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd876c-6508-4181-93da-a6d9b9353d1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:08.347305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd876c-6508-4181-93da-a6d9b9353d1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:47:08.355357 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-1dbd876c-6508-4181-93da-a6d9b9353d1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:47:08.355357 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:47:08.355357 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:47:08.355357 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:47:08.355357 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:47:08.355357 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:47:08.355357 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:47:08.355357 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:47:08.355357 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:47:08.355357 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:47:08.355357 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:47:08.355357 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:47:08.355357 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:47:08.355357 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:47:08.355357 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:47:08.355357 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:47:08.356452 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:47:08.356452 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:47:08.356452 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:47:08.356452 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:47:08.356452 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:47:08.356452 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:47:08.356452 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:47:08.356452 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:47:08.356452 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:47:08.356452 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:47:08.356452 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:47:08.356452 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:47:08.356452 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:47:08.356452 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:47:08.356452 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:47:08.356452 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:47:08.357310 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:47:08.357310 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:47:08.357310 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:47:08.357310 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:47:08.357310 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:47:08.357310 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:47:08.357310 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:47:08.357310 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:47:08.357310 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:47:08.357310 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:47:08.357310 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:47:08.357310 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:47:08.357310 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 578/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:47:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:47:08.362934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5571e0-5c69-49ec-8c69-1f23fdac0f05 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:08.463311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5571e0-5c69-49ec-8c69-1f23fdac0f05 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:08.497293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8dc6d4-fbce-45bc-9c12-97aac3e99fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:08.502935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dc6d4-fbce-45bc-9c12-97aac3e99fed None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:08.502935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dc6d4-fbce-45bc-9c12-97aac3e99fed None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:08.502935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dc6d4-fbce-45bc-9c12-97aac3e99fed None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:08.502935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8dc6d4-fbce-45bc-9c12-97aac3e99fed None admin] RBAC: Adding query filter params (name=admin) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:47:08.502935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8dc6d4-fbce-45bc-9c12-97aac3e99fed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:08.502935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8dc6d4-fbce-45bc-9c12-97aac3e99fed None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:08.508893 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 579/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:47:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:08.514932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd876c-6508-4181-93da-a6d9b9353d1f None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:08.583419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:08.614400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd876c-6508-4181-93da-a6d9b9353d1f None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:08.648126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6824f81-e2b5-471a-8ea7-9fbd948e61d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:08.649010 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6824f81-e2b5-471a-8ea7-9fbd948e61d8 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:08.649289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6824f81-e2b5-471a-8ea7-9fbd948e61d8 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:08.649562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6824f81-e2b5-471a-8ea7-9fbd948e61d8 None admin] PATH_INFO: `/v3/users/3f8b86020b3d49c9a9e4d675b6b5fcab` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:08.650842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6824f81-e2b5-471a-8ea7-9fbd948e61d8 None admin] RBAC: Authorizing `identity:get_user(user_id=3f8b86020b3d49c9a9e4d675b6b5fcab)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:08.652916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6824f81-e2b5-471a-8ea7-9fbd948e61d8 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:08.654554 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 579/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:47:08 2022] GET /identity/v3/users/3f8b86020b3d49c9a9e4d675b6b5fcab => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:08.660636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8dc6d4-fbce-45bc-9c12-97aac3e99fed None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:08.681385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:08.760347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8dc6d4-fbce-45bc-9c12-97aac3e99fed None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:08.794050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02bf93-0f19-4896-bc18-83cfae7b51c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:08.794691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02bf93-0f19-4896-bc18-83cfae7b51c3 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:08.794968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02bf93-0f19-4896-bc18-83cfae7b51c3 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:08.795266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02bf93-0f19-4896-bc18-83cfae7b51c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:08.862066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02bf93-0f19-4896-bc18-83cfae7b51c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:08.863598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02bf93-0f19-4896-bc18-83cfae7b51c3 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:08.881046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:08.960943 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 580/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:47:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 16 20:47:08.967579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6824f81-e2b5-471a-8ea7-9fbd948e61d8 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:09.065091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6824f81-e2b5-471a-8ea7-9fbd948e61d8 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:09.098356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081a377-ce2d-4f6d-8e28-4b92ab3247c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:09.099221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081a377-ce2d-4f6d-8e28-4b92ab3247c7 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:09.099503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081a377-ce2d-4f6d-8e28-4b92ab3247c7 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:09.099778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081a377-ce2d-4f6d-8e28-4b92ab3247c7 None admin] PATH_INFO: `/v3/projects/9d0c8d9789eb429f890cb319c8db110d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:09.100941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081a377-ce2d-4f6d-8e28-4b92ab3247c7 None admin] RBAC: Authorizing `identity:get_project(project_id=9d0c8d9789eb429f890cb319c8db110d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:09.102349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081a377-ce2d-4f6d-8e28-4b92ab3247c7 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:09.104084 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 580/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:47:08 2022] GET /identity/v3/projects/9d0c8d9789eb429f890cb319c8db110d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:09.110728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02bf93-0f19-4896-bc18-83cfae7b51c3 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:09.210406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02bf93-0f19-4896-bc18-83cfae7b51c3 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:09.227809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:09.244083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670abc08-a4b2-4763-a1c0-ca638c5c1c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:09.244719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670abc08-a4b2-4763-a1c0-ca638c5c1c87 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:09.244995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670abc08-a4b2-4763-a1c0-ca638c5c1c87 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:09.245264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670abc08-a4b2-4763-a1c0-ca638c5c1c87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:09.246443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670abc08-a4b2-4763-a1c0-ca638c5c1c87 None admin] RBAC: Adding query filter params (role.id=bd33b827674a4d4db30c164cab416056, scope.project.id=9d0c8d9789eb429f890cb319c8db110d, user.id=3f8b86020b3d49c9a9e4d675b6b5fcab) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:47:09.246750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670abc08-a4b2-4763-a1c0-ca638c5c1c87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:09.248235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670abc08-a4b2-4763-a1c0-ca638c5c1c87 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:09.253909 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 581/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:47:09 2022] GET /identity/v3/role_assignments?user.id=3f8b86020b3d49c9a9e4d675b6b5fcab&scope.project.id=9d0c8d9789eb429f890cb319c8db110d&role.id=bd33b827674a4d4db30c164cab416056 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:11.523392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc7084-4cd1-4f78-88e5-023056eb94f3 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:11.523951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc7084-4cd1-4f78-88e5-023056eb94f3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:11.523951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc7084-4cd1-4f78-88e5-023056eb94f3 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:11.525285 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 581/1162] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:47:11.531104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11e1d8-2c9d-472b-830c-4808d0866fa8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:11.531514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11e1d8-2c9d-472b-830c-4808d0866fa8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:11.531673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11e1d8-2c9d-472b-830c-4808d0866fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:11.548716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6e11e1d8-2c9d-472b-830c-4808d0866fa8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:47:11.549902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6e11e1d8-2c9d-472b-830c-4808d0866fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:47:11.615628 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 582/1163] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:47:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:47:11.638993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc7084-4cd1-4f78-88e5-023056eb94f3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:11.649626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:11.740275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc7084-4cd1-4f78-88e5-023056eb94f3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:11.773067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdce9c-ca32-4b3f-a05c-228944509b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:11.773759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdce9c-ca32-4b3f-a05c-228944509b93 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:11.773990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdce9c-ca32-4b3f-a05c-228944509b93 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:11.774307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdce9c-ca32-4b3f-a05c-228944509b93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:11.841333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdce9c-ca32-4b3f-a05c-228944509b93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:11.842769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdce9c-ca32-4b3f-a05c-228944509b93 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:11.852326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:11.938912 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 582/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:47:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 16 20:47:11.944902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11e1d8-2c9d-472b-830c-4808d0866fa8 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:12.042647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11e1d8-2c9d-472b-830c-4808d0866fa8 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:12.055712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:12.076572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d8322-0ff6-4b4a-af41-d7ae02af28e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:12.077359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d8322-0ff6-4b4a-af41-d7ae02af28e1 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:12.077638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d8322-0ff6-4b4a-af41-d7ae02af28e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:12.077908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d8322-0ff6-4b4a-af41-d7ae02af28e1 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:12.084438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d8322-0ff6-4b4a-af41-d7ae02af28e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:12.085887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d8322-0ff6-4b4a-af41-d7ae02af28e1 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:12.100991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-b34d8322-0ff6-4b4a-af41-d7ae02af28e1 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 16 20:47:12.100991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:47:12.100991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 16 20:47:12.100991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 16 20:47:12.100991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:47:12.100991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:47:12.100991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:47:12.100991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:47:12.100991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 16 20:47:12.100991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:47:12.100991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:47:12.100991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:47:12.100991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:47:12.100991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:47:12.100991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:47:12.100991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:47:12.100991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:47:12.102074 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:47:12.102074 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:47:12.102074 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:47:12.102074 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:47:12.102074 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:47:12.102074 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:47:12.102074 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:47:12.102074 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:47:12.102074 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:47:12.102074 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:47:12.102074 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:47:12.102074 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:47:12.102074 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:47:12.102074 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:47:12.102074 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:47:12.102074 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:47:12.103330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:47:12.103330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:47:12.103330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:47:12.103330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:47:12.103330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:47:12.103330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:47:12.103330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:47:12.103330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:47:12.103330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:47:12.103330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:47:12.103330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 16 20:47:12.103330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:47:12.103330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 16 20:47:12.103330 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:47:12.103330 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 583/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Jul 16 20:47:11 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:47:12.108378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdce9c-ca32-4b3f-a05c-228944509b93 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:12.209464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdce9c-ca32-4b3f-a05c-228944509b93 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:12.220515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:12.247966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22251a02-e9f9-4649-8c12-e4b93c9f151d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:12.248636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22251a02-e9f9-4649-8c12-e4b93c9f151d None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:12.248932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22251a02-e9f9-4649-8c12-e4b93c9f151d None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:12.249310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22251a02-e9f9-4649-8c12-e4b93c9f151d None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:12.250047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22251a02-e9f9-4649-8c12-e4b93c9f151d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:47:12.250358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22251a02-e9f9-4649-8c12-e4b93c9f151d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:12.251751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22251a02-e9f9-4649-8c12-e4b93c9f151d None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:12.263253 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 583/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Jul 16 20:47:12 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:14.483646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec0b0f-59fb-4549-b764-b77f948df8ed None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:14.484179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec0b0f-59fb-4549-b764-b77f948df8ed None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:14.484179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec0b0f-59fb-4549-b764-b77f948df8ed None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:14.485554 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 584/1167] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:47:14.490866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02e8c8-348e-4af6-9846-8026a06320fb None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:14.491300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02e8c8-348e-4af6-9846-8026a06320fb None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:14.491452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02e8c8-348e-4af6-9846-8026a06320fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:14.508993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8b02e8c8-348e-4af6-9846-8026a06320fb None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:47:14.510157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8b02e8c8-348e-4af6-9846-8026a06320fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:47:14.577294 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 584/1168] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:47:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 16 20:47:14.601431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec0b0f-59fb-4549-b764-b77f948df8ed None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:14.708071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec0b0f-59fb-4549-b764-b77f948df8ed None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:14.742991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee534069-9846-45f3-8a92-cc61738107ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:14.743591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee534069-9846-45f3-8a92-cc61738107ba None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:14.743872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee534069-9846-45f3-8a92-cc61738107ba None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:14.744138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee534069-9846-45f3-8a92-cc61738107ba None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:14.744857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee534069-9846-45f3-8a92-cc61738107ba None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:14.746835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee534069-9846-45f3-8a92-cc61738107ba None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:14.895185 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 585/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Sat Jul 16 20:47:14 2022] POST /identity/v3/domains => generated 267 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:47:17.161687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40b997-9bdd-4013-95cb-54fb1ce49515 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:17.162192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40b997-9bdd-4013-95cb-54fb1ce49515 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:17.162192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40b997-9bdd-4013-95cb-54fb1ce49515 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:17.163548 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 585/1170] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:47:17.168927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3b4a9-fb93-4712-b268-ca12bfd855a9 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:17.169327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3b4a9-fb93-4712-b268-ca12bfd855a9 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:17.169474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3b4a9-fb93-4712-b268-ca12bfd855a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:17.186246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1eb3b4a9-fb93-4712-b268-ca12bfd855a9 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:47:17.187449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1eb3b4a9-fb93-4712-b268-ca12bfd855a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:47:17.213495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:17.253798 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 586/1171] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:47:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:47:17.279610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40b997-9bdd-4013-95cb-54fb1ce49515 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:17.378172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40b997-9bdd-4013-95cb-54fb1ce49515 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:17.379708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:17.412101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165bbf3-71bd-4164-9d62-49028ac07681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:17.412887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165bbf3-71bd-4164-9d62-49028ac07681 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:17.413170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165bbf3-71bd-4164-9d62-49028ac07681 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:17.413443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165bbf3-71bd-4164-9d62-49028ac07681 None admin] PATH_INFO: `/v3/domains/e2d5874f26ec415bbbb590420b740867` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:17.424120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165bbf3-71bd-4164-9d62-49028ac07681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e2d5874f26ec415bbbb590420b740867)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:17.425551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165bbf3-71bd-4164-9d62-49028ac07681 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:17.427238 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 586/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Sat Jul 16 20:47:17 2022] GET /identity/v3/domains/e2d5874f26ec415bbbb590420b740867 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:17.433492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3b4a9-fb93-4712-b268-ca12bfd855a9 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:17.530500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3b4a9-fb93-4712-b268-ca12bfd855a9 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:17.564685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6dc22-03b1-4a13-aeea-df40c2532480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:17.565332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6dc22-03b1-4a13-aeea-df40c2532480 None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:17.565635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6dc22-03b1-4a13-aeea-df40c2532480 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:17.565913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6dc22-03b1-4a13-aeea-df40c2532480 None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:17.566613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6dc22-03b1-4a13-aeea-df40c2532480 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:17.568074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6dc22-03b1-4a13-aeea-df40c2532480 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:17.665420 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 587/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Jul 16 20:47:17 2022] POST /identity/v3/projects => generated 361 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 20:47:19.968403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d204349-66f3-4528-bcd4-cb2f23792263 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:19.969087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d204349-66f3-4528-bcd4-cb2f23792263 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:19.969087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d204349-66f3-4528-bcd4-cb2f23792263 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:19.970327 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 587/1174] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:47:19.975796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36474200-ee1f-4ab6-9570-e2edcf0df6b7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:19.976222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36474200-ee1f-4ab6-9570-e2edcf0df6b7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:19.976329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36474200-ee1f-4ab6-9570-e2edcf0df6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:19.994003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-36474200-ee1f-4ab6-9570-e2edcf0df6b7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:47:19.995252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-36474200-ee1f-4ab6-9570-e2edcf0df6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:47:20.004876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:20.061469 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 588/1175] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:47:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:47:20.087539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d204349-66f3-4528-bcd4-cb2f23792263 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:20.192575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d204349-66f3-4528-bcd4-cb2f23792263 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:20.226107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba3007-65c9-4d46-9c69-6b89a8f28554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:20.226957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba3007-65c9-4d46-9c69-6b89a8f28554 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:20.227265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba3007-65c9-4d46-9c69-6b89a8f28554 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:20.227540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba3007-65c9-4d46-9c69-6b89a8f28554 None admin] PATH_INFO: `/v3/domains/e2d5874f26ec415bbbb590420b740867` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:20.228709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba3007-65c9-4d46-9c69-6b89a8f28554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e2d5874f26ec415bbbb590420b740867)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:20.230365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba3007-65c9-4d46-9c69-6b89a8f28554 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:20.232061 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 588/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Sat Jul 16 20:47:20 2022] GET /identity/v3/domains/e2d5874f26ec415bbbb590420b740867 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:20.238170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36474200-ee1f-4ab6-9570-e2edcf0df6b7 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:20.336807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36474200-ee1f-4ab6-9570-e2edcf0df6b7 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:20.370731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c66bbb-c70f-4958-820f-448323e9b28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:20.371417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c66bbb-c70f-4958-820f-448323e9b28c None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:20.371700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c66bbb-c70f-4958-820f-448323e9b28c None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:20.371974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c66bbb-c70f-4958-820f-448323e9b28c None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:20.372695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c66bbb-c70f-4958-820f-448323e9b28c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:20.374120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c66bbb-c70f-4958-820f-448323e9b28c None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:20.502986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:20.508219 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 589/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Jul 16 20:47:20 2022] POST /identity/v3/users => generated 311 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:47:22.773843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e9377-489c-4ed1-9e23-b7ef480aab3f None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:22.774405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e9377-489c-4ed1-9e23-b7ef480aab3f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:22.774405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e9377-489c-4ed1-9e23-b7ef480aab3f None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:22.775794 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 589/1178] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:47:22.781852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48956ed-3250-469a-8823-6610c2fd3089 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:22.782314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48956ed-3250-469a-8823-6610c2fd3089 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:22.782425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48956ed-3250-469a-8823-6610c2fd3089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:22.799345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b48956ed-3250-469a-8823-6610c2fd3089 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:47:22.800512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b48956ed-3250-469a-8823-6610c2fd3089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:47:22.867749 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 590/1179] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:47:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:47:22.893538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e9377-489c-4ed1-9e23-b7ef480aab3f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:22.923722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:22.993903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e9377-489c-4ed1-9e23-b7ef480aab3f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:23.027553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ecacb-4893-45ce-ad7d-a9d2f06b21ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:23.028334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ecacb-4893-45ce-ad7d-a9d2f06b21ac None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:23.028648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ecacb-4893-45ce-ad7d-a9d2f06b21ac None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:23.028938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ecacb-4893-45ce-ad7d-a9d2f06b21ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:23.039394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ecacb-4893-45ce-ad7d-a9d2f06b21ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:47:23.047300 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-3c8ecacb-4893-45ce-ad7d-a9d2f06b21ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:47:23.047300 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:47:23.047300 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:47:23.047300 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:47:23.047300 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:47:23.047300 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:47:23.047300 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:47:23.047300 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:47:23.047300 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:47:23.047300 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:47:23.047300 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:47:23.047300 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:47:23.047300 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:47:23.047300 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:47:23.047300 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:47:23.047300 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:47:23.048473 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:47:23.048473 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:47:23.048473 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:47:23.048473 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:47:23.048473 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:47:23.048473 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:47:23.048473 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:47:23.048473 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:47:23.048473 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:47:23.048473 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:47:23.048473 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:47:23.048473 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:47:23.048473 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:47:23.048473 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:47:23.048473 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:47:23.048473 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:47:23.049548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:47:23.049548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:47:23.049548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:47:23.049548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:47:23.049548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:47:23.049548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:47:23.049548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:47:23.049548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:47:23.049548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:47:23.049548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:47:23.049548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:47:23.049548 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:47:23.049548 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 590/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:47:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:47:23.054554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48956ed-3250-469a-8823-6610c2fd3089 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:23.155652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48956ed-3250-469a-8823-6610c2fd3089 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:23.186016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:23.191741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de30bf4-ea44-4693-aaf3-50037e431966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:23.194079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de30bf4-ea44-4693-aaf3-50037e431966 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:23.194079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de30bf4-ea44-4693-aaf3-50037e431966 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:23.194079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de30bf4-ea44-4693-aaf3-50037e431966 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:23.194079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de30bf4-ea44-4693-aaf3-50037e431966 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:47:23.194079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de30bf4-ea44-4693-aaf3-50037e431966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:23.195355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de30bf4-ea44-4693-aaf3-50037e431966 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:23.204025 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 591/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:47:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:23.210008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ecacb-4893-45ce-ad7d-a9d2f06b21ac None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:23.298768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:23.309191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ecacb-4893-45ce-ad7d-a9d2f06b21ac None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:23.341995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d074c-c08e-428a-8b8b-852ebbdd36f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:23.342849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d074c-c08e-428a-8b8b-852ebbdd36f3 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:23.343160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d074c-c08e-428a-8b8b-852ebbdd36f3 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:23.343435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d074c-c08e-428a-8b8b-852ebbdd36f3 None admin] PATH_INFO: `/v3/users/c8a55c95356a4de8929b3e3f8eddafb1` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:23.356373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d074c-c08e-428a-8b8b-852ebbdd36f3 None admin] RBAC: Authorizing `identity:get_user(user_id=c8a55c95356a4de8929b3e3f8eddafb1)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:23.357804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d074c-c08e-428a-8b8b-852ebbdd36f3 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:23.359486 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 591/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:47:23 2022] GET /identity/v3/users/c8a55c95356a4de8929b3e3f8eddafb1 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:23.365464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de30bf4-ea44-4693-aaf3-50037e431966 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:23.471255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de30bf4-ea44-4693-aaf3-50037e431966 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:23.504771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dec27a-07c1-4414-8e3a-e78557f7b317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:23.505407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dec27a-07c1-4414-8e3a-e78557f7b317 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:23.505713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dec27a-07c1-4414-8e3a-e78557f7b317 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:23.505984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dec27a-07c1-4414-8e3a-e78557f7b317 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:23.563592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:23.573050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dec27a-07c1-4414-8e3a-e78557f7b317 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:23.574491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dec27a-07c1-4414-8e3a-e78557f7b317 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:23.672547 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 592/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:47:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 16 20:47:23.678486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d074c-c08e-428a-8b8b-852ebbdd36f3 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:23.777014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d074c-c08e-428a-8b8b-852ebbdd36f3 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:23.811132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004ef03-8a85-4599-a0f8-a094b96c69a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:23.811982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004ef03-8a85-4599-a0f8-a094b96c69a4 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:23.812263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004ef03-8a85-4599-a0f8-a094b96c69a4 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:23.812538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004ef03-8a85-4599-a0f8-a094b96c69a4 None admin] PATH_INFO: `/v3/projects/5b73b56e60eb4b58940340d5cb63f6a0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:23.813752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004ef03-8a85-4599-a0f8-a094b96c69a4 None admin] RBAC: Authorizing `identity:get_project(project_id=5b73b56e60eb4b58940340d5cb63f6a0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:23.815160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004ef03-8a85-4599-a0f8-a094b96c69a4 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:23.816864 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 592/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:47:23 2022] GET /identity/v3/projects/5b73b56e60eb4b58940340d5cb63f6a0 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:23.823703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dec27a-07c1-4414-8e3a-e78557f7b317 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:23.913630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:23.922061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dec27a-07c1-4414-8e3a-e78557f7b317 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:23.956144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10915d8-eef0-439f-b2ca-ee93b0b4b844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:23.956770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10915d8-eef0-439f-b2ca-ee93b0b4b844 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:23.957047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10915d8-eef0-439f-b2ca-ee93b0b4b844 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:23.957316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10915d8-eef0-439f-b2ca-ee93b0b4b844 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:23.958127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10915d8-eef0-439f-b2ca-ee93b0b4b844 None admin] RBAC: Adding query filter params (role.id=bd33b827674a4d4db30c164cab416056, scope.project.id=5b73b56e60eb4b58940340d5cb63f6a0, user.id=c8a55c95356a4de8929b3e3f8eddafb1) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:47:23.958431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10915d8-eef0-439f-b2ca-ee93b0b4b844 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:23.959926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10915d8-eef0-439f-b2ca-ee93b0b4b844 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:23.965957 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 593/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:47:23 2022] GET /identity/v3/role_assignments?user.id=c8a55c95356a4de8929b3e3f8eddafb1&scope.project.id=5b73b56e60eb4b58940340d5cb63f6a0&role.id=bd33b827674a4d4db30c164cab416056 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:26.169665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c54e2-0efd-473e-8458-e06f88098830 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:26.170180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c54e2-0efd-473e-8458-e06f88098830 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:26.170180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c54e2-0efd-473e-8458-e06f88098830 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:26.171598 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 593/1186] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:47:26.177066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426757a-d4c6-4123-bef3-a30905dc90c6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:26.177457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426757a-d4c6-4123-bef3-a30905dc90c6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:26.177614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426757a-d4c6-4123-bef3-a30905dc90c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:26.195895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9426757a-d4c6-4123-bef3-a30905dc90c6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:47:26.197086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9426757a-d4c6-4123-bef3-a30905dc90c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:47:26.263519 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 594/1187] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:47:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:47:26.286909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c54e2-0efd-473e-8458-e06f88098830 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:26.305978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:26.387366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c54e2-0efd-473e-8458-e06f88098830 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:26.424516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffcd75-f641-480f-920e-90f948dc6a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:26.425396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffcd75-f641-480f-920e-90f948dc6a95 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:26.425571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffcd75-f641-480f-920e-90f948dc6a95 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:26.425815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffcd75-f641-480f-920e-90f948dc6a95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:26.438688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffffcd75-f641-480f-920e-90f948dc6a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:47:26.446480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-ffffcd75-f641-480f-920e-90f948dc6a95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:47:26.446480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:47:26.446480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:47:26.446480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:47:26.446480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:47:26.446480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:47:26.446480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:47:26.446480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:47:26.446480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:47:26.446480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:47:26.446480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:47:26.446480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:47:26.446480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:47:26.446480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:47:26.446480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:47:26.446480 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:47:26.447603 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:47:26.447603 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:47:26.447603 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:47:26.447603 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:47:26.447603 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:47:26.447603 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:47:26.447603 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:47:26.447603 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:47:26.447603 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:47:26.447603 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:47:26.447603 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:47:26.447603 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:47:26.447603 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:47:26.447603 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:47:26.447603 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:47:26.447603 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:47:26.448721 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:47:26.448721 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:47:26.448721 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:47:26.448721 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:47:26.448721 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:47:26.448721 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:47:26.448721 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:47:26.448721 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:47:26.448721 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:47:26.448721 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:47:26.448721 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:47:26.448721 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:47:26.448721 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 594/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:47:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:47:26.454246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426757a-d4c6-4123-bef3-a30905dc90c6 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:26.540231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:26.556022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426757a-d4c6-4123-bef3-a30905dc90c6 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:26.592225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce6863-80e0-4f4b-b3f7-0193cf30a21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:26.592884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce6863-80e0-4f4b-b3f7-0193cf30a21e None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:26.593161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce6863-80e0-4f4b-b3f7-0193cf30a21e None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:26.593434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce6863-80e0-4f4b-b3f7-0193cf30a21e None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:26.594180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce6863-80e0-4f4b-b3f7-0193cf30a21e None admin] RBAC: Adding query filter params (name=admin) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:47:26.594483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce6863-80e0-4f4b-b3f7-0193cf30a21e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:26.595890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce6863-80e0-4f4b-b3f7-0193cf30a21e None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:26.605110 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 595/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:47:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:26.611364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffcd75-f641-480f-920e-90f948dc6a95 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:26.695504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:26.720329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffcd75-f641-480f-920e-90f948dc6a95 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:26.757309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c9a6b-58e9-4724-a005-ea32ef0352df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:26.758171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c9a6b-58e9-4724-a005-ea32ef0352df None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:26.758454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c9a6b-58e9-4724-a005-ea32ef0352df None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:26.758810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c9a6b-58e9-4724-a005-ea32ef0352df None admin] PATH_INFO: `/v3/users/c8a55c95356a4de8929b3e3f8eddafb1` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:26.759960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c9a6b-58e9-4724-a005-ea32ef0352df None admin] RBAC: Authorizing `identity:get_user(user_id=c8a55c95356a4de8929b3e3f8eddafb1)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:26.761408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c9a6b-58e9-4724-a005-ea32ef0352df None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:26.763089 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 595/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:47:26 2022] GET /identity/v3/users/c8a55c95356a4de8929b3e3f8eddafb1 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:26.769784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce6863-80e0-4f4b-b3f7-0193cf30a21e None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:26.889459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce6863-80e0-4f4b-b3f7-0193cf30a21e None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:26.933503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bfaa3-1c3e-4307-8472-69a70b8b7be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:26.934379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bfaa3-1c3e-4307-8472-69a70b8b7be4 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:26.934745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bfaa3-1c3e-4307-8472-69a70b8b7be4 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:26.935049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bfaa3-1c3e-4307-8472-69a70b8b7be4 None admin] PATH_INFO: `/v3/projects/5b73b56e60eb4b58940340d5cb63f6a0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:26.936212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bfaa3-1c3e-4307-8472-69a70b8b7be4 None admin] RBAC: Authorizing `identity:get_project(project_id=5b73b56e60eb4b58940340d5cb63f6a0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:26.937641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bfaa3-1c3e-4307-8472-69a70b8b7be4 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:26.939376 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 596/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:47:26 2022] GET /identity/v3/projects/5b73b56e60eb4b58940340d5cb63f6a0 => generated 361 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:47:26.948655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c9a6b-58e9-4724-a005-ea32ef0352df None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:27.057862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c9a6b-58e9-4724-a005-ea32ef0352df None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:27.094450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af96460-4418-4205-a35c-ce7bec9cbb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:27.095354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af96460-4418-4205-a35c-ce7bec9cbb95 None admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:27.095633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af96460-4418-4205-a35c-ce7bec9cbb95 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:27.095906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af96460-4418-4205-a35c-ce7bec9cbb95 None admin] PATH_INFO: `/v3/projects/5b73b56e60eb4b58940340d5cb63f6a0/users/c8a55c95356a4de8929b3e3f8eddafb1/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:27.098003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af96460-4418-4205-a35c-ce7bec9cbb95 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b73b56e60eb4b58940340d5cb63f6a0, user_id=c8a55c95356a4de8929b3e3f8eddafb1, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:27.099464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af96460-4418-4205-a35c-ce7bec9cbb95 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:27.196221 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 596/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:47:26 2022] PUT /identity/v3/projects/5b73b56e60eb4b58940340d5cb63f6a0/users/c8a55c95356a4de8929b3e3f8eddafb1/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:47:29.447861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157d8ca-aa70-422d-b698-aa964e97c9be None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:29.448439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157d8ca-aa70-422d-b698-aa964e97c9be None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:29.448682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157d8ca-aa70-422d-b698-aa964e97c9be None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:29.450051 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 597/1193] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:47:29.455396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868bd3e-c2c5-456a-925f-e9b785dc7c8e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:29.455815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868bd3e-c2c5-456a-925f-e9b785dc7c8e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:29.455928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868bd3e-c2c5-456a-925f-e9b785dc7c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:29.461837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:29.472383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f868bd3e-c2c5-456a-925f-e9b785dc7c8e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:47:29.473552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f868bd3e-c2c5-456a-925f-e9b785dc7c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:47:29.539803 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 597/1194] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:47:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:47:29.565595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157d8ca-aa70-422d-b698-aa964e97c9be None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:29.584548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:29.669698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157d8ca-aa70-422d-b698-aa964e97c9be None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:29.706646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee49862-c52d-4300-9ba8-4ab76e0b2890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:29.707379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee49862-c52d-4300-9ba8-4ab76e0b2890 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:29.707655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee49862-c52d-4300-9ba8-4ab76e0b2890 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:29.707925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee49862-c52d-4300-9ba8-4ab76e0b2890 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:29.718061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee49862-c52d-4300-9ba8-4ab76e0b2890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:47:29.725549 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-6ee49862-c52d-4300-9ba8-4ab76e0b2890 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:47:29.725549 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:47:29.725549 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:47:29.725549 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:47:29.725549 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:47:29.725549 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:47:29.725549 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:47:29.725549 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:47:29.725549 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:47:29.725549 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:47:29.725549 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:47:29.725549 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:47:29.725549 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:47:29.725549 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:47:29.725549 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:47:29.725549 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:47:29.726713 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:47:29.726713 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:47:29.726713 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:47:29.726713 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:47:29.726713 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:47:29.726713 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:47:29.726713 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:47:29.726713 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:47:29.726713 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:47:29.726713 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:47:29.726713 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:47:29.726713 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:47:29.726713 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:47:29.726713 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:47:29.726713 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:47:29.726713 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:47:29.727827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:47:29.727827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:47:29.727827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:47:29.727827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:47:29.727827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:47:29.727827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:47:29.727827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:47:29.727827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:47:29.727827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:47:29.727827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:47:29.727827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:47:29.727827 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:47:29.727827 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 598/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:47:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:47:29.733047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868bd3e-c2c5-456a-925f-e9b785dc7c8e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:29.834971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868bd3e-c2c5-456a-925f-e9b785dc7c8e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:29.868947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95d493-d30e-457e-87f4-ce778bc1edac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:29.870157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95d493-d30e-457e-87f4-ce778bc1edac None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:29.870438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95d493-d30e-457e-87f4-ce778bc1edac None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:29.870708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95d493-d30e-457e-87f4-ce778bc1edac None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:29.871487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95d493-d30e-457e-87f4-ce778bc1edac None admin] RBAC: Adding query filter params (name=admin) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:47:29.871787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95d493-d30e-457e-87f4-ce778bc1edac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:29.873165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95d493-d30e-457e-87f4-ce778bc1edac None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:29.874509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:29.881626 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 598/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:47:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:29.888281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee49862-c52d-4300-9ba8-4ab76e0b2890 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:29.969281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:29.992515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee49862-c52d-4300-9ba8-4ab76e0b2890 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:30.026520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd9f68-4e71-4550-86f6-446a7123ae90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:30.027599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd9f68-4e71-4550-86f6-446a7123ae90 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:30.027905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd9f68-4e71-4550-86f6-446a7123ae90 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:30.028185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd9f68-4e71-4550-86f6-446a7123ae90 None admin] PATH_INFO: `/v3/users/c8a55c95356a4de8929b3e3f8eddafb1` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:30.029373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd9f68-4e71-4550-86f6-446a7123ae90 None admin] RBAC: Authorizing `identity:get_user(user_id=c8a55c95356a4de8929b3e3f8eddafb1)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:30.030813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd9f68-4e71-4550-86f6-446a7123ae90 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:30.033476 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 599/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Jul 16 20:47:29 2022] GET /identity/v3/users/c8a55c95356a4de8929b3e3f8eddafb1 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:30.039321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95d493-d30e-457e-87f4-ce778bc1edac None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:30.138677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95d493-d30e-457e-87f4-ce778bc1edac None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:30.171309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a72537-bc05-4760-b2ff-384cd03ee3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:30.171953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a72537-bc05-4760-b2ff-384cd03ee3a9 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:30.171953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a72537-bc05-4760-b2ff-384cd03ee3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:30.171953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a72537-bc05-4760-b2ff-384cd03ee3a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:30.232731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:30.238967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a72537-bc05-4760-b2ff-384cd03ee3a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:30.240441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a72537-bc05-4760-b2ff-384cd03ee3a9 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:30.341849 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 599/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:47:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 16 20:47:30.347858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd9f68-4e71-4550-86f6-446a7123ae90 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:30.447374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd9f68-4e71-4550-86f6-446a7123ae90 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:30.481383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b1063-d414-40ff-b899-8b9f9f2a9830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:30.482232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b1063-d414-40ff-b899-8b9f9f2a9830 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:30.482511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b1063-d414-40ff-b899-8b9f9f2a9830 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:30.482833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b1063-d414-40ff-b899-8b9f9f2a9830 None admin] PATH_INFO: `/v3/projects/5b73b56e60eb4b58940340d5cb63f6a0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:30.483988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b1063-d414-40ff-b899-8b9f9f2a9830 None admin] RBAC: Authorizing `identity:get_project(project_id=5b73b56e60eb4b58940340d5cb63f6a0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:30.485562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b1063-d414-40ff-b899-8b9f9f2a9830 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:30.487287 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 600/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Jul 16 20:47:30 2022] GET /identity/v3/projects/5b73b56e60eb4b58940340d5cb63f6a0 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:30.493474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a72537-bc05-4760-b2ff-384cd03ee3a9 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:47:30.585602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:30.592149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a72537-bc05-4760-b2ff-384cd03ee3a9 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:47:30.625449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02476cb-a551-4ece-94b3-d291f87112c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:47:30.626087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02476cb-a551-4ece-94b3-d291f87112c9 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:47:30.626365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02476cb-a551-4ece-94b3-d291f87112c9 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:47:30.626638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02476cb-a551-4ece-94b3-d291f87112c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:47:30.627487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02476cb-a551-4ece-94b3-d291f87112c9 None admin] RBAC: Adding query filter params (role.id=bd33b827674a4d4db30c164cab416056, scope.project.id=5b73b56e60eb4b58940340d5cb63f6a0, user.id=c8a55c95356a4de8929b3e3f8eddafb1) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:47:30.627796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02476cb-a551-4ece-94b3-d291f87112c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:47:30.629212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02476cb-a551-4ece-94b3-d291f87112c9 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:47:30.634871 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 600/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:47:30 2022] GET /identity/v3/role_assignments?user.id=c8a55c95356a4de8929b3e3f8eddafb1&scope.project.id=5b73b56e60eb4b58940340d5cb63f6a0&role.id=bd33b827674a4d4db30c164cab416056 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:47:40.476536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:47:40.632253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=20 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:48:55.351566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c2bce-1929-42c6-9cf6-e9047b7f1abf None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:48:55.352175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c2bce-1929-42c6-9cf6-e9047b7f1abf None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:48:55.352273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c2bce-1929-42c6-9cf6-e9047b7f1abf None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:48:55.353592 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 601/1201] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:48:55.359105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede691d6-a736-49a2-ad4e-c19e1b3863ca None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:48:55.360490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede691d6-a736-49a2-ad4e-c19e1b3863ca None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:48:55.360490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede691d6-a736-49a2-ad4e-c19e1b3863ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:48:55.376584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ede691d6-a736-49a2-ad4e-c19e1b3863ca None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:48:55.377778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ede691d6-a736-49a2-ad4e-c19e1b3863ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:48:55.444905 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 601/1202] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:48:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 16 20:48:55.470826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c2bce-1929-42c6-9cf6-e9047b7f1abf None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:48:55.576382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c2bce-1929-42c6-9cf6-e9047b7f1abf None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:48:55.613832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb1a06-9eb3-4183-bbff-c59806abc1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:48:55.615168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb1a06-9eb3-4183-bbff-c59806abc1c9 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:48:55.615441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb1a06-9eb3-4183-bbff-c59806abc1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:48:55.615713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb1a06-9eb3-4183-bbff-c59806abc1c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:48:55.625762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb1a06-9eb3-4183-bbff-c59806abc1c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:48:55.627222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb1a06-9eb3-4183-bbff-c59806abc1c9 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:48:55.644799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-26bb1a06-9eb3-4183-bbff-c59806abc1c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:48:55.644799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:48:55.644799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:48:55.644799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:48:55.644799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:48:55.644799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:48:55.644799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:48:55.644799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:48:55.644799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:48:55.644799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:48:55.644799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:48:55.644799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:48:55.644799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:48:55.644799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:48:55.644799 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:48:55.646024 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:48:55.646024 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:48:55.646024 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:48:55.646024 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:48:55.646024 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:48:55.646024 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:48:55.646024 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:48:55.646024 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:48:55.646024 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:48:55.646024 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:48:55.646024 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:48:55.646024 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:48:55.646024 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:48:55.646024 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:48:55.646024 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:48:55.646024 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:48:55.646024 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:48:55.647047 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:48:55.647047 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:48:55.647047 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:48:55.647047 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:48:55.647047 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 602/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:48:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:48:55.652322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede691d6-a736-49a2-ad4e-c19e1b3863ca None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:48:55.751694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede691d6-a736-49a2-ad4e-c19e1b3863ca None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:48:55.781922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:48:55.788471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403d125-dfe4-490b-adc9-6735e0135bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:48:55.789283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403d125-dfe4-490b-adc9-6735e0135bd6 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:48:55.789444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403d125-dfe4-490b-adc9-6735e0135bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:48:55.789733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403d125-dfe4-490b-adc9-6735e0135bd6 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:48:55.790456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403d125-dfe4-490b-adc9-6735e0135bd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:48:55.790756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403d125-dfe4-490b-adc9-6735e0135bd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:48:55.792142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403d125-dfe4-490b-adc9-6735e0135bd6 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:48:55.804323 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 602/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:48:55.810329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb1a06-9eb3-4183-bbff-c59806abc1c9 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:48:55.864070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:48:55.910032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb1a06-9eb3-4183-bbff-c59806abc1c9 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:48:55.943603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b8203-cae8-435f-ab55-f5ca004ef293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:48:55.944259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b8203-cae8-435f-ab55-f5ca004ef293 None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:48:55.944540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b8203-cae8-435f-ab55-f5ca004ef293 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:48:55.944813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b8203-cae8-435f-ab55-f5ca004ef293 None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:48:55.945497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b8203-cae8-435f-ab55-f5ca004ef293 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:48:55.947029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b8203-cae8-435f-ab55-f5ca004ef293 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:48:56.056953 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 603/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Jul 16 20:48:55 2022] POST /identity/v3/users => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:48:58.354880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8318ffb-7a5c-4d6c-9d9c-134e94d88573 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:48:58.355469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8318ffb-7a5c-4d6c-9d9c-134e94d88573 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:48:58.355469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8318ffb-7a5c-4d6c-9d9c-134e94d88573 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:48:58.356818 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 603/1206] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:48:58.361914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3a0c5-0f7f-4050-9323-6aa691bdf64e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:48:58.362439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3a0c5-0f7f-4050-9323-6aa691bdf64e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:48:58.362439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3a0c5-0f7f-4050-9323-6aa691bdf64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:48:58.379120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f0c3a0c5-0f7f-4050-9323-6aa691bdf64e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:48:58.380607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f0c3a0c5-0f7f-4050-9323-6aa691bdf64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:48:58.448867 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 604/1207] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:48:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:48:58.474137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8318ffb-7a5c-4d6c-9d9c-134e94d88573 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:48:58.578184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8318ffb-7a5c-4d6c-9d9c-134e94d88573 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:48:58.612556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31061f46-4f92-432a-8e1f-442170cada76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:48:58.613270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31061f46-4f92-432a-8e1f-442170cada76 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:48:58.613552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31061f46-4f92-432a-8e1f-442170cada76 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:48:58.613907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31061f46-4f92-432a-8e1f-442170cada76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:48:58.625017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31061f46-4f92-432a-8e1f-442170cada76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:48:58.633441 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-31061f46-4f92-432a-8e1f-442170cada76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:48:58.633441 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:48:58.633441 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:48:58.633441 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:48:58.633441 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:48:58.633441 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:48:58.633441 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:48:58.633441 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:48:58.633441 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:48:58.633441 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:48:58.633441 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:48:58.633441 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:48:58.633441 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:48:58.633441 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:48:58.633441 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:48:58.633441 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:48:58.634585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:48:58.634585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:48:58.634585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:48:58.634585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:48:58.634585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:48:58.634585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:48:58.634585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:48:58.634585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:48:58.634585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:48:58.634585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:48:58.634585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:48:58.634585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:48:58.634585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:48:58.634585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:48:58.634585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:48:58.634585 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:48:58.635646 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:48:58.635646 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:48:58.635646 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:48:58.635646 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:48:58.635646 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:48:58.635646 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:48:58.635646 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:48:58.635646 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:48:58.635646 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:48:58.635646 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:48:58.635646 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:48:58.635646 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:48:58.635646 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 604/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:48:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:48:58.640784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3a0c5-0f7f-4050-9323-6aa691bdf64e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:48:58.681374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:48:58.741481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3a0c5-0f7f-4050-9323-6aa691bdf64e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:48:58.777167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be92e8-2ee4-47cb-8c68-173fa01432f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:48:58.777836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be92e8-2ee4-47cb-8c68-173fa01432f9 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:48:58.778121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be92e8-2ee4-47cb-8c68-173fa01432f9 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:48:58.778388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be92e8-2ee4-47cb-8c68-173fa01432f9 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:48:58.779161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be92e8-2ee4-47cb-8c68-173fa01432f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:48:58.779466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be92e8-2ee4-47cb-8c68-173fa01432f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:48:58.780841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be92e8-2ee4-47cb-8c68-173fa01432f9 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:48:58.789254 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 605/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Jul 16 20:48:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:48:58.795254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31061f46-4f92-432a-8e1f-442170cada76 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:48:58.846264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:48:58.894597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31061f46-4f92-432a-8e1f-442170cada76 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:48:58.929618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ae223-b402-43a4-b898-c30692b34db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:48:58.930437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ae223-b402-43a4-b898-c30692b34db4 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:48:58.930717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ae223-b402-43a4-b898-c30692b34db4 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:48:58.930986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ae223-b402-43a4-b898-c30692b34db4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:48:58.940957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ae223-b402-43a4-b898-c30692b34db4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:48:58.943315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ae223-b402-43a4-b898-c30692b34db4 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:48:58.961182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-f67ae223-b402-43a4-b898-c30692b34db4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:48:58.961182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:48:58.961182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:48:58.961182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:48:58.961182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:48:58.961182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:48:58.961182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:48:58.961182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:48:58.961182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:48:58.961182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:48:58.961182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:48:58.961182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:48:58.961182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:48:58.961182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:48:58.961182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:48:58.962332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:48:58.962332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:48:58.962332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:48:58.962332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:48:58.962332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:48:58.962332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:48:58.962332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:48:58.962332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:48:58.962332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:48:58.962332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:48:58.962332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:48:58.962332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:48:58.962332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:48:58.962332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:48:58.962332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:48:58.962332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:48:58.962332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:48:58.963523 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:48:58.963523 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:48:58.963523 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:48:58.963523 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:48:58.963523 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 605/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:48:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:48:58.968112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be92e8-2ee4-47cb-8c68-173fa01432f9 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:48:59.068751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:48:59.071641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be92e8-2ee4-47cb-8c68-173fa01432f9 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:48:59.105049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac051a33-9f7f-4291-a4a5-e077356a6957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:48:59.105733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac051a33-9f7f-4291-a4a5-e077356a6957 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:48:59.106013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac051a33-9f7f-4291-a4a5-e077356a6957 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:48:59.106283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac051a33-9f7f-4291-a4a5-e077356a6957 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:48:59.106984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac051a33-9f7f-4291-a4a5-e077356a6957 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:48:59.107455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac051a33-9f7f-4291-a4a5-e077356a6957 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:48:59.108829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac051a33-9f7f-4291-a4a5-e077356a6957 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:48:59.125890 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 606/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:48:59.126524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ae223-b402-43a4-b898-c30692b34db4 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:48:59.226321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ae223-b402-43a4-b898-c30692b34db4 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:48:59.227900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:48:59.260066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b881ba-25f9-4226-a48b-3bb1c2f185c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:48:59.260852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b881ba-25f9-4226-a48b-3bb1c2f185c2 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:48:59.261128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b881ba-25f9-4226-a48b-3bb1c2f185c2 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:48:59.261398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b881ba-25f9-4226-a48b-3bb1c2f185c2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:48:59.268552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b881ba-25f9-4226-a48b-3bb1c2f185c2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:48:59.270007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b881ba-25f9-4226-a48b-3bb1c2f185c2 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:48:59.284675 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-36b881ba-25f9-4226-a48b-3bb1c2f185c2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 16 20:48:59.284675 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:48:59.284675 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:48:59.284675 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:48:59.284675 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:48:59.284675 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:48:59.284675 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:48:59.284675 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:48:59.284675 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:48:59.284675 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:48:59.284675 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:48:59.284675 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:48:59.284675 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:48:59.284675 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:48:59.284675 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:48:59.284675 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:48:59.286448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:48:59.286448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:48:59.286448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:48:59.286448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:48:59.286448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:48:59.286448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:48:59.286448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:48:59.286448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:48:59.286448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:48:59.286448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:48:59.286448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:48:59.286448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:48:59.286448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:48:59.286448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:48:59.286448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:48:59.286448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:48:59.286448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:48:59.286448 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:48:59.287637 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:48:59.287637 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:48:59.287637 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:48:59.287637 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:48:59.287637 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:48:59.287637 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:48:59.287637 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:48:59.287637 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:48:59.287637 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 16 20:48:59.287637 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:48:59.287637 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 606/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:48:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:48:59.292342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac051a33-9f7f-4291-a4a5-e077356a6957 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:48:59.398427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac051a33-9f7f-4291-a4a5-e077356a6957 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:48:59.432251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e531c-3b06-4b6f-b2a0-3d37fff4105d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:48:59.432904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e531c-3b06-4b6f-b2a0-3d37fff4105d None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:48:59.433181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e531c-3b06-4b6f-b2a0-3d37fff4105d None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:48:59.433450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e531c-3b06-4b6f-b2a0-3d37fff4105d None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:48:59.434265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e531c-3b06-4b6f-b2a0-3d37fff4105d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:48:59.434565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e531c-3b06-4b6f-b2a0-3d37fff4105d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:48:59.436037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e531c-3b06-4b6f-b2a0-3d37fff4105d None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:48:59.452865 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 607/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Jul 16 20:48:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:48:59.459244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b881ba-25f9-4226-a48b-3bb1c2f185c2 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:48:59.560738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b881ba-25f9-4226-a48b-3bb1c2f185c2 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:48:59.594575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed85ce-82db-4dd3-b3a8-1397a34e6e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:48:59.595237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed85ce-82db-4dd3-b3a8-1397a34e6e41 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:48:59.595517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed85ce-82db-4dd3-b3a8-1397a34e6e41 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:48:59.595790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed85ce-82db-4dd3-b3a8-1397a34e6e41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:48:59.626430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:48:59.663322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed85ce-82db-4dd3-b3a8-1397a34e6e41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:48:59.664720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed85ce-82db-4dd3-b3a8-1397a34e6e41 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:48:59.765759 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 607/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:48:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 16 20:48:59.772320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e531c-3b06-4b6f-b2a0-3d37fff4105d None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:48:59.792848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:48:59.876042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e531c-3b06-4b6f-b2a0-3d37fff4105d None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:48:59.910241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b043048-fdb4-48c4-8ee4-dc54f2d761d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:48:59.914157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b043048-fdb4-48c4-8ee4-dc54f2d761d8 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:48:59.914157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b043048-fdb4-48c4-8ee4-dc54f2d761d8 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:48:59.914157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b043048-fdb4-48c4-8ee4-dc54f2d761d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:48:59.922598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b043048-fdb4-48c4-8ee4-dc54f2d761d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:48:59.924101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b043048-fdb4-48c4-8ee4-dc54f2d761d8 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:48:59.942764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-2b043048-fdb4-48c4-8ee4-dc54f2d761d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:48:59.942764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:48:59.942764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:48:59.942764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:48:59.942764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:48:59.942764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:48:59.942764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:48:59.942764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:48:59.942764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:48:59.942764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:48:59.942764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:48:59.942764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:48:59.942764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:48:59.942764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:48:59.942764 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:48:59.943897 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:48:59.943897 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:48:59.943897 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:48:59.943897 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:48:59.943897 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:48:59.943897 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:48:59.943897 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:48:59.943897 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:48:59.943897 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:48:59.943897 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:48:59.943897 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:48:59.943897 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:48:59.943897 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:48:59.943897 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:48:59.943897 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:48:59.943897 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:48:59.943897 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:48:59.945014 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:48:59.945014 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:48:59.945014 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:48:59.945014 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:48:59.945014 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 608/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:48:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:48:59.949771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed85ce-82db-4dd3-b3a8-1397a34e6e41 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:00.012041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:00.059877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed85ce-82db-4dd3-b3a8-1397a34e6e41 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:00.095134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12dca2-9713-447e-a2e2-6ae0f303a053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:00.095782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12dca2-9713-447e-a2e2-6ae0f303a053 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:00.096062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12dca2-9713-447e-a2e2-6ae0f303a053 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:00.096341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12dca2-9713-447e-a2e2-6ae0f303a053 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:00.097076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12dca2-9713-447e-a2e2-6ae0f303a053 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:00.097421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12dca2-9713-447e-a2e2-6ae0f303a053 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:00.098981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12dca2-9713-447e-a2e2-6ae0f303a053 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:00.109937 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 608/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:00.116255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b043048-fdb4-48c4-8ee4-dc54f2d761d8 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:00.188396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:00.219292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b043048-fdb4-48c4-8ee4-dc54f2d761d8 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:00.252760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3203946-9de3-41d7-9f33-00ac62405576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:00.253538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3203946-9de3-41d7-9f33-00ac62405576 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:00.253812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3203946-9de3-41d7-9f33-00ac62405576 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:00.254081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3203946-9de3-41d7-9f33-00ac62405576 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:00.262022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3203946-9de3-41d7-9f33-00ac62405576 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:00.263630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3203946-9de3-41d7-9f33-00ac62405576 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:00.277831 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-a3203946-9de3-41d7-9f33-00ac62405576 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:49:00.277831 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:00.277831 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:00.277831 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:00.277831 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:00.277831 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:00.277831 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:00.277831 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:00.277831 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:00.277831 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:00.277831 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:00.277831 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:00.277831 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:49:00.277831 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:49:00.277831 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:49:00.278879 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:49:00.278879 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:00.278879 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:00.278879 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:00.278879 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:00.278879 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:00.278879 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:00.278879 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:00.278879 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:00.278879 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:00.278879 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:00.278879 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:00.278879 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:00.278879 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:00.278879 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:00.278879 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:00.278879 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:00.280141 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:49:00.280141 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:49:00.280141 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:49:00.280141 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:49:00.280141 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:49:00.280141 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:49:00.280141 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:49:00.280141 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:49:00.280141 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 609/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:49:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:00.285056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12dca2-9713-447e-a2e2-6ae0f303a053 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:00.386995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12dca2-9713-447e-a2e2-6ae0f303a053 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:00.408764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:00.419965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64aaa99-d62c-489a-a1e3-4996ab365227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:00.420617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aaa99-d62c-489a-a1e3-4996ab365227 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:00.420897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aaa99-d62c-489a-a1e3-4996ab365227 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:00.421173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aaa99-d62c-489a-a1e3-4996ab365227 None admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:00.421951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64aaa99-d62c-489a-a1e3-4996ab365227 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:00.422255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64aaa99-d62c-489a-a1e3-4996ab365227 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:00.423875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64aaa99-d62c-489a-a1e3-4996ab365227 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:00.436987 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 609/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:49:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:00.444695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3203946-9de3-41d7-9f33-00ac62405576 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:00.544732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3203946-9de3-41d7-9f33-00ac62405576 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:00.574472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:00.580362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541566b-b72c-476c-a3c8-5e5752f6a6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:00.581010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541566b-b72c-476c-a3c8-5e5752f6a6f7 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:00.581292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541566b-b72c-476c-a3c8-5e5752f6a6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:00.581565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541566b-b72c-476c-a3c8-5e5752f6a6f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:00.582417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541566b-b72c-476c-a3c8-5e5752f6a6f7 None admin] RBAC: Adding query filter params (role.id=99a4e0ec120f4163a419b2775afb8a41, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=2054690a99c843aaaf19d8193510fec1) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:00.582885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541566b-b72c-476c-a3c8-5e5752f6a6f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:00.584404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541566b-b72c-476c-a3c8-5e5752f6a6f7 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:00.589779 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 610/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:49:00 2022] GET /identity/v3/role_assignments?user.id=2054690a99c843aaaf19d8193510fec1&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=99a4e0ec120f4163a419b2775afb8a41 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:02.893261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dadfa-6867-430f-abb7-028f47644a97 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:02.893789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dadfa-6867-430f-abb7-028f47644a97 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:02.893889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dadfa-6867-430f-abb7-028f47644a97 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:02.895424 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 610/1220] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:49:02.900629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f31ca-f82c-4255-8265-9c8bd48da911 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:02.901031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f31ca-f82c-4255-8265-9c8bd48da911 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:02.901176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f31ca-f82c-4255-8265-9c8bd48da911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:02.918032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-655f31ca-f82c-4255-8265-9c8bd48da911 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:49:02.919246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-655f31ca-f82c-4255-8265-9c8bd48da911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:49:02.987658 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 611/1221] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:49:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:49:03.012890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dadfa-6867-430f-abb7-028f47644a97 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:03.114348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dadfa-6867-430f-abb7-028f47644a97 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:03.147738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90682e6f-78f7-40f6-89aa-b8c3dc011597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:03.148462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90682e6f-78f7-40f6-89aa-b8c3dc011597 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:03.148747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90682e6f-78f7-40f6-89aa-b8c3dc011597 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:03.149027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90682e6f-78f7-40f6-89aa-b8c3dc011597 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:03.159189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90682e6f-78f7-40f6-89aa-b8c3dc011597 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:49:03.167531 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-90682e6f-78f7-40f6-89aa-b8c3dc011597 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:49:03.167531 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:03.167531 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:03.167531 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:03.167531 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:03.167531 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:03.167531 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:03.167531 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:03.167531 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:03.167531 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:03.167531 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:03.167531 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:03.167531 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:49:03.167531 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:49:03.167531 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:49:03.167531 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:49:03.168573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:49:03.168573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:49:03.168573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:49:03.168573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:49:03.168573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:03.168573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:03.168573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:03.168573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:03.168573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:03.168573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:03.168573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:03.168573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:03.168573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:03.168573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:03.168573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:03.168573 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:03.169663 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:03.169663 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:03.169663 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:03.169663 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:03.169663 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:49:03.169663 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:49:03.169663 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:49:03.169663 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:49:03.169663 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:49:03.169663 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:49:03.169663 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:49:03.169663 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:49:03.169663 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 611/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:49:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:03.174974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f31ca-f82c-4255-8265-9c8bd48da911 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:03.275337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f31ca-f82c-4255-8265-9c8bd48da911 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:03.299448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:03.311149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607fed5-f57c-435d-9ec1-a44e013639c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:03.311811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607fed5-f57c-435d-9ec1-a44e013639c2 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:03.312090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607fed5-f57c-435d-9ec1-a44e013639c2 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:03.312361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607fed5-f57c-435d-9ec1-a44e013639c2 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:03.313098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607fed5-f57c-435d-9ec1-a44e013639c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:03.313403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607fed5-f57c-435d-9ec1-a44e013639c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:03.314769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607fed5-f57c-435d-9ec1-a44e013639c2 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:03.322788 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 612/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Jul 16 20:49:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:03.328789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90682e6f-78f7-40f6-89aa-b8c3dc011597 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:03.373883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:03.430233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90682e6f-78f7-40f6-89aa-b8c3dc011597 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:03.462630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df86e4e-845b-4dc8-83db-3a2847b2ed9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:03.469546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df86e4e-845b-4dc8-83db-3a2847b2ed9d None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:03.469546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df86e4e-845b-4dc8-83db-3a2847b2ed9d None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:03.469546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df86e4e-845b-4dc8-83db-3a2847b2ed9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:03.474788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df86e4e-845b-4dc8-83db-3a2847b2ed9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:03.476322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df86e4e-845b-4dc8-83db-3a2847b2ed9d None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:03.493133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-6df86e4e-845b-4dc8-83db-3a2847b2ed9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:49:03.493133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:03.493133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:03.493133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:03.493133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:03.493133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:03.493133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:03.493133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:03.493133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:03.493133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:03.493133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:03.493133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:03.493133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:49:03.493133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:49:03.493133 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:49:03.494201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:49:03.494201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:03.494201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:03.494201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:03.494201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:03.494201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:03.494201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:03.494201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:03.494201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:03.494201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:03.494201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:03.494201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:03.494201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:03.494201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:03.494201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:03.494201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:03.494201 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:03.495333 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:49:03.495333 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:49:03.495333 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:49:03.495333 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:49:03.495333 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 612/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:49:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:03.500246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607fed5-f57c-435d-9ec1-a44e013639c2 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:03.602577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607fed5-f57c-435d-9ec1-a44e013639c2 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:03.635752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f16340-edad-4829-95ae-66aae98c03de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:03.636396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f16340-edad-4829-95ae-66aae98c03de None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:03.636674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f16340-edad-4829-95ae-66aae98c03de None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:03.636941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f16340-edad-4829-95ae-66aae98c03de None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:03.637643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f16340-edad-4829-95ae-66aae98c03de None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:03.637943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f16340-edad-4829-95ae-66aae98c03de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:03.639332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f16340-edad-4829-95ae-66aae98c03de None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:03.651681 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 613/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:03.657414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df86e4e-845b-4dc8-83db-3a2847b2ed9d None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:03.751029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:03.758046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df86e4e-845b-4dc8-83db-3a2847b2ed9d None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:03.795650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce150b9-e6e8-4ad4-b546-f8dbd8d34c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:03.796436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce150b9-e6e8-4ad4-b546-f8dbd8d34c93 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:03.796713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce150b9-e6e8-4ad4-b546-f8dbd8d34c93 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:03.796984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce150b9-e6e8-4ad4-b546-f8dbd8d34c93 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:03.804543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce150b9-e6e8-4ad4-b546-f8dbd8d34c93 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:03.805963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce150b9-e6e8-4ad4-b546-f8dbd8d34c93 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:03.820518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-4ce150b9-e6e8-4ad4-b546-f8dbd8d34c93 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 16 20:49:03.820518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:03.820518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:03.820518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:03.820518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:03.820518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:03.820518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:03.820518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:03.820518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:03.820518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:03.820518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:03.820518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:03.820518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:49:03.820518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:49:03.820518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:49:03.820518 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:49:03.821686 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:03.821686 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:03.821686 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:49:03.821686 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:49:03.821686 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:49:03.821686 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:49:03.821686 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:03.821686 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:03.821686 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:03.821686 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:03.821686 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:03.821686 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:03.821686 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:03.821686 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:03.821686 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:03.821686 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:03.821686 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:03.821686 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:03.822620 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:03.822620 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:03.822620 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:49:03.822620 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:49:03.822620 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:49:03.822620 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:49:03.822620 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:49:03.822620 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:49:03.822620 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 16 20:49:03.822620 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:49:03.822620 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 613/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:49:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:03.827927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f16340-edad-4829-95ae-66aae98c03de None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:03.875616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:03.930580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f16340-edad-4829-95ae-66aae98c03de None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:03.966090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da55668-ea7d-4b61-b0be-736f5fdcf2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:03.966752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da55668-ea7d-4b61-b0be-736f5fdcf2c4 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:03.967055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da55668-ea7d-4b61-b0be-736f5fdcf2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:03.967362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da55668-ea7d-4b61-b0be-736f5fdcf2c4 None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:03.968189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da55668-ea7d-4b61-b0be-736f5fdcf2c4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:03.968504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da55668-ea7d-4b61-b0be-736f5fdcf2c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:03.970034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da55668-ea7d-4b61-b0be-736f5fdcf2c4 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:03.987670 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 614/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Jul 16 20:49:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:03.993693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce150b9-e6e8-4ad4-b546-f8dbd8d34c93 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:04.094886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce150b9-e6e8-4ad4-b546-f8dbd8d34c93 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:04.128484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba00ce-316b-4000-a8ac-f3f46621916f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:04.129826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba00ce-316b-4000-a8ac-f3f46621916f None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:04.130114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba00ce-316b-4000-a8ac-f3f46621916f None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:04.130386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba00ce-316b-4000-a8ac-f3f46621916f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:04.140950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba00ce-316b-4000-a8ac-f3f46621916f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:04.142420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba00ce-316b-4000-a8ac-f3f46621916f None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:04.159714 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-cdba00ce-316b-4000-a8ac-f3f46621916f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:49:04.159714 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:04.159714 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:04.159714 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:04.159714 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:04.159714 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:04.159714 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:04.159714 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:04.159714 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:04.159714 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:04.159714 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:04.159714 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:04.159714 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:49:04.159714 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:49:04.159714 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:49:04.161900 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:49:04.161900 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:04.161900 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:04.161900 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:04.161900 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:04.161900 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:04.161900 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:04.161900 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:04.161900 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:04.161900 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:04.161900 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:04.161900 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:04.161900 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:04.161900 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:04.161900 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:04.161900 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:04.161900 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:04.162828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:49:04.162828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:49:04.162828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:49:04.162828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:49:04.162828 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 614/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:49:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:04.167023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da55668-ea7d-4b61-b0be-736f5fdcf2c4 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:04.270270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da55668-ea7d-4b61-b0be-736f5fdcf2c4 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:04.272781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:04.304862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522a2cc-83aa-44df-b370-88b96b907298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:04.305508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522a2cc-83aa-44df-b370-88b96b907298 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:04.305789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522a2cc-83aa-44df-b370-88b96b907298 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:04.306094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522a2cc-83aa-44df-b370-88b96b907298 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:04.306803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522a2cc-83aa-44df-b370-88b96b907298 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:04.307141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522a2cc-83aa-44df-b370-88b96b907298 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:04.308500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522a2cc-83aa-44df-b370-88b96b907298 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:04.320195 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 615/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:49:04.325933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba00ce-316b-4000-a8ac-f3f46621916f None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:04.336485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:04.424825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba00ce-316b-4000-a8ac-f3f46621916f None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:04.459304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835c36e-a9de-4b17-94e1-a53d2a1ecf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:04.460189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835c36e-a9de-4b17-94e1-a53d2a1ecf8b None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:04.460465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835c36e-a9de-4b17-94e1-a53d2a1ecf8b None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:04.460734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835c36e-a9de-4b17-94e1-a53d2a1ecf8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:04.467304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835c36e-a9de-4b17-94e1-a53d2a1ecf8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:04.468719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835c36e-a9de-4b17-94e1-a53d2a1ecf8b None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:04.483828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-e835c36e-a9de-4b17-94e1-a53d2a1ecf8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:49:04.483828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:04.483828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:04.483828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:04.483828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:04.483828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:04.483828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:04.483828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:04.483828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:04.483828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:04.483828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:04.483828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:04.483828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:49:04.483828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:49:04.483828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:49:04.484801 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:49:04.484801 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:04.484801 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:04.484801 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:04.484801 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:04.484801 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:04.484801 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:04.484801 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:04.484801 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:04.484801 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:04.484801 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:04.484801 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:04.484801 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:04.484801 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:04.484801 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:04.484801 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:04.484801 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:04.485838 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:49:04.485838 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:49:04.485838 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:49:04.485838 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:49:04.485838 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:49:04.485838 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:49:04.485838 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:49:04.485838 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:49:04.485838 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 615/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:49:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:04.492153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522a2cc-83aa-44df-b370-88b96b907298 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:04.594757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522a2cc-83aa-44df-b370-88b96b907298 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:04.628561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916dbdcb-fc40-414f-9873-31cf3baabd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:04.629776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dbdcb-fc40-414f-9873-31cf3baabd8f None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:04.630145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dbdcb-fc40-414f-9873-31cf3baabd8f None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:04.630565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dbdcb-fc40-414f-9873-31cf3baabd8f None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:04.631381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916dbdcb-fc40-414f-9873-31cf3baabd8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:04.631687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916dbdcb-fc40-414f-9873-31cf3baabd8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:04.633110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916dbdcb-fc40-414f-9873-31cf3baabd8f None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:04.645669 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 616/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:49:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:04.652229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835c36e-a9de-4b17-94e1-a53d2a1ecf8b None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:04.717561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:04.751469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835c36e-a9de-4b17-94e1-a53d2a1ecf8b None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:04.783970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793d73f-69eb-42a6-b8ab-eca9cae50bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:04.784848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793d73f-69eb-42a6-b8ab-eca9cae50bc4 None admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:04.785127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793d73f-69eb-42a6-b8ab-eca9cae50bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:04.785883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793d73f-69eb-42a6-b8ab-eca9cae50bc4 None admin] PATH_INFO: `/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/2054690a99c843aaaf19d8193510fec1/roles/99a4e0ec120f4163a419b2775afb8a41` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:04.800041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793d73f-69eb-42a6-b8ab-eca9cae50bc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3045a89835d4e879a0ddc2557b831a3, user_id=2054690a99c843aaaf19d8193510fec1, role_id=99a4e0ec120f4163a419b2775afb8a41)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:04.802131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793d73f-69eb-42a6-b8ab-eca9cae50bc4 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:04.891362 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 616/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:49:04 2022] PUT /identity/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/2054690a99c843aaaf19d8193510fec1/roles/99a4e0ec120f4163a419b2775afb8a41 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 20:49:07.131849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437a275-5704-4d6d-a61d-2e4e9a3b2c6d None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:07.132390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437a275-5704-4d6d-a61d-2e4e9a3b2c6d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:07.132390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437a275-5704-4d6d-a61d-2e4e9a3b2c6d None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:07.133692 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 617/1233] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:49:07.139121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec163c6-046e-4c14-8d74-9fddf995d9fa None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:07.139533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec163c6-046e-4c14-8d74-9fddf995d9fa None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:07.139789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec163c6-046e-4c14-8d74-9fddf995d9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:07.156387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-aec163c6-046e-4c14-8d74-9fddf995d9fa None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:49:07.157555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-aec163c6-046e-4c14-8d74-9fddf995d9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:49:07.224222 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 617/1234] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:49:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:49:07.248427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437a275-5704-4d6d-a61d-2e4e9a3b2c6d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:07.274237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:07.353437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437a275-5704-4d6d-a61d-2e4e9a3b2c6d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:07.387238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f491b-54c9-42b0-a9f2-134362a68d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:07.387941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f491b-54c9-42b0-a9f2-134362a68d1a None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:07.388222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f491b-54c9-42b0-a9f2-134362a68d1a None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:07.388483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f491b-54c9-42b0-a9f2-134362a68d1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:07.399134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f491b-54c9-42b0-a9f2-134362a68d1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:49:07.406973 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-ad7f491b-54c9-42b0-a9f2-134362a68d1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:49:07.406973 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:07.406973 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:07.406973 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:07.406973 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:07.406973 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:07.406973 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:07.406973 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:07.406973 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:07.406973 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:07.406973 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:07.406973 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:07.406973 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:49:07.406973 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:49:07.406973 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:49:07.406973 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:49:07.407949 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:49:07.407949 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:49:07.407949 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:49:07.407949 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:49:07.407949 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:07.407949 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:07.407949 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:07.407949 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:07.407949 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:07.407949 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:07.407949 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:07.407949 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:07.407949 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:07.407949 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:07.407949 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:07.407949 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:07.408758 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:07.408758 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:07.408758 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:07.408758 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:07.408758 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:49:07.408758 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:49:07.408758 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:49:07.408758 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:49:07.408758 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:49:07.408758 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:49:07.408758 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 16 20:49:07.408758 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:49:07.409521 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 618/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Jul 16 20:49:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:07.415242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec163c6-046e-4c14-8d74-9fddf995d9fa None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:07.461572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:07.512743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec163c6-046e-4c14-8d74-9fddf995d9fa None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:07.546060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19d680-4320-46f3-9ff9-2446bcdbb7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:07.546719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19d680-4320-46f3-9ff9-2446bcdbb7a7 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:07.546994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19d680-4320-46f3-9ff9-2446bcdbb7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:07.547309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19d680-4320-46f3-9ff9-2446bcdbb7a7 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:07.548043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19d680-4320-46f3-9ff9-2446bcdbb7a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:07.548343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19d680-4320-46f3-9ff9-2446bcdbb7a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:07.549767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19d680-4320-46f3-9ff9-2446bcdbb7a7 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:07.558289 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 618/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Jul 16 20:49:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:07.564283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f491b-54c9-42b0-a9f2-134362a68d1a None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:07.649299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:07.665265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f491b-54c9-42b0-a9f2-134362a68d1a None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:07.699101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80111d54-e24d-4667-bd32-2f8c59dd9492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:07.699885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80111d54-e24d-4667-bd32-2f8c59dd9492 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:07.700164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80111d54-e24d-4667-bd32-2f8c59dd9492 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:07.700437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80111d54-e24d-4667-bd32-2f8c59dd9492 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:07.711569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80111d54-e24d-4667-bd32-2f8c59dd9492 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:07.713051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80111d54-e24d-4667-bd32-2f8c59dd9492 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:07.730190 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-80111d54-e24d-4667-bd32-2f8c59dd9492 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:49:07.730190 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:07.730190 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:07.730190 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:07.730190 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:07.730190 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:07.730190 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:07.730190 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:07.730190 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:07.730190 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:07.730190 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:07.730190 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:07.730190 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:49:07.730190 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:49:07.730190 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:49:07.731336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:49:07.731336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:07.731336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:07.731336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:07.731336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:07.731336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:07.731336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:07.731336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:07.731336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:07.731336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:07.731336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:07.731336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:07.731336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:07.731336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:07.731336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:07.731336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:07.731336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:07.737389 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:49:07.737389 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:49:07.737389 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:49:07.737389 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:49:07.737389 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 619/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:49:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:07.737879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19d680-4320-46f3-9ff9-2446bcdbb7a7 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:07.841263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19d680-4320-46f3-9ff9-2446bcdbb7a7 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:07.850561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:07.877964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7edd99-9ed6-4892-9548-ab0b96c3e561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:07.878632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7edd99-9ed6-4892-9548-ab0b96c3e561 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:07.878913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7edd99-9ed6-4892-9548-ab0b96c3e561 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:07.879838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7edd99-9ed6-4892-9548-ab0b96c3e561 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:07.880836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7edd99-9ed6-4892-9548-ab0b96c3e561 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:07.881093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7edd99-9ed6-4892-9548-ab0b96c3e561 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:07.882445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7edd99-9ed6-4892-9548-ab0b96c3e561 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:07.893505 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 619/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:07.899356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80111d54-e24d-4667-bd32-2f8c59dd9492 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:08.001593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80111d54-e24d-4667-bd32-2f8c59dd9492 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:08.036794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c359e-8862-4725-b417-b550a6168fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:08.037575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c359e-8862-4725-b417-b550a6168fe7 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:08.037852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c359e-8862-4725-b417-b550a6168fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:08.038201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c359e-8862-4725-b417-b550a6168fe7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:08.041091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:08.045602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c359e-8862-4725-b417-b550a6168fe7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:08.047149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c359e-8862-4725-b417-b550a6168fe7 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:08.062789 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-046c359e-8862-4725-b417-b550a6168fe7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 16 20:49:08.062789 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:08.062789 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:08.062789 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:08.062789 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:08.062789 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:08.062789 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:08.062789 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:08.062789 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:08.062789 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:08.062789 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:08.062789 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:08.062789 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:49:08.062789 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:49:08.062789 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:49:08.062789 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:49:08.063951 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:08.063951 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:08.063951 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:49:08.063951 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:49:08.063951 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:49:08.063951 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:49:08.063951 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:08.063951 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:08.063951 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:08.063951 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:08.063951 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:08.063951 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:08.063951 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:08.063951 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:08.063951 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:08.063951 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:08.063951 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:08.063951 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:08.064878 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:08.064878 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:08.064878 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:49:08.064878 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:49:08.064878 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:49:08.064878 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:49:08.064878 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:49:08.064878 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:49:08.064878 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 16 20:49:08.064878 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:49:08.064878 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 620/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:49:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:08.070779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7edd99-9ed6-4892-9548-ab0b96c3e561 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:08.172486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7edd99-9ed6-4892-9548-ab0b96c3e561 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:08.207460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09bd69-8c05-4fb1-807d-e80668c20870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:08.208292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09bd69-8c05-4fb1-807d-e80668c20870 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:08.208566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09bd69-8c05-4fb1-807d-e80668c20870 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:08.208844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09bd69-8c05-4fb1-807d-e80668c20870 None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:08.209699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09bd69-8c05-4fb1-807d-e80668c20870 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:08.210006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09bd69-8c05-4fb1-807d-e80668c20870 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:08.211467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09bd69-8c05-4fb1-807d-e80668c20870 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:08.228815 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 620/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Jul 16 20:49:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:08.234767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c359e-8862-4725-b417-b550a6168fe7 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:08.335853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c359e-8862-4725-b417-b550a6168fe7 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:08.369509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae6458-ed9f-4b9e-a7dd-fc879ddc003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:08.370799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae6458-ed9f-4b9e-a7dd-fc879ddc003c None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:08.370799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae6458-ed9f-4b9e-a7dd-fc879ddc003c None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:08.370799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae6458-ed9f-4b9e-a7dd-fc879ddc003c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:08.431704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:08.438264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae6458-ed9f-4b9e-a7dd-fc879ddc003c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:08.439764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae6458-ed9f-4b9e-a7dd-fc879ddc003c None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:08.539608 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 621/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:49:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 16 20:49:08.545585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09bd69-8c05-4fb1-807d-e80668c20870 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:08.573759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:08.645768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09bd69-8c05-4fb1-807d-e80668c20870 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:08.680683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1e783-23dd-46bc-ac25-4c5e5d4958b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:08.681517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1e783-23dd-46bc-ac25-4c5e5d4958b0 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:08.681840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1e783-23dd-46bc-ac25-4c5e5d4958b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:08.682064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1e783-23dd-46bc-ac25-4c5e5d4958b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:08.693301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1e783-23dd-46bc-ac25-4c5e5d4958b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:08.694768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1e783-23dd-46bc-ac25-4c5e5d4958b0 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:08.712289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-21b1e783-23dd-46bc-ac25-4c5e5d4958b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:49:08.712289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:08.712289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:08.712289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:08.712289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:08.712289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:08.712289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:08.712289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:08.712289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:08.712289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:08.712289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:08.712289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:08.712289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:49:08.712289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:49:08.712289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:49:08.713360 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:49:08.713360 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:08.713360 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:08.713360 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:08.713360 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:08.713360 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:08.713360 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:08.713360 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:08.713360 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:08.713360 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:08.713360 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:08.713360 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:08.713360 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:08.713360 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:08.713360 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:08.713360 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:08.713360 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:08.714478 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:49:08.714478 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:49:08.714478 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:49:08.714478 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:49:08.714478 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 621/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:49:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:08.719292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae6458-ed9f-4b9e-a7dd-fc879ddc003c None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:08.814457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:08.820525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae6458-ed9f-4b9e-a7dd-fc879ddc003c None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:08.855419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa0690-e1ce-4574-afc7-2e64d65c8d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:08.856073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa0690-e1ce-4574-afc7-2e64d65c8d11 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:08.856352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa0690-e1ce-4574-afc7-2e64d65c8d11 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:08.856623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa0690-e1ce-4574-afc7-2e64d65c8d11 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:08.857332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa0690-e1ce-4574-afc7-2e64d65c8d11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:08.857635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa0690-e1ce-4574-afc7-2e64d65c8d11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:08.859061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa0690-e1ce-4574-afc7-2e64d65c8d11 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:08.872888 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 622/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:08.878693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1e783-23dd-46bc-ac25-4c5e5d4958b0 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:08.960586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:08.981268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1e783-23dd-46bc-ac25-4c5e5d4958b0 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:09.015204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb98be5-9325-4bf2-bf48-ad25abd03c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:09.015985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb98be5-9325-4bf2-bf48-ad25abd03c87 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:09.016278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb98be5-9325-4bf2-bf48-ad25abd03c87 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:09.016527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb98be5-9325-4bf2-bf48-ad25abd03c87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:09.026200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb98be5-9325-4bf2-bf48-ad25abd03c87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:09.027712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb98be5-9325-4bf2-bf48-ad25abd03c87 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:09.041735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-cbb98be5-9325-4bf2-bf48-ad25abd03c87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:49:09.041735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:09.041735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:09.041735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:09.041735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:09.041735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:09.041735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:09.041735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:09.041735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:09.041735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:09.041735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:09.041735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:09.041735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:49:09.041735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:49:09.041735 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:49:09.042903 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:49:09.042903 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:09.042903 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:09.042903 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:09.042903 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:09.042903 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:09.042903 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:09.042903 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:09.042903 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:09.042903 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:09.042903 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:09.042903 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:09.042903 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:09.042903 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:09.042903 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:09.042903 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:09.042903 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:09.044013 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:49:09.044013 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:49:09.044013 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:49:09.044013 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:49:09.044013 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:49:09.044013 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:49:09.044013 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:49:09.044013 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:49:09.044013 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 622/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:49:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:09.049079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa0690-e1ce-4574-afc7-2e64d65c8d11 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:09.157225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa0690-e1ce-4574-afc7-2e64d65c8d11 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:09.191385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f977976-c859-444c-a790-f327e02255e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:09.192528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f977976-c859-444c-a790-f327e02255e1 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:09.192808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f977976-c859-444c-a790-f327e02255e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:09.193086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f977976-c859-444c-a790-f327e02255e1 None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:09.193862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f977976-c859-444c-a790-f327e02255e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:09.194170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f977976-c859-444c-a790-f327e02255e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:09.195666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f977976-c859-444c-a790-f327e02255e1 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:09.208487 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 623/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:49:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:09.214800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb98be5-9325-4bf2-bf48-ad25abd03c87 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:09.313473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb98be5-9325-4bf2-bf48-ad25abd03c87 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:09.346305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19043397-41ae-4fc2-b9a5-9eb69553894c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:09.346940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19043397-41ae-4fc2-b9a5-9eb69553894c None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:09.347244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19043397-41ae-4fc2-b9a5-9eb69553894c None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:09.347511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19043397-41ae-4fc2-b9a5-9eb69553894c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:09.349889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19043397-41ae-4fc2-b9a5-9eb69553894c None admin] RBAC: Adding query filter params (role.id=99a4e0ec120f4163a419b2775afb8a41, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=2054690a99c843aaaf19d8193510fec1) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:09.350333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19043397-41ae-4fc2-b9a5-9eb69553894c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:09.351815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19043397-41ae-4fc2-b9a5-9eb69553894c None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:09.357926 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 623/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:49:09 2022] GET /identity/v3/role_assignments?user.id=2054690a99c843aaaf19d8193510fec1&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=99a4e0ec120f4163a419b2775afb8a41 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 20:49:11.728994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ed363-5801-4fd8-96a6-83a1ea6a8150 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:11.729560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ed363-5801-4fd8-96a6-83a1ea6a8150 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:11.729560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ed363-5801-4fd8-96a6-83a1ea6a8150 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:11.730951 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 624/1247] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:49:11.736184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f5cc7-e8af-41e9-96fd-edfa73239d9b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:11.736611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f5cc7-e8af-41e9-96fd-edfa73239d9b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:11.736765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f5cc7-e8af-41e9-96fd-edfa73239d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:11.742498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:11.755031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3b9f5cc7-e8af-41e9-96fd-edfa73239d9b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:49:11.756206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3b9f5cc7-e8af-41e9-96fd-edfa73239d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:49:11.824397 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 624/1248] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:49:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:49:11.849622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ed363-5801-4fd8-96a6-83a1ea6a8150 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:11.868593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:11.950754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ed363-5801-4fd8-96a6-83a1ea6a8150 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:11.984002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc288ec-4181-41a1-84eb-3e87f7b9a697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:11.984709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc288ec-4181-41a1-84eb-3e87f7b9a697 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:11.984993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc288ec-4181-41a1-84eb-3e87f7b9a697 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:11.985262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc288ec-4181-41a1-84eb-3e87f7b9a697 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:11.996159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc288ec-4181-41a1-84eb-3e87f7b9a697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:49:12.003770 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-0dc288ec-4181-41a1-84eb-3e87f7b9a697 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:49:12.003770 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:12.003770 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:12.003770 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:12.003770 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:12.003770 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:12.003770 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:12.003770 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:12.003770 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:12.003770 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:12.003770 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:12.003770 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:12.003770 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:49:12.003770 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:49:12.003770 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:49:12.003770 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:49:12.006452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:49:12.006452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:49:12.006452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:49:12.006452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:49:12.006452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:12.006452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:12.006452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:12.006452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:12.006452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:12.006452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:12.006452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:12.006452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:12.006452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:12.006452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:12.006452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:12.006452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:12.007557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:12.007557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:12.007557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:12.007557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:12.007557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:49:12.007557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:49:12.007557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:49:12.007557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:49:12.007557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:49:12.007557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:49:12.007557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:49:12.007557 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:49:12.007557 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 625/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:49:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:12.011836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f5cc7-e8af-41e9-96fd-edfa73239d9b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:12.110428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f5cc7-e8af-41e9-96fd-edfa73239d9b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:12.139823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:12.144670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523f894-9df4-4909-9b2b-d3380b05cecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:12.145327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523f894-9df4-4909-9b2b-d3380b05cecd None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:12.145603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523f894-9df4-4909-9b2b-d3380b05cecd None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:12.145872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523f894-9df4-4909-9b2b-d3380b05cecd None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:12.146603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523f894-9df4-4909-9b2b-d3380b05cecd None admin] RBAC: Adding query filter params (name=admin) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:12.146904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523f894-9df4-4909-9b2b-d3380b05cecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:12.148297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523f894-9df4-4909-9b2b-d3380b05cecd None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:12.156498 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 625/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:49:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:12.163721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc288ec-4181-41a1-84eb-3e87f7b9a697 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:12.247314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:12.269228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc288ec-4181-41a1-84eb-3e87f7b9a697 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:12.304039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09884f-1cf9-42f0-8892-afc63b0b1109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:12.304812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09884f-1cf9-42f0-8892-afc63b0b1109 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:12.305101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09884f-1cf9-42f0-8892-afc63b0b1109 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:12.305397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09884f-1cf9-42f0-8892-afc63b0b1109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:12.315661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09884f-1cf9-42f0-8892-afc63b0b1109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:12.317366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09884f-1cf9-42f0-8892-afc63b0b1109 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:12.334725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-4e09884f-1cf9-42f0-8892-afc63b0b1109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:49:12.334725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:12.334725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:12.334725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:12.334725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:12.334725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:12.334725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:12.334725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:12.334725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:12.334725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:12.334725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:12.334725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:12.334725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:49:12.334725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:49:12.334725 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:49:12.335798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:49:12.335798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:12.335798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:12.335798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:12.335798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:12.335798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:12.335798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:12.335798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:12.335798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:12.335798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:12.335798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:12.335798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:12.335798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:12.335798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:12.335798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:12.335798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:12.335798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:12.336858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:49:12.336858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:49:12.336858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:49:12.336858 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:49:12.336858 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 626/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:49:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:12.341740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523f894-9df4-4909-9b2b-d3380b05cecd None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:12.443802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523f894-9df4-4909-9b2b-d3380b05cecd None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:12.477739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde0dcf-d2c5-4192-a026-17faf1269858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:12.478386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde0dcf-d2c5-4192-a026-17faf1269858 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:12.478663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde0dcf-d2c5-4192-a026-17faf1269858 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:12.478930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde0dcf-d2c5-4192-a026-17faf1269858 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:12.479666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde0dcf-d2c5-4192-a026-17faf1269858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:12.479966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde0dcf-d2c5-4192-a026-17faf1269858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:12.481307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde0dcf-d2c5-4192-a026-17faf1269858 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:12.492830 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 626/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:12.498736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09884f-1cf9-42f0-8892-afc63b0b1109 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:12.603023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09884f-1cf9-42f0-8892-afc63b0b1109 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:12.628613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:12.636522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a2bed-dbc5-4bcb-8b11-e1f7611dac07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:12.637339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a2bed-dbc5-4bcb-8b11-e1f7611dac07 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:12.637614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a2bed-dbc5-4bcb-8b11-e1f7611dac07 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:12.637907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a2bed-dbc5-4bcb-8b11-e1f7611dac07 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:12.645932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a2bed-dbc5-4bcb-8b11-e1f7611dac07 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:12.647424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a2bed-dbc5-4bcb-8b11-e1f7611dac07 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:12.662447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-e98a2bed-dbc5-4bcb-8b11-e1f7611dac07 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 16 20:49:12.662447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:12.662447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:12.662447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:12.662447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:12.662447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:12.662447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:12.662447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:12.662447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:12.662447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:12.662447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:12.662447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:12.662447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:49:12.662447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:49:12.662447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:49:12.662447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:49:12.663585 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:12.663585 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:12.663585 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:49:12.663585 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:49:12.663585 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:49:12.663585 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:49:12.663585 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:12.663585 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:12.663585 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:12.663585 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:12.663585 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:12.663585 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:12.663585 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:12.663585 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:12.663585 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:12.663585 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:12.663585 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:12.663585 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:12.664738 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:12.664738 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:12.664738 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:49:12.664738 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:49:12.664738 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:49:12.664738 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:49:12.664738 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:49:12.664738 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:49:12.664738 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 16 20:49:12.664738 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:49:12.664738 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 627/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:49:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:12.669528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde0dcf-d2c5-4192-a026-17faf1269858 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:12.729391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:12.781631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde0dcf-d2c5-4192-a026-17faf1269858 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:12.827988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febe8f7-8008-4dfe-b7f2-ece73825f455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:12.828659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febe8f7-8008-4dfe-b7f2-ece73825f455 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:12.829000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febe8f7-8008-4dfe-b7f2-ece73825f455 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:12.829291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febe8f7-8008-4dfe-b7f2-ece73825f455 None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:12.830264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febe8f7-8008-4dfe-b7f2-ece73825f455 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:12.830571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febe8f7-8008-4dfe-b7f2-ece73825f455 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:12.832829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febe8f7-8008-4dfe-b7f2-ece73825f455 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:12.851245 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 627/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Jul 16 20:49:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:12.856961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a2bed-dbc5-4bcb-8b11-e1f7611dac07 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:12.962012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a2bed-dbc5-4bcb-8b11-e1f7611dac07 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:12.994858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a65427-05c9-446e-b14c-9941091aac49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:12.995520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a65427-05c9-446e-b14c-9941091aac49 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:12.995796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a65427-05c9-446e-b14c-9941091aac49 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:12.996065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a65427-05c9-446e-b14c-9941091aac49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:13.050595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:13.063279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a65427-05c9-446e-b14c-9941091aac49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:13.064751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a65427-05c9-446e-b14c-9941091aac49 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:13.160012 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 628/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:49:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 16 20:49:13.165900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febe8f7-8008-4dfe-b7f2-ece73825f455 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:13.264559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febe8f7-8008-4dfe-b7f2-ece73825f455 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:13.277319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:13.299220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef3bc2-6533-4550-bdd2-a376c41ba43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:13.304732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef3bc2-6533-4550-bdd2-a376c41ba43e None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:13.304732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef3bc2-6533-4550-bdd2-a376c41ba43e None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:13.304732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef3bc2-6533-4550-bdd2-a376c41ba43e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:13.311460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef3bc2-6533-4550-bdd2-a376c41ba43e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:13.312894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef3bc2-6533-4550-bdd2-a376c41ba43e None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:13.330458 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-69ef3bc2-6533-4550-bdd2-a376c41ba43e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:49:13.330458 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:13.330458 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:13.330458 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:13.330458 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:13.330458 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:13.330458 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:13.330458 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:13.330458 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:13.330458 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:13.330458 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:13.330458 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:13.330458 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:49:13.330458 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:49:13.330458 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:49:13.331527 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:49:13.331527 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:13.331527 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:13.331527 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:13.331527 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:13.331527 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:13.331527 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:13.331527 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:13.331527 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:13.331527 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:13.331527 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:13.331527 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:13.331527 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:13.331527 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:13.331527 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:13.331527 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:13.331527 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:13.332903 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:49:13.332903 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:49:13.332903 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:49:13.332903 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:49:13.332903 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 628/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:49:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:13.337440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a65427-05c9-446e-b14c-9941091aac49 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:13.424993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:13.438057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a65427-05c9-446e-b14c-9941091aac49 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:13.472144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488ef3d-8495-4828-bc61-ef85a956bf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:13.473306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488ef3d-8495-4828-bc61-ef85a956bf1a None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:13.473581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488ef3d-8495-4828-bc61-ef85a956bf1a None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:13.473853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488ef3d-8495-4828-bc61-ef85a956bf1a None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:13.474558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488ef3d-8495-4828-bc61-ef85a956bf1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:13.474863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488ef3d-8495-4828-bc61-ef85a956bf1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:13.476533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488ef3d-8495-4828-bc61-ef85a956bf1a None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:13.488018 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 629/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:13.494503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef3bc2-6533-4550-bdd2-a376c41ba43e None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:13.595673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef3bc2-6533-4550-bdd2-a376c41ba43e None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:13.631992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd4a6d-cc3d-4e7c-862f-39e7bc5e3773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:13.632782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd4a6d-cc3d-4e7c-862f-39e7bc5e3773 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:13.633061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd4a6d-cc3d-4e7c-862f-39e7bc5e3773 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:13.633332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd4a6d-cc3d-4e7c-862f-39e7bc5e3773 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:13.640111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd4a6d-cc3d-4e7c-862f-39e7bc5e3773 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:13.641581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd4a6d-cc3d-4e7c-862f-39e7bc5e3773 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:13.655186 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-c9fd4a6d-cc3d-4e7c-862f-39e7bc5e3773 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:49:13.655186 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:13.655186 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:13.655186 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:13.655186 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:13.655186 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:13.655186 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:13.655186 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:13.655186 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:13.655186 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:13.655186 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:13.655186 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:13.655186 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:49:13.655186 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:49:13.655186 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:49:13.659040 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:49:13.659040 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:13.659040 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:13.659040 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:13.659040 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:13.659040 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:13.659040 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:13.659040 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:13.659040 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:13.659040 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:13.659040 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:13.659040 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:13.659040 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:13.659040 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:13.659040 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:13.659040 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:13.659040 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:13.660751 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:49:13.660751 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:49:13.660751 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:49:13.660751 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:49:13.660751 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:49:13.660751 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:49:13.660751 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:49:13.660751 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:49:13.660751 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 629/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:49:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:13.662866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488ef3d-8495-4828-bc61-ef85a956bf1a None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:13.761596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488ef3d-8495-4828-bc61-ef85a956bf1a None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:13.796021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4a039-753f-4541-ad24-680ecfd66659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:13.796671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4a039-753f-4541-ad24-680ecfd66659 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:13.797067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4a039-753f-4541-ad24-680ecfd66659 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:13.797273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4a039-753f-4541-ad24-680ecfd66659 None admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:13.798050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4a039-753f-4541-ad24-680ecfd66659 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:13.798357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4a039-753f-4541-ad24-680ecfd66659 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:13.799826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4a039-753f-4541-ad24-680ecfd66659 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:13.813215 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 630/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:49:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:13.819877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd4a6d-cc3d-4e7c-862f-39e7bc5e3773 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:13.848856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:13.922309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd4a6d-cc3d-4e7c-862f-39e7bc5e3773 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:13.955475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327fb46-bb9d-4e23-9dfb-4ce1ee39102b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:13.956122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327fb46-bb9d-4e23-9dfb-4ce1ee39102b None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:13.956403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327fb46-bb9d-4e23-9dfb-4ce1ee39102b None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:13.956709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327fb46-bb9d-4e23-9dfb-4ce1ee39102b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:13.958012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327fb46-bb9d-4e23-9dfb-4ce1ee39102b None admin] RBAC: Adding query filter params (role.id=bd33b827674a4d4db30c164cab416056, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=2054690a99c843aaaf19d8193510fec1) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:13.958321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327fb46-bb9d-4e23-9dfb-4ce1ee39102b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:13.959764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327fb46-bb9d-4e23-9dfb-4ce1ee39102b None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:13.965157 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 630/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:49:13 2022] GET /identity/v3/role_assignments?user.id=2054690a99c843aaaf19d8193510fec1&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=bd33b827674a4d4db30c164cab416056 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:16.197236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ce518-b7bd-47d6-b597-60f256d671ef None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:16.197769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ce518-b7bd-47d6-b597-60f256d671ef None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:16.197769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ce518-b7bd-47d6-b597-60f256d671ef None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:16.199098 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 631/1261] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:49:16.204510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121c76e-9e38-43dc-a503-d8698856f321 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:16.204912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121c76e-9e38-43dc-a503-d8698856f321 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:16.215628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121c76e-9e38-43dc-a503-d8698856f321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:16.222432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2121c76e-9e38-43dc-a503-d8698856f321 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:49:16.224306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2121c76e-9e38-43dc-a503-d8698856f321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:49:16.290272 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 631/1262] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:49:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:49:16.314424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ce518-b7bd-47d6-b597-60f256d671ef None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:16.326031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:16.417846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ce518-b7bd-47d6-b597-60f256d671ef None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:16.453401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bd7eb-75ce-4fcf-b887-af4320e16326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:16.454114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bd7eb-75ce-4fcf-b887-af4320e16326 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:16.454395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bd7eb-75ce-4fcf-b887-af4320e16326 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:16.454670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bd7eb-75ce-4fcf-b887-af4320e16326 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:16.465249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bd7eb-75ce-4fcf-b887-af4320e16326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:49:16.473322 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-da6bd7eb-75ce-4fcf-b887-af4320e16326 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:49:16.473322 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:16.473322 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:16.473322 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:16.473322 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:16.473322 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:16.473322 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:16.473322 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:16.473322 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:16.473322 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:16.473322 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:16.473322 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:16.473322 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:49:16.473322 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:49:16.473322 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:49:16.473322 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:49:16.474915 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:49:16.474915 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:49:16.474915 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:49:16.474915 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:49:16.474915 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:16.474915 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:16.474915 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:16.474915 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:16.474915 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:16.474915 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:16.474915 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:16.474915 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:16.474915 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:16.474915 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:16.474915 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:16.474915 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:16.475791 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:16.475791 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:16.475791 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:16.475791 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:16.475791 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:49:16.475791 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:49:16.475791 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:49:16.475791 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:49:16.475791 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:49:16.475791 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:49:16.475791 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:49:16.475791 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:49:16.475791 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 632/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:49:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:16.480645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121c76e-9e38-43dc-a503-d8698856f321 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:16.499365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:16.579387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121c76e-9e38-43dc-a503-d8698856f321 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:16.615170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea414c-6ce0-4e50-91b2-3fdfbd9d1ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:16.615834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea414c-6ce0-4e50-91b2-3fdfbd9d1ab2 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:16.616112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea414c-6ce0-4e50-91b2-3fdfbd9d1ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:16.616385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea414c-6ce0-4e50-91b2-3fdfbd9d1ab2 None admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:16.617121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea414c-6ce0-4e50-91b2-3fdfbd9d1ab2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:16.617424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea414c-6ce0-4e50-91b2-3fdfbd9d1ab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:16.618832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea414c-6ce0-4e50-91b2-3fdfbd9d1ab2 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:16.627124 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 632/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:49:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:16.633112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bd7eb-75ce-4fcf-b887-af4320e16326 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:16.701052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:16.734550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bd7eb-75ce-4fcf-b887-af4320e16326 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:16.767731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5898407-24e8-4fd4-b702-eafc5e3650df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:16.768512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5898407-24e8-4fd4-b702-eafc5e3650df None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:16.768789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5898407-24e8-4fd4-b702-eafc5e3650df None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:16.769060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5898407-24e8-4fd4-b702-eafc5e3650df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:16.782874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5898407-24e8-4fd4-b702-eafc5e3650df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:16.789429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5898407-24e8-4fd4-b702-eafc5e3650df None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:16.802692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-e5898407-24e8-4fd4-b702-eafc5e3650df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:49:16.802692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:16.802692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:16.802692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:16.802692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:16.802692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:16.802692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:16.802692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:16.802692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:16.802692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:16.802692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:16.802692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:16.802692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:49:16.802692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:49:16.802692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:49:16.804050 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:49:16.804050 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:16.804050 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:16.804050 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:16.804050 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:16.804050 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:16.804050 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:16.804050 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:16.804050 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:16.804050 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:16.804050 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:16.804050 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:16.804050 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:16.804050 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:16.804050 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:16.804050 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:16.804050 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:16.805126 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:49:16.805126 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:49:16.805126 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:49:16.805126 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:49:16.805126 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 633/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:49:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:16.810543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea414c-6ce0-4e50-91b2-3fdfbd9d1ab2 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:16.891907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:16.911746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea414c-6ce0-4e50-91b2-3fdfbd9d1ab2 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:16.945934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5385ab-f23c-4e9d-87de-dab9b736ff41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:16.946598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5385ab-f23c-4e9d-87de-dab9b736ff41 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:16.946874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5385ab-f23c-4e9d-87de-dab9b736ff41 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:16.947175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5385ab-f23c-4e9d-87de-dab9b736ff41 None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:16.947895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5385ab-f23c-4e9d-87de-dab9b736ff41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:16.948199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5385ab-f23c-4e9d-87de-dab9b736ff41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:16.949555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5385ab-f23c-4e9d-87de-dab9b736ff41 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:16.961974 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 633/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:16.967891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5898407-24e8-4fd4-b702-eafc5e3650df None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:17.070176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5898407-24e8-4fd4-b702-eafc5e3650df None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:17.089713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:17.103392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2feeeb-ac2d-4880-b225-190d8dd20a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:17.104184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2feeeb-ac2d-4880-b225-190d8dd20a35 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:17.104457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2feeeb-ac2d-4880-b225-190d8dd20a35 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:17.104724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2feeeb-ac2d-4880-b225-190d8dd20a35 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:17.112226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2feeeb-ac2d-4880-b225-190d8dd20a35 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:17.114396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2feeeb-ac2d-4880-b225-190d8dd20a35 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:17.129447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-5a2feeeb-ac2d-4880-b225-190d8dd20a35 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 16 20:49:17.129447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:17.129447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:17.129447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:17.129447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:17.129447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:17.129447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:17.129447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:17.129447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:17.129447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:17.129447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:17.129447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:17.129447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:49:17.129447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:49:17.129447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:49:17.129447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:49:17.130588 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:17.130588 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:17.130588 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:49:17.130588 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:49:17.130588 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:49:17.130588 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:49:17.130588 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:17.130588 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:17.130588 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:17.130588 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:17.130588 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:17.130588 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:17.130588 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:17.130588 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:17.130588 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:17.130588 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:17.130588 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:17.130588 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:17.131569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:17.131569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:17.131569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:49:17.131569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:49:17.131569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:49:17.131569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:49:17.131569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:49:17.131569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:49:17.131569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 16 20:49:17.131569 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:49:17.131569 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 634/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:49:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:17.136596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5385ab-f23c-4e9d-87de-dab9b736ff41 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:17.235097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5385ab-f23c-4e9d-87de-dab9b736ff41 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:17.270008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720603a0-d954-4440-8031-96223fedcb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:17.270657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720603a0-d954-4440-8031-96223fedcb63 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:17.270938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720603a0-d954-4440-8031-96223fedcb63 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:17.271246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720603a0-d954-4440-8031-96223fedcb63 None admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:17.272146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720603a0-d954-4440-8031-96223fedcb63 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:17.272458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720603a0-d954-4440-8031-96223fedcb63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:17.273874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720603a0-d954-4440-8031-96223fedcb63 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:17.282602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:17.292570 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 634/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Jul 16 20:49:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:17.298386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2feeeb-ac2d-4880-b225-190d8dd20a35 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:17.399431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2feeeb-ac2d-4880-b225-190d8dd20a35 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:17.434186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b3df1-8991-4184-993a-fc13d084c525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:17.434968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b3df1-8991-4184-993a-fc13d084c525 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:17.435278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b3df1-8991-4184-993a-fc13d084c525 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:17.435551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b3df1-8991-4184-993a-fc13d084c525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:17.446183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b3df1-8991-4184-993a-fc13d084c525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:17.447658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b3df1-8991-4184-993a-fc13d084c525 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:17.464566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-079b3df1-8991-4184-993a-fc13d084c525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:49:17.464566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:17.464566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:17.464566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:17.464566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:17.464566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:17.464566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:17.464566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:17.464566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:17.464566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:17.464566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:17.464566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:17.464566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:49:17.464566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:49:17.464566 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:49:17.468656 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:49:17.468656 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:17.468656 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:17.468656 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:17.468656 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:17.468656 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:17.468656 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:17.468656 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:17.468656 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:17.468656 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:17.468656 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:17.468656 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:17.468656 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:17.468656 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:17.468656 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:17.468656 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:17.468656 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:17.469782 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:49:17.469782 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:49:17.469782 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:49:17.469782 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:49:17.469782 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 635/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:49:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:17.471753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720603a0-d954-4440-8031-96223fedcb63 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:17.571758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720603a0-d954-4440-8031-96223fedcb63 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:17.605917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be0ccd-3f39-4db1-b2be-5a9f14182b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:17.606626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be0ccd-3f39-4db1-b2be-5a9f14182b2b None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:17.606913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be0ccd-3f39-4db1-b2be-5a9f14182b2b None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:17.607219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be0ccd-3f39-4db1-b2be-5a9f14182b2b None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:17.607937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be0ccd-3f39-4db1-b2be-5a9f14182b2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:17.608245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be0ccd-3f39-4db1-b2be-5a9f14182b2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:17.609810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be0ccd-3f39-4db1-b2be-5a9f14182b2b None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:17.622039 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 635/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:17.628011 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b3df1-8991-4184-993a-fc13d084c525 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:17.661648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:17.730637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b3df1-8991-4184-993a-fc13d084c525 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:17.764558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb916df-4765-42a5-8927-2b3bfa900795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:17.765337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb916df-4765-42a5-8927-2b3bfa900795 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:17.765617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb916df-4765-42a5-8927-2b3bfa900795 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:17.765890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb916df-4765-42a5-8927-2b3bfa900795 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:17.773221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb916df-4765-42a5-8927-2b3bfa900795 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:17.774742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb916df-4765-42a5-8927-2b3bfa900795 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:17.790679 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-cdb916df-4765-42a5-8927-2b3bfa900795 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:49:17.790679 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:17.790679 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:17.790679 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:17.790679 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:17.790679 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:17.790679 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:17.790679 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:17.790679 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:17.790679 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:17.790679 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:17.790679 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:17.790679 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:49:17.790679 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:49:17.790679 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:49:17.801366 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:49:17.801366 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:17.801366 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:17.801366 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:17.801366 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:17.801366 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:17.801366 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:17.801366 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:17.801366 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:17.801366 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:17.801366 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:17.801366 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:17.801366 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:17.801366 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:17.801366 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:17.801366 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:17.801366 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:17.802413 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:49:17.802413 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:49:17.802413 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:49:17.802413 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:49:17.802413 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:49:17.802413 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:49:17.802413 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:49:17.802413 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:49:17.802413 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 636/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:49:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:17.802915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be0ccd-3f39-4db1-b2be-5a9f14182b2b None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:17.861444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:17.902965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be0ccd-3f39-4db1-b2be-5a9f14182b2b None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:17.936447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c144e-fce2-4c25-bee8-7d6d2ee339ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:17.937023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c144e-fce2-4c25-bee8-7d6d2ee339ff None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:17.937299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c144e-fce2-4c25-bee8-7d6d2ee339ff None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:17.937566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c144e-fce2-4c25-bee8-7d6d2ee339ff None admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:17.938336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c144e-fce2-4c25-bee8-7d6d2ee339ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:17.938635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c144e-fce2-4c25-bee8-7d6d2ee339ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:17.940123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c144e-fce2-4c25-bee8-7d6d2ee339ff None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:17.952753 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 636/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:49:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:17.959341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb916df-4765-42a5-8927-2b3bfa900795 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:18.051902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:18.060748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb916df-4765-42a5-8927-2b3bfa900795 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:18.094228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f347e-5ea3-4ebc-a654-c2747dc017b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:18.095130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f347e-5ea3-4ebc-a654-c2747dc017b3 None admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:18.095411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f347e-5ea3-4ebc-a654-c2747dc017b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:18.095683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f347e-5ea3-4ebc-a654-c2747dc017b3 None admin] PATH_INFO: `/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/2054690a99c843aaaf19d8193510fec1/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:18.098296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f347e-5ea3-4ebc-a654-c2747dc017b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3045a89835d4e879a0ddc2557b831a3, user_id=2054690a99c843aaaf19d8193510fec1, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:18.099973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f347e-5ea3-4ebc-a654-c2747dc017b3 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:18.180532 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 637/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Jul 16 20:49:17 2022] PUT /identity/v3/projects/c3045a89835d4e879a0ddc2557b831a3/users/2054690a99c843aaaf19d8193510fec1/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 20:49:20.409188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b84f7f-f190-40ae-8bf5-454f58e47b84 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:20.409754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b84f7f-f190-40ae-8bf5-454f58e47b84 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:20.409754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b84f7f-f190-40ae-8bf5-454f58e47b84 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:20.411271 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 637/1274] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:49:20.416617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068e8f3-3e35-48d2-894a-c3ce5ca9fda1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:20.417017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068e8f3-3e35-48d2-894a-c3ce5ca9fda1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:20.417249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068e8f3-3e35-48d2-894a-c3ce5ca9fda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:20.434773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2068e8f3-3e35-48d2-894a-c3ce5ca9fda1 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:49:20.435988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2068e8f3-3e35-48d2-894a-c3ce5ca9fda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:49:20.503382 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 638/1275] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:49:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:49:20.528927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b84f7f-f190-40ae-8bf5-454f58e47b84 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:20.633130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b84f7f-f190-40ae-8bf5-454f58e47b84 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:20.649844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:20.665890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32304c38-bfea-41d8-93b3-af11e236157f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:20.666608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32304c38-bfea-41d8-93b3-af11e236157f None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:20.666889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32304c38-bfea-41d8-93b3-af11e236157f None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:20.667200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32304c38-bfea-41d8-93b3-af11e236157f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:20.677602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32304c38-bfea-41d8-93b3-af11e236157f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 20:49:20.685482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-32304c38-bfea-41d8-93b3-af11e236157f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:49:20.685482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:20.685482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:20.685482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:20.685482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:20.685482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:20.685482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:20.685482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:20.685482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:20.685482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:20.685482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:20.685482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:20.685482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 16 20:49:20.685482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 16 20:49:20.685482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 16 20:49:20.685482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 16 20:49:20.686486 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 20:49:20.686486 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 20:49:20.686486 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 20:49:20.686486 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 20:49:20.686486 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:20.686486 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:20.686486 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:20.686486 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:20.686486 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:20.686486 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:20.686486 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:20.686486 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:20.686486 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:20.686486 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:20.686486 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:20.686486 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:20.687540 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:20.687540 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:20.687540 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:20.687540 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:20.687540 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 20:49:20.687540 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 20:49:20.687540 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 20:49:20.687540 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 20:49:20.687540 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 20:49:20.687540 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 20:49:20.687540 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 16 20:49:20.687540 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:49:20.687540 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 638/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Jul 16 20:49:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:20.693813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068e8f3-3e35-48d2-894a-c3ce5ca9fda1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:20.776489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:20.794500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068e8f3-3e35-48d2-894a-c3ce5ca9fda1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:20.829281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9a8e7-7a49-4277-b624-e14e7f4841d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:20.829932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9a8e7-7a49-4277-b624-e14e7f4841d7 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:20.830206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9a8e7-7a49-4277-b624-e14e7f4841d7 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:20.830471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9a8e7-7a49-4277-b624-e14e7f4841d7 None admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:20.831266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9a8e7-7a49-4277-b624-e14e7f4841d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:20.831568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9a8e7-7a49-4277-b624-e14e7f4841d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:20.833325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9a8e7-7a49-4277-b624-e14e7f4841d7 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:20.841413 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 639/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Jul 16 20:49:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:20.847360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32304c38-bfea-41d8-93b3-af11e236157f None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:20.949951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32304c38-bfea-41d8-93b3-af11e236157f None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:20.983129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c2348-d49b-43e9-9376-e8bbc7fad3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:20.986400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c2348-d49b-43e9-9376-e8bbc7fad3e6 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:20.986400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c2348-d49b-43e9-9376-e8bbc7fad3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:20.986400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c2348-d49b-43e9-9376-e8bbc7fad3e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:20.995533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c2348-d49b-43e9-9376-e8bbc7fad3e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:20.997013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c2348-d49b-43e9-9376-e8bbc7fad3e6 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:21.013647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-fb6c2348-d49b-43e9-9376-e8bbc7fad3e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:49:21.013647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:21.013647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:21.013647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:21.013647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:21.013647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:21.013647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:21.013647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:21.013647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:21.013647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:21.013647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:21.013647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:21.013647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:49:21.013647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:49:21.013647 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:49:21.014905 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:49:21.014905 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:21.014905 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:21.014905 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:21.014905 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:21.014905 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:21.014905 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:21.014905 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:21.014905 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:21.014905 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:21.014905 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:21.014905 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:21.014905 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:21.014905 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:21.014905 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:21.014905 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:21.014905 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:21.015953 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:49:21.015953 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:49:21.015953 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:49:21.015953 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:49:21.015953 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 639/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:49:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:21.021767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9a8e7-7a49-4277-b624-e14e7f4841d7 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:21.126969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9a8e7-7a49-4277-b624-e14e7f4841d7 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:21.159515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc14fce-ae03-4a57-8da3-0d126c378a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:21.160725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc14fce-ae03-4a57-8da3-0d126c378a63 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:21.161226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc14fce-ae03-4a57-8da3-0d126c378a63 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:21.161510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc14fce-ae03-4a57-8da3-0d126c378a63 None admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:21.162216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc14fce-ae03-4a57-8da3-0d126c378a63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:21.162516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc14fce-ae03-4a57-8da3-0d126c378a63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:21.163890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc14fce-ae03-4a57-8da3-0d126c378a63 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:21.175264 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 640/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:21.182116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c2348-d49b-43e9-9376-e8bbc7fad3e6 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:21.212857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:21.281867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c2348-d49b-43e9-9376-e8bbc7fad3e6 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:21.314776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22b353-3aa5-4e92-8a53-7b38a226965a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:21.315592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22b353-3aa5-4e92-8a53-7b38a226965a None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:21.315870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22b353-3aa5-4e92-8a53-7b38a226965a None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:21.316138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22b353-3aa5-4e92-8a53-7b38a226965a None admin] PATH_INFO: `/v3/users/placement` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:21.323661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22b353-3aa5-4e92-8a53-7b38a226965a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:21.325077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22b353-3aa5-4e92-8a53-7b38a226965a None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:21.339437 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-5b22b353-3aa5-4e92-8a53-7b38a226965a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 16 20:49:21.339437 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:21.339437 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:21.339437 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:21.339437 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:21.339437 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:21.339437 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:21.339437 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:21.339437 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:21.339437 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:21.339437 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:21.339437 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:21.339437 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 20:49:21.339437 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 20:49:21.339437 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 20:49:21.339437 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 20:49:21.349808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:21.349808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:21.349808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 20:49:21.349808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:49:21.349808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 20:49:21.349808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 20:49:21.349808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:21.349808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:21.349808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:21.349808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:21.349808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:21.349808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:21.349808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:21.349808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:21.349808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:21.349808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:21.349808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:21.349808 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:21.350787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:21.350787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:21.350787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 20:49:21.350787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 20:49:21.350787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 20:49:21.350787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 20:49:21.350787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 20:49:21.350787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 20:49:21.350787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 16 20:49:21.350787 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:49:21.350787 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 640/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:49:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:21.351449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc14fce-ae03-4a57-8da3-0d126c378a63 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:21.351449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:21.446970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc14fce-ae03-4a57-8da3-0d126c378a63 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:21.480779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d10ad-00fb-4fcf-a1c0-74dfdc0f8cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:21.481367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d10ad-00fb-4fcf-a1c0-74dfdc0f8cf1 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:21.481644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d10ad-00fb-4fcf-a1c0-74dfdc0f8cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:21.481971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d10ad-00fb-4fcf-a1c0-74dfdc0f8cf1 None admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:21.482723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d10ad-00fb-4fcf-a1c0-74dfdc0f8cf1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:21.483046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d10ad-00fb-4fcf-a1c0-74dfdc0f8cf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:21.484743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d10ad-00fb-4fcf-a1c0-74dfdc0f8cf1 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:21.501540 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 641/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Jul 16 20:49:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:21.507446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22b353-3aa5-4e92-8a53-7b38a226965a None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:21.597310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:21.607160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22b353-3aa5-4e92-8a53-7b38a226965a None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:21.639441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24b0f2-717c-432a-906f-f930b1d4bee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:21.640084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24b0f2-717c-432a-906f-f930b1d4bee9 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:21.640364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24b0f2-717c-432a-906f-f930b1d4bee9 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:21.640644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24b0f2-717c-432a-906f-f930b1d4bee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:21.709436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24b0f2-717c-432a-906f-f930b1d4bee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:21.710880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24b0f2-717c-432a-906f-f930b1d4bee9 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:21.800572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:21.811234 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 641/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Jul 16 20:49:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 16 20:49:21.818111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d10ad-00fb-4fcf-a1c0-74dfdc0f8cf1 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:21.880368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:21.918146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d10ad-00fb-4fcf-a1c0-74dfdc0f8cf1 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:21.952212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933d61c-32f2-4b1d-b30b-4bfa323a2661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:21.952985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933d61c-32f2-4b1d-b30b-4bfa323a2661 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:21.953260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933d61c-32f2-4b1d-b30b-4bfa323a2661 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:21.953572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933d61c-32f2-4b1d-b30b-4bfa323a2661 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:21.964331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933d61c-32f2-4b1d-b30b-4bfa323a2661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:21.965792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933d61c-32f2-4b1d-b30b-4bfa323a2661 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:21.983324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-3933d61c-32f2-4b1d-b30b-4bfa323a2661 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:49:21.983324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:21.983324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:21.983324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:21.983324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:21.983324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:21.983324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:21.983324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:21.983324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:21.983324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:21.983324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:21.983324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:21.983324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 20:49:21.983324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 20:49:21.983324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 20:49:21.984472 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 20:49:21.984472 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:21.984472 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:21.984472 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:21.984472 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:21.984472 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:21.984472 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:21.984472 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:21.984472 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:21.984472 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:21.984472 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:21.984472 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:21.984472 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:21.984472 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:21.984472 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:21.984472 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:21.984472 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:21.985641 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 16 20:49:21.985641 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 20:49:21.985641 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 16 20:49:21.985641 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:49:21.985641 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 642/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 20:49:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:21.990597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24b0f2-717c-432a-906f-f930b1d4bee9 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:22.087723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24b0f2-717c-432a-906f-f930b1d4bee9 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:22.121229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaad89-51e8-4347-a60b-37764747f5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:22.121882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaad89-51e8-4347-a60b-37764747f5de None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:22.122164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaad89-51e8-4347-a60b-37764747f5de None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:22.122437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaad89-51e8-4347-a60b-37764747f5de None admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:22.123177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aaad89-51e8-4347-a60b-37764747f5de None admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:22.123478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aaad89-51e8-4347-a60b-37764747f5de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:22.124826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aaad89-51e8-4347-a60b-37764747f5de None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:22.136918 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 642/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Jul 16 20:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:22.142414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933d61c-32f2-4b1d-b30b-4bfa323a2661 None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:22.242382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933d61c-32f2-4b1d-b30b-4bfa323a2661 None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:22.256822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:22.276286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00806596-99ba-40fa-a6b3-7a0f564e741a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:22.277098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00806596-99ba-40fa-a6b3-7a0f564e741a None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:22.277379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00806596-99ba-40fa-a6b3-7a0f564e741a None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:22.277686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00806596-99ba-40fa-a6b3-7a0f564e741a None admin] PATH_INFO: `/v3/projects/service` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:22.284309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00806596-99ba-40fa-a6b3-7a0f564e741a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:22.285737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00806596-99ba-40fa-a6b3-7a0f564e741a None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:22.299685 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-00806596-99ba-40fa-a6b3-7a0f564e741a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:49:22.299685 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:22.299685 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:22.299685 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:22.299685 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:22.299685 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:22.299685 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:22.299685 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:22.299685 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:22.299685 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:22.299685 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:22.299685 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:22.299685 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 16 20:49:22.299685 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 16 20:49:22.299685 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 16 20:49:22.301324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 16 20:49:22.301324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:22.301324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:22.301324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:22.301324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:22.301324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:22.301324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:22.301324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:22.301324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:22.301324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:22.301324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:22.301324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:22.301324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:22.301324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:22.301324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:22.301324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:22.301324 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:22.302360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 16 20:49:22.302360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 16 20:49:22.302360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 20:49:22.302360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 20:49:22.302360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 20:49:22.302360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 20:49:22.302360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 16 20:49:22.302360 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 20:49:22.302360 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 643/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Jul 16 20:49:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:22.307786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaad89-51e8-4347-a60b-37764747f5de None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:22.359384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:22.409091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaad89-51e8-4347-a60b-37764747f5de None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:22.442941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2504619-30ed-4ad6-b94d-abae43db0cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:22.443625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2504619-30ed-4ad6-b94d-abae43db0cbf None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:22.443911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2504619-30ed-4ad6-b94d-abae43db0cbf None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:22.444189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2504619-30ed-4ad6-b94d-abae43db0cbf None admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:22.444972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2504619-30ed-4ad6-b94d-abae43db0cbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:22.445363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2504619-30ed-4ad6-b94d-abae43db0cbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:22.446790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2504619-30ed-4ad6-b94d-abae43db0cbf None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:22.459462 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 643/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Jul 16 20:49:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:22.465644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00806596-99ba-40fa-a6b3-7a0f564e741a None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:22.570030 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00806596-99ba-40fa-a6b3-7a0f564e741a None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:22.604014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95aa403-4317-42aa-ab0b-fb1b0aee2da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:22.604654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aa403-4317-42aa-ab0b-fb1b0aee2da1 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:22.604937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aa403-4317-42aa-ab0b-fb1b0aee2da1 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:22.605212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aa403-4317-42aa-ab0b-fb1b0aee2da1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:22.606036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95aa403-4317-42aa-ab0b-fb1b0aee2da1 None admin] RBAC: Adding query filter params (role.id=bd33b827674a4d4db30c164cab416056, scope.project.id=c3045a89835d4e879a0ddc2557b831a3, user.id=2054690a99c843aaaf19d8193510fec1) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:22.606345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95aa403-4317-42aa-ab0b-fb1b0aee2da1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:22.607813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95aa403-4317-42aa-ab0b-fb1b0aee2da1 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:22.628212 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 644/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Jul 16 20:49:22 2022] GET /identity/v3/role_assignments?user.id=2054690a99c843aaaf19d8193510fec1&scope.project.id=c3045a89835d4e879a0ddc2557b831a3&role.id=bd33b827674a4d4db30c164cab416056 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:24.874699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f811b4-be63-4922-be64-158d37a541e5 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:24.875235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f811b4-be63-4922-be64-158d37a541e5 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:24.875354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f811b4-be63-4922-be64-158d37a541e5 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:24.876767 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 644/1288] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:49:24.882816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3d70d-676c-46fb-8d0d-d9d7d7355253 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:24.883328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3d70d-676c-46fb-8d0d-d9d7d7355253 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:24.883421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3d70d-676c-46fb-8d0d-d9d7d7355253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:24.902773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a4e3d70d-676c-46fb-8d0d-d9d7d7355253 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:49:24.903999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a4e3d70d-676c-46fb-8d0d-d9d7d7355253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:49:24.935205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:24.975313 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 645/1289] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:49:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:49:25.000408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f811b4-be63-4922-be64-158d37a541e5 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:25.105736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f811b4-be63-4922-be64-158d37a541e5 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:25.117063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:25.139747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c26797-e607-4723-a3f6-33712786c5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:25.140533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c26797-e607-4723-a3f6-33712786c5eb None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:25.140809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c26797-e607-4723-a3f6-33712786c5eb None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:25.141080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c26797-e607-4723-a3f6-33712786c5eb None admin] PATH_INFO: `/v3/services/placement` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:25.141725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c26797-e607-4723-a3f6-33712786c5eb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:25.143104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c26797-e607-4723-a3f6-33712786c5eb None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:25.154665 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-f8c26797-e607-4723-a3f6-33712786c5eb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 16 20:49:25.154665 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:25.154665 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:49:25.154665 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:49:25.154665 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:49:25.154665 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:49:25.154665 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:49:25.154665 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:49:25.154665 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 16 20:49:25.154665 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:49:25.154665 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:49:25.154665 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:49:25.154665 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:25.154665 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:25.154665 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:25.154665 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:25.154665 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:25.155912 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:25.155912 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:25.155912 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:25.155912 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:25.155912 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:25.155912 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:25.155912 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:49:25.155912 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:49:25.155912 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:49:25.155912 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:49:25.155912 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:25.155912 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:25.155912 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:25.155912 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:25.155912 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:25.155912 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:25.156942 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:25.156942 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:25.156942 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:25.156942 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:25.156942 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:25.156942 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:25.156942 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:25.156942 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:25.156942 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:25.156942 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:25.156942 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:49:25.156942 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:49:25.156942 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 16 20:49:25.156942 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:49:25.156942 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 645/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Jul 16 20:49:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:25.161892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3d70d-676c-46fb-8d0d-d9d7d7355253 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:25.260897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3d70d-676c-46fb-8d0d-d9d7d7355253 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:25.295044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddf4fd-aa14-4c0b-9eeb-c3f451b6c475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:25.295827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddf4fd-aa14-4c0b-9eeb-c3f451b6c475 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:25.296105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddf4fd-aa14-4c0b-9eeb-c3f451b6c475 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:25.296377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddf4fd-aa14-4c0b-9eeb-c3f451b6c475 None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:25.297072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddf4fd-aa14-4c0b-9eeb-c3f451b6c475 None admin] RBAC: Adding query filter params (name=placement) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:25.297375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddf4fd-aa14-4c0b-9eeb-c3f451b6c475 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:25.298750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddf4fd-aa14-4c0b-9eeb-c3f451b6c475 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:25.304630 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 646/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Jul 16 20:49:25 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:25.310498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c26797-e607-4723-a3f6-33712786c5eb None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:25.411371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c26797-e607-4723-a3f6-33712786c5eb None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:25.444835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c5aac-02c2-49b9-b5b4-6c7f45d3f9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:25.445487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c5aac-02c2-49b9-b5b4-6c7f45d3f9e2 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:25.445769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c5aac-02c2-49b9-b5b4-6c7f45d3f9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:25.446056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c5aac-02c2-49b9-b5b4-6c7f45d3f9e2 None admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:25.446754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c5aac-02c2-49b9-b5b4-6c7f45d3f9e2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:25.447089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c5aac-02c2-49b9-b5b4-6c7f45d3f9e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:25.448461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c5aac-02c2-49b9-b5b4-6c7f45d3f9e2 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:25.453038 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 646/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Jul 16 20:49:25 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:27.711654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535b45c-42ec-4433-b0eb-ec5a3f112d66 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:27.712195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535b45c-42ec-4433-b0eb-ec5a3f112d66 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:27.712195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535b45c-42ec-4433-b0eb-ec5a3f112d66 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:27.713566 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 647/1293] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:49:27.719280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d8b64-0d18-434a-90a5-38f7e8f31349 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:27.719759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d8b64-0d18-434a-90a5-38f7e8f31349 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:27.719851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d8b64-0d18-434a-90a5-38f7e8f31349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:27.739596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-880d8b64-0d18-434a-90a5-38f7e8f31349 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:49:27.740795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-880d8b64-0d18-434a-90a5-38f7e8f31349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:49:27.778051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:27.828207 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 647/1294] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:49:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:49:27.856244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535b45c-42ec-4433-b0eb-ec5a3f112d66 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:27.890970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:27.964000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535b45c-42ec-4433-b0eb-ec5a3f112d66 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:28.002666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ebe61-5fd1-4bc9-97b4-1be193166118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:28.003358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ebe61-5fd1-4bc9-97b4-1be193166118 None admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:28.003642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ebe61-5fd1-4bc9-97b4-1be193166118 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:28.003949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ebe61-5fd1-4bc9-97b4-1be193166118 None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:28.004865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ebe61-5fd1-4bc9-97b4-1be193166118 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:28.006271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ebe61-5fd1-4bc9-97b4-1be193166118 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:28.095961 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 648/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Jul 16 20:49:27 2022] POST /identity/v3/services => generated 246 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 20:49:30.363952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37739c6e-0b62-4ecd-88d8-efff4903fa12 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:30.364652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37739c6e-0b62-4ecd-88d8-efff4903fa12 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:30.364652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37739c6e-0b62-4ecd-88d8-efff4903fa12 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:30.365868 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 648/1296] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:49:30.371180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e853a-35ad-4bf9-826d-faa10942267f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:30.371617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e853a-35ad-4bf9-826d-faa10942267f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:30.371743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e853a-35ad-4bf9-826d-faa10942267f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:30.389119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9b8e853a-35ad-4bf9-826d-faa10942267f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:49:30.399785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9b8e853a-35ad-4bf9-826d-faa10942267f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:49:30.464136 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 649/1297] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:49:30 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:49:30.488623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37739c6e-0b62-4ecd-88d8-efff4903fa12 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:30.594487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37739c6e-0b62-4ecd-88d8-efff4903fa12 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:30.627656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb38c49-112e-45a3-a3f0-991f76d3a2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:30.628381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb38c49-112e-45a3-a3f0-991f76d3a2e7 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:30.628757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb38c49-112e-45a3-a3f0-991f76d3a2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:30.629031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb38c49-112e-45a3-a3f0-991f76d3a2e7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:30.629683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb38c49-112e-45a3-a3f0-991f76d3a2e7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:30.631052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb38c49-112e-45a3-a3f0-991f76d3a2e7 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:30.642513 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-5eb38c49-112e-45a3-a3f0-991f76d3a2e7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 16 20:49:30.642513 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:30.642513 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:49:30.642513 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:49:30.642513 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:49:30.642513 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:49:30.642513 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:49:30.642513 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:49:30.642513 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 16 20:49:30.642513 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:49:30.642513 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:49:30.642513 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:49:30.642513 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:30.642513 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:30.642513 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:30.642513 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:30.642513 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:30.650163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:30.650163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:30.650163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:30.650163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:30.650163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:30.650163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:30.650163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:49:30.650163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:49:30.650163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:49:30.650163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:49:30.650163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:30.650163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:30.650163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:30.650163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:30.650163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:30.650163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:30.651247 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:30.651247 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:30.651247 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:30.651247 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:30.651247 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:30.651247 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:30.651247 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:30.651247 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:30.651247 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:30.651247 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:30.651247 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:49:30.651247 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:49:30.651247 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 16 20:49:30.651247 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:49:30.651247 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 649/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Jul 16 20:49:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:30.652246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e853a-35ad-4bf9-826d-faa10942267f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:30.669881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:30.750453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e853a-35ad-4bf9-826d-faa10942267f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:30.784945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90483d1e-78b1-43ee-aadb-f9d74e49742b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:30.785705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90483d1e-78b1-43ee-aadb-f9d74e49742b None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:30.785988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90483d1e-78b1-43ee-aadb-f9d74e49742b None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:30.786271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90483d1e-78b1-43ee-aadb-f9d74e49742b None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:30.786973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90483d1e-78b1-43ee-aadb-f9d74e49742b None admin] RBAC: Adding query filter params (name=placement) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:30.787387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90483d1e-78b1-43ee-aadb-f9d74e49742b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:30.788738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90483d1e-78b1-43ee-aadb-f9d74e49742b None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:30.793908 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 650/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Jul 16 20:49:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:30.800311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb38c49-112e-45a3-a3f0-991f76d3a2e7 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:30.837775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:30.905352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb38c49-112e-45a3-a3f0-991f76d3a2e7 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:30.939690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55df902-ab74-4082-a659-7fc8f44da228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:30.940344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55df902-ab74-4082-a659-7fc8f44da228 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:30.940629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55df902-ab74-4082-a659-7fc8f44da228 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:30.941445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55df902-ab74-4082-a659-7fc8f44da228 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:30.942231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55df902-ab74-4082-a659-7fc8f44da228 None admin] RBAC: Adding query filter params (interface=public, service_id=b79777ba23394f7a8e4bec19e7f07045, region_id=RegionOne) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:30.942541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55df902-ab74-4082-a659-7fc8f44da228 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:30.943936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55df902-ab74-4082-a659-7fc8f44da228 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:30.948943 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 650/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Jul 16 20:49:30 2022] GET /identity/v3/endpoints?service_id=b79777ba23394f7a8e4bec19e7f07045&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:30.954640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90483d1e-78b1-43ee-aadb-f9d74e49742b None admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:31.037434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:31.056548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90483d1e-78b1-43ee-aadb-f9d74e49742b None admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:31.090169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecbdf7-f9a3-462d-bce5-a38e2174e81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:31.090792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecbdf7-f9a3-462d-bce5-a38e2174e81a None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:31.091103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecbdf7-f9a3-462d-bce5-a38e2174e81a None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:31.091385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecbdf7-f9a3-462d-bce5-a38e2174e81a None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:31.092056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecbdf7-f9a3-462d-bce5-a38e2174e81a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:31.093411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecbdf7-f9a3-462d-bce5-a38e2174e81a None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:31.100383 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 651/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Jul 16 20:49:30 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 20:49:33.328220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98f820-63d5-4bbb-ae6a-dc8a654b02fa None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:33.329935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98f820-63d5-4bbb-ae6a-dc8a654b02fa None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:33.329935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98f820-63d5-4bbb-ae6a-dc8a654b02fa None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:33.330269 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 651/1302] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:49:33.335881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daad9a5-5a49-42d7-b6b3-a472da81370f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:33.336311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daad9a5-5a49-42d7-b6b3-a472da81370f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:33.336433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daad9a5-5a49-42d7-b6b3-a472da81370f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:33.353098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1daad9a5-5a49-42d7-b6b3-a472da81370f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:49:33.354280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1daad9a5-5a49-42d7-b6b3-a472da81370f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:49:33.422918 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 652/1303] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:49:33 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 20:49:33.449567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98f820-63d5-4bbb-ae6a-dc8a654b02fa None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:33.546873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:33.555021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98f820-63d5-4bbb-ae6a-dc8a654b02fa None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:33.591418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2933f4-5d0f-42bc-9cdf-fe8bc25bc023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:33.592128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2933f4-5d0f-42bc-9cdf-fe8bc25bc023 None admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:33.592403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2933f4-5d0f-42bc-9cdf-fe8bc25bc023 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:33.592670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2933f4-5d0f-42bc-9cdf-fe8bc25bc023 None admin] PATH_INFO: `/v3/services/placement` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:33.593310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2933f4-5d0f-42bc-9cdf-fe8bc25bc023 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:33.594812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2933f4-5d0f-42bc-9cdf-fe8bc25bc023 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:33.606816 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-cf2933f4-5d0f-42bc-9cdf-fe8bc25bc023 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 16 20:49:33.606816 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:33.606816 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 20:49:33.606816 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 20:49:33.606816 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 20:49:33.606816 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 20:49:33.606816 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 20:49:33.606816 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:49:33.606816 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 16 20:49:33.606816 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:49:33.606816 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 20:49:33.606816 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:49:33.606816 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 20:49:33.606816 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 20:49:33.606816 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 20:49:33.606816 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 20:49:33.606816 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 20:49:33.608098 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 20:49:33.608098 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 20:49:33.608098 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 20:49:33.608098 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 20:49:33.608098 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 20:49:33.608098 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 20:49:33.608098 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 20:49:33.608098 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 20:49:33.608098 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 20:49:33.608098 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 20:49:33.608098 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 20:49:33.608098 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 20:49:33.608098 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 20:49:33.608098 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 20:49:33.608098 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 20:49:33.608098 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 20:49:33.609374 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 20:49:33.609374 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 20:49:33.609374 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 20:49:33.609374 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 20:49:33.609374 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 20:49:33.609374 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 20:49:33.609374 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 20:49:33.609374 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 20:49:33.609374 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 20:49:33.609374 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 20:49:33.609374 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 20:49:33.609374 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 20:49:33.609374 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 16 20:49:33.609374 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 20:49:33.609374 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 652/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Jul 16 20:49:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 20:49:33.615544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daad9a5-5a49-42d7-b6b3-a472da81370f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:33.693117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:33.715282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daad9a5-5a49-42d7-b6b3-a472da81370f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:33.749380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35abad8-db60-46f9-8cf5-2b2d88e4c221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:33.750030 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35abad8-db60-46f9-8cf5-2b2d88e4c221 None admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:33.750310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35abad8-db60-46f9-8cf5-2b2d88e4c221 None admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:33.750584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35abad8-db60-46f9-8cf5-2b2d88e4c221 None admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:33.751308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35abad8-db60-46f9-8cf5-2b2d88e4c221 None admin] RBAC: Adding query filter params (name=placement) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 20:49:33.751611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35abad8-db60-46f9-8cf5-2b2d88e4c221 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:33.752985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35abad8-db60-46f9-8cf5-2b2d88e4c221 None admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:33.759178 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 653/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Jul 16 20:49:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 20:49:33.764982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2933f4-5d0f-42bc-9cdf-fe8bc25bc023 None admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:49:33.867221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2933f4-5d0f-42bc-9cdf-fe8bc25bc023 None admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:49:33.900668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe554e-50bb-4985-b028-ee8bc9f09769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:49:33.901308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe554e-50bb-4985-b028-ee8bc9f09769 None admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:49:33.901586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe554e-50bb-4985-b028-ee8bc9f09769 None admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:49:33.901857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe554e-50bb-4985-b028-ee8bc9f09769 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:49:33.902617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe554e-50bb-4985-b028-ee8bc9f09769 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:49:33.904003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe554e-50bb-4985-b028-ee8bc9f09769 None admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:49:33.980033 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 653/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Jul 16 20:49:33 2022] POST /identity/v3/endpoints => generated 331 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 20:49:43.756509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=30 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:49:43.975219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:02.523941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a37fc8-d48d-4d32-8de4-4a6ce5138017 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:02.525210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a37fc8-d48d-4d32-8de4-4a6ce5138017 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:02.525210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a37fc8-d48d-4d32-8de4-4a6ce5138017 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:02.526101 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 654/1307] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:57:02.532303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e00eb-2bb2-4585-a53d-977638218eb6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:02.532872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e00eb-2bb2-4585-a53d-977638218eb6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:02.532872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e00eb-2bb2-4585-a53d-977638218eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:02.744505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f71e00eb-2bb2-4585-a53d-977638218eb6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:57:02.746458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f71e00eb-2bb2-4585-a53d-977638218eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:03.019049 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 654/1308] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:57:03.076717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7737c7-a3ea-4260-8f14-aa44880c4657 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:03.077214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7737c7-a3ea-4260-8f14-aa44880c4657 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:03.077323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7737c7-a3ea-4260-8f14-aa44880c4657 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:03.079603 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 655/1309] 10.222.0.16 () {54 vars in 965 bytes} [Sat Jul 16 20:57:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:57:03.087626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266cdb7-f2df-4da0-9626-bea5a993af31 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:03.087935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266cdb7-f2df-4da0-9626-bea5a993af31 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:03.090000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266cdb7-f2df-4da0-9626-bea5a993af31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:03.193786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6266cdb7-f2df-4da0-9626-bea5a993af31 None None] MFA Rules not processed for user `fbd858f3e6ba4523b056bbdc2af427b0`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:57:03.195252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6266cdb7-f2df-4da0-9626-bea5a993af31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:03.226628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:03.322501 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 655/1310] 10.222.0.16 () {58 vars in 1062 bytes} [Sat Jul 16 20:57:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:57:03.331741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7737c7-a3ea-4260-8f14-aa44880c4657 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:57:03.333485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5b7737c7-a3ea-4260-8f14-aa44880c4657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:03.461995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7737c7-a3ea-4260-8f14-aa44880c4657 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:57:03.550241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfef1e4-d9c6-4918-aacf-911fc46b6edb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:57:03.551627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfef1e4-d9c6-4918-aacf-911fc46b6edb service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:03.552084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfef1e4-d9c6-4918-aacf-911fc46b6edb service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:03.552514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfef1e4-d9c6-4918-aacf-911fc46b6edb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:03.554416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0bfef1e4-d9c6-4918-aacf-911fc46b6edb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:03.620506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:03.685656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfef1e4-d9c6-4918-aacf-911fc46b6edb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:57:03.687435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfef1e4-d9c6-4918-aacf-911fc46b6edb service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:57:03.728272 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 656/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:57:06.455360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffca96e-f795-4644-b2fb-ba9e6fed7c19 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:06.455907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffca96e-f795-4644-b2fb-ba9e6fed7c19 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:06.455907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffca96e-f795-4644-b2fb-ba9e6fed7c19 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:06.457436 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 656/1312] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:57:06.462639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b8607-c4bb-4099-9429-e1ab2f6312cd None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:06.463085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b8607-c4bb-4099-9429-e1ab2f6312cd None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:06.463214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b8607-c4bb-4099-9429-e1ab2f6312cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:06.534419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-543b8607-c4bb-4099-9429-e1ab2f6312cd None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:57:06.535646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-543b8607-c4bb-4099-9429-e1ab2f6312cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:06.638554 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 657/1313] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:57:06.679863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffca96e-f795-4644-b2fb-ba9e6fed7c19 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:57:06.682043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4ffca96e-f795-4644-b2fb-ba9e6fed7c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:06.797559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffca96e-f795-4644-b2fb-ba9e6fed7c19 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:57:06.875648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:06.878236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abbce0-41e9-4caf-9e45-506b955a7aa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:57:06.878887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abbce0-41e9-4caf-9e45-506b955a7aa8 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:06.879202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abbce0-41e9-4caf-9e45-506b955a7aa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:06.879482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abbce0-41e9-4caf-9e45-506b955a7aa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:06.881146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d2abbce0-41e9-4caf-9e45-506b955a7aa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:06.995234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2abbce0-41e9-4caf-9e45-506b955a7aa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:57:06.996672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2abbce0-41e9-4caf-9e45-506b955a7aa8 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:57:07.015868 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 657/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:57:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:57:09.867545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3880c-ea49-4ea9-87bd-1e0b5370a667 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:09.868084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3880c-ea49-4ea9-87bd-1e0b5370a667 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:09.868084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3880c-ea49-4ea9-87bd-1e0b5370a667 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:09.869484 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 658/1315] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:57:09.874815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b08e5-2968-454d-acd6-03c6609f21a8 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:09.875303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b08e5-2968-454d-acd6-03c6609f21a8 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:09.875400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b08e5-2968-454d-acd6-03c6609f21a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:09.939840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-674b08e5-2968-454d-acd6-03c6609f21a8 None None] MFA Rules not processed for user `1bde7f2d8d764aa8a711e0cf7801a350`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:57:09.941062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-674b08e5-2968-454d-acd6-03c6609f21a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:09.994363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:10.043882 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 658/1316] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:57:09 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:57:10.085339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3880c-ea49-4ea9-87bd-1e0b5370a667 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:57:10.087426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8da3880c-ea49-4ea9-87bd-1e0b5370a667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:10.097151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:10.192215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3880c-ea49-4ea9-87bd-1e0b5370a667 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:57:10.274961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f40d35-5fb3-43bd-9382-a58470ac7637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:57:10.275554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f40d35-5fb3-43bd-9382-a58470ac7637 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:10.275866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f40d35-5fb3-43bd-9382-a58470ac7637 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:10.276087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f40d35-5fb3-43bd-9382-a58470ac7637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:10.277800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-35f40d35-5fb3-43bd-9382-a58470ac7637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:10.344024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:10.397329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f40d35-5fb3-43bd-9382-a58470ac7637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:57:10.399469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f40d35-5fb3-43bd-9382-a58470ac7637 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:57:10.418767 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 659/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:57:10 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:57:13.536818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39176660-fa9e-4a2e-981c-319dcc998df6 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:13.537471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39176660-fa9e-4a2e-981c-319dcc998df6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:13.537471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39176660-fa9e-4a2e-981c-319dcc998df6 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:13.540023 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 659/1318] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:57:13.545427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269ebe7-afc9-4a6d-8bea-b7d0fef38873 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:13.545842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269ebe7-afc9-4a6d-8bea-b7d0fef38873 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:13.545981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269ebe7-afc9-4a6d-8bea-b7d0fef38873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:13.610622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5269ebe7-afc9-4a6d-8bea-b7d0fef38873 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:57:13.611871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5269ebe7-afc9-4a6d-8bea-b7d0fef38873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:13.713255 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 660/1319] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:57:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:57:13.754067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39176660-fa9e-4a2e-981c-319dcc998df6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:57:13.755860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-39176660-fa9e-4a2e-981c-319dcc998df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:13.861857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39176660-fa9e-4a2e-981c-319dcc998df6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:57:13.934945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b46810-f7d9-4a18-83d2-c1dedccca175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:57:13.935626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b46810-f7d9-4a18-83d2-c1dedccca175 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:13.935910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b46810-f7d9-4a18-83d2-c1dedccca175 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:13.936184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b46810-f7d9-4a18-83d2-c1dedccca175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:13.937829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-60b46810-f7d9-4a18-83d2-c1dedccca175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:13.946470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:14.046449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b46810-f7d9-4a18-83d2-c1dedccca175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:57:14.047908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b46810-f7d9-4a18-83d2-c1dedccca175 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:57:14.065776 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 660/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:57:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:57:17.368346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e4062-f306-4fd9-ac39-9fa0270e168b None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:17.368923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e4062-f306-4fd9-ac39-9fa0270e168b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:17.368923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e4062-f306-4fd9-ac39-9fa0270e168b None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:17.370364 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 661/1321] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:57:17.375707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e8c9a-bc21-4053-9b9a-1038d130a2fd None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:17.376151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e8c9a-bc21-4053-9b9a-1038d130a2fd None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:17.376244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e8c9a-bc21-4053-9b9a-1038d130a2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:17.445537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0e2e8c9a-bc21-4053-9b9a-1038d130a2fd None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:57:17.446910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0e2e8c9a-bc21-4053-9b9a-1038d130a2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:17.505871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:17.546917 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 661/1322] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:57:17.584067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e4062-f306-4fd9-ac39-9fa0270e168b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:57:17.586869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5e5e4062-f306-4fd9-ac39-9fa0270e168b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:17.607095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:17.697059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e4062-f306-4fd9-ac39-9fa0270e168b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:57:17.771864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713f406-e23b-4013-957b-da36f8f60a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:57:17.772509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713f406-e23b-4013-957b-da36f8f60a2b service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:17.772804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713f406-e23b-4013-957b-da36f8f60a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:17.773594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713f406-e23b-4013-957b-da36f8f60a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:17.775292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d713f406-e23b-4013-957b-da36f8f60a2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:17.850064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:17.893341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713f406-e23b-4013-957b-da36f8f60a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:57:17.895158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713f406-e23b-4013-957b-da36f8f60a2b service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:57:17.913988 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 662/1323] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:57:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:57:20.229718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18bd44-b048-4a0b-9c16-e5cb7be66668 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:20.230246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18bd44-b048-4a0b-9c16-e5cb7be66668 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:20.230246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18bd44-b048-4a0b-9c16-e5cb7be66668 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:20.231595 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 662/1324] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:57:20.236970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f40da-5f5b-480a-bcb6-eea168c95b9a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:20.237475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f40da-5f5b-480a-bcb6-eea168c95b9a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:20.237572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f40da-5f5b-480a-bcb6-eea168c95b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:20.309128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ea2f40da-5f5b-480a-bcb6-eea168c95b9a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:57:20.310376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ea2f40da-5f5b-480a-bcb6-eea168c95b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:20.423274 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 663/1325] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:57:20.455223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18bd44-b048-4a0b-9c16-e5cb7be66668 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:57:20.456772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4a18bd44-b048-4a0b-9c16-e5cb7be66668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:20.572318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18bd44-b048-4a0b-9c16-e5cb7be66668 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:57:20.648156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec4fdf-c68f-4d03-a17d-66217b686ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:57:20.648807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec4fdf-c68f-4d03-a17d-66217b686ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:20.649085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec4fdf-c68f-4d03-a17d-66217b686ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:20.649356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec4fdf-c68f-4d03-a17d-66217b686ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:20.650983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-95ec4fdf-c68f-4d03-a17d-66217b686ee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:20.669071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:20.776864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec4fdf-c68f-4d03-a17d-66217b686ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:57:20.778341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec4fdf-c68f-4d03-a17d-66217b686ee8 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:57:20.798056 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 663/1326] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:57:23.089702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f2801-ab0c-4998-86d0-da66292177c0 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:23.090261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f2801-ab0c-4998-86d0-da66292177c0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:23.090261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f2801-ab0c-4998-86d0-da66292177c0 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:23.091681 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 664/1327] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:57:23.097109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b21f5-f46c-4177-918b-d819d5786784 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:23.097551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b21f5-f46c-4177-918b-d819d5786784 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:23.097736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b21f5-f46c-4177-918b-d819d5786784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:23.164954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8f9b21f5-f46c-4177-918b-d819d5786784 None None] MFA Rules not processed for user `1bde7f2d8d764aa8a711e0cf7801a350`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:57:23.166423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8f9b21f5-f46c-4177-918b-d819d5786784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:23.230445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:23.261864 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 664/1328] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:57:23 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 20:57:23.301058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f2801-ab0c-4998-86d0-da66292177c0 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:57:23.302595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-479f2801-ab0c-4998-86d0-da66292177c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:23.334763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:23.412524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f2801-ab0c-4998-86d0-da66292177c0 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:57:23.486956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea61ace-e8ae-4786-aa5a-375cba1cc61c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:57:23.487550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea61ace-e8ae-4786-aa5a-375cba1cc61c service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:23.487828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea61ace-e8ae-4786-aa5a-375cba1cc61c service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:23.488100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea61ace-e8ae-4786-aa5a-375cba1cc61c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:23.489759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3ea61ace-e8ae-4786-aa5a-375cba1cc61c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:23.568069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:23.600138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea61ace-e8ae-4786-aa5a-375cba1cc61c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:57:23.602380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea61ace-e8ae-4786-aa5a-375cba1cc61c service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:57:23.621595 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 665/1329] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:57:23 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:57:26.325991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb49f6-c24d-4f37-8fa3-80dd1654b2b9 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:26.326549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb49f6-c24d-4f37-8fa3-80dd1654b2b9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:26.326549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb49f6-c24d-4f37-8fa3-80dd1654b2b9 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:26.327951 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 665/1330] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:57:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:57:26.333393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a0e5e-1a52-44f5-a9b0-89636f6b5d37 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:26.333821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a0e5e-1a52-44f5-a9b0-89636f6b5d37 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:26.339242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a0e5e-1a52-44f5-a9b0-89636f6b5d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:26.405429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e74a0e5e-1a52-44f5-a9b0-89636f6b5d37 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:57:26.406537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e74a0e5e-1a52-44f5-a9b0-89636f6b5d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:26.509430 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 666/1331] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:57:26.571369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7d90c-412b-4a0f-8d61-da6fc1b10f1a None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:26.571666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7d90c-412b-4a0f-8d61-da6fc1b10f1a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:26.571947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7d90c-412b-4a0f-8d61-da6fc1b10f1a None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:26.574311 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 666/1332] 10.222.0.16 () {54 vars in 965 bytes} [Sat Jul 16 20:57:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:57:26.582667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4e2f9-a48d-4182-a250-e3d4c2998a2e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:26.582957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4e2f9-a48d-4182-a250-e3d4c2998a2e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:26.583294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4e2f9-a48d-4182-a250-e3d4c2998a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:26.646881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:26.689353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0ba4e2f9-a48d-4182-a250-e3d4c2998a2e None None] MFA Rules not processed for user `fbd858f3e6ba4523b056bbdc2af427b0`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:57:26.690586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0ba4e2f9-a48d-4182-a250-e3d4c2998a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:26.777111 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 667/1333] 10.222.0.16 () {58 vars in 1062 bytes} [Sat Jul 16 20:57:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:57:26.786899 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7d90c-412b-4a0f-8d61-da6fc1b10f1a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:57:26.789098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3fe7d90c-412b-4a0f-8d61-da6fc1b10f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:26.917454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7d90c-412b-4a0f-8d61-da6fc1b10f1a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:57:26.996848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ac7a5-bbc9-4316-a0da-567e93bcb23e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:57:26.997517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ac7a5-bbc9-4316-a0da-567e93bcb23e service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:26.997803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ac7a5-bbc9-4316-a0da-567e93bcb23e service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:26.998077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ac7a5-bbc9-4316-a0da-567e93bcb23e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:26.999790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-aa0ac7a5-bbc9-4316-a0da-567e93bcb23e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:27.029172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:27.119166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ac7a5-bbc9-4316-a0da-567e93bcb23e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:57:27.120623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ac7a5-bbc9-4316-a0da-567e93bcb23e service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:57:27.139641 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 667/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:57:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:57:29.705880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701f594-172d-4a0c-a680-efcc56ee8d99 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:29.706460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701f594-172d-4a0c-a680-efcc56ee8d99 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:29.706460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701f594-172d-4a0c-a680-efcc56ee8d99 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:29.707865 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 668/1335] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:57:29.713659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8bf6b-ed79-4521-9e7f-c117fbb777b0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:29.714071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8bf6b-ed79-4521-9e7f-c117fbb777b0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:29.714211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8bf6b-ed79-4521-9e7f-c117fbb777b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:29.779613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b5a8bf6b-ed79-4521-9e7f-c117fbb777b0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:57:29.780827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b5a8bf6b-ed79-4521-9e7f-c117fbb777b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:29.857929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:29.880515 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 668/1336] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:57:29.923783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701f594-172d-4a0c-a680-efcc56ee8d99 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:57:29.925291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1701f594-172d-4a0c-a680-efcc56ee8d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:30.029064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701f594-172d-4a0c-a680-efcc56ee8d99 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:57:30.057108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:30.103559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea3259-6b97-4009-a833-bfcd5ff06e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:57:30.104202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea3259-6b97-4009-a833-bfcd5ff06e8f service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:30.104483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea3259-6b97-4009-a833-bfcd5ff06e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:30.104757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea3259-6b97-4009-a833-bfcd5ff06e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:30.106400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2dea3259-6b97-4009-a833-bfcd5ff06e8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:30.217948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea3259-6b97-4009-a833-bfcd5ff06e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:57:30.219448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea3259-6b97-4009-a833-bfcd5ff06e8f service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:57:30.238729 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 669/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:57:33.420200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e1b90-79d6-48fc-9f60-e44c7b1ccb45 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:33.420775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e1b90-79d6-48fc-9f60-e44c7b1ccb45 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:33.420775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e1b90-79d6-48fc-9f60-e44c7b1ccb45 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:33.422133 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 669/1338] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:57:33.427466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf804ee-b2c1-49d0-a920-9a7ae6023775 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:33.427925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf804ee-b2c1-49d0-a920-9a7ae6023775 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:33.428035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf804ee-b2c1-49d0-a920-9a7ae6023775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:33.494559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7bf804ee-b2c1-49d0-a920-9a7ae6023775 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:57:33.495808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7bf804ee-b2c1-49d0-a920-9a7ae6023775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:33.504404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:33.596456 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 670/1339] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:57:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:57:33.635960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e1b90-79d6-48fc-9f60-e44c7b1ccb45 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:57:33.637535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f61e1b90-79d6-48fc-9f60-e44c7b1ccb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:33.743373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e1b90-79d6-48fc-9f60-e44c7b1ccb45 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:57:33.816485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701dc19-96e9-477b-82e1-63e06d43c726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:57:33.817131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701dc19-96e9-477b-82e1-63e06d43c726 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:33.817422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701dc19-96e9-477b-82e1-63e06d43c726 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:33.817697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701dc19-96e9-477b-82e1-63e06d43c726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:33.819563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d701dc19-96e9-477b-82e1-63e06d43c726 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:33.856151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:33.930401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701dc19-96e9-477b-82e1-63e06d43c726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:57:33.931856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701dc19-96e9-477b-82e1-63e06d43c726 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:57:33.950737 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 670/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:57:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:57:38.701327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74292c2c-da23-4d91-af7a-0de593b902dc None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:38.701940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74292c2c-da23-4d91-af7a-0de593b902dc None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:38.702023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74292c2c-da23-4d91-af7a-0de593b902dc None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:38.704318 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 671/1341] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:57:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:57:38.713446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ae160-497f-42d9-9323-9532a964205a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:38.714214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ae160-497f-42d9-9323-9532a964205a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:38.714214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ae160-497f-42d9-9323-9532a964205a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:38.795129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5c5ae160-497f-42d9-9323-9532a964205a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:57:38.796350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5c5ae160-497f-42d9-9323-9532a964205a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:38.889502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:38.900720 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 671/1342] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 20:57:38.942452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74292c2c-da23-4d91-af7a-0de593b902dc None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:57:38.944316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-74292c2c-da23-4d91-af7a-0de593b902dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:39.047984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74292c2c-da23-4d91-af7a-0de593b902dc None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:57:39.087220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:39.126183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3216a-5f7d-464e-b2e6-4576db109857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:57:39.126931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3216a-5f7d-464e-b2e6-4576db109857 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:39.127607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3216a-5f7d-464e-b2e6-4576db109857 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:39.127875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3216a-5f7d-464e-b2e6-4576db109857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:39.129515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2ad3216a-5f7d-464e-b2e6-4576db109857 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:39.243453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3216a-5f7d-464e-b2e6-4576db109857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:57:39.244894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3216a-5f7d-464e-b2e6-4576db109857 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:57:39.264791 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 672/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:57:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 20:57:42.527783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879a815-dc0b-4122-b475-f44665c44c61 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:42.528357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879a815-dc0b-4122-b475-f44665c44c61 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:42.528357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879a815-dc0b-4122-b475-f44665c44c61 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:42.529779 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 672/1344] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:57:42.535454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b340651-39b3-4401-8aa9-5dcb3daf2198 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:42.535899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b340651-39b3-4401-8aa9-5dcb3daf2198 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:42.536022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b340651-39b3-4401-8aa9-5dcb3daf2198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:42.606145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2b340651-39b3-4401-8aa9-5dcb3daf2198 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:57:42.607361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2b340651-39b3-4401-8aa9-5dcb3daf2198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:42.626876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:42.710176 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 673/1345] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:57:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 20:57:42.750556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879a815-dc0b-4122-b475-f44665c44c61 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:57:42.752153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d879a815-dc0b-4122-b475-f44665c44c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:42.866135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879a815-dc0b-4122-b475-f44665c44c61 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:57:42.943983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a566c-69cc-4f1f-bdfb-9aeae3aa92ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:57:42.944644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a566c-69cc-4f1f-bdfb-9aeae3aa92ba service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:42.944931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a566c-69cc-4f1f-bdfb-9aeae3aa92ba service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:42.945209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a566c-69cc-4f1f-bdfb-9aeae3aa92ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:42.946880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9b6a566c-69cc-4f1f-bdfb-9aeae3aa92ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:42.995713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:43.065178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a566c-69cc-4f1f-bdfb-9aeae3aa92ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:57:43.066616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a566c-69cc-4f1f-bdfb-9aeae3aa92ba service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:57:43.087904 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 673/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:57:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:57:47.833846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad864f-67f9-4a8e-9912-219dd697fe5d None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:47.834384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad864f-67f9-4a8e-9912-219dd697fe5d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:47.834680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad864f-67f9-4a8e-9912-219dd697fe5d None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:47.836089 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 674/1347] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:57:47.841498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a1c44-f539-4f21-880b-e71c076e7478 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:47.842005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a1c44-f539-4f21-880b-e71c076e7478 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:47.842202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a1c44-f539-4f21-880b-e71c076e7478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:47.914348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c43a1c44-f539-4f21-880b-e71c076e7478 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:57:47.915622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c43a1c44-f539-4f21-880b-e71c076e7478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:48.015886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:48.018656 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 674/1348] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:57:48.059346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad864f-67f9-4a8e-9912-219dd697fe5d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:57:48.061005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0fad864f-67f9-4a8e-9912-219dd697fe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:48.172860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad864f-67f9-4a8e-9912-219dd697fe5d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:57:48.225698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:48.253424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9ba08-5741-4fdf-ab99-35f5900d9498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:57:48.254075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9ba08-5741-4fdf-ab99-35f5900d9498 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:48.254355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9ba08-5741-4fdf-ab99-35f5900d9498 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:48.254631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9ba08-5741-4fdf-ab99-35f5900d9498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:48.256940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9ba9ba08-5741-4fdf-ab99-35f5900d9498 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:48.374194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9ba08-5741-4fdf-ab99-35f5900d9498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:57:48.375644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9ba08-5741-4fdf-ab99-35f5900d9498 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:57:48.396112 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 675/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:57:54.014804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b40c9c-b37f-4f56-b0a0-e85a8b2c54d0 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:54.015644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b40c9c-b37f-4f56-b0a0-e85a8b2c54d0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:54.016090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b40c9c-b37f-4f56-b0a0-e85a8b2c54d0 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:54.017993 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 675/1350] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 20:57:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:57:54.025069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e4854-a9f1-43b3-8c48-d83ff77ef9a1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:54.025859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e4854-a9f1-43b3-8c48-d83ff77ef9a1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:54.026297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e4854-a9f1-43b3-8c48-d83ff77ef9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:54.137669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c54e4854-a9f1-43b3-8c48-d83ff77ef9a1 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:57:54.138873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c54e4854-a9f1-43b3-8c48-d83ff77ef9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:54.185677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:54.273473 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 676/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:57:58.889935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cf2d0-ef4e-4dc2-885b-71c3598992cd None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:58.890834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cf2d0-ef4e-4dc2-885b-71c3598992cd None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:58.891327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cf2d0-ef4e-4dc2-885b-71c3598992cd None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:58.892712 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 676/1352] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 20:57:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:57:58.899702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499de953-5da2-4ea4-a642-e88c68ecf985 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:57:58.900234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499de953-5da2-4ea4-a642-e88c68ecf985 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:57:58.900810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499de953-5da2-4ea4-a642-e88c68ecf985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:57:58.989717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-499de953-5da2-4ea4-a642-e88c68ecf985 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:57:58.991187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-499de953-5da2-4ea4-a642-e88c68ecf985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:57:59.071140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:57:59.110309 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 677/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 20:57:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:58:00.663522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44a20f-fb69-4cc2-bd9f-c05037f16565 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:00.664038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44a20f-fb69-4cc2-bd9f-c05037f16565 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:00.664038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44a20f-fb69-4cc2-bd9f-c05037f16565 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:00.665434 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 677/1354] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 20:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:58:00.671060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a7122-32a4-4f56-9a35-4ab581c30874 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:00.671566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a7122-32a4-4f56-9a35-4ab581c30874 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:00.671658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a7122-32a4-4f56-9a35-4ab581c30874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:00.751730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4c6a7122-32a4-4f56-9a35-4ab581c30874 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:58:00.753010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4c6a7122-32a4-4f56-9a35-4ab581c30874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:00.879942 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 678/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 20:58:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:58:04.706570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c7015-1269-4951-b426-cc6ee0415346 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:04.707159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c7015-1269-4951-b426-cc6ee0415346 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:04.707159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c7015-1269-4951-b426-cc6ee0415346 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:04.709418 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 678/1356] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:58:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:58:04.715469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534baf17-3b90-465f-a1f8-e1776a7cbbc3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:04.715995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534baf17-3b90-465f-a1f8-e1776a7cbbc3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:04.716110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534baf17-3b90-465f-a1f8-e1776a7cbbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:04.755318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:04.813618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-534baf17-3b90-465f-a1f8-e1776a7cbbc3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:58:04.818754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-534baf17-3b90-465f-a1f8-e1776a7cbbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:04.951370 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 679/1357] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:58:05.013886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae84fb-5f44-40ec-a655-761331736aa8 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:05.014355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae84fb-5f44-40ec-a655-761331736aa8 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:05.014647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae84fb-5f44-40ec-a655-761331736aa8 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:05.021374 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 679/1358] 10.222.0.16 () {54 vars in 962 bytes} [Sat Jul 16 20:58:05 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:58:05.031218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f81c9-fdb0-41d2-8d11-2726ee7d2e8e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:05.032547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f81c9-fdb0-41d2-8d11-2726ee7d2e8e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:05.032547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f81c9-fdb0-41d2-8d11-2726ee7d2e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:05.127366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c69f81c9-fdb0-41d2-8d11-2726ee7d2e8e None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:58:05.128883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c69f81c9-fdb0-41d2-8d11-2726ee7d2e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:05.186769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:05.276112 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 680/1359] 10.222.0.16 () {58 vars in 1059 bytes} [Sat Jul 16 20:58:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:58:05.284290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae84fb-5f44-40ec-a655-761331736aa8 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:58:05.285869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-80ae84fb-5f44-40ec-a655-761331736aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:05.473365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae84fb-5f44-40ec-a655-761331736aa8 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:58:05.565819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:05.634671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa116dc-83ac-45c0-8846-b0ed99b640f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:58:05.635480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa116dc-83ac-45c0-8846-b0ed99b640f2 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:05.635803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa116dc-83ac-45c0-8846-b0ed99b640f2 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:05.636081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa116dc-83ac-45c0-8846-b0ed99b640f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:05.637774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2aa116dc-83ac-45c0-8846-b0ed99b640f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:05.741412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa116dc-83ac-45c0-8846-b0ed99b640f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:58:05.742937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa116dc-83ac-45c0-8846-b0ed99b640f2 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:58:05.762579 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 680/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:58:08.307729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032bcf5-9a6a-447b-be83-6cc822d962ea None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:08.309722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032bcf5-9a6a-447b-be83-6cc822d962ea None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:08.309722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032bcf5-9a6a-447b-be83-6cc822d962ea None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:08.309722 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 681/1361] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:58:08.315669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e023fd3-7414-42e7-a048-9620728ff632 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:08.316205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e023fd3-7414-42e7-a048-9620728ff632 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:08.316671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e023fd3-7414-42e7-a048-9620728ff632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:08.408571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7e023fd3-7414-42e7-a048-9620728ff632 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:58:08.409889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7e023fd3-7414-42e7-a048-9620728ff632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:08.456148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:08.522157 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 681/1362] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:58:08.574049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032bcf5-9a6a-447b-be83-6cc822d962ea None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:58:08.575589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1032bcf5-9a6a-447b-be83-6cc822d962ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:08.756528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032bcf5-9a6a-447b-be83-6cc822d962ea None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:58:08.767974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:08.899115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673e0b9-ec95-4a12-a996-bd539597c1f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:58:08.899777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673e0b9-ec95-4a12-a996-bd539597c1f3 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:08.900062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673e0b9-ec95-4a12-a996-bd539597c1f3 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:08.900336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673e0b9-ec95-4a12-a996-bd539597c1f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:08.902105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4673e0b9-ec95-4a12-a996-bd539597c1f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:09.019897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673e0b9-ec95-4a12-a996-bd539597c1f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:58:09.022308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673e0b9-ec95-4a12-a996-bd539597c1f3 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:58:09.044949 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 682/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:58:11.802743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4651a-9cef-4fd6-90a6-681c26abf7bb None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:11.803407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4651a-9cef-4fd6-90a6-681c26abf7bb None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:11.803407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4651a-9cef-4fd6-90a6-681c26abf7bb None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:11.805088 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 682/1364] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:58:11.811210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaddcd-766a-4079-9517-e2dd4154c13e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:11.811744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaddcd-766a-4079-9517-e2dd4154c13e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:11.811744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaddcd-766a-4079-9517-e2dd4154c13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:11.829429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:11.911735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6ffaddcd-766a-4079-9517-e2dd4154c13e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:58:11.913009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6ffaddcd-766a-4079-9517-e2dd4154c13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:12.073428 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 683/1365] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:58:12.123862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936f0df-7ea6-484c-a2d6-77c560baf383 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:12.124436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936f0df-7ea6-484c-a2d6-77c560baf383 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:12.124874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936f0df-7ea6-484c-a2d6-77c560baf383 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:12.126262 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 683/1366] 10.222.0.16 () {54 vars in 962 bytes} [Sat Jul 16 20:58:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:58:12.133165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93cfa9-72c3-4158-a76a-c77b7e2ef775 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:12.133472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93cfa9-72c3-4158-a76a-c77b7e2ef775 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:12.133786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93cfa9-72c3-4158-a76a-c77b7e2ef775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:12.215808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4d93cfa9-72c3-4158-a76a-c77b7e2ef775 None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:58:12.217048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4d93cfa9-72c3-4158-a76a-c77b7e2ef775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:12.258291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:12.358651 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 684/1367] 10.222.0.16 () {58 vars in 1059 bytes} [Sat Jul 16 20:58:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:58:12.376173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936f0df-7ea6-484c-a2d6-77c560baf383 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:58:12.377785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e936f0df-7ea6-484c-a2d6-77c560baf383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:12.601666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936f0df-7ea6-484c-a2d6-77c560baf383 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:58:12.624754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:12.741286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b04536-bf1d-482f-a450-844e0d3683e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:58:12.741954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b04536-bf1d-482f-a450-844e0d3683e4 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:12.742240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b04536-bf1d-482f-a450-844e0d3683e4 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:12.742515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b04536-bf1d-482f-a450-844e0d3683e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:12.744317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f0b04536-bf1d-482f-a450-844e0d3683e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:12.874186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b04536-bf1d-482f-a450-844e0d3683e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:58:12.877628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b04536-bf1d-482f-a450-844e0d3683e4 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:58:12.905118 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 684/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:58:15.732878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5abc0b-b0e1-4c6a-bb1e-2348c9afef80 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:15.733369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5abc0b-b0e1-4c6a-bb1e-2348c9afef80 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:15.733494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5abc0b-b0e1-4c6a-bb1e-2348c9afef80 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:15.741987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fbcf3-2a1a-4f3d-853d-b8ca6e1acc38 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:15.742450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fbcf3-2a1a-4f3d-853d-b8ca6e1acc38 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:15.742922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fbcf3-2a1a-4f3d-853d-b8ca6e1acc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:15.750362 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 685/1369] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:58:15 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:58:15.788474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:15.878381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e52fbcf3-2a1a-4f3d-853d-b8ca6e1acc38 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:58:15.880727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e52fbcf3-2a1a-4f3d-853d-b8ca6e1acc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:16.017070 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 685/1370] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:58:16.061169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5abc0b-b0e1-4c6a-bb1e-2348c9afef80 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:58:16.065674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ba5abc0b-b0e1-4c6a-bb1e-2348c9afef80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:16.285015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:16.302977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5abc0b-b0e1-4c6a-bb1e-2348c9afef80 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:58:16.454955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e3ba7-32d2-4f79-bb1f-b87588c17e02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:58:16.455688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e3ba7-32d2-4f79-bb1f-b87588c17e02 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:16.455971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e3ba7-32d2-4f79-bb1f-b87588c17e02 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:16.456284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e3ba7-32d2-4f79-bb1f-b87588c17e02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:16.458875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c87e3ba7-32d2-4f79-bb1f-b87588c17e02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:16.580736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e3ba7-32d2-4f79-bb1f-b87588c17e02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:58:16.580736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e3ba7-32d2-4f79-bb1f-b87588c17e02 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:58:16.609841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:16.617081 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 686/1371] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:58:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:58:17.787828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727e8a4-6918-43cd-8f53-173540768e36 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:17.787828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727e8a4-6918-43cd-8f53-173540768e36 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:17.787828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727e8a4-6918-43cd-8f53-173540768e36 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:17.788824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d992a-a016-4e12-af78-64f876719ab1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:17.788824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d992a-a016-4e12-af78-64f876719ab1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:17.788824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d992a-a016-4e12-af78-64f876719ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:17.789389 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 686/1372] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:58:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:58:17.840419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2e1d992a-a016-4e12-af78-64f876719ab1 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:58:17.841596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2e1d992a-a016-4e12-af78-64f876719ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:17.999130 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 687/1373] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:58:18.338718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9931e8-c4ec-4ec0-9b88-a06598572f60 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:18.339168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9931e8-c4ec-4ec0-9b88-a06598572f60 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:18.339347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9931e8-c4ec-4ec0-9b88-a06598572f60 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:18.343052 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 687/1374] 10.222.0.16 () {54 vars in 964 bytes} [Sat Jul 16 20:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:58:18.345926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af072320-b104-4387-b862-47c4dae24f8c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:18.346255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af072320-b104-4387-b862-47c4dae24f8c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:18.346539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af072320-b104-4387-b862-47c4dae24f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:18.446119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-af072320-b104-4387-b862-47c4dae24f8c None None] MFA Rules not processed for user `6dcc74f579e447938a2477e253e5d36e`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:58:18.447555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-af072320-b104-4387-b862-47c4dae24f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:18.471276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:18.540445 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 688/1375] 10.222.0.16 () {58 vars in 1061 bytes} [Sat Jul 16 20:58:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 20:58:18.548152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9931e8-c4ec-4ec0-9b88-a06598572f60 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:58:18.549938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-df9931e8-c4ec-4ec0-9b88-a06598572f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:18.678209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9931e8-c4ec-4ec0-9b88-a06598572f60 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:58:18.683592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:18.764672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8275e8b-9552-4a67-8728-4a2a719a973b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:58:18.765558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8275e8b-9552-4a67-8728-4a2a719a973b service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:18.765938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8275e8b-9552-4a67-8728-4a2a719a973b service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:18.766312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8275e8b-9552-4a67-8728-4a2a719a973b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:18.768186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d8275e8b-9552-4a67-8728-4a2a719a973b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:18.903098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8275e8b-9552-4a67-8728-4a2a719a973b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:58:18.906052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8275e8b-9552-4a67-8728-4a2a719a973b service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:58:18.926544 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 688/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:58:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 20:58:19.357103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccc913-8e97-4e65-aa78-e2e3fae2737e None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:19.361331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccc913-8e97-4e65-aa78-e2e3fae2737e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:19.361331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccc913-8e97-4e65-aa78-e2e3fae2737e None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:19.361331 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 689/1377] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:58:19.365789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137da218-7dbe-4679-a762-45542f42a4d6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:19.366179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137da218-7dbe-4679-a762-45542f42a4d6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:19.366472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137da218-7dbe-4679-a762-45542f42a4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:19.416888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:19.446534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-137da218-7dbe-4679-a762-45542f42a4d6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:58:19.462335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-137da218-7dbe-4679-a762-45542f42a4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:19.592113 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 689/1378] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:58:19.633940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccc913-8e97-4e65-aa78-e2e3fae2737e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:58:19.640375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f7ccc913-8e97-4e65-aa78-e2e3fae2737e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:19.846460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccc913-8e97-4e65-aa78-e2e3fae2737e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:58:19.882054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:20.020735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af90e5-1887-45fa-b274-917ba8f96ad8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:58:20.021753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af90e5-1887-45fa-b274-917ba8f96ad8 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:20.022102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af90e5-1887-45fa-b274-917ba8f96ad8 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:20.022442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af90e5-1887-45fa-b274-917ba8f96ad8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:20.024305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a3af90e5-1887-45fa-b274-917ba8f96ad8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:20.127372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af90e5-1887-45fa-b274-917ba8f96ad8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:58:20.128989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af90e5-1887-45fa-b274-917ba8f96ad8 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:58:20.147444 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 690/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:58:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:58:22.786782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d4f8d-00cb-4c45-9a78-471cb03ef3e4 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:22.787549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d4f8d-00cb-4c45-9a78-471cb03ef3e4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:22.787549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d4f8d-00cb-4c45-9a78-471cb03ef3e4 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:22.788773 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 690/1380] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:58:22.794214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7f0f3-6a4d-497b-9980-ab131034e586 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:22.794717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7f0f3-6a4d-497b-9980-ab131034e586 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:22.794821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7f0f3-6a4d-497b-9980-ab131034e586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:22.839927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:22.873923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ede7f0f3-6a4d-497b-9980-ab131034e586 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:58:22.875647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ede7f0f3-6a4d-497b-9980-ab131034e586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:23.006368 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 691/1381] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:58:23.056303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d4f8d-00cb-4c45-9a78-471cb03ef3e4 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:58:23.057824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f93d4f8d-00cb-4c45-9a78-471cb03ef3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:23.192862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:23.234078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d4f8d-00cb-4c45-9a78-471cb03ef3e4 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:58:23.364524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f12eff-0d32-4e6d-93b3-38edb6e9d992 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:58:23.365168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f12eff-0d32-4e6d-93b3-38edb6e9d992 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:23.365442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f12eff-0d32-4e6d-93b3-38edb6e9d992 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:23.365713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f12eff-0d32-4e6d-93b3-38edb6e9d992 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:23.367450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-29f12eff-0d32-4e6d-93b3-38edb6e9d992 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:23.456952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:23.473730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f12eff-0d32-4e6d-93b3-38edb6e9d992 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:58:23.475375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f12eff-0d32-4e6d-93b3-38edb6e9d992 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:58:23.496302 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 691/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:58:26.150525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb13ef-4fc6-4843-bbdf-474f07c1f765 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:26.151223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb13ef-4fc6-4843-bbdf-474f07c1f765 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:26.151223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb13ef-4fc6-4843-bbdf-474f07c1f765 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:26.152756 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 692/1383] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:58:26.158889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad5f80-01fc-44bd-b0f0-0f2ab905cf42 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:26.159544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad5f80-01fc-44bd-b0f0-0f2ab905cf42 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:26.159544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad5f80-01fc-44bd-b0f0-0f2ab905cf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:26.235862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-39ad5f80-01fc-44bd-b0f0-0f2ab905cf42 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:58:26.237079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-39ad5f80-01fc-44bd-b0f0-0f2ab905cf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:26.355755 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 692/1384] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:58:26.402521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb13ef-4fc6-4843-bbdf-474f07c1f765 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:58:26.404277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c8fb13ef-4fc6-4843-bbdf-474f07c1f765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:26.546620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:26.591657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb13ef-4fc6-4843-bbdf-474f07c1f765 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:58:26.719149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8db9b0-ea7b-4704-978c-b6f5bbef0883 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:58:26.719755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8db9b0-ea7b-4704-978c-b6f5bbef0883 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:26.720041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8db9b0-ea7b-4704-978c-b6f5bbef0883 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:26.720314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8db9b0-ea7b-4704-978c-b6f5bbef0883 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:26.721949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2e8db9b0-ea7b-4704-978c-b6f5bbef0883 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:26.811638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:26.829772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8db9b0-ea7b-4704-978c-b6f5bbef0883 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:58:26.836084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8db9b0-ea7b-4704-978c-b6f5bbef0883 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:58:26.853707 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 693/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:58:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:58:29.429112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d68b0b-7fb6-428f-bb3f-f3b1904b3e77 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:29.429826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d68b0b-7fb6-428f-bb3f-f3b1904b3e77 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:29.429826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d68b0b-7fb6-428f-bb3f-f3b1904b3e77 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:29.430933 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 693/1386] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:58:29.436633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581fc7e-87c8-4a95-89d3-0d69dce1cdc7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:29.437113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581fc7e-87c8-4a95-89d3-0d69dce1cdc7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:29.437205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581fc7e-87c8-4a95-89d3-0d69dce1cdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:29.511286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2581fc7e-87c8-4a95-89d3-0d69dce1cdc7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:58:29.512530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2581fc7e-87c8-4a95-89d3-0d69dce1cdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:29.615729 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 694/1387] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:58:29.664411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d68b0b-7fb6-428f-bb3f-f3b1904b3e77 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:58:29.666470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-77d68b0b-7fb6-428f-bb3f-f3b1904b3e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:29.730445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:29.838643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d68b0b-7fb6-428f-bb3f-f3b1904b3e77 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:58:29.978449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e634c3-0ad6-427d-9edf-a316f13c3b6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:58:29.979174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e634c3-0ad6-427d-9edf-a316f13c3b6f service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:29.979556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e634c3-0ad6-427d-9edf-a316f13c3b6f service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:29.979730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e634c3-0ad6-427d-9edf-a316f13c3b6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:29.981596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b4e634c3-0ad6-427d-9edf-a316f13c3b6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:29.996927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:30.087166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e634c3-0ad6-427d-9edf-a316f13c3b6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:58:30.088768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e634c3-0ad6-427d-9edf-a316f13c3b6f service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:58:30.108245 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 694/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:58:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:58:32.625696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47124ef-91bc-43c2-99cf-002152abcd30 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:32.626360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47124ef-91bc-43c2-99cf-002152abcd30 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:32.626654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47124ef-91bc-43c2-99cf-002152abcd30 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:32.628861 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 695/1389] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:58:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:58:32.634195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dfd13-1d42-47f3-a2a7-ab1c06397cae None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:32.634694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dfd13-1d42-47f3-a2a7-ab1c06397cae None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:32.634789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dfd13-1d42-47f3-a2a7-ab1c06397cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:32.713808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-401dfd13-1d42-47f3-a2a7-ab1c06397cae None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:58:32.715056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-401dfd13-1d42-47f3-a2a7-ab1c06397cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:32.833513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:32.850535 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 695/1390] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:58:32.900271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47124ef-91bc-43c2-99cf-002152abcd30 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:58:32.902569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d47124ef-91bc-43c2-99cf-002152abcd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:32.974021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:33.090485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47124ef-91bc-43c2-99cf-002152abcd30 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:58:33.244766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5631c7-59e9-4641-aa58-f35d54e7fdd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:58:33.245445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5631c7-59e9-4641-aa58-f35d54e7fdd8 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:33.245693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5631c7-59e9-4641-aa58-f35d54e7fdd8 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:33.246065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5631c7-59e9-4641-aa58-f35d54e7fdd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:33.248382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0d5631c7-59e9-4641-aa58-f35d54e7fdd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:33.268725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:33.361031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5631c7-59e9-4641-aa58-f35d54e7fdd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:58:33.363858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5631c7-59e9-4641-aa58-f35d54e7fdd8 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:58:33.383477 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 696/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:58:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:58:35.720552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18685d-657f-4e9d-95d1-b121c720abf1 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:35.721186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18685d-657f-4e9d-95d1-b121c720abf1 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:35.721186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18685d-657f-4e9d-95d1-b121c720abf1 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:35.723146 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 696/1392] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:58:35.729964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df2223-21e7-464a-ae80-df26d203e097 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:35.730598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df2223-21e7-464a-ae80-df26d203e097 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:35.730598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df2223-21e7-464a-ae80-df26d203e097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:35.804064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-57df2223-21e7-464a-ae80-df26d203e097 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:58:35.805314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-57df2223-21e7-464a-ae80-df26d203e097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:35.887636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f551e-18e9-4bad-b023-9fc1aa783fc4 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:35.887920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f551e-18e9-4bad-b023-9fc1aa783fc4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:35.888199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f551e-18e9-4bad-b023-9fc1aa783fc4 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:35.889580 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 697/1393] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:58:35.895146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d1f02-5e6f-4f12-bff5-b9f96b3b5553 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:35.896932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d1f02-5e6f-4f12-bff5-b9f96b3b5553 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:35.896932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d1f02-5e6f-4f12-bff5-b9f96b3b5553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:35.904928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:35.919413 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 697/1394] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:58:35.965969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-845d1f02-5e6f-4f12-bff5-b9f96b3b5553 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:58:35.967215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-845d1f02-5e6f-4f12-bff5-b9f96b3b5553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:35.982722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e5998-bcc7-4c75-a791-f87cc5f69579 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:35.983021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e5998-bcc7-4c75-a791-f87cc5f69579 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:35.983368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e5998-bcc7-4c75-a791-f87cc5f69579 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:35.984746 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 698/1395] 10.222.0.16 () {54 vars in 961 bytes} [Sat Jul 16 20:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:58:35.990192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826050dd-d848-40f5-8e0b-1007fa460635 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:35.990479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826050dd-d848-40f5-8e0b-1007fa460635 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:35.990755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826050dd-d848-40f5-8e0b-1007fa460635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:36.069811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-826050dd-d848-40f5-8e0b-1007fa460635 None None] MFA Rules not processed for user `78ec461b4719448597c99fd9368fa740`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:58:36.071080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-826050dd-d848-40f5-8e0b-1007fa460635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:36.071965 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 698/1396] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 20:58:36.119056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d1f02-5e6f-4f12-bff5-b9f96b3b5553 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:58:36.120240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-845d1f02-5e6f-4f12-bff5-b9f96b3b5553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:36.155081 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 699/1397] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Jul 16 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 20:58:36.163347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826050dd-d848-40f5-8e0b-1007fa460635 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:58:36.171516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826050dd-d848-40f5-8e0b-1007fa460635 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:58:36.191501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:36.238559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d1f02-5e6f-4f12-bff5-b9f96b3b5553 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:58:36.251959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b47986-c3ac-405f-96b6-20dbdc3d0e55 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:58:36.252609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b47986-c3ac-405f-96b6-20dbdc3d0e55 service glance] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:36.252893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b47986-c3ac-405f-96b6-20dbdc3d0e55 service glance] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:36.253167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b47986-c3ac-405f-96b6-20dbdc3d0e55 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:36.255752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-72b47986-c3ac-405f-96b6-20dbdc3d0e55 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:36.258138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:36.360583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa90fb-9447-4691-ad56-79cbf7a7d0e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:58:36.361235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa90fb-9447-4691-ad56-79cbf7a7d0e4 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:36.361515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa90fb-9447-4691-ad56-79cbf7a7d0e4 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:36.361788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa90fb-9447-4691-ad56-79cbf7a7d0e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:36.364812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-96aa90fb-9447-4691-ad56-79cbf7a7d0e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:36.371094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b47986-c3ac-405f-96b6-20dbdc3d0e55 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:58:36.372516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b47986-c3ac-405f-96b6-20dbdc3d0e55 service glance] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:58:36.394932 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 700/1398] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:58:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 20:58:36.441827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:36.468317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa90fb-9447-4691-ad56-79cbf7a7d0e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:58:36.469933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa90fb-9447-4691-ad56-79cbf7a7d0e4 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:58:36.488911 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 699/1399] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:58:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 20:58:37.175615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc02c2-9924-433f-9b4f-44cb5ac3a858 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:37.176391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc02c2-9924-433f-9b4f-44cb5ac3a858 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:37.176391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc02c2-9924-433f-9b4f-44cb5ac3a858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:37.246190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3ecc02c2-9924-433f-9b4f-44cb5ac3a858 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:58:37.247428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3ecc02c2-9924-433f-9b4f-44cb5ac3a858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:37.305813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:37.340939 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 701/1400] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:58:37.388606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7d372-08f0-4643-9080-b0dc4299606a None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:37.389144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7d372-08f0-4643-9080-b0dc4299606a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:37.389144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7d372-08f0-4643-9080-b0dc4299606a None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:37.390588 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 700/1401] 10.222.0.16 () {54 vars in 943 bytes} [Sat Jul 16 20:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:58:37.398239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcffdac-3107-4b5b-957c-a87e7fd2837b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:37.398597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcffdac-3107-4b5b-957c-a87e7fd2837b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:37.398943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcffdac-3107-4b5b-957c-a87e7fd2837b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:37.477703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0bcffdac-3107-4b5b-957c-a87e7fd2837b None None] MFA Rules not processed for user `9a66df01ea414b34a8842488b145974f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:58:37.478842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0bcffdac-3107-4b5b-957c-a87e7fd2837b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:37.587060 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 702/1402] 10.222.0.16 () {58 vars in 1040 bytes} [Sat Jul 16 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:58:37.596596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7d372-08f0-4643-9080-b0dc4299606a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:58:37.598559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fff7d372-08f0-4643-9080-b0dc4299606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:37.744106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7d372-08f0-4643-9080-b0dc4299606a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:58:37.801957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:37.853894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3a65b-f8e3-44af-8986-9e0a13a6f615 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:58:37.854546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3a65b-f8e3-44af-8986-9e0a13a6f615 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:37.854827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3a65b-f8e3-44af-8986-9e0a13a6f615 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:37.855136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3a65b-f8e3-44af-8986-9e0a13a6f615 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:37.856839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-88d3a65b-f8e3-44af-8986-9e0a13a6f615 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:37.948783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3a65b-f8e3-44af-8986-9e0a13a6f615 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:58:37.950412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3a65b-f8e3-44af-8986-9e0a13a6f615 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:58:37.959915 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 701/1403] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 20:58:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 20:58:39.027457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e575ee3-e6c5-454d-82f8-ffd9caf6e801 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:39.028008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e575ee3-e6c5-454d-82f8-ffd9caf6e801 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:39.028265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e575ee3-e6c5-454d-82f8-ffd9caf6e801 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:39.030034 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 703/1404] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:58:39.036072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296e93c-07f9-4da1-bd4d-792d53fffe52 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:39.036984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296e93c-07f9-4da1-bd4d-792d53fffe52 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:39.037261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296e93c-07f9-4da1-bd4d-792d53fffe52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:39.123477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4296e93c-07f9-4da1-bd4d-792d53fffe52 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:58:39.124863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4296e93c-07f9-4da1-bd4d-792d53fffe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:39.186123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:39.328103 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 702/1405] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:58:39.329003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e575ee3-e6c5-454d-82f8-ffd9caf6e801 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:58:39.329003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8e575ee3-e6c5-454d-82f8-ffd9caf6e801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:39.363260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:39.516208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e575ee3-e6c5-454d-82f8-ffd9caf6e801 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:58:39.681214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64de366-9659-4fde-b962-60fe239500ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:58:39.682096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64de366-9659-4fde-b962-60fe239500ae service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:39.682385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64de366-9659-4fde-b962-60fe239500ae service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:39.682693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64de366-9659-4fde-b962-60fe239500ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:39.684464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f64de366-9659-4fde-b962-60fe239500ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:39.760125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:39.809571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64de366-9659-4fde-b962-60fe239500ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:58:39.810388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64de366-9659-4fde-b962-60fe239500ae service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:58:39.832592 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 704/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:58:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:58:42.384178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa18f75-c0e9-44bd-aead-a192b6577044 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:42.384911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa18f75-c0e9-44bd-aead-a192b6577044 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:42.384911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa18f75-c0e9-44bd-aead-a192b6577044 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:42.386126 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 703/1407] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 20:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:58:42.391990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6efc0-84c0-41ba-bb4e-b93e22715d2f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:42.392535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6efc0-84c0-41ba-bb4e-b93e22715d2f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:42.392535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6efc0-84c0-41ba-bb4e-b93e22715d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:42.467471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7ea6efc0-84c0-41ba-bb4e-b93e22715d2f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:58:42.468830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7ea6efc0-84c0-41ba-bb4e-b93e22715d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:42.542961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:42.583977 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 705/1408] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 20:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:58:42.631238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa18f75-c0e9-44bd-aead-a192b6577044 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:58:42.633025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-baa18f75-c0e9-44bd-aead-a192b6577044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:42.850524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa18f75-c0e9-44bd-aead-a192b6577044 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:58:42.881583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:43.001372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44005024-6651-41a7-9be0-c824dc63c10b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:58:43.001939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44005024-6651-41a7-9be0-c824dc63c10b service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:58:43.002218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44005024-6651-41a7-9be0-c824dc63c10b service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:58:43.002487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44005024-6651-41a7-9be0-c824dc63c10b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:58:43.005793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-44005024-6651-41a7-9be0-c824dc63c10b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:58:43.121701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44005024-6651-41a7-9be0-c824dc63c10b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:58:43.123485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44005024-6651-41a7-9be0-c824dc63c10b service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:58:43.147652 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 704/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:58:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:58:52.581344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=14 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:58:53.145202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:03.068636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94c9f2-6b5e-471a-af04-f97a5e008445 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:03.069233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94c9f2-6b5e-471a-af04-f97a5e008445 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:03.069233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94c9f2-6b5e-471a-af04-f97a5e008445 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:03.070632 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 706/1410] 10.222.0.16 () {54 vars in 918 bytes} [Sat Jul 16 20:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:59:03.076083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3514c4-2175-4676-b46d-243d843bdac1 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:03.076532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3514c4-2175-4676-b46d-243d843bdac1 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:03.076640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3514c4-2175-4676-b46d-243d843bdac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:03.157971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4e3514c4-2175-4676-b46d-243d843bdac1 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:59:03.159245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4e3514c4-2175-4676-b46d-243d843bdac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:03.269983 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 705/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Sat Jul 16 20:59:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:59:03.282950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011687ee-443a-4e7f-8463-81a44f6f92cb None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:03.283262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011687ee-443a-4e7f-8463-81a44f6f92cb None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:03.283533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011687ee-443a-4e7f-8463-81a44f6f92cb None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:03.286000 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 707/1412] 10.222.0.16 () {54 vars in 918 bytes} [Sat Jul 16 20:59:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:59:03.290795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9326c5-66b0-460d-b0a7-d4347ccff440 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:03.291106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9326c5-66b0-460d-b0a7-d4347ccff440 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:03.291383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9326c5-66b0-460d-b0a7-d4347ccff440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:03.365905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:03.370295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8e9326c5-66b0-460d-b0a7-d4347ccff440 None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:59:03.371552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8e9326c5-66b0-460d-b0a7-d4347ccff440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:03.488134 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 706/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Sat Jul 16 20:59:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:59:06.249765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a871b-112d-4b43-a728-b72b6f1eb522 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:06.250277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a871b-112d-4b43-a728-b72b6f1eb522 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:06.250277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a871b-112d-4b43-a728-b72b6f1eb522 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:06.251603 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 16 20:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:59:06.257909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783c6fe-e2f1-49f2-bc7a-fd0ecda54d36 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:06.258352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783c6fe-e2f1-49f2-bc7a-fd0ecda54d36 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:06.258470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783c6fe-e2f1-49f2-bc7a-fd0ecda54d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:06.324986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5783c6fe-e2f1-49f2-bc7a-fd0ecda54d36 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:59:06.326188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5783c6fe-e2f1-49f2-bc7a-fd0ecda54d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:06.382161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:06.426020 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 16 20:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:59:06.471699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a871b-112d-4b43-a728-b72b6f1eb522 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:59:06.473946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d80a871b-112d-4b43-a728-b72b6f1eb522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:06.623567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a871b-112d-4b43-a728-b72b6f1eb522 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:59:06.699727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:06.740718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58489a78-b7ef-4d11-a02d-375badfe1046 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:59:06.741382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58489a78-b7ef-4d11-a02d-375badfe1046 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:06.741881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58489a78-b7ef-4d11-a02d-375badfe1046 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:06.742488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58489a78-b7ef-4d11-a02d-375badfe1046 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:06.744232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-58489a78-b7ef-4d11-a02d-375badfe1046 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:06.839512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58489a78-b7ef-4d11-a02d-375badfe1046 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:59:06.841116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58489a78-b7ef-4d11-a02d-375badfe1046 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:59:06.858939 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 709/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:59:07.825024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95afa08-74b1-41fa-84b9-febc16ff7071 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:07.825574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95afa08-74b1-41fa-84b9-febc16ff7071 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:07.825574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95afa08-74b1-41fa-84b9-febc16ff7071 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:07.826951 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 16 20:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:59:07.832721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e3d2c-b0ee-439b-a4e4-1e57b4933383 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:07.833218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e3d2c-b0ee-439b-a4e4-1e57b4933383 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:07.833334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e3d2c-b0ee-439b-a4e4-1e57b4933383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:07.917605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-176e3d2c-b0ee-439b-a4e4-1e57b4933383 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:59:07.918836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-176e3d2c-b0ee-439b-a4e4-1e57b4933383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:07.946870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:08.017140 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 16 20:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:59:08.217948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95afa08-74b1-41fa-84b9-febc16ff7071 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:59:08.219411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b95afa08-74b1-41fa-84b9-febc16ff7071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:08.372583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95afa08-74b1-41fa-84b9-febc16ff7071 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:59:08.414629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:08.490426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a9527-1afa-4fe5-acbe-654e79d9462a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:59:08.490997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a9527-1afa-4fe5-acbe-654e79d9462a service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:08.491311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a9527-1afa-4fe5-acbe-654e79d9462a service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:08.491592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a9527-1afa-4fe5-acbe-654e79d9462a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:08.493274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4f6a9527-1afa-4fe5-acbe-654e79d9462a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:08.587695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a9527-1afa-4fe5-acbe-654e79d9462a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:59:08.589286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a9527-1afa-4fe5-acbe-654e79d9462a service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:59:08.607552 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 709/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:59:09.522507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcc147-8ec6-4062-adf9-c23691f19984 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:09.523165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcc147-8ec6-4062-adf9-c23691f19984 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:09.523165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcc147-8ec6-4062-adf9-c23691f19984 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:09.524429 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 16 20:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:59:09.529507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe76a1-bfc7-4f06-90d5-f8641056cf33 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:09.529951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe76a1-bfc7-4f06-90d5-f8641056cf33 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:09.530059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe76a1-bfc7-4f06-90d5-f8641056cf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:09.584646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:09.606647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-43fe76a1-bfc7-4f06-90d5-f8641056cf33 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:59:09.607936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-43fe76a1-bfc7-4f06-90d5-f8641056cf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:09.706988 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 16 20:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:59:09.875118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcc147-8ec6-4062-adf9-c23691f19984 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:59:09.876727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1fdcc147-8ec6-4062-adf9-c23691f19984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:10.030523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcc147-8ec6-4062-adf9-c23691f19984 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:59:10.043721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:10.153238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c536b77-480a-4ae0-9833-a299990ef33f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:59:10.153790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c536b77-480a-4ae0-9833-a299990ef33f service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:10.154075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c536b77-480a-4ae0-9833-a299990ef33f service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:10.154356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c536b77-480a-4ae0-9833-a299990ef33f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:10.156045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2c536b77-480a-4ae0-9833-a299990ef33f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:10.252528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c536b77-480a-4ae0-9833-a299990ef33f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:59:10.254389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c536b77-480a-4ae0-9833-a299990ef33f service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:59:10.274245 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 712/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:59:11.168976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5adf5-15fc-400d-b5f1-eeeb8f9f0f85 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:11.169581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5adf5-15fc-400d-b5f1-eeeb8f9f0f85 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:11.169581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5adf5-15fc-400d-b5f1-eeeb8f9f0f85 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:11.171269 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 16 20:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:59:11.177521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973126d1-6f7a-4b5d-a04f-77d35ec81a9e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:11.178164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973126d1-6f7a-4b5d-a04f-77d35ec81a9e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:11.178164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973126d1-6f7a-4b5d-a04f-77d35ec81a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:11.199053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:11.262673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-973126d1-6f7a-4b5d-a04f-77d35ec81a9e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:59:11.263953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-973126d1-6f7a-4b5d-a04f-77d35ec81a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:11.364978 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 16 20:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:59:11.524055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5adf5-15fc-400d-b5f1-eeeb8f9f0f85 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:59:11.525597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d3a5adf5-15fc-400d-b5f1-eeeb8f9f0f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:11.637054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:11.673816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5adf5-15fc-400d-b5f1-eeeb8f9f0f85 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:59:11.795664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9aa999-3ba5-4270-b5eb-8462b4baf765 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:59:11.796071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9aa999-3ba5-4270-b5eb-8462b4baf765 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:11.796338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9aa999-3ba5-4270-b5eb-8462b4baf765 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:11.796608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9aa999-3ba5-4270-b5eb-8462b4baf765 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:11.798257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-df9aa999-3ba5-4270-b5eb-8462b4baf765 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:11.880083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:11.894419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9aa999-3ba5-4270-b5eb-8462b4baf765 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:59:11.901889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9aa999-3ba5-4270-b5eb-8462b4baf765 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:59:11.914765 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 712/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:59:12.793315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062687db-1f6f-4aa4-b7dd-0219273fceca None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:12.793892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062687db-1f6f-4aa4-b7dd-0219273fceca None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:12.793892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062687db-1f6f-4aa4-b7dd-0219273fceca None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:12.795250 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 16 20:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:59:12.801415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a53aa-25c9-483a-b3df-772b1061b72b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:12.801875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a53aa-25c9-483a-b3df-772b1061b72b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:12.801980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a53aa-25c9-483a-b3df-772b1061b72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:12.879874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7f1a53aa-25c9-483a-b3df-772b1061b72b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:59:12.881009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7f1a53aa-25c9-483a-b3df-772b1061b72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:12.983524 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 16 20:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:59:13.140840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062687db-1f6f-4aa4-b7dd-0219273fceca None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:59:13.142433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-062687db-1f6f-4aa4-b7dd-0219273fceca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:13.228866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:13.293401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062687db-1f6f-4aa4-b7dd-0219273fceca None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:59:13.408424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761fefb-4374-43ef-846c-d4fe8bf1a1d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:59:13.409586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761fefb-4374-43ef-846c-d4fe8bf1a1d6 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:13.409868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761fefb-4374-43ef-846c-d4fe8bf1a1d6 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:13.410490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761fefb-4374-43ef-846c-d4fe8bf1a1d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:13.412196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4761fefb-4374-43ef-846c-d4fe8bf1a1d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:13.463026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:13.506163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4761fefb-4374-43ef-846c-d4fe8bf1a1d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:59:13.507825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4761fefb-4374-43ef-846c-d4fe8bf1a1d6 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:59:13.526392 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 715/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:59:14.429974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fed17-ffc6-4932-be35-810a950e6988 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:14.430553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fed17-ffc6-4932-be35-810a950e6988 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:14.430553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fed17-ffc6-4932-be35-810a950e6988 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:14.431963 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 16 20:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:59:14.437541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc43b6-d91d-4e32-bd5d-a36650bd5b0f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:14.437990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc43b6-d91d-4e32-bd5d-a36650bd5b0f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:14.438150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc43b6-d91d-4e32-bd5d-a36650bd5b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:14.514851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-38fc43b6-d91d-4e32-bd5d-a36650bd5b0f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:59:14.516093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-38fc43b6-d91d-4e32-bd5d-a36650bd5b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:14.617605 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 16 20:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:59:14.780107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fed17-ffc6-4932-be35-810a950e6988 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:59:14.781546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fe1fed17-ffc6-4932-be35-810a950e6988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:14.838396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:14.944325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fed17-ffc6-4932-be35-810a950e6988 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:59:15.060934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08431f96-2b2f-45da-b765-2390a6c90a57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:59:15.061598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08431f96-2b2f-45da-b765-2390a6c90a57 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:15.061890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08431f96-2b2f-45da-b765-2390a6c90a57 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:15.062189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08431f96-2b2f-45da-b765-2390a6c90a57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:15.063920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-08431f96-2b2f-45da-b765-2390a6c90a57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:15.071880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:15.283088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08431f96-2b2f-45da-b765-2390a6c90a57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:59:15.284804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08431f96-2b2f-45da-b765-2390a6c90a57 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:59:15.306212 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 715/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:59:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:59:16.231040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ca53a-d996-4919-9e76-a22dbcfe1ca6 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:16.231604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ca53a-d996-4919-9e76-a22dbcfe1ca6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:16.231604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ca53a-d996-4919-9e76-a22dbcfe1ca6 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:16.233015 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 16 20:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:59:16.238676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae0936-4979-4ce4-9602-4083db152e2e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:16.239150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae0936-4979-4ce4-9602-4083db152e2e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:16.239257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae0936-4979-4ce4-9602-4083db152e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:16.321926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d3ae0936-4979-4ce4-9602-4083db152e2e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:59:16.323194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d3ae0936-4979-4ce4-9602-4083db152e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:16.405744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:16.441311 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 16 20:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 20:59:16.602765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ca53a-d996-4919-9e76-a22dbcfe1ca6 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:59:16.604325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-412ca53a-d996-4919-9e76-a22dbcfe1ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:16.622662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:16.766818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ca53a-d996-4919-9e76-a22dbcfe1ca6 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:59:16.858511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:16.886323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a22efa-434a-4e0a-b6dd-f218f50f7b9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:59:16.886980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a22efa-434a-4e0a-b6dd-f218f50f7b9d service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:16.887290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a22efa-434a-4e0a-b6dd-f218f50f7b9d service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:16.887562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a22efa-434a-4e0a-b6dd-f218f50f7b9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:16.889870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-69a22efa-434a-4e0a-b6dd-f218f50f7b9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:16.995192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a22efa-434a-4e0a-b6dd-f218f50f7b9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:59:16.996830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a22efa-434a-4e0a-b6dd-f218f50f7b9d service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:59:17.020384 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 718/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:59:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:59:17.911286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f91bb6-873a-46c7-ba45-c622b87a5ef0 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:17.911848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f91bb6-873a-46c7-ba45-c622b87a5ef0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:17.911848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f91bb6-873a-46c7-ba45-c622b87a5ef0 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:17.913195 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 16 20:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 20:59:17.918315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a55789-d04b-401d-b6b2-73a9ccf7b3b8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:17.918750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a55789-d04b-401d-b6b2-73a9ccf7b3b8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:17.918871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a55789-d04b-401d-b6b2-73a9ccf7b3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:17.996508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f9a55789-d04b-401d-b6b2-73a9ccf7b3b8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:59:17.997802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f9a55789-d04b-401d-b6b2-73a9ccf7b3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:18.044566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:18.104610 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 16 20:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:59:18.271913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f91bb6-873a-46c7-ba45-c622b87a5ef0 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:59:18.273370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e7f91bb6-873a-46c7-ba45-c622b87a5ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:18.430035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f91bb6-873a-46c7-ba45-c622b87a5ef0 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:59:18.496638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:18.557380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74952a55-05c4-4cd9-8e72-4a0f21d1bbdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:59:18.558004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74952a55-05c4-4cd9-8e72-4a0f21d1bbdf service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:18.558282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74952a55-05c4-4cd9-8e72-4a0f21d1bbdf service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:18.558554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74952a55-05c4-4cd9-8e72-4a0f21d1bbdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:18.560228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-74952a55-05c4-4cd9-8e72-4a0f21d1bbdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:18.652105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74952a55-05c4-4cd9-8e72-4a0f21d1bbdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:59:18.653665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74952a55-05c4-4cd9-8e72-4a0f21d1bbdf service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:59:18.672950 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 718/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:59:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:59:19.573437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8d7e5-baaf-4747-b738-fd64b284ed1b None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:19.574017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8d7e5-baaf-4747-b738-fd64b284ed1b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:19.574017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8d7e5-baaf-4747-b738-fd64b284ed1b None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:19.575379 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 16 20:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:59:19.580472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703d92f-5706-4ecd-b8ff-8c3a97031806 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:19.580936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703d92f-5706-4ecd-b8ff-8c3a97031806 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:19.581044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703d92f-5706-4ecd-b8ff-8c3a97031806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:19.656732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3703d92f-5706-4ecd-b8ff-8c3a97031806 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:59:19.657998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3703d92f-5706-4ecd-b8ff-8c3a97031806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:19.660873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:19.758803 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 16 20:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:59:19.921919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8d7e5-baaf-4747-b738-fd64b284ed1b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:59:19.923562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-38b8d7e5-baaf-4747-b738-fd64b284ed1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:20.072360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8d7e5-baaf-4747-b738-fd64b284ed1b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:59:20.099774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:20.187239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0688453-3915-43d9-9dc7-de841275fe27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:59:20.187876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0688453-3915-43d9-9dc7-de841275fe27 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:20.188160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0688453-3915-43d9-9dc7-de841275fe27 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:20.188438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0688453-3915-43d9-9dc7-de841275fe27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:20.190717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f0688453-3915-43d9-9dc7-de841275fe27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:20.410950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0688453-3915-43d9-9dc7-de841275fe27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:59:20.412583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0688453-3915-43d9-9dc7-de841275fe27 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:59:20.431666 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 721/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:59:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:59:22.548512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a8cb3-b6ac-48e8-8bc5-86ee8eadde95 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:22.549156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a8cb3-b6ac-48e8-8bc5-86ee8eadde95 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:22.549156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a8cb3-b6ac-48e8-8bc5-86ee8eadde95 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:22.550578 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 16 20:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:59:22.555884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696890ae-ed6f-4cbe-819f-593d1c53ecbc None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:22.556297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696890ae-ed6f-4cbe-819f-593d1c53ecbc None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:22.556463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696890ae-ed6f-4cbe-819f-593d1c53ecbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:22.596129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:22.620224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-696890ae-ed6f-4cbe-819f-593d1c53ecbc None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:59:22.621465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-696890ae-ed6f-4cbe-819f-593d1c53ecbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:22.718120 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 16 20:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:59:22.760743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a8cb3-b6ac-48e8-8bc5-86ee8eadde95 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:59:22.762267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a02a8cb3-b6ac-48e8-8bc5-86ee8eadde95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:22.874436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a8cb3-b6ac-48e8-8bc5-86ee8eadde95 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:59:22.907048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:22.950729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e815c0a-205a-4cb5-8ee1-bf94e36857fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:59:22.951455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e815c0a-205a-4cb5-8ee1-bf94e36857fb service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:22.951736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e815c0a-205a-4cb5-8ee1-bf94e36857fb service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:22.952011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e815c0a-205a-4cb5-8ee1-bf94e36857fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:22.953682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4e815c0a-205a-4cb5-8ee1-bf94e36857fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:23.061390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e815c0a-205a-4cb5-8ee1-bf94e36857fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:59:23.062803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e815c0a-205a-4cb5-8ee1-bf94e36857fb service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:59:23.080914 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 721/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:59:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:59:25.629409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31851cbd-31c4-4b95-a44f-490f25c821f9 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:25.629952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31851cbd-31c4-4b95-a44f-490f25c821f9 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:25.629952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31851cbd-31c4-4b95-a44f-490f25c821f9 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:25.631358 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 16 20:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:59:25.636714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4253d-ef4b-4d71-ac29-b7bdebd42003 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:25.637119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4253d-ef4b-4d71-ac29-b7bdebd42003 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:25.637247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4253d-ef4b-4d71-ac29-b7bdebd42003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:25.703681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6ff4253d-ef4b-4d71-ac29-b7bdebd42003 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:59:25.704915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6ff4253d-ef4b-4d71-ac29-b7bdebd42003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:25.719336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:25.807662 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 16 20:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:59:25.849705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31851cbd-31c4-4b95-a44f-490f25c821f9 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:59:25.851256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-31851cbd-31c4-4b95-a44f-490f25c821f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:25.954572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31851cbd-31c4-4b95-a44f-490f25c821f9 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:59:25.967974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:26.028076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e645f1e-6482-40c9-b1d1-0bddef7d2861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:59:26.028713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e645f1e-6482-40c9-b1d1-0bddef7d2861 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:26.028988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e645f1e-6482-40c9-b1d1-0bddef7d2861 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:26.029257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e645f1e-6482-40c9-b1d1-0bddef7d2861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:26.030870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0e645f1e-6482-40c9-b1d1-0bddef7d2861 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:26.141412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e645f1e-6482-40c9-b1d1-0bddef7d2861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:59:26.143752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e645f1e-6482-40c9-b1d1-0bddef7d2861 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:59:26.162315 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 724/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:59:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 20:59:28.823696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27837ffb-46ce-4195-a11a-1594d3e9be43 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:28.824278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27837ffb-46ce-4195-a11a-1594d3e9be43 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:28.824377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27837ffb-46ce-4195-a11a-1594d3e9be43 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:28.825823 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 16 20:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:59:28.832107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141fb63-1240-4ee5-8454-0c41aed799ef None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:28.832539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141fb63-1240-4ee5-8454-0c41aed799ef None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:28.832539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141fb63-1240-4ee5-8454-0c41aed799ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:28.880835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:28.901473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5141fb63-1240-4ee5-8454-0c41aed799ef None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:59:28.902749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5141fb63-1240-4ee5-8454-0c41aed799ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:29.001403 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 16 20:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:59:29.042932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27837ffb-46ce-4195-a11a-1594d3e9be43 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:59:29.044520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-27837ffb-46ce-4195-a11a-1594d3e9be43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:29.147133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27837ffb-46ce-4195-a11a-1594d3e9be43 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:59:29.187919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:29.223349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec5c11-eb0f-4fc3-ab55-7a81d3f0b8c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:59:29.223918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec5c11-eb0f-4fc3-ab55-7a81d3f0b8c7 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:29.224199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec5c11-eb0f-4fc3-ab55-7a81d3f0b8c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:29.224474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec5c11-eb0f-4fc3-ab55-7a81d3f0b8c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:29.226126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-28ec5c11-eb0f-4fc3-ab55-7a81d3f0b8c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:29.337783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec5c11-eb0f-4fc3-ab55-7a81d3f0b8c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:59:29.339247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec5c11-eb0f-4fc3-ab55-7a81d3f0b8c7 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:59:29.357764 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 724/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:59:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:59:31.748543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac259496-fa8b-4cdb-84f4-8e33450b4db3 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:31.749052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac259496-fa8b-4cdb-84f4-8e33450b4db3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:31.749052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac259496-fa8b-4cdb-84f4-8e33450b4db3 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:31.750431 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 16 20:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:59:31.755948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba205274-9077-4f87-95b3-31543133d2e6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:31.756404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba205274-9077-4f87-95b3-31543133d2e6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:31.756501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba205274-9077-4f87-95b3-31543133d2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:31.822489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ba205274-9077-4f87-95b3-31543133d2e6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:59:31.823733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ba205274-9077-4f87-95b3-31543133d2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:31.845002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:31.922525 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 16 20:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:59:31.964238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac259496-fa8b-4cdb-84f4-8e33450b4db3 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:59:31.965787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ac259496-fa8b-4cdb-84f4-8e33450b4db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:32.070660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac259496-fa8b-4cdb-84f4-8e33450b4db3 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:59:32.090526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:32.144731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a94d6b-8b42-4375-9078-ad9f68055632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:59:32.145404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a94d6b-8b42-4375-9078-ad9f68055632 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:32.145685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a94d6b-8b42-4375-9078-ad9f68055632 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:32.145955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a94d6b-8b42-4375-9078-ad9f68055632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:32.147636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-15a94d6b-8b42-4375-9078-ad9f68055632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:32.257966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a94d6b-8b42-4375-9078-ad9f68055632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:59:32.259445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a94d6b-8b42-4375-9078-ad9f68055632 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:59:32.278792 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 727/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:59:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:59:34.609764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c7f40-e7fc-442f-a893-7a0588142748 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:34.610391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c7f40-e7fc-442f-a893-7a0588142748 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:34.610391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c7f40-e7fc-442f-a893-7a0588142748 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:34.612530 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 16 20:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:59:34.617815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7aadd4-5d54-4b91-b6b8-39ca04df764d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:34.618230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7aadd4-5d54-4b91-b6b8-39ca04df764d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:34.618360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7aadd4-5d54-4b91-b6b8-39ca04df764d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:34.683074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:34.685843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-bf7aadd4-5d54-4b91-b6b8-39ca04df764d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:59:34.687094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bf7aadd4-5d54-4b91-b6b8-39ca04df764d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:34.789978 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 16 20:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:59:34.830514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c7f40-e7fc-442f-a893-7a0588142748 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:59:34.832107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0e7c7f40-e7fc-442f-a893-7a0588142748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:34.939715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c7f40-e7fc-442f-a893-7a0588142748 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:59:34.989605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:35.014330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c2844-5552-4206-9389-91390b0c7168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:59:35.014900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c2844-5552-4206-9389-91390b0c7168 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:35.015213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c2844-5552-4206-9389-91390b0c7168 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:35.015490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c2844-5552-4206-9389-91390b0c7168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:35.017149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-186c2844-5552-4206-9389-91390b0c7168 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:35.125951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c2844-5552-4206-9389-91390b0c7168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:59:35.127798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c2844-5552-4206-9389-91390b0c7168 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:59:35.148421 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 727/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:59:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:59:37.503866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6a391-b8c5-4b46-906d-32a3bc5ab62f None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:37.504451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6a391-b8c5-4b46-906d-32a3bc5ab62f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:37.504451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6a391-b8c5-4b46-906d-32a3bc5ab62f None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:37.505762 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 16 20:59:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:59:37.511207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e1ef0-53f4-43ad-acad-1d445a42a017 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:37.511634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e1ef0-53f4-43ad-acad-1d445a42a017 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:37.511738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e1ef0-53f4-43ad-acad-1d445a42a017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:37.577700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-268e1ef0-53f4-43ad-acad-1d445a42a017 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:59:37.578900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-268e1ef0-53f4-43ad-acad-1d445a42a017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:37.607240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:37.675000 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 16 20:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:59:37.714869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6a391-b8c5-4b46-906d-32a3bc5ab62f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:59:37.716427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0df6a391-b8c5-4b46-906d-32a3bc5ab62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:37.819652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6a391-b8c5-4b46-906d-32a3bc5ab62f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:59:37.848863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:37.895056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0bdce-3638-4718-9ad5-bb9ad185e901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:59:37.895720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0bdce-3638-4718-9ad5-bb9ad185e901 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:37.895999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0bdce-3638-4718-9ad5-bb9ad185e901 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:37.896273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0bdce-3638-4718-9ad5-bb9ad185e901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:37.897914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-58b0bdce-3638-4718-9ad5-bb9ad185e901 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:38.007090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0bdce-3638-4718-9ad5-bb9ad185e901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:59:38.008530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0bdce-3638-4718-9ad5-bb9ad185e901 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:59:38.027644 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 730/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:59:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:59:40.358175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e875a94-925b-4f4c-8c32-978d1aba72ec None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:40.358736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e875a94-925b-4f4c-8c32-978d1aba72ec None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:40.358736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e875a94-925b-4f4c-8c32-978d1aba72ec None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:40.360115 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 16 20:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:59:40.365928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382ffa2-42d9-4dca-9023-dbd26028fc0b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:40.369038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382ffa2-42d9-4dca-9023-dbd26028fc0b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:40.369038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382ffa2-42d9-4dca-9023-dbd26028fc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:40.433118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7382ffa2-42d9-4dca-9023-dbd26028fc0b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:59:40.434322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7382ffa2-42d9-4dca-9023-dbd26028fc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:40.443373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:40.534132 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 16 20:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:59:40.575576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e875a94-925b-4f4c-8c32-978d1aba72ec None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:59:40.577104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2e875a94-925b-4f4c-8c32-978d1aba72ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:40.682398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e875a94-925b-4f4c-8c32-978d1aba72ec None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:59:40.739339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:40.758646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82be6b-493d-4937-a9a9-caa8f407304e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:59:40.759327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82be6b-493d-4937-a9a9-caa8f407304e service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:40.759636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82be6b-493d-4937-a9a9-caa8f407304e service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:40.759912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82be6b-493d-4937-a9a9-caa8f407304e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:40.761633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9f82be6b-493d-4937-a9a9-caa8f407304e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:40.876707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82be6b-493d-4937-a9a9-caa8f407304e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:59:40.878768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82be6b-493d-4937-a9a9-caa8f407304e service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:59:40.897842 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 730/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:59:43.316623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5c31e-7b2e-445f-a4f5-89d985a67b8c None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:43.317223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5c31e-7b2e-445f-a4f5-89d985a67b8c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:43.317223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5c31e-7b2e-445f-a4f5-89d985a67b8c None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:43.318523 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 16 20:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:59:43.324105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa780a23-42b5-4839-b0ea-64d330245265 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:43.331052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa780a23-42b5-4839-b0ea-64d330245265 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:43.331052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa780a23-42b5-4839-b0ea-64d330245265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:43.391425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-aa780a23-42b5-4839-b0ea-64d330245265 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:59:43.393362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-aa780a23-42b5-4839-b0ea-64d330245265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:43.433231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:43.492232 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 16 20:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:59:43.532576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5c31e-7b2e-445f-a4f5-89d985a67b8c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:59:43.535258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-84c5c31e-7b2e-445f-a4f5-89d985a67b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:43.643181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5c31e-7b2e-445f-a4f5-89d985a67b8c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:59:43.686211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:43.725995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8bc7e-4a4d-4018-a60c-ff48fcb6e610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:59:43.726640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8bc7e-4a4d-4018-a60c-ff48fcb6e610 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:43.726918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8bc7e-4a4d-4018-a60c-ff48fcb6e610 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:43.727221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8bc7e-4a4d-4018-a60c-ff48fcb6e610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:43.728857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-43a8bc7e-4a4d-4018-a60c-ff48fcb6e610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:43.837455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8bc7e-4a4d-4018-a60c-ff48fcb6e610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:59:43.838888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8bc7e-4a4d-4018-a60c-ff48fcb6e610 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:59:43.857720 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 733/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:59:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 20:59:46.151703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad5dfa-e617-48d0-849e-867d526f38c9 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:46.152246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad5dfa-e617-48d0-849e-867d526f38c9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:46.152246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad5dfa-e617-48d0-849e-867d526f38c9 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:46.153554 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 16 20:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:59:46.159997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b3916-5181-49a0-a537-b72ce9222e1b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:46.160410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b3916-5181-49a0-a537-b72ce9222e1b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:46.160528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b3916-5181-49a0-a537-b72ce9222e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:46.226555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-786b3916-5181-49a0-a537-b72ce9222e1b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:59:46.227799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-786b3916-5181-49a0-a537-b72ce9222e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:46.246071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:46.326906 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 16 20:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:59:46.366449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad5dfa-e617-48d0-849e-867d526f38c9 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:59:46.368094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-33ad5dfa-e617-48d0-849e-867d526f38c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:46.474395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad5dfa-e617-48d0-849e-867d526f38c9 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:59:46.542884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:46.550231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a09a58-f9ba-4f49-8a45-4f4d96fbcf71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:59:46.550877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a09a58-f9ba-4f49-8a45-4f4d96fbcf71 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:46.551198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a09a58-f9ba-4f49-8a45-4f4d96fbcf71 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:46.551473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a09a58-f9ba-4f49-8a45-4f4d96fbcf71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:46.553119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-44a09a58-f9ba-4f49-8a45-4f4d96fbcf71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:46.662453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a09a58-f9ba-4f49-8a45-4f4d96fbcf71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:59:46.663922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a09a58-f9ba-4f49-8a45-4f4d96fbcf71 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:59:46.683156 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 733/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:59:49.170635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a4786-8973-4281-916d-b227fc667d71 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:49.171292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a4786-8973-4281-916d-b227fc667d71 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:49.171292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a4786-8973-4281-916d-b227fc667d71 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:49.172577 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 16 20:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 20:59:49.178502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976c77b-2fe2-4bab-969c-fab904a3216b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:49.178941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976c77b-2fe2-4bab-969c-fab904a3216b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:49.179070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976c77b-2fe2-4bab-969c-fab904a3216b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:49.244424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9976c77b-2fe2-4bab-969c-fab904a3216b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 20:59:49.245641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9976c77b-2fe2-4bab-969c-fab904a3216b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:49.296780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:49.349483 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 16 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 20:59:49.389484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a4786-8973-4281-916d-b227fc667d71 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 20:59:49.391031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cf5a4786-8973-4281-916d-b227fc667d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:49.498184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a4786-8973-4281-916d-b227fc667d71 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 20:59:49.546399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:49.574280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c10887-7a53-47dd-bb65-7dc1c0221045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 20:59:49.574949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c10887-7a53-47dd-bb65-7dc1c0221045 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 20:59:49.575252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c10887-7a53-47dd-bb65-7dc1c0221045 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 20:59:49.575527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c10887-7a53-47dd-bb65-7dc1c0221045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 20:59:49.577136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-55c10887-7a53-47dd-bb65-7dc1c0221045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 20:59:49.693874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c10887-7a53-47dd-bb65-7dc1c0221045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 20:59:49.696494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c10887-7a53-47dd-bb65-7dc1c0221045 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 20:59:49.717685 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 736/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 20:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 20:59:59.347473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=22 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 20:59:59.715374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=66 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:00:14.082627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0131f75-2c25-44eb-8886-3bdd950417be None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:14.083277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0131f75-2c25-44eb-8886-3bdd950417be None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:14.083277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0131f75-2c25-44eb-8886-3bdd950417be None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:14.084601 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 735/1471] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 21:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:00:14.089895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da26e8f-e858-450b-b9c2-02b0afddba6b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:14.090340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da26e8f-e858-450b-b9c2-02b0afddba6b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:14.090457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da26e8f-e858-450b-b9c2-02b0afddba6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:14.154760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1da26e8f-e858-450b-b9c2-02b0afddba6b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:00:14.155909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1da26e8f-e858-450b-b9c2-02b0afddba6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:00:14.253062 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 737/1472] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:00:14.302031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa082ca-3682-481f-a321-e87da11beac8 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:14.302324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa082ca-3682-481f-a321-e87da11beac8 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:14.302605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa082ca-3682-481f-a321-e87da11beac8 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:14.304019 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 736/1473] 10.222.0.16 () {54 vars in 961 bytes} [Sat Jul 16 21:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:00:14.308934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e9e01-a63d-4161-a3a3-393c0349055e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:14.309219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e9e01-a63d-4161-a3a3-393c0349055e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:14.309491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e9e01-a63d-4161-a3a3-393c0349055e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:14.384537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f94e9e01-a63d-4161-a3a3-393c0349055e None None] MFA Rules not processed for user `78ec461b4719448597c99fd9368fa740`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:00:14.385732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f94e9e01-a63d-4161-a3a3-393c0349055e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:00:14.406254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:00:14.461248 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 738/1474] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Jul 16 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:00:14.468663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa082ca-3682-481f-a321-e87da11beac8 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:00:14.470215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ffa082ca-3682-481f-a321-e87da11beac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:00:14.574117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa082ca-3682-481f-a321-e87da11beac8 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:00:14.647022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50701320-8319-4219-a688-65f5a769d9d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:00:14.647676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50701320-8319-4219-a688-65f5a769d9d6 service glance] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:14.647955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50701320-8319-4219-a688-65f5a769d9d6 service glance] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:14.648228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50701320-8319-4219-a688-65f5a769d9d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:14.649894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-50701320-8319-4219-a688-65f5a769d9d6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:00:14.705438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:00:14.762366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50701320-8319-4219-a688-65f5a769d9d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:00:14.763848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50701320-8319-4219-a688-65f5a769d9d6 service glance] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:00:14.783561 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 737/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:00:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:00:17.162969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde1250-34c1-453b-ad23-df9c9767afaf None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:17.163563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde1250-34c1-453b-ad23-df9c9767afaf None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:17.163563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde1250-34c1-453b-ad23-df9c9767afaf None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:17.164904 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 739/1476] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 21:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 21:00:17.170149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ec988-5aa6-4779-a4be-316e153c1b34 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:17.170572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ec988-5aa6-4779-a4be-316e153c1b34 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:17.170704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ec988-5aa6-4779-a4be-316e153c1b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:17.234436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0e3ec988-5aa6-4779-a4be-316e153c1b34 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:00:17.235958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0e3ec988-5aa6-4779-a4be-316e153c1b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:00:17.333902 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 738/1477] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 21:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:00:17.359140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde1250-34c1-453b-ad23-df9c9767afaf None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:00:17.361372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9fde1250-34c1-453b-ad23-df9c9767afaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:00:17.488552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde1250-34c1-453b-ad23-df9c9767afaf None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:00:17.537317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:00:17.581170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4154ad-8f6f-4cbe-b4f8-e5993be1e947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:00:17.581830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4154ad-8f6f-4cbe-b4f8-e5993be1e947 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:17.582108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4154ad-8f6f-4cbe-b4f8-e5993be1e947 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:17.582378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4154ad-8f6f-4cbe-b4f8-e5993be1e947 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:17.583127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4154ad-8f6f-4cbe-b4f8-e5993be1e947 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:00:17.584838 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-de4154ad-8f6f-4cbe-b4f8-e5993be1e947 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:00:17.584838 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:00:17.584838 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:00:17.585967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4154ad-8f6f-4cbe-b4f8-e5993be1e947 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:00:17.605374 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 740/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Jul 16 21:00:17 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:00:19.927071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28013cc-3088-49ff-be01-dcef6177bf4c None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:19.927676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28013cc-3088-49ff-be01-dcef6177bf4c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:19.927676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28013cc-3088-49ff-be01-dcef6177bf4c None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:19.929052 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 739/1479] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 21:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:00:19.934446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6067adb-fabf-431e-82c1-da974063983a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:19.934873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6067adb-fabf-431e-82c1-da974063983a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:19.935035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6067adb-fabf-431e-82c1-da974063983a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:20.004067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e6067adb-fabf-431e-82c1-da974063983a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:00:20.005291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e6067adb-fabf-431e-82c1-da974063983a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:00:20.104367 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 741/1480] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 21:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:00:20.150093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28013cc-3088-49ff-be01-dcef6177bf4c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:00:20.151629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f28013cc-3088-49ff-be01-dcef6177bf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:00:20.162186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:00:20.302254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28013cc-3088-49ff-be01-dcef6177bf4c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:00:20.385294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:00:20.418661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce94be-d1f0-4b08-8ad8-bf1094480fc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:00:20.419259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce94be-d1f0-4b08-8ad8-bf1094480fc3 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:20.419541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce94be-d1f0-4b08-8ad8-bf1094480fc3 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:20.419816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce94be-d1f0-4b08-8ad8-bf1094480fc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:20.421463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-58ce94be-d1f0-4b08-8ad8-bf1094480fc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:00:20.513029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce94be-d1f0-4b08-8ad8-bf1094480fc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:00:20.514741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce94be-d1f0-4b08-8ad8-bf1094480fc3 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:00:20.534265 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 740/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:00:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:00:23.033888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6bbbb-3321-4fab-adb9-089ae324eee8 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:23.033888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6bbbb-3321-4fab-adb9-089ae324eee8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:23.033888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6bbbb-3321-4fab-adb9-089ae324eee8 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:23.033888 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 742/1482] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 21:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:00:23.035271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2733dc5-4490-40de-a008-e19116b8f297 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:23.035679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2733dc5-4490-40de-a008-e19116b8f297 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:23.035833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2733dc5-4490-40de-a008-e19116b8f297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:23.101658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a2733dc5-4490-40de-a008-e19116b8f297 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:00:23.102892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a2733dc5-4490-40de-a008-e19116b8f297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:00:23.150790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:00:23.203758 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 741/1483] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 21:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:00:23.242753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6bbbb-3321-4fab-adb9-089ae324eee8 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:00:23.244347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-44b6bbbb-3321-4fab-adb9-089ae324eee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:00:23.267927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:00:23.348743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6bbbb-3321-4fab-adb9-089ae324eee8 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:00:23.421662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3e6be-dd1f-42ae-a1d2-d6c2b7acaf05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:00:23.422305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3e6be-dd1f-42ae-a1d2-d6c2b7acaf05 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:23.422584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3e6be-dd1f-42ae-a1d2-d6c2b7acaf05 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:23.423402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3e6be-dd1f-42ae-a1d2-d6c2b7acaf05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:23.425225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bfc3e6be-dd1f-42ae-a1d2-d6c2b7acaf05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:00:23.497884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:00:23.533930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3e6be-dd1f-42ae-a1d2-d6c2b7acaf05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:00:23.535414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3e6be-dd1f-42ae-a1d2-d6c2b7acaf05 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:00:23.553708 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 743/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:00:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:00:25.850810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e1ba2-f394-4ebb-847b-339e1024e514 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:25.851388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e1ba2-f394-4ebb-847b-339e1024e514 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:25.851388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e1ba2-f394-4ebb-847b-339e1024e514 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:25.852863 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 742/1485] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 21:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:00:25.858043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad49c0-28dc-4261-84a0-8ab910d9440f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:25.858476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad49c0-28dc-4261-84a0-8ab910d9440f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:25.858585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad49c0-28dc-4261-84a0-8ab910d9440f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:25.928037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a5ad49c0-28dc-4261-84a0-8ab910d9440f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:00:25.929239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a5ad49c0-28dc-4261-84a0-8ab910d9440f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:00:26.027789 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 744/1486] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 21:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:00:26.068947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e1ba2-f394-4ebb-847b-339e1024e514 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:00:26.070480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ff3e1ba2-f394-4ebb-847b-339e1024e514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:00:26.175429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e1ba2-f394-4ebb-847b-339e1024e514 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:00:26.246283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:00:26.248068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc6b9d-5555-4fcb-b564-edb2ed25740f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:00:26.248713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc6b9d-5555-4fcb-b564-edb2ed25740f service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:26.248993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc6b9d-5555-4fcb-b564-edb2ed25740f service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:26.249265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc6b9d-5555-4fcb-b564-edb2ed25740f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:26.251446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b7cc6b9d-5555-4fcb-b564-edb2ed25740f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:00:26.359935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc6b9d-5555-4fcb-b564-edb2ed25740f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:00:26.362165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc6b9d-5555-4fcb-b564-edb2ed25740f service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:00:26.380013 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 743/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:00:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:00:28.774804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869422ba-1ffa-47f6-a550-ca318cf9419f None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:28.775401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869422ba-1ffa-47f6-a550-ca318cf9419f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:28.775401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869422ba-1ffa-47f6-a550-ca318cf9419f None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:28.776750 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 745/1488] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 21:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:00:28.782944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab245eb-60a9-4fbc-a24f-997a4a169c9c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:28.783836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab245eb-60a9-4fbc-a24f-997a4a169c9c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:28.783836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab245eb-60a9-4fbc-a24f-997a4a169c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:28.851345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2ab245eb-60a9-4fbc-a24f-997a4a169c9c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:00:28.852575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2ab245eb-60a9-4fbc-a24f-997a4a169c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:00:28.912195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:00:28.959946 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 744/1489] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 21:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:00:29.003948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869422ba-1ffa-47f6-a550-ca318cf9419f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:00:29.005489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-869422ba-1ffa-47f6-a550-ca318cf9419f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:00:29.042631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:00:29.111436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869422ba-1ffa-47f6-a550-ca318cf9419f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:00:29.186099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a04a5d-917f-4450-9265-6b35030fcbcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:00:29.186745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a04a5d-917f-4450-9265-6b35030fcbcc service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:29.187048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a04a5d-917f-4450-9265-6b35030fcbcc service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:29.187327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a04a5d-917f-4450-9265-6b35030fcbcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:29.189837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d7a04a5d-917f-4450-9265-6b35030fcbcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:00:29.271912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:00:29.301361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a04a5d-917f-4450-9265-6b35030fcbcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:00:29.302812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a04a5d-917f-4450-9265-6b35030fcbcc service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:00:29.321780 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 746/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:00:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:00:31.998356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb3ea8-3081-4f8a-85d1-93f9f61e1d00 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:31.998932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb3ea8-3081-4f8a-85d1-93f9f61e1d00 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:31.998932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb3ea8-3081-4f8a-85d1-93f9f61e1d00 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:32.000315 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 745/1491] 10.222.0.16 () {54 vars in 926 bytes} [Sat Jul 16 21:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:00:32.007640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c9c7f-fceb-431a-b96b-130dae2457ac None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:32.008133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c9c7f-fceb-431a-b96b-130dae2457ac None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:32.008228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c9c7f-fceb-431a-b96b-130dae2457ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:32.074947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a61c9c7f-fceb-431a-b96b-130dae2457ac None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:00:32.076190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a61c9c7f-fceb-431a-b96b-130dae2457ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:00:32.175102 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 747/1492] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Jul 16 21:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:00:32.217137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb3ea8-3081-4f8a-85d1-93f9f61e1d00 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:00:32.218662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-01bb3ea8-3081-4f8a-85d1-93f9f61e1d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:00:32.328355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb3ea8-3081-4f8a-85d1-93f9f61e1d00 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:00:32.413704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c710d85-df0f-4a18-a848-55c35e066882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:00:32.414344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c710d85-df0f-4a18-a848-55c35e066882 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:00:32.414623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c710d85-df0f-4a18-a848-55c35e066882 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:00:32.414893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c710d85-df0f-4a18-a848-55c35e066882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:00:32.416560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6c710d85-df0f-4a18-a848-55c35e066882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:00:32.425502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:00:32.526692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c710d85-df0f-4a18-a848-55c35e066882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:00:32.528187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c710d85-df0f-4a18-a848-55c35e066882 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:00:32.546829 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 746/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:00:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:00:42.173162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=82 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:00:42.544748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=50 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:02:12.297820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a50cb7-5530-486c-aa5f-3eb5d859233b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:02:12.298394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a50cb7-5530-486c-aa5f-3eb5d859233b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:02:12.298394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a50cb7-5530-486c-aa5f-3eb5d859233b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:02:12.384522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f8a50cb7-5530-486c-aa5f-3eb5d859233b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:02:12.385756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f8a50cb7-5530-486c-aa5f-3eb5d859233b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:02:12.490668 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 748/1494] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:02:12.499459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e78487-3b9a-4be1-920a-ac7e28be412d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:02:12.500066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e78487-3b9a-4be1-920a-ac7e28be412d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:02:12.500066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e78487-3b9a-4be1-920a-ac7e28be412d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:02:12.519378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-08e78487-3b9a-4be1-920a-ac7e28be412d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:02:12.520587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-08e78487-3b9a-4be1-920a-ac7e28be412d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:02:12.529948 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 747/1495] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:02:12.534874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a50cb7-5530-486c-aa5f-3eb5d859233b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:02:12.544873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a50cb7-5530-486c-aa5f-3eb5d859233b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:02:12.549620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda0d56-55a6-4c13-94c9-2a67b9512174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:02:12.550228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda0d56-55a6-4c13-94c9-2a67b9512174 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:02:12.550511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda0d56-55a6-4c13-94c9-2a67b9512174 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:02:12.550791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda0d56-55a6-4c13-94c9-2a67b9512174 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:02:12.551564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda0d56-55a6-4c13-94c9-2a67b9512174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:02:12.551868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda0d56-55a6-4c13-94c9-2a67b9512174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:02:12.552883 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-efda0d56-55a6-4c13-94c9-2a67b9512174 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:02:12.552883 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:02:12.552883 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:02:12.553780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda0d56-55a6-4c13-94c9-2a67b9512174 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:02:12.566365 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 749/1496] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:02:12.574639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e78487-3b9a-4be1-920a-ac7e28be412d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:02:12.584526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e78487-3b9a-4be1-920a-ac7e28be412d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:02:12.589242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a909090-0b56-4a34-becc-5493b2901309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:02:12.589897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a909090-0b56-4a34-becc-5493b2901309 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:02:12.590185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a909090-0b56-4a34-becc-5493b2901309 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:02:12.590456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a909090-0b56-4a34-becc-5493b2901309 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:02:12.591370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a909090-0b56-4a34-becc-5493b2901309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:02:12.593164 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-5a909090-0b56-4a34-becc-5493b2901309 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:02:12.593164 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:02:12.593164 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:02:12.594362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a909090-0b56-4a34-becc-5493b2901309 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:02:12.694596 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 748/1497] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:02:12 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:02:12.698748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda0d56-55a6-4c13-94c9-2a67b9512174 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:02:12.709801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda0d56-55a6-4c13-94c9-2a67b9512174 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:02:12.760787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:02:12.768362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b0bc8-ff79-429a-97f0-ed495403ecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:02:12.769009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b0bc8-ff79-429a-97f0-ed495403ecc6 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:02:12.769298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b0bc8-ff79-429a-97f0-ed495403ecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:02:12.769574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b0bc8-ff79-429a-97f0-ed495403ecc6 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:02:12.770277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b0bc8-ff79-429a-97f0-ed495403ecc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:02:12.771378 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-2d0b0bc8-ff79-429a-97f0-ed495403ecc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:02:12.771378 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:02:12.771378 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:02:12.776005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b0bc8-ff79-429a-97f0-ed495403ecc6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:02:12.870687 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 750/1498] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:02:12 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:02:12.875763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a909090-0b56-4a34-becc-5493b2901309 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:02:12.886421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a909090-0b56-4a34-becc-5493b2901309 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:02:12.892130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24b63a-94ab-4b2b-a603-1b19adbbd62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:02:12.892801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24b63a-94ab-4b2b-a603-1b19adbbd62c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:02:12.893078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24b63a-94ab-4b2b-a603-1b19adbbd62c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:02:12.893351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24b63a-94ab-4b2b-a603-1b19adbbd62c admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:02:12.894077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24b63a-94ab-4b2b-a603-1b19adbbd62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:02:12.895116 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-9d24b63a-94ab-4b2b-a603-1b19adbbd62c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:02:12.895116 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:02:12.895116 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:02:12.896007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24b63a-94ab-4b2b-a603-1b19adbbd62c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:02:12.914060 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 749/1499] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:02:12.918241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b0bc8-ff79-429a-97f0-ed495403ecc6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:02:12.929180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b0bc8-ff79-429a-97f0-ed495403ecc6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:02:12.933758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2698d21-f719-4cfa-9840-dc0d8fa694b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:02:12.937789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2698d21-f719-4cfa-9840-dc0d8fa694b3 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:02:12.937789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2698d21-f719-4cfa-9840-dc0d8fa694b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:02:12.937789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2698d21-f719-4cfa-9840-dc0d8fa694b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:02:12.937789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2698d21-f719-4cfa-9840-dc0d8fa694b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:02:12.937789 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-f2698d21-f719-4cfa-9840-dc0d8fa694b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:02:12.937789 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:02:12.937789 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:02:12.938521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2698d21-f719-4cfa-9840-dc0d8fa694b3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:02:12.952856 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 751/1500] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:02:12.957516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24b63a-94ab-4b2b-a603-1b19adbbd62c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:02:12.968098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24b63a-94ab-4b2b-a603-1b19adbbd62c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:02:12.973160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4546029-b462-4b5c-a9d5-6078a72c63d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:02:12.974051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4546029-b462-4b5c-a9d5-6078a72c63d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:02:12.974358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4546029-b462-4b5c-a9d5-6078a72c63d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:02:12.974654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4546029-b462-4b5c-a9d5-6078a72c63d2 admin admin] PATH_INFO: `/v3/projects/25d1c2a906c64195b720f9242e48bef0/users/3cf01d24f5fa4f25b4e839bf8bec0232/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:02:12.991256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4546029-b462-4b5c-a9d5-6078a72c63d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d1c2a906c64195b720f9242e48bef0, user_id=3cf01d24f5fa4f25b4e839bf8bec0232, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:02:12.992320 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-b4546029-b462-4b5c-a9d5-6078a72c63d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:02:12.992320 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:02:12.992320 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:02:12.994258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4546029-b462-4b5c-a9d5-6078a72c63d2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:02:13.087573 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 750/1501] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:02:12 2022] PUT /identity/v3/projects/25d1c2a906c64195b720f9242e48bef0/users/3cf01d24f5fa4f25b4e839bf8bec0232/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:02:13.100264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cf536-d592-4bc6-be7d-1f17cff67fb4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:02:13.100562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cf536-d592-4bc6-be7d-1f17cff67fb4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:02:13.100841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cf536-d592-4bc6-be7d-1f17cff67fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:02:13.130074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f76cf536-d592-4bc6-be7d-1f17cff67fb4 None None] MFA Rules not processed for user `3cf01d24f5fa4f25b4e839bf8bec0232`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:02:13.131336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f76cf536-d592-4bc6-be7d-1f17cff67fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:02:13.196542 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 752/1502] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:02:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:02:13.210615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ed747-6b3d-432f-9fae-1fca3e06f5aa None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:02:13.210904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ed747-6b3d-432f-9fae-1fca3e06f5aa None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:02:13.211221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ed747-6b3d-432f-9fae-1fca3e06f5aa None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:02:13.212744 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 751/1503] 10.222.0.16 () {54 vars in 964 bytes} [Sat Jul 16 21:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:02:13.218532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69771710-dd1d-4db9-bd60-3a7028b306fe None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:02:13.218855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69771710-dd1d-4db9-bd60-3a7028b306fe None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:02:13.219111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69771710-dd1d-4db9-bd60-3a7028b306fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:02:13.278606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-69771710-dd1d-4db9-bd60-3a7028b306fe None None] MFA Rules not processed for user `6dcc74f579e447938a2477e253e5d36e`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:02:13.280028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-69771710-dd1d-4db9-bd60-3a7028b306fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:02:13.359558 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 753/1504] 10.222.0.16 () {58 vars in 1061 bytes} [Sat Jul 16 21:02:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:02:13.367131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ed747-6b3d-432f-9fae-1fca3e06f5aa None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:02:13.378114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ed747-6b3d-432f-9fae-1fca3e06f5aa None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:02:13.381823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a4371-a122-4eea-b819-8be7deb1ed7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:02:13.382402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a4371-a122-4eea-b819-8be7deb1ed7e service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:02:13.382687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a4371-a122-4eea-b819-8be7deb1ed7e service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:02:13.382965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a4371-a122-4eea-b819-8be7deb1ed7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:02:13.392040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a4371-a122-4eea-b819-8be7deb1ed7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:02:13.393470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a4371-a122-4eea-b819-8be7deb1ed7e service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:02:13.402678 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 752/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:02:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:02:13.449905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a94a8-4be2-4e2d-bef5-a2dbb7ba68cd None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:02:13.450193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a94a8-4be2-4e2d-bef5-a2dbb7ba68cd None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:02:13.450464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a94a8-4be2-4e2d-bef5-a2dbb7ba68cd None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:02:13.451891 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 754/1506] 10.222.0.16 () {52 vars in 829 bytes} [Sat Jul 16 21:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:02:13.455463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a4371-a122-4eea-b819-8be7deb1ed7e service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:02:13.518083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a4371-a122-4eea-b819-8be7deb1ed7e service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:02:13.522883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea8623-4b07-452b-a3b8-4479eda5438a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:02:13.523786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea8623-4b07-452b-a3b8-4479eda5438a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:02:13.524067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea8623-4b07-452b-a3b8-4479eda5438a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:02:13.524341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea8623-4b07-452b-a3b8-4479eda5438a admin admin] PATH_INFO: `/v3/users/3cf01d24f5fa4f25b4e839bf8bec0232` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:02:13.525538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea8623-4b07-452b-a3b8-4479eda5438a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf01d24f5fa4f25b4e839bf8bec0232)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:02:13.526571 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-78ea8623-4b07-452b-a3b8-4479eda5438a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:02:13.526571 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:02:13.526571 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:02:13.527830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea8623-4b07-452b-a3b8-4479eda5438a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:02:13.726726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-78ea8623-4b07-452b-a3b8-4479eda5438a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf01d24f5fa4f25b4e839bf8bec0232'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:02:13.746075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-78ea8623-4b07-452b-a3b8-4479eda5438a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf01d24f5fa4f25b4e839bf8bec0232'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:02:13.809892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-78ea8623-4b07-452b-a3b8-4479eda5438a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf01d24f5fa4f25b4e839bf8bec0232'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:02:13.822709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:02:13.824327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-78ea8623-4b07-452b-a3b8-4479eda5438a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf01d24f5fa4f25b4e839bf8bec0232'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:02:13.825711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-78ea8623-4b07-452b-a3b8-4479eda5438a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf01d24f5fa4f25b4e839bf8bec0232'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:02:13.834459 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 753/1507] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:02:13 2022] DELETE /identity/v3/users/3cf01d24f5fa4f25b4e839bf8bec0232 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:02:13.838943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d10d7-f5d8-462b-8fa1-5912341cf35f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:02:13.839342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d10d7-f5d8-462b-8fa1-5912341cf35f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:02:13.839652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d10d7-f5d8-462b-8fa1-5912341cf35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:02:13.858413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a78d10d7-f5d8-462b-8fa1-5912341cf35f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:02:13.859681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a78d10d7-f5d8-462b-8fa1-5912341cf35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:02:13.869759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:02:13.921540 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 755/1508] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:02:13.931799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea8623-4b07-452b-a3b8-4479eda5438a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:02:13.933188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-78ea8623-4b07-452b-a3b8-4479eda5438a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:02:14.014447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea8623-4b07-452b-a3b8-4479eda5438a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:02:14.018073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6962b2b-1261-42c9-9b9b-503007f1e7fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:02:14.018816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6962b2b-1261-42c9-9b9b-503007f1e7fc service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:02:14.019138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6962b2b-1261-42c9-9b9b-503007f1e7fc service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:02:14.019418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6962b2b-1261-42c9-9b9b-503007f1e7fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:02:14.029440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6962b2b-1261-42c9-9b9b-503007f1e7fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:02:14.030874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6962b2b-1261-42c9-9b9b-503007f1e7fc service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:02:14.040888 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 754/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:02:14.738659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d10d7-f5d8-462b-8fa1-5912341cf35f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:02:14.740279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a78d10d7-f5d8-462b-8fa1-5912341cf35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:02:14.753137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d10d7-f5d8-462b-8fa1-5912341cf35f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:02:14.757877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c5b54-57e6-49a5-9142-3703ab2a2756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:02:14.758749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c5b54-57e6-49a5-9142-3703ab2a2756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:02:14.759044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c5b54-57e6-49a5-9142-3703ab2a2756 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:02:14.759331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c5b54-57e6-49a5-9142-3703ab2a2756 admin admin] PATH_INFO: `/v3/projects/25d1c2a906c64195b720f9242e48bef0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:02:14.760693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c5b54-57e6-49a5-9142-3703ab2a2756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25d1c2a906c64195b720f9242e48bef0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:02:14.761712 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-953c5b54-57e6-49a5-9142-3703ab2a2756 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:02:14.761712 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:02:14.761712 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:02:14.764462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c5b54-57e6-49a5-9142-3703ab2a2756 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:02:14.895680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-953c5b54-57e6-49a5-9142-3703ab2a2756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25d1c2a906c64195b720f9242e48bef0', 'request_id': 'req-953c5b54-57e6-49a5-9142-3703ab2a2756'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:02:14.909863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-953c5b54-57e6-49a5-9142-3703ab2a2756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25d1c2a906c64195b720f9242e48bef0', 'request_id': 'req-953c5b54-57e6-49a5-9142-3703ab2a2756'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:02:14.917183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-953c5b54-57e6-49a5-9142-3703ab2a2756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25d1c2a906c64195b720f9242e48bef0', 'request_id': 'req-953c5b54-57e6-49a5-9142-3703ab2a2756'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:02:14.990192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-953c5b54-57e6-49a5-9142-3703ab2a2756 admin admin] The token cache is being invalidate because project 25d1c2a906c64195b720f9242e48bef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:02:14.990395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-953c5b54-57e6-49a5-9142-3703ab2a2756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:02:14.991088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-953c5b54-57e6-49a5-9142-3703ab2a2756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:02:14.992764 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 756/1510] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:02:14 2022] DELETE /identity/v3/projects/25d1c2a906c64195b720f9242e48bef0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:02:24.036551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=38 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:02:24.986240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:05:39.298642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed56d4-301d-42da-99cd-69738e18fd70 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:05:39.299289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed56d4-301d-42da-99cd-69738e18fd70 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:05:39.299289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed56d4-301d-42da-99cd-69738e18fd70 None None] PATH_INFO: `/v3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:05:39.300529 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 755/1511] 10.222.0.30 () {54 vars in 925 bytes} [Sat Jul 16 21:05:39 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:05:39.306624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e7b15-61b5-464e-b1c2-a45911b2ae6c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:05:39.307100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e7b15-61b5-464e-b1c2-a45911b2ae6c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:05:39.307220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e7b15-61b5-464e-b1c2-a45911b2ae6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:05:39.356046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ac5e7b15-61b5-464e-b1c2-a45911b2ae6c None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:05:39.357244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ac5e7b15-61b5-464e-b1c2-a45911b2ae6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:05:39.428845 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 757/1512] 10.222.0.30 () {58 vars in 1015 bytes} [Sat Jul 16 21:05:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:05:42.085399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c4ed6-1adb-4849-8c3a-98a4595502b5 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:05:42.085982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c4ed6-1adb-4849-8c3a-98a4595502b5 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:05:42.085982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c4ed6-1adb-4849-8c3a-98a4595502b5 None None] PATH_INFO: `/v3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:05:42.087383 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 756/1513] 10.222.0.17 () {54 vars in 925 bytes} [Sat Jul 16 21:05:42 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:05:42.105127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71b39c-a0fc-41cc-958e-e95e98f833f4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:05:42.105563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71b39c-a0fc-41cc-958e-e95e98f833f4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:05:42.105685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71b39c-a0fc-41cc-958e-e95e98f833f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:05:42.124309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5c71b39c-a0fc-41cc-958e-e95e98f833f4 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:05:42.126006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5c71b39c-a0fc-41cc-958e-e95e98f833f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:05:42.134836 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 758/1514] 10.222.0.17 () {58 vars in 1015 bytes} [Sat Jul 16 21:05:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:05:43.672573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec978f-a947-4d79-bd37-23d49b9f8802 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:05:43.673455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec978f-a947-4d79-bd37-23d49b9f8802 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:05:43.673455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec978f-a947-4d79-bd37-23d49b9f8802 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:05:43.675345 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 757/1515] 10.222.0.16 () {54 vars in 961 bytes} [Sat Jul 16 21:05:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:05:43.681474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dd680-765e-4033-b1e1-ca7f6592de5c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:05:43.682008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dd680-765e-4033-b1e1-ca7f6592de5c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:05:43.682008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dd680-765e-4033-b1e1-ca7f6592de5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:05:43.701936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7d8dd680-765e-4033-b1e1-ca7f6592de5c None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:05:43.703971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7d8dd680-765e-4033-b1e1-ca7f6592de5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:05:43.713213 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 759/1516] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Jul 16 21:05:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:05:43.721378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec978f-a947-4d79-bd37-23d49b9f8802 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:05:43.735573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec978f-a947-4d79-bd37-23d49b9f8802 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:05:43.740729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec212dd8-b467-420d-8536-12a70c668493 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:05:43.741380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec212dd8-b467-420d-8536-12a70c668493 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:05:43.741663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec212dd8-b467-420d-8536-12a70c668493 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:05:43.741938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec212dd8-b467-420d-8536-12a70c668493 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:05:43.751884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec212dd8-b467-420d-8536-12a70c668493 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:05:43.753493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec212dd8-b467-420d-8536-12a70c668493 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:05:43.766488 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 758/1517] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:05:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:05:46.220444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef8925-8f75-48b5-ad2d-7f844a519e53 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:05:46.220913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef8925-8f75-48b5-ad2d-7f844a519e53 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:05:46.221025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef8925-8f75-48b5-ad2d-7f844a519e53 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:05:46.222437 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 760/1518] 10.222.0.16 () {54 vars in 961 bytes} [Sat Jul 16 21:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:05:46.228047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcdec4-5d3c-47c2-8b60-2547b2ab757e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:05:46.228606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcdec4-5d3c-47c2-8b60-2547b2ab757e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:05:46.228732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcdec4-5d3c-47c2-8b60-2547b2ab757e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:05:46.249265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a2fcdec4-5d3c-47c2-8b60-2547b2ab757e None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:05:46.250762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a2fcdec4-5d3c-47c2-8b60-2547b2ab757e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:05:46.261026 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 759/1519] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Jul 16 21:05:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:05:46.269309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef8925-8f75-48b5-ad2d-7f844a519e53 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:05:46.285644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef8925-8f75-48b5-ad2d-7f844a519e53 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:05:46.290741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613921c0-39db-4d01-bae0-8effa24b0cfd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:05:46.291421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613921c0-39db-4d01-bae0-8effa24b0cfd service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:05:46.291705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613921c0-39db-4d01-bae0-8effa24b0cfd service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:05:46.291981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613921c0-39db-4d01-bae0-8effa24b0cfd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:05:46.301456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613921c0-39db-4d01-bae0-8effa24b0cfd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:05:46.303112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613921c0-39db-4d01-bae0-8effa24b0cfd service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:05:46.313870 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 761/1520] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:05:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:05:56.243400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=9 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:05:56.309282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=56 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:06:16.566686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb665f9d-11b5-417e-90b3-f9bf95a554ae None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:06:16.567618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb665f9d-11b5-417e-90b3-f9bf95a554ae None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:06:16.567618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb665f9d-11b5-417e-90b3-f9bf95a554ae None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:06:16.568690 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 760/1521] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 16 21:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:06:16.574803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a485a-7f33-4aed-a4ad-405e9f71977b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:06:16.575305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a485a-7f33-4aed-a4ad-405e9f71977b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:06:16.575412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a485a-7f33-4aed-a4ad-405e9f71977b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:06:16.595547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7e4a485a-7f33-4aed-a4ad-405e9f71977b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:06:16.596735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7e4a485a-7f33-4aed-a4ad-405e9f71977b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:06:16.656424 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 762/1522] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 16 21:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:06:16.822767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb665f9d-11b5-417e-90b3-f9bf95a554ae None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:06:16.822767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-eb665f9d-11b5-417e-90b3-f9bf95a554ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:06:16.925230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb665f9d-11b5-417e-90b3-f9bf95a554ae None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:06:16.931653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bea49a-0cbc-4b27-8211-6f614735b5a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:06:16.932505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bea49a-0cbc-4b27-8211-6f614735b5a7 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:06:16.932813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bea49a-0cbc-4b27-8211-6f614735b5a7 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:06:16.933092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bea49a-0cbc-4b27-8211-6f614735b5a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:06:16.941941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bea49a-0cbc-4b27-8211-6f614735b5a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:06:16.943715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bea49a-0cbc-4b27-8211-6f614735b5a7 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:06:16.954185 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 761/1523] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:06:17.807712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f85631-56fb-4204-882f-4973453ad021 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:06:17.808285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f85631-56fb-4204-882f-4973453ad021 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:06:17.808285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f85631-56fb-4204-882f-4973453ad021 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:06:17.809680 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 763/1524] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 16 21:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 21:06:17.814721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc77663-ed02-481c-acc0-1e410be64965 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:06:17.815166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc77663-ed02-481c-acc0-1e410be64965 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:06:17.815311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc77663-ed02-481c-acc0-1e410be64965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:06:17.834053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-fdc77663-ed02-481c-acc0-1e410be64965 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:06:17.835852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fdc77663-ed02-481c-acc0-1e410be64965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:06:17.843780 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 762/1525] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 16 21:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:06:18.005243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f85631-56fb-4204-882f-4973453ad021 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:06:18.020577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f85631-56fb-4204-882f-4973453ad021 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:06:18.026668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479191c-d48d-4064-9031-394a10c4f700 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:06:18.027345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479191c-d48d-4064-9031-394a10c4f700 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:06:18.027628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479191c-d48d-4064-9031-394a10c4f700 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:06:18.027903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479191c-d48d-4064-9031-394a10c4f700 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:06:18.036735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479191c-d48d-4064-9031-394a10c4f700 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:06:18.039001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479191c-d48d-4064-9031-394a10c4f700 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:06:18.048813 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 764/1526] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:06:22.076081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d9e0b-1ea7-4388-9c9a-479f7fd94ef2 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:06:22.076749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d9e0b-1ea7-4388-9c9a-479f7fd94ef2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:06:22.076749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d9e0b-1ea7-4388-9c9a-479f7fd94ef2 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:06:22.078333 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 763/1527] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 16 21:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:06:22.083723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645725e9-5bdd-476e-b49d-6d9b062fd5b3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:06:22.084185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645725e9-5bdd-476e-b49d-6d9b062fd5b3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:06:22.084300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645725e9-5bdd-476e-b49d-6d9b062fd5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:06:22.102782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-645725e9-5bdd-476e-b49d-6d9b062fd5b3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:06:22.104022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-645725e9-5bdd-476e-b49d-6d9b062fd5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:06:22.111985 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 765/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 16 21:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:06:22.152373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d9e0b-1ea7-4388-9c9a-479f7fd94ef2 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:06:22.161354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fd7d9e0b-1ea7-4388-9c9a-479f7fd94ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:06:22.215549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d9e0b-1ea7-4388-9c9a-479f7fd94ef2 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:06:22.219151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1603d38-d373-4d4f-a509-4738f9e238e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:06:22.224384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1603d38-d373-4d4f-a509-4738f9e238e9 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:06:22.224384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1603d38-d373-4d4f-a509-4738f9e238e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:06:22.224384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1603d38-d373-4d4f-a509-4738f9e238e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:06:22.230511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1603d38-d373-4d4f-a509-4738f9e238e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:06:22.231995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1603d38-d373-4d4f-a509-4738f9e238e9 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:06:22.242552 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 764/1529] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:06:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:06:24.493137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7aa8d-5554-4da5-a1fe-24006e917c1b None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:06:24.493711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7aa8d-5554-4da5-a1fe-24006e917c1b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:06:24.493711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7aa8d-5554-4da5-a1fe-24006e917c1b None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:06:24.495280 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 766/1530] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 16 21:06:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:06:24.500424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c929e8-43cb-43b7-914d-6272abf93982 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:06:24.500840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c929e8-43cb-43b7-914d-6272abf93982 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:06:24.500978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c929e8-43cb-43b7-914d-6272abf93982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:06:24.518709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-20c929e8-43cb-43b7-914d-6272abf93982 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:06:24.519943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-20c929e8-43cb-43b7-914d-6272abf93982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:06:24.528455 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 765/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 16 21:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:06:24.566806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7aa8d-5554-4da5-a1fe-24006e917c1b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:06:24.577920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7aa8d-5554-4da5-a1fe-24006e917c1b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:06:24.581513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a471c-3d04-495b-9f19-25ed0b5de3f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:06:24.582132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a471c-3d04-495b-9f19-25ed0b5de3f1 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:06:24.582410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a471c-3d04-495b-9f19-25ed0b5de3f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:06:24.582684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a471c-3d04-495b-9f19-25ed0b5de3f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:06:24.591928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a471c-3d04-495b-9f19-25ed0b5de3f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:06:24.593404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a471c-3d04-495b-9f19-25ed0b5de3f1 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:06:24.603528 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 767/1532] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:06:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:06:34.513638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=78 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:06:34.598623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=42 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:07:16.218116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee7c9b-3423-4620-af13-8074c969cbcb None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:16.218629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee7c9b-3423-4620-af13-8074c969cbcb None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:16.218629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee7c9b-3423-4620-af13-8074c969cbcb None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:16.220155 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 766/1533] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:07:16.225924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c26b6-b428-4d6f-82e0-c025d6b3d14e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:16.226351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c26b6-b428-4d6f-82e0-c025d6b3d14e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:16.226469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c26b6-b428-4d6f-82e0-c025d6b3d14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:16.245688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-dc4c26b6-b428-4d6f-82e0-c025d6b3d14e None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:07:16.246915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dc4c26b6-b428-4d6f-82e0-c025d6b3d14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:07:16.255875 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 768/1534] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:07:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:07:26.240422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:07:55.535383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa23262-40ed-4537-8a9a-c06fd8987d4c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:55.536471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa23262-40ed-4537-8a9a-c06fd8987d4c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:55.536966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa23262-40ed-4537-8a9a-c06fd8987d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:55.553660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e64412-a3ef-4817-ab80-d6234db1e986 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:55.554676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e64412-a3ef-4817-ab80-d6234db1e986 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:55.555199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e64412-a3ef-4817-ab80-d6234db1e986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:55.558848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8fa23262-40ed-4537-8a9a-c06fd8987d4c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:07:55.564570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8fa23262-40ed-4537-8a9a-c06fd8987d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:07:55.579072 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 767/1535] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:07:55.580182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b1e64412-a3ef-4817-ab80-d6234db1e986 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:07:55.587473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b1e64412-a3ef-4817-ab80-d6234db1e986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:07:55.588875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6bf16-2d0e-4a08-bc98-f53e35b8e08a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:55.589168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6bf16-2d0e-4a08-bc98-f53e35b8e08a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:55.589450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6bf16-2d0e-4a08-bc98-f53e35b8e08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:55.595945 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 769/1536] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:07:55.605344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c199783-4d7d-4a7c-b2d6-287eda33cf19 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:55.605657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c199783-4d7d-4a7c-b2d6-287eda33cf19 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:55.605905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c199783-4d7d-4a7c-b2d6-287eda33cf19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:55.616617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-acd6bf16-2d0e-4a08-bc98-f53e35b8e08a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:07:55.618449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-acd6bf16-2d0e-4a08-bc98-f53e35b8e08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:07:55.636022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6c199783-4d7d-4a7c-b2d6-287eda33cf19 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:07:55.637448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6c199783-4d7d-4a7c-b2d6-287eda33cf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:07:55.647931 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 770/1537] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:07:55.649887 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 768/1538] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:07:55.656266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6bf16-2d0e-4a08-bc98-f53e35b8e08a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:55.656448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c199783-4d7d-4a7c-b2d6-287eda33cf19 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:55.666685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c199783-4d7d-4a7c-b2d6-287eda33cf19 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:55.672603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6bf16-2d0e-4a08-bc98-f53e35b8e08a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:55.681565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1195e-107c-4c46-b421-e6011bffc140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:55.681787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbf06b-5ce3-4986-9836-3dbca4109295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:55.682259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1195e-107c-4c46-b421-e6011bffc140 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:55.682441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbf06b-5ce3-4986-9836-3dbca4109295 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:55.682556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1195e-107c-4c46-b421-e6011bffc140 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:55.682748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbf06b-5ce3-4986-9836-3dbca4109295 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:55.682846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1195e-107c-4c46-b421-e6011bffc140 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:55.682993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbf06b-5ce3-4986-9836-3dbca4109295 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:55.683555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1195e-107c-4c46-b421-e6011bffc140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:07:55.683723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbf06b-5ce3-4986-9836-3dbca4109295 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:07:55.683875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1195e-107c-4c46-b421-e6011bffc140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:55.684057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbf06b-5ce3-4986-9836-3dbca4109295 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:55.685154 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-e9bbf06b-5ce3-4986-9836-3dbca4109295 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:07:55.685154 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:07:55.685154 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:07:55.685529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1195e-107c-4c46-b421-e6011bffc140 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:55.686067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbf06b-5ce3-4986-9836-3dbca4109295 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:55.710684 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 771/1539] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:07:55.713542 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 769/1540] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:07:55.723265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1195e-107c-4c46-b421-e6011bffc140 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:55.725677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbf06b-5ce3-4986-9836-3dbca4109295 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:55.736797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbf06b-5ce3-4986-9836-3dbca4109295 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:55.742032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1195e-107c-4c46-b421-e6011bffc140 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:55.747969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08ffcf-054b-42d1-b880-e5d8d45a11f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:55.748667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08ffcf-054b-42d1-b880-e5d8d45a11f2 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:55.748947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08ffcf-054b-42d1-b880-e5d8d45a11f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:55.749220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08ffcf-054b-42d1-b880-e5d8d45a11f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:55.756539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08ffcf-054b-42d1-b880-e5d8d45a11f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:55.758565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08ffcf-054b-42d1-b880-e5d8d45a11f2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:55.766821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453956c-1a56-4038-95aa-9520716ce425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:55.767611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453956c-1a56-4038-95aa-9520716ce425 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:55.767906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453956c-1a56-4038-95aa-9520716ce425 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:55.768191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453956c-1a56-4038-95aa-9520716ce425 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:55.768953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453956c-1a56-4038-95aa-9520716ce425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:55.770356 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-f453956c-1a56-4038-95aa-9520716ce425 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:07:55.770356 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:07:55.770356 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:07:55.771673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453956c-1a56-4038-95aa-9520716ce425 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:55.896635 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 770/1541] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:07:55 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:07:55.900995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08ffcf-054b-42d1-b880-e5d8d45a11f2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:55.929511 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 772/1542] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:07:55 2022] POST /identity/v3/projects => generated 369 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:07:55.943329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453956c-1a56-4038-95aa-9520716ce425 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:56.012712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08ffcf-054b-42d1-b880-e5d8d45a11f2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:56.043890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453956c-1a56-4038-95aa-9520716ce425 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:56.056366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928ff23-d4a6-4bfe-a841-a98267a58fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:56.057067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928ff23-d4a6-4bfe-a841-a98267a58fac admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.057351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928ff23-d4a6-4bfe-a841-a98267a58fac admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.057623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928ff23-d4a6-4bfe-a841-a98267a58fac admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.058339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928ff23-d4a6-4bfe-a841-a98267a58fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:56.060358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928ff23-d4a6-4bfe-a841-a98267a58fac admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:56.117874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31195d-ff4d-4aa7-9727-fda42b56824c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:56.118480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31195d-ff4d-4aa7-9727-fda42b56824c admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.118762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31195d-ff4d-4aa7-9727-fda42b56824c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.119055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31195d-ff4d-4aa7-9727-fda42b56824c admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.119896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31195d-ff4d-4aa7-9727-fda42b56824c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:56.120990 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-bc31195d-ff4d-4aa7-9727-fda42b56824c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:07:56.120990 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:07:56.120990 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:07:56.122233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31195d-ff4d-4aa7-9727-fda42b56824c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:56.192123 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 773/1543] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:07:55 2022] POST /identity/v3/users => generated 285 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:07:56.196292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928ff23-d4a6-4bfe-a841-a98267a58fac admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:56.207749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928ff23-d4a6-4bfe-a841-a98267a58fac admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:56.219753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93127d13-517f-474c-91cd-6d41643ac923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:56.222144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93127d13-517f-474c-91cd-6d41643ac923 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.222144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93127d13-517f-474c-91cd-6d41643ac923 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.222144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93127d13-517f-474c-91cd-6d41643ac923 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.222144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93127d13-517f-474c-91cd-6d41643ac923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:56.223449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93127d13-517f-474c-91cd-6d41643ac923 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:56.242918 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 774/1544] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:07:56.244280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5a083-a103-4040-8798-11df6007e43b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.244568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5a083-a103-4040-8798-11df6007e43b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.244878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5a083-a103-4040-8798-11df6007e43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.250479 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 771/1545] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:07:55 2022] POST /identity/v3/users => generated 290 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:07:56.255428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31195d-ff4d-4aa7-9727-fda42b56824c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:56.275646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31195d-ff4d-4aa7-9727-fda42b56824c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:56.277126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-96e5a083-a103-4040-8798-11df6007e43b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:07:56.278273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-96e5a083-a103-4040-8798-11df6007e43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:07:56.284634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5e9bd-c5c1-4d0b-a238-3f918802de45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:56.285980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5e9bd-c5c1-4d0b-a238-3f918802de45 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.286265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5e9bd-c5c1-4d0b-a238-3f918802de45 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.286547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5e9bd-c5c1-4d0b-a238-3f918802de45 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.287302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5e9bd-c5c1-4d0b-a238-3f918802de45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:56.289067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5e9bd-c5c1-4d0b-a238-3f918802de45 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:56.298720 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 775/1546] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:07:56.299968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5a083-a103-4040-8798-11df6007e43b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:56.308733 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 772/1547] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:07:56.310128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221c766-fb06-42a4-807e-b053f5617cbe None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.310595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221c766-fb06-42a4-807e-b053f5617cbe None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.310877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221c766-fb06-42a4-807e-b053f5617cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.313293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5a083-a103-4040-8798-11df6007e43b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:56.346172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3221c766-fb06-42a4-807e-b053f5617cbe None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:07:56.347200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46905a1c-15eb-4831-ac2a-330421640825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:56.348463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46905a1c-15eb-4831-ac2a-330421640825 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.348962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46905a1c-15eb-4831-ac2a-330421640825 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.349429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46905a1c-15eb-4831-ac2a-330421640825 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.350211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3221c766-fb06-42a4-807e-b053f5617cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:07:56.350591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46905a1c-15eb-4831-ac2a-330421640825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:56.352447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46905a1c-15eb-4831-ac2a-330421640825 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:56.361941 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 773/1548] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:07:56.362814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221c766-fb06-42a4-807e-b053f5617cbe None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:56.367793 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 776/1549] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:07:56.369794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2614e76-1250-4060-b7c4-0546e52707c1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.371140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2614e76-1250-4060-b7c4-0546e52707c1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.371638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2614e76-1250-4060-b7c4-0546e52707c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.382325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221c766-fb06-42a4-807e-b053f5617cbe None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:56.388430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713928ef-16fe-4f5b-a898-49c7c0187754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:56.389389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713928ef-16fe-4f5b-a898-49c7c0187754 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.389670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713928ef-16fe-4f5b-a898-49c7c0187754 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.389944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713928ef-16fe-4f5b-a898-49c7c0187754 admin admin] PATH_INFO: `/v3/projects/bafdaf9b261b45aa9ca5dd31aeaf8b66/users/6ebf41e0763e41c9a2483a2088c0c50a/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.412050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a2614e76-1250-4060-b7c4-0546e52707c1 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:07:56.413851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a2614e76-1250-4060-b7c4-0546e52707c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:07:56.418984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713928ef-16fe-4f5b-a898-49c7c0187754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bafdaf9b261b45aa9ca5dd31aeaf8b66, user_id=6ebf41e0763e41c9a2483a2088c0c50a, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:56.422149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713928ef-16fe-4f5b-a898-49c7c0187754 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:56.430688 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 777/1550] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:07:56.431657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2614e76-1250-4060-b7c4-0546e52707c1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:56.444580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2614e76-1250-4060-b7c4-0546e52707c1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:56.449321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45f763-bb94-4e8c-915f-fad43ef1068e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:56.450001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45f763-bb94-4e8c-915f-fad43ef1068e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.450315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45f763-bb94-4e8c-915f-fad43ef1068e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.450619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45f763-bb94-4e8c-915f-fad43ef1068e admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.451408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45f763-bb94-4e8c-915f-fad43ef1068e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:56.453024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45f763-bb94-4e8c-915f-fad43ef1068e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:56.464016 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 778/1551] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:07:56.465376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558536fe-a560-432a-9689-f01bcb77cde7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.465667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558536fe-a560-432a-9689-f01bcb77cde7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.465951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558536fe-a560-432a-9689-f01bcb77cde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.487890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-558536fe-a560-432a-9689-f01bcb77cde7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:07:56.489094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-558536fe-a560-432a-9689-f01bcb77cde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:07:56.497413 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 779/1552] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:07:56.498469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f15a8-c713-4955-8cab-e743f7f33a83 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.503058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f15a8-c713-4955-8cab-e743f7f33a83 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.503058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f15a8-c713-4955-8cab-e743f7f33a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.517947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f81f15a8-c713-4955-8cab-e743f7f33a83 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:07:56.519194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f81f15a8-c713-4955-8cab-e743f7f33a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:07:56.528078 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 780/1553] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:07:56.529325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929d94b-e716-4697-b9eb-38707ba56a25 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.529618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929d94b-e716-4697-b9eb-38707ba56a25 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.529900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929d94b-e716-4697-b9eb-38707ba56a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.534338 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 774/1554] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:07:56 2022] PUT /identity/v3/projects/bafdaf9b261b45aa9ca5dd31aeaf8b66/users/6ebf41e0763e41c9a2483a2088c0c50a/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:07:56.535709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7eeb10-5b88-414b-a280-ac39cd4b3171 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.536258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7eeb10-5b88-414b-a280-ac39cd4b3171 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.536258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7eeb10-5b88-414b-a280-ac39cd4b3171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.550179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:07:56.551124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f929d94b-e716-4697-b9eb-38707ba56a25 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:07:56.552389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f929d94b-e716-4697-b9eb-38707ba56a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:07:56.556444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1d7eeb10-5b88-414b-a280-ac39cd4b3171 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:07:56.557624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1d7eeb10-5b88-414b-a280-ac39cd4b3171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:07:56.594445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:07:56.615810 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 781/1555] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:07:56.619978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929d94b-e716-4697-b9eb-38707ba56a25 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:56.621135 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 775/1556] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:07:56.622015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7eeb10-5b88-414b-a280-ac39cd4b3171 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:56.632891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7eeb10-5b88-414b-a280-ac39cd4b3171 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:56.637981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adbd06-627a-42b9-8fc2-3864f14e5d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:56.654561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929d94b-e716-4697-b9eb-38707ba56a25 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:56.654717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adbd06-627a-42b9-8fc2-3864f14e5d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.654717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adbd06-627a-42b9-8fc2-3864f14e5d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.654717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adbd06-627a-42b9-8fc2-3864f14e5d9f admin admin] PATH_INFO: `/v3/projects/ba432093c99945c1af32f04d896809b6/users/1f825fe1541f4ba898be68cb7a6ac992/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.654960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4d3ff-c19c-4088-b2ad-e9711c71bed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:56.654960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4d3ff-c19c-4088-b2ad-e9711c71bed6 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.654960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4d3ff-c19c-4088-b2ad-e9711c71bed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.654960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4d3ff-c19c-4088-b2ad-e9711c71bed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.655337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4d3ff-c19c-4088-b2ad-e9711c71bed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:07:56.655337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4d3ff-c19c-4088-b2ad-e9711c71bed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:56.655337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4d3ff-c19c-4088-b2ad-e9711c71bed6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:56.655910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adbd06-627a-42b9-8fc2-3864f14e5d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba432093c99945c1af32f04d896809b6, user_id=1f825fe1541f4ba898be68cb7a6ac992, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:56.658639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adbd06-627a-42b9-8fc2-3864f14e5d9f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:56.660652 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 782/1557] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:07:56.662065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6abb0-7778-4cb8-ab12-e0ee51a0f20c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.662346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6abb0-7778-4cb8-ab12-e0ee51a0f20c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.662616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6abb0-7778-4cb8-ab12-e0ee51a0f20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.682122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-92f6abb0-7778-4cb8-ab12-e0ee51a0f20c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:07:56.683347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-92f6abb0-7778-4cb8-ab12-e0ee51a0f20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:07:56.692331 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 783/1558] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:07:56.693119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6abb0-7778-4cb8-ab12-e0ee51a0f20c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:56.702919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6abb0-7778-4cb8-ab12-e0ee51a0f20c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:56.709059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60057a-def0-40c3-b0ec-ebe924c3d1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:56.709787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60057a-def0-40c3-b0ec-ebe924c3d1ff admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.710014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60057a-def0-40c3-b0ec-ebe924c3d1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.710300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60057a-def0-40c3-b0ec-ebe924c3d1ff admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.711042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60057a-def0-40c3-b0ec-ebe924c3d1ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:07:56.711390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60057a-def0-40c3-b0ec-ebe924c3d1ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:56.713017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60057a-def0-40c3-b0ec-ebe924c3d1ff admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:56.725202 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 784/1559] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:07:56.726654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15104aa-9c8f-423a-a2c8-926d063976be None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.726945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15104aa-9c8f-423a-a2c8-926d063976be None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.727271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15104aa-9c8f-423a-a2c8-926d063976be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.745064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c15104aa-9c8f-423a-a2c8-926d063976be None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:07:56.746256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c15104aa-9c8f-423a-a2c8-926d063976be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:07:56.754971 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 785/1560] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:07:56.756273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77e83d-2bdc-4a64-a91a-0730096316ea None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.756568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77e83d-2bdc-4a64-a91a-0730096316ea None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.756841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77e83d-2bdc-4a64-a91a-0730096316ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.779378 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 776/1561] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:07:56 2022] PUT /identity/v3/projects/ba432093c99945c1af32f04d896809b6/users/1f825fe1541f4ba898be68cb7a6ac992/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:07:56.780849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d8d54-8ae9-4603-93ba-cdfd1372a958 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.781233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d8d54-8ae9-4603-93ba-cdfd1372a958 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.781616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d8d54-8ae9-4603-93ba-cdfd1372a958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.785528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1a77e83d-2bdc-4a64-a91a-0730096316ea None None] MFA Rules not processed for user `6ebf41e0763e41c9a2483a2088c0c50a`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:07:56.786755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1a77e83d-2bdc-4a64-a91a-0730096316ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:07:56.801374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a48d8d54-8ae9-4603-93ba-cdfd1372a958 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:07:56.802581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a48d8d54-8ae9-4603-93ba-cdfd1372a958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:07:56.855737 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 786/1562] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:07:56.857237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc387c18-bd86-4a7d-9a48-95abfd4adc92 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.857527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc387c18-bd86-4a7d-9a48-95abfd4adc92 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.857817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc387c18-bd86-4a7d-9a48-95abfd4adc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.871264 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 777/1563] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:07:56.872038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d8d54-8ae9-4603-93ba-cdfd1372a958 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:56.881957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-bc387c18-bd86-4a7d-9a48-95abfd4adc92 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:07:56.883081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d8d54-8ae9-4603-93ba-cdfd1372a958 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:56.889414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bc387c18-bd86-4a7d-9a48-95abfd4adc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:07:56.889528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e81fe2-9a55-46ad-8f04-d528c0091184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:56.889528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e81fe2-9a55-46ad-8f04-d528c0091184 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.889528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e81fe2-9a55-46ad-8f04-d528c0091184 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.889790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e81fe2-9a55-46ad-8f04-d528c0091184 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.890540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e81fe2-9a55-46ad-8f04-d528c0091184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:56.891352 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 787/1564] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:07:56.893448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccea0b5-2c98-417b-b5f9-0a5e3db17482 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.893735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccea0b5-2c98-417b-b5f9-0a5e3db17482 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.894012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccea0b5-2c98-417b-b5f9-0a5e3db17482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.897121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e81fe2-9a55-46ad-8f04-d528c0091184 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:56.912191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1ccea0b5-2c98-417b-b5f9-0a5e3db17482 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:07:56.913397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1ccea0b5-2c98-417b-b5f9-0a5e3db17482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:07:56.924631 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 788/1565] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:07:56.925700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccea0b5-2c98-417b-b5f9-0a5e3db17482 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:56.935545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccea0b5-2c98-417b-b5f9-0a5e3db17482 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:56.941007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9da29-2d98-4ec9-8f4f-92dbdebe5184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:56.941651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9da29-2d98-4ec9-8f4f-92dbdebe5184 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:56.942950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9da29-2d98-4ec9-8f4f-92dbdebe5184 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:56.942950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9da29-2d98-4ec9-8f4f-92dbdebe5184 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:56.943148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9da29-2d98-4ec9-8f4f-92dbdebe5184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:56.944974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9da29-2d98-4ec9-8f4f-92dbdebe5184 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:57.042600 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 778/1566] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:07:56 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:07:57.043616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e81fe2-9a55-46ad-8f04-d528c0091184 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:57.069745 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 789/1567] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:07:56 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:07:57.069745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840249f-3d38-4b26-bdb4-69e31d59411a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:57.069745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840249f-3d38-4b26-bdb4-69e31d59411a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:57.069745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840249f-3d38-4b26-bdb4-69e31d59411a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:57.097780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5840249f-3d38-4b26-bdb4-69e31d59411a None None] MFA Rules not processed for user `1f825fe1541f4ba898be68cb7a6ac992`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:07:57.099001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5840249f-3d38-4b26-bdb4-69e31d59411a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:07:57.109221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e81fe2-9a55-46ad-8f04-d528c0091184 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:57.114121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:07:57.146305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:07:57.167190 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 790/1568] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:07:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:07:57.168018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840249f-3d38-4b26-bdb4-69e31d59411a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:57.171498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b97653-e6de-46ac-a8eb-80cf8d7a82c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:57.172146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b97653-e6de-46ac-a8eb-80cf8d7a82c6 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:57.172473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b97653-e6de-46ac-a8eb-80cf8d7a82c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:57.172694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b97653-e6de-46ac-a8eb-80cf8d7a82c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:57.173911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b97653-e6de-46ac-a8eb-80cf8d7a82c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:07:57.174214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b97653-e6de-46ac-a8eb-80cf8d7a82c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:57.175841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b97653-e6de-46ac-a8eb-80cf8d7a82c6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:57.180708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840249f-3d38-4b26-bdb4-69e31d59411a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:57.185382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24427b3-2944-42e2-ac59-2b349488ed4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:57.186031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24427b3-2944-42e2-ac59-2b349488ed4d admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:57.186316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24427b3-2944-42e2-ac59-2b349488ed4d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:57.186591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24427b3-2944-42e2-ac59-2b349488ed4d admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:57.187310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24427b3-2944-42e2-ac59-2b349488ed4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:57.187470 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 779/1569] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:07:57.188267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b97653-e6de-46ac-a8eb-80cf8d7a82c6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:57.189972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24427b3-2944-42e2-ac59-2b349488ed4d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:57.198616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b97653-e6de-46ac-a8eb-80cf8d7a82c6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:57.203668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4289b3-b900-4d2a-8ad0-b6e17f98b7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:57.204328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4289b3-b900-4d2a-8ad0-b6e17f98b7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:57.204750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4289b3-b900-4d2a-8ad0-b6e17f98b7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:57.205162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4289b3-b900-4d2a-8ad0-b6e17f98b7e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:57.205926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4289b3-b900-4d2a-8ad0-b6e17f98b7e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:07:57.206388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4289b3-b900-4d2a-8ad0-b6e17f98b7e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:57.208180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4289b3-b900-4d2a-8ad0-b6e17f98b7e9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:57.221584 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 780/1570] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:07:57.222528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4289b3-b900-4d2a-8ad0-b6e17f98b7e9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:57.232346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4289b3-b900-4d2a-8ad0-b6e17f98b7e9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:57.238040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689ec28-746f-4855-a331-a7b96ef0d8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:57.238681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689ec28-746f-4855-a331-a7b96ef0d8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:57.240961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689ec28-746f-4855-a331-a7b96ef0d8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:57.240961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689ec28-746f-4855-a331-a7b96ef0d8c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:57.240961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689ec28-746f-4855-a331-a7b96ef0d8c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:07:57.240961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689ec28-746f-4855-a331-a7b96ef0d8c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:57.242029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689ec28-746f-4855-a331-a7b96ef0d8c3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:57.254833 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 781/1571] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:07:57.255661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689ec28-746f-4855-a331-a7b96ef0d8c3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:57.266862 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 791/1572] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:07:57 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:07:57.268692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689ec28-746f-4855-a331-a7b96ef0d8c3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:57.268809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24427b3-2944-42e2-ac59-2b349488ed4d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:57.328889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e1cf1-17c3-4db2-869a-450310868eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:57.330116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e1cf1-17c3-4db2-869a-450310868eee admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:57.330398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e1cf1-17c3-4db2-869a-450310868eee admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:57.330670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e1cf1-17c3-4db2-869a-450310868eee admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:57.331427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e1cf1-17c3-4db2-869a-450310868eee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:07:57.331737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e1cf1-17c3-4db2-869a-450310868eee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:57.333655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24427b3-2944-42e2-ac59-2b349488ed4d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:57.334136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e1cf1-17c3-4db2-869a-450310868eee admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:57.339180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd0d2b-7bc6-4b83-bb8c-96204047a417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:57.339846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd0d2b-7bc6-4b83-bb8c-96204047a417 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:57.340122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd0d2b-7bc6-4b83-bb8c-96204047a417 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:57.340528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd0d2b-7bc6-4b83-bb8c-96204047a417 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:57.341719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd0d2b-7bc6-4b83-bb8c-96204047a417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:57.344167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd0d2b-7bc6-4b83-bb8c-96204047a417 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:57.353624 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 782/1573] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:07:57.353624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e1cf1-17c3-4db2-869a-450310868eee admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:57.357782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e1cf1-17c3-4db2-869a-450310868eee admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:57.363311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acc84f-9e8c-49bd-837b-9de69d42d844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:57.363969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acc84f-9e8c-49bd-837b-9de69d42d844 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:57.366331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acc84f-9e8c-49bd-837b-9de69d42d844 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:57.366331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acc84f-9e8c-49bd-837b-9de69d42d844 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:57.366331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acc84f-9e8c-49bd-837b-9de69d42d844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:57.367260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acc84f-9e8c-49bd-837b-9de69d42d844 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:57.442657 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 792/1574] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:07:57 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:07:57.443433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd0d2b-7bc6-4b83-bb8c-96204047a417 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:57.453579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd0d2b-7bc6-4b83-bb8c-96204047a417 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:57.458463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8181826-ce36-44d7-9aa3-0c565d5ff668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:57.459144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8181826-ce36-44d7-9aa3-0c565d5ff668 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:57.459429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8181826-ce36-44d7-9aa3-0c565d5ff668 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:57.459708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8181826-ce36-44d7-9aa3-0c565d5ff668 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:57.460392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8181826-ce36-44d7-9aa3-0c565d5ff668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:57.462449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8181826-ce36-44d7-9aa3-0c565d5ff668 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:57.468348 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 783/1575] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:07:57 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:07:57.468348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acc84f-9e8c-49bd-837b-9de69d42d844 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:57.477897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acc84f-9e8c-49bd-837b-9de69d42d844 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:57.482665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2f043-af98-4257-ac75-9a3a1f6e0c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:57.483359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2f043-af98-4257-ac75-9a3a1f6e0c17 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:57.483643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2f043-af98-4257-ac75-9a3a1f6e0c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:57.483923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2f043-af98-4257-ac75-9a3a1f6e0c17 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:57.484614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2f043-af98-4257-ac75-9a3a1f6e0c17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:57.487154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2f043-af98-4257-ac75-9a3a1f6e0c17 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:57.542238 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 793/1576] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:07:57 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:07:57.542238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8181826-ce36-44d7-9aa3-0c565d5ff668 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:57.568983 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 784/1577] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:07:57 2022] POST /identity/v3/projects => generated 399 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:07:57.570365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2f043-af98-4257-ac75-9a3a1f6e0c17 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:57.604847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:07:57.607650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8181826-ce36-44d7-9aa3-0c565d5ff668 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:57.635176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2f043-af98-4257-ac75-9a3a1f6e0c17 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:57.640182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b138c-0b2e-4dac-98c8-6756b25d9126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:57.640844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b138c-0b2e-4dac-98c8-6756b25d9126 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:57.641158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b138c-0b2e-4dac-98c8-6756b25d9126 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:57.641433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b138c-0b2e-4dac-98c8-6756b25d9126 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:57.642655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b138c-0b2e-4dac-98c8-6756b25d9126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:57.644598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b138c-0b2e-4dac-98c8-6756b25d9126 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:57.646259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:07:57.668370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467a858-e065-4e05-a32b-4173f8bd0c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:57.669026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467a858-e065-4e05-a32b-4173f8bd0c65 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:57.669312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467a858-e065-4e05-a32b-4173f8bd0c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:57.669582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467a858-e065-4e05-a32b-4173f8bd0c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:57.670265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467a858-e065-4e05-a32b-4173f8bd0c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:57.672206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467a858-e065-4e05-a32b-4173f8bd0c65 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:57.761465 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 785/1578] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:07:57 2022] POST /identity/v3/projects => generated 391 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:07:57.762202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b138c-0b2e-4dac-98c8-6756b25d9126 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:57.796369 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 794/1579] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:07:57 2022] POST /identity/v3/projects => generated 383 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:07:57.799343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467a858-e065-4e05-a32b-4173f8bd0c65 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:57.833345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b138c-0b2e-4dac-98c8-6756b25d9126 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:57.863690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467a858-e065-4e05-a32b-4173f8bd0c65 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:57.869331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fb1ff-2d61-4f5b-81f5-4349c8e7307a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:57.870020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fb1ff-2d61-4f5b-81f5-4349c8e7307a admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:57.870300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fb1ff-2d61-4f5b-81f5-4349c8e7307a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:57.870595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fb1ff-2d61-4f5b-81f5-4349c8e7307a admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:57.871356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fb1ff-2d61-4f5b-81f5-4349c8e7307a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:57.873274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fb1ff-2d61-4f5b-81f5-4349c8e7307a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:57.894350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d08c2e-e78d-48ab-af5d-f69913c56532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:57.895069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08c2e-e78d-48ab-af5d-f69913c56532 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:57.895356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08c2e-e78d-48ab-af5d-f69913c56532 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:57.895656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08c2e-e78d-48ab-af5d-f69913c56532 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:57.896380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d08c2e-e78d-48ab-af5d-f69913c56532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:57.898532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d08c2e-e78d-48ab-af5d-f69913c56532 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:58.094782 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 795/1580] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:07:57 2022] POST /identity/v3/projects => generated 381 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:07:58.096231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fb1ff-2d61-4f5b-81f5-4349c8e7307a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:58.110276 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 786/1581] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:07:57 2022] POST /identity/v3/users => generated 292 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:07:58.111398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d08c2e-e78d-48ab-af5d-f69913c56532 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:58.121137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d08c2e-e78d-48ab-af5d-f69913c56532 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:58.169586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fb1ff-2d61-4f5b-81f5-4349c8e7307a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:58.173369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:07:58.174556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace74ffb-24d1-4a7c-8329-69198714ec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:58.175259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace74ffb-24d1-4a7c-8329-69198714ec46 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:58.175544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace74ffb-24d1-4a7c-8329-69198714ec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:58.175821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace74ffb-24d1-4a7c-8329-69198714ec46 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:58.176578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace74ffb-24d1-4a7c-8329-69198714ec46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:58.178197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace74ffb-24d1-4a7c-8329-69198714ec46 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:58.182521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b5a40-9d0b-49ff-a9da-fb811d855b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:58.183218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b5a40-9d0b-49ff-a9da-fb811d855b86 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:58.192278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b5a40-9d0b-49ff-a9da-fb811d855b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:58.192278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b5a40-9d0b-49ff-a9da-fb811d855b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:58.192278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b5a40-9d0b-49ff-a9da-fb811d855b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:58.192278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b5a40-9d0b-49ff-a9da-fb811d855b86 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:58.192588 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 796/1582] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:07:58.192588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace74ffb-24d1-4a7c-8329-69198714ec46 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:58.196648 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 787/1583] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:07:58.197456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b5a40-9d0b-49ff-a9da-fb811d855b86 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:58.198657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace74ffb-24d1-4a7c-8329-69198714ec46 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:58.203484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56197339-e315-4ac8-92de-e543df094801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:58.204145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56197339-e315-4ac8-92de-e543df094801 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:58.205240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56197339-e315-4ac8-92de-e543df094801 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:58.205240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56197339-e315-4ac8-92de-e543df094801 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:58.206047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56197339-e315-4ac8-92de-e543df094801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:58.207983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b5a40-9d0b-49ff-a9da-fb811d855b86 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:58.208102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56197339-e315-4ac8-92de-e543df094801 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:58.212537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c30a39-03a9-410e-8290-487e3c917a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:58.213185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c30a39-03a9-410e-8290-487e3c917a86 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:58.213462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c30a39-03a9-410e-8290-487e3c917a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:58.213735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c30a39-03a9-410e-8290-487e3c917a86 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:58.214408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c30a39-03a9-410e-8290-487e3c917a86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:58.216337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c30a39-03a9-410e-8290-487e3c917a86 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:58.310837 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 797/1584] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:07:58 2022] POST /identity/v3/users => generated 295 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:07:58.311845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56197339-e315-4ac8-92de-e543df094801 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:58.322099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56197339-e315-4ac8-92de-e543df094801 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:58.326727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b40f5-ae53-4604-90cc-1d757fd3f8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:58.327408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b40f5-ae53-4604-90cc-1d757fd3f8a8 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:58.327684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b40f5-ae53-4604-90cc-1d757fd3f8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:58.327955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b40f5-ae53-4604-90cc-1d757fd3f8a8 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:58.328681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b40f5-ae53-4604-90cc-1d757fd3f8a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:58.331335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b40f5-ae53-4604-90cc-1d757fd3f8a8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:58.355721 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 788/1585] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:07:58 2022] POST /identity/v3/users => generated 300 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:07:58.355721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c30a39-03a9-410e-8290-487e3c917a86 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:58.356203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c30a39-03a9-410e-8290-487e3c917a86 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:58.361140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac96ffd-933c-48f5-88b8-ab60e9e68882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:58.361986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac96ffd-933c-48f5-88b8-ab60e9e68882 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:58.362273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac96ffd-933c-48f5-88b8-ab60e9e68882 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:58.362545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac96ffd-933c-48f5-88b8-ab60e9e68882 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:58.363280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac96ffd-933c-48f5-88b8-ab60e9e68882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:58.365364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac96ffd-933c-48f5-88b8-ab60e9e68882 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:58.424332 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 798/1586] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:07:58 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:07:58.425338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b40f5-ae53-4604-90cc-1d757fd3f8a8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:58.435262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b40f5-ae53-4604-90cc-1d757fd3f8a8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:58.440578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7ec02-efe0-4a49-bbf5-954f3dd228cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:58.441235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7ec02-efe0-4a49-bbf5-954f3dd228cd admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:58.441498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7ec02-efe0-4a49-bbf5-954f3dd228cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:58.441776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7ec02-efe0-4a49-bbf5-954f3dd228cd admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:58.442447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7ec02-efe0-4a49-bbf5-954f3dd228cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:58.444397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7ec02-efe0-4a49-bbf5-954f3dd228cd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:58.447801 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 789/1587] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:07:58 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:07:58.451068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac96ffd-933c-48f5-88b8-ab60e9e68882 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:58.457223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:07:58.459611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac96ffd-933c-48f5-88b8-ab60e9e68882 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:58.464276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede131a-b926-42bc-acf8-eb2b9ad9c85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:58.464931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede131a-b926-42bc-acf8-eb2b9ad9c85a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:58.465214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede131a-b926-42bc-acf8-eb2b9ad9c85a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:58.465490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede131a-b926-42bc-acf8-eb2b9ad9c85a admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:58.466205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede131a-b926-42bc-acf8-eb2b9ad9c85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:58.467837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede131a-b926-42bc-acf8-eb2b9ad9c85a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:58.478060 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 790/1588] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:07:58.479770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede131a-b926-42bc-acf8-eb2b9ad9c85a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:58.490648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede131a-b926-42bc-acf8-eb2b9ad9c85a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:58.495451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9406095-3378-402d-918a-d47609fdcee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:58.496092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9406095-3378-402d-918a-d47609fdcee4 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:58.496396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9406095-3378-402d-918a-d47609fdcee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:58.496711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9406095-3378-402d-918a-d47609fdcee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:58.497427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9406095-3378-402d-918a-d47609fdcee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:58.499003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9406095-3378-402d-918a-d47609fdcee4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:58.509697 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 791/1589] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:07:58.510518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9406095-3378-402d-918a-d47609fdcee4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:58.520671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9406095-3378-402d-918a-d47609fdcee4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:58.525367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a71e1-548e-4af9-8be7-b705aa1265b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:58.526023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a71e1-548e-4af9-8be7-b705aa1265b1 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:58.526302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a71e1-548e-4af9-8be7-b705aa1265b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:58.526567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a71e1-548e-4af9-8be7-b705aa1265b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:58.527294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a71e1-548e-4af9-8be7-b705aa1265b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:58.528846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a71e1-548e-4af9-8be7-b705aa1265b1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:58.539160 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 792/1590] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:07:58.539932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a71e1-548e-4af9-8be7-b705aa1265b1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:58.549234 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 799/1591] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:07:58 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:07:58.549687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a71e1-548e-4af9-8be7-b705aa1265b1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:58.550037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7ec02-efe0-4a49-bbf5-954f3dd228cd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:58.554910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c72d0-d63e-4ee8-825d-b89dde8c3354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:58.555619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c72d0-d63e-4ee8-825d-b89dde8c3354 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:58.555902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c72d0-d63e-4ee8-825d-b89dde8c3354 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:58.556182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c72d0-d63e-4ee8-825d-b89dde8c3354 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:58.556914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c72d0-d63e-4ee8-825d-b89dde8c3354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:58.558546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c72d0-d63e-4ee8-825d-b89dde8c3354 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:58.560281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7ec02-efe0-4a49-bbf5-954f3dd228cd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:58.565732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6cc36-5f8c-496b-a9cf-bb58ac50f917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:58.566390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6cc36-5f8c-496b-a9cf-bb58ac50f917 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:58.566668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6cc36-5f8c-496b-a9cf-bb58ac50f917 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:58.566941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6cc36-5f8c-496b-a9cf-bb58ac50f917 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:58.567705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6cc36-5f8c-496b-a9cf-bb58ac50f917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:58.569321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6cc36-5f8c-496b-a9cf-bb58ac50f917 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:58.573573 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 793/1592] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:07:58.574380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c72d0-d63e-4ee8-825d-b89dde8c3354 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:58.580993 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 800/1593] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:07:58.582446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6cc36-5f8c-496b-a9cf-bb58ac50f917 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:58.586390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c72d0-d63e-4ee8-825d-b89dde8c3354 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:58.591835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1192c-ed5d-4dc8-a0a6-c2ae22737a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:58.592560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1192c-ed5d-4dc8-a0a6-c2ae22737a46 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:58.592691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6cc36-5f8c-496b-a9cf-bb58ac50f917 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:58.592839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1192c-ed5d-4dc8-a0a6-c2ae22737a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:58.593134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1192c-ed5d-4dc8-a0a6-c2ae22737a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:58.593822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1192c-ed5d-4dc8-a0a6-c2ae22737a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:58.595797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1192c-ed5d-4dc8-a0a6-c2ae22737a46 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:58.597696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe13c1e-19ce-44d5-8d91-d9758eb3df98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:58.598375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe13c1e-19ce-44d5-8d91-d9758eb3df98 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:58.598664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe13c1e-19ce-44d5-8d91-d9758eb3df98 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:58.599031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe13c1e-19ce-44d5-8d91-d9758eb3df98 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:58.599694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe13c1e-19ce-44d5-8d91-d9758eb3df98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:58.601300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe13c1e-19ce-44d5-8d91-d9758eb3df98 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:58.607158 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 794/1594] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:07:58.607693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1192c-ed5d-4dc8-a0a6-c2ae22737a46 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:58.618775 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 801/1595] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:07:58.618775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe13c1e-19ce-44d5-8d91-d9758eb3df98 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:58.619408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1192c-ed5d-4dc8-a0a6-c2ae22737a46 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:58.622891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2070d7d-915e-4b0a-afeb-eed53164966b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:58.624692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2070d7d-915e-4b0a-afeb-eed53164966b admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:58.624974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2070d7d-915e-4b0a-afeb-eed53164966b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:58.625251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2070d7d-915e-4b0a-afeb-eed53164966b admin admin] PATH_INFO: `/v3/projects/b7caea2925c54539bbb1c6ca87d9f383/users/31d28b021c8e49d4b5c599686d098729/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:58.628570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe13c1e-19ce-44d5-8d91-d9758eb3df98 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:58.633905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d9797-0cf3-48d7-8414-e74a6d9fb986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:58.635151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d9797-0cf3-48d7-8414-e74a6d9fb986 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:58.635497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d9797-0cf3-48d7-8414-e74a6d9fb986 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:58.635837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d9797-0cf3-48d7-8414-e74a6d9fb986 admin admin] PATH_INFO: `/v3/projects/57887ca847c64efba6b864955e6ee14b/users/6f34858458b7434fa08eb5be6b0ce1cf/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:58.643528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2070d7d-915e-4b0a-afeb-eed53164966b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7caea2925c54539bbb1c6ca87d9f383, user_id=31d28b021c8e49d4b5c599686d098729, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:58.646246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2070d7d-915e-4b0a-afeb-eed53164966b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:58.653019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d9797-0cf3-48d7-8414-e74a6d9fb986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57887ca847c64efba6b864955e6ee14b, user_id=6f34858458b7434fa08eb5be6b0ce1cf, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:58.654067 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-271d9797-0cf3-48d7-8414-e74a6d9fb986 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:07:58.654067 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:07:58.654067 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:07:58.656109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d9797-0cf3-48d7-8414-e74a6d9fb986 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:58.744999 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 795/1596] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:07:58 2022] PUT /identity/v3/projects/b7caea2925c54539bbb1c6ca87d9f383/users/31d28b021c8e49d4b5c599686d098729/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:07:58.745925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2070d7d-915e-4b0a-afeb-eed53164966b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:58.762067 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 802/1597] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:07:58 2022] PUT /identity/v3/projects/57887ca847c64efba6b864955e6ee14b/users/6f34858458b7434fa08eb5be6b0ce1cf/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:07:58.774847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d9797-0cf3-48d7-8414-e74a6d9fb986 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:58.818454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2070d7d-915e-4b0a-afeb-eed53164966b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:58.844480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d9797-0cf3-48d7-8414-e74a6d9fb986 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:58.849707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f940d8-3104-4cd1-80a7-59331299c197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:58.850395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f940d8-3104-4cd1-80a7-59331299c197 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:58.850675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f940d8-3104-4cd1-80a7-59331299c197 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:58.850956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f940d8-3104-4cd1-80a7-59331299c197 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:58.851873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f940d8-3104-4cd1-80a7-59331299c197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:58.853520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f940d8-3104-4cd1-80a7-59331299c197 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:58.865974 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 803/1598] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:07:58.866903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f940d8-3104-4cd1-80a7-59331299c197 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:58.868927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:07:58.878243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f940d8-3104-4cd1-80a7-59331299c197 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:58.883143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346c883-542c-46de-8057-b254d6adf8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:58.884026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346c883-542c-46de-8057-b254d6adf8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:58.884311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346c883-542c-46de-8057-b254d6adf8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:58.884587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346c883-542c-46de-8057-b254d6adf8a0 admin admin] PATH_INFO: `/v3/projects/6ee2739c1c9c451f8136d38bd945ada8/users/b09a625f203b408bafa8d76043c61862/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:58.887801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92d5b7-381d-4df5-94b4-f53969918b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:58.888701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92d5b7-381d-4df5-94b4-f53969918b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:58.888983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92d5b7-381d-4df5-94b4-f53969918b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:58.889255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92d5b7-381d-4df5-94b4-f53969918b59 admin admin] PATH_INFO: `/v3/projects/563f88246ee64de4941bdc07b03fad2f/users/c15f5d7effb9454eaf0875411a16f53c/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:58.903587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346c883-542c-46de-8057-b254d6adf8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ee2739c1c9c451f8136d38bd945ada8, user_id=b09a625f203b408bafa8d76043c61862, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:58.904826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346c883-542c-46de-8057-b254d6adf8a0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:58.909589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92d5b7-381d-4df5-94b4-f53969918b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=563f88246ee64de4941bdc07b03fad2f, user_id=c15f5d7effb9454eaf0875411a16f53c, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:58.912379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92d5b7-381d-4df5-94b4-f53969918b59 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:59.002705 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 804/1599] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:07:58 2022] PUT /identity/v3/projects/6ee2739c1c9c451f8136d38bd945ada8/users/b09a625f203b408bafa8d76043c61862/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:07:59.003631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346c883-542c-46de-8057-b254d6adf8a0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:59.016940 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 796/1600] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:07:58 2022] PUT /identity/v3/projects/563f88246ee64de4941bdc07b03fad2f/users/c15f5d7effb9454eaf0875411a16f53c/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:07:59.019086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92d5b7-381d-4df5-94b4-f53969918b59 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:59.082861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346c883-542c-46de-8057-b254d6adf8a0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:59.089359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b88b37-a831-47ff-a581-8f2cac4e643c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:59.090043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b88b37-a831-47ff-a581-8f2cac4e643c admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:59.090326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b88b37-a831-47ff-a581-8f2cac4e643c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:59.090585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92d5b7-381d-4df5-94b4-f53969918b59 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:59.090724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b88b37-a831-47ff-a581-8f2cac4e643c admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:59.091344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b88b37-a831-47ff-a581-8f2cac4e643c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:59.092955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b88b37-a831-47ff-a581-8f2cac4e643c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:59.096675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392d250-840c-4813-914f-29e26a686b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:59.097370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392d250-840c-4813-914f-29e26a686b5a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:59.097654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392d250-840c-4813-914f-29e26a686b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:59.097930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392d250-840c-4813-914f-29e26a686b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:59.098698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392d250-840c-4813-914f-29e26a686b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:59.100362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392d250-840c-4813-914f-29e26a686b5a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:59.105277 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 805/1601] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:07:59.106522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b88b37-a831-47ff-a581-8f2cac4e643c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:59.115858 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 797/1602] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:07:59.117069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b88b37-a831-47ff-a581-8f2cac4e643c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:59.117148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392d250-840c-4813-914f-29e26a686b5a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:59.122942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcd87e-2c7e-4fd3-b9b5-cab77f470fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:59.123652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcd87e-2c7e-4fd3-b9b5-cab77f470fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:59.123931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcd87e-2c7e-4fd3-b9b5-cab77f470fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:59.124208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcd87e-2c7e-4fd3-b9b5-cab77f470fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:59.124935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcd87e-2c7e-4fd3-b9b5-cab77f470fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:59.126859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcd87e-2c7e-4fd3-b9b5-cab77f470fd6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:59.128300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392d250-840c-4813-914f-29e26a686b5a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:59.133082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4656af-aa1e-4609-80af-200e1cbe24dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:59.133754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4656af-aa1e-4609-80af-200e1cbe24dd admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:59.134034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4656af-aa1e-4609-80af-200e1cbe24dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:59.134314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4656af-aa1e-4609-80af-200e1cbe24dd admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:59.135065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4656af-aa1e-4609-80af-200e1cbe24dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:59.136750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4656af-aa1e-4609-80af-200e1cbe24dd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:59.144100 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 806/1603] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:07:59.144100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9944549-a637-4f45-90e5-bc4f01f975a3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:59.144100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9944549-a637-4f45-90e5-bc4f01f975a3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:59.144100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9944549-a637-4f45-90e5-bc4f01f975a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:59.146458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:07:59.155001 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 798/1604] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:07:59.155001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4656af-aa1e-4609-80af-200e1cbe24dd admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:59.163980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4656af-aa1e-4609-80af-200e1cbe24dd admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:59.172905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b9944549-a637-4f45-90e5-bc4f01f975a3 None None] MFA Rules not processed for user `6f34858458b7434fa08eb5be6b0ce1cf`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:07:59.173023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f391341-f69c-4f60-b044-a344e179df27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:59.173023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f391341-f69c-4f60-b044-a344e179df27 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:59.173884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b9944549-a637-4f45-90e5-bc4f01f975a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:07:59.173974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f391341-f69c-4f60-b044-a344e179df27 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:59.173974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f391341-f69c-4f60-b044-a344e179df27 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:59.173974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f391341-f69c-4f60-b044-a344e179df27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:59.173974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f391341-f69c-4f60-b044-a344e179df27 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:59.185208 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 799/1605] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:07:59.186112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f391341-f69c-4f60-b044-a344e179df27 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:59.197764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f391341-f69c-4f60-b044-a344e179df27 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:59.202628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288913e-e0ac-4451-9ba7-739402dac118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:59.203332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288913e-e0ac-4451-9ba7-739402dac118 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:59.203597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288913e-e0ac-4451-9ba7-739402dac118 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:59.203871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288913e-e0ac-4451-9ba7-739402dac118 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:59.205273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288913e-e0ac-4451-9ba7-739402dac118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:59.207082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288913e-e0ac-4451-9ba7-739402dac118 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:59.218867 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 800/1606] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:07:59.221246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d713c6-2e70-4dd7-88d5-4a1fec1e1de6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:59.221246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d713c6-2e70-4dd7-88d5-4a1fec1e1de6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:59.221513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d713c6-2e70-4dd7-88d5-4a1fec1e1de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:59.246964 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 807/1607] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:07:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:07:59.248012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9944549-a637-4f45-90e5-bc4f01f975a3 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:59.260151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9944549-a637-4f45-90e5-bc4f01f975a3 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:59.264113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-16d713c6-2e70-4dd7-88d5-4a1fec1e1de6 None None] MFA Rules not processed for user `c15f5d7effb9454eaf0875411a16f53c`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:07:59.265314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffa085-8d62-4028-9f6f-3cd0375e79e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:59.265510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-16d713c6-2e70-4dd7-88d5-4a1fec1e1de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:07:59.270433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffa085-8d62-4028-9f6f-3cd0375e79e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:59.270433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffa085-8d62-4028-9f6f-3cd0375e79e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:59.270433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffa085-8d62-4028-9f6f-3cd0375e79e8 admin admin] PATH_INFO: `/v3/projects/49044125b0414a4ab0e2ab9eb7d66e6e/users/35a4905d463a4db2960294407f747f20/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:59.287948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffa085-8d62-4028-9f6f-3cd0375e79e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49044125b0414a4ab0e2ab9eb7d66e6e, user_id=35a4905d463a4db2960294407f747f20, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:59.290896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffa085-8d62-4028-9f6f-3cd0375e79e8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:59.353082 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 801/1608] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:07:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:07:59.353979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d713c6-2e70-4dd7-88d5-4a1fec1e1de6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:59.369366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d713c6-2e70-4dd7-88d5-4a1fec1e1de6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:59.375480 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 808/1609] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:07:59 2022] PUT /identity/v3/projects/49044125b0414a4ab0e2ab9eb7d66e6e/users/35a4905d463a4db2960294407f747f20/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:07:59.377569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffa085-8d62-4028-9f6f-3cd0375e79e8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:59.388791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:07:59.448568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f17fdd-b1d5-499f-aad7-0f6f02a7383c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:59.449572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f17fdd-b1d5-499f-aad7-0f6f02a7383c admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:59.449916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f17fdd-b1d5-499f-aad7-0f6f02a7383c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:59.450253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f17fdd-b1d5-499f-aad7-0f6f02a7383c admin admin] PATH_INFO: `/v3/projects/b0b268e0b58f480e8c999c9f518f3bb4/users/c5b1414ed1244fa7aeecf3c6b77150c7/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:59.478140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f17fdd-b1d5-499f-aad7-0f6f02a7383c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b268e0b58f480e8c999c9f518f3bb4, user_id=c5b1414ed1244fa7aeecf3c6b77150c7, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:59.479803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffa085-8d62-4028-9f6f-3cd0375e79e8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:59.481077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f17fdd-b1d5-499f-aad7-0f6f02a7383c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:59.486763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc673a-a5bb-4dbc-a145-c72a69e25764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:59.487860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc673a-a5bb-4dbc-a145-c72a69e25764 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:59.488180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc673a-a5bb-4dbc-a145-c72a69e25764 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:59.488494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc673a-a5bb-4dbc-a145-c72a69e25764 admin admin] PATH_INFO: `/v3/projects/5e8b80f1c27f4ba5b636e8852ee1fe52/users/1bf0c339207d43538dcffce1aa9e2beb/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:59.510197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc673a-a5bb-4dbc-a145-c72a69e25764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e8b80f1c27f4ba5b636e8852ee1fe52, user_id=1bf0c339207d43538dcffce1aa9e2beb, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:59.512990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc673a-a5bb-4dbc-a145-c72a69e25764 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:59.562130 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 802/1610] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:07:59 2022] PUT /identity/v3/projects/b0b268e0b58f480e8c999c9f518f3bb4/users/c5b1414ed1244fa7aeecf3c6b77150c7/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:07:59.563338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f17fdd-b1d5-499f-aad7-0f6f02a7383c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:59.585225 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 809/1611] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:07:59 2022] PUT /identity/v3/projects/5e8b80f1c27f4ba5b636e8852ee1fe52/users/1bf0c339207d43538dcffce1aa9e2beb/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:07:59.586196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc673a-a5bb-4dbc-a145-c72a69e25764 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:59.635999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f17fdd-b1d5-499f-aad7-0f6f02a7383c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:59.655172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:07:59.669272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc673a-a5bb-4dbc-a145-c72a69e25764 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:59.675414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca33f48-e7e2-49ff-8fd7-d5dc9f1bd33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:59.676297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca33f48-e7e2-49ff-8fd7-d5dc9f1bd33c admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:59.676563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca33f48-e7e2-49ff-8fd7-d5dc9f1bd33c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:59.676838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca33f48-e7e2-49ff-8fd7-d5dc9f1bd33c admin admin] PATH_INFO: `/v3/projects/e7c343c974bd4ec0a6a765f818b895be/users/db6c21ea09c54ea492d806f42d2f69a7/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:59.695550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca33f48-e7e2-49ff-8fd7-d5dc9f1bd33c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c343c974bd4ec0a6a765f818b895be, user_id=db6c21ea09c54ea492d806f42d2f69a7, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:59.698391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca33f48-e7e2-49ff-8fd7-d5dc9f1bd33c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:59.707139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e2a58-3b2a-4f28-a56b-dddd6e5f1fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:59.708080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e2a58-3b2a-4f28-a56b-dddd6e5f1fea admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:59.708394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e2a58-3b2a-4f28-a56b-dddd6e5f1fea admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:59.708674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e2a58-3b2a-4f28-a56b-dddd6e5f1fea admin admin] PATH_INFO: `/v3/projects/b7caea2925c54539bbb1c6ca87d9f383/users/31d28b021c8e49d4b5c599686d098729/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:59.710709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e2a58-3b2a-4f28-a56b-dddd6e5f1fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7caea2925c54539bbb1c6ca87d9f383, user_id=31d28b021c8e49d4b5c599686d098729, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:59.713574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e2a58-3b2a-4f28-a56b-dddd6e5f1fea admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:59.728349 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 803/1612] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:07:59 2022] PUT /identity/v3/projects/b7caea2925c54539bbb1c6ca87d9f383/users/31d28b021c8e49d4b5c599686d098729/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:07:59.729186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e2a58-3b2a-4f28-a56b-dddd6e5f1fea admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:59.785914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:07:59.806634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e2a58-3b2a-4f28-a56b-dddd6e5f1fea admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:59.808016 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 810/1613] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:07:59 2022] PUT /identity/v3/projects/e7c343c974bd4ec0a6a765f818b895be/users/db6c21ea09c54ea492d806f42d2f69a7/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:07:59.808908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca33f48-e7e2-49ff-8fd7-d5dc9f1bd33c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:59.888965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749ad6b-0a4e-4f0f-aca4-db739b542fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:59.889958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749ad6b-0a4e-4f0f-aca4-db739b542fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:59.890236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749ad6b-0a4e-4f0f-aca4-db739b542fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:59.890506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749ad6b-0a4e-4f0f-aca4-db739b542fbc admin admin] PATH_INFO: `/v3/projects/6ee2739c1c9c451f8136d38bd945ada8/users/b09a625f203b408bafa8d76043c61862/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:59.893683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749ad6b-0a4e-4f0f-aca4-db739b542fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ee2739c1c9c451f8136d38bd945ada8, user_id=b09a625f203b408bafa8d76043c61862, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:59.895147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca33f48-e7e2-49ff-8fd7-d5dc9f1bd33c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:59.896482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749ad6b-0a4e-4f0f-aca4-db739b542fbc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:59.900653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f90a0-3629-4b86-87b7-c3e787fa0236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:59.901322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f90a0-3629-4b86-87b7-c3e787fa0236 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:59.901609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f90a0-3629-4b86-87b7-c3e787fa0236 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:59.901875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f90a0-3629-4b86-87b7-c3e787fa0236 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:59.902622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f90a0-3629-4b86-87b7-c3e787fa0236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:07:59.904933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f90a0-3629-4b86-87b7-c3e787fa0236 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:07:59.909017 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 804/1614] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:07:59 2022] PUT /identity/v3/projects/6ee2739c1c9c451f8136d38bd945ada8/users/b09a625f203b408bafa8d76043c61862/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:07:59.909925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749ad6b-0a4e-4f0f-aca4-db739b542fbc admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:07:59.980804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749ad6b-0a4e-4f0f-aca4-db739b542fbc admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:07:59.984638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e15cac-fc12-404d-af8b-28b4ac7195a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:07:59.985330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e15cac-fc12-404d-af8b-28b4ac7195a0 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:59.985755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e15cac-fc12-404d-af8b-28b4ac7195a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:59.986198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e15cac-fc12-404d-af8b-28b4ac7195a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:07:59.997571 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 811/1615] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:07:59 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:07:59.998883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd9f52-04bc-461e-98c7-537d0ca66a5a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:07:59.999331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd9f52-04bc-461e-98c7-537d0ca66a5a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:07:59.999659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd9f52-04bc-461e-98c7-537d0ca66a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:00.030518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-cffd9f52-04bc-461e-98c7-537d0ca66a5a None None] MFA Rules not processed for user `35a4905d463a4db2960294407f747f20`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:00.031772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cffd9f52-04bc-461e-98c7-537d0ca66a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:00.054822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e15cac-fc12-404d-af8b-28b4ac7195a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:00.056301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e15cac-fc12-404d-af8b-28b4ac7195a0 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:00.067254 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 805/1616] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:07:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:00.068672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f538f-327c-4c4e-bb1d-4ec3baad9906 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:00.068873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f538f-327c-4c4e-bb1d-4ec3baad9906 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:00.069150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f538f-327c-4c4e-bb1d-4ec3baad9906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:00.099727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9a3f538f-327c-4c4e-bb1d-4ec3baad9906 None None] MFA Rules not processed for user `c5b1414ed1244fa7aeecf3c6b77150c7`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:00.100940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9a3f538f-327c-4c4e-bb1d-4ec3baad9906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:00.118705 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 812/1617] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:07:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:00.120260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d9737-3399-4bbe-a5c4-f989ae758226 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:00.120659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d9737-3399-4bbe-a5c4-f989ae758226 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:00.120959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d9737-3399-4bbe-a5c4-f989ae758226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:00.141419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:00.156042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-cd5d9737-3399-4bbe-a5c4-f989ae758226 None None] MFA Rules not processed for user `1bf0c339207d43538dcffce1aa9e2beb`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:00.158294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cd5d9737-3399-4bbe-a5c4-f989ae758226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:00.204981 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 806/1618] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:00.207163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a50c4-a5b9-4a3e-b1b3-8cb59565adf3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:00.207602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a50c4-a5b9-4a3e-b1b3-8cb59565adf3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:00.208369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a50c4-a5b9-4a3e-b1b3-8cb59565adf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:00.214549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:00.237792 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 813/1619] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:00.239348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2709d14-0f75-4484-99a5-b2273f74ebc1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:00.239626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2709d14-0f75-4484-99a5-b2273f74ebc1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:00.242943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-791a50c4-a5b9-4a3e-b1b3-8cb59565adf3 None None] MFA Rules not processed for user `31d28b021c8e49d4b5c599686d098729`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:00.243675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2709d14-0f75-4484-99a5-b2273f74ebc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:00.244458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-791a50c4-a5b9-4a3e-b1b3-8cb59565adf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:00.278163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d2709d14-0f75-4484-99a5-b2273f74ebc1 None None] MFA Rules not processed for user `db6c21ea09c54ea492d806f42d2f69a7`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:00.279528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d2709d14-0f75-4484-99a5-b2273f74ebc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:00.342543 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 807/1620] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:00.344095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329a633-3834-42c3-aa81-0cd6f78a96f5 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:00.344491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329a633-3834-42c3-aa81-0cd6f78a96f5 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:00.346204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329a633-3834-42c3-aa81-0cd6f78a96f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:00.366401 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 814/1621] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:00.372368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2709d14-0f75-4484-99a5-b2273f74ebc1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:00.382682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6329a633-3834-42c3-aa81-0cd6f78a96f5 None None] MFA Rules not processed for user `b09a625f203b408bafa8d76043c61862`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:00.384620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6329a633-3834-42c3-aa81-0cd6f78a96f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:00.455909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2709d14-0f75-4484-99a5-b2273f74ebc1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:00.461542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faad06-b229-4e5a-82cc-5474a9893fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:00.462251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faad06-b229-4e5a-82cc-5474a9893fcf admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:00.462679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faad06-b229-4e5a-82cc-5474a9893fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:00.462957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faad06-b229-4e5a-82cc-5474a9893fcf admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:00.463703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1faad06-b229-4e5a-82cc-5474a9893fcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:00.465600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1faad06-b229-4e5a-82cc-5474a9893fcf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:00.465992 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 808/1622] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:00.466833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329a633-3834-42c3-aa81-0cd6f78a96f5 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:00.478155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329a633-3834-42c3-aa81-0cd6f78a96f5 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:00.483452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc2a27-9185-40de-872d-6b39316cfcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:00.483969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc2a27-9185-40de-872d-6b39316cfcf0 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:00.484255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc2a27-9185-40de-872d-6b39316cfcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:00.484533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc2a27-9185-40de-872d-6b39316cfcf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:00.485536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc2a27-9185-40de-872d-6b39316cfcf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:00.487578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc2a27-9185-40de-872d-6b39316cfcf0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:00.585524 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 815/1623] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:00 2022] POST /identity/v3/users => generated 296 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:00.586557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faad06-b229-4e5a-82cc-5474a9893fcf admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:00.598099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faad06-b229-4e5a-82cc-5474a9893fcf admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:00.602832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146a148-363b-46ca-8358-55220d0ff3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:00.603674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146a148-363b-46ca-8358-55220d0ff3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:00.603959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146a148-363b-46ca-8358-55220d0ff3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:00.604230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146a148-363b-46ca-8358-55220d0ff3c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:00.604914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146a148-363b-46ca-8358-55220d0ff3c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:00.606926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146a148-363b-46ca-8358-55220d0ff3c1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:00.620261 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 809/1624] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:00 2022] POST /identity/v3/projects => generated 397 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:00.621379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc2a27-9185-40de-872d-6b39316cfcf0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:00.641380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:00.686516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc2a27-9185-40de-872d-6b39316cfcf0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:00.692783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e5806-4c02-4744-b95a-a3cc2f1b298f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:00.693460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e5806-4c02-4744-b95a-a3cc2f1b298f admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:00.693743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e5806-4c02-4744-b95a-a3cc2f1b298f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:00.694020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e5806-4c02-4744-b95a-a3cc2f1b298f admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:00.694710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e5806-4c02-4744-b95a-a3cc2f1b298f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:00.696698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e5806-4c02-4744-b95a-a3cc2f1b298f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:00.712114 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 816/1625] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:00 2022] POST /identity/v3/projects => generated 391 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:00.714010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b89f2-fc4c-4206-9bf6-1a3f60dcb8b0 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:00.720590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b89f2-fc4c-4206-9bf6-1a3f60dcb8b0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:00.720590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b89f2-fc4c-4206-9bf6-1a3f60dcb8b0 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:00.720590 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 817/1626] 10.222.0.16 () {54 vars in 962 bytes} [Sat Jul 16 21:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:08:00.720590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b89f2-fc4c-4206-9bf6-1a3f60dcb8b0 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:00.759889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:00.785270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b89f2-fc4c-4206-9bf6-1a3f60dcb8b0 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:00.789966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068217d8-98ef-4b31-869a-eafe54a858c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:00.790623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068217d8-98ef-4b31-869a-eafe54a858c0 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:00.790900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068217d8-98ef-4b31-869a-eafe54a858c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:00.791204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068217d8-98ef-4b31-869a-eafe54a858c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:00.791889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068217d8-98ef-4b31-869a-eafe54a858c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:00.793843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068217d8-98ef-4b31-869a-eafe54a858c0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:00.802942 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 810/1627] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:00 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:00.804034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e5806-4c02-4744-b95a-a3cc2f1b298f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:00.872099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e5806-4c02-4744-b95a-a3cc2f1b298f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:00.878340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f342b2-a262-4e30-8d9d-90a2c61b95a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:00.879284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f342b2-a262-4e30-8d9d-90a2c61b95a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:00.879567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f342b2-a262-4e30-8d9d-90a2c61b95a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:00.879846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f342b2-a262-4e30-8d9d-90a2c61b95a3 admin admin] PATH_INFO: `/v3/users/c15f5d7effb9454eaf0875411a16f53c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:00.881069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f342b2-a262-4e30-8d9d-90a2c61b95a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c15f5d7effb9454eaf0875411a16f53c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:00.883113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f342b2-a262-4e30-8d9d-90a2c61b95a3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:00.905634 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 818/1628] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:00 2022] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:00.907258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0ec62-85ea-4528-bb15-8204c0e8d1cd None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:00.907669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0ec62-85ea-4528-bb15-8204c0e8d1cd None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:00.908022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0ec62-85ea-4528-bb15-8204c0e8d1cd None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:00.909732 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 819/1629] 10.222.0.16 () {54 vars in 962 bytes} [Sat Jul 16 21:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:08:00.914774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0ec62-85ea-4528-bb15-8204c0e8d1cd None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:00.984066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0ec62-85ea-4528-bb15-8204c0e8d1cd None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:00.989330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97d41a-b19d-40cf-b326-1d7231c1d1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:00.990078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97d41a-b19d-40cf-b326-1d7231c1d1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:00.990272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97d41a-b19d-40cf-b326-1d7231c1d1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:00.990543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97d41a-b19d-40cf-b326-1d7231c1d1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:00.991347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97d41a-b19d-40cf-b326-1d7231c1d1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:00.996450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97d41a-b19d-40cf-b326-1d7231c1d1d1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:01.004685 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 820/1630] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:01.005534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97d41a-b19d-40cf-b326-1d7231c1d1d1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:01.016000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97d41a-b19d-40cf-b326-1d7231c1d1d1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:01.021944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b002fe-64e0-445f-995b-9b0c07f6d1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:01.023002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b002fe-64e0-445f-995b-9b0c07f6d1fe admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:01.023358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b002fe-64e0-445f-995b-9b0c07f6d1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:01.023667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b002fe-64e0-445f-995b-9b0c07f6d1fe admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:01.025106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b002fe-64e0-445f-995b-9b0c07f6d1fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:01.026415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b002fe-64e0-445f-995b-9b0c07f6d1fe admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:01.057533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e7f342b2-a262-4e30-8d9d-90a2c61b95a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c15f5d7effb9454eaf0875411a16f53c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:01.071381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e7f342b2-a262-4e30-8d9d-90a2c61b95a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c15f5d7effb9454eaf0875411a16f53c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:01.134643 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 821/1631] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:01 2022] POST /identity/v3/users => generated 305 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:01.135673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b002fe-64e0-445f-995b-9b0c07f6d1fe admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:01.146910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b002fe-64e0-445f-995b-9b0c07f6d1fe admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:01.149628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e7f342b2-a262-4e30-8d9d-90a2c61b95a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c15f5d7effb9454eaf0875411a16f53c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:01.152896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acefe31-d082-4901-9425-02050a7388d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:01.153582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acefe31-d082-4901-9425-02050a7388d1 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:01.154052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acefe31-d082-4901-9425-02050a7388d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:01.154232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acefe31-d082-4901-9425-02050a7388d1 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:01.154838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acefe31-d082-4901-9425-02050a7388d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:01.156880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acefe31-d082-4901-9425-02050a7388d1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:01.159806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e7f342b2-a262-4e30-8d9d-90a2c61b95a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c15f5d7effb9454eaf0875411a16f53c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:01.163039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e7f342b2-a262-4e30-8d9d-90a2c61b95a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c15f5d7effb9454eaf0875411a16f53c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:01.168730 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 811/1632] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:00 2022] DELETE /identity/v3/users/c15f5d7effb9454eaf0875411a16f53c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:01.170130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410052b1-40e5-48e3-baad-b20285862b45 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:01.170486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410052b1-40e5-48e3-baad-b20285862b45 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:01.170769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410052b1-40e5-48e3-baad-b20285862b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:01.228009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:01.233356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-410052b1-40e5-48e3-baad-b20285862b45 None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:01.236110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-410052b1-40e5-48e3-baad-b20285862b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:01.248648 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 822/1633] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:01 2022] POST /identity/v3/users => generated 302 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:01.249770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acefe31-d082-4901-9425-02050a7388d1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:01.253842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3acefe31-d082-4901-9425-02050a7388d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:01.267545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acefe31-d082-4901-9425-02050a7388d1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:01.326829 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 812/1634] 10.222.0.16 () {58 vars in 1059 bytes} [Sat Jul 16 21:08:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:01.327866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410052b1-40e5-48e3-baad-b20285862b45 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:01.329756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-410052b1-40e5-48e3-baad-b20285862b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:01.333344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709d5d8-2034-4aa6-92d9-30732ed49b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:01.334018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709d5d8-2034-4aa6-92d9-30732ed49b76 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:01.334295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709d5d8-2034-4aa6-92d9-30732ed49b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:01.334571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709d5d8-2034-4aa6-92d9-30732ed49b76 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:01.335355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709d5d8-2034-4aa6-92d9-30732ed49b76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:01.337285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709d5d8-2034-4aa6-92d9-30732ed49b76 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:01.342975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410052b1-40e5-48e3-baad-b20285862b45 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:01.349011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d9c3a-e6dd-4a28-9301-2ac6da67070b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:01.349691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d9c3a-e6dd-4a28-9301-2ac6da67070b admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:01.349974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d9c3a-e6dd-4a28-9301-2ac6da67070b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:01.350245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d9c3a-e6dd-4a28-9301-2ac6da67070b admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:01.350932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d9c3a-e6dd-4a28-9301-2ac6da67070b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:01.353011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d9c3a-e6dd-4a28-9301-2ac6da67070b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:01.482318 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 823/1635] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:01 2022] POST /identity/v3/users => generated 297 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:01.483696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8719f-e83b-4f28-a8b7-6e645fdb0c1f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:01.483985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8719f-e83b-4f28-a8b7-6e645fdb0c1f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:01.484264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8719f-e83b-4f28-a8b7-6e645fdb0c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:01.504363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2dd8719f-e83b-4f28-a8b7-6e645fdb0c1f None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:01.505541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2dd8719f-e83b-4f28-a8b7-6e645fdb0c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:01.517026 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 824/1636] 10.222.0.16 () {58 vars in 1059 bytes} [Sat Jul 16 21:08:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:01.517917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8719f-e83b-4f28-a8b7-6e645fdb0c1f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:01.518338 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 813/1637] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:01 2022] POST /identity/v3/users => generated 298 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:01.519611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d9c3a-e6dd-4a28-9301-2ac6da67070b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:01.522689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2dd8719f-e83b-4f28-a8b7-6e645fdb0c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:01.522834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-332d9c3a-e6dd-4a28-9301-2ac6da67070b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:01.537591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8719f-e83b-4f28-a8b7-6e645fdb0c1f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:01.543145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3615e08-12e8-4a80-825b-54b7dee67bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:01.544063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3615e08-12e8-4a80-825b-54b7dee67bb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:01.544347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3615e08-12e8-4a80-825b-54b7dee67bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:01.549140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3615e08-12e8-4a80-825b-54b7dee67bb8 admin admin] PATH_INFO: `/v3/projects/6907a091f6a844a3afc38f380ea3ca57/users/893a178daa70493bb9055554d94dce96/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:01.549789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d9c3a-e6dd-4a28-9301-2ac6da67070b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:01.549942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:01.554142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc908d30-e9c7-4301-95c4-044f0b92aaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:01.555375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc908d30-e9c7-4301-95c4-044f0b92aaa9 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:01.555758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc908d30-e9c7-4301-95c4-044f0b92aaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:01.556126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc908d30-e9c7-4301-95c4-044f0b92aaa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:01.557571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc908d30-e9c7-4301-95c4-044f0b92aaa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:01.560765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc908d30-e9c7-4301-95c4-044f0b92aaa9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:01.563928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3615e08-12e8-4a80-825b-54b7dee67bb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6907a091f6a844a3afc38f380ea3ca57, user_id=893a178daa70493bb9055554d94dce96, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:01.567083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3615e08-12e8-4a80-825b-54b7dee67bb8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:01.573683 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 814/1638] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:01.575041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5d1d4-dd42-4053-ba19-79fb2160ca00 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:01.575320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5d1d4-dd42-4053-ba19-79fb2160ca00 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:01.575592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5d1d4-dd42-4053-ba19-79fb2160ca00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:01.596980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-eec5d1d4-dd42-4053-ba19-79fb2160ca00 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:01.602567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-eec5d1d4-dd42-4053-ba19-79fb2160ca00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:01.605991 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 815/1639] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:01.606825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5d1d4-dd42-4053-ba19-79fb2160ca00 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:01.608135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-eec5d1d4-dd42-4053-ba19-79fb2160ca00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:01.621106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5d1d4-dd42-4053-ba19-79fb2160ca00 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:01.625721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578da95a-4019-4ec3-99c3-27fc21d5afc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:01.627116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578da95a-4019-4ec3-99c3-27fc21d5afc8 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:01.627116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578da95a-4019-4ec3-99c3-27fc21d5afc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:01.627429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578da95a-4019-4ec3-99c3-27fc21d5afc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:01.628155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578da95a-4019-4ec3-99c3-27fc21d5afc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:01.629768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578da95a-4019-4ec3-99c3-27fc21d5afc8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:01.640503 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 816/1640] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:01.641386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578da95a-4019-4ec3-99c3-27fc21d5afc8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:01.656538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578da95a-4019-4ec3-99c3-27fc21d5afc8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:01.663923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab95b0-db3f-485b-b1d5-032385e96749 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:01.664590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab95b0-db3f-485b-b1d5-032385e96749 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:01.664869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab95b0-db3f-485b-b1d5-032385e96749 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:01.665137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab95b0-db3f-485b-b1d5-032385e96749 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:01.667159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8eab95b0-db3f-485b-b1d5-032385e96749 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:01.670624 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 825/1641] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:01 2022] PUT /identity/v3/projects/6907a091f6a844a3afc38f380ea3ca57/users/893a178daa70493bb9055554d94dce96/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:01.671507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3615e08-12e8-4a80-825b-54b7dee67bb8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:01.744444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab95b0-db3f-485b-b1d5-032385e96749 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:01.746117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab95b0-db3f-485b-b1d5-032385e96749 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:01.753027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3615e08-12e8-4a80-825b-54b7dee67bb8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:01.757565 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 817/1642] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:01.758419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54eecd-bb57-4679-9af6-89639e1fef38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:01.758636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab95b0-db3f-485b-b1d5-032385e96749 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:01.759143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54eecd-bb57-4679-9af6-89639e1fef38 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:01.759441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54eecd-bb57-4679-9af6-89639e1fef38 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:01.759722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54eecd-bb57-4679-9af6-89639e1fef38 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:01.760463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54eecd-bb57-4679-9af6-89639e1fef38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:01.762102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54eecd-bb57-4679-9af6-89639e1fef38 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:01.772033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab95b0-db3f-485b-b1d5-032385e96749 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:01.774272 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 826/1643] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:01.775425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54eecd-bb57-4679-9af6-89639e1fef38 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:01.783918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240c119-a818-4879-8fa1-94db08e901a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:01.785674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240c119-a818-4879-8fa1-94db08e901a8 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:01.786298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240c119-a818-4879-8fa1-94db08e901a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:01.786841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240c119-a818-4879-8fa1-94db08e901a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:01.787763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240c119-a818-4879-8fa1-94db08e901a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:01.790744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240c119-a818-4879-8fa1-94db08e901a8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:01.805378 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 818/1644] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:01.806505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240c119-a818-4879-8fa1-94db08e901a8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:01.822729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240c119-a818-4879-8fa1-94db08e901a8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:01.827944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84d1bc-e71e-4c2a-90d3-cf46b3d703a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:01.828850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84d1bc-e71e-4c2a-90d3-cf46b3d703a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:01.829989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84d1bc-e71e-4c2a-90d3-cf46b3d703a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:01.830419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84d1bc-e71e-4c2a-90d3-cf46b3d703a8 admin admin] PATH_INFO: `/v3/projects/b6be58dcb13b4cec8f0bfc58f0080173/users/cadb63bb5d6b4d7597987780f7d9ef21/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:01.849461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84d1bc-e71e-4c2a-90d3-cf46b3d703a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6be58dcb13b4cec8f0bfc58f0080173, user_id=cadb63bb5d6b4d7597987780f7d9ef21, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:01.852397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84d1bc-e71e-4c2a-90d3-cf46b3d703a8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:01.889099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54eecd-bb57-4679-9af6-89639e1fef38 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:01.896113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e177c0-7a7b-49d2-96a9-215f4a134a6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:01.896916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e177c0-7a7b-49d2-96a9-215f4a134a6c service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:01.897192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e177c0-7a7b-49d2-96a9-215f4a134a6c service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:01.897731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e177c0-7a7b-49d2-96a9-215f4a134a6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:01.899626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-06e177c0-7a7b-49d2-96a9-215f4a134a6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:01.939088 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 819/1645] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:01 2022] PUT /identity/v3/projects/b6be58dcb13b4cec8f0bfc58f0080173/users/cadb63bb5d6b4d7597987780f7d9ef21/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:01.940732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84d1bc-e71e-4c2a-90d3-cf46b3d703a8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:01.943088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3c84d1bc-e71e-4c2a-90d3-cf46b3d703a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:01.960119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:01.978988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e177c0-7a7b-49d2-96a9-215f4a134a6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:01.981134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e177c0-7a7b-49d2-96a9-215f4a134a6c service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:01.993298 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 827/1646] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:01.994229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e177c0-7a7b-49d2-96a9-215f4a134a6c service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:02.008436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e177c0-7a7b-49d2-96a9-215f4a134a6c service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:02.013850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84d1bc-e71e-4c2a-90d3-cf46b3d703a8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:02.020450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:02.024402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f45b7-c5b0-4cd8-b51b-9895b30c50f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:02.026078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f45b7-c5b0-4cd8-b51b-9895b30c50f4 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:02.026595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f45b7-c5b0-4cd8-b51b-9895b30c50f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:02.027106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f45b7-c5b0-4cd8-b51b-9895b30c50f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:02.119793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e52665-937a-475b-b7b9-af698260c779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:02.121344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e52665-937a-475b-b7b9-af698260c779 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:02.121770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f45b7-c5b0-4cd8-b51b-9895b30c50f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:02.121884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e52665-937a-475b-b7b9-af698260c779 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:02.122359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e52665-937a-475b-b7b9-af698260c779 admin admin] PATH_INFO: `/v3/projects/30df0b9ba27347a4b290a119c7fad4df/users/965b7cf10d9b4da2bca5aa0f4782357a/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:02.123256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f45b7-c5b0-4cd8-b51b-9895b30c50f4 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:02.136738 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 820/1647] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:02.137424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f45b7-c5b0-4cd8-b51b-9895b30c50f4 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:02.150315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f45b7-c5b0-4cd8-b51b-9895b30c50f4 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:02.152346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e52665-937a-475b-b7b9-af698260c779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30df0b9ba27347a4b290a119c7fad4df, user_id=965b7cf10d9b4da2bca5aa0f4782357a, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:02.155977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8fe5d-9182-44b9-a60c-07c4a43ec999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:02.156650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8fe5d-9182-44b9-a60c-07c4a43ec999 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:02.156928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8fe5d-9182-44b9-a60c-07c4a43ec999 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:02.157200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8fe5d-9182-44b9-a60c-07c4a43ec999 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:02.158232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e52665-937a-475b-b7b9-af698260c779 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:02.159664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8fe5d-9182-44b9-a60c-07c4a43ec999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:02.161482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8fe5d-9182-44b9-a60c-07c4a43ec999 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:02.173930 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 821/1648] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:02.175090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8fe5d-9182-44b9-a60c-07c4a43ec999 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:02.186858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8fe5d-9182-44b9-a60c-07c4a43ec999 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:02.193196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886767f-aaf8-4c8a-a507-4d23cdee5c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:02.194148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886767f-aaf8-4c8a-a507-4d23cdee5c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:02.194426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886767f-aaf8-4c8a-a507-4d23cdee5c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:02.194696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886767f-aaf8-4c8a-a507-4d23cdee5c0e admin admin] PATH_INFO: `/v3/projects/93ef716961464e6ca518f2cab3bf1fda/users/1c143f95261f496d9a43f3f89c686719/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:02.213675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886767f-aaf8-4c8a-a507-4d23cdee5c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=93ef716961464e6ca518f2cab3bf1fda, user_id=1c143f95261f496d9a43f3f89c686719, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:02.217014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886767f-aaf8-4c8a-a507-4d23cdee5c0e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:02.239141 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 828/1649] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:01 2022] PUT /identity/v3/projects/30df0b9ba27347a4b290a119c7fad4df/users/965b7cf10d9b4da2bca5aa0f4782357a/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:02.243209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e52665-937a-475b-b7b9-af698260c779 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:02.309474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e52665-937a-475b-b7b9-af698260c779 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:02.316364 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 822/1650] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:02 2022] PUT /identity/v3/projects/93ef716961464e6ca518f2cab3bf1fda/users/1c143f95261f496d9a43f3f89c686719/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:02.317291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886767f-aaf8-4c8a-a507-4d23cdee5c0e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:02.395629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145d8d1-30b2-4267-8a86-41fb2c8d07fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:02.396502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145d8d1-30b2-4267-8a86-41fb2c8d07fc admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:02.396786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145d8d1-30b2-4267-8a86-41fb2c8d07fc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:02.397051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145d8d1-30b2-4267-8a86-41fb2c8d07fc admin admin] PATH_INFO: `/v3/projects/09da0450b1464083990b4b3566862cd6/users/ceb1a15568df445abebf4220c6894ca9/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:02.411477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886767f-aaf8-4c8a-a507-4d23cdee5c0e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:02.416414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5eb857-9a8b-429f-a0e8-927ff0023068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:02.417105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eb857-9a8b-429f-a0e8-927ff0023068 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:02.417545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eb857-9a8b-429f-a0e8-927ff0023068 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:02.418157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eb857-9a8b-429f-a0e8-927ff0023068 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:02.418757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5eb857-9a8b-429f-a0e8-927ff0023068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:02.420413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5eb857-9a8b-429f-a0e8-927ff0023068 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:02.428565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145d8d1-30b2-4267-8a86-41fb2c8d07fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=09da0450b1464083990b4b3566862cd6, user_id=ceb1a15568df445abebf4220c6894ca9, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:02.431642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145d8d1-30b2-4267-8a86-41fb2c8d07fc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:02.435189 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 823/1651] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:02.436508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5eb857-9a8b-429f-a0e8-927ff0023068 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:02.438793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-eb5eb857-9a8b-429f-a0e8-927ff0023068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:02.451688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5eb857-9a8b-429f-a0e8-927ff0023068 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:02.457346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c9a42-d9e1-4bcd-8e5f-fe405826539f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:02.458221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c9a42-d9e1-4bcd-8e5f-fe405826539f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:02.458496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c9a42-d9e1-4bcd-8e5f-fe405826539f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:02.458772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c9a42-d9e1-4bcd-8e5f-fe405826539f admin admin] PATH_INFO: `/v3/users/6ebf41e0763e41c9a2483a2088c0c50a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:02.459995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c9a42-d9e1-4bcd-8e5f-fe405826539f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ebf41e0763e41c9a2483a2088c0c50a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:02.461912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c9a42-d9e1-4bcd-8e5f-fe405826539f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:02.480060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:02.540274 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 829/1652] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:02 2022] PUT /identity/v3/projects/09da0450b1464083990b4b3566862cd6/users/ceb1a15568df445abebf4220c6894ca9/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:02.541505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145d8d1-30b2-4267-8a86-41fb2c8d07fc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:02.570753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:02.607275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145d8d1-30b2-4267-8a86-41fb2c8d07fc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:02.612642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eebb8c-dcd3-4341-b101-2ddb56a47732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:02.613534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eebb8c-dcd3-4341-b101-2ddb56a47732 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:02.613817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eebb8c-dcd3-4341-b101-2ddb56a47732 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:02.614091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eebb8c-dcd3-4341-b101-2ddb56a47732 admin admin] PATH_INFO: `/v3/projects/6907a091f6a844a3afc38f380ea3ca57/users/893a178daa70493bb9055554d94dce96/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:02.616196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eebb8c-dcd3-4341-b101-2ddb56a47732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6907a091f6a844a3afc38f380ea3ca57, user_id=893a178daa70493bb9055554d94dce96, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:02.619002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eebb8c-dcd3-4341-b101-2ddb56a47732 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:02.630315 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 830/1653] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:02 2022] PUT /identity/v3/projects/6907a091f6a844a3afc38f380ea3ca57/users/893a178daa70493bb9055554d94dce96/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:02.631492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eebb8c-dcd3-4341-b101-2ddb56a47732 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:02.682072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ae6c9a42-d9e1-4bcd-8e5f-fe405826539f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ebf41e0763e41c9a2483a2088c0c50a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:02.707379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ae6c9a42-d9e1-4bcd-8e5f-fe405826539f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ebf41e0763e41c9a2483a2088c0c50a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:02.719032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eebb8c-dcd3-4341-b101-2ddb56a47732 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:02.724580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e61f91-7b3e-4e76-a181-af2707f153d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:02.725261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e61f91-7b3e-4e76-a181-af2707f153d8 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:02.725845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e61f91-7b3e-4e76-a181-af2707f153d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:02.726324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e61f91-7b3e-4e76-a181-af2707f153d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:02.727588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e61f91-7b3e-4e76-a181-af2707f153d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:02.730076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e61f91-7b3e-4e76-a181-af2707f153d8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:02.739847 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 831/1654] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:02.740859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e61f91-7b3e-4e76-a181-af2707f153d8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:02.750973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e61f91-7b3e-4e76-a181-af2707f153d8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:02.756163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fedf1b-ebc3-4a71-94e7-6883ef6c2101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:02.759628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fedf1b-ebc3-4a71-94e7-6883ef6c2101 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:02.759628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fedf1b-ebc3-4a71-94e7-6883ef6c2101 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:02.759628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fedf1b-ebc3-4a71-94e7-6883ef6c2101 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:02.759628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fedf1b-ebc3-4a71-94e7-6883ef6c2101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:02.759934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fedf1b-ebc3-4a71-94e7-6883ef6c2101 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:02.771806 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 832/1655] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:02.773365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9790d7-d41d-4250-82e8-984f014f3f75 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:02.773653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9790d7-d41d-4250-82e8-984f014f3f75 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:02.773930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9790d7-d41d-4250-82e8-984f014f3f75 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:02.775350 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 833/1656] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:08:02.776099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9790d7-d41d-4250-82e8-984f014f3f75 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:02.789662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9790d7-d41d-4250-82e8-984f014f3f75 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:02.794202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c80e0-72b8-4250-8e73-f83cac82a72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:02.795108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c80e0-72b8-4250-8e73-f83cac82a72d admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:02.795394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c80e0-72b8-4250-8e73-f83cac82a72d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:02.795666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c80e0-72b8-4250-8e73-f83cac82a72d admin admin] PATH_INFO: `/v3/projects/b6be58dcb13b4cec8f0bfc58f0080173/users/cadb63bb5d6b4d7597987780f7d9ef21/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:02.797650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c80e0-72b8-4250-8e73-f83cac82a72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6be58dcb13b4cec8f0bfc58f0080173, user_id=cadb63bb5d6b4d7597987780f7d9ef21, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:02.800953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c80e0-72b8-4250-8e73-f83cac82a72d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:02.816898 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 834/1657] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:02 2022] PUT /identity/v3/projects/b6be58dcb13b4cec8f0bfc58f0080173/users/cadb63bb5d6b4d7597987780f7d9ef21/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:02.818083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c80e0-72b8-4250-8e73-f83cac82a72d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:02.840147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ae6c9a42-d9e1-4bcd-8e5f-fe405826539f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ebf41e0763e41c9a2483a2088c0c50a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:02.844007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ae6c9a42-d9e1-4bcd-8e5f-fe405826539f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ebf41e0763e41c9a2483a2088c0c50a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:02.845570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ae6c9a42-d9e1-4bcd-8e5f-fe405826539f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ebf41e0763e41c9a2483a2088c0c50a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:02.859522 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 824/1658] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:02 2022] DELETE /identity/v3/users/6ebf41e0763e41c9a2483a2088c0c50a => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:02.859917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c9a42-d9e1-4bcd-8e5f-fe405826539f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:02.863527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ae6c9a42-d9e1-4bcd-8e5f-fe405826539f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:02.895569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c80e0-72b8-4250-8e73-f83cac82a72d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:02.934877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:02.949730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c9a42-d9e1-4bcd-8e5f-fe405826539f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:02.958348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb6027-af4d-45a6-9010-3ab0b7041a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:02.959836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb6027-af4d-45a6-9010-3ab0b7041a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:02.960304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb6027-af4d-45a6-9010-3ab0b7041a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:02.960792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb6027-af4d-45a6-9010-3ab0b7041a61 admin admin] PATH_INFO: `/v3/projects/563f88246ee64de4941bdc07b03fad2f` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:02.962913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb6027-af4d-45a6-9010-3ab0b7041a61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=563f88246ee64de4941bdc07b03fad2f)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:02.964764 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-77fb6027-af4d-45a6-9010-3ab0b7041a61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:08:02.964764 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:08:02.964764 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:08:02.967099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb6027-af4d-45a6-9010-3ab0b7041a61 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:02.968271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56430436-bad1-46a1-a442-28047921ad10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:02.969677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56430436-bad1-46a1-a442-28047921ad10 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:02.970014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56430436-bad1-46a1-a442-28047921ad10 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:02.970869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56430436-bad1-46a1-a442-28047921ad10 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:02.971993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56430436-bad1-46a1-a442-28047921ad10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:02.976135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56430436-bad1-46a1-a442-28047921ad10 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:02.993516 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 835/1659] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:02.995447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd0c6c-adf5-49b5-acb6-e495316ed87c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:02.995921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd0c6c-adf5-49b5-acb6-e495316ed87c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:02.996651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd0c6c-adf5-49b5-acb6-e495316ed87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:03.030089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-54bd0c6c-adf5-49b5-acb6-e495316ed87c None None] MFA Rules not processed for user `893a178daa70493bb9055554d94dce96`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:03.031338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-54bd0c6c-adf5-49b5-acb6-e495316ed87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:03.104860 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 836/1660] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:03.105602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd0c6c-adf5-49b5-acb6-e495316ed87c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:03.106862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-54bd0c6c-adf5-49b5-acb6-e495316ed87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:03.114657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-77fb6027-af4d-45a6-9010-3ab0b7041a61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '563f88246ee64de4941bdc07b03fad2f', 'request_id': 'req-77fb6027-af4d-45a6-9010-3ab0b7041a61'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:03.121727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd0c6c-adf5-49b5-acb6-e495316ed87c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:03.125564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-77fb6027-af4d-45a6-9010-3ab0b7041a61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '563f88246ee64de4941bdc07b03fad2f', 'request_id': 'req-77fb6027-af4d-45a6-9010-3ab0b7041a61'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:03.136595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-77fb6027-af4d-45a6-9010-3ab0b7041a61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '563f88246ee64de4941bdc07b03fad2f', 'request_id': 'req-77fb6027-af4d-45a6-9010-3ab0b7041a61'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:03.185798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfaad3-c094-4659-9f9f-aa7ebe738572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:03.186719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfaad3-c094-4659-9f9f-aa7ebe738572 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:03.187021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfaad3-c094-4659-9f9f-aa7ebe738572 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:03.187323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfaad3-c094-4659-9f9f-aa7ebe738572 admin admin] PATH_INFO: `/v3/projects/30df0b9ba27347a4b290a119c7fad4df/users/965b7cf10d9b4da2bca5aa0f4782357a/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:03.190199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfaad3-c094-4659-9f9f-aa7ebe738572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30df0b9ba27347a4b290a119c7fad4df, user_id=965b7cf10d9b4da2bca5aa0f4782357a, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:03.192962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfaad3-c094-4659-9f9f-aa7ebe738572 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:03.204109 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 837/1661] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:03 2022] PUT /identity/v3/projects/30df0b9ba27347a4b290a119c7fad4df/users/965b7cf10d9b4da2bca5aa0f4782357a/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:03.205040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfaad3-c094-4659-9f9f-aa7ebe738572 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:03.207842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b4dfaad3-c094-4659-9f9f-aa7ebe738572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:03.218887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-77fb6027-af4d-45a6-9010-3ab0b7041a61 admin admin] The token cache is being invalidate because project 563f88246ee64de4941bdc07b03fad2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:03.219254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-77fb6027-af4d-45a6-9010-3ab0b7041a61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:03.219927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-77fb6027-af4d-45a6-9010-3ab0b7041a61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:03.221540 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 825/1662] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:02 2022] DELETE /identity/v3/projects/563f88246ee64de4941bdc07b03fad2f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:03.224207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb6027-af4d-45a6-9010-3ab0b7041a61 admin admin] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:08:03.225541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-77fb6027-af4d-45a6-9010-3ab0b7041a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:03.263871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:03.265984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:03.285614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfaad3-c094-4659-9f9f-aa7ebe738572 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:03.290479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01c889-e1c4-4e73-9423-779433902f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:03.291416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01c889-e1c4-4e73-9423-779433902f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:03.291693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01c889-e1c4-4e73-9423-779433902f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:03.291967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01c889-e1c4-4e73-9423-779433902f81 admin admin] PATH_INFO: `/v3/projects/93ef716961464e6ca518f2cab3bf1fda/users/1c143f95261f496d9a43f3f89c686719/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:03.293986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01c889-e1c4-4e73-9423-779433902f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93ef716961464e6ca518f2cab3bf1fda, user_id=1c143f95261f496d9a43f3f89c686719, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:03.296802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01c889-e1c4-4e73-9423-779433902f81 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:03.312206 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 838/1663] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:03 2022] PUT /identity/v3/projects/93ef716961464e6ca518f2cab3bf1fda/users/1c143f95261f496d9a43f3f89c686719/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:03.314848 ncdv-master-1 devstack@keystone.service[98195]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-77fb6027-af4d-45a6-9010-3ab0b7041a61 admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jul 16 21:08:03.314848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb6027-af4d-45a6-9010-3ab0b7041a61 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:03.315292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb490b9-1f13-43dc-9d72-2c9d0f686710 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:03.315292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb490b9-1f13-43dc-9d72-2c9d0f686710 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:03.315292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb490b9-1f13-43dc-9d72-2c9d0f686710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:03.315637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-77fb6027-af4d-45a6-9010-3ab0b7041a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:03.347902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6eb490b9-1f13-43dc-9d72-2c9d0f686710 None None] MFA Rules not processed for user `cadb63bb5d6b4d7597987780f7d9ef21`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:03.349099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6eb490b9-1f13-43dc-9d72-2c9d0f686710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:03.384161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb6027-af4d-45a6-9010-3ab0b7041a61 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:03.421648 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 839/1664] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:03.423675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9ca0a-5dd6-4634-ab75-4909aac6cba3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:03.423961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9ca0a-5dd6-4634-ab75-4909aac6cba3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:03.424248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9ca0a-5dd6-4634-ab75-4909aac6cba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:03.442956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-bca9ca0a-5dd6-4634-ab75-4909aac6cba3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:03.444211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bca9ca0a-5dd6-4634-ab75-4909aac6cba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:03.446831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd4520-c292-48ce-9904-90a447926e25 tempest-FlavorsAccessTestJSON-378486216 tempest-FlavorsAccessTestJSON-378486216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09a625f203b408bafa8d76043c61862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ee2739c1c9c451f8136d38bd945ada8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:03.447728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd4520-c292-48ce-9904-90a447926e25 tempest-FlavorsAccessTestJSON-378486216 tempest-FlavorsAccessTestJSON-378486216-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:03.448023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd4520-c292-48ce-9904-90a447926e25 tempest-FlavorsAccessTestJSON-378486216 tempest-FlavorsAccessTestJSON-378486216-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:03.448328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd4520-c292-48ce-9904-90a447926e25 tempest-FlavorsAccessTestJSON-378486216 tempest-FlavorsAccessTestJSON-378486216-project-admin] PATH_INFO: `/v3/projects/ba432093c99945c1af32f04d896809b6` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:03.449558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd4520-c292-48ce-9904-90a447926e25 tempest-FlavorsAccessTestJSON-378486216 tempest-FlavorsAccessTestJSON-378486216-project-admin] RBAC: Authorizing `identity:get_project(project_id=ba432093c99945c1af32f04d896809b6)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:03.451711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd4520-c292-48ce-9904-90a447926e25 tempest-FlavorsAccessTestJSON-378486216 tempest-FlavorsAccessTestJSON-378486216-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:03.453464 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 826/1665] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:08:03 2022] GET /identity/v3/projects/ba432093c99945c1af32f04d896809b6 => generated 379 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:03.454242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd4520-c292-48ce-9904-90a447926e25 tempest-FlavorsAccessTestJSON-378486216 tempest-FlavorsAccessTestJSON-378486216-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:03.455950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d1cd4520-c292-48ce-9904-90a447926e25 tempest-FlavorsAccessTestJSON-378486216 tempest-FlavorsAccessTestJSON-378486216-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:03.507676 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 840/1666] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:03.508601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9ca0a-5dd6-4634-ab75-4909aac6cba3 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:03.509932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bca9ca0a-5dd6-4634-ab75-4909aac6cba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:03.535313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd4520-c292-48ce-9904-90a447926e25 tempest-FlavorsAccessTestJSON-378486216 tempest-FlavorsAccessTestJSON-378486216-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:03.540903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657c242-d5b3-4f5d-bfdf-cbf842e6e459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:03.541862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657c242-d5b3-4f5d-bfdf-cbf842e6e459 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:03.542302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657c242-d5b3-4f5d-bfdf-cbf842e6e459 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:03.542421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657c242-d5b3-4f5d-bfdf-cbf842e6e459 admin admin] PATH_INFO: `/v3/projects/09da0450b1464083990b4b3566862cd6/users/ceb1a15568df445abebf4220c6894ca9/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:03.544574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657c242-d5b3-4f5d-bfdf-cbf842e6e459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09da0450b1464083990b4b3566862cd6, user_id=ceb1a15568df445abebf4220c6894ca9, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:03.547360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657c242-d5b3-4f5d-bfdf-cbf842e6e459 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:03.569771 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 827/1667] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:03 2022] PUT /identity/v3/projects/09da0450b1464083990b4b3566862cd6/users/ceb1a15568df445abebf4220c6894ca9/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:03.569771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881da8e-7a94-4dea-abad-13b13f216d65 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:03.569771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881da8e-7a94-4dea-abad-13b13f216d65 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:03.569771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881da8e-7a94-4dea-abad-13b13f216d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:03.569771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:03.590911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6881da8e-7a94-4dea-abad-13b13f216d65 None None] MFA Rules not processed for user `965b7cf10d9b4da2bca5aa0f4782357a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:03.592165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6881da8e-7a94-4dea-abad-13b13f216d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:03.596861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9ca0a-5dd6-4634-ab75-4909aac6cba3 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:03.604931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:03.662370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68315562-cb3b-4c42-b4bf-e94f9b73c74e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:03.662808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68315562-cb3b-4c42-b4bf-e94f9b73c74e service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:03.663215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68315562-cb3b-4c42-b4bf-e94f9b73c74e service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:03.663648 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 828/1668] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:03.663755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68315562-cb3b-4c42-b4bf-e94f9b73c74e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:03.664835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dd86a-dbb9-401a-8958-93a6510a8902 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:03.665124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dd86a-dbb9-401a-8958-93a6510a8902 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:03.665311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-68315562-cb3b-4c42-b4bf-e94f9b73c74e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:03.665415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dd86a-dbb9-401a-8958-93a6510a8902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:03.684529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-230dd86a-dbb9-401a-8958-93a6510a8902 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:03.685904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-230dd86a-dbb9-401a-8958-93a6510a8902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:03.727635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68315562-cb3b-4c42-b4bf-e94f9b73c74e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:03.729261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68315562-cb3b-4c42-b4bf-e94f9b73c74e service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:03.739280 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 841/1669] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:03.740879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157dacc-f0a1-4545-9376-66dfe407852f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:03.741186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157dacc-f0a1-4545-9376-66dfe407852f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:03.741461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157dacc-f0a1-4545-9376-66dfe407852f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:03.746838 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 829/1670] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:03.747753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dd86a-dbb9-401a-8958-93a6510a8902 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:03.749146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-230dd86a-dbb9-401a-8958-93a6510a8902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:03.776777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6157dacc-f0a1-4545-9376-66dfe407852f None None] MFA Rules not processed for user `1c143f95261f496d9a43f3f89c686719`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:03.778494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6157dacc-f0a1-4545-9376-66dfe407852f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:03.812133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dd86a-dbb9-401a-8958-93a6510a8902 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:03.816805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46a9b7-ed5d-4188-af28-9e77300e669d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:03.817471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46a9b7-ed5d-4188-af28-9e77300e669d service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:03.817748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46a9b7-ed5d-4188-af28-9e77300e669d service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:03.818064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46a9b7-ed5d-4188-af28-9e77300e669d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:03.831590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46a9b7-ed5d-4188-af28-9e77300e669d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:03.833095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46a9b7-ed5d-4188-af28-9e77300e669d service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:03.844500 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 830/1671] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:03.846107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e49fb-3e73-4a74-af7f-c017c6625952 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:03.846211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e49fb-3e73-4a74-af7f-c017c6625952 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:03.846469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e49fb-3e73-4a74-af7f-c017c6625952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:03.865319 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 842/1672] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:03.867404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157dacc-f0a1-4545-9376-66dfe407852f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:03.877850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-443e49fb-3e73-4a74-af7f-c017c6625952 None None] MFA Rules not processed for user `ceb1a15568df445abebf4220c6894ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:03.879323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-443e49fb-3e73-4a74-af7f-c017c6625952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:03.881359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157dacc-f0a1-4545-9376-66dfe407852f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:03.888089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715bb11-54b8-4608-a346-2739c94766cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:03.888803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715bb11-54b8-4608-a346-2739c94766cd service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:03.889032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715bb11-54b8-4608-a346-2739c94766cd service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:03.889344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715bb11-54b8-4608-a346-2739c94766cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:03.908112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:03.928883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:03.967310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715bb11-54b8-4608-a346-2739c94766cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:03.968948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715bb11-54b8-4608-a346-2739c94766cd service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:03.972086 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 831/1673] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:03.973527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ee076-f748-49cb-9792-0867427545b3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:03.973883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ee076-f748-49cb-9792-0867427545b3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:03.974710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ee076-f748-49cb-9792-0867427545b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:03.981045 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 843/1674] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:03 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:03.982341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715bb11-54b8-4608-a346-2739c94766cd service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:03.983474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7715bb11-54b8-4608-a346-2739c94766cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:03.993439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-208ee076-f748-49cb-9792-0867427545b3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:03.994970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-208ee076-f748-49cb-9792-0867427545b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:03.998652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715bb11-54b8-4608-a346-2739c94766cd service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:04.004470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155de08c-39ad-4ac9-bfb9-391a27c1c8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:04.005518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155de08c-39ad-4ac9-bfb9-391a27c1c8a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:04.012391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155de08c-39ad-4ac9-bfb9-391a27c1c8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:04.012391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155de08c-39ad-4ac9-bfb9-391a27c1c8a8 admin admin] PATH_INFO: `/v3/users/6f34858458b7434fa08eb5be6b0ce1cf` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:04.012391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155de08c-39ad-4ac9-bfb9-391a27c1c8a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f34858458b7434fa08eb5be6b0ce1cf)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:04.012391 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-155de08c-39ad-4ac9-bfb9-391a27c1c8a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:08:04.012391 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:08:04.012391 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:08:04.012823 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 832/1675] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:04.012823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ee076-f748-49cb-9792-0867427545b3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:04.013065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155de08c-39ad-4ac9-bfb9-391a27c1c8a8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:04.024898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ee076-f748-49cb-9792-0867427545b3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:04.030958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc6d5c-4b9d-4e72-8a50-e6c50990c320 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:04.031673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc6d5c-4b9d-4e72-8a50-e6c50990c320 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:04.031959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc6d5c-4b9d-4e72-8a50-e6c50990c320 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:04.032285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc6d5c-4b9d-4e72-8a50-e6c50990c320 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:04.034354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c7bc6d5c-4b9d-4e72-8a50-e6c50990c320 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:04.104821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc6d5c-4b9d-4e72-8a50-e6c50990c320 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:04.106396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc6d5c-4b9d-4e72-8a50-e6c50990c320 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:04.117947 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 833/1676] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:04.119592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc6d5c-4b9d-4e72-8a50-e6c50990c320 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:04.131492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc6d5c-4b9d-4e72-8a50-e6c50990c320 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:04.136840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b3a10-ff3a-41e4-af6e-800c3c64a2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:04.137492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b3a10-ff3a-41e4-af6e-800c3c64a2ed admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:04.137765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b3a10-ff3a-41e4-af6e-800c3c64a2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:04.138038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b3a10-ff3a-41e4-af6e-800c3c64a2ed admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:04.138792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b3a10-ff3a-41e4-af6e-800c3c64a2ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:08:04.139172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b3a10-ff3a-41e4-af6e-800c3c64a2ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:04.140762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b3a10-ff3a-41e4-af6e-800c3c64a2ed admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:04.158454 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 834/1677] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:04.159517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b3a10-ff3a-41e4-af6e-800c3c64a2ed admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:04.183615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b3a10-ff3a-41e4-af6e-800c3c64a2ed admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:04.190394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c1fbe-d149-460b-ae49-77110413ce83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:04.191090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c1fbe-d149-460b-ae49-77110413ce83 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:04.191373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c1fbe-d149-460b-ae49-77110413ce83 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:04.191648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c1fbe-d149-460b-ae49-77110413ce83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:04.200435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c1fbe-d149-460b-ae49-77110413ce83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:04.202027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c1fbe-d149-460b-ae49-77110413ce83 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:04.214793 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 835/1678] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:04.215819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c1fbe-d149-460b-ae49-77110413ce83 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:04.232817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-155de08c-39ad-4ac9-bfb9-391a27c1c8a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f34858458b7434fa08eb5be6b0ce1cf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:04.236706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c1fbe-d149-460b-ae49-77110413ce83 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:04.243387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a0f66-0138-4f59-94fb-b51d188b0a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:04.244564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a0f66-0138-4f59-94fb-b51d188b0a49 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:04.245363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a0f66-0138-4f59-94fb-b51d188b0a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:04.245857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a0f66-0138-4f59-94fb-b51d188b0a49 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:04.247193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a0f66-0138-4f59-94fb-b51d188b0a49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:04.250647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a0f66-0138-4f59-94fb-b51d188b0a49 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:04.253152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-155de08c-39ad-4ac9-bfb9-391a27c1c8a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f34858458b7434fa08eb5be6b0ce1cf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:04.371994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-155de08c-39ad-4ac9-bfb9-391a27c1c8a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f34858458b7434fa08eb5be6b0ce1cf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:04.372700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-155de08c-39ad-4ac9-bfb9-391a27c1c8a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f34858458b7434fa08eb5be6b0ce1cf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:04.386452 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 836/1679] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:04 2022] POST /identity/v3/projects => generated 389 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:04.387379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a0f66-0138-4f59-94fb-b51d188b0a49 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:04.389137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1b5a0f66-0138-4f59-94fb-b51d188b0a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:04.394765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-155de08c-39ad-4ac9-bfb9-391a27c1c8a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f34858458b7434fa08eb5be6b0ce1cf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:04.402238 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 844/1680] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:03 2022] DELETE /identity/v3/users/6f34858458b7434fa08eb5be6b0ce1cf => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:04.402815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155de08c-39ad-4ac9-bfb9-391a27c1c8a8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:04.405051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-155de08c-39ad-4ac9-bfb9-391a27c1c8a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:04.459861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:04.475542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a0f66-0138-4f59-94fb-b51d188b0a49 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:04.481116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032166b-346a-4b3f-9d67-14a78815c6fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:04.481760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032166b-346a-4b3f-9d67-14a78815c6fc service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:04.482036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032166b-346a-4b3f-9d67-14a78815c6fc service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:04.482306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032166b-346a-4b3f-9d67-14a78815c6fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:04.484199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c032166b-346a-4b3f-9d67-14a78815c6fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:04.485272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155de08c-39ad-4ac9-bfb9-391a27c1c8a8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:04.491737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608bbab-7d9c-4b9d-bd9a-c2ab941941a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:04.492420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608bbab-7d9c-4b9d-bd9a-c2ab941941a5 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:04.492702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608bbab-7d9c-4b9d-bd9a-c2ab941941a5 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:04.492978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608bbab-7d9c-4b9d-bd9a-c2ab941941a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:04.494774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4608bbab-7d9c-4b9d-bd9a-c2ab941941a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:04.529454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:04.550144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032166b-346a-4b3f-9d67-14a78815c6fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:04.551882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032166b-346a-4b3f-9d67-14a78815c6fc service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:04.557323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608bbab-7d9c-4b9d-bd9a-c2ab941941a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:04.558899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608bbab-7d9c-4b9d-bd9a-c2ab941941a5 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:04.561947 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 837/1681] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:04.563042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032166b-346a-4b3f-9d67-14a78815c6fc service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:04.565869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c032166b-346a-4b3f-9d67-14a78815c6fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:04.572438 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 845/1682] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:04.572438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608bbab-7d9c-4b9d-bd9a-c2ab941941a5 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:04.572438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4608bbab-7d9c-4b9d-bd9a-c2ab941941a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:04.647178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032166b-346a-4b3f-9d67-14a78815c6fc service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:04.655235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608bbab-7d9c-4b9d-bd9a-c2ab941941a5 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:04.655374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277f144-13a5-46b6-9a36-b260a4d49e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:04.656232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277f144-13a5-46b6-9a36-b260a4d49e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:04.656744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277f144-13a5-46b6-9a36-b260a4d49e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:04.657037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277f144-13a5-46b6-9a36-b260a4d49e32 admin admin] PATH_INFO: `/v3/projects/bafdaf9b261b45aa9ca5dd31aeaf8b66` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:04.658334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277f144-13a5-46b6-9a36-b260a4d49e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bafdaf9b261b45aa9ca5dd31aeaf8b66)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:04.660277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277f144-13a5-46b6-9a36-b260a4d49e32 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:04.663500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938313e-2f44-4a31-bc34-3df73e7cc1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:04.665164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938313e-2f44-4a31-bc34-3df73e7cc1ef admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:04.665164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938313e-2f44-4a31-bc34-3df73e7cc1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:04.665164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938313e-2f44-4a31-bc34-3df73e7cc1ef admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:04.665967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938313e-2f44-4a31-bc34-3df73e7cc1ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:04.668486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938313e-2f44-4a31-bc34-3df73e7cc1ef admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:04.819488 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 846/1683] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:04 2022] POST /identity/v3/users => generated 295 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:04.820796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef611695-52e1-41f3-9c24-5f9772d2984d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:04.823125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef611695-52e1-41f3-9c24-5f9772d2984d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:04.823125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef611695-52e1-41f3-9c24-5f9772d2984d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:04.840485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ef611695-52e1-41f3-9c24-5f9772d2984d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:04.852235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ef611695-52e1-41f3-9c24-5f9772d2984d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:04.855587 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 847/1684] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:04.857164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84512cde-357b-4e46-a516-5fa9f98eadf8 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:04.857466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84512cde-357b-4e46-a516-5fa9f98eadf8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:04.857725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84512cde-357b-4e46-a516-5fa9f98eadf8 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:04.864492 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 848/1685] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:08:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:08:04.866322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84512cde-357b-4e46-a516-5fa9f98eadf8 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:04.869523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8277f144-13a5-46b6-9a36-b260a4d49e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bafdaf9b261b45aa9ca5dd31aeaf8b66', 'request_id': 'req-8277f144-13a5-46b6-9a36-b260a4d49e32'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:04.885323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8277f144-13a5-46b6-9a36-b260a4d49e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bafdaf9b261b45aa9ca5dd31aeaf8b66', 'request_id': 'req-8277f144-13a5-46b6-9a36-b260a4d49e32'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:04.893981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8277f144-13a5-46b6-9a36-b260a4d49e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bafdaf9b261b45aa9ca5dd31aeaf8b66', 'request_id': 'req-8277f144-13a5-46b6-9a36-b260a4d49e32'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:04.942475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84512cde-357b-4e46-a516-5fa9f98eadf8 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:04.946950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbcd94-986d-44d6-9fa9-9f26537ec2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:04.947671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbcd94-986d-44d6-9fa9-9f26537ec2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:04.947952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbcd94-986d-44d6-9fa9-9f26537ec2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:04.948224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbcd94-986d-44d6-9fa9-9f26537ec2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:04.948942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbcd94-986d-44d6-9fa9-9f26537ec2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:04.950629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbcd94-986d-44d6-9fa9-9f26537ec2b6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:04.966438 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 849/1686] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:04.966438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbcd94-986d-44d6-9fa9-9f26537ec2b6 admin admin] Authenticating service token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:08:05.012865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8277f144-13a5-46b6-9a36-b260a4d49e32 admin admin] The token cache is being invalidate because project bafdaf9b261b45aa9ca5dd31aeaf8b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:05.013164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8277f144-13a5-46b6-9a36-b260a4d49e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:05.018682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8277f144-13a5-46b6-9a36-b260a4d49e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:05.018682 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 838/1687] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:04 2022] DELETE /identity/v3/projects/bafdaf9b261b45aa9ca5dd31aeaf8b66 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:05.018682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277f144-13a5-46b6-9a36-b260a4d49e32 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:05.018682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8277f144-13a5-46b6-9a36-b260a4d49e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:05.025895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:05.046233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:05.049573 ncdv-master-1 devstack@keystone.service[98196]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbcd94-986d-44d6-9fa9-9f26537ec2b6 admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jul 16 21:08:05.049573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbcd94-986d-44d6-9fa9-9f26537ec2b6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:05.049573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9cdbcd94-986d-44d6-9fa9-9f26537ec2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:05.083960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277f144-13a5-46b6-9a36-b260a4d49e32 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:05.087590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011aa73-e62d-425b-88ca-067e7f3c23f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:05.088246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011aa73-e62d-425b-88ca-067e7f3c23f0 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:05.088532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011aa73-e62d-425b-88ca-067e7f3c23f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:05.088803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011aa73-e62d-425b-88ca-067e7f3c23f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:05.090596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5011aa73-e62d-425b-88ca-067e7f3c23f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:05.103900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011aa73-e62d-425b-88ca-067e7f3c23f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:05.105332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011aa73-e62d-425b-88ca-067e7f3c23f0 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:05.117153 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 839/1688] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:05.117703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbcd94-986d-44d6-9fa9-9f26537ec2b6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:05.117986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011aa73-e62d-425b-88ca-067e7f3c23f0 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:05.120809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5011aa73-e62d-425b-88ca-067e7f3c23f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:05.122802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0f8e7-b398-4e19-b05e-2c48a03e8ff1 tempest-FlavorsAccessTestJSON-378486216 tempest-FlavorsAccessTestJSON-378486216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09a625f203b408bafa8d76043c61862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ee2739c1c9c451f8136d38bd945ada8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:05.124023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0f8e7-b398-4e19-b05e-2c48a03e8ff1 tempest-FlavorsAccessTestJSON-378486216 tempest-FlavorsAccessTestJSON-378486216-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:05.124200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0f8e7-b398-4e19-b05e-2c48a03e8ff1 tempest-FlavorsAccessTestJSON-378486216 tempest-FlavorsAccessTestJSON-378486216-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:05.124424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0f8e7-b398-4e19-b05e-2c48a03e8ff1 tempest-FlavorsAccessTestJSON-378486216 tempest-FlavorsAccessTestJSON-378486216-project-admin] PATH_INFO: `/v3/projects/ba432093c99945c1af32f04d896809b6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:05.125719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0f8e7-b398-4e19-b05e-2c48a03e8ff1 tempest-FlavorsAccessTestJSON-378486216 tempest-FlavorsAccessTestJSON-378486216-project-admin] RBAC: Authorizing `identity:get_project(project_id=ba432093c99945c1af32f04d896809b6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:05.127943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0f8e7-b398-4e19-b05e-2c48a03e8ff1 tempest-FlavorsAccessTestJSON-378486216 tempest-FlavorsAccessTestJSON-378486216-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:05.129947 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 850/1689] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:08:04 2022] GET /identity/v3/projects/ba432093c99945c1af32f04d896809b6 => generated 379 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:05.132913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0f8e7-b398-4e19-b05e-2c48a03e8ff1 tempest-FlavorsAccessTestJSON-378486216 tempest-FlavorsAccessTestJSON-378486216-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:05.140490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d2d0f8e7-b398-4e19-b05e-2c48a03e8ff1 tempest-FlavorsAccessTestJSON-378486216 tempest-FlavorsAccessTestJSON-378486216-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:05.145795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011aa73-e62d-425b-88ca-067e7f3c23f0 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:05.151976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cf998-9502-4eb9-9e58-e236e39859f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:05.153296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0f8e7-b398-4e19-b05e-2c48a03e8ff1 tempest-FlavorsAccessTestJSON-378486216 tempest-FlavorsAccessTestJSON-378486216-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:05.153552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cf998-9502-4eb9-9e58-e236e39859f0 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:05.154015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cf998-9502-4eb9-9e58-e236e39859f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:05.154605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cf998-9502-4eb9-9e58-e236e39859f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:05.155606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cf998-9502-4eb9-9e58-e236e39859f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:05.158009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cf998-9502-4eb9-9e58-e236e39859f0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:05.159968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0ebb7-90f7-4e44-a1a4-9b40c8cae943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:05.160838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0ebb7-90f7-4e44-a1a4-9b40c8cae943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:05.161165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0ebb7-90f7-4e44-a1a4-9b40c8cae943 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:05.161470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0ebb7-90f7-4e44-a1a4-9b40c8cae943 admin admin] PATH_INFO: `/v3/users/31d28b021c8e49d4b5c599686d098729` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:05.162693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0ebb7-90f7-4e44-a1a4-9b40c8cae943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31d28b021c8e49d4b5c599686d098729)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:05.164941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0ebb7-90f7-4e44-a1a4-9b40c8cae943 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:05.171849 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 840/1690] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:05.174047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b0b4b-bd3a-490b-94d7-0367125fd88d None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:05.174560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b0b4b-bd3a-490b-94d7-0367125fd88d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:05.174880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b0b4b-bd3a-490b-94d7-0367125fd88d None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:05.176480 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 841/1691] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:08:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:08:05.177014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b0b4b-bd3a-490b-94d7-0367125fd88d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:05.192608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b0b4b-bd3a-490b-94d7-0367125fd88d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:05.198946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee770c-d546-4e4c-a93b-cf398934c1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:05.199965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee770c-d546-4e4c-a93b-cf398934c1c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:05.200237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee770c-d546-4e4c-a93b-cf398934c1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:05.200512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee770c-d546-4e4c-a93b-cf398934c1c5 admin admin] PATH_INFO: `/v3/projects/964640b04de845039e4b41cda5f555f1/users/9b61d9df6f51477f9e1c2072a03a073c/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:05.216829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee770c-d546-4e4c-a93b-cf398934c1c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=964640b04de845039e4b41cda5f555f1, user_id=9b61d9df6f51477f9e1c2072a03a073c, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:05.219574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee770c-d546-4e4c-a93b-cf398934c1c5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:05.376224 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 842/1692] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:05 2022] PUT /identity/v3/projects/964640b04de845039e4b41cda5f555f1/users/9b61d9df6f51477f9e1c2072a03a073c/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:05.376224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd06997-aa38-42e3-97a3-5a6272d367c0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:05.376224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd06997-aa38-42e3-97a3-5a6272d367c0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:05.376224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd06997-aa38-42e3-97a3-5a6272d367c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:05.399672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3fd06997-aa38-42e3-97a3-5a6272d367c0 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:05.401075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3fd06997-aa38-42e3-97a3-5a6272d367c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:05.481344 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 843/1693] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:08:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:05.482748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a74f3b-2855-4649-9bbc-2e4bae2d14ba None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:05.483056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a74f3b-2855-4649-9bbc-2e4bae2d14ba None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:05.483342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a74f3b-2855-4649-9bbc-2e4bae2d14ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:05.507799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16f0ebb7-90f7-4e44-a1a4-9b40c8cae943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31d28b021c8e49d4b5c599686d098729'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:05.515872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-11a74f3b-2855-4649-9bbc-2e4bae2d14ba None None] MFA Rules not processed for user `9b61d9df6f51477f9e1c2072a03a073c`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:05.516660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16f0ebb7-90f7-4e44-a1a4-9b40c8cae943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31d28b021c8e49d4b5c599686d098729'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:05.517104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-11a74f3b-2855-4649-9bbc-2e4bae2d14ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:05.592714 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 844/1694] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:05.593636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a74f3b-2855-4649-9bbc-2e4bae2d14ba None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:05.597709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-11a74f3b-2855-4649-9bbc-2e4bae2d14ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:05.606743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16f0ebb7-90f7-4e44-a1a4-9b40c8cae943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31d28b021c8e49d4b5c599686d098729'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:05.607557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16f0ebb7-90f7-4e44-a1a4-9b40c8cae943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31d28b021c8e49d4b5c599686d098729'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:05.617197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:05.621856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16f0ebb7-90f7-4e44-a1a4-9b40c8cae943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31d28b021c8e49d4b5c599686d098729'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:05.628727 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 851/1695] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:05 2022] DELETE /identity/v3/users/31d28b021c8e49d4b5c599686d098729 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:05.629352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0ebb7-90f7-4e44-a1a4-9b40c8cae943 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:05.630699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-16f0ebb7-90f7-4e44-a1a4-9b40c8cae943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:05.687096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a74f3b-2855-4649-9bbc-2e4bae2d14ba None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:05.719580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:05.727284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0ebb7-90f7-4e44-a1a4-9b40c8cae943 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:05.735135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076df21-604e-491e-979b-8f2c044e53c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:05.736136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076df21-604e-491e-979b-8f2c044e53c3 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:05.737069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076df21-604e-491e-979b-8f2c044e53c3 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:05.737724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076df21-604e-491e-979b-8f2c044e53c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:05.740242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7076df21-604e-491e-979b-8f2c044e53c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:05.757110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1f767-f0c1-4770-841d-7daac4a396b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:05.758178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1f767-f0c1-4770-841d-7daac4a396b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:05.760727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1f767-f0c1-4770-841d-7daac4a396b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:05.760727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1f767-f0c1-4770-841d-7daac4a396b7 admin admin] PATH_INFO: `/v3/users/c5b1414ed1244fa7aeecf3c6b77150c7` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:05.760727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1f767-f0c1-4770-841d-7daac4a396b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5b1414ed1244fa7aeecf3c6b77150c7)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:05.761324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076df21-604e-491e-979b-8f2c044e53c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:05.763108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1f767-f0c1-4770-841d-7daac4a396b7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:05.763392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076df21-604e-491e-979b-8f2c044e53c3 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:05.776343 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 852/1696] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:05.777298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076df21-604e-491e-979b-8f2c044e53c3 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:05.778724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7076df21-604e-491e-979b-8f2c044e53c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:05.796813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076df21-604e-491e-979b-8f2c044e53c3 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:05.801792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ba2f7-dde5-4c69-90e5-7eaa89454210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:05.802674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ba2f7-dde5-4c69-90e5-7eaa89454210 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:05.802952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ba2f7-dde5-4c69-90e5-7eaa89454210 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:05.803840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ba2f7-dde5-4c69-90e5-7eaa89454210 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:05.804545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ba2f7-dde5-4c69-90e5-7eaa89454210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:05.806417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ba2f7-dde5-4c69-90e5-7eaa89454210 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:05.970075 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 853/1697] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:05 2022] POST /identity/v3/projects => generated 389 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:05.971455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ba2f7-dde5-4c69-90e5-7eaa89454210 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:05.975349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-395ba2f7-dde5-4c69-90e5-7eaa89454210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:06.051434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ba2f7-dde5-4c69-90e5-7eaa89454210 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:06.056333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e7d00-ceed-4ea1-a38b-e3119a13324e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:06.057323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e7d00-ceed-4ea1-a38b-e3119a13324e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:06.057689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e7d00-ceed-4ea1-a38b-e3119a13324e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:06.058096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e7d00-ceed-4ea1-a38b-e3119a13324e admin admin] PATH_INFO: `/v3/projects/57887ca847c64efba6b864955e6ee14b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:06.059406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e7d00-ceed-4ea1-a38b-e3119a13324e admin admin] RBAC: Authorizing `identity:delete_project(project_id=57887ca847c64efba6b864955e6ee14b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:06.061412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e7d00-ceed-4ea1-a38b-e3119a13324e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:06.090124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-63d1f767-f0c1-4770-841d-7daac4a396b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5b1414ed1244fa7aeecf3c6b77150c7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:06.102255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-63d1f767-f0c1-4770-841d-7daac4a396b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5b1414ed1244fa7aeecf3c6b77150c7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:06.222873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-906e7d00-ceed-4ea1-a38b-e3119a13324e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57887ca847c64efba6b864955e6ee14b', 'request_id': 'req-906e7d00-ceed-4ea1-a38b-e3119a13324e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:06.229424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-63d1f767-f0c1-4770-841d-7daac4a396b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5b1414ed1244fa7aeecf3c6b77150c7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:06.241142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-906e7d00-ceed-4ea1-a38b-e3119a13324e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57887ca847c64efba6b864955e6ee14b', 'request_id': 'req-906e7d00-ceed-4ea1-a38b-e3119a13324e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:06.244262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-63d1f767-f0c1-4770-841d-7daac4a396b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5b1414ed1244fa7aeecf3c6b77150c7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:06.244262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-63d1f767-f0c1-4770-841d-7daac4a396b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5b1414ed1244fa7aeecf3c6b77150c7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:06.255196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-906e7d00-ceed-4ea1-a38b-e3119a13324e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57887ca847c64efba6b864955e6ee14b', 'request_id': 'req-906e7d00-ceed-4ea1-a38b-e3119a13324e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:06.258092 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 845/1698] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:05 2022] DELETE /identity/v3/users/c5b1414ed1244fa7aeecf3c6b77150c7 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:06.258797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1f767-f0c1-4770-841d-7daac4a396b7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:06.260004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-63d1f767-f0c1-4770-841d-7daac4a396b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:06.310851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:06.330328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1f767-f0c1-4770-841d-7daac4a396b7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:06.332400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-906e7d00-ceed-4ea1-a38b-e3119a13324e admin admin] The token cache is being invalidate because project 57887ca847c64efba6b864955e6ee14b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:06.332855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-906e7d00-ceed-4ea1-a38b-e3119a13324e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:06.333634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-906e7d00-ceed-4ea1-a38b-e3119a13324e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:06.335730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355dc63-4add-4855-9ca6-9d1e97cf7ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:06.339966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355dc63-4add-4855-9ca6-9d1e97cf7ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:06.340337 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 854/1699] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:05 2022] DELETE /identity/v3/projects/57887ca847c64efba6b864955e6ee14b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:06.340433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355dc63-4add-4855-9ca6-9d1e97cf7ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:06.340433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355dc63-4add-4855-9ca6-9d1e97cf7ecd admin admin] PATH_INFO: `/v3/users/1f825fe1541f4ba898be68cb7a6ac992` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:06.340433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355dc63-4add-4855-9ca6-9d1e97cf7ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f825fe1541f4ba898be68cb7a6ac992)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:06.341104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355dc63-4add-4855-9ca6-9d1e97cf7ecd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:06.341966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e7d00-ceed-4ea1-a38b-e3119a13324e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:06.343883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-906e7d00-ceed-4ea1-a38b-e3119a13324e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:06.412307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e7d00-ceed-4ea1-a38b-e3119a13324e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:06.417259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a10bbe-1353-483e-abcf-9f02aa482285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:06.417919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a10bbe-1353-483e-abcf-9f02aa482285 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:06.418199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a10bbe-1353-483e-abcf-9f02aa482285 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:06.418467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a10bbe-1353-483e-abcf-9f02aa482285 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:06.419185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a10bbe-1353-483e-abcf-9f02aa482285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:06.421085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a10bbe-1353-483e-abcf-9f02aa482285 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:06.552457 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 855/1700] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:06 2022] POST /identity/v3/users => generated 301 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:06.552457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a10bbe-1353-483e-abcf-9f02aa482285 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:06.552457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a4a10bbe-1353-483e-abcf-9f02aa482285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:06.564359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a10bbe-1353-483e-abcf-9f02aa482285 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:06.569152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668c67c-1ee7-4f9d-9544-2ed20e49b1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:06.569993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668c67c-1ee7-4f9d-9544-2ed20e49b1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:06.570274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668c67c-1ee7-4f9d-9544-2ed20e49b1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:06.570548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668c67c-1ee7-4f9d-9544-2ed20e49b1e0 admin admin] PATH_INFO: `/v3/projects/b7caea2925c54539bbb1c6ca87d9f383` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:06.572085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668c67c-1ee7-4f9d-9544-2ed20e49b1e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7caea2925c54539bbb1c6ca87d9f383)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:06.575883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668c67c-1ee7-4f9d-9544-2ed20e49b1e0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:06.599321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9355dc63-4add-4855-9ca6-9d1e97cf7ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f825fe1541f4ba898be68cb7a6ac992'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:06.612398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9355dc63-4add-4855-9ca6-9d1e97cf7ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f825fe1541f4ba898be68cb7a6ac992'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:06.663996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:06.697721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9355dc63-4add-4855-9ca6-9d1e97cf7ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f825fe1541f4ba898be68cb7a6ac992'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:06.706882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9355dc63-4add-4855-9ca6-9d1e97cf7ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f825fe1541f4ba898be68cb7a6ac992'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:06.708512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9355dc63-4add-4855-9ca6-9d1e97cf7ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f825fe1541f4ba898be68cb7a6ac992'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:06.719592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a668c67c-1ee7-4f9d-9544-2ed20e49b1e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7caea2925c54539bbb1c6ca87d9f383', 'request_id': 'req-a668c67c-1ee7-4f9d-9544-2ed20e49b1e0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:06.726775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a668c67c-1ee7-4f9d-9544-2ed20e49b1e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7caea2925c54539bbb1c6ca87d9f383', 'request_id': 'req-a668c67c-1ee7-4f9d-9544-2ed20e49b1e0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:06.730595 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 846/1701] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:06 2022] DELETE /identity/v3/users/1f825fe1541f4ba898be68cb7a6ac992 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:06.732528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bac8e7-7d46-4114-8793-bf5f82831d33 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:06.732881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bac8e7-7d46-4114-8793-bf5f82831d33 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:06.733160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bac8e7-7d46-4114-8793-bf5f82831d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:06.736393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a668c67c-1ee7-4f9d-9544-2ed20e49b1e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7caea2925c54539bbb1c6ca87d9f383', 'request_id': 'req-a668c67c-1ee7-4f9d-9544-2ed20e49b1e0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:06.753994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-89bac8e7-7d46-4114-8793-bf5f82831d33 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:06.755362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-89bac8e7-7d46-4114-8793-bf5f82831d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:06.818051 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 847/1702] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:06.823715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bac8e7-7d46-4114-8793-bf5f82831d33 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:06.823715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-89bac8e7-7d46-4114-8793-bf5f82831d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:06.833820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bac8e7-7d46-4114-8793-bf5f82831d33 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:06.838331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9120f7-7931-4424-9693-8017695693c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:06.839321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9120f7-7931-4424-9693-8017695693c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:06.844959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9120f7-7931-4424-9693-8017695693c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:06.844959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9120f7-7931-4424-9693-8017695693c6 admin admin] PATH_INFO: `/v3/users/893a178daa70493bb9055554d94dce96` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:06.845144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a668c67c-1ee7-4f9d-9544-2ed20e49b1e0 admin admin] The token cache is being invalidate because project b7caea2925c54539bbb1c6ca87d9f383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:06.845144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a668c67c-1ee7-4f9d-9544-2ed20e49b1e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:06.845328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9120f7-7931-4424-9693-8017695693c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=893a178daa70493bb9055554d94dce96)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:06.845409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a668c67c-1ee7-4f9d-9544-2ed20e49b1e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:06.845486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9120f7-7931-4424-9693-8017695693c6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:06.845560 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 856/1703] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:06 2022] DELETE /identity/v3/projects/b7caea2925c54539bbb1c6ca87d9f383 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:06.845560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668c67c-1ee7-4f9d-9544-2ed20e49b1e0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:06.845560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a668c67c-1ee7-4f9d-9544-2ed20e49b1e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:06.929562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668c67c-1ee7-4f9d-9544-2ed20e49b1e0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:06.934351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e01626-5855-4edd-ad28-c7ec122455cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:06.935051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e01626-5855-4edd-ad28-c7ec122455cb admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:06.935356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e01626-5855-4edd-ad28-c7ec122455cb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:06.939528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e01626-5855-4edd-ad28-c7ec122455cb admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:06.939528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e01626-5855-4edd-ad28-c7ec122455cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:06.939528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e01626-5855-4edd-ad28-c7ec122455cb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:06.949580 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 857/1704] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:06.951204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cff61-1d18-4b51-86c0-d4e70d583adb None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:06.951496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cff61-1d18-4b51-86c0-d4e70d583adb None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:06.951774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cff61-1d18-4b51-86c0-d4e70d583adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:06.972569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-682cff61-1d18-4b51-86c0-d4e70d583adb None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:06.974215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-682cff61-1d18-4b51-86c0-d4e70d583adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:06.982476 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 858/1705] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:06.983350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cff61-1d18-4b51-86c0-d4e70d583adb None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:06.984595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-682cff61-1d18-4b51-86c0-d4e70d583adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:07.045916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cff61-1d18-4b51-86c0-d4e70d583adb None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:07.049550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50091361-0dc0-4bc0-a806-bf583d2afa5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:07.050203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50091361-0dc0-4bc0-a806-bf583d2afa5f service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:07.050623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50091361-0dc0-4bc0-a806-bf583d2afa5f service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:07.050795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50091361-0dc0-4bc0-a806-bf583d2afa5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:07.052597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-50091361-0dc0-4bc0-a806-bf583d2afa5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:07.071631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50091361-0dc0-4bc0-a806-bf583d2afa5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:07.073121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50091361-0dc0-4bc0-a806-bf583d2afa5f service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:07.089144 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 859/1706] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:07.090469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86884cbb-e0b4-48bb-97b0-052628de9aa6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:07.091508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86884cbb-e0b4-48bb-97b0-052628de9aa6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:07.091959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86884cbb-e0b4-48bb-97b0-052628de9aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:07.097467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3f9120f7-7931-4424-9693-8017695693c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '893a178daa70493bb9055554d94dce96'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:07.106246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:07.112820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3f9120f7-7931-4424-9693-8017695693c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '893a178daa70493bb9055554d94dce96'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:07.114080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-86884cbb-e0b4-48bb-97b0-052628de9aa6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:07.115509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-86884cbb-e0b4-48bb-97b0-052628de9aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:07.124542 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 860/1707] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:07.131216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86884cbb-e0b4-48bb-97b0-052628de9aa6 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:07.131216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-86884cbb-e0b4-48bb-97b0-052628de9aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:07.188934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3f9120f7-7931-4424-9693-8017695693c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '893a178daa70493bb9055554d94dce96'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:07.197294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3f9120f7-7931-4424-9693-8017695693c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '893a178daa70493bb9055554d94dce96'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:07.197984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3f9120f7-7931-4424-9693-8017695693c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '893a178daa70493bb9055554d94dce96'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:07.204482 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 848/1708] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:06 2022] DELETE /identity/v3/users/893a178daa70493bb9055554d94dce96 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:07.205910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9120f7-7931-4424-9693-8017695693c6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:07.209143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86884cbb-e0b4-48bb-97b0-052628de9aa6 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:07.217099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3f9120f7-7931-4424-9693-8017695693c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:07.294213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91c9af-01c9-46c3-823b-646d2bf76fea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:07.294702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91c9af-01c9-46c3-823b-646d2bf76fea service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:07.295051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91c9af-01c9-46c3-823b-646d2bf76fea service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:07.295333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91c9af-01c9-46c3-823b-646d2bf76fea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:07.297681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-db91c9af-01c9-46c3-823b-646d2bf76fea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:07.305666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9120f7-7931-4424-9693-8017695693c6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:07.321450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af6867-bcdb-4f19-bc78-93a26295b985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:07.323180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af6867-bcdb-4f19-bc78-93a26295b985 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:07.325657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af6867-bcdb-4f19-bc78-93a26295b985 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:07.326014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af6867-bcdb-4f19-bc78-93a26295b985 admin admin] PATH_INFO: `/v3/projects/64f567689acb4ab7b9a6d8af6459f87a/users/17538442f109479896480a0c97445aba/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:07.340681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:07.352266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af6867-bcdb-4f19-bc78-93a26295b985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64f567689acb4ab7b9a6d8af6459f87a, user_id=17538442f109479896480a0c97445aba, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:07.355065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af6867-bcdb-4f19-bc78-93a26295b985 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:07.370000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91c9af-01c9-46c3-823b-646d2bf76fea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:07.371656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91c9af-01c9-46c3-823b-646d2bf76fea service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:07.382130 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 861/1709] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:07.383110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91c9af-01c9-46c3-823b-646d2bf76fea service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:07.384780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-db91c9af-01c9-46c3-823b-646d2bf76fea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:07.460048 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 849/1710] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:07 2022] PUT /identity/v3/projects/64f567689acb4ab7b9a6d8af6459f87a/users/17538442f109479896480a0c97445aba/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:07.462670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6899e-9f46-4b40-bf85-2e732ad29f8a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:07.463698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6899e-9f46-4b40-bf85-2e732ad29f8a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:07.464590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6899e-9f46-4b40-bf85-2e732ad29f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:07.477527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91c9af-01c9-46c3-823b-646d2bf76fea service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:07.515305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b8e6899e-9f46-4b40-bf85-2e732ad29f8a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:07.518002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b8e6899e-9f46-4b40-bf85-2e732ad29f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:07.565227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb272da-5580-4c10-9ed0-c5c5df44cb98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:07.566516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb272da-5580-4c10-9ed0-c5c5df44cb98 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:07.567108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb272da-5580-4c10-9ed0-c5c5df44cb98 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:07.567641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb272da-5580-4c10-9ed0-c5c5df44cb98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:07.572152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5cb272da-5580-4c10-9ed0-c5c5df44cb98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:07.620169 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 850/1711] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:07.621670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d493ca-149d-4594-a2a2-18451326d4f8 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:07.622000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d493ca-149d-4594-a2a2-18451326d4f8 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:07.622233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d493ca-149d-4594-a2a2-18451326d4f8 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:07.623770 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 851/1712] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:08:07.629264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d493ca-149d-4594-a2a2-18451326d4f8 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:07.652700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d493ca-149d-4594-a2a2-18451326d4f8 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:07.657535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ec31f-29f8-46bd-a9b1-da68adcfe333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:07.658430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ec31f-29f8-46bd-a9b1-da68adcfe333 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:07.659527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ec31f-29f8-46bd-a9b1-da68adcfe333 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:07.659820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ec31f-29f8-46bd-a9b1-da68adcfe333 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:07.660702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ec31f-29f8-46bd-a9b1-da68adcfe333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:07.662531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ec31f-29f8-46bd-a9b1-da68adcfe333 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:07.664619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb272da-5580-4c10-9ed0-c5c5df44cb98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:07.667211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb272da-5580-4c10-9ed0-c5c5df44cb98 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:07.674353 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 852/1713] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:07.675530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ec31f-29f8-46bd-a9b1-da68adcfe333 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:07.678344 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 862/1714] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:07.679801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c63cc5-7d87-44af-a54e-ce63b77e29b4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:07.680094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c63cc5-7d87-44af-a54e-ce63b77e29b4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:07.686898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c63cc5-7d87-44af-a54e-ce63b77e29b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:07.687096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ec31f-29f8-46bd-a9b1-da68adcfe333 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:07.693429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d60c4f-a61a-482f-98e7-222b0e23d497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:07.695048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d60c4f-a61a-482f-98e7-222b0e23d497 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:07.695350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d60c4f-a61a-482f-98e7-222b0e23d497 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:07.695619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d60c4f-a61a-482f-98e7-222b0e23d497 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:07.696356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d60c4f-a61a-482f-98e7-222b0e23d497 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:08:07.696663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d60c4f-a61a-482f-98e7-222b0e23d497 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:07.698278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d60c4f-a61a-482f-98e7-222b0e23d497 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:07.700755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-47c63cc5-7d87-44af-a54e-ce63b77e29b4 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:07.702006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-47c63cc5-7d87-44af-a54e-ce63b77e29b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:07.712513 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 853/1715] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:07.713371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d60c4f-a61a-482f-98e7-222b0e23d497 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:07.715060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-31d60c4f-a61a-482f-98e7-222b0e23d497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:07.729211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d60c4f-a61a-482f-98e7-222b0e23d497 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:07.733845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5c9df-1b54-46dd-add3-74a8f94eaf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:07.734730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5c9df-1b54-46dd-add3-74a8f94eaf8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:07.734983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5c9df-1b54-46dd-add3-74a8f94eaf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:07.735285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5c9df-1b54-46dd-add3-74a8f94eaf8a admin admin] PATH_INFO: `/v3/projects/b0b268e0b58f480e8c999c9f518f3bb4` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:07.736458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5c9df-1b54-46dd-add3-74a8f94eaf8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0b268e0b58f480e8c999c9f518f3bb4)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:07.738526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5c9df-1b54-46dd-add3-74a8f94eaf8a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:07.773736 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 863/1716] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:08:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:07.774581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c63cc5-7d87-44af-a54e-ce63b77e29b4 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:07.789524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c63cc5-7d87-44af-a54e-ce63b77e29b4 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:07.795457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb6e90-8a2d-4a57-bdf5-450c1baa4ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:07.796351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb6e90-8a2d-4a57-bdf5-450c1baa4ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:07.796631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb6e90-8a2d-4a57-bdf5-450c1baa4ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:07.796909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb6e90-8a2d-4a57-bdf5-450c1baa4ff6 admin admin] PATH_INFO: `/v3/projects/64f567689acb4ab7b9a6d8af6459f87a/users/17538442f109479896480a0c97445aba/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:07.799391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb6e90-8a2d-4a57-bdf5-450c1baa4ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64f567689acb4ab7b9a6d8af6459f87a, user_id=17538442f109479896480a0c97445aba, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:07.802294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb6e90-8a2d-4a57-bdf5-450c1baa4ff6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:07.849244 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 864/1717] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:07 2022] PUT /identity/v3/projects/64f567689acb4ab7b9a6d8af6459f87a/users/17538442f109479896480a0c97445aba/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:07.849244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb6e90-8a2d-4a57-bdf5-450c1baa4ff6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:07.896741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:07.913141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-91d5c9df-1b54-46dd-add3-74a8f94eaf8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0b268e0b58f480e8c999c9f518f3bb4', 'request_id': 'req-91d5c9df-1b54-46dd-add3-74a8f94eaf8a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:07.918447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-91d5c9df-1b54-46dd-add3-74a8f94eaf8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0b268e0b58f480e8c999c9f518f3bb4', 'request_id': 'req-91d5c9df-1b54-46dd-add3-74a8f94eaf8a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:07.924577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-91d5c9df-1b54-46dd-add3-74a8f94eaf8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0b268e0b58f480e8c999c9f518f3bb4', 'request_id': 'req-91d5c9df-1b54-46dd-add3-74a8f94eaf8a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:07.926978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb6e90-8a2d-4a57-bdf5-450c1baa4ff6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:07.937920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:07.992769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fb604-dee6-46cb-a9ac-7d2cc7973559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:07.992769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fb604-dee6-46cb-a9ac-7d2cc7973559 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:07.992769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fb604-dee6-46cb-a9ac-7d2cc7973559 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:07.992769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fb604-dee6-46cb-a9ac-7d2cc7973559 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:07.993643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fb604-dee6-46cb-a9ac-7d2cc7973559 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:07.993643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fb604-dee6-46cb-a9ac-7d2cc7973559 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:08.075033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-91d5c9df-1b54-46dd-add3-74a8f94eaf8a admin admin] The token cache is being invalidate because project b0b268e0b58f480e8c999c9f518f3bb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:08.075515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-91d5c9df-1b54-46dd-add3-74a8f94eaf8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:08.076726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-91d5c9df-1b54-46dd-add3-74a8f94eaf8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:08.083726 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 854/1718] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:07 2022] DELETE /identity/v3/projects/b0b268e0b58f480e8c999c9f518f3bb4 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:08.085331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5c9df-1b54-46dd-add3-74a8f94eaf8a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:08.087366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-91d5c9df-1b54-46dd-add3-74a8f94eaf8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:08.150166 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 865/1719] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:07 2022] POST /identity/v3/projects => generated 389 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:08.150166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fb604-dee6-46cb-a9ac-7d2cc7973559 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:08.150166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c93fb604-dee6-46cb-a9ac-7d2cc7973559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:08.173776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5c9df-1b54-46dd-add3-74a8f94eaf8a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:08.249375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fb604-dee6-46cb-a9ac-7d2cc7973559 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:08.265837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54392424-bb9d-4d2e-9d40-5f23b0979156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:08.266830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54392424-bb9d-4d2e-9d40-5f23b0979156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:08.267386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54392424-bb9d-4d2e-9d40-5f23b0979156 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:08.267578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54392424-bb9d-4d2e-9d40-5f23b0979156 admin admin] PATH_INFO: `/v3/projects/6907a091f6a844a3afc38f380ea3ca57` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:08.269122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a4574-7e21-4f93-acef-f5ec7f06fc9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:08.269862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54392424-bb9d-4d2e-9d40-5f23b0979156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6907a091f6a844a3afc38f380ea3ca57)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:08.269978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a4574-7e21-4f93-acef-f5ec7f06fc9e service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:08.270307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a4574-7e21-4f93-acef-f5ec7f06fc9e service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:08.270646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a4574-7e21-4f93-acef-f5ec7f06fc9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:08.272645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54392424-bb9d-4d2e-9d40-5f23b0979156 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:08.273062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8e9a4574-7e21-4f93-acef-f5ec7f06fc9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:08.286099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a4574-7e21-4f93-acef-f5ec7f06fc9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:08.287774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a4574-7e21-4f93-acef-f5ec7f06fc9e service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:08.298440 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 855/1720] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:08.300404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594d86f-d36f-4523-b09a-4769512eec6a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:08.300687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594d86f-d36f-4523-b09a-4769512eec6a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:08.300956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594d86f-d36f-4523-b09a-4769512eec6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:08.316296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:08.329107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a594d86f-d36f-4523-b09a-4769512eec6a None None] MFA Rules not processed for user `17538442f109479896480a0c97445aba`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:08.330433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a594d86f-d36f-4523-b09a-4769512eec6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:08.392646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-54392424-bb9d-4d2e-9d40-5f23b0979156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6907a091f6a844a3afc38f380ea3ca57', 'request_id': 'req-54392424-bb9d-4d2e-9d40-5f23b0979156'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:08.401137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-54392424-bb9d-4d2e-9d40-5f23b0979156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6907a091f6a844a3afc38f380ea3ca57', 'request_id': 'req-54392424-bb9d-4d2e-9d40-5f23b0979156'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:08.407242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-54392424-bb9d-4d2e-9d40-5f23b0979156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6907a091f6a844a3afc38f380ea3ca57', 'request_id': 'req-54392424-bb9d-4d2e-9d40-5f23b0979156'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:08.422696 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 856/1721] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:08 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:08.424696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594d86f-d36f-4523-b09a-4769512eec6a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:08.426131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a594d86f-d36f-4523-b09a-4769512eec6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:08.439774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594d86f-d36f-4523-b09a-4769512eec6a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:08.509085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-54392424-bb9d-4d2e-9d40-5f23b0979156 admin admin] The token cache is being invalidate because project 6907a091f6a844a3afc38f380ea3ca57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:08.509085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-54392424-bb9d-4d2e-9d40-5f23b0979156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:08.509409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d8713-7398-4ea4-b0dc-c9ffaab7866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:08.509409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d8713-7398-4ea4-b0dc-c9ffaab7866b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:08.509409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d8713-7398-4ea4-b0dc-c9ffaab7866b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:08.509409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d8713-7398-4ea4-b0dc-c9ffaab7866b admin admin] PATH_INFO: `/v3/users/965b7cf10d9b4da2bca5aa0f4782357a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:08.509713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d8713-7398-4ea4-b0dc-c9ffaab7866b admin admin] RBAC: Authorizing `identity:delete_user(user_id=965b7cf10d9b4da2bca5aa0f4782357a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:08.509713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d8713-7398-4ea4-b0dc-c9ffaab7866b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:08.511206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-54392424-bb9d-4d2e-9d40-5f23b0979156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:08.516618 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 866/1722] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:08 2022] DELETE /identity/v3/projects/6907a091f6a844a3afc38f380ea3ca57 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:08.516618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54392424-bb9d-4d2e-9d40-5f23b0979156 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:08.516618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-54392424-bb9d-4d2e-9d40-5f23b0979156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:08.530935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54392424-bb9d-4d2e-9d40-5f23b0979156 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:08.536134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b56c0-c695-437a-b9ff-397432f26516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:08.536938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b56c0-c695-437a-b9ff-397432f26516 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:08.537285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b56c0-c695-437a-b9ff-397432f26516 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:08.537627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b56c0-c695-437a-b9ff-397432f26516 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:08.538385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b56c0-c695-437a-b9ff-397432f26516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:08.540436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b56c0-c695-437a-b9ff-397432f26516 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:08.669507 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 867/1723] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:08 2022] POST /identity/v3/users => generated 295 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:08.670338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b56c0-c695-437a-b9ff-397432f26516 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:08.672009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7a8b56c0-c695-437a-b9ff-397432f26516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:08.683941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b56c0-c695-437a-b9ff-397432f26516 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:08.688779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ac35f-0009-4d55-aadc-177314c0a294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:08.689637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ac35f-0009-4d55-aadc-177314c0a294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:08.690036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ac35f-0009-4d55-aadc-177314c0a294 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:08.690312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ac35f-0009-4d55-aadc-177314c0a294 admin admin] PATH_INFO: `/v3/projects/ba432093c99945c1af32f04d896809b6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:08.691527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ac35f-0009-4d55-aadc-177314c0a294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba432093c99945c1af32f04d896809b6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:08.693477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ac35f-0009-4d55-aadc-177314c0a294 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:08.804295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fa7d8713-7398-4ea4-b0dc-c9ffaab7866b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '965b7cf10d9b4da2bca5aa0f4782357a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:08.816651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fa7d8713-7398-4ea4-b0dc-c9ffaab7866b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '965b7cf10d9b4da2bca5aa0f4782357a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:08.836279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e90ac35f-0009-4d55-aadc-177314c0a294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba432093c99945c1af32f04d896809b6', 'request_id': 'req-e90ac35f-0009-4d55-aadc-177314c0a294'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:08.843192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e90ac35f-0009-4d55-aadc-177314c0a294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba432093c99945c1af32f04d896809b6', 'request_id': 'req-e90ac35f-0009-4d55-aadc-177314c0a294'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:08.857149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e90ac35f-0009-4d55-aadc-177314c0a294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba432093c99945c1af32f04d896809b6', 'request_id': 'req-e90ac35f-0009-4d55-aadc-177314c0a294'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:08.960649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fa7d8713-7398-4ea4-b0dc-c9ffaab7866b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '965b7cf10d9b4da2bca5aa0f4782357a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:08.968518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fa7d8713-7398-4ea4-b0dc-c9ffaab7866b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '965b7cf10d9b4da2bca5aa0f4782357a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:08.969305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fa7d8713-7398-4ea4-b0dc-c9ffaab7866b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '965b7cf10d9b4da2bca5aa0f4782357a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:08.975760 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 857/1724] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:08 2022] DELETE /identity/v3/users/965b7cf10d9b4da2bca5aa0f4782357a => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:08.976584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d8713-7398-4ea4-b0dc-c9ffaab7866b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:08.978046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fa7d8713-7398-4ea4-b0dc-c9ffaab7866b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:09.058558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e90ac35f-0009-4d55-aadc-177314c0a294 admin admin] The token cache is being invalidate because project ba432093c99945c1af32f04d896809b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:09.059130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e90ac35f-0009-4d55-aadc-177314c0a294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:09.059423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e90ac35f-0009-4d55-aadc-177314c0a294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:09.061311 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 868/1725] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:08 2022] DELETE /identity/v3/projects/ba432093c99945c1af32f04d896809b6 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:09.062413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa491e8-a770-4b3f-b142-a02dcb9f24f4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:09.062702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa491e8-a770-4b3f-b142-a02dcb9f24f4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:09.062980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa491e8-a770-4b3f-b142-a02dcb9f24f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:09.069636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d8713-7398-4ea4-b0dc-c9ffaab7866b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:09.075466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfc99f-3cb9-4241-a48f-c51964265d4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:09.076143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfc99f-3cb9-4241-a48f-c51964265d4b service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:09.076426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfc99f-3cb9-4241-a48f-c51964265d4b service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:09.076721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfc99f-3cb9-4241-a48f-c51964265d4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:09.078559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cbcfc99f-3cb9-4241-a48f-c51964265d4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:09.082050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0aa491e8-a770-4b3f-b142-a02dcb9f24f4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:09.083277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0aa491e8-a770-4b3f-b142-a02dcb9f24f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:09.149321 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 869/1726] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:09.150232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa491e8-a770-4b3f-b142-a02dcb9f24f4 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:09.157313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0aa491e8-a770-4b3f-b142-a02dcb9f24f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:09.165831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfc99f-3cb9-4241-a48f-c51964265d4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:09.167481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfc99f-3cb9-4241-a48f-c51964265d4b service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:09.170097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa491e8-a770-4b3f-b142-a02dcb9f24f4 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:09.175980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5a3f3-2874-4152-bd4f-ff9556a5dc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:09.176667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5a3f3-2874-4152-bd4f-ff9556a5dc18 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:09.176946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5a3f3-2874-4152-bd4f-ff9556a5dc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:09.182396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5a3f3-2874-4152-bd4f-ff9556a5dc18 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:09.182396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5a3f3-2874-4152-bd4f-ff9556a5dc18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:09.182396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5a3f3-2874-4152-bd4f-ff9556a5dc18 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:09.187375 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 858/1727] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:08 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:09.188944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfc99f-3cb9-4241-a48f-c51964265d4b service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:09.193679 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 870/1728] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:09.193822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cbcfc99f-3cb9-4241-a48f-c51964265d4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:09.193912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5a3f3-2874-4152-bd4f-ff9556a5dc18 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:09.193912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-00e5a3f3-2874-4152-bd4f-ff9556a5dc18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:09.207334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5a3f3-2874-4152-bd4f-ff9556a5dc18 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:09.210706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfc99f-3cb9-4241-a48f-c51964265d4b service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:09.212561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41702a7b-a1e1-4a41-9b22-bf50746cfe0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:09.213126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41702a7b-a1e1-4a41-9b22-bf50746cfe0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:09.221802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41702a7b-a1e1-4a41-9b22-bf50746cfe0e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:09.221802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41702a7b-a1e1-4a41-9b22-bf50746cfe0e admin admin] PATH_INFO: `/v3/users/b09a625f203b408bafa8d76043c61862` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:09.221802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41702a7b-a1e1-4a41-9b22-bf50746cfe0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b09a625f203b408bafa8d76043c61862)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:09.221802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41702a7b-a1e1-4a41-9b22-bf50746cfe0e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:09.222339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e43f21-e844-429e-bf1d-11f95c00ee70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:09.222339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e43f21-e844-429e-bf1d-11f95c00ee70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:09.222339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e43f21-e844-429e-bf1d-11f95c00ee70 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:09.222339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e43f21-e844-429e-bf1d-11f95c00ee70 admin admin] PATH_INFO: `/v3/users/1bf0c339207d43538dcffce1aa9e2beb` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:09.222847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e43f21-e844-429e-bf1d-11f95c00ee70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bf0c339207d43538dcffce1aa9e2beb)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:09.224979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e43f21-e844-429e-bf1d-11f95c00ee70 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:09.485765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-41702a7b-a1e1-4a41-9b22-bf50746cfe0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b09a625f203b408bafa8d76043c61862'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:09.493730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-41702a7b-a1e1-4a41-9b22-bf50746cfe0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b09a625f203b408bafa8d76043c61862'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:09.537144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-57e43f21-e844-429e-bf1d-11f95c00ee70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bf0c339207d43538dcffce1aa9e2beb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:09.550119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-57e43f21-e844-429e-bf1d-11f95c00ee70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bf0c339207d43538dcffce1aa9e2beb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:09.606490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-41702a7b-a1e1-4a41-9b22-bf50746cfe0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b09a625f203b408bafa8d76043c61862'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:09.607056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-41702a7b-a1e1-4a41-9b22-bf50746cfe0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b09a625f203b408bafa8d76043c61862'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:09.620554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-41702a7b-a1e1-4a41-9b22-bf50746cfe0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b09a625f203b408bafa8d76043c61862'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:09.626394 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 871/1729] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:09 2022] DELETE /identity/v3/users/b09a625f203b408bafa8d76043c61862 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:09.627784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaafeb7-6a3f-4882-83f4-c4e51b6fb6bc None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:09.628060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaafeb7-6a3f-4882-83f4-c4e51b6fb6bc None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:09.628332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaafeb7-6a3f-4882-83f4-c4e51b6fb6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:09.646397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-dcaafeb7-6a3f-4882-83f4-c4e51b6fb6bc None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:09.647910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dcaafeb7-6a3f-4882-83f4-c4e51b6fb6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:09.648445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:09.686860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-57e43f21-e844-429e-bf1d-11f95c00ee70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bf0c339207d43538dcffce1aa9e2beb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:09.697458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-57e43f21-e844-429e-bf1d-11f95c00ee70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bf0c339207d43538dcffce1aa9e2beb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:09.701151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-57e43f21-e844-429e-bf1d-11f95c00ee70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bf0c339207d43538dcffce1aa9e2beb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:09.706768 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 859/1730] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:09 2022] DELETE /identity/v3/users/1bf0c339207d43538dcffce1aa9e2beb => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:09.707994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e43f21-e844-429e-bf1d-11f95c00ee70 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:09.710256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-57e43f21-e844-429e-bf1d-11f95c00ee70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:09.727191 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 872/1731] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:09.728205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaafeb7-6a3f-4882-83f4-c4e51b6fb6bc None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:09.729687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dcaafeb7-6a3f-4882-83f4-c4e51b6fb6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:09.795218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e43f21-e844-429e-bf1d-11f95c00ee70 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:09.801394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e85bc-a86f-4ea2-b209-30272c99781b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:09.802098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e85bc-a86f-4ea2-b209-30272c99781b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:09.802389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e85bc-a86f-4ea2-b209-30272c99781b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:09.802665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e85bc-a86f-4ea2-b209-30272c99781b admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:09.803461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e85bc-a86f-4ea2-b209-30272c99781b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:09.805858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e85bc-a86f-4ea2-b209-30272c99781b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:09.816834 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 860/1732] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:09.817687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e85bc-a86f-4ea2-b209-30272c99781b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:09.821243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-186e85bc-a86f-4ea2-b209-30272c99781b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:09.825867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaafeb7-6a3f-4882-83f4-c4e51b6fb6bc None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:09.832839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:09.835359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e85bc-a86f-4ea2-b209-30272c99781b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:09.840062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f871279-4725-4264-bb6a-80c163066ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:09.840922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f871279-4725-4264-bb6a-80c163066ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:09.841205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f871279-4725-4264-bb6a-80c163066ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:09.841479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f871279-4725-4264-bb6a-80c163066ec6 admin admin] PATH_INFO: `/v3/projects/30df0b9ba27347a4b290a119c7fad4df` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:09.842666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f871279-4725-4264-bb6a-80c163066ec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30df0b9ba27347a4b290a119c7fad4df)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:09.844662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f871279-4725-4264-bb6a-80c163066ec6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:09.901468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4474f01-9991-457e-810c-d1bba6cc39d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:09.905109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4474f01-9991-457e-810c-d1bba6cc39d4 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:09.905109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4474f01-9991-457e-810c-d1bba6cc39d4 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:09.905109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4474f01-9991-457e-810c-d1bba6cc39d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:09.905109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e4474f01-9991-457e-810c-d1bba6cc39d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:09.976702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4474f01-9991-457e-810c-d1bba6cc39d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:09.978987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4474f01-9991-457e-810c-d1bba6cc39d4 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:09.990293 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 873/1733] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:09.991838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d5968-7061-4f31-9e28-c58568e9219a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:09.992020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d5968-7061-4f31-9e28-c58568e9219a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:09.992384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d5968-7061-4f31-9e28-c58568e9219a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:10.012984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ec3d5968-7061-4f31-9e28-c58568e9219a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:10.012984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ec3d5968-7061-4f31-9e28-c58568e9219a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:10.027398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4f871279-4725-4264-bb6a-80c163066ec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30df0b9ba27347a4b290a119c7fad4df', 'request_id': 'req-4f871279-4725-4264-bb6a-80c163066ec6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:10.035925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4f871279-4725-4264-bb6a-80c163066ec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30df0b9ba27347a4b290a119c7fad4df', 'request_id': 'req-4f871279-4725-4264-bb6a-80c163066ec6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:10.043885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4f871279-4725-4264-bb6a-80c163066ec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30df0b9ba27347a4b290a119c7fad4df', 'request_id': 'req-4f871279-4725-4264-bb6a-80c163066ec6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:10.120300 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 874/1734] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:10.120300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d5968-7061-4f31-9e28-c58568e9219a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:10.134655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4f871279-4725-4264-bb6a-80c163066ec6 admin admin] The token cache is being invalidate because project 30df0b9ba27347a4b290a119c7fad4df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:10.134888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4f871279-4725-4264-bb6a-80c163066ec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:10.140531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4f871279-4725-4264-bb6a-80c163066ec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:10.142246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d5968-7061-4f31-9e28-c58568e9219a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:10.143792 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 861/1735] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:09 2022] DELETE /identity/v3/projects/30df0b9ba27347a4b290a119c7fad4df => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:10.144770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f871279-4725-4264-bb6a-80c163066ec6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:10.146197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4f871279-4725-4264-bb6a-80c163066ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:10.152392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9183837-7f3b-4145-8d16-dfe7cac9808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:10.153438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9183837-7f3b-4145-8d16-dfe7cac9808c admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:10.153823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9183837-7f3b-4145-8d16-dfe7cac9808c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:10.154195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9183837-7f3b-4145-8d16-dfe7cac9808c admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:10.155332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9183837-7f3b-4145-8d16-dfe7cac9808c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:08:10.156292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9183837-7f3b-4145-8d16-dfe7cac9808c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:10.158454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9183837-7f3b-4145-8d16-dfe7cac9808c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:10.163837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f871279-4725-4264-bb6a-80c163066ec6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:10.175222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d043e72-ea40-431a-8dcf-cd9747fb5226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:10.176552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d043e72-ea40-431a-8dcf-cd9747fb5226 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:10.177031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d043e72-ea40-431a-8dcf-cd9747fb5226 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:10.177415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d043e72-ea40-431a-8dcf-cd9747fb5226 admin admin] PATH_INFO: `/v3/projects/7981b0049dfa4112b2f22ef551b3e96d/users/bbb4d474e4f94b78a616e6d9782fb2ac/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:10.193475 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 875/1736] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:10.194968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d49fb-9587-4674-843a-13e43445971f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:10.195288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d49fb-9587-4674-843a-13e43445971f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:10.195647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d49fb-9587-4674-843a-13e43445971f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:10.206833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d043e72-ea40-431a-8dcf-cd9747fb5226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7981b0049dfa4112b2f22ef551b3e96d, user_id=bbb4d474e4f94b78a616e6d9782fb2ac, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:10.209663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d043e72-ea40-431a-8dcf-cd9747fb5226 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:10.218206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-251d49fb-9587-4674-843a-13e43445971f None None] MFA Rules not processed for user `db6c21ea09c54ea492d806f42d2f69a7`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:10.220292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-251d49fb-9587-4674-843a-13e43445971f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:10.289509 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 876/1737] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:10.291113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d49fb-9587-4674-843a-13e43445971f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:10.299649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-251d49fb-9587-4674-843a-13e43445971f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:10.346503 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 862/1738] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:10 2022] PUT /identity/v3/projects/7981b0049dfa4112b2f22ef551b3e96d/users/bbb4d474e4f94b78a616e6d9782fb2ac/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:10.348532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e34a20-84c8-4887-a63c-0451c206c709 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:10.348816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e34a20-84c8-4887-a63c-0451c206c709 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:10.350752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e34a20-84c8-4887-a63c-0451c206c709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:10.356588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d49fb-9587-4674-843a-13e43445971f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:10.373568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-45e34a20-84c8-4887-a63c-0451c206c709 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:10.374662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-45e34a20-84c8-4887-a63c-0451c206c709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:10.409593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752fe36-8681-425e-b6ad-069123241f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:10.410401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752fe36-8681-425e-b6ad-069123241f48 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:10.410731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752fe36-8681-425e-b6ad-069123241f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:10.411033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752fe36-8681-425e-b6ad-069123241f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:10.412920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7752fe36-8681-425e-b6ad-069123241f48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:10.443074 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 863/1739] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:10.443074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e34a20-84c8-4887-a63c-0451c206c709 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:10.443074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-45e34a20-84c8-4887-a63c-0451c206c709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:10.450744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e34a20-84c8-4887-a63c-0451c206c709 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:10.456121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108a8e4-04f9-46c4-b2e4-ed4b5ea7d882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:10.457000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108a8e4-04f9-46c4-b2e4-ed4b5ea7d882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:10.457281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108a8e4-04f9-46c4-b2e4-ed4b5ea7d882 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:10.457725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108a8e4-04f9-46c4-b2e4-ed4b5ea7d882 admin admin] PATH_INFO: `/v3/projects/6ee2739c1c9c451f8136d38bd945ada8` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:10.458935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108a8e4-04f9-46c4-b2e4-ed4b5ea7d882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ee2739c1c9c451f8136d38bd945ada8)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:10.460869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108a8e4-04f9-46c4-b2e4-ed4b5ea7d882 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:10.481442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752fe36-8681-425e-b6ad-069123241f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:10.482951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752fe36-8681-425e-b6ad-069123241f48 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:10.494191 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 877/1740] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:10.494994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752fe36-8681-425e-b6ad-069123241f48 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:10.496334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7752fe36-8681-425e-b6ad-069123241f48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:10.508868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752fe36-8681-425e-b6ad-069123241f48 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:10.513957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad4c08-fdbc-4157-bb6b-26be7ad1b184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:10.518098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad4c08-fdbc-4157-bb6b-26be7ad1b184 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:10.518098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad4c08-fdbc-4157-bb6b-26be7ad1b184 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:10.518098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad4c08-fdbc-4157-bb6b-26be7ad1b184 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:10.518098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad4c08-fdbc-4157-bb6b-26be7ad1b184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:10.518913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad4c08-fdbc-4157-bb6b-26be7ad1b184 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:10.624626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a108a8e4-04f9-46c4-b2e4-ed4b5ea7d882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ee2739c1c9c451f8136d38bd945ada8', 'request_id': 'req-a108a8e4-04f9-46c4-b2e4-ed4b5ea7d882'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:10.630127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a108a8e4-04f9-46c4-b2e4-ed4b5ea7d882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ee2739c1c9c451f8136d38bd945ada8', 'request_id': 'req-a108a8e4-04f9-46c4-b2e4-ed4b5ea7d882'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:10.636440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a108a8e4-04f9-46c4-b2e4-ed4b5ea7d882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ee2739c1c9c451f8136d38bd945ada8', 'request_id': 'req-a108a8e4-04f9-46c4-b2e4-ed4b5ea7d882'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:10.653983 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 878/1741] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:10 2022] POST /identity/v3/projects => generated 403 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:10.655721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad4c08-fdbc-4157-bb6b-26be7ad1b184 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:10.656652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4bad4c08-fdbc-4157-bb6b-26be7ad1b184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:10.737309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad4c08-fdbc-4157-bb6b-26be7ad1b184 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:10.743880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea67a2-a517-40a4-90f5-fb770ff0cff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:10.744543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea67a2-a517-40a4-90f5-fb770ff0cff2 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:10.744826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea67a2-a517-40a4-90f5-fb770ff0cff2 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:10.745100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea67a2-a517-40a4-90f5-fb770ff0cff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:10.747125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-80ea67a2-a517-40a4-90f5-fb770ff0cff2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:10.749559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a108a8e4-04f9-46c4-b2e4-ed4b5ea7d882 admin admin] The token cache is being invalidate because project 6ee2739c1c9c451f8136d38bd945ada8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:10.756897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a108a8e4-04f9-46c4-b2e4-ed4b5ea7d882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:10.756897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a108a8e4-04f9-46c4-b2e4-ed4b5ea7d882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:10.756897 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 864/1742] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:10 2022] DELETE /identity/v3/projects/6ee2739c1c9c451f8136d38bd945ada8 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:10.756897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108a8e4-04f9-46c4-b2e4-ed4b5ea7d882 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:10.758551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a108a8e4-04f9-46c4-b2e4-ed4b5ea7d882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:10.818408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea67a2-a517-40a4-90f5-fb770ff0cff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:10.820504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea67a2-a517-40a4-90f5-fb770ff0cff2 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:10.829224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108a8e4-04f9-46c4-b2e4-ed4b5ea7d882 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:10.834087 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 879/1743] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:10.835924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6201c-1b74-4e35-aa4b-97bfdfc33c90 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:10.836563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6201c-1b74-4e35-aa4b-97bfdfc33c90 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:10.837032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6201c-1b74-4e35-aa4b-97bfdfc33c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:10.876408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-eca6201c-1b74-4e35-aa4b-97bfdfc33c90 None None] MFA Rules not processed for user `bbb4d474e4f94b78a616e6d9782fb2ac`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:10.876845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-eca6201c-1b74-4e35-aa4b-97bfdfc33c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:10.894501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc4ef4-636e-4281-b224-0c52c4ded3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:10.896127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc4ef4-636e-4281-b224-0c52c4ded3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:10.896678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc4ef4-636e-4281-b224-0c52c4ded3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:10.899995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc4ef4-636e-4281-b224-0c52c4ded3e4 admin admin] PATH_INFO: `/v3/users/9b61d9df6f51477f9e1c2072a03a073c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:10.899995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc4ef4-636e-4281-b224-0c52c4ded3e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b61d9df6f51477f9e1c2072a03a073c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:10.900779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc4ef4-636e-4281-b224-0c52c4ded3e4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:10.949699 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 880/1744] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:10.951072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f39f6-0497-4e7a-9aea-169e8331cff5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:10.951390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f39f6-0497-4e7a-9aea-169e8331cff5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:10.951711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f39f6-0497-4e7a-9aea-169e8331cff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:10.970051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a55f39f6-0497-4e7a-9aea-169e8331cff5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:10.974434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a55f39f6-0497-4e7a-9aea-169e8331cff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:10.980387 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 881/1745] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:10.981199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f39f6-0497-4e7a-9aea-169e8331cff5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:10.986076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a55f39f6-0497-4e7a-9aea-169e8331cff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:10.996941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f39f6-0497-4e7a-9aea-169e8331cff5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:11.001917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8e63b-de58-4ed7-ba76-233274149573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:11.003726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8e63b-de58-4ed7-ba76-233274149573 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:11.003726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8e63b-de58-4ed7-ba76-233274149573 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:11.003873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8e63b-de58-4ed7-ba76-233274149573 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:11.004687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8e63b-de58-4ed7-ba76-233274149573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:11.006535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8e63b-de58-4ed7-ba76-233274149573 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:11.133364 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 882/1746] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:10 2022] POST /identity/v3/users => generated 302 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:11.134662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29e5e5-0f0a-4672-9163-98c8b4e474d4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:11.134949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29e5e5-0f0a-4672-9163-98c8b4e474d4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:11.135251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29e5e5-0f0a-4672-9163-98c8b4e474d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:11.153160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-68bc4ef4-636e-4281-b224-0c52c4ded3e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b61d9df6f51477f9e1c2072a03a073c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:11.154042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0a29e5e5-0f0a-4672-9163-98c8b4e474d4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:11.155283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0a29e5e5-0f0a-4672-9163-98c8b4e474d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:11.163660 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 883/1747] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:11.165077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055beba2-4da9-4584-8da5-90feedcf9c29 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:11.165422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055beba2-4da9-4584-8da5-90feedcf9c29 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:11.165699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055beba2-4da9-4584-8da5-90feedcf9c29 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:11.167052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-68bc4ef4-636e-4281-b224-0c52c4ded3e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b61d9df6f51477f9e1c2072a03a073c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:11.167207 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 884/1748] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:08:11.167881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055beba2-4da9-4584-8da5-90feedcf9c29 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:11.169703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-055beba2-4da9-4584-8da5-90feedcf9c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:11.189839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055beba2-4da9-4584-8da5-90feedcf9c29 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:11.195997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c9ad1-ba3b-423d-9d68-6286214a6d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:11.196722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c9ad1-ba3b-423d-9d68-6286214a6d1b admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:11.197046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c9ad1-ba3b-423d-9d68-6286214a6d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:11.197395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c9ad1-ba3b-423d-9d68-6286214a6d1b admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:11.198164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c9ad1-ba3b-423d-9d68-6286214a6d1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:11.200665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c9ad1-ba3b-423d-9d68-6286214a6d1b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:11.243289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-68bc4ef4-636e-4281-b224-0c52c4ded3e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b61d9df6f51477f9e1c2072a03a073c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:11.250818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-68bc4ef4-636e-4281-b224-0c52c4ded3e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b61d9df6f51477f9e1c2072a03a073c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:11.251455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-68bc4ef4-636e-4281-b224-0c52c4ded3e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b61d9df6f51477f9e1c2072a03a073c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:11.258468 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 865/1749] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:10 2022] DELETE /identity/v3/users/9b61d9df6f51477f9e1c2072a03a073c => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:11.259311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc4ef4-636e-4281-b224-0c52c4ded3e4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:11.260630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-68bc4ef4-636e-4281-b224-0c52c4ded3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:11.326407 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 885/1750] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:11 2022] POST /identity/v3/projects => generated 391 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:11.326407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c9ad1-ba3b-423d-9d68-6286214a6d1b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:11.328347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-450c9ad1-ba3b-423d-9d68-6286214a6d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:11.351431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc4ef4-636e-4281-b224-0c52c4ded3e4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:11.393965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2258e-56ec-4680-bc19-fcea5bd0b39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:11.394800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2258e-56ec-4680-bc19-fcea5bd0b39b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:11.395194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2258e-56ec-4680-bc19-fcea5bd0b39b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:11.395477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2258e-56ec-4680-bc19-fcea5bd0b39b admin admin] PATH_INFO: `/v3/projects/5e8b80f1c27f4ba5b636e8852ee1fe52` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:11.396714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2258e-56ec-4680-bc19-fcea5bd0b39b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e8b80f1c27f4ba5b636e8852ee1fe52)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:11.396848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c9ad1-ba3b-423d-9d68-6286214a6d1b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:11.399128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2258e-56ec-4680-bc19-fcea5bd0b39b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:11.401726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d325b8-f253-42db-8d1c-98a2160e9cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:11.402380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d325b8-f253-42db-8d1c-98a2160e9cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:11.402662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d325b8-f253-42db-8d1c-98a2160e9cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:11.402936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d325b8-f253-42db-8d1c-98a2160e9cb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:11.403682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d325b8-f253-42db-8d1c-98a2160e9cb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:08:11.403990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d325b8-f253-42db-8d1c-98a2160e9cb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:11.405590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d325b8-f253-42db-8d1c-98a2160e9cb8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:11.418061 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 886/1751] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:11.418917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d325b8-f253-42db-8d1c-98a2160e9cb8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:11.420721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-04d325b8-f253-42db-8d1c-98a2160e9cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:11.435213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d325b8-f253-42db-8d1c-98a2160e9cb8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:11.440045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60767f2b-1e12-4f91-bd36-65f8246d9329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:11.441382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60767f2b-1e12-4f91-bd36-65f8246d9329 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:11.441675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60767f2b-1e12-4f91-bd36-65f8246d9329 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:11.441923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60767f2b-1e12-4f91-bd36-65f8246d9329 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:11.442644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60767f2b-1e12-4f91-bd36-65f8246d9329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:11.444266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60767f2b-1e12-4f91-bd36-65f8246d9329 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:11.455879 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 887/1752] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:11.457234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae52c8-341f-4b18-adde-ea833ee77108 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:11.457525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae52c8-341f-4b18-adde-ea833ee77108 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:11.457798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae52c8-341f-4b18-adde-ea833ee77108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:11.475105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-19ae52c8-341f-4b18-adde-ea833ee77108 None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:11.476291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-19ae52c8-341f-4b18-adde-ea833ee77108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:11.515903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aad2258e-56ec-4680-bc19-fcea5bd0b39b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e8b80f1c27f4ba5b636e8852ee1fe52', 'request_id': 'req-aad2258e-56ec-4680-bc19-fcea5bd0b39b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:11.522028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aad2258e-56ec-4680-bc19-fcea5bd0b39b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e8b80f1c27f4ba5b636e8852ee1fe52', 'request_id': 'req-aad2258e-56ec-4680-bc19-fcea5bd0b39b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:11.528791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aad2258e-56ec-4680-bc19-fcea5bd0b39b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e8b80f1c27f4ba5b636e8852ee1fe52', 'request_id': 'req-aad2258e-56ec-4680-bc19-fcea5bd0b39b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:11.534033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:11.544299 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 888/1753] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:08:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:11.545732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c269481-b6cd-4f8b-a680-548411eb3d3e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:11.546024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c269481-b6cd-4f8b-a680-548411eb3d3e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:11.546304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c269481-b6cd-4f8b-a680-548411eb3d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:11.561155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=15,keystone:SELECT=80,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:11.567765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4c269481-b6cd-4f8b-a680-548411eb3d3e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:11.568956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4c269481-b6cd-4f8b-a680-548411eb3d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:11.630655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aad2258e-56ec-4680-bc19-fcea5bd0b39b admin admin] The token cache is being invalidate because project 5e8b80f1c27f4ba5b636e8852ee1fe52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:11.631190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aad2258e-56ec-4680-bc19-fcea5bd0b39b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:11.631946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aad2258e-56ec-4680-bc19-fcea5bd0b39b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:11.633835 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 866/1754] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:11 2022] DELETE /identity/v3/projects/5e8b80f1c27f4ba5b636e8852ee1fe52 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:11.634577 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 889/1755] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:11.640190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c269481-b6cd-4f8b-a680-548411eb3d3e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:11.640422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f73ff-c03a-4f76-8c45-139b79cd0edb None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:11.640422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f73ff-c03a-4f76-8c45-139b79cd0edb None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:11.640422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f73ff-c03a-4f76-8c45-139b79cd0edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:11.645322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4c269481-b6cd-4f8b-a680-548411eb3d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:11.655287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c269481-b6cd-4f8b-a680-548411eb3d3e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:11.660213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-dd7f73ff-c03a-4f76-8c45-139b79cd0edb None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:11.660392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bb73f-77c5-4cb7-9bc0-816fec320ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:11.661028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bb73f-77c5-4cb7-9bc0-816fec320ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:11.661308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bb73f-77c5-4cb7-9bc0-816fec320ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:11.661609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bb73f-77c5-4cb7-9bc0-816fec320ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:11.661737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-dd7f73ff-c03a-4f76-8c45-139b79cd0edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:11.662379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bb73f-77c5-4cb7-9bc0-816fec320ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:11.664666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bb73f-77c5-4cb7-9bc0-816fec320ab1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:11.670122 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 867/1756] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:11.670930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f73ff-c03a-4f76-8c45-139b79cd0edb None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:11.675701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-dd7f73ff-c03a-4f76-8c45-139b79cd0edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:11.688022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f73ff-c03a-4f76-8c45-139b79cd0edb None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:11.693463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292362b2-7c5d-4773-9672-bebc6759144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:11.694252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292362b2-7c5d-4773-9672-bebc6759144e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:11.694534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292362b2-7c5d-4773-9672-bebc6759144e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:11.694808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292362b2-7c5d-4773-9672-bebc6759144e admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:11.695528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292362b2-7c5d-4773-9672-bebc6759144e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:11.697459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292362b2-7c5d-4773-9672-bebc6759144e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:11.790824 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 890/1757] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:11 2022] POST /identity/v3/users => generated 302 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:11.791708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bb73f-77c5-4cb7-9bc0-816fec320ab1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:11.793368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c59bb73f-77c5-4cb7-9bc0-816fec320ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:11.806480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bb73f-77c5-4cb7-9bc0-816fec320ab1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:11.811157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089f8b6-e841-40a8-a227-b5cf9a900783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:11.811813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089f8b6-e841-40a8-a227-b5cf9a900783 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:11.812104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089f8b6-e841-40a8-a227-b5cf9a900783 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:11.812388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089f8b6-e841-40a8-a227-b5cf9a900783 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:11.813133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089f8b6-e841-40a8-a227-b5cf9a900783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:11.814747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089f8b6-e841-40a8-a227-b5cf9a900783 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:11.825648 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 891/1758] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:11.826396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089f8b6-e841-40a8-a227-b5cf9a900783 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:11.828121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6089f8b6-e841-40a8-a227-b5cf9a900783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:11.834129 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 868/1759] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:11 2022] POST /identity/v3/projects => generated 409 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:11.834129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292362b2-7c5d-4773-9672-bebc6759144e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:11.838066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-292362b2-7c5d-4773-9672-bebc6759144e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:11.901286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292362b2-7c5d-4773-9672-bebc6759144e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:11.905808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a479b1-d567-4283-9574-40ce444c4b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:11.906722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a479b1-d567-4283-9574-40ce444c4b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:11.907040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a479b1-d567-4283-9574-40ce444c4b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:11.907319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a479b1-d567-4283-9574-40ce444c4b97 admin admin] PATH_INFO: `/v3/users/1c143f95261f496d9a43f3f89c686719` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:11.908544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a479b1-d567-4283-9574-40ce444c4b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c143f95261f496d9a43f3f89c686719)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:11.911183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a479b1-d567-4283-9574-40ce444c4b97 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:11.912984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089f8b6-e841-40a8-a227-b5cf9a900783 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:11.965819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cce31b-c0f8-4fd5-b1f7-7a8e200f47b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:11.966465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cce31b-c0f8-4fd5-b1f7-7a8e200f47b9 service glance] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:11.966751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cce31b-c0f8-4fd5-b1f7-7a8e200f47b9 service glance] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:11.967022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cce31b-c0f8-4fd5-b1f7-7a8e200f47b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:11.968834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-70cce31b-c0f8-4fd5-b1f7-7a8e200f47b9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:12.043870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cce31b-c0f8-4fd5-b1f7-7a8e200f47b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:12.045876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cce31b-c0f8-4fd5-b1f7-7a8e200f47b9 service glance] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:12.059365 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 892/1760] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:12.060216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cce31b-c0f8-4fd5-b1f7-7a8e200f47b9 service glance] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:12.061746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-70cce31b-c0f8-4fd5-b1f7-7a8e200f47b9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:12.075367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cce31b-c0f8-4fd5-b1f7-7a8e200f47b9 service glance] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:12.080112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4edddc-14dd-4e36-982f-b824bd14c8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:12.080768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4edddc-14dd-4e36-982f-b824bd14c8bf admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:12.081048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4edddc-14dd-4e36-982f-b824bd14c8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:12.081333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4edddc-14dd-4e36-982f-b824bd14c8bf admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:12.082046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4edddc-14dd-4e36-982f-b824bd14c8bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:08:12.082386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4edddc-14dd-4e36-982f-b824bd14c8bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:12.084098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4edddc-14dd-4e36-982f-b824bd14c8bf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:12.096472 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 893/1761] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:12.098067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4edddc-14dd-4e36-982f-b824bd14c8bf admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:12.099773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6e4edddc-14dd-4e36-982f-b824bd14c8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:12.118566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f5a479b1-d567-4283-9574-40ce444c4b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c143f95261f496d9a43f3f89c686719'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:12.131791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f5a479b1-d567-4283-9574-40ce444c4b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c143f95261f496d9a43f3f89c686719'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:12.168221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4edddc-14dd-4e36-982f-b824bd14c8bf admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:12.177087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204ef64-e6fe-46cb-aeeb-e7a303511681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:12.177830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204ef64-e6fe-46cb-aeeb-e7a303511681 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:12.178106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204ef64-e6fe-46cb-aeeb-e7a303511681 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:12.178375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204ef64-e6fe-46cb-aeeb-e7a303511681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:12.188876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204ef64-e6fe-46cb-aeeb-e7a303511681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:12.190332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204ef64-e6fe-46cb-aeeb-e7a303511681 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:12.203296 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 894/1762] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:12.208156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204ef64-e6fe-46cb-aeeb-e7a303511681 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:12.210129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7204ef64-e6fe-46cb-aeeb-e7a303511681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:12.224339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f5a479b1-d567-4283-9574-40ce444c4b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c143f95261f496d9a43f3f89c686719'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:12.225744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204ef64-e6fe-46cb-aeeb-e7a303511681 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:12.232666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4c654-b325-4a96-914b-7e3be198f44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:12.237775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4c654-b325-4a96-914b-7e3be198f44d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:12.237775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4c654-b325-4a96-914b-7e3be198f44d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:12.237775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4c654-b325-4a96-914b-7e3be198f44d admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:12.238083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f5a479b1-d567-4283-9574-40ce444c4b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c143f95261f496d9a43f3f89c686719'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:12.238174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4c654-b325-4a96-914b-7e3be198f44d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:12.238274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f5a479b1-d567-4283-9574-40ce444c4b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c143f95261f496d9a43f3f89c686719'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:12.238356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4c654-b325-4a96-914b-7e3be198f44d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:12.245894 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 869/1763] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:11 2022] DELETE /identity/v3/users/1c143f95261f496d9a43f3f89c686719 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:12.247862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a479b1-d567-4283-9574-40ce444c4b97 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:12.250089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f5a479b1-d567-4283-9574-40ce444c4b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:12.262052 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 895/1764] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:12.263578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4c654-b325-4a96-914b-7e3be198f44d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:12.266405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6fa4c654-b325-4a96-914b-7e3be198f44d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:12.295249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4c654-b325-4a96-914b-7e3be198f44d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:12.353725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a479b1-d567-4283-9574-40ce444c4b97 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:12.360031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb47e3a-ccd1-4f0f-acce-ab7fcf0671dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:12.361078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb47e3a-ccd1-4f0f-acce-ab7fcf0671dd admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:12.361474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb47e3a-ccd1-4f0f-acce-ab7fcf0671dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:12.361805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb47e3a-ccd1-4f0f-acce-ab7fcf0671dd admin admin] PATH_INFO: `/v3/projects/d0ee02e4c8b448f2b77798ae504129b9/users/ef9cbce2b2e64665b7f50767342dcb46/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:12.382639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb47e3a-ccd1-4f0f-acce-ab7fcf0671dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ee02e4c8b448f2b77798ae504129b9, user_id=ef9cbce2b2e64665b7f50767342dcb46, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:12.387051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb47e3a-ccd1-4f0f-acce-ab7fcf0671dd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:12.407219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fe8a1-9db1-481f-9043-5c4ffd00dac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:12.407956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fe8a1-9db1-481f-9043-5c4ffd00dac6 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:12.408347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fe8a1-9db1-481f-9043-5c4ffd00dac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:12.408687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fe8a1-9db1-481f-9043-5c4ffd00dac6 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:12.409531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fe8a1-9db1-481f-9043-5c4ffd00dac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:12.412865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fe8a1-9db1-481f-9043-5c4ffd00dac6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:12.511292 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 870/1765] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:12 2022] PUT /identity/v3/projects/d0ee02e4c8b448f2b77798ae504129b9/users/ef9cbce2b2e64665b7f50767342dcb46/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:12.512115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb47e3a-ccd1-4f0f-acce-ab7fcf0671dd admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:12.513751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-afb47e3a-ccd1-4f0f-acce-ab7fcf0671dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:12.519493 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 896/1766] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:12 2022] POST /identity/v3/users => generated 305 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:12.519493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fe8a1-9db1-481f-9043-5c4ffd00dac6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:12.521367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-691fe8a1-9db1-481f-9043-5c4ffd00dac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:12.535512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fe8a1-9db1-481f-9043-5c4ffd00dac6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:12.590867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:12.620260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb47e3a-ccd1-4f0f-acce-ab7fcf0671dd admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:12.627514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d881087-42c9-4de8-9b6e-16b40ba0eb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:12.629420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d881087-42c9-4de8-9b6e-16b40ba0eb9d admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:12.629953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d881087-42c9-4de8-9b6e-16b40ba0eb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:12.630458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d881087-42c9-4de8-9b6e-16b40ba0eb9d admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:12.632103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d881087-42c9-4de8-9b6e-16b40ba0eb9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:12.634812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d881087-42c9-4de8-9b6e-16b40ba0eb9d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:12.637349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50493efc-7425-419e-b068-8a138a7a632f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:12.638704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50493efc-7425-419e-b068-8a138a7a632f admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:12.638844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50493efc-7425-419e-b068-8a138a7a632f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:12.639155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50493efc-7425-419e-b068-8a138a7a632f admin admin] PATH_INFO: `/v3/projects/8ecb3d4d8ff944e987794279afa527a3/users/082f99b89371427f81e0bc85cae026dc/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:12.657451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:12.676252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50493efc-7425-419e-b068-8a138a7a632f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ecb3d4d8ff944e987794279afa527a3, user_id=082f99b89371427f81e0bc85cae026dc, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:12.679128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50493efc-7425-419e-b068-8a138a7a632f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:12.757084 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 871/1767] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:12 2022] POST /identity/v3/projects => generated 385 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:12.757084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12e151-b13b-4c0d-87b0-e70876b87a84 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:12.757084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12e151-b13b-4c0d-87b0-e70876b87a84 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:12.757084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12e151-b13b-4c0d-87b0-e70876b87a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:12.779933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0c12e151-b13b-4c0d-87b0-e70876b87a84 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:12.781185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0c12e151-b13b-4c0d-87b0-e70876b87a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:12.822523 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 897/1768] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:12 2022] PUT /identity/v3/projects/8ecb3d4d8ff944e987794279afa527a3/users/082f99b89371427f81e0bc85cae026dc/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:12.823310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50493efc-7425-419e-b068-8a138a7a632f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:12.886763 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 872/1769] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:12.888626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a84e37-3002-4194-ac3e-199cc31601e1 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:12.889389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a84e37-3002-4194-ac3e-199cc31601e1 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:12.889991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a84e37-3002-4194-ac3e-199cc31601e1 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:12.891382 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 873/1770] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:08:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:08:12.892232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a84e37-3002-4194-ac3e-199cc31601e1 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:12.913099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50493efc-7425-419e-b068-8a138a7a632f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:12.917914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e7df7-3685-4ba4-aca1-f2d1e431cd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:12.918580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e7df7-3685-4ba4-aca1-f2d1e431cd1e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:12.918972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e7df7-3685-4ba4-aca1-f2d1e431cd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:12.919279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e7df7-3685-4ba4-aca1-f2d1e431cd1e admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:12.920025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e7df7-3685-4ba4-aca1-f2d1e431cd1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:12.921622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e7df7-3685-4ba4-aca1-f2d1e431cd1e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:12.933505 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 898/1771] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:12.934734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e7df7-3685-4ba4-aca1-f2d1e431cd1e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:12.936619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8c9e7df7-3685-4ba4-aca1-f2d1e431cd1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:12.965831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a84e37-3002-4194-ac3e-199cc31601e1 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:12.979858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b368ed-d726-44bd-a822-33f6333a9a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:12.980563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b368ed-d726-44bd-a822-33f6333a9a68 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:12.980850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b368ed-d726-44bd-a822-33f6333a9a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:12.981159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b368ed-d726-44bd-a822-33f6333a9a68 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:12.982004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b368ed-d726-44bd-a822-33f6333a9a68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:12.984030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b368ed-d726-44bd-a822-33f6333a9a68 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:13.017397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e7df7-3685-4ba4-aca1-f2d1e431cd1e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:13.023055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7131d6-8d4c-4154-9905-8a10b016b63a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:13.028484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7131d6-8d4c-4154-9905-8a10b016b63a service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:13.028484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7131d6-8d4c-4154-9905-8a10b016b63a service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:13.028484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7131d6-8d4c-4154-9905-8a10b016b63a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:13.028484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7c7131d6-8d4c-4154-9905-8a10b016b63a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:13.037718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7131d6-8d4c-4154-9905-8a10b016b63a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:13.039466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7131d6-8d4c-4154-9905-8a10b016b63a service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:13.049409 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 899/1772] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:13.050830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7131d6-8d4c-4154-9905-8a10b016b63a service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:13.060897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7131d6-8d4c-4154-9905-8a10b016b63a service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:13.067227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d1bd8-f5fd-42e4-8f16-e37c7ed877dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:13.067969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d1bd8-f5fd-42e4-8f16-e37c7ed877dc admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:13.068251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d1bd8-f5fd-42e4-8f16-e37c7ed877dc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:13.068525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d1bd8-f5fd-42e4-8f16-e37c7ed877dc admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:13.069604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d1bd8-f5fd-42e4-8f16-e37c7ed877dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:13.071401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d1bd8-f5fd-42e4-8f16-e37c7ed877dc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:13.077097 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 874/1773] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:12 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:13.078709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b368ed-d726-44bd-a822-33f6333a9a68 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:13.081747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-18b368ed-d726-44bd-a822-33f6333a9a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:13.085352 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 900/1774] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:13.087156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d1bd8-f5fd-42e4-8f16-e37c7ed877dc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:13.091430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5f2d1bd8-f5fd-42e4-8f16-e37c7ed877dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:13.099879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b368ed-d726-44bd-a822-33f6333a9a68 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:13.105627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f67ad-d606-4f5a-a839-360028c51f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:13.106510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f67ad-d606-4f5a-a839-360028c51f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:13.106815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f67ad-d606-4f5a-a839-360028c51f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:13.107128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f67ad-d606-4f5a-a839-360028c51f45 admin admin] PATH_INFO: `/v3/projects/964640b04de845039e4b41cda5f555f1` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:13.108886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f67ad-d606-4f5a-a839-360028c51f45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=964640b04de845039e4b41cda5f555f1)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:13.111175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f67ad-d606-4f5a-a839-360028c51f45 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:13.157978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d1bd8-f5fd-42e4-8f16-e37c7ed877dc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:13.161777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e39d3-c956-455b-ae8d-93db7cbfebaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:13.162453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e39d3-c956-455b-ae8d-93db7cbfebaa service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:13.162767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e39d3-c956-455b-ae8d-93db7cbfebaa service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:13.162996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e39d3-c956-455b-ae8d-93db7cbfebaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:13.175636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e39d3-c956-455b-ae8d-93db7cbfebaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:13.177198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e39d3-c956-455b-ae8d-93db7cbfebaa service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:13.188073 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 901/1775] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:13.189281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d54ac-2c99-425d-8dbb-4fb6c17af53a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:13.189571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d54ac-2c99-425d-8dbb-4fb6c17af53a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:13.189854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d54ac-2c99-425d-8dbb-4fb6c17af53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:13.209869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-964d54ac-2c99-425d-8dbb-4fb6c17af53a None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:13.211244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-964d54ac-2c99-425d-8dbb-4fb6c17af53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:13.275126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a63f67ad-d606-4f5a-a839-360028c51f45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '964640b04de845039e4b41cda5f555f1', 'request_id': 'req-a63f67ad-d606-4f5a-a839-360028c51f45'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:13.280863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a63f67ad-d606-4f5a-a839-360028c51f45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '964640b04de845039e4b41cda5f555f1', 'request_id': 'req-a63f67ad-d606-4f5a-a839-360028c51f45'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:13.288216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a63f67ad-d606-4f5a-a839-360028c51f45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '964640b04de845039e4b41cda5f555f1', 'request_id': 'req-a63f67ad-d606-4f5a-a839-360028c51f45'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:13.291698 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 902/1776] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:08:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:13.292610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d54ac-2c99-425d-8dbb-4fb6c17af53a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:13.307787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d54ac-2c99-425d-8dbb-4fb6c17af53a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:13.359556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:13.370450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1215d-f6e6-43de-9863-de1587b26330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:13.370993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1215d-f6e6-43de-9863-de1587b26330 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:13.371300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1215d-f6e6-43de-9863-de1587b26330 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:13.371569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1215d-f6e6-43de-9863-de1587b26330 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:13.372291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1215d-f6e6-43de-9863-de1587b26330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:13.373887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1215d-f6e6-43de-9863-de1587b26330 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:13.387607 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 903/1777] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:13.448518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1215d-f6e6-43de-9863-de1587b26330 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:13.448518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-edb1215d-f6e6-43de-9863-de1587b26330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:13.448518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1215d-f6e6-43de-9863-de1587b26330 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:13.449471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d24b1-330c-4d40-bd1f-317d90a5f789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:13.449471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d24b1-330c-4d40-bd1f-317d90a5f789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:13.449471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d24b1-330c-4d40-bd1f-317d90a5f789 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:13.449471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d24b1-330c-4d40-bd1f-317d90a5f789 admin admin] PATH_INFO: `/v3/projects/93ef716961464e6ca518f2cab3bf1fda` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:13.449909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d24b1-330c-4d40-bd1f-317d90a5f789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93ef716961464e6ca518f2cab3bf1fda)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:13.449909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d24b1-330c-4d40-bd1f-317d90a5f789 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:13.635263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a63f67ad-d606-4f5a-a839-360028c51f45 admin admin] The token cache is being invalidate because project 964640b04de845039e4b41cda5f555f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:13.635552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a63f67ad-d606-4f5a-a839-360028c51f45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:13.636216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a63f67ad-d606-4f5a-a839-360028c51f45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:13.637822 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 875/1778] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:13 2022] DELETE /identity/v3/projects/964640b04de845039e4b41cda5f555f1 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:13.638863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f67ad-d606-4f5a-a839-360028c51f45 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:13.640206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a63f67ad-d606-4f5a-a839-360028c51f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:13.653929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f67ad-d606-4f5a-a839-360028c51f45 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:13.658640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603de78-d32f-4944-abc9-b31807f41dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:13.659357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603de78-d32f-4944-abc9-b31807f41dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:13.659642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603de78-d32f-4944-abc9-b31807f41dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:13.659921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603de78-d32f-4944-abc9-b31807f41dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:13.660655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603de78-d32f-4944-abc9-b31807f41dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:13.662298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603de78-d32f-4944-abc9-b31807f41dc8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:13.673274 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 876/1779] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:13.674245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603de78-d32f-4944-abc9-b31807f41dc8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:13.676641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4603de78-d32f-4944-abc9-b31807f41dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:13.692222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603de78-d32f-4944-abc9-b31807f41dc8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:13.697447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd6e0b-1227-4d73-964b-1a4d853e2630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:13.698367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd6e0b-1227-4d73-964b-1a4d853e2630 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:13.698701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd6e0b-1227-4d73-964b-1a4d853e2630 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:13.698930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd6e0b-1227-4d73-964b-1a4d853e2630 admin admin] PATH_INFO: `/v3/projects/8ecb3d4d8ff944e987794279afa527a3/users/082f99b89371427f81e0bc85cae026dc/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:13.700951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd6e0b-1227-4d73-964b-1a4d853e2630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ecb3d4d8ff944e987794279afa527a3, user_id=082f99b89371427f81e0bc85cae026dc, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:13.703845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd6e0b-1227-4d73-964b-1a4d853e2630 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:13.715198 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 877/1780] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:13 2022] PUT /identity/v3/projects/8ecb3d4d8ff944e987794279afa527a3/users/082f99b89371427f81e0bc85cae026dc/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:13.716045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd6e0b-1227-4d73-964b-1a4d853e2630 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:13.718744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-77cd6e0b-1227-4d73-964b-1a4d853e2630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:13.755297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-368d24b1-330c-4d40-bd1f-317d90a5f789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93ef716961464e6ca518f2cab3bf1fda', 'request_id': 'req-368d24b1-330c-4d40-bd1f-317d90a5f789'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:13.766922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-368d24b1-330c-4d40-bd1f-317d90a5f789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93ef716961464e6ca518f2cab3bf1fda', 'request_id': 'req-368d24b1-330c-4d40-bd1f-317d90a5f789'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:13.776504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-368d24b1-330c-4d40-bd1f-317d90a5f789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93ef716961464e6ca518f2cab3bf1fda', 'request_id': 'req-368d24b1-330c-4d40-bd1f-317d90a5f789'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:13.786264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:13.789592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd6e0b-1227-4d73-964b-1a4d853e2630 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:13.845056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50847777-b4c7-4253-8f37-6dc13151d1e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:13.845670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50847777-b4c7-4253-8f37-6dc13151d1e5 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:13.845953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50847777-b4c7-4253-8f37-6dc13151d1e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:13.846233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50847777-b4c7-4253-8f37-6dc13151d1e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:13.848572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-50847777-b4c7-4253-8f37-6dc13151d1e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:13.913164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-368d24b1-330c-4d40-bd1f-317d90a5f789 admin admin] The token cache is being invalidate because project 93ef716961464e6ca518f2cab3bf1fda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:13.914085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-368d24b1-330c-4d40-bd1f-317d90a5f789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:13.915408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-368d24b1-330c-4d40-bd1f-317d90a5f789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:13.919467 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 904/1781] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:13 2022] DELETE /identity/v3/projects/93ef716961464e6ca518f2cab3bf1fda => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:13.920798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d24b1-330c-4d40-bd1f-317d90a5f789 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:13.923167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-368d24b1-330c-4d40-bd1f-317d90a5f789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:13.929670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50847777-b4c7-4253-8f37-6dc13151d1e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:13.931222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50847777-b4c7-4253-8f37-6dc13151d1e5 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:13.946956 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 878/1782] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:13.947816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50847777-b4c7-4253-8f37-6dc13151d1e5 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:13.949620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-50847777-b4c7-4253-8f37-6dc13151d1e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:14.032936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50847777-b4c7-4253-8f37-6dc13151d1e5 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:14.038619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f2ccd-04ea-481a-bf43-0a6726feda77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:14.039926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f2ccd-04ea-481a-bf43-0a6726feda77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:14.040355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f2ccd-04ea-481a-bf43-0a6726feda77 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:14.041491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f2ccd-04ea-481a-bf43-0a6726feda77 admin admin] PATH_INFO: `/v3/users/17538442f109479896480a0c97445aba` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:14.043197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f2ccd-04ea-481a-bf43-0a6726feda77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17538442f109479896480a0c97445aba)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:14.045001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d24b1-330c-4d40-bd1f-317d90a5f789 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:14.045193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f2ccd-04ea-481a-bf43-0a6726feda77 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:14.052397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a29aeb-2f28-4407-bc95-66f0c354bf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:14.053433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a29aeb-2f28-4407-bc95-66f0c354bf97 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:14.053776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a29aeb-2f28-4407-bc95-66f0c354bf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:14.054117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a29aeb-2f28-4407-bc95-66f0c354bf97 admin admin] PATH_INFO: `/v3/projects/ed6998e80f4044fc8bb56a23ac75a4a6/users/134751891f45482c8c5e7584ac1ea522/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:14.072904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a29aeb-2f28-4407-bc95-66f0c354bf97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed6998e80f4044fc8bb56a23ac75a4a6, user_id=134751891f45482c8c5e7584ac1ea522, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:14.079085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a29aeb-2f28-4407-bc95-66f0c354bf97 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:14.229623 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 905/1783] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:13 2022] PUT /identity/v3/projects/ed6998e80f4044fc8bb56a23ac75a4a6/users/134751891f45482c8c5e7584ac1ea522/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:14.229623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a29aeb-2f28-4407-bc95-66f0c354bf97 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:14.239746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a1a29aeb-2f28-4407-bc95-66f0c354bf97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:14.322776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a29aeb-2f28-4407-bc95-66f0c354bf97 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:14.327863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6538d7-fb79-44b9-8dff-bae6cd64be74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:14.328536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6538d7-fb79-44b9-8dff-bae6cd64be74 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:14.328813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6538d7-fb79-44b9-8dff-bae6cd64be74 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:14.329087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6538d7-fb79-44b9-8dff-bae6cd64be74 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:14.329812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6538d7-fb79-44b9-8dff-bae6cd64be74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:14.331669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6538d7-fb79-44b9-8dff-bae6cd64be74 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:14.342265 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 906/1784] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:14.344254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f605c4-3aa2-4585-9a46-27c092b3bf08 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:14.344540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f605c4-3aa2-4585-9a46-27c092b3bf08 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:14.344815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f605c4-3aa2-4585-9a46-27c092b3bf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:14.375206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-16f605c4-3aa2-4585-9a46-27c092b3bf08 None None] MFA Rules not processed for user `082f99b89371427f81e0bc85cae026dc`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:14.382154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-16f605c4-3aa2-4585-9a46-27c092b3bf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:14.434647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0b4f2ccd-04ea-481a-bf43-0a6726feda77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17538442f109479896480a0c97445aba'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:14.451531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0b4f2ccd-04ea-481a-bf43-0a6726feda77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17538442f109479896480a0c97445aba'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:14.452125 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 907/1785] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:14.453811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc4c19-70d6-41fb-b742-79e0dc1a039c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:14.454292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc4c19-70d6-41fb-b742-79e0dc1a039c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:14.454766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc4c19-70d6-41fb-b742-79e0dc1a039c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:14.474678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e8fc4c19-70d6-41fb-b742-79e0dc1a039c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:14.475937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e8fc4c19-70d6-41fb-b742-79e0dc1a039c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:14.484421 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 908/1786] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:14.485710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836d57e-cdd5-4668-bf59-e67cea9ece34 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:14.485955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836d57e-cdd5-4668-bf59-e67cea9ece34 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:14.486245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836d57e-cdd5-4668-bf59-e67cea9ece34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:14.515370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9836d57e-cdd5-4668-bf59-e67cea9ece34 None None] MFA Rules not processed for user `134751891f45482c8c5e7584ac1ea522`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:14.516644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9836d57e-cdd5-4668-bf59-e67cea9ece34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:14.584072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0b4f2ccd-04ea-481a-bf43-0a6726feda77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17538442f109479896480a0c97445aba'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:14.598175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0b4f2ccd-04ea-481a-bf43-0a6726feda77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17538442f109479896480a0c97445aba'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:14.599854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0b4f2ccd-04ea-481a-bf43-0a6726feda77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17538442f109479896480a0c97445aba'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:14.605774 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 879/1787] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:13 2022] DELETE /identity/v3/users/17538442f109479896480a0c97445aba => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:14.607044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f2ccd-04ea-481a-bf43-0a6726feda77 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:14.616619 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 909/1788] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:14 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:14.616619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836d57e-cdd5-4668-bf59-e67cea9ece34 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:14.617227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9836d57e-cdd5-4668-bf59-e67cea9ece34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:14.619125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0b4f2ccd-04ea-481a-bf43-0a6726feda77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:14.713689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f2ccd-04ea-481a-bf43-0a6726feda77 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:14.717533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:14.720141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832eb6f-c4e0-41bc-98d4-e186a11fd5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:14.725761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832eb6f-c4e0-41bc-98d4-e186a11fd5ac admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:14.725761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832eb6f-c4e0-41bc-98d4-e186a11fd5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:14.725761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832eb6f-c4e0-41bc-98d4-e186a11fd5ac admin admin] PATH_INFO: `/v3/projects/74f033c562184d2a8a047a419005c880/users/df0614677e554551aa250ced6099526f/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:14.739719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832eb6f-c4e0-41bc-98d4-e186a11fd5ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=74f033c562184d2a8a047a419005c880, user_id=df0614677e554551aa250ced6099526f, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:14.742828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832eb6f-c4e0-41bc-98d4-e186a11fd5ac admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:14.746125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836d57e-cdd5-4668-bf59-e67cea9ece34 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:14.838362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c2668-feac-4b60-9fea-30748c851af7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:14.839253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c2668-feac-4b60-9fea-30748c851af7 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:14.839518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c2668-feac-4b60-9fea-30748c851af7 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:14.839783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c2668-feac-4b60-9fea-30748c851af7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:14.841839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-219c2668-feac-4b60-9fea-30748c851af7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:14.873017 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 880/1789] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:14 2022] PUT /identity/v3/projects/74f033c562184d2a8a047a419005c880/users/df0614677e554551aa250ced6099526f/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:14.875483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffc058-a1ea-4ea3-9217-1ea31d0911b7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:14.876272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffc058-a1ea-4ea3-9217-1ea31d0911b7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:14.876856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffc058-a1ea-4ea3-9217-1ea31d0911b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:14.905074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-feffc058-a1ea-4ea3-9217-1ea31d0911b7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:14.906706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-feffc058-a1ea-4ea3-9217-1ea31d0911b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:14.970444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c2668-feac-4b60-9fea-30748c851af7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:14.975218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c2668-feac-4b60-9fea-30748c851af7 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:14.985573 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 881/1790] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:14.988392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffc058-a1ea-4ea3-9217-1ea31d0911b7 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:14.988392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-feffc058-a1ea-4ea3-9217-1ea31d0911b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:15.000395 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 910/1791] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:15.001410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffc058-a1ea-4ea3-9217-1ea31d0911b7 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:15.003925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a39d5-721c-490c-949e-618e54890173 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:15.004613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a39d5-721c-490c-949e-618e54890173 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:15.005161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a39d5-721c-490c-949e-618e54890173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:15.007159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189c5f7-2c60-4c16-8e5a-a269eaf055d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:15.008172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189c5f7-2c60-4c16-8e5a-a269eaf055d2 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:15.008290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189c5f7-2c60-4c16-8e5a-a269eaf055d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:15.008543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189c5f7-2c60-4c16-8e5a-a269eaf055d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:15.009328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189c5f7-2c60-4c16-8e5a-a269eaf055d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:15.011526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189c5f7-2c60-4c16-8e5a-a269eaf055d2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:15.051101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f16a39d5-721c-490c-949e-618e54890173 None None] MFA Rules not processed for user `df0614677e554551aa250ced6099526f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:15.052681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f16a39d5-721c-490c-949e-618e54890173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:15.138749 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 882/1792] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:14 2022] POST /identity/v3/projects => generated 409 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:15.139607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189c5f7-2c60-4c16-8e5a-a269eaf055d2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:15.186030 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 911/1793] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:15.186030 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a39d5-721c-490c-949e-618e54890173 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:15.200331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a39d5-721c-490c-949e-618e54890173 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:15.261788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:15.302685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58598f2c-63fc-4478-8b51-45f86d6d0f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:15.305179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58598f2c-63fc-4478-8b51-45f86d6d0f10 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:15.305729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58598f2c-63fc-4478-8b51-45f86d6d0f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:15.306397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58598f2c-63fc-4478-8b51-45f86d6d0f10 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:15.307530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58598f2c-63fc-4478-8b51-45f86d6d0f10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:15.310974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58598f2c-63fc-4478-8b51-45f86d6d0f10 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:15.321077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189c5f7-2c60-4c16-8e5a-a269eaf055d2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:15.337702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01618eb3-c596-42b5-8f75-0ce20eb793af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:15.338760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01618eb3-c596-42b5-8f75-0ce20eb793af admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:15.339252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01618eb3-c596-42b5-8f75-0ce20eb793af admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:15.339689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01618eb3-c596-42b5-8f75-0ce20eb793af admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:15.340558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01618eb3-c596-42b5-8f75-0ce20eb793af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:08:15.340873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01618eb3-c596-42b5-8f75-0ce20eb793af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:15.349616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01618eb3-c596-42b5-8f75-0ce20eb793af admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:15.367669 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 883/1794] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:15.368609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01618eb3-c596-42b5-8f75-0ce20eb793af admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:15.382789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01618eb3-c596-42b5-8f75-0ce20eb793af admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:15.388849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82e12b-a212-4a7b-8180-3d74fd6ee2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:15.389529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82e12b-a212-4a7b-8180-3d74fd6ee2e1 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:15.389819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82e12b-a212-4a7b-8180-3d74fd6ee2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:15.390951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82e12b-a212-4a7b-8180-3d74fd6ee2e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:15.391729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82e12b-a212-4a7b-8180-3d74fd6ee2e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:15.394471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82e12b-a212-4a7b-8180-3d74fd6ee2e1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:15.462356 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 912/1795] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:15 2022] POST /identity/v3/users => generated 311 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:15.462356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58598f2c-63fc-4478-8b51-45f86d6d0f10 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:15.463241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-58598f2c-63fc-4478-8b51-45f86d6d0f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:15.478965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58598f2c-63fc-4478-8b51-45f86d6d0f10 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:15.486795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b1a21-1ece-4b79-8140-d57baa2d29b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:15.488186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b1a21-1ece-4b79-8140-d57baa2d29b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:15.488600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b1a21-1ece-4b79-8140-d57baa2d29b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:15.489119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b1a21-1ece-4b79-8140-d57baa2d29b8 admin admin] PATH_INFO: `/v3/projects/64f567689acb4ab7b9a6d8af6459f87a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:15.492975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b1a21-1ece-4b79-8140-d57baa2d29b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64f567689acb4ab7b9a6d8af6459f87a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:15.495029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b1a21-1ece-4b79-8140-d57baa2d29b8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:15.508531 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 884/1796] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:15 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:15.508531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82e12b-a212-4a7b-8180-3d74fd6ee2e1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:15.592837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82e12b-a212-4a7b-8180-3d74fd6ee2e1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:15.598205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bf2df-d9e2-4474-b9e3-f9ff9d0be593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:15.598982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bf2df-d9e2-4474-b9e3-f9ff9d0be593 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:15.599362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bf2df-d9e2-4474-b9e3-f9ff9d0be593 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:15.599709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bf2df-d9e2-4474-b9e3-f9ff9d0be593 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:15.600483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bf2df-d9e2-4474-b9e3-f9ff9d0be593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:15.602402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bf2df-d9e2-4474-b9e3-f9ff9d0be593 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:15.637907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4c7b1a21-1ece-4b79-8140-d57baa2d29b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64f567689acb4ab7b9a6d8af6459f87a', 'request_id': 'req-4c7b1a21-1ece-4b79-8140-d57baa2d29b8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:15.646608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:15.648584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4c7b1a21-1ece-4b79-8140-d57baa2d29b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64f567689acb4ab7b9a6d8af6459f87a', 'request_id': 'req-4c7b1a21-1ece-4b79-8140-d57baa2d29b8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:15.661735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4c7b1a21-1ece-4b79-8140-d57baa2d29b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64f567689acb4ab7b9a6d8af6459f87a', 'request_id': 'req-4c7b1a21-1ece-4b79-8140-d57baa2d29b8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:15.789861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4c7b1a21-1ece-4b79-8140-d57baa2d29b8 admin admin] The token cache is being invalidate because project 64f567689acb4ab7b9a6d8af6459f87a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:15.790045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4c7b1a21-1ece-4b79-8140-d57baa2d29b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:15.790726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4c7b1a21-1ece-4b79-8140-d57baa2d29b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:15.795687 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 913/1797] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:15 2022] DELETE /identity/v3/projects/64f567689acb4ab7b9a6d8af6459f87a => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:15.795687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b1a21-1ece-4b79-8140-d57baa2d29b8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:15.796189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4c7b1a21-1ece-4b79-8140-d57baa2d29b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:15.797481 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 885/1798] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:15 2022] POST /identity/v3/projects => generated 373 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:15.798453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bf2df-d9e2-4474-b9e3-f9ff9d0be593 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:15.800263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a56bf2df-d9e2-4474-b9e3-f9ff9d0be593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:15.893320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bf2df-d9e2-4474-b9e3-f9ff9d0be593 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:15.893320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23c027-8bc3-40f3-85ff-fa67ee779733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:15.894211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23c027-8bc3-40f3-85ff-fa67ee779733 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:15.894497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23c027-8bc3-40f3-85ff-fa67ee779733 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:15.894777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23c027-8bc3-40f3-85ff-fa67ee779733 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:15.895358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b1a21-1ece-4b79-8140-d57baa2d29b8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:15.896054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23c027-8bc3-40f3-85ff-fa67ee779733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:15.897745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23c027-8bc3-40f3-85ff-fa67ee779733 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:15.901092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0de0e6-2ae6-4907-9699-d3e18edf5d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:15.902033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0de0e6-2ae6-4907-9699-d3e18edf5d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:15.902311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0de0e6-2ae6-4907-9699-d3e18edf5d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:15.902582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0de0e6-2ae6-4907-9699-d3e18edf5d89 admin admin] PATH_INFO: `/v3/users/bbb4d474e4f94b78a616e6d9782fb2ac` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:15.903928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0de0e6-2ae6-4907-9699-d3e18edf5d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb4d474e4f94b78a616e6d9782fb2ac)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:15.905890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0de0e6-2ae6-4907-9699-d3e18edf5d89 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:15.913597 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 886/1799] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:15.913597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23c027-8bc3-40f3-85ff-fa67ee779733 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:15.915391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ad23c027-8bc3-40f3-85ff-fa67ee779733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:15.928796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23c027-8bc3-40f3-85ff-fa67ee779733 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:15.933855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ca5b2-24af-48c3-9eac-7fc854e77514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:15.934546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ca5b2-24af-48c3-9eac-7fc854e77514 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:15.934828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ca5b2-24af-48c3-9eac-7fc854e77514 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:15.935135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ca5b2-24af-48c3-9eac-7fc854e77514 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:15.935842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ca5b2-24af-48c3-9eac-7fc854e77514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:15.939022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ca5b2-24af-48c3-9eac-7fc854e77514 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:16.023749 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 887/1800] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:15 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:16.025388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763121e-fd05-4dce-9115-5034f996143f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:16.025697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763121e-fd05-4dce-9115-5034f996143f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:16.028303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763121e-fd05-4dce-9115-5034f996143f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:16.058556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2763121e-fd05-4dce-9115-5034f996143f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:16.060014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2763121e-fd05-4dce-9115-5034f996143f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:16.070926 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 888/1801] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:16.074903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763121e-fd05-4dce-9115-5034f996143f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:16.074903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2763121e-fd05-4dce-9115-5034f996143f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:16.086066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763121e-fd05-4dce-9115-5034f996143f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:16.098485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee35f7-a1d0-4517-8eaf-eb4914769d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:16.102761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee35f7-a1d0-4517-8eaf-eb4914769d6f admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:16.102761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee35f7-a1d0-4517-8eaf-eb4914769d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:16.102761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee35f7-a1d0-4517-8eaf-eb4914769d6f admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:16.102761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee35f7-a1d0-4517-8eaf-eb4914769d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:16.102761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee35f7-a1d0-4517-8eaf-eb4914769d6f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:16.149678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ae0de0e6-2ae6-4907-9699-d3e18edf5d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb4d474e4f94b78a616e6d9782fb2ac'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:16.157584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ae0de0e6-2ae6-4907-9699-d3e18edf5d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb4d474e4f94b78a616e6d9782fb2ac'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:16.213411 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 889/1802] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:16 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:16.214248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee35f7-a1d0-4517-8eaf-eb4914769d6f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:16.228041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee35f7-a1d0-4517-8eaf-eb4914769d6f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:16.233752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26230d-a915-48a2-961b-d14c9d83c070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:16.234740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26230d-a915-48a2-961b-d14c9d83c070 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:16.235153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26230d-a915-48a2-961b-d14c9d83c070 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:16.235512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26230d-a915-48a2-961b-d14c9d83c070 admin admin] PATH_INFO: `/v3/projects/427515e67f884dbe988c183fa82424eb/users/eeef7e8219ec4bd1b463112fe6dfb740/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:16.253847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26230d-a915-48a2-961b-d14c9d83c070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=427515e67f884dbe988c183fa82424eb, user_id=eeef7e8219ec4bd1b463112fe6dfb740, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:16.257136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26230d-a915-48a2-961b-d14c9d83c070 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:16.264615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ae0de0e6-2ae6-4907-9699-d3e18edf5d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb4d474e4f94b78a616e6d9782fb2ac'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:16.265915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ae0de0e6-2ae6-4907-9699-d3e18edf5d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb4d474e4f94b78a616e6d9782fb2ac'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:16.281777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ae0de0e6-2ae6-4907-9699-d3e18edf5d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb4d474e4f94b78a616e6d9782fb2ac'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:16.302490 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 914/1803] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:15 2022] DELETE /identity/v3/users/bbb4d474e4f94b78a616e6d9782fb2ac => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:16.304317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0de0e6-2ae6-4907-9699-d3e18edf5d89 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:16.306742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ae0de0e6-2ae6-4907-9699-d3e18edf5d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:16.387625 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 890/1804] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:16 2022] PUT /identity/v3/projects/427515e67f884dbe988c183fa82424eb/users/eeef7e8219ec4bd1b463112fe6dfb740/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:16.391982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85447b0d-3842-49ef-a6ca-51de8fcc331a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:16.391982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85447b0d-3842-49ef-a6ca-51de8fcc331a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:16.391982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85447b0d-3842-49ef-a6ca-51de8fcc331a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:16.430961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0de0e6-2ae6-4907-9699-d3e18edf5d89 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:16.435300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-85447b0d-3842-49ef-a6ca-51de8fcc331a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:16.438780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-85447b0d-3842-49ef-a6ca-51de8fcc331a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:16.496442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:16.553272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78053713-d36d-4bfb-8424-e98fc46cf299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:16.554627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78053713-d36d-4bfb-8424-e98fc46cf299 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:16.554989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:16.555529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78053713-d36d-4bfb-8424-e98fc46cf299 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:16.555529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78053713-d36d-4bfb-8424-e98fc46cf299 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:16.556954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78053713-d36d-4bfb-8424-e98fc46cf299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:16.559735 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 891/1805] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:16.560653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78053713-d36d-4bfb-8424-e98fc46cf299 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:16.561027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85447b0d-3842-49ef-a6ca-51de8fcc331a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:16.564753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-85447b0d-3842-49ef-a6ca-51de8fcc331a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:16.581171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85447b0d-3842-49ef-a6ca-51de8fcc331a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:16.587296 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 915/1806] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:16.592508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efdd53-4bbc-4c1e-9a0f-2ad7005e2618 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:16.592508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efdd53-4bbc-4c1e-9a0f-2ad7005e2618 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:16.592508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efdd53-4bbc-4c1e-9a0f-2ad7005e2618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:16.596119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97bacd-2efe-45af-8b4c-fd316df76057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:16.597655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97bacd-2efe-45af-8b4c-fd316df76057 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:16.597655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97bacd-2efe-45af-8b4c-fd316df76057 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:16.598329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97bacd-2efe-45af-8b4c-fd316df76057 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:16.599826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97bacd-2efe-45af-8b4c-fd316df76057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:16.601436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97bacd-2efe-45af-8b4c-fd316df76057 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:16.613690 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 892/1807] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:16.615054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97bacd-2efe-45af-8b4c-fd316df76057 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:16.617587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9c97bacd-2efe-45af-8b4c-fd316df76057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:16.637586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97bacd-2efe-45af-8b4c-fd316df76057 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:16.648794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c0efdd53-4bbc-4c1e-9a0f-2ad7005e2618 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:16.654012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c0efdd53-4bbc-4c1e-9a0f-2ad7005e2618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:16.672724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6ca44-d780-4026-960f-6fd43ac16b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:16.673884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6ca44-d780-4026-960f-6fd43ac16b61 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:16.674391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6ca44-d780-4026-960f-6fd43ac16b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:16.674978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6ca44-d780-4026-960f-6fd43ac16b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:16.676450 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 916/1808] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:16.677326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6ca44-d780-4026-960f-6fd43ac16b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:16.677434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efdd53-4bbc-4c1e-9a0f-2ad7005e2618 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:16.679469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6ca44-d780-4026-960f-6fd43ac16b61 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:16.692846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efdd53-4bbc-4c1e-9a0f-2ad7005e2618 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:16.701515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be300cea-2555-44ca-ae14-5077f6f03d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:16.701515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be300cea-2555-44ca-ae14-5077f6f03d86 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:16.701515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be300cea-2555-44ca-ae14-5077f6f03d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:16.701515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be300cea-2555-44ca-ae14-5077f6f03d86 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:16.701961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be300cea-2555-44ca-ae14-5077f6f03d86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:08:16.701961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be300cea-2555-44ca-ae14-5077f6f03d86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:16.702371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be300cea-2555-44ca-ae14-5077f6f03d86 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:16.711893 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 893/1809] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:16.714402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6ca44-d780-4026-960f-6fd43ac16b61 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:16.719249 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 917/1810] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:16.722866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be300cea-2555-44ca-ae14-5077f6f03d86 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:16.740483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6ca44-d780-4026-960f-6fd43ac16b61 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:16.742912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be300cea-2555-44ca-ae14-5077f6f03d86 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:16.754470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d55ad-68d0-475d-80cc-1a667926a803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:16.755372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d55ad-68d0-475d-80cc-1a667926a803 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:16.755656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d55ad-68d0-475d-80cc-1a667926a803 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:16.755933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d55ad-68d0-475d-80cc-1a667926a803 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:16.756717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d55ad-68d0-475d-80cc-1a667926a803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:16.758333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d55ad-68d0-475d-80cc-1a667926a803 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:16.771514 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 918/1811] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:16.772354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d55ad-68d0-475d-80cc-1a667926a803 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:16.773879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301291a-a7bc-4eed-9851-15cff5fd8c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:16.775047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301291a-a7bc-4eed-9851-15cff5fd8c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:16.775609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301291a-a7bc-4eed-9851-15cff5fd8c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:16.776022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301291a-a7bc-4eed-9851-15cff5fd8c74 admin admin] PATH_INFO: `/v3/projects/46bba77d2d774946afb95674b6eb4da8/users/d26abb39168242ddbb4d7a247fc17dd1/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:16.776882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d17d55ad-68d0-475d-80cc-1a667926a803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:16.801634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301291a-a7bc-4eed-9851-15cff5fd8c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46bba77d2d774946afb95674b6eb4da8, user_id=d26abb39168242ddbb4d7a247fc17dd1, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:16.813149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301291a-a7bc-4eed-9851-15cff5fd8c74 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:16.852280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d55ad-68d0-475d-80cc-1a667926a803 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:16.856676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf9cea-5979-4b5d-a2ff-8c1230270f76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:16.861877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf9cea-5979-4b5d-a2ff-8c1230270f76 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:16.861877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf9cea-5979-4b5d-a2ff-8c1230270f76 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:16.861877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf9cea-5979-4b5d-a2ff-8c1230270f76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:16.870990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf9cea-5979-4b5d-a2ff-8c1230270f76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:16.872593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf9cea-5979-4b5d-a2ff-8c1230270f76 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:16.885028 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 919/1812] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:16.885905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf9cea-5979-4b5d-a2ff-8c1230270f76 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:16.901472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf9cea-5979-4b5d-a2ff-8c1230270f76 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:16.908035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12e750-8f4c-40a0-9384-000a54beeaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:16.908035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12e750-8f4c-40a0-9384-000a54beeaeb admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:16.908207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12e750-8f4c-40a0-9384-000a54beeaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:16.908675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12e750-8f4c-40a0-9384-000a54beeaeb admin admin] PATH_INFO: `/v3/projects/427515e67f884dbe988c183fa82424eb/users/eeef7e8219ec4bd1b463112fe6dfb740/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:16.911646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12e750-8f4c-40a0-9384-000a54beeaeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=427515e67f884dbe988c183fa82424eb, user_id=eeef7e8219ec4bd1b463112fe6dfb740, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:16.914687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12e750-8f4c-40a0-9384-000a54beeaeb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:16.936572 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 920/1813] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:16 2022] PUT /identity/v3/projects/427515e67f884dbe988c183fa82424eb/users/eeef7e8219ec4bd1b463112fe6dfb740/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:16.936572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12e750-8f4c-40a0-9384-000a54beeaeb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:16.943382 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 894/1814] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:16 2022] PUT /identity/v3/projects/46bba77d2d774946afb95674b6eb4da8/users/d26abb39168242ddbb4d7a247fc17dd1/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:16.944548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301291a-a7bc-4eed-9851-15cff5fd8c74 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:17.012023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12e750-8f4c-40a0-9384-000a54beeaeb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:17.074225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301291a-a7bc-4eed-9851-15cff5fd8c74 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:17.079607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109ce7c-39dd-4e6a-925c-d3bd26f2b8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:17.080503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109ce7c-39dd-4e6a-925c-d3bd26f2b8a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:17.080751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109ce7c-39dd-4e6a-925c-d3bd26f2b8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:17.081196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109ce7c-39dd-4e6a-925c-d3bd26f2b8a5 admin admin] PATH_INFO: `/v3/projects/4ec272599c454aa0a9f19e865491272d/users/6b0de12b53df495d851dbc910f5ed0c2/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:17.099072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109ce7c-39dd-4e6a-925c-d3bd26f2b8a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec272599c454aa0a9f19e865491272d, user_id=6b0de12b53df495d851dbc910f5ed0c2, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:17.102316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109ce7c-39dd-4e6a-925c-d3bd26f2b8a5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:17.117710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c3e23-f414-443e-a1ec-4fbbb639f959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:17.118512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c3e23-f414-443e-a1ec-4fbbb639f959 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:17.118834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c3e23-f414-443e-a1ec-4fbbb639f959 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:17.119381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c3e23-f414-443e-a1ec-4fbbb639f959 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:17.120208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c3e23-f414-443e-a1ec-4fbbb639f959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:17.122195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c3e23-f414-443e-a1ec-4fbbb639f959 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:17.257801 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 895/1815] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:16 2022] PUT /identity/v3/projects/4ec272599c454aa0a9f19e865491272d/users/6b0de12b53df495d851dbc910f5ed0c2/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:17.264552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51e275-794e-43d4-8cb8-feea0ec6c486 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:17.264552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51e275-794e-43d4-8cb8-feea0ec6c486 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:17.264552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51e275-794e-43d4-8cb8-feea0ec6c486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:17.265000 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 921/1816] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:16 2022] POST /identity/v3/projects => generated 383 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:17.265000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c3e23-f414-443e-a1ec-4fbbb639f959 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:17.344979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4d51e275-794e-43d4-8cb8-feea0ec6c486 None None] MFA Rules not processed for user `eeef7e8219ec4bd1b463112fe6dfb740`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:17.349162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4d51e275-794e-43d4-8cb8-feea0ec6c486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:17.437846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:17.449143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c3e23-f414-443e-a1ec-4fbbb639f959 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:17.463525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68311c34-f6a3-4a9a-b149-7daa3a353c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:17.464224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68311c34-f6a3-4a9a-b149-7daa3a353c1e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:17.464506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68311c34-f6a3-4a9a-b149-7daa3a353c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:17.468070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68311c34-f6a3-4a9a-b149-7daa3a353c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:17.469762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68311c34-f6a3-4a9a-b149-7daa3a353c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:17.475624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68311c34-f6a3-4a9a-b149-7daa3a353c1e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:17.506668 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 922/1817] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:17.508527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc29d4c-d6e1-4a9b-8d82-a9e12980dd82 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:17.510514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc29d4c-d6e1-4a9b-8d82-a9e12980dd82 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:17.510819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc29d4c-d6e1-4a9b-8d82-a9e12980dd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:17.522919 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 896/1818] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:17 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:17.523879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51e275-794e-43d4-8cb8-feea0ec6c486 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:17.547365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51e275-794e-43d4-8cb8-feea0ec6c486 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:17.553759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f780dd-ba09-4771-8104-88b80e5c2011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:17.557879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f780dd-ba09-4771-8104-88b80e5c2011 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:17.558534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f780dd-ba09-4771-8104-88b80e5c2011 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:17.558608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f780dd-ba09-4771-8104-88b80e5c2011 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:17.559947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f780dd-ba09-4771-8104-88b80e5c2011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:17.562685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f780dd-ba09-4771-8104-88b80e5c2011 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:17.585326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1fc29d4c-d6e1-4a9b-8d82-a9e12980dd82 None None] MFA Rules not processed for user `6b0de12b53df495d851dbc910f5ed0c2`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:17.586727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1fc29d4c-d6e1-4a9b-8d82-a9e12980dd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:17.748122 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 897/1819] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:17 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:17.748122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f780dd-ba09-4771-8104-88b80e5c2011 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:17.778747 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 923/1820] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:17.781115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc29d4c-d6e1-4a9b-8d82-a9e12980dd82 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:17.784006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1fc29d4c-d6e1-4a9b-8d82-a9e12980dd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:17.785440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f780dd-ba09-4771-8104-88b80e5c2011 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:17.800021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497ad76-54e7-4256-b84e-969c63c23647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:17.801175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497ad76-54e7-4256-b84e-969c63c23647 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:17.801492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497ad76-54e7-4256-b84e-969c63c23647 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:17.801775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497ad76-54e7-4256-b84e-969c63c23647 admin admin] PATH_INFO: `/v3/projects/46bba77d2d774946afb95674b6eb4da8/users/d26abb39168242ddbb4d7a247fc17dd1/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:17.810154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497ad76-54e7-4256-b84e-969c63c23647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46bba77d2d774946afb95674b6eb4da8, user_id=d26abb39168242ddbb4d7a247fc17dd1, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:17.823506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497ad76-54e7-4256-b84e-969c63c23647 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:17.859703 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 898/1821] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:17 2022] PUT /identity/v3/projects/46bba77d2d774946afb95674b6eb4da8/users/d26abb39168242ddbb4d7a247fc17dd1/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:17.873239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497ad76-54e7-4256-b84e-969c63c23647 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:17.945151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:18.031667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc29d4c-d6e1-4a9b-8d82-a9e12980dd82 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:18.035829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497ad76-54e7-4256-b84e-969c63c23647 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:18.042343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aac643-1b48-489e-9fa7-e48d20e73971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:18.043226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aac643-1b48-489e-9fa7-e48d20e73971 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:18.043582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aac643-1b48-489e-9fa7-e48d20e73971 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:18.045628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aac643-1b48-489e-9fa7-e48d20e73971 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:18.045628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aac643-1b48-489e-9fa7-e48d20e73971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:18.046900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aac643-1b48-489e-9fa7-e48d20e73971 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:18.073068 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 899/1822] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:18.074738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1466d0-544a-4bb3-bfd8-a5dffc767eb7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:18.079196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1466d0-544a-4bb3-bfd8-a5dffc767eb7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:18.080399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1466d0-544a-4bb3-bfd8-a5dffc767eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:18.086386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:18.197172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0d1466d0-544a-4bb3-bfd8-a5dffc767eb7 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:18.199201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0d1466d0-544a-4bb3-bfd8-a5dffc767eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:18.202110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59529c-73bc-4e5c-88a0-da18d2b09f13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:18.202905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59529c-73bc-4e5c-88a0-da18d2b09f13 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:18.203350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59529c-73bc-4e5c-88a0-da18d2b09f13 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:18.203784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59529c-73bc-4e5c-88a0-da18d2b09f13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:18.336523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59529c-73bc-4e5c-88a0-da18d2b09f13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:18.338258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59529c-73bc-4e5c-88a0-da18d2b09f13 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:18.354990 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 924/1823] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:17 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:18.355871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59529c-73bc-4e5c-88a0-da18d2b09f13 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:18.368973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59529c-73bc-4e5c-88a0-da18d2b09f13 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:18.377403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21729ef1-d886-4a86-b03a-284c503b46c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:18.377403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21729ef1-d886-4a86-b03a-284c503b46c0 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:18.377403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21729ef1-d886-4a86-b03a-284c503b46c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:18.377403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21729ef1-d886-4a86-b03a-284c503b46c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:18.378974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21729ef1-d886-4a86-b03a-284c503b46c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:18.380329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21729ef1-d886-4a86-b03a-284c503b46c0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:18.389825 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 900/1824] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:08:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:18.391431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9b22a-3af4-4376-aca1-c744a282fbfe None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:18.391720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9b22a-3af4-4376-aca1-c744a282fbfe None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:18.391993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9b22a-3af4-4376-aca1-c744a282fbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:18.437985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-bca9b22a-3af4-4376-aca1-c744a282fbfe None None] MFA Rules not processed for user `d26abb39168242ddbb4d7a247fc17dd1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:18.440145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bca9b22a-3af4-4376-aca1-c744a282fbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:18.541127 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 901/1825] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:18.541127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9b22a-3af4-4376-aca1-c744a282fbfe None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:18.542659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bca9b22a-3af4-4376-aca1-c744a282fbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:18.557605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9b22a-3af4-4376-aca1-c744a282fbfe None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:18.565225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0166f-4714-44e8-b3f7-312e3d71bcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:18.571617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0166f-4714-44e8-b3f7-312e3d71bcdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:18.571617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0166f-4714-44e8-b3f7-312e3d71bcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:18.571617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0166f-4714-44e8-b3f7-312e3d71bcdf admin admin] PATH_INFO: `/v3/projects/7981b0049dfa4112b2f22ef551b3e96d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:18.571617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0166f-4714-44e8-b3f7-312e3d71bcdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7981b0049dfa4112b2f22ef551b3e96d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:18.571617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0166f-4714-44e8-b3f7-312e3d71bcdf admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:18.572800 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 925/1826] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:18 2022] POST /identity/v3/projects => generated 375 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:18.573911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21729ef1-d886-4a86-b03a-284c503b46c0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:18.710943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21729ef1-d886-4a86-b03a-284c503b46c0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:18.719162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a7eef-531a-4fc6-b14a-12771457919a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:18.719908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a7eef-531a-4fc6-b14a-12771457919a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:18.720224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a7eef-531a-4fc6-b14a-12771457919a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:18.721244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a7eef-531a-4fc6-b14a-12771457919a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:18.722377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a7eef-531a-4fc6-b14a-12771457919a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:18.725117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a7eef-531a-4fc6-b14a-12771457919a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:18.742483 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 926/1827] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:18.743506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a7eef-531a-4fc6-b14a-12771457919a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:18.745495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-224a7eef-531a-4fc6-b14a-12771457919a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:18.866277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a7eef-531a-4fc6-b14a-12771457919a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:18.873917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4cf5f-d471-49a8-9587-caf83f66c008 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:18.874661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4cf5f-d471-49a8-9587-caf83f66c008 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:18.875060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4cf5f-d471-49a8-9587-caf83f66c008 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:18.875464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4cf5f-d471-49a8-9587-caf83f66c008 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:18.878922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9ed4cf5f-d471-49a8-9587-caf83f66c008 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:18.936908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7bc0166f-4714-44e8-b3f7-312e3d71bcdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7981b0049dfa4112b2f22ef551b3e96d', 'request_id': 'req-7bc0166f-4714-44e8-b3f7-312e3d71bcdf'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:18.948219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7bc0166f-4714-44e8-b3f7-312e3d71bcdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7981b0049dfa4112b2f22ef551b3e96d', 'request_id': 'req-7bc0166f-4714-44e8-b3f7-312e3d71bcdf'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:18.955892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4cf5f-d471-49a8-9587-caf83f66c008 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:18.960943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4cf5f-d471-49a8-9587-caf83f66c008 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:18.963144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7bc0166f-4714-44e8-b3f7-312e3d71bcdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7981b0049dfa4112b2f22ef551b3e96d', 'request_id': 'req-7bc0166f-4714-44e8-b3f7-312e3d71bcdf'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:18.984581 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 927/1828] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:18 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:18.986951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4cf5f-d471-49a8-9587-caf83f66c008 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:19.024195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4cf5f-d471-49a8-9587-caf83f66c008 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:19.087206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7bc0166f-4714-44e8-b3f7-312e3d71bcdf admin admin] The token cache is being invalidate because project 7981b0049dfa4112b2f22ef551b3e96d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:19.087543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7bc0166f-4714-44e8-b3f7-312e3d71bcdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:19.093053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7bc0166f-4714-44e8-b3f7-312e3d71bcdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:19.094770 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 902/1829] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:18 2022] DELETE /identity/v3/projects/7981b0049dfa4112b2f22ef551b3e96d => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:19.095644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0166f-4714-44e8-b3f7-312e3d71bcdf admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:19.100258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7bc0166f-4714-44e8-b3f7-312e3d71bcdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:19.106279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:19.150439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca6ad0-4bf3-49ae-a221-be28a68fb674 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:19.151622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca6ad0-4bf3-49ae-a221-be28a68fb674 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:19.153127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca6ad0-4bf3-49ae-a221-be28a68fb674 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:19.153127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca6ad0-4bf3-49ae-a221-be28a68fb674 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:19.155469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7eca6ad0-4bf3-49ae-a221-be28a68fb674 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:19.215844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0166f-4714-44e8-b3f7-312e3d71bcdf admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:19.222364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0794583-3eff-4d4a-a698-2ef678a70e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:19.223096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0794583-3eff-4d4a-a698-2ef678a70e07 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:19.224063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0794583-3eff-4d4a-a698-2ef678a70e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:19.224411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0794583-3eff-4d4a-a698-2ef678a70e07 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:19.225137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0794583-3eff-4d4a-a698-2ef678a70e07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:19.230266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0794583-3eff-4d4a-a698-2ef678a70e07 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:19.338710 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 903/1830] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:19 2022] POST /identity/v3/users => generated 294 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:19.342596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca6ad0-4bf3-49ae-a221-be28a68fb674 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:19.342796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0794583-3eff-4d4a-a698-2ef678a70e07 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:19.344278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca6ad0-4bf3-49ae-a221-be28a68fb674 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:19.344391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c0794583-3eff-4d4a-a698-2ef678a70e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:19.372773 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 928/1831] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:19.373655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca6ad0-4bf3-49ae-a221-be28a68fb674 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:19.378564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7eca6ad0-4bf3-49ae-a221-be28a68fb674 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:19.380766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0794583-3eff-4d4a-a698-2ef678a70e07 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:19.389153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91c920-6cf0-420b-8b71-7044c00899f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:19.392597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91c920-6cf0-420b-8b71-7044c00899f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:19.392597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91c920-6cf0-420b-8b71-7044c00899f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:19.393005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91c920-6cf0-420b-8b71-7044c00899f2 admin admin] PATH_INFO: `/v3/projects/db02af1656684f57904f5a33ca045740/users/b2e42b0ddd1b44b79a6f8e0bbf5da3cf/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:19.435031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91c920-6cf0-420b-8b71-7044c00899f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db02af1656684f57904f5a33ca045740, user_id=b2e42b0ddd1b44b79a6f8e0bbf5da3cf, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:19.437889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91c920-6cf0-420b-8b71-7044c00899f2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:19.546602 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 904/1832] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:19 2022] PUT /identity/v3/projects/db02af1656684f57904f5a33ca045740/users/b2e42b0ddd1b44b79a6f8e0bbf5da3cf/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:19.547867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91c920-6cf0-420b-8b71-7044c00899f2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:19.550445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3c91c920-6cf0-420b-8b71-7044c00899f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:19.572726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:19.601231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca6ad0-4bf3-49ae-a221-be28a68fb674 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:19.701686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91c920-6cf0-420b-8b71-7044c00899f2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:19.713454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dae92-9a2e-4afc-ae13-f6257c7f1d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:19.715882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dae92-9a2e-4afc-ae13-f6257c7f1d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:19.716379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dae92-9a2e-4afc-ae13-f6257c7f1d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:19.716871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dae92-9a2e-4afc-ae13-f6257c7f1d15 admin admin] PATH_INFO: `/v3/users/082f99b89371427f81e0bc85cae026dc` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:19.727740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634dae92-9a2e-4afc-ae13-f6257c7f1d15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=082f99b89371427f81e0bc85cae026dc)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:19.730672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634dae92-9a2e-4afc-ae13-f6257c7f1d15 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:19.739386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:19.760113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b89e3-0158-4fe8-9fd3-839a6befb0f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:19.760802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b89e3-0158-4fe8-9fd3-839a6befb0f1 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:19.761130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b89e3-0158-4fe8-9fd3-839a6befb0f1 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:19.761447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b89e3-0158-4fe8-9fd3-839a6befb0f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:19.770028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-798b89e3-0158-4fe8-9fd3-839a6befb0f1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:19.846211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b89e3-0158-4fe8-9fd3-839a6befb0f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:19.850124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b89e3-0158-4fe8-9fd3-839a6befb0f1 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:19.871854 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 929/1833] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:08:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:08:19.873121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b89e3-0158-4fe8-9fd3-839a6befb0f1 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:19.874759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-798b89e3-0158-4fe8-9fd3-839a6befb0f1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:19.893034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b89e3-0158-4fe8-9fd3-839a6befb0f1 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:19.905102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba9bde-5322-453b-b8f1-61a9cf594c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:19.905102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba9bde-5322-453b-b8f1-61a9cf594c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:19.905102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba9bde-5322-453b-b8f1-61a9cf594c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:19.905102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba9bde-5322-453b-b8f1-61a9cf594c8e admin admin] PATH_INFO: `/v3/users/134751891f45482c8c5e7584ac1ea522` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:19.905950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba9bde-5322-453b-b8f1-61a9cf594c8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=134751891f45482c8c5e7584ac1ea522)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:19.909950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba9bde-5322-453b-b8f1-61a9cf594c8e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:20.053015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-634dae92-9a2e-4afc-ae13-f6257c7f1d15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '082f99b89371427f81e0bc85cae026dc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:20.074413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-634dae92-9a2e-4afc-ae13-f6257c7f1d15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '082f99b89371427f81e0bc85cae026dc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:20.213231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9bba9bde-5322-453b-b8f1-61a9cf594c8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '134751891f45482c8c5e7584ac1ea522'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:20.221281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-634dae92-9a2e-4afc-ae13-f6257c7f1d15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '082f99b89371427f81e0bc85cae026dc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:20.231800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-634dae92-9a2e-4afc-ae13-f6257c7f1d15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '082f99b89371427f81e0bc85cae026dc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:20.234858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-634dae92-9a2e-4afc-ae13-f6257c7f1d15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '082f99b89371427f81e0bc85cae026dc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:20.246716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9bba9bde-5322-453b-b8f1-61a9cf594c8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '134751891f45482c8c5e7584ac1ea522'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:20.251068 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 905/1834] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:19 2022] DELETE /identity/v3/users/082f99b89371427f81e0bc85cae026dc => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:20.252313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dae92-9a2e-4afc-ae13-f6257c7f1d15 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:20.256962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-634dae92-9a2e-4afc-ae13-f6257c7f1d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:20.355816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9bba9bde-5322-453b-b8f1-61a9cf594c8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '134751891f45482c8c5e7584ac1ea522'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:20.360272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9bba9bde-5322-453b-b8f1-61a9cf594c8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '134751891f45482c8c5e7584ac1ea522'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:20.404412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9bba9bde-5322-453b-b8f1-61a9cf594c8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '134751891f45482c8c5e7584ac1ea522'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:20.427948 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 930/1835] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:19 2022] DELETE /identity/v3/users/134751891f45482c8c5e7584ac1ea522 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:20.429911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c42cab-75a2-430e-a261-f6437be4edc7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:20.430345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c42cab-75a2-430e-a261-f6437be4edc7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:20.430954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c42cab-75a2-430e-a261-f6437be4edc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:20.508296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dae92-9a2e-4afc-ae13-f6257c7f1d15 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:20.526619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b7c42cab-75a2-430e-a261-f6437be4edc7 None None] MFA Rules not processed for user `b2e42b0ddd1b44b79a6f8e0bbf5da3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:20.531463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b7c42cab-75a2-430e-a261-f6437be4edc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:20.728203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc643825-bb6c-4821-ba29-da3e2e81d249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:20.728920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc643825-bb6c-4821-ba29-da3e2e81d249 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:20.729198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc643825-bb6c-4821-ba29-da3e2e81d249 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:20.729478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc643825-bb6c-4821-ba29-da3e2e81d249 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:20.744027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc643825-bb6c-4821-ba29-da3e2e81d249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:20.748042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc643825-bb6c-4821-ba29-da3e2e81d249 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:20.753546 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 931/1836] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:20.753546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b44bd-dddb-4248-8727-86208904ac7f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:20.762007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b44bd-dddb-4248-8727-86208904ac7f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:20.762940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b44bd-dddb-4248-8727-86208904ac7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:20.799745 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 906/1837] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 548 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:20.803488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc643825-bb6c-4821-ba29-da3e2e81d249 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:20.890415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-dc643825-bb6c-4821-ba29-da3e2e81d249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:20.891089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e23b44bd-dddb-4248-8727-86208904ac7f None None] MFA Rules not processed for user `fbd858f3e6ba4523b056bbdc2af427b0`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:20.891089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e23b44bd-dddb-4248-8727-86208904ac7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:20.939855 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 932/1838] 10.222.0.30 () {58 vars in 1015 bytes} [Sat Jul 16 21:08:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:20.942157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fd0fe-8705-4eff-97bf-fdd35a735f71 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:20.942423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fd0fe-8705-4eff-97bf-fdd35a735f71 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:20.942769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fd0fe-8705-4eff-97bf-fdd35a735f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:20.948493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc643825-bb6c-4821-ba29-da3e2e81d249 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:20.957861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d831317-6754-40d5-8236-593c5e5c69e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:20.959354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d831317-6754-40d5-8236-593c5e5c69e9 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:20.959918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d831317-6754-40d5-8236-593c5e5c69e9 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:20.960379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d831317-6754-40d5-8236-593c5e5c69e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:20.963845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2d831317-6754-40d5-8236-593c5e5c69e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:20.974182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-574fd0fe-8705-4eff-97bf-fdd35a735f71 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:20.977070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-574fd0fe-8705-4eff-97bf-fdd35a735f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:20.991606 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 933/1839] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:20.994963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fd0fe-8705-4eff-97bf-fdd35a735f71 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:20.997345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-574fd0fe-8705-4eff-97bf-fdd35a735f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:21.020888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fd0fe-8705-4eff-97bf-fdd35a735f71 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:21.033172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de0ec2-84bc-4eb1-8bcd-c2a3ba009e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:21.034924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de0ec2-84bc-4eb1-8bcd-c2a3ba009e95 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:21.035477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de0ec2-84bc-4eb1-8bcd-c2a3ba009e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:21.035982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de0ec2-84bc-4eb1-8bcd-c2a3ba009e95 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:21.037536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de0ec2-84bc-4eb1-8bcd-c2a3ba009e95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:21.041397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de0ec2-84bc-4eb1-8bcd-c2a3ba009e95 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:21.095427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d831317-6754-40d5-8236-593c5e5c69e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:21.097751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d831317-6754-40d5-8236-593c5e5c69e9 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:21.120756 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 907/1840] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:21.121956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d831317-6754-40d5-8236-593c5e5c69e9 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:21.125916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2d831317-6754-40d5-8236-593c5e5c69e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:21.166379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d831317-6754-40d5-8236-593c5e5c69e9 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:21.173939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548c9a9-e5da-4551-af42-730754e21bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:21.175822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548c9a9-e5da-4551-af42-730754e21bab admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:21.176375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548c9a9-e5da-4551-af42-730754e21bab admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:21.176829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548c9a9-e5da-4551-af42-730754e21bab admin admin] PATH_INFO: `/v3/projects/be86660ebb5d41879a693ec7b865ff63/users/0ef788633ee342f588481ecefcae5655/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:21.229627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548c9a9-e5da-4551-af42-730754e21bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=be86660ebb5d41879a693ec7b865ff63, user_id=0ef788633ee342f588481ecefcae5655, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:21.232622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548c9a9-e5da-4551-af42-730754e21bab admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:21.481377 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 908/1841] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:21 2022] PUT /identity/v3/projects/be86660ebb5d41879a693ec7b865ff63/users/0ef788633ee342f588481ecefcae5655/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:21.482098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548c9a9-e5da-4551-af42-730754e21bab admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:21.487831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1548c9a9-e5da-4551-af42-730754e21bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:21.494768 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 934/1842] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:20 2022] POST /identity/v3/projects => generated 383 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:21.494768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de0ec2-84bc-4eb1-8bcd-c2a3ba009e95 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:21.497311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c9de0ec2-84bc-4eb1-8bcd-c2a3ba009e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:21.644101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de0ec2-84bc-4eb1-8bcd-c2a3ba009e95 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:21.652859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b88b6-9ca1-4c6f-8dcd-29ad9f2b5ce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:21.653543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b88b6-9ca1-4c6f-8dcd-29ad9f2b5ce2 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:21.653820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b88b6-9ca1-4c6f-8dcd-29ad9f2b5ce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:21.654149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b88b6-9ca1-4c6f-8dcd-29ad9f2b5ce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:21.724659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548c9a9-e5da-4551-af42-730754e21bab admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:21.735091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea56ab8-143c-4042-90f3-04283e5f0512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:21.735818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea56ab8-143c-4042-90f3-04283e5f0512 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:21.736020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea56ab8-143c-4042-90f3-04283e5f0512 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:21.736283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea56ab8-143c-4042-90f3-04283e5f0512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:21.748039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea56ab8-143c-4042-90f3-04283e5f0512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:21.750017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea56ab8-143c-4042-90f3-04283e5f0512 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:21.774571 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 909/1843] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:21.775349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea56ab8-143c-4042-90f3-04283e5f0512 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:21.852679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b88b6-9ca1-4c6f-8dcd-29ad9f2b5ce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:21.854261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b88b6-9ca1-4c6f-8dcd-29ad9f2b5ce2 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:21.881481 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 935/1844] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:21.882450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b88b6-9ca1-4c6f-8dcd-29ad9f2b5ce2 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:21.910848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b88b6-9ca1-4c6f-8dcd-29ad9f2b5ce2 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:21.922117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998217d-b0e6-45ec-ae75-6e6e1cf6bcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:21.922814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998217d-b0e6-45ec-ae75-6e6e1cf6bcb7 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:21.924087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998217d-b0e6-45ec-ae75-6e6e1cf6bcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:21.924418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998217d-b0e6-45ec-ae75-6e6e1cf6bcb7 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:21.925516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998217d-b0e6-45ec-ae75-6e6e1cf6bcb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:21.930014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998217d-b0e6-45ec-ae75-6e6e1cf6bcb7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:21.963541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea56ab8-143c-4042-90f3-04283e5f0512 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:21.969454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e59d8c-ccb5-46ca-857a-cd05292cf6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:21.970267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e59d8c-ccb5-46ca-857a-cd05292cf6cc admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:21.970542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e59d8c-ccb5-46ca-857a-cd05292cf6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:21.970848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e59d8c-ccb5-46ca-857a-cd05292cf6cc admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:21.972407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e59d8c-ccb5-46ca-857a-cd05292cf6cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:21.974177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e59d8c-ccb5-46ca-857a-cd05292cf6cc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:21.993625 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 910/1845] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:21.993625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e59d8c-ccb5-46ca-857a-cd05292cf6cc admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:21.994239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-54e59d8c-ccb5-46ca-857a-cd05292cf6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:22.015523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e59d8c-ccb5-46ca-857a-cd05292cf6cc admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:22.022905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f4151-c7f0-4ff5-85db-d502ae75dab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:22.023841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f4151-c7f0-4ff5-85db-d502ae75dab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:22.025240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f4151-c7f0-4ff5-85db-d502ae75dab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:22.025549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f4151-c7f0-4ff5-85db-d502ae75dab2 admin admin] PATH_INFO: `/v3/projects/8ecb3d4d8ff944e987794279afa527a3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:22.028259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f4151-c7f0-4ff5-85db-d502ae75dab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ecb3d4d8ff944e987794279afa527a3)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:22.030813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f4151-c7f0-4ff5-85db-d502ae75dab2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:22.078833 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 936/1846] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:21 2022] POST /identity/v3/users => generated 298 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:22.079915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998217d-b0e6-45ec-ae75-6e6e1cf6bcb7 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:22.100338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998217d-b0e6-45ec-ae75-6e6e1cf6bcb7 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:22.106334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9724bd5-2945-41a4-bc18-5e370ff321b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:22.107700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9724bd5-2945-41a4-bc18-5e370ff321b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:22.108139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9724bd5-2945-41a4-bc18-5e370ff321b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:22.108139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9724bd5-2945-41a4-bc18-5e370ff321b2 admin admin] PATH_INFO: `/v3/projects/be86660ebb5d41879a693ec7b865ff63/users/0ef788633ee342f588481ecefcae5655/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:22.110874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9724bd5-2945-41a4-bc18-5e370ff321b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be86660ebb5d41879a693ec7b865ff63, user_id=0ef788633ee342f588481ecefcae5655, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:22.115894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9724bd5-2945-41a4-bc18-5e370ff321b2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:22.126936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:22.144178 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 937/1847] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:22 2022] PUT /identity/v3/projects/be86660ebb5d41879a693ec7b865ff63/users/0ef788633ee342f588481ecefcae5655/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:22.146783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9724bd5-2945-41a4-bc18-5e370ff321b2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:22.205432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc0f4151-c7f0-4ff5-85db-d502ae75dab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ecb3d4d8ff944e987794279afa527a3', 'request_id': 'req-dc0f4151-c7f0-4ff5-85db-d502ae75dab2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:22.234555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc0f4151-c7f0-4ff5-85db-d502ae75dab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ecb3d4d8ff944e987794279afa527a3', 'request_id': 'req-dc0f4151-c7f0-4ff5-85db-d502ae75dab2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:22.249197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc0f4151-c7f0-4ff5-85db-d502ae75dab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ecb3d4d8ff944e987794279afa527a3', 'request_id': 'req-dc0f4151-c7f0-4ff5-85db-d502ae75dab2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:22.354141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc0f4151-c7f0-4ff5-85db-d502ae75dab2 admin admin] The token cache is being invalidate because project 8ecb3d4d8ff944e987794279afa527a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:22.354473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc0f4151-c7f0-4ff5-85db-d502ae75dab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:22.355345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc0f4151-c7f0-4ff5-85db-d502ae75dab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:22.357103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9724bd5-2945-41a4-bc18-5e370ff321b2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:22.357965 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 911/1848] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:21 2022] DELETE /identity/v3/projects/8ecb3d4d8ff944e987794279afa527a3 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:22.359418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40ebd9-f6a7-4dda-a736-245f65ff03ef None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:22.362636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40ebd9-f6a7-4dda-a736-245f65ff03ef None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:22.363872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40ebd9-f6a7-4dda-a736-245f65ff03ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:22.420067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:22.450509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-af40ebd9-f6a7-4dda-a736-245f65ff03ef None None] MFA Rules not processed for user `0ef788633ee342f588481ecefcae5655`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:22.456893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-af40ebd9-f6a7-4dda-a736-245f65ff03ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:22.473561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56471e41-f46c-4338-8f74-da3dd5963d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:22.474395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56471e41-f46c-4338-8f74-da3dd5963d6d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:22.474900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56471e41-f46c-4338-8f74-da3dd5963d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:22.475369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56471e41-f46c-4338-8f74-da3dd5963d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:22.476232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56471e41-f46c-4338-8f74-da3dd5963d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:22.478527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56471e41-f46c-4338-8f74-da3dd5963d6d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:22.502353 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 938/1849] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:22.504355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56471e41-f46c-4338-8f74-da3dd5963d6d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:22.506977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-56471e41-f46c-4338-8f74-da3dd5963d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:22.537281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56471e41-f46c-4338-8f74-da3dd5963d6d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:22.546135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b69c56-1432-464a-8b99-9d7a7087329c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:22.554800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b69c56-1432-464a-8b99-9d7a7087329c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:22.554800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b69c56-1432-464a-8b99-9d7a7087329c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:22.554800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b69c56-1432-464a-8b99-9d7a7087329c admin admin] PATH_INFO: `/v3/users/df0614677e554551aa250ced6099526f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:22.554800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b69c56-1432-464a-8b99-9d7a7087329c admin admin] RBAC: Authorizing `identity:delete_user(user_id=df0614677e554551aa250ced6099526f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:22.568883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b69c56-1432-464a-8b99-9d7a7087329c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:22.635037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:22.648233 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 912/1850] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:22.649686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46501644-7512-4ca6-ae7c-03e4e622ea3e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:22.652067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46501644-7512-4ca6-ae7c-03e4e622ea3e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:22.652067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46501644-7512-4ca6-ae7c-03e4e622ea3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:22.713486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-46501644-7512-4ca6-ae7c-03e4e622ea3e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:22.715098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-46501644-7512-4ca6-ae7c-03e4e622ea3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:22.750991 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 913/1851] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:22.753591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46501644-7512-4ca6-ae7c-03e4e622ea3e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:22.758733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-46501644-7512-4ca6-ae7c-03e4e622ea3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:22.781367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46501644-7512-4ca6-ae7c-03e4e622ea3e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:22.791518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968dbb71-7a3e-4e92-9675-283a9d974671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:22.792955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dbb71-7a3e-4e92-9675-283a9d974671 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:22.793698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dbb71-7a3e-4e92-9675-283a9d974671 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:22.794204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dbb71-7a3e-4e92-9675-283a9d974671 admin admin] PATH_INFO: `/v3/projects/27f8b42f302c4a4292ab2f3885b77d08/users/8fff80184fdf45f6b4a5c376a2cc6993/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:22.837215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-87b69c56-1432-464a-8b99-9d7a7087329c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df0614677e554551aa250ced6099526f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:22.846312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968dbb71-7a3e-4e92-9675-283a9d974671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f8b42f302c4a4292ab2f3885b77d08, user_id=8fff80184fdf45f6b4a5c376a2cc6993, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:22.852575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968dbb71-7a3e-4e92-9675-283a9d974671 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:22.856176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-87b69c56-1432-464a-8b99-9d7a7087329c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df0614677e554551aa250ced6099526f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:22.959064 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 914/1852] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:22 2022] PUT /identity/v3/projects/27f8b42f302c4a4292ab2f3885b77d08/users/8fff80184fdf45f6b4a5c376a2cc6993/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:22.959064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968dbb71-7a3e-4e92-9675-283a9d974671 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:22.959960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-968dbb71-7a3e-4e92-9675-283a9d974671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:22.994710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-87b69c56-1432-464a-8b99-9d7a7087329c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df0614677e554551aa250ced6099526f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:22.995431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-87b69c56-1432-464a-8b99-9d7a7087329c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df0614677e554551aa250ced6099526f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:23.024509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-87b69c56-1432-464a-8b99-9d7a7087329c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df0614677e554551aa250ced6099526f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:23.037427 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 939/1853] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:22 2022] DELETE /identity/v3/users/df0614677e554551aa250ced6099526f => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:23.038949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479ae9e-9071-41d5-a785-8cdedd6e9d35 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:23.039097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479ae9e-9071-41d5-a785-8cdedd6e9d35 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:23.039382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479ae9e-9071-41d5-a785-8cdedd6e9d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:23.067638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4479ae9e-9071-41d5-a785-8cdedd6e9d35 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:23.068947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4479ae9e-9071-41d5-a785-8cdedd6e9d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:23.144587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968dbb71-7a3e-4e92-9675-283a9d974671 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:23.211550 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 940/1854] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:23.212261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479ae9e-9071-41d5-a785-8cdedd6e9d35 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:23.216927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4479ae9e-9071-41d5-a785-8cdedd6e9d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:23.247264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479ae9e-9071-41d5-a785-8cdedd6e9d35 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:23.256994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446085a-ead2-44c8-ad9e-ef3120deff6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:23.256994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446085a-ead2-44c8-ad9e-ef3120deff6f admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:23.256994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446085a-ead2-44c8-ad9e-ef3120deff6f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:23.256994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446085a-ead2-44c8-ad9e-ef3120deff6f admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:23.257611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446085a-ead2-44c8-ad9e-ef3120deff6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:23.259385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446085a-ead2-44c8-ad9e-ef3120deff6f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:23.288619 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 941/1855] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:23.289933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a98006-1bee-441d-8549-f3d748f70cf8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:23.290219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a98006-1bee-441d-8549-f3d748f70cf8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:23.290488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a98006-1bee-441d-8549-f3d748f70cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:23.297414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66abfc-2dba-4744-b2ac-4add2437f4b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:23.304480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66abfc-2dba-4744-b2ac-4add2437f4b8 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:23.304480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66abfc-2dba-4744-b2ac-4add2437f4b8 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:23.304480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66abfc-2dba-4744-b2ac-4add2437f4b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:23.304480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1b66abfc-2dba-4744-b2ac-4add2437f4b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:23.320230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e3a98006-1bee-441d-8549-f3d748f70cf8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:23.321538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e3a98006-1bee-441d-8549-f3d748f70cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:23.356225 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 942/1856] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:23.356225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a98006-1bee-441d-8549-f3d748f70cf8 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:23.381955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a98006-1bee-441d-8549-f3d748f70cf8 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:23.395422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69b682-259b-4c46-9a5e-538c8e89bc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:23.397418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69b682-259b-4c46-9a5e-538c8e89bc2d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:23.405534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69b682-259b-4c46-9a5e-538c8e89bc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:23.405839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69b682-259b-4c46-9a5e-538c8e89bc2d admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:23.406729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69b682-259b-4c46-9a5e-538c8e89bc2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:08:23.407101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69b682-259b-4c46-9a5e-538c8e89bc2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:23.410964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69b682-259b-4c46-9a5e-538c8e89bc2d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:23.451246 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 943/1857] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:23.452067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69b682-259b-4c46-9a5e-538c8e89bc2d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:23.475572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69b682-259b-4c46-9a5e-538c8e89bc2d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:23.479302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:23.490155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66abfc-2dba-4744-b2ac-4add2437f4b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:23.491790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78613999-9286-4813-a9d6-c8f33c306bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:23.492418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66abfc-2dba-4744-b2ac-4add2437f4b8 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:23.492713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78613999-9286-4813-a9d6-c8f33c306bde admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:23.493000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78613999-9286-4813-a9d6-c8f33c306bde admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:23.493296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78613999-9286-4813-a9d6-c8f33c306bde admin admin] PATH_INFO: `/v3/projects/27f8b42f302c4a4292ab2f3885b77d08/users/8fff80184fdf45f6b4a5c376a2cc6993/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:23.504300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78613999-9286-4813-a9d6-c8f33c306bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f8b42f302c4a4292ab2f3885b77d08, user_id=8fff80184fdf45f6b4a5c376a2cc6993, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:23.506323 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 915/1858] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:23.506563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78613999-9286-4813-a9d6-c8f33c306bde admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:23.509810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1336a-2f12-4e89-9da4-dc1d1981bde2 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:23.511918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1336a-2f12-4e89-9da4-dc1d1981bde2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:23.512343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1336a-2f12-4e89-9da4-dc1d1981bde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:23.539943 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 944/1859] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:23 2022] PUT /identity/v3/projects/27f8b42f302c4a4292ab2f3885b77d08/users/8fff80184fdf45f6b4a5c376a2cc6993/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:23.540885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78613999-9286-4813-a9d6-c8f33c306bde admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:23.551870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-78613999-9286-4813-a9d6-c8f33c306bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:23.602185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-57f1336a-2f12-4e89-9da4-dc1d1981bde2 None None] MFA Rules not processed for user `ef9cbce2b2e64665b7f50767342dcb46`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:23.603910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-57f1336a-2f12-4e89-9da4-dc1d1981bde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:23.691387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78613999-9286-4813-a9d6-c8f33c306bde admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:23.695529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b6909-96e1-4dc1-811c-ac9a6d5a7c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:23.696600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b6909-96e1-4dc1-811c-ac9a6d5a7c00 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:23.696886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b6909-96e1-4dc1-811c-ac9a6d5a7c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:23.697281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b6909-96e1-4dc1-811c-ac9a6d5a7c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:23.758982 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 916/1860] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:23.764099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1336a-2f12-4e89-9da4-dc1d1981bde2 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:23.844572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b6909-96e1-4dc1-811c-ac9a6d5a7c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:23.846275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b6909-96e1-4dc1-811c-ac9a6d5a7c00 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:23.874040 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 945/1861] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:23.875908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b42b8-72a3-4ac5-a4d3-611484aee688 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:23.876194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b42b8-72a3-4ac5-a4d3-611484aee688 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:23.876630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b42b8-72a3-4ac5-a4d3-611484aee688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:23.944632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-409b42b8-72a3-4ac5-a4d3-611484aee688 None None] MFA Rules not processed for user `8fff80184fdf45f6b4a5c376a2cc6993`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:23.945866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-409b42b8-72a3-4ac5-a4d3-611484aee688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:23.959145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1336a-2f12-4e89-9da4-dc1d1981bde2 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:23.984124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cb5eb-a69e-4a62-9f30-c55f7d4f7766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:23.984820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cb5eb-a69e-4a62-9f30-c55f7d4f7766 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:23.985107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cb5eb-a69e-4a62-9f30-c55f7d4f7766 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:23.986415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cb5eb-a69e-4a62-9f30-c55f7d4f7766 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:23.986415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6cb5eb-a69e-4a62-9f30-c55f7d4f7766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:23.996832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6cb5eb-a69e-4a62-9f30-c55f7d4f7766 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:24.112822 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 946/1862] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:24.112822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b42b8-72a3-4ac5-a4d3-611484aee688 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:24.117223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-409b42b8-72a3-4ac5-a4d3-611484aee688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:24.173045 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 917/1863] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:23 2022] POST /identity/v3/projects => generated 397 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:24.173045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cb5eb-a69e-4a62-9f30-c55f7d4f7766 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:24.177612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2e6cb5eb-a69e-4a62-9f30-c55f7d4f7766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:24.309005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b42b8-72a3-4ac5-a4d3-611484aee688 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:24.433056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cb5eb-a69e-4a62-9f30-c55f7d4f7766 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:24.442761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:24.446133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802440d0-4a13-4dac-910e-243144c3a5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:24.446830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802440d0-4a13-4dac-910e-243144c3a5d4 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:24.447142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802440d0-4a13-4dac-910e-243144c3a5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:24.447422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802440d0-4a13-4dac-910e-243144c3a5d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:24.448156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802440d0-4a13-4dac-910e-243144c3a5d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:24.450041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802440d0-4a13-4dac-910e-243144c3a5d4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:24.558154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115896ae-fcf8-453d-8dc6-79cead96fe13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:24.559509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115896ae-fcf8-453d-8dc6-79cead96fe13 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:24.560212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115896ae-fcf8-453d-8dc6-79cead96fe13 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:24.560842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115896ae-fcf8-453d-8dc6-79cead96fe13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:24.564948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-115896ae-fcf8-453d-8dc6-79cead96fe13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:24.591807 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 918/1864] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:24 2022] POST /identity/v3/projects => generated 403 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:24.594230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802440d0-4a13-4dac-910e-243144c3a5d4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:24.764929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115896ae-fcf8-453d-8dc6-79cead96fe13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:24.767635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115896ae-fcf8-453d-8dc6-79cead96fe13 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:24.793387 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 947/1865] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:24.797475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115896ae-fcf8-453d-8dc6-79cead96fe13 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:24.840719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115896ae-fcf8-453d-8dc6-79cead96fe13 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:24.913060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802440d0-4a13-4dac-910e-243144c3a5d4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:24.934194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a1014-6abe-4154-b0af-c1416801984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:24.937065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a1014-6abe-4154-b0af-c1416801984a admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:24.937374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a1014-6abe-4154-b0af-c1416801984a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:24.937617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a1014-6abe-4154-b0af-c1416801984a admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:24.938338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a1014-6abe-4154-b0af-c1416801984a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:24.944385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a1014-6abe-4154-b0af-c1416801984a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:25.007516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c832ad-da20-402a-938d-47fab2cedf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:25.009248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c832ad-da20-402a-938d-47fab2cedf4b admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:25.009635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c832ad-da20-402a-938d-47fab2cedf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:25.013075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c832ad-da20-402a-938d-47fab2cedf4b admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:25.014627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c832ad-da20-402a-938d-47fab2cedf4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:25.016215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c832ad-da20-402a-938d-47fab2cedf4b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:25.051329 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 919/1866] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:24 2022] POST /identity/v3/users => generated 299 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:25.054078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a1014-6abe-4154-b0af-c1416801984a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:25.057128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d75a1014-6abe-4154-b0af-c1416801984a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:25.181620 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 948/1867] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:24 2022] POST /identity/v3/users => generated 308 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:25.183363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c832ad-da20-402a-938d-47fab2cedf4b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:25.195859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-25c832ad-da20-402a-938d-47fab2cedf4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:25.312931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a1014-6abe-4154-b0af-c1416801984a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:25.328179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe72494-942f-44c7-b865-0d0c922a0aa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:25.329201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe72494-942f-44c7-b865-0d0c922a0aa6 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:25.329552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe72494-942f-44c7-b865-0d0c922a0aa6 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:25.329948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe72494-942f-44c7-b865-0d0c922a0aa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:25.340578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c832ad-da20-402a-938d-47fab2cedf4b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:25.372227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7ac62-78f9-4a71-830b-5617544231e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:25.377161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7ac62-78f9-4a71-830b-5617544231e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:25.377161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7ac62-78f9-4a71-830b-5617544231e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:25.377161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7ac62-78f9-4a71-830b-5617544231e0 admin admin] PATH_INFO: `/v3/projects/ed6998e80f4044fc8bb56a23ac75a4a6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:25.378514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7ac62-78f9-4a71-830b-5617544231e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed6998e80f4044fc8bb56a23ac75a4a6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:25.381637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7ac62-78f9-4a71-830b-5617544231e0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:25.431834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:25.526830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe72494-942f-44c7-b865-0d0c922a0aa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:25.528532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe72494-942f-44c7-b865-0d0c922a0aa6 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:25.546444 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 920/1868] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:25.546629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe72494-942f-44c7-b865-0d0c922a0aa6 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:25.556895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0fe72494-942f-44c7-b865-0d0c922a0aa6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:25.601108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-45b7ac62-78f9-4a71-830b-5617544231e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed6998e80f4044fc8bb56a23ac75a4a6', 'request_id': 'req-45b7ac62-78f9-4a71-830b-5617544231e0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:25.610111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe72494-942f-44c7-b865-0d0c922a0aa6 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:25.617252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-45b7ac62-78f9-4a71-830b-5617544231e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed6998e80f4044fc8bb56a23ac75a4a6', 'request_id': 'req-45b7ac62-78f9-4a71-830b-5617544231e0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:25.645793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-45b7ac62-78f9-4a71-830b-5617544231e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed6998e80f4044fc8bb56a23ac75a4a6', 'request_id': 'req-45b7ac62-78f9-4a71-830b-5617544231e0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:25.780342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe8d35-17d6-483c-a762-a76537caab73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:25.782589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe8d35-17d6-483c-a762-a76537caab73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:25.783367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe8d35-17d6-483c-a762-a76537caab73 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:25.784609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe8d35-17d6-483c-a762-a76537caab73 admin admin] PATH_INFO: `/v3/projects/74f033c562184d2a8a047a419005c880` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:25.786183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe8d35-17d6-483c-a762-a76537caab73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74f033c562184d2a8a047a419005c880)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:25.789298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe8d35-17d6-483c-a762-a76537caab73 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:25.875351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-45b7ac62-78f9-4a71-830b-5617544231e0 admin admin] The token cache is being invalidate because project ed6998e80f4044fc8bb56a23ac75a4a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:25.875942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-45b7ac62-78f9-4a71-830b-5617544231e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:25.876820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-45b7ac62-78f9-4a71-830b-5617544231e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:25.881743 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 949/1869] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:25 2022] DELETE /identity/v3/projects/ed6998e80f4044fc8bb56a23ac75a4a6 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:25.882847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7ac62-78f9-4a71-830b-5617544231e0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:25.884811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-45b7ac62-78f9-4a71-830b-5617544231e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:25.904999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7ac62-78f9-4a71-830b-5617544231e0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:25.911990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb05e5c-4b89-4f96-9857-2776dacd7018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:25.913151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb05e5c-4b89-4f96-9857-2776dacd7018 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:25.913915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb05e5c-4b89-4f96-9857-2776dacd7018 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:25.914744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb05e5c-4b89-4f96-9857-2776dacd7018 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:25.916452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb05e5c-4b89-4f96-9857-2776dacd7018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:25.919116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb05e5c-4b89-4f96-9857-2776dacd7018 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:25.948513 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 950/1870] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:25.948513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb05e5c-4b89-4f96-9857-2776dacd7018 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:25.948513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ecb05e5c-4b89-4f96-9857-2776dacd7018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:25.978719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb05e5c-4b89-4f96-9857-2776dacd7018 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:25.982072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-53fe8d35-17d6-483c-a762-a76537caab73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74f033c562184d2a8a047a419005c880', 'request_id': 'req-53fe8d35-17d6-483c-a762-a76537caab73'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:26.011534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-53fe8d35-17d6-483c-a762-a76537caab73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74f033c562184d2a8a047a419005c880', 'request_id': 'req-53fe8d35-17d6-483c-a762-a76537caab73'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:26.031104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-53fe8d35-17d6-483c-a762-a76537caab73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74f033c562184d2a8a047a419005c880', 'request_id': 'req-53fe8d35-17d6-483c-a762-a76537caab73'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:26.127345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99192f1-301c-4445-b268-7c9988845c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:26.130608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99192f1-301c-4445-b268-7c9988845c20 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:26.131282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99192f1-301c-4445-b268-7c9988845c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:26.131812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99192f1-301c-4445-b268-7c9988845c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:26.132795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99192f1-301c-4445-b268-7c9988845c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:26.136626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99192f1-301c-4445-b268-7c9988845c20 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:26.153099 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 951/1871] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:26.159454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5e593-ecbb-4786-baf7-599cfa2fbc22 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:26.160283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5e593-ecbb-4786-baf7-599cfa2fbc22 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:26.160869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5e593-ecbb-4786-baf7-599cfa2fbc22 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:26.162901 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 952/1872] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:08:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:08:26.164093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5e593-ecbb-4786-baf7-599cfa2fbc22 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:26.167982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dbe5e593-ecbb-4786-baf7-599cfa2fbc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:26.191802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-53fe8d35-17d6-483c-a762-a76537caab73 admin admin] The token cache is being invalidate because project 74f033c562184d2a8a047a419005c880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:26.191802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-53fe8d35-17d6-483c-a762-a76537caab73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:26.191802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-53fe8d35-17d6-483c-a762-a76537caab73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:26.192782 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 921/1873] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:25 2022] DELETE /identity/v3/projects/74f033c562184d2a8a047a419005c880 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:26.194543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe8d35-17d6-483c-a762-a76537caab73 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:26.196162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-53fe8d35-17d6-483c-a762-a76537caab73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:26.213009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5e593-ecbb-4786-baf7-599cfa2fbc22 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:26.220039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe8d35-17d6-483c-a762-a76537caab73 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:26.223864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6d65f-7367-43f0-bb0a-f04d3354ac25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:26.224880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6d65f-7367-43f0-bb0a-f04d3354ac25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:26.225278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6d65f-7367-43f0-bb0a-f04d3354ac25 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:26.225710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6d65f-7367-43f0-bb0a-f04d3354ac25 admin admin] PATH_INFO: `/v3/users/6b0de12b53df495d851dbc910f5ed0c2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:26.227188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6d65f-7367-43f0-bb0a-f04d3354ac25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b0de12b53df495d851dbc910f5ed0c2)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:26.229227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e34315-22fe-4e98-88c7-598574d9d9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:26.230799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e34315-22fe-4e98-88c7-598574d9d9fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:26.231424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e34315-22fe-4e98-88c7-598574d9d9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:26.231985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e34315-22fe-4e98-88c7-598574d9d9fb admin admin] PATH_INFO: `/v3/users/eeef7e8219ec4bd1b463112fe6dfb740` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:26.235321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6d65f-7367-43f0-bb0a-f04d3354ac25 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:26.243991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e34315-22fe-4e98-88c7-598574d9d9fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeef7e8219ec4bd1b463112fe6dfb740)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:26.249639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e34315-22fe-4e98-88c7-598574d9d9fb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:26.555203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f1e34315-22fe-4e98-88c7-598574d9d9fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeef7e8219ec4bd1b463112fe6dfb740'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:26.557941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eed6d65f-7367-43f0-bb0a-f04d3354ac25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b0de12b53df495d851dbc910f5ed0c2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:26.572747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eed6d65f-7367-43f0-bb0a-f04d3354ac25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b0de12b53df495d851dbc910f5ed0c2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:26.581553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f1e34315-22fe-4e98-88c7-598574d9d9fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeef7e8219ec4bd1b463112fe6dfb740'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:26.703157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eed6d65f-7367-43f0-bb0a-f04d3354ac25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b0de12b53df495d851dbc910f5ed0c2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:26.704996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eed6d65f-7367-43f0-bb0a-f04d3354ac25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b0de12b53df495d851dbc910f5ed0c2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:26.728345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eed6d65f-7367-43f0-bb0a-f04d3354ac25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b0de12b53df495d851dbc910f5ed0c2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:26.732210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:26.739316 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 953/1874] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:26 2022] DELETE /identity/v3/users/6b0de12b53df495d851dbc910f5ed0c2 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:26.741414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6d65f-7367-43f0-bb0a-f04d3354ac25 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:26.744403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-eed6d65f-7367-43f0-bb0a-f04d3354ac25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:26.802213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f1e34315-22fe-4e98-88c7-598574d9d9fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeef7e8219ec4bd1b463112fe6dfb740'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:26.815877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f1e34315-22fe-4e98-88c7-598574d9d9fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeef7e8219ec4bd1b463112fe6dfb740'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:26.817274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f1e34315-22fe-4e98-88c7-598574d9d9fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeef7e8219ec4bd1b463112fe6dfb740'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:26.840948 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 922/1875] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:26 2022] DELETE /identity/v3/users/eeef7e8219ec4bd1b463112fe6dfb740 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:26.844396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e34315-22fe-4e98-88c7-598574d9d9fb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:26.855291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f1e34315-22fe-4e98-88c7-598574d9d9fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:26.959952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6d65f-7367-43f0-bb0a-f04d3354ac25 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:27.037025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e34315-22fe-4e98-88c7-598574d9d9fb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:27.043428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0144a-bdce-4bac-ba74-55ef81daebf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:27.044487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0144a-bdce-4bac-ba74-55ef81daebf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:27.044871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0144a-bdce-4bac-ba74-55ef81daebf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:27.045283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0144a-bdce-4bac-ba74-55ef81daebf1 admin admin] PATH_INFO: `/v3/projects/04682771a847412fb31d7e6758a95a9a/users/497fdecb763d4d038580caf3c1c8ae01/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:27.082683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0144a-bdce-4bac-ba74-55ef81daebf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04682771a847412fb31d7e6758a95a9a, user_id=497fdecb763d4d038580caf3c1c8ae01, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:27.084026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4315a99-575c-4b84-95c5-004888124119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:27.084777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4315a99-575c-4b84-95c5-004888124119 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:27.085064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4315a99-575c-4b84-95c5-004888124119 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:27.085397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4315a99-575c-4b84-95c5-004888124119 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:27.086147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4315a99-575c-4b84-95c5-004888124119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:27.088361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4315a99-575c-4b84-95c5-004888124119 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:27.097678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0144a-bdce-4bac-ba74-55ef81daebf1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:27.106522 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 954/1876] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:27.107585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4315a99-575c-4b84-95c5-004888124119 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:27.111666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a4315a99-575c-4b84-95c5-004888124119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:27.126897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4315a99-575c-4b84-95c5-004888124119 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:27.134135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a69fb-861a-4d65-8038-f028850cf99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:27.141792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a69fb-861a-4d65-8038-f028850cf99b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:27.142592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a69fb-861a-4d65-8038-f028850cf99b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:27.142592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a69fb-861a-4d65-8038-f028850cf99b admin admin] PATH_INFO: `/v3/users/d26abb39168242ddbb4d7a247fc17dd1` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:27.144842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a69fb-861a-4d65-8038-f028850cf99b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d26abb39168242ddbb4d7a247fc17dd1)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:27.146959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a69fb-861a-4d65-8038-f028850cf99b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:27.237492 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 923/1877] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:26 2022] PUT /identity/v3/projects/04682771a847412fb31d7e6758a95a9a/users/497fdecb763d4d038580caf3c1c8ae01/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:27.239435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b19d9-49d9-43b5-a748-ca9f8802298b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:27.239918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b19d9-49d9-43b5-a748-ca9f8802298b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:27.240555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b19d9-49d9-43b5-a748-ca9f8802298b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:27.297482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3a0b19d9-49d9-43b5-a748-ca9f8802298b None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:27.298846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3a0b19d9-49d9-43b5-a748-ca9f8802298b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:27.470141 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 924/1878] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:08:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:27.472513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bfb7e-556e-431b-a6ac-d6fe25e14833 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:27.473395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bfb7e-556e-431b-a6ac-d6fe25e14833 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:27.473883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bfb7e-556e-431b-a6ac-d6fe25e14833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:27.483656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-919a69fb-861a-4d65-8038-f028850cf99b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd26abb39168242ddbb4d7a247fc17dd1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:27.506063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2f0bfb7e-556e-431b-a6ac-d6fe25e14833 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:27.507897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2f0bfb7e-556e-431b-a6ac-d6fe25e14833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:27.510773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-919a69fb-861a-4d65-8038-f028850cf99b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd26abb39168242ddbb4d7a247fc17dd1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:27.619374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-919a69fb-861a-4d65-8038-f028850cf99b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd26abb39168242ddbb4d7a247fc17dd1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:27.620002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-919a69fb-861a-4d65-8038-f028850cf99b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd26abb39168242ddbb4d7a247fc17dd1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:27.653814 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 925/1879] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:27.654846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-919a69fb-861a-4d65-8038-f028850cf99b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd26abb39168242ddbb4d7a247fc17dd1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:27.658478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bfb7e-556e-431b-a6ac-d6fe25e14833 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:27.668808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2f0bfb7e-556e-431b-a6ac-d6fe25e14833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:27.671144 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 955/1880] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:27 2022] DELETE /identity/v3/users/d26abb39168242ddbb4d7a247fc17dd1 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:27.672015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a69fb-861a-4d65-8038-f028850cf99b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:27.691067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-919a69fb-861a-4d65-8038-f028850cf99b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:27.700370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bfb7e-556e-431b-a6ac-d6fe25e14833 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:27.870757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b784fc-9544-4d46-a743-81c7477c4dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:27.872926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b784fc-9544-4d46-a743-81c7477c4dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:27.873575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b784fc-9544-4d46-a743-81c7477c4dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:27.874041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b784fc-9544-4d46-a743-81c7477c4dfc admin admin] PATH_INFO: `/v3/projects/55dc74e9c8884796818fb12bd31f449a/users/3f63a1fb362b462fa8f36f5a53cb6cf1/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:27.904643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b784fc-9544-4d46-a743-81c7477c4dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=55dc74e9c8884796818fb12bd31f449a, user_id=3f63a1fb362b462fa8f36f5a53cb6cf1, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:27.940351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b784fc-9544-4d46-a743-81c7477c4dfc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:27.968672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a69fb-861a-4d65-8038-f028850cf99b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:27.975488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38356e5f-a5b9-4c1c-939c-58d8897da02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:27.976390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38356e5f-a5b9-4c1c-939c-58d8897da02b admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:27.976799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38356e5f-a5b9-4c1c-939c-58d8897da02b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:27.977941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38356e5f-a5b9-4c1c-939c-58d8897da02b admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:27.979114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38356e5f-a5b9-4c1c-939c-58d8897da02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:27.981085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38356e5f-a5b9-4c1c-939c-58d8897da02b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:28.013952 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 956/1881] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:28.013952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38356e5f-a5b9-4c1c-939c-58d8897da02b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:28.017079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-38356e5f-a5b9-4c1c-939c-58d8897da02b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:28.067658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38356e5f-a5b9-4c1c-939c-58d8897da02b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:28.074680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee882df-fce7-4782-99c1-007b61ced4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:28.075618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee882df-fce7-4782-99c1-007b61ced4f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:28.075897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee882df-fce7-4782-99c1-007b61ced4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:28.076172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee882df-fce7-4782-99c1-007b61ced4f8 admin admin] PATH_INFO: `/v3/users/b2e42b0ddd1b44b79a6f8e0bbf5da3cf` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:28.078341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee882df-fce7-4782-99c1-007b61ced4f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2e42b0ddd1b44b79a6f8e0bbf5da3cf)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:28.081250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee882df-fce7-4782-99c1-007b61ced4f8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:28.114558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:28.120054 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 926/1882] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:27 2022] PUT /identity/v3/projects/55dc74e9c8884796818fb12bd31f449a/users/3f63a1fb362b462fa8f36f5a53cb6cf1/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:28.120054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b784fc-9544-4d46-a743-81c7477c4dfc admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:28.128237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-43b784fc-9544-4d46-a743-81c7477c4dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:28.326169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3ee882df-fce7-4782-99c1-007b61ced4f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2e42b0ddd1b44b79a6f8e0bbf5da3cf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:28.341450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3ee882df-fce7-4782-99c1-007b61ced4f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2e42b0ddd1b44b79a6f8e0bbf5da3cf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:28.350404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b784fc-9544-4d46-a743-81c7477c4dfc admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:28.359540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888a3da-a9c2-43ac-a6ca-a5e4910c3691 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:28.360298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888a3da-a9c2-43ac-a6ca-a5e4910c3691 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:28.360583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888a3da-a9c2-43ac-a6ca-a5e4910c3691 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:28.362905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888a3da-a9c2-43ac-a6ca-a5e4910c3691 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:28.365251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e888a3da-a9c2-43ac-a6ca-a5e4910c3691 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:28.384108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888a3da-a9c2-43ac-a6ca-a5e4910c3691 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:28.385948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888a3da-a9c2-43ac-a6ca-a5e4910c3691 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:28.409815 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 927/1883] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:28.409815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888a3da-a9c2-43ac-a6ca-a5e4910c3691 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:28.423589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e888a3da-a9c2-43ac-a6ca-a5e4910c3691 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:28.434393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3ee882df-fce7-4782-99c1-007b61ced4f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2e42b0ddd1b44b79a6f8e0bbf5da3cf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:28.435032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3ee882df-fce7-4782-99c1-007b61ced4f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2e42b0ddd1b44b79a6f8e0bbf5da3cf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:28.462858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3ee882df-fce7-4782-99c1-007b61ced4f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2e42b0ddd1b44b79a6f8e0bbf5da3cf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:28.479556 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 957/1884] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:28 2022] DELETE /identity/v3/users/b2e42b0ddd1b44b79a6f8e0bbf5da3cf => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:28.480332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee882df-fce7-4782-99c1-007b61ced4f8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:28.485020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3ee882df-fce7-4782-99c1-007b61ced4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:28.543032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888a3da-a9c2-43ac-a6ca-a5e4910c3691 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:28.620066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee882df-fce7-4782-99c1-007b61ced4f8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:28.626405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3752a-ffc3-4dc7-b400-c5058c7845f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:28.628479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3752a-ffc3-4dc7-b400-c5058c7845f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:28.629703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3752a-ffc3-4dc7-b400-c5058c7845f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:28.630165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3752a-ffc3-4dc7-b400-c5058c7845f5 admin admin] PATH_INFO: `/v3/projects/04682771a847412fb31d7e6758a95a9a/users/497fdecb763d4d038580caf3c1c8ae01/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:28.632897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3752a-ffc3-4dc7-b400-c5058c7845f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04682771a847412fb31d7e6758a95a9a, user_id=497fdecb763d4d038580caf3c1c8ae01, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:28.637208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:28.639065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3752a-ffc3-4dc7-b400-c5058c7845f5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:28.655633 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 958/1885] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:28 2022] PUT /identity/v3/projects/04682771a847412fb31d7e6758a95a9a/users/497fdecb763d4d038580caf3c1c8ae01/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:28.657290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a6714-2a4c-4faa-8052-7b635a421278 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:28.657652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a6714-2a4c-4faa-8052-7b635a421278 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:28.658041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a6714-2a4c-4faa-8052-7b635a421278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:28.694530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de953ef0-2a50-4b6a-abc8-ca731be292e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:28.695651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de953ef0-2a50-4b6a-abc8-ca731be292e2 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:28.696085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de953ef0-2a50-4b6a-abc8-ca731be292e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:28.697812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de953ef0-2a50-4b6a-abc8-ca731be292e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:28.702881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-022a6714-2a4c-4faa-8052-7b635a421278 None None] MFA Rules not processed for user `3f63a1fb362b462fa8f36f5a53cb6cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:28.703330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-de953ef0-2a50-4b6a-abc8-ca731be292e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:28.708432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-022a6714-2a4c-4faa-8052-7b635a421278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:28.746948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de953ef0-2a50-4b6a-abc8-ca731be292e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:28.754965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de953ef0-2a50-4b6a-abc8-ca731be292e2 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:28.879347 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 928/1886] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:28.879347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de953ef0-2a50-4b6a-abc8-ca731be292e2 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:28.889020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-de953ef0-2a50-4b6a-abc8-ca731be292e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:28.905821 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 959/1887] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:28.905821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a6714-2a4c-4faa-8052-7b635a421278 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:28.910225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-022a6714-2a4c-4faa-8052-7b635a421278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:28.918411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de953ef0-2a50-4b6a-abc8-ca731be292e2 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:29.112408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bdc20-76d0-4da0-b57f-7edf09eaebf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:29.113653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bdc20-76d0-4da0-b57f-7edf09eaebf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:29.114119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bdc20-76d0-4da0-b57f-7edf09eaebf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:29.115278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bdc20-76d0-4da0-b57f-7edf09eaebf3 admin admin] PATH_INFO: `/v3/projects/427515e67f884dbe988c183fa82424eb` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:29.116913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bdc20-76d0-4da0-b57f-7edf09eaebf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=427515e67f884dbe988c183fa82424eb)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:29.119373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bdc20-76d0-4da0-b57f-7edf09eaebf3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:29.132746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a6714-2a4c-4faa-8052-7b635a421278 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:29.158377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c1da8-22f3-49a0-b331-5f0b7479becd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:29.159568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c1da8-22f3-49a0-b331-5f0b7479becd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:29.160000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c1da8-22f3-49a0-b331-5f0b7479becd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:29.160742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c1da8-22f3-49a0-b331-5f0b7479becd admin admin] PATH_INFO: `/v3/projects/46bba77d2d774946afb95674b6eb4da8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:29.162403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c1da8-22f3-49a0-b331-5f0b7479becd admin admin] RBAC: Authorizing `identity:delete_project(project_id=46bba77d2d774946afb95674b6eb4da8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:29.165445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c1da8-22f3-49a0-b331-5f0b7479becd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:29.305873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0a7bdc20-76d0-4da0-b57f-7edf09eaebf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '427515e67f884dbe988c183fa82424eb', 'request_id': 'req-0a7bdc20-76d0-4da0-b57f-7edf09eaebf3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:29.321023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0a7bdc20-76d0-4da0-b57f-7edf09eaebf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '427515e67f884dbe988c183fa82424eb', 'request_id': 'req-0a7bdc20-76d0-4da0-b57f-7edf09eaebf3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:29.348958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0a7bdc20-76d0-4da0-b57f-7edf09eaebf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '427515e67f884dbe988c183fa82424eb', 'request_id': 'req-0a7bdc20-76d0-4da0-b57f-7edf09eaebf3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:29.399128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ae4c1da8-22f3-49a0-b331-5f0b7479becd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46bba77d2d774946afb95674b6eb4da8', 'request_id': 'req-ae4c1da8-22f3-49a0-b331-5f0b7479becd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:29.403239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:29.412444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ae4c1da8-22f3-49a0-b331-5f0b7479becd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46bba77d2d774946afb95674b6eb4da8', 'request_id': 'req-ae4c1da8-22f3-49a0-b331-5f0b7479becd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:29.432712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ae4c1da8-22f3-49a0-b331-5f0b7479becd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46bba77d2d774946afb95674b6eb4da8', 'request_id': 'req-ae4c1da8-22f3-49a0-b331-5f0b7479becd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:29.480925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0a7bdc20-76d0-4da0-b57f-7edf09eaebf3 admin admin] The token cache is being invalidate because project 427515e67f884dbe988c183fa82424eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:29.480925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0a7bdc20-76d0-4da0-b57f-7edf09eaebf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:29.487873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0a7bdc20-76d0-4da0-b57f-7edf09eaebf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:29.489678 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 929/1888] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:28 2022] DELETE /identity/v3/projects/427515e67f884dbe988c183fa82424eb => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:29.491743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e3e2e-30c2-4dc2-825f-64e759c3c9ad None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:29.491743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e3e2e-30c2-4dc2-825f-64e759c3c9ad None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:29.491743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e3e2e-30c2-4dc2-825f-64e759c3c9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:29.555673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-372e3e2e-30c2-4dc2-825f-64e759c3c9ad None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:29.556941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-372e3e2e-30c2-4dc2-825f-64e759c3c9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:29.592294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ae4c1da8-22f3-49a0-b331-5f0b7479becd admin admin] The token cache is being invalidate because project 46bba77d2d774946afb95674b6eb4da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:29.597600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ae4c1da8-22f3-49a0-b331-5f0b7479becd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:29.597600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ae4c1da8-22f3-49a0-b331-5f0b7479becd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:29.597600 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 960/1889] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:28 2022] DELETE /identity/v3/projects/46bba77d2d774946afb95674b6eb4da8 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:29.598039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c1da8-22f3-49a0-b331-5f0b7479becd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:29.620132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ae4c1da8-22f3-49a0-b331-5f0b7479becd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:29.663879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:29.803565 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 930/1890] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:29.810614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ced692-4fb8-4ad4-977c-8317ed3276fe None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:29.810614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ced692-4fb8-4ad4-977c-8317ed3276fe None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:29.810614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ced692-4fb8-4ad4-977c-8317ed3276fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:29.855422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c1da8-22f3-49a0-b331-5f0b7479becd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:29.873885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac5cf7-1216-4d0b-ad73-7e113df7de05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:29.874743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac5cf7-1216-4d0b-ad73-7e113df7de05 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:29.875053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac5cf7-1216-4d0b-ad73-7e113df7de05 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:29.875339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac5cf7-1216-4d0b-ad73-7e113df7de05 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:29.876246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac5cf7-1216-4d0b-ad73-7e113df7de05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:29.878912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac5cf7-1216-4d0b-ad73-7e113df7de05 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:29.934867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-96ced692-4fb8-4ad4-977c-8317ed3276fe None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:29.946223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-96ced692-4fb8-4ad4-977c-8317ed3276fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:30.076881 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 931/1891] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:30.076881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4306a-0837-4f2a-988c-1934ab8bfb7f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:30.076881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4306a-0837-4f2a-988c-1934ab8bfb7f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:30.076881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4306a-0837-4f2a-988c-1934ab8bfb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:30.076881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1fc4306a-0837-4f2a-988c-1934ab8bfb7f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:30.076881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1fc4306a-0837-4f2a-988c-1934ab8bfb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:30.077723 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 932/1892] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:30.077723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4306a-0837-4f2a-988c-1934ab8bfb7f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:30.077723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1fc4306a-0837-4f2a-988c-1934ab8bfb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:30.185648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4306a-0837-4f2a-988c-1934ab8bfb7f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:30.192883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2f4d0-3c8a-48b6-8bb4-26748f8e93be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:30.193863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2f4d0-3c8a-48b6-8bb4-26748f8e93be service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:30.194160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2f4d0-3c8a-48b6-8bb4-26748f8e93be service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:30.194654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2f4d0-3c8a-48b6-8bb4-26748f8e93be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:30.216785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2f4d0-3c8a-48b6-8bb4-26748f8e93be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:30.226364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2f4d0-3c8a-48b6-8bb4-26748f8e93be service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:30.274046 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 933/1893] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:30.275727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2f4d0-3c8a-48b6-8bb4-26748f8e93be service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:30.283672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ead2f4d0-3c8a-48b6-8bb4-26748f8e93be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:30.332118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2f4d0-3c8a-48b6-8bb4-26748f8e93be service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:30.341136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b934e-5576-44e8-95f9-da1e7250bc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:30.342540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b934e-5576-44e8-95f9-da1e7250bc5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:30.343057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b934e-5576-44e8-95f9-da1e7250bc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:30.344329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b934e-5576-44e8-95f9-da1e7250bc5b admin admin] PATH_INFO: `/v3/projects/4ec272599c454aa0a9f19e865491272d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:30.348479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b934e-5576-44e8-95f9-da1e7250bc5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec272599c454aa0a9f19e865491272d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:30.352559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b934e-5576-44e8-95f9-da1e7250bc5b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:31.398331 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 961/1894] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:29 2022] POST /identity/v3/projects => generated 399 bytes in 1798 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:31.398331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485bba5-ce5d-468b-b3d3-402b3fb69c37 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:31.398331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485bba5-ce5d-468b-b3d3-402b3fb69c37 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:31.398331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485bba5-ce5d-468b-b3d3-402b3fb69c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:31.417988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3485bba5-ce5d-468b-b3d3-402b3fb69c37 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:31.419229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3485bba5-ce5d-468b-b3d3-402b3fb69c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:31.504071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a94b934e-5576-44e8-95f9-da1e7250bc5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec272599c454aa0a9f19e865491272d', 'request_id': 'req-a94b934e-5576-44e8-95f9-da1e7250bc5b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:31.512450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a94b934e-5576-44e8-95f9-da1e7250bc5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec272599c454aa0a9f19e865491272d', 'request_id': 'req-a94b934e-5576-44e8-95f9-da1e7250bc5b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:31.535377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a94b934e-5576-44e8-95f9-da1e7250bc5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec272599c454aa0a9f19e865491272d', 'request_id': 'req-a94b934e-5576-44e8-95f9-da1e7250bc5b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:31.565441 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 962/1895] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:31.568214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81199e-8949-451c-9ab7-b01369c98fe8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:31.568770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81199e-8949-451c-9ab7-b01369c98fe8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:31.569887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81199e-8949-451c-9ab7-b01369c98fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:31.620504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8b81199e-8949-451c-9ab7-b01369c98fe8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:31.622038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8b81199e-8949-451c-9ab7-b01369c98fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:31.732279 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 963/1896] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:31.733436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81199e-8949-451c-9ab7-b01369c98fe8 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:31.744644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81199e-8949-451c-9ab7-b01369c98fe8 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:31.749910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2355dec-a152-43e3-a029-b73bd8afcddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:31.750603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2355dec-a152-43e3-a029-b73bd8afcddd admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:31.750883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2355dec-a152-43e3-a029-b73bd8afcddd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:31.751220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2355dec-a152-43e3-a029-b73bd8afcddd admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:31.751919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2355dec-a152-43e3-a029-b73bd8afcddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:31.759176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2355dec-a152-43e3-a029-b73bd8afcddd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:31.761387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a94b934e-5576-44e8-95f9-da1e7250bc5b admin admin] The token cache is being invalidate because project 4ec272599c454aa0a9f19e865491272d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:31.761739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a94b934e-5576-44e8-95f9-da1e7250bc5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:31.762448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a94b934e-5576-44e8-95f9-da1e7250bc5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:31.764480 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 934/1897] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:30 2022] DELETE /identity/v3/projects/4ec272599c454aa0a9f19e865491272d => generated 0 bytes in 1490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:31.765034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b934e-5576-44e8-95f9-da1e7250bc5b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:31.766287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a94b934e-5576-44e8-95f9-da1e7250bc5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:31.791066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b934e-5576-44e8-95f9-da1e7250bc5b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:31.803859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e07498-da44-42b0-ae40-41b244c17a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:31.803859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e07498-da44-42b0-ae40-41b244c17a50 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:31.803859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e07498-da44-42b0-ae40-41b244c17a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:31.803859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e07498-da44-42b0-ae40-41b244c17a50 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:31.804453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e07498-da44-42b0-ae40-41b244c17a50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:08:31.804453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e07498-da44-42b0-ae40-41b244c17a50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:31.804453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e07498-da44-42b0-ae40-41b244c17a50 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:31.814314 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 935/1898] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:31.816033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e07498-da44-42b0-ae40-41b244c17a50 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:31.817870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-58e07498-da44-42b0-ae40-41b244c17a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:31.831574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e07498-da44-42b0-ae40-41b244c17a50 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:31.839416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a778e9-08b9-42b7-9af6-b2a2c9a3d0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:31.839416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a778e9-08b9-42b7-9af6-b2a2c9a3d0fb admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:31.839416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a778e9-08b9-42b7-9af6-b2a2c9a3d0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:31.839416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a778e9-08b9-42b7-9af6-b2a2c9a3d0fb admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:31.839775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a778e9-08b9-42b7-9af6-b2a2c9a3d0fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:08:31.839775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a778e9-08b9-42b7-9af6-b2a2c9a3d0fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:31.840302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a778e9-08b9-42b7-9af6-b2a2c9a3d0fb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:31.853848 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 936/1899] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:31.854773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a778e9-08b9-42b7-9af6-b2a2c9a3d0fb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:31.857789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-31a778e9-08b9-42b7-9af6-b2a2c9a3d0fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:31.876288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a778e9-08b9-42b7-9af6-b2a2c9a3d0fb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:31.882210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62f8ca-6fb5-410c-9478-696e78c67379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:31.883127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62f8ca-6fb5-410c-9478-696e78c67379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:31.883494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62f8ca-6fb5-410c-9478-696e78c67379 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:31.883723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62f8ca-6fb5-410c-9478-696e78c67379 admin admin] PATH_INFO: `/v3/users/0ef788633ee342f588481ecefcae5655` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:31.885167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62f8ca-6fb5-410c-9478-696e78c67379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ef788633ee342f588481ecefcae5655)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:31.887302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62f8ca-6fb5-410c-9478-696e78c67379 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:31.932881 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 964/1900] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:31 2022] POST /identity/v3/users => generated 306 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:31.933512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2355dec-a152-43e3-a029-b73bd8afcddd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:31.962428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2355dec-a152-43e3-a029-b73bd8afcddd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:31.970787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbf831-ee37-47ab-ad03-4657775fe5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:31.972529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbf831-ee37-47ab-ad03-4657775fe5f6 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:31.973029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbf831-ee37-47ab-ad03-4657775fe5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:31.973528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbf831-ee37-47ab-ad03-4657775fe5f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:31.974854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbf831-ee37-47ab-ad03-4657775fe5f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:31.978718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbf831-ee37-47ab-ad03-4657775fe5f6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:32.108789 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 965/1901] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:31 2022] POST /identity/v3/projects => generated 403 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:32.108789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbf831-ee37-47ab-ad03-4657775fe5f6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:32.134286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:32.156944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3c62f8ca-6fb5-410c-9478-696e78c67379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ef788633ee342f588481ecefcae5655'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:32.180105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3c62f8ca-6fb5-410c-9478-696e78c67379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ef788633ee342f588481ecefcae5655'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:32.218166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbf831-ee37-47ab-ad03-4657775fe5f6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:32.225250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d23c46-0f05-45fa-8c4d-d690591b31e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:32.225934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d23c46-0f05-45fa-8c4d-d690591b31e6 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:32.226214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d23c46-0f05-45fa-8c4d-d690591b31e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:32.226487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d23c46-0f05-45fa-8c4d-d690591b31e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:32.227383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d23c46-0f05-45fa-8c4d-d690591b31e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:32.229428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d23c46-0f05-45fa-8c4d-d690591b31e6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:32.240623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3c62f8ca-6fb5-410c-9478-696e78c67379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ef788633ee342f588481ecefcae5655'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:32.248256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3c62f8ca-6fb5-410c-9478-696e78c67379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ef788633ee342f588481ecefcae5655'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:32.252824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3c62f8ca-6fb5-410c-9478-696e78c67379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ef788633ee342f588481ecefcae5655'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:32.256364 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 937/1902] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:31 2022] DELETE /identity/v3/users/0ef788633ee342f588481ecefcae5655 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:32.257478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62f8ca-6fb5-410c-9478-696e78c67379 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:32.258962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3c62f8ca-6fb5-410c-9478-696e78c67379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:32.342632 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 966/1903] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:32 2022] POST /identity/v3/projects => generated 373 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:32.342632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d23c46-0f05-45fa-8c4d-d690591b31e6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:32.342632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-27d23c46-0f05-45fa-8c4d-d690591b31e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:32.400444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62f8ca-6fb5-410c-9478-696e78c67379 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:32.429393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d23c46-0f05-45fa-8c4d-d690591b31e6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:32.433625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e6b2c-2d54-4b3d-93be-e83af92942d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:32.434475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e6b2c-2d54-4b3d-93be-e83af92942d3 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:32.434817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e6b2c-2d54-4b3d-93be-e83af92942d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:32.435209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e6b2c-2d54-4b3d-93be-e83af92942d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:32.436004 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e6b2c-2d54-4b3d-93be-e83af92942d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:32.437771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e6b2c-2d54-4b3d-93be-e83af92942d3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:32.454359 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 967/1904] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:32.458819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e6b2c-2d54-4b3d-93be-e83af92942d3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:32.461151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1d7e6b2c-2d54-4b3d-93be-e83af92942d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:32.476497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e6b2c-2d54-4b3d-93be-e83af92942d3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:32.477583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b8bbf-d931-46f9-ac47-2acea1cab4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:32.478454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b8bbf-d931-46f9-ac47-2acea1cab4d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:32.478762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b8bbf-d931-46f9-ac47-2acea1cab4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:32.478996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b8bbf-d931-46f9-ac47-2acea1cab4d9 admin admin] PATH_INFO: `/v3/projects/db02af1656684f57904f5a33ca045740` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:32.480187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b8bbf-d931-46f9-ac47-2acea1cab4d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db02af1656684f57904f5a33ca045740)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:32.481202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4dd15e-ec82-48eb-9bb2-ffcc2ee4cd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:32.481843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dd15e-ec82-48eb-9bb2-ffcc2ee4cd89 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:32.482082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b8bbf-d931-46f9-ac47-2acea1cab4d9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:32.482188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dd15e-ec82-48eb-9bb2-ffcc2ee4cd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:32.482380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dd15e-ec82-48eb-9bb2-ffcc2ee4cd89 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:32.483090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4dd15e-ec82-48eb-9bb2-ffcc2ee4cd89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:32.485053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4dd15e-ec82-48eb-9bb2-ffcc2ee4cd89 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:32.618084 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 968/1905] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:32 2022] POST /identity/v3/users => generated 302 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:32.619061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4dd15e-ec82-48eb-9bb2-ffcc2ee4cd89 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:32.621599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ee4dd15e-ec82-48eb-9bb2-ffcc2ee4cd89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:32.636118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7a6b8bbf-d931-46f9-ac47-2acea1cab4d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db02af1656684f57904f5a33ca045740', 'request_id': 'req-7a6b8bbf-d931-46f9-ac47-2acea1cab4d9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:32.637296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4dd15e-ec82-48eb-9bb2-ffcc2ee4cd89 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:32.644834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7a6b8bbf-d931-46f9-ac47-2acea1cab4d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db02af1656684f57904f5a33ca045740', 'request_id': 'req-7a6b8bbf-d931-46f9-ac47-2acea1cab4d9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:32.653287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7a6b8bbf-d931-46f9-ac47-2acea1cab4d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db02af1656684f57904f5a33ca045740', 'request_id': 'req-7a6b8bbf-d931-46f9-ac47-2acea1cab4d9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:32.728932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5811b-a4d6-41c9-a778-a3556d3b2406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:32.739335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5811b-a4d6-41c9-a778-a3556d3b2406 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:32.739335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5811b-a4d6-41c9-a778-a3556d3b2406 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:32.739335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5811b-a4d6-41c9-a778-a3556d3b2406 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:32.739335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5811b-a4d6-41c9-a778-a3556d3b2406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:32.739335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5811b-a4d6-41c9-a778-a3556d3b2406 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:32.766629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7a6b8bbf-d931-46f9-ac47-2acea1cab4d9 admin admin] The token cache is being invalidate because project db02af1656684f57904f5a33ca045740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:32.779783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7a6b8bbf-d931-46f9-ac47-2acea1cab4d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:32.779783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7a6b8bbf-d931-46f9-ac47-2acea1cab4d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:32.779783 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 938/1906] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:32 2022] DELETE /identity/v3/projects/db02af1656684f57904f5a33ca045740 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:32.779783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b8bbf-d931-46f9-ac47-2acea1cab4d9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:32.779783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7a6b8bbf-d931-46f9-ac47-2acea1cab4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:32.793402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b8bbf-d931-46f9-ac47-2acea1cab4d9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:32.802248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ca4ae-b6b6-484c-87ce-40b266e802df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:32.803779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ca4ae-b6b6-484c-87ce-40b266e802df admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:32.804265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ca4ae-b6b6-484c-87ce-40b266e802df admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:32.804768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ca4ae-b6b6-484c-87ce-40b266e802df admin admin] PATH_INFO: `/v3/projects/531521baa8f1419398a42b7e7cf47b33/users/10ccde987997492c9dc816f3edb9d6c1/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:32.828416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ca4ae-b6b6-484c-87ce-40b266e802df admin admin] RBAC: Authorizing `identity:create_grant(project_id=531521baa8f1419398a42b7e7cf47b33, user_id=10ccde987997492c9dc816f3edb9d6c1, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:32.831849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ca4ae-b6b6-484c-87ce-40b266e802df admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:32.859890 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 969/1907] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:32 2022] POST /identity/v3/users => generated 287 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:32.859890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5811b-a4d6-41c9-a778-a3556d3b2406 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:32.859890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c7c5811b-a4d6-41c9-a778-a3556d3b2406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:32.879064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5811b-a4d6-41c9-a778-a3556d3b2406 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:32.884977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc680306-62ef-4858-8e7a-9905e4feae6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:32.885801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc680306-62ef-4858-8e7a-9905e4feae6c admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:32.886017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc680306-62ef-4858-8e7a-9905e4feae6c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:32.886297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc680306-62ef-4858-8e7a-9905e4feae6c admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:32.887124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc680306-62ef-4858-8e7a-9905e4feae6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:32.889050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc680306-62ef-4858-8e7a-9905e4feae6c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:32.904791 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 970/1908] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:32.906400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc680306-62ef-4858-8e7a-9905e4feae6c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:32.909034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cc680306-62ef-4858-8e7a-9905e4feae6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:32.925015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc680306-62ef-4858-8e7a-9905e4feae6c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:32.932770 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 939/1909] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:32 2022] PUT /identity/v3/projects/531521baa8f1419398a42b7e7cf47b33/users/10ccde987997492c9dc816f3edb9d6c1/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:32.935071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ca4ae-b6b6-484c-87ce-40b266e802df admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:32.941493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-623ca4ae-b6b6-484c-87ce-40b266e802df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:32.953652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:33.019546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7db9b2-f7ee-455a-821d-9d0bcf6932ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:33.020703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7db9b2-f7ee-455a-821d-9d0bcf6932ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:33.021058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7db9b2-f7ee-455a-821d-9d0bcf6932ef admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:33.023612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7db9b2-f7ee-455a-821d-9d0bcf6932ef admin admin] PATH_INFO: `/v3/users/8fff80184fdf45f6b4a5c376a2cc6993` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:33.025675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7db9b2-f7ee-455a-821d-9d0bcf6932ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fff80184fdf45f6b4a5c376a2cc6993)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:33.029170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7db9b2-f7ee-455a-821d-9d0bcf6932ef admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:33.053150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ca4ae-b6b6-484c-87ce-40b266e802df admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:33.064095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479695c-2304-454f-b4b7-8a066c17933e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:33.065805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479695c-2304-454f-b4b7-8a066c17933e admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:33.065805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479695c-2304-454f-b4b7-8a066c17933e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:33.066238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479695c-2304-454f-b4b7-8a066c17933e admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:33.067153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479695c-2304-454f-b4b7-8a066c17933e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:33.076101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479695c-2304-454f-b4b7-8a066c17933e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:33.086585 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 940/1910] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:33.086585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479695c-2304-454f-b4b7-8a066c17933e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:33.088526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f479695c-2304-454f-b4b7-8a066c17933e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:33.104181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479695c-2304-454f-b4b7-8a066c17933e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:33.110294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb68e0-4af3-4f79-ae47-97b6d7a58ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:33.111391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb68e0-4af3-4f79-ae47-97b6d7a58ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:33.112088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb68e0-4af3-4f79-ae47-97b6d7a58ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:33.112543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb68e0-4af3-4f79-ae47-97b6d7a58ff4 admin admin] PATH_INFO: `/v3/projects/be86660ebb5d41879a693ec7b865ff63` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:33.114276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb68e0-4af3-4f79-ae47-97b6d7a58ff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be86660ebb5d41879a693ec7b865ff63)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:33.116285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb68e0-4af3-4f79-ae47-97b6d7a58ff4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:33.302630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6f7db9b2-f7ee-455a-821d-9d0bcf6932ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fff80184fdf45f6b4a5c376a2cc6993'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:33.309696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f4bb68e0-4af3-4f79-ae47-97b6d7a58ff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be86660ebb5d41879a693ec7b865ff63', 'request_id': 'req-f4bb68e0-4af3-4f79-ae47-97b6d7a58ff4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:33.314892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6f7db9b2-f7ee-455a-821d-9d0bcf6932ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fff80184fdf45f6b4a5c376a2cc6993'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:33.320176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f4bb68e0-4af3-4f79-ae47-97b6d7a58ff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be86660ebb5d41879a693ec7b865ff63', 'request_id': 'req-f4bb68e0-4af3-4f79-ae47-97b6d7a58ff4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:33.327333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f4bb68e0-4af3-4f79-ae47-97b6d7a58ff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be86660ebb5d41879a693ec7b865ff63', 'request_id': 'req-f4bb68e0-4af3-4f79-ae47-97b6d7a58ff4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:33.416944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6f7db9b2-f7ee-455a-821d-9d0bcf6932ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fff80184fdf45f6b4a5c376a2cc6993'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:33.434300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6f7db9b2-f7ee-455a-821d-9d0bcf6932ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fff80184fdf45f6b4a5c376a2cc6993'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:33.434300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6f7db9b2-f7ee-455a-821d-9d0bcf6932ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fff80184fdf45f6b4a5c376a2cc6993'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:33.437961 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 971/1911] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:32 2022] DELETE /identity/v3/users/8fff80184fdf45f6b4a5c376a2cc6993 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:33.438783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7db9b2-f7ee-455a-821d-9d0bcf6932ef admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:33.440548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6f7db9b2-f7ee-455a-821d-9d0bcf6932ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:33.525046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7db9b2-f7ee-455a-821d-9d0bcf6932ef admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:33.535211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d9e81-341d-4f4e-a08f-e3660d644f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:33.537948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d9e81-341d-4f4e-a08f-e3660d644f16 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:33.537948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d9e81-341d-4f4e-a08f-e3660d644f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:33.537948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d9e81-341d-4f4e-a08f-e3660d644f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:33.537948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d9e81-341d-4f4e-a08f-e3660d644f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:33.540289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d9e81-341d-4f4e-a08f-e3660d644f16 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:33.552759 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 972/1912] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:33.553587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d9e81-341d-4f4e-a08f-e3660d644f16 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:33.556303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-229d9e81-341d-4f4e-a08f-e3660d644f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:33.571706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d9e81-341d-4f4e-a08f-e3660d644f16 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:33.579584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5332505-7267-40ad-9d0b-99485b7381f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:33.581884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5332505-7267-40ad-9d0b-99485b7381f0 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:33.581884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5332505-7267-40ad-9d0b-99485b7381f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:33.585879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5332505-7267-40ad-9d0b-99485b7381f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:33.590745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f4bb68e0-4af3-4f79-ae47-97b6d7a58ff4 admin admin] The token cache is being invalidate because project be86660ebb5d41879a693ec7b865ff63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:33.591086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f4bb68e0-4af3-4f79-ae47-97b6d7a58ff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:33.591782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5332505-7267-40ad-9d0b-99485b7381f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:33.591973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f4bb68e0-4af3-4f79-ae47-97b6d7a58ff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:33.592960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:33.596876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5332505-7267-40ad-9d0b-99485b7381f0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:33.600199 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 941/1913] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:33 2022] DELETE /identity/v3/projects/be86660ebb5d41879a693ec7b865ff63 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:33.605370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb68e0-4af3-4f79-ae47-97b6d7a58ff4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:33.605370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f4bb68e0-4af3-4f79-ae47-97b6d7a58ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:33.617771 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 973/1914] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:33.620136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5332505-7267-40ad-9d0b-99485b7381f0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:33.623977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e5332505-7267-40ad-9d0b-99485b7381f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:33.652862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5332505-7267-40ad-9d0b-99485b7381f0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:33.665013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff74a2-fcd3-4c28-8747-c9435efd0617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:33.666101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff74a2-fcd3-4c28-8747-c9435efd0617 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:33.666421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff74a2-fcd3-4c28-8747-c9435efd0617 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:33.666729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff74a2-fcd3-4c28-8747-c9435efd0617 admin admin] PATH_INFO: `/v3/projects/ceca3fd7b56b43db929d4a6c7528e856/users/700a44c6eacf41649a8d6d52eaa7f9f3/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:33.698392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff74a2-fcd3-4c28-8747-c9435efd0617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceca3fd7b56b43db929d4a6c7528e856, user_id=700a44c6eacf41649a8d6d52eaa7f9f3, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:33.701301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff74a2-fcd3-4c28-8747-c9435efd0617 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:33.707244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb68e0-4af3-4f79-ae47-97b6d7a58ff4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:33.718488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d180e2-ee06-45a3-9f28-632e3354785c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:33.719361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d180e2-ee06-45a3-9f28-632e3354785c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:33.719809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d180e2-ee06-45a3-9f28-632e3354785c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:33.720097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d180e2-ee06-45a3-9f28-632e3354785c admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:33.721037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d180e2-ee06-45a3-9f28-632e3354785c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:33.723037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d180e2-ee06-45a3-9f28-632e3354785c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:33.738608 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 942/1915] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:33.738608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0874b68-aea2-4b7c-adfc-d1809fa45729 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:33.738608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0874b68-aea2-4b7c-adfc-d1809fa45729 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:33.738608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0874b68-aea2-4b7c-adfc-d1809fa45729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:33.758618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c0874b68-aea2-4b7c-adfc-d1809fa45729 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:33.760776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c0874b68-aea2-4b7c-adfc-d1809fa45729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:33.774977 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 943/1916] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:33.775432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0874b68-aea2-4b7c-adfc-d1809fa45729 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:33.780143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c0874b68-aea2-4b7c-adfc-d1809fa45729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:33.798377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0874b68-aea2-4b7c-adfc-d1809fa45729 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:33.805339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5e633-d76c-47ad-9289-566d23e48cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:33.806253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5e633-d76c-47ad-9289-566d23e48cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:33.806537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5e633-d76c-47ad-9289-566d23e48cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:33.806834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5e633-d76c-47ad-9289-566d23e48cd7 admin admin] PATH_INFO: `/v3/projects/531521baa8f1419398a42b7e7cf47b33/users/10ccde987997492c9dc816f3edb9d6c1/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:33.809291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5e633-d76c-47ad-9289-566d23e48cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=531521baa8f1419398a42b7e7cf47b33, user_id=10ccde987997492c9dc816f3edb9d6c1, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:33.812311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5e633-d76c-47ad-9289-566d23e48cd7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:33.829036 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 974/1917] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:33 2022] PUT /identity/v3/projects/ceca3fd7b56b43db929d4a6c7528e856/users/700a44c6eacf41649a8d6d52eaa7f9f3/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:33.830040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff74a2-fcd3-4c28-8747-c9435efd0617 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:33.833484 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 944/1918] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:33 2022] PUT /identity/v3/projects/531521baa8f1419398a42b7e7cf47b33/users/10ccde987997492c9dc816f3edb9d6c1/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:33.835065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365df695-090a-4683-b0b4-5e1841eda604 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:33.836432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365df695-090a-4683-b0b4-5e1841eda604 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:33.836730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365df695-090a-4683-b0b4-5e1841eda604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:33.864026 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-365df695-090a-4683-b0b4-5e1841eda604 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:33.865257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-365df695-090a-4683-b0b4-5e1841eda604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:33.960771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff74a2-fcd3-4c28-8747-c9435efd0617 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:33.964921 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 945/1919] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:33.967664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d323eb-cb83-42a8-b8e2-8436bc357b04 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:33.968183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d323eb-cb83-42a8-b8e2-8436bc357b04 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:33.968731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d323eb-cb83-42a8-b8e2-8436bc357b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:33.970506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdda4b-4386-4b0b-a930-58287b2e6bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:33.972043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdda4b-4386-4b0b-a930-58287b2e6bb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:33.977374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdda4b-4386-4b0b-a930-58287b2e6bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:33.977374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdda4b-4386-4b0b-a930-58287b2e6bb8 admin admin] PATH_INFO: `/v3/projects/55a19b7a4682457a9132f5fc80110712/users/a9b68dacc4b8463ba07fae6372131117/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:33.995609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d2d323eb-cb83-42a8-b8e2-8436bc357b04 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:33.997079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d2d323eb-cb83-42a8-b8e2-8436bc357b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:34.002611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdda4b-4386-4b0b-a930-58287b2e6bb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a19b7a4682457a9132f5fc80110712, user_id=a9b68dacc4b8463ba07fae6372131117, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:34.005922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdda4b-4386-4b0b-a930-58287b2e6bb8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:34.009473 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 946/1920] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:34.009473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb623702-8d1a-4bfb-8e0e-3e0d09918b6a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:34.009473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb623702-8d1a-4bfb-8e0e-3e0d09918b6a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:34.009473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb623702-8d1a-4bfb-8e0e-3e0d09918b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:34.043801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-bb623702-8d1a-4bfb-8e0e-3e0d09918b6a None None] MFA Rules not processed for user `10ccde987997492c9dc816f3edb9d6c1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:34.045502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bb623702-8d1a-4bfb-8e0e-3e0d09918b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:34.120767 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 975/1921] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:33 2022] PUT /identity/v3/projects/55a19b7a4682457a9132f5fc80110712/users/a9b68dacc4b8463ba07fae6372131117/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:34.121706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdda4b-4386-4b0b-a930-58287b2e6bb8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:34.167115 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 947/1922] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:34 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:34.167340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb623702-8d1a-4bfb-8e0e-3e0d09918b6a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:34.171689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bb623702-8d1a-4bfb-8e0e-3e0d09918b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:34.218591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:34.239445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdda4b-4386-4b0b-a930-58287b2e6bb8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:34.242153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:34.254326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64827839-2726-409e-88af-113c8b2134dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:34.255328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64827839-2726-409e-88af-113c8b2134dd admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:34.255977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64827839-2726-409e-88af-113c8b2134dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:34.256689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64827839-2726-409e-88af-113c8b2134dd admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:34.258254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64827839-2726-409e-88af-113c8b2134dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:08:34.258530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64827839-2726-409e-88af-113c8b2134dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:34.261316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64827839-2726-409e-88af-113c8b2134dd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:34.264438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb623702-8d1a-4bfb-8e0e-3e0d09918b6a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:34.279613 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 976/1923] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:34.280901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64827839-2726-409e-88af-113c8b2134dd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:34.283241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-64827839-2726-409e-88af-113c8b2134dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:34.303044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64827839-2726-409e-88af-113c8b2134dd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:34.311338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339a1b5-8017-4b32-9ede-d32b3758fa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:34.312833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339a1b5-8017-4b32-9ede-d32b3758fa90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:34.313127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339a1b5-8017-4b32-9ede-d32b3758fa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:34.313407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339a1b5-8017-4b32-9ede-d32b3758fa90 admin admin] PATH_INFO: `/v3/projects/27f8b42f302c4a4292ab2f3885b77d08` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:34.315874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339a1b5-8017-4b32-9ede-d32b3758fa90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f8b42f302c4a4292ab2f3885b77d08)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:34.319509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339a1b5-8017-4b32-9ede-d32b3758fa90 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:34.376568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f481f8-3ce1-4cbb-a94e-5cc65ecad407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:34.381445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f481f8-3ce1-4cbb-a94e-5cc65ecad407 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:34.381445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f481f8-3ce1-4cbb-a94e-5cc65ecad407 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:34.381445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f481f8-3ce1-4cbb-a94e-5cc65ecad407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:34.398457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f481f8-3ce1-4cbb-a94e-5cc65ecad407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:34.399950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f481f8-3ce1-4cbb-a94e-5cc65ecad407 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:34.420100 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 948/1924] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:34.422049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948094f-4512-4032-9251-7d5a45697838 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:34.427000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948094f-4512-4032-9251-7d5a45697838 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:34.427000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948094f-4512-4032-9251-7d5a45697838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:34.452410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d948094f-4512-4032-9251-7d5a45697838 None None] MFA Rules not processed for user `a9b68dacc4b8463ba07fae6372131117`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:34.453893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d948094f-4512-4032-9251-7d5a45697838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:34.508347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8339a1b5-8017-4b32-9ede-d32b3758fa90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f8b42f302c4a4292ab2f3885b77d08', 'request_id': 'req-8339a1b5-8017-4b32-9ede-d32b3758fa90'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:34.524310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8339a1b5-8017-4b32-9ede-d32b3758fa90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f8b42f302c4a4292ab2f3885b77d08', 'request_id': 'req-8339a1b5-8017-4b32-9ede-d32b3758fa90'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:34.544371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8339a1b5-8017-4b32-9ede-d32b3758fa90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f8b42f302c4a4292ab2f3885b77d08', 'request_id': 'req-8339a1b5-8017-4b32-9ede-d32b3758fa90'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:34.586885 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 949/1925] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:34.586885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948094f-4512-4032-9251-7d5a45697838 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:34.598354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d948094f-4512-4032-9251-7d5a45697838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:34.638997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8339a1b5-8017-4b32-9ede-d32b3758fa90 admin admin] The token cache is being invalidate because project 27f8b42f302c4a4292ab2f3885b77d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:34.639638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8339a1b5-8017-4b32-9ede-d32b3758fa90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:34.640577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8339a1b5-8017-4b32-9ede-d32b3758fa90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:34.644799 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 977/1926] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:34 2022] DELETE /identity/v3/projects/27f8b42f302c4a4292ab2f3885b77d08 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:34.645941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339a1b5-8017-4b32-9ede-d32b3758fa90 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:34.649135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8339a1b5-8017-4b32-9ede-d32b3758fa90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:34.738533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948094f-4512-4032-9251-7d5a45697838 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:34.750988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339a1b5-8017-4b32-9ede-d32b3758fa90 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:34.762320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0efe2-5d50-4520-8d78-c26b0b8483e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:34.766647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0efe2-5d50-4520-8d78-c26b0b8483e6 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:34.766647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0efe2-5d50-4520-8d78-c26b0b8483e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:34.766647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0efe2-5d50-4520-8d78-c26b0b8483e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:34.766647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0efe2-5d50-4520-8d78-c26b0b8483e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:34.769144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0efe2-5d50-4520-8d78-c26b0b8483e6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:34.838439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152020c-96de-4a67-ba4a-fb09d4fc64be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:34.839193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152020c-96de-4a67-ba4a-fb09d4fc64be service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:34.839554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152020c-96de-4a67-ba4a-fb09d4fc64be service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:34.839737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152020c-96de-4a67-ba4a-fb09d4fc64be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:34.845005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4152020c-96de-4a67-ba4a-fb09d4fc64be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:34.935659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152020c-96de-4a67-ba4a-fb09d4fc64be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:34.936195 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 978/1927] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:34 2022] POST /identity/v3/projects => generated 373 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:34.937894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152020c-96de-4a67-ba4a-fb09d4fc64be service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:34.951173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0efe2-5d50-4520-8d78-c26b0b8483e6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:34.951173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b9e0efe2-5d50-4520-8d78-c26b0b8483e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:34.953701 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 950/1928] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:34.956557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d5eb5-5e66-4b22-a374-59d8e5a7ec45 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:34.957024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d5eb5-5e66-4b22-a374-59d8e5a7ec45 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:34.957402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d5eb5-5e66-4b22-a374-59d8e5a7ec45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:34.999250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-866d5eb5-5e66-4b22-a374-59d8e5a7ec45 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:34.999250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-866d5eb5-5e66-4b22-a374-59d8e5a7ec45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:35.109707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0efe2-5d50-4520-8d78-c26b0b8483e6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:35.111312 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 951/1929] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:35.112135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d5eb5-5e66-4b22-a374-59d8e5a7ec45 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:35.124347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfc27f-b2ac-473b-ad04-df0fa47f08e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:35.125553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfc27f-b2ac-473b-ad04-df0fa47f08e9 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:35.126238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfc27f-b2ac-473b-ad04-df0fa47f08e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:35.126694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfc27f-b2ac-473b-ad04-df0fa47f08e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:35.129667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfc27f-b2ac-473b-ad04-df0fa47f08e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:35.132867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfc27f-b2ac-473b-ad04-df0fa47f08e9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:35.138271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d5eb5-5e66-4b22-a374-59d8e5a7ec45 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:35.144497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928d598-02f9-4048-87e4-b9136842bb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:35.145450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928d598-02f9-4048-87e4-b9136842bb59 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:35.145837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928d598-02f9-4048-87e4-b9136842bb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:35.146214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928d598-02f9-4048-87e4-b9136842bb59 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:35.147592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928d598-02f9-4048-87e4-b9136842bb59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:35.149927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928d598-02f9-4048-87e4-b9136842bb59 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:35.234669 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 979/1930] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:34 2022] POST /identity/v3/projects => generated 373 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:35.236034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfc27f-b2ac-473b-ad04-df0fa47f08e9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:35.251348 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 952/1931] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:35 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:35.251348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae4b65-dbda-42ad-88d2-ec471b075fa6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:35.251348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae4b65-dbda-42ad-88d2-ec471b075fa6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:35.253023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-88bfc27f-b2ac-473b-ad04-df0fa47f08e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:35.255761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae4b65-dbda-42ad-88d2-ec471b075fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:35.284652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1dae4b65-dbda-42ad-88d2-ec471b075fa6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:35.286403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1dae4b65-dbda-42ad-88d2-ec471b075fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:35.406110 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 953/1932] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:35.407762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae4b65-dbda-42ad-88d2-ec471b075fa6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:35.416807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfc27f-b2ac-473b-ad04-df0fa47f08e9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:35.427645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae4b65-dbda-42ad-88d2-ec471b075fa6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:35.429736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12f300-641d-44fe-a8da-1870d8a67a8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:35.430436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12f300-641d-44fe-a8da-1870d8a67a8f service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:35.430705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12f300-641d-44fe-a8da-1870d8a67a8f service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:35.430982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12f300-641d-44fe-a8da-1870d8a67a8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:35.434136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18a079-97bd-411b-a62f-6fb5c610b563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:35.434832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18a079-97bd-411b-a62f-6fb5c610b563 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:35.435147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18a079-97bd-411b-a62f-6fb5c610b563 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:35.435428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18a079-97bd-411b-a62f-6fb5c610b563 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:35.436135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18a079-97bd-411b-a62f-6fb5c610b563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:35.438985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9e12f300-641d-44fe-a8da-1870d8a67a8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:35.442110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18a079-97bd-411b-a62f-6fb5c610b563 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:35.510177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:35.546340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12f300-641d-44fe-a8da-1870d8a67a8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:35.548165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12f300-641d-44fe-a8da-1870d8a67a8f service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:35.569142 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 980/1933] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:35 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:35.572122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12f300-641d-44fe-a8da-1870d8a67a8f service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:35.577001 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 954/1934] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:35 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:35.577983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18a079-97bd-411b-a62f-6fb5c610b563 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:35.590019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12f300-641d-44fe-a8da-1870d8a67a8f service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:35.598675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62532f9-a07d-47ce-9225-a4b06ed9cad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:35.599776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62532f9-a07d-47ce-9225-a4b06ed9cad2 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:35.600067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62532f9-a07d-47ce-9225-a4b06ed9cad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:35.600704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62532f9-a07d-47ce-9225-a4b06ed9cad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:35.602145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62532f9-a07d-47ce-9225-a4b06ed9cad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:35.603254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62532f9-a07d-47ce-9225-a4b06ed9cad2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:35.603392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18a079-97bd-411b-a62f-6fb5c610b563 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:35.614621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488d0c0-d30d-4bbf-93c0-f42207eaf561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:35.617326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488d0c0-d30d-4bbf-93c0-f42207eaf561 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:35.621175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488d0c0-d30d-4bbf-93c0-f42207eaf561 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:35.621612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488d0c0-d30d-4bbf-93c0-f42207eaf561 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:35.622419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488d0c0-d30d-4bbf-93c0-f42207eaf561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:08:35.624895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488d0c0-d30d-4bbf-93c0-f42207eaf561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:35.626730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488d0c0-d30d-4bbf-93c0-f42207eaf561 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:35.631533 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 981/1935] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:35.635360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62532f9-a07d-47ce-9225-a4b06ed9cad2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:35.648908 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 955/1936] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:35.653666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488d0c0-d30d-4bbf-93c0-f42207eaf561 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:35.675347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488d0c0-d30d-4bbf-93c0-f42207eaf561 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:35.675490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62532f9-a07d-47ce-9225-a4b06ed9cad2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:35.680366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681167bc-6375-4671-b1bd-5d5475598a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:35.681168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681167bc-6375-4671-b1bd-5d5475598a3a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:35.681459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681167bc-6375-4671-b1bd-5d5475598a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:35.682201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681167bc-6375-4671-b1bd-5d5475598a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:35.682859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681167bc-6375-4671-b1bd-5d5475598a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:35.684178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83343fad-f67e-499e-8ac4-93f3b5b37cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:35.684751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83343fad-f67e-499e-8ac4-93f3b5b37cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:35.684879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681167bc-6375-4671-b1bd-5d5475598a3a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:35.685037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83343fad-f67e-499e-8ac4-93f3b5b37cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:35.685356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83343fad-f67e-499e-8ac4-93f3b5b37cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:35.687433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83343fad-f67e-499e-8ac4-93f3b5b37cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:35.692474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83343fad-f67e-499e-8ac4-93f3b5b37cb6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:35.709481 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 982/1937] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:35.710732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681167bc-6375-4671-b1bd-5d5475598a3a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:35.717395 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 956/1938] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:35.718260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83343fad-f67e-499e-8ac4-93f3b5b37cb6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:35.729981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681167bc-6375-4671-b1bd-5d5475598a3a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:35.732917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83343fad-f67e-499e-8ac4-93f3b5b37cb6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:35.748138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c5239-0791-4c65-bb6b-6e17693da088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:35.750191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c5239-0791-4c65-bb6b-6e17693da088 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:35.751001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827099d-3228-41f7-92e4-369a86240af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:35.751805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c5239-0791-4c65-bb6b-6e17693da088 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:35.753541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c5239-0791-4c65-bb6b-6e17693da088 admin admin] PATH_INFO: `/v3/projects/cbbed051cbaf450f92a79d71d58ba7a2/users/1ead1619fabc4552b11f712b28cc6187/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:35.754398 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827099d-3228-41f7-92e4-369a86240af3 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:35.755598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827099d-3228-41f7-92e4-369a86240af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:35.755977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827099d-3228-41f7-92e4-369a86240af3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:35.756986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827099d-3228-41f7-92e4-369a86240af3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:35.761546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827099d-3228-41f7-92e4-369a86240af3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:35.777865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c5239-0791-4c65-bb6b-6e17693da088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbbed051cbaf450f92a79d71d58ba7a2, user_id=1ead1619fabc4552b11f712b28cc6187, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:35.781643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c5239-0791-4c65-bb6b-6e17693da088 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:35.869870 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 983/1939] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:35 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:35.870872 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 957/1940] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:35 2022] PUT /identity/v3/projects/cbbed051cbaf450f92a79d71d58ba7a2/users/1ead1619fabc4552b11f712b28cc6187/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:35.871295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827099d-3228-41f7-92e4-369a86240af3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:35.871959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c5239-0791-4c65-bb6b-6e17693da088 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:35.877009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0f9c5239-0791-4c65-bb6b-6e17693da088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:35.963570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:35.975215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827099d-3228-41f7-92e4-369a86240af3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:35.980853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8484f1-8f91-4878-a94a-6c647cfc132f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:35.982277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8484f1-8f91-4878-a94a-6c647cfc132f admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:35.982894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8484f1-8f91-4878-a94a-6c647cfc132f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:35.983354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8484f1-8f91-4878-a94a-6c647cfc132f admin admin] PATH_INFO: `/v3/projects/a97328b7ae9f44f8a1c275efb98ec250/users/2b1a976345364bbe993706cc8f12889d/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:36.006988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c5239-0791-4c65-bb6b-6e17693da088 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:36.015964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701ab21-e44b-4fb3-ab10-f582ff1539d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:36.016863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701ab21-e44b-4fb3-ab10-f582ff1539d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:36.017300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701ab21-e44b-4fb3-ab10-f582ff1539d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:36.017806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701ab21-e44b-4fb3-ab10-f582ff1539d3 admin admin] PATH_INFO: `/v3/users/3f63a1fb362b462fa8f36f5a53cb6cf1` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:36.020251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701ab21-e44b-4fb3-ab10-f582ff1539d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f63a1fb362b462fa8f36f5a53cb6cf1)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:36.020402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8484f1-8f91-4878-a94a-6c647cfc132f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a97328b7ae9f44f8a1c275efb98ec250, user_id=2b1a976345364bbe993706cc8f12889d, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:36.023535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701ab21-e44b-4fb3-ab10-f582ff1539d3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:36.024082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8484f1-8f91-4878-a94a-6c647cfc132f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:36.159423 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 984/1941] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:35 2022] PUT /identity/v3/projects/a97328b7ae9f44f8a1c275efb98ec250/users/2b1a976345364bbe993706cc8f12889d/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:36.161245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8484f1-8f91-4878-a94a-6c647cfc132f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:36.264084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8484f1-8f91-4878-a94a-6c647cfc132f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:36.269943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb0a8a-7d6e-48c4-bd60-33985fd67929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:36.270727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb0a8a-7d6e-48c4-bd60-33985fd67929 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:36.271130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb0a8a-7d6e-48c4-bd60-33985fd67929 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:36.271760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb0a8a-7d6e-48c4-bd60-33985fd67929 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:36.273092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb0a8a-7d6e-48c4-bd60-33985fd67929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:36.274930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1701ab21-e44b-4fb3-ab10-f582ff1539d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f63a1fb362b462fa8f36f5a53cb6cf1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:36.275279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb0a8a-7d6e-48c4-bd60-33985fd67929 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:36.296514 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 985/1942] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:36.299726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb0a8a-7d6e-48c4-bd60-33985fd67929 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:36.301087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1701ab21-e44b-4fb3-ab10-f582ff1539d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f63a1fb362b462fa8f36f5a53cb6cf1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:36.313829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb0a8a-7d6e-48c4-bd60-33985fd67929 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:36.323093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09721684-43bb-4bcc-95dd-12ef478e293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:36.324992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09721684-43bb-4bcc-95dd-12ef478e293e admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:36.325297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09721684-43bb-4bcc-95dd-12ef478e293e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:36.325650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09721684-43bb-4bcc-95dd-12ef478e293e admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:36.326585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09721684-43bb-4bcc-95dd-12ef478e293e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:36.328816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09721684-43bb-4bcc-95dd-12ef478e293e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:36.444196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1701ab21-e44b-4fb3-ab10-f582ff1539d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f63a1fb362b462fa8f36f5a53cb6cf1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:36.477099 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 986/1943] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:36 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:36.481495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8c50e-bd29-46dc-8754-f49d6efd4999 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:36.481980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8c50e-bd29-46dc-8754-f49d6efd4999 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:36.482481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8c50e-bd29-46dc-8754-f49d6efd4999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:36.486210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1701ab21-e44b-4fb3-ab10-f582ff1539d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f63a1fb362b462fa8f36f5a53cb6cf1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:36.489318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1701ab21-e44b-4fb3-ab10-f582ff1539d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f63a1fb362b462fa8f36f5a53cb6cf1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:36.502769 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 958/1944] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:35 2022] DELETE /identity/v3/users/3f63a1fb362b462fa8f36f5a53cb6cf1 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:36.504084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701ab21-e44b-4fb3-ab10-f582ff1539d3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:36.510388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1701ab21-e44b-4fb3-ab10-f582ff1539d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:36.569083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f7d8c50e-bd29-46dc-8754-f49d6efd4999 None None] MFA Rules not processed for user `2b1a976345364bbe993706cc8f12889d`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:36.574654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f7d8c50e-bd29-46dc-8754-f49d6efd4999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:36.621786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701ab21-e44b-4fb3-ab10-f582ff1539d3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:36.629267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d01c6-7db8-41cd-86ae-516bd28164e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:36.630359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d01c6-7db8-41cd-86ae-516bd28164e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:36.630641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d01c6-7db8-41cd-86ae-516bd28164e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:36.630919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d01c6-7db8-41cd-86ae-516bd28164e1 admin admin] PATH_INFO: `/v3/projects/cbbed051cbaf450f92a79d71d58ba7a2/users/1ead1619fabc4552b11f712b28cc6187/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:36.634343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d01c6-7db8-41cd-86ae-516bd28164e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbbed051cbaf450f92a79d71d58ba7a2, user_id=1ead1619fabc4552b11f712b28cc6187, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:36.638733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d01c6-7db8-41cd-86ae-516bd28164e1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:36.670726 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 959/1945] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:36 2022] PUT /identity/v3/projects/cbbed051cbaf450f92a79d71d58ba7a2/users/1ead1619fabc4552b11f712b28cc6187/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:36.670726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d01c6-7db8-41cd-86ae-516bd28164e1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:36.670726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b06d01c6-7db8-41cd-86ae-516bd28164e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:36.752730 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 987/1946] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:36.752730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bca72-499f-431f-8ea8-6979ea8d2303 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:36.752730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bca72-499f-431f-8ea8-6979ea8d2303 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:36.752730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bca72-499f-431f-8ea8-6979ea8d2303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:36.764490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d01c6-7db8-41cd-86ae-516bd28164e1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:36.777466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46338436-01a8-4fe0-b056-6fc7eff8336d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:36.778804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46338436-01a8-4fe0-b056-6fc7eff8336d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:36.779168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46338436-01a8-4fe0-b056-6fc7eff8336d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:36.779493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46338436-01a8-4fe0-b056-6fc7eff8336d admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:36.782121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46338436-01a8-4fe0-b056-6fc7eff8336d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:36.786352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46338436-01a8-4fe0-b056-6fc7eff8336d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:36.792866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f94bca72-499f-431f-8ea8-6979ea8d2303 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:36.794386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f94bca72-499f-431f-8ea8-6979ea8d2303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:36.806341 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 960/1947] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:36.808358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72317c09-c087-4546-9d7b-559fced03f07 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:36.809793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72317c09-c087-4546-9d7b-559fced03f07 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:36.810236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72317c09-c087-4546-9d7b-559fced03f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:36.813367 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 988/1948] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:36.814326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94bca72-499f-431f-8ea8-6979ea8d2303 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:36.817713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f94bca72-499f-431f-8ea8-6979ea8d2303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:36.854216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94bca72-499f-431f-8ea8-6979ea8d2303 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:36.877956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851ee09-8f66-4bc0-8f6c-b32bff918bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:36.885516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851ee09-8f66-4bc0-8f6c-b32bff918bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:36.885516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851ee09-8f66-4bc0-8f6c-b32bff918bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:36.885516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851ee09-8f66-4bc0-8f6c-b32bff918bf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:36.885516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851ee09-8f66-4bc0-8f6c-b32bff918bf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:36.885834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-72317c09-c087-4546-9d7b-559fced03f07 None None] MFA Rules not processed for user `1ead1619fabc4552b11f712b28cc6187`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:36.885910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851ee09-8f66-4bc0-8f6c-b32bff918bf6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:36.885987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-72317c09-c087-4546-9d7b-559fced03f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:37.064249 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 961/1949] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:37.068465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72317c09-c087-4546-9d7b-559fced03f07 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:37.090642 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 989/1950] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:36 2022] POST /identity/v3/projects => generated 373 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:37.091722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851ee09-8f66-4bc0-8f6c-b32bff918bf6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:37.098326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6851ee09-8f66-4bc0-8f6c-b32bff918bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:37.107746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72317c09-c087-4546-9d7b-559fced03f07 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:37.188716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851ee09-8f66-4bc0-8f6c-b32bff918bf6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:37.195661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5c9cc-e053-4e2e-9127-4c12170010ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:37.196631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5c9cc-e053-4e2e-9127-4c12170010ff service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:37.196925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5c9cc-e053-4e2e-9127-4c12170010ff service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:37.197341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5c9cc-e053-4e2e-9127-4c12170010ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:37.244983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db114b3d-2b13-4620-91ed-976acc3c7af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:37.245712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db114b3d-2b13-4620-91ed-976acc3c7af5 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:37.246001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db114b3d-2b13-4620-91ed-976acc3c7af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:37.246284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db114b3d-2b13-4620-91ed-976acc3c7af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:37.247042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db114b3d-2b13-4620-91ed-976acc3c7af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:37.249101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db114b3d-2b13-4620-91ed-976acc3c7af5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:37.279104 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 962/1951] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:37.281899 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b17a57-6642-47b7-bafc-b2c548cbdad9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:37.282189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b17a57-6642-47b7-bafc-b2c548cbdad9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:37.282470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b17a57-6642-47b7-bafc-b2c548cbdad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:37.310165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:37.318733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-67b17a57-6642-47b7-bafc-b2c548cbdad9 None None] MFA Rules not processed for user `a9b68dacc4b8463ba07fae6372131117`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:37.322317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-67b17a57-6642-47b7-bafc-b2c548cbdad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:37.344162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5c9cc-e053-4e2e-9127-4c12170010ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:37.345639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5c9cc-e053-4e2e-9127-4c12170010ff service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:37.357437 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 990/1952] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:37.358549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5c9cc-e053-4e2e-9127-4c12170010ff service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:37.370783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5c9cc-e053-4e2e-9127-4c12170010ff service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:37.398047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96efe7-7186-47cf-ad99-0a976a6dea80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:37.404208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96efe7-7186-47cf-ad99-0a976a6dea80 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:37.404208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96efe7-7186-47cf-ad99-0a976a6dea80 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:37.404510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96efe7-7186-47cf-ad99-0a976a6dea80 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:37.405266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96efe7-7186-47cf-ad99-0a976a6dea80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:37.407315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96efe7-7186-47cf-ad99-0a976a6dea80 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:37.479531 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 963/1953] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:37.480373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b17a57-6642-47b7-bafc-b2c548cbdad9 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:37.513770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b17a57-6642-47b7-bafc-b2c548cbdad9 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:37.521874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c02cc-e79e-4e44-86df-90824fb72b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:37.524209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c02cc-e79e-4e44-86df-90824fb72b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:37.524617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c02cc-e79e-4e44-86df-90824fb72b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:37.524977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c02cc-e79e-4e44-86df-90824fb72b86 admin admin] PATH_INFO: `/v3/projects/9dcf95f2466344d1a28724d545a8fed6/users/2b750f4a86974b8189ab99143131b1cd/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:37.545561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c02cc-e79e-4e44-86df-90824fb72b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dcf95f2466344d1a28724d545a8fed6, user_id=2b750f4a86974b8189ab99143131b1cd, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:37.551416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c02cc-e79e-4e44-86df-90824fb72b86 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:37.581264 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 991/1954] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:37 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:37.585357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96efe7-7186-47cf-ad99-0a976a6dea80 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:37.590537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6c96efe7-7186-47cf-ad99-0a976a6dea80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:37.707709 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 964/1955] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:37 2022] PUT /identity/v3/projects/9dcf95f2466344d1a28724d545a8fed6/users/2b750f4a86974b8189ab99143131b1cd/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:37.723808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c02cc-e79e-4e44-86df-90824fb72b86 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:37.808327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96efe7-7186-47cf-ad99-0a976a6dea80 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:37.853053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c02cc-e79e-4e44-86df-90824fb72b86 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:37.858955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1b7df-d771-4720-a785-c879fffe0853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:37.864817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1b7df-d771-4720-a785-c879fffe0853 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:37.864817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1b7df-d771-4720-a785-c879fffe0853 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:37.864817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1b7df-d771-4720-a785-c879fffe0853 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:37.864817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1b7df-d771-4720-a785-c879fffe0853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:37.864817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1b7df-d771-4720-a785-c879fffe0853 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:37.880002 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 965/1956] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:37.881280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acb2e5-0a35-4c56-af77-fa007a97746c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:37.881566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acb2e5-0a35-4c56-af77-fa007a97746c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:37.882282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acb2e5-0a35-4c56-af77-fa007a97746c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:37.930377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b640b0-d3ee-411a-a960-cf7e7ca05aed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:37.934859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b640b0-d3ee-411a-a960-cf7e7ca05aed service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:37.934859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b640b0-d3ee-411a-a960-cf7e7ca05aed service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:37.934859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b640b0-d3ee-411a-a960-cf7e7ca05aed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:37.934859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c8b640b0-d3ee-411a-a960-cf7e7ca05aed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:37.976226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-03acb2e5-0a35-4c56-af77-fa007a97746c None None] MFA Rules not processed for user `2b750f4a86974b8189ab99143131b1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:37.980666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-03acb2e5-0a35-4c56-af77-fa007a97746c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:38.021029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b640b0-d3ee-411a-a960-cf7e7ca05aed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:38.026421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b640b0-d3ee-411a-a960-cf7e7ca05aed service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:38.052068 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 992/1957] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:38.054822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b640b0-d3ee-411a-a960-cf7e7ca05aed service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:38.088058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b640b0-d3ee-411a-a960-cf7e7ca05aed service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:38.115492 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 966/1958] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:38.126966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03acb2e5-0a35-4c56-af77-fa007a97746c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:38.128019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62815f02-a1aa-43db-92af-57749507c177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:38.128019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62815f02-a1aa-43db-92af-57749507c177 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:38.128019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62815f02-a1aa-43db-92af-57749507c177 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:38.128019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62815f02-a1aa-43db-92af-57749507c177 admin admin] PATH_INFO: `/v3/projects/b7a826efdb624e53bfcb953efdb0b239/users/9b8cec31075a44e29ecc88a83891027b/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:38.143911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03acb2e5-0a35-4c56-af77-fa007a97746c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:38.159779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878be8ce-e7ee-488c-a2d6-8f8ad838c954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:38.160680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878be8ce-e7ee-488c-a2d6-8f8ad838c954 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:38.162198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878be8ce-e7ee-488c-a2d6-8f8ad838c954 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:38.162198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878be8ce-e7ee-488c-a2d6-8f8ad838c954 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:38.162849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878be8ce-e7ee-488c-a2d6-8f8ad838c954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:38.172111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62815f02-a1aa-43db-92af-57749507c177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a826efdb624e53bfcb953efdb0b239, user_id=9b8cec31075a44e29ecc88a83891027b, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:38.172447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878be8ce-e7ee-488c-a2d6-8f8ad838c954 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:38.175933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62815f02-a1aa-43db-92af-57749507c177 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:38.207306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:38.265381 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 993/1959] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:38 2022] PUT /identity/v3/projects/b7a826efdb624e53bfcb953efdb0b239/users/9b8cec31075a44e29ecc88a83891027b/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:38.270011 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62815f02-a1aa-43db-92af-57749507c177 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:38.369829 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 967/1960] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:38 2022] POST /identity/v3/projects => generated 373 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:38.372434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878be8ce-e7ee-488c-a2d6-8f8ad838c954 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:38.441713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62815f02-a1aa-43db-92af-57749507c177 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:38.489506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878be8ce-e7ee-488c-a2d6-8f8ad838c954 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:38.496537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded2041-3d2f-4e7c-a0db-8f8142ec24c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:38.498571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded2041-3d2f-4e7c-a0db-8f8142ec24c9 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:38.499330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded2041-3d2f-4e7c-a0db-8f8142ec24c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:38.499517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded2041-3d2f-4e7c-a0db-8f8142ec24c9 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:38.500933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded2041-3d2f-4e7c-a0db-8f8142ec24c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:38.506223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded2041-3d2f-4e7c-a0db-8f8142ec24c9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:38.585016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5fd67-9224-4827-b462-10a7dc2d1c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:38.587246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5fd67-9224-4827-b462-10a7dc2d1c3a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:38.588078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5fd67-9224-4827-b462-10a7dc2d1c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:38.588853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5fd67-9224-4827-b462-10a7dc2d1c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:38.590492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5fd67-9224-4827-b462-10a7dc2d1c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:38.603472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5fd67-9224-4827-b462-10a7dc2d1c3a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:38.620476 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 994/1961] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:38.629782 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 968/1962] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:38 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:38.630360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74696358-e7d6-46f3-936e-40f2f33be722 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:38.630654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74696358-e7d6-46f3-936e-40f2f33be722 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:38.630939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74696358-e7d6-46f3-936e-40f2f33be722 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:38.631311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded2041-3d2f-4e7c-a0db-8f8142ec24c9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:38.643619 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 995/1963] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:08:38 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:08:38.644616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74696358-e7d6-46f3-936e-40f2f33be722 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:38.646797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded2041-3d2f-4e7c-a0db-8f8142ec24c9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:38.652539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072e423-eb1c-4b56-bc0e-3cde3378fc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:38.654203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072e423-eb1c-4b56-bc0e-3cde3378fc32 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:38.654486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072e423-eb1c-4b56-bc0e-3cde3378fc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:38.656294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072e423-eb1c-4b56-bc0e-3cde3378fc32 admin admin] PATH_INFO: `/v3/projects/b7a826efdb624e53bfcb953efdb0b239/users/9b8cec31075a44e29ecc88a83891027b/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:38.658831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072e423-eb1c-4b56-bc0e-3cde3378fc32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a826efdb624e53bfcb953efdb0b239, user_id=9b8cec31075a44e29ecc88a83891027b, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:38.661973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072e423-eb1c-4b56-bc0e-3cde3378fc32 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:38.664364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74696358-e7d6-46f3-936e-40f2f33be722 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:38.669874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d54f7-b047-4180-a94b-a664a46e07f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:38.670568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d54f7-b047-4180-a94b-a664a46e07f4 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:38.670958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d54f7-b047-4180-a94b-a664a46e07f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:38.671302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d54f7-b047-4180-a94b-a664a46e07f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:38.672092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d54f7-b047-4180-a94b-a664a46e07f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:38.673843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d54f7-b047-4180-a94b-a664a46e07f4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:38.694981 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 996/1964] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:38.696709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0ff38-322d-469a-ada7-8f57eeed5c86 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:38.697002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0ff38-322d-469a-ada7-8f57eeed5c86 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:38.697325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0ff38-322d-469a-ada7-8f57eeed5c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:38.710197 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 969/1965] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:38 2022] PUT /identity/v3/projects/b7a826efdb624e53bfcb953efdb0b239/users/9b8cec31075a44e29ecc88a83891027b/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:38.711725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072e423-eb1c-4b56-bc0e-3cde3378fc32 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:38.763236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-45f0ff38-322d-469a-ada7-8f57eeed5c86 None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:38.764568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-45f0ff38-322d-469a-ada7-8f57eeed5c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:38.813442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072e423-eb1c-4b56-bc0e-3cde3378fc32 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:38.828322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a7238-db5c-4392-ace1-d7dc33c453aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:38.829501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a7238-db5c-4392-ace1-d7dc33c453aa admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:38.829771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a7238-db5c-4392-ace1-d7dc33c453aa admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:38.830119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a7238-db5c-4392-ace1-d7dc33c453aa admin admin] PATH_INFO: `/v3/projects/b8650a799d2e4d6885ebc9a41a041103/users/88106ab3700141c59577d36de8956a96/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:38.852518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a7238-db5c-4392-ace1-d7dc33c453aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8650a799d2e4d6885ebc9a41a041103, user_id=88106ab3700141c59577d36de8956a96, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:38.855576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a7238-db5c-4392-ace1-d7dc33c453aa admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:38.975513 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 997/1966] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:08:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:39.003817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc889d4a-9e3f-44a1-8812-14e3b30b4369 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:39.006909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc889d4a-9e3f-44a1-8812-14e3b30b4369 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:39.007741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc889d4a-9e3f-44a1-8812-14e3b30b4369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:39.024483 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 970/1967] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:38 2022] PUT /identity/v3/projects/b8650a799d2e4d6885ebc9a41a041103/users/88106ab3700141c59577d36de8956a96/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:39.031001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a7238-db5c-4392-ace1-d7dc33c453aa admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:39.062687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-fc889d4a-9e3f-44a1-8812-14e3b30b4369 None None] MFA Rules not processed for user `9b8cec31075a44e29ecc88a83891027b`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:39.072663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fc889d4a-9e3f-44a1-8812-14e3b30b4369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:39.093430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:39.205933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a7238-db5c-4392-ace1-d7dc33c453aa admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:39.216075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b7f94-cf7b-4dee-8060-81f9d8fd2d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:39.216567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b7f94-cf7b-4dee-8060-81f9d8fd2d01 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:39.225901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b7f94-cf7b-4dee-8060-81f9d8fd2d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:39.226330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b7f94-cf7b-4dee-8060-81f9d8fd2d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:39.228062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b7f94-cf7b-4dee-8060-81f9d8fd2d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:39.230657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b7f94-cf7b-4dee-8060-81f9d8fd2d01 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:39.264069 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 971/1968] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:39.265275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b7f94-cf7b-4dee-8060-81f9d8fd2d01 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:39.292684 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 998/1969] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:39.293591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc889d4a-9e3f-44a1-8812-14e3b30b4369 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:39.297036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fc889d4a-9e3f-44a1-8812-14e3b30b4369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:39.333887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc889d4a-9e3f-44a1-8812-14e3b30b4369 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:39.348186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2caded-366c-4cd1-abe8-2b37539f2552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:39.348954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2caded-366c-4cd1-abe8-2b37539f2552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:39.349243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2caded-366c-4cd1-abe8-2b37539f2552 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:39.349522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2caded-366c-4cd1-abe8-2b37539f2552 admin admin] PATH_INFO: `/v3/projects/55dc74e9c8884796818fb12bd31f449a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:39.355852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2caded-366c-4cd1-abe8-2b37539f2552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55dc74e9c8884796818fb12bd31f449a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:39.362245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2caded-366c-4cd1-abe8-2b37539f2552 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:39.419045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b7f94-cf7b-4dee-8060-81f9d8fd2d01 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:39.435969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86219345-061a-473b-8d38-491685095335 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:39.438328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86219345-061a-473b-8d38-491685095335 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:39.445708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86219345-061a-473b-8d38-491685095335 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:39.445708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86219345-061a-473b-8d38-491685095335 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:39.464283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86219345-061a-473b-8d38-491685095335 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:39.466990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86219345-061a-473b-8d38-491685095335 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:39.566858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3b2caded-366c-4cd1-abe8-2b37539f2552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55dc74e9c8884796818fb12bd31f449a', 'request_id': 'req-3b2caded-366c-4cd1-abe8-2b37539f2552'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:39.567037 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 972/1970] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:39.569776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86219345-061a-473b-8d38-491685095335 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:39.593278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3b2caded-366c-4cd1-abe8-2b37539f2552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55dc74e9c8884796818fb12bd31f449a', 'request_id': 'req-3b2caded-366c-4cd1-abe8-2b37539f2552'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:39.607349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3b2caded-366c-4cd1-abe8-2b37539f2552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55dc74e9c8884796818fb12bd31f449a', 'request_id': 'req-3b2caded-366c-4cd1-abe8-2b37539f2552'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:39.626046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86219345-061a-473b-8d38-491685095335 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:39.725922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:39.790116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3b2caded-366c-4cd1-abe8-2b37539f2552 admin admin] The token cache is being invalidate because project 55dc74e9c8884796818fb12bd31f449a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:39.791460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3b2caded-366c-4cd1-abe8-2b37539f2552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:39.796019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3b2caded-366c-4cd1-abe8-2b37539f2552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:39.803901 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 999/1971] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:39 2022] DELETE /identity/v3/projects/55dc74e9c8884796818fb12bd31f449a => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:39.805328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2caded-366c-4cd1-abe8-2b37539f2552 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:39.823935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3b2caded-366c-4cd1-abe8-2b37539f2552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:39.833420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f548c-ac5c-4c54-9ebc-c3242e3ca0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:39.834812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f548c-ac5c-4c54-9ebc-c3242e3ca0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:39.835252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f548c-ac5c-4c54-9ebc-c3242e3ca0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:39.835551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f548c-ac5c-4c54-9ebc-c3242e3ca0f0 admin admin] PATH_INFO: `/v3/projects/b8650a799d2e4d6885ebc9a41a041103/users/88106ab3700141c59577d36de8956a96/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:39.838249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f548c-ac5c-4c54-9ebc-c3242e3ca0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8650a799d2e4d6885ebc9a41a041103, user_id=88106ab3700141c59577d36de8956a96, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:39.841844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f548c-ac5c-4c54-9ebc-c3242e3ca0f0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:39.881708 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 973/1972] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:39 2022] PUT /identity/v3/projects/b8650a799d2e4d6885ebc9a41a041103/users/88106ab3700141c59577d36de8956a96/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:39.883539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f548c-ac5c-4c54-9ebc-c3242e3ca0f0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:39.886914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3a0f548c-ac5c-4c54-9ebc-c3242e3ca0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:40.018501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2caded-366c-4cd1-abe8-2b37539f2552 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:40.173688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b108db7-26f2-4f4c-abe4-a902bddec306 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:40.174548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b108db7-26f2-4f4c-abe4-a902bddec306 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:40.174847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b108db7-26f2-4f4c-abe4-a902bddec306 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:40.175148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b108db7-26f2-4f4c-abe4-a902bddec306 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:40.180082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6b108db7-26f2-4f4c-abe4-a902bddec306 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:40.202637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f548c-ac5c-4c54-9ebc-c3242e3ca0f0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:40.216626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69995c-32fc-4602-ac31-8b3997f90519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:40.224102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69995c-32fc-4602-ac31-8b3997f90519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:40.224429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69995c-32fc-4602-ac31-8b3997f90519 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:40.224643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69995c-32fc-4602-ac31-8b3997f90519 admin admin] PATH_INFO: `/v3/users/10ccde987997492c9dc816f3edb9d6c1` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:40.229611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69995c-32fc-4602-ac31-8b3997f90519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10ccde987997492c9dc816f3edb9d6c1)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:40.231815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69995c-32fc-4602-ac31-8b3997f90519 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:40.343419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b108db7-26f2-4f4c-abe4-a902bddec306 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:40.345417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b108db7-26f2-4f4c-abe4-a902bddec306 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:40.375148 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1000/1973] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:40.377548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded883d4-deb0-455f-b531-6d8715b54a81 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:40.377956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded883d4-deb0-455f-b531-6d8715b54a81 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:40.378681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded883d4-deb0-455f-b531-6d8715b54a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:40.466321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ded883d4-deb0-455f-b531-6d8715b54a81 None None] MFA Rules not processed for user `88106ab3700141c59577d36de8956a96`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:40.469571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ded883d4-deb0-455f-b531-6d8715b54a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:40.492507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7e69995c-32fc-4602-ac31-8b3997f90519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10ccde987997492c9dc816f3edb9d6c1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:40.526592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7e69995c-32fc-4602-ac31-8b3997f90519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10ccde987997492c9dc816f3edb9d6c1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:40.617144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7e69995c-32fc-4602-ac31-8b3997f90519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10ccde987997492c9dc816f3edb9d6c1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:40.638515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7e69995c-32fc-4602-ac31-8b3997f90519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10ccde987997492c9dc816f3edb9d6c1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:40.639541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7e69995c-32fc-4602-ac31-8b3997f90519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10ccde987997492c9dc816f3edb9d6c1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:40.656619 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1001/1974] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:40.656619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d41c72-4c75-48b9-bdfe-50976057a6bc None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:40.656619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d41c72-4c75-48b9-bdfe-50976057a6bc None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:40.657177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d41c72-4c75-48b9-bdfe-50976057a6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:40.665846 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 974/1975] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:39 2022] DELETE /identity/v3/users/10ccde987997492c9dc816f3edb9d6c1 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:40.665846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69995c-32fc-4602-ac31-8b3997f90519 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:40.678880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7e69995c-32fc-4602-ac31-8b3997f90519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:40.702649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-92d41c72-4c75-48b9-bdfe-50976057a6bc None None] MFA Rules not processed for user `497fdecb763d4d038580caf3c1c8ae01`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:40.704208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-92d41c72-4c75-48b9-bdfe-50976057a6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:40.853020 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1002/1976] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:40 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:40.854664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d41c72-4c75-48b9-bdfe-50976057a6bc None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:40.856401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-92d41c72-4c75-48b9-bdfe-50976057a6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:40.891586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69995c-32fc-4602-ac31-8b3997f90519 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:40.907609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0057a-fc36-456b-bcb3-2e160eb4fcd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:40.908745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0057a-fc36-456b-bcb3-2e160eb4fcd9 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:40.909092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0057a-fc36-456b-bcb3-2e160eb4fcd9 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:40.910477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0057a-fc36-456b-bcb3-2e160eb4fcd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:40.922059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9ad0057a-fc36-456b-bcb3-2e160eb4fcd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:41.040763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d41c72-4c75-48b9-bdfe-50976057a6bc None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:41.051320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0057a-fc36-456b-bcb3-2e160eb4fcd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:41.053321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0057a-fc36-456b-bcb3-2e160eb4fcd9 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:41.056549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c6993-7b23-4692-89ea-58d963d4c37b tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:41.057213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c6993-7b23-4692-89ea-58d963d4c37b tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:41.057503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c6993-7b23-4692-89ea-58d963d4c37b tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:41.057782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c6993-7b23-4692-89ea-58d963d4c37b tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:41.058525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c6993-7b23-4692-89ea-58d963d4c37b tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:08:41.058851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c6993-7b23-4692-89ea-58d963d4c37b tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:41.067618 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 975/1977] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:41.084570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c6993-7b23-4692-89ea-58d963d4c37b tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:41.107124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0057a-fc36-456b-bcb3-2e160eb4fcd9 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:41.115720 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1003/1978] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:41.116104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c6993-7b23-4692-89ea-58d963d4c37b tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:41.120857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0057a-fc36-456b-bcb3-2e160eb4fcd9 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:41.127744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c6993-7b23-4692-89ea-58d963d4c37b tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:41.134116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd5239-a138-49f3-882f-75fa996b2334 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:41.135783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd5239-a138-49f3-882f-75fa996b2334 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:41.135783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd5239-a138-49f3-882f-75fa996b2334 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:41.135992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd5239-a138-49f3-882f-75fa996b2334 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:41.136624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd5239-a138-49f3-882f-75fa996b2334 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:41.137108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297f9b9-6c7a-4bd0-982c-58362e43a292 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:41.137902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297f9b9-6c7a-4bd0-982c-58362e43a292 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:41.138261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297f9b9-6c7a-4bd0-982c-58362e43a292 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:41.138621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297f9b9-6c7a-4bd0-982c-58362e43a292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:41.138725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd5239-a138-49f3-882f-75fa996b2334 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:41.141092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6297f9b9-6c7a-4bd0-982c-58362e43a292 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:41.263707 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1004/1979] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:41 2022] POST /identity/v3/projects => generated 369 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:08:41.268897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd5239-a138-49f3-882f-75fa996b2334 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:41.347671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297f9b9-6c7a-4bd0-982c-58362e43a292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:41.351924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297f9b9-6c7a-4bd0-982c-58362e43a292 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:41.392144 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 976/1980] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:41 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:41.443106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:41.454078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd5239-a138-49f3-882f-75fa996b2334 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:41.461103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327d9dd-fe14-4973-8ad3-9d441fba0803 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:41.462228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327d9dd-fe14-4973-8ad3-9d441fba0803 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:41.462615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327d9dd-fe14-4973-8ad3-9d441fba0803 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:41.463465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327d9dd-fe14-4973-8ad3-9d441fba0803 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:41.464579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327d9dd-fe14-4973-8ad3-9d441fba0803 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:08:41.465078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327d9dd-fe14-4973-8ad3-9d441fba0803 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:41.484960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327d9dd-fe14-4973-8ad3-9d441fba0803 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:41.486620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297f9b9-6c7a-4bd0-982c-58362e43a292 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:41.488897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6297f9b9-6c7a-4bd0-982c-58362e43a292 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:41.509507 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1005/1981] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:41.510420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327d9dd-fe14-4973-8ad3-9d441fba0803 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:41.512863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9327d9dd-fe14-4973-8ad3-9d441fba0803 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:41.635232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297f9b9-6c7a-4bd0-982c-58362e43a292 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:41.654617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327d9dd-fe14-4973-8ad3-9d441fba0803 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:41.664718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38d14a-9731-4edf-9f19-b641637fc480 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:41.666213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38d14a-9731-4edf-9f19-b641637fc480 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:41.667389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38d14a-9731-4edf-9f19-b641637fc480 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:41.668211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38d14a-9731-4edf-9f19-b641637fc480 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:41.756691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38d14a-9731-4edf-9f19-b641637fc480 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:41.758482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38d14a-9731-4edf-9f19-b641637fc480 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:41.777929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fa45a-cbea-4854-acb8-41aed0e62934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:41.779925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fa45a-cbea-4854-acb8-41aed0e62934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:41.780421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fa45a-cbea-4854-acb8-41aed0e62934 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:41.780890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fa45a-cbea-4854-acb8-41aed0e62934 admin admin] PATH_INFO: `/v3/projects/531521baa8f1419398a42b7e7cf47b33` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:41.782687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fa45a-cbea-4854-acb8-41aed0e62934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=531521baa8f1419398a42b7e7cf47b33)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:41.784581 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1006/1982] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:41 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:41.785119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fa45a-cbea-4854-acb8-41aed0e62934 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:41.789102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38d14a-9731-4edf-9f19-b641637fc480 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:41.803717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38d14a-9731-4edf-9f19-b641637fc480 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:41.812895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cd9ec-1b4a-48e5-ad05-906a9833f79d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:41.813710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cd9ec-1b4a-48e5-ad05-906a9833f79d service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:41.813999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cd9ec-1b4a-48e5-ad05-906a9833f79d service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:41.815243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cd9ec-1b4a-48e5-ad05-906a9833f79d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:41.826911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cd9ec-1b4a-48e5-ad05-906a9833f79d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:41.828689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cd9ec-1b4a-48e5-ad05-906a9833f79d service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:41.840850 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1007/1983] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:41.857615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486218ee-477e-44ad-ad29-cc4955d4c83b None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:41.857912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486218ee-477e-44ad-ad29-cc4955d4c83b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:41.858512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486218ee-477e-44ad-ad29-cc4955d4c83b None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:41.863779 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1008/1984] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:08:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 21:08:41.876539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486218ee-477e-44ad-ad29-cc4955d4c83b None None] Authenticating service token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:08:41.894594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486218ee-477e-44ad-ad29-cc4955d4c83b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:41.910691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486218ee-477e-44ad-ad29-cc4955d4c83b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:41.939033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074421d-a77f-4597-8d03-4c06137753b4 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:41.943380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074421d-a77f-4597-8d03-4c06137753b4 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:41.943667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074421d-a77f-4597-8d03-4c06137753b4 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:41.943947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074421d-a77f-4597-8d03-4c06137753b4 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/projects/ab7c7acf71184ab983a12fa486de5850` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:41.950064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:41.950562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074421d-a77f-4597-8d03-4c06137753b4 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:get_project(project_id=ab7c7acf71184ab983a12fa486de5850)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:41.950562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074421d-a77f-4597-8d03-4c06137753b4 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:41.952212 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1009/1985] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:08:41 2022] GET /identity/v3/projects/ab7c7acf71184ab983a12fa486de5850 => generated 369 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:41.969379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b90fa45a-cbea-4854-acb8-41aed0e62934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '531521baa8f1419398a42b7e7cf47b33', 'request_id': 'req-b90fa45a-cbea-4854-acb8-41aed0e62934'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:41.981972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b90fa45a-cbea-4854-acb8-41aed0e62934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '531521baa8f1419398a42b7e7cf47b33', 'request_id': 'req-b90fa45a-cbea-4854-acb8-41aed0e62934'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:41.993314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b90fa45a-cbea-4854-acb8-41aed0e62934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '531521baa8f1419398a42b7e7cf47b33', 'request_id': 'req-b90fa45a-cbea-4854-acb8-41aed0e62934'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:42.004418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44041342-0568-41a0-a3f5-dc7c5fec0bc5 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:42.005112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44041342-0568-41a0-a3f5-dc7c5fec0bc5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:42.005633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44041342-0568-41a0-a3f5-dc7c5fec0bc5 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:42.008078 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1010/1986] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:08:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:08:42.013733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44041342-0568-41a0-a3f5-dc7c5fec0bc5 None None] Authenticating service token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:08:42.138990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44041342-0568-41a0-a3f5-dc7c5fec0bc5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:42.149107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b90fa45a-cbea-4854-acb8-41aed0e62934 admin admin] The token cache is being invalidate because project 531521baa8f1419398a42b7e7cf47b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:42.149484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b90fa45a-cbea-4854-acb8-41aed0e62934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:42.150872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b90fa45a-cbea-4854-acb8-41aed0e62934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:42.152718 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 977/1987] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:41 2022] DELETE /identity/v3/projects/531521baa8f1419398a42b7e7cf47b33 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:08:42.160407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff9793-92e7-4981-8fd4-7130f0ed68aa None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:42.160757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff9793-92e7-4981-8fd4-7130f0ed68aa None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:42.161108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff9793-92e7-4981-8fd4-7130f0ed68aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:42.183542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3fff9793-92e7-4981-8fd4-7130f0ed68aa None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:42.185355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3fff9793-92e7-4981-8fd4-7130f0ed68aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:42.247161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44041342-0568-41a0-a3f5-dc7c5fec0bc5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:42.254585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c900f-c9cc-48d5-aa14-42896819d2b3 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:42.255714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c900f-c9cc-48d5-aa14-42896819d2b3 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:42.256067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c900f-c9cc-48d5-aa14-42896819d2b3 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:42.256428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c900f-c9cc-48d5-aa14-42896819d2b3 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/projects/ab7c7acf71184ab983a12fa486de5850` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:42.258348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c900f-c9cc-48d5-aa14-42896819d2b3 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:get_project(project_id=ab7c7acf71184ab983a12fa486de5850)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:42.261219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c900f-c9cc-48d5-aa14-42896819d2b3 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:42.304706 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 978/1988] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:42.308338 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1011/1989] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:08:42 2022] GET /identity/v3/projects/ab7c7acf71184ab983a12fa486de5850 => generated 369 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:08:42.312486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe468c-69f8-4e60-8c4e-7758c7ea7b73 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:42.312855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe468c-69f8-4e60-8c4e-7758c7ea7b73 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:42.313209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe468c-69f8-4e60-8c4e-7758c7ea7b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:42.355517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-bebe468c-69f8-4e60-8c4e-7758c7ea7b73 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:42.356902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bebe468c-69f8-4e60-8c4e-7758c7ea7b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:42.370037 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 979/1990] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:08:42.374278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c900f-c9cc-48d5-aa14-42896819d2b3 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:42.389802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c900f-c9cc-48d5-aa14-42896819d2b3 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:42.396669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e45aa7-c32c-4108-90f4-c39df84ae710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:42.397419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e45aa7-c32c-4108-90f4-c39df84ae710 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:42.397704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e45aa7-c32c-4108-90f4-c39df84ae710 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:42.398082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e45aa7-c32c-4108-90f4-c39df84ae710 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:42.398824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e45aa7-c32c-4108-90f4-c39df84ae710 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:08:42.399210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e45aa7-c32c-4108-90f4-c39df84ae710 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:42.400916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e45aa7-c32c-4108-90f4-c39df84ae710 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:42.420413 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1012/1991] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:08:42.427465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe468c-69f8-4e60-8c4e-7758c7ea7b73 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:42.441102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe468c-69f8-4e60-8c4e-7758c7ea7b73 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:42.457817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebf36b-d135-4455-8cf5-7f70ce5a7f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:42.459023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebf36b-d135-4455-8cf5-7f70ce5a7f99 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:42.459327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebf36b-d135-4455-8cf5-7f70ce5a7f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:42.460136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebf36b-d135-4455-8cf5-7f70ce5a7f99 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:42.460703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebf36b-d135-4455-8cf5-7f70ce5a7f99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:42.462449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebf36b-d135-4455-8cf5-7f70ce5a7f99 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:42.570442 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 980/1992] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:42 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:42.576432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e45aa7-c32c-4108-90f4-c39df84ae710 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:42.604526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e45aa7-c32c-4108-90f4-c39df84ae710 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:42.653024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebf36b-d135-4455-8cf5-7f70ce5a7f99 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:42.658074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0bebf36b-d135-4455-8cf5-7f70ce5a7f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:42.744060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4057e-0d0a-414d-8e83-621a38f02128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:42.744747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4057e-0d0a-414d-8e83-621a38f02128 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:42.745028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4057e-0d0a-414d-8e83-621a38f02128 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:42.745298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4057e-0d0a-414d-8e83-621a38f02128 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:42.745997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4057e-0d0a-414d-8e83-621a38f02128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:42.748098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4057e-0d0a-414d-8e83-621a38f02128 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:42.768144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebf36b-d135-4455-8cf5-7f70ce5a7f99 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:42.775456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ba777-913e-47c7-b7b0-6b72d3a5037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:42.776563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ba777-913e-47c7-b7b0-6b72d3a5037a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:42.776820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ba777-913e-47c7-b7b0-6b72d3a5037a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:42.777327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ba777-913e-47c7-b7b0-6b72d3a5037a admin admin] PATH_INFO: `/v3/users/2b1a976345364bbe993706cc8f12889d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:42.779122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ba777-913e-47c7-b7b0-6b72d3a5037a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b1a976345364bbe993706cc8f12889d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:42.781457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ba777-913e-47c7-b7b0-6b72d3a5037a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:42.886863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:43.069674 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1013/1993] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:42 2022] POST /identity/v3/users => generated 286 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:43.072969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d748b-107b-41ae-9bff-c248b9defae8 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:43.073358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d748b-107b-41ae-9bff-c248b9defae8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:43.073735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d748b-107b-41ae-9bff-c248b9defae8 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:43.076758 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1014/1994] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:08:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:08:43.077659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d748b-107b-41ae-9bff-c248b9defae8 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:43.098043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d748b-107b-41ae-9bff-c248b9defae8 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:43.106902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0a0c0-4a70-4dc7-8f09-c0d091bc0d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:43.107759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0a0c0-4a70-4dc7-8f09-c0d091bc0d00 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:43.108136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0a0c0-4a70-4dc7-8f09-c0d091bc0d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:43.108507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0a0c0-4a70-4dc7-8f09-c0d091bc0d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:43.109916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0a0c0-4a70-4dc7-8f09-c0d091bc0d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:43.113532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0a0c0-4a70-4dc7-8f09-c0d091bc0d00 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:43.128335 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1015/1995] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:43.129343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0a0c0-4a70-4dc7-8f09-c0d091bc0d00 admin admin] Authenticating service token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:08:43.134381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0ac0a0c0-4a70-4dc7-8f09-c0d091bc0d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:43.290442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0a0c0-4a70-4dc7-8f09-c0d091bc0d00 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:43.292327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0ac0a0c0-4a70-4dc7-8f09-c0d091bc0d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:43.420401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bf6ba777-913e-47c7-b7b0-6b72d3a5037a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b1a976345364bbe993706cc8f12889d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:43.448608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0a0c0-4a70-4dc7-8f09-c0d091bc0d00 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:43.469235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cd4bd-9248-4157-8d39-bbd887fe2756 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:43.470145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cd4bd-9248-4157-8d39-bbd887fe2756 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:43.471463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cd4bd-9248-4157-8d39-bbd887fe2756 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:43.480640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cd4bd-9248-4157-8d39-bbd887fe2756 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/projects/ab7c7acf71184ab983a12fa486de5850` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:43.494215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bf6ba777-913e-47c7-b7b0-6b72d3a5037a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b1a976345364bbe993706cc8f12889d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:43.496026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86cd4bd-9248-4157-8d39-bbd887fe2756 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:get_project(project_id=ab7c7acf71184ab983a12fa486de5850)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:43.498632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86cd4bd-9248-4157-8d39-bbd887fe2756 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:43.512314 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1016/1996] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:08:43 2022] GET /identity/v3/projects/ab7c7acf71184ab983a12fa486de5850 => generated 369 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:43.515683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cd4bd-9248-4157-8d39-bbd887fe2756 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:43.562904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cd4bd-9248-4157-8d39-bbd887fe2756 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:43.599282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20987b0f-12b1-4bc8-9877-d8a6643beefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:43.599975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20987b0f-12b1-4bc8-9877-d8a6643beefb admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:43.600253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20987b0f-12b1-4bc8-9877-d8a6643beefb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:43.610979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20987b0f-12b1-4bc8-9877-d8a6643beefb admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:43.610979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20987b0f-12b1-4bc8-9877-d8a6643beefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:43.610979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20987b0f-12b1-4bc8-9877-d8a6643beefb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:43.650672 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1017/1997] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:43.651877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20987b0f-12b1-4bc8-9877-d8a6643beefb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:43.676421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20987b0f-12b1-4bc8-9877-d8a6643beefb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:43.693230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cd0a2-800b-42dd-97ee-cccf9c60c718 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:43.693934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cd0a2-800b-42dd-97ee-cccf9c60c718 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:43.694259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cd0a2-800b-42dd-97ee-cccf9c60c718 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:43.694545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cd0a2-800b-42dd-97ee-cccf9c60c718 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/projects/ab7c7acf71184ab983a12fa486de5850` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:43.702110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cd0a2-800b-42dd-97ee-cccf9c60c718 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ab7c7acf71184ab983a12fa486de5850)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:43.710899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cd0a2-800b-42dd-97ee-cccf9c60c718 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:43.714603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bf6ba777-913e-47c7-b7b0-6b72d3a5037a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b1a976345364bbe993706cc8f12889d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:43.725772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bf6ba777-913e-47c7-b7b0-6b72d3a5037a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b1a976345364bbe993706cc8f12889d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:43.727000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bf6ba777-913e-47c7-b7b0-6b72d3a5037a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b1a976345364bbe993706cc8f12889d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:43.743858 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 981/1998] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:42 2022] DELETE /identity/v3/users/2b1a976345364bbe993706cc8f12889d => generated 0 bytes in 1091 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:43.747465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ba777-913e-47c7-b7b0-6b72d3a5037a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:43.754223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bf6ba777-913e-47c7-b7b0-6b72d3a5037a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:43.785747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:43.945714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-852cd0a2-800b-42dd-97ee-cccf9c60c718 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab7c7acf71184ab983a12fa486de5850', 'request_id': 'req-852cd0a2-800b-42dd-97ee-cccf9c60c718'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:43.948109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ba777-913e-47c7-b7b0-6b72d3a5037a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:43.962046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-852cd0a2-800b-42dd-97ee-cccf9c60c718 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab7c7acf71184ab983a12fa486de5850', 'request_id': 'req-852cd0a2-800b-42dd-97ee-cccf9c60c718'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:43.976855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-852cd0a2-800b-42dd-97ee-cccf9c60c718 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab7c7acf71184ab983a12fa486de5850', 'request_id': 'req-852cd0a2-800b-42dd-97ee-cccf9c60c718'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:44.107128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-852cd0a2-800b-42dd-97ee-cccf9c60c718 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] The token cache is being invalidate because project ab7c7acf71184ab983a12fa486de5850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:44.107874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-852cd0a2-800b-42dd-97ee-cccf9c60c718 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:44.114275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237cdd9-5927-4f8e-94b2-e1cf2fd92f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:44.116150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237cdd9-5927-4f8e-94b2-e1cf2fd92f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:44.116698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237cdd9-5927-4f8e-94b2-e1cf2fd92f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:44.117208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-852cd0a2-800b-42dd-97ee-cccf9c60c718 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:44.117670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237cdd9-5927-4f8e-94b2-e1cf2fd92f4d admin admin] PATH_INFO: `/v3/projects/9b769bf8f3ea4e368bf68de1df6538f9/users/6a69f9dee03d43beaafa966216b9e289/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:44.120548 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1018/1999] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:43 2022] DELETE /identity/v3/projects/ab7c7acf71184ab983a12fa486de5850 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:44.129791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8955d18-55ce-4ddc-b596-2d934850e961 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:44.133428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8955d18-55ce-4ddc-b596-2d934850e961 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:44.133428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8955d18-55ce-4ddc-b596-2d934850e961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:44.162149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=83,keystone:INSERT=4,keystone:DELETE=13 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:44.164835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e8955d18-55ce-4ddc-b596-2d934850e961 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:44.166555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e8955d18-55ce-4ddc-b596-2d934850e961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:44.182253 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1019/2000] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:44.183637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237cdd9-5927-4f8e-94b2-e1cf2fd92f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b769bf8f3ea4e368bf68de1df6538f9, user_id=6a69f9dee03d43beaafa966216b9e289, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:44.190927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237cdd9-5927-4f8e-94b2-e1cf2fd92f4d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:44.243903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8955d18-55ce-4ddc-b596-2d934850e961 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:44.243903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e8955d18-55ce-4ddc-b596-2d934850e961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:44.328130 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 982/2001] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:43 2022] PUT /identity/v3/projects/9b769bf8f3ea4e368bf68de1df6538f9/users/6a69f9dee03d43beaafa966216b9e289/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:44.335266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff705dab-b544-45aa-90d9-50881579d5d9 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:44.335266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff705dab-b544-45aa-90d9-50881579d5d9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:44.335266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff705dab-b544-45aa-90d9-50881579d5d9 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:44.335266 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 983/2002] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:08:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:08:44.338223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b2b82-0d38-4f22-ace5-bf705440af0c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:44.340937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b2b82-0d38-4f22-ace5-bf705440af0c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:44.341660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b2b82-0d38-4f22-ace5-bf705440af0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:44.343594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8955d18-55ce-4ddc-b596-2d934850e961 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:44.393331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-210b2b82-0d38-4f22-ace5-bf705440af0c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:44.397954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-210b2b82-0d38-4f22-ace5-bf705440af0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:44.508273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9896c0-5c7a-4d28-a791-0b29bd4954f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:44.508986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9896c0-5c7a-4d28-a791-0b29bd4954f3 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:44.509282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9896c0-5c7a-4d28-a791-0b29bd4954f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:44.509554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9896c0-5c7a-4d28-a791-0b29bd4954f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:44.543498 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 984/2003] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:44.545375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b2b82-0d38-4f22-ace5-bf705440af0c None None] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:08:44.550566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-210b2b82-0d38-4f22-ace5-bf705440af0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:44.683735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9896c0-5c7a-4d28-a791-0b29bd4954f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:44.686344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9896c0-5c7a-4d28-a791-0b29bd4954f3 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:44.726774 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1020/2004] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:44.727371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9896c0-5c7a-4d28-a791-0b29bd4954f3 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:44.729936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8b9896c0-5c7a-4d28-a791-0b29bd4954f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:44.773663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9896c0-5c7a-4d28-a791-0b29bd4954f3 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:44.786038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b2b82-0d38-4f22-ace5-bf705440af0c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:44.788575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132c584-ecf9-4e50-b15b-c89d20150773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:44.792944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-210b2b82-0d38-4f22-ace5-bf705440af0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:44.795295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132c584-ecf9-4e50-b15b-c89d20150773 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:44.795578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132c584-ecf9-4e50-b15b-c89d20150773 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:44.796003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132c584-ecf9-4e50-b15b-c89d20150773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:44.848674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132c584-ecf9-4e50-b15b-c89d20150773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:44.850536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132c584-ecf9-4e50-b15b-c89d20150773 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:44.882715 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1021/2005] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:45.015499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b2b82-0d38-4f22-ace5-bf705440af0c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:45.044395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c14cb-628e-41c9-a4ea-6637a59bfb93 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:45.045702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c14cb-628e-41c9-a4ea-6637a59bfb93 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:45.046158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c14cb-628e-41c9-a4ea-6637a59bfb93 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:45.047366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c14cb-628e-41c9-a4ea-6637a59bfb93 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/projects/9dcf95f2466344d1a28724d545a8fed6` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:45.054057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c14cb-628e-41c9-a4ea-6637a59bfb93 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:get_project(project_id=9dcf95f2466344d1a28724d545a8fed6)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:45.059072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c14cb-628e-41c9-a4ea-6637a59bfb93 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:45.070062 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 985/2006] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:08:44 2022] GET /identity/v3/projects/9dcf95f2466344d1a28724d545a8fed6 => generated 373 bytes in 525 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:45.090735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132c584-ecf9-4e50-b15b-c89d20150773 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:45.107654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132c584-ecf9-4e50-b15b-c89d20150773 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:45.117238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66e2c0-d60b-457d-9084-6593acb088bd tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:45.118410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66e2c0-d60b-457d-9084-6593acb088bd tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:45.118925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66e2c0-d60b-457d-9084-6593acb088bd tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:45.119633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66e2c0-d60b-457d-9084-6593acb088bd tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:45.121042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66e2c0-d60b-457d-9084-6593acb088bd tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:08:45.121513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66e2c0-d60b-457d-9084-6593acb088bd tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:45.123501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66e2c0-d60b-457d-9084-6593acb088bd tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:45.131614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:45.152347 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1022/2007] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:45.156878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c14cb-628e-41c9-a4ea-6637a59bfb93 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:45.177209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c14cb-628e-41c9-a4ea-6637a59bfb93 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:45.186429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bd250-9eab-4786-8773-332b8c533681 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:45.187177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bd250-9eab-4786-8773-332b8c533681 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:45.187439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bd250-9eab-4786-8773-332b8c533681 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:45.187870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bd250-9eab-4786-8773-332b8c533681 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:45.188593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5bd250-9eab-4786-8773-332b8c533681 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:45.192125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5bd250-9eab-4786-8773-332b8c533681 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:45.349222 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 986/2008] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:45 2022] POST /identity/v3/projects => generated 369 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:45.353792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66e2c0-d60b-457d-9084-6593acb088bd tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:45.373143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66e2c0-d60b-457d-9084-6593acb088bd tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:45.516633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fd346-da78-4716-b5d6-9feee98554c9 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:45.519360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fd346-da78-4716-b5d6-9feee98554c9 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:45.519662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fd346-da78-4716-b5d6-9feee98554c9 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:45.522007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fd346-da78-4716-b5d6-9feee98554c9 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:45.522807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fd346-da78-4716-b5d6-9feee98554c9 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:08:45.523417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fd346-da78-4716-b5d6-9feee98554c9 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:45.525141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fd346-da78-4716-b5d6-9feee98554c9 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:45.546677 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1023/2009] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:45.572596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912f43f-2b07-4d6a-a8ce-b253c81119d3 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:45.573137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912f43f-2b07-4d6a-a8ce-b253c81119d3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:45.573137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912f43f-2b07-4d6a-a8ce-b253c81119d3 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:45.575229 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 987/2010] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:08:45.580741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fd346-da78-4716-b5d6-9feee98554c9 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Authenticating service token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:08:45.705689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fd346-da78-4716-b5d6-9feee98554c9 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:45.723319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fd346-da78-4716-b5d6-9feee98554c9 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:45.732462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c80e18-db5f-4323-9518-5b7abe2e221c tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:45.735477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c80e18-db5f-4323-9518-5b7abe2e221c tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:45.743107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c80e18-db5f-4323-9518-5b7abe2e221c tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:45.743107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c80e18-db5f-4323-9518-5b7abe2e221c tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/projects/b74bc8cc72c8405a9a5b124902016aff` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:45.743482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c80e18-db5f-4323-9518-5b7abe2e221c tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:get_project(project_id=b74bc8cc72c8405a9a5b124902016aff)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:45.754414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c80e18-db5f-4323-9518-5b7abe2e221c tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:45.757007 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1024/2011] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:08:45 2022] GET /identity/v3/projects/b74bc8cc72c8405a9a5b124902016aff => generated 369 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:46.002817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f823995-bbb5-47d7-b3f4-55ba0a2c08be None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:46.003150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f823995-bbb5-47d7-b3f4-55ba0a2c08be None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:46.003424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f823995-bbb5-47d7-b3f4-55ba0a2c08be None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:46.005878 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 988/2012] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:08:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:08:46.016584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c80e18-db5f-4323-9518-5b7abe2e221c tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Authenticating service token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:08:46.088415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c80e18-db5f-4323-9518-5b7abe2e221c tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:46.102655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c80e18-db5f-4323-9518-5b7abe2e221c tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:46.108133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05891e-ed43-4e12-b128-909f25660fff tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:46.109370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05891e-ed43-4e12-b128-909f25660fff tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:46.109759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05891e-ed43-4e12-b128-909f25660fff tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:46.110477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05891e-ed43-4e12-b128-909f25660fff tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/projects/b74bc8cc72c8405a9a5b124902016aff` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:46.113241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05891e-ed43-4e12-b128-909f25660fff tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:get_project(project_id=b74bc8cc72c8405a9a5b124902016aff)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:46.117323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05891e-ed43-4e12-b128-909f25660fff tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:46.121475 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1025/2013] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:08:46 2022] GET /identity/v3/projects/b74bc8cc72c8405a9a5b124902016aff => generated 369 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:08:46.280205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f823995-bbb5-47d7-b3f4-55ba0a2c08be None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:46.311291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f823995-bbb5-47d7-b3f4-55ba0a2c08be None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:46.322046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1734a54-0f62-4351-b975-6ecdd79dfc62 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:46.322743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1734a54-0f62-4351-b975-6ecdd79dfc62 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:46.323051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1734a54-0f62-4351-b975-6ecdd79dfc62 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:46.323346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1734a54-0f62-4351-b975-6ecdd79dfc62 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:46.324462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1734a54-0f62-4351-b975-6ecdd79dfc62 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:08:46.324938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1734a54-0f62-4351-b975-6ecdd79dfc62 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:46.326851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1734a54-0f62-4351-b975-6ecdd79dfc62 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:46.350863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:46.360314 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 989/2014] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:46.362377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05891e-ed43-4e12-b128-909f25660fff tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:46.371826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:46.380371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05891e-ed43-4e12-b128-909f25660fff tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:46.410000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f5375-6870-4bd8-9f91-e3f9f25f6e37 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:46.410939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f5375-6870-4bd8-9f91-e3f9f25f6e37 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:46.411265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f5375-6870-4bd8-9f91-e3f9f25f6e37 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:46.411550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f5375-6870-4bd8-9f91-e3f9f25f6e37 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:46.421114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f5375-6870-4bd8-9f91-e3f9f25f6e37 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:46.421114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f5375-6870-4bd8-9f91-e3f9f25f6e37 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:46.543323 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1026/2015] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:46 2022] POST /identity/v3/users => generated 383 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:08:46.549961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1734a54-0f62-4351-b975-6ecdd79dfc62 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:46.594354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1734a54-0f62-4351-b975-6ecdd79dfc62 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:46.600779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67621ebc-bb3d-4721-ba2f-53571371e694 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:46.601604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67621ebc-bb3d-4721-ba2f-53571371e694 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:46.601976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67621ebc-bb3d-4721-ba2f-53571371e694 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:46.602312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67621ebc-bb3d-4721-ba2f-53571371e694 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:46.603281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67621ebc-bb3d-4721-ba2f-53571371e694 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:08:46.603658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67621ebc-bb3d-4721-ba2f-53571371e694 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:46.613818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67621ebc-bb3d-4721-ba2f-53571371e694 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:46.635788 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 990/2016] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:46.838890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e4f06-e6c9-4a3c-a939-53397d8ac4db None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:46.840287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e4f06-e6c9-4a3c-a939-53397d8ac4db None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:46.840577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e4f06-e6c9-4a3c-a939-53397d8ac4db None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:46.843597 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1027/2017] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:08:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:08:46.851580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67621ebc-bb3d-4721-ba2f-53571371e694 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:08:46.873845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67621ebc-bb3d-4721-ba2f-53571371e694 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:46.912467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67621ebc-bb3d-4721-ba2f-53571371e694 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:46.930632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6148ac4-e427-4718-9f1f-1f088adeea41 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:46.930632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6148ac4-e427-4718-9f1f-1f088adeea41 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:46.930632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6148ac4-e427-4718-9f1f-1f088adeea41 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:46.930960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6148ac4-e427-4718-9f1f-1f088adeea41 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/projects/b74bc8cc72c8405a9a5b124902016aff` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:46.930960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6148ac4-e427-4718-9f1f-1f088adeea41 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:get_project(project_id=b74bc8cc72c8405a9a5b124902016aff)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:46.930960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6148ac4-e427-4718-9f1f-1f088adeea41 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:46.930960 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 991/2018] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:08:46 2022] GET /identity/v3/projects/b74bc8cc72c8405a9a5b124902016aff => generated 369 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:08:47.133981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e4f06-e6c9-4a3c-a939-53397d8ac4db None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:47.135772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f42e4f06-e6c9-4a3c-a939-53397d8ac4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:47.336829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfc422-d2c9-4819-8581-25bfb02ac60a None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:47.337494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfc422-d2c9-4819-8581-25bfb02ac60a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:47.337929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfc422-d2c9-4819-8581-25bfb02ac60a None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:47.339889 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 992/2019] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:08:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 21:08:47.345306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfc422-d2c9-4819-8581-25bfb02ac60a None None] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:08:47.367356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e4f06-e6c9-4a3c-a939-53397d8ac4db None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:47.378045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfc422-d2c9-4819-8581-25bfb02ac60a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:47.382148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363bb40-c8b9-460d-9b18-edf9d6468ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:47.386597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363bb40-c8b9-460d-9b18-edf9d6468ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:47.390335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363bb40-c8b9-460d-9b18-edf9d6468ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:47.390552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363bb40-c8b9-460d-9b18-edf9d6468ec6 admin admin] PATH_INFO: `/v3/projects/a97328b7ae9f44f8a1c275efb98ec250` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:47.397749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363bb40-c8b9-460d-9b18-edf9d6468ec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a97328b7ae9f44f8a1c275efb98ec250)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:47.404992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363bb40-c8b9-460d-9b18-edf9d6468ec6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:47.415247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfc422-d2c9-4819-8581-25bfb02ac60a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:47.439762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7eea2-b9d1-420a-a102-88c9d88eba13 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:47.440963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7eea2-b9d1-420a-a102-88c9d88eba13 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:47.442804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7eea2-b9d1-420a-a102-88c9d88eba13 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:47.444333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7eea2-b9d1-420a-a102-88c9d88eba13 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/projects/b74bc8cc72c8405a9a5b124902016aff` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:47.448190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7eea2-b9d1-420a-a102-88c9d88eba13 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:get_project(project_id=b74bc8cc72c8405a9a5b124902016aff)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:47.461691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7eea2-b9d1-420a-a102-88c9d88eba13 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:47.474226 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 993/2020] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:08:47 2022] GET /identity/v3/projects/b74bc8cc72c8405a9a5b124902016aff => generated 369 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:08:47.482025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbad23-a5e8-42c3-bae8-a79d5cebec8d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:47.482674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbad23-a5e8-42c3-bae8-a79d5cebec8d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:47.483117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbad23-a5e8-42c3-bae8-a79d5cebec8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:47.554953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f7cbad23-a5e8-42c3-bae8-a79d5cebec8d None None] MFA Rules not processed for user `700a44c6eacf41649a8d6d52eaa7f9f3`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:47.556460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f7cbad23-a5e8-42c3-bae8-a79d5cebec8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:47.638224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a363bb40-c8b9-460d-9b18-edf9d6468ec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a97328b7ae9f44f8a1c275efb98ec250', 'request_id': 'req-a363bb40-c8b9-460d-9b18-edf9d6468ec6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:47.648737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a363bb40-c8b9-460d-9b18-edf9d6468ec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a97328b7ae9f44f8a1c275efb98ec250', 'request_id': 'req-a363bb40-c8b9-460d-9b18-edf9d6468ec6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:47.659050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a363bb40-c8b9-460d-9b18-edf9d6468ec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a97328b7ae9f44f8a1c275efb98ec250', 'request_id': 'req-a363bb40-c8b9-460d-9b18-edf9d6468ec6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:47.687084 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 994/2021] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:47.687866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbad23-a5e8-42c3-bae8-a79d5cebec8d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:47.712205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbad23-a5e8-42c3-bae8-a79d5cebec8d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:47.784744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a363bb40-c8b9-460d-9b18-edf9d6468ec6 admin admin] The token cache is being invalidate because project a97328b7ae9f44f8a1c275efb98ec250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:47.785115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a363bb40-c8b9-460d-9b18-edf9d6468ec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:47.785979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a363bb40-c8b9-460d-9b18-edf9d6468ec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:47.790768 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1028/2022] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:47 2022] DELETE /identity/v3/projects/a97328b7ae9f44f8a1c275efb98ec250 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:47.791929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363bb40-c8b9-460d-9b18-edf9d6468ec6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:47.793266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a363bb40-c8b9-460d-9b18-edf9d6468ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:47.795580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02360d03-bcb0-49f2-9251-73fb9770477a tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:47.796540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02360d03-bcb0-49f2-9251-73fb9770477a tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:47.796837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02360d03-bcb0-49f2-9251-73fb9770477a tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:47.797122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02360d03-bcb0-49f2-9251-73fb9770477a tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/users/674d28367979435aa78462118d6a7256` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:47.878834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02360d03-bcb0-49f2-9251-73fb9770477a tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:delete_user(user_id=674d28367979435aa78462118d6a7256)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:47.880781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:47.881994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02360d03-bcb0-49f2-9251-73fb9770477a tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:47.914802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:47.939156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363bb40-c8b9-460d-9b18-edf9d6468ec6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:47.951065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a6ec6-8623-4936-9bcb-7a5289e03213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:47.952013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a6ec6-8623-4936-9bcb-7a5289e03213 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:47.952470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a6ec6-8623-4936-9bcb-7a5289e03213 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:47.967156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a6ec6-8623-4936-9bcb-7a5289e03213 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:47.969046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a6ec6-8623-4936-9bcb-7a5289e03213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:47.971719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a6ec6-8623-4936-9bcb-7a5289e03213 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:48.090296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-02360d03-bcb0-49f2-9251-73fb9770477a tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '674d28367979435aa78462118d6a7256'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:48.113705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-02360d03-bcb0-49f2-9251-73fb9770477a tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '674d28367979435aa78462118d6a7256'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:48.126208 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1029/2023] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:47 2022] POST /identity/v3/projects => generated 405 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:48.128044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a6ec6-8623-4936-9bcb-7a5289e03213 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:48.131536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-da1a6ec6-8623-4936-9bcb-7a5289e03213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:48.234763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-02360d03-bcb0-49f2-9251-73fb9770477a tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '674d28367979435aa78462118d6a7256'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:48.247927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-02360d03-bcb0-49f2-9251-73fb9770477a tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '674d28367979435aa78462118d6a7256'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:48.249600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-02360d03-bcb0-49f2-9251-73fb9770477a tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '674d28367979435aa78462118d6a7256'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:48.269375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a6ec6-8623-4936-9bcb-7a5289e03213 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:48.274675 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 995/2024] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:47 2022] DELETE /identity/v3/users/674d28367979435aa78462118d6a7256 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:48.277252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02360d03-bcb0-49f2-9251-73fb9770477a tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:48.281788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-02360d03-bcb0-49f2-9251-73fb9770477a tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:48.393679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02360d03-bcb0-49f2-9251-73fb9770477a tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:48.399782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38042ce7-d9ed-4b43-a30b-92f1be7fe378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:48.400548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38042ce7-d9ed-4b43-a30b-92f1be7fe378 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:48.400913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38042ce7-d9ed-4b43-a30b-92f1be7fe378 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:48.401202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38042ce7-d9ed-4b43-a30b-92f1be7fe378 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:48.408937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38042ce7-d9ed-4b43-a30b-92f1be7fe378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:48.412929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198eb10f-b7b9-4a50-a927-5129067bed61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:48.412929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198eb10f-b7b9-4a50-a927-5129067bed61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:48.412929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198eb10f-b7b9-4a50-a927-5129067bed61 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:48.412929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198eb10f-b7b9-4a50-a927-5129067bed61 admin admin] PATH_INFO: `/v3/users/9b8cec31075a44e29ecc88a83891027b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:48.416265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198eb10f-b7b9-4a50-a927-5129067bed61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b8cec31075a44e29ecc88a83891027b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:48.416420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38042ce7-d9ed-4b43-a30b-92f1be7fe378 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:48.418838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198eb10f-b7b9-4a50-a927-5129067bed61 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:48.554512 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 996/2025] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:48 2022] POST /identity/v3/users => generated 309 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:48.555727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38042ce7-d9ed-4b43-a30b-92f1be7fe378 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:48.558289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-38042ce7-d9ed-4b43-a30b-92f1be7fe378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:48.686415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-198eb10f-b7b9-4a50-a927-5129067bed61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b8cec31075a44e29ecc88a83891027b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:48.692756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38042ce7-d9ed-4b43-a30b-92f1be7fe378 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:48.699522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16aeadc-5a60-4c71-8951-afe0683620f7 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:48.701180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16aeadc-5a60-4c71-8951-afe0683620f7 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:48.701701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16aeadc-5a60-4c71-8951-afe0683620f7 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:48.702191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16aeadc-5a60-4c71-8951-afe0683620f7 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/projects/b74bc8cc72c8405a9a5b124902016aff` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:48.704388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16aeadc-5a60-4c71-8951-afe0683620f7 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b74bc8cc72c8405a9a5b124902016aff)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:48.707291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16aeadc-5a60-4c71-8951-afe0683620f7 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:48.710748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-198eb10f-b7b9-4a50-a927-5129067bed61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b8cec31075a44e29ecc88a83891027b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:48.811145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-198eb10f-b7b9-4a50-a927-5129067bed61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b8cec31075a44e29ecc88a83891027b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:48.812066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-198eb10f-b7b9-4a50-a927-5129067bed61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b8cec31075a44e29ecc88a83891027b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:48.838056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-198eb10f-b7b9-4a50-a927-5129067bed61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b8cec31075a44e29ecc88a83891027b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:48.848936 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1030/2026] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:48 2022] DELETE /identity/v3/users/9b8cec31075a44e29ecc88a83891027b => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:48.848936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198eb10f-b7b9-4a50-a927-5129067bed61 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:48.850504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-198eb10f-b7b9-4a50-a927-5129067bed61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:48.854956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:48.907405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d16aeadc-5a60-4c71-8951-afe0683620f7 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b74bc8cc72c8405a9a5b124902016aff', 'request_id': 'req-d16aeadc-5a60-4c71-8951-afe0683620f7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:48.925933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d16aeadc-5a60-4c71-8951-afe0683620f7 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b74bc8cc72c8405a9a5b124902016aff', 'request_id': 'req-d16aeadc-5a60-4c71-8951-afe0683620f7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:48.937640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d16aeadc-5a60-4c71-8951-afe0683620f7 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b74bc8cc72c8405a9a5b124902016aff', 'request_id': 'req-d16aeadc-5a60-4c71-8951-afe0683620f7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:48.953450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198eb10f-b7b9-4a50-a927-5129067bed61 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:49.031764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22059108-34c6-479b-93d4-aaed5c3d921c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:49.032504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22059108-34c6-479b-93d4-aaed5c3d921c admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:49.033213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22059108-34c6-479b-93d4-aaed5c3d921c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:49.033507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22059108-34c6-479b-93d4-aaed5c3d921c admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:49.034305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22059108-34c6-479b-93d4-aaed5c3d921c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:49.036146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22059108-34c6-479b-93d4-aaed5c3d921c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:49.051112 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1031/2027] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:49.052851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22059108-34c6-479b-93d4-aaed5c3d921c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:49.064540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22059108-34c6-479b-93d4-aaed5c3d921c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:49.075181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be2239-2fd3-4844-b806-459346956ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:49.075544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d16aeadc-5a60-4c71-8951-afe0683620f7 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] The token cache is being invalidate because project b74bc8cc72c8405a9a5b124902016aff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:49.075732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be2239-2fd3-4844-b806-459346956ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:49.078215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d16aeadc-5a60-4c71-8951-afe0683620f7 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:49.078338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be2239-2fd3-4844-b806-459346956ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:49.078338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be2239-2fd3-4844-b806-459346956ffb admin admin] PATH_INFO: `/v3/projects/a5ba9cfa3207476b81dd1988390480c7/users/637bd247436f468cb66232d28cae9d11/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:49.083529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d16aeadc-5a60-4c71-8951-afe0683620f7 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:49.092000 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 997/2028] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:48 2022] DELETE /identity/v3/projects/b74bc8cc72c8405a9a5b124902016aff => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:49.099472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be2239-2fd3-4844-b806-459346956ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ba9cfa3207476b81dd1988390480c7, user_id=637bd247436f468cb66232d28cae9d11, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:49.102402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be2239-2fd3-4844-b806-459346956ffb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:49.113707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82a3a4-29b2-43de-8d3a-15b12ed8aea9 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:49.113993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82a3a4-29b2-43de-8d3a-15b12ed8aea9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:49.114275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82a3a4-29b2-43de-8d3a-15b12ed8aea9 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:49.115895 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 998/2029] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:08:49.120984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82a3a4-29b2-43de-8d3a-15b12ed8aea9 None None] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:08:49.123712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2b82a3a4-29b2-43de-8d3a-15b12ed8aea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:49.244388 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1032/2030] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:49 2022] PUT /identity/v3/projects/a5ba9cfa3207476b81dd1988390480c7/users/637bd247436f468cb66232d28cae9d11/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:49.247869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be2239-2fd3-4844-b806-459346956ffb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:49.250041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f7be2239-2fd3-4844-b806-459346956ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:49.250616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82a3a4-29b2-43de-8d3a-15b12ed8aea9 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:49.253114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2b82a3a4-29b2-43de-8d3a-15b12ed8aea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:49.343234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:49.426418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be2239-2fd3-4844-b806-459346956ffb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:49.433022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351168d-842c-490e-87cb-cd6d2248fd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:49.439973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351168d-842c-490e-87cb-cd6d2248fd9e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:49.439973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351168d-842c-490e-87cb-cd6d2248fd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:49.439973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351168d-842c-490e-87cb-cd6d2248fd9e admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:49.439973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351168d-842c-490e-87cb-cd6d2248fd9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:49.439973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351168d-842c-490e-87cb-cd6d2248fd9e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:49.462702 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1033/2031] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:49.462904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82a3a4-29b2-43de-8d3a-15b12ed8aea9 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:49.464209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351168d-842c-490e-87cb-cd6d2248fd9e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:49.477511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351168d-842c-490e-87cb-cd6d2248fd9e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:49.485514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166abe62-ab97-4bcf-9545-23a62abb754a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:49.488055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166abe62-ab97-4bcf-9545-23a62abb754a admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:49.488055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166abe62-ab97-4bcf-9545-23a62abb754a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:49.488055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166abe62-ab97-4bcf-9545-23a62abb754a admin admin] PATH_INFO: `/v3/projects/a5ba9cfa3207476b81dd1988390480c7/users/637bd247436f468cb66232d28cae9d11/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:49.491296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166abe62-ab97-4bcf-9545-23a62abb754a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ba9cfa3207476b81dd1988390480c7, user_id=637bd247436f468cb66232d28cae9d11, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:49.496164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166abe62-ab97-4bcf-9545-23a62abb754a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:49.520048 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1034/2032] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:49 2022] PUT /identity/v3/projects/a5ba9cfa3207476b81dd1988390480c7/users/637bd247436f468cb66232d28cae9d11/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:49.521627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a89260-bb19-4125-af7a-296bd8a123b3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:49.521919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a89260-bb19-4125-af7a-296bd8a123b3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:49.522193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a89260-bb19-4125-af7a-296bd8a123b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:49.555695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-56a89260-bb19-4125-af7a-296bd8a123b3 None None] MFA Rules not processed for user `fbd858f3e6ba4523b056bbdc2af427b0`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:49.556942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-56a89260-bb19-4125-af7a-296bd8a123b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:49.572261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7db56-14ad-4248-962f-83eb4f9f2424 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:49.573332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7db56-14ad-4248-962f-83eb4f9f2424 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:49.573731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7db56-14ad-4248-962f-83eb4f9f2424 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:49.574115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7db56-14ad-4248-962f-83eb4f9f2424 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/projects/9dcf95f2466344d1a28724d545a8fed6` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:49.575575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7db56-14ad-4248-962f-83eb4f9f2424 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:get_project(project_id=9dcf95f2466344d1a28724d545a8fed6)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:49.577831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7db56-14ad-4248-962f-83eb4f9f2424 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:49.580410 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 999/2033] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:08:49 2022] GET /identity/v3/projects/9dcf95f2466344d1a28724d545a8fed6 => generated 373 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:08:49.620607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661548e4-6d9d-4adf-878a-80412b804875 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:49.621081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661548e4-6d9d-4adf-878a-80412b804875 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:49.621602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661548e4-6d9d-4adf-878a-80412b804875 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:49.623696 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1000/2034] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:08:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:08:49.630743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661548e4-6d9d-4adf-878a-80412b804875 None None] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:08:49.681370 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1035/2035] 10.222.0.17 () {58 vars in 1015 bytes} [Sat Jul 16 21:08:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:49.682583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a89260-bb19-4125-af7a-296bd8a123b3 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:49.685975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-56a89260-bb19-4125-af7a-296bd8a123b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:49.745714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661548e4-6d9d-4adf-878a-80412b804875 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:49.797870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a89260-bb19-4125-af7a-296bd8a123b3 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:49.804618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125e4ef-1e2c-4c95-b8fd-a591486e696c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:49.806450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125e4ef-1e2c-4c95-b8fd-a591486e696c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:49.806909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125e4ef-1e2c-4c95-b8fd-a591486e696c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:49.807620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125e4ef-1e2c-4c95-b8fd-a591486e696c admin admin] PATH_INFO: `/v3/projects/b7a826efdb624e53bfcb953efdb0b239` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:49.810420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125e4ef-1e2c-4c95-b8fd-a591486e696c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7a826efdb624e53bfcb953efdb0b239)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:49.815261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125e4ef-1e2c-4c95-b8fd-a591486e696c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:49.858960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661548e4-6d9d-4adf-878a-80412b804875 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:49.880142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6140e7-afc3-4755-8dbf-2fb3b5369ee6 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:49.889709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6140e7-afc3-4755-8dbf-2fb3b5369ee6 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:49.890671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6140e7-afc3-4755-8dbf-2fb3b5369ee6 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:49.891142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6140e7-afc3-4755-8dbf-2fb3b5369ee6 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/projects/9dcf95f2466344d1a28724d545a8fed6` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:49.895522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6140e7-afc3-4755-8dbf-2fb3b5369ee6 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:get_project(project_id=9dcf95f2466344d1a28724d545a8fed6)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:49.899793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6140e7-afc3-4755-8dbf-2fb3b5369ee6 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:49.915650 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1001/2036] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:08:49 2022] GET /identity/v3/projects/9dcf95f2466344d1a28724d545a8fed6 => generated 373 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:08:49.918975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6140e7-afc3-4755-8dbf-2fb3b5369ee6 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:49.927340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ce6140e7-afc3-4755-8dbf-2fb3b5369ee6 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:49.966961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6140e7-afc3-4755-8dbf-2fb3b5369ee6 tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:49.974056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961412ba-eaa0-4370-a4a7-72d26134bf45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:49.990322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961412ba-eaa0-4370-a4a7-72d26134bf45 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:49.992191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961412ba-eaa0-4370-a4a7-72d26134bf45 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:49.992493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961412ba-eaa0-4370-a4a7-72d26134bf45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:50.054697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961412ba-eaa0-4370-a4a7-72d26134bf45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:50.066632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9125e4ef-1e2c-4c95-b8fd-a591486e696c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7a826efdb624e53bfcb953efdb0b239', 'request_id': 'req-9125e4ef-1e2c-4c95-b8fd-a591486e696c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:50.067456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961412ba-eaa0-4370-a4a7-72d26134bf45 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:50.095632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9125e4ef-1e2c-4c95-b8fd-a591486e696c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7a826efdb624e53bfcb953efdb0b239', 'request_id': 'req-9125e4ef-1e2c-4c95-b8fd-a591486e696c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:50.101152 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1002/2037] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:50.102755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:50.113539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9125e4ef-1e2c-4c95-b8fd-a591486e696c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7a826efdb624e53bfcb953efdb0b239', 'request_id': 'req-9125e4ef-1e2c-4c95-b8fd-a591486e696c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:50.200298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9125e4ef-1e2c-4c95-b8fd-a591486e696c admin admin] The token cache is being invalidate because project b7a826efdb624e53bfcb953efdb0b239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:50.201236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9125e4ef-1e2c-4c95-b8fd-a591486e696c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:50.202555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9125e4ef-1e2c-4c95-b8fd-a591486e696c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:50.206657 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1036/2038] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:49 2022] DELETE /identity/v3/projects/b7a826efdb624e53bfcb953efdb0b239 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:50.212418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0d17f-1ce0-4f50-ab60-8f78891256f1 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:50.212891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0d17f-1ce0-4f50-ab60-8f78891256f1 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:50.213562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0d17f-1ce0-4f50-ab60-8f78891256f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:50.246741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-64c0d17f-1ce0-4f50-ab60-8f78891256f1 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:50.249808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-64c0d17f-1ce0-4f50-ab60-8f78891256f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:50.444479 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1003/2039] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:50.467785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a8162-c272-4ed6-b17f-012818ea5b92 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:50.468433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a8162-c272-4ed6-b17f-012818ea5b92 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:50.468826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a8162-c272-4ed6-b17f-012818ea5b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:50.513422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f79a8162-c272-4ed6-b17f-012818ea5b92 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:50.514683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f79a8162-c272-4ed6-b17f-012818ea5b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:50.551443 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1037/2040] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:50.555313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0d17f-1ce0-4f50-ab60-8f78891256f1 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:50.567314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0d17f-1ce0-4f50-ab60-8f78891256f1 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:50.574762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce71111-a5f2-4918-bffd-0b655862e551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:50.576089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce71111-a5f2-4918-bffd-0b655862e551 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:50.576573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce71111-a5f2-4918-bffd-0b655862e551 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:50.579829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce71111-a5f2-4918-bffd-0b655862e551 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:50.579829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce71111-a5f2-4918-bffd-0b655862e551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:08:50.579829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce71111-a5f2-4918-bffd-0b655862e551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:50.581450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce71111-a5f2-4918-bffd-0b655862e551 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:50.608901 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1004/2041] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:08:50.613549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a8162-c272-4ed6-b17f-012818ea5b92 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:50.623955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a8162-c272-4ed6-b17f-012818ea5b92 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:50.629742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280b572-cde6-4996-9e0e-f70500a6a550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:50.630424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280b572-cde6-4996-9e0e-f70500a6a550 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:50.630706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280b572-cde6-4996-9e0e-f70500a6a550 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:50.630984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280b572-cde6-4996-9e0e-f70500a6a550 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:50.631828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280b572-cde6-4996-9e0e-f70500a6a550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:50.633836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280b572-cde6-4996-9e0e-f70500a6a550 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:50.739750 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1038/2042] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:50 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:50.740093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce71111-a5f2-4918-bffd-0b655862e551 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:50.752487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce71111-a5f2-4918-bffd-0b655862e551 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:50.944412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b553d-9d9b-4047-8a64-1a7b2ce5b2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:50.945166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b553d-9d9b-4047-8a64-1a7b2ce5b2cb admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:50.945455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b553d-9d9b-4047-8a64-1a7b2ce5b2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:50.945728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b553d-9d9b-4047-8a64-1a7b2ce5b2cb admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:50.959750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b553d-9d9b-4047-8a64-1a7b2ce5b2cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:50.962290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b553d-9d9b-4047-8a64-1a7b2ce5b2cb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:51.114645 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1005/2043] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:50 2022] POST /identity/v3/users => generated 292 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:08:51.131119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280b572-cde6-4996-9e0e-f70500a6a550 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:51.144473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280b572-cde6-4996-9e0e-f70500a6a550 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:51.152431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0394e67-1c45-421c-a49a-14f7d56f3080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:51.153182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0394e67-1c45-421c-a49a-14f7d56f3080 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:51.153467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0394e67-1c45-421c-a49a-14f7d56f3080 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:51.154420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0394e67-1c45-421c-a49a-14f7d56f3080 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:51.173166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0394e67-1c45-421c-a49a-14f7d56f3080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:51.175720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0394e67-1c45-421c-a49a-14f7d56f3080 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:51.198708 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1039/2044] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:51.203425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b553d-9d9b-4047-8a64-1a7b2ce5b2cb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:51.221911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b553d-9d9b-4047-8a64-1a7b2ce5b2cb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:51.228700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b436067-9b76-4050-9632-260552e37d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:51.230422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b436067-9b76-4050-9632-260552e37d03 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:51.230720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b436067-9b76-4050-9632-260552e37d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:51.231028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b436067-9b76-4050-9632-260552e37d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:51.231923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b436067-9b76-4050-9632-260552e37d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:51.234275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b436067-9b76-4050-9632-260552e37d03 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:51.275884 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1006/2045] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:51.278808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0394e67-1c45-421c-a49a-14f7d56f3080 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:51.297737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0394e67-1c45-421c-a49a-14f7d56f3080 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:51.306594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01f544-f46d-469f-89df-b3399c6d0a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:51.307801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01f544-f46d-469f-89df-b3399c6d0a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:51.308231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01f544-f46d-469f-89df-b3399c6d0a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:51.308648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01f544-f46d-469f-89df-b3399c6d0a07 admin admin] PATH_INFO: `/v3/projects/7130ea0ca0fa45598a4ae811f9e57c1b/users/68e0ace7431547d3be79364653a690f6/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:51.334986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01f544-f46d-469f-89df-b3399c6d0a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7130ea0ca0fa45598a4ae811f9e57c1b, user_id=68e0ace7431547d3be79364653a690f6, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:51.338165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01f544-f46d-469f-89df-b3399c6d0a07 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:51.442304 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1040/2046] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:51 2022] PUT /identity/v3/projects/7130ea0ca0fa45598a4ae811f9e57c1b/users/68e0ace7431547d3be79364653a690f6/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:51.453489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969af16-ee29-4902-8b3f-f11687c1dd16 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:51.453782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969af16-ee29-4902-8b3f-f11687c1dd16 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:51.454071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969af16-ee29-4902-8b3f-f11687c1dd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:51.558177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f969af16-ee29-4902-8b3f-f11687c1dd16 None None] MFA Rules not processed for user `68e0ace7431547d3be79364653a690f6`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:51.559907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f969af16-ee29-4902-8b3f-f11687c1dd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:51.677194 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1007/2047] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:51.681919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01f544-f46d-469f-89df-b3399c6d0a07 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:51.752307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a24d9-9063-4e9b-bf2d-6c586d9307d4 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:51.753073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a24d9-9063-4e9b-bf2d-6c586d9307d4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:51.754784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a24d9-9063-4e9b-bf2d-6c586d9307d4 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:51.756701 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1008/2048] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:08:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 21:08:51.763038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a24d9-9063-4e9b-bf2d-6c586d9307d4 None None] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:08:51.766383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-367a24d9-9063-4e9b-bf2d-6c586d9307d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:51.800919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01f544-f46d-469f-89df-b3399c6d0a07 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:51.818150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03916f7c-1eff-4c42-8281-0d4d380d63a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:51.818918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03916f7c-1eff-4c42-8281-0d4d380d63a8 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:51.819224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03916f7c-1eff-4c42-8281-0d4d380d63a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:51.819502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03916f7c-1eff-4c42-8281-0d4d380d63a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:51.820251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03916f7c-1eff-4c42-8281-0d4d380d63a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:51.822262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03916f7c-1eff-4c42-8281-0d4d380d63a8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:51.829091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:51.922405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a24d9-9063-4e9b-bf2d-6c586d9307d4 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:51.924699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-367a24d9-9063-4e9b-bf2d-6c586d9307d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:51.956956 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1041/2049] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:08:51 2022] POST /identity/v3/projects => generated 381 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:08:51.961130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03916f7c-1eff-4c42-8281-0d4d380d63a8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:52.061327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a24d9-9063-4e9b-bf2d-6c586d9307d4 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:52.070149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03916f7c-1eff-4c42-8281-0d4d380d63a8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:52.078550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd717677-4bd6-4d2b-9538-b7ce0f288cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:52.081998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd717677-4bd6-4d2b-9538-b7ce0f288cde admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:52.082388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd717677-4bd6-4d2b-9538-b7ce0f288cde admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:52.082673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd717677-4bd6-4d2b-9538-b7ce0f288cde admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:52.083703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd717677-4bd6-4d2b-9538-b7ce0f288cde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:52.086375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd717677-4bd6-4d2b-9538-b7ce0f288cde admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:52.208429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f9756-22c3-4808-a643-4a0ce76bbdfd tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88106ab3700141c59577d36de8956a96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8650a799d2e4d6885ebc9a41a041103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:52.208792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f9756-22c3-4808-a643-4a0ce76bbdfd tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:52.209080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f9756-22c3-4808-a643-4a0ce76bbdfd tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:52.209396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f9756-22c3-4808-a643-4a0ce76bbdfd tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] PATH_INFO: `/v3/projects/9dcf95f2466344d1a28724d545a8fed6` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:52.210806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f9756-22c3-4808-a643-4a0ce76bbdfd tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorizing `identity:get_project(project_id=9dcf95f2466344d1a28724d545a8fed6)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:52.212948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f9756-22c3-4808-a643-4a0ce76bbdfd tempest-QuotasAdminTestJSON-972835255 tempest-QuotasAdminTestJSON-972835255-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:52.215155 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1009/2050] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:08:51 2022] GET /identity/v3/projects/9dcf95f2466344d1a28724d545a8fed6 => generated 373 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:08:52.216436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47187125-0247-4473-a8b5-0b8cf18abf55 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:52.216704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47187125-0247-4473-a8b5-0b8cf18abf55 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:52.216978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47187125-0247-4473-a8b5-0b8cf18abf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:52.250506 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1042/2051] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:08:51 2022] POST /identity/v3/users => generated 297 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:08:52.254106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd717677-4bd6-4d2b-9538-b7ce0f288cde admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:52.263863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-47187125-0247-4473-a8b5-0b8cf18abf55 None None] MFA Rules not processed for user `ef9cbce2b2e64665b7f50767342dcb46`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:52.265093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-47187125-0247-4473-a8b5-0b8cf18abf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:52.280012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd717677-4bd6-4d2b-9538-b7ce0f288cde admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:52.291463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ae6b9-e975-43f4-8a20-564db9d0a530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:52.293223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ae6b9-e975-43f4-8a20-564db9d0a530 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:52.293949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ae6b9-e975-43f4-8a20-564db9d0a530 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:52.294574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ae6b9-e975-43f4-8a20-564db9d0a530 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:52.295724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ae6b9-e975-43f4-8a20-564db9d0a530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:52.298054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ae6b9-e975-43f4-8a20-564db9d0a530 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:52.335248 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1043/2052] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:52.337182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ae6b9-e975-43f4-8a20-564db9d0a530 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:52.365910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ae6b9-e975-43f4-8a20-564db9d0a530 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:52.372369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18075b1-0212-47e0-9c59-ab569a39a813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:52.373868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18075b1-0212-47e0-9c59-ab569a39a813 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:52.374296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18075b1-0212-47e0-9c59-ab569a39a813 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:52.374666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18075b1-0212-47e0-9c59-ab569a39a813 admin admin] PATH_INFO: `/v3/projects/1cdd126dd3f048648a7b6612829d4db7/users/0cadd8cf351b44c8807de8413add6a8e/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:52.405971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18075b1-0212-47e0-9c59-ab569a39a813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cdd126dd3f048648a7b6612829d4db7, user_id=0cadd8cf351b44c8807de8413add6a8e, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:52.410300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18075b1-0212-47e0-9c59-ab569a39a813 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:52.435677 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1010/2053] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:52.565511 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1044/2054] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:52 2022] PUT /identity/v3/projects/1cdd126dd3f048648a7b6612829d4db7/users/0cadd8cf351b44c8807de8413add6a8e/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:52.570010 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47187125-0247-4473-a8b5-0b8cf18abf55 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:52.588599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47187125-0247-4473-a8b5-0b8cf18abf55 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:52.733942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c497c71-410d-4e84-bc52-b3969cebdae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:52.734736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c497c71-410d-4e84-bc52-b3969cebdae8 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:52.739125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c497c71-410d-4e84-bc52-b3969cebdae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:52.739125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c497c71-410d-4e84-bc52-b3969cebdae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:52.739477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c497c71-410d-4e84-bc52-b3969cebdae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:52.742485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c497c71-410d-4e84-bc52-b3969cebdae8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:52.784059 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1011/2055] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:08:52.784905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18075b1-0212-47e0-9c59-ab569a39a813 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:52.821893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18075b1-0212-47e0-9c59-ab569a39a813 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:52.852448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747ec6b-94c0-41df-a09b-8cb62c1d434c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:52.875328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747ec6b-94c0-41df-a09b-8cb62c1d434c admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:52.879685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747ec6b-94c0-41df-a09b-8cb62c1d434c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:52.879685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747ec6b-94c0-41df-a09b-8cb62c1d434c admin admin] PATH_INFO: `/v3/projects/1cdd126dd3f048648a7b6612829d4db7/users/0cadd8cf351b44c8807de8413add6a8e/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:52.894135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747ec6b-94c0-41df-a09b-8cb62c1d434c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cdd126dd3f048648a7b6612829d4db7, user_id=0cadd8cf351b44c8807de8413add6a8e, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:52.914619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747ec6b-94c0-41df-a09b-8cb62c1d434c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:53.020270 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1045/2056] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:08:52 2022] PUT /identity/v3/projects/1cdd126dd3f048648a7b6612829d4db7/users/0cadd8cf351b44c8807de8413add6a8e/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:53.021428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4fd23-e8be-4daa-adbc-371e41b28a21 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:53.022303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4fd23-e8be-4daa-adbc-371e41b28a21 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:53.022583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4fd23-e8be-4daa-adbc-371e41b28a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:53.080787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-79b4fd23-e8be-4daa-adbc-371e41b28a21 None None] MFA Rules not processed for user `0cadd8cf351b44c8807de8413add6a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:53.082016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-79b4fd23-e8be-4daa-adbc-371e41b28a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:53.335592 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1012/2057] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:53.707080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:54.388837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:54.563670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3855529-45ed-4a65-95e3-5943957724ca None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:54.565108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3855529-45ed-4a65-95e3-5943957724ca None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:54.566072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3855529-45ed-4a65-95e3-5943957724ca None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:54.568218 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1046/2058] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:08:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:08:54.584774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a6346-1727-48ef-9abe-f4de731dbbd6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:54.585258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a6346-1727-48ef-9abe-f4de731dbbd6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:54.585377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a6346-1727-48ef-9abe-f4de731dbbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:54.684056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b51a6346-1727-48ef-9abe-f4de731dbbd6 None None] MFA Rules not processed for user `fbd858f3e6ba4523b056bbdc2af427b0`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:54.691721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b51a6346-1727-48ef-9abe-f4de731dbbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:54.838660 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1013/2059] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:08:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:54.891570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3855529-45ed-4a65-95e3-5943957724ca None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:54.894824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c3855529-45ed-4a65-95e3-5943957724ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:54.942238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3855529-45ed-4a65-95e3-5943957724ca None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:54.950232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba8561-d49c-4b83-928c-d83a0a9ea521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:54.953175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba8561-d49c-4b83-928c-d83a0a9ea521 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:54.953723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba8561-d49c-4b83-928c-d83a0a9ea521 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:54.954228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba8561-d49c-4b83-928c-d83a0a9ea521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:54.957578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a6346-1727-48ef-9abe-f4de731dbbd6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:54.976450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b51a6346-1727-48ef-9abe-f4de731dbbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:54.976607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba8561-d49c-4b83-928c-d83a0a9ea521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:54.980179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba8561-d49c-4b83-928c-d83a0a9ea521 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:55.007412 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1047/2060] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:55.107786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a6346-1727-48ef-9abe-f4de731dbbd6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:55.114634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86cc0d-de5b-4d3e-bd19-d07ae7b44732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:55.115835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86cc0d-de5b-4d3e-bd19-d07ae7b44732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:55.116201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86cc0d-de5b-4d3e-bd19-d07ae7b44732 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:55.116580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86cc0d-de5b-4d3e-bd19-d07ae7b44732 admin admin] PATH_INFO: `/v3/users/2b750f4a86974b8189ab99143131b1cd` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:55.118761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86cc0d-de5b-4d3e-bd19-d07ae7b44732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b750f4a86974b8189ab99143131b1cd)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:55.121272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86cc0d-de5b-4d3e-bd19-d07ae7b44732 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:55.382711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1d86cc0d-de5b-4d3e-bd19-d07ae7b44732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b750f4a86974b8189ab99143131b1cd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:55.455951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1d86cc0d-de5b-4d3e-bd19-d07ae7b44732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b750f4a86974b8189ab99143131b1cd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:55.550197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1d86cc0d-de5b-4d3e-bd19-d07ae7b44732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b750f4a86974b8189ab99143131b1cd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:55.566138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1d86cc0d-de5b-4d3e-bd19-d07ae7b44732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b750f4a86974b8189ab99143131b1cd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:55.567487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1d86cc0d-de5b-4d3e-bd19-d07ae7b44732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b750f4a86974b8189ab99143131b1cd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:55.593976 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1014/2061] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:54 2022] DELETE /identity/v3/users/2b750f4a86974b8189ab99143131b1cd => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:55.599833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d2318-6a65-470c-85c6-3bf97d3b0d52 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:55.600672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d2318-6a65-470c-85c6-3bf97d3b0d52 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:55.601117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d2318-6a65-470c-85c6-3bf97d3b0d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:55.632401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-dc8d2318-6a65-470c-85c6-3bf97d3b0d52 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:55.637688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dc8d2318-6a65-470c-85c6-3bf97d3b0d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:55.737274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86cc0d-de5b-4d3e-bd19-d07ae7b44732 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:55.738720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1d86cc0d-de5b-4d3e-bd19-d07ae7b44732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:55.755977 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1048/2062] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:55.772180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d2318-6a65-470c-85c6-3bf97d3b0d52 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:55.774670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dc8d2318-6a65-470c-85c6-3bf97d3b0d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:55.928858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86cc0d-de5b-4d3e-bd19-d07ae7b44732 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:55.936657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf0dbc-29a0-4ee6-9c4d-dfc6a88b3ce6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:55.937472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf0dbc-29a0-4ee6-9c4d-dfc6a88b3ce6 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:55.937885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf0dbc-29a0-4ee6-9c4d-dfc6a88b3ce6 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:55.938479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf0dbc-29a0-4ee6-9c4d-dfc6a88b3ce6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:55.945525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d2318-6a65-470c-85c6-3bf97d3b0d52 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:55.947215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-24bf0dbc-29a0-4ee6-9c4d-dfc6a88b3ce6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:55.955660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cab13-95a4-4e14-8822-d5e32a60d7c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:55.956462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cab13-95a4-4e14-8822-d5e32a60d7c0 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:55.956751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cab13-95a4-4e14-8822-d5e32a60d7c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:55.957028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cab13-95a4-4e14-8822-d5e32a60d7c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:55.981651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6cab13-95a4-4e14-8822-d5e32a60d7c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:55.981651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6cab13-95a4-4e14-8822-d5e32a60d7c0 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:56.026151 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1049/2063] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:56.175268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf0dbc-29a0-4ee6-9c4d-dfc6a88b3ce6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:56.176928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf0dbc-29a0-4ee6-9c4d-dfc6a88b3ce6 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:56.210813 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1015/2064] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:08:56.441016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:56.463795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cab13-95a4-4e14-8822-d5e32a60d7c0 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:56.465819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-eb6cab13-95a4-4e14-8822-d5e32a60d7c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:56.485697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cab13-95a4-4e14-8822-d5e32a60d7c0 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:56.491023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a02728-d974-45c6-a280-4cb7757f7979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:56.492056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a02728-d974-45c6-a280-4cb7757f7979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:56.492454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a02728-d974-45c6-a280-4cb7757f7979 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:56.492825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a02728-d974-45c6-a280-4cb7757f7979 admin admin] PATH_INFO: `/v3/users/68e0ace7431547d3be79364653a690f6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:56.494211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a02728-d974-45c6-a280-4cb7757f7979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68e0ace7431547d3be79364653a690f6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:56.497125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a02728-d974-45c6-a280-4cb7757f7979 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:56.856994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e9a02728-d974-45c6-a280-4cb7757f7979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68e0ace7431547d3be79364653a690f6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:56.885940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e9a02728-d974-45c6-a280-4cb7757f7979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68e0ace7431547d3be79364653a690f6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:56.988370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e9a02728-d974-45c6-a280-4cb7757f7979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68e0ace7431547d3be79364653a690f6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:56.989754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e9a02728-d974-45c6-a280-4cb7757f7979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68e0ace7431547d3be79364653a690f6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:57.028175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e9a02728-d974-45c6-a280-4cb7757f7979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68e0ace7431547d3be79364653a690f6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:57.063748 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1050/2065] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:56 2022] DELETE /identity/v3/users/68e0ace7431547d3be79364653a690f6 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:57.069318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22716b-db63-4fea-86a5-9cd96ada0f6a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:57.069802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22716b-db63-4fea-86a5-9cd96ada0f6a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:57.069899 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22716b-db63-4fea-86a5-9cd96ada0f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:57.101394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7b22716b-db63-4fea-86a5-9cd96ada0f6a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:57.104227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7b22716b-db63-4fea-86a5-9cd96ada0f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:57.255969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:08:57.271977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a02728-d974-45c6-a280-4cb7757f7979 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:57.273834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e9a02728-d974-45c6-a280-4cb7757f7979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:57.308216 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1016/2066] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:08:57.320996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22716b-db63-4fea-86a5-9cd96ada0f6a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:57.325890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7b22716b-db63-4fea-86a5-9cd96ada0f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:57.482183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a02728-d974-45c6-a280-4cb7757f7979 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:57.501927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403e087-4712-429a-a572-78da411eeff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:57.502797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403e087-4712-429a-a572-78da411eeff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:57.503105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403e087-4712-429a-a572-78da411eeff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:57.503419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403e087-4712-429a-a572-78da411eeff4 admin admin] PATH_INFO: `/v3/projects/9dcf95f2466344d1a28724d545a8fed6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:57.505137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22716b-db63-4fea-86a5-9cd96ada0f6a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:57.516506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403e087-4712-429a-a572-78da411eeff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dcf95f2466344d1a28724d545a8fed6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:57.522487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403e087-4712-429a-a572-78da411eeff4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:57.524886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ccc12-6d04-46ba-b944-856879c2254c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:57.525587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ccc12-6d04-46ba-b944-856879c2254c service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:57.525872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ccc12-6d04-46ba-b944-856879c2254c service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:57.526147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ccc12-6d04-46ba-b944-856879c2254c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:57.556070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ccc12-6d04-46ba-b944-856879c2254c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:57.556070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ccc12-6d04-46ba-b944-856879c2254c service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:57.585121 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1017/2067] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:08:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:08:57.728651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f403e087-4712-429a-a572-78da411eeff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dcf95f2466344d1a28724d545a8fed6', 'request_id': 'req-f403e087-4712-429a-a572-78da411eeff4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:57.739890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f403e087-4712-429a-a572-78da411eeff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dcf95f2466344d1a28724d545a8fed6', 'request_id': 'req-f403e087-4712-429a-a572-78da411eeff4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:57.747852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f403e087-4712-429a-a572-78da411eeff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dcf95f2466344d1a28724d545a8fed6', 'request_id': 'req-f403e087-4712-429a-a572-78da411eeff4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:57.837339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f403e087-4712-429a-a572-78da411eeff4 admin admin] The token cache is being invalidate because project 9dcf95f2466344d1a28724d545a8fed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:57.837667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f403e087-4712-429a-a572-78da411eeff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:57.859577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f403e087-4712-429a-a572-78da411eeff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:57.871178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ccc12-6d04-46ba-b944-856879c2254c service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:57.877557 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1051/2068] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:57 2022] DELETE /identity/v3/projects/9dcf95f2466344d1a28724d545a8fed6 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:57.885816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ccc12-6d04-46ba-b944-856879c2254c service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:58.006954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f7540-a1ed-4449-8402-18a618d8d3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:58.009643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f7540-a1ed-4449-8402-18a618d8d3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:58.014433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f7540-a1ed-4449-8402-18a618d8d3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:58.014433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f7540-a1ed-4449-8402-18a618d8d3d0 admin admin] PATH_INFO: `/v3/users/88106ab3700141c59577d36de8956a96` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:58.014433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f7540-a1ed-4449-8402-18a618d8d3d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88106ab3700141c59577d36de8956a96)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:58.015835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f7540-a1ed-4449-8402-18a618d8d3d0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:58.368897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ef3f7540-a1ed-4449-8402-18a618d8d3d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88106ab3700141c59577d36de8956a96'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:58.394113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ef3f7540-a1ed-4449-8402-18a618d8d3d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88106ab3700141c59577d36de8956a96'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:58.521712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ef3f7540-a1ed-4449-8402-18a618d8d3d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88106ab3700141c59577d36de8956a96'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:58.535268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ef3f7540-a1ed-4449-8402-18a618d8d3d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88106ab3700141c59577d36de8956a96'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:58.536227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ef3f7540-a1ed-4449-8402-18a618d8d3d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88106ab3700141c59577d36de8956a96'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:58.548579 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1018/2069] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:57 2022] DELETE /identity/v3/users/88106ab3700141c59577d36de8956a96 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:59.057252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403e087-4712-429a-a572-78da411eeff4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:59.065693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f403e087-4712-429a-a572-78da411eeff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:59.122583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403e087-4712-429a-a572-78da411eeff4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:59.289079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8f666-91fe-467a-b597-a78be0295fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:59.290784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8f666-91fe-467a-b597-a78be0295fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:59.291383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8f666-91fe-467a-b597-a78be0295fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:59.291840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8f666-91fe-467a-b597-a78be0295fa8 admin admin] PATH_INFO: `/v3/projects/7130ea0ca0fa45598a4ae811f9e57c1b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:59.293541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8f666-91fe-467a-b597-a78be0295fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7130ea0ca0fa45598a4ae811f9e57c1b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:59.296905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8f666-91fe-467a-b597-a78be0295fa8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:59.509578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4ff8f666-91fe-467a-b597-a78be0295fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7130ea0ca0fa45598a4ae811f9e57c1b', 'request_id': 'req-4ff8f666-91fe-467a-b597-a78be0295fa8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:59.519356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4ff8f666-91fe-467a-b597-a78be0295fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7130ea0ca0fa45598a4ae811f9e57c1b', 'request_id': 'req-4ff8f666-91fe-467a-b597-a78be0295fa8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:59.531306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4ff8f666-91fe-467a-b597-a78be0295fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7130ea0ca0fa45598a4ae811f9e57c1b', 'request_id': 'req-4ff8f666-91fe-467a-b597-a78be0295fa8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:59.535902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a030c-cda3-462f-a247-c6dcd019fd1b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:59.536426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a030c-cda3-462f-a247-c6dcd019fd1b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:59.536504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a030c-cda3-462f-a247-c6dcd019fd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:59.576420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-be4a030c-cda3-462f-a247-c6dcd019fd1b None None] MFA Rules not processed for user `637bd247436f468cb66232d28cae9d11`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:08:59.578639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-be4a030c-cda3-462f-a247-c6dcd019fd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:59.620889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4ff8f666-91fe-467a-b597-a78be0295fa8 admin admin] The token cache is being invalidate because project 7130ea0ca0fa45598a4ae811f9e57c1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:08:59.621329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4ff8f666-91fe-467a-b597-a78be0295fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:59.622746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4ff8f666-91fe-467a-b597-a78be0295fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:08:59.625475 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1052/2070] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:08:59 2022] DELETE /identity/v3/projects/7130ea0ca0fa45598a4ae811f9e57c1b => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:08:59.638858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8f666-91fe-467a-b597-a78be0295fa8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:08:59.640331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4ff8f666-91fe-467a-b597-a78be0295fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:08:59.730456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8f666-91fe-467a-b597-a78be0295fa8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:08:59.736681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ec9e8-1fc4-4d56-886c-e782d7817257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:08:59.737830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ec9e8-1fc4-4d56-886c-e782d7817257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:08:59.738364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ec9e8-1fc4-4d56-886c-e782d7817257 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:08:59.738859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ec9e8-1fc4-4d56-886c-e782d7817257 admin admin] PATH_INFO: `/v3/users/0cadd8cf351b44c8807de8413add6a8e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:08:59.740594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ec9e8-1fc4-4d56-886c-e782d7817257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cadd8cf351b44c8807de8413add6a8e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:08:59.743411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ec9e8-1fc4-4d56-886c-e782d7817257 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:08:59.743882 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1019/2071] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:08:59 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:00.027714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-690ec9e8-1fc4-4d56-886c-e782d7817257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cadd8cf351b44c8807de8413add6a8e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:00.045474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-690ec9e8-1fc4-4d56-886c-e782d7817257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cadd8cf351b44c8807de8413add6a8e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:00.057670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:00.171619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-690ec9e8-1fc4-4d56-886c-e782d7817257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cadd8cf351b44c8807de8413add6a8e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:00.172477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-690ec9e8-1fc4-4d56-886c-e782d7817257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cadd8cf351b44c8807de8413add6a8e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:00.230696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-690ec9e8-1fc4-4d56-886c-e782d7817257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cadd8cf351b44c8807de8413add6a8e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:00.240767 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1053/2072] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:08:59 2022] DELETE /identity/v3/users/0cadd8cf351b44c8807de8413add6a8e => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:00.926464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:00.959507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a030c-cda3-462f-a247-c6dcd019fd1b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:00.963276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-be4a030c-cda3-462f-a247-c6dcd019fd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:00.996471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a030c-cda3-462f-a247-c6dcd019fd1b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:01.155045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6fd20-15df-411f-9468-d633361089e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:01.156330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6fd20-15df-411f-9468-d633361089e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:01.156620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6fd20-15df-411f-9468-d633361089e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:01.157203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6fd20-15df-411f-9468-d633361089e8 admin admin] PATH_INFO: `/v3/projects/b8650a799d2e4d6885ebc9a41a041103` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:01.159564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6fd20-15df-411f-9468-d633361089e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8650a799d2e4d6885ebc9a41a041103)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:01.164999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6fd20-15df-411f-9468-d633361089e8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:01.397035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aac6fd20-15df-411f-9468-d633361089e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8650a799d2e4d6885ebc9a41a041103', 'request_id': 'req-aac6fd20-15df-411f-9468-d633361089e8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:01.411410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aac6fd20-15df-411f-9468-d633361089e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8650a799d2e4d6885ebc9a41a041103', 'request_id': 'req-aac6fd20-15df-411f-9468-d633361089e8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:01.432820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aac6fd20-15df-411f-9468-d633361089e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8650a799d2e4d6885ebc9a41a041103', 'request_id': 'req-aac6fd20-15df-411f-9468-d633361089e8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:01.979348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aac6fd20-15df-411f-9468-d633361089e8 admin admin] The token cache is being invalidate because project b8650a799d2e4d6885ebc9a41a041103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:01.979348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aac6fd20-15df-411f-9468-d633361089e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:01.981526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aac6fd20-15df-411f-9468-d633361089e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:01.983640 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1020/2073] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:00 2022] DELETE /identity/v3/projects/b8650a799d2e4d6885ebc9a41a041103 => generated 0 bytes in 1024 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:01.990273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d3b10-f0c4-4037-8baf-e8218d85debd None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:01.990942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d3b10-f0c4-4037-8baf-e8218d85debd None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:01.992114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d3b10-f0c4-4037-8baf-e8218d85debd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:02.049291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-782d3b10-f0c4-4037-8baf-e8218d85debd None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:02.054492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-782d3b10-f0c4-4037-8baf-e8218d85debd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:02.332543 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1054/2074] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:02.341643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12244850-a6f5-4891-a197-f22807049e0e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:02.342315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12244850-a6f5-4891-a197-f22807049e0e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:02.343413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12244850-a6f5-4891-a197-f22807049e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:02.357408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d3b10-f0c4-4037-8baf-e8218d85debd None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:02.359112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-782d3b10-f0c4-4037-8baf-e8218d85debd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:02.377136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-12244850-a6f5-4891-a197-f22807049e0e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:02.380666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-12244850-a6f5-4891-a197-f22807049e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:02.381985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d3b10-f0c4-4037-8baf-e8218d85debd None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:02.398985 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1021/2075] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:02.401017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12244850-a6f5-4891-a197-f22807049e0e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:02.409535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f74c8-4d8b-4fb4-979c-a5d50aab7aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:02.411798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f74c8-4d8b-4fb4-979c-a5d50aab7aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:02.412074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f74c8-4d8b-4fb4-979c-a5d50aab7aee admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:02.415239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f74c8-4d8b-4fb4-979c-a5d50aab7aee admin admin] PATH_INFO: `/v3/projects/1cdd126dd3f048648a7b6612829d4db7` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:02.423090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f74c8-4d8b-4fb4-979c-a5d50aab7aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cdd126dd3f048648a7b6612829d4db7)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:02.425457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12244850-a6f5-4891-a197-f22807049e0e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:02.437305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f74c8-4d8b-4fb4-979c-a5d50aab7aee admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:02.445538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1547bd-e4fe-40ad-9350-6c5bfeaea7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:02.446591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1547bd-e4fe-40ad-9350-6c5bfeaea7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:02.447252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1547bd-e4fe-40ad-9350-6c5bfeaea7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:02.447907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1547bd-e4fe-40ad-9350-6c5bfeaea7e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:02.450182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1547bd-e4fe-40ad-9350-6c5bfeaea7e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:09:02.453555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1547bd-e4fe-40ad-9350-6c5bfeaea7e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:02.470182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1547bd-e4fe-40ad-9350-6c5bfeaea7e6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:02.526001 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1022/2076] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:09:02.530635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1547bd-e4fe-40ad-9350-6c5bfeaea7e6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:02.551709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1547bd-e4fe-40ad-9350-6c5bfeaea7e6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:02.560242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:02.561114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d1868-a4e1-4036-8d79-7b591b73c883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:02.562171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d1868-a4e1-4036-8d79-7b591b73c883 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:02.562911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d1868-a4e1-4036-8d79-7b591b73c883 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:02.564290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d1868-a4e1-4036-8d79-7b591b73c883 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:02.565779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d1868-a4e1-4036-8d79-7b591b73c883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:02.569100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d1868-a4e1-4036-8d79-7b591b73c883 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:02.727095 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1023/2077] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:02 2022] POST /identity/v3/projects => generated 383 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:02.728240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-148f74c8-4d8b-4fb4-979c-a5d50aab7aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cdd126dd3f048648a7b6612829d4db7', 'request_id': 'req-148f74c8-4d8b-4fb4-979c-a5d50aab7aee'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:02.735398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d1868-a4e1-4036-8d79-7b591b73c883 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:02.749838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-148f74c8-4d8b-4fb4-979c-a5d50aab7aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cdd126dd3f048648a7b6612829d4db7', 'request_id': 'req-148f74c8-4d8b-4fb4-979c-a5d50aab7aee'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:02.761848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-148f74c8-4d8b-4fb4-979c-a5d50aab7aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cdd126dd3f048648a7b6612829d4db7', 'request_id': 'req-148f74c8-4d8b-4fb4-979c-a5d50aab7aee'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:02.905861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-148f74c8-4d8b-4fb4-979c-a5d50aab7aee admin admin] The token cache is being invalidate because project 1cdd126dd3f048648a7b6612829d4db7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:02.906147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-148f74c8-4d8b-4fb4-979c-a5d50aab7aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:02.907120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-148f74c8-4d8b-4fb4-979c-a5d50aab7aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:02.913490 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1055/2078] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:02 2022] DELETE /identity/v3/projects/1cdd126dd3f048648a7b6612829d4db7 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:09:02.921908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3e6e8-5d05-47a3-b139-a4fab098a2de None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:02.925557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3e6e8-5d05-47a3-b139-a4fab098a2de None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:02.929825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3e6e8-5d05-47a3-b139-a4fab098a2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:02.966461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d1868-a4e1-4036-8d79-7b591b73c883 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:03.005014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584035fc-34fd-4546-b83b-75f5f48315b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:03.005731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584035fc-34fd-4546-b83b-75f5f48315b1 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:03.005981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584035fc-34fd-4546-b83b-75f5f48315b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:03.013581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584035fc-34fd-4546-b83b-75f5f48315b1 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:03.017567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b7c3e6e8-5d05-47a3-b139-a4fab098a2de None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:03.019102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584035fc-34fd-4546-b83b-75f5f48315b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:03.026904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b7c3e6e8-5d05-47a3-b139-a4fab098a2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:03.031374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584035fc-34fd-4546-b83b-75f5f48315b1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:03.056626 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1056/2079] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:03.061724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a807d-d70a-4375-9912-c1c8fbbef5e1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:03.064829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a807d-d70a-4375-9912-c1c8fbbef5e1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:03.065373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a807d-d70a-4375-9912-c1c8fbbef5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:03.110100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a52a807d-d70a-4375-9912-c1c8fbbef5e1 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:03.111915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a52a807d-d70a-4375-9912-c1c8fbbef5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:03.147136 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1057/2080] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:03.151735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a807d-d70a-4375-9912-c1c8fbbef5e1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:03.169283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a807d-d70a-4375-9912-c1c8fbbef5e1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:03.178647 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1024/2081] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:02 2022] POST /identity/v3/users => generated 292 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:03.183566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584035fc-34fd-4546-b83b-75f5f48315b1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:03.190156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-584035fc-34fd-4546-b83b-75f5f48315b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:03.211448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96832000-2e02-4bf1-a589-3f538e664590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:03.212782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96832000-2e02-4bf1-a589-3f538e664590 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:03.213064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96832000-2e02-4bf1-a589-3f538e664590 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:03.213345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96832000-2e02-4bf1-a589-3f538e664590 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:03.214080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96832000-2e02-4bf1-a589-3f538e664590 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:09:03.214384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96832000-2e02-4bf1-a589-3f538e664590 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:03.225504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96832000-2e02-4bf1-a589-3f538e664590 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:03.241392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584035fc-34fd-4546-b83b-75f5f48315b1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:03.263769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03416cc1-6a26-46a4-803c-1a57ee3d7d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:03.264468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03416cc1-6a26-46a4-803c-1a57ee3d7d42 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:03.264753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03416cc1-6a26-46a4-803c-1a57ee3d7d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:03.265028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03416cc1-6a26-46a4-803c-1a57ee3d7d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:03.265777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03416cc1-6a26-46a4-803c-1a57ee3d7d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:03.273599 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1058/2082] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:09:03.278068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96832000-2e02-4bf1-a589-3f538e664590 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:03.278892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03416cc1-6a26-46a4-803c-1a57ee3d7d42 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:03.311024 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1025/2083] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:03.323438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96832000-2e02-4bf1-a589-3f538e664590 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:03.329648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03416cc1-6a26-46a4-803c-1a57ee3d7d42 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:03.347945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b793614-c29d-47fb-b2f7-3ee8c699de72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:03.348634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b793614-c29d-47fb-b2f7-3ee8c699de72 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:03.348917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b793614-c29d-47fb-b2f7-3ee8c699de72 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:03.349218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b793614-c29d-47fb-b2f7-3ee8c699de72 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:03.349921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b793614-c29d-47fb-b2f7-3ee8c699de72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:03.351934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b793614-c29d-47fb-b2f7-3ee8c699de72 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:03.373661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03416cc1-6a26-46a4-803c-1a57ee3d7d42 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:03.399387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb317d-3abe-4846-bad7-2928cd043d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:03.400193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb317d-3abe-4846-bad7-2928cd043d80 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:03.400587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb317d-3abe-4846-bad7-2928cd043d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:03.401218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb317d-3abe-4846-bad7-2928cd043d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:03.402961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb317d-3abe-4846-bad7-2928cd043d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:03.406491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb317d-3abe-4846-bad7-2928cd043d80 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:03.463895 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1026/2084] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:03.464936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb317d-3abe-4846-bad7-2928cd043d80 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:03.487056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb317d-3abe-4846-bad7-2928cd043d80 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:03.520235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9e775-2d86-4abe-821b-0e770341ad8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:03.527713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9e775-2d86-4abe-821b-0e770341ad8c admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:03.528691 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1059/2085] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:03 2022] POST /identity/v3/projects => generated 385 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:03.528944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9e775-2d86-4abe-821b-0e770341ad8c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:03.529541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9e775-2d86-4abe-821b-0e770341ad8c admin admin] PATH_INFO: `/v3/projects/649babe54d104436af461f1ee4767001/users/abeb7020019d41a18de42956d706a011/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:03.530672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b793614-c29d-47fb-b2f7-3ee8c699de72 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:03.626621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9e775-2d86-4abe-821b-0e770341ad8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=649babe54d104436af461f1ee4767001, user_id=abeb7020019d41a18de42956d706a011, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:03.640937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9e775-2d86-4abe-821b-0e770341ad8c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:03.770221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b793614-c29d-47fb-b2f7-3ee8c699de72 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:03.785512 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1027/2086] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:03 2022] PUT /identity/v3/projects/649babe54d104436af461f1ee4767001/users/abeb7020019d41a18de42956d706a011/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:03.801127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9c260-b2f6-452e-9354-b48ab3f0864a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:03.801813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9c260-b2f6-452e-9354-b48ab3f0864a admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:03.802124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39f13f-36bd-4d31-a1ae-8b98fb9a3ff8 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:03.802289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9c260-b2f6-452e-9354-b48ab3f0864a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:03.802535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39f13f-36bd-4d31-a1ae-8b98fb9a3ff8 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:03.802655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9c260-b2f6-452e-9354-b48ab3f0864a admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:03.802841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39f13f-36bd-4d31-a1ae-8b98fb9a3ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:03.804934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9c260-b2f6-452e-9354-b48ab3f0864a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:03.807654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9c260-b2f6-452e-9354-b48ab3f0864a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:03.873689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-dd39f13f-36bd-4d31-a1ae-8b98fb9a3ff8 None None] MFA Rules not processed for user `abeb7020019d41a18de42956d706a011`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:03.874958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-dd39f13f-36bd-4d31-a1ae-8b98fb9a3ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:04.003919 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1060/2087] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:03 2022] POST /identity/v3/users => generated 293 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:04.008362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9c260-b2f6-452e-9354-b48ab3f0864a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:04.033390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9c260-b2f6-452e-9354-b48ab3f0864a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:04.047848 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1028/2088] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:04.053405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39f13f-36bd-4d31-a1ae-8b98fb9a3ff8 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:04.182961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:04.201436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c24c85-0755-46f6-a538-06095c0ae27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:04.202913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c24c85-0755-46f6-a538-06095c0ae27e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:04.203270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c24c85-0755-46f6-a538-06095c0ae27e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:04.203553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c24c85-0755-46f6-a538-06095c0ae27e admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:04.204962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c24c85-0755-46f6-a538-06095c0ae27e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:04.206683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c24c85-0755-46f6-a538-06095c0ae27e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:04.228540 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1061/2089] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:09:04.232532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c24c85-0755-46f6-a538-06095c0ae27e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:04.275614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39f13f-36bd-4d31-a1ae-8b98fb9a3ff8 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:04.279435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c24c85-0755-46f6-a538-06095c0ae27e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:04.294853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df4cee-298a-4280-a887-3217aae5843a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:04.295596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df4cee-298a-4280-a887-3217aae5843a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:04.295859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df4cee-298a-4280-a887-3217aae5843a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:04.299086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df4cee-298a-4280-a887-3217aae5843a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:04.300102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df4cee-298a-4280-a887-3217aae5843a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:04.301488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22025fe5-28db-4860-b543-189bfcb9a4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:04.302191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22025fe5-28db-4860-b543-189bfcb9a4b3 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:04.302477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22025fe5-28db-4860-b543-189bfcb9a4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:04.302758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22025fe5-28db-4860-b543-189bfcb9a4b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:04.303528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22025fe5-28db-4860-b543-189bfcb9a4b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:04.305295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df4cee-298a-4280-a887-3217aae5843a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:04.305518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22025fe5-28db-4860-b543-189bfcb9a4b3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:04.347558 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1062/2090] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:09:04.350182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df4cee-298a-4280-a887-3217aae5843a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:04.367134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df4cee-298a-4280-a887-3217aae5843a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:04.373652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70674b-035a-45ce-b185-0b169c25e7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:04.382181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70674b-035a-45ce-b185-0b169c25e7bf admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:04.388510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70674b-035a-45ce-b185-0b169c25e7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:04.388510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70674b-035a-45ce-b185-0b169c25e7bf admin admin] PATH_INFO: `/v3/projects/fc1c3463f9444119af9d18f85bdd703d/users/0d72626f465b4f37ad3b18bb945d4000/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:04.437293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70674b-035a-45ce-b185-0b169c25e7bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1c3463f9444119af9d18f85bdd703d, user_id=0d72626f465b4f37ad3b18bb945d4000, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:04.449326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70674b-035a-45ce-b185-0b169c25e7bf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:04.456317 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1029/2091] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:04 2022] POST /identity/v3/projects => generated 379 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:04.460498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22025fe5-28db-4860-b543-189bfcb9a4b3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:04.605678 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1063/2092] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:04 2022] PUT /identity/v3/projects/fc1c3463f9444119af9d18f85bdd703d/users/0d72626f465b4f37ad3b18bb945d4000/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:09:04.613192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70674b-035a-45ce-b185-0b169c25e7bf admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:04.615518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4d70674b-035a-45ce-b185-0b169c25e7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:04.667924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22025fe5-28db-4860-b543-189bfcb9a4b3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:04.788501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70674b-035a-45ce-b185-0b169c25e7bf admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:04.805959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4201db1-1f23-4145-82a6-74b579b3b0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:04.807036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4201db1-1f23-4145-82a6-74b579b3b0cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:04.807427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4201db1-1f23-4145-82a6-74b579b3b0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:04.807801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4201db1-1f23-4145-82a6-74b579b3b0cd admin admin] PATH_INFO: `/v3/users/35a4905d463a4db2960294407f747f20` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:04.810160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4201db1-1f23-4145-82a6-74b579b3b0cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=35a4905d463a4db2960294407f747f20)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:04.812224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4201db1-1f23-4145-82a6-74b579b3b0cd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:04.823581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3d2b4-495b-47b9-9b20-774e20d84f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:04.827808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3d2b4-495b-47b9-9b20-774e20d84f66 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:04.827808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3d2b4-495b-47b9-9b20-774e20d84f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:04.827808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3d2b4-495b-47b9-9b20-774e20d84f66 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:04.827808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3d2b4-495b-47b9-9b20-774e20d84f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:04.832901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3d2b4-495b-47b9-9b20-774e20d84f66 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:05.009534 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1030/2093] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:04 2022] POST /identity/v3/users => generated 296 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:09:05.011296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e789613-a883-4e9a-842a-6a9106e5253b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:05.011431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e789613-a883-4e9a-842a-6a9106e5253b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:05.013136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e789613-a883-4e9a-842a-6a9106e5253b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:05.036477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:05.070092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7e789613-a883-4e9a-842a-6a9106e5253b None None] MFA Rules not processed for user `0d72626f465b4f37ad3b18bb945d4000`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:05.071617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7e789613-a883-4e9a-842a-6a9106e5253b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:05.096834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a4201db1-1f23-4145-82a6-74b579b3b0cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35a4905d463a4db2960294407f747f20'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:05.108284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a4201db1-1f23-4145-82a6-74b579b3b0cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35a4905d463a4db2960294407f747f20'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:05.159182 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1031/2094] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:05.160711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e789613-a883-4e9a-842a-6a9106e5253b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:05.181284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e789613-a883-4e9a-842a-6a9106e5253b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:05.189400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f77d6-5023-4070-b909-ee3c0a16b468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:05.190511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f77d6-5023-4070-b909-ee3c0a16b468 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:05.191716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f77d6-5023-4070-b909-ee3c0a16b468 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:05.192505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f77d6-5023-4070-b909-ee3c0a16b468 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:05.193492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f77d6-5023-4070-b909-ee3c0a16b468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:05.197899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a4201db1-1f23-4145-82a6-74b579b3b0cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35a4905d463a4db2960294407f747f20'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:05.198742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a4201db1-1f23-4145-82a6-74b579b3b0cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35a4905d463a4db2960294407f747f20'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:05.203437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f77d6-5023-4070-b909-ee3c0a16b468 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:05.217545 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1032/2095] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:05.219133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f77d6-5023-4070-b909-ee3c0a16b468 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:05.223770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ef6f77d6-5023-4070-b909-ee3c0a16b468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:05.241091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f77d6-5023-4070-b909-ee3c0a16b468 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:05.258153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956c566-da84-4b67-8083-d6377dbc17c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:05.259696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956c566-da84-4b67-8083-d6377dbc17c8 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:05.262592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956c566-da84-4b67-8083-d6377dbc17c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:05.263281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956c566-da84-4b67-8083-d6377dbc17c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:05.273802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:05.278030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956c566-da84-4b67-8083-d6377dbc17c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:05.278771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956c566-da84-4b67-8083-d6377dbc17c8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:05.295800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a4201db1-1f23-4145-82a6-74b579b3b0cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35a4905d463a4db2960294407f747f20'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:05.336921 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1064/2096] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:09:04 2022] DELETE /identity/v3/users/35a4905d463a4db2960294407f747f20 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:05.337981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4201db1-1f23-4145-82a6-74b579b3b0cd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:05.342301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a4201db1-1f23-4145-82a6-74b579b3b0cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:05.435471 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1033/2097] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:05 2022] POST /identity/v3/projects => generated 387 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:05.437009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e8ac4-6add-4887-a14c-37fbf929a474 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:05.439395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e8ac4-6add-4887-a14c-37fbf929a474 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:05.439897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e8ac4-6add-4887-a14c-37fbf929a474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:05.472458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b38e8ac4-6add-4887-a14c-37fbf929a474 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:05.473614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b38e8ac4-6add-4887-a14c-37fbf929a474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:05.544381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:05.553148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4201db1-1f23-4145-82a6-74b579b3b0cd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:05.592207 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1034/2098] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:05.593107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e8ac4-6add-4887-a14c-37fbf929a474 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:05.628356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e8ac4-6add-4887-a14c-37fbf929a474 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:05.637688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33daa9-8716-4e19-a166-dfaa648cc249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:05.639185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33daa9-8716-4e19-a166-dfaa648cc249 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:05.639483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33daa9-8716-4e19-a166-dfaa648cc249 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:05.639762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33daa9-8716-4e19-a166-dfaa648cc249 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:05.640564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33daa9-8716-4e19-a166-dfaa648cc249 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:05.644918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33daa9-8716-4e19-a166-dfaa648cc249 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:05.675610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210f161-bb05-4eaf-813d-e88bd2c1e1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:05.676698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210f161-bb05-4eaf-813d-e88bd2c1e1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:05.677127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210f161-bb05-4eaf-813d-e88bd2c1e1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:05.677562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210f161-bb05-4eaf-813d-e88bd2c1e1a9 admin admin] PATH_INFO: `/v3/projects/1371ba5caa8f4db78c53cec976f9a868/users/7550ec9a6f2a4352a4a929c2eacfa354/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:05.704300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210f161-bb05-4eaf-813d-e88bd2c1e1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1371ba5caa8f4db78c53cec976f9a868, user_id=7550ec9a6f2a4352a4a929c2eacfa354, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:05.710405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210f161-bb05-4eaf-813d-e88bd2c1e1a9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:05.786277 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1035/2099] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:05 2022] POST /identity/v3/users => generated 300 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:05.787245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33daa9-8716-4e19-a166-dfaa648cc249 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:05.790525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ed33daa9-8716-4e19-a166-dfaa648cc249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:05.807106 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1065/2100] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:05 2022] PUT /identity/v3/projects/1371ba5caa8f4db78c53cec976f9a868/users/7550ec9a6f2a4352a4a929c2eacfa354/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:05.808306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210f161-bb05-4eaf-813d-e88bd2c1e1a9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:05.950618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210f161-bb05-4eaf-813d-e88bd2c1e1a9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:05.969772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1a800-2cee-42fa-ae37-8c87fd5fdd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:05.970852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1a800-2cee-42fa-ae37-8c87fd5fdd41 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:05.971368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1a800-2cee-42fa-ae37-8c87fd5fdd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:05.972008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33daa9-8716-4e19-a166-dfaa648cc249 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:05.972509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1a800-2cee-42fa-ae37-8c87fd5fdd41 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:05.975568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1a800-2cee-42fa-ae37-8c87fd5fdd41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:05.977750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1a800-2cee-42fa-ae37-8c87fd5fdd41 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:06.006868 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1066/2101] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:06.011259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1a800-2cee-42fa-ae37-8c87fd5fdd41 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:06.037988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1a800-2cee-42fa-ae37-8c87fd5fdd41 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:06.053015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d81ead-8b8c-48a2-9b0d-3d185e2cc8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:06.055132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d81ead-8b8c-48a2-9b0d-3d185e2cc8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:06.071785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d81ead-8b8c-48a2-9b0d-3d185e2cc8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:06.072154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d81ead-8b8c-48a2-9b0d-3d185e2cc8c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:06.076459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d81ead-8b8c-48a2-9b0d-3d185e2cc8c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:06.078135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d81ead-8b8c-48a2-9b0d-3d185e2cc8c6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:06.139366 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1067/2102] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:06.140561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e500e9-1489-4ae3-8425-edc633e5366b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:06.141799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e500e9-1489-4ae3-8425-edc633e5366b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:06.142486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e500e9-1489-4ae3-8425-edc633e5366b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:06.164669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ef42e-48fa-47d2-bbab-be704719349b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:06.170326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ef42e-48fa-47d2-bbab-be704719349b service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:06.170749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ef42e-48fa-47d2-bbab-be704719349b service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:06.171297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ef42e-48fa-47d2-bbab-be704719349b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:06.199022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ef42e-48fa-47d2-bbab-be704719349b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:06.200686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ef42e-48fa-47d2-bbab-be704719349b service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:06.201369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:06.228701 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1036/2103] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:06.229545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ef42e-48fa-47d2-bbab-be704719349b service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:06.233087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f7e500e9-1489-4ae3-8425-edc633e5366b None None] MFA Rules not processed for user `6a69f9dee03d43beaafa966216b9e289`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:06.234295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f7e500e9-1489-4ae3-8425-edc633e5366b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:06.253142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ef42e-48fa-47d2-bbab-be704719349b service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:06.274015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307da2b3-7fd9-4c8b-8566-6a5b108aa7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:06.277184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307da2b3-7fd9-4c8b-8566-6a5b108aa7a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:06.279240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307da2b3-7fd9-4c8b-8566-6a5b108aa7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:06.279240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307da2b3-7fd9-4c8b-8566-6a5b108aa7a9 admin admin] PATH_INFO: `/v3/projects/7f515204606542ce9377e2c0b707e5bc/users/24d825f528ce4d6d9e4da4fa13a417d9/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:06.372712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307da2b3-7fd9-4c8b-8566-6a5b108aa7a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f515204606542ce9377e2c0b707e5bc, user_id=24d825f528ce4d6d9e4da4fa13a417d9, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:06.379640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307da2b3-7fd9-4c8b-8566-6a5b108aa7a9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:06.520503 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1068/2104] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:06.521754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e500e9-1489-4ae3-8425-edc633e5366b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:06.533155 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1037/2105] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:06 2022] PUT /identity/v3/projects/7f515204606542ce9377e2c0b707e5bc/users/24d825f528ce4d6d9e4da4fa13a417d9/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:06.536271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307da2b3-7fd9-4c8b-8566-6a5b108aa7a9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:06.544344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-307da2b3-7fd9-4c8b-8566-6a5b108aa7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:06.565222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e500e9-1489-4ae3-8425-edc633e5366b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:06.692215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307da2b3-7fd9-4c8b-8566-6a5b108aa7a9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:06.711756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3744c-4241-40b2-9680-fe0261e90b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:06.712860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3744c-4241-40b2-9680-fe0261e90b19 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:06.713676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3744c-4241-40b2-9680-fe0261e90b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:06.715889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3744c-4241-40b2-9680-fe0261e90b19 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:06.717281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3744c-4241-40b2-9680-fe0261e90b19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:06.720030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3744c-4241-40b2-9680-fe0261e90b19 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:06.726059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d53ff-5ea6-43da-8046-cc8549289580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:06.728538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d53ff-5ea6-43da-8046-cc8549289580 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:06.729197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d53ff-5ea6-43da-8046-cc8549289580 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:06.729827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d53ff-5ea6-43da-8046-cc8549289580 admin admin] PATH_INFO: `/v3/projects/1371ba5caa8f4db78c53cec976f9a868/users/7550ec9a6f2a4352a4a929c2eacfa354/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:06.735777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:06.736048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d53ff-5ea6-43da-8046-cc8549289580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1371ba5caa8f4db78c53cec976f9a868, user_id=7550ec9a6f2a4352a4a929c2eacfa354, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:06.739500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d53ff-5ea6-43da-8046-cc8549289580 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:06.776384 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1069/2106] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:06 2022] PUT /identity/v3/projects/1371ba5caa8f4db78c53cec976f9a868/users/7550ec9a6f2a4352a4a929c2eacfa354/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:06.776384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d53ff-5ea6-43da-8046-cc8549289580 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:06.865351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d53ff-5ea6-43da-8046-cc8549289580 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:06.876719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ec0ba-2b7d-4cbf-977f-c702012e5b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:06.876719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ec0ba-2b7d-4cbf-977f-c702012e5b74 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:06.876719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ec0ba-2b7d-4cbf-977f-c702012e5b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:06.876719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ec0ba-2b7d-4cbf-977f-c702012e5b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:06.877110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ec0ba-2b7d-4cbf-977f-c702012e5b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:06.877593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ec0ba-2b7d-4cbf-977f-c702012e5b74 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:06.888301 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1070/2107] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:06.888301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ec0ba-2b7d-4cbf-977f-c702012e5b74 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:06.891821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-525ec0ba-2b7d-4cbf-977f-c702012e5b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:06.906460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ec0ba-2b7d-4cbf-977f-c702012e5b74 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:06.912810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb406fe-e0f8-44e8-bc77-3141cbf4920a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:06.913695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb406fe-e0f8-44e8-bc77-3141cbf4920a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:06.913971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb406fe-e0f8-44e8-bc77-3141cbf4920a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:06.914271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb406fe-e0f8-44e8-bc77-3141cbf4920a admin admin] PATH_INFO: `/v3/users/db6c21ea09c54ea492d806f42d2f69a7` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:06.915534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb406fe-e0f8-44e8-bc77-3141cbf4920a admin admin] RBAC: Authorizing `identity:delete_user(user_id=db6c21ea09c54ea492d806f42d2f69a7)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:06.917694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb406fe-e0f8-44e8-bc77-3141cbf4920a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:06.973595 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1038/2108] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:06 2022] POST /identity/v3/projects => generated 371 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:06.975363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d69e4-685c-47a5-9054-c706525240cd None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:06.975783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d69e4-685c-47a5-9054-c706525240cd None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:06.976578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d69e4-685c-47a5-9054-c706525240cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:07.012052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-741d69e4-685c-47a5-9054-c706525240cd None None] MFA Rules not processed for user `7550ec9a6f2a4352a4a929c2eacfa354`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:07.013640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-741d69e4-685c-47a5-9054-c706525240cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:07.099662 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1039/2109] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:07.100542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d69e4-685c-47a5-9054-c706525240cd None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:07.182774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d69e4-685c-47a5-9054-c706525240cd None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:07.189113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a018de6-7d40-4e16-b1b0-d00e4bc3bbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:07.190356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a018de6-7d40-4e16-b1b0-d00e4bc3bbdf admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:07.190720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a018de6-7d40-4e16-b1b0-d00e4bc3bbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:07.190908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a018de6-7d40-4e16-b1b0-d00e4bc3bbdf admin admin] PATH_INFO: `/v3/projects/7f515204606542ce9377e2c0b707e5bc/users/24d825f528ce4d6d9e4da4fa13a417d9/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:07.193215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a018de6-7d40-4e16-b1b0-d00e4bc3bbdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f515204606542ce9377e2c0b707e5bc, user_id=24d825f528ce4d6d9e4da4fa13a417d9, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:07.196105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a018de6-7d40-4e16-b1b0-d00e4bc3bbdf admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:07.217569 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1040/2110] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:07 2022] PUT /identity/v3/projects/7f515204606542ce9377e2c0b707e5bc/users/24d825f528ce4d6d9e4da4fa13a417d9/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:07.237281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a018de6-7d40-4e16-b1b0-d00e4bc3bbdf admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:07.264897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-acb406fe-e0f8-44e8-bc77-3141cbf4920a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db6c21ea09c54ea492d806f42d2f69a7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:07.284286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-acb406fe-e0f8-44e8-bc77-3141cbf4920a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db6c21ea09c54ea492d806f42d2f69a7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:07.401510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a018de6-7d40-4e16-b1b0-d00e4bc3bbdf admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:07.411780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-acb406fe-e0f8-44e8-bc77-3141cbf4920a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db6c21ea09c54ea492d806f42d2f69a7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:07.416631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-acb406fe-e0f8-44e8-bc77-3141cbf4920a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db6c21ea09c54ea492d806f42d2f69a7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:07.417776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16da1e-1e32-47db-b8fd-ba097828eb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:07.420000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16da1e-1e32-47db-b8fd-ba097828eb1e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:07.420794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16da1e-1e32-47db-b8fd-ba097828eb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:07.421433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16da1e-1e32-47db-b8fd-ba097828eb1e admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:07.422441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16da1e-1e32-47db-b8fd-ba097828eb1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:07.429837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16da1e-1e32-47db-b8fd-ba097828eb1e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:07.467520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-acb406fe-e0f8-44e8-bc77-3141cbf4920a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db6c21ea09c54ea492d806f42d2f69a7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:07.478681 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1071/2111] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:09:06 2022] DELETE /identity/v3/users/db6c21ea09c54ea492d806f42d2f69a7 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:07.478681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791e1d5-192b-49e0-8f08-2d689feb5c92 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:07.478681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791e1d5-192b-49e0-8f08-2d689feb5c92 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:07.478681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791e1d5-192b-49e0-8f08-2d689feb5c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:07.506255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6791e1d5-192b-49e0-8f08-2d689feb5c92 None None] MFA Rules not processed for user `abeb7020019d41a18de42956d706a011`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:07.507812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6791e1d5-192b-49e0-8f08-2d689feb5c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:07.544271 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1041/2112] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:07 2022] POST /identity/v3/users => generated 292 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:07.549376 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47cbc2-ee6c-4a4e-9f92-8abca0cce227 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:07.550191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47cbc2-ee6c-4a4e-9f92-8abca0cce227 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:07.550471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47cbc2-ee6c-4a4e-9f92-8abca0cce227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:07.616842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-cc47cbc2-ee6c-4a4e-9f92-8abca0cce227 None None] MFA Rules not processed for user `24d825f528ce4d6d9e4da4fa13a417d9`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:07.619971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cc47cbc2-ee6c-4a4e-9f92-8abca0cce227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:07.633492 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1072/2113] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:07.640252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791e1d5-192b-49e0-8f08-2d689feb5c92 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:07.646307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6791e1d5-192b-49e0-8f08-2d689feb5c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:07.749778 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1042/2114] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:07.751847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ee4f5-463f-49e3-9876-d68e0ccfb109 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:07.752139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ee4f5-463f-49e3-9876-d68e0ccfb109 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:07.752611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ee4f5-463f-49e3-9876-d68e0ccfb109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:07.802319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-230ee4f5-463f-49e3-9876-d68e0ccfb109 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:07.806004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-230ee4f5-463f-49e3-9876-d68e0ccfb109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:07.810801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791e1d5-192b-49e0-8f08-2d689feb5c92 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:07.825447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dc195-e085-4254-af05-ae840bbb5aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:07.826344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dc195-e085-4254-af05-ae840bbb5aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:07.826630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dc195-e085-4254-af05-ae840bbb5aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:07.826905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dc195-e085-4254-af05-ae840bbb5aa6 admin admin] PATH_INFO: `/v3/projects/49044125b0414a4ab0e2ab9eb7d66e6e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:07.832754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900dc195-e085-4254-af05-ae840bbb5aa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49044125b0414a4ab0e2ab9eb7d66e6e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:07.835277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900dc195-e085-4254-af05-ae840bbb5aa6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:07.838911 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1043/2115] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:07.838911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ee4f5-463f-49e3-9876-d68e0ccfb109 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:07.840197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-230ee4f5-463f-49e3-9876-d68e0ccfb109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:07.882337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ee4f5-463f-49e3-9876-d68e0ccfb109 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:07.910686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131b071-a9ec-443c-ad97-c8a66a8c21c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:07.912064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131b071-a9ec-443c-ad97-c8a66a8c21c1 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:07.912586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131b071-a9ec-443c-ad97-c8a66a8c21c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:07.913088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131b071-a9ec-443c-ad97-c8a66a8c21c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:07.914476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131b071-a9ec-443c-ad97-c8a66a8c21c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:07.920619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131b071-a9ec-443c-ad97-c8a66a8c21c1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:07.955293 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1044/2116] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:07.957235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131b071-a9ec-443c-ad97-c8a66a8c21c1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:07.962405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7131b071-a9ec-443c-ad97-c8a66a8c21c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:08.066755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-900dc195-e085-4254-af05-ae840bbb5aa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49044125b0414a4ab0e2ab9eb7d66e6e', 'request_id': 'req-900dc195-e085-4254-af05-ae840bbb5aa6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:08.076297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:08.092090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-900dc195-e085-4254-af05-ae840bbb5aa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49044125b0414a4ab0e2ab9eb7d66e6e', 'request_id': 'req-900dc195-e085-4254-af05-ae840bbb5aa6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:08.106392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-900dc195-e085-4254-af05-ae840bbb5aa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49044125b0414a4ab0e2ab9eb7d66e6e', 'request_id': 'req-900dc195-e085-4254-af05-ae840bbb5aa6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:08.143000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131b071-a9ec-443c-ad97-c8a66a8c21c1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:08.200683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-900dc195-e085-4254-af05-ae840bbb5aa6 admin admin] The token cache is being invalidate because project 49044125b0414a4ab0e2ab9eb7d66e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:08.201237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-900dc195-e085-4254-af05-ae840bbb5aa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:08.202300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-900dc195-e085-4254-af05-ae840bbb5aa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:08.205243 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1073/2117] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:07 2022] DELETE /identity/v3/projects/49044125b0414a4ab0e2ab9eb7d66e6e => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:08.206282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dc195-e085-4254-af05-ae840bbb5aa6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:08.211517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-900dc195-e085-4254-af05-ae840bbb5aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:08.307487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dc195-e085-4254-af05-ae840bbb5aa6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:08.308898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5aa0e-52bc-4136-bcdc-2ecf6b7ae268 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:08.310364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5aa0e-52bc-4136-bcdc-2ecf6b7ae268 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:08.310867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5aa0e-52bc-4136-bcdc-2ecf6b7ae268 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:08.311329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5aa0e-52bc-4136-bcdc-2ecf6b7ae268 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:08.315232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d933ac2-c15d-47b1-9f18-9a5b6eedc70d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:08.316249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d933ac2-c15d-47b1-9f18-9a5b6eedc70d service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:08.316537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d933ac2-c15d-47b1-9f18-9a5b6eedc70d service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:08.316867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d933ac2-c15d-47b1-9f18-9a5b6eedc70d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:08.317746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a5d5aa0e-52bc-4136-bcdc-2ecf6b7ae268 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:08.318946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0d933ac2-c15d-47b1-9f18-9a5b6eedc70d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:08.436970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d933ac2-c15d-47b1-9f18-9a5b6eedc70d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:08.441546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d933ac2-c15d-47b1-9f18-9a5b6eedc70d service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:08.462806 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1074/2118] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:08.477891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d690b-f921-4428-9496-97f360a0eb39 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:08.482982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d690b-f921-4428-9496-97f360a0eb39 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:08.483536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d690b-f921-4428-9496-97f360a0eb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:08.574951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3c0d690b-f921-4428-9496-97f360a0eb39 None None] MFA Rules not processed for user `0d72626f465b4f37ad3b18bb945d4000`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:08.580753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5aa0e-52bc-4136-bcdc-2ecf6b7ae268 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:08.581232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3c0d690b-f921-4428-9496-97f360a0eb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:08.587365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5aa0e-52bc-4136-bcdc-2ecf6b7ae268 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:08.636530 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1045/2119] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:08.656559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5aa0e-52bc-4136-bcdc-2ecf6b7ae268 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:08.668375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a5d5aa0e-52bc-4136-bcdc-2ecf6b7ae268 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:08.839902 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1075/2120] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:08.841116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d690b-f921-4428-9496-97f360a0eb39 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:08.843258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3c0d690b-f921-4428-9496-97f360a0eb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:08.894305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5aa0e-52bc-4136-bcdc-2ecf6b7ae268 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:08.908562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e00fc4-1916-4437-8b4f-49419f6a0317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:08.909588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e00fc4-1916-4437-8b4f-49419f6a0317 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:08.910110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e00fc4-1916-4437-8b4f-49419f6a0317 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:08.910763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e00fc4-1916-4437-8b4f-49419f6a0317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:08.914173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-61e00fc4-1916-4437-8b4f-49419f6a0317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:09.073402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e00fc4-1916-4437-8b4f-49419f6a0317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:09.076393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e00fc4-1916-4437-8b4f-49419f6a0317 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:09.111133 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1046/2121] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:09.116677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d690b-f921-4428-9496-97f360a0eb39 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:09.124862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e00fc4-1916-4437-8b4f-49419f6a0317 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:09.133474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-61e00fc4-1916-4437-8b4f-49419f6a0317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:09.149963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb2aaa-6e83-412f-ac12-f580499e8b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:09.152463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb2aaa-6e83-412f-ac12-f580499e8b38 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:09.153131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb2aaa-6e83-412f-ac12-f580499e8b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:09.154093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb2aaa-6e83-412f-ac12-f580499e8b38 admin admin] PATH_INFO: `/v3/projects/e90ff42dcff94dbf8474491e7c7a5376/users/ff57da59f5c5440dbcc198885643e41d/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:09.166904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e00fc4-1916-4437-8b4f-49419f6a0317 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:09.177494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4951e15-4977-46cc-b670-8f0434d2c24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:09.181620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4951e15-4977-46cc-b670-8f0434d2c24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:09.185933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4951e15-4977-46cc-b670-8f0434d2c24f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:09.187362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4951e15-4977-46cc-b670-8f0434d2c24f admin admin] PATH_INFO: `/v3/users/cadb63bb5d6b4d7597987780f7d9ef21` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:09.191393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4951e15-4977-46cc-b670-8f0434d2c24f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cadb63bb5d6b4d7597987780f7d9ef21)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:09.193467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4951e15-4977-46cc-b670-8f0434d2c24f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:09.195926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb2aaa-6e83-412f-ac12-f580499e8b38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e90ff42dcff94dbf8474491e7c7a5376, user_id=ff57da59f5c5440dbcc198885643e41d, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:09.199693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb2aaa-6e83-412f-ac12-f580499e8b38 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:09.310246 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1076/2122] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:08 2022] PUT /identity/v3/projects/e90ff42dcff94dbf8474491e7c7a5376/users/ff57da59f5c5440dbcc198885643e41d/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:09.315623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb2aaa-6e83-412f-ac12-f580499e8b38 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:09.485290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f4951e15-4977-46cc-b670-8f0434d2c24f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cadb63bb5d6b4d7597987780f7d9ef21'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:09.535841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f4951e15-4977-46cc-b670-8f0434d2c24f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cadb63bb5d6b4d7597987780f7d9ef21'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:09.539314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb2aaa-6e83-412f-ac12-f580499e8b38 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:09.554428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34b4b9-eebe-4a29-8778-3054a9512d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:09.555795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34b4b9-eebe-4a29-8778-3054a9512d51 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:09.558170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34b4b9-eebe-4a29-8778-3054a9512d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:09.559199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34b4b9-eebe-4a29-8778-3054a9512d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:09.561547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34b4b9-eebe-4a29-8778-3054a9512d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:09.568992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34b4b9-eebe-4a29-8778-3054a9512d51 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:09.597899 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1077/2123] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:09.598686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34b4b9-eebe-4a29-8778-3054a9512d51 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:09.603787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9c34b4b9-eebe-4a29-8778-3054a9512d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:09.628043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f4951e15-4977-46cc-b670-8f0434d2c24f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cadb63bb5d6b4d7597987780f7d9ef21'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:09.642420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f4951e15-4977-46cc-b670-8f0434d2c24f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cadb63bb5d6b4d7597987780f7d9ef21'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:09.646161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f4951e15-4977-46cc-b670-8f0434d2c24f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cadb63bb5d6b4d7597987780f7d9ef21'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:09.662926 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1047/2124] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:09:09 2022] DELETE /identity/v3/users/cadb63bb5d6b4d7597987780f7d9ef21 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:09.664069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4951e15-4977-46cc-b670-8f0434d2c24f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:09.669551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f4951e15-4977-46cc-b670-8f0434d2c24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:09.730444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34b4b9-eebe-4a29-8778-3054a9512d51 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:09.845267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4951e15-4977-46cc-b670-8f0434d2c24f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:09.855929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8b59f-8fbe-4a4c-98af-be607031c306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:09.859206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8b59f-8fbe-4a4c-98af-be607031c306 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:09.859501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8b59f-8fbe-4a4c-98af-be607031c306 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:09.859787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8b59f-8fbe-4a4c-98af-be607031c306 admin admin] PATH_INFO: `/v3/projects/e90ff42dcff94dbf8474491e7c7a5376/users/ff57da59f5c5440dbcc198885643e41d/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:09.864517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8b59f-8fbe-4a4c-98af-be607031c306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e90ff42dcff94dbf8474491e7c7a5376, user_id=ff57da59f5c5440dbcc198885643e41d, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:09.866887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0e302-1169-4455-9b3e-522f7527e9c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:09.867589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0e302-1169-4455-9b3e-522f7527e9c8 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:09.869721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8b59f-8fbe-4a4c-98af-be607031c306 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:09.872465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0e302-1169-4455-9b3e-522f7527e9c8 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:09.872822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0e302-1169-4455-9b3e-522f7527e9c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:09.874225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:09.878525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3cd0e302-1169-4455-9b3e-522f7527e9c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:09.900827 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1048/2125] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:09 2022] PUT /identity/v3/projects/e90ff42dcff94dbf8474491e7c7a5376/users/ff57da59f5c5440dbcc198885643e41d/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:09.983949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0e302-1169-4455-9b3e-522f7527e9c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:09.986499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0e302-1169-4455-9b3e-522f7527e9c8 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:09.993714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:09.999392 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1078/2126] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:10.227735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8b59f-8fbe-4a4c-98af-be607031c306 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:10.229772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-38c8b59f-8fbe-4a4c-98af-be607031c306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:10.376805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8b59f-8fbe-4a4c-98af-be607031c306 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:10.399940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a242526-02cf-425c-ae9a-302eb2b847a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:10.402086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a242526-02cf-425c-ae9a-302eb2b847a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:10.402458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a242526-02cf-425c-ae9a-302eb2b847a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:10.403778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a242526-02cf-425c-ae9a-302eb2b847a5 admin admin] PATH_INFO: `/v3/projects/e7c343c974bd4ec0a6a765f818b895be` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:10.410886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a242526-02cf-425c-ae9a-302eb2b847a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7c343c974bd4ec0a6a765f818b895be)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:10.416189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a242526-02cf-425c-ae9a-302eb2b847a5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:10.542548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78211ec-c955-4049-8922-86647489c4cd None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:10.543213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78211ec-c955-4049-8922-86647489c4cd None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:10.543213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78211ec-c955-4049-8922-86647489c4cd None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:10.544937 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1079/2127] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:09:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 21:09:10.561538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e4635-e6f9-4963-9155-18f070911826 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:10.561832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e4635-e6f9-4963-9155-18f070911826 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:10.562179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e4635-e6f9-4963-9155-18f070911826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:10.601175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-424e4635-e6f9-4963-9155-18f070911826 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:10.603549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-424e4635-e6f9-4963-9155-18f070911826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:10.714292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9a242526-02cf-425c-ae9a-302eb2b847a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7c343c974bd4ec0a6a765f818b895be', 'request_id': 'req-9a242526-02cf-425c-ae9a-302eb2b847a5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:10.735856 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1080/2128] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:09:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:09:10.739420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9a242526-02cf-425c-ae9a-302eb2b847a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7c343c974bd4ec0a6a765f818b895be', 'request_id': 'req-9a242526-02cf-425c-ae9a-302eb2b847a5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:10.749508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9a242526-02cf-425c-ae9a-302eb2b847a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7c343c974bd4ec0a6a765f818b895be', 'request_id': 'req-9a242526-02cf-425c-ae9a-302eb2b847a5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:10.758714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e4635-e6f9-4963-9155-18f070911826 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:10.760375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-424e4635-e6f9-4963-9155-18f070911826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:10.776360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e4635-e6f9-4963-9155-18f070911826 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:10.874479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc62da-8b30-40c0-988d-7f2abee8d4fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:10.875225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc62da-8b30-40c0-988d-7f2abee8d4fa service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:10.876034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc62da-8b30-40c0-988d-7f2abee8d4fa service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:10.876312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc62da-8b30-40c0-988d-7f2abee8d4fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:10.886014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc62da-8b30-40c0-988d-7f2abee8d4fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:10.887714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc62da-8b30-40c0-988d-7f2abee8d4fa service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:10.900262 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1081/2129] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:09:10.964516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9a242526-02cf-425c-ae9a-302eb2b847a5 admin admin] The token cache is being invalidate because project e7c343c974bd4ec0a6a765f818b895be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:10.964916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9a242526-02cf-425c-ae9a-302eb2b847a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:10.966035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9a242526-02cf-425c-ae9a-302eb2b847a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:10.968070 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1049/2130] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:10 2022] DELETE /identity/v3/projects/e7c343c974bd4ec0a6a765f818b895be => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:10.972784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc62da-8b30-40c0-988d-7f2abee8d4fa service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:11.061308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc62da-8b30-40c0-988d-7f2abee8d4fa service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:11.069124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ec95a-b9ef-40dc-9573-1880e01e8471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:11.070156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ec95a-b9ef-40dc-9573-1880e01e8471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:11.070675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ec95a-b9ef-40dc-9573-1880e01e8471 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:11.071184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ec95a-b9ef-40dc-9573-1880e01e8471 admin admin] PATH_INFO: `/v3/users/ceb1a15568df445abebf4220c6894ca9` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:11.072494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ec95a-b9ef-40dc-9573-1880e01e8471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceb1a15568df445abebf4220c6894ca9)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:11.075772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ec95a-b9ef-40dc-9573-1880e01e8471 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:11.230604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54adc1a-e9e5-4689-8a44-a20b8249098f None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:11.230817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54adc1a-e9e5-4689-8a44-a20b8249098f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:11.231249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54adc1a-e9e5-4689-8a44-a20b8249098f None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:11.232881 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1050/2131] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:09:11.252844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1123c14-8074-4e3c-ba01-afddb7a4c4e3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:11.253240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1123c14-8074-4e3c-ba01-afddb7a4c4e3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:11.253651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1123c14-8074-4e3c-ba01-afddb7a4c4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:11.291075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b1123c14-8074-4e3c-ba01-afddb7a4c4e3 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:11.292657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b1123c14-8074-4e3c-ba01-afddb7a4c4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:11.316943 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1051/2132] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:09:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:09:11.349164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1123c14-8074-4e3c-ba01-afddb7a4c4e3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:11.350651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b1123c14-8074-4e3c-ba01-afddb7a4c4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:11.372669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1123c14-8074-4e3c-ba01-afddb7a4c4e3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:11.387623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8022b-ae51-4215-b83b-3dc82694ac79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:11.388546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8022b-ae51-4215-b83b-3dc82694ac79 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:11.388981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8022b-ae51-4215-b83b-3dc82694ac79 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:11.389421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8022b-ae51-4215-b83b-3dc82694ac79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:11.400282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8022b-ae51-4215-b83b-3dc82694ac79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:11.401942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8022b-ae51-4215-b83b-3dc82694ac79 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:11.434607 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1052/2133] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:11.451177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c28ec95a-b9ef-40dc-9573-1880e01e8471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceb1a15568df445abebf4220c6894ca9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:11.478273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c28ec95a-b9ef-40dc-9573-1880e01e8471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceb1a15568df445abebf4220c6894ca9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:11.628207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c28ec95a-b9ef-40dc-9573-1880e01e8471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceb1a15568df445abebf4220c6894ca9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:11.628841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c28ec95a-b9ef-40dc-9573-1880e01e8471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceb1a15568df445abebf4220c6894ca9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:11.658608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c28ec95a-b9ef-40dc-9573-1880e01e8471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceb1a15568df445abebf4220c6894ca9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:11.671756 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1082/2134] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:09:10 2022] DELETE /identity/v3/users/ceb1a15568df445abebf4220c6894ca9 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:11.703611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8022b-ae51-4215-b83b-3dc82694ac79 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:11.707726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ebf8022b-ae51-4215-b83b-3dc82694ac79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:11.716144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4c1c7-9761-45e3-9bfe-5b460d076897 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:11.717597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4c1c7-9761-45e3-9bfe-5b460d076897 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:11.718091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4c1c7-9761-45e3-9bfe-5b460d076897 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:11.720944 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1083/2135] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:09:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 21:09:11.728698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92da435-8de2-44c0-b1be-47c91d712250 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:11.729381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92da435-8de2-44c0-b1be-47c91d712250 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:11.729856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92da435-8de2-44c0-b1be-47c91d712250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:11.756701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a92da435-8de2-44c0-b1be-47c91d712250 None None] MFA Rules not processed for user `fbd858f3e6ba4523b056bbdc2af427b0`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:11.758253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a92da435-8de2-44c0-b1be-47c91d712250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:11.811079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8022b-ae51-4215-b83b-3dc82694ac79 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:11.907096 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1084/2136] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:09:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:09:11.930940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92da435-8de2-44c0-b1be-47c91d712250 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:11.933675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a92da435-8de2-44c0-b1be-47c91d712250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:11.949972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92da435-8de2-44c0-b1be-47c91d712250 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:11.955885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7d4a1-01ab-426d-89c3-871faaee9c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:11.960026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7d4a1-01ab-426d-89c3-871faaee9c67 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:11.962934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7d4a1-01ab-426d-89c3-871faaee9c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:11.964734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1c303-d957-4666-8c0a-8c62a4e6c6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:11.968432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7d4a1-01ab-426d-89c3-871faaee9c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:11.968703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1c303-d957-4666-8c0a-8c62a4e6c6c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:11.968703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1c303-d957-4666-8c0a-8c62a4e6c6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:11.968703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1c303-d957-4666-8c0a-8c62a4e6c6c4 admin admin] PATH_INFO: `/v3/projects/b6be58dcb13b4cec8f0bfc58f0080173` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:11.970829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1c303-d957-4666-8c0a-8c62a4e6c6c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6be58dcb13b4cec8f0bfc58f0080173)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:11.974802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1c303-d957-4666-8c0a-8c62a4e6c6c4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:11.978962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7d4a1-01ab-426d-89c3-871faaee9c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:11.980965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7d4a1-01ab-426d-89c3-871faaee9c67 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:11.994144 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1085/2137] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:09:12.135535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-90b1c303-d957-4666-8c0a-8c62a4e6c6c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6be58dcb13b4cec8f0bfc58f0080173', 'request_id': 'req-90b1c303-d957-4666-8c0a-8c62a4e6c6c4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:12.166403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-90b1c303-d957-4666-8c0a-8c62a4e6c6c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6be58dcb13b4cec8f0bfc58f0080173', 'request_id': 'req-90b1c303-d957-4666-8c0a-8c62a4e6c6c4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:12.197021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-90b1c303-d957-4666-8c0a-8c62a4e6c6c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6be58dcb13b4cec8f0bfc58f0080173', 'request_id': 'req-90b1c303-d957-4666-8c0a-8c62a4e6c6c4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:12.206940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:12.319860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-90b1c303-d957-4666-8c0a-8c62a4e6c6c4 admin admin] The token cache is being invalidate because project b6be58dcb13b4cec8f0bfc58f0080173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:12.320243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-90b1c303-d957-4666-8c0a-8c62a4e6c6c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:12.327146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-90b1c303-d957-4666-8c0a-8c62a4e6c6c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:12.327268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7d4a1-01ab-426d-89c3-871faaee9c67 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:12.327268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-81e7d4a1-01ab-426d-89c3-871faaee9c67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:12.328170 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1053/2138] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:11 2022] DELETE /identity/v3/projects/b6be58dcb13b4cec8f0bfc58f0080173 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:12.329782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ed456-a3de-4434-86a6-4b8817a2a7a0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:12.331082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ed456-a3de-4434-86a6-4b8817a2a7a0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:12.331591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ed456-a3de-4434-86a6-4b8817a2a7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:12.353177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7d4a1-01ab-426d-89c3-871faaee9c67 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:12.375899 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3b6ed456-a3de-4434-86a6-4b8817a2a7a0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:12.381712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3b6ed456-a3de-4434-86a6-4b8817a2a7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:12.431360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:12.493031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edac0f4-c612-4881-8882-603e786dca7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:12.494324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edac0f4-c612-4881-8882-603e786dca7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:12.494790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edac0f4-c612-4881-8882-603e786dca7d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:12.495485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edac0f4-c612-4881-8882-603e786dca7d admin admin] PATH_INFO: `/v3/projects/09da0450b1464083990b4b3566862cd6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:12.503431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edac0f4-c612-4881-8882-603e786dca7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=09da0450b1464083990b4b3566862cd6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:12.509011 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edac0f4-c612-4881-8882-603e786dca7d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:12.519451 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1054/2139] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:12.522002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67392bc-d3a4-4721-9cff-187b716d408f None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:12.522794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67392bc-d3a4-4721-9cff-187b716d408f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:12.531670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67392bc-d3a4-4721-9cff-187b716d408f None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:12.535431 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1055/2140] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:09:12 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:09:12.536863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfdc36-058d-45d2-b1e5-d25bf5440b66 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:12.537524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfdc36-058d-45d2-b1e5-d25bf5440b66 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:12.537843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfdc36-058d-45d2-b1e5-d25bf5440b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:12.575933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2ebfdc36-058d-45d2-b1e5-d25bf5440b66 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:12.577382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2ebfdc36-058d-45d2-b1e5-d25bf5440b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:12.591811 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1056/2141] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:12.593698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148c364-77fe-47f7-9e60-3cd31855cd6a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:12.594399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148c364-77fe-47f7-9e60-3cd31855cd6a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:12.595709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148c364-77fe-47f7-9e60-3cd31855cd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:12.619814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7148c364-77fe-47f7-9e60-3cd31855cd6a None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:12.621257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7148c364-77fe-47f7-9e60-3cd31855cd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:12.653707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3edac0f4-c612-4881-8882-603e786dca7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09da0450b1464083990b4b3566862cd6', 'request_id': 'req-3edac0f4-c612-4881-8882-603e786dca7d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:12.683262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3edac0f4-c612-4881-8882-603e786dca7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09da0450b1464083990b4b3566862cd6', 'request_id': 'req-3edac0f4-c612-4881-8882-603e786dca7d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:12.691835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3edac0f4-c612-4881-8882-603e786dca7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09da0450b1464083990b4b3566862cd6', 'request_id': 'req-3edac0f4-c612-4881-8882-603e786dca7d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:12.698842 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1057/2142] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:09:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:12.700620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148c364-77fe-47f7-9e60-3cd31855cd6a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:12.712426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148c364-77fe-47f7-9e60-3cd31855cd6a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:12.790505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b1db3-9086-4cf5-8eb0-6417a5df0ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:12.791444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b1db3-9086-4cf5-8eb0-6417a5df0ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:12.792312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b1db3-9086-4cf5-8eb0-6417a5df0ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:12.792755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b1db3-9086-4cf5-8eb0-6417a5df0ea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:12.793616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b1db3-9086-4cf5-8eb0-6417a5df0ea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:09:12.793961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b1db3-9086-4cf5-8eb0-6417a5df0ea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:12.795695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b1db3-9086-4cf5-8eb0-6417a5df0ea2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:12.818609 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1058/2143] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:09:12.819668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b1db3-9086-4cf5-8eb0-6417a5df0ea2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:12.821897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ad3b1db3-9086-4cf5-8eb0-6417a5df0ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:12.852220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3edac0f4-c612-4881-8882-603e786dca7d admin admin] The token cache is being invalidate because project 09da0450b1464083990b4b3566862cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:12.852827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3edac0f4-c612-4881-8882-603e786dca7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:12.853727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3edac0f4-c612-4881-8882-603e786dca7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:12.860079 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1086/2144] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:12 2022] DELETE /identity/v3/projects/09da0450b1464083990b4b3566862cd6 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:09:12.861857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edac0f4-c612-4881-8882-603e786dca7d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:12.863683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3edac0f4-c612-4881-8882-603e786dca7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:12.882676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edac0f4-c612-4881-8882-603e786dca7d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:12.903203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2be010-b459-4e0e-8d90-89312a823249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:12.903203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2be010-b459-4e0e-8d90-89312a823249 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:12.903203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2be010-b459-4e0e-8d90-89312a823249 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:12.903203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2be010-b459-4e0e-8d90-89312a823249 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:12.903747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2be010-b459-4e0e-8d90-89312a823249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:12.903747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2be010-b459-4e0e-8d90-89312a823249 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:12.967034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b1db3-9086-4cf5-8eb0-6417a5df0ea2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:12.973587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce942183-45df-4b9d-b480-a6d4dee8f33e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:12.974263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce942183-45df-4b9d-b480-a6d4dee8f33e service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:12.974550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce942183-45df-4b9d-b480-a6d4dee8f33e service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:12.974845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce942183-45df-4b9d-b480-a6d4dee8f33e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:12.977042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ce942183-45df-4b9d-b480-a6d4dee8f33e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:12.994717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce942183-45df-4b9d-b480-a6d4dee8f33e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:12.996465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce942183-45df-4b9d-b480-a6d4dee8f33e service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:13.008438 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1059/2145] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:13.011842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c62ad1-f8ca-4024-b1d5-276445d5172a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:13.015688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c62ad1-f8ca-4024-b1d5-276445d5172a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:13.015688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c62ad1-f8ca-4024-b1d5-276445d5172a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:13.052364 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1087/2146] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:12 2022] POST /identity/v3/projects => generated 395 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:13.054302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2be010-b459-4e0e-8d90-89312a823249 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:13.058646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-31c62ad1-f8ca-4024-b1d5-276445d5172a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:13.061445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-31c62ad1-f8ca-4024-b1d5-276445d5172a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:13.232236 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1060/2147] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:13.232534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2be010-b459-4e0e-8d90-89312a823249 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:13.247450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d3071-1561-48b4-aeaf-4a6f6837899b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:13.247591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d3071-1561-48b4-aeaf-4a6f6837899b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:13.253031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d3071-1561-48b4-aeaf-4a6f6837899b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:13.289039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50047a75-f6aa-4ce9-9b52-b0359d7d9e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:13.289742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50047a75-f6aa-4ce9-9b52-b0359d7d9e0d admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:13.290203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50047a75-f6aa-4ce9-9b52-b0359d7d9e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:13.291104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50047a75-f6aa-4ce9-9b52-b0359d7d9e0d admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:13.291914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50047a75-f6aa-4ce9-9b52-b0359d7d9e0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:13.293942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50047a75-f6aa-4ce9-9b52-b0359d7d9e0d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:13.311071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a01d3071-1561-48b4-aeaf-4a6f6837899b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:13.315117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a01d3071-1561-48b4-aeaf-4a6f6837899b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:13.329849 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1061/2148] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:13.334311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d3071-1561-48b4-aeaf-4a6f6837899b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:13.347638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d3071-1561-48b4-aeaf-4a6f6837899b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:13.356126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3734a9-7769-4955-aafd-c0cbe1de4b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:13.357095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3734a9-7769-4955-aafd-c0cbe1de4b3a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:13.357592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3734a9-7769-4955-aafd-c0cbe1de4b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:13.358024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3734a9-7769-4955-aafd-c0cbe1de4b3a admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:13.359143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3734a9-7769-4955-aafd-c0cbe1de4b3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:09:13.359607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3734a9-7769-4955-aafd-c0cbe1de4b3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:13.363374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3734a9-7769-4955-aafd-c0cbe1de4b3a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:13.382700 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1062/2149] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:09:13.392699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3734a9-7769-4955-aafd-c0cbe1de4b3a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:13.416178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3734a9-7769-4955-aafd-c0cbe1de4b3a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:13.430646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd5555-9e54-44e9-aa71-43619e0ec234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:13.432779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd5555-9e54-44e9-aa71-43619e0ec234 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:13.432939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd5555-9e54-44e9-aa71-43619e0ec234 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:13.433299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd5555-9e54-44e9-aa71-43619e0ec234 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:13.434604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd5555-9e54-44e9-aa71-43619e0ec234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:13.437148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd5555-9e54-44e9-aa71-43619e0ec234 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:13.484215 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1088/2150] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:13 2022] POST /identity/v3/users => generated 298 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:13.489122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50047a75-f6aa-4ce9-9b52-b0359d7d9e0d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:13.509851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50047a75-f6aa-4ce9-9b52-b0359d7d9e0d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:13.538348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1332c-71f0-4150-8e72-30548cdc1272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:13.540130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1332c-71f0-4150-8e72-30548cdc1272 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:13.550977 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1063/2151] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:13 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:13.551145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1332c-71f0-4150-8e72-30548cdc1272 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:13.551672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1332c-71f0-4150-8e72-30548cdc1272 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:13.553541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1332c-71f0-4150-8e72-30548cdc1272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:13.555788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd5555-9e54-44e9-aa71-43619e0ec234 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:13.557094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1332c-71f0-4150-8e72-30548cdc1272 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:13.593519 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1089/2152] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:13.597853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6f083-a7d2-48a7-a439-05569ef2bc94 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:13.600983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6f083-a7d2-48a7-a439-05569ef2bc94 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:13.600983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6f083-a7d2-48a7-a439-05569ef2bc94 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:13.603092 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1090/2153] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:09:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:09:13.605481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6f083-a7d2-48a7-a439-05569ef2bc94 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:13.722401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd5555-9e54-44e9-aa71-43619e0ec234 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:13.731493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79eee4-410b-4f71-89d7-6baef12f1b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:13.732449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79eee4-410b-4f71-89d7-6baef12f1b19 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:13.732866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79eee4-410b-4f71-89d7-6baef12f1b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:13.733256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79eee4-410b-4f71-89d7-6baef12f1b19 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:13.734754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79eee4-410b-4f71-89d7-6baef12f1b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:13.739623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79eee4-410b-4f71-89d7-6baef12f1b19 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:13.782750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6f083-a7d2-48a7-a439-05569ef2bc94 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:13.817075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489458a3-8244-42e9-8d28-19d61a249c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:13.818279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489458a3-8244-42e9-8d28-19d61a249c04 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:13.832370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489458a3-8244-42e9-8d28-19d61a249c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:13.832928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489458a3-8244-42e9-8d28-19d61a249c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:13.833933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489458a3-8244-42e9-8d28-19d61a249c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:13.840052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489458a3-8244-42e9-8d28-19d61a249c04 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:13.859455 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1091/2154] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:13.859455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858638c-1d53-424e-9344-3cd46b69e398 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:13.859455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858638c-1d53-424e-9344-3cd46b69e398 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:13.859455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858638c-1d53-424e-9344-3cd46b69e398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:13.884347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9858638c-1d53-424e-9344-3cd46b69e398 None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:13.885590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9858638c-1d53-424e-9344-3cd46b69e398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:13.968725 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1092/2155] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:09:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:13.970252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858638c-1d53-424e-9344-3cd46b69e398 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:13.980660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858638c-1d53-424e-9344-3cd46b69e398 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:13.987144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db9ecb-cbac-43e6-ad75-f9b3afedeef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:13.988016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db9ecb-cbac-43e6-ad75-f9b3afedeef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:13.988630 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1064/2156] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:13 2022] POST /identity/v3/users => generated 287 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:13.989080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db9ecb-cbac-43e6-ad75-f9b3afedeef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:13.989080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db9ecb-cbac-43e6-ad75-f9b3afedeef6 admin admin] PATH_INFO: `/v3/projects/6beaabf2d684478fac58e01a0d3a77fe/users/a0d51dd7cf834374b6a05298707b3ef1/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:13.993022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79eee4-410b-4f71-89d7-6baef12f1b19 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:14.008365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db9ecb-cbac-43e6-ad75-f9b3afedeef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6beaabf2d684478fac58e01a0d3a77fe, user_id=a0d51dd7cf834374b6a05298707b3ef1, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:14.008631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79eee4-410b-4f71-89d7-6baef12f1b19 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:14.013141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db9ecb-cbac-43e6-ad75-f9b3afedeef6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:14.018611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071b3f0-8d06-4834-8d0f-829129bc8259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:14.019427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071b3f0-8d06-4834-8d0f-829129bc8259 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:14.020009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071b3f0-8d06-4834-8d0f-829129bc8259 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:14.021249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071b3f0-8d06-4834-8d0f-829129bc8259 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:14.022080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071b3f0-8d06-4834-8d0f-829129bc8259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:14.024090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071b3f0-8d06-4834-8d0f-829129bc8259 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:14.043620 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1065/2157] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:14.043620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071b3f0-8d06-4834-8d0f-829129bc8259 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:14.045403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1071b3f0-8d06-4834-8d0f-829129bc8259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:14.120253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071b3f0-8d06-4834-8d0f-829129bc8259 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:14.123992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418c1e2-6b08-4386-b180-9499888f3a79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:14.124651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418c1e2-6b08-4386-b180-9499888f3a79 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:14.124956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418c1e2-6b08-4386-b180-9499888f3a79 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:14.125236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418c1e2-6b08-4386-b180-9499888f3a79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:14.139492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418c1e2-6b08-4386-b180-9499888f3a79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:14.141642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418c1e2-6b08-4386-b180-9499888f3a79 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:14.154303 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1066/2158] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:14.155076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418c1e2-6b08-4386-b180-9499888f3a79 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:14.167885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418c1e2-6b08-4386-b180-9499888f3a79 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:14.175382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c263c-60f8-45dc-9510-2160b6c62d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:14.191804 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1093/2159] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:13 2022] PUT /identity/v3/projects/6beaabf2d684478fac58e01a0d3a77fe/users/a0d51dd7cf834374b6a05298707b3ef1/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:14.192019 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c263c-60f8-45dc-9510-2160b6c62d37 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:14.192019 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c263c-60f8-45dc-9510-2160b6c62d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:14.192019 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c263c-60f8-45dc-9510-2160b6c62d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:14.192019 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c263c-60f8-45dc-9510-2160b6c62d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:14.192019 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c263c-60f8-45dc-9510-2160b6c62d37 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:14.193735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59223d8-d3cf-46ca-868b-d919a4f12fe7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:14.194021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59223d8-d3cf-46ca-868b-d919a4f12fe7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:14.194874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59223d8-d3cf-46ca-868b-d919a4f12fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:14.232838 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1067/2160] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:14.239107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f59223d8-d3cf-46ca-868b-d919a4f12fe7 None None] MFA Rules not processed for user `a0d51dd7cf834374b6a05298707b3ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:14.240587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f59223d8-d3cf-46ca-868b-d919a4f12fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:14.242199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c263c-60f8-45dc-9510-2160b6c62d37 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:14.264617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c263c-60f8-45dc-9510-2160b6c62d37 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:14.374075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e15db9-ae03-4331-84dc-aba49ebc7ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:14.376185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e15db9-ae03-4331-84dc-aba49ebc7ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:14.377269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e15db9-ae03-4331-84dc-aba49ebc7ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:14.377857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e15db9-ae03-4331-84dc-aba49ebc7ca8 admin admin] PATH_INFO: `/v3/projects/f792890ae08b44fd90d0eed3a7a9877f/users/9b1dca63a7a94fe8b40a3967f7a293e1/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:14.379389 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1094/2161] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:14.382597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59223d8-d3cf-46ca-868b-d919a4f12fe7 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:14.399375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59223d8-d3cf-46ca-868b-d919a4f12fe7 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:14.403769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e15db9-ae03-4331-84dc-aba49ebc7ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f792890ae08b44fd90d0eed3a7a9877f, user_id=9b1dca63a7a94fe8b40a3967f7a293e1, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:14.407603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975e536-420c-424a-8fb4-d11921c2e7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:14.408571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975e536-420c-424a-8fb4-d11921c2e7cb admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:14.408713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e15db9-ae03-4331-84dc-aba49ebc7ca8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:14.409143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975e536-420c-424a-8fb4-d11921c2e7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:14.410213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975e536-420c-424a-8fb4-d11921c2e7cb admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:14.411319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975e536-420c-424a-8fb4-d11921c2e7cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:14.439889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975e536-420c-424a-8fb4-d11921c2e7cb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:14.515082 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1068/2162] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:14 2022] PUT /identity/v3/projects/f792890ae08b44fd90d0eed3a7a9877f/users/9b1dca63a7a94fe8b40a3967f7a293e1/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:14.530065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7723e14-d0dd-474b-b7a3-f8095394170d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:14.530619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7723e14-d0dd-474b-b7a3-f8095394170d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:14.533270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:14.537793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7723e14-d0dd-474b-b7a3-f8095394170d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:14.568505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d7723e14-d0dd-474b-b7a3-f8095394170d None None] MFA Rules not processed for user `9b1dca63a7a94fe8b40a3967f7a293e1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:14.569973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d7723e14-d0dd-474b-b7a3-f8095394170d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:14.573919 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1095/2163] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:14 2022] POST /identity/v3/projects => generated 395 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:14.575159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975e536-420c-424a-8fb4-d11921c2e7cb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:14.675855 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1069/2164] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:09:14.677411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975e536-420c-424a-8fb4-d11921c2e7cb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:14.685648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2861be-1ea3-4ea7-8084-939e4b51df8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:14.686748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2861be-1ea3-4ea7-8084-939e4b51df8f admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:14.687284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2861be-1ea3-4ea7-8084-939e4b51df8f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:14.687779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2861be-1ea3-4ea7-8084-939e4b51df8f admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:14.689084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7723e14-d0dd-474b-b7a3-f8095394170d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:14.689692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2861be-1ea3-4ea7-8084-939e4b51df8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:14.692667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2861be-1ea3-4ea7-8084-939e4b51df8f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:14.704255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7723e14-d0dd-474b-b7a3-f8095394170d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:14.724687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e43eb-2d78-40e9-890a-41bd90951fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:14.726336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e43eb-2d78-40e9-890a-41bd90951fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:14.726464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e43eb-2d78-40e9-890a-41bd90951fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:14.727096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e43eb-2d78-40e9-890a-41bd90951fa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:14.728193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e43eb-2d78-40e9-890a-41bd90951fa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:14.730597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e43eb-2d78-40e9-890a-41bd90951fa5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:14.842617 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1096/2165] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:14 2022] POST /identity/v3/users => generated 304 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:14.846574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2861be-1ea3-4ea7-8084-939e4b51df8f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:14.866104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2861be-1ea3-4ea7-8084-939e4b51df8f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:14.892393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27266309-020c-4de3-b9a7-1f2194ff69b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:14.893271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27266309-020c-4de3-b9a7-1f2194ff69b8 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:14.894055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27266309-020c-4de3-b9a7-1f2194ff69b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:14.894535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27266309-020c-4de3-b9a7-1f2194ff69b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:14.895955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27266309-020c-4de3-b9a7-1f2194ff69b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:14.900724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27266309-020c-4de3-b9a7-1f2194ff69b8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:14.911183 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1070/2166] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:14 2022] POST /identity/v3/projects => generated 375 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:14.912314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e43eb-2d78-40e9-890a-41bd90951fa5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:14.932107 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1097/2167] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:14.933302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27266309-020c-4de3-b9a7-1f2194ff69b8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:14.955126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27266309-020c-4de3-b9a7-1f2194ff69b8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:15.084990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03784c7-a226-44c7-baeb-7518ac5bc1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:15.086206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03784c7-a226-44c7-baeb-7518ac5bc1d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:15.086662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03784c7-a226-44c7-baeb-7518ac5bc1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:15.087216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03784c7-a226-44c7-baeb-7518ac5bc1d6 admin admin] PATH_INFO: `/v3/projects/054de79bd580451bafa72a8e903ffab5/users/651cbc6596e24fcfa7232ddc273692ae/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:15.114839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e43eb-2d78-40e9-890a-41bd90951fa5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:15.130996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03784c7-a226-44c7-baeb-7518ac5bc1d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=054de79bd580451bafa72a8e903ffab5, user_id=651cbc6596e24fcfa7232ddc273692ae, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:15.133774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03784c7-a226-44c7-baeb-7518ac5bc1d6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:15.136870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b37fa-647e-4b6d-91f9-1877e6dcf299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:15.137562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b37fa-647e-4b6d-91f9-1877e6dcf299 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:15.137849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b37fa-647e-4b6d-91f9-1877e6dcf299 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:15.138130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b37fa-647e-4b6d-91f9-1877e6dcf299 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:15.138829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b37fa-647e-4b6d-91f9-1877e6dcf299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:15.140825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b37fa-647e-4b6d-91f9-1877e6dcf299 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:15.269607 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1098/2168] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:14 2022] PUT /identity/v3/projects/054de79bd580451bafa72a8e903ffab5/users/651cbc6596e24fcfa7232ddc273692ae/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:15.277628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03784c7-a226-44c7-baeb-7518ac5bc1d6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:15.366161 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1071/2169] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:14 2022] POST /identity/v3/users => generated 294 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:15.374811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b37fa-647e-4b6d-91f9-1877e6dcf299 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:15.402180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b37fa-647e-4b6d-91f9-1877e6dcf299 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:15.464038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03784c7-a226-44c7-baeb-7518ac5bc1d6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:15.488390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c57ab-ddbe-40f0-a103-26146357ab4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:15.489106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c57ab-ddbe-40f0-a103-26146357ab4d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:15.489396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c57ab-ddbe-40f0-a103-26146357ab4d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:15.489677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c57ab-ddbe-40f0-a103-26146357ab4d admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:15.490549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c57ab-ddbe-40f0-a103-26146357ab4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:15.492433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c57ab-ddbe-40f0-a103-26146357ab4d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:15.529795 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1099/2170] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:15.532705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c57ab-ddbe-40f0-a103-26146357ab4d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:15.565784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c57ab-ddbe-40f0-a103-26146357ab4d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:15.588863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbff8b0-965c-4bbb-ae17-9135baef4619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:15.589781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbff8b0-965c-4bbb-ae17-9135baef4619 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:15.590065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbff8b0-965c-4bbb-ae17-9135baef4619 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:15.590339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbff8b0-965c-4bbb-ae17-9135baef4619 admin admin] PATH_INFO: `/v3/projects/054de79bd580451bafa72a8e903ffab5/users/651cbc6596e24fcfa7232ddc273692ae/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:15.591972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825bde4-7cb6-47eb-bec9-5cc01d66f46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:15.600268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825bde4-7cb6-47eb-bec9-5cc01d66f46a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:15.600268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825bde4-7cb6-47eb-bec9-5cc01d66f46a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:15.600268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825bde4-7cb6-47eb-bec9-5cc01d66f46a admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:15.600268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825bde4-7cb6-47eb-bec9-5cc01d66f46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:15.600268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825bde4-7cb6-47eb-bec9-5cc01d66f46a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:15.600684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbff8b0-965c-4bbb-ae17-9135baef4619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=054de79bd580451bafa72a8e903ffab5, user_id=651cbc6596e24fcfa7232ddc273692ae, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:15.601847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbff8b0-965c-4bbb-ae17-9135baef4619 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:15.633352 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1072/2171] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:15.634367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825bde4-7cb6-47eb-bec9-5cc01d66f46a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:15.647221 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1100/2172] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:15 2022] PUT /identity/v3/projects/054de79bd580451bafa72a8e903ffab5/users/651cbc6596e24fcfa7232ddc273692ae/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:15.652730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa602f-fddb-4694-8c91-8b0c42b41418 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:15.653248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa602f-fddb-4694-8c91-8b0c42b41418 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:15.653697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa602f-fddb-4694-8c91-8b0c42b41418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:15.668133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825bde4-7cb6-47eb-bec9-5cc01d66f46a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:15.693860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5afa602f-fddb-4694-8c91-8b0c42b41418 None None] MFA Rules not processed for user `651cbc6596e24fcfa7232ddc273692ae`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:15.697831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5afa602f-fddb-4694-8c91-8b0c42b41418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:15.819090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5020b2-9d00-4440-9814-425bdbb8ea55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:15.823314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5020b2-9d00-4440-9814-425bdbb8ea55 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:15.824255 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1101/2173] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:15 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:15.827488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5020b2-9d00-4440-9814-425bdbb8ea55 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:15.828675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa602f-fddb-4694-8c91-8b0c42b41418 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:15.829715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5020b2-9d00-4440-9814-425bdbb8ea55 admin admin] PATH_INFO: `/v3/projects/e251873f71214253a84f442689a439e1/users/7cc8560f17284b2783bd8d42f6466832/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:15.841682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa602f-fddb-4694-8c91-8b0c42b41418 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:15.847330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4b947-f9a6-4142-9069-05ae43656c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:15.848153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4b947-f9a6-4142-9069-05ae43656c59 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:15.848433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4b947-f9a6-4142-9069-05ae43656c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:15.848758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4b947-f9a6-4142-9069-05ae43656c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:15.849464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4b947-f9a6-4142-9069-05ae43656c59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:15.852095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4b947-f9a6-4142-9069-05ae43656c59 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:15.869860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5020b2-9d00-4440-9814-425bdbb8ea55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e251873f71214253a84f442689a439e1, user_id=7cc8560f17284b2783bd8d42f6466832, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:15.873715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5020b2-9d00-4440-9814-425bdbb8ea55 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:15.992532 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1102/2174] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:15 2022] POST /identity/v3/projects => generated 395 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:16.000997 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1073/2175] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:15 2022] PUT /identity/v3/projects/e251873f71214253a84f442689a439e1/users/7cc8560f17284b2783bd8d42f6466832/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:16.006619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5020b2-9d00-4440-9814-425bdbb8ea55 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:16.010484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4b947-f9a6-4142-9069-05ae43656c59 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:16.083958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:16.153993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4b947-f9a6-4142-9069-05ae43656c59 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:16.165484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b92895-bfca-43d3-9bd9-3ff66955f3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:16.168978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b92895-bfca-43d3-9bd9-3ff66955f3ba admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:16.169409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5020b2-9d00-4440-9814-425bdbb8ea55 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:16.170042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b92895-bfca-43d3-9bd9-3ff66955f3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:16.170391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b92895-bfca-43d3-9bd9-3ff66955f3ba admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:16.171586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b92895-bfca-43d3-9bd9-3ff66955f3ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:16.178455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b92895-bfca-43d3-9bd9-3ff66955f3ba admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:16.190092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56992bec-adbb-4e7f-8781-94cb0b1a8007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:16.195511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56992bec-adbb-4e7f-8781-94cb0b1a8007 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:16.195890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56992bec-adbb-4e7f-8781-94cb0b1a8007 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:16.196234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56992bec-adbb-4e7f-8781-94cb0b1a8007 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:16.197117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56992bec-adbb-4e7f-8781-94cb0b1a8007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:16.199043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56992bec-adbb-4e7f-8781-94cb0b1a8007 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:16.215052 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1074/2176] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:16.216925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56992bec-adbb-4e7f-8781-94cb0b1a8007 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:16.228915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56992bec-adbb-4e7f-8781-94cb0b1a8007 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:16.234106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b971186-8e42-46f4-8dfb-8777735ed5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:16.235800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b971186-8e42-46f4-8dfb-8777735ed5e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:16.236110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b971186-8e42-46f4-8dfb-8777735ed5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:16.236775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b971186-8e42-46f4-8dfb-8777735ed5e8 admin admin] PATH_INFO: `/v3/projects/e251873f71214253a84f442689a439e1/users/7cc8560f17284b2783bd8d42f6466832/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:16.239097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b971186-8e42-46f4-8dfb-8777735ed5e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e251873f71214253a84f442689a439e1, user_id=7cc8560f17284b2783bd8d42f6466832, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:16.241943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b971186-8e42-46f4-8dfb-8777735ed5e8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:16.259545 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1075/2177] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:16 2022] PUT /identity/v3/projects/e251873f71214253a84f442689a439e1/users/7cc8560f17284b2783bd8d42f6466832/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:16.274752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c729d-31e3-4ee1-a894-daa8abf70c9c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:16.275362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c729d-31e3-4ee1-a894-daa8abf70c9c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:16.276382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c729d-31e3-4ee1-a894-daa8abf70c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:16.307058 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1103/2178] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:16 2022] POST /identity/v3/users => generated 298 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:16.308089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b92895-bfca-43d3-9bd9-3ff66955f3ba admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:16.315409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f07c729d-31e3-4ee1-a894-daa8abf70c9c None None] MFA Rules not processed for user `7cc8560f17284b2783bd8d42f6466832`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:16.318848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f07c729d-31e3-4ee1-a894-daa8abf70c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:16.333495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b92895-bfca-43d3-9bd9-3ff66955f3ba admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:16.443318 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1076/2179] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:16.455257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c729d-31e3-4ee1-a894-daa8abf70c9c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:16.460351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f07c729d-31e3-4ee1-a894-daa8abf70c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:16.496785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fa361-c71b-417b-bb81-1a1c9826740f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:16.498821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fa361-c71b-417b-bb81-1a1c9826740f admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:16.499593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fa361-c71b-417b-bb81-1a1c9826740f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:16.503108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fa361-c71b-417b-bb81-1a1c9826740f admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:16.503108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95fa361-c71b-417b-bb81-1a1c9826740f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:16.507662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95fa361-c71b-417b-bb81-1a1c9826740f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:16.532685 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1104/2180] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:16.535273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fa361-c71b-417b-bb81-1a1c9826740f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:16.559712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fa361-c71b-417b-bb81-1a1c9826740f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:16.576155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc7617-f5cb-4605-a4a6-c79ca7a9347f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:16.577125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc7617-f5cb-4605-a4a6-c79ca7a9347f admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:16.577541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc7617-f5cb-4605-a4a6-c79ca7a9347f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:16.579276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc7617-f5cb-4605-a4a6-c79ca7a9347f admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:16.587585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc7617-f5cb-4605-a4a6-c79ca7a9347f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:16.588554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc7617-f5cb-4605-a4a6-c79ca7a9347f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:16.609460 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1105/2181] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:16.615177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc7617-f5cb-4605-a4a6-c79ca7a9347f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:16.630582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc7617-f5cb-4605-a4a6-c79ca7a9347f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:16.638977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305a186-1611-4e66-8532-dcb0c3eab10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:16.641697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305a186-1611-4e66-8532-dcb0c3eab10f admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:16.642282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305a186-1611-4e66-8532-dcb0c3eab10f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:16.642928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305a186-1611-4e66-8532-dcb0c3eab10f admin admin] PATH_INFO: `/v3/projects/4fcfaa54bdb445179a4e772933128170/users/abe83cdd50ad4fc09b91b69e995b3123/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:16.648079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c729d-31e3-4ee1-a894-daa8abf70c9c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:16.659721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f044a9-ee50-4c3d-b179-190248b197c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:16.660397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f044a9-ee50-4c3d-b179-190248b197c1 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:16.660677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f044a9-ee50-4c3d-b179-190248b197c1 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:16.660953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f044a9-ee50-4c3d-b179-190248b197c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:16.665633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305a186-1611-4e66-8532-dcb0c3eab10f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fcfaa54bdb445179a4e772933128170, user_id=abe83cdd50ad4fc09b91b69e995b3123, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:16.668994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305a186-1611-4e66-8532-dcb0c3eab10f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:16.674388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f044a9-ee50-4c3d-b179-190248b197c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:16.676072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f044a9-ee50-4c3d-b179-190248b197c1 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:16.689124 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1077/2182] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:16.691860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:16.783603 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1106/2183] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:16 2022] PUT /identity/v3/projects/4fcfaa54bdb445179a4e772933128170/users/abe83cdd50ad4fc09b91b69e995b3123/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:16.796165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489030c-16e2-4716-a6da-adf2953f358c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:16.796165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489030c-16e2-4716-a6da-adf2953f358c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:16.796165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489030c-16e2-4716-a6da-adf2953f358c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:16.837445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8489030c-16e2-4716-a6da-adf2953f358c None None] MFA Rules not processed for user `abe83cdd50ad4fc09b91b69e995b3123`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:16.842014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8489030c-16e2-4716-a6da-adf2953f358c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:16.936604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:16.947604 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1078/2184] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:16.977695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305a186-1611-4e66-8532-dcb0c3eab10f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:17.090810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305a186-1611-4e66-8532-dcb0c3eab10f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:17.097269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768382a8-7962-40c2-a371-3538c2a6e32e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:17.097983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768382a8-7962-40c2-a371-3538c2a6e32e service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:17.098340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768382a8-7962-40c2-a371-3538c2a6e32e service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:17.098691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768382a8-7962-40c2-a371-3538c2a6e32e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:17.214613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768382a8-7962-40c2-a371-3538c2a6e32e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:17.216401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768382a8-7962-40c2-a371-3538c2a6e32e service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:17.228916 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1107/2185] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:17.874894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0135fc1-3a36-468a-a290-5b618a6e3e4b None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:17.876010 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0135fc1-3a36-468a-a290-5b618a6e3e4b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:17.876495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0135fc1-3a36-468a-a290-5b618a6e3e4b None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:17.879430 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1079/2186] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:09:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:09:17.885194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768382a8-7962-40c2-a371-3538c2a6e32e service nova] Authenticating service token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:09:17.901462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768382a8-7962-40c2-a371-3538c2a6e32e service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:17.913643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768382a8-7962-40c2-a371-3538c2a6e32e service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:17.922492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdd18a-d041-44fb-abe2-6ef6ca2cddf0 tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '651cbc6596e24fcfa7232ddc273692ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '054de79bd580451bafa72a8e903ffab5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:17.923618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdd18a-d041-44fb-abe2-6ef6ca2cddf0 tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:17.923902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdd18a-d041-44fb-abe2-6ef6ca2cddf0 tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:17.924261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdd18a-d041-44fb-abe2-6ef6ca2cddf0 tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] PATH_INFO: `/v3/projects/6beaabf2d684478fac58e01a0d3a77fe` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:17.925524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fdd18a-d041-44fb-abe2-6ef6ca2cddf0 tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] RBAC: Authorizing `identity:get_project(project_id=6beaabf2d684478fac58e01a0d3a77fe)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:17.928969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fdd18a-d041-44fb-abe2-6ef6ca2cddf0 tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:17.930965 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1108/2187] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:09:17 2022] GET /identity/v3/projects/6beaabf2d684478fac58e01a0d3a77fe => generated 395 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:09:18.115812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f27c2-76e7-4f26-a9f8-0b758972c1c4 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:18.123190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f27c2-76e7-4f26-a9f8-0b758972c1c4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:18.123796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f27c2-76e7-4f26-a9f8-0b758972c1c4 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:18.126092 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1080/2188] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:09:18 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:09:18.131710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdd18a-d041-44fb-abe2-6ef6ca2cddf0 tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] Authenticating service token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:09:18.150898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdd18a-d041-44fb-abe2-6ef6ca2cddf0 tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:18.163289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdd18a-d041-44fb-abe2-6ef6ca2cddf0 tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:18.172985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b6674-1366-435e-8b4a-fdfa4b19ebeb tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '651cbc6596e24fcfa7232ddc273692ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '054de79bd580451bafa72a8e903ffab5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:18.177471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b6674-1366-435e-8b4a-fdfa4b19ebeb tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:18.177471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b6674-1366-435e-8b4a-fdfa4b19ebeb tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:18.177471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b6674-1366-435e-8b4a-fdfa4b19ebeb tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] PATH_INFO: `/v3/projects/6beaabf2d684478fac58e01a0d3a77fe` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:18.178751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b6674-1366-435e-8b4a-fdfa4b19ebeb tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] RBAC: Authorizing `identity:get_project(project_id=6beaabf2d684478fac58e01a0d3a77fe)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:18.182334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b6674-1366-435e-8b4a-fdfa4b19ebeb tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:18.196319 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1109/2189] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:09:18 2022] GET /identity/v3/projects/6beaabf2d684478fac58e01a0d3a77fe => generated 395 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:09:18.374638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163af53-675c-4b61-a7d7-b9a16f0efe12 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:18.374870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163af53-675c-4b61-a7d7-b9a16f0efe12 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:18.375620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163af53-675c-4b61-a7d7-b9a16f0efe12 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:18.377090 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1081/2190] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:09:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 21:09:18.384831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b6674-1366-435e-8b4a-fdfa4b19ebeb tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] Authenticating service token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:09:18.409113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b6674-1366-435e-8b4a-fdfa4b19ebeb tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:18.429633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b6674-1366-435e-8b4a-fdfa4b19ebeb tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:18.436863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88443703-6f58-4113-a618-94fc0001569d tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '651cbc6596e24fcfa7232ddc273692ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '054de79bd580451bafa72a8e903ffab5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:18.438516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88443703-6f58-4113-a618-94fc0001569d tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:18.439353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88443703-6f58-4113-a618-94fc0001569d tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:18.439874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88443703-6f58-4113-a618-94fc0001569d tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] PATH_INFO: `/v3/projects/6beaabf2d684478fac58e01a0d3a77fe` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:18.441499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88443703-6f58-4113-a618-94fc0001569d tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] RBAC: Authorizing `identity:get_project(project_id=6beaabf2d684478fac58e01a0d3a77fe)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:18.444984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88443703-6f58-4113-a618-94fc0001569d tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:18.454095 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1110/2191] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:09:18 2022] GET /identity/v3/projects/6beaabf2d684478fac58e01a0d3a77fe => generated 395 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:09:19.193403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:19.365134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:20.261850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:20.587966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163af53-675c-4b61-a7d7-b9a16f0efe12 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:20.595485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2163af53-675c-4b61-a7d7-b9a16f0efe12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:20.632925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163af53-675c-4b61-a7d7-b9a16f0efe12 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:20.659441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3853a2b-00f1-46d8-ad7b-989ccc9977a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:20.660591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3853a2b-00f1-46d8-ad7b-989ccc9977a4 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:20.661081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3853a2b-00f1-46d8-ad7b-989ccc9977a4 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:20.661571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3853a2b-00f1-46d8-ad7b-989ccc9977a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:20.789030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3853a2b-00f1-46d8-ad7b-989ccc9977a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:20.791051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3853a2b-00f1-46d8-ad7b-989ccc9977a4 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:20.815224 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1082/2192] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:21.803082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88443703-6f58-4113-a618-94fc0001569d tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:21.819491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88443703-6f58-4113-a618-94fc0001569d tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:21.840093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3cc355-29f3-4f2a-a5f3-4990a6125a19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:21.840813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cc355-29f3-4f2a-a5f3-4990a6125a19 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:21.841105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cc355-29f3-4f2a-a5f3-4990a6125a19 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:21.841380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cc355-29f3-4f2a-a5f3-4990a6125a19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:21.922671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290f884-1f93-4f5f-a2d1-c5dd74553a67 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:21.923172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290f884-1f93-4f5f-a2d1-c5dd74553a67 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:21.923262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290f884-1f93-4f5f-a2d1-c5dd74553a67 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:21.924721 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1083/2193] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:09:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 21:09:21.939096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290f884-1f93-4f5f-a2d1-c5dd74553a67 None None] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:09:21.947261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3cc355-29f3-4f2a-a5f3-4990a6125a19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:21.949279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3cc355-29f3-4f2a-a5f3-4990a6125a19 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:21.961785 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1111/2194] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:21.992317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290f884-1f93-4f5f-a2d1-c5dd74553a67 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:22.023027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290f884-1f93-4f5f-a2d1-c5dd74553a67 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:22.036428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b8a53-e8f2-4d8d-81d3-c5513daf3b3f tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '651cbc6596e24fcfa7232ddc273692ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '054de79bd580451bafa72a8e903ffab5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:22.037598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b8a53-e8f2-4d8d-81d3-c5513daf3b3f tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:22.038179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b8a53-e8f2-4d8d-81d3-c5513daf3b3f tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:22.038608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b8a53-e8f2-4d8d-81d3-c5513daf3b3f tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] PATH_INFO: `/v3/projects/6beaabf2d684478fac58e01a0d3a77fe` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:22.042871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b8a53-e8f2-4d8d-81d3-c5513daf3b3f tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] RBAC: Authorizing `identity:get_project(project_id=6beaabf2d684478fac58e01a0d3a77fe)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:22.045029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b8a53-e8f2-4d8d-81d3-c5513daf3b3f tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:22.053959 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1084/2195] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:09:21 2022] GET /identity/v3/projects/6beaabf2d684478fac58e01a0d3a77fe => generated 395 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:09:22.078780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3cc355-29f3-4f2a-a5f3-4990a6125a19 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:22.081355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ba3cc355-29f3-4f2a-a5f3-4990a6125a19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:22.143474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:22.205029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3cc355-29f3-4f2a-a5f3-4990a6125a19 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:22.216688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b4ad4-0f24-4bea-b107-4d887bcf3516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:22.217583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b4ad4-0f24-4bea-b107-4d887bcf3516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:22.217864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b4ad4-0f24-4bea-b107-4d887bcf3516 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:22.218142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b4ad4-0f24-4bea-b107-4d887bcf3516 admin admin] PATH_INFO: `/v3/users/700a44c6eacf41649a8d6d52eaa7f9f3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:22.220868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b4ad4-0f24-4bea-b107-4d887bcf3516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=700a44c6eacf41649a8d6d52eaa7f9f3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:22.222911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b4ad4-0f24-4bea-b107-4d887bcf3516 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:22.346496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6308e6-d4dc-4405-8277-0c750872a67b None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:22.346900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6308e6-d4dc-4405-8277-0c750872a67b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:22.347475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6308e6-d4dc-4405-8277-0c750872a67b None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:22.351099 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1085/2196] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:09:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:09:22.378925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ad5ac-b011-494a-90a6-7e781a5aa892 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:22.379336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ad5ac-b011-494a-90a6-7e781a5aa892 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:22.379932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ad5ac-b011-494a-90a6-7e781a5aa892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:22.429925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f92ad5ac-b011-494a-90a6-7e781a5aa892 None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:22.436820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f92ad5ac-b011-494a-90a6-7e781a5aa892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:22.472964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d23b4ad4-0f24-4bea-b107-4d887bcf3516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '700a44c6eacf41649a8d6d52eaa7f9f3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:22.486857 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1086/2197] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:09:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:22.489690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d614656-bb57-4840-a568-c21b2415b848 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:22.493562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d614656-bb57-4840-a568-c21b2415b848 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:22.494512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d614656-bb57-4840-a568-c21b2415b848 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:22.497361 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1087/2198] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:09:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:09:22.500823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d23b4ad4-0f24-4bea-b107-4d887bcf3516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '700a44c6eacf41649a8d6d52eaa7f9f3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:22.503868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d614656-bb57-4840-a568-c21b2415b848 None None] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:09:22.536850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d614656-bb57-4840-a568-c21b2415b848 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:22.548713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d614656-bb57-4840-a568-c21b2415b848 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:22.554179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a208a91-c857-4bd8-a0cb-a4a2f34a7ce3 tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '651cbc6596e24fcfa7232ddc273692ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '054de79bd580451bafa72a8e903ffab5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:22.558480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a208a91-c857-4bd8-a0cb-a4a2f34a7ce3 tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:22.558480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a208a91-c857-4bd8-a0cb-a4a2f34a7ce3 tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:22.558480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a208a91-c857-4bd8-a0cb-a4a2f34a7ce3 tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] PATH_INFO: `/v3/projects/6beaabf2d684478fac58e01a0d3a77fe` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:22.558480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a208a91-c857-4bd8-a0cb-a4a2f34a7ce3 tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] RBAC: Authorizing `identity:get_project(project_id=6beaabf2d684478fac58e01a0d3a77fe)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:22.559676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a208a91-c857-4bd8-a0cb-a4a2f34a7ce3 tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:22.561645 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1088/2199] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:09:22 2022] GET /identity/v3/projects/6beaabf2d684478fac58e01a0d3a77fe => generated 395 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:09:22.668893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:22.716056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d23b4ad4-0f24-4bea-b107-4d887bcf3516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '700a44c6eacf41649a8d6d52eaa7f9f3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:22.717190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d23b4ad4-0f24-4bea-b107-4d887bcf3516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '700a44c6eacf41649a8d6d52eaa7f9f3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:22.736247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a208a91-c857-4bd8-a0cb-a4a2f34a7ce3 tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:22.738595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7a208a91-c857-4bd8-a0cb-a4a2f34a7ce3 tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:22.758186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d23b4ad4-0f24-4bea-b107-4d887bcf3516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '700a44c6eacf41649a8d6d52eaa7f9f3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:22.760014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a208a91-c857-4bd8-a0cb-a4a2f34a7ce3 tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:22.767637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f537b6-c52f-40e5-90b6-33cc7fd0dabc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:22.771481 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1112/2200] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:09:22 2022] DELETE /identity/v3/users/700a44c6eacf41649a8d6d52eaa7f9f3 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:22.772464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f537b6-c52f-40e5-90b6-33cc7fd0dabc service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:22.772969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f537b6-c52f-40e5-90b6-33cc7fd0dabc service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:22.773408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f537b6-c52f-40e5-90b6-33cc7fd0dabc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:22.775519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b8f537b6-c52f-40e5-90b6-33cc7fd0dabc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:22.791290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f537b6-c52f-40e5-90b6-33cc7fd0dabc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:22.792988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f537b6-c52f-40e5-90b6-33cc7fd0dabc service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:22.829558 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1089/2201] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:09:23.739836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b4ad4-0f24-4bea-b107-4d887bcf3516 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:23.741346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d23b4ad4-0f24-4bea-b107-4d887bcf3516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:23.881639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b4ad4-0f24-4bea-b107-4d887bcf3516 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:23.890048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8c505-3ef7-4495-b210-023849ffe83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:23.891372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8c505-3ef7-4495-b210-023849ffe83b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:23.891675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8c505-3ef7-4495-b210-023849ffe83b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:23.891908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8c505-3ef7-4495-b210-023849ffe83b admin admin] PATH_INFO: `/v3/projects/ceca3fd7b56b43db929d4a6c7528e856` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:23.894162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8c505-3ef7-4495-b210-023849ffe83b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceca3fd7b56b43db929d4a6c7528e856)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:23.896932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8c505-3ef7-4495-b210-023849ffe83b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:24.023885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2aa8c505-3ef7-4495-b210-023849ffe83b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceca3fd7b56b43db929d4a6c7528e856', 'request_id': 'req-2aa8c505-3ef7-4495-b210-023849ffe83b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:24.035704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2aa8c505-3ef7-4495-b210-023849ffe83b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceca3fd7b56b43db929d4a6c7528e856', 'request_id': 'req-2aa8c505-3ef7-4495-b210-023849ffe83b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:24.044558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2aa8c505-3ef7-4495-b210-023849ffe83b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceca3fd7b56b43db929d4a6c7528e856', 'request_id': 'req-2aa8c505-3ef7-4495-b210-023849ffe83b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:24.148575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2aa8c505-3ef7-4495-b210-023849ffe83b admin admin] The token cache is being invalidate because project ceca3fd7b56b43db929d4a6c7528e856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:24.153205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2aa8c505-3ef7-4495-b210-023849ffe83b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:24.153205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2aa8c505-3ef7-4495-b210-023849ffe83b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:24.153205 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1113/2202] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:23 2022] DELETE /identity/v3/projects/ceca3fd7b56b43db929d4a6c7528e856 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:24.157314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f537b6-c52f-40e5-90b6-33cc7fd0dabc service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:24.173042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f537b6-c52f-40e5-90b6-33cc7fd0dabc service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:24.243873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e08cb-474f-4d66-9482-81f4ff90a06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:24.245029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e08cb-474f-4d66-9482-81f4ff90a06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:24.245310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e08cb-474f-4d66-9482-81f4ff90a06f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:24.245588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e08cb-474f-4d66-9482-81f4ff90a06f admin admin] PATH_INFO: `/v3/users/637bd247436f468cb66232d28cae9d11` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:24.246830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e08cb-474f-4d66-9482-81f4ff90a06f admin admin] RBAC: Authorizing `identity:delete_user(user_id=637bd247436f468cb66232d28cae9d11)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:24.249059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e08cb-474f-4d66-9482-81f4ff90a06f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:24.451744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a70e08cb-474f-4d66-9482-81f4ff90a06f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '637bd247436f468cb66232d28cae9d11'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:24.472449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a70e08cb-474f-4d66-9482-81f4ff90a06f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '637bd247436f468cb66232d28cae9d11'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:24.549217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a70e08cb-474f-4d66-9482-81f4ff90a06f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '637bd247436f468cb66232d28cae9d11'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:24.562664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a70e08cb-474f-4d66-9482-81f4ff90a06f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '637bd247436f468cb66232d28cae9d11'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:24.563666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a70e08cb-474f-4d66-9482-81f4ff90a06f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '637bd247436f468cb66232d28cae9d11'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:24.578621 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1090/2203] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:09:24 2022] DELETE /identity/v3/users/637bd247436f468cb66232d28cae9d11 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:24.686977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0e89d-4ddf-487c-80a3-d86dc76e62cf None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:24.687297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0e89d-4ddf-487c-80a3-d86dc76e62cf None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:24.687675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0e89d-4ddf-487c-80a3-d86dc76e62cf None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:24.689160 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1114/2204] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:09:24.701800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e08cb-474f-4d66-9482-81f4ff90a06f admin admin] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:09:24.704980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a70e08cb-474f-4d66-9482-81f4ff90a06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:24.813857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e08cb-474f-4d66-9482-81f4ff90a06f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:24.815471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a70e08cb-474f-4d66-9482-81f4ff90a06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:24.951479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e08cb-474f-4d66-9482-81f4ff90a06f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:24.963077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bb308-c036-4b73-992a-43a151e8718b tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '651cbc6596e24fcfa7232ddc273692ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '054de79bd580451bafa72a8e903ffab5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:24.964339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bb308-c036-4b73-992a-43a151e8718b tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:24.964854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bb308-c036-4b73-992a-43a151e8718b tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:24.965043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bb308-c036-4b73-992a-43a151e8718b tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] PATH_INFO: `/v3/projects/4fcfaa54bdb445179a4e772933128170` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:24.966410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269bb308-c036-4b73-992a-43a151e8718b tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] RBAC: Authorizing `identity:get_project(project_id=4fcfaa54bdb445179a4e772933128170)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:24.970335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269bb308-c036-4b73-992a-43a151e8718b tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:24.973675 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1091/2205] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:09:24 2022] GET /identity/v3/projects/4fcfaa54bdb445179a4e772933128170 => generated 395 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:09:25.052222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0e89d-4ddf-487c-80a3-d86dc76e62cf None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:25.064046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6ca0e89d-4ddf-487c-80a3-d86dc76e62cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:25.170659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0e89d-4ddf-487c-80a3-d86dc76e62cf None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:25.190026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33643679-ab30-478c-8572-06721a7f18f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:25.190986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33643679-ab30-478c-8572-06721a7f18f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:25.191330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33643679-ab30-478c-8572-06721a7f18f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:25.191629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33643679-ab30-478c-8572-06721a7f18f3 admin admin] PATH_INFO: `/v3/projects/a5ba9cfa3207476b81dd1988390480c7` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:25.193428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33643679-ab30-478c-8572-06721a7f18f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ba9cfa3207476b81dd1988390480c7)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:25.197392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:25.200305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33643679-ab30-478c-8572-06721a7f18f3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:25.232494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bb308-c036-4b73-992a-43a151e8718b tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:25.234934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-269bb308-c036-4b73-992a-43a151e8718b tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:25.255736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bb308-c036-4b73-992a-43a151e8718b tempest-FlavorsAccessNegativeTestJSON-1113799613 tempest-FlavorsAccessNegativeTestJSON-1113799613-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:25.276519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838f5b7-e14b-4d49-a128-b7d696c5a4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:25.283689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838f5b7-e14b-4d49-a128-b7d696c5a4a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:25.284339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838f5b7-e14b-4d49-a128-b7d696c5a4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:25.284829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838f5b7-e14b-4d49-a128-b7d696c5a4a9 admin admin] PATH_INFO: `/v3/users/a0d51dd7cf834374b6a05298707b3ef1` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:25.287131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838f5b7-e14b-4d49-a128-b7d696c5a4a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0d51dd7cf834374b6a05298707b3ef1)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:25.289490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838f5b7-e14b-4d49-a128-b7d696c5a4a9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:25.559397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-33643679-ab30-478c-8572-06721a7f18f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ba9cfa3207476b81dd1988390480c7', 'request_id': 'req-33643679-ab30-478c-8572-06721a7f18f3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:25.559761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f838f5b7-e14b-4d49-a128-b7d696c5a4a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0d51dd7cf834374b6a05298707b3ef1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:25.569115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-33643679-ab30-478c-8572-06721a7f18f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ba9cfa3207476b81dd1988390480c7', 'request_id': 'req-33643679-ab30-478c-8572-06721a7f18f3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:25.578118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-33643679-ab30-478c-8572-06721a7f18f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ba9cfa3207476b81dd1988390480c7', 'request_id': 'req-33643679-ab30-478c-8572-06721a7f18f3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:25.580350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f838f5b7-e14b-4d49-a128-b7d696c5a4a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0d51dd7cf834374b6a05298707b3ef1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:25.674459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-33643679-ab30-478c-8572-06721a7f18f3 admin admin] The token cache is being invalidate because project a5ba9cfa3207476b81dd1988390480c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:25.674845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-33643679-ab30-478c-8572-06721a7f18f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:25.676010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-33643679-ab30-478c-8572-06721a7f18f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:25.677133 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1115/2206] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:25 2022] DELETE /identity/v3/projects/a5ba9cfa3207476b81dd1988390480c7 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:25.682190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dcc8f-12a7-4101-b89d-dcf3dfd4785f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:25.682481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dcc8f-12a7-4101-b89d-dcf3dfd4785f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:25.682761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dcc8f-12a7-4101-b89d-dcf3dfd4785f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:25.701826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-618dcc8f-12a7-4101-b89d-dcf3dfd4785f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:25.703319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-618dcc8f-12a7-4101-b89d-dcf3dfd4785f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:25.744327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f838f5b7-e14b-4d49-a128-b7d696c5a4a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0d51dd7cf834374b6a05298707b3ef1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:25.757521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f838f5b7-e14b-4d49-a128-b7d696c5a4a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0d51dd7cf834374b6a05298707b3ef1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:25.758596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f838f5b7-e14b-4d49-a128-b7d696c5a4a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0d51dd7cf834374b6a05298707b3ef1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:25.772074 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1092/2207] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:09:25 2022] DELETE /identity/v3/users/a0d51dd7cf834374b6a05298707b3ef1 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:09:25.775104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062b1d0-0b9a-435c-9e7f-07c878f5ee71 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:25.781939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062b1d0-0b9a-435c-9e7f-07c878f5ee71 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:25.782627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062b1d0-0b9a-435c-9e7f-07c878f5ee71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:25.791055 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1116/2208] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:25.791055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631a0af-f161-4b8d-bb0b-2007115f8340 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:25.791055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631a0af-f161-4b8d-bb0b-2007115f8340 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:25.791055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631a0af-f161-4b8d-bb0b-2007115f8340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:25.818839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d631a0af-f161-4b8d-bb0b-2007115f8340 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:25.823056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d631a0af-f161-4b8d-bb0b-2007115f8340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:25.851085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:25.871160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0062b1d0-0b9a-435c-9e7f-07c878f5ee71 None None] MFA Rules not processed for user `ff57da59f5c5440dbcc198885643e41d`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:25.872590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0062b1d0-0b9a-435c-9e7f-07c878f5ee71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:25.968412 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1117/2209] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:25.970868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8444e9c-2844-4d54-af5f-fc36dcac4e60 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:25.971183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8444e9c-2844-4d54-af5f-fc36dcac4e60 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:25.971458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8444e9c-2844-4d54-af5f-fc36dcac4e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:25.993029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f8444e9c-2844-4d54-af5f-fc36dcac4e60 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:25.994247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f8444e9c-2844-4d54-af5f-fc36dcac4e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:26.011704 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1093/2210] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:25 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:26.011704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062b1d0-0b9a-435c-9e7f-07c878f5ee71 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:26.021640 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1118/2211] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:26.025258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0062b1d0-0b9a-435c-9e7f-07c878f5ee71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:26.027215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a8de5-2031-411e-a930-2ad9d67ebb53 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:26.027501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a8de5-2031-411e-a930-2ad9d67ebb53 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:26.027777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a8de5-2031-411e-a930-2ad9d67ebb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:26.054017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9d5a8de5-2031-411e-a930-2ad9d67ebb53 None None] MFA Rules not processed for user `6a69f9dee03d43beaafa966216b9e289`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:26.056031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9d5a8de5-2031-411e-a930-2ad9d67ebb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:26.129079 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1119/2212] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:26.130978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a8de5-2031-411e-a930-2ad9d67ebb53 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:26.132040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062b1d0-0b9a-435c-9e7f-07c878f5ee71 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:26.145324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a8de5-2031-411e-a930-2ad9d67ebb53 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:26.146356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289034c-7524-4100-85a7-8086d7a5ec38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:26.147073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289034c-7524-4100-85a7-8086d7a5ec38 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:26.147365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289034c-7524-4100-85a7-8086d7a5ec38 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:26.147675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289034c-7524-4100-85a7-8086d7a5ec38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:26.162933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a400a-2197-4afb-adbf-ae3ad9dac99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:26.164162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a400a-2197-4afb-adbf-ae3ad9dac99b admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:26.164663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a400a-2197-4afb-adbf-ae3ad9dac99b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:26.165265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a400a-2197-4afb-adbf-ae3ad9dac99b admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:26.166176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a400a-2197-4afb-adbf-ae3ad9dac99b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:09:26.167306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a400a-2197-4afb-adbf-ae3ad9dac99b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:26.169233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a400a-2197-4afb-adbf-ae3ad9dac99b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:26.187977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289034c-7524-4100-85a7-8086d7a5ec38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:26.192786 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1120/2213] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:09:26.193050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289034c-7524-4100-85a7-8086d7a5ec38 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:26.193146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a400a-2197-4afb-adbf-ae3ad9dac99b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:26.195670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c21a400a-2197-4afb-adbf-ae3ad9dac99b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:26.215799 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1094/2214] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:26.218616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289034c-7524-4100-85a7-8086d7a5ec38 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:26.233141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289034c-7524-4100-85a7-8086d7a5ec38 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:26.241951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea2b99-67d4-454a-aba5-26bd2b7b7002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:26.244588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea2b99-67d4-454a-aba5-26bd2b7b7002 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:26.244588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea2b99-67d4-454a-aba5-26bd2b7b7002 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:26.245482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea2b99-67d4-454a-aba5-26bd2b7b7002 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:26.246493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea2b99-67d4-454a-aba5-26bd2b7b7002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:26.257343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea2b99-67d4-454a-aba5-26bd2b7b7002 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:26.333665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a400a-2197-4afb-adbf-ae3ad9dac99b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:26.339863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebd317-0921-468a-ae3f-34b62645b0e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:26.340595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebd317-0921-468a-ae3f-34b62645b0e1 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:26.340944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebd317-0921-468a-ae3f-34b62645b0e1 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:26.341288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebd317-0921-468a-ae3f-34b62645b0e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:26.343257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c8ebd317-0921-468a-ae3f-34b62645b0e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:26.363989 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1095/2215] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:26 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:26.365919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea2b99-67d4-454a-aba5-26bd2b7b7002 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:26.379597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ebd317-0921-468a-ae3f-34b62645b0e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:26.382027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ebd317-0921-468a-ae3f-34b62645b0e1 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:26.399904 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1121/2216] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:26.453729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea2b99-67d4-454a-aba5-26bd2b7b7002 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:26.459878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3199731-3db0-45e4-b141-c43d0d678ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:26.460575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3199731-3db0-45e4-b141-c43d0d678ffe admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:26.460860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3199731-3db0-45e4-b141-c43d0d678ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:26.461138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3199731-3db0-45e4-b141-c43d0d678ffe admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:26.462014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3199731-3db0-45e4-b141-c43d0d678ffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:26.465290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3199731-3db0-45e4-b141-c43d0d678ffe admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:26.564128 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1096/2217] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:26 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:26.565732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebd317-0921-468a-ae3f-34b62645b0e1 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:26.584963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebd317-0921-468a-ae3f-34b62645b0e1 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:26.590568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:26.599815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec77614-207e-4968-91f1-a238515aac5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:26.601389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec77614-207e-4968-91f1-a238515aac5b admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:26.601821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec77614-207e-4968-91f1-a238515aac5b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:26.602176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec77614-207e-4968-91f1-a238515aac5b admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:26.603442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec77614-207e-4968-91f1-a238515aac5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:26.605734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec77614-207e-4968-91f1-a238515aac5b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:26.623718 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1122/2218] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:26.625120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3199731-3db0-45e4-b141-c43d0d678ffe admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:26.637354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3199731-3db0-45e4-b141-c43d0d678ffe admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:26.644108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5cb88-bcde-42cd-bf38-fee51fbbb9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:26.644797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5cb88-bcde-42cd-bf38-fee51fbbb9fc admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:26.645676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5cb88-bcde-42cd-bf38-fee51fbbb9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:26.646113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5cb88-bcde-42cd-bf38-fee51fbbb9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:26.647075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5cb88-bcde-42cd-bf38-fee51fbbb9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:26.648813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5cb88-bcde-42cd-bf38-fee51fbbb9fc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:26.662568 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1097/2219] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:26.673109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec77614-207e-4968-91f1-a238515aac5b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:26.685702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec77614-207e-4968-91f1-a238515aac5b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:26.692180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13e172-543a-4511-8af6-847203aad6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:26.693895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13e172-543a-4511-8af6-847203aad6c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:26.694538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13e172-543a-4511-8af6-847203aad6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:26.694783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13e172-543a-4511-8af6-847203aad6c1 admin admin] PATH_INFO: `/v3/projects/fb6deae6b08e4ed8b15dc6edfe1d38d3/users/ba60685a2001459cbfb531d95a6b296e/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:26.709485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5cb88-bcde-42cd-bf38-fee51fbbb9fc admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:26.711041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d2a5cb88-bcde-42cd-bf38-fee51fbbb9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:26.720246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13e172-543a-4511-8af6-847203aad6c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6deae6b08e4ed8b15dc6edfe1d38d3, user_id=ba60685a2001459cbfb531d95a6b296e, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:26.723468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13e172-543a-4511-8af6-847203aad6c1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:26.733310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5cb88-bcde-42cd-bf38-fee51fbbb9fc admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:26.740822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbdcfa-7191-44c9-82fd-5d4ac3df809c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:26.742015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbdcfa-7191-44c9-82fd-5d4ac3df809c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:26.742441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbdcfa-7191-44c9-82fd-5d4ac3df809c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:26.742903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbdcfa-7191-44c9-82fd-5d4ac3df809c admin admin] PATH_INFO: `/v3/users/9b1dca63a7a94fe8b40a3967f7a293e1` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:26.744392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fbdcfa-7191-44c9-82fd-5d4ac3df809c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b1dca63a7a94fe8b40a3967f7a293e1)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:26.746754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fbdcfa-7191-44c9-82fd-5d4ac3df809c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:26.863353 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1123/2220] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:26 2022] PUT /identity/v3/projects/fb6deae6b08e4ed8b15dc6edfe1d38d3/users/ba60685a2001459cbfb531d95a6b296e/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:26.864788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c321b81-6910-4d64-aa70-8abea9e76aab None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:26.865047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c321b81-6910-4d64-aa70-8abea9e76aab None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:26.865400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c321b81-6910-4d64-aa70-8abea9e76aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:26.890186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9c321b81-6910-4d64-aa70-8abea9e76aab None None] MFA Rules not processed for user `fbd858f3e6ba4523b056bbdc2af427b0`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:26.891488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9c321b81-6910-4d64-aa70-8abea9e76aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:26.976986 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1124/2221] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:09:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:26.978220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c6b4d-df59-4bdd-940f-cc734fc309c6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:26.978514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c6b4d-df59-4bdd-940f-cc734fc309c6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:26.978790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c6b4d-df59-4bdd-940f-cc734fc309c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:27.013040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-880c6b4d-df59-4bdd-940f-cc734fc309c6 None None] MFA Rules not processed for user `ba60685a2001459cbfb531d95a6b296e`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:27.016337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-880c6b4d-df59-4bdd-940f-cc734fc309c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:27.037827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-44fbdcfa-7191-44c9-82fd-5d4ac3df809c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b1dca63a7a94fe8b40a3967f7a293e1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:27.067658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-44fbdcfa-7191-44c9-82fd-5d4ac3df809c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b1dca63a7a94fe8b40a3967f7a293e1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:27.127493 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1125/2222] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:27.128776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c6b4d-df59-4bdd-940f-cc734fc309c6 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:27.130593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-880c6b4d-df59-4bdd-940f-cc734fc309c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:27.131999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-44fbdcfa-7191-44c9-82fd-5d4ac3df809c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b1dca63a7a94fe8b40a3967f7a293e1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:27.140732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-44fbdcfa-7191-44c9-82fd-5d4ac3df809c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b1dca63a7a94fe8b40a3967f7a293e1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:27.146279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-44fbdcfa-7191-44c9-82fd-5d4ac3df809c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b1dca63a7a94fe8b40a3967f7a293e1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:27.157554 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1098/2223] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:09:26 2022] DELETE /identity/v3/users/9b1dca63a7a94fe8b40a3967f7a293e1 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:27.164132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbdcfa-7191-44c9-82fd-5d4ac3df809c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:27.164132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-44fbdcfa-7191-44c9-82fd-5d4ac3df809c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:27.267234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c6b4d-df59-4bdd-940f-cc734fc309c6 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:27.296177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbdcfa-7191-44c9-82fd-5d4ac3df809c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:27.309945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a3ed4-e801-4f4e-9fd9-fa9734cccc1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:27.310728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a3ed4-e801-4f4e-9fd9-fa9734cccc1d service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:27.311249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a3ed4-e801-4f4e-9fd9-fa9734cccc1d service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:27.311626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a3ed4-e801-4f4e-9fd9-fa9734cccc1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:27.319866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d58a3ed4-e801-4f4e-9fd9-fa9734cccc1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:27.337623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a3ed4-e801-4f4e-9fd9-fa9734cccc1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:27.337623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a3ed4-e801-4f4e-9fd9-fa9734cccc1d service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:27.347286 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1099/2224] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:27.348590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a3ed4-e801-4f4e-9fd9-fa9734cccc1d service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:27.349604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d58a3ed4-e801-4f4e-9fd9-fa9734cccc1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:27.367766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8e12e-26f9-4992-934c-bcd08fe35f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:27.368706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8e12e-26f9-4992-934c-bcd08fe35f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:27.368992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8e12e-26f9-4992-934c-bcd08fe35f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:27.369268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8e12e-26f9-4992-934c-bcd08fe35f76 admin admin] PATH_INFO: `/v3/projects/6beaabf2d684478fac58e01a0d3a77fe` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:27.370471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8e12e-26f9-4992-934c-bcd08fe35f76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6beaabf2d684478fac58e01a0d3a77fe)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:27.372848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8e12e-26f9-4992-934c-bcd08fe35f76 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:27.430896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a3ed4-e801-4f4e-9fd9-fa9734cccc1d service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:27.436510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084b03e-9b94-496a-a487-5e946c303518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:27.437998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084b03e-9b94-496a-a487-5e946c303518 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:27.438384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084b03e-9b94-496a-a487-5e946c303518 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:27.438769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084b03e-9b94-496a-a487-5e946c303518 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:27.439617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084b03e-9b94-496a-a487-5e946c303518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:27.441645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084b03e-9b94-496a-a487-5e946c303518 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:27.536424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cfc8e12e-26f9-4992-934c-bcd08fe35f76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6beaabf2d684478fac58e01a0d3a77fe', 'request_id': 'req-cfc8e12e-26f9-4992-934c-bcd08fe35f76'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:27.550038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cfc8e12e-26f9-4992-934c-bcd08fe35f76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6beaabf2d684478fac58e01a0d3a77fe', 'request_id': 'req-cfc8e12e-26f9-4992-934c-bcd08fe35f76'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:27.564482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cfc8e12e-26f9-4992-934c-bcd08fe35f76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6beaabf2d684478fac58e01a0d3a77fe', 'request_id': 'req-cfc8e12e-26f9-4992-934c-bcd08fe35f76'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:27.629771 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1100/2225] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:27 2022] POST /identity/v3/projects => generated 375 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:27.629771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb2041-a23f-42b2-bb31-a99ca2273363 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:27.629771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb2041-a23f-42b2-bb31-a99ca2273363 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:27.629771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb2041-a23f-42b2-bb31-a99ca2273363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:27.646384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cfc8e12e-26f9-4992-934c-bcd08fe35f76 admin admin] The token cache is being invalidate because project 6beaabf2d684478fac58e01a0d3a77fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:27.646925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cfc8e12e-26f9-4992-934c-bcd08fe35f76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:27.651295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cfc8e12e-26f9-4992-934c-bcd08fe35f76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:27.655541 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1126/2226] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:27 2022] DELETE /identity/v3/projects/6beaabf2d684478fac58e01a0d3a77fe => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:27.656671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8e12e-26f9-4992-934c-bcd08fe35f76 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:27.665010 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a4bb2041-a23f-42b2-bb31-a99ca2273363 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:27.667620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a4bb2041-a23f-42b2-bb31-a99ca2273363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:27.668233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cfc8e12e-26f9-4992-934c-bcd08fe35f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:27.766704 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1101/2227] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:27.767716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb2041-a23f-42b2-bb31-a99ca2273363 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:27.773525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a4bb2041-a23f-42b2-bb31-a99ca2273363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:27.796312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb2041-a23f-42b2-bb31-a99ca2273363 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:27.798423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8e12e-26f9-4992-934c-bcd08fe35f76 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:27.802193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aff4bf-ed79-4459-9052-010b5895fb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:27.803080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aff4bf-ed79-4459-9052-010b5895fb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:27.803354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aff4bf-ed79-4459-9052-010b5895fb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:27.803654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aff4bf-ed79-4459-9052-010b5895fb35 admin admin] PATH_INFO: `/v3/users/651cbc6596e24fcfa7232ddc273692ae` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:27.804291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011aaaf9-1a3c-430c-a27d-305e44603c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:27.804903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011aaaf9-1a3c-430c-a27d-305e44603c66 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:27.805214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aff4bf-ed79-4459-9052-010b5895fb35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=651cbc6596e24fcfa7232ddc273692ae)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:27.805354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011aaaf9-1a3c-430c-a27d-305e44603c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:27.805600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011aaaf9-1a3c-430c-a27d-305e44603c66 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:27.806349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011aaaf9-1a3c-430c-a27d-305e44603c66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:27.807190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aff4bf-ed79-4459-9052-010b5895fb35 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:27.808680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011aaaf9-1a3c-430c-a27d-305e44603c66 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:27.941489 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1127/2228] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:27 2022] POST /identity/v3/users => generated 294 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:27.942328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011aaaf9-1a3c-430c-a27d-305e44603c66 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:27.953144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-011aaaf9-1a3c-430c-a27d-305e44603c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:28.010523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:28.056192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011aaaf9-1a3c-430c-a27d-305e44603c66 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:28.071782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29274fb-8369-41ef-bf5a-90826eb5bb51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:28.072473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29274fb-8369-41ef-bf5a-90826eb5bb51 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:28.072822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29274fb-8369-41ef-bf5a-90826eb5bb51 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:28.073022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29274fb-8369-41ef-bf5a-90826eb5bb51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:28.095110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29274fb-8369-41ef-bf5a-90826eb5bb51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:28.098462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29274fb-8369-41ef-bf5a-90826eb5bb51 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:28.113483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-26aff4bf-ed79-4459-9052-010b5895fb35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '651cbc6596e24fcfa7232ddc273692ae'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:28.116080 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1128/2229] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:28.135885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29274fb-8369-41ef-bf5a-90826eb5bb51 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:28.148496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-26aff4bf-ed79-4459-9052-010b5895fb35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '651cbc6596e24fcfa7232ddc273692ae'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:28.150178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29274fb-8369-41ef-bf5a-90826eb5bb51 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:28.157193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be248f-eb83-4e7e-96c0-417fbbcaf5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:28.158715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be248f-eb83-4e7e-96c0-417fbbcaf5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:28.159295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be248f-eb83-4e7e-96c0-417fbbcaf5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:28.159775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be248f-eb83-4e7e-96c0-417fbbcaf5e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:28.161169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be248f-eb83-4e7e-96c0-417fbbcaf5e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:28.162808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be248f-eb83-4e7e-96c0-417fbbcaf5e4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:28.180404 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1129/2230] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:28.184556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be248f-eb83-4e7e-96c0-417fbbcaf5e4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:28.204359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be248f-eb83-4e7e-96c0-417fbbcaf5e4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:28.211552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be2a42-7574-4312-98be-f10f7fd9b326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:28.212589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be2a42-7574-4312-98be-f10f7fd9b326 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:28.212956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be2a42-7574-4312-98be-f10f7fd9b326 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:28.213357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be2a42-7574-4312-98be-f10f7fd9b326 admin admin] PATH_INFO: `/v3/projects/d2c43412361646d1a14ffec32a0a02bd/users/a9f9d4731e4d46c9ac9bc60e50746b33/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:28.250166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-26aff4bf-ed79-4459-9052-010b5895fb35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '651cbc6596e24fcfa7232ddc273692ae'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:28.261392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-26aff4bf-ed79-4459-9052-010b5895fb35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '651cbc6596e24fcfa7232ddc273692ae'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:28.263377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-26aff4bf-ed79-4459-9052-010b5895fb35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '651cbc6596e24fcfa7232ddc273692ae'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:28.286869 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1102/2231] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:09:27 2022] DELETE /identity/v3/users/651cbc6596e24fcfa7232ddc273692ae => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:28.298321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be2a42-7574-4312-98be-f10f7fd9b326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c43412361646d1a14ffec32a0a02bd, user_id=a9f9d4731e4d46c9ac9bc60e50746b33, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:28.302228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be2a42-7574-4312-98be-f10f7fd9b326 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:28.433884 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1130/2232] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:28 2022] PUT /identity/v3/projects/d2c43412361646d1a14ffec32a0a02bd/users/a9f9d4731e4d46c9ac9bc60e50746b33/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:09:28.437892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aff4bf-ed79-4459-9052-010b5895fb35 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:28.439900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-26aff4bf-ed79-4459-9052-010b5895fb35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:28.612650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aff4bf-ed79-4459-9052-010b5895fb35 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:28.743345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1becab-e678-4c1d-af29-e883e68158cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:28.746172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1becab-e678-4c1d-af29-e883e68158cf admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:28.746673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1becab-e678-4c1d-af29-e883e68158cf admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:28.747235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1becab-e678-4c1d-af29-e883e68158cf admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:28.750816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1becab-e678-4c1d-af29-e883e68158cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:28.756320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1becab-e678-4c1d-af29-e883e68158cf admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:28.792749 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1103/2233] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:28.797076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be2a42-7574-4312-98be-f10f7fd9b326 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:28.814934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be2a42-7574-4312-98be-f10f7fd9b326 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:28.821353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0accc98-7306-4beb-9ffd-59ee679821b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:28.822333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0accc98-7306-4beb-9ffd-59ee679821b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:28.822613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0accc98-7306-4beb-9ffd-59ee679821b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:28.822889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0accc98-7306-4beb-9ffd-59ee679821b2 admin admin] PATH_INFO: `/v3/projects/d2c43412361646d1a14ffec32a0a02bd/users/a9f9d4731e4d46c9ac9bc60e50746b33/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:28.827920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0accc98-7306-4beb-9ffd-59ee679821b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c43412361646d1a14ffec32a0a02bd, user_id=a9f9d4731e4d46c9ac9bc60e50746b33, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:28.832553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0accc98-7306-4beb-9ffd-59ee679821b2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:28.850406 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1131/2234] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:28 2022] PUT /identity/v3/projects/d2c43412361646d1a14ffec32a0a02bd/users/a9f9d4731e4d46c9ac9bc60e50746b33/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:28.864700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bebb0d-7061-465c-8b44-d2d9cd977540 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:28.864992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bebb0d-7061-465c-8b44-d2d9cd977540 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:28.865294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bebb0d-7061-465c-8b44-d2d9cd977540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:28.910015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-47bebb0d-7061-465c-8b44-d2d9cd977540 None None] MFA Rules not processed for user `a9f9d4731e4d46c9ac9bc60e50746b33`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:28.912131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-47bebb0d-7061-465c-8b44-d2d9cd977540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:29.074258 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1104/2235] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:29.075066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37417fcf-81d6-4e2e-bde8-0f09f55b053e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:29.075066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37417fcf-81d6-4e2e-bde8-0f09f55b053e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:29.075066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37417fcf-81d6-4e2e-bde8-0f09f55b053e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:29.098597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-37417fcf-81d6-4e2e-bde8-0f09f55b053e None None] MFA Rules not processed for user `ba60685a2001459cbfb531d95a6b296e`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:29.101164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-37417fcf-81d6-4e2e-bde8-0f09f55b053e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:29.141539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bebb0d-7061-465c-8b44-d2d9cd977540 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:29.143138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-47bebb0d-7061-465c-8b44-d2d9cd977540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:29.242109 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1132/2236] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:29.244324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37417fcf-81d6-4e2e-bde8-0f09f55b053e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:29.247223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-37417fcf-81d6-4e2e-bde8-0f09f55b053e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:29.293161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bebb0d-7061-465c-8b44-d2d9cd977540 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:29.301986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0eb27-1a5e-4171-9887-7ef0a3ae862c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:29.302995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0eb27-1a5e-4171-9887-7ef0a3ae862c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:29.303409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0eb27-1a5e-4171-9887-7ef0a3ae862c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:29.303795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0eb27-1a5e-4171-9887-7ef0a3ae862c admin admin] PATH_INFO: `/v3/projects/f792890ae08b44fd90d0eed3a7a9877f` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:29.305749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0eb27-1a5e-4171-9887-7ef0a3ae862c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f792890ae08b44fd90d0eed3a7a9877f)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:29.307890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0eb27-1a5e-4171-9887-7ef0a3ae862c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:29.378174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37417fcf-81d6-4e2e-bde8-0f09f55b053e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:29.394303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4148e6-ccce-4932-8e64-262cb5c8be2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:29.396370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4148e6-ccce-4932-8e64-262cb5c8be2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:29.396850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4148e6-ccce-4932-8e64-262cb5c8be2e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:29.397139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4148e6-ccce-4932-8e64-262cb5c8be2e admin admin] PATH_INFO: `/v3/projects/054de79bd580451bafa72a8e903ffab5` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:29.399103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4148e6-ccce-4932-8e64-262cb5c8be2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=054de79bd580451bafa72a8e903ffab5)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:29.401171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4148e6-ccce-4932-8e64-262cb5c8be2e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:29.511329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-13b0eb27-1a5e-4171-9887-7ef0a3ae862c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f792890ae08b44fd90d0eed3a7a9877f', 'request_id': 'req-13b0eb27-1a5e-4171-9887-7ef0a3ae862c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:29.519854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-13b0eb27-1a5e-4171-9887-7ef0a3ae862c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f792890ae08b44fd90d0eed3a7a9877f', 'request_id': 'req-13b0eb27-1a5e-4171-9887-7ef0a3ae862c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:29.527446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-13b0eb27-1a5e-4171-9887-7ef0a3ae862c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f792890ae08b44fd90d0eed3a7a9877f', 'request_id': 'req-13b0eb27-1a5e-4171-9887-7ef0a3ae862c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:29.558542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5d4148e6-ccce-4932-8e64-262cb5c8be2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '054de79bd580451bafa72a8e903ffab5', 'request_id': 'req-5d4148e6-ccce-4932-8e64-262cb5c8be2e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:29.566786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5d4148e6-ccce-4932-8e64-262cb5c8be2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '054de79bd580451bafa72a8e903ffab5', 'request_id': 'req-5d4148e6-ccce-4932-8e64-262cb5c8be2e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:29.574456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5d4148e6-ccce-4932-8e64-262cb5c8be2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '054de79bd580451bafa72a8e903ffab5', 'request_id': 'req-5d4148e6-ccce-4932-8e64-262cb5c8be2e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:29.641918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-13b0eb27-1a5e-4171-9887-7ef0a3ae862c admin admin] The token cache is being invalidate because project f792890ae08b44fd90d0eed3a7a9877f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:29.642348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-13b0eb27-1a5e-4171-9887-7ef0a3ae862c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:29.643684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-13b0eb27-1a5e-4171-9887-7ef0a3ae862c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:29.648950 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1105/2237] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:29 2022] DELETE /identity/v3/projects/f792890ae08b44fd90d0eed3a7a9877f => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:29.650538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0eb27-1a5e-4171-9887-7ef0a3ae862c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:29.652415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-13b0eb27-1a5e-4171-9887-7ef0a3ae862c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:29.685272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=2,keystone:DELETE=5,keystone:SELECT=93 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:29.719561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5d4148e6-ccce-4932-8e64-262cb5c8be2e admin admin] The token cache is being invalidate because project 054de79bd580451bafa72a8e903ffab5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:29.720004 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5d4148e6-ccce-4932-8e64-262cb5c8be2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:29.721922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5d4148e6-ccce-4932-8e64-262cb5c8be2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:29.725646 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1133/2238] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:29 2022] DELETE /identity/v3/projects/054de79bd580451bafa72a8e903ffab5 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:29.728595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4148e6-ccce-4932-8e64-262cb5c8be2e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:29.728965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5d4148e6-ccce-4932-8e64-262cb5c8be2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:29.810140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0eb27-1a5e-4171-9887-7ef0a3ae862c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:29.841630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4148e6-ccce-4932-8e64-262cb5c8be2e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:29.847276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b18ec-bfe6-4cde-a023-47fb93ff49bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:29.848355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b18ec-bfe6-4cde-a023-47fb93ff49bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:29.848791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b18ec-bfe6-4cde-a023-47fb93ff49bd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:29.849086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b18ec-bfe6-4cde-a023-47fb93ff49bd admin admin] PATH_INFO: `/v3/users/7cc8560f17284b2783bd8d42f6466832` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:29.850690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b18ec-bfe6-4cde-a023-47fb93ff49bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cc8560f17284b2783bd8d42f6466832)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:29.853391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b18ec-bfe6-4cde-a023-47fb93ff49bd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:29.901173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbb844-ee19-43fe-8a74-1a3472834cda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:29.901844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbb844-ee19-43fe-8a74-1a3472834cda service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:29.902128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbb844-ee19-43fe-8a74-1a3472834cda service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:29.902517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbb844-ee19-43fe-8a74-1a3472834cda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:29.904366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f9dbb844-ee19-43fe-8a74-1a3472834cda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:29.973332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbb844-ee19-43fe-8a74-1a3472834cda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:29.977967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbb844-ee19-43fe-8a74-1a3472834cda service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:29.995234 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1106/2239] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:30.000218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbb844-ee19-43fe-8a74-1a3472834cda service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:30.000218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f9dbb844-ee19-43fe-8a74-1a3472834cda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:30.016364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbb844-ee19-43fe-8a74-1a3472834cda service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:30.022128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1f0a3-9d10-4b3b-84e0-6aa7d679299b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:30.023035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1f0a3-9d10-4b3b-84e0-6aa7d679299b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:30.023365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1f0a3-9d10-4b3b-84e0-6aa7d679299b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:30.023779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1f0a3-9d10-4b3b-84e0-6aa7d679299b admin admin] PATH_INFO: `/v3/users/abe83cdd50ad4fc09b91b69e995b3123` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:30.025000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1f0a3-9d10-4b3b-84e0-6aa7d679299b admin admin] RBAC: Authorizing `identity:delete_user(user_id=abe83cdd50ad4fc09b91b69e995b3123)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:30.026922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1f0a3-9d10-4b3b-84e0-6aa7d679299b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:30.072304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-281b18ec-bfe6-4cde-a023-47fb93ff49bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cc8560f17284b2783bd8d42f6466832'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:30.078444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-281b18ec-bfe6-4cde-a023-47fb93ff49bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cc8560f17284b2783bd8d42f6466832'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:30.085171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:30.176467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-281b18ec-bfe6-4cde-a023-47fb93ff49bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cc8560f17284b2783bd8d42f6466832'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:30.177517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-281b18ec-bfe6-4cde-a023-47fb93ff49bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cc8560f17284b2783bd8d42f6466832'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:30.203778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-281b18ec-bfe6-4cde-a023-47fb93ff49bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cc8560f17284b2783bd8d42f6466832'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:30.211561 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1134/2240] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:09:29 2022] DELETE /identity/v3/users/7cc8560f17284b2783bd8d42f6466832 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:30.212625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b18ec-bfe6-4cde-a023-47fb93ff49bd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:30.214120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-281b18ec-bfe6-4cde-a023-47fb93ff49bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:30.248731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fba1f0a3-9d10-4b3b-84e0-6aa7d679299b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abe83cdd50ad4fc09b91b69e995b3123'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:30.281058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fba1f0a3-9d10-4b3b-84e0-6aa7d679299b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abe83cdd50ad4fc09b91b69e995b3123'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:30.343937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b18ec-bfe6-4cde-a023-47fb93ff49bd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:30.357644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392e121-7505-4ea2-970c-1dedd33eb4b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:30.359073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392e121-7505-4ea2-970c-1dedd33eb4b5 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:30.359656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392e121-7505-4ea2-970c-1dedd33eb4b5 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:30.360170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392e121-7505-4ea2-970c-1dedd33eb4b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:30.363768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4392e121-7505-4ea2-970c-1dedd33eb4b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:30.413482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fba1f0a3-9d10-4b3b-84e0-6aa7d679299b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abe83cdd50ad4fc09b91b69e995b3123'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:30.448992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fba1f0a3-9d10-4b3b-84e0-6aa7d679299b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abe83cdd50ad4fc09b91b69e995b3123'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:30.449854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fba1f0a3-9d10-4b3b-84e0-6aa7d679299b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abe83cdd50ad4fc09b91b69e995b3123'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:30.457817 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1107/2241] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:09:29 2022] DELETE /identity/v3/users/abe83cdd50ad4fc09b91b69e995b3123 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:30.503985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392e121-7505-4ea2-970c-1dedd33eb4b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:30.505705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392e121-7505-4ea2-970c-1dedd33eb4b5 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:30.525824 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1135/2242] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:31.159444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1f0a3-9d10-4b3b-84e0-6aa7d679299b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:31.160188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392e121-7505-4ea2-970c-1dedd33eb4b5 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:31.161901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fba1f0a3-9d10-4b3b-84e0-6aa7d679299b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:31.163821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4392e121-7505-4ea2-970c-1dedd33eb4b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:31.322386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1f0a3-9d10-4b3b-84e0-6aa7d679299b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:31.328955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392e121-7505-4ea2-970c-1dedd33eb4b5 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:31.334560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b8e8e-d916-468f-bde3-8addc550cc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:31.336269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b8e8e-d916-468f-bde3-8addc550cc11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:31.336658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b8e8e-d916-468f-bde3-8addc550cc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:31.337032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b8e8e-d916-468f-bde3-8addc550cc11 admin admin] PATH_INFO: `/v3/projects/e251873f71214253a84f442689a439e1` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:31.342112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b8e8e-d916-468f-bde3-8addc550cc11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e251873f71214253a84f442689a439e1)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:31.343090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb0d18-0dcb-4a25-be69-92a0c2eb9e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:31.343912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb0d18-0dcb-4a25-be69-92a0c2eb9e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:31.344192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb0d18-0dcb-4a25-be69-92a0c2eb9e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:31.344724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b8e8e-d916-468f-bde3-8addc550cc11 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:31.344814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb0d18-0dcb-4a25-be69-92a0c2eb9e57 admin admin] PATH_INFO: `/v3/projects/4fcfaa54bdb445179a4e772933128170` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:31.347137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb0d18-0dcb-4a25-be69-92a0c2eb9e57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fcfaa54bdb445179a4e772933128170)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:31.349149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb0d18-0dcb-4a25-be69-92a0c2eb9e57 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:31.504234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1c2b8e8e-d916-468f-bde3-8addc550cc11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e251873f71214253a84f442689a439e1', 'request_id': 'req-1c2b8e8e-d916-468f-bde3-8addc550cc11'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:31.506689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-edfb0d18-0dcb-4a25-be69-92a0c2eb9e57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fcfaa54bdb445179a4e772933128170', 'request_id': 'req-edfb0d18-0dcb-4a25-be69-92a0c2eb9e57'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:31.510287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1c2b8e8e-d916-468f-bde3-8addc550cc11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e251873f71214253a84f442689a439e1', 'request_id': 'req-1c2b8e8e-d916-468f-bde3-8addc550cc11'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:31.513370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-edfb0d18-0dcb-4a25-be69-92a0c2eb9e57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fcfaa54bdb445179a4e772933128170', 'request_id': 'req-edfb0d18-0dcb-4a25-be69-92a0c2eb9e57'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:31.518440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1c2b8e8e-d916-468f-bde3-8addc550cc11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e251873f71214253a84f442689a439e1', 'request_id': 'req-1c2b8e8e-d916-468f-bde3-8addc550cc11'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:31.539961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-edfb0d18-0dcb-4a25-be69-92a0c2eb9e57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fcfaa54bdb445179a4e772933128170', 'request_id': 'req-edfb0d18-0dcb-4a25-be69-92a0c2eb9e57'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:31.609715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1c2b8e8e-d916-468f-bde3-8addc550cc11 admin admin] The token cache is being invalidate because project e251873f71214253a84f442689a439e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:31.610025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1c2b8e8e-d916-468f-bde3-8addc550cc11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:31.610855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1c2b8e8e-d916-468f-bde3-8addc550cc11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:31.612883 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1108/2243] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:31 2022] DELETE /identity/v3/projects/e251873f71214253a84f442689a439e1 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:09:31.614128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc689e9-3bd3-4fec-84c8-3e4505bdbf9e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:31.614414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc689e9-3bd3-4fec-84c8-3e4505bdbf9e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:31.614693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc689e9-3bd3-4fec-84c8-3e4505bdbf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:31.634227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ecc689e9-3bd3-4fec-84c8-3e4505bdbf9e None None] MFA Rules not processed for user `abeb7020019d41a18de42956d706a011`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:31.635598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ecc689e9-3bd3-4fec-84c8-3e4505bdbf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:31.693221 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1109/2244] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:31.694838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48afcd-8bcf-417c-896c-1b89407b9ac4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:31.695882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48afcd-8bcf-417c-896c-1b89407b9ac4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:31.695882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48afcd-8bcf-417c-896c-1b89407b9ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:31.716501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7a48afcd-8bcf-417c-896c-1b89407b9ac4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:31.717950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7a48afcd-8bcf-417c-896c-1b89407b9ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:31.793141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-edfb0d18-0dcb-4a25-be69-92a0c2eb9e57 admin admin] The token cache is being invalidate because project 4fcfaa54bdb445179a4e772933128170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:31.793737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-edfb0d18-0dcb-4a25-be69-92a0c2eb9e57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:31.794570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-edfb0d18-0dcb-4a25-be69-92a0c2eb9e57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:31.802307 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1136/2245] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:31 2022] DELETE /identity/v3/projects/4fcfaa54bdb445179a4e772933128170 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:31.804106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de000f-a1fc-4a83-99ba-abc0938003d4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:31.804846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de000f-a1fc-4a83-99ba-abc0938003d4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:31.805422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de000f-a1fc-4a83-99ba-abc0938003d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:31.816773 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1110/2246] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:31.841532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937b67b-6eee-4367-8a91-8bdfacdcdf4d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:31.841532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937b67b-6eee-4367-8a91-8bdfacdcdf4d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:31.841532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937b67b-6eee-4367-8a91-8bdfacdcdf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:31.856743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-42de000f-a1fc-4a83-99ba-abc0938003d4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:31.859456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8937b67b-6eee-4367-8a91-8bdfacdcdf4d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:31.859456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8937b67b-6eee-4367-8a91-8bdfacdcdf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:31.859648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-42de000f-a1fc-4a83-99ba-abc0938003d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:31.878417 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1111/2247] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:09:31.878417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937b67b-6eee-4367-8a91-8bdfacdcdf4d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:31.879329 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1137/2248] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:31.880933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60461272-605b-4de7-b39d-e970eee53bc9 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:31.881415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60461272-605b-4de7-b39d-e970eee53bc9 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:31.881864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60461272-605b-4de7-b39d-e970eee53bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:31.888751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937b67b-6eee-4367-8a91-8bdfacdcdf4d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:31.896938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38ac3b-7bbc-477f-ab1c-7cb16f4a835c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:31.897758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38ac3b-7bbc-477f-ab1c-7cb16f4a835c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:31.898425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38ac3b-7bbc-477f-ab1c-7cb16f4a835c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:31.898705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38ac3b-7bbc-477f-ab1c-7cb16f4a835c admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:31.900666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38ac3b-7bbc-477f-ab1c-7cb16f4a835c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:09:31.900994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38ac3b-7bbc-477f-ab1c-7cb16f4a835c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:31.903478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38ac3b-7bbc-477f-ab1c-7cb16f4a835c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:31.906464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-60461272-605b-4de7-b39d-e970eee53bc9 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:31.907858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-60461272-605b-4de7-b39d-e970eee53bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:31.923773 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1112/2250] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:09:31.923977 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1138/2250] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:31.925161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38ac3b-7bbc-477f-ab1c-7cb16f4a835c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:31.925287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60461272-605b-4de7-b39d-e970eee53bc9 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:31.937157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60461272-605b-4de7-b39d-e970eee53bc9 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:31.937686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38ac3b-7bbc-477f-ab1c-7cb16f4a835c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:31.943627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d28d43-e839-4d29-927e-5af655e4efb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:31.944558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d28d43-e839-4d29-927e-5af655e4efb4 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:31.945020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d28d43-e839-4d29-927e-5af655e4efb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:31.945474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffeaa8-7027-4bd2-88fb-e095074e9cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:31.946180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffeaa8-7027-4bd2-88fb-e095074e9cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:31.946447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffeaa8-7027-4bd2-88fb-e095074e9cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:31.946770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffeaa8-7027-4bd2-88fb-e095074e9cb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:31.947756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d28d43-e839-4d29-927e-5af655e4efb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:31.948903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d28d43-e839-4d29-927e-5af655e4efb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:31.949662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffeaa8-7027-4bd2-88fb-e095074e9cb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:09:31.950230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffeaa8-7027-4bd2-88fb-e095074e9cb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:31.952165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d28d43-e839-4d29-927e-5af655e4efb4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:31.952445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffeaa8-7027-4bd2-88fb-e095074e9cb6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:31.978545 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1113/2251] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:09:31.981580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffeaa8-7027-4bd2-88fb-e095074e9cb6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:31.996139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffeaa8-7027-4bd2-88fb-e095074e9cb6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:32.002348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8ecb2-834e-4037-a07c-d8ccda74b9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:32.003421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8ecb2-834e-4037-a07c-d8ccda74b9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:32.003709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8ecb2-834e-4037-a07c-d8ccda74b9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:32.003986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8ecb2-834e-4037-a07c-d8ccda74b9e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:32.004680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8ecb2-834e-4037-a07c-d8ccda74b9e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:32.006695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8ecb2-834e-4037-a07c-d8ccda74b9e5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:32.083591 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1139/2252] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:31 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:32.089110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d28d43-e839-4d29-927e-5af655e4efb4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:32.122545 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1114/2253] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:31 2022] POST /identity/v3/projects => generated 401 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:32.123644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8ecb2-834e-4037-a07c-d8ccda74b9e5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:32.161766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d28d43-e839-4d29-927e-5af655e4efb4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:32.207871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8ecb2-834e-4037-a07c-d8ccda74b9e5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:32.215859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b27ff3-044a-4190-b292-78e898710926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:32.216646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b27ff3-044a-4190-b292-78e898710926 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:32.217024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b27ff3-044a-4190-b292-78e898710926 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:32.217391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b27ff3-044a-4190-b292-78e898710926 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:32.218927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b27ff3-044a-4190-b292-78e898710926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:32.222139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b27ff3-044a-4190-b292-78e898710926 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:32.251240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b71c9-79f9-4e72-b17a-0df7097b0adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:32.252974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b71c9-79f9-4e72-b17a-0df7097b0adf admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:32.253261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b71c9-79f9-4e72-b17a-0df7097b0adf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:32.253538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b71c9-79f9-4e72-b17a-0df7097b0adf admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:32.254874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b71c9-79f9-4e72-b17a-0df7097b0adf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:32.257205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b71c9-79f9-4e72-b17a-0df7097b0adf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:32.359001 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1115/2254] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:32 2022] POST /identity/v3/users => generated 301 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:32.363857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b27ff3-044a-4190-b292-78e898710926 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:32.377640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b27ff3-044a-4190-b292-78e898710926 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:32.383383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:32.386880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2905583-e8c9-4b7c-a88f-9e14a8b829ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:32.387653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2905583-e8c9-4b7c-a88f-9e14a8b829ec admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:32.387935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2905583-e8c9-4b7c-a88f-9e14a8b829ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:32.388282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2905583-e8c9-4b7c-a88f-9e14a8b829ec admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:32.389012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2905583-e8c9-4b7c-a88f-9e14a8b829ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:32.390868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2905583-e8c9-4b7c-a88f-9e14a8b829ec admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:32.398142 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1140/2255] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:32 2022] POST /identity/v3/users => generated 293 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:32.403070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b71c9-79f9-4e72-b17a-0df7097b0adf admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:32.409898 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1116/2256] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:32.414936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2905583-e8c9-4b7c-a88f-9e14a8b829ec admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:32.424584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b71c9-79f9-4e72-b17a-0df7097b0adf admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:32.428778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2905583-e8c9-4b7c-a88f-9e14a8b829ec admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:32.431714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ac369-50db-4142-927e-b25c0dead91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:32.432412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ac369-50db-4142-927e-b25c0dead91a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:32.432722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ac369-50db-4142-927e-b25c0dead91a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:32.433026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ac369-50db-4142-927e-b25c0dead91a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:32.433788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ac369-50db-4142-927e-b25c0dead91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:32.434691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3c9a6-b9e4-494b-9782-f120e4adb1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:32.435522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3c9a6-b9e4-494b-9782-f120e4adb1be admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:32.435653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ac369-50db-4142-927e-b25c0dead91a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:32.436071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3c9a6-b9e4-494b-9782-f120e4adb1be admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:32.436536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3c9a6-b9e4-494b-9782-f120e4adb1be admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:32.437237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3c9a6-b9e4-494b-9782-f120e4adb1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:32.439351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3c9a6-b9e4-494b-9782-f120e4adb1be admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:32.460162 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1141/2257] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:09:32.460376 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1117/2258] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:32.462964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ac369-50db-4142-927e-b25c0dead91a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:32.464742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3c9a6-b9e4-494b-9782-f120e4adb1be admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:32.476820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ac369-50db-4142-927e-b25c0dead91a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:32.477519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3c9a6-b9e4-494b-9782-f120e4adb1be admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:32.483417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56deb1ff-c3f0-4054-b7d6-73974c2f3ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:32.483652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fc4d3-136b-4423-b1e3-78d0a5ee203b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:32.484439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fc4d3-136b-4423-b1e3-78d0a5ee203b admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:32.484722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fc4d3-136b-4423-b1e3-78d0a5ee203b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:32.485125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fc4d3-136b-4423-b1e3-78d0a5ee203b admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:32.485497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56deb1ff-c3f0-4054-b7d6-73974c2f3ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:32.486712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56deb1ff-c3f0-4054-b7d6-73974c2f3ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:32.487292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578fc4d3-136b-4423-b1e3-78d0a5ee203b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:32.487424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56deb1ff-c3f0-4054-b7d6-73974c2f3ec7 admin admin] PATH_INFO: `/v3/projects/5fcfd03d78284545bd934e58574f5f17/users/95424d5b83cb45a8a291dc5c2e511ca4/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:32.492755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578fc4d3-136b-4423-b1e3-78d0a5ee203b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:32.503710 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1142/2259] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:32.506873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56deb1ff-c3f0-4054-b7d6-73974c2f3ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fcfd03d78284545bd934e58574f5f17, user_id=95424d5b83cb45a8a291dc5c2e511ca4, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:32.507829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fc4d3-136b-4423-b1e3-78d0a5ee203b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:32.510460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56deb1ff-c3f0-4054-b7d6-73974c2f3ec7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:32.518443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fc4d3-136b-4423-b1e3-78d0a5ee203b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:32.531702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cf53d-1343-4230-9ddd-b4dfe128603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:32.531702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cf53d-1343-4230-9ddd-b4dfe128603c admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:32.531702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cf53d-1343-4230-9ddd-b4dfe128603c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:32.531702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cf53d-1343-4230-9ddd-b4dfe128603c admin admin] PATH_INFO: `/v3/projects/8e86da1bb2724074ac3d2be147ade96b/users/b9b9a9d263d546249dd6558efd855073/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:32.540068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cf53d-1343-4230-9ddd-b4dfe128603c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e86da1bb2724074ac3d2be147ade96b, user_id=b9b9a9d263d546249dd6558efd855073, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:32.542748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cf53d-1343-4230-9ddd-b4dfe128603c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:33.011961 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1143/2260] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:32 2022] PUT /identity/v3/projects/8e86da1bb2724074ac3d2be147ade96b/users/b9b9a9d263d546249dd6558efd855073/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:09:33.014895 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1118/2261] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:32 2022] PUT /identity/v3/projects/5fcfd03d78284545bd934e58574f5f17/users/95424d5b83cb45a8a291dc5c2e511ca4/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:33.027370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aaccc-4a0f-4c97-9f86-3fbee22d5c89 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:33.030719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e14269-e063-4c43-b37b-5cf99bdd3892 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:33.030842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aaccc-4a0f-4c97-9f86-3fbee22d5c89 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:33.030842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aaccc-4a0f-4c97-9f86-3fbee22d5c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:33.031062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e14269-e063-4c43-b37b-5cf99bdd3892 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:33.031062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e14269-e063-4c43-b37b-5cf99bdd3892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:33.059938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-38e14269-e063-4c43-b37b-5cf99bdd3892 None None] MFA Rules not processed for user `95424d5b83cb45a8a291dc5c2e511ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:33.061826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-38e14269-e063-4c43-b37b-5cf99bdd3892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:33.076482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-fb3aaccc-4a0f-4c97-9f86-3fbee22d5c89 None None] MFA Rules not processed for user `b9b9a9d263d546249dd6558efd855073`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:33.077794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fb3aaccc-4a0f-4c97-9f86-3fbee22d5c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:33.154350 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1119/2262] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:33.159255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e14269-e063-4c43-b37b-5cf99bdd3892 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:33.170443 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1144/2263] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:09:33.175072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aaccc-4a0f-4c97-9f86-3fbee22d5c89 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:33.240942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e14269-e063-4c43-b37b-5cf99bdd3892 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:33.246437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ce2b8-0ae6-49f0-89fe-035d84770d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:33.247136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ce2b8-0ae6-49f0-89fe-035d84770d34 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:33.247415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ce2b8-0ae6-49f0-89fe-035d84770d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:33.247690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ce2b8-0ae6-49f0-89fe-035d84770d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:33.248383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ce2b8-0ae6-49f0-89fe-035d84770d34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:33.250652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ce2b8-0ae6-49f0-89fe-035d84770d34 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:33.262805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aaccc-4a0f-4c97-9f86-3fbee22d5c89 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:33.273492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302c764-d61a-4300-8c08-6bdd922b29d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:33.274303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302c764-d61a-4300-8c08-6bdd922b29d9 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:33.274590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302c764-d61a-4300-8c08-6bdd922b29d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:33.275152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302c764-d61a-4300-8c08-6bdd922b29d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:33.276477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302c764-d61a-4300-8c08-6bdd922b29d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:33.278664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302c764-d61a-4300-8c08-6bdd922b29d9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:33.380411 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1120/2264] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:33 2022] POST /identity/v3/projects => generated 403 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:33.388249 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1145/2265] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:33 2022] POST /identity/v3/projects => generated 383 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:09:33.388476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ce2b8-0ae6-49f0-89fe-035d84770d34 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:33.391988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302c764-d61a-4300-8c08-6bdd922b29d9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:33.487519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ce2b8-0ae6-49f0-89fe-035d84770d34 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:33.521823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:33.524350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302c764-d61a-4300-8c08-6bdd922b29d9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:33.540240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7156b8-92fd-43f4-b14c-46bfb3b60713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:33.546241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7156b8-92fd-43f4-b14c-46bfb3b60713 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:33.546241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7156b8-92fd-43f4-b14c-46bfb3b60713 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:33.546241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7156b8-92fd-43f4-b14c-46bfb3b60713 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:33.546241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7156b8-92fd-43f4-b14c-46bfb3b60713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:33.552777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7156b8-92fd-43f4-b14c-46bfb3b60713 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:33.606973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337af501-0c00-43fe-860b-08917ac4a6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:33.607901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337af501-0c00-43fe-860b-08917ac4a6dd admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:33.608183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337af501-0c00-43fe-860b-08917ac4a6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:33.608459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337af501-0c00-43fe-860b-08917ac4a6dd admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:33.609158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337af501-0c00-43fe-860b-08917ac4a6dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:33.614473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337af501-0c00-43fe-860b-08917ac4a6dd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:33.753796 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1146/2266] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:33 2022] POST /identity/v3/users => generated 298 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:09:33.761979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7156b8-92fd-43f4-b14c-46bfb3b60713 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:33.761979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9a7156b8-92fd-43f4-b14c-46bfb3b60713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:33.824091 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1121/2267] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:33 2022] POST /identity/v3/users => generated 308 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:33.825164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337af501-0c00-43fe-860b-08917ac4a6dd admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:33.835933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337af501-0c00-43fe-860b-08917ac4a6dd admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:33.844615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c7a99-574e-4110-9e28-8f0b947ab529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:33.845373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c7a99-574e-4110-9e28-8f0b947ab529 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:33.845654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c7a99-574e-4110-9e28-8f0b947ab529 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:33.845789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c7a99-574e-4110-9e28-8f0b947ab529 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:33.846473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c7a99-574e-4110-9e28-8f0b947ab529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:33.848499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c7a99-574e-4110-9e28-8f0b947ab529 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:33.862817 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1122/2268] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:33.864823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c7a99-574e-4110-9e28-8f0b947ab529 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:33.881616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c7a99-574e-4110-9e28-8f0b947ab529 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:33.884923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7156b8-92fd-43f4-b14c-46bfb3b60713 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:33.893987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61899e0-6c91-484c-a343-278c656cd774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:33.893987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61899e0-6c91-484c-a343-278c656cd774 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:33.893987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61899e0-6c91-484c-a343-278c656cd774 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:33.893987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61899e0-6c91-484c-a343-278c656cd774 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:33.894363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61899e0-6c91-484c-a343-278c656cd774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:33.894440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e555e-0d90-4959-a32c-1edbe4f4faa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:33.894621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e555e-0d90-4959-a32c-1edbe4f4faa2 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:33.895277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e555e-0d90-4959-a32c-1edbe4f4faa2 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:33.895558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e555e-0d90-4959-a32c-1edbe4f4faa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:33.895654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61899e0-6c91-484c-a343-278c656cd774 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:33.897433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-472e555e-0d90-4959-a32c-1edbe4f4faa2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:33.913048 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1123/2269] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:33.913048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61899e0-6c91-484c-a343-278c656cd774 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:33.933941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61899e0-6c91-484c-a343-278c656cd774 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:33.957484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163c09a-02c1-4df3-ae42-a301a9daa7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:33.962310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163c09a-02c1-4df3-ae42-a301a9daa7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:33.962310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163c09a-02c1-4df3-ae42-a301a9daa7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:33.962310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163c09a-02c1-4df3-ae42-a301a9daa7b5 admin admin] PATH_INFO: `/v3/projects/d3e838b91b61415ca0755461b83fe74b/users/e6d8247e10864ad49c9f4a7aa9a0c036/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:33.997714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163c09a-02c1-4df3-ae42-a301a9daa7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e838b91b61415ca0755461b83fe74b, user_id=e6d8247e10864ad49c9f4a7aa9a0c036, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:34.008061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163c09a-02c1-4df3-ae42-a301a9daa7b5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:34.041913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e555e-0d90-4959-a32c-1edbe4f4faa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:34.044133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e555e-0d90-4959-a32c-1edbe4f4faa2 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:34.069497 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1147/2270] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:34.071440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e555e-0d90-4959-a32c-1edbe4f4faa2 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:34.093064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e555e-0d90-4959-a32c-1edbe4f4faa2 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:34.098566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982c110-f182-48f2-962d-2bcf0d05d88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:34.099931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982c110-f182-48f2-962d-2bcf0d05d88e admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:34.099931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982c110-f182-48f2-962d-2bcf0d05d88e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:34.100212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982c110-f182-48f2-962d-2bcf0d05d88e admin admin] PATH_INFO: `/v3/projects/792720ef974e4498b36e3faf082bb51b/users/454d449792ca4f9e8b524fb38e7576ff/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:34.118018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982c110-f182-48f2-962d-2bcf0d05d88e admin admin] RBAC: Authorizing `identity:create_grant(project_id=792720ef974e4498b36e3faf082bb51b, user_id=454d449792ca4f9e8b524fb38e7576ff, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:34.120854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982c110-f182-48f2-962d-2bcf0d05d88e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:34.139623 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1124/2271] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:33 2022] PUT /identity/v3/projects/d3e838b91b61415ca0755461b83fe74b/users/e6d8247e10864ad49c9f4a7aa9a0c036/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:34.141410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163c09a-02c1-4df3-ae42-a301a9daa7b5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:34.237596 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1148/2272] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:34 2022] PUT /identity/v3/projects/792720ef974e4498b36e3faf082bb51b/users/454d449792ca4f9e8b524fb38e7576ff/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:34.238890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982c110-f182-48f2-962d-2bcf0d05d88e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:34.312056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163c09a-02c1-4df3-ae42-a301a9daa7b5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:34.417021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982c110-f182-48f2-962d-2bcf0d05d88e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:34.437146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5e685-afcc-46b2-b5b9-367e51830a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:34.438674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5e685-afcc-46b2-b5b9-367e51830a48 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:34.440382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e1b49-360e-4c8e-8607-9ff1ba5dd548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:34.441068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e1b49-360e-4c8e-8607-9ff1ba5dd548 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:34.441354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e1b49-360e-4c8e-8607-9ff1ba5dd548 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:34.441678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5e685-afcc-46b2-b5b9-367e51830a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:34.442171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5e685-afcc-46b2-b5b9-367e51830a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:34.442905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e1b49-360e-4c8e-8607-9ff1ba5dd548 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:34.443549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5e685-afcc-46b2-b5b9-367e51830a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:34.445374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5e685-afcc-46b2-b5b9-367e51830a48 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:34.447490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e1b49-360e-4c8e-8607-9ff1ba5dd548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:34.449413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e1b49-360e-4c8e-8607-9ff1ba5dd548 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:34.472503 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1149/2273] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:09:34.477114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e1b49-360e-4c8e-8607-9ff1ba5dd548 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:34.481768 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1125/2274] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:09:34.487509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5e685-afcc-46b2-b5b9-367e51830a48 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:34.492441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e1b49-360e-4c8e-8607-9ff1ba5dd548 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:34.498328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d308600-c488-471f-a2f5-454c6bfe0138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:34.500000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d308600-c488-471f-a2f5-454c6bfe0138 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:34.500000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d308600-c488-471f-a2f5-454c6bfe0138 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:34.500000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d308600-c488-471f-a2f5-454c6bfe0138 admin admin] PATH_INFO: `/v3/projects/792720ef974e4498b36e3faf082bb51b/users/454d449792ca4f9e8b524fb38e7576ff/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:34.502564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d308600-c488-471f-a2f5-454c6bfe0138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=792720ef974e4498b36e3faf082bb51b, user_id=454d449792ca4f9e8b524fb38e7576ff, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:34.505297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d308600-c488-471f-a2f5-454c6bfe0138 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:34.513432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5e685-afcc-46b2-b5b9-367e51830a48 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:34.543283 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1150/2275] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:34 2022] PUT /identity/v3/projects/792720ef974e4498b36e3faf082bb51b/users/454d449792ca4f9e8b524fb38e7576ff/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:09:34.554570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad764e5-174b-4db2-aff1-d694976c597a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:34.555501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad764e5-174b-4db2-aff1-d694976c597a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:34.556018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad764e5-174b-4db2-aff1-d694976c597a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:34.607444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-bad764e5-174b-4db2-aff1-d694976c597a None None] MFA Rules not processed for user `454d449792ca4f9e8b524fb38e7576ff`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:34.609064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bad764e5-174b-4db2-aff1-d694976c597a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:34.655570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a4544-7623-47d9-a2c1-659a064278bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:34.658655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a4544-7623-47d9-a2c1-659a064278bb admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:34.658655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a4544-7623-47d9-a2c1-659a064278bb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:34.659743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a4544-7623-47d9-a2c1-659a064278bb admin admin] PATH_INFO: `/v3/projects/d3e838b91b61415ca0755461b83fe74b/users/e6d8247e10864ad49c9f4a7aa9a0c036/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:34.662316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a4544-7623-47d9-a2c1-659a064278bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e838b91b61415ca0755461b83fe74b, user_id=e6d8247e10864ad49c9f4a7aa9a0c036, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:34.666124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a4544-7623-47d9-a2c1-659a064278bb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:34.683235 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1126/2276] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:34 2022] PUT /identity/v3/projects/d3e838b91b61415ca0755461b83fe74b/users/e6d8247e10864ad49c9f4a7aa9a0c036/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:34.694383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be918335-2188-4d06-88b9-51f8c8d5c1a7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:34.694686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be918335-2188-4d06-88b9-51f8c8d5c1a7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:34.694971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be918335-2188-4d06-88b9-51f8c8d5c1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:34.730667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-be918335-2188-4d06-88b9-51f8c8d5c1a7 None None] MFA Rules not processed for user `e6d8247e10864ad49c9f4a7aa9a0c036`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:34.733209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-be918335-2188-4d06-88b9-51f8c8d5c1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:34.736564 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1151/2277] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:34 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:34.737956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a8ebe-c544-46b4-85c5-f56422923fac None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:34.738242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a8ebe-c544-46b4-85c5-f56422923fac None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:34.738601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a8ebe-c544-46b4-85c5-f56422923fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:34.762690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1e4a8ebe-c544-46b4-85c5-f56422923fac None None] MFA Rules not processed for user `0d72626f465b4f37ad3b18bb945d4000`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:34.764518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1e4a8ebe-c544-46b4-85c5-f56422923fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:34.827244 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1127/2278] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:34.832380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be918335-2188-4d06-88b9-51f8c8d5c1a7 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:34.832380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-be918335-2188-4d06-88b9-51f8c8d5c1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:34.867065 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1152/2279] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:34.938173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be918335-2188-4d06-88b9-51f8c8d5c1a7 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:34.944604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfda34-74b6-4552-a006-1c07a106a48a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:34.945304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfda34-74b6-4552-a006-1c07a106a48a service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:34.945594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfda34-74b6-4552-a006-1c07a106a48a service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:34.945876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfda34-74b6-4552-a006-1c07a106a48a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:35.008996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a8ebe-c544-46b4-85c5-f56422923fac None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:35.011296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfda34-74b6-4552-a006-1c07a106a48a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:35.013123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfda34-74b6-4552-a006-1c07a106a48a service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:35.024662 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1128/2280] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:34 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:35.037813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a8ebe-c544-46b4-85c5-f56422923fac None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:35.043401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a9aab-c8f9-4756-9424-59b0477268df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:35.044074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a9aab-c8f9-4756-9424-59b0477268df service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:35.044353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a9aab-c8f9-4756-9424-59b0477268df service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:35.044654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a9aab-c8f9-4756-9424-59b0477268df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:35.053776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a9aab-c8f9-4756-9424-59b0477268df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:35.056337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a9aab-c8f9-4756-9424-59b0477268df service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:35.065500 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1153/2281] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:35.385562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfda34-74b6-4552-a006-1c07a106a48a service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:35.397548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfda34-74b6-4552-a006-1c07a106a48a service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:35.403858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace04ce6-661c-4957-97e7-f50d930b74c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:35.404599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace04ce6-661c-4957-97e7-f50d930b74c5 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:35.404886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace04ce6-661c-4957-97e7-f50d930b74c5 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:35.405166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace04ce6-661c-4957-97e7-f50d930b74c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:35.484038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace04ce6-661c-4957-97e7-f50d930b74c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:35.486498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace04ce6-661c-4957-97e7-f50d930b74c5 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:35.499943 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1129/2282] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:36.690205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a9aab-c8f9-4756-9424-59b0477268df service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:36.795777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a9aab-c8f9-4756-9424-59b0477268df service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:36.805998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cab466-41ff-4b4f-9e3e-867358650a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:36.806885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cab466-41ff-4b4f-9e3e-867358650a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:36.807949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cab466-41ff-4b4f-9e3e-867358650a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:36.807949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cab466-41ff-4b4f-9e3e-867358650a62 admin admin] PATH_INFO: `/v3/users/b9b9a9d263d546249dd6558efd855073` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:36.812704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cab466-41ff-4b4f-9e3e-867358650a62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9b9a9d263d546249dd6558efd855073)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:36.815068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cab466-41ff-4b4f-9e3e-867358650a62 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:36.828821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:36.984694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace04ce6-661c-4957-97e7-f50d930b74c5 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:36.996894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace04ce6-661c-4957-97e7-f50d930b74c5 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:37.002187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78990a41-a06d-43ab-ab62-dd1ca749e54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:37.003236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78990a41-a06d-43ab-ab62-dd1ca749e54f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:37.003572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78990a41-a06d-43ab-ab62-dd1ca749e54f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:37.003825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78990a41-a06d-43ab-ab62-dd1ca749e54f admin admin] PATH_INFO: `/v3/users/95424d5b83cb45a8a291dc5c2e511ca4` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:37.005049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78990a41-a06d-43ab-ab62-dd1ca749e54f admin admin] RBAC: Authorizing `identity:delete_user(user_id=95424d5b83cb45a8a291dc5c2e511ca4)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:37.007032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78990a41-a06d-43ab-ab62-dd1ca749e54f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:37.065556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c3cab466-41ff-4b4f-9e3e-867358650a62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9b9a9d263d546249dd6558efd855073'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:37.072917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c3cab466-41ff-4b4f-9e3e-867358650a62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9b9a9d263d546249dd6558efd855073'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:37.198769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c3cab466-41ff-4b4f-9e3e-867358650a62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9b9a9d263d546249dd6558efd855073'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:37.199398 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c3cab466-41ff-4b4f-9e3e-867358650a62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9b9a9d263d546249dd6558efd855073'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:37.213990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c3cab466-41ff-4b4f-9e3e-867358650a62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9b9a9d263d546249dd6558efd855073'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:37.220315 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1154/2283] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:09:36 2022] DELETE /identity/v3/users/b9b9a9d263d546249dd6558efd855073 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:37.224812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962df2b-ef69-4f38-9762-0fa94dc393d1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:37.225095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962df2b-ef69-4f38-9762-0fa94dc393d1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:37.225380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962df2b-ef69-4f38-9762-0fa94dc393d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:37.244548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0962df2b-ef69-4f38-9762-0fa94dc393d1 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:37.246261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0962df2b-ef69-4f38-9762-0fa94dc393d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:37.254204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-78990a41-a06d-43ab-ab62-dd1ca749e54f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95424d5b83cb45a8a291dc5c2e511ca4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:37.267473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-78990a41-a06d-43ab-ab62-dd1ca749e54f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95424d5b83cb45a8a291dc5c2e511ca4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:37.343056 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1155/2284] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:09:37.353645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962df2b-ef69-4f38-9762-0fa94dc393d1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:37.355140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0962df2b-ef69-4f38-9762-0fa94dc393d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:37.371268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-78990a41-a06d-43ab-ab62-dd1ca749e54f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95424d5b83cb45a8a291dc5c2e511ca4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:37.381847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-78990a41-a06d-43ab-ab62-dd1ca749e54f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95424d5b83cb45a8a291dc5c2e511ca4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:37.383964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-78990a41-a06d-43ab-ab62-dd1ca749e54f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95424d5b83cb45a8a291dc5c2e511ca4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:37.400390 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1130/2285] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:09:36 2022] DELETE /identity/v3/users/95424d5b83cb45a8a291dc5c2e511ca4 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:09:37.405831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:37.418387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdca762-47e9-4e8b-ad63-6eaee95914f5 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:37.418387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdca762-47e9-4e8b-ad63-6eaee95914f5 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:37.418387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdca762-47e9-4e8b-ad63-6eaee95914f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:37.440669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5cdca762-47e9-4e8b-ad63-6eaee95914f5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:37.442254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5cdca762-47e9-4e8b-ad63-6eaee95914f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:37.470033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962df2b-ef69-4f38-9762-0fa94dc393d1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:37.511133 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1131/2286] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:37.521380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdca762-47e9-4e8b-ad63-6eaee95914f5 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:37.525416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5cdca762-47e9-4e8b-ad63-6eaee95914f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:37.552752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9225ba9-858f-4f79-b8df-b55a8cde0c80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:37.556309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9225ba9-858f-4f79-b8df-b55a8cde0c80 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:37.557204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9225ba9-858f-4f79-b8df-b55a8cde0c80 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:37.558503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9225ba9-858f-4f79-b8df-b55a8cde0c80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:37.563304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d9225ba9-858f-4f79-b8df-b55a8cde0c80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:37.580472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9225ba9-858f-4f79-b8df-b55a8cde0c80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:37.582779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9225ba9-858f-4f79-b8df-b55a8cde0c80 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:37.595584 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1156/2287] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:37.621915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdca762-47e9-4e8b-ad63-6eaee95914f5 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:37.627478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5eefab-3a50-4767-8add-fd28ad7b5630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:37.628149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eefab-3a50-4767-8add-fd28ad7b5630 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:37.629709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eefab-3a50-4767-8add-fd28ad7b5630 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:37.630074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eefab-3a50-4767-8add-fd28ad7b5630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:37.645205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5eefab-3a50-4767-8add-fd28ad7b5630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:37.646939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5eefab-3a50-4767-8add-fd28ad7b5630 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:37.660447 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1132/2288] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:38.846483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9225ba9-858f-4f79-b8df-b55a8cde0c80 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:38.849974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d9225ba9-858f-4f79-b8df-b55a8cde0c80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:38.869869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9225ba9-858f-4f79-b8df-b55a8cde0c80 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:38.878258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8edeb-7a32-4556-addd-bda40ddbae58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:38.880499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8edeb-7a32-4556-addd-bda40ddbae58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:38.881058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8edeb-7a32-4556-addd-bda40ddbae58 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:38.881513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8edeb-7a32-4556-addd-bda40ddbae58 admin admin] PATH_INFO: `/v3/projects/8e86da1bb2724074ac3d2be147ade96b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:38.885528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8edeb-7a32-4556-addd-bda40ddbae58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e86da1bb2724074ac3d2be147ade96b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:38.888078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8edeb-7a32-4556-addd-bda40ddbae58 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:39.128843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6dc8edeb-7a32-4556-addd-bda40ddbae58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e86da1bb2724074ac3d2be147ade96b', 'request_id': 'req-6dc8edeb-7a32-4556-addd-bda40ddbae58'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:39.138457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6dc8edeb-7a32-4556-addd-bda40ddbae58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e86da1bb2724074ac3d2be147ade96b', 'request_id': 'req-6dc8edeb-7a32-4556-addd-bda40ddbae58'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:39.148762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6dc8edeb-7a32-4556-addd-bda40ddbae58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e86da1bb2724074ac3d2be147ade96b', 'request_id': 'req-6dc8edeb-7a32-4556-addd-bda40ddbae58'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:39.299245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6dc8edeb-7a32-4556-addd-bda40ddbae58 admin admin] The token cache is being invalidate because project 8e86da1bb2724074ac3d2be147ade96b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:39.299245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6dc8edeb-7a32-4556-addd-bda40ddbae58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:39.299245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6dc8edeb-7a32-4556-addd-bda40ddbae58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:39.299245 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1157/2289] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:38 2022] DELETE /identity/v3/projects/8e86da1bb2724074ac3d2be147ade96b => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:39.306302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5eefab-3a50-4767-8add-fd28ad7b5630 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:39.317007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5eefab-3a50-4767-8add-fd28ad7b5630 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:39.402453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8e725-6ad3-4256-9878-d177762076ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:39.403824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8e725-6ad3-4256-9878-d177762076ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:39.404244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8e725-6ad3-4256-9878-d177762076ff admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:39.404520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8e725-6ad3-4256-9878-d177762076ff admin admin] PATH_INFO: `/v3/users/e6d8247e10864ad49c9f4a7aa9a0c036` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:39.409888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8e725-6ad3-4256-9878-d177762076ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6d8247e10864ad49c9f4a7aa9a0c036)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:39.409888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8e725-6ad3-4256-9878-d177762076ff admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:39.427537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8edeb-7a32-4556-addd-bda40ddbae58 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:39.428992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6dc8edeb-7a32-4556-addd-bda40ddbae58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:39.444997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8edeb-7a32-4556-addd-bda40ddbae58 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:39.450679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ebacd-6440-45e2-a5a2-e2074c4ce8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:39.451598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ebacd-6440-45e2-a5a2-e2074c4ce8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:39.451881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ebacd-6440-45e2-a5a2-e2074c4ce8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:39.452157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ebacd-6440-45e2-a5a2-e2074c4ce8f2 admin admin] PATH_INFO: `/v3/projects/5fcfd03d78284545bd934e58574f5f17` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:39.453599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ebacd-6440-45e2-a5a2-e2074c4ce8f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fcfd03d78284545bd934e58574f5f17)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:39.456342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ebacd-6440-45e2-a5a2-e2074c4ce8f2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:39.681388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8d8ebacd-6440-45e2-a5a2-e2074c4ce8f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fcfd03d78284545bd934e58574f5f17', 'request_id': 'req-8d8ebacd-6440-45e2-a5a2-e2074c4ce8f2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:39.682491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-37c8e725-6ad3-4256-9878-d177762076ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6d8247e10864ad49c9f4a7aa9a0c036'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:39.689491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8d8ebacd-6440-45e2-a5a2-e2074c4ce8f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fcfd03d78284545bd934e58574f5f17', 'request_id': 'req-8d8ebacd-6440-45e2-a5a2-e2074c4ce8f2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:39.696062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8d8ebacd-6440-45e2-a5a2-e2074c4ce8f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fcfd03d78284545bd934e58574f5f17', 'request_id': 'req-8d8ebacd-6440-45e2-a5a2-e2074c4ce8f2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:39.699396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-37c8e725-6ad3-4256-9878-d177762076ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6d8247e10864ad49c9f4a7aa9a0c036'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:39.810988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8d8ebacd-6440-45e2-a5a2-e2074c4ce8f2 admin admin] The token cache is being invalidate because project 5fcfd03d78284545bd934e58574f5f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:39.811424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8d8ebacd-6440-45e2-a5a2-e2074c4ce8f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:39.812183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8d8ebacd-6440-45e2-a5a2-e2074c4ce8f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:39.814968 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1158/2290] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:39 2022] DELETE /identity/v3/projects/5fcfd03d78284545bd934e58574f5f17 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:39.818799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ebacd-6440-45e2-a5a2-e2074c4ce8f2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:39.824674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8d8ebacd-6440-45e2-a5a2-e2074c4ce8f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:39.890508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-37c8e725-6ad3-4256-9878-d177762076ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6d8247e10864ad49c9f4a7aa9a0c036'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:39.900356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-37c8e725-6ad3-4256-9878-d177762076ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6d8247e10864ad49c9f4a7aa9a0c036'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:39.903249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-37c8e725-6ad3-4256-9878-d177762076ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6d8247e10864ad49c9f4a7aa9a0c036'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:39.916457 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1133/2291] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:09:39 2022] DELETE /identity/v3/users/e6d8247e10864ad49c9f4a7aa9a0c036 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:39.919712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ebacd-6440-45e2-a5a2-e2074c4ce8f2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:39.999029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc260275-268f-4d9a-aa71-07a9345391ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:40.000034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc260275-268f-4d9a-aa71-07a9345391ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:40.000315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc260275-268f-4d9a-aa71-07a9345391ac admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:40.000588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc260275-268f-4d9a-aa71-07a9345391ac admin admin] PATH_INFO: `/v3/users/454d449792ca4f9e8b524fb38e7576ff` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:40.002788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc260275-268f-4d9a-aa71-07a9345391ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=454d449792ca4f9e8b524fb38e7576ff)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:40.005206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc260275-268f-4d9a-aa71-07a9345391ac admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:40.178927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:40.314903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fc260275-268f-4d9a-aa71-07a9345391ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454d449792ca4f9e8b524fb38e7576ff'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:40.325643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fc260275-268f-4d9a-aa71-07a9345391ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454d449792ca4f9e8b524fb38e7576ff'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:40.508693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fc260275-268f-4d9a-aa71-07a9345391ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454d449792ca4f9e8b524fb38e7576ff'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:40.510286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fc260275-268f-4d9a-aa71-07a9345391ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454d449792ca4f9e8b524fb38e7576ff'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:40.534590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=2,keystone:INSERT=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:40.545289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fc260275-268f-4d9a-aa71-07a9345391ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454d449792ca4f9e8b524fb38e7576ff'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:40.557461 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1159/2292] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:09:39 2022] DELETE /identity/v3/users/454d449792ca4f9e8b524fb38e7576ff => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:09:40.741927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:41.375658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8e725-6ad3-4256-9878-d177762076ff admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:41.377538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-37c8e725-6ad3-4256-9878-d177762076ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:41.421726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8e725-6ad3-4256-9878-d177762076ff admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:41.499730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9d89a-8c85-4f49-996b-704cb69607d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:41.500645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9d89a-8c85-4f49-996b-704cb69607d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:41.501456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9d89a-8c85-4f49-996b-704cb69607d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:41.501738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9d89a-8c85-4f49-996b-704cb69607d3 admin admin] PATH_INFO: `/v3/projects/d3e838b91b61415ca0755461b83fe74b` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:41.502965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9d89a-8c85-4f49-996b-704cb69607d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3e838b91b61415ca0755461b83fe74b)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:41.505102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9d89a-8c85-4f49-996b-704cb69607d3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:41.701808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f9a9d89a-8c85-4f49-996b-704cb69607d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3e838b91b61415ca0755461b83fe74b', 'request_id': 'req-f9a9d89a-8c85-4f49-996b-704cb69607d3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:41.713570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f9a9d89a-8c85-4f49-996b-704cb69607d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3e838b91b61415ca0755461b83fe74b', 'request_id': 'req-f9a9d89a-8c85-4f49-996b-704cb69607d3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:41.726178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f9a9d89a-8c85-4f49-996b-704cb69607d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3e838b91b61415ca0755461b83fe74b', 'request_id': 'req-f9a9d89a-8c85-4f49-996b-704cb69607d3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:41.846779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f9a9d89a-8c85-4f49-996b-704cb69607d3 admin admin] The token cache is being invalidate because project d3e838b91b61415ca0755461b83fe74b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:41.848055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f9a9d89a-8c85-4f49-996b-704cb69607d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:41.852721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f9a9d89a-8c85-4f49-996b-704cb69607d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:41.852721 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1134/2293] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:41 2022] DELETE /identity/v3/projects/d3e838b91b61415ca0755461b83fe74b => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:41.857340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc260275-268f-4d9a-aa71-07a9345391ac admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:41.858526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fc260275-268f-4d9a-aa71-07a9345391ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:41.873020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdf417-72b0-48e0-8293-9414b020332c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:41.876648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdf417-72b0-48e0-8293-9414b020332c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:41.877604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdf417-72b0-48e0-8293-9414b020332c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:41.901643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc260275-268f-4d9a-aa71-07a9345391ac admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:41.906041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-63bdf417-72b0-48e0-8293-9414b020332c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:41.907960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-63bdf417-72b0-48e0-8293-9414b020332c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:42.008565 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1135/2294] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:42.013167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20672d4-3785-45e8-b86a-b4f9fe66b0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:42.014108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20672d4-3785-45e8-b86a-b4f9fe66b0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:42.021305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20672d4-3785-45e8-b86a-b4f9fe66b0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:42.021305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20672d4-3785-45e8-b86a-b4f9fe66b0eb admin admin] PATH_INFO: `/v3/projects/792720ef974e4498b36e3faf082bb51b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:42.021305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20672d4-3785-45e8-b86a-b4f9fe66b0eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=792720ef974e4498b36e3faf082bb51b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:42.021640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7410cc5-59bf-49a8-b286-c1c956189641 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:42.021640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7410cc5-59bf-49a8-b286-c1c956189641 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:42.021640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7410cc5-59bf-49a8-b286-c1c956189641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:42.021875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20672d4-3785-45e8-b86a-b4f9fe66b0eb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:42.067175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f7410cc5-59bf-49a8-b286-c1c956189641 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:42.068782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f7410cc5-59bf-49a8-b286-c1c956189641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:42.089774 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1136/2295] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:42.096402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7410cc5-59bf-49a8-b286-c1c956189641 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:42.119605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7410cc5-59bf-49a8-b286-c1c956189641 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:42.138638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761324f-c7c5-4f0c-8696-ebdd30b4559e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:42.148179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761324f-c7c5-4f0c-8696-ebdd30b4559e admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:42.148179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761324f-c7c5-4f0c-8696-ebdd30b4559e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:42.148179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761324f-c7c5-4f0c-8696-ebdd30b4559e admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:42.148179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4761324f-c7c5-4f0c-8696-ebdd30b4559e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:09:42.148179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4761324f-c7c5-4f0c-8696-ebdd30b4559e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:42.149287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4761324f-c7c5-4f0c-8696-ebdd30b4559e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:42.188106 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1137/2296] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:09:42.189118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761324f-c7c5-4f0c-8696-ebdd30b4559e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:42.215648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761324f-c7c5-4f0c-8696-ebdd30b4559e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:42.238283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d20672d4-3785-45e8-b86a-b4f9fe66b0eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '792720ef974e4498b36e3faf082bb51b', 'request_id': 'req-d20672d4-3785-45e8-b86a-b4f9fe66b0eb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:42.265529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d20672d4-3785-45e8-b86a-b4f9fe66b0eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '792720ef974e4498b36e3faf082bb51b', 'request_id': 'req-d20672d4-3785-45e8-b86a-b4f9fe66b0eb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:42.296629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d20672d4-3785-45e8-b86a-b4f9fe66b0eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '792720ef974e4498b36e3faf082bb51b', 'request_id': 'req-d20672d4-3785-45e8-b86a-b4f9fe66b0eb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:42.374043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:42.381307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed7b4b-9b1d-4961-8723-f16b09da242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:42.382522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed7b4b-9b1d-4961-8723-f16b09da242b admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:42.382989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed7b4b-9b1d-4961-8723-f16b09da242b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:42.383516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed7b4b-9b1d-4961-8723-f16b09da242b admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:42.384786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed7b4b-9b1d-4961-8723-f16b09da242b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:42.388743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed7b4b-9b1d-4961-8723-f16b09da242b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:42.401287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d20672d4-3785-45e8-b86a-b4f9fe66b0eb admin admin] The token cache is being invalidate because project 792720ef974e4498b36e3faf082bb51b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:42.401851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d20672d4-3785-45e8-b86a-b4f9fe66b0eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:42.403985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d20672d4-3785-45e8-b86a-b4f9fe66b0eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:42.406607 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1160/2297] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:41 2022] DELETE /identity/v3/projects/792720ef974e4498b36e3faf082bb51b => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:42.412795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcb133-af02-49a4-9dad-64cb3c11f730 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:42.419250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcb133-af02-49a4-9dad-64cb3c11f730 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:42.419250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcb133-af02-49a4-9dad-64cb3c11f730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:42.448711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-10fcb133-af02-49a4-9dad-64cb3c11f730 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:42.450058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-10fcb133-af02-49a4-9dad-64cb3c11f730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:42.465715 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1161/2298] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:42.470264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071b08e-b1a5-4947-bab9-7cb0fe52f536 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:42.470264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071b08e-b1a5-4947-bab9-7cb0fe52f536 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:42.470264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071b08e-b1a5-4947-bab9-7cb0fe52f536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:42.493808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8071b08e-b1a5-4947-bab9-7cb0fe52f536 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:42.494757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8071b08e-b1a5-4947-bab9-7cb0fe52f536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:42.507045 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1162/2299] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:09:42.508360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071b08e-b1a5-4947-bab9-7cb0fe52f536 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:42.526795 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1138/2300] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:42 2022] POST /identity/v3/projects => generated 393 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:42.531104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed7b4b-9b1d-4961-8723-f16b09da242b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:42.535258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d6ed7b4b-9b1d-4961-8723-f16b09da242b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:42.546487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071b08e-b1a5-4947-bab9-7cb0fe52f536 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:42.640382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae50d2-4b93-47a1-ad1a-ebf4a26efeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:42.642235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae50d2-4b93-47a1-ad1a-ebf4a26efeff admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:42.643538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae50d2-4b93-47a1-ad1a-ebf4a26efeff admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:42.643861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae50d2-4b93-47a1-ad1a-ebf4a26efeff admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:42.645194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae50d2-4b93-47a1-ad1a-ebf4a26efeff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:09:42.645515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae50d2-4b93-47a1-ad1a-ebf4a26efeff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:42.648559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae50d2-4b93-47a1-ad1a-ebf4a26efeff admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:42.648688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed7b4b-9b1d-4961-8723-f16b09da242b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:42.655684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bba5c2-e920-4dc2-b4b2-6d91056104df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:42.656435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bba5c2-e920-4dc2-b4b2-6d91056104df admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:42.656975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bba5c2-e920-4dc2-b4b2-6d91056104df admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:42.658058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bba5c2-e920-4dc2-b4b2-6d91056104df admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:42.659021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bba5c2-e920-4dc2-b4b2-6d91056104df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:42.661881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bba5c2-e920-4dc2-b4b2-6d91056104df admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:42.675888 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1163/2301] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:09:42.680530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae50d2-4b93-47a1-ad1a-ebf4a26efeff admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:42.701050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae50d2-4b93-47a1-ad1a-ebf4a26efeff admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:42.708071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3f2cf-fa09-4e53-bf88-d0ec1ff4bd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:42.708809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3f2cf-fa09-4e53-bf88-d0ec1ff4bd2b admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:42.709101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3f2cf-fa09-4e53-bf88-d0ec1ff4bd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:42.709472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3f2cf-fa09-4e53-bf88-d0ec1ff4bd2b admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:42.710482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3f2cf-fa09-4e53-bf88-d0ec1ff4bd2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:42.713976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3f2cf-fa09-4e53-bf88-d0ec1ff4bd2b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:42.871476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:42.880098 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1139/2302] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:42 2022] POST /identity/v3/users => generated 297 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:09:42.881119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bba5c2-e920-4dc2-b4b2-6d91056104df admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:42.896942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bba5c2-e920-4dc2-b4b2-6d91056104df admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:42.903350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b113e-becb-44df-a7ff-21670ddaf015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:42.904138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b113e-becb-44df-a7ff-21670ddaf015 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:42.904338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b113e-becb-44df-a7ff-21670ddaf015 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:42.905297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b113e-becb-44df-a7ff-21670ddaf015 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:42.914239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b113e-becb-44df-a7ff-21670ddaf015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:42.916036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b113e-becb-44df-a7ff-21670ddaf015 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:42.925023 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1164/2303] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:42 2022] POST /identity/v3/projects => generated 381 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:42.926302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3f2cf-fa09-4e53-bf88-d0ec1ff4bd2b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:42.949839 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1140/2304] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:42.956558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b113e-becb-44df-a7ff-21670ddaf015 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:42.976832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b113e-becb-44df-a7ff-21670ddaf015 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:43.105309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3f2cf-fa09-4e53-bf88-d0ec1ff4bd2b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:43.121054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0b71c-23ef-4cf6-b006-baaddf5fa88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:43.121434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0b71c-23ef-4cf6-b006-baaddf5fa88c admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:43.121720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0b71c-23ef-4cf6-b006-baaddf5fa88c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:43.122008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0b71c-23ef-4cf6-b006-baaddf5fa88c admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:43.125083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0b71c-23ef-4cf6-b006-baaddf5fa88c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:43.128604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0b71c-23ef-4cf6-b006-baaddf5fa88c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:43.148355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6a5e0-c430-46a4-ae12-b61d8f5f0636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:43.149643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6a5e0-c430-46a4-ae12-b61d8f5f0636 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:43.149643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6a5e0-c430-46a4-ae12-b61d8f5f0636 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:43.149825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6a5e0-c430-46a4-ae12-b61d8f5f0636 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:43.150503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6a5e0-c430-46a4-ae12-b61d8f5f0636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:43.154378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6a5e0-c430-46a4-ae12-b61d8f5f0636 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:43.182548 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1141/2305] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:43.184489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6a5e0-c430-46a4-ae12-b61d8f5f0636 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:43.199824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6a5e0-c430-46a4-ae12-b61d8f5f0636 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:43.218454 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1165/2306] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:42 2022] POST /identity/v3/users => generated 291 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:43.224606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0b71c-23ef-4cf6-b006-baaddf5fa88c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:43.226314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc5401-0a52-4fdd-bc02-1d0f3bad6b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:43.228139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc5401-0a52-4fdd-bc02-1d0f3bad6b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:43.231489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc5401-0a52-4fdd-bc02-1d0f3bad6b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:43.232231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc5401-0a52-4fdd-bc02-1d0f3bad6b30 admin admin] PATH_INFO: `/v3/projects/0d8655c3387e4dbfacd83086a9b5bb28/users/e2001b719b6c4e81bc95b9d5ceca276d/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:43.239168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:43.252146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0b71c-23ef-4cf6-b006-baaddf5fa88c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:43.260723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d4fd2-4747-4a75-afc7-06bb48a4385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:43.264140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d4fd2-4747-4a75-afc7-06bb48a4385a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:43.264140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d4fd2-4747-4a75-afc7-06bb48a4385a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:43.264140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d4fd2-4747-4a75-afc7-06bb48a4385a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:43.264140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d4fd2-4747-4a75-afc7-06bb48a4385a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:43.265311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d4fd2-4747-4a75-afc7-06bb48a4385a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:43.279590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc5401-0a52-4fdd-bc02-1d0f3bad6b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8655c3387e4dbfacd83086a9b5bb28, user_id=e2001b719b6c4e81bc95b9d5ceca276d, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:43.282794 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1166/2307] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:43.286912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d4fd2-4747-4a75-afc7-06bb48a4385a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:43.287214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc5401-0a52-4fdd-bc02-1d0f3bad6b30 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:43.295021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d4fd2-4747-4a75-afc7-06bb48a4385a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:43.301804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e825443-080f-4064-a025-acfd27ac2f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:43.302503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e825443-080f-4064-a025-acfd27ac2f09 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:43.302789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e825443-080f-4064-a025-acfd27ac2f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:43.303272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e825443-080f-4064-a025-acfd27ac2f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:43.304062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e825443-080f-4064-a025-acfd27ac2f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:43.306697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e825443-080f-4064-a025-acfd27ac2f09 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:43.325501 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1167/2308] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:43.326500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e825443-080f-4064-a025-acfd27ac2f09 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:43.339371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e825443-080f-4064-a025-acfd27ac2f09 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:43.345948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c8632-39e6-4092-b400-dc343844ea28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:43.347287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c8632-39e6-4092-b400-dc343844ea28 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:43.347670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c8632-39e6-4092-b400-dc343844ea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:43.358227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c8632-39e6-4092-b400-dc343844ea28 admin admin] PATH_INFO: `/v3/projects/2ca168f0945547549df096b15b0bb68c/users/926fb223caf842dca8d0d82fb8772794/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:43.385590 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1142/2309] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:43 2022] PUT /identity/v3/projects/0d8655c3387e4dbfacd83086a9b5bb28/users/e2001b719b6c4e81bc95b9d5ceca276d/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:43.398270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd59ee-ddc4-4d18-8339-c6069a8ab1e9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:43.399041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd59ee-ddc4-4d18-8339-c6069a8ab1e9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:43.399539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd59ee-ddc4-4d18-8339-c6069a8ab1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:43.411980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c8632-39e6-4092-b400-dc343844ea28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca168f0945547549df096b15b0bb68c, user_id=926fb223caf842dca8d0d82fb8772794, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:43.415282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c8632-39e6-4092-b400-dc343844ea28 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:43.477418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-61cd59ee-ddc4-4d18-8339-c6069a8ab1e9 None None] MFA Rules not processed for user `e2001b719b6c4e81bc95b9d5ceca276d`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:43.479263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-61cd59ee-ddc4-4d18-8339-c6069a8ab1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:43.498913 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1168/2310] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:43 2022] PUT /identity/v3/projects/2ca168f0945547549df096b15b0bb68c/users/926fb223caf842dca8d0d82fb8772794/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:43.512254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6cfad-2350-47b4-9240-29f286539556 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:43.512784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6cfad-2350-47b4-9240-29f286539556 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:43.513483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6cfad-2350-47b4-9240-29f286539556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:43.549966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-94a6cfad-2350-47b4-9240-29f286539556 None None] MFA Rules not processed for user `926fb223caf842dca8d0d82fb8772794`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:43.552154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-94a6cfad-2350-47b4-9240-29f286539556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:43.595280 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1143/2311] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:09:43.599406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd59ee-ddc4-4d18-8339-c6069a8ab1e9 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:43.691708 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1169/2312] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:43.692572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6cfad-2350-47b4-9240-29f286539556 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:43.704913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6cfad-2350-47b4-9240-29f286539556 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:43.709890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a5174-08cd-4c25-8e16-47e3b6d1e6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:43.710554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a5174-08cd-4c25-8e16-47e3b6d1e6e7 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:43.710845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a5174-08cd-4c25-8e16-47e3b6d1e6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:43.711138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a5174-08cd-4c25-8e16-47e3b6d1e6e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:43.711818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd59ee-ddc4-4d18-8339-c6069a8ab1e9 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:43.711953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a5174-08cd-4c25-8e16-47e3b6d1e6e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:43.713879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a5174-08cd-4c25-8e16-47e3b6d1e6e7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:43.718357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268e514-7920-4c05-9e0d-5b33191ad8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:43.719468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268e514-7920-4c05-9e0d-5b33191ad8d8 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:43.719786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268e514-7920-4c05-9e0d-5b33191ad8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:43.720059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268e514-7920-4c05-9e0d-5b33191ad8d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:43.720939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268e514-7920-4c05-9e0d-5b33191ad8d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:43.723382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268e514-7920-4c05-9e0d-5b33191ad8d8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:43.856186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:43.897279 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1144/2313] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:43 2022] POST /identity/v3/projects => generated 391 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:43.897913 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1170/2314] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:43 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:43.898291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268e514-7920-4c05-9e0d-5b33191ad8d8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:43.898388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a5174-08cd-4c25-8e16-47e3b6d1e6e7 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:44.044710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a5174-08cd-4c25-8e16-47e3b6d1e6e7 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:44.078112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268e514-7920-4c05-9e0d-5b33191ad8d8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:44.099075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5032d2-7509-4bab-b208-ffd34e9cd0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:44.099956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5032d2-7509-4bab-b208-ffd34e9cd0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:44.100265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5032d2-7509-4bab-b208-ffd34e9cd0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:44.100654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5032d2-7509-4bab-b208-ffd34e9cd0d0 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:44.102041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5032d2-7509-4bab-b208-ffd34e9cd0d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:44.104158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5032d2-7509-4bab-b208-ffd34e9cd0d0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:44.187950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db55a12-ee7e-464f-a6d0-7976487d0bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:44.189354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db55a12-ee7e-464f-a6d0-7976487d0bbf admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:44.189639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db55a12-ee7e-464f-a6d0-7976487d0bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:44.189913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db55a12-ee7e-464f-a6d0-7976487d0bbf admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:44.190631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db55a12-ee7e-464f-a6d0-7976487d0bbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:44.192895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db55a12-ee7e-464f-a6d0-7976487d0bbf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:44.259350 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1145/2315] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:43 2022] POST /identity/v3/users => generated 297 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:44.263191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5032d2-7509-4bab-b208-ffd34e9cd0d0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:44.288568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5032d2-7509-4bab-b208-ffd34e9cd0d0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:44.289225 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1171/2316] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:43 2022] POST /identity/v3/users => generated 302 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:44.293098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db55a12-ee7e-464f-a6d0-7976487d0bbf admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:44.298785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4607c-f7a2-4cab-a91d-b73197891c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:44.299684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4607c-f7a2-4cab-a91d-b73197891c3d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:44.299974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4607c-f7a2-4cab-a91d-b73197891c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:44.300259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4607c-f7a2-4cab-a91d-b73197891c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:44.301015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4607c-f7a2-4cab-a91d-b73197891c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:44.304303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4607c-f7a2-4cab-a91d-b73197891c3d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:44.312624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db55a12-ee7e-464f-a6d0-7976487d0bbf admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:44.325232 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1146/2317] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:09:44.331660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4607c-f7a2-4cab-a91d-b73197891c3d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:44.339736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6283a-9a05-40eb-a648-066a1c8b3d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:44.340421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6283a-9a05-40eb-a648-066a1c8b3d58 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:44.340704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6283a-9a05-40eb-a648-066a1c8b3d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:44.340914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4607c-f7a2-4cab-a91d-b73197891c3d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:44.341066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6283a-9a05-40eb-a648-066a1c8b3d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:44.341756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6283a-9a05-40eb-a648-066a1c8b3d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:44.347831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e196da6-2f31-4ede-a929-ea7a44cf5889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:44.349268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e196da6-2f31-4ede-a929-ea7a44cf5889 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:44.349701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e196da6-2f31-4ede-a929-ea7a44cf5889 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:44.349987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e196da6-2f31-4ede-a929-ea7a44cf5889 admin admin] PATH_INFO: `/v3/projects/7d667b71788a497fa9b839134fef0988/users/2a50a4fc7421430db7fca37a91f02867/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:44.355123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6283a-9a05-40eb-a648-066a1c8b3d58 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:44.372293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e196da6-2f31-4ede-a929-ea7a44cf5889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d667b71788a497fa9b839134fef0988, user_id=2a50a4fc7421430db7fca37a91f02867, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:44.375549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e196da6-2f31-4ede-a929-ea7a44cf5889 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:44.385334 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1172/2318] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:09:44.389263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6283a-9a05-40eb-a648-066a1c8b3d58 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:44.403160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6283a-9a05-40eb-a648-066a1c8b3d58 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:44.411189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f35396-69bc-417d-8c9c-b6ceeba3cce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:44.412213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f35396-69bc-417d-8c9c-b6ceeba3cce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:44.412501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f35396-69bc-417d-8c9c-b6ceeba3cce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:44.413520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f35396-69bc-417d-8c9c-b6ceeba3cce4 admin admin] PATH_INFO: `/v3/projects/f89a6d96a8064cb8bd39fdbfe0d2d96d/users/8b357c4e8e254cd2a8d4e22f521718cb/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:44.439842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f35396-69bc-417d-8c9c-b6ceeba3cce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f89a6d96a8064cb8bd39fdbfe0d2d96d, user_id=8b357c4e8e254cd2a8d4e22f521718cb, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:44.445348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f35396-69bc-417d-8c9c-b6ceeba3cce4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:44.513828 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1147/2319] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:44 2022] PUT /identity/v3/projects/7d667b71788a497fa9b839134fef0988/users/2a50a4fc7421430db7fca37a91f02867/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:44.518923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e196da6-2f31-4ede-a929-ea7a44cf5889 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:44.586918 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1173/2320] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:44 2022] PUT /identity/v3/projects/f89a6d96a8064cb8bd39fdbfe0d2d96d/users/8b357c4e8e254cd2a8d4e22f521718cb/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:09:44.588109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f35396-69bc-417d-8c9c-b6ceeba3cce4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:44.596686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e196da6-2f31-4ede-a929-ea7a44cf5889 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:44.708211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebe9a9-2a50-4e6f-8215-6335645f9557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:44.709514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebe9a9-2a50-4e6f-8215-6335645f9557 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:44.710152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebe9a9-2a50-4e6f-8215-6335645f9557 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:44.712813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebe9a9-2a50-4e6f-8215-6335645f9557 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:44.714426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebe9a9-2a50-4e6f-8215-6335645f9557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:44.717179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebe9a9-2a50-4e6f-8215-6335645f9557 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:44.735305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f35396-69bc-417d-8c9c-b6ceeba3cce4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:44.740383 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1148/2321] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:09:44.742594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee6e0e-e93b-4ca7-9ecf-d95106944042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:44.743758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee6e0e-e93b-4ca7-9ecf-d95106944042 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:44.744879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebe9a9-2a50-4e6f-8215-6335645f9557 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:44.748308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee6e0e-e93b-4ca7-9ecf-d95106944042 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:44.749218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee6e0e-e93b-4ca7-9ecf-d95106944042 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:44.750153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee6e0e-e93b-4ca7-9ecf-d95106944042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:44.753926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee6e0e-e93b-4ca7-9ecf-d95106944042 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:44.774616 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1174/2322] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:44.778382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee6e0e-e93b-4ca7-9ecf-d95106944042 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:44.784020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebe9a9-2a50-4e6f-8215-6335645f9557 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:44.789523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaafae-4222-4491-8dfe-a95b6144de7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:44.790704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaafae-4222-4491-8dfe-a95b6144de7c admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:44.791157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaafae-4222-4491-8dfe-a95b6144de7c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:44.791291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaafae-4222-4491-8dfe-a95b6144de7c admin admin] PATH_INFO: `/v3/projects/7d667b71788a497fa9b839134fef0988/users/2a50a4fc7421430db7fca37a91f02867/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:44.794309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcaafae-4222-4491-8dfe-a95b6144de7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d667b71788a497fa9b839134fef0988, user_id=2a50a4fc7421430db7fca37a91f02867, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:44.798517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcaafae-4222-4491-8dfe-a95b6144de7c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:44.808994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee6e0e-e93b-4ca7-9ecf-d95106944042 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:44.814305 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1149/2323] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:44 2022] PUT /identity/v3/projects/7d667b71788a497fa9b839134fef0988/users/2a50a4fc7421430db7fca37a91f02867/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:44.828828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ed524-5c48-4ca4-9f7f-68c0ba44f2b9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:44.829248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ed524-5c48-4ca4-9f7f-68c0ba44f2b9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:44.829496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ed524-5c48-4ca4-9f7f-68c0ba44f2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:44.919217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-cc9ed524-5c48-4ca4-9f7f-68c0ba44f2b9 None None] MFA Rules not processed for user `2a50a4fc7421430db7fca37a91f02867`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:44.920827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cc9ed524-5c48-4ca4-9f7f-68c0ba44f2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:44.937413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8974a83-cd45-46c6-af00-aea690069e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:44.940014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8974a83-cd45-46c6-af00-aea690069e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:44.940543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8974a83-cd45-46c6-af00-aea690069e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:44.941529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8974a83-cd45-46c6-af00-aea690069e93 admin admin] PATH_INFO: `/v3/projects/f89a6d96a8064cb8bd39fdbfe0d2d96d/users/8b357c4e8e254cd2a8d4e22f521718cb/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:44.943981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8974a83-cd45-46c6-af00-aea690069e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f89a6d96a8064cb8bd39fdbfe0d2d96d, user_id=8b357c4e8e254cd2a8d4e22f521718cb, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:44.952166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8974a83-cd45-46c6-af00-aea690069e93 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:44.957214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:44.980053 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1175/2324] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:44 2022] PUT /identity/v3/projects/f89a6d96a8064cb8bd39fdbfe0d2d96d/users/8b357c4e8e254cd2a8d4e22f521718cb/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:44.990895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26bc3a-170a-41e2-9d44-cb259640f596 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:44.991365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26bc3a-170a-41e2-9d44-cb259640f596 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:44.991870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26bc3a-170a-41e2-9d44-cb259640f596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:45.065357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1b26bc3a-170a-41e2-9d44-cb259640f596 None None] MFA Rules not processed for user `8b357c4e8e254cd2a8d4e22f521718cb`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:45.067113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1b26bc3a-170a-41e2-9d44-cb259640f596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:45.081016 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1150/2325] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:45.141808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ed524-5c48-4ca4-9f7f-68c0ba44f2b9 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:45.144216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cc9ed524-5c48-4ca4-9f7f-68c0ba44f2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:45.199205 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1176/2326] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:09:45.200183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26bc3a-170a-41e2-9d44-cb259640f596 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:45.203805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1b26bc3a-170a-41e2-9d44-cb259640f596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:45.251659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ed524-5c48-4ca4-9f7f-68c0ba44f2b9 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:45.306235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26bc3a-170a-41e2-9d44-cb259640f596 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:45.314750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1af28-169c-4a01-b393-747e7802111d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:45.317724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1af28-169c-4a01-b393-747e7802111d service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:45.317724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1af28-169c-4a01-b393-747e7802111d service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:45.317724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1af28-169c-4a01-b393-747e7802111d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:45.321730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-97e1af28-169c-4a01-b393-747e7802111d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:45.356659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c49762-9188-4a04-aed4-a69ef6acabb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:45.357358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c49762-9188-4a04-aed4-a69ef6acabb2 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:45.357691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c49762-9188-4a04-aed4-a69ef6acabb2 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:45.357970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c49762-9188-4a04-aed4-a69ef6acabb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:45.405960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1af28-169c-4a01-b393-747e7802111d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:45.408039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1af28-169c-4a01-b393-747e7802111d service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:45.421801 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1177/2327] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:45 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:45.473979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c49762-9188-4a04-aed4-a69ef6acabb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:45.478238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c49762-9188-4a04-aed4-a69ef6acabb2 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:45.504733 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1151/2328] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:45.507302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:45.563279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1af28-169c-4a01-b393-747e7802111d service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:45.674047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1af28-169c-4a01-b393-747e7802111d service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:45.679789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907bca4-58ff-45d6-9d68-ef2705afdcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:45.681255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907bca4-58ff-45d6-9d68-ef2705afdcb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:45.681546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907bca4-58ff-45d6-9d68-ef2705afdcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:45.681917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907bca4-58ff-45d6-9d68-ef2705afdcb5 admin admin] PATH_INFO: `/v3/users/e2001b719b6c4e81bc95b9d5ceca276d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:45.683134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907bca4-58ff-45d6-9d68-ef2705afdcb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2001b719b6c4e81bc95b9d5ceca276d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:45.688081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907bca4-58ff-45d6-9d68-ef2705afdcb5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:45.890035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:45.948955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e907bca4-58ff-45d6-9d68-ef2705afdcb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2001b719b6c4e81bc95b9d5ceca276d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:45.958558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e907bca4-58ff-45d6-9d68-ef2705afdcb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2001b719b6c4e81bc95b9d5ceca276d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:46.106839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e907bca4-58ff-45d6-9d68-ef2705afdcb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2001b719b6c4e81bc95b9d5ceca276d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:46.107628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e907bca4-58ff-45d6-9d68-ef2705afdcb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2001b719b6c4e81bc95b9d5ceca276d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:46.128158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e907bca4-58ff-45d6-9d68-ef2705afdcb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2001b719b6c4e81bc95b9d5ceca276d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:46.139236 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1178/2329] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:09:45 2022] DELETE /identity/v3/users/e2001b719b6c4e81bc95b9d5ceca276d => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:46.145130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979904d3-4901-41a1-b509-29f814d479aa None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:46.145680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979904d3-4901-41a1-b509-29f814d479aa None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:46.145777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979904d3-4901-41a1-b509-29f814d479aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:46.172852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-979904d3-4901-41a1-b509-29f814d479aa None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:46.174632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-979904d3-4901-41a1-b509-29f814d479aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:46.243740 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1152/2330] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:46.255346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:46.280729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907bca4-58ff-45d6-9d68-ef2705afdcb5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:46.282579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e907bca4-58ff-45d6-9d68-ef2705afdcb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:46.365913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907bca4-58ff-45d6-9d68-ef2705afdcb5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:46.370783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56038a9-ceb3-40b5-af95-77df0d3e88f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:46.371500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56038a9-ceb3-40b5-af95-77df0d3e88f8 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:46.371839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56038a9-ceb3-40b5-af95-77df0d3e88f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:46.372118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56038a9-ceb3-40b5-af95-77df0d3e88f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:46.396013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56038a9-ceb3-40b5-af95-77df0d3e88f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:46.398040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56038a9-ceb3-40b5-af95-77df0d3e88f8 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:46.425251 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1179/2331] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:47.091806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979904d3-4901-41a1-b509-29f814d479aa None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:47.093309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-979904d3-4901-41a1-b509-29f814d479aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:47.106350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979904d3-4901-41a1-b509-29f814d479aa None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:47.111851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584593a-cd1c-459e-b6c4-28115537ca3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:47.112859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584593a-cd1c-459e-b6c4-28115537ca3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:47.113142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584593a-cd1c-459e-b6c4-28115537ca3a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:47.113427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584593a-cd1c-459e-b6c4-28115537ca3a admin admin] PATH_INFO: `/v3/users/926fb223caf842dca8d0d82fb8772794` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:47.114648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584593a-cd1c-459e-b6c4-28115537ca3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=926fb223caf842dca8d0d82fb8772794)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:47.116941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584593a-cd1c-459e-b6c4-28115537ca3a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:47.121677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56038a9-ceb3-40b5-af95-77df0d3e88f8 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:47.123665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c56038a9-ceb3-40b5-af95-77df0d3e88f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:47.151739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56038a9-ceb3-40b5-af95-77df0d3e88f8 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:47.158257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e94b33-993e-43b7-8910-764782dabdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:47.159186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e94b33-993e-43b7-8910-764782dabdbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:47.159574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e94b33-993e-43b7-8910-764782dabdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:47.159733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e94b33-993e-43b7-8910-764782dabdbd admin admin] PATH_INFO: `/v3/projects/0d8655c3387e4dbfacd83086a9b5bb28` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:47.162211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e94b33-993e-43b7-8910-764782dabdbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8655c3387e4dbfacd83086a9b5bb28)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:47.168139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e94b33-993e-43b7-8910-764782dabdbd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:47.392468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8584593a-cd1c-459e-b6c4-28115537ca3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '926fb223caf842dca8d0d82fb8772794'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:47.396563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-37e94b33-993e-43b7-8910-764782dabdbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8655c3387e4dbfacd83086a9b5bb28', 'request_id': 'req-37e94b33-993e-43b7-8910-764782dabdbd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:47.408768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-37e94b33-993e-43b7-8910-764782dabdbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8655c3387e4dbfacd83086a9b5bb28', 'request_id': 'req-37e94b33-993e-43b7-8910-764782dabdbd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:47.409597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8584593a-cd1c-459e-b6c4-28115537ca3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '926fb223caf842dca8d0d82fb8772794'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:47.419230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-37e94b33-993e-43b7-8910-764782dabdbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8655c3387e4dbfacd83086a9b5bb28', 'request_id': 'req-37e94b33-993e-43b7-8910-764782dabdbd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:47.510676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8584593a-cd1c-459e-b6c4-28115537ca3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '926fb223caf842dca8d0d82fb8772794'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:47.528331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8584593a-cd1c-459e-b6c4-28115537ca3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '926fb223caf842dca8d0d82fb8772794'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:47.530283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8584593a-cd1c-459e-b6c4-28115537ca3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '926fb223caf842dca8d0d82fb8772794'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:47.545958 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1153/2332] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:09:47 2022] DELETE /identity/v3/users/926fb223caf842dca8d0d82fb8772794 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:47.551970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b50979-b4a1-42e4-a89c-936dcc0a67ac None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:47.552498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b50979-b4a1-42e4-a89c-936dcc0a67ac None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:47.552874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b50979-b4a1-42e4-a89c-936dcc0a67ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:47.571350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-90b50979-b4a1-42e4-a89c-936dcc0a67ac None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:47.572573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-90b50979-b4a1-42e4-a89c-936dcc0a67ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:47.594218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-37e94b33-993e-43b7-8910-764782dabdbd admin admin] The token cache is being invalidate because project 0d8655c3387e4dbfacd83086a9b5bb28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:47.596664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-37e94b33-993e-43b7-8910-764782dabdbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:47.597477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-37e94b33-993e-43b7-8910-764782dabdbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:47.599937 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1180/2333] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:47 2022] DELETE /identity/v3/projects/0d8655c3387e4dbfacd83086a9b5bb28 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:47.605885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e94b33-993e-43b7-8910-764782dabdbd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:47.607184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-37e94b33-993e-43b7-8910-764782dabdbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:47.646394 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1154/2334] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:47.656963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b50979-b4a1-42e4-a89c-936dcc0a67ac None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:47.658376 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-90b50979-b4a1-42e4-a89c-936dcc0a67ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:47.691443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e94b33-993e-43b7-8910-764782dabdbd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:47.696827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d158c-1334-4ddf-9616-e31596b5d3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:47.697778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d158c-1334-4ddf-9616-e31596b5d3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:47.698073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d158c-1334-4ddf-9616-e31596b5d3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:47.698352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d158c-1334-4ddf-9616-e31596b5d3d2 admin admin] PATH_INFO: `/v3/users/8b357c4e8e254cd2a8d4e22f521718cb` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:47.699712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d158c-1334-4ddf-9616-e31596b5d3d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b357c4e8e254cd2a8d4e22f521718cb)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:47.701899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d158c-1334-4ddf-9616-e31596b5d3d2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:47.723716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b50979-b4a1-42e4-a89c-936dcc0a67ac None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:47.727798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c0bb8-4f3b-4e1c-a952-1341d6dec685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:47.728462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c0bb8-4f3b-4e1c-a952-1341d6dec685 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:47.728742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c0bb8-4f3b-4e1c-a952-1341d6dec685 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:47.729017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c0bb8-4f3b-4e1c-a952-1341d6dec685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:47.740115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c0bb8-4f3b-4e1c-a952-1341d6dec685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:47.741598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c0bb8-4f3b-4e1c-a952-1341d6dec685 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:47.752523 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1155/2335] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:47.804711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81fd60-ec22-40e1-af9e-f47b6e515a93 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:47.805080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81fd60-ec22-40e1-af9e-f47b6e515a93 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:47.805587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81fd60-ec22-40e1-af9e-f47b6e515a93 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:47.807273 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1156/2336] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:09:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 21:09:47.812672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f88bb-07c9-4b7a-9563-3769bc0b2409 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:47.813072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f88bb-07c9-4b7a-9563-3769bc0b2409 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:47.814040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f88bb-07c9-4b7a-9563-3769bc0b2409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:47.835374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1e1f88bb-07c9-4b7a-9563-3769bc0b2409 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:47.836777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1e1f88bb-07c9-4b7a-9563-3769bc0b2409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:47.907255 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1157/2337] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:09:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:47.929201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f88bb-07c9-4b7a-9563-3769bc0b2409 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:47.930658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1e1f88bb-07c9-4b7a-9563-3769bc0b2409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:47.944787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f88bb-07c9-4b7a-9563-3769bc0b2409 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:47.954226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb5517-7768-47d0-806d-09ad45bb1d0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:47.954882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb5517-7768-47d0-806d-09ad45bb1d0c service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:47.955338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb5517-7768-47d0-806d-09ad45bb1d0c service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:47.955630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb5517-7768-47d0-806d-09ad45bb1d0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:47.967698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb5517-7768-47d0-806d-09ad45bb1d0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:47.969512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5c9d158c-1334-4ddf-9616-e31596b5d3d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b357c4e8e254cd2a8d4e22f521718cb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:47.969722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb5517-7768-47d0-806d-09ad45bb1d0c service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:47.982419 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1158/2338] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:09:47.984226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5c9d158c-1334-4ddf-9616-e31596b5d3d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b357c4e8e254cd2a8d4e22f521718cb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:48.102236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5c9d158c-1334-4ddf-9616-e31596b5d3d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b357c4e8e254cd2a8d4e22f521718cb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:48.102947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5c9d158c-1334-4ddf-9616-e31596b5d3d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b357c4e8e254cd2a8d4e22f521718cb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:48.119991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5c9d158c-1334-4ddf-9616-e31596b5d3d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b357c4e8e254cd2a8d4e22f521718cb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:48.128037 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1181/2339] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:09:47 2022] DELETE /identity/v3/users/8b357c4e8e254cd2a8d4e22f521718cb => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:48.284563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb5517-7768-47d0-806d-09ad45bb1d0c service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:48.286766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a2bb5517-7768-47d0-806d-09ad45bb1d0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:48.302678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb5517-7768-47d0-806d-09ad45bb1d0c service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:48.380212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb78461-8f4a-4032-bdc3-1656b4d8e874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:48.381093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb78461-8f4a-4032-bdc3-1656b4d8e874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:48.381436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb78461-8f4a-4032-bdc3-1656b4d8e874 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:48.381711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb78461-8f4a-4032-bdc3-1656b4d8e874 admin admin] PATH_INFO: `/v3/projects/2ca168f0945547549df096b15b0bb68c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:48.382924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb78461-8f4a-4032-bdc3-1656b4d8e874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca168f0945547549df096b15b0bb68c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:48.384910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb78461-8f4a-4032-bdc3-1656b4d8e874 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:48.474023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d158c-1334-4ddf-9616-e31596b5d3d2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:48.475738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5c9d158c-1334-4ddf-9616-e31596b5d3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:48.580483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d158c-1334-4ddf-9616-e31596b5d3d2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:48.587040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aeb78461-8f4a-4032-bdc3-1656b4d8e874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca168f0945547549df096b15b0bb68c', 'request_id': 'req-aeb78461-8f4a-4032-bdc3-1656b4d8e874'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:48.594707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aeb78461-8f4a-4032-bdc3-1656b4d8e874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca168f0945547549df096b15b0bb68c', 'request_id': 'req-aeb78461-8f4a-4032-bdc3-1656b4d8e874'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:48.608552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:48.617203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aeb78461-8f4a-4032-bdc3-1656b4d8e874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca168f0945547549df096b15b0bb68c', 'request_id': 'req-aeb78461-8f4a-4032-bdc3-1656b4d8e874'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:48.669304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbb3c6-d3dc-4d4e-bb09-b2c274e1eff4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:48.670193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbb3c6-d3dc-4d4e-bb09-b2c274e1eff4 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:48.670854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbb3c6-d3dc-4d4e-bb09-b2c274e1eff4 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:48.670854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbb3c6-d3dc-4d4e-bb09-b2c274e1eff4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:48.673490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f3dbb3c6-d3dc-4d4e-bb09-b2c274e1eff4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:48.686803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dbb3c6-d3dc-4d4e-bb09-b2c274e1eff4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:48.688943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dbb3c6-d3dc-4d4e-bb09-b2c274e1eff4 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:48.703250 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1182/2340] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:09:48.835987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aeb78461-8f4a-4032-bdc3-1656b4d8e874 admin admin] The token cache is being invalidate because project 2ca168f0945547549df096b15b0bb68c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:48.836841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aeb78461-8f4a-4032-bdc3-1656b4d8e874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:48.838958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aeb78461-8f4a-4032-bdc3-1656b4d8e874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:48.842370 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1159/2341] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:48 2022] DELETE /identity/v3/projects/2ca168f0945547549df096b15b0bb68c => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:48.847876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbb3c6-d3dc-4d4e-bb09-b2c274e1eff4 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:48.849271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f3dbb3c6-d3dc-4d4e-bb09-b2c274e1eff4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:49.020449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbb3c6-d3dc-4d4e-bb09-b2c274e1eff4 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:49.022591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:49.036689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6530d-4acd-42e8-9300-09e435b47380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:49.037544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6530d-4acd-42e8-9300-09e435b47380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:49.038303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6530d-4acd-42e8-9300-09e435b47380 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:49.038597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6530d-4acd-42e8-9300-09e435b47380 admin admin] PATH_INFO: `/v3/users/2a50a4fc7421430db7fca37a91f02867` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:49.040206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6530d-4acd-42e8-9300-09e435b47380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a50a4fc7421430db7fca37a91f02867)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:49.043570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6530d-4acd-42e8-9300-09e435b47380 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:49.262977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb78461-8f4a-4032-bdc3-1656b4d8e874 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:49.264464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-aeb78461-8f4a-4032-bdc3-1656b4d8e874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:49.282664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb78461-8f4a-4032-bdc3-1656b4d8e874 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:49.291803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a5930-8853-4617-80bf-f2ecb590bc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:49.291803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a5930-8853-4617-80bf-f2ecb590bc07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:49.292064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a5930-8853-4617-80bf-f2ecb590bc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:49.292369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a5930-8853-4617-80bf-f2ecb590bc07 admin admin] PATH_INFO: `/v3/projects/f89a6d96a8064cb8bd39fdbfe0d2d96d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:49.293832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a5930-8853-4617-80bf-f2ecb590bc07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f89a6d96a8064cb8bd39fdbfe0d2d96d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:49.296380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a5930-8853-4617-80bf-f2ecb590bc07 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:49.385800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bcc6530d-4acd-42e8-9300-09e435b47380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a50a4fc7421430db7fca37a91f02867'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:49.405705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bcc6530d-4acd-42e8-9300-09e435b47380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a50a4fc7421430db7fca37a91f02867'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:49.409550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-133a5930-8853-4617-80bf-f2ecb590bc07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f89a6d96a8064cb8bd39fdbfe0d2d96d', 'request_id': 'req-133a5930-8853-4617-80bf-f2ecb590bc07'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:49.416103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-133a5930-8853-4617-80bf-f2ecb590bc07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f89a6d96a8064cb8bd39fdbfe0d2d96d', 'request_id': 'req-133a5930-8853-4617-80bf-f2ecb590bc07'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:49.425232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-133a5930-8853-4617-80bf-f2ecb590bc07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f89a6d96a8064cb8bd39fdbfe0d2d96d', 'request_id': 'req-133a5930-8853-4617-80bf-f2ecb590bc07'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:49.472778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bcc6530d-4acd-42e8-9300-09e435b47380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a50a4fc7421430db7fca37a91f02867'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:49.473414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bcc6530d-4acd-42e8-9300-09e435b47380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a50a4fc7421430db7fca37a91f02867'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:49.503520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bcc6530d-4acd-42e8-9300-09e435b47380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a50a4fc7421430db7fca37a91f02867'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:49.516718 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1183/2342] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:09:48 2022] DELETE /identity/v3/users/2a50a4fc7421430db7fca37a91f02867 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:49.610680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-133a5930-8853-4617-80bf-f2ecb590bc07 admin admin] The token cache is being invalidate because project f89a6d96a8064cb8bd39fdbfe0d2d96d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:49.611536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-133a5930-8853-4617-80bf-f2ecb590bc07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:49.616612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-133a5930-8853-4617-80bf-f2ecb590bc07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:49.629256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea0ca6-524e-4b87-a7ab-9b5167cd4ec7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:49.630729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea0ca6-524e-4b87-a7ab-9b5167cd4ec7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:49.636630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea0ca6-524e-4b87-a7ab-9b5167cd4ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:49.637245 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1160/2343] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:49 2022] DELETE /identity/v3/projects/f89a6d96a8064cb8bd39fdbfe0d2d96d => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:49.656519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d8ea0ca6-524e-4b87-a7ab-9b5167cd4ec7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:49.658941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d8ea0ca6-524e-4b87-a7ab-9b5167cd4ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:49.731367 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1184/2344] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:49.739471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cac119-faa0-49cb-a000-b34e75ab7af7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:49.739763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cac119-faa0-49cb-a000-b34e75ab7af7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:49.740778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cac119-faa0-49cb-a000-b34e75ab7af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:49.767863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b2cac119-faa0-49cb-a000-b34e75ab7af7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:49.770054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b2cac119-faa0-49cb-a000-b34e75ab7af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:49.778514 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1161/2345] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:49.786573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea0ca6-524e-4b87-a7ab-9b5167cd4ec7 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:49.796472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea0ca6-524e-4b87-a7ab-9b5167cd4ec7 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:49.801120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5e64d-a303-4ab6-81fb-be4479ecba90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:49.801768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5e64d-a303-4ab6-81fb-be4479ecba90 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:49.802050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5e64d-a303-4ab6-81fb-be4479ecba90 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:49.802326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5e64d-a303-4ab6-81fb-be4479ecba90 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:49.803076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5e64d-a303-4ab6-81fb-be4479ecba90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:09:49.803392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5e64d-a303-4ab6-81fb-be4479ecba90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:49.805002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5e64d-a303-4ab6-81fb-be4479ecba90 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:49.819708 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1185/2346] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:09:49.824163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cac119-faa0-49cb-a000-b34e75ab7af7 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:49.834207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cac119-faa0-49cb-a000-b34e75ab7af7 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:49.838987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccbebf-2e49-4c79-82bb-69f5f43160f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:49.839783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccbebf-2e49-4c79-82bb-69f5f43160f2 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:49.840065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccbebf-2e49-4c79-82bb-69f5f43160f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:49.840340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccbebf-2e49-4c79-82bb-69f5f43160f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:49.841026 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dccbebf-2e49-4c79-82bb-69f5f43160f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:49.843050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dccbebf-2e49-4c79-82bb-69f5f43160f2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:50.047160 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1162/2347] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:49 2022] POST /identity/v3/projects => generated 371 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:50.056010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5e64d-a303-4ab6-81fb-be4479ecba90 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:50.068212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5e64d-a303-4ab6-81fb-be4479ecba90 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:50.163527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2289dfe-487e-4ea6-8912-56fa0990d284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:50.164311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2289dfe-487e-4ea6-8912-56fa0990d284 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:50.166248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2289dfe-487e-4ea6-8912-56fa0990d284 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:50.166248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2289dfe-487e-4ea6-8912-56fa0990d284 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:50.166248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2289dfe-487e-4ea6-8912-56fa0990d284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:50.167720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2289dfe-487e-4ea6-8912-56fa0990d284 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:50.200862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccbebf-2e49-4c79-82bb-69f5f43160f2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:50.202711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3dccbebf-2e49-4c79-82bb-69f5f43160f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:50.218054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccbebf-2e49-4c79-82bb-69f5f43160f2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:50.226476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978dbb1-437e-45fb-b672-5bbd44ba0c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:50.227996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978dbb1-437e-45fb-b672-5bbd44ba0c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:50.228489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978dbb1-437e-45fb-b672-5bbd44ba0c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:50.233446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978dbb1-437e-45fb-b672-5bbd44ba0c35 admin admin] PATH_INFO: `/v3/projects/7d667b71788a497fa9b839134fef0988` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:50.234839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978dbb1-437e-45fb-b672-5bbd44ba0c35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d667b71788a497fa9b839134fef0988)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:50.237275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978dbb1-437e-45fb-b672-5bbd44ba0c35 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:50.275948 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1186/2348] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:50 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:50.281344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2289dfe-487e-4ea6-8912-56fa0990d284 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:50.292506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2289dfe-487e-4ea6-8912-56fa0990d284 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:50.298684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fdaf9-f058-4c6b-9775-f1c53cea75d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:50.299340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fdaf9-f058-4c6b-9775-f1c53cea75d2 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:50.299656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fdaf9-f058-4c6b-9775-f1c53cea75d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:50.299929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fdaf9-f058-4c6b-9775-f1c53cea75d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:50.300658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fdaf9-f058-4c6b-9775-f1c53cea75d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:50.302254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fdaf9-f058-4c6b-9775-f1c53cea75d2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:50.317945 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1187/2349] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:09:50.319394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fdaf9-f058-4c6b-9775-f1c53cea75d2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:50.331104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fdaf9-f058-4c6b-9775-f1c53cea75d2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:50.336107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc489b1d-6c14-4526-862d-0e416f737fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:50.336779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc489b1d-6c14-4526-862d-0e416f737fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:50.337061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc489b1d-6c14-4526-862d-0e416f737fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:50.337342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc489b1d-6c14-4526-862d-0e416f737fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:50.338063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc489b1d-6c14-4526-862d-0e416f737fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:50.339783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc489b1d-6c14-4526-862d-0e416f737fb1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:50.351889 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1188/2350] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:50.356017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc489b1d-6c14-4526-862d-0e416f737fb1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:50.366556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc489b1d-6c14-4526-862d-0e416f737fb1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:50.373478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c343242-92fc-46c8-aff9-0cc64352c2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:50.374754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c343242-92fc-46c8-aff9-0cc64352c2bb admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:50.375220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c343242-92fc-46c8-aff9-0cc64352c2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:50.375526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c343242-92fc-46c8-aff9-0cc64352c2bb admin admin] PATH_INFO: `/v3/projects/ba5f10b718604fafbd5f802302f496d8/users/448a33a68a3643a799cfbc71cc441509/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:50.393283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c343242-92fc-46c8-aff9-0cc64352c2bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5f10b718604fafbd5f802302f496d8, user_id=448a33a68a3643a799cfbc71cc441509, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:50.398151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c343242-92fc-46c8-aff9-0cc64352c2bb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:50.537518 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1189/2351] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:50 2022] PUT /identity/v3/projects/ba5f10b718604fafbd5f802302f496d8/users/448a33a68a3643a799cfbc71cc441509/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:50.548292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2e465-0920-431c-a42e-cec53b76c9e9 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:50.548795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2e465-0920-431c-a42e-cec53b76c9e9 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:50.549093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2e465-0920-431c-a42e-cec53b76c9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:50.551093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1978dbb1-437e-45fb-b672-5bbd44ba0c35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d667b71788a497fa9b839134fef0988', 'request_id': 'req-1978dbb1-437e-45fb-b672-5bbd44ba0c35'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:50.557457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1978dbb1-437e-45fb-b672-5bbd44ba0c35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d667b71788a497fa9b839134fef0988', 'request_id': 'req-1978dbb1-437e-45fb-b672-5bbd44ba0c35'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:50.566933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1978dbb1-437e-45fb-b672-5bbd44ba0c35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d667b71788a497fa9b839134fef0988', 'request_id': 'req-1978dbb1-437e-45fb-b672-5bbd44ba0c35'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:50.581887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-16b2e465-0920-431c-a42e-cec53b76c9e9 None None] MFA Rules not processed for user `448a33a68a3643a799cfbc71cc441509`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:50.581887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-16b2e465-0920-431c-a42e-cec53b76c9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:50.659502 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1190/2352] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:09:50.664012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2e465-0920-431c-a42e-cec53b76c9e9 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:50.683623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1978dbb1-437e-45fb-b672-5bbd44ba0c35 admin admin] The token cache is being invalidate because project 7d667b71788a497fa9b839134fef0988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:50.684510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1978dbb1-437e-45fb-b672-5bbd44ba0c35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:50.686045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1978dbb1-437e-45fb-b672-5bbd44ba0c35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:50.692877 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1163/2353] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:50 2022] DELETE /identity/v3/projects/7d667b71788a497fa9b839134fef0988 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:50.694570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9de07-a81d-49d8-80a2-d48e5a3b1417 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:50.695039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9de07-a81d-49d8-80a2-d48e5a3b1417 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:50.695605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9de07-a81d-49d8-80a2-d48e5a3b1417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:50.733914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9db9de07-a81d-49d8-80a2-d48e5a3b1417 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:50.735902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9db9de07-a81d-49d8-80a2-d48e5a3b1417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:50.772289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2e465-0920-431c-a42e-cec53b76c9e9 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:50.779183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ba96a-6a95-4c66-b048-99e27068099b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:50.779959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ba96a-6a95-4c66-b048-99e27068099b admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:50.780251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ba96a-6a95-4c66-b048-99e27068099b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:50.780701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ba96a-6a95-4c66-b048-99e27068099b admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:50.781412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ba96a-6a95-4c66-b048-99e27068099b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:50.784157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ba96a-6a95-4c66-b048-99e27068099b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:50.812526 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1164/2354] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:50.820903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d4cd2-c37e-43bc-baa0-49bf4c3b3030 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:50.821351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d4cd2-c37e-43bc-baa0-49bf4c3b3030 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:50.821707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d4cd2-c37e-43bc-baa0-49bf4c3b3030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:50.845913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-567d4cd2-c37e-43bc-baa0-49bf4c3b3030 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:50.847398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-567d4cd2-c37e-43bc-baa0-49bf4c3b3030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:50.857720 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1165/2355] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:09:50.862328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d4cd2-c37e-43bc-baa0-49bf4c3b3030 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:50.872039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d4cd2-c37e-43bc-baa0-49bf4c3b3030 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:50.877975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cabb4-b162-42fb-8f73-79c1a2c1a934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:50.878853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cabb4-b162-42fb-8f73-79c1a2c1a934 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:50.879170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cabb4-b162-42fb-8f73-79c1a2c1a934 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:50.879452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cabb4-b162-42fb-8f73-79c1a2c1a934 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:50.880532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4cabb4-b162-42fb-8f73-79c1a2c1a934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:09:50.880532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4cabb4-b162-42fb-8f73-79c1a2c1a934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:50.882341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4cabb4-b162-42fb-8f73-79c1a2c1a934 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:50.911389 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1191/2357] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:50 2022] POST /identity/v3/projects => generated 373 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:50.912331 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1166/2356] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:09:50.913280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cabb4-b162-42fb-8f73-79c1a2c1a934 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:50.914612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee5a5c-d516-4da3-815a-c82faf979436 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:50.914931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee5a5c-d516-4da3-815a-c82faf979436 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:50.915230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1f4cabb4-b162-42fb-8f73-79c1a2c1a934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:50.915720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee5a5c-d516-4da3-815a-c82faf979436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:50.932297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cabb4-b162-42fb-8f73-79c1a2c1a934 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:50.946144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b8ee5a5c-d516-4da3-815a-c82faf979436 None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:50.950348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b8ee5a5c-d516-4da3-815a-c82faf979436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:51.017964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ba617-abfb-456d-88aa-8c7ea1364310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:51.018640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ba617-abfb-456d-88aa-8c7ea1364310 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:51.018919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ba617-abfb-456d-88aa-8c7ea1364310 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:51.019756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ba617-abfb-456d-88aa-8c7ea1364310 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:51.020218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ba617-abfb-456d-88aa-8c7ea1364310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:51.022288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ba617-abfb-456d-88aa-8c7ea1364310 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:51.037908 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1192/2358] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:09:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:51.038852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee5a5c-d516-4da3-815a-c82faf979436 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:51.053610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee5a5c-d516-4da3-815a-c82faf979436 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:51.062251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444c683-5549-4af4-8cfd-a757a47b2e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:51.062933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444c683-5549-4af4-8cfd-a757a47b2e31 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:51.063866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444c683-5549-4af4-8cfd-a757a47b2e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:51.064356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444c683-5549-4af4-8cfd-a757a47b2e31 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:51.064828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444c683-5549-4af4-8cfd-a757a47b2e31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:51.067619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444c683-5549-4af4-8cfd-a757a47b2e31 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:51.147988 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1167/2359] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:50 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:51.148951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ba617-abfb-456d-88aa-8c7ea1364310 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:51.150543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-527ba617-abfb-456d-88aa-8c7ea1364310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:51.184160 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1193/2360] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:51 2022] POST /identity/v3/projects => generated 395 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:51.185034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444c683-5549-4af4-8cfd-a757a47b2e31 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:51.228516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ba617-abfb-456d-88aa-8c7ea1364310 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:51.263659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444c683-5549-4af4-8cfd-a757a47b2e31 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:51.269909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78557228-8cce-40ac-8fd2-5ad9ebc3a742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:51.270601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78557228-8cce-40ac-8fd2-5ad9ebc3a742 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:51.270888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78557228-8cce-40ac-8fd2-5ad9ebc3a742 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:51.271191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78557228-8cce-40ac-8fd2-5ad9ebc3a742 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:51.271927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78557228-8cce-40ac-8fd2-5ad9ebc3a742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:51.273599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78557228-8cce-40ac-8fd2-5ad9ebc3a742 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:51.279546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954b94e-6106-417a-a860-8841d4678d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:51.280205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954b94e-6106-417a-a860-8841d4678d2d service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:51.280487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954b94e-6106-417a-a860-8841d4678d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:51.280763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954b94e-6106-417a-a860-8841d4678d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:51.288094 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1194/2361] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:51.288094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78557228-8cce-40ac-8fd2-5ad9ebc3a742 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:51.296156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78557228-8cce-40ac-8fd2-5ad9ebc3a742 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:51.301331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c82b7e-629b-4ede-ab5f-e5f21af214e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:51.302000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c82b7e-629b-4ede-ab5f-e5f21af214e1 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:51.302611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c82b7e-629b-4ede-ab5f-e5f21af214e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:51.302611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c82b7e-629b-4ede-ab5f-e5f21af214e1 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:51.303317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c82b7e-629b-4ede-ab5f-e5f21af214e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:51.305474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c82b7e-629b-4ede-ab5f-e5f21af214e1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:51.358395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954b94e-6106-417a-a860-8841d4678d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:51.359792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954b94e-6106-417a-a860-8841d4678d2d service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:51.371364 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1168/2362] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:51.372178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954b94e-6106-417a-a860-8841d4678d2d service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:51.383941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954b94e-6106-417a-a860-8841d4678d2d service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:51.389162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0892e-26d2-4e0f-a086-8b864ca6e42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:51.390198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0892e-26d2-4e0f-a086-8b864ca6e42a admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:51.390560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0892e-26d2-4e0f-a086-8b864ca6e42a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:51.390896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0892e-26d2-4e0f-a086-8b864ca6e42a admin admin] PATH_INFO: `/v3/projects/a379e3f37b394ab7986318989751035f/users/f4470c3b676347e29820cad396b32da2/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:51.408793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0892e-26d2-4e0f-a086-8b864ca6e42a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a379e3f37b394ab7986318989751035f, user_id=f4470c3b676347e29820cad396b32da2, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:51.416420 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1195/2363] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:51 2022] POST /identity/v3/users => generated 298 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:51.416917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0892e-26d2-4e0f-a086-8b864ca6e42a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:51.417037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c82b7e-629b-4ede-ab5f-e5f21af214e1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:51.429494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c82b7e-629b-4ede-ab5f-e5f21af214e1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:51.435860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce01aa-47eb-4e27-a0cc-a8c9b43e2f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:51.436550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce01aa-47eb-4e27-a0cc-a8c9b43e2f6f admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:51.436832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce01aa-47eb-4e27-a0cc-a8c9b43e2f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:51.437257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce01aa-47eb-4e27-a0cc-a8c9b43e2f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:51.438718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce01aa-47eb-4e27-a0cc-a8c9b43e2f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:51.440447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce01aa-47eb-4e27-a0cc-a8c9b43e2f6f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:51.453625 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1196/2364] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:51.459598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce01aa-47eb-4e27-a0cc-a8c9b43e2f6f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:51.470747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce01aa-47eb-4e27-a0cc-a8c9b43e2f6f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:51.475952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90810f-6953-4724-9ee7-1d9396f1d36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:51.477051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90810f-6953-4724-9ee7-1d9396f1d36b admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:51.477406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90810f-6953-4724-9ee7-1d9396f1d36b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:51.477688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90810f-6953-4724-9ee7-1d9396f1d36b admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:51.478967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90810f-6953-4724-9ee7-1d9396f1d36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:51.480533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90810f-6953-4724-9ee7-1d9396f1d36b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:51.494312 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1197/2365] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:09:51.500140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90810f-6953-4724-9ee7-1d9396f1d36b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:51.511964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90810f-6953-4724-9ee7-1d9396f1d36b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:51.518088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfe19d-763b-4b31-bd32-8194b1c5235b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:51.519829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfe19d-763b-4b31-bd32-8194b1c5235b admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:51.519829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfe19d-763b-4b31-bd32-8194b1c5235b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:51.524760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfe19d-763b-4b31-bd32-8194b1c5235b admin admin] PATH_INFO: `/v3/projects/5f9cdca4179c4875a4be57cf8a9f46a8/users/9c428093bcf445a6aea6ddb209e6e5cf/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:51.526687 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1169/2366] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:51 2022] PUT /identity/v3/projects/a379e3f37b394ab7986318989751035f/users/f4470c3b676347e29820cad396b32da2/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:51.532136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0892e-26d2-4e0f-a086-8b864ca6e42a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:51.539505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfe19d-763b-4b31-bd32-8194b1c5235b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f9cdca4179c4875a4be57cf8a9f46a8, user_id=9c428093bcf445a6aea6ddb209e6e5cf, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:51.542375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfe19d-763b-4b31-bd32-8194b1c5235b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:51.642505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0892e-26d2-4e0f-a086-8b864ca6e42a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:51.647779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eec668-cf8b-432d-9145-29af58060eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:51.648453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eec668-cf8b-432d-9145-29af58060eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:51.648739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eec668-cf8b-432d-9145-29af58060eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:51.649017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eec668-cf8b-432d-9145-29af58060eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:51.649785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eec668-cf8b-432d-9145-29af58060eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:51.651471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eec668-cf8b-432d-9145-29af58060eb3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:51.665873 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1170/2367] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:51.667083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eec668-cf8b-432d-9145-29af58060eb3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:51.677380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eec668-cf8b-432d-9145-29af58060eb3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:51.682774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1598c7-ca83-467c-a7eb-a1dce63ca7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:51.683526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1598c7-ca83-467c-a7eb-a1dce63ca7db admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:51.683811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1598c7-ca83-467c-a7eb-a1dce63ca7db admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:51.684308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1598c7-ca83-467c-a7eb-a1dce63ca7db admin admin] PATH_INFO: `/v3/projects/a379e3f37b394ab7986318989751035f/users/f4470c3b676347e29820cad396b32da2/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:51.686349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1598c7-ca83-467c-a7eb-a1dce63ca7db admin admin] RBAC: Authorizing `identity:create_grant(project_id=a379e3f37b394ab7986318989751035f, user_id=f4470c3b676347e29820cad396b32da2, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:51.689695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1598c7-ca83-467c-a7eb-a1dce63ca7db admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:51.701160 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1171/2368] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:51 2022] PUT /identity/v3/projects/a379e3f37b394ab7986318989751035f/users/f4470c3b676347e29820cad396b32da2/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:51.712327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060aaf8-5462-42e7-a5ed-7b6f811e88bc None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:51.712616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060aaf8-5462-42e7-a5ed-7b6f811e88bc None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:51.712896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060aaf8-5462-42e7-a5ed-7b6f811e88bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:51.737010 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1198/2369] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:51 2022] PUT /identity/v3/projects/5f9cdca4179c4875a4be57cf8a9f46a8/users/9c428093bcf445a6aea6ddb209e6e5cf/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:51.752514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4060aaf8-5462-42e7-a5ed-7b6f811e88bc None None] MFA Rules not processed for user `f4470c3b676347e29820cad396b32da2`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:51.752514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4060aaf8-5462-42e7-a5ed-7b6f811e88bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:51.753864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c5aee-4ef5-4290-a94f-f727ccb07a91 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:51.753990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c5aee-4ef5-4290-a94f-f727ccb07a91 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:51.754282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c5aee-4ef5-4290-a94f-f727ccb07a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:51.808430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-af4c5aee-4ef5-4290-a94f-f727ccb07a91 None None] MFA Rules not processed for user `9c428093bcf445a6aea6ddb209e6e5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:51.810323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-af4c5aee-4ef5-4290-a94f-f727ccb07a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:51.855244 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1172/2370] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:09:51.899213 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1199/2371] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:51.908521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060aaf8-5462-42e7-a5ed-7b6f811e88bc None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:51.980625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060aaf8-5462-42e7-a5ed-7b6f811e88bc None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:51.989249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c5aee-4ef5-4290-a94f-f727ccb07a91 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:51.992857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-af4c5aee-4ef5-4290-a94f-f727ccb07a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:52.002286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998eeef-18f7-4d23-9814-746781511f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:52.003121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998eeef-18f7-4d23-9814-746781511f5f admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:52.003446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998eeef-18f7-4d23-9814-746781511f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:52.003788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998eeef-18f7-4d23-9814-746781511f5f admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:52.004613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998eeef-18f7-4d23-9814-746781511f5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:52.006631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998eeef-18f7-4d23-9814-746781511f5f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:52.076745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c5aee-4ef5-4290-a94f-f727ccb07a91 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:52.083252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc3bb8-9984-4a24-b147-9999e5fba3be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:52.083925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc3bb8-9984-4a24-b147-9999e5fba3be service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:52.084200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc3bb8-9984-4a24-b147-9999e5fba3be service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:52.084467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc3bb8-9984-4a24-b147-9999e5fba3be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:52.092773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc3bb8-9984-4a24-b147-9999e5fba3be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:52.094888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc3bb8-9984-4a24-b147-9999e5fba3be service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:52.104694 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1200/2372] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:09:52.160211 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1173/2373] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:51 2022] POST /identity/v3/projects => generated 395 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:52.164428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc3bb8-9984-4a24-b147-9999e5fba3be service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:52.176180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc3bb8-9984-4a24-b147-9999e5fba3be service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:52.238353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3d910-a492-4eea-8947-70e12412868d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:52.239144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3d910-a492-4eea-8947-70e12412868d admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:52.239426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3d910-a492-4eea-8947-70e12412868d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:52.239703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3d910-a492-4eea-8947-70e12412868d admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:52.240397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3d910-a492-4eea-8947-70e12412868d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:52.242322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3d910-a492-4eea-8947-70e12412868d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:52.318106 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1201/2374] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:52 2022] POST /identity/v3/users => generated 304 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:52.322300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998eeef-18f7-4d23-9814-746781511f5f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:52.334183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998eeef-18f7-4d23-9814-746781511f5f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:52.340019 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a25bd7-4db6-4dda-8034-1391534f8c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:52.340933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a25bd7-4db6-4dda-8034-1391534f8c57 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:52.341261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a25bd7-4db6-4dda-8034-1391534f8c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:52.341688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a25bd7-4db6-4dda-8034-1391534f8c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:52.342700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a25bd7-4db6-4dda-8034-1391534f8c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:52.345859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a25bd7-4db6-4dda-8034-1391534f8c57 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:52.361189 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1174/2375] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:52.365069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3d910-a492-4eea-8947-70e12412868d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:52.376600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3d910-a492-4eea-8947-70e12412868d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:52.393983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2c8f2-0191-4c48-ac8c-06803310c52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:52.395449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2c8f2-0191-4c48-ac8c-06803310c52c admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:52.396245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2c8f2-0191-4c48-ac8c-06803310c52c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:52.396631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2c8f2-0191-4c48-ac8c-06803310c52c admin admin] PATH_INFO: `/v3/projects/7b35e417b1f84a99a10fe98ed6964d30/users/94e0c3e66a3544438cd7a481427b011d/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:52.419239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2c8f2-0191-4c48-ac8c-06803310c52c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b35e417b1f84a99a10fe98ed6964d30, user_id=94e0c3e66a3544438cd7a481427b011d, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:52.423494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2c8f2-0191-4c48-ac8c-06803310c52c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:52.548101 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1202/2376] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:52 2022] PUT /identity/v3/projects/7b35e417b1f84a99a10fe98ed6964d30/users/94e0c3e66a3544438cd7a481427b011d/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:52.552201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a25bd7-4db6-4dda-8034-1391534f8c57 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:52.588648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a25bd7-4db6-4dda-8034-1391534f8c57 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:52.659029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3245ae-a5ae-4558-a3c9-5401e5dd9dbc None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:52.659385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3245ae-a5ae-4558-a3c9-5401e5dd9dbc None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:52.659485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3245ae-a5ae-4558-a3c9-5401e5dd9dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:52.698758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4704d-ad12-44f8-a577-697748bdd4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:52.699548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4704d-ad12-44f8-a577-697748bdd4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:52.699855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4704d-ad12-44f8-a577-697748bdd4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:52.700307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4704d-ad12-44f8-a577-697748bdd4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:52.701065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4704d-ad12-44f8-a577-697748bdd4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:52.702702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4704d-ad12-44f8-a577-697748bdd4b3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:52.711116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ef3245ae-a5ae-4558-a3c9-5401e5dd9dbc None None] MFA Rules not processed for user `a9b68dacc4b8463ba07fae6372131117`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:52.712246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ef3245ae-a5ae-4558-a3c9-5401e5dd9dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:52.720422 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1175/2377] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:52.728290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4704d-ad12-44f8-a577-697748bdd4b3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:52.743223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4704d-ad12-44f8-a577-697748bdd4b3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:52.749095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:52.756209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9d8a7-47d3-40b3-876f-d5bd62011853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:52.757648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9d8a7-47d3-40b3-876f-d5bd62011853 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:52.758048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9d8a7-47d3-40b3-876f-d5bd62011853 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:52.758468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9d8a7-47d3-40b3-876f-d5bd62011853 admin admin] PATH_INFO: `/v3/projects/7b35e417b1f84a99a10fe98ed6964d30/users/94e0c3e66a3544438cd7a481427b011d/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:52.761757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9d8a7-47d3-40b3-876f-d5bd62011853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b35e417b1f84a99a10fe98ed6964d30, user_id=94e0c3e66a3544438cd7a481427b011d, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:52.767490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9d8a7-47d3-40b3-876f-d5bd62011853 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:52.787355 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1176/2378] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:52 2022] PUT /identity/v3/projects/7b35e417b1f84a99a10fe98ed6964d30/users/94e0c3e66a3544438cd7a481427b011d/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:52.798364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c30fb7-afb7-4279-836d-ebb6819ef3f4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:52.798662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c30fb7-afb7-4279-836d-ebb6819ef3f4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:52.799374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c30fb7-afb7-4279-836d-ebb6819ef3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:52.826533 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1203/2379] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:52.852727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e1c30fb7-afb7-4279-836d-ebb6819ef3f4 None None] MFA Rules not processed for user `94e0c3e66a3544438cd7a481427b011d`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:52.854048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e1c30fb7-afb7-4279-836d-ebb6819ef3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:53.027922 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1177/2380] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:53.040426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca7f94-ab06-4faf-9181-21ceb157614d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:53.040712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca7f94-ab06-4faf-9181-21ceb157614d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:53.041051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca7f94-ab06-4faf-9181-21ceb157614d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:53.049619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c30fb7-afb7-4279-836d-ebb6819ef3f4 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:53.068402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8bca7f94-ab06-4faf-9181-21ceb157614d None None] MFA Rules not processed for user `9c428093bcf445a6aea6ddb209e6e5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:53.071029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8bca7f94-ab06-4faf-9181-21ceb157614d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:53.153359 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1204/2381] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:53.178556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c30fb7-afb7-4279-836d-ebb6819ef3f4 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:53.186134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2be8a-fad0-44ad-8275-645667db5ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:53.187655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2be8a-fad0-44ad-8275-645667db5ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:53.187939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2be8a-fad0-44ad-8275-645667db5ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:53.189158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2be8a-fad0-44ad-8275-645667db5ea6 admin admin] PATH_INFO: `/v3/users/448a33a68a3643a799cfbc71cc441509` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:53.190508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2be8a-fad0-44ad-8275-645667db5ea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=448a33a68a3643a799cfbc71cc441509)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:53.192661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2be8a-fad0-44ad-8275-645667db5ea6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:53.321080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca7f94-ab06-4faf-9181-21ceb157614d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:53.323137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8bca7f94-ab06-4faf-9181-21ceb157614d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:53.409414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca7f94-ab06-4faf-9181-21ceb157614d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:53.415579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248494df-96a4-4b88-b308-e9b45aa340b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:53.416468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248494df-96a4-4b88-b308-e9b45aa340b6 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:53.416755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248494df-96a4-4b88-b308-e9b45aa340b6 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:53.417028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248494df-96a4-4b88-b308-e9b45aa340b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:53.426107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248494df-96a4-4b88-b308-e9b45aa340b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:53.427789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248494df-96a4-4b88-b308-e9b45aa340b6 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:53.438482 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1205/2382] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:09:53.511456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d6b2be8a-fad0-44ad-8275-645667db5ea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448a33a68a3643a799cfbc71cc441509'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:53.527621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d6b2be8a-fad0-44ad-8275-645667db5ea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448a33a68a3643a799cfbc71cc441509'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:53.535515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:53.683649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d6b2be8a-fad0-44ad-8275-645667db5ea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448a33a68a3643a799cfbc71cc441509'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:53.698016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d6b2be8a-fad0-44ad-8275-645667db5ea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448a33a68a3643a799cfbc71cc441509'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:53.699341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d6b2be8a-fad0-44ad-8275-645667db5ea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448a33a68a3643a799cfbc71cc441509'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:53.710840 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1178/2383] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:09:53 2022] DELETE /identity/v3/users/448a33a68a3643a799cfbc71cc441509 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:53.712678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3386d-94ca-413c-8538-629f52524d73 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:53.713182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3386d-94ca-413c-8538-629f52524d73 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:53.713324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3386d-94ca-413c-8538-629f52524d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:53.751884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ebb3386d-94ca-413c-8538-629f52524d73 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:53.753238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ebb3386d-94ca-413c-8538-629f52524d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:53.848761 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1206/2384] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:53.887287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2be8a-fad0-44ad-8275-645667db5ea6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:53.888794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d6b2be8a-fad0-44ad-8275-645667db5ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:53.989670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2be8a-fad0-44ad-8275-645667db5ea6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:53.994277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6ccfb-4b19-4a89-a14f-a0ebee2c4edf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:53.994938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6ccfb-4b19-4a89-a14f-a0ebee2c4edf service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:53.995454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6ccfb-4b19-4a89-a14f-a0ebee2c4edf service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:53.995727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6ccfb-4b19-4a89-a14f-a0ebee2c4edf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:54.016752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6ccfb-4b19-4a89-a14f-a0ebee2c4edf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:54.018951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6ccfb-4b19-4a89-a14f-a0ebee2c4edf service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:54.033194 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1179/2385] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:09:54.913294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3386d-94ca-413c-8538-629f52524d73 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:54.915359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ebb3386d-94ca-413c-8538-629f52524d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:54.948236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3386d-94ca-413c-8538-629f52524d73 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:54.962812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28952f9a-5b52-4166-a5b3-f17d5f50ec85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:54.965132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28952f9a-5b52-4166-a5b3-f17d5f50ec85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:54.968358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28952f9a-5b52-4166-a5b3-f17d5f50ec85 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:54.971199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28952f9a-5b52-4166-a5b3-f17d5f50ec85 admin admin] PATH_INFO: `/v3/projects/ba5f10b718604fafbd5f802302f496d8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:54.975419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28952f9a-5b52-4166-a5b3-f17d5f50ec85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba5f10b718604fafbd5f802302f496d8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:54.982695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28952f9a-5b52-4166-a5b3-f17d5f50ec85 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:55.055782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:55.224625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-28952f9a-5b52-4166-a5b3-f17d5f50ec85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba5f10b718604fafbd5f802302f496d8', 'request_id': 'req-28952f9a-5b52-4166-a5b3-f17d5f50ec85'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:55.238962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-28952f9a-5b52-4166-a5b3-f17d5f50ec85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba5f10b718604fafbd5f802302f496d8', 'request_id': 'req-28952f9a-5b52-4166-a5b3-f17d5f50ec85'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:55.246434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-28952f9a-5b52-4166-a5b3-f17d5f50ec85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba5f10b718604fafbd5f802302f496d8', 'request_id': 'req-28952f9a-5b52-4166-a5b3-f17d5f50ec85'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:55.335270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-28952f9a-5b52-4166-a5b3-f17d5f50ec85 admin admin] The token cache is being invalidate because project ba5f10b718604fafbd5f802302f496d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:55.335857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-28952f9a-5b52-4166-a5b3-f17d5f50ec85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:55.336521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-28952f9a-5b52-4166-a5b3-f17d5f50ec85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:55.338279 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1207/2386] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:54 2022] DELETE /identity/v3/projects/ba5f10b718604fafbd5f802302f496d8 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:55.343476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6ccfb-4b19-4a89-a14f-a0ebee2c4edf service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:55.356426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6ccfb-4b19-4a89-a14f-a0ebee2c4edf service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:55.501482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0afb35-2127-429b-b41b-8ff00fcbea53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:55.502366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0afb35-2127-429b-b41b-8ff00fcbea53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:55.502646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0afb35-2127-429b-b41b-8ff00fcbea53 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:55.502922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0afb35-2127-429b-b41b-8ff00fcbea53 admin admin] PATH_INFO: `/v3/users/f4470c3b676347e29820cad396b32da2` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:55.504590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0afb35-2127-429b-b41b-8ff00fcbea53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4470c3b676347e29820cad396b32da2)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:55.506572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0afb35-2127-429b-b41b-8ff00fcbea53 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:55.837826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6a0afb35-2127-429b-b41b-8ff00fcbea53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4470c3b676347e29820cad396b32da2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:55.850274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6a0afb35-2127-429b-b41b-8ff00fcbea53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4470c3b676347e29820cad396b32da2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:55.952314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6a0afb35-2127-429b-b41b-8ff00fcbea53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4470c3b676347e29820cad396b32da2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:55.961042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6a0afb35-2127-429b-b41b-8ff00fcbea53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4470c3b676347e29820cad396b32da2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:55.961940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6a0afb35-2127-429b-b41b-8ff00fcbea53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4470c3b676347e29820cad396b32da2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:55.968352 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1180/2387] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:09:55 2022] DELETE /identity/v3/users/f4470c3b676347e29820cad396b32da2 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:56.152494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85524af7-b907-4167-9abb-1477e06da595 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:56.152992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85524af7-b907-4167-9abb-1477e06da595 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:56.153576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85524af7-b907-4167-9abb-1477e06da595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:56.171486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-85524af7-b907-4167-9abb-1477e06da595 None None] MFA Rules not processed for user `abeb7020019d41a18de42956d706a011`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:56.173860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-85524af7-b907-4167-9abb-1477e06da595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:56.237164 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1208/2388] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:56.358650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:56.882137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0afb35-2127-429b-b41b-8ff00fcbea53 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:56.884039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6a0afb35-2127-429b-b41b-8ff00fcbea53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:56.971661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0afb35-2127-429b-b41b-8ff00fcbea53 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:56.977936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bab87-b818-4835-9a3f-690641d091b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:56.978814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bab87-b818-4835-9a3f-690641d091b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:56.979165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bab87-b818-4835-9a3f-690641d091b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:56.979450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bab87-b818-4835-9a3f-690641d091b5 admin admin] PATH_INFO: `/v3/projects/a379e3f37b394ab7986318989751035f` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:56.980690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bab87-b818-4835-9a3f-690641d091b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a379e3f37b394ab7986318989751035f)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:56.983053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bab87-b818-4835-9a3f-690641d091b5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:57.138340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-162bab87-b818-4835-9a3f-690641d091b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a379e3f37b394ab7986318989751035f', 'request_id': 'req-162bab87-b818-4835-9a3f-690641d091b5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:57.144604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-162bab87-b818-4835-9a3f-690641d091b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a379e3f37b394ab7986318989751035f', 'request_id': 'req-162bab87-b818-4835-9a3f-690641d091b5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:57.158067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-162bab87-b818-4835-9a3f-690641d091b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a379e3f37b394ab7986318989751035f', 'request_id': 'req-162bab87-b818-4835-9a3f-690641d091b5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:57.238513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:57.311885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-162bab87-b818-4835-9a3f-690641d091b5 admin admin] The token cache is being invalidate because project a379e3f37b394ab7986318989751035f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:09:57.312280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-162bab87-b818-4835-9a3f-690641d091b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:57.313156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-162bab87-b818-4835-9a3f-690641d091b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:09:57.315471 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1181/2389] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:09:56 2022] DELETE /identity/v3/projects/a379e3f37b394ab7986318989751035f => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:57.320680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b056d1-650e-45e7-9136-0b1bf7595122 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:57.321330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b056d1-650e-45e7-9136-0b1bf7595122 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:57.321330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b056d1-650e-45e7-9136-0b1bf7595122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:57.341591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-77b056d1-650e-45e7-9136-0b1bf7595122 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:57.343576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-77b056d1-650e-45e7-9136-0b1bf7595122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:57.415969 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1209/2390] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:57.426898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f711a-d663-4570-a65c-66c6399232aa None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:57.427233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f711a-d663-4570-a65c-66c6399232aa None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:57.427517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f711a-d663-4570-a65c-66c6399232aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:57.456462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6a3f711a-d663-4570-a65c-66c6399232aa None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:57.457753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6a3f711a-d663-4570-a65c-66c6399232aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:57.471476 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1182/2391] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:09:57.475658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b056d1-650e-45e7-9136-0b1bf7595122 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:57.489032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b056d1-650e-45e7-9136-0b1bf7595122 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:57.496027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f863f-a29f-46d3-a27f-803e7bbc0251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:57.496905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f863f-a29f-46d3-a27f-803e7bbc0251 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:57.497450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f863f-a29f-46d3-a27f-803e7bbc0251 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:57.497877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f863f-a29f-46d3-a27f-803e7bbc0251 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:57.498821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f863f-a29f-46d3-a27f-803e7bbc0251 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:09:57.499475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f863f-a29f-46d3-a27f-803e7bbc0251 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:57.502768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f863f-a29f-46d3-a27f-803e7bbc0251 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:57.517514 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1210/2392] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:09:57.523343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f711a-d663-4570-a65c-66c6399232aa None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:57.538955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f711a-d663-4570-a65c-66c6399232aa None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:57.545469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abd221-846b-4ea9-8494-b4bdd6c60a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:57.546418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abd221-846b-4ea9-8494-b4bdd6c60a18 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:57.546710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abd221-846b-4ea9-8494-b4bdd6c60a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:57.547148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abd221-846b-4ea9-8494-b4bdd6c60a18 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:57.547944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abd221-846b-4ea9-8494-b4bdd6c60a18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:57.550443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abd221-846b-4ea9-8494-b4bdd6c60a18 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:57.688952 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1183/2393] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:57 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:57.691391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f863f-a29f-46d3-a27f-803e7bbc0251 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:57.709366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f863f-a29f-46d3-a27f-803e7bbc0251 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:57.797937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b144207-2549-4b6a-ac81-242dc36a85d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:57.800178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b144207-2549-4b6a-ac81-242dc36a85d9 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:57.800178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b144207-2549-4b6a-ac81-242dc36a85d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:57.800178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b144207-2549-4b6a-ac81-242dc36a85d9 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:57.800178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b144207-2549-4b6a-ac81-242dc36a85d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:57.802172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b144207-2549-4b6a-ac81-242dc36a85d9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:57.931203 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1211/2394] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:57 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:09:57.935275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abd221-846b-4ea9-8494-b4bdd6c60a18 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:57.957028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abd221-846b-4ea9-8494-b4bdd6c60a18 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:57.975600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fde2f2-62b0-43be-9fd3-7eda19b31eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:57.979521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fde2f2-62b0-43be-9fd3-7eda19b31eaf admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:57.979521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fde2f2-62b0-43be-9fd3-7eda19b31eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:57.979521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fde2f2-62b0-43be-9fd3-7eda19b31eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:57.979521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fde2f2-62b0-43be-9fd3-7eda19b31eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:57.983417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fde2f2-62b0-43be-9fd3-7eda19b31eaf admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:58.023116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76c771-bf89-43b7-b082-a028d50ab881 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:58.023577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76c771-bf89-43b7-b082-a028d50ab881 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:58.023874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76c771-bf89-43b7-b082-a028d50ab881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:58.025919 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1184/2395] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:58.028180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fde2f2-62b0-43be-9fd3-7eda19b31eaf admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:58.052558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fde2f2-62b0-43be-9fd3-7eda19b31eaf admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:58.059678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4e76c771-bf89-43b7-b082-a028d50ab881 None None] MFA Rules not processed for user `ef9cbce2b2e64665b7f50767342dcb46`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:58.060913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4e76c771-bf89-43b7-b082-a028d50ab881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:58.067882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584d601-ef4a-4130-b70a-cb611a1932bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:58.072060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584d601-ef4a-4130-b70a-cb611a1932bf admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:58.072597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584d601-ef4a-4130-b70a-cb611a1932bf admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:58.073793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584d601-ef4a-4130-b70a-cb611a1932bf admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:58.074748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584d601-ef4a-4130-b70a-cb611a1932bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:58.080893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584d601-ef4a-4130-b70a-cb611a1932bf admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:58.116491 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1185/2396] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:58.122846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584d601-ef4a-4130-b70a-cb611a1932bf admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:58.149463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584d601-ef4a-4130-b70a-cb611a1932bf admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:58.186847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec818b-6edb-4f74-b1f0-0c30c8d75ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:58.186847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec818b-6edb-4f74-b1f0-0c30c8d75ad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:58.186847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec818b-6edb-4f74-b1f0-0c30c8d75ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:58.186847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec818b-6edb-4f74-b1f0-0c30c8d75ad0 admin admin] PATH_INFO: `/v3/projects/3caa92c882de41cf9c40dd3a47d20db7/users/587057ad0ece48d2a6ae419b7535ef64/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:58.201937 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1212/2397] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:09:58.237830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec818b-6edb-4f74-b1f0-0c30c8d75ad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3caa92c882de41cf9c40dd3a47d20db7, user_id=587057ad0ece48d2a6ae419b7535ef64, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:58.240576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec818b-6edb-4f74-b1f0-0c30c8d75ad0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:58.348080 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1186/2398] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:58 2022] PUT /identity/v3/projects/3caa92c882de41cf9c40dd3a47d20db7/users/587057ad0ece48d2a6ae419b7535ef64/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:58.354668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1d86e-d2d2-444b-bf4a-348160bb8722 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:58.355218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1d86e-d2d2-444b-bf4a-348160bb8722 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:58.355218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1d86e-d2d2-444b-bf4a-348160bb8722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:58.397836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f0b1d86e-d2d2-444b-bf4a-348160bb8722 None None] MFA Rules not processed for user `587057ad0ece48d2a6ae419b7535ef64`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:58.399110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f0b1d86e-d2d2-444b-bf4a-348160bb8722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:58.490181 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1213/2399] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:09:58.495334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec818b-6edb-4f74-b1f0-0c30c8d75ad0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:58.616171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec818b-6edb-4f74-b1f0-0c30c8d75ad0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:58.643419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d74c61-1ce2-4f26-8da8-94cbd50a8bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:58.643419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d74c61-1ce2-4f26-8da8-94cbd50a8bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:58.643419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d74c61-1ce2-4f26-8da8-94cbd50a8bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:58.643419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d74c61-1ce2-4f26-8da8-94cbd50a8bf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:58.643776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d74c61-1ce2-4f26-8da8-94cbd50a8bf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:58.643776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d74c61-1ce2-4f26-8da8-94cbd50a8bf9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:58.883188 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1187/2400] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:09:58 2022] POST /identity/v3/projects => generated 375 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:58.884442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1d86e-d2d2-444b-bf4a-348160bb8722 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:58.897008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1d86e-d2d2-444b-bf4a-348160bb8722 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:58.982811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946980b-7279-4996-8a5d-7d85fd8f8794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:58.990498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946980b-7279-4996-8a5d-7d85fd8f8794 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:58.991478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946980b-7279-4996-8a5d-7d85fd8f8794 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:58.991771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946980b-7279-4996-8a5d-7d85fd8f8794 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:58.992796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946980b-7279-4996-8a5d-7d85fd8f8794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:58.994594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946980b-7279-4996-8a5d-7d85fd8f8794 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:59.078846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:59.115294 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1214/2401] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:09:58 2022] POST /identity/v3/users => generated 294 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:09:59.119600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d74c61-1ce2-4f26-8da8-94cbd50a8bf9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:59.123680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:09:59.134452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d74c61-1ce2-4f26-8da8-94cbd50a8bf9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:59.146988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6ca03-4e48-4ba7-a089-fc449bb5db29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:59.147697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6ca03-4e48-4ba7-a089-fc449bb5db29 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:59.147978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6ca03-4e48-4ba7-a089-fc449bb5db29 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:59.148372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6ca03-4e48-4ba7-a089-fc449bb5db29 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:59.149113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6ca03-4e48-4ba7-a089-fc449bb5db29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:59.150827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6ca03-4e48-4ba7-a089-fc449bb5db29 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:59.168398 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1188/2402] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:59.170406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946980b-7279-4996-8a5d-7d85fd8f8794 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:59.181756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946980b-7279-4996-8a5d-7d85fd8f8794 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:59.188807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83575226-bc60-47e4-a9a9-064733729b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:59.189955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83575226-bc60-47e4-a9a9-064733729b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:59.191039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83575226-bc60-47e4-a9a9-064733729b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:59.191039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83575226-bc60-47e4-a9a9-064733729b34 admin admin] PATH_INFO: `/v3/projects/8f20749824c24f70a981dad14a0c6b9a/users/87ba7aa1510244a5a2543b78c9691a97/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:59.211533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83575226-bc60-47e4-a9a9-064733729b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f20749824c24f70a981dad14a0c6b9a, user_id=87ba7aa1510244a5a2543b78c9691a97, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:59.211842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83575226-bc60-47e4-a9a9-064733729b34 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:59.295777 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1215/2403] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:59 2022] PUT /identity/v3/projects/8f20749824c24f70a981dad14a0c6b9a/users/87ba7aa1510244a5a2543b78c9691a97/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:09:59.298839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6ca03-4e48-4ba7-a089-fc449bb5db29 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:59.310265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6ca03-4e48-4ba7-a089-fc449bb5db29 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:59.373197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d5b93-1029-486b-a2bd-1eeec572ad62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:59.373871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d5b93-1029-486b-a2bd-1eeec572ad62 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:59.374332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d5b93-1029-486b-a2bd-1eeec572ad62 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:59.374609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d5b93-1029-486b-a2bd-1eeec572ad62 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:59.375404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d5b93-1029-486b-a2bd-1eeec572ad62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:59.377006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d5b93-1029-486b-a2bd-1eeec572ad62 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:59.390687 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1189/2404] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:09:59.392703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83575226-bc60-47e4-a9a9-064733729b34 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:09:59.403481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83575226-bc60-47e4-a9a9-064733729b34 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:09:59.409720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc084194-844e-4903-a08a-88f716b8a7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:09:59.410714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc084194-844e-4903-a08a-88f716b8a7a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:59.411103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc084194-844e-4903-a08a-88f716b8a7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:59.411462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc084194-844e-4903-a08a-88f716b8a7a4 admin admin] PATH_INFO: `/v3/projects/8f20749824c24f70a981dad14a0c6b9a/users/87ba7aa1510244a5a2543b78c9691a97/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:59.420145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc084194-844e-4903-a08a-88f716b8a7a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f20749824c24f70a981dad14a0c6b9a, user_id=87ba7aa1510244a5a2543b78c9691a97, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:09:59.423125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc084194-844e-4903-a08a-88f716b8a7a4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:09:59.436232 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1216/2405] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:09:59 2022] PUT /identity/v3/projects/8f20749824c24f70a981dad14a0c6b9a/users/87ba7aa1510244a5a2543b78c9691a97/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:09:59.448302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d97031-dd54-46a2-b708-5a6846ce889b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:09:59.448814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d97031-dd54-46a2-b708-5a6846ce889b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:09:59.449093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d97031-dd54-46a2-b708-5a6846ce889b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:09:59.478586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-77d97031-dd54-46a2-b708-5a6846ce889b None None] MFA Rules not processed for user `87ba7aa1510244a5a2543b78c9691a97`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:09:59.479838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-77d97031-dd54-46a2-b708-5a6846ce889b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:09:59.585221 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1190/2406] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:09:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:00.066737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc084194-844e-4903-a08a-88f716b8a7a4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:00.068630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bc084194-844e-4903-a08a-88f716b8a7a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:00.306839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc084194-844e-4903-a08a-88f716b8a7a4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:00.315331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4cf60-89e2-4a0c-8841-f0fdef020e14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:00.316068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4cf60-89e2-4a0c-8841-f0fdef020e14 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:00.316351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4cf60-89e2-4a0c-8841-f0fdef020e14 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:00.316626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4cf60-89e2-4a0c-8841-f0fdef020e14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:00.334033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4cf60-89e2-4a0c-8841-f0fdef020e14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:00.336570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4cf60-89e2-4a0c-8841-f0fdef020e14 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:00.351539 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1217/2407] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:10:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:10:00.929650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:01.284144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:02.226238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:04.723462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:05.009456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:08.066755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:08.076789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d97031-dd54-46a2-b708-5a6846ce889b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:08.190197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d97031-dd54-46a2-b708-5a6846ce889b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:08.196875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ab3fc-1439-4067-b2d4-9f8202ed3657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:08.198218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ab3fc-1439-4067-b2d4-9f8202ed3657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:08.198830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ab3fc-1439-4067-b2d4-9f8202ed3657 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:08.199276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ab3fc-1439-4067-b2d4-9f8202ed3657 admin admin] PATH_INFO: `/v3/users/587057ad0ece48d2a6ae419b7535ef64` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:08.200819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ab3fc-1439-4067-b2d4-9f8202ed3657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=587057ad0ece48d2a6ae419b7535ef64)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:08.204009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ab3fc-1439-4067-b2d4-9f8202ed3657 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:08.375026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:08.528648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d56ab3fc-1439-4067-b2d4-9f8202ed3657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '587057ad0ece48d2a6ae419b7535ef64'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:08.549762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d56ab3fc-1439-4067-b2d4-9f8202ed3657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '587057ad0ece48d2a6ae419b7535ef64'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:08.682043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d56ab3fc-1439-4067-b2d4-9f8202ed3657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '587057ad0ece48d2a6ae419b7535ef64'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:08.693178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d56ab3fc-1439-4067-b2d4-9f8202ed3657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '587057ad0ece48d2a6ae419b7535ef64'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:08.694297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d56ab3fc-1439-4067-b2d4-9f8202ed3657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '587057ad0ece48d2a6ae419b7535ef64'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:08.708281 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1191/2408] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:10:08 2022] DELETE /identity/v3/users/587057ad0ece48d2a6ae419b7535ef64 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:08.713160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809037cf-f62f-4fca-a7aa-ee25d0fb832e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:08.714362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809037cf-f62f-4fca-a7aa-ee25d0fb832e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:08.714846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809037cf-f62f-4fca-a7aa-ee25d0fb832e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:08.743173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-809037cf-f62f-4fca-a7aa-ee25d0fb832e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:08.744131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-809037cf-f62f-4fca-a7aa-ee25d0fb832e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:08.825607 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1218/2409] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:08.896424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ab3fc-1439-4067-b2d4-9f8202ed3657 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:08.899572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d56ab3fc-1439-4067-b2d4-9f8202ed3657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:09.011260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ab3fc-1439-4067-b2d4-9f8202ed3657 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:09.015844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8db8db-be12-4548-993a-1aff1566e6ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:09.018382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8db8db-be12-4548-993a-1aff1566e6ef service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:09.018382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8db8db-be12-4548-993a-1aff1566e6ef service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:09.018382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8db8db-be12-4548-993a-1aff1566e6ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:09.028872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8db8db-be12-4548-993a-1aff1566e6ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:09.030377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8db8db-be12-4548-993a-1aff1566e6ef service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:09.044262 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1192/2410] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:10:09.942335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8528ef-0ef4-4cbd-a4ab-762ad9f4f0f1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:09.943697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8528ef-0ef4-4cbd-a4ab-762ad9f4f0f1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:09.945737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8528ef-0ef4-4cbd-a4ab-762ad9f4f0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:09.988394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2e8528ef-0ef4-4cbd-a4ab-762ad9f4f0f1 None None] MFA Rules not processed for user `6a69f9dee03d43beaafa966216b9e289`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:09.989575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2e8528ef-0ef4-4cbd-a4ab-762ad9f4f0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:10.060000 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1219/2411] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:10.106284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8db8db-be12-4548-993a-1aff1566e6ef service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:10.107854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8f8db8db-be12-4548-993a-1aff1566e6ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:10.123919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:10.135292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8db8db-be12-4548-993a-1aff1566e6ef service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:10.147109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373b910-0802-453f-9697-16129a3e4d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:10.148047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373b910-0802-453f-9697-16129a3e4d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:10.148377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373b910-0802-453f-9697-16129a3e4d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:10.148699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373b910-0802-453f-9697-16129a3e4d8e admin admin] PATH_INFO: `/v3/projects/3caa92c882de41cf9c40dd3a47d20db7` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:10.150037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373b910-0802-453f-9697-16129a3e4d8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3caa92c882de41cf9c40dd3a47d20db7)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:10.152866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373b910-0802-453f-9697-16129a3e4d8e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:10.309128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4373b910-0802-453f-9697-16129a3e4d8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3caa92c882de41cf9c40dd3a47d20db7', 'request_id': 'req-4373b910-0802-453f-9697-16129a3e4d8e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:10.318086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4373b910-0802-453f-9697-16129a3e4d8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3caa92c882de41cf9c40dd3a47d20db7', 'request_id': 'req-4373b910-0802-453f-9697-16129a3e4d8e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:10.325161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4373b910-0802-453f-9697-16129a3e4d8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3caa92c882de41cf9c40dd3a47d20db7', 'request_id': 'req-4373b910-0802-453f-9697-16129a3e4d8e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:10.450318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4373b910-0802-453f-9697-16129a3e4d8e admin admin] The token cache is being invalidate because project 3caa92c882de41cf9c40dd3a47d20db7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:10:10.450663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4373b910-0802-453f-9697-16129a3e4d8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:10.451351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4373b910-0802-453f-9697-16129a3e4d8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:10.453602 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1193/2412] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:10:10 2022] DELETE /identity/v3/projects/3caa92c882de41cf9c40dd3a47d20db7 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:10.458346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8528ef-0ef4-4cbd-a4ab-762ad9f4f0f1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:10.470404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8528ef-0ef4-4cbd-a4ab-762ad9f4f0f1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:10.548269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9987b-fb0e-4e3e-bf17-aadb04385675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:10.549284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9987b-fb0e-4e3e-bf17-aadb04385675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:10.549950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9987b-fb0e-4e3e-bf17-aadb04385675 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:10.550458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9987b-fb0e-4e3e-bf17-aadb04385675 admin admin] PATH_INFO: `/v3/users/87ba7aa1510244a5a2543b78c9691a97` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:10.552044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9987b-fb0e-4e3e-bf17-aadb04385675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ba7aa1510244a5a2543b78c9691a97)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:10.554539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9987b-fb0e-4e3e-bf17-aadb04385675 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:10.729898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ebc9987b-fb0e-4e3e-bf17-aadb04385675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ba7aa1510244a5a2543b78c9691a97'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:10.739321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ebc9987b-fb0e-4e3e-bf17-aadb04385675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ba7aa1510244a5a2543b78c9691a97'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:10.826534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ebc9987b-fb0e-4e3e-bf17-aadb04385675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ba7aa1510244a5a2543b78c9691a97'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:10.830404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ebc9987b-fb0e-4e3e-bf17-aadb04385675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ba7aa1510244a5a2543b78c9691a97'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:10.844861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ebc9987b-fb0e-4e3e-bf17-aadb04385675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ba7aa1510244a5a2543b78c9691a97'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:10.851980 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1220/2413] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:10:10 2022] DELETE /identity/v3/users/87ba7aa1510244a5a2543b78c9691a97 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:10.980588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:11.300558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:11.776815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373b910-0802-453f-9697-16129a3e4d8e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:11.780086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4373b910-0802-453f-9697-16129a3e4d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:11.811028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373b910-0802-453f-9697-16129a3e4d8e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:11.939026 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935ba3c-c11f-48d6-9c90-1e4e1776028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:11.940373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935ba3c-c11f-48d6-9c90-1e4e1776028a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:11.940661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935ba3c-c11f-48d6-9c90-1e4e1776028a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:11.952877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935ba3c-c11f-48d6-9c90-1e4e1776028a admin admin] PATH_INFO: `/v3/projects/8f20749824c24f70a981dad14a0c6b9a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:11.955823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935ba3c-c11f-48d6-9c90-1e4e1776028a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f20749824c24f70a981dad14a0c6b9a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:11.960212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935ba3c-c11f-48d6-9c90-1e4e1776028a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:12.178062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2935ba3c-c11f-48d6-9c90-1e4e1776028a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f20749824c24f70a981dad14a0c6b9a', 'request_id': 'req-2935ba3c-c11f-48d6-9c90-1e4e1776028a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:12.215063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:12.231265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2935ba3c-c11f-48d6-9c90-1e4e1776028a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f20749824c24f70a981dad14a0c6b9a', 'request_id': 'req-2935ba3c-c11f-48d6-9c90-1e4e1776028a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:12.250945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2935ba3c-c11f-48d6-9c90-1e4e1776028a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f20749824c24f70a981dad14a0c6b9a', 'request_id': 'req-2935ba3c-c11f-48d6-9c90-1e4e1776028a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:12.349216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2935ba3c-c11f-48d6-9c90-1e4e1776028a admin admin] The token cache is being invalidate because project 8f20749824c24f70a981dad14a0c6b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:10:12.349697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2935ba3c-c11f-48d6-9c90-1e4e1776028a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:12.352386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2935ba3c-c11f-48d6-9c90-1e4e1776028a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:12.355265 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1194/2414] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:10:11 2022] DELETE /identity/v3/projects/8f20749824c24f70a981dad14a0c6b9a => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:12.361256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1116e46-2a5d-4955-88f1-88928f26aabe None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:12.361722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1116e46-2a5d-4955-88f1-88928f26aabe None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:12.361802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1116e46-2a5d-4955-88f1-88928f26aabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:12.393671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e1116e46-2a5d-4955-88f1-88928f26aabe None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:12.395672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e1116e46-2a5d-4955-88f1-88928f26aabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:12.438898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86bad4-0bb5-40bb-b365-e84cf8c1e4c9 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:12.439705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86bad4-0bb5-40bb-b365-e84cf8c1e4c9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:12.440439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86bad4-0bb5-40bb-b365-e84cf8c1e4c9 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:12.442505 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1195/2415] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:10:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 21:10:12.449022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bac1f0-7db7-409f-8942-b3c728500f7d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:12.449578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bac1f0-7db7-409f-8942-b3c728500f7d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:12.450290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bac1f0-7db7-409f-8942-b3c728500f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:12.477257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-65bac1f0-7db7-409f-8942-b3c728500f7d None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:12.478635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-65bac1f0-7db7-409f-8942-b3c728500f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:12.507803 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1221/2416] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:12.517622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f09b86-d89f-403d-ab23-d2401a634c26 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:12.517915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f09b86-d89f-403d-ab23-d2401a634c26 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:12.518277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f09b86-d89f-403d-ab23-d2401a634c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:12.553498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b8f09b86-d89f-403d-ab23-d2401a634c26 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:12.556040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b8f09b86-d89f-403d-ab23-d2401a634c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:12.576149 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1196/2417] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:10:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:10:12.581242 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1222/2418] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:12.590607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bac1f0-7db7-409f-8942-b3c728500f7d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:12.605173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f09b86-d89f-403d-ab23-d2401a634c26 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:12.606584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b8f09b86-d89f-403d-ab23-d2401a634c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:12.619246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bac1f0-7db7-409f-8942-b3c728500f7d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:12.629031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53830833-b28f-4600-a340-e3b616082c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:12.630247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53830833-b28f-4600-a340-e3b616082c46 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:12.630247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53830833-b28f-4600-a340-e3b616082c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:12.630247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53830833-b28f-4600-a340-e3b616082c46 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:12.630988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53830833-b28f-4600-a340-e3b616082c46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:10:12.631343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53830833-b28f-4600-a340-e3b616082c46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:12.633675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53830833-b28f-4600-a340-e3b616082c46 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:12.634298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f09b86-d89f-403d-ab23-d2401a634c26 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:12.640890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab44163-f3ce-46b9-afa3-b23d665876df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:12.641766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab44163-f3ce-46b9-afa3-b23d665876df service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:12.642144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab44163-f3ce-46b9-afa3-b23d665876df service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:12.642434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab44163-f3ce-46b9-afa3-b23d665876df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:12.655831 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1197/2419] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:10:12.658955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53830833-b28f-4600-a340-e3b616082c46 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:12.659179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab44163-f3ce-46b9-afa3-b23d665876df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:12.660235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab44163-f3ce-46b9-afa3-b23d665876df service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:12.676678 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1223/2420] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:10:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:10:12.678313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53830833-b28f-4600-a340-e3b616082c46 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:12.689355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34bda4-271f-4a2f-830d-010b5eb665ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:12.690010 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34bda4-271f-4a2f-830d-010b5eb665ff admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:12.690268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34bda4-271f-4a2f-830d-010b5eb665ff admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:12.690546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34bda4-271f-4a2f-830d-010b5eb665ff admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:12.691366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34bda4-271f-4a2f-830d-010b5eb665ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:12.693725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34bda4-271f-4a2f-830d-010b5eb665ff admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:12.837784 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1198/2421] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:10:12 2022] POST /identity/v3/projects => generated 397 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:10:12.838971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab44163-f3ce-46b9-afa3-b23d665876df service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:12.850555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab44163-f3ce-46b9-afa3-b23d665876df service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:12.920276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8d5bd-a855-44ae-b03c-e742ed48821e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:12.920966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8d5bd-a855-44ae-b03c-e742ed48821e admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:12.921724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8d5bd-a855-44ae-b03c-e742ed48821e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:12.921724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8d5bd-a855-44ae-b03c-e742ed48821e admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:12.922932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8d5bd-a855-44ae-b03c-e742ed48821e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:12.924671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8d5bd-a855-44ae-b03c-e742ed48821e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:13.066738 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1224/2422] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:10:12 2022] POST /identity/v3/users => generated 299 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:10:13.070905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34bda4-271f-4a2f-830d-010b5eb665ff admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:13.082014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34bda4-271f-4a2f-830d-010b5eb665ff admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:13.086652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ae586-8c76-475e-8dbf-b08844855348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:13.087360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ae586-8c76-475e-8dbf-b08844855348 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:13.087648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ae586-8c76-475e-8dbf-b08844855348 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:13.087929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ae586-8c76-475e-8dbf-b08844855348 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:13.088684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ae586-8c76-475e-8dbf-b08844855348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:13.090292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ae586-8c76-475e-8dbf-b08844855348 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:13.101837 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1199/2423] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:10:13.105840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8d5bd-a855-44ae-b03c-e742ed48821e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:13.117966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8d5bd-a855-44ae-b03c-e742ed48821e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:13.125017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec25fe-4ed9-46c8-9210-f52fd8b55e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:13.126550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec25fe-4ed9-46c8-9210-f52fd8b55e26 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:13.126550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec25fe-4ed9-46c8-9210-f52fd8b55e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:13.126818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec25fe-4ed9-46c8-9210-f52fd8b55e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:13.127793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec25fe-4ed9-46c8-9210-f52fd8b55e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:13.129526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec25fe-4ed9-46c8-9210-f52fd8b55e26 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:13.148269 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1225/2424] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:10:13.160766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ae586-8c76-475e-8dbf-b08844855348 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:13.177337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ae586-8c76-475e-8dbf-b08844855348 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:13.190492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705054a-ba5d-44b2-8624-c992432fc42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:13.191748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705054a-ba5d-44b2-8624-c992432fc42e admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:13.192910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705054a-ba5d-44b2-8624-c992432fc42e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:13.193359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705054a-ba5d-44b2-8624-c992432fc42e admin admin] PATH_INFO: `/v3/projects/d9b92fc544c544f686ac2ab7ff5123b6/users/578b87f863b34f57a571f7e56d44f118/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:13.233693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705054a-ba5d-44b2-8624-c992432fc42e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b92fc544c544f686ac2ab7ff5123b6, user_id=578b87f863b34f57a571f7e56d44f118, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:13.237324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705054a-ba5d-44b2-8624-c992432fc42e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:13.404338 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1200/2425] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:10:13 2022] PUT /identity/v3/projects/d9b92fc544c544f686ac2ab7ff5123b6/users/578b87f863b34f57a571f7e56d44f118/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:13.413413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42506813-0874-4d0e-8e8d-9e547d0a59f8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:13.413413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42506813-0874-4d0e-8e8d-9e547d0a59f8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:13.413983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42506813-0874-4d0e-8e8d-9e547d0a59f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:13.455680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-42506813-0874-4d0e-8e8d-9e547d0a59f8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:13.457526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-42506813-0874-4d0e-8e8d-9e547d0a59f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:13.541732 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1226/2426] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:13.554002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705054a-ba5d-44b2-8624-c992432fc42e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:13.556420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8705054a-ba5d-44b2-8624-c992432fc42e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:13.692164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705054a-ba5d-44b2-8624-c992432fc42e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:13.696705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295c1a7-f594-4e5c-b090-2916a7106883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:13.697369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295c1a7-f594-4e5c-b090-2916a7106883 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:13.697652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295c1a7-f594-4e5c-b090-2916a7106883 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:13.698372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295c1a7-f594-4e5c-b090-2916a7106883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:13.710486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295c1a7-f594-4e5c-b090-2916a7106883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:13.716479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295c1a7-f594-4e5c-b090-2916a7106883 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:13.725237 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1201/2427] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:10:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:10:15.232101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:15.494491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:16.878434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42506813-0874-4d0e-8e8d-9e547d0a59f8 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:16.879682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-42506813-0874-4d0e-8e8d-9e547d0a59f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:17.063464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42506813-0874-4d0e-8e8d-9e547d0a59f8 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:17.070774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e035d6-f56e-429d-9209-67ed125b7656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:17.071900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e035d6-f56e-429d-9209-67ed125b7656 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:17.072338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e035d6-f56e-429d-9209-67ed125b7656 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:17.072769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e035d6-f56e-429d-9209-67ed125b7656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:17.074999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b0e035d6-f56e-429d-9209-67ed125b7656 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:17.165819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e035d6-f56e-429d-9209-67ed125b7656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:17.173487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e035d6-f56e-429d-9209-67ed125b7656 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:17.184550 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1227/2428] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:10:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:10:17.873725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:18.838763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:19.216008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:19.839062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:20.204918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:21.511902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:22.326993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295c1a7-f594-4e5c-b090-2916a7106883 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:22.329611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1295c1a7-f594-4e5c-b090-2916a7106883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:22.350491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295c1a7-f594-4e5c-b090-2916a7106883 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:22.365495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b7f52-c183-4f5d-8057-9070a58375b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:22.366381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b7f52-c183-4f5d-8057-9070a58375b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:22.366669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b7f52-c183-4f5d-8057-9070a58375b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:22.366950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b7f52-c183-4f5d-8057-9070a58375b6 admin admin] PATH_INFO: `/v3/users/0d72626f465b4f37ad3b18bb945d4000` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:22.368896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b7f52-c183-4f5d-8057-9070a58375b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d72626f465b4f37ad3b18bb945d4000)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:22.370856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b7f52-c183-4f5d-8057-9070a58375b6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:22.391271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e035d6-f56e-429d-9209-67ed125b7656 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:22.392944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b0e035d6-f56e-429d-9209-67ed125b7656 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:22.422736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e035d6-f56e-429d-9209-67ed125b7656 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:22.429667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a9591-73d4-4c6d-bf9a-62899e305c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:22.430557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a9591-73d4-4c6d-bf9a-62899e305c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:22.430945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a9591-73d4-4c6d-bf9a-62899e305c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:22.431306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a9591-73d4-4c6d-bf9a-62899e305c88 admin admin] PATH_INFO: `/v3/users/9c428093bcf445a6aea6ddb209e6e5cf` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:22.433121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a9591-73d4-4c6d-bf9a-62899e305c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c428093bcf445a6aea6ddb209e6e5cf)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:22.437710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a9591-73d4-4c6d-bf9a-62899e305c88 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:22.443188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:22.665107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-577b7f52-c183-4f5d-8057-9070a58375b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d72626f465b4f37ad3b18bb945d4000'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:22.686145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-577b7f52-c183-4f5d-8057-9070a58375b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d72626f465b4f37ad3b18bb945d4000'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:22.692687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3c6a9591-73d4-4c6d-bf9a-62899e305c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c428093bcf445a6aea6ddb209e6e5cf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:22.702303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3c6a9591-73d4-4c6d-bf9a-62899e305c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c428093bcf445a6aea6ddb209e6e5cf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:22.844495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-577b7f52-c183-4f5d-8057-9070a58375b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d72626f465b4f37ad3b18bb945d4000'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:22.861450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-577b7f52-c183-4f5d-8057-9070a58375b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d72626f465b4f37ad3b18bb945d4000'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:22.863264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-577b7f52-c183-4f5d-8057-9070a58375b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d72626f465b4f37ad3b18bb945d4000'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:22.882789 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1202/2429] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:10:22 2022] DELETE /identity/v3/users/0d72626f465b4f37ad3b18bb945d4000 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:22.889216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed03ecf-7292-4b5d-bedf-94b2d2e18f2d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:22.889755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed03ecf-7292-4b5d-bedf-94b2d2e18f2d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:22.890871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed03ecf-7292-4b5d-bedf-94b2d2e18f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:22.924255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-aed03ecf-7292-4b5d-bedf-94b2d2e18f2d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:22.925506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-aed03ecf-7292-4b5d-bedf-94b2d2e18f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:22.928803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3c6a9591-73d4-4c6d-bf9a-62899e305c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c428093bcf445a6aea6ddb209e6e5cf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:22.929477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3c6a9591-73d4-4c6d-bf9a-62899e305c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c428093bcf445a6aea6ddb209e6e5cf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:22.957412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3c6a9591-73d4-4c6d-bf9a-62899e305c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c428093bcf445a6aea6ddb209e6e5cf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:22.976064 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1228/2430] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:10:22 2022] DELETE /identity/v3/users/9c428093bcf445a6aea6ddb209e6e5cf => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:22.980701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1983bb-385f-48a4-ae38-d2d948642097 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:22.984591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1983bb-385f-48a4-ae38-d2d948642097 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:22.984591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1983bb-385f-48a4-ae38-d2d948642097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:23.032188 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1203/2431] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:10:23.036216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8b1983bb-385f-48a4-ae38-d2d948642097 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:23.037471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8b1983bb-385f-48a4-ae38-d2d948642097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:23.055716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed03ecf-7292-4b5d-bedf-94b2d2e18f2d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:23.057891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-aed03ecf-7292-4b5d-bedf-94b2d2e18f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:23.154475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed03ecf-7292-4b5d-bedf-94b2d2e18f2d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:23.190309 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1229/2432] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:23.202291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1983bb-385f-48a4-ae38-d2d948642097 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:23.271071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b360d7-62bd-4109-86a9-fae987c56616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:23.271764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b360d7-62bd-4109-86a9-fae987c56616 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:23.272046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b360d7-62bd-4109-86a9-fae987c56616 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:23.272321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b360d7-62bd-4109-86a9-fae987c56616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:23.299223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b360d7-62bd-4109-86a9-fae987c56616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:23.299223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b360d7-62bd-4109-86a9-fae987c56616 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:23.309612 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1204/2433] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:10:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:10:23.349348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1983bb-385f-48a4-ae38-d2d948642097 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:23.353386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8917854-345d-4613-8e99-910d15cff32d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:23.354059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8917854-345d-4613-8e99-910d15cff32d service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:23.354344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8917854-345d-4613-8e99-910d15cff32d service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:23.354650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8917854-345d-4613-8e99-910d15cff32d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:23.367589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8917854-345d-4613-8e99-910d15cff32d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:23.369097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8917854-345d-4613-8e99-910d15cff32d service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:23.382250 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1230/2434] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:10:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:10:23.963211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:24.270976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0acd70-f142-4182-ac44-41377b7efbe9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:24.271565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0acd70-f142-4182-ac44-41377b7efbe9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:24.271649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0acd70-f142-4182-ac44-41377b7efbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:24.292264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-fe0acd70-f142-4182-ac44-41377b7efbe9 None None] MFA Rules not processed for user `abeb7020019d41a18de42956d706a011`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:24.293496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fe0acd70-f142-4182-ac44-41377b7efbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:24.324562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8917854-345d-4613-8e99-910d15cff32d service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:24.326645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f8917854-345d-4613-8e99-910d15cff32d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:24.353918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8917854-345d-4613-8e99-910d15cff32d service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:24.367904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff32b11-3c00-4afb-80d0-0f520c844a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:24.368980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff32b11-3c00-4afb-80d0-0f520c844a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:24.369362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff32b11-3c00-4afb-80d0-0f520c844a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:24.369529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff32b11-3c00-4afb-80d0-0f520c844a3c admin admin] PATH_INFO: `/v3/projects/5f9cdca4179c4875a4be57cf8a9f46a8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:24.371662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff32b11-3c00-4afb-80d0-0f520c844a3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f9cdca4179c4875a4be57cf8a9f46a8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:24.373739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff32b11-3c00-4afb-80d0-0f520c844a3c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:24.397458 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1205/2435] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:24.550850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eff32b11-3c00-4afb-80d0-0f520c844a3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f9cdca4179c4875a4be57cf8a9f46a8', 'request_id': 'req-eff32b11-3c00-4afb-80d0-0f520c844a3c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:24.559159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eff32b11-3c00-4afb-80d0-0f520c844a3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f9cdca4179c4875a4be57cf8a9f46a8', 'request_id': 'req-eff32b11-3c00-4afb-80d0-0f520c844a3c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:24.567762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eff32b11-3c00-4afb-80d0-0f520c844a3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f9cdca4179c4875a4be57cf8a9f46a8', 'request_id': 'req-eff32b11-3c00-4afb-80d0-0f520c844a3c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:24.669896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0acd70-f142-4182-ac44-41377b7efbe9 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:24.676863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fe0acd70-f142-4182-ac44-41377b7efbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:24.682400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eff32b11-3c00-4afb-80d0-0f520c844a3c admin admin] The token cache is being invalidate because project 5f9cdca4179c4875a4be57cf8a9f46a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:10:24.683184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eff32b11-3c00-4afb-80d0-0f520c844a3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:24.684389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eff32b11-3c00-4afb-80d0-0f520c844a3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:24.687692 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1231/2436] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:10:24 2022] DELETE /identity/v3/projects/5f9cdca4179c4875a4be57cf8a9f46a8 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:10:24.690596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff32b11-3c00-4afb-80d0-0f520c844a3c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:24.692549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-eff32b11-3c00-4afb-80d0-0f520c844a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:24.719331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0acd70-f142-4182-ac44-41377b7efbe9 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:24.881824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5372d-df52-496d-b1f4-5b7141f98234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:24.888514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5372d-df52-496d-b1f4-5b7141f98234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:24.888514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5372d-df52-496d-b1f4-5b7141f98234 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:24.888514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5372d-df52-496d-b1f4-5b7141f98234 admin admin] PATH_INFO: `/v3/projects/fc1c3463f9444119af9d18f85bdd703d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:24.888514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5372d-df52-496d-b1f4-5b7141f98234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc1c3463f9444119af9d18f85bdd703d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:24.888514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5372d-df52-496d-b1f4-5b7141f98234 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:24.925848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff32b11-3c00-4afb-80d0-0f520c844a3c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:24.943520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f29f91-7088-4764-9a80-ad508255514d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:24.944727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f29f91-7088-4764-9a80-ad508255514d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:24.945017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f29f91-7088-4764-9a80-ad508255514d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:24.945295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f29f91-7088-4764-9a80-ad508255514d admin admin] PATH_INFO: `/v3/users/94e0c3e66a3544438cd7a481427b011d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:24.953038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f29f91-7088-4764-9a80-ad508255514d admin admin] RBAC: Authorizing `identity:delete_user(user_id=94e0c3e66a3544438cd7a481427b011d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:24.953038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f29f91-7088-4764-9a80-ad508255514d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:25.067746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cfb5372d-df52-496d-b1f4-5b7141f98234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc1c3463f9444119af9d18f85bdd703d', 'request_id': 'req-cfb5372d-df52-496d-b1f4-5b7141f98234'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:25.088125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cfb5372d-df52-496d-b1f4-5b7141f98234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc1c3463f9444119af9d18f85bdd703d', 'request_id': 'req-cfb5372d-df52-496d-b1f4-5b7141f98234'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:25.110671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cfb5372d-df52-496d-b1f4-5b7141f98234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc1c3463f9444119af9d18f85bdd703d', 'request_id': 'req-cfb5372d-df52-496d-b1f4-5b7141f98234'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:25.195105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-14f29f91-7088-4764-9a80-ad508255514d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94e0c3e66a3544438cd7a481427b011d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:25.205173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-14f29f91-7088-4764-9a80-ad508255514d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94e0c3e66a3544438cd7a481427b011d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:25.221483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cfb5372d-df52-496d-b1f4-5b7141f98234 admin admin] The token cache is being invalidate because project fc1c3463f9444119af9d18f85bdd703d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:10:25.228898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cfb5372d-df52-496d-b1f4-5b7141f98234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:25.228898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cfb5372d-df52-496d-b1f4-5b7141f98234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:25.228898 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1206/2437] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:10:24 2022] DELETE /identity/v3/projects/fc1c3463f9444119af9d18f85bdd703d => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:25.230496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5372d-df52-496d-b1f4-5b7141f98234 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:25.232092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cfb5372d-df52-496d-b1f4-5b7141f98234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:25.309157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5372d-df52-496d-b1f4-5b7141f98234 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:25.323920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9fa97-004c-4bd6-b70d-25eed60fdeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:25.325659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9fa97-004c-4bd6-b70d-25eed60fdeba admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:25.326084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9fa97-004c-4bd6-b70d-25eed60fdeba admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:25.326695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9fa97-004c-4bd6-b70d-25eed60fdeba admin admin] PATH_INFO: `/v3/users/24d825f528ce4d6d9e4da4fa13a417d9` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:25.328292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9fa97-004c-4bd6-b70d-25eed60fdeba admin admin] RBAC: Authorizing `identity:delete_user(user_id=24d825f528ce4d6d9e4da4fa13a417d9)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:25.330388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9fa97-004c-4bd6-b70d-25eed60fdeba admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:25.376828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-14f29f91-7088-4764-9a80-ad508255514d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94e0c3e66a3544438cd7a481427b011d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:25.380073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-14f29f91-7088-4764-9a80-ad508255514d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94e0c3e66a3544438cd7a481427b011d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:25.454123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-14f29f91-7088-4764-9a80-ad508255514d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94e0c3e66a3544438cd7a481427b011d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:25.476481 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1232/2438] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:10:24 2022] DELETE /identity/v3/users/94e0c3e66a3544438cd7a481427b011d => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:10:25.481511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af3215-35b1-4873-9551-708e38a51498 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:25.482083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af3215-35b1-4873-9551-708e38a51498 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:25.482949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af3215-35b1-4873-9551-708e38a51498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:25.536112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a4af3215-35b1-4873-9551-708e38a51498 None None] MFA Rules not processed for user `578b87f863b34f57a571f7e56d44f118`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:25.537610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a4af3215-35b1-4873-9551-708e38a51498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:25.598938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-63f9fa97-004c-4bd6-b70d-25eed60fdeba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24d825f528ce4d6d9e4da4fa13a417d9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:25.633607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-63f9fa97-004c-4bd6-b70d-25eed60fdeba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24d825f528ce4d6d9e4da4fa13a417d9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:25.666353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:25.669486 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1233/2439] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:25.674514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af3215-35b1-4873-9551-708e38a51498 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:25.675961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a4af3215-35b1-4873-9551-708e38a51498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:25.734284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-63f9fa97-004c-4bd6-b70d-25eed60fdeba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24d825f528ce4d6d9e4da4fa13a417d9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:25.745880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-63f9fa97-004c-4bd6-b70d-25eed60fdeba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24d825f528ce4d6d9e4da4fa13a417d9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:25.759410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-63f9fa97-004c-4bd6-b70d-25eed60fdeba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24d825f528ce4d6d9e4da4fa13a417d9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:25.767941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:25.774890 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1207/2440] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:10:25 2022] DELETE /identity/v3/users/24d825f528ce4d6d9e4da4fa13a417d9 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:25.867921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af3215-35b1-4873-9551-708e38a51498 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:25.966690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba02020-49f2-425e-b677-90d82814d144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:25.970589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba02020-49f2-425e-b677-90d82814d144 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:25.970883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba02020-49f2-425e-b677-90d82814d144 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:25.971236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba02020-49f2-425e-b677-90d82814d144 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:25.971954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba02020-49f2-425e-b677-90d82814d144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:25.974314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba02020-49f2-425e-b677-90d82814d144 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:26.150482 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1234/2441] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:10:25 2022] POST /identity/v3/projects => generated 397 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:10:26.151809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9fa97-004c-4bd6-b70d-25eed60fdeba admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:26.153885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-63f9fa97-004c-4bd6-b70d-25eed60fdeba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:26.183372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9fa97-004c-4bd6-b70d-25eed60fdeba admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:26.308712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23588bd-f63d-4b2b-86c0-85c1562b97b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:26.309418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23588bd-f63d-4b2b-86c0-85c1562b97b3 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:26.309986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23588bd-f63d-4b2b-86c0-85c1562b97b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:26.310173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23588bd-f63d-4b2b-86c0-85c1562b97b3 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:26.312852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23588bd-f63d-4b2b-86c0-85c1562b97b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:26.315569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23588bd-f63d-4b2b-86c0-85c1562b97b3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:26.505033 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1208/2442] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:10:26 2022] POST /identity/v3/users => generated 305 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:10:26.517009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba02020-49f2-425e-b677-90d82814d144 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:26.533180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23588bd-f63d-4b2b-86c0-85c1562b97b3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:26.536728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba02020-49f2-425e-b677-90d82814d144 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:26.541437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d23588bd-f63d-4b2b-86c0-85c1562b97b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:26.557703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb407a03-9f17-4bd1-a2b7-762717a179e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:26.562265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb407a03-9f17-4bd1-a2b7-762717a179e2 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:26.564283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb407a03-9f17-4bd1-a2b7-762717a179e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:26.567553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb407a03-9f17-4bd1-a2b7-762717a179e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:26.570442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb407a03-9f17-4bd1-a2b7-762717a179e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:26.576032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb407a03-9f17-4bd1-a2b7-762717a179e2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:26.586669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23588bd-f63d-4b2b-86c0-85c1562b97b3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:26.616936 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1235/2443] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:10:26.618511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb407a03-9f17-4bd1-a2b7-762717a179e2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:26.622079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658bc63-e0ce-45c9-9457-35c985cdaeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:26.623133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658bc63-e0ce-45c9-9457-35c985cdaeeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:26.623423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658bc63-e0ce-45c9-9457-35c985cdaeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:26.623708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658bc63-e0ce-45c9-9457-35c985cdaeeb admin admin] PATH_INFO: `/v3/projects/7f515204606542ce9377e2c0b707e5bc` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:26.631488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658bc63-e0ce-45c9-9457-35c985cdaeeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f515204606542ce9377e2c0b707e5bc)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:26.634022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658bc63-e0ce-45c9-9457-35c985cdaeeb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:26.655423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb407a03-9f17-4bd1-a2b7-762717a179e2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:26.670493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8e235-3a49-407b-b559-9f0665b529dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:26.671641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8e235-3a49-407b-b559-9f0665b529dd admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:26.671928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8e235-3a49-407b-b559-9f0665b529dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:26.672209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8e235-3a49-407b-b559-9f0665b529dd admin admin] PATH_INFO: `/v3/projects/f3135f7cb65242db8aa7f75a3468e9e0/users/2022d33a84b6457abb0ae42747dac56e/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:26.702088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8e235-3a49-407b-b559-9f0665b529dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3135f7cb65242db8aa7f75a3468e9e0, user_id=2022d33a84b6457abb0ae42747dac56e, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:26.714937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8e235-3a49-407b-b559-9f0665b529dd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:26.879150 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1236/2444] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:10:26 2022] PUT /identity/v3/projects/f3135f7cb65242db8aa7f75a3468e9e0/users/2022d33a84b6457abb0ae42747dac56e/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:26.880650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8e235-3a49-407b-b559-9f0665b529dd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:26.883707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1cd8e235-3a49-407b-b559-9f0665b529dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:26.895727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0658bc63-e0ce-45c9-9457-35c985cdaeeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f515204606542ce9377e2c0b707e5bc', 'request_id': 'req-0658bc63-e0ce-45c9-9457-35c985cdaeeb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:26.903747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0658bc63-e0ce-45c9-9457-35c985cdaeeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f515204606542ce9377e2c0b707e5bc', 'request_id': 'req-0658bc63-e0ce-45c9-9457-35c985cdaeeb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:26.915327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0658bc63-e0ce-45c9-9457-35c985cdaeeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f515204606542ce9377e2c0b707e5bc', 'request_id': 'req-0658bc63-e0ce-45c9-9457-35c985cdaeeb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:27.000788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8e235-3a49-407b-b559-9f0665b529dd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:27.039524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0658bc63-e0ce-45c9-9457-35c985cdaeeb admin admin] The token cache is being invalidate because project 7f515204606542ce9377e2c0b707e5bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:10:27.040268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0658bc63-e0ce-45c9-9457-35c985cdaeeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:27.041480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0658bc63-e0ce-45c9-9457-35c985cdaeeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:27.044585 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1209/2445] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:10:26 2022] DELETE /identity/v3/projects/7f515204606542ce9377e2c0b707e5bc => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:27.048899 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658bc63-e0ce-45c9-9457-35c985cdaeeb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:27.050785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0658bc63-e0ce-45c9-9457-35c985cdaeeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:27.130268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ff013-61a8-4185-9a4f-7a6c019c7fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:27.132951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ff013-61a8-4185-9a4f-7a6c019c7fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:27.133383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ff013-61a8-4185-9a4f-7a6c019c7fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:27.133782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ff013-61a8-4185-9a4f-7a6c019c7fd5 admin admin] PATH_INFO: `/v3/projects/7b35e417b1f84a99a10fe98ed6964d30` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:27.135502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ff013-61a8-4185-9a4f-7a6c019c7fd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b35e417b1f84a99a10fe98ed6964d30)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:27.137688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ff013-61a8-4185-9a4f-7a6c019c7fd5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:27.152763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:27.206317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658bc63-e0ce-45c9-9457-35c985cdaeeb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:27.217103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a827a-f242-4ba9-984e-cb38a0deda34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:27.220175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a827a-f242-4ba9-984e-cb38a0deda34 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:27.221168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a827a-f242-4ba9-984e-cb38a0deda34 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:27.222352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a827a-f242-4ba9-984e-cb38a0deda34 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:27.224285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a827a-f242-4ba9-984e-cb38a0deda34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:27.232897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a827a-f242-4ba9-984e-cb38a0deda34 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:27.260155 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1210/2446] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:10:27.272931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46c01d-e26a-48f2-82a5-d5742904fac4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:27.273612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46c01d-e26a-48f2-82a5-d5742904fac4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:27.275033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46c01d-e26a-48f2-82a5-d5742904fac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:27.319563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ca46c01d-e26a-48f2-82a5-d5742904fac4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:27.320864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ca46c01d-e26a-48f2-82a5-d5742904fac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:27.354162 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1211/2447] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:27.354162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46c01d-e26a-48f2-82a5-d5742904fac4 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:27.377711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46c01d-e26a-48f2-82a5-d5742904fac4 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:27.407055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d06ff013-61a8-4185-9a4f-7a6c019c7fd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b35e417b1f84a99a10fe98ed6964d30', 'request_id': 'req-d06ff013-61a8-4185-9a4f-7a6c019c7fd5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:27.412185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d06ff013-61a8-4185-9a4f-7a6c019c7fd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b35e417b1f84a99a10fe98ed6964d30', 'request_id': 'req-d06ff013-61a8-4185-9a4f-7a6c019c7fd5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:27.431619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d06ff013-61a8-4185-9a4f-7a6c019c7fd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b35e417b1f84a99a10fe98ed6964d30', 'request_id': 'req-d06ff013-61a8-4185-9a4f-7a6c019c7fd5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:27.504689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25639e34-5798-4e1e-b4c8-14d04e0ccc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:27.507350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25639e34-5798-4e1e-b4c8-14d04e0ccc53 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:27.507961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25639e34-5798-4e1e-b4c8-14d04e0ccc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:27.508289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25639e34-5798-4e1e-b4c8-14d04e0ccc53 admin admin] PATH_INFO: `/v3/projects/f3135f7cb65242db8aa7f75a3468e9e0/users/2022d33a84b6457abb0ae42747dac56e/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:27.513715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25639e34-5798-4e1e-b4c8-14d04e0ccc53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3135f7cb65242db8aa7f75a3468e9e0, user_id=2022d33a84b6457abb0ae42747dac56e, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:27.521886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25639e34-5798-4e1e-b4c8-14d04e0ccc53 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:27.540350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d06ff013-61a8-4185-9a4f-7a6c019c7fd5 admin admin] The token cache is being invalidate because project 7b35e417b1f84a99a10fe98ed6964d30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:10:27.540872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d06ff013-61a8-4185-9a4f-7a6c019c7fd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:27.541491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d06ff013-61a8-4185-9a4f-7a6c019c7fd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:27.544387 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1237/2449] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:10:26 2022] DELETE /identity/v3/projects/7b35e417b1f84a99a10fe98ed6964d30 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:27.546566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174862d-9c5b-48a1-8fae-fc55b0351fa0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:27.547352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174862d-9c5b-48a1-8fae-fc55b0351fa0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:27.547766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174862d-9c5b-48a1-8fae-fc55b0351fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:27.560027 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1212/2449] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:10:27 2022] PUT /identity/v3/projects/f3135f7cb65242db8aa7f75a3468e9e0/users/2022d33a84b6457abb0ae42747dac56e/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:27.566438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4c9b4-4c64-4be0-88c8-ace951ee8282 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:27.566903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4c9b4-4c64-4be0-88c8-ace951ee8282 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:27.567407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4c9b4-4c64-4be0-88c8-ace951ee8282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:27.590480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2174862d-9c5b-48a1-8fae-fc55b0351fa0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:27.592107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2174862d-9c5b-48a1-8fae-fc55b0351fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:27.612921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e1e4c9b4-4c64-4be0-88c8-ace951ee8282 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:27.614137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e1e4c9b4-4c64-4be0-88c8-ace951ee8282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:27.804196 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1213/2450] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:27.809524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fc60c-025e-47fd-b2de-ad4c261f9373 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:27.809524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fc60c-025e-47fd-b2de-ad4c261f9373 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:27.809524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fc60c-025e-47fd-b2de-ad4c261f9373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:27.841252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:27.849606 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1238/2451] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:27.850911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-943fc60c-025e-47fd-b2de-ad4c261f9373 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:27.852504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-943fc60c-025e-47fd-b2de-ad4c261f9373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:27.854075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174862d-9c5b-48a1-8fae-fc55b0351fa0 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:27.871813 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1214/2452] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:27.872698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174862d-9c5b-48a1-8fae-fc55b0351fa0 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:27.877346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fc60c-025e-47fd-b2de-ad4c261f9373 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:27.895517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b24342-f131-4753-ab1d-2aeeabe439b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:27.895517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b24342-f131-4753-ab1d-2aeeabe439b3 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:27.895517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b24342-f131-4753-ab1d-2aeeabe439b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:27.895517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b24342-f131-4753-ab1d-2aeeabe439b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:27.895892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b24342-f131-4753-ab1d-2aeeabe439b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:10:27.895892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b24342-f131-4753-ab1d-2aeeabe439b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:27.895892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b24342-f131-4753-ab1d-2aeeabe439b3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:27.907329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fc60c-025e-47fd-b2de-ad4c261f9373 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:27.922379 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1239/2453] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:10:27.923493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666951f3-ef6b-49d7-8bc4-3ed864e84745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:27.924471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666951f3-ef6b-49d7-8bc4-3ed864e84745 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:27.924988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666951f3-ef6b-49d7-8bc4-3ed864e84745 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:27.925478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666951f3-ef6b-49d7-8bc4-3ed864e84745 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:27.926581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666951f3-ef6b-49d7-8bc4-3ed864e84745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:10:27.927137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666951f3-ef6b-49d7-8bc4-3ed864e84745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:27.928468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b24342-f131-4753-ab1d-2aeeabe439b3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:27.930595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666951f3-ef6b-49d7-8bc4-3ed864e84745 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:27.960858 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1215/2454] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:10:27.966549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666951f3-ef6b-49d7-8bc4-3ed864e84745 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:27.969277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b24342-f131-4753-ab1d-2aeeabe439b3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:27.981004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666951f3-ef6b-49d7-8bc4-3ed864e84745 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:27.987035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b159a-c6ed-4edf-bf8d-99fbaa2cb57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:27.989459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c46902-1411-4b2f-9a34-763dd54cd2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:27.990290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c46902-1411-4b2f-9a34-763dd54cd2bd admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:27.990552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b159a-c6ed-4edf-bf8d-99fbaa2cb57f admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:27.990752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c46902-1411-4b2f-9a34-763dd54cd2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:27.991190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b159a-c6ed-4edf-bf8d-99fbaa2cb57f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:27.991300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c46902-1411-4b2f-9a34-763dd54cd2bd admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:27.991486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b159a-c6ed-4edf-bf8d-99fbaa2cb57f admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:27.992165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c46902-1411-4b2f-9a34-763dd54cd2bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:27.992367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b159a-c6ed-4edf-bf8d-99fbaa2cb57f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:27.994317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b159a-c6ed-4edf-bf8d-99fbaa2cb57f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:27.996208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c46902-1411-4b2f-9a34-763dd54cd2bd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:28.151777 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1240/2455] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:10:27 2022] POST /identity/v3/projects => generated 383 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:10:28.157462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b159a-c6ed-4edf-bf8d-99fbaa2cb57f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:28.179437 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1216/2456] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:10:27 2022] POST /identity/v3/projects => generated 389 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:10:28.182043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c46902-1411-4b2f-9a34-763dd54cd2bd admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:28.295210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b159a-c6ed-4edf-bf8d-99fbaa2cb57f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:28.302268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c46902-1411-4b2f-9a34-763dd54cd2bd admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:28.302587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394562d-7835-49a1-8de8-5d2929a507f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:28.303412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394562d-7835-49a1-8de8-5d2929a507f7 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:28.304078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394562d-7835-49a1-8de8-5d2929a507f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:28.304506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394562d-7835-49a1-8de8-5d2929a507f7 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:28.305604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394562d-7835-49a1-8de8-5d2929a507f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:28.308336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394562d-7835-49a1-8de8-5d2929a507f7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:28.309351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584353a2-f4c2-49bc-9c6b-bcf9d355dae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:28.310328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584353a2-f4c2-49bc-9c6b-bcf9d355dae9 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:28.310772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584353a2-f4c2-49bc-9c6b-bcf9d355dae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:28.311319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584353a2-f4c2-49bc-9c6b-bcf9d355dae9 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:28.312990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584353a2-f4c2-49bc-9c6b-bcf9d355dae9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:28.315349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584353a2-f4c2-49bc-9c6b-bcf9d355dae9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:28.446984 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1241/2457] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:10:28 2022] POST /identity/v3/users => generated 292 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:10:28.448562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394562d-7835-49a1-8de8-5d2929a507f7 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:28.450804 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1217/2458] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:10:28 2022] POST /identity/v3/users => generated 295 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:10:28.455731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584353a2-f4c2-49bc-9c6b-bcf9d355dae9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:28.466712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394562d-7835-49a1-8de8-5d2929a507f7 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:28.477201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ceb1f-4b50-4fff-90b7-26aed55d4bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:28.477796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ceb1f-4b50-4fff-90b7-26aed55d4bcc admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:28.479920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ceb1f-4b50-4fff-90b7-26aed55d4bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:28.479920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ceb1f-4b50-4fff-90b7-26aed55d4bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:28.479920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ceb1f-4b50-4fff-90b7-26aed55d4bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:28.488403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ceb1f-4b50-4fff-90b7-26aed55d4bcc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:28.504878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584353a2-f4c2-49bc-9c6b-bcf9d355dae9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:28.518041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce936f-9a27-4b4d-b53a-91113626b2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:28.519001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce936f-9a27-4b4d-b53a-91113626b2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:28.519376 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce936f-9a27-4b4d-b53a-91113626b2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:28.520228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce936f-9a27-4b4d-b53a-91113626b2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:28.520367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce936f-9a27-4b4d-b53a-91113626b2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:28.523967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce936f-9a27-4b4d-b53a-91113626b2f0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:28.535077 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1242/2459] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:10:28.539809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ceb1f-4b50-4fff-90b7-26aed55d4bcc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:28.550685 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1218/2460] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:10:28.554661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce936f-9a27-4b4d-b53a-91113626b2f0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:28.565759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ceb1f-4b50-4fff-90b7-26aed55d4bcc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:28.573176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1955396-71ac-4247-95a8-cb83d5209f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:28.574356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1955396-71ac-4247-95a8-cb83d5209f30 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:28.574862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1955396-71ac-4247-95a8-cb83d5209f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:28.575112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce936f-9a27-4b4d-b53a-91113626b2f0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:28.575631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1955396-71ac-4247-95a8-cb83d5209f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:28.576525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1955396-71ac-4247-95a8-cb83d5209f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:28.582593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1955396-71ac-4247-95a8-cb83d5209f30 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:28.587765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a053fa2-1e62-40f6-8008-c72d42e90020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:28.588444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a053fa2-1e62-40f6-8008-c72d42e90020 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:28.588728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a053fa2-1e62-40f6-8008-c72d42e90020 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:28.589003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a053fa2-1e62-40f6-8008-c72d42e90020 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:28.590543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a053fa2-1e62-40f6-8008-c72d42e90020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:28.592231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a053fa2-1e62-40f6-8008-c72d42e90020 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:28.603455 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1243/2461] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:10:28.610354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1955396-71ac-4247-95a8-cb83d5209f30 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:28.644567 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1219/2462] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:10:28.645674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a053fa2-1e62-40f6-8008-c72d42e90020 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:28.651991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1955396-71ac-4247-95a8-cb83d5209f30 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:28.686140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a053fa2-1e62-40f6-8008-c72d42e90020 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:28.686980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de858091-f14d-4eb7-a3bc-b771c987e09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:28.686980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de858091-f14d-4eb7-a3bc-b771c987e09d admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:28.686980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de858091-f14d-4eb7-a3bc-b771c987e09d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:28.686980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de858091-f14d-4eb7-a3bc-b771c987e09d admin admin] PATH_INFO: `/v3/projects/29f6db32114b458685269df31fae51c6/users/ca38f16f48494cc4aa71c7f5bd0916a4/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:28.687317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f07bf3-a767-4921-a094-35816d8b92d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:28.687317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f07bf3-a767-4921-a094-35816d8b92d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:28.687777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f07bf3-a767-4921-a094-35816d8b92d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:28.688357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f07bf3-a767-4921-a094-35816d8b92d9 admin admin] PATH_INFO: `/v3/projects/e62d0d1cfd6b44bf8a0c0df282e585ad/users/31756abdfccf43e0b33e33300a527f29/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:28.716500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de858091-f14d-4eb7-a3bc-b771c987e09d admin admin] RBAC: Authorizing `identity:create_grant(project_id=29f6db32114b458685269df31fae51c6, user_id=ca38f16f48494cc4aa71c7f5bd0916a4, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:28.720102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de858091-f14d-4eb7-a3bc-b771c987e09d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:28.724478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f07bf3-a767-4921-a094-35816d8b92d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e62d0d1cfd6b44bf8a0c0df282e585ad, user_id=31756abdfccf43e0b33e33300a527f29, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:28.728444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f07bf3-a767-4921-a094-35816d8b92d9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:28.896469 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1220/2463] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:10:28 2022] PUT /identity/v3/projects/e62d0d1cfd6b44bf8a0c0df282e585ad/users/31756abdfccf43e0b33e33300a527f29/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:28.903485 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1244/2464] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:10:28 2022] PUT /identity/v3/projects/29f6db32114b458685269df31fae51c6/users/ca38f16f48494cc4aa71c7f5bd0916a4/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:28.903603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53341f1d-2eb6-4c92-bf6a-177e8630f38b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:28.903603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53341f1d-2eb6-4c92-bf6a-177e8630f38b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:28.903603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53341f1d-2eb6-4c92-bf6a-177e8630f38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:28.912406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec421ffe-2213-4d86-b2e5-ef4cc7eb09d0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:28.913276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec421ffe-2213-4d86-b2e5-ef4cc7eb09d0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:28.913707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec421ffe-2213-4d86-b2e5-ef4cc7eb09d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:28.940640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-53341f1d-2eb6-4c92-bf6a-177e8630f38b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:28.941810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-53341f1d-2eb6-4c92-bf6a-177e8630f38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:28.976508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ec421ffe-2213-4d86-b2e5-ef4cc7eb09d0 None None] MFA Rules not processed for user `ca38f16f48494cc4aa71c7f5bd0916a4`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:28.995689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ec421ffe-2213-4d86-b2e5-ef4cc7eb09d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:29.084118 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1221/2465] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:29.112826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53341f1d-2eb6-4c92-bf6a-177e8630f38b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:29.114255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-53341f1d-2eb6-4c92-bf6a-177e8630f38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:29.140782 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1245/2466] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:29.144646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec421ffe-2213-4d86-b2e5-ef4cc7eb09d0 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:29.177407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec421ffe-2213-4d86-b2e5-ef4cc7eb09d0 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:29.189509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd6fb8-c687-4cd6-9310-ad1b4b8d6fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:29.190635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd6fb8-c687-4cd6-9310-ad1b4b8d6fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:29.195319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd6fb8-c687-4cd6-9310-ad1b4b8d6fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:29.195319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd6fb8-c687-4cd6-9310-ad1b4b8d6fc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:29.195319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd6fb8-c687-4cd6-9310-ad1b4b8d6fc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:29.197100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd6fb8-c687-4cd6-9310-ad1b4b8d6fc3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:29.242043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53341f1d-2eb6-4c92-bf6a-177e8630f38b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:29.248498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5bbc5-8d6d-430d-8458-07d40cfad259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:29.250115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5bbc5-8d6d-430d-8458-07d40cfad259 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:29.250412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5bbc5-8d6d-430d-8458-07d40cfad259 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:29.250689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5bbc5-8d6d-430d-8458-07d40cfad259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:29.269986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5bbc5-8d6d-430d-8458-07d40cfad259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:29.271507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5bbc5-8d6d-430d-8458-07d40cfad259 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:29.288146 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1222/2467] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:10:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:10:29.327548 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1246/2468] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:10:29 2022] POST /identity/v3/projects => generated 381 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:10:29.330029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5bbc5-8d6d-430d-8458-07d40cfad259 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:29.343481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5bbc5-8d6d-430d-8458-07d40cfad259 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:29.441462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c490c-d73e-4741-8708-c4340e707aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:29.442238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c490c-d73e-4741-8708-c4340e707aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:29.443326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c490c-d73e-4741-8708-c4340e707aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:29.443821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c490c-d73e-4741-8708-c4340e707aa3 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:29.445065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c490c-d73e-4741-8708-c4340e707aa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:29.446728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c490c-d73e-4741-8708-c4340e707aa3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:29.546273 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1223/2469] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:10:29 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:10:29.547224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd6fb8-c687-4cd6-9310-ad1b4b8d6fc3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:29.579731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd6fb8-c687-4cd6-9310-ad1b4b8d6fc3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:29.586238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46420bf-fdfe-41e6-857b-66c1eb6a9bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:29.586943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46420bf-fdfe-41e6-857b-66c1eb6a9bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:29.587390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46420bf-fdfe-41e6-857b-66c1eb6a9bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:29.588779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46420bf-fdfe-41e6-857b-66c1eb6a9bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:29.588779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46420bf-fdfe-41e6-857b-66c1eb6a9bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:29.590072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46420bf-fdfe-41e6-857b-66c1eb6a9bc5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:29.606124 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1247/2470] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:10:29.607170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c490c-d73e-4741-8708-c4340e707aa3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:29.631679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c490c-d73e-4741-8708-c4340e707aa3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:29.644860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544ad1d-8ca9-47c3-919b-7c6bfeaefe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:29.647323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544ad1d-8ca9-47c3-919b-7c6bfeaefe25 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:29.648858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544ad1d-8ca9-47c3-919b-7c6bfeaefe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:29.648858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544ad1d-8ca9-47c3-919b-7c6bfeaefe25 admin admin] PATH_INFO: `/v3/projects/6b601e5160184047bf6209b06e370a00/users/27366a452ebb42158ae2a3d055f0ecd4/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:29.674497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544ad1d-8ca9-47c3-919b-7c6bfeaefe25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b601e5160184047bf6209b06e370a00, user_id=27366a452ebb42158ae2a3d055f0ecd4, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:29.678338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544ad1d-8ca9-47c3-919b-7c6bfeaefe25 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:29.794038 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1224/2471] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:10:29 2022] PUT /identity/v3/projects/6b601e5160184047bf6209b06e370a00/users/27366a452ebb42158ae2a3d055f0ecd4/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:10:29.798780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46420bf-fdfe-41e6-857b-66c1eb6a9bc5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:29.815631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46420bf-fdfe-41e6-857b-66c1eb6a9bc5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:29.940958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acffe3e-e4c9-4a64-8d68-86ba213531ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:29.941560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acffe3e-e4c9-4a64-8d68-86ba213531ce admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:29.941910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acffe3e-e4c9-4a64-8d68-86ba213531ce admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:29.942106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acffe3e-e4c9-4a64-8d68-86ba213531ce admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:29.942836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acffe3e-e4c9-4a64-8d68-86ba213531ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:29.945374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acffe3e-e4c9-4a64-8d68-86ba213531ce admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:29.963481 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1248/2472] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:10:29.964792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544ad1d-8ca9-47c3-919b-7c6bfeaefe25 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:29.980728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544ad1d-8ca9-47c3-919b-7c6bfeaefe25 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:29.998650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c51da-82f3-4546-8269-71c4b460ce4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:30.000520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c51da-82f3-4546-8269-71c4b460ce4b admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:30.000807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c51da-82f3-4546-8269-71c4b460ce4b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:30.001751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c51da-82f3-4546-8269-71c4b460ce4b admin admin] PATH_INFO: `/v3/projects/6b601e5160184047bf6209b06e370a00/users/27366a452ebb42158ae2a3d055f0ecd4/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:30.009364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c51da-82f3-4546-8269-71c4b460ce4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b601e5160184047bf6209b06e370a00, user_id=27366a452ebb42158ae2a3d055f0ecd4, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:30.020086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c51da-82f3-4546-8269-71c4b460ce4b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:30.039374 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1225/2473] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:10:29 2022] PUT /identity/v3/projects/6b601e5160184047bf6209b06e370a00/users/27366a452ebb42158ae2a3d055f0ecd4/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:30.043858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7619705-ac81-419f-8d7e-d4923ae76ae5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:30.044238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7619705-ac81-419f-8d7e-d4923ae76ae5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:30.044586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7619705-ac81-419f-8d7e-d4923ae76ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:30.094614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a7619705-ac81-419f-8d7e-d4923ae76ae5 None None] MFA Rules not processed for user `27366a452ebb42158ae2a3d055f0ecd4`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:30.097112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a7619705-ac81-419f-8d7e-d4923ae76ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:30.220186 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1249/2474] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:30.235757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c51da-82f3-4546-8269-71c4b460ce4b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:30.242463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-616c51da-82f3-4546-8269-71c4b460ce4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:30.334220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:30.391301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c51da-82f3-4546-8269-71c4b460ce4b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:30.401841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564f71f-3b81-4201-83eb-415742be6158 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:30.403277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564f71f-3b81-4201-83eb-415742be6158 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:30.403792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564f71f-3b81-4201-83eb-415742be6158 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:30.404302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564f71f-3b81-4201-83eb-415742be6158 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:30.421777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564f71f-3b81-4201-83eb-415742be6158 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:30.423651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564f71f-3b81-4201-83eb-415742be6158 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:30.434930 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1226/2475] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:10:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:10:30.450699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b40e9-776d-4b3e-904d-4f4ef00dd26e None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:30.451258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b40e9-776d-4b3e-904d-4f4ef00dd26e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:30.451655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b40e9-776d-4b3e-904d-4f4ef00dd26e None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:30.453944 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1250/2476] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:10:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:10:30.459352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564f71f-3b81-4201-83eb-415742be6158 service nova] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:10:30.475907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564f71f-3b81-4201-83eb-415742be6158 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:30.484278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564f71f-3b81-4201-83eb-415742be6158 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:30.490740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7452b-1c5d-4696-83d8-a66e4fe7db65 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27366a452ebb42158ae2a3d055f0ecd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b601e5160184047bf6209b06e370a00', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:30.492006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7452b-1c5d-4696-83d8-a66e4fe7db65 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:30.492673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7452b-1c5d-4696-83d8-a66e4fe7db65 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:30.493204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7452b-1c5d-4696-83d8-a66e4fe7db65 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] PATH_INFO: `/v3/projects/29f6db32114b458685269df31fae51c6` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:30.494719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7452b-1c5d-4696-83d8-a66e4fe7db65 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: Authorizing `identity:get_project(project_id=29f6db32114b458685269df31fae51c6)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:30.498001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7452b-1c5d-4696-83d8-a66e4fe7db65 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:30.508425 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1227/2477] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:10:30 2022] GET /identity/v3/projects/29f6db32114b458685269df31fae51c6 => generated 383 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:10:31.053276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799164d-f23a-4ceb-b4dc-6157c3a57adc None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:31.055526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799164d-f23a-4ceb-b4dc-6157c3a57adc None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:31.055813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799164d-f23a-4ceb-b4dc-6157c3a57adc None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:31.057535 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1251/2478] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:10:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:10:31.067932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7452b-1c5d-4696-83d8-a66e4fe7db65 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:10:31.088490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7452b-1c5d-4696-83d8-a66e4fe7db65 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:31.105877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7452b-1c5d-4696-83d8-a66e4fe7db65 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:31.113235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd445c-3d3e-4d27-9a20-f0c022b5027e tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27366a452ebb42158ae2a3d055f0ecd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b601e5160184047bf6209b06e370a00', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:31.114308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd445c-3d3e-4d27-9a20-f0c022b5027e tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:31.114308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd445c-3d3e-4d27-9a20-f0c022b5027e tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:31.114518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd445c-3d3e-4d27-9a20-f0c022b5027e tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] PATH_INFO: `/v3/projects/29f6db32114b458685269df31fae51c6` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:31.115982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd445c-3d3e-4d27-9a20-f0c022b5027e tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: Authorizing `identity:get_project(project_id=29f6db32114b458685269df31fae51c6)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:31.118128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd445c-3d3e-4d27-9a20-f0c022b5027e tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:31.131925 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1228/2479] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:10:31 2022] GET /identity/v3/projects/29f6db32114b458685269df31fae51c6 => generated 383 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:10:31.157484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:31.376936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f5cf7-1eb2-4adf-84b0-5ef0a146cb32 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:31.377365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f5cf7-1eb2-4adf-84b0-5ef0a146cb32 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:31.377749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f5cf7-1eb2-4adf-84b0-5ef0a146cb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:31.407976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-bb0f5cf7-1eb2-4adf-84b0-5ef0a146cb32 None None] MFA Rules not processed for user `ca38f16f48494cc4aa71c7f5bd0916a4`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:31.412134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bb0f5cf7-1eb2-4adf-84b0-5ef0a146cb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:31.534696 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1252/2480] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:31.555682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd445c-3d3e-4d27-9a20-f0c022b5027e tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:31.571644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd445c-3d3e-4d27-9a20-f0c022b5027e tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:31.579346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7031187-b437-4098-ab82-046567e5a021 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:31.580382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7031187-b437-4098-ab82-046567e5a021 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:31.580983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7031187-b437-4098-ab82-046567e5a021 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:31.581420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7031187-b437-4098-ab82-046567e5a021 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:31.591597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7031187-b437-4098-ab82-046567e5a021 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:31.594382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7031187-b437-4098-ab82-046567e5a021 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:31.605338 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1229/2481] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:10:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:10:32.683150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:33.057848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbda62-149a-4c30-8f4a-1c67a5593b96 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:33.058611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbda62-149a-4c30-8f4a-1c67a5593b96 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:33.058907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbda62-149a-4c30-8f4a-1c67a5593b96 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:33.067763 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1253/2482] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:10:33 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:10:33.074541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7031187-b437-4098-ab82-046567e5a021 service nova] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:10:33.091238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7031187-b437-4098-ab82-046567e5a021 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:33.105229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7031187-b437-4098-ab82-046567e5a021 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:33.111459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d20af-eb99-4022-887f-039be2dc7499 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27366a452ebb42158ae2a3d055f0ecd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b601e5160184047bf6209b06e370a00', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:33.112576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d20af-eb99-4022-887f-039be2dc7499 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:33.112866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d20af-eb99-4022-887f-039be2dc7499 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:33.113144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d20af-eb99-4022-887f-039be2dc7499 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] PATH_INFO: `/v3/projects/29f6db32114b458685269df31fae51c6` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:33.114805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d20af-eb99-4022-887f-039be2dc7499 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: Authorizing `identity:get_project(project_id=29f6db32114b458685269df31fae51c6)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:33.116939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d20af-eb99-4022-887f-039be2dc7499 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:33.118751 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1230/2483] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:10:33 2022] GET /identity/v3/projects/29f6db32114b458685269df31fae51c6 => generated 383 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:10:33.180329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:33.347224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc74375-b600-4674-8a75-deb9c3a13265 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:33.348106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc74375-b600-4674-8a75-deb9c3a13265 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:33.348488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc74375-b600-4674-8a75-deb9c3a13265 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:33.351283 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1254/2484] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:10:33.355374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d20af-eb99-4022-887f-039be2dc7499 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:10:33.357130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ba3d20af-eb99-4022-887f-039be2dc7499 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:33.375743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d20af-eb99-4022-887f-039be2dc7499 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:33.391386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d20af-eb99-4022-887f-039be2dc7499 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:33.401486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bab00c-9463-406d-b9e9-4143998e2d25 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27366a452ebb42158ae2a3d055f0ecd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b601e5160184047bf6209b06e370a00', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:33.402383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bab00c-9463-406d-b9e9-4143998e2d25 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:33.402672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bab00c-9463-406d-b9e9-4143998e2d25 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:33.402952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bab00c-9463-406d-b9e9-4143998e2d25 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] PATH_INFO: `/v3/projects/29f6db32114b458685269df31fae51c6` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:33.418938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bab00c-9463-406d-b9e9-4143998e2d25 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: Authorizing `identity:get_project(project_id=29f6db32114b458685269df31fae51c6)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:33.423720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bab00c-9463-406d-b9e9-4143998e2d25 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:33.431785 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1231/2485] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:10:33 2022] GET /identity/v3/projects/29f6db32114b458685269df31fae51c6 => generated 383 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:10:33.478358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d665b-58c5-45df-bdbf-1fd349efda0f None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:33.479403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d665b-58c5-45df-bdbf-1fd349efda0f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:33.479897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d665b-58c5-45df-bdbf-1fd349efda0f None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:33.481842 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1255/2486] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:10:33.487624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bab00c-9463-406d-b9e9-4143998e2d25 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:10:33.516790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bab00c-9463-406d-b9e9-4143998e2d25 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:33.530770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bab00c-9463-406d-b9e9-4143998e2d25 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:33.568757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26139bd-6069-4ec3-991a-d6cb04485c81 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27366a452ebb42158ae2a3d055f0ecd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b601e5160184047bf6209b06e370a00', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:33.569958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26139bd-6069-4ec3-991a-d6cb04485c81 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:33.570966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26139bd-6069-4ec3-991a-d6cb04485c81 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:33.571857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26139bd-6069-4ec3-991a-d6cb04485c81 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] PATH_INFO: `/v3/projects/29f6db32114b458685269df31fae51c6` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:33.573457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26139bd-6069-4ec3-991a-d6cb04485c81 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: Authorizing `identity:get_project(project_id=29f6db32114b458685269df31fae51c6)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:33.577503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26139bd-6069-4ec3-991a-d6cb04485c81 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:33.580014 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1232/2487] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:10:33 2022] GET /identity/v3/projects/29f6db32114b458685269df31fae51c6 => generated 383 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:10:33.875785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844cfcb-ae50-4e83-8465-14ec25c07825 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:33.875785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844cfcb-ae50-4e83-8465-14ec25c07825 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:33.876201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844cfcb-ae50-4e83-8465-14ec25c07825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:33.914834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a844cfcb-ae50-4e83-8465-14ec25c07825 None None] MFA Rules not processed for user `ca38f16f48494cc4aa71c7f5bd0916a4`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:33.916128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a844cfcb-ae50-4e83-8465-14ec25c07825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:33.927331 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1256/2488] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:34.094583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:34.359390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:35.153713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69036680-0ef8-4655-8659-01e5c2670aa4 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:35.154922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69036680-0ef8-4655-8659-01e5c2670aa4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:35.155634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69036680-0ef8-4655-8659-01e5c2670aa4 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:35.157932 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1233/2489] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:10:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:10:35.163271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844cfcb-ae50-4e83-8465-14ec25c07825 None None] Authenticating service token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:10:35.179956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844cfcb-ae50-4e83-8465-14ec25c07825 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:35.191426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844cfcb-ae50-4e83-8465-14ec25c07825 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:35.196865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ac90e-3219-443c-be79-53958ecfa929 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27366a452ebb42158ae2a3d055f0ecd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b601e5160184047bf6209b06e370a00', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:35.201186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ac90e-3219-443c-be79-53958ecfa929 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:35.201186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ac90e-3219-443c-be79-53958ecfa929 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:35.201186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ac90e-3219-443c-be79-53958ecfa929 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] PATH_INFO: `/v3/projects/29f6db32114b458685269df31fae51c6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:35.201186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ac90e-3219-443c-be79-53958ecfa929 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: Authorizing `identity:get_project(project_id=29f6db32114b458685269df31fae51c6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:35.202600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ac90e-3219-443c-be79-53958ecfa929 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:35.205147 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1257/2490] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:10:35 2022] GET /identity/v3/projects/29f6db32114b458685269df31fae51c6 => generated 383 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:10:35.609867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:35.616472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176520e1-fb7c-405f-8842-aeba2adfdeef None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:35.620863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176520e1-fb7c-405f-8842-aeba2adfdeef None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:35.620863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176520e1-fb7c-405f-8842-aeba2adfdeef None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:35.620863 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1234/2491] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:10:35.637934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ac90e-3219-443c-be79-53958ecfa929 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] Authenticating service token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:10:35.659793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ac90e-3219-443c-be79-53958ecfa929 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:35.681714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ac90e-3219-443c-be79-53958ecfa929 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:35.692598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec19aa-4420-495e-b60c-2ae921cc6e13 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27366a452ebb42158ae2a3d055f0ecd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b601e5160184047bf6209b06e370a00', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:35.695204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec19aa-4420-495e-b60c-2ae921cc6e13 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:35.695616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec19aa-4420-495e-b60c-2ae921cc6e13 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:35.697845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec19aa-4420-495e-b60c-2ae921cc6e13 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] PATH_INFO: `/v3/projects/29f6db32114b458685269df31fae51c6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:35.701474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec19aa-4420-495e-b60c-2ae921cc6e13 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: Authorizing `identity:get_project(project_id=29f6db32114b458685269df31fae51c6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:35.710046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec19aa-4420-495e-b60c-2ae921cc6e13 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:35.712483 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1258/2492] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:10:35 2022] GET /identity/v3/projects/29f6db32114b458685269df31fae51c6 => generated 383 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:10:35.803868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f0568-b1a6-4fdf-87bb-db56c916fa3d None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:35.804473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f0568-b1a6-4fdf-87bb-db56c916fa3d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:35.804954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f0568-b1a6-4fdf-87bb-db56c916fa3d None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:35.806936 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1235/2493] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:10:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:10:35.816406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec19aa-4420-495e-b60c-2ae921cc6e13 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] Authenticating service token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:10:35.838086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec19aa-4420-495e-b60c-2ae921cc6e13 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:35.856604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec19aa-4420-495e-b60c-2ae921cc6e13 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:35.862711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3cd09-9f74-4711-803e-f216d28e02e0 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27366a452ebb42158ae2a3d055f0ecd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b601e5160184047bf6209b06e370a00', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:35.864207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3cd09-9f74-4711-803e-f216d28e02e0 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:35.864729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3cd09-9f74-4711-803e-f216d28e02e0 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:35.865237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3cd09-9f74-4711-803e-f216d28e02e0 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] PATH_INFO: `/v3/projects/29f6db32114b458685269df31fae51c6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:35.866782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3cd09-9f74-4711-803e-f216d28e02e0 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: Authorizing `identity:get_project(project_id=29f6db32114b458685269df31fae51c6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:35.870864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3cd09-9f74-4711-803e-f216d28e02e0 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:35.873309 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1259/2494] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:10:35 2022] GET /identity/v3/projects/29f6db32114b458685269df31fae51c6 => generated 383 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:10:36.113022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69381d0f-c7a2-451c-9adc-66a01e5fcbbf None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:36.113534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69381d0f-c7a2-451c-9adc-66a01e5fcbbf None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:36.114259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69381d0f-c7a2-451c-9adc-66a01e5fcbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:36.153085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-69381d0f-c7a2-451c-9adc-66a01e5fcbbf None None] MFA Rules not processed for user `ca38f16f48494cc4aa71c7f5bd0916a4`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:36.162283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-69381d0f-c7a2-451c-9adc-66a01e5fcbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:36.176032 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1236/2495] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:36.551890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:37.281571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:37.775613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d4d91-21ff-4d6e-87d7-483ff0a997d3 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:37.776162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d4d91-21ff-4d6e-87d7-483ff0a997d3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:37.777347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d4d91-21ff-4d6e-87d7-483ff0a997d3 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:37.780427 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1260/2496] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:10:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:10:37.791856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69381d0f-c7a2-451c-9adc-66a01e5fcbbf None None] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:10:37.815245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69381d0f-c7a2-451c-9adc-66a01e5fcbbf None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:37.835494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69381d0f-c7a2-451c-9adc-66a01e5fcbbf None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:37.846356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25b3da-8a9c-4971-91a3-ee328576d923 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27366a452ebb42158ae2a3d055f0ecd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b601e5160184047bf6209b06e370a00', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:37.847597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25b3da-8a9c-4971-91a3-ee328576d923 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:37.848054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25b3da-8a9c-4971-91a3-ee328576d923 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:37.848503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25b3da-8a9c-4971-91a3-ee328576d923 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] PATH_INFO: `/v3/projects/29f6db32114b458685269df31fae51c6` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:37.850783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25b3da-8a9c-4971-91a3-ee328576d923 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: Authorizing `identity:get_project(project_id=29f6db32114b458685269df31fae51c6)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:37.853053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25b3da-8a9c-4971-91a3-ee328576d923 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:37.863120 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1237/2497] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:10:37 2022] GET /identity/v3/projects/29f6db32114b458685269df31fae51c6 => generated 383 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:10:38.193773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5ae68-e758-4468-8378-70fa738e4eb7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:38.194051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5ae68-e758-4468-8378-70fa738e4eb7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:38.194508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5ae68-e758-4468-8378-70fa738e4eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:38.240301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7cd5ae68-e758-4468-8378-70fa738e4eb7 None None] MFA Rules not processed for user `31756abdfccf43e0b33e33300a527f29`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:38.241546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7cd5ae68-e758-4468-8378-70fa738e4eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:38.329003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:38.346442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25b3da-8a9c-4971-91a3-ee328576d923 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:38.405956 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1261/2498] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:38.479175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25b3da-8a9c-4971-91a3-ee328576d923 tempest-QuotasAdminNegativeTest-760882802 tempest-QuotasAdminNegativeTest-760882802-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:38.486723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5ae68-e758-4468-8378-70fa738e4eb7 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:38.502145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5ae68-e758-4468-8378-70fa738e4eb7 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:38.504872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628360e-ff94-4941-b9c9-421408ac13a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:38.507272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628360e-ff94-4941-b9c9-421408ac13a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:38.507552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628360e-ff94-4941-b9c9-421408ac13a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:38.508017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628360e-ff94-4941-b9c9-421408ac13a7 admin admin] PATH_INFO: `/v3/users/ca38f16f48494cc4aa71c7f5bd0916a4` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:38.511982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628360e-ff94-4941-b9c9-421408ac13a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca38f16f48494cc4aa71c7f5bd0916a4)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:38.514208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628360e-ff94-4941-b9c9-421408ac13a7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:38.525173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ff515-2dfc-4dc6-a972-17eba572b8e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:38.526041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ff515-2dfc-4dc6-a972-17eba572b8e4 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:38.527283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ff515-2dfc-4dc6-a972-17eba572b8e4 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:38.527768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ff515-2dfc-4dc6-a972-17eba572b8e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:38.547129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ff515-2dfc-4dc6-a972-17eba572b8e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:38.552304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ff515-2dfc-4dc6-a972-17eba572b8e4 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:38.570963 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1262/2499] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:10:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:10:38.834705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0628360e-ff94-4941-b9c9-421408ac13a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca38f16f48494cc4aa71c7f5bd0916a4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:38.850041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0628360e-ff94-4941-b9c9-421408ac13a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca38f16f48494cc4aa71c7f5bd0916a4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:38.916383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0628360e-ff94-4941-b9c9-421408ac13a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca38f16f48494cc4aa71c7f5bd0916a4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:38.931985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0628360e-ff94-4941-b9c9-421408ac13a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca38f16f48494cc4aa71c7f5bd0916a4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:38.932829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0628360e-ff94-4941-b9c9-421408ac13a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca38f16f48494cc4aa71c7f5bd0916a4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:38.951688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c79bd6-534f-41fd-9f93-98a89367fc97 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:38.959375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c79bd6-534f-41fd-9f93-98a89367fc97 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:38.959375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c79bd6-534f-41fd-9f93-98a89367fc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:38.959587 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1238/2500] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:10:38 2022] DELETE /identity/v3/users/ca38f16f48494cc4aa71c7f5bd0916a4 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:38.988812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e3c79bd6-534f-41fd-9f93-98a89367fc97 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:38.990340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e3c79bd6-534f-41fd-9f93-98a89367fc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:39.093062 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1263/2501] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:39.102934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628360e-ff94-4941-b9c9-421408ac13a7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:39.104478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0628360e-ff94-4941-b9c9-421408ac13a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:39.191275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628360e-ff94-4941-b9c9-421408ac13a7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:39.197181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb60f4-0b88-4594-88fc-1a6e276a1a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:39.198025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb60f4-0b88-4594-88fc-1a6e276a1a21 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:39.198401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb60f4-0b88-4594-88fc-1a6e276a1a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:39.198925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb60f4-0b88-4594-88fc-1a6e276a1a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:39.220256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb60f4-0b88-4594-88fc-1a6e276a1a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:39.222294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb60f4-0b88-4594-88fc-1a6e276a1a21 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:39.237924 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1239/2502] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:10:39.294723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:40.196941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c79bd6-534f-41fd-9f93-98a89367fc97 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:40.203033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e3c79bd6-534f-41fd-9f93-98a89367fc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:40.242588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c79bd6-534f-41fd-9f93-98a89367fc97 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:40.267050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cf915-d0d2-4387-b24a-09363933a57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:40.268596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cf915-d0d2-4387-b24a-09363933a57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:40.269123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cf915-d0d2-4387-b24a-09363933a57d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:40.271414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cf915-d0d2-4387-b24a-09363933a57d admin admin] PATH_INFO: `/v3/projects/29f6db32114b458685269df31fae51c6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:40.277265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962cf915-d0d2-4387-b24a-09363933a57d admin admin] RBAC: Authorizing `identity:delete_project(project_id=29f6db32114b458685269df31fae51c6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:40.281355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962cf915-d0d2-4387-b24a-09363933a57d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:40.461374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-962cf915-d0d2-4387-b24a-09363933a57d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29f6db32114b458685269df31fae51c6', 'request_id': 'req-962cf915-d0d2-4387-b24a-09363933a57d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:40.472704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-962cf915-d0d2-4387-b24a-09363933a57d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29f6db32114b458685269df31fae51c6', 'request_id': 'req-962cf915-d0d2-4387-b24a-09363933a57d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:40.480097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-962cf915-d0d2-4387-b24a-09363933a57d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29f6db32114b458685269df31fae51c6', 'request_id': 'req-962cf915-d0d2-4387-b24a-09363933a57d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:40.536433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d109fc-286a-46a4-806c-2f939a80b325 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:40.537823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d109fc-286a-46a4-806c-2f939a80b325 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:40.538278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d109fc-286a-46a4-806c-2f939a80b325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:40.558433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-962cf915-d0d2-4387-b24a-09363933a57d admin admin] The token cache is being invalidate because project 29f6db32114b458685269df31fae51c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:10:40.559368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-962cf915-d0d2-4387-b24a-09363933a57d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:40.559809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-962cf915-d0d2-4387-b24a-09363933a57d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:40.567657 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1264/2503] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:10:40 2022] DELETE /identity/v3/projects/29f6db32114b458685269df31fae51c6 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:40.572249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cf915-d0d2-4387-b24a-09363933a57d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:40.575203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-962cf915-d0d2-4387-b24a-09363933a57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:40.579390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-72d109fc-286a-46a4-806c-2f939a80b325 None None] MFA Rules not processed for user `2022d33a84b6457abb0ae42747dac56e`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:40.581801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-72d109fc-286a-46a4-806c-2f939a80b325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:40.706530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cf915-d0d2-4387-b24a-09363933a57d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:40.721646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfa978-8d42-441b-ae7e-e7aa4f4f6150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:40.723563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfa978-8d42-441b-ae7e-e7aa4f4f6150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:40.724683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfa978-8d42-441b-ae7e-e7aa4f4f6150 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:40.724972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfa978-8d42-441b-ae7e-e7aa4f4f6150 admin admin] PATH_INFO: `/v3/users/27366a452ebb42158ae2a3d055f0ecd4` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:40.729535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfa978-8d42-441b-ae7e-e7aa4f4f6150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27366a452ebb42158ae2a3d055f0ecd4)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:40.735993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfa978-8d42-441b-ae7e-e7aa4f4f6150 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:40.764737 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1240/2504] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:10:40.843079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9abc6a-aeb2-4fcb-923f-ece7f106cf59 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:40.843704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9abc6a-aeb2-4fcb-923f-ece7f106cf59 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:40.844294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9abc6a-aeb2-4fcb-923f-ece7f106cf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:40.871415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ca9abc6a-aeb2-4fcb-923f-ece7f106cf59 None None] MFA Rules not processed for user `578b87f863b34f57a571f7e56d44f118`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:40.874782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ca9abc6a-aeb2-4fcb-923f-ece7f106cf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:40.945055 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1241/2505] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:41.005105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f2dfa978-8d42-441b-ae7e-e7aa4f4f6150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27366a452ebb42158ae2a3d055f0ecd4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:41.012680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f2dfa978-8d42-441b-ae7e-e7aa4f4f6150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27366a452ebb42158ae2a3d055f0ecd4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:41.117555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f2dfa978-8d42-441b-ae7e-e7aa4f4f6150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27366a452ebb42158ae2a3d055f0ecd4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:41.119176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f2dfa978-8d42-441b-ae7e-e7aa4f4f6150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27366a452ebb42158ae2a3d055f0ecd4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:41.119516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:41.144435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f2dfa978-8d42-441b-ae7e-e7aa4f4f6150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27366a452ebb42158ae2a3d055f0ecd4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:41.152557 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1265/2506] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:10:40 2022] DELETE /identity/v3/users/27366a452ebb42158ae2a3d055f0ecd4 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:41.343312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9abc6a-aeb2-4fcb-923f-ece7f106cf59 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:41.344727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ca9abc6a-aeb2-4fcb-923f-ece7f106cf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:41.441111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9abc6a-aeb2-4fcb-923f-ece7f106cf59 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:41.520784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ccd4d-2f49-4a7a-a4cd-ad400738c85f None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:41.521401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ccd4d-2f49-4a7a-a4cd-ad400738c85f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:41.521401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ccd4d-2f49-4a7a-a4cd-ad400738c85f None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:41.522783 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1266/2507] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:10:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:10:41.538601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b267c1-10b6-42a1-8460-c1c4f3e01bb4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:41.538601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b267c1-10b6-42a1-8460-c1c4f3e01bb4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:41.538601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b267c1-10b6-42a1-8460-c1c4f3e01bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:41.574220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-95b267c1-10b6-42a1-8460-c1c4f3e01bb4 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:41.576008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-95b267c1-10b6-42a1-8460-c1c4f3e01bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:41.603642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6027969-9bbe-45f8-898e-91dda0572ee1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:41.604483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6027969-9bbe-45f8-898e-91dda0572ee1 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:41.604945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6027969-9bbe-45f8-898e-91dda0572ee1 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:41.605638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6027969-9bbe-45f8-898e-91dda0572ee1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:41.612797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d6027969-9bbe-45f8-898e-91dda0572ee1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:41.698768 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1267/2508] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:10:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:10:41.731952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b267c1-10b6-42a1-8460-c1c4f3e01bb4 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:41.734621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-95b267c1-10b6-42a1-8460-c1c4f3e01bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:41.751346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6027969-9bbe-45f8-898e-91dda0572ee1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:41.754669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6027969-9bbe-45f8-898e-91dda0572ee1 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:41.766232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b267c1-10b6-42a1-8460-c1c4f3e01bb4 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:41.778451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17dced1-d605-44a0-99b6-1dfbf1d9f474 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:41.779152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dced1-d605-44a0-99b6-1dfbf1d9f474 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:41.779478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dced1-d605-44a0-99b6-1dfbf1d9f474 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:41.780076 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1242/2509] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:10:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:10:41.780878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dced1-d605-44a0-99b6-1dfbf1d9f474 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:41.792293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17dced1-d605-44a0-99b6-1dfbf1d9f474 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:41.795847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17dced1-d605-44a0-99b6-1dfbf1d9f474 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:41.826401 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1268/2510] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:10:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:10:41.948055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6027969-9bbe-45f8-898e-91dda0572ee1 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:41.953094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d6027969-9bbe-45f8-898e-91dda0572ee1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:42.065447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:42.091397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6027969-9bbe-45f8-898e-91dda0572ee1 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:42.097987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd280ba0-e3e7-486e-b655-1da5fcd7c76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:42.099286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd280ba0-e3e7-486e-b655-1da5fcd7c76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:42.099515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd280ba0-e3e7-486e-b655-1da5fcd7c76d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:42.099798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd280ba0-e3e7-486e-b655-1da5fcd7c76d admin admin] PATH_INFO: `/v3/projects/6b601e5160184047bf6209b06e370a00` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:42.101112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd280ba0-e3e7-486e-b655-1da5fcd7c76d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b601e5160184047bf6209b06e370a00)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:42.103338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd280ba0-e3e7-486e-b655-1da5fcd7c76d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:42.284078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fd280ba0-e3e7-486e-b655-1da5fcd7c76d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b601e5160184047bf6209b06e370a00', 'request_id': 'req-fd280ba0-e3e7-486e-b655-1da5fcd7c76d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:42.313513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fd280ba0-e3e7-486e-b655-1da5fcd7c76d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b601e5160184047bf6209b06e370a00', 'request_id': 'req-fd280ba0-e3e7-486e-b655-1da5fcd7c76d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:42.332989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fd280ba0-e3e7-486e-b655-1da5fcd7c76d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b601e5160184047bf6209b06e370a00', 'request_id': 'req-fd280ba0-e3e7-486e-b655-1da5fcd7c76d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:42.455947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fd280ba0-e3e7-486e-b655-1da5fcd7c76d admin admin] The token cache is being invalidate because project 6b601e5160184047bf6209b06e370a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:10:42.458820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fd280ba0-e3e7-486e-b655-1da5fcd7c76d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:42.459815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fd280ba0-e3e7-486e-b655-1da5fcd7c76d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:10:42.469592 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1243/2511] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:10:41 2022] DELETE /identity/v3/projects/6b601e5160184047bf6209b06e370a00 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:42.474673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479c01d-9636-4a9a-adeb-ee69cf2dbb20 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:42.474673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479c01d-9636-4a9a-adeb-ee69cf2dbb20 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:42.479252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479c01d-9636-4a9a-adeb-ee69cf2dbb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:42.512122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9479c01d-9636-4a9a-adeb-ee69cf2dbb20 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:42.522317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9479c01d-9636-4a9a-adeb-ee69cf2dbb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:42.639163 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1269/2512] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:42.706440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85528596-b0d0-4cfa-896a-8f8342e352e7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:42.707343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85528596-b0d0-4cfa-896a-8f8342e352e7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:42.707622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85528596-b0d0-4cfa-896a-8f8342e352e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:42.728390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-85528596-b0d0-4cfa-896a-8f8342e352e7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:42.729864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-85528596-b0d0-4cfa-896a-8f8342e352e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:42.744420 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1244/2513] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:10:42.750165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479c01d-9636-4a9a-adeb-ee69cf2dbb20 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:42.760304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479c01d-9636-4a9a-adeb-ee69cf2dbb20 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:42.766416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12750bf4-0bfd-4fa3-b577-8065e40be963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:42.768157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12750bf4-0bfd-4fa3-b577-8065e40be963 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:42.768871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12750bf4-0bfd-4fa3-b577-8065e40be963 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:42.769565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12750bf4-0bfd-4fa3-b577-8065e40be963 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:42.771374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12750bf4-0bfd-4fa3-b577-8065e40be963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:10:42.772384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12750bf4-0bfd-4fa3-b577-8065e40be963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:42.774917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12750bf4-0bfd-4fa3-b577-8065e40be963 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:42.792659 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1270/2514] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:10:42.795426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85528596-b0d0-4cfa-896a-8f8342e352e7 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:42.809702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85528596-b0d0-4cfa-896a-8f8342e352e7 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:42.818028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72434fa3-bc99-4943-b2b2-45b59b0377af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:42.818789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72434fa3-bc99-4943-b2b2-45b59b0377af admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:42.819101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72434fa3-bc99-4943-b2b2-45b59b0377af admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:42.819385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72434fa3-bc99-4943-b2b2-45b59b0377af admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:42.823031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72434fa3-bc99-4943-b2b2-45b59b0377af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:42.825343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72434fa3-bc99-4943-b2b2-45b59b0377af admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:42.948553 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1245/2515] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:10:42 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:10:42.954412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12750bf4-0bfd-4fa3-b577-8065e40be963 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:42.983912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12750bf4-0bfd-4fa3-b577-8065e40be963 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:43.105085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d5cf9-4d40-4205-86f2-8b0afa6541e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:43.106299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d5cf9-4d40-4205-86f2-8b0afa6541e9 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:43.106880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d5cf9-4d40-4205-86f2-8b0afa6541e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:43.107429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d5cf9-4d40-4205-86f2-8b0afa6541e9 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:43.109496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d5cf9-4d40-4205-86f2-8b0afa6541e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:43.112607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d5cf9-4d40-4205-86f2-8b0afa6541e9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:43.122872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:43.279913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72434fa3-bc99-4943-b2b2-45b59b0377af admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:43.280083 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1271/2516] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:10:42 2022] POST /identity/v3/users => generated 293 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:10:43.291936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72434fa3-bc99-4943-b2b2-45b59b0377af admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:43.298460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52a535-a939-4306-810e-01dfc98575cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:43.299891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52a535-a939-4306-810e-01dfc98575cd admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:43.300320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52a535-a939-4306-810e-01dfc98575cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:43.300910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52a535-a939-4306-810e-01dfc98575cd admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:43.301797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52a535-a939-4306-810e-01dfc98575cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:43.303891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52a535-a939-4306-810e-01dfc98575cd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:43.324362 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1246/2517] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:10:43.326704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d5cf9-4d40-4205-86f2-8b0afa6541e9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:43.342532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d5cf9-4d40-4205-86f2-8b0afa6541e9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:43.369460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c06da-1eae-4bec-9d7b-fee8630301a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:43.370706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c06da-1eae-4bec-9d7b-fee8630301a4 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:43.370968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c06da-1eae-4bec-9d7b-fee8630301a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:43.371281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c06da-1eae-4bec-9d7b-fee8630301a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:43.372089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c06da-1eae-4bec-9d7b-fee8630301a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:43.374302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c06da-1eae-4bec-9d7b-fee8630301a4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:43.410252 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1272/2518] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:10:43.420852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52a535-a939-4306-810e-01dfc98575cd admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:43.435528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52a535-a939-4306-810e-01dfc98575cd admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:43.443874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7c9ab-66db-4e6e-a21e-dae1f025f810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:43.445071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7c9ab-66db-4e6e-a21e-dae1f025f810 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:43.445526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7c9ab-66db-4e6e-a21e-dae1f025f810 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:43.446005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7c9ab-66db-4e6e-a21e-dae1f025f810 admin admin] PATH_INFO: `/v3/projects/30d028fa9b854c8fb71c8cbed2985c27/users/52281b3989a04ca2a50b0bc93bf783f0/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:43.465181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7c9ab-66db-4e6e-a21e-dae1f025f810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d028fa9b854c8fb71c8cbed2985c27, user_id=52281b3989a04ca2a50b0bc93bf783f0, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:43.468508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7c9ab-66db-4e6e-a21e-dae1f025f810 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:43.584716 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1247/2519] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:10:43 2022] PUT /identity/v3/projects/30d028fa9b854c8fb71c8cbed2985c27/users/52281b3989a04ca2a50b0bc93bf783f0/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:43.589993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896aeed6-3de5-4511-80c5-ec6c0344a947 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:43.590665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896aeed6-3de5-4511-80c5-ec6c0344a947 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:43.590665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896aeed6-3de5-4511-80c5-ec6c0344a947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:43.657779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-896aeed6-3de5-4511-80c5-ec6c0344a947 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:43.657779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-896aeed6-3de5-4511-80c5-ec6c0344a947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:43.802493 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1273/2520] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:43.858714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7c9ab-66db-4e6e-a21e-dae1f025f810 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:43.869314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f4c7c9ab-66db-4e6e-a21e-dae1f025f810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:43.921215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315174e-3f5e-4c18-b465-1aef98bc0494 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:43.921476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315174e-3f5e-4c18-b465-1aef98bc0494 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:43.921952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315174e-3f5e-4c18-b465-1aef98bc0494 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:43.923762 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1274/2521] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:10:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:10:43.929766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd55c69-774f-43b0-93ff-5b06aec8ec69 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:43.930290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd55c69-774f-43b0-93ff-5b06aec8ec69 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:43.930747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd55c69-774f-43b0-93ff-5b06aec8ec69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:43.999881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9bd55c69-774f-43b0-93ff-5b06aec8ec69 None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:44.004717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9bd55c69-774f-43b0-93ff-5b06aec8ec69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:44.082716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7c9ab-66db-4e6e-a21e-dae1f025f810 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:44.094356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c6c8d-c5e0-4f54-a305-126d26ba1db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:44.095384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c6c8d-c5e0-4f54-a305-126d26ba1db7 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:44.097528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c6c8d-c5e0-4f54-a305-126d26ba1db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:44.098035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c6c8d-c5e0-4f54-a305-126d26ba1db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:44.120976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c6c8d-c5e0-4f54-a305-126d26ba1db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:44.122742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c6c8d-c5e0-4f54-a305-126d26ba1db7 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:44.154752 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1248/2522] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:10:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:10:44.256006 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1275/2523] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:10:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:10:44.288437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c6c8d-c5e0-4f54-a305-126d26ba1db7 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:44.301988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c6c8d-c5e0-4f54-a305-126d26ba1db7 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:44.313596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59e99e-5c2e-486f-8887-7202ea736fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:44.314330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59e99e-5c2e-486f-8887-7202ea736fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:44.314696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59e99e-5c2e-486f-8887-7202ea736fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:44.314983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59e99e-5c2e-486f-8887-7202ea736fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:44.336896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59e99e-5c2e-486f-8887-7202ea736fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:44.344931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59e99e-5c2e-486f-8887-7202ea736fa0 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:44.372985 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1249/2524] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:10:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:10:44.418641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971de471-8b73-4ac6-a18a-0df1d1375ec8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:44.418931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971de471-8b73-4ac6-a18a-0df1d1375ec8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:44.419245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971de471-8b73-4ac6-a18a-0df1d1375ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:44.455704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-971de471-8b73-4ac6-a18a-0df1d1375ec8 None None] MFA Rules not processed for user `fbd858f3e6ba4523b056bbdc2af427b0`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:44.458059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-971de471-8b73-4ac6-a18a-0df1d1375ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:44.473956 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1276/2525] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:10:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:44.505187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59e99e-5c2e-486f-8887-7202ea736fa0 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:44.516782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59e99e-5c2e-486f-8887-7202ea736fa0 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:44.522985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7d6de-2362-421b-b5af-a8854be9d21b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:44.523795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7d6de-2362-421b-b5af-a8854be9d21b service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:44.524798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7d6de-2362-421b-b5af-a8854be9d21b service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:44.525024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7d6de-2362-421b-b5af-a8854be9d21b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:44.537809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7d6de-2362-421b-b5af-a8854be9d21b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:44.539993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7d6de-2362-421b-b5af-a8854be9d21b service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:44.555028 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1250/2526] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:10:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:10:44.827064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:44.949211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:45.663583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971de471-8b73-4ac6-a18a-0df1d1375ec8 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:45.663583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-971de471-8b73-4ac6-a18a-0df1d1375ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:45.867366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971de471-8b73-4ac6-a18a-0df1d1375ec8 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:45.875034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d268217-1804-4693-8d7f-314508b89276 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:45.876062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d268217-1804-4693-8d7f-314508b89276 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:45.876453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d268217-1804-4693-8d7f-314508b89276 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:45.876803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d268217-1804-4693-8d7f-314508b89276 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:45.885472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4d268217-1804-4693-8d7f-314508b89276 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:45.920756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d268217-1804-4693-8d7f-314508b89276 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:45.925043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d268217-1804-4693-8d7f-314508b89276 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:45.947901 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1277/2527] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:10:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:10:46.274306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d9825-4ab0-434b-80aa-f583b5ae17c2 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:46.279184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d9825-4ab0-434b-80aa-f583b5ae17c2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:46.279184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d9825-4ab0-434b-80aa-f583b5ae17c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:46.353430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9b4d9825-4ab0-434b-80aa-f583b5ae17c2 None None] MFA Rules not processed for user `abeb7020019d41a18de42956d706a011`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:46.355981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9b4d9825-4ab0-434b-80aa-f583b5ae17c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:46.507592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d268217-1804-4693-8d7f-314508b89276 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:46.535157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d268217-1804-4693-8d7f-314508b89276 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:46.552587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fffca7-088c-4e10-bc6c-416606300ea5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:46.553563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fffca7-088c-4e10-bc6c-416606300ea5 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:46.554137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fffca7-088c-4e10-bc6c-416606300ea5 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:46.554575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fffca7-088c-4e10-bc6c-416606300ea5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:46.558709 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1251/2528] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:46.574018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d9fffca7-088c-4e10-bc6c-416606300ea5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:46.615297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fffca7-088c-4e10-bc6c-416606300ea5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:46.616967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fffca7-088c-4e10-bc6c-416606300ea5 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:46.637740 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1278/2529] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:10:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:10:47.409432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:47.482874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:48.403790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:49.916958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:52.294047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:52.351455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:55.009915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:55.105861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:57.723334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c54b10-cc85-427b-a073-adc39ebd40bd None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:57.726706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c54b10-cc85-427b-a073-adc39ebd40bd None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:57.726706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c54b10-cc85-427b-a073-adc39ebd40bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:57.752271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:57.786648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e1c54b10-cc85-427b-a073-adc39ebd40bd None None] MFA Rules not processed for user `52281b3989a04ca2a50b0bc93bf783f0`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:10:57.787917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e1c54b10-cc85-427b-a073-adc39ebd40bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:57.953569 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1252/2530] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:10:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:10:57.959703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fffca7-088c-4e10-bc6c-416606300ea5 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:57.975257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fffca7-088c-4e10-bc6c-416606300ea5 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:57.989084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4211c-7869-4ee3-b3bd-1f43e9963bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:57.990017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4211c-7869-4ee3-b3bd-1f43e9963bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:57.990498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4211c-7869-4ee3-b3bd-1f43e9963bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:57.990970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4211c-7869-4ee3-b3bd-1f43e9963bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:57.991904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4211c-7869-4ee3-b3bd-1f43e9963bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:57.994090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4211c-7869-4ee3-b3bd-1f43e9963bd2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:58.037623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:58.136121 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1279/2531] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:10:57 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:10:58.139127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c54b10-cc85-427b-a073-adc39ebd40bd None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:58.164544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c54b10-cc85-427b-a073-adc39ebd40bd None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:58.244443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adc616-3d75-4c8b-89db-87ccd861d014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:58.245261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adc616-3d75-4c8b-89db-87ccd861d014 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:58.245846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adc616-3d75-4c8b-89db-87ccd861d014 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:58.247036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adc616-3d75-4c8b-89db-87ccd861d014 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:58.247683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adc616-3d75-4c8b-89db-87ccd861d014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:58.249892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adc616-3d75-4c8b-89db-87ccd861d014 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:58.397464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4211c-7869-4ee3-b3bd-1f43e9963bd2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:58.397718 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1253/2532] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:10:58 2022] POST /identity/v3/users => generated 299 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:10:58.411268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4211c-7869-4ee3-b3bd-1f43e9963bd2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:58.424752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddb20a-da27-4a08-9ab2-2d4abc2d0ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:58.424752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddb20a-da27-4a08-9ab2-2d4abc2d0ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:58.424752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddb20a-da27-4a08-9ab2-2d4abc2d0ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:58.424752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddb20a-da27-4a08-9ab2-2d4abc2d0ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:58.425528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cddb20a-da27-4a08-9ab2-2d4abc2d0ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:58.425528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cddb20a-da27-4a08-9ab2-2d4abc2d0ce9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:58.440705 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1280/2533] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:10:58.454971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adc616-3d75-4c8b-89db-87ccd861d014 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:58.472796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adc616-3d75-4c8b-89db-87ccd861d014 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:58.514746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea781cf-795b-4db6-bbcf-ce3c852abd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:58.518207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea781cf-795b-4db6-bbcf-ce3c852abd00 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:58.525091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea781cf-795b-4db6-bbcf-ce3c852abd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:58.525523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea781cf-795b-4db6-bbcf-ce3c852abd00 admin admin] PATH_INFO: `/v3/projects/f27ffd13e54d41ebb9e79a74725cb3bf/users/6dfd80a71b204625b5401e5249a0bbed/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:58.563673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea781cf-795b-4db6-bbcf-ce3c852abd00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27ffd13e54d41ebb9e79a74725cb3bf, user_id=6dfd80a71b204625b5401e5249a0bbed, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:58.576887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea781cf-795b-4db6-bbcf-ce3c852abd00 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:58.726091 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1254/2534] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:10:58 2022] PUT /identity/v3/projects/f27ffd13e54d41ebb9e79a74725cb3bf/users/6dfd80a71b204625b5401e5249a0bbed/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:58.729717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddb20a-da27-4a08-9ab2-2d4abc2d0ce9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:58.750036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddb20a-da27-4a08-9ab2-2d4abc2d0ce9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:58.914094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11866460-f867-4d94-aa50-7cfe53b4d2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:58.915699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11866460-f867-4d94-aa50-7cfe53b4d2cc admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:58.916176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11866460-f867-4d94-aa50-7cfe53b4d2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:58.916621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11866460-f867-4d94-aa50-7cfe53b4d2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:58.917902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11866460-f867-4d94-aa50-7cfe53b4d2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:58.920015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11866460-f867-4d94-aa50-7cfe53b4d2cc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:58.939680 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1281/2535] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:10:58.944806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea781cf-795b-4db6-bbcf-ce3c852abd00 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:58.962243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea781cf-795b-4db6-bbcf-ce3c852abd00 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:58.971699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb5db8-0dbf-47e9-a5a9-f47a9e6f035d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:58.974285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb5db8-0dbf-47e9-a5a9-f47a9e6f035d admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:58.975034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb5db8-0dbf-47e9-a5a9-f47a9e6f035d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:58.975567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb5db8-0dbf-47e9-a5a9-f47a9e6f035d admin admin] PATH_INFO: `/v3/projects/f27ffd13e54d41ebb9e79a74725cb3bf/users/6dfd80a71b204625b5401e5249a0bbed/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:58.978896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb5db8-0dbf-47e9-a5a9-f47a9e6f035d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27ffd13e54d41ebb9e79a74725cb3bf, user_id=6dfd80a71b204625b5401e5249a0bbed, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:58.988691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb5db8-0dbf-47e9-a5a9-f47a9e6f035d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:10:59.022808 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1255/2536] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:10:58 2022] PUT /identity/v3/projects/f27ffd13e54d41ebb9e79a74725cb3bf/users/6dfd80a71b204625b5401e5249a0bbed/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:10:59.526580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:10:59.561889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11866460-f867-4d94-aa50-7cfe53b4d2cc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:10:59.568711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-11866460-f867-4d94-aa50-7cfe53b4d2cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:10:59.588987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11866460-f867-4d94-aa50-7cfe53b4d2cc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:10:59.688930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063093fb-7017-4faf-bc1d-6204d007d95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:10:59.690262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063093fb-7017-4faf-bc1d-6204d007d95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:10:59.690548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063093fb-7017-4faf-bc1d-6204d007d95f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:10:59.690872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063093fb-7017-4faf-bc1d-6204d007d95f admin admin] PATH_INFO: `/v3/users/ba60685a2001459cbfb531d95a6b296e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:10:59.692585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063093fb-7017-4faf-bc1d-6204d007d95f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba60685a2001459cbfb531d95a6b296e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:10:59.694549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063093fb-7017-4faf-bc1d-6204d007d95f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:00.063669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-063093fb-7017-4faf-bc1d-6204d007d95f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba60685a2001459cbfb531d95a6b296e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:00.078378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-063093fb-7017-4faf-bc1d-6204d007d95f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba60685a2001459cbfb531d95a6b296e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:00.214409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-063093fb-7017-4faf-bc1d-6204d007d95f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba60685a2001459cbfb531d95a6b296e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:00.215176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-063093fb-7017-4faf-bc1d-6204d007d95f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba60685a2001459cbfb531d95a6b296e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:00.249223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-063093fb-7017-4faf-bc1d-6204d007d95f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba60685a2001459cbfb531d95a6b296e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:00.264443 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1282/2537] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:10:59 2022] DELETE /identity/v3/users/ba60685a2001459cbfb531d95a6b296e => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:11:00.269523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac44a2a-90de-452e-aecb-ebdbcb5663df None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:00.271613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac44a2a-90de-452e-aecb-ebdbcb5663df None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:00.272090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac44a2a-90de-452e-aecb-ebdbcb5663df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:00.301335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-eac44a2a-90de-452e-aecb-ebdbcb5663df None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:00.303656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-eac44a2a-90de-452e-aecb-ebdbcb5663df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:00.397744 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1256/2538] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:00.542860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063093fb-7017-4faf-bc1d-6204d007d95f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:00.545532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-063093fb-7017-4faf-bc1d-6204d007d95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:00.626697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063093fb-7017-4faf-bc1d-6204d007d95f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:00.633284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bbcbb-12e7-4fda-a371-4f33facad87c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:00.634921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bbcbb-12e7-4fda-a371-4f33facad87c service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:00.635522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bbcbb-12e7-4fda-a371-4f33facad87c service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:00.636541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bbcbb-12e7-4fda-a371-4f33facad87c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:00.655887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293bbcbb-12e7-4fda-a371-4f33facad87c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:00.658123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293bbcbb-12e7-4fda-a371-4f33facad87c service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:00.674470 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1283/2539] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:11:02.018161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac44a2a-90de-452e-aecb-ebdbcb5663df None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:02.020903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-eac44a2a-90de-452e-aecb-ebdbcb5663df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:02.055510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac44a2a-90de-452e-aecb-ebdbcb5663df None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:02.069218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f1dbd-2d8d-47ce-baaa-eb2f43be5124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:02.070164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f1dbd-2d8d-47ce-baaa-eb2f43be5124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:02.070451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f1dbd-2d8d-47ce-baaa-eb2f43be5124 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:02.070725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f1dbd-2d8d-47ce-baaa-eb2f43be5124 admin admin] PATH_INFO: `/v3/projects/fb6deae6b08e4ed8b15dc6edfe1d38d3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:02.074591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f1dbd-2d8d-47ce-baaa-eb2f43be5124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb6deae6b08e4ed8b15dc6edfe1d38d3)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:02.081692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f1dbd-2d8d-47ce-baaa-eb2f43be5124 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:02.082628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:02.310883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-829f1dbd-2d8d-47ce-baaa-eb2f43be5124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb6deae6b08e4ed8b15dc6edfe1d38d3', 'request_id': 'req-829f1dbd-2d8d-47ce-baaa-eb2f43be5124'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:02.330641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-829f1dbd-2d8d-47ce-baaa-eb2f43be5124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb6deae6b08e4ed8b15dc6edfe1d38d3', 'request_id': 'req-829f1dbd-2d8d-47ce-baaa-eb2f43be5124'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:02.346230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-829f1dbd-2d8d-47ce-baaa-eb2f43be5124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb6deae6b08e4ed8b15dc6edfe1d38d3', 'request_id': 'req-829f1dbd-2d8d-47ce-baaa-eb2f43be5124'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:02.495206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-829f1dbd-2d8d-47ce-baaa-eb2f43be5124 admin admin] The token cache is being invalidate because project fb6deae6b08e4ed8b15dc6edfe1d38d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:11:02.495630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-829f1dbd-2d8d-47ce-baaa-eb2f43be5124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:02.498059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-829f1dbd-2d8d-47ce-baaa-eb2f43be5124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:02.501308 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1257/2540] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:11:02 2022] DELETE /identity/v3/projects/fb6deae6b08e4ed8b15dc6edfe1d38d3 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:11:02.504736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bbcbb-12e7-4fda-a371-4f33facad87c service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:02.506055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:02.522637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bbcbb-12e7-4fda-a371-4f33facad87c service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:02.655466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052047e1-883b-4d7d-89a4-f59658623f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:02.656661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052047e1-883b-4d7d-89a4-f59658623f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:02.657176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052047e1-883b-4d7d-89a4-f59658623f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:02.657696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052047e1-883b-4d7d-89a4-f59658623f95 admin admin] PATH_INFO: `/v3/users/a9f9d4731e4d46c9ac9bc60e50746b33` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:02.660136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052047e1-883b-4d7d-89a4-f59658623f95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f9d4731e4d46c9ac9bc60e50746b33)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:02.664671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052047e1-883b-4d7d-89a4-f59658623f95 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:02.949714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-052047e1-883b-4d7d-89a4-f59658623f95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f9d4731e4d46c9ac9bc60e50746b33'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:02.973110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-052047e1-883b-4d7d-89a4-f59658623f95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f9d4731e4d46c9ac9bc60e50746b33'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:03.112509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-052047e1-883b-4d7d-89a4-f59658623f95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f9d4731e4d46c9ac9bc60e50746b33'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:03.114427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-052047e1-883b-4d7d-89a4-f59658623f95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f9d4731e4d46c9ac9bc60e50746b33'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:03.121248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f1dbd-2d8d-47ce-baaa-eb2f43be5124 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:03.126551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-829f1dbd-2d8d-47ce-baaa-eb2f43be5124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:03.143344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-052047e1-883b-4d7d-89a4-f59658623f95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f9d4731e4d46c9ac9bc60e50746b33'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:03.151238 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1284/2541] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:11:02 2022] DELETE /identity/v3/users/a9f9d4731e4d46c9ac9bc60e50746b33 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:11:03.254535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f1dbd-2d8d-47ce-baaa-eb2f43be5124 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:03.362802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b5479-3ba3-4a90-bcd7-e97b1b7bb61e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:03.369610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b5479-3ba3-4a90-bcd7-e97b1b7bb61e service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:03.369973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b5479-3ba3-4a90-bcd7-e97b1b7bb61e service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:03.370264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b5479-3ba3-4a90-bcd7-e97b1b7bb61e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:03.385985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-830b5479-3ba3-4a90-bcd7-e97b1b7bb61e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:03.508905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b5479-3ba3-4a90-bcd7-e97b1b7bb61e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:03.511116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b5479-3ba3-4a90-bcd7-e97b1b7bb61e service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:03.538992 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1258/2542] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:11:03 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:11:04.288065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:04.636217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7dba1-65e9-4ee2-b81d-779121836693 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:04.636717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7dba1-65e9-4ee2-b81d-779121836693 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:04.637007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7dba1-65e9-4ee2-b81d-779121836693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:04.658923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f4e7dba1-65e9-4ee2-b81d-779121836693 None None] MFA Rules not processed for user `a9b68dacc4b8463ba07fae6372131117`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:04.660140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f4e7dba1-65e9-4ee2-b81d-779121836693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:04.707689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b5479-3ba3-4a90-bcd7-e97b1b7bb61e service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:04.711349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-830b5479-3ba3-4a90-bcd7-e97b1b7bb61e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:04.733971 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1285/2543] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:04.834287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b5479-3ba3-4a90-bcd7-e97b1b7bb61e service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:04.845437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0027f-12e4-4917-9514-f4954c21503f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:04.846604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0027f-12e4-4917-9514-f4954c21503f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:04.846604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0027f-12e4-4917-9514-f4954c21503f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:04.846604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0027f-12e4-4917-9514-f4954c21503f admin admin] PATH_INFO: `/v3/projects/d2c43412361646d1a14ffec32a0a02bd` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:04.848268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0027f-12e4-4917-9514-f4954c21503f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c43412361646d1a14ffec32a0a02bd)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:04.850668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0027f-12e4-4917-9514-f4954c21503f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:05.119290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-97a0027f-12e4-4917-9514-f4954c21503f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c43412361646d1a14ffec32a0a02bd', 'request_id': 'req-97a0027f-12e4-4917-9514-f4954c21503f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:05.144108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-97a0027f-12e4-4917-9514-f4954c21503f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c43412361646d1a14ffec32a0a02bd', 'request_id': 'req-97a0027f-12e4-4917-9514-f4954c21503f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:05.163480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-97a0027f-12e4-4917-9514-f4954c21503f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c43412361646d1a14ffec32a0a02bd', 'request_id': 'req-97a0027f-12e4-4917-9514-f4954c21503f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:05.221691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:05.331234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-97a0027f-12e4-4917-9514-f4954c21503f admin admin] The token cache is being invalidate because project d2c43412361646d1a14ffec32a0a02bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:11:05.331831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-97a0027f-12e4-4917-9514-f4954c21503f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:05.332526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-97a0027f-12e4-4917-9514-f4954c21503f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:05.335094 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1259/2544] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:11:04 2022] DELETE /identity/v3/projects/d2c43412361646d1a14ffec32a0a02bd => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:11:05.340436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714e2b8-1b63-4a29-98b6-c4c6e4613974 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:05.342097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714e2b8-1b63-4a29-98b6-c4c6e4613974 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:05.342503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714e2b8-1b63-4a29-98b6-c4c6e4613974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:05.369336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d714e2b8-1b63-4a29-98b6-c4c6e4613974 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:05.373100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d714e2b8-1b63-4a29-98b6-c4c6e4613974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:05.422095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e33e54-0c47-4f88-b0d4-6590aa5cbf78 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:05.422527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e33e54-0c47-4f88-b0d4-6590aa5cbf78 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:05.422959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e33e54-0c47-4f88-b0d4-6590aa5cbf78 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:05.425186 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1260/2545] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 21:11:05.441449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb9f89-e63e-466a-a598-04f98c6e4b2e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:05.441449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb9f89-e63e-466a-a598-04f98c6e4b2e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:05.441449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb9f89-e63e-466a-a598-04f98c6e4b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:05.490780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5cdb9f89-e63e-466a-a598-04f98c6e4b2e None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:05.493235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5cdb9f89-e63e-466a-a598-04f98c6e4b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:05.513735 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1286/2546] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:05.522587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de4ade-2dc6-4c06-af6a-8ef873cd9ecd None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:05.523234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de4ade-2dc6-4c06-af6a-8ef873cd9ecd None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:05.523704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de4ade-2dc6-4c06-af6a-8ef873cd9ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:05.566088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-07de4ade-2dc6-4c06-af6a-8ef873cd9ecd None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:05.568865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-07de4ade-2dc6-4c06-af6a-8ef873cd9ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:05.585792 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1287/2547] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:11:05.589688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de4ade-2dc6-4c06-af6a-8ef873cd9ecd None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:05.608185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de4ade-2dc6-4c06-af6a-8ef873cd9ecd None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:05.616976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c781c75-1209-4026-8cfb-cec9149de04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:05.619910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c781c75-1209-4026-8cfb-cec9149de04f admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:05.620361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c781c75-1209-4026-8cfb-cec9149de04f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:05.620892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c781c75-1209-4026-8cfb-cec9149de04f admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:05.622723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c781c75-1209-4026-8cfb-cec9149de04f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:11:05.623434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c781c75-1209-4026-8cfb-cec9149de04f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:05.626855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c781c75-1209-4026-8cfb-cec9149de04f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:05.657210 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1288/2548] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:11:05.659329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c781c75-1209-4026-8cfb-cec9149de04f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:05.679186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c781c75-1209-4026-8cfb-cec9149de04f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:05.683644 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1261/2549] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:11:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:05.686618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfa202-945a-4924-a736-437ec224d11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:05.688280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfa202-945a-4924-a736-437ec224d11b admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:05.688791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfa202-945a-4924-a736-437ec224d11b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:05.689254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfa202-945a-4924-a736-437ec224d11b admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:05.704612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfa202-945a-4924-a736-437ec224d11b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:05.706371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb9f89-e63e-466a-a598-04f98c6e4b2e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:05.707613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfa202-945a-4924-a736-437ec224d11b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:05.707887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5cdb9f89-e63e-466a-a598-04f98c6e4b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:05.729534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb9f89-e63e-466a-a598-04f98c6e4b2e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:05.735665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d2a3d-936b-44a0-9f4a-07a6b8bc7457 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:05.736602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d2a3d-936b-44a0-9f4a-07a6b8bc7457 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:05.736997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d2a3d-936b-44a0-9f4a-07a6b8bc7457 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:05.737283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d2a3d-936b-44a0-9f4a-07a6b8bc7457 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:05.760567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d2a3d-936b-44a0-9f4a-07a6b8bc7457 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:05.764025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d2a3d-936b-44a0-9f4a-07a6b8bc7457 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:05.782693 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1262/2550] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:11:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:11:05.824039 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1289/2551] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:11:05 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:11:05.829014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d2a3d-936b-44a0-9f4a-07a6b8bc7457 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:05.846585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:05.848668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d2a3d-936b-44a0-9f4a-07a6b8bc7457 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:05.994824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7d2a0-9ebe-4b74-9dc0-702fe4206e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:05.996325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7d2a0-9ebe-4b74-9dc0-702fe4206e93 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:05.996799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7d2a0-9ebe-4b74-9dc0-702fe4206e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:05.998045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7d2a0-9ebe-4b74-9dc0-702fe4206e93 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:05.999744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7d2a0-9ebe-4b74-9dc0-702fe4206e93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:06.002742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7d2a0-9ebe-4b74-9dc0-702fe4206e93 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:06.127682 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1263/2552] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:11:05 2022] POST /identity/v3/users => generated 289 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:11:06.129081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfa202-945a-4924-a736-437ec224d11b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:06.151113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfa202-945a-4924-a736-437ec224d11b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:06.171680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37904c64-f106-4e8f-aa27-f7b4d22d0452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:06.173018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37904c64-f106-4e8f-aa27-f7b4d22d0452 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:06.173290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37904c64-f106-4e8f-aa27-f7b4d22d0452 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:06.173569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37904c64-f106-4e8f-aa27-f7b4d22d0452 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:06.174314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37904c64-f106-4e8f-aa27-f7b4d22d0452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:06.183933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37904c64-f106-4e8f-aa27-f7b4d22d0452 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:06.209579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7d2a0-9ebe-4b74-9dc0-702fe4206e93 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:06.220384 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1290/2553] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:11:06.223965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7d2a0-9ebe-4b74-9dc0-702fe4206e93 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:06.229474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d3c17-241a-4279-bf5b-5a4216c8be7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:06.230172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d3c17-241a-4279-bf5b-5a4216c8be7d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:06.230627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d3c17-241a-4279-bf5b-5a4216c8be7d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:06.230909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d3c17-241a-4279-bf5b-5a4216c8be7d admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:06.232431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d3c17-241a-4279-bf5b-5a4216c8be7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:06.234757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d3c17-241a-4279-bf5b-5a4216c8be7d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:06.242551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:06.255356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37904c64-f106-4e8f-aa27-f7b4d22d0452 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:06.262406 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1264/2554] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:11:06.285118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37904c64-f106-4e8f-aa27-f7b4d22d0452 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:06.304438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edacb53-dddc-4ed7-8cb3-8ab4c5be4431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:06.305809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edacb53-dddc-4ed7-8cb3-8ab4c5be4431 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:06.306163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edacb53-dddc-4ed7-8cb3-8ab4c5be4431 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:06.306510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edacb53-dddc-4ed7-8cb3-8ab4c5be4431 admin admin] PATH_INFO: `/v3/projects/9c3a6b6327ce4612b5edc31c3dc6ea52/users/35a8e5b99bbf45c1b165b3ba09c62ea3/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:06.348602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edacb53-dddc-4ed7-8cb3-8ab4c5be4431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c3a6b6327ce4612b5edc31c3dc6ea52, user_id=35a8e5b99bbf45c1b165b3ba09c62ea3, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:06.360532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edacb53-dddc-4ed7-8cb3-8ab4c5be4431 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:06.488757 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1291/2555] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:11:06 2022] PUT /identity/v3/projects/9c3a6b6327ce4612b5edc31c3dc6ea52/users/35a8e5b99bbf45c1b165b3ba09c62ea3/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:11:06.501868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12674ebb-05e3-4415-a286-414417a09455 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:06.502729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12674ebb-05e3-4415-a286-414417a09455 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:06.502729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12674ebb-05e3-4415-a286-414417a09455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:06.597810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-12674ebb-05e3-4415-a286-414417a09455 None None] MFA Rules not processed for user `35a8e5b99bbf45c1b165b3ba09c62ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:06.599095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-12674ebb-05e3-4415-a286-414417a09455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:06.734068 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1265/2556] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:06.739308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edacb53-dddc-4ed7-8cb3-8ab4c5be4431 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:06.897228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edacb53-dddc-4ed7-8cb3-8ab4c5be4431 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:06.911180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b17e7-da93-45ec-ad93-4921fc9399fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:06.911875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b17e7-da93-45ec-ad93-4921fc9399fb admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:06.912156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b17e7-da93-45ec-ad93-4921fc9399fb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:06.912433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b17e7-da93-45ec-ad93-4921fc9399fb admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:06.913215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b17e7-da93-45ec-ad93-4921fc9399fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:06.916258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b17e7-da93-45ec-ad93-4921fc9399fb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:07.087177 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1292/2557] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:11:06 2022] POST /identity/v3/projects => generated 379 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:11:07.093778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12674ebb-05e3-4415-a286-414417a09455 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:07.110429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12674ebb-05e3-4415-a286-414417a09455 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:07.208650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467b6e0-357d-4b9a-9ae2-4c0df041a051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:07.209574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467b6e0-357d-4b9a-9ae2-4c0df041a051 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:07.210024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467b6e0-357d-4b9a-9ae2-4c0df041a051 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:07.210637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467b6e0-357d-4b9a-9ae2-4c0df041a051 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:07.211571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467b6e0-357d-4b9a-9ae2-4c0df041a051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:07.214714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467b6e0-357d-4b9a-9ae2-4c0df041a051 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:07.345918 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1266/2558] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:11:07 2022] POST /identity/v3/users => generated 296 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:11:07.350439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b17e7-da93-45ec-ad93-4921fc9399fb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:07.363137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b17e7-da93-45ec-ad93-4921fc9399fb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:07.369792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0494942-b988-400e-9878-8684b7eab981 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:07.370087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0494942-b988-400e-9878-8684b7eab981 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:07.372448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0494942-b988-400e-9878-8684b7eab981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:07.372713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde458b-fe1b-4627-8c2c-afc321963e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:07.376983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde458b-fe1b-4627-8c2c-afc321963e24 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:07.377523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde458b-fe1b-4627-8c2c-afc321963e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:07.378003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde458b-fe1b-4627-8c2c-afc321963e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:07.388386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde458b-fe1b-4627-8c2c-afc321963e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:07.399082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c0494942-b988-400e-9878-8684b7eab981 None None] MFA Rules not processed for user `6a69f9dee03d43beaafa966216b9e289`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:07.402149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c0494942-b988-400e-9878-8684b7eab981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:07.406976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde458b-fe1b-4627-8c2c-afc321963e24 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:07.420078 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1293/2559] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:11:07.425138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde458b-fe1b-4627-8c2c-afc321963e24 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:07.445981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde458b-fe1b-4627-8c2c-afc321963e24 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:07.456278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d1d41-7418-4ca6-a68e-ee2377ef35c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:07.471401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d1d41-7418-4ca6-a68e-ee2377ef35c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:07.472379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d1d41-7418-4ca6-a68e-ee2377ef35c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:07.473090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d1d41-7418-4ca6-a68e-ee2377ef35c3 admin admin] PATH_INFO: `/v3/projects/9817d45af8cc4abea73d95f38f8840e1/users/7fc749abe1074efab022ef35c729ee7f/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:07.504395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d1d41-7418-4ca6-a68e-ee2377ef35c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9817d45af8cc4abea73d95f38f8840e1, user_id=7fc749abe1074efab022ef35c729ee7f, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:07.509026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d1d41-7418-4ca6-a68e-ee2377ef35c3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:07.519367 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1267/2560] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:11:07.580311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:07.584245 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1294/2561] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:11:07 2022] PUT /identity/v3/projects/9817d45af8cc4abea73d95f38f8840e1/users/7fc749abe1074efab022ef35c729ee7f/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:11:07.588224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0494942-b988-400e-9878-8684b7eab981 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:07.610022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0494942-b988-400e-9878-8684b7eab981 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:07.721816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:07.726025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c87b81-7136-4010-8d97-c047e113d9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:07.726025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c87b81-7136-4010-8d97-c047e113d9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:07.727538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c87b81-7136-4010-8d97-c047e113d9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:07.727972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c87b81-7136-4010-8d97-c047e113d9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:07.729134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c87b81-7136-4010-8d97-c047e113d9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:07.732300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c87b81-7136-4010-8d97-c047e113d9a1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:07.756522 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1268/2562] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:11:07.756749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d1d41-7418-4ca6-a68e-ee2377ef35c3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:07.769256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d1d41-7418-4ca6-a68e-ee2377ef35c3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:07.779351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d0f63-04a0-484f-b32c-a0d0b8867b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:07.781301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d0f63-04a0-484f-b32c-a0d0b8867b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:07.781856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d0f63-04a0-484f-b32c-a0d0b8867b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:07.782361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d0f63-04a0-484f-b32c-a0d0b8867b9f admin admin] PATH_INFO: `/v3/projects/9817d45af8cc4abea73d95f38f8840e1/users/7fc749abe1074efab022ef35c729ee7f/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:07.785051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d0f63-04a0-484f-b32c-a0d0b8867b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9817d45af8cc4abea73d95f38f8840e1, user_id=7fc749abe1074efab022ef35c729ee7f, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:07.788617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d0f63-04a0-484f-b32c-a0d0b8867b9f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:07.817454 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1295/2563] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:11:07 2022] PUT /identity/v3/projects/9817d45af8cc4abea73d95f38f8840e1/users/7fc749abe1074efab022ef35c729ee7f/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:11:07.817926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a562d0-94da-4301-8e99-f4eefd2bfd84 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:07.833184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a562d0-94da-4301-8e99-f4eefd2bfd84 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:07.833760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a562d0-94da-4301-8e99-f4eefd2bfd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:07.900377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-54a562d0-94da-4301-8e99-f4eefd2bfd84 None None] MFA Rules not processed for user `7fc749abe1074efab022ef35c729ee7f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:07.909947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-54a562d0-94da-4301-8e99-f4eefd2bfd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:08.096280 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1269/2564] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:08.704974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:09.447432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d0f63-04a0-484f-b32c-a0d0b8867b9f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:09.452307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9a3d0f63-04a0-484f-b32c-a0d0b8867b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:09.826375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:09.866266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d0f63-04a0-484f-b32c-a0d0b8867b9f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:09.876827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f571a9-d0c9-489b-95ad-00024dd4b40f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:09.877747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f571a9-d0c9-489b-95ad-00024dd4b40f service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:09.878246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f571a9-d0c9-489b-95ad-00024dd4b40f service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:09.878716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f571a9-d0c9-489b-95ad-00024dd4b40f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:09.899524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f571a9-d0c9-489b-95ad-00024dd4b40f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:09.902268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f571a9-d0c9-489b-95ad-00024dd4b40f service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:09.924189 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1296/2565] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:11:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:11:10.493679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:11.221403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb4c43-a03a-4e29-b97d-bf087d7acd47 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:11.221871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb4c43-a03a-4e29-b97d-bf087d7acd47 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:11.222063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb4c43-a03a-4e29-b97d-bf087d7acd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:11.252834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1ceb4c43-a03a-4e29-b97d-bf087d7acd47 None None] MFA Rules not processed for user `abeb7020019d41a18de42956d706a011`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:11.254605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1ceb4c43-a03a-4e29-b97d-bf087d7acd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:11.379722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f571a9-d0c9-489b-95ad-00024dd4b40f service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:11.397582 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1270/2566] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:11.493063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f571a9-d0c9-489b-95ad-00024dd4b40f service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:11.501732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4980692-b831-46d7-8dab-9932c67b646d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:11.502834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4980692-b831-46d7-8dab-9932c67b646d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:11.503255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4980692-b831-46d7-8dab-9932c67b646d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:11.503598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4980692-b831-46d7-8dab-9932c67b646d admin admin] PATH_INFO: `/v3/users/35a8e5b99bbf45c1b165b3ba09c62ea3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:11.505415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4980692-b831-46d7-8dab-9932c67b646d admin admin] RBAC: Authorizing `identity:delete_user(user_id=35a8e5b99bbf45c1b165b3ba09c62ea3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:11.507657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4980692-b831-46d7-8dab-9932c67b646d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:11.830633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4980692-b831-46d7-8dab-9932c67b646d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35a8e5b99bbf45c1b165b3ba09c62ea3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:11.855535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4980692-b831-46d7-8dab-9932c67b646d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35a8e5b99bbf45c1b165b3ba09c62ea3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:11.963960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4980692-b831-46d7-8dab-9932c67b646d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35a8e5b99bbf45c1b165b3ba09c62ea3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:11.964953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4980692-b831-46d7-8dab-9932c67b646d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35a8e5b99bbf45c1b165b3ba09c62ea3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:11.987884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4980692-b831-46d7-8dab-9932c67b646d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35a8e5b99bbf45c1b165b3ba09c62ea3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:12.010173 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1297/2567] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:11:11 2022] DELETE /identity/v3/users/35a8e5b99bbf45c1b165b3ba09c62ea3 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:11:12.015473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e3eda-925f-4dfe-93fa-acb9bc60bbc4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:12.015769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e3eda-925f-4dfe-93fa-acb9bc60bbc4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:12.016050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e3eda-925f-4dfe-93fa-acb9bc60bbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:12.037931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4d7e3eda-925f-4dfe-93fa-acb9bc60bbc4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:12.039188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4d7e3eda-925f-4dfe-93fa-acb9bc60bbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:12.164480 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1271/2568] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:12.178684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4980692-b831-46d7-8dab-9932c67b646d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:12.180374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c4980692-b831-46d7-8dab-9932c67b646d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:12.394610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4980692-b831-46d7-8dab-9932c67b646d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:12.401982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caaa711-d966-4e37-a5c6-7efe4e4f7f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:12.403535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caaa711-d966-4e37-a5c6-7efe4e4f7f28 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:12.404305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caaa711-d966-4e37-a5c6-7efe4e4f7f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:12.405103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caaa711-d966-4e37-a5c6-7efe4e4f7f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:12.457296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caaa711-d966-4e37-a5c6-7efe4e4f7f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:12.466387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caaa711-d966-4e37-a5c6-7efe4e4f7f28 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:12.549533 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1298/2569] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:11:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:11:12.756323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:13.253406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:14.477476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:14.829926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37229d67-a2d4-48fa-96bd-e5a49f292bfb None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:14.831273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37229d67-a2d4-48fa-96bd-e5a49f292bfb None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:14.831970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37229d67-a2d4-48fa-96bd-e5a49f292bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:14.877368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caaa711-d966-4e37-a5c6-7efe4e4f7f28 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:14.880642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6caaa711-d966-4e37-a5c6-7efe4e4f7f28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:14.910216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caaa711-d966-4e37-a5c6-7efe4e4f7f28 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:14.931206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338780f-4805-4d9a-b535-aa3ca35bb5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:14.932107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338780f-4805-4d9a-b535-aa3ca35bb5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:14.932392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338780f-4805-4d9a-b535-aa3ca35bb5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:14.932670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338780f-4805-4d9a-b535-aa3ca35bb5d5 admin admin] PATH_INFO: `/v3/projects/9c3a6b6327ce4612b5edc31c3dc6ea52` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:14.936210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338780f-4805-4d9a-b535-aa3ca35bb5d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c3a6b6327ce4612b5edc31c3dc6ea52)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:14.941397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338780f-4805-4d9a-b535-aa3ca35bb5d5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:14.943528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-37229d67-a2d4-48fa-96bd-e5a49f292bfb None None] MFA Rules not processed for user `6dfd80a71b204625b5401e5249a0bbed`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:14.946043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-37229d67-a2d4-48fa-96bd-e5a49f292bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:15.114144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0338780f-4805-4d9a-b535-aa3ca35bb5d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c3a6b6327ce4612b5edc31c3dc6ea52', 'request_id': 'req-0338780f-4805-4d9a-b535-aa3ca35bb5d5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:15.132978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0338780f-4805-4d9a-b535-aa3ca35bb5d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c3a6b6327ce4612b5edc31c3dc6ea52', 'request_id': 'req-0338780f-4805-4d9a-b535-aa3ca35bb5d5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:15.149331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0338780f-4805-4d9a-b535-aa3ca35bb5d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c3a6b6327ce4612b5edc31c3dc6ea52', 'request_id': 'req-0338780f-4805-4d9a-b535-aa3ca35bb5d5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:15.185447 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1272/2570] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:15.186818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37229d67-a2d4-48fa-96bd-e5a49f292bfb None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:15.194813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-37229d67-a2d4-48fa-96bd-e5a49f292bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:15.226617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37229d67-a2d4-48fa-96bd-e5a49f292bfb None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:15.265611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0338780f-4805-4d9a-b535-aa3ca35bb5d5 admin admin] The token cache is being invalidate because project 9c3a6b6327ce4612b5edc31c3dc6ea52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:11:15.267308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0338780f-4805-4d9a-b535-aa3ca35bb5d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:15.267735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0338780f-4805-4d9a-b535-aa3ca35bb5d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:15.270967 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1299/2571] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:11:14 2022] DELETE /identity/v3/projects/9c3a6b6327ce4612b5edc31c3dc6ea52 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:11:15.272140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338780f-4805-4d9a-b535-aa3ca35bb5d5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:15.274022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0338780f-4805-4d9a-b535-aa3ca35bb5d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:15.383077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29af4a1-25dc-4fb2-b141-aa34c488e3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:15.383077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29af4a1-25dc-4fb2-b141-aa34c488e3cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:15.383077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29af4a1-25dc-4fb2-b141-aa34c488e3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:15.383077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29af4a1-25dc-4fb2-b141-aa34c488e3cd admin admin] PATH_INFO: `/v3/users/31756abdfccf43e0b33e33300a527f29` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:15.383535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29af4a1-25dc-4fb2-b141-aa34c488e3cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=31756abdfccf43e0b33e33300a527f29)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:15.384708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29af4a1-25dc-4fb2-b141-aa34c488e3cd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:15.478453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338780f-4805-4d9a-b535-aa3ca35bb5d5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:15.490764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c0e67-450c-4ea9-a865-9d1963f98198 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:15.493699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c0e67-450c-4ea9-a865-9d1963f98198 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:15.494272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c0e67-450c-4ea9-a865-9d1963f98198 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:15.494957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c0e67-450c-4ea9-a865-9d1963f98198 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:15.498248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6c2c0e67-450c-4ea9-a865-9d1963f98198 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:15.603712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c0e67-450c-4ea9-a865-9d1963f98198 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:15.606337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c0e67-450c-4ea9-a865-9d1963f98198 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:15.621477 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1300/2572] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:11:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:11:15.623547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c0e67-450c-4ea9-a865-9d1963f98198 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:15.625909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6c2c0e67-450c-4ea9-a865-9d1963f98198 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:15.663474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c0e67-450c-4ea9-a865-9d1963f98198 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:15.701399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a29af4a1-25dc-4fb2-b141-aa34c488e3cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31756abdfccf43e0b33e33300a527f29'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:15.702324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bf86f-9dd5-434f-99a9-1e8e72f3c5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:15.712854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bf86f-9dd5-434f-99a9-1e8e72f3c5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:15.715232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bf86f-9dd5-434f-99a9-1e8e72f3c5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:15.716460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bf86f-9dd5-434f-99a9-1e8e72f3c5c6 admin admin] PATH_INFO: `/v3/users/7fc749abe1074efab022ef35c729ee7f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:15.723599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403bf86f-9dd5-434f-99a9-1e8e72f3c5c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc749abe1074efab022ef35c729ee7f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:15.733088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403bf86f-9dd5-434f-99a9-1e8e72f3c5c6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:15.755731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a29af4a1-25dc-4fb2-b141-aa34c488e3cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31756abdfccf43e0b33e33300a527f29'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:15.864063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a29af4a1-25dc-4fb2-b141-aa34c488e3cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31756abdfccf43e0b33e33300a527f29'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:15.876376 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a29af4a1-25dc-4fb2-b141-aa34c488e3cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31756abdfccf43e0b33e33300a527f29'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:15.880907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a29af4a1-25dc-4fb2-b141-aa34c488e3cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31756abdfccf43e0b33e33300a527f29'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:15.893483 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1273/2573] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:11:15 2022] DELETE /identity/v3/users/31756abdfccf43e0b33e33300a527f29 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:11:15.967314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-403bf86f-9dd5-434f-99a9-1e8e72f3c5c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc749abe1074efab022ef35c729ee7f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:15.976591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-403bf86f-9dd5-434f-99a9-1e8e72f3c5c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc749abe1074efab022ef35c729ee7f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:15.995184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:16.105975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-403bf86f-9dd5-434f-99a9-1e8e72f3c5c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc749abe1074efab022ef35c729ee7f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:16.107607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-403bf86f-9dd5-434f-99a9-1e8e72f3c5c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc749abe1074efab022ef35c729ee7f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:16.139722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-403bf86f-9dd5-434f-99a9-1e8e72f3c5c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc749abe1074efab022ef35c729ee7f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:16.152509 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1301/2574] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:11:15 2022] DELETE /identity/v3/users/7fc749abe1074efab022ef35c729ee7f => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:11:16.442011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:17.847712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:17.922082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29af4a1-25dc-4fb2-b141-aa34c488e3cd admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:17.923975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a29af4a1-25dc-4fb2-b141-aa34c488e3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:18.026206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29af4a1-25dc-4fb2-b141-aa34c488e3cd admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:18.035979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bf86f-9dd5-434f-99a9-1e8e72f3c5c6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:18.037540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-403bf86f-9dd5-434f-99a9-1e8e72f3c5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:18.233224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc5b7f-a6a8-45ad-9efd-71adbdffb229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:18.235368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc5b7f-a6a8-45ad-9efd-71adbdffb229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:18.235848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc5b7f-a6a8-45ad-9efd-71adbdffb229 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:18.236467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc5b7f-a6a8-45ad-9efd-71adbdffb229 admin admin] PATH_INFO: `/v3/projects/e62d0d1cfd6b44bf8a0c0df282e585ad` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:18.238654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc5b7f-a6a8-45ad-9efd-71adbdffb229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e62d0d1cfd6b44bf8a0c0df282e585ad)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:18.244025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc5b7f-a6a8-45ad-9efd-71adbdffb229 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:18.300811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:18.357320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bf86f-9dd5-434f-99a9-1e8e72f3c5c6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:18.366478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42548df-2ac2-4541-8ac5-938676d4c886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:18.368352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42548df-2ac2-4541-8ac5-938676d4c886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:18.368848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42548df-2ac2-4541-8ac5-938676d4c886 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:18.369363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42548df-2ac2-4541-8ac5-938676d4c886 admin admin] PATH_INFO: `/v3/projects/9817d45af8cc4abea73d95f38f8840e1` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:18.371330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42548df-2ac2-4541-8ac5-938676d4c886 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9817d45af8cc4abea73d95f38f8840e1)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:18.373919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42548df-2ac2-4541-8ac5-938676d4c886 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:18.398321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1fcc5b7f-a6a8-45ad-9efd-71adbdffb229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e62d0d1cfd6b44bf8a0c0df282e585ad', 'request_id': 'req-1fcc5b7f-a6a8-45ad-9efd-71adbdffb229'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:18.415666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1fcc5b7f-a6a8-45ad-9efd-71adbdffb229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e62d0d1cfd6b44bf8a0c0df282e585ad', 'request_id': 'req-1fcc5b7f-a6a8-45ad-9efd-71adbdffb229'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:18.430579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1fcc5b7f-a6a8-45ad-9efd-71adbdffb229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e62d0d1cfd6b44bf8a0c0df282e585ad', 'request_id': 'req-1fcc5b7f-a6a8-45ad-9efd-71adbdffb229'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:18.547713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1fcc5b7f-a6a8-45ad-9efd-71adbdffb229 admin admin] The token cache is being invalidate because project e62d0d1cfd6b44bf8a0c0df282e585ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:11:18.548045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1fcc5b7f-a6a8-45ad-9efd-71adbdffb229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:18.549582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1fcc5b7f-a6a8-45ad-9efd-71adbdffb229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:18.551772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f42548df-2ac2-4541-8ac5-938676d4c886 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9817d45af8cc4abea73d95f38f8840e1', 'request_id': 'req-f42548df-2ac2-4541-8ac5-938676d4c886'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:18.553390 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1274/2575] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:11:17 2022] DELETE /identity/v3/projects/e62d0d1cfd6b44bf8a0c0df282e585ad => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:11:18.561525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d203f-c56f-4b9e-b57a-f439481b9313 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:18.563817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d203f-c56f-4b9e-b57a-f439481b9313 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:18.564114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d203f-c56f-4b9e-b57a-f439481b9313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:18.580551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f42548df-2ac2-4541-8ac5-938676d4c886 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9817d45af8cc4abea73d95f38f8840e1', 'request_id': 'req-f42548df-2ac2-4541-8ac5-938676d4c886'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:18.607400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f42548df-2ac2-4541-8ac5-938676d4c886 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9817d45af8cc4abea73d95f38f8840e1', 'request_id': 'req-f42548df-2ac2-4541-8ac5-938676d4c886'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:18.638399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-118d203f-c56f-4b9e-b57a-f439481b9313 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:18.643575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-118d203f-c56f-4b9e-b57a-f439481b9313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:18.764940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f42548df-2ac2-4541-8ac5-938676d4c886 admin admin] The token cache is being invalidate because project 9817d45af8cc4abea73d95f38f8840e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:11:18.765300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f42548df-2ac2-4541-8ac5-938676d4c886 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:18.776220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f42548df-2ac2-4541-8ac5-938676d4c886 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:18.783985 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1302/2576] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:11:18 2022] DELETE /identity/v3/projects/9817d45af8cc4abea73d95f38f8840e1 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:11:18.792553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cee385-6f0e-4e28-bd85-00ec3509a436 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:18.794179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cee385-6f0e-4e28-bd85-00ec3509a436 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:18.794474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cee385-6f0e-4e28-bd85-00ec3509a436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:18.833071 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1275/2577] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:18.839241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beac0bf-8f7e-4fdb-848c-6bdbf3e57245 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:18.839465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beac0bf-8f7e-4fdb-848c-6bdbf3e57245 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:18.841292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beac0bf-8f7e-4fdb-848c-6bdbf3e57245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:18.871168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-96cee385-6f0e-4e28-bd85-00ec3509a436 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:18.872496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-96cee385-6f0e-4e28-bd85-00ec3509a436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:18.886611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3beac0bf-8f7e-4fdb-848c-6bdbf3e57245 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:18.889526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3beac0bf-8f7e-4fdb-848c-6bdbf3e57245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:18.908784 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1303/2578] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:18.918067 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1276/2579] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:11:18.923693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beac0bf-8f7e-4fdb-848c-6bdbf3e57245 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:18.930289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e45c8e-c9f1-4d04-97fd-7260679d230a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:18.930687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e45c8e-c9f1-4d04-97fd-7260679d230a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:18.931782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e45c8e-c9f1-4d04-97fd-7260679d230a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:18.945422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beac0bf-8f7e-4fdb-848c-6bdbf3e57245 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:18.957198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024bd2b-91e3-4ca8-bc57-a85912d617ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:18.957878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024bd2b-91e3-4ca8-bc57-a85912d617ae admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:18.958159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024bd2b-91e3-4ca8-bc57-a85912d617ae admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:18.958431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024bd2b-91e3-4ca8-bc57-a85912d617ae admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:18.962191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-47e45c8e-c9f1-4d04-97fd-7260679d230a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:18.962595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024bd2b-91e3-4ca8-bc57-a85912d617ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:11:18.962950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024bd2b-91e3-4ca8-bc57-a85912d617ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:18.964728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024bd2b-91e3-4ca8-bc57-a85912d617ae admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:18.966264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-47e45c8e-c9f1-4d04-97fd-7260679d230a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:18.982333 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1304/2580] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:18.994770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e45c8e-c9f1-4d04-97fd-7260679d230a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:19.008154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e45c8e-c9f1-4d04-97fd-7260679d230a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:19.014501 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1277/2581] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:11:19.018420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024bd2b-91e3-4ca8-bc57-a85912d617ae admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:19.021010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6628320-5499-4a60-b725-da3f70486012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:19.021570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6628320-5499-4a60-b725-da3f70486012 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:19.023294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6628320-5499-4a60-b725-da3f70486012 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:19.023689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6628320-5499-4a60-b725-da3f70486012 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:19.024565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6628320-5499-4a60-b725-da3f70486012 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:11:19.026242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6628320-5499-4a60-b725-da3f70486012 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:19.029700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6628320-5499-4a60-b725-da3f70486012 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:19.041637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024bd2b-91e3-4ca8-bc57-a85912d617ae admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:19.053712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00748ae-f8a3-4556-9180-faa8d1878d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:19.054389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00748ae-f8a3-4556-9180-faa8d1878d99 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:19.054791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00748ae-f8a3-4556-9180-faa8d1878d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:19.054928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00748ae-f8a3-4556-9180-faa8d1878d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:19.060658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00748ae-f8a3-4556-9180-faa8d1878d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:19.061904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00748ae-f8a3-4556-9180-faa8d1878d99 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:19.068450 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1305/2582] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:11:19.073000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6628320-5499-4a60-b725-da3f70486012 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:19.100291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6628320-5499-4a60-b725-da3f70486012 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:19.116323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581f101-51e9-4c82-8292-bcd80f2bf2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:19.120095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581f101-51e9-4c82-8292-bcd80f2bf2bb admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:19.120522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581f101-51e9-4c82-8292-bcd80f2bf2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:19.123426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581f101-51e9-4c82-8292-bcd80f2bf2bb admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:19.124345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581f101-51e9-4c82-8292-bcd80f2bf2bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:19.127037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581f101-51e9-4c82-8292-bcd80f2bf2bb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:19.242075 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1278/2583] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:11:19 2022] POST /identity/v3/projects => generated 363 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:11:19.246354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00748ae-f8a3-4556-9180-faa8d1878d99 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:19.301288 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1306/2584] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:11:19 2022] POST /identity/v3/projects => generated 397 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:11:19.302856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581f101-51e9-4c82-8292-bcd80f2bf2bb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:19.416354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00748ae-f8a3-4556-9180-faa8d1878d99 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:19.454960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581f101-51e9-4c82-8292-bcd80f2bf2bb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:19.461818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e140036-fa31-4e24-8a4d-b4e15e99e6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:19.464972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e140036-fa31-4e24-8a4d-b4e15e99e6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:19.465910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:19.466653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e140036-fa31-4e24-8a4d-b4e15e99e6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:19.467037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e140036-fa31-4e24-8a4d-b4e15e99e6b9 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:19.467827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e140036-fa31-4e24-8a4d-b4e15e99e6b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:19.470122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e140036-fa31-4e24-8a4d-b4e15e99e6b9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:19.499962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:19.560450 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1307/2585] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:11:19 2022] POST /identity/v3/users => generated 299 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:11:19.565974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e140036-fa31-4e24-8a4d-b4e15e99e6b9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:19.585257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6819570-4772-4774-b4a1-048b13ce0a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:19.586116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6819570-4772-4774-b4a1-048b13ce0a41 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:19.586409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6819570-4772-4774-b4a1-048b13ce0a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:19.586690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6819570-4772-4774-b4a1-048b13ce0a41 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:19.587593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6819570-4772-4774-b4a1-048b13ce0a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:19.589440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6819570-4772-4774-b4a1-048b13ce0a41 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:19.608973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e140036-fa31-4e24-8a4d-b4e15e99e6b9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:19.625720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b970d-d29f-4ed1-be7d-483bc21c3184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:19.633360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b970d-d29f-4ed1-be7d-483bc21c3184 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:19.633360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b970d-d29f-4ed1-be7d-483bc21c3184 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:19.633360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b970d-d29f-4ed1-be7d-483bc21c3184 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:19.633360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b970d-d29f-4ed1-be7d-483bc21c3184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:19.633360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b970d-d29f-4ed1-be7d-483bc21c3184 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:19.651397 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1308/2586] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:11:19.654530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b970d-d29f-4ed1-be7d-483bc21c3184 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:19.668648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b970d-d29f-4ed1-be7d-483bc21c3184 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:19.678485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162b2c6-9811-40e4-b10a-ac3dda26487d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:19.679294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162b2c6-9811-40e4-b10a-ac3dda26487d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:19.679668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162b2c6-9811-40e4-b10a-ac3dda26487d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:19.680069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162b2c6-9811-40e4-b10a-ac3dda26487d admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:19.681784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162b2c6-9811-40e4-b10a-ac3dda26487d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:19.683365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162b2c6-9811-40e4-b10a-ac3dda26487d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:19.702246 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1309/2587] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:11:19.703402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162b2c6-9811-40e4-b10a-ac3dda26487d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:19.706856 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1279/2588] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:11:19 2022] POST /identity/v3/users => generated 282 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:11:19.710701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6819570-4772-4774-b4a1-048b13ce0a41 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:19.714923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162b2c6-9811-40e4-b10a-ac3dda26487d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:19.724488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f517cf4-dcbd-4199-b740-accef9942903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:19.725921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f517cf4-dcbd-4199-b740-accef9942903 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:19.726313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f517cf4-dcbd-4199-b740-accef9942903 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:19.726716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f517cf4-dcbd-4199-b740-accef9942903 admin admin] PATH_INFO: `/v3/projects/cda86413e74b4c1e8e09bd4df4926664/users/2dfcad8d2b57481bb33aa8f5d7483c51/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:19.741053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6819570-4772-4774-b4a1-048b13ce0a41 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:19.759317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f395e-8c98-40e7-84a3-21f01ec906f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:19.759770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f517cf4-dcbd-4199-b740-accef9942903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda86413e74b4c1e8e09bd4df4926664, user_id=2dfcad8d2b57481bb33aa8f5d7483c51, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:19.760681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f395e-8c98-40e7-84a3-21f01ec906f5 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:19.761125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f395e-8c98-40e7-84a3-21f01ec906f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:19.761639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f395e-8c98-40e7-84a3-21f01ec906f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:19.763152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f395e-8c98-40e7-84a3-21f01ec906f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:19.765383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f395e-8c98-40e7-84a3-21f01ec906f5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:19.766556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f517cf4-dcbd-4199-b740-accef9942903 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:19.798462 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1280/2589] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:11:19.804076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f395e-8c98-40e7-84a3-21f01ec906f5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:19.828773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f395e-8c98-40e7-84a3-21f01ec906f5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:19.846859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133afc0e-1dc2-4401-b63b-31d4f32c062c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:19.847933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133afc0e-1dc2-4401-b63b-31d4f32c062c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:19.849195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133afc0e-1dc2-4401-b63b-31d4f32c062c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:19.850163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133afc0e-1dc2-4401-b63b-31d4f32c062c admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:19.852498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133afc0e-1dc2-4401-b63b-31d4f32c062c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:19.859687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133afc0e-1dc2-4401-b63b-31d4f32c062c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:19.866416 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1310/2590] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:11:19 2022] PUT /identity/v3/projects/cda86413e74b4c1e8e09bd4df4926664/users/2dfcad8d2b57481bb33aa8f5d7483c51/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:11:19.873887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbc645-6700-4aa5-9e5f-0196768612fb None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:19.879899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbc645-6700-4aa5-9e5f-0196768612fb None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:19.879899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbc645-6700-4aa5-9e5f-0196768612fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:19.916815 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1281/2591] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:11:19.927058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133afc0e-1dc2-4401-b63b-31d4f32c062c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:19.935252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133afc0e-1dc2-4401-b63b-31d4f32c062c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:19.961551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-01dbc645-6700-4aa5-9e5f-0196768612fb None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:19.965347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-01dbc645-6700-4aa5-9e5f-0196768612fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:20.055825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8ad61-86e7-4689-a1fc-89a852b76019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:20.056774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8ad61-86e7-4689-a1fc-89a852b76019 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:20.057046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8ad61-86e7-4689-a1fc-89a852b76019 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:20.057495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8ad61-86e7-4689-a1fc-89a852b76019 admin admin] PATH_INFO: `/v3/projects/fb4ff5d7e42940cdb7be71dadd895ee4/users/034c11cc3f174c6fb44c8d64e55cf8b9/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:20.109880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8ad61-86e7-4689-a1fc-89a852b76019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb4ff5d7e42940cdb7be71dadd895ee4, user_id=034c11cc3f174c6fb44c8d64e55cf8b9, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:20.117120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8ad61-86e7-4689-a1fc-89a852b76019 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:20.167190 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1311/2592] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:20.193689 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1282/2593] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:11:19 2022] PUT /identity/v3/projects/fb4ff5d7e42940cdb7be71dadd895ee4/users/034c11cc3f174c6fb44c8d64e55cf8b9/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:11:20.196728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbc645-6700-4aa5-9e5f-0196768612fb None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:20.197069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d32754-6851-49d4-be82-4b19e18b8121 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:20.197371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d32754-6851-49d4-be82-4b19e18b8121 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:20.197657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d32754-6851-49d4-be82-4b19e18b8121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:20.200003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-01dbc645-6700-4aa5-9e5f-0196768612fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:20.232630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f0d32754-6851-49d4-be82-4b19e18b8121 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:20.237062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f0d32754-6851-49d4-be82-4b19e18b8121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:20.326828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbc645-6700-4aa5-9e5f-0196768612fb None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:20.431731 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1283/2594] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:20.460714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:20.464351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770e724-5622-49a5-b396-5954382f4003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:20.465922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770e724-5622-49a5-b396-5954382f4003 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:20.467514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770e724-5622-49a5-b396-5954382f4003 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:20.469121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770e724-5622-49a5-b396-5954382f4003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:20.475505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d32754-6851-49d4-be82-4b19e18b8121 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:20.477078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f0d32754-6851-49d4-be82-4b19e18b8121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:20.485549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770e724-5622-49a5-b396-5954382f4003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:20.487942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770e724-5622-49a5-b396-5954382f4003 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:20.504305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d32754-6851-49d4-be82-4b19e18b8121 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:20.508472 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1312/2595] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:11:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:11:20.512832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516a20b-159e-4679-89a9-cb0c71ddcb9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:20.514043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516a20b-159e-4679-89a9-cb0c71ddcb9d service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:20.514458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516a20b-159e-4679-89a9-cb0c71ddcb9d service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:20.514879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516a20b-159e-4679-89a9-cb0c71ddcb9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:20.529655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a516a20b-159e-4679-89a9-cb0c71ddcb9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:20.531825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a516a20b-159e-4679-89a9-cb0c71ddcb9d service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:20.547675 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1284/2596] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:11:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:11:21.339732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:22.298716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:23.347126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792aa2f-57db-4f78-9d22-ee7c04e92080 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:23.348051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792aa2f-57db-4f78-9d22-ee7c04e92080 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:23.348051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792aa2f-57db-4f78-9d22-ee7c04e92080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:23.421923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a792aa2f-57db-4f78-9d22-ee7c04e92080 None None] MFA Rules not processed for user `52281b3989a04ca2a50b0bc93bf783f0`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:23.429444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a792aa2f-57db-4f78-9d22-ee7c04e92080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:23.568976 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1313/2597] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:23.806005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:24.968614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:27.095932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:28.060747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:29.779118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:29.818165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:30.128147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896a739-1676-4b61-9465-b81eb46a6807 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:30.128780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896a739-1676-4b61-9465-b81eb46a6807 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:30.129217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896a739-1676-4b61-9465-b81eb46a6807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:30.159595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e896a739-1676-4b61-9465-b81eb46a6807 None None] MFA Rules not processed for user `578b87f863b34f57a571f7e56d44f118`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:30.161490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e896a739-1676-4b61-9465-b81eb46a6807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:30.292313 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1285/2598] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:30.624972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:31.321549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:31.550392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf41ac8-2fe1-425e-b82d-3218c3b75c2b None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:31.550939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf41ac8-2fe1-425e-b82d-3218c3b75c2b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:31.550939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf41ac8-2fe1-425e-b82d-3218c3b75c2b None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:31.552318 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1314/2599] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:11:31.563233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539878d6-61fd-4e59-992b-2b424d03c439 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:31.563532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539878d6-61fd-4e59-992b-2b424d03c439 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:31.563793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539878d6-61fd-4e59-992b-2b424d03c439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:31.586486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-539878d6-61fd-4e59-992b-2b424d03c439 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:31.587839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-539878d6-61fd-4e59-992b-2b424d03c439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:31.712207 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1286/2600] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:31.748110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf41ac8-2fe1-425e-b82d-3218c3b75c2b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:31.750556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ebf41ac8-2fe1-425e-b82d-3218c3b75c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:31.772805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf41ac8-2fe1-425e-b82d-3218c3b75c2b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:31.780459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddc5c8-5548-412b-a246-308c745a1bd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:31.781325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddc5c8-5548-412b-a246-308c745a1bd6 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:31.781776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddc5c8-5548-412b-a246-308c745a1bd6 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:31.782265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddc5c8-5548-412b-a246-308c745a1bd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:31.793442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddc5c8-5548-412b-a246-308c745a1bd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:31.795401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddc5c8-5548-412b-a246-308c745a1bd6 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:31.804842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:31.820613 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1315/2601] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:11:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:11:32.957128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:33.681860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:35.498878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:35.869127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:37.224321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:37.625266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:38.081466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f01f0-a932-4f06-8bab-8b290b4e8d5a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:38.082345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f01f0-a932-4f06-8bab-8b290b4e8d5a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:38.083453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f01f0-a932-4f06-8bab-8b290b4e8d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:38.174664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b40f01f0-a932-4f06-8bab-8b290b4e8d5a None None] MFA Rules not processed for user `2dfcad8d2b57481bb33aa8f5d7483c51`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:38.176718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b40f01f0-a932-4f06-8bab-8b290b4e8d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:38.337230 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1287/2602] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:38.339126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a363c6f-f468-48d2-ab92-df71ef58b304 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:38.339904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a363c6f-f468-48d2-ab92-df71ef58b304 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:38.339904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a363c6f-f468-48d2-ab92-df71ef58b304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:38.360208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2a363c6f-f468-48d2-ab92-df71ef58b304 None None] MFA Rules not processed for user `2dfcad8d2b57481bb33aa8f5d7483c51`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:38.361440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2a363c6f-f468-48d2-ab92-df71ef58b304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:38.369206 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1316/2603] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:11:38.572693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:38.769427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:39.206015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f01f0-a932-4f06-8bab-8b290b4e8d5a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:39.206015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b40f01f0-a932-4f06-8bab-8b290b4e8d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:39.206015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f01f0-a932-4f06-8bab-8b290b4e8d5a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:39.208858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517bed5-01d5-4b9d-a5f5-2c18f989c3f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:39.208858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517bed5-01d5-4b9d-a5f5-2c18f989c3f4 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:39.208858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517bed5-01d5-4b9d-a5f5-2c18f989c3f4 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:39.208858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517bed5-01d5-4b9d-a5f5-2c18f989c3f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:39.209681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4997a4-c1a4-40c7-886e-a1e47abc9d9e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:39.209681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4997a4-c1a4-40c7-886e-a1e47abc9d9e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:39.209681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4997a4-c1a4-40c7-886e-a1e47abc9d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:39.211405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517bed5-01d5-4b9d-a5f5-2c18f989c3f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:39.211405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517bed5-01d5-4b9d-a5f5-2c18f989c3f4 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:39.211405 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1288/2604] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:11:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:11:39.211405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:39.212262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3f4997a4-c1a4-40c7-886e-a1e47abc9d9e None None] MFA Rules not processed for user `034c11cc3f174c6fb44c8d64e55cf8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:39.212262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3f4997a4-c1a4-40c7-886e-a1e47abc9d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:39.351135 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1317/2605] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:39 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:39.442501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:39.893443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:40.223804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:40.350933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517bed5-01d5-4b9d-a5f5-2c18f989c3f4 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:40.352695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e517bed5-01d5-4b9d-a5f5-2c18f989c3f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:40.377542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517bed5-01d5-4b9d-a5f5-2c18f989c3f4 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:40.396056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bff4f5-c5d9-4dc9-8ec5-e731d3253b72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:40.403138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bff4f5-c5d9-4dc9-8ec5-e731d3253b72 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:40.403138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bff4f5-c5d9-4dc9-8ec5-e731d3253b72 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:40.403138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bff4f5-c5d9-4dc9-8ec5-e731d3253b72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:40.423741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bff4f5-c5d9-4dc9-8ec5-e731d3253b72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:40.426798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bff4f5-c5d9-4dc9-8ec5-e731d3253b72 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:40.460179 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1289/2606] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:11:40 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:11:40.481261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:41.465156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:42.106857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:42.780255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:43.550057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:44.812876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:45.854955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:46.654022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:46.899179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:48.329138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:48.606887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:49.034964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:49.058319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:49.306629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b41ba-2ea8-4a5e-bc46-7b1acd15f003 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:49.307216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b41ba-2ea8-4a5e-bc46-7b1acd15f003 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:49.308124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b41ba-2ea8-4a5e-bc46-7b1acd15f003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:49.327868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1a6b41ba-2ea8-4a5e-bc46-7b1acd15f003 None None] MFA Rules not processed for user `034c11cc3f174c6fb44c8d64e55cf8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:49.329119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1a6b41ba-2ea8-4a5e-bc46-7b1acd15f003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:49.336913 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1318/2607] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:49 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:49.967080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:50.172516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:50.967500 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:51.515343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:51.648023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:52.864228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:53.195283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:54.660316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bff4f5-c5d9-4dc9-8ec5-e731d3253b72 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:54.667401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-74bff4f5-c5d9-4dc9-8ec5-e731d3253b72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:54.680519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bff4f5-c5d9-4dc9-8ec5-e731d3253b72 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:54.686463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73890d8-b8db-4673-8405-3c4f360b4f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:54.687526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73890d8-b8db-4673-8405-3c4f360b4f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:54.687903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73890d8-b8db-4673-8405-3c4f360b4f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:54.688306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73890d8-b8db-4673-8405-3c4f360b4f9b admin admin] PATH_INFO: `/v3/users/ef9cbce2b2e64665b7f50767342dcb46` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:54.689640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73890d8-b8db-4673-8405-3c4f360b4f9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef9cbce2b2e64665b7f50767342dcb46)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:54.691948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73890d8-b8db-4673-8405-3c4f360b4f9b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:54.907813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e73890d8-b8db-4673-8405-3c4f360b4f9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef9cbce2b2e64665b7f50767342dcb46'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:54.930224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e73890d8-b8db-4673-8405-3c4f360b4f9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef9cbce2b2e64665b7f50767342dcb46'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:55.046964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e73890d8-b8db-4673-8405-3c4f360b4f9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef9cbce2b2e64665b7f50767342dcb46'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:55.059434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e73890d8-b8db-4673-8405-3c4f360b4f9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef9cbce2b2e64665b7f50767342dcb46'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:55.060399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e73890d8-b8db-4673-8405-3c4f360b4f9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef9cbce2b2e64665b7f50767342dcb46'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:55.087329 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1290/2608] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:11:54 2022] DELETE /identity/v3/users/ef9cbce2b2e64665b7f50767342dcb46 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:11:55.528658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b41ba-2ea8-4a5e-bc46-7b1acd15f003 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:55.543194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b41ba-2ea8-4a5e-bc46-7b1acd15f003 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:55.637579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e0b1f-4501-41b6-877f-f0178cb31636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:55.639503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e0b1f-4501-41b6-877f-f0178cb31636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:55.639805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e0b1f-4501-41b6-877f-f0178cb31636 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:55.640081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e0b1f-4501-41b6-877f-f0178cb31636 admin admin] PATH_INFO: `/v3/projects/d0ee02e4c8b448f2b77798ae504129b9` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:55.641708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e0b1f-4501-41b6-877f-f0178cb31636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0ee02e4c8b448f2b77798ae504129b9)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:55.644302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e0b1f-4501-41b6-877f-f0178cb31636 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:55.862739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2c8e0b1f-4501-41b6-877f-f0178cb31636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0ee02e4c8b448f2b77798ae504129b9', 'request_id': 'req-2c8e0b1f-4501-41b6-877f-f0178cb31636'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:55.869326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2c8e0b1f-4501-41b6-877f-f0178cb31636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0ee02e4c8b448f2b77798ae504129b9', 'request_id': 'req-2c8e0b1f-4501-41b6-877f-f0178cb31636'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:55.876822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2c8e0b1f-4501-41b6-877f-f0178cb31636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0ee02e4c8b448f2b77798ae504129b9', 'request_id': 'req-2c8e0b1f-4501-41b6-877f-f0178cb31636'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:55.948337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2c8e0b1f-4501-41b6-877f-f0178cb31636 admin admin] The token cache is being invalidate because project d0ee02e4c8b448f2b77798ae504129b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:11:55.952742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2c8e0b1f-4501-41b6-877f-f0178cb31636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:55.952742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2c8e0b1f-4501-41b6-877f-f0178cb31636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:55.952742 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1319/2609] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:11:55 2022] DELETE /identity/v3/projects/d0ee02e4c8b448f2b77798ae504129b9 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:11:55.955648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73890d8-b8db-4673-8405-3c4f360b4f9b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:55.957107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e73890d8-b8db-4673-8405-3c4f360b4f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:55.972415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73890d8-b8db-4673-8405-3c4f360b4f9b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:56.054298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343db52-90a3-4a8d-b9b2-fab1ce4b9805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:56.055302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343db52-90a3-4a8d-b9b2-fab1ce4b9805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:56.055731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343db52-90a3-4a8d-b9b2-fab1ce4b9805 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:56.056016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343db52-90a3-4a8d-b9b2-fab1ce4b9805 admin admin] PATH_INFO: `/v3/users/497fdecb763d4d038580caf3c1c8ae01` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:56.058494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343db52-90a3-4a8d-b9b2-fab1ce4b9805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=497fdecb763d4d038580caf3c1c8ae01)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:56.060953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343db52-90a3-4a8d-b9b2-fab1ce4b9805 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:56.247575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:56.286287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6343db52-90a3-4a8d-b9b2-fab1ce4b9805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '497fdecb763d4d038580caf3c1c8ae01'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:56.301258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6343db52-90a3-4a8d-b9b2-fab1ce4b9805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '497fdecb763d4d038580caf3c1c8ae01'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:56.377613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6343db52-90a3-4a8d-b9b2-fab1ce4b9805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '497fdecb763d4d038580caf3c1c8ae01'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:56.386886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6343db52-90a3-4a8d-b9b2-fab1ce4b9805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '497fdecb763d4d038580caf3c1c8ae01'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:56.388144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6343db52-90a3-4a8d-b9b2-fab1ce4b9805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '497fdecb763d4d038580caf3c1c8ae01'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:56.395330 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1291/2610] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:11:55 2022] DELETE /identity/v3/users/497fdecb763d4d038580caf3c1c8ae01 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:11:56.481705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:56.877172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e0b1f-4501-41b6-877f-f0178cb31636 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:56.879593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2c8e0b1f-4501-41b6-877f-f0178cb31636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:56.898993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e0b1f-4501-41b6-877f-f0178cb31636 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:57.011786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf12133-9993-4b81-a8b0-32c9aa2bfbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:57.015509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf12133-9993-4b81-a8b0-32c9aa2bfbef admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:57.016312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf12133-9993-4b81-a8b0-32c9aa2bfbef admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:57.016605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf12133-9993-4b81-a8b0-32c9aa2bfbef admin admin] PATH_INFO: `/v3/projects/04682771a847412fb31d7e6758a95a9a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:57.018180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf12133-9993-4b81-a8b0-32c9aa2bfbef admin admin] RBAC: Authorizing `identity:delete_project(project_id=04682771a847412fb31d7e6758a95a9a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:57.020329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf12133-9993-4b81-a8b0-32c9aa2bfbef admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:57.179745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bbf12133-9993-4b81-a8b0-32c9aa2bfbef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04682771a847412fb31d7e6758a95a9a', 'request_id': 'req-bbf12133-9993-4b81-a8b0-32c9aa2bfbef'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:57.194261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bbf12133-9993-4b81-a8b0-32c9aa2bfbef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04682771a847412fb31d7e6758a95a9a', 'request_id': 'req-bbf12133-9993-4b81-a8b0-32c9aa2bfbef'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:57.200478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bbf12133-9993-4b81-a8b0-32c9aa2bfbef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04682771a847412fb31d7e6758a95a9a', 'request_id': 'req-bbf12133-9993-4b81-a8b0-32c9aa2bfbef'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:57.286432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bbf12133-9993-4b81-a8b0-32c9aa2bfbef admin admin] The token cache is being invalidate because project 04682771a847412fb31d7e6758a95a9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:11:57.286792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bbf12133-9993-4b81-a8b0-32c9aa2bfbef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:57.287589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bbf12133-9993-4b81-a8b0-32c9aa2bfbef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:11:57.293744 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1320/2611] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:11:56 2022] DELETE /identity/v3/projects/04682771a847412fb31d7e6758a95a9a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:11:57.295851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678e5f5-08b6-4958-92f5-dfc2f93a8b64 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:57.296681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678e5f5-08b6-4958-92f5-dfc2f93a8b64 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:57.296959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678e5f5-08b6-4958-92f5-dfc2f93a8b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:57.318194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f678e5f5-08b6-4958-92f5-dfc2f93a8b64 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:57.322868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f678e5f5-08b6-4958-92f5-dfc2f93a8b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:57.423553 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1292/2612] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:57.430416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3b236-f392-4f10-a0ac-16cb6981ecea None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:57.430736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3b236-f392-4f10-a0ac-16cb6981ecea None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:57.431497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3b236-f392-4f10-a0ac-16cb6981ecea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:57.457819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-58f3b236-f392-4f10-a0ac-16cb6981ecea None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:57.459028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-58f3b236-f392-4f10-a0ac-16cb6981ecea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:57.469928 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1321/2613] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:57.474212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678e5f5-08b6-4958-92f5-dfc2f93a8b64 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:57.488614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678e5f5-08b6-4958-92f5-dfc2f93a8b64 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:57.494098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65181bb1-70d0-4d7c-aa52-0479791a7b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:57.495690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65181bb1-70d0-4d7c-aa52-0479791a7b87 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:57.496338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65181bb1-70d0-4d7c-aa52-0479791a7b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:57.496812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65181bb1-70d0-4d7c-aa52-0479791a7b87 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:57.497718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65181bb1-70d0-4d7c-aa52-0479791a7b87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:11:57.498040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65181bb1-70d0-4d7c-aa52-0479791a7b87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:57.499844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65181bb1-70d0-4d7c-aa52-0479791a7b87 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:57.514091 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1293/2614] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:11:57.518972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3b236-f392-4f10-a0ac-16cb6981ecea None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:57.529383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3b236-f392-4f10-a0ac-16cb6981ecea None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:57.534337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381a28c-681b-4e1f-b371-8a1e478dfd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:57.535060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381a28c-681b-4e1f-b371-8a1e478dfd7e admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:57.535344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381a28c-681b-4e1f-b371-8a1e478dfd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:57.536162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381a28c-681b-4e1f-b371-8a1e478dfd7e admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:57.536416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381a28c-681b-4e1f-b371-8a1e478dfd7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:57.544675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381a28c-681b-4e1f-b371-8a1e478dfd7e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:57.706619 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1322/2615] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:11:57 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:11:57.712253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65181bb1-70d0-4d7c-aa52-0479791a7b87 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:57.729276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65181bb1-70d0-4d7c-aa52-0479791a7b87 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:57.821670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccd12f-f083-4261-bec8-8ab3e213b678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:57.822613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccd12f-f083-4261-bec8-8ab3e213b678 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:57.824521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccd12f-f083-4261-bec8-8ab3e213b678 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:57.824958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccd12f-f083-4261-bec8-8ab3e213b678 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:57.825814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccd12f-f083-4261-bec8-8ab3e213b678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:57.828303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccd12f-f083-4261-bec8-8ab3e213b678 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:57.977087 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1294/2616] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:11:57 2022] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:11:57.978556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381a28c-681b-4e1f-b371-8a1e478dfd7e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:57.993632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381a28c-681b-4e1f-b371-8a1e478dfd7e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:58.005128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61686d20-68a9-490b-b6f2-b2c9ef29538a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:58.006247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61686d20-68a9-490b-b6f2-b2c9ef29538a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:58.006753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61686d20-68a9-490b-b6f2-b2c9ef29538a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:58.007297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61686d20-68a9-490b-b6f2-b2c9ef29538a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:58.008331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61686d20-68a9-490b-b6f2-b2c9ef29538a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:58.010718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61686d20-68a9-490b-b6f2-b2c9ef29538a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:58.027832 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1323/2617] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:11:58.028550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccd12f-f083-4261-bec8-8ab3e213b678 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:58.041306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccd12f-f083-4261-bec8-8ab3e213b678 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:58.060963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12e709-e359-4c7f-bd45-8c8d5b5dc535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:58.061750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12e709-e359-4c7f-bd45-8c8d5b5dc535 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:58.062035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12e709-e359-4c7f-bd45-8c8d5b5dc535 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:58.062313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12e709-e359-4c7f-bd45-8c8d5b5dc535 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:58.063105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12e709-e359-4c7f-bd45-8c8d5b5dc535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:58.064737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12e709-e359-4c7f-bd45-8c8d5b5dc535 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:58.095176 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1295/2618] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:11:58.096641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61686d20-68a9-490b-b6f2-b2c9ef29538a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:58.114176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61686d20-68a9-490b-b6f2-b2c9ef29538a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:58.125967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bcd66-b5e2-44b7-9f9c-6e49d84fbd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:58.125967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bcd66-b5e2-44b7-9f9c-6e49d84fbd95 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:58.126287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bcd66-b5e2-44b7-9f9c-6e49d84fbd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:58.126526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bcd66-b5e2-44b7-9f9c-6e49d84fbd95 admin admin] PATH_INFO: `/v3/projects/7d2b583c48254e17a8082f6467f2ae6d/users/56d4bbcdebc24a34a814d7f6e72fbcfd/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:58.164256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bcd66-b5e2-44b7-9f9c-6e49d84fbd95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2b583c48254e17a8082f6467f2ae6d, user_id=56d4bbcdebc24a34a814d7f6e72fbcfd, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:58.168676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bcd66-b5e2-44b7-9f9c-6e49d84fbd95 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:58.222426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:58.277268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e347c-1e77-4ac5-9278-b02c61a68aec None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:58.277981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e347c-1e77-4ac5-9278-b02c61a68aec None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:58.278457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e347c-1e77-4ac5-9278-b02c61a68aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:58.282297 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1324/2619] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:11:58 2022] PUT /identity/v3/projects/7d2b583c48254e17a8082f6467f2ae6d/users/56d4bbcdebc24a34a814d7f6e72fbcfd/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:11:58.300186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec7e6a-ffb0-46bd-b8e5-862e6213b16b None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:58.300878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec7e6a-ffb0-46bd-b8e5-862e6213b16b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:58.302131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec7e6a-ffb0-46bd-b8e5-862e6213b16b None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:58.303122 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1325/2620] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:11:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 21:11:58.309252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c5f61-7a0c-4abf-a5ce-5129202b9f9a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:58.309934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c5f61-7a0c-4abf-a5ce-5129202b9f9a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:58.310400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c5f61-7a0c-4abf-a5ce-5129202b9f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:58.349534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5c4c5f61-7a0c-4abf-a5ce-5129202b9f9a None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:58.351803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5c4c5f61-7a0c-4abf-a5ce-5129202b9f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:58.370242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-571e347c-1e77-4ac5-9278-b02c61a68aec None None] MFA Rules not processed for user `56d4bbcdebc24a34a814d7f6e72fbcfd`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:58.370242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-571e347c-1e77-4ac5-9278-b02c61a68aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:58.453809 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1326/2621] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:11:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:11:58.482329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c5f61-7a0c-4abf-a5ce-5129202b9f9a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:58.484349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5c4c5f61-7a0c-4abf-a5ce-5129202b9f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:58.509003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c5f61-7a0c-4abf-a5ce-5129202b9f9a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:58.515500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98078d-b334-431e-838c-39d3e8c37fb1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:58.517082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98078d-b334-431e-838c-39d3e8c37fb1 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:58.517435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98078d-b334-431e-838c-39d3e8c37fb1 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:58.517807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98078d-b334-431e-838c-39d3e8c37fb1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:58.528961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98078d-b334-431e-838c-39d3e8c37fb1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:58.531052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98078d-b334-431e-838c-39d3e8c37fb1 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:58.548172 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1296/2622] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:58.551536 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1327/2623] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:11:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:11:58.562878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e347c-1e77-4ac5-9278-b02c61a68aec None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:58.590149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:11:58.673309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e347c-1e77-4ac5-9278-b02c61a68aec None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:58.679144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63553e4e-579e-4a24-ba89-d6d18b2ab698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:58.680171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63553e4e-579e-4a24-ba89-d6d18b2ab698 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:58.680730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63553e4e-579e-4a24-ba89-d6d18b2ab698 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:58.681069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63553e4e-579e-4a24-ba89-d6d18b2ab698 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:58.681765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63553e4e-579e-4a24-ba89-d6d18b2ab698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:58.684440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63553e4e-579e-4a24-ba89-d6d18b2ab698 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:58.832472 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1297/2624] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:11:58 2022] POST /identity/v3/projects => generated 389 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:11:58.836626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98078d-b334-431e-838c-39d3e8c37fb1 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:58.872970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98078d-b334-431e-838c-39d3e8c37fb1 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:58.951414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95320f-8526-441c-ba7e-068c0e634c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:58.960149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95320f-8526-441c-ba7e-068c0e634c60 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:58.960149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95320f-8526-441c-ba7e-068c0e634c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:58.960149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95320f-8526-441c-ba7e-068c0e634c60 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:58.960149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95320f-8526-441c-ba7e-068c0e634c60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:58.960149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95320f-8526-441c-ba7e-068c0e634c60 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:59.122760 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1328/2625] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:11:58 2022] POST /identity/v3/users => generated 301 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:11:59.127458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63553e4e-579e-4a24-ba89-d6d18b2ab698 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:59.142777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63553e4e-579e-4a24-ba89-d6d18b2ab698 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:59.146142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6b10d-7fec-4047-a1e7-a2197fb5c5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:59.146942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6b10d-7fec-4047-a1e7-a2197fb5c5ac admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:59.147277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6b10d-7fec-4047-a1e7-a2197fb5c5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:59.147555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6b10d-7fec-4047-a1e7-a2197fb5c5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:59.148312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6b10d-7fec-4047-a1e7-a2197fb5c5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:59.149908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6b10d-7fec-4047-a1e7-a2197fb5c5ac admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:59.162046 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1298/2626] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:11:59.166313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95320f-8526-441c-ba7e-068c0e634c60 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:59.177555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95320f-8526-441c-ba7e-068c0e634c60 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:59.182929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b73c1-3628-4a5d-b2fc-d55e73d931fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:59.184430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b73c1-3628-4a5d-b2fc-d55e73d931fb admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:59.184714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b73c1-3628-4a5d-b2fc-d55e73d931fb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:59.184987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b73c1-3628-4a5d-b2fc-d55e73d931fb admin admin] PATH_INFO: `/v3/projects/2cae2f164c474c69afcc1cee13b57bbd/users/a50c00c7754a440a81728eb67513829a/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:59.203228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b73c1-3628-4a5d-b2fc-d55e73d931fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cae2f164c474c69afcc1cee13b57bbd, user_id=a50c00c7754a440a81728eb67513829a, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:59.205937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b73c1-3628-4a5d-b2fc-d55e73d931fb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:59.281132 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1329/2627] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:11:59 2022] PUT /identity/v3/projects/2cae2f164c474c69afcc1cee13b57bbd/users/a50c00c7754a440a81728eb67513829a/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:11:59.285041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6b10d-7fec-4047-a1e7-a2197fb5c5ac admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:59.300295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6b10d-7fec-4047-a1e7-a2197fb5c5ac admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:59.370836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97a1cd-02d2-4a4a-9097-9cd021592f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:59.371666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97a1cd-02d2-4a4a-9097-9cd021592f8f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:59.371873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97a1cd-02d2-4a4a-9097-9cd021592f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:59.372164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97a1cd-02d2-4a4a-9097-9cd021592f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:59.372954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97a1cd-02d2-4a4a-9097-9cd021592f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:59.374493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97a1cd-02d2-4a4a-9097-9cd021592f8f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:59.393051 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1299/2628] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:11:59.393327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b73c1-3628-4a5d-b2fc-d55e73d931fb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:59.403818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b73c1-3628-4a5d-b2fc-d55e73d931fb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:59.411692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472ae75-4bdb-4ce3-8b53-5b2496cb5f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:59.412883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472ae75-4bdb-4ce3-8b53-5b2496cb5f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:59.413268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472ae75-4bdb-4ce3-8b53-5b2496cb5f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:59.413682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472ae75-4bdb-4ce3-8b53-5b2496cb5f86 admin admin] PATH_INFO: `/v3/projects/2cae2f164c474c69afcc1cee13b57bbd/users/a50c00c7754a440a81728eb67513829a/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:59.415748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472ae75-4bdb-4ce3-8b53-5b2496cb5f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cae2f164c474c69afcc1cee13b57bbd, user_id=a50c00c7754a440a81728eb67513829a, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:59.419300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472ae75-4bdb-4ce3-8b53-5b2496cb5f86 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:59.430328 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1330/2629] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:11:59 2022] PUT /identity/v3/projects/2cae2f164c474c69afcc1cee13b57bbd/users/a50c00c7754a440a81728eb67513829a/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:11:59.441862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee2629-2c92-4189-939b-a7161c553f8d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:59.442381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee2629-2c92-4189-939b-a7161c553f8d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:59.442668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee2629-2c92-4189-939b-a7161c553f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:59.472690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-60ee2629-2c92-4189-939b-a7161c553f8d None None] MFA Rules not processed for user `a50c00c7754a440a81728eb67513829a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:59.473928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-60ee2629-2c92-4189-939b-a7161c553f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:59.553557 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1300/2630] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:59.565687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc3417-2c08-4f5e-ba1e-94efee299a76 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:59.565969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc3417-2c08-4f5e-ba1e-94efee299a76 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:59.566243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc3417-2c08-4f5e-ba1e-94efee299a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:59.587261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-46cc3417-2c08-4f5e-ba1e-94efee299a76 None None] MFA Rules not processed for user `56d4bbcdebc24a34a814d7f6e72fbcfd`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:11:59.589412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-46cc3417-2c08-4f5e-ba1e-94efee299a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:59.647583 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1331/2631] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:11:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:11:59.662378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee2629-2c92-4189-939b-a7161c553f8d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:11:59.662378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-60ee2629-2c92-4189-939b-a7161c553f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:11:59.747918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee2629-2c92-4189-939b-a7161c553f8d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:11:59.754127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a7072-c965-480a-b459-0278d1580dfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:11:59.754783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a7072-c965-480a-b459-0278d1580dfb service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:11:59.755102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a7072-c965-480a-b459-0278d1580dfb service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:11:59.755385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a7072-c965-480a-b459-0278d1580dfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:11:59.766098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a7072-c965-480a-b459-0278d1580dfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:11:59.770992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a7072-c965-480a-b459-0278d1580dfb service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:11:59.781706 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1301/2632] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:11:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:11:59.937840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:00.938265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:01.412783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:03.160347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:03.481447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:04.143501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:04.311910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:05.337387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:05.872712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2ec81-85e8-4485-b066-99b33cd87f5b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:05.872712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2ec81-85e8-4485-b066-99b33cd87f5b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:05.872712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2ec81-85e8-4485-b066-99b33cd87f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:05.887524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5ab2ec81-85e8-4485-b066-99b33cd87f5b None None] MFA Rules not processed for user `2dfcad8d2b57481bb33aa8f5d7483c51`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:12:05.889085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5ab2ec81-85e8-4485-b066-99b33cd87f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:05.966605 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1332/2633] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:12:06.435149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:15.200334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=38 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:17.709058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=18 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:20.993312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a7072-c965-480a-b459-0278d1580dfb service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:21.046100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a7072-c965-480a-b459-0278d1580dfb service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:21.052706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928a9fa-67b9-460a-84e0-70d55858dcf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:21.053246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928a9fa-67b9-460a-84e0-70d55858dcf1 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:21.062983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928a9fa-67b9-460a-84e0-70d55858dcf1 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:21.062983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928a9fa-67b9-460a-84e0-70d55858dcf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:21.063746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928a9fa-67b9-460a-84e0-70d55858dcf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:21.065341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928a9fa-67b9-460a-84e0-70d55858dcf1 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:21.075813 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1302/2634] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:12:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:12:25.361531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571f5cf-a21c-41d3-a670-425d3ce4b2a2 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:25.362092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571f5cf-a21c-41d3-a670-425d3ce4b2a2 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:25.362092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571f5cf-a21c-41d3-a670-425d3ce4b2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:25.393380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8571f5cf-a21c-41d3-a670-425d3ce4b2a2 None None] MFA Rules not processed for user `578b87f863b34f57a571f7e56d44f118`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:12:25.394760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8571f5cf-a21c-41d3-a670-425d3ce4b2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:25.480487 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1333/2635] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:12:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:12:26.874937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928a9fa-67b9-460a-84e0-70d55858dcf1 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:26.876225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c928a9fa-67b9-460a-84e0-70d55858dcf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:27.035558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928a9fa-67b9-460a-84e0-70d55858dcf1 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:27.048929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703eae9-6c9c-434b-94b2-24ba4ae82b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:27.050071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703eae9-6c9c-434b-94b2-24ba4ae82b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:27.050410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703eae9-6c9c-434b-94b2-24ba4ae82b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:27.050696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703eae9-6c9c-434b-94b2-24ba4ae82b10 admin admin] PATH_INFO: `/v3/users/abeb7020019d41a18de42956d706a011` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:27.052030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703eae9-6c9c-434b-94b2-24ba4ae82b10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abeb7020019d41a18de42956d706a011)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:27.054809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703eae9-6c9c-434b-94b2-24ba4ae82b10 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:27.300985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c703eae9-6c9c-434b-94b2-24ba4ae82b10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abeb7020019d41a18de42956d706a011'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:27.314348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c703eae9-6c9c-434b-94b2-24ba4ae82b10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abeb7020019d41a18de42956d706a011'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:27.382903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0baf1-6033-49b7-af71-bd11054b26a9 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:27.383578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0baf1-6033-49b7-af71-bd11054b26a9 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:27.383578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0baf1-6033-49b7-af71-bd11054b26a9 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:27.385301 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1334/2636] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:12:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 21:12:27.397133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9d022-4000-45a7-a9c5-8b6971331e4e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:27.398856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9d022-4000-45a7-a9c5-8b6971331e4e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:27.399253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9d022-4000-45a7-a9c5-8b6971331e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:27.401855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c703eae9-6c9c-434b-94b2-24ba4ae82b10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abeb7020019d41a18de42956d706a011'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:27.418096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c703eae9-6c9c-434b-94b2-24ba4ae82b10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abeb7020019d41a18de42956d706a011'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:27.418851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c703eae9-6c9c-434b-94b2-24ba4ae82b10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abeb7020019d41a18de42956d706a011'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:27.427827 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1303/2637] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:12:26 2022] DELETE /identity/v3/users/abeb7020019d41a18de42956d706a011 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:12:27.432685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696358d7-290e-4fdf-ac24-53949c2d3d03 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:27.433510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696358d7-290e-4fdf-ac24-53949c2d3d03 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:27.433922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696358d7-290e-4fdf-ac24-53949c2d3d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:27.456700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:27.467585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-696358d7-290e-4fdf-ac24-53949c2d3d03 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:12:27.469000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-696358d7-290e-4fdf-ac24-53949c2d3d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:27.476068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-cef9d022-4000-45a7-a9c5-8b6971331e4e None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:12:27.477471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cef9d022-4000-45a7-a9c5-8b6971331e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:27.556204 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1304/2638] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:12:27.558045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cc3d6-2e46-4e40-b720-fdec718ddf84 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:27.558516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cc3d6-2e46-4e40-b720-fdec718ddf84 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:27.558800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cc3d6-2e46-4e40-b720-fdec718ddf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:27.584639 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1335/2639] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:12:27.584924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-be7cc3d6-2e46-4e40-b720-fdec718ddf84 None None] MFA Rules not processed for user `56d4bbcdebc24a34a814d7f6e72fbcfd`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:12:27.585016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a5c06-effb-42e0-93f1-5237472c8b7a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:27.585016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a5c06-effb-42e0-93f1-5237472c8b7a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:27.585016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a5c06-effb-42e0-93f1-5237472c8b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:27.585276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-be7cc3d6-2e46-4e40-b720-fdec718ddf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:27.598997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ce1a5c06-effb-42e0-93f1-5237472c8b7a None None] MFA Rules not processed for user `a9b68dacc4b8463ba07fae6372131117`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:12:27.600210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ce1a5c06-effb-42e0-93f1-5237472c8b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:27.641926 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1305/2640] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:12:27.642803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cc3d6-2e46-4e40-b720-fdec718ddf84 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:27.644060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-be7cc3d6-2e46-4e40-b720-fdec718ddf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:27.665311 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1336/2641] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:12:27.666772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a5c06-effb-42e0-93f1-5237472c8b7a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:27.668033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ce1a5c06-effb-42e0-93f1-5237472c8b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:27.685521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a5c06-effb-42e0-93f1-5237472c8b7a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:27.691934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066bfd7-89c6-4294-9683-72a659409ef4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:27.692678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066bfd7-89c6-4294-9683-72a659409ef4 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:27.693042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066bfd7-89c6-4294-9683-72a659409ef4 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:27.693541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066bfd7-89c6-4294-9683-72a659409ef4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:27.704557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066bfd7-89c6-4294-9683-72a659409ef4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:27.706249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066bfd7-89c6-4294-9683-72a659409ef4 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:27.711487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:27.719706 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1337/2642] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:12:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:12:27.767999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cc3d6-2e46-4e40-b720-fdec718ddf84 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:27.789302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321ba94-209c-43b3-bd7f-185b44476a0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:27.790121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321ba94-209c-43b3-bd7f-185b44476a0b service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:27.790939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321ba94-209c-43b3-bd7f-185b44476a0b service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:27.792400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321ba94-209c-43b3-bd7f-185b44476a0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:27.820063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321ba94-209c-43b3-bd7f-185b44476a0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:27.820063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321ba94-209c-43b3-bd7f-185b44476a0b service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:27.841934 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1306/2643] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:12:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:12:28.162865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066bfd7-89c6-4294-9683-72a659409ef4 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:28.165634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8066bfd7-89c6-4294-9683-72a659409ef4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:28.187342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066bfd7-89c6-4294-9683-72a659409ef4 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:28.193307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adbdc1-607d-44aa-90d8-8f0f5365e436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:28.194353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adbdc1-607d-44aa-90d8-8f0f5365e436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:28.194815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adbdc1-607d-44aa-90d8-8f0f5365e436 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:28.195136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adbdc1-607d-44aa-90d8-8f0f5365e436 admin admin] PATH_INFO: `/v3/projects/649babe54d104436af461f1ee4767001` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:28.196549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adbdc1-607d-44aa-90d8-8f0f5365e436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=649babe54d104436af461f1ee4767001)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:28.199106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adbdc1-607d-44aa-90d8-8f0f5365e436 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:28.346125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51adbdc1-607d-44aa-90d8-8f0f5365e436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '649babe54d104436af461f1ee4767001', 'request_id': 'req-51adbdc1-607d-44aa-90d8-8f0f5365e436'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:28.355649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51adbdc1-607d-44aa-90d8-8f0f5365e436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '649babe54d104436af461f1ee4767001', 'request_id': 'req-51adbdc1-607d-44aa-90d8-8f0f5365e436'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:28.362946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51adbdc1-607d-44aa-90d8-8f0f5365e436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '649babe54d104436af461f1ee4767001', 'request_id': 'req-51adbdc1-607d-44aa-90d8-8f0f5365e436'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:28.420204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51adbdc1-607d-44aa-90d8-8f0f5365e436 admin admin] The token cache is being invalidate because project 649babe54d104436af461f1ee4767001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:12:28.420930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51adbdc1-607d-44aa-90d8-8f0f5365e436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:28.421219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51adbdc1-607d-44aa-90d8-8f0f5365e436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:28.422749 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1338/2644] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:12:28 2022] DELETE /identity/v3/projects/649babe54d104436af461f1ee4767001 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:12:28.426997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321ba94-209c-43b3-bd7f-185b44476a0b service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:28.446407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321ba94-209c-43b3-bd7f-185b44476a0b service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:28.513664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9d332-3826-44eb-a34c-150e13494e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:28.514700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9d332-3826-44eb-a34c-150e13494e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:28.515146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9d332-3826-44eb-a34c-150e13494e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:28.515437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9d332-3826-44eb-a34c-150e13494e17 admin admin] PATH_INFO: `/v3/users/7550ec9a6f2a4352a4a929c2eacfa354` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:28.516649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9d332-3826-44eb-a34c-150e13494e17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7550ec9a6f2a4352a4a929c2eacfa354)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:28.518646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9d332-3826-44eb-a34c-150e13494e17 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:28.941975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-71c9d332-3826-44eb-a34c-150e13494e17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7550ec9a6f2a4352a4a929c2eacfa354'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:28.961556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-71c9d332-3826-44eb-a34c-150e13494e17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7550ec9a6f2a4352a4a929c2eacfa354'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:29.097126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-71c9d332-3826-44eb-a34c-150e13494e17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7550ec9a6f2a4352a4a929c2eacfa354'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:29.112752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-71c9d332-3826-44eb-a34c-150e13494e17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7550ec9a6f2a4352a4a929c2eacfa354'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:29.113682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-71c9d332-3826-44eb-a34c-150e13494e17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7550ec9a6f2a4352a4a929c2eacfa354'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:29.128738 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1307/2645] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:12:28 2022] DELETE /identity/v3/users/7550ec9a6f2a4352a4a929c2eacfa354 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:12:29.201707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:29.797266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adbdc1-607d-44aa-90d8-8f0f5365e436 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:29.798718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-51adbdc1-607d-44aa-90d8-8f0f5365e436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:29.812636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adbdc1-607d-44aa-90d8-8f0f5365e436 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:29.886817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676f3c9-9ef7-4d1e-ae91-f1f8c9a0bf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:29.888080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676f3c9-9ef7-4d1e-ae91-f1f8c9a0bf37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:29.888542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676f3c9-9ef7-4d1e-ae91-f1f8c9a0bf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:29.888994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676f3c9-9ef7-4d1e-ae91-f1f8c9a0bf37 admin admin] PATH_INFO: `/v3/projects/1371ba5caa8f4db78c53cec976f9a868` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:29.891752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676f3c9-9ef7-4d1e-ae91-f1f8c9a0bf37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1371ba5caa8f4db78c53cec976f9a868)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:29.894658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676f3c9-9ef7-4d1e-ae91-f1f8c9a0bf37 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:30.053681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f676f3c9-9ef7-4d1e-ae91-f1f8c9a0bf37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1371ba5caa8f4db78c53cec976f9a868', 'request_id': 'req-f676f3c9-9ef7-4d1e-ae91-f1f8c9a0bf37'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:30.061285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f676f3c9-9ef7-4d1e-ae91-f1f8c9a0bf37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1371ba5caa8f4db78c53cec976f9a868', 'request_id': 'req-f676f3c9-9ef7-4d1e-ae91-f1f8c9a0bf37'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:30.068075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f676f3c9-9ef7-4d1e-ae91-f1f8c9a0bf37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1371ba5caa8f4db78c53cec976f9a868', 'request_id': 'req-f676f3c9-9ef7-4d1e-ae91-f1f8c9a0bf37'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:30.186663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f676f3c9-9ef7-4d1e-ae91-f1f8c9a0bf37 admin admin] The token cache is being invalidate because project 1371ba5caa8f4db78c53cec976f9a868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:12:30.187500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f676f3c9-9ef7-4d1e-ae91-f1f8c9a0bf37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:30.188400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f676f3c9-9ef7-4d1e-ae91-f1f8c9a0bf37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:30.197010 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1339/2646] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:12:29 2022] DELETE /identity/v3/projects/1371ba5caa8f4db78c53cec976f9a868 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:12:30.201929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d45dc-1f25-4ac7-8da6-74b11a04b89d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:30.204590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d45dc-1f25-4ac7-8da6-74b11a04b89d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:30.204590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d45dc-1f25-4ac7-8da6-74b11a04b89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:30.308953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-661d45dc-1f25-4ac7-8da6-74b11a04b89d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:12:30.310610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-661d45dc-1f25-4ac7-8da6-74b11a04b89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:30.390866 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1308/2647] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:12:30.398660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c71ce8-b765-489d-bd32-488968c074f6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:30.399173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c71ce8-b765-489d-bd32-488968c074f6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:30.400166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c71ce8-b765-489d-bd32-488968c074f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:30.422439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-60c71ce8-b765-489d-bd32-488968c074f6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:12:30.424089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-60c71ce8-b765-489d-bd32-488968c074f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:30.439054 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1340/2648] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:12:30.442959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d45dc-1f25-4ac7-8da6-74b11a04b89d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:30.467227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d45dc-1f25-4ac7-8da6-74b11a04b89d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:30.479167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff12a78-b08b-4d91-99cb-fc0345772e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:30.481198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff12a78-b08b-4d91-99cb-fc0345772e28 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:30.481558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff12a78-b08b-4d91-99cb-fc0345772e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:30.482042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff12a78-b08b-4d91-99cb-fc0345772e28 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:30.483592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff12a78-b08b-4d91-99cb-fc0345772e28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:12:30.484322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff12a78-b08b-4d91-99cb-fc0345772e28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:30.486989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff12a78-b08b-4d91-99cb-fc0345772e28 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:30.505221 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1309/2649] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:12:30.508058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c71ce8-b765-489d-bd32-488968c074f6 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:30.517068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:30.522597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c71ce8-b765-489d-bd32-488968c074f6 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:30.529327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f12c2a-a76c-4c9d-bd1a-6fdb3705e95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:30.531059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f12c2a-a76c-4c9d-bd1a-6fdb3705e95a admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:30.531059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f12c2a-a76c-4c9d-bd1a-6fdb3705e95a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:30.531486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f12c2a-a76c-4c9d-bd1a-6fdb3705e95a admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:30.532403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f12c2a-a76c-4c9d-bd1a-6fdb3705e95a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:30.534919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f12c2a-a76c-4c9d-bd1a-6fdb3705e95a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:30.698119 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1341/2650] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:12:30 2022] POST /identity/v3/projects => generated 403 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:12:30.702657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff12a78-b08b-4d91-99cb-fc0345772e28 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:30.710268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff12a78-b08b-4d91-99cb-fc0345772e28 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:30.741808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:30.799499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412933a-0b6e-494f-91f9-62098937e636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:30.800357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412933a-0b6e-494f-91f9-62098937e636 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:30.800650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412933a-0b6e-494f-91f9-62098937e636 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:30.800932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412933a-0b6e-494f-91f9-62098937e636 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:30.801639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412933a-0b6e-494f-91f9-62098937e636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:30.803725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412933a-0b6e-494f-91f9-62098937e636 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:30.964474 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1310/2651] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:12:30 2022] POST /identity/v3/users => generated 302 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:12:30.968902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f12c2a-a76c-4c9d-bd1a-6fdb3705e95a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:30.982252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f12c2a-a76c-4c9d-bd1a-6fdb3705e95a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:30.987246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72452a5c-ba87-49c4-995a-e8eb6b17cac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:30.987930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72452a5c-ba87-49c4-995a-e8eb6b17cac9 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:30.988209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72452a5c-ba87-49c4-995a-e8eb6b17cac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:30.988483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72452a5c-ba87-49c4-995a-e8eb6b17cac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:30.989225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72452a5c-ba87-49c4-995a-e8eb6b17cac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:30.990837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72452a5c-ba87-49c4-995a-e8eb6b17cac9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:31.003441 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1342/2652] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:12:31.007728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412933a-0b6e-494f-91f9-62098937e636 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:31.020204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412933a-0b6e-494f-91f9-62098937e636 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:31.025866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa1ac3-5bdf-42f1-b55d-70464c2558fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:31.026682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa1ac3-5bdf-42f1-b55d-70464c2558fa admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:31.027056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa1ac3-5bdf-42f1-b55d-70464c2558fa admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:31.027415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa1ac3-5bdf-42f1-b55d-70464c2558fa admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:31.028884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa1ac3-5bdf-42f1-b55d-70464c2558fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:31.030597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa1ac3-5bdf-42f1-b55d-70464c2558fa admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:31.046861 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1311/2653] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:12:31.049815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72452a5c-ba87-49c4-995a-e8eb6b17cac9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:31.066006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72452a5c-ba87-49c4-995a-e8eb6b17cac9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:31.077048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0127df1-efa6-49e3-be3e-e10936666d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:31.078996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0127df1-efa6-49e3-be3e-e10936666d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:31.079352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0127df1-efa6-49e3-be3e-e10936666d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:31.079921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0127df1-efa6-49e3-be3e-e10936666d19 admin admin] PATH_INFO: `/v3/projects/590e71ab4bc34f53a63735fa625d7c2e/users/732d3205d99740469700a324f0054a22/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:31.103865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0127df1-efa6-49e3-be3e-e10936666d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=590e71ab4bc34f53a63735fa625d7c2e, user_id=732d3205d99740469700a324f0054a22, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:31.107040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0127df1-efa6-49e3-be3e-e10936666d19 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:31.210856 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1343/2654] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:12:31 2022] PUT /identity/v3/projects/590e71ab4bc34f53a63735fa625d7c2e/users/732d3205d99740469700a324f0054a22/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:12:31.222465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678d655-9ccd-4673-a15b-b961cffb975c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:31.223446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678d655-9ccd-4673-a15b-b961cffb975c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:31.223968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678d655-9ccd-4673-a15b-b961cffb975c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:31.302703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e678d655-9ccd-4673-a15b-b961cffb975c None None] MFA Rules not processed for user `732d3205d99740469700a324f0054a22`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:12:31.305858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e678d655-9ccd-4673-a15b-b961cffb975c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:31.431384 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1312/2655] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:12:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:12:31.435755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0127df1-efa6-49e3-be3e-e10936666d19 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:31.547867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0127df1-efa6-49e3-be3e-e10936666d19 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:31.553906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d5a75-d9e9-436d-b43e-10d7a3dcc50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:31.554598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d5a75-d9e9-436d-b43e-10d7a3dcc50e admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:31.554882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d5a75-d9e9-436d-b43e-10d7a3dcc50e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:31.555196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d5a75-d9e9-436d-b43e-10d7a3dcc50e admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:31.555939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d5a75-d9e9-436d-b43e-10d7a3dcc50e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:31.557872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d5a75-d9e9-436d-b43e-10d7a3dcc50e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:31.678629 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1344/2656] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:12:31 2022] POST /identity/v3/projects => generated 403 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:12:31.680096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678d655-9ccd-4673-a15b-b961cffb975c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:31.694209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678d655-9ccd-4673-a15b-b961cffb975c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:31.839719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b866407-4caf-40ec-a3ac-861680cec9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:31.848400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b866407-4caf-40ec-a3ac-861680cec9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:31.848992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b866407-4caf-40ec-a3ac-861680cec9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:31.849465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b866407-4caf-40ec-a3ac-861680cec9e8 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:31.852956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b866407-4caf-40ec-a3ac-861680cec9e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:31.856991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b866407-4caf-40ec-a3ac-861680cec9e8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:31.985995 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1313/2657] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:12:31 2022] POST /identity/v3/users => generated 308 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:12:31.990666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d5a75-d9e9-436d-b43e-10d7a3dcc50e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:32.006802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d5a75-d9e9-436d-b43e-10d7a3dcc50e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:32.015737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb312c-fb9c-43e5-8b68-4262b958d8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:32.016923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb312c-fb9c-43e5-8b68-4262b958d8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:32.017445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb312c-fb9c-43e5-8b68-4262b958d8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:32.018027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb312c-fb9c-43e5-8b68-4262b958d8f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:32.019077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb312c-fb9c-43e5-8b68-4262b958d8f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:32.021127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb312c-fb9c-43e5-8b68-4262b958d8f4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:32.048415 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1345/2658] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:12:32.052698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b866407-4caf-40ec-a3ac-861680cec9e8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:32.068204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b866407-4caf-40ec-a3ac-861680cec9e8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:32.081360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefaa0c-1d37-496e-8435-072ce12a6ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:32.082765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefaa0c-1d37-496e-8435-072ce12a6ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:32.083466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefaa0c-1d37-496e-8435-072ce12a6ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:32.083852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefaa0c-1d37-496e-8435-072ce12a6ce1 admin admin] PATH_INFO: `/v3/projects/dec88ce6b54d4046afa64c2e4d116c11/users/1044a67f4df44c07b3a62100f9cc1534/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:32.105703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fefaa0c-1d37-496e-8435-072ce12a6ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec88ce6b54d4046afa64c2e4d116c11, user_id=1044a67f4df44c07b3a62100f9cc1534, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:32.111612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fefaa0c-1d37-496e-8435-072ce12a6ce1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:32.218096 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1314/2659] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:12:32 2022] PUT /identity/v3/projects/dec88ce6b54d4046afa64c2e4d116c11/users/1044a67f4df44c07b3a62100f9cc1534/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:12:32.224558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb312c-fb9c-43e5-8b68-4262b958d8f4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:32.259483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb312c-fb9c-43e5-8b68-4262b958d8f4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:32.419601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85dddf6-583c-4fd5-aefc-f9facf7d9935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:32.421619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dddf6-583c-4fd5-aefc-f9facf7d9935 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:32.422002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dddf6-583c-4fd5-aefc-f9facf7d9935 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:32.422464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dddf6-583c-4fd5-aefc-f9facf7d9935 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:32.423609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85dddf6-583c-4fd5-aefc-f9facf7d9935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:32.428499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85dddf6-583c-4fd5-aefc-f9facf7d9935 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:32.444410 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1346/2660] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:12:32.445648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefaa0c-1d37-496e-8435-072ce12a6ce1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:32.460462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefaa0c-1d37-496e-8435-072ce12a6ce1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:32.475207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1aed9e-1d17-48df-9930-24e52436ce40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:32.478445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1aed9e-1d17-48df-9930-24e52436ce40 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:32.478924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1aed9e-1d17-48df-9930-24e52436ce40 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:32.480334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1aed9e-1d17-48df-9930-24e52436ce40 admin admin] PATH_INFO: `/v3/projects/dec88ce6b54d4046afa64c2e4d116c11/users/1044a67f4df44c07b3a62100f9cc1534/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:32.485372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1aed9e-1d17-48df-9930-24e52436ce40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec88ce6b54d4046afa64c2e4d116c11, user_id=1044a67f4df44c07b3a62100f9cc1534, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:32.495134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1aed9e-1d17-48df-9930-24e52436ce40 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:32.526965 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1315/2661] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:12:32 2022] PUT /identity/v3/projects/dec88ce6b54d4046afa64c2e4d116c11/users/1044a67f4df44c07b3a62100f9cc1534/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:12:32.613191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ada18-dbf0-4495-ac56-84032e126bbe None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:32.614222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ada18-dbf0-4495-ac56-84032e126bbe None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:32.615039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ada18-dbf0-4495-ac56-84032e126bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:32.672123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f36ada18-dbf0-4495-ac56-84032e126bbe None None] MFA Rules not processed for user `1044a67f4df44c07b3a62100f9cc1534`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:12:32.673460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f36ada18-dbf0-4495-ac56-84032e126bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:32.816687 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1347/2662] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:12:32 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:12:32.873804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:33.032999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:33.612188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1aed9e-1d17-48df-9930-24e52436ce40 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:33.614148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8b1aed9e-1d17-48df-9930-24e52436ce40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:33.773280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1aed9e-1d17-48df-9930-24e52436ce40 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:33.782249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23401b-e73c-43bb-ac71-b21716baf84f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:33.785071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23401b-e73c-43bb-ac71-b21716baf84f service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:33.785071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23401b-e73c-43bb-ac71-b21716baf84f service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:33.785071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23401b-e73c-43bb-ac71-b21716baf84f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:33.801727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23401b-e73c-43bb-ac71-b21716baf84f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:33.808663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23401b-e73c-43bb-ac71-b21716baf84f service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:33.825504 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1316/2663] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:12:33 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:12:37.484305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ada18-dbf0-4495-ac56-84032e126bbe None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:37.490235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f36ada18-dbf0-4495-ac56-84032e126bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:37.511517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ada18-dbf0-4495-ac56-84032e126bbe None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:37.517887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68834e53-fb9c-42a9-9903-90153d2a1ad7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:37.520404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68834e53-fb9c-42a9-9903-90153d2a1ad7 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:37.520404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68834e53-fb9c-42a9-9903-90153d2a1ad7 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:37.520404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68834e53-fb9c-42a9-9903-90153d2a1ad7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:37.596648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68834e53-fb9c-42a9-9903-90153d2a1ad7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:37.599617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68834e53-fb9c-42a9-9903-90153d2a1ad7 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:37.613125 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1348/2664] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:12:37 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:12:37.636809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23401b-e73c-43bb-ac71-b21716baf84f service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:37.725464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23401b-e73c-43bb-ac71-b21716baf84f service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:37.732626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a502f-b787-454e-85a2-61efb3688c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:37.733746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a502f-b787-454e-85a2-61efb3688c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:37.734475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a502f-b787-454e-85a2-61efb3688c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:37.734968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a502f-b787-454e-85a2-61efb3688c09 admin admin] PATH_INFO: `/v3/users/732d3205d99740469700a324f0054a22` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:37.737290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a502f-b787-454e-85a2-61efb3688c09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=732d3205d99740469700a324f0054a22)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:37.740324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a502f-b787-454e-85a2-61efb3688c09 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:37.979829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b09a502f-b787-454e-85a2-61efb3688c09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '732d3205d99740469700a324f0054a22'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:37.990027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b09a502f-b787-454e-85a2-61efb3688c09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '732d3205d99740469700a324f0054a22'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:37.996582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:38.138617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b09a502f-b787-454e-85a2-61efb3688c09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '732d3205d99740469700a324f0054a22'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:38.151055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b09a502f-b787-454e-85a2-61efb3688c09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '732d3205d99740469700a324f0054a22'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:38.151823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b09a502f-b787-454e-85a2-61efb3688c09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '732d3205d99740469700a324f0054a22'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:38.168340 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1317/2665] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:12:37 2022] DELETE /identity/v3/users/732d3205d99740469700a324f0054a22 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:12:38.172858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a9475-0d4c-4037-a355-f31a083b963b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:38.173143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a9475-0d4c-4037-a355-f31a083b963b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:38.173420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a9475-0d4c-4037-a355-f31a083b963b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:38.195141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-cc7a9475-0d4c-4037-a355-f31a083b963b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:12:38.196874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cc7a9475-0d4c-4037-a355-f31a083b963b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:38.307707 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1349/2666] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:12:38.321506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a502f-b787-454e-85a2-61efb3688c09 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:38.323216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b09a502f-b787-454e-85a2-61efb3688c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:38.413573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a502f-b787-454e-85a2-61efb3688c09 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:38.417805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f17c4b-bdfc-4451-81f7-527c545532db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:38.418478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f17c4b-bdfc-4451-81f7-527c545532db service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:38.418760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f17c4b-bdfc-4451-81f7-527c545532db service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:38.419065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f17c4b-bdfc-4451-81f7-527c545532db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:38.431384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f17c4b-bdfc-4451-81f7-527c545532db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:38.432997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f17c4b-bdfc-4451-81f7-527c545532db service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:38.444366 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1318/2667] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:12:38.916958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a9475-0d4c-4037-a355-f31a083b963b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:38.918625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cc7a9475-0d4c-4037-a355-f31a083b963b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:38.931861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a9475-0d4c-4037-a355-f31a083b963b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:38.937910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1190e-3bce-4087-8f3f-27199ed2416c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:38.939230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1190e-3bce-4087-8f3f-27199ed2416c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:38.939669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1190e-3bce-4087-8f3f-27199ed2416c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:38.940130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1190e-3bce-4087-8f3f-27199ed2416c admin admin] PATH_INFO: `/v3/projects/590e71ab4bc34f53a63735fa625d7c2e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:38.941742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1190e-3bce-4087-8f3f-27199ed2416c admin admin] RBAC: Authorizing `identity:delete_project(project_id=590e71ab4bc34f53a63735fa625d7c2e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:38.943874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1190e-3bce-4087-8f3f-27199ed2416c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:39.070566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:39.090682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d5d1190e-3bce-4087-8f3f-27199ed2416c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '590e71ab4bc34f53a63735fa625d7c2e', 'request_id': 'req-d5d1190e-3bce-4087-8f3f-27199ed2416c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:39.098065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d5d1190e-3bce-4087-8f3f-27199ed2416c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '590e71ab4bc34f53a63735fa625d7c2e', 'request_id': 'req-d5d1190e-3bce-4087-8f3f-27199ed2416c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:39.107050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f17c4b-bdfc-4451-81f7-527c545532db service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:39.108826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-10f17c4b-bdfc-4451-81f7-527c545532db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:39.115584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d5d1190e-3bce-4087-8f3f-27199ed2416c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '590e71ab4bc34f53a63735fa625d7c2e', 'request_id': 'req-d5d1190e-3bce-4087-8f3f-27199ed2416c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:39.190958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f17c4b-bdfc-4451-81f7-527c545532db service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:39.212185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d5d1190e-3bce-4087-8f3f-27199ed2416c admin admin] The token cache is being invalidate because project 590e71ab4bc34f53a63735fa625d7c2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:12:39.212838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d5d1190e-3bce-4087-8f3f-27199ed2416c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:39.214307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d5d1190e-3bce-4087-8f3f-27199ed2416c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:39.216556 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1350/2668] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:12:38 2022] DELETE /identity/v3/projects/590e71ab4bc34f53a63735fa625d7c2e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:12:39.220418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1190e-3bce-4087-8f3f-27199ed2416c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:39.221795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d5d1190e-3bce-4087-8f3f-27199ed2416c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:39.286149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ea9b4-5e1f-4983-9129-06f403fe3a62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:39.287387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ea9b4-5e1f-4983-9129-06f403fe3a62 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:39.287740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ea9b4-5e1f-4983-9129-06f403fe3a62 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:39.288089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ea9b4-5e1f-4983-9129-06f403fe3a62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:39.292538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c34ea9b4-5e1f-4983-9129-06f403fe3a62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:39.334915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:39.345310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1190e-3bce-4087-8f3f-27199ed2416c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:39.352692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e897c51-733f-44ff-b324-a782c8611831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:39.353995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e897c51-733f-44ff-b324-a782c8611831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:39.354636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e897c51-733f-44ff-b324-a782c8611831 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:39.356185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e897c51-733f-44ff-b324-a782c8611831 admin admin] PATH_INFO: `/v3/users/1044a67f4df44c07b3a62100f9cc1534` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:39.357911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e897c51-733f-44ff-b324-a782c8611831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1044a67f4df44c07b3a62100f9cc1534)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:39.360280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e897c51-733f-44ff-b324-a782c8611831 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:39.393040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ea9b4-5e1f-4983-9129-06f403fe3a62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:39.395050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ea9b4-5e1f-4983-9129-06f403fe3a62 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:39.407410 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1319/2669] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:12:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:12:39.617014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8e897c51-733f-44ff-b324-a782c8611831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1044a67f4df44c07b3a62100f9cc1534'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:39.652292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8e897c51-733f-44ff-b324-a782c8611831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1044a67f4df44c07b3a62100f9cc1534'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:39.725259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8e897c51-733f-44ff-b324-a782c8611831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1044a67f4df44c07b3a62100f9cc1534'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:39.726156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8e897c51-733f-44ff-b324-a782c8611831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1044a67f4df44c07b3a62100f9cc1534'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:39.750302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8e897c51-733f-44ff-b324-a782c8611831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1044a67f4df44c07b3a62100f9cc1534'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:39.773408 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1351/2670] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:12:39 2022] DELETE /identity/v3/users/1044a67f4df44c07b3a62100f9cc1534 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:12:40.757700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ea9b4-5e1f-4983-9129-06f403fe3a62 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:40.783355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ea9b4-5e1f-4983-9129-06f403fe3a62 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:40.924657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8573f-f739-4a6e-a07b-5a7200518bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:40.927065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8573f-f739-4a6e-a07b-5a7200518bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:40.930144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8573f-f739-4a6e-a07b-5a7200518bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:40.931300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8573f-f739-4a6e-a07b-5a7200518bdc admin admin] PATH_INFO: `/v3/projects/dec88ce6b54d4046afa64c2e4d116c11` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:40.935713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8573f-f739-4a6e-a07b-5a7200518bdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec88ce6b54d4046afa64c2e4d116c11)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:40.941398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8573f-f739-4a6e-a07b-5a7200518bdc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:41.154415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-21b8573f-f739-4a6e-a07b-5a7200518bdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec88ce6b54d4046afa64c2e4d116c11', 'request_id': 'req-21b8573f-f739-4a6e-a07b-5a7200518bdc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:41.161307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-21b8573f-f739-4a6e-a07b-5a7200518bdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec88ce6b54d4046afa64c2e4d116c11', 'request_id': 'req-21b8573f-f739-4a6e-a07b-5a7200518bdc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:41.172454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-21b8573f-f739-4a6e-a07b-5a7200518bdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec88ce6b54d4046afa64c2e4d116c11', 'request_id': 'req-21b8573f-f739-4a6e-a07b-5a7200518bdc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:41.300478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-21b8573f-f739-4a6e-a07b-5a7200518bdc admin admin] The token cache is being invalidate because project dec88ce6b54d4046afa64c2e4d116c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:12:41.301487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-21b8573f-f739-4a6e-a07b-5a7200518bdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:41.305735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-21b8573f-f739-4a6e-a07b-5a7200518bdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:12:41.314957 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1320/2671] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:12:40 2022] DELETE /identity/v3/projects/dec88ce6b54d4046afa64c2e4d116c11 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:12:41.330526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c06f2c-b696-4d8f-8a2d-3f2c88df4513 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:41.331101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c06f2c-b696-4d8f-8a2d-3f2c88df4513 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:41.333130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c06f2c-b696-4d8f-8a2d-3f2c88df4513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:41.359992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d8c06f2c-b696-4d8f-8a2d-3f2c88df4513 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:12:41.361923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d8c06f2c-b696-4d8f-8a2d-3f2c88df4513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:41.395155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:41.440662 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1352/2672] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:12:41.450980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82dae3-cbbd-4fe0-8e72-98384797c981 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:41.453296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82dae3-cbbd-4fe0-8e72-98384797c981 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:41.454699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82dae3-cbbd-4fe0-8e72-98384797c981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:41.506210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4a82dae3-cbbd-4fe0-8e72-98384797c981 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:12:41.510971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4a82dae3-cbbd-4fe0-8e72-98384797c981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:41.534149 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1321/2673] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:12:41.537582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c06f2c-b696-4d8f-8a2d-3f2c88df4513 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:41.558710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c06f2c-b696-4d8f-8a2d-3f2c88df4513 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:41.568047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057544a3-e642-4375-96a9-6905257343a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:41.569837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057544a3-e642-4375-96a9-6905257343a3 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:41.569837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057544a3-e642-4375-96a9-6905257343a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:41.570328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057544a3-e642-4375-96a9-6905257343a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:41.572342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057544a3-e642-4375-96a9-6905257343a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:12:41.572904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057544a3-e642-4375-96a9-6905257343a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:41.576192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057544a3-e642-4375-96a9-6905257343a3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:41.602259 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1353/2674] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:12:41.604224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82dae3-cbbd-4fe0-8e72-98384797c981 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:41.620911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82dae3-cbbd-4fe0-8e72-98384797c981 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:41.626745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167543d-668f-4e40-b9b4-3905bd2db660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:41.627573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167543d-668f-4e40-b9b4-3905bd2db660 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:41.627950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167543d-668f-4e40-b9b4-3905bd2db660 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:41.628326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167543d-668f-4e40-b9b4-3905bd2db660 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:41.629345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167543d-668f-4e40-b9b4-3905bd2db660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:41.638843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167543d-668f-4e40-b9b4-3905bd2db660 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:41.749693 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1322/2675] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:12:41 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:12:41.750556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057544a3-e642-4375-96a9-6905257343a3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:41.761929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057544a3-e642-4375-96a9-6905257343a3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:41.827511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aea7e2-a951-46f3-b7f0-bfabbe7fa186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:41.828237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aea7e2-a951-46f3-b7f0-bfabbe7fa186 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:41.828520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aea7e2-a951-46f3-b7f0-bfabbe7fa186 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:41.829573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aea7e2-a951-46f3-b7f0-bfabbe7fa186 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:41.830281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aea7e2-a951-46f3-b7f0-bfabbe7fa186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:41.832487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aea7e2-a951-46f3-b7f0-bfabbe7fa186 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:41.939409 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1354/2676] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:12:41 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:12:41.943614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167543d-668f-4e40-b9b4-3905bd2db660 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:41.955418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167543d-668f-4e40-b9b4-3905bd2db660 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:41.960977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8553c-7205-49b6-8452-e1cca8220af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:41.964418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8553c-7205-49b6-8452-e1cca8220af4 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:41.964418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8553c-7205-49b6-8452-e1cca8220af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:41.964418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8553c-7205-49b6-8452-e1cca8220af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:41.965103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8553c-7205-49b6-8452-e1cca8220af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:41.967646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8553c-7205-49b6-8452-e1cca8220af4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:41.984408 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1323/2677] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:12:41.989355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aea7e2-a951-46f3-b7f0-bfabbe7fa186 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:42.001002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aea7e2-a951-46f3-b7f0-bfabbe7fa186 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:42.006881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b3bed-da50-4641-9349-f0cffb73fe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:42.007676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b3bed-da50-4641-9349-f0cffb73fe93 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:42.010883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b3bed-da50-4641-9349-f0cffb73fe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:42.010883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b3bed-da50-4641-9349-f0cffb73fe93 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:42.010883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b3bed-da50-4641-9349-f0cffb73fe93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:42.011599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b3bed-da50-4641-9349-f0cffb73fe93 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:42.026097 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1355/2678] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:12:42.030487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8553c-7205-49b6-8452-e1cca8220af4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:42.042337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8553c-7205-49b6-8452-e1cca8220af4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:42.049942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b8869-1964-40eb-be75-d1f23794715b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:42.051260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b8869-1964-40eb-be75-d1f23794715b admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:42.057232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b8869-1964-40eb-be75-d1f23794715b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:42.057232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b8869-1964-40eb-be75-d1f23794715b admin admin] PATH_INFO: `/v3/projects/cad2f07400d54ef9825022d5b3489db0/users/2db871d6aa9746d2b660efbfbdb1dc75/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:42.057232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:42.071843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b8869-1964-40eb-be75-d1f23794715b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad2f07400d54ef9825022d5b3489db0, user_id=2db871d6aa9746d2b660efbfbdb1dc75, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:42.074580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b8869-1964-40eb-be75-d1f23794715b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:42.144135 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1324/2679] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:12:42 2022] PUT /identity/v3/projects/cad2f07400d54ef9825022d5b3489db0/users/2db871d6aa9746d2b660efbfbdb1dc75/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:12:42.157041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cef31-1bfe-402d-b1f5-c675ae284a00 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:42.157465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cef31-1bfe-402d-b1f5-c675ae284a00 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:42.157704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cef31-1bfe-402d-b1f5-c675ae284a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:42.194998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-374cef31-1bfe-402d-b1f5-c675ae284a00 None None] MFA Rules not processed for user `2db871d6aa9746d2b660efbfbdb1dc75`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:12:42.197241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-374cef31-1bfe-402d-b1f5-c675ae284a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:42.317462 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1356/2680] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:12:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:12:42.319191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b8869-1964-40eb-be75-d1f23794715b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:42.397680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b8869-1964-40eb-be75-d1f23794715b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:42.404300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe008b-6d85-4bae-8015-4281f9258dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:42.405157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe008b-6d85-4bae-8015-4281f9258dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:42.405639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe008b-6d85-4bae-8015-4281f9258dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:42.405897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe008b-6d85-4bae-8015-4281f9258dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:42.407446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe008b-6d85-4bae-8015-4281f9258dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:42.409860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe008b-6d85-4bae-8015-4281f9258dc7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:42.584747 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1325/2681] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:12:42 2022] POST /identity/v3/projects => generated 377 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:12:42.589941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cef31-1bfe-402d-b1f5-c675ae284a00 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:42.631615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cef31-1bfe-402d-b1f5-c675ae284a00 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:42.683614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:42.710146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721802c-9cc7-431a-a14d-f8f98a530c37 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:42.710840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721802c-9cc7-431a-a14d-f8f98a530c37 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:42.711320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721802c-9cc7-431a-a14d-f8f98a530c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:42.741301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6721802c-9cc7-431a-a14d-f8f98a530c37 None None] MFA Rules not processed for user `52281b3989a04ca2a50b0bc93bf783f0`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:12:42.743854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6721802c-9cc7-431a-a14d-f8f98a530c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:42.755371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf673d-d0f3-4a47-a689-c848fe96ccda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:42.756594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf673d-d0f3-4a47-a689-c848fe96ccda admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:42.757110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf673d-d0f3-4a47-a689-c848fe96ccda admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:42.758119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf673d-d0f3-4a47-a689-c848fe96ccda admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:42.759738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf673d-d0f3-4a47-a689-c848fe96ccda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:42.764628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf673d-d0f3-4a47-a689-c848fe96ccda admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:42.866082 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1326/2682] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:12:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:12:42.895692 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1357/2683] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:12:42 2022] POST /identity/v3/users => generated 295 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:12:42.899076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721802c-9cc7-431a-a14d-f8f98a530c37 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:42.925202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721802c-9cc7-431a-a14d-f8f98a530c37 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:42.933482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0b34f-2103-4057-a839-6b0905c85f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:42.934168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0b34f-2103-4057-a839-6b0905c85f9f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:42.934862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0b34f-2103-4057-a839-6b0905c85f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:42.935181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0b34f-2103-4057-a839-6b0905c85f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:42.937604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0b34f-2103-4057-a839-6b0905c85f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:42.939836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0b34f-2103-4057-a839-6b0905c85f9f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:42.958307 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1327/2684] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:12:42.959967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf673d-d0f3-4a47-a689-c848fe96ccda admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:42.974742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf673d-d0f3-4a47-a689-c848fe96ccda admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:42.986100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630641eb-bfcf-45fb-aee3-cc05b5877df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:42.987029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630641eb-bfcf-45fb-aee3-cc05b5877df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:42.988120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630641eb-bfcf-45fb-aee3-cc05b5877df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:42.988454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630641eb-bfcf-45fb-aee3-cc05b5877df8 admin admin] PATH_INFO: `/v3/projects/6e81dc2f67894c5e99512041283174fb/users/966ec65300104fa7ae2e57ab46b4a219/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:43.050240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630641eb-bfcf-45fb-aee3-cc05b5877df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e81dc2f67894c5e99512041283174fb, user_id=966ec65300104fa7ae2e57ab46b4a219, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:43.056394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630641eb-bfcf-45fb-aee3-cc05b5877df8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:43.199998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0b34f-2103-4057-a839-6b0905c85f9f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:43.200906 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1358/2685] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:12:42 2022] PUT /identity/v3/projects/6e81dc2f67894c5e99512041283174fb/users/966ec65300104fa7ae2e57ab46b4a219/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:12:43.221786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0b34f-2103-4057-a839-6b0905c85f9f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:43.297736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4123c5-aaa3-44ce-bb03-061c974554d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:43.298872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4123c5-aaa3-44ce-bb03-061c974554d9 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:43.299385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4123c5-aaa3-44ce-bb03-061c974554d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:43.299828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4123c5-aaa3-44ce-bb03-061c974554d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:43.300847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4123c5-aaa3-44ce-bb03-061c974554d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:43.302475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4123c5-aaa3-44ce-bb03-061c974554d9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:43.314833 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1328/2686] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:12:43.319048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630641eb-bfcf-45fb-aee3-cc05b5877df8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:43.341357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630641eb-bfcf-45fb-aee3-cc05b5877df8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:43.351443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d3b16-e9ce-422c-998c-dd0341df01a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:43.352420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d3b16-e9ce-422c-998c-dd0341df01a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:43.352956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d3b16-e9ce-422c-998c-dd0341df01a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:43.354097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d3b16-e9ce-422c-998c-dd0341df01a7 admin admin] PATH_INFO: `/v3/projects/6e81dc2f67894c5e99512041283174fb/users/966ec65300104fa7ae2e57ab46b4a219/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:43.356209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d3b16-e9ce-422c-998c-dd0341df01a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e81dc2f67894c5e99512041283174fb, user_id=966ec65300104fa7ae2e57ab46b4a219, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:43.359884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d3b16-e9ce-422c-998c-dd0341df01a7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:43.389906 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1359/2687] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:12:43 2022] PUT /identity/v3/projects/6e81dc2f67894c5e99512041283174fb/users/966ec65300104fa7ae2e57ab46b4a219/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:12:43.400437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e143b1e-c238-43c9-812e-a253ca6ed9d3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:43.400730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e143b1e-c238-43c9-812e-a253ca6ed9d3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:43.402521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e143b1e-c238-43c9-812e-a253ca6ed9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:43.472471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6e143b1e-c238-43c9-812e-a253ca6ed9d3 None None] MFA Rules not processed for user `966ec65300104fa7ae2e57ab46b4a219`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:12:43.473870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6e143b1e-c238-43c9-812e-a253ca6ed9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:43.587254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:43.609309 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1329/2688] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:12:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:12:43.625302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666aec2d-1ef2-430c-8027-25171f1f2354 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:43.626219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666aec2d-1ef2-430c-8027-25171f1f2354 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:43.626651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666aec2d-1ef2-430c-8027-25171f1f2354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:43.650415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-666aec2d-1ef2-430c-8027-25171f1f2354 None None] MFA Rules not processed for user `2db871d6aa9746d2b660efbfbdb1dc75`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:12:43.652224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-666aec2d-1ef2-430c-8027-25171f1f2354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:43.761116 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1360/2689] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:12:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:12:45.244714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e143b1e-c238-43c9-812e-a253ca6ed9d3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:45.246472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6e143b1e-c238-43c9-812e-a253ca6ed9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:45.519625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e143b1e-c238-43c9-812e-a253ca6ed9d3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:45.529121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a16046-2d93-4543-8992-230f6465c34b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:45.530323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a16046-2d93-4543-8992-230f6465c34b service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:45.530801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a16046-2d93-4543-8992-230f6465c34b service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:45.531069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a16046-2d93-4543-8992-230f6465c34b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:45.542741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a16046-2d93-4543-8992-230f6465c34b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:45.544717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a16046-2d93-4543-8992-230f6465c34b service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:45.556732 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1330/2690] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:12:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:12:53.754813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=55,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:53.811541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913cebb-22a7-43a8-815e-744ebfb52d6a None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:53.811994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913cebb-22a7-43a8-815e-744ebfb52d6a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:53.812340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913cebb-22a7-43a8-815e-744ebfb52d6a None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:53.813846 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1361/2691] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:12:53.819163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae3b1b-3119-4303-a2dd-22d4aee705a7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:53.819906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae3b1b-3119-4303-a2dd-22d4aee705a7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:53.819906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae3b1b-3119-4303-a2dd-22d4aee705a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:53.848813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e3ae3b1b-3119-4303-a2dd-22d4aee705a7 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:12:53.850359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e3ae3b1b-3119-4303-a2dd-22d4aee705a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:53.931709 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1331/2692] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:12:53.954224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913cebb-22a7-43a8-815e-744ebfb52d6a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:53.955989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f913cebb-22a7-43a8-815e-744ebfb52d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:53.973397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913cebb-22a7-43a8-815e-744ebfb52d6a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:53.981488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eac62b-131b-4ece-88a0-2140e8765691 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:53.982144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eac62b-131b-4ece-88a0-2140e8765691 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:53.982448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eac62b-131b-4ece-88a0-2140e8765691 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:53.982719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eac62b-131b-4ece-88a0-2140e8765691 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:53.994581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eac62b-131b-4ece-88a0-2140e8765691 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:53.996436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eac62b-131b-4ece-88a0-2140e8765691 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:54.009281 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1362/2693] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:12:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:12:54.419097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5693c5-efc7-49b9-81e8-ca1559cb46b1 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:54.419434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5693c5-efc7-49b9-81e8-ca1559cb46b1 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:54.419708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5693c5-efc7-49b9-81e8-ca1559cb46b1 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:54.421212 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1332/2694] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:12:54.432566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39991a99-3ddc-43d4-a3ae-44390a64e515 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:54.433348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39991a99-3ddc-43d4-a3ae-44390a64e515 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:54.446365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39991a99-3ddc-43d4-a3ae-44390a64e515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:54.470909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-39991a99-3ddc-43d4-a3ae-44390a64e515 None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:12:54.478777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-39991a99-3ddc-43d4-a3ae-44390a64e515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:54.503193 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1363/2695] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:12:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:12:54.511747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5693c5-efc7-49b9-81e8-ca1559cb46b1 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:12:54.515331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6e5693c5-efc7-49b9-81e8-ca1559cb46b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:12:54.531779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:12:54.645095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5693c5-efc7-49b9-81e8-ca1559cb46b1 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:12:54.657469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213cbcb-3d5b-4abc-ac20-b60e40006fa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:12:54.658839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213cbcb-3d5b-4abc-ac20-b60e40006fa9 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:12:54.660819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213cbcb-3d5b-4abc-ac20-b60e40006fa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:12:54.661209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213cbcb-3d5b-4abc-ac20-b60e40006fa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:12:54.688945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213cbcb-3d5b-4abc-ac20-b60e40006fa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:12:54.696491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213cbcb-3d5b-4abc-ac20-b60e40006fa9 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:12:54.717099 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1333/2696] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:12:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:13:00.978848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39991a99-3ddc-43d4-a3ae-44390a64e515 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:00.978848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-39991a99-3ddc-43d4-a3ae-44390a64e515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:01.114151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39991a99-3ddc-43d4-a3ae-44390a64e515 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:01.119796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41274ea9-3dad-4191-8d30-f6831d79ea81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:01.120615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41274ea9-3dad-4191-8d30-f6831d79ea81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:01.120895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41274ea9-3dad-4191-8d30-f6831d79ea81 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:01.121169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41274ea9-3dad-4191-8d30-f6831d79ea81 admin admin] PATH_INFO: `/v3/users/56d4bbcdebc24a34a814d7f6e72fbcfd` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:01.122757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41274ea9-3dad-4191-8d30-f6831d79ea81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56d4bbcdebc24a34a814d7f6e72fbcfd)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:01.124839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41274ea9-3dad-4191-8d30-f6831d79ea81 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:01.336910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-41274ea9-3dad-4191-8d30-f6831d79ea81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56d4bbcdebc24a34a814d7f6e72fbcfd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:01.346133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-41274ea9-3dad-4191-8d30-f6831d79ea81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56d4bbcdebc24a34a814d7f6e72fbcfd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:01.421596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-41274ea9-3dad-4191-8d30-f6831d79ea81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56d4bbcdebc24a34a814d7f6e72fbcfd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:01.422260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-41274ea9-3dad-4191-8d30-f6831d79ea81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56d4bbcdebc24a34a814d7f6e72fbcfd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:01.435558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-41274ea9-3dad-4191-8d30-f6831d79ea81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56d4bbcdebc24a34a814d7f6e72fbcfd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:01.446214 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1364/2697] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:13:00 2022] DELETE /identity/v3/users/56d4bbcdebc24a34a814d7f6e72fbcfd => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:01.448029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a882e25-c619-421a-8203-024b11c8ca7f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:01.448554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a882e25-c619-421a-8203-024b11c8ca7f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:01.448660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a882e25-c619-421a-8203-024b11c8ca7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:01.467363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5a882e25-c619-421a-8203-024b11c8ca7f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:01.468554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5a882e25-c619-421a-8203-024b11c8ca7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:01.534013 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1334/2698] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:13:01.544288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41274ea9-3dad-4191-8d30-f6831d79ea81 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:01.545765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-41274ea9-3dad-4191-8d30-f6831d79ea81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:01.622076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41274ea9-3dad-4191-8d30-f6831d79ea81 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:01.628620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47780b-411e-4c79-9754-7723c4e3818d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:01.629442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47780b-411e-4c79-9754-7723c4e3818d service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:01.630153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47780b-411e-4c79-9754-7723c4e3818d service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:01.630599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47780b-411e-4c79-9754-7723c4e3818d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:01.646766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47780b-411e-4c79-9754-7723c4e3818d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:01.648706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47780b-411e-4c79-9754-7723c4e3818d service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:01.679850 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1365/2699] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:13:01.975969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a882e25-c619-421a-8203-024b11c8ca7f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:01.978565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5a882e25-c619-421a-8203-024b11c8ca7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:01.994493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a882e25-c619-421a-8203-024b11c8ca7f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:02.008768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f71ab5-6807-484d-acc5-63600cf5b216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:02.008768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f71ab5-6807-484d-acc5-63600cf5b216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:02.008768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f71ab5-6807-484d-acc5-63600cf5b216 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:02.008768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f71ab5-6807-484d-acc5-63600cf5b216 admin admin] PATH_INFO: `/v3/projects/7d2b583c48254e17a8082f6467f2ae6d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:02.009453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f71ab5-6807-484d-acc5-63600cf5b216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2b583c48254e17a8082f6467f2ae6d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:02.009453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f71ab5-6807-484d-acc5-63600cf5b216 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:02.187429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-64f71ab5-6807-484d-acc5-63600cf5b216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2b583c48254e17a8082f6467f2ae6d', 'request_id': 'req-64f71ab5-6807-484d-acc5-63600cf5b216'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:02.193195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-64f71ab5-6807-484d-acc5-63600cf5b216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2b583c48254e17a8082f6467f2ae6d', 'request_id': 'req-64f71ab5-6807-484d-acc5-63600cf5b216'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:02.199708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-64f71ab5-6807-484d-acc5-63600cf5b216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2b583c48254e17a8082f6467f2ae6d', 'request_id': 'req-64f71ab5-6807-484d-acc5-63600cf5b216'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:02.301403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-64f71ab5-6807-484d-acc5-63600cf5b216 admin admin] The token cache is being invalidate because project 7d2b583c48254e17a8082f6467f2ae6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:13:02.301686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-64f71ab5-6807-484d-acc5-63600cf5b216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:02.302312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-64f71ab5-6807-484d-acc5-63600cf5b216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:02.303885 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1335/2700] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:13:01 2022] DELETE /identity/v3/projects/7d2b583c48254e17a8082f6467f2ae6d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:02.308451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47780b-411e-4c79-9754-7723c4e3818d service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:02.314179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:02.321262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47780b-411e-4c79-9754-7723c4e3818d service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:02.383682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c91fa-4f9e-42bf-9e0d-e4f504d56531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:02.385246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c91fa-4f9e-42bf-9e0d-e4f504d56531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:02.385661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c91fa-4f9e-42bf-9e0d-e4f504d56531 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:02.385945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c91fa-4f9e-42bf-9e0d-e4f504d56531 admin admin] PATH_INFO: `/v3/users/a50c00c7754a440a81728eb67513829a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:02.387419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c91fa-4f9e-42bf-9e0d-e4f504d56531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a50c00c7754a440a81728eb67513829a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:02.389619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c91fa-4f9e-42bf-9e0d-e4f504d56531 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:02.569496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f64c91fa-4f9e-42bf-9e0d-e4f504d56531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a50c00c7754a440a81728eb67513829a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:02.582266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f64c91fa-4f9e-42bf-9e0d-e4f504d56531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a50c00c7754a440a81728eb67513829a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:02.667190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f64c91fa-4f9e-42bf-9e0d-e4f504d56531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a50c00c7754a440a81728eb67513829a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:02.667908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f64c91fa-4f9e-42bf-9e0d-e4f504d56531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a50c00c7754a440a81728eb67513829a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:02.681423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f64c91fa-4f9e-42bf-9e0d-e4f504d56531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a50c00c7754a440a81728eb67513829a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:02.689891 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1366/2701] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:13:02 2022] DELETE /identity/v3/users/a50c00c7754a440a81728eb67513829a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:03.376767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f71ab5-6807-484d-acc5-63600cf5b216 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:03.378237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-64f71ab5-6807-484d-acc5-63600cf5b216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:03.409219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f71ab5-6807-484d-acc5-63600cf5b216 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:03.447654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:03.475539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90564bbc-871a-4088-9267-54cfdf85f986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:03.476667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90564bbc-871a-4088-9267-54cfdf85f986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:03.476983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90564bbc-871a-4088-9267-54cfdf85f986 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:03.477324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90564bbc-871a-4088-9267-54cfdf85f986 admin admin] PATH_INFO: `/v3/projects/2cae2f164c474c69afcc1cee13b57bbd` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:03.478608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90564bbc-871a-4088-9267-54cfdf85f986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cae2f164c474c69afcc1cee13b57bbd)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:03.480626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90564bbc-871a-4088-9267-54cfdf85f986 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:03.629449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-90564bbc-871a-4088-9267-54cfdf85f986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cae2f164c474c69afcc1cee13b57bbd', 'request_id': 'req-90564bbc-871a-4088-9267-54cfdf85f986'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:03.636131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-90564bbc-871a-4088-9267-54cfdf85f986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cae2f164c474c69afcc1cee13b57bbd', 'request_id': 'req-90564bbc-871a-4088-9267-54cfdf85f986'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:03.642903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-90564bbc-871a-4088-9267-54cfdf85f986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cae2f164c474c69afcc1cee13b57bbd', 'request_id': 'req-90564bbc-871a-4088-9267-54cfdf85f986'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:03.769483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-90564bbc-871a-4088-9267-54cfdf85f986 admin admin] The token cache is being invalidate because project 2cae2f164c474c69afcc1cee13b57bbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:13:03.769776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-90564bbc-871a-4088-9267-54cfdf85f986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:03.770443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-90564bbc-871a-4088-9267-54cfdf85f986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:03.774278 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1336/2702] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:13:03 2022] DELETE /identity/v3/projects/2cae2f164c474c69afcc1cee13b57bbd => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:03.777469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c73251-976a-4c98-958f-52ab4e8ed43e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:03.777947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c73251-976a-4c98-958f-52ab4e8ed43e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:03.778044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c73251-976a-4c98-958f-52ab4e8ed43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:03.801833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-80c73251-976a-4c98-958f-52ab4e8ed43e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:03.803751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-80c73251-976a-4c98-958f-52ab4e8ed43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:03.877920 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1367/2703] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:13:03.886058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d35dd6-ef2c-4ddc-a6e3-95111f2e0db9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:03.886630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d35dd6-ef2c-4ddc-a6e3-95111f2e0db9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:03.886735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d35dd6-ef2c-4ddc-a6e3-95111f2e0db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:03.908776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-92d35dd6-ef2c-4ddc-a6e3-95111f2e0db9 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:03.909988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-92d35dd6-ef2c-4ddc-a6e3-95111f2e0db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:03.921140 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1337/2704] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:03.925291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c73251-976a-4c98-958f-52ab4e8ed43e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:03.938344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c73251-976a-4c98-958f-52ab4e8ed43e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:03.942237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5154e-b60e-4a92-b0da-0ce61ff8b894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:03.943653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5154e-b60e-4a92-b0da-0ce61ff8b894 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:03.944001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5154e-b60e-4a92-b0da-0ce61ff8b894 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:03.944340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5154e-b60e-4a92-b0da-0ce61ff8b894 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:03.945361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5154e-b60e-4a92-b0da-0ce61ff8b894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:13:03.945740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5154e-b60e-4a92-b0da-0ce61ff8b894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:03.947572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5154e-b60e-4a92-b0da-0ce61ff8b894 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:03.964426 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1368/2705] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:13:03.965532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d35dd6-ef2c-4ddc-a6e3-95111f2e0db9 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:03.975219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d35dd6-ef2c-4ddc-a6e3-95111f2e0db9 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:03.981101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6661259-c596-49b0-9e21-729f171accd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:03.981962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6661259-c596-49b0-9e21-729f171accd0 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:03.982235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6661259-c596-49b0-9e21-729f171accd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:03.984309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6661259-c596-49b0-9e21-729f171accd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:03.984309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6661259-c596-49b0-9e21-729f171accd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:03.985165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6661259-c596-49b0-9e21-729f171accd0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:04.086341 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1338/2706] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:13:03 2022] POST /identity/v3/projects => generated 407 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:13:04.090818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5154e-b60e-4a92-b0da-0ce61ff8b894 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:04.100905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5154e-b60e-4a92-b0da-0ce61ff8b894 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:04.106546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:04.159525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da647e5-f2e9-4796-8d94-3cb3e25fdab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:04.160184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da647e5-f2e9-4796-8d94-3cb3e25fdab4 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:04.160460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da647e5-f2e9-4796-8d94-3cb3e25fdab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:04.161538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da647e5-f2e9-4796-8d94-3cb3e25fdab4 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:04.162229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da647e5-f2e9-4796-8d94-3cb3e25fdab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:04.165559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da647e5-f2e9-4796-8d94-3cb3e25fdab4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:04.337844 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1369/2707] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:13:04 2022] POST /identity/v3/users => generated 304 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:13:04.343378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6661259-c596-49b0-9e21-729f171accd0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:04.354700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6661259-c596-49b0-9e21-729f171accd0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:04.359760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b961a-c987-446f-aec4-0d985117b65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:04.360429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b961a-c987-446f-aec4-0d985117b65d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:04.360713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b961a-c987-446f-aec4-0d985117b65d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:04.361018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b961a-c987-446f-aec4-0d985117b65d admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:04.361770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b961a-c987-446f-aec4-0d985117b65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:04.363705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b961a-c987-446f-aec4-0d985117b65d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:04.378045 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1339/2708] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:13:04.382265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da647e5-f2e9-4796-8d94-3cb3e25fdab4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:04.394956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da647e5-f2e9-4796-8d94-3cb3e25fdab4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:04.400616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978c52f-af37-411d-8042-bc4723240aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:04.401283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978c52f-af37-411d-8042-bc4723240aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:04.401563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978c52f-af37-411d-8042-bc4723240aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:04.402052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978c52f-af37-411d-8042-bc4723240aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:04.402823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978c52f-af37-411d-8042-bc4723240aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:04.404570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978c52f-af37-411d-8042-bc4723240aa2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:04.417967 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1370/2709] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:13:04.422829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b961a-c987-446f-aec4-0d985117b65d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:04.436065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b961a-c987-446f-aec4-0d985117b65d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:04.441273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566eff0-9319-4278-b15f-0f9a3e7654d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:04.443223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566eff0-9319-4278-b15f-0f9a3e7654d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:04.443223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566eff0-9319-4278-b15f-0f9a3e7654d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:04.444109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566eff0-9319-4278-b15f-0f9a3e7654d4 admin admin] PATH_INFO: `/v3/projects/96d95e580d4543b58779272cd43f48eb/users/702b9008184d401c855087785ce319ad/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:04.462400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566eff0-9319-4278-b15f-0f9a3e7654d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d95e580d4543b58779272cd43f48eb, user_id=702b9008184d401c855087785ce319ad, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:04.465425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566eff0-9319-4278-b15f-0f9a3e7654d4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:04.570896 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1340/2710] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:13:04 2022] PUT /identity/v3/projects/96d95e580d4543b58779272cd43f48eb/users/702b9008184d401c855087785ce319ad/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:04.581760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150348a-1e66-46e0-9e98-f24f189c0e77 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:04.582044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150348a-1e66-46e0-9e98-f24f189c0e77 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:04.582336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150348a-1e66-46e0-9e98-f24f189c0e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:04.609611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0150348a-1e66-46e0-9e98-f24f189c0e77 None None] MFA Rules not processed for user `702b9008184d401c855087785ce319ad`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:04.610722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0150348a-1e66-46e0-9e98-f24f189c0e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:04.678923 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1371/2711] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:04 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:04.684193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566eff0-9319-4278-b15f-0f9a3e7654d4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:04.763097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566eff0-9319-4278-b15f-0f9a3e7654d4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:04.774912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243a184-aee6-4380-98e5-864601202a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:04.775621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243a184-aee6-4380-98e5-864601202a3b admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:04.776180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243a184-aee6-4380-98e5-864601202a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:04.776466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243a184-aee6-4380-98e5-864601202a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:04.777997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243a184-aee6-4380-98e5-864601202a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:04.780197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243a184-aee6-4380-98e5-864601202a3b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:04.784776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:04.880624 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1341/2712] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:13:04 2022] POST /identity/v3/projects => generated 409 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:13:04.885985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150348a-1e66-46e0-9e98-f24f189c0e77 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:04.899044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150348a-1e66-46e0-9e98-f24f189c0e77 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:04.960038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20ca3e-7bfa-4e4e-9913-fd96d583bd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:04.960038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20ca3e-7bfa-4e4e-9913-fd96d583bd58 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:04.960475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20ca3e-7bfa-4e4e-9913-fd96d583bd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:04.960642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20ca3e-7bfa-4e4e-9913-fd96d583bd58 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:04.962698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20ca3e-7bfa-4e4e-9913-fd96d583bd58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:04.963419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20ca3e-7bfa-4e4e-9913-fd96d583bd58 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:05.092154 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1372/2713] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:13:04 2022] POST /identity/v3/users => generated 311 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:13:05.096044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243a184-aee6-4380-98e5-864601202a3b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:05.106470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243a184-aee6-4380-98e5-864601202a3b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:05.117048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f089881-73f3-4af4-85a4-ba269aede376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:05.117048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f089881-73f3-4af4-85a4-ba269aede376 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:05.117048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f089881-73f3-4af4-85a4-ba269aede376 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:05.117048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f089881-73f3-4af4-85a4-ba269aede376 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:05.117438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f089881-73f3-4af4-85a4-ba269aede376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:05.117438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f089881-73f3-4af4-85a4-ba269aede376 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:05.126759 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1342/2714] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:13:05.131064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20ca3e-7bfa-4e4e-9913-fd96d583bd58 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:05.142162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20ca3e-7bfa-4e4e-9913-fd96d583bd58 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:05.146908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edc1c1-9038-48cf-a0d9-ab62afe8d659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:05.147865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edc1c1-9038-48cf-a0d9-ab62afe8d659 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:05.148207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edc1c1-9038-48cf-a0d9-ab62afe8d659 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:05.148424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edc1c1-9038-48cf-a0d9-ab62afe8d659 admin admin] PATH_INFO: `/v3/projects/61f05fc0cab24be5885bd585883e2053/users/7c815676ecac4f0f89546cbaaa3c447f/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:05.165325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09edc1c1-9038-48cf-a0d9-ab62afe8d659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61f05fc0cab24be5885bd585883e2053, user_id=7c815676ecac4f0f89546cbaaa3c447f, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:05.168136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09edc1c1-9038-48cf-a0d9-ab62afe8d659 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:05.300316 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1373/2715] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:13:05 2022] PUT /identity/v3/projects/61f05fc0cab24be5885bd585883e2053/users/7c815676ecac4f0f89546cbaaa3c447f/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:05.301780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:05.316439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f089881-73f3-4af4-85a4-ba269aede376 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:05.316439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f089881-73f3-4af4-85a4-ba269aede376 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:05.383253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286f73b-c81f-4a53-97ed-e88516ced2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:05.384713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286f73b-c81f-4a53-97ed-e88516ced2ea admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:05.385000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286f73b-c81f-4a53-97ed-e88516ced2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:05.385419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286f73b-c81f-4a53-97ed-e88516ced2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:05.386161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286f73b-c81f-4a53-97ed-e88516ced2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:05.387811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286f73b-c81f-4a53-97ed-e88516ced2ea admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:05.403478 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1343/2716] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:13:05.408095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edc1c1-9038-48cf-a0d9-ab62afe8d659 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:05.419380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edc1c1-9038-48cf-a0d9-ab62afe8d659 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:05.424228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d4502-104f-41e6-939c-69cceec5b05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:05.425560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d4502-104f-41e6-939c-69cceec5b05c admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:05.426490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d4502-104f-41e6-939c-69cceec5b05c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:05.426770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d4502-104f-41e6-939c-69cceec5b05c admin admin] PATH_INFO: `/v3/projects/61f05fc0cab24be5885bd585883e2053/users/7c815676ecac4f0f89546cbaaa3c447f/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:05.428991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d4502-104f-41e6-939c-69cceec5b05c admin admin] RBAC: Authorizing `identity:create_grant(project_id=61f05fc0cab24be5885bd585883e2053, user_id=7c815676ecac4f0f89546cbaaa3c447f, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:05.432339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d4502-104f-41e6-939c-69cceec5b05c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:05.451908 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1374/2717] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:13:05 2022] PUT /identity/v3/projects/61f05fc0cab24be5885bd585883e2053/users/7c815676ecac4f0f89546cbaaa3c447f/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:05.458346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7325c71-47fe-4208-ab11-247495007ad6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:05.458456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7325c71-47fe-4208-ab11-247495007ad6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:05.458675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7325c71-47fe-4208-ab11-247495007ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:05.529231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e7325c71-47fe-4208-ab11-247495007ad6 None None] MFA Rules not processed for user `7c815676ecac4f0f89546cbaaa3c447f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:05.544548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e7325c71-47fe-4208-ab11-247495007ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:05.649548 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1344/2718] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:05 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:06.153780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d4502-104f-41e6-939c-69cceec5b05c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:06.155848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cb8d4502-104f-41e6-939c-69cceec5b05c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:06.240427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d4502-104f-41e6-939c-69cceec5b05c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:06.247405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0e48c-18b7-4bee-9997-4427001a341e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:06.248223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0e48c-18b7-4bee-9997-4427001a341e service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:06.248504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0e48c-18b7-4bee-9997-4427001a341e service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:06.249034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0e48c-18b7-4bee-9997-4427001a341e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:06.259942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0e48c-18b7-4bee-9997-4427001a341e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:06.261906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0e48c-18b7-4bee-9997-4427001a341e service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:06.278533 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1375/2719] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:06 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:13:06.288892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fc6c9-9e5e-4da5-bb2a-052799db1a94 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:06.289179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fc6c9-9e5e-4da5-bb2a-052799db1a94 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:06.289479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fc6c9-9e5e-4da5-bb2a-052799db1a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:06.312496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d22fc6c9-9e5e-4da5-bb2a-052799db1a94 None None] MFA Rules not processed for user `6a69f9dee03d43beaafa966216b9e289`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:06.313791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d22fc6c9-9e5e-4da5-bb2a-052799db1a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:06.344747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0e48c-18b7-4bee-9997-4427001a341e service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:06.344747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-31f0e48c-18b7-4bee-9997-4427001a341e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:06.362703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0e48c-18b7-4bee-9997-4427001a341e service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:06.370052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4825dc-6231-4f99-ba68-64ff9c3b4ee7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:06.370710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4825dc-6231-4f99-ba68-64ff9c3b4ee7 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:06.371206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4825dc-6231-4f99-ba68-64ff9c3b4ee7 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:06.371638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4825dc-6231-4f99-ba68-64ff9c3b4ee7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:06.381688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:06.395833 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1345/2720] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:06.439782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4825dc-6231-4f99-ba68-64ff9c3b4ee7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:06.441455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4825dc-6231-4f99-ba68-64ff9c3b4ee7 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:06.453618 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1376/2721] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:06 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:13:06.766911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fc6c9-9e5e-4da5-bb2a-052799db1a94 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:06.866638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fc6c9-9e5e-4da5-bb2a-052799db1a94 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:06.871872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdc51a-6307-4dcb-811f-64b06f4cf77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:06.872767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdc51a-6307-4dcb-811f-64b06f4cf77f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:06.873047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdc51a-6307-4dcb-811f-64b06f4cf77f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:06.873325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdc51a-6307-4dcb-811f-64b06f4cf77f admin admin] PATH_INFO: `/v3/users/702b9008184d401c855087785ce319ad` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:06.874638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdc51a-6307-4dcb-811f-64b06f4cf77f admin admin] RBAC: Authorizing `identity:delete_user(user_id=702b9008184d401c855087785ce319ad)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:06.876636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdc51a-6307-4dcb-811f-64b06f4cf77f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:07.140126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-36fdc51a-6307-4dcb-811f-64b06f4cf77f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '702b9008184d401c855087785ce319ad'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:07.152756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-36fdc51a-6307-4dcb-811f-64b06f4cf77f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '702b9008184d401c855087785ce319ad'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:07.258655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-36fdc51a-6307-4dcb-811f-64b06f4cf77f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '702b9008184d401c855087785ce319ad'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:07.272709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-36fdc51a-6307-4dcb-811f-64b06f4cf77f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '702b9008184d401c855087785ce319ad'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:07.274506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-36fdc51a-6307-4dcb-811f-64b06f4cf77f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '702b9008184d401c855087785ce319ad'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:07.281801 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1346/2722] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:13:06 2022] DELETE /identity/v3/users/702b9008184d401c855087785ce319ad => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:07.291918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfa681-04f2-41f9-a534-837e1aabcfb9 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:07.292397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfa681-04f2-41f9-a534-837e1aabcfb9 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:07.292607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfa681-04f2-41f9-a534-837e1aabcfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:07.332327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ccdfa681-04f2-41f9-a534-837e1aabcfb9 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:07.333568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ccdfa681-04f2-41f9-a534-837e1aabcfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:07.449987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:07.471196 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1377/2723] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:07.484307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdc51a-6307-4dcb-811f-64b06f4cf77f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:07.488530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-36fdc51a-6307-4dcb-811f-64b06f4cf77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:07.590693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdc51a-6307-4dcb-811f-64b06f4cf77f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:07.595455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0e708-6d98-43ab-ac29-4a620c968d6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:07.596158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0e708-6d98-43ab-ac29-4a620c968d6b service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:07.596445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0e708-6d98-43ab-ac29-4a620c968d6b service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:07.596724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0e708-6d98-43ab-ac29-4a620c968d6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:07.635451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0e708-6d98-43ab-ac29-4a620c968d6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:07.637989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0e708-6d98-43ab-ac29-4a620c968d6b service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:07.666152 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1347/2724] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:13:08.230535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfa681-04f2-41f9-a534-837e1aabcfb9 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:08.232527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ccdfa681-04f2-41f9-a534-837e1aabcfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:08.255230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfa681-04f2-41f9-a534-837e1aabcfb9 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:08.267109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407122d-d600-48d6-af8f-80ca5bab04b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:08.268228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407122d-d600-48d6-af8f-80ca5bab04b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:08.269638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407122d-d600-48d6-af8f-80ca5bab04b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:08.269933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407122d-d600-48d6-af8f-80ca5bab04b8 admin admin] PATH_INFO: `/v3/projects/96d95e580d4543b58779272cd43f48eb` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:08.272197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407122d-d600-48d6-af8f-80ca5bab04b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d95e580d4543b58779272cd43f48eb)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:08.277210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407122d-d600-48d6-af8f-80ca5bab04b8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:08.426721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6407122d-d600-48d6-af8f-80ca5bab04b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d95e580d4543b58779272cd43f48eb', 'request_id': 'req-6407122d-d600-48d6-af8f-80ca5bab04b8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:08.435175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6407122d-d600-48d6-af8f-80ca5bab04b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d95e580d4543b58779272cd43f48eb', 'request_id': 'req-6407122d-d600-48d6-af8f-80ca5bab04b8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:08.441865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6407122d-d600-48d6-af8f-80ca5bab04b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d95e580d4543b58779272cd43f48eb', 'request_id': 'req-6407122d-d600-48d6-af8f-80ca5bab04b8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:08.542365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6407122d-d600-48d6-af8f-80ca5bab04b8 admin admin] The token cache is being invalidate because project 96d95e580d4543b58779272cd43f48eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:13:08.542913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6407122d-d600-48d6-af8f-80ca5bab04b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:08.543984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6407122d-d600-48d6-af8f-80ca5bab04b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:08.547061 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1378/2725] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:13:08 2022] DELETE /identity/v3/projects/96d95e580d4543b58779272cd43f48eb => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:08.550700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0e708-6d98-43ab-ac29-4a620c968d6b service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:08.563954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0e708-6d98-43ab-ac29-4a620c968d6b service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:08.594506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:08.642286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97a2f8-e1cf-4019-a361-66d7694a8f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:08.643574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97a2f8-e1cf-4019-a361-66d7694a8f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:08.644153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97a2f8-e1cf-4019-a361-66d7694a8f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:08.644693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97a2f8-e1cf-4019-a361-66d7694a8f0e admin admin] PATH_INFO: `/v3/users/7c815676ecac4f0f89546cbaaa3c447f` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:08.646305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97a2f8-e1cf-4019-a361-66d7694a8f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c815676ecac4f0f89546cbaaa3c447f)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:08.649091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97a2f8-e1cf-4019-a361-66d7694a8f0e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:08.959963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7e97a2f8-e1cf-4019-a361-66d7694a8f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c815676ecac4f0f89546cbaaa3c447f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:08.979904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7e97a2f8-e1cf-4019-a361-66d7694a8f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c815676ecac4f0f89546cbaaa3c447f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:09.101672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7e97a2f8-e1cf-4019-a361-66d7694a8f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c815676ecac4f0f89546cbaaa3c447f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:09.113949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7e97a2f8-e1cf-4019-a361-66d7694a8f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c815676ecac4f0f89546cbaaa3c447f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:09.114995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7e97a2f8-e1cf-4019-a361-66d7694a8f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c815676ecac4f0f89546cbaaa3c447f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:09.124638 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1348/2726] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:13:08 2022] DELETE /identity/v3/users/7c815676ecac4f0f89546cbaaa3c447f => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:09.748441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407122d-d600-48d6-af8f-80ca5bab04b8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:09.751111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6407122d-d600-48d6-af8f-80ca5bab04b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:09.768735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407122d-d600-48d6-af8f-80ca5bab04b8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:09.905667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c65198-ec3c-4253-978b-ddb8fb2392a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:09.906534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65198-ec3c-4253-978b-ddb8fb2392a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:09.909568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65198-ec3c-4253-978b-ddb8fb2392a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:09.909927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65198-ec3c-4253-978b-ddb8fb2392a9 admin admin] PATH_INFO: `/v3/projects/61f05fc0cab24be5885bd585883e2053` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:09.911885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c65198-ec3c-4253-978b-ddb8fb2392a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61f05fc0cab24be5885bd585883e2053)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:09.915921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c65198-ec3c-4253-978b-ddb8fb2392a9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:10.092451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-79c65198-ec3c-4253-978b-ddb8fb2392a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61f05fc0cab24be5885bd585883e2053', 'request_id': 'req-79c65198-ec3c-4253-978b-ddb8fb2392a9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:10.100018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-79c65198-ec3c-4253-978b-ddb8fb2392a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61f05fc0cab24be5885bd585883e2053', 'request_id': 'req-79c65198-ec3c-4253-978b-ddb8fb2392a9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:10.112616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-79c65198-ec3c-4253-978b-ddb8fb2392a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61f05fc0cab24be5885bd585883e2053', 'request_id': 'req-79c65198-ec3c-4253-978b-ddb8fb2392a9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:10.188017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-79c65198-ec3c-4253-978b-ddb8fb2392a9 admin admin] The token cache is being invalidate because project 61f05fc0cab24be5885bd585883e2053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:13:10.188815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-79c65198-ec3c-4253-978b-ddb8fb2392a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:10.190649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-79c65198-ec3c-4253-978b-ddb8fb2392a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:10.196448 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1379/2727] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:13:09 2022] DELETE /identity/v3/projects/61f05fc0cab24be5885bd585883e2053 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:10.198688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8f337-11f2-4fb0-a70e-799bef1ec9d2 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:10.199211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8f337-11f2-4fb0-a70e-799bef1ec9d2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:10.199333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8f337-11f2-4fb0-a70e-799bef1ec9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:10.220788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c0d8f337-11f2-4fb0-a70e-799bef1ec9d2 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:10.222085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c0d8f337-11f2-4fb0-a70e-799bef1ec9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:10.311120 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1349/2728] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:10.320149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d3e52-65f5-417b-8d6a-8d735cc4b8d4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:10.320456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d3e52-65f5-417b-8d6a-8d735cc4b8d4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:10.320733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d3e52-65f5-417b-8d6a-8d735cc4b8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:10.339940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:10.348268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-183d3e52-65f5-417b-8d6a-8d735cc4b8d4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:10.349492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-183d3e52-65f5-417b-8d6a-8d735cc4b8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:10.363491 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1380/2729] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:10.365592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8f337-11f2-4fb0-a70e-799bef1ec9d2 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:10.379210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8f337-11f2-4fb0-a70e-799bef1ec9d2 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:10.385051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8b95b-6a4c-4788-be75-6b3822db9c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:10.385885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8b95b-6a4c-4788-be75-6b3822db9c0b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:10.386179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8b95b-6a4c-4788-be75-6b3822db9c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:10.386457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8b95b-6a4c-4788-be75-6b3822db9c0b admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:10.387514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8b95b-6a4c-4788-be75-6b3822db9c0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:13:10.387832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8b95b-6a4c-4788-be75-6b3822db9c0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:10.390034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8b95b-6a4c-4788-be75-6b3822db9c0b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:10.406840 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1350/2730] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:13:10.416013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d3e52-65f5-417b-8d6a-8d735cc4b8d4 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:10.430578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d3e52-65f5-417b-8d6a-8d735cc4b8d4 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:10.438823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b284760-7041-4a03-8611-01663043ec82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:10.439988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b284760-7041-4a03-8611-01663043ec82 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:10.440736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b284760-7041-4a03-8611-01663043ec82 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:10.441180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b284760-7041-4a03-8611-01663043ec82 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:10.442871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b284760-7041-4a03-8611-01663043ec82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:10.446115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b284760-7041-4a03-8611-01663043ec82 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:10.556630 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1381/2731] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:13:10 2022] POST /identity/v3/projects => generated 393 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:13:10.561148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8b95b-6a4c-4788-be75-6b3822db9c0b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:10.572930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8b95b-6a4c-4788-be75-6b3822db9c0b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:10.627716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:10.679778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152d9ba-0e08-466d-ab18-a52eb1383109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:10.680750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152d9ba-0e08-466d-ab18-a52eb1383109 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:10.681341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152d9ba-0e08-466d-ab18-a52eb1383109 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:10.681681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152d9ba-0e08-466d-ab18-a52eb1383109 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:10.682606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152d9ba-0e08-466d-ab18-a52eb1383109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:10.685012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152d9ba-0e08-466d-ab18-a52eb1383109 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:10.796112 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1351/2732] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:13:10 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:13:10.803615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b284760-7041-4a03-8611-01663043ec82 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:10.824945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b284760-7041-4a03-8611-01663043ec82 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:10.831959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c692eb6-10fe-4a45-b376-2614e01b0dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:10.832645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c692eb6-10fe-4a45-b376-2614e01b0dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:10.832944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c692eb6-10fe-4a45-b376-2614e01b0dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:10.833208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c692eb6-10fe-4a45-b376-2614e01b0dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:10.833940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c692eb6-10fe-4a45-b376-2614e01b0dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:10.841012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c692eb6-10fe-4a45-b376-2614e01b0dd9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:10.863952 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1382/2733] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:13:10.869089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152d9ba-0e08-466d-ab18-a52eb1383109 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:10.883727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152d9ba-0e08-466d-ab18-a52eb1383109 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:10.892433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86309bb6-0c0a-4db3-ae25-db7e8beafc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:10.894368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86309bb6-0c0a-4db3-ae25-db7e8beafc2b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:10.896210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86309bb6-0c0a-4db3-ae25-db7e8beafc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:10.900713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86309bb6-0c0a-4db3-ae25-db7e8beafc2b admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:10.901609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86309bb6-0c0a-4db3-ae25-db7e8beafc2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:10.921113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86309bb6-0c0a-4db3-ae25-db7e8beafc2b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:10.957756 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1352/2734] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:13:10.958925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c692eb6-10fe-4a45-b376-2614e01b0dd9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:10.973159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c692eb6-10fe-4a45-b376-2614e01b0dd9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:10.981456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98b259-e5a4-40df-a0b0-1caacf01ba1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:10.983548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98b259-e5a4-40df-a0b0-1caacf01ba1e admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:10.983868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98b259-e5a4-40df-a0b0-1caacf01ba1e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:10.984132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98b259-e5a4-40df-a0b0-1caacf01ba1e admin admin] PATH_INFO: `/v3/projects/c9c8dc8ef2ad4bffbaf3b6b837c569b9/users/7df7e10e748644f69d80d85195f81dba/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:11.005737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98b259-e5a4-40df-a0b0-1caacf01ba1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c8dc8ef2ad4bffbaf3b6b837c569b9, user_id=7df7e10e748644f69d80d85195f81dba, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:11.009744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98b259-e5a4-40df-a0b0-1caacf01ba1e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:11.090150 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1383/2735] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:13:10 2022] PUT /identity/v3/projects/c9c8dc8ef2ad4bffbaf3b6b837c569b9/users/7df7e10e748644f69d80d85195f81dba/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:11.102356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e5b34-a44d-4972-bf5a-e78d542d296d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:11.103266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e5b34-a44d-4972-bf5a-e78d542d296d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:11.103728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e5b34-a44d-4972-bf5a-e78d542d296d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:11.137616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f60e5b34-a44d-4972-bf5a-e78d542d296d None None] MFA Rules not processed for user `7df7e10e748644f69d80d85195f81dba`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:11.139031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f60e5b34-a44d-4972-bf5a-e78d542d296d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:11.282257 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1353/2736] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:11.292679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98b259-e5a4-40df-a0b0-1caacf01ba1e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:11.303797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e5b34-a44d-4972-bf5a-e78d542d296d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:11.309530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f60e5b34-a44d-4972-bf5a-e78d542d296d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:11.426137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98b259-e5a4-40df-a0b0-1caacf01ba1e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:11.435588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a8a75-8c84-4ee6-9bdb-316515a52fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:11.436386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a8a75-8c84-4ee6-9bdb-316515a52fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:11.436668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a8a75-8c84-4ee6-9bdb-316515a52fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:11.436938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a8a75-8c84-4ee6-9bdb-316515a52fd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:11.437632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a8a75-8c84-4ee6-9bdb-316515a52fd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:11.440026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a8a75-8c84-4ee6-9bdb-316515a52fd7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:11.509052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e5b34-a44d-4972-bf5a-e78d542d296d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:11.518423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fc0ef-0006-4513-b909-7915e60bccec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:11.519124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fc0ef-0006-4513-b909-7915e60bccec service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:11.519406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fc0ef-0006-4513-b909-7915e60bccec service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:11.519704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fc0ef-0006-4513-b909-7915e60bccec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:11.526223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-499fc0ef-0006-4513-b909-7915e60bccec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:11.640656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fc0ef-0006-4513-b909-7915e60bccec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:11.642283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fc0ef-0006-4513-b909-7915e60bccec service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:11.669592 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1354/2737] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:11 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:13:11.845894 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1384/2738] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:13:11 2022] POST /identity/v3/projects => generated 391 bytes in 556 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:13:11.850415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fc0ef-0006-4513-b909-7915e60bccec service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:11.871310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fc0ef-0006-4513-b909-7915e60bccec service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:11.983827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea754943-3dce-4ad3-88b7-5dd0dd6a95c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:11.988984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea754943-3dce-4ad3-88b7-5dd0dd6a95c8 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:11.989294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea754943-3dce-4ad3-88b7-5dd0dd6a95c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:11.989583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea754943-3dce-4ad3-88b7-5dd0dd6a95c8 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:11.993584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea754943-3dce-4ad3-88b7-5dd0dd6a95c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:11.998174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea754943-3dce-4ad3-88b7-5dd0dd6a95c8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:12.097415 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1355/2739] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:13:11 2022] POST /identity/v3/users => generated 302 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:13:12.101488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a8a75-8c84-4ee6-9bdb-316515a52fd7 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:12.114253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a8a75-8c84-4ee6-9bdb-316515a52fd7 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:12.122722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdea8e-caee-4d4e-94da-90a8819b54a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:12.123441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdea8e-caee-4d4e-94da-90a8819b54a5 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:12.126016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdea8e-caee-4d4e-94da-90a8819b54a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:12.126016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdea8e-caee-4d4e-94da-90a8819b54a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:12.126016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdea8e-caee-4d4e-94da-90a8819b54a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:12.130561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdea8e-caee-4d4e-94da-90a8819b54a5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:12.159543 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1385/2740] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:13:12.160612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea754943-3dce-4ad3-88b7-5dd0dd6a95c8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:12.190405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea754943-3dce-4ad3-88b7-5dd0dd6a95c8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:12.212724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065bda8-50d6-4021-b2ae-86b889edcd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:12.214999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065bda8-50d6-4021-b2ae-86b889edcd9b admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:12.221986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065bda8-50d6-4021-b2ae-86b889edcd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:12.221986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065bda8-50d6-4021-b2ae-86b889edcd9b admin admin] PATH_INFO: `/v3/projects/5c54651ad88c4649a702e18ed8f73c0f/users/ba95e60c421f48ccbb937981cbfd9957/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:12.263329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065bda8-50d6-4021-b2ae-86b889edcd9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c54651ad88c4649a702e18ed8f73c0f, user_id=ba95e60c421f48ccbb937981cbfd9957, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:12.270558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065bda8-50d6-4021-b2ae-86b889edcd9b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:12.354522 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1356/2741] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:13:12 2022] PUT /identity/v3/projects/5c54651ad88c4649a702e18ed8f73c0f/users/ba95e60c421f48ccbb937981cbfd9957/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:12.358803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdea8e-caee-4d4e-94da-90a8819b54a5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:12.377512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdea8e-caee-4d4e-94da-90a8819b54a5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:12.534017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273fc60-3c14-481c-ad3e-7b714d8e49af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:12.534689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273fc60-3c14-481c-ad3e-7b714d8e49af admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:12.534982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273fc60-3c14-481c-ad3e-7b714d8e49af admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:12.535291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273fc60-3c14-481c-ad3e-7b714d8e49af admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:12.536013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273fc60-3c14-481c-ad3e-7b714d8e49af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:12.537638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273fc60-3c14-481c-ad3e-7b714d8e49af admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:12.555776 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1386/2742] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:13:12.560203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065bda8-50d6-4021-b2ae-86b889edcd9b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:12.572699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065bda8-50d6-4021-b2ae-86b889edcd9b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:12.580540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ac50c-4a91-4d59-8e8d-80de7db9fe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:12.581725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ac50c-4a91-4d59-8e8d-80de7db9fe17 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:12.582025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ac50c-4a91-4d59-8e8d-80de7db9fe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:12.582296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ac50c-4a91-4d59-8e8d-80de7db9fe17 admin admin] PATH_INFO: `/v3/projects/5c54651ad88c4649a702e18ed8f73c0f/users/ba95e60c421f48ccbb937981cbfd9957/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:12.584743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ac50c-4a91-4d59-8e8d-80de7db9fe17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c54651ad88c4649a702e18ed8f73c0f, user_id=ba95e60c421f48ccbb937981cbfd9957, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:12.598765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ac50c-4a91-4d59-8e8d-80de7db9fe17 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:12.626334 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1357/2743] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:13:12 2022] PUT /identity/v3/projects/5c54651ad88c4649a702e18ed8f73c0f/users/ba95e60c421f48ccbb937981cbfd9957/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:13:12.627696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044399c-7edb-4f33-ae2d-b6d281f6ba07 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:12.628081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044399c-7edb-4f33-ae2d-b6d281f6ba07 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:12.628320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044399c-7edb-4f33-ae2d-b6d281f6ba07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:12.677504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2044399c-7edb-4f33-ae2d-b6d281f6ba07 None None] MFA Rules not processed for user `ba95e60c421f48ccbb937981cbfd9957`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:12.679550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2044399c-7edb-4f33-ae2d-b6d281f6ba07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:12.777138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:12.838433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ac50c-4a91-4d59-8e8d-80de7db9fe17 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:12.841245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e30ac50c-4a91-4d59-8e8d-80de7db9fe17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:12.873888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:12.912692 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1387/2744] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:12.992952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044399c-7edb-4f33-ae2d-b6d281f6ba07 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:12.995268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2044399c-7edb-4f33-ae2d-b6d281f6ba07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:13.014174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ac50c-4a91-4d59-8e8d-80de7db9fe17 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:13.022017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f929bf7-2f8a-49fe-b5ed-c6895e97622a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:13.023476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f929bf7-2f8a-49fe-b5ed-c6895e97622a service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:13.023834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f929bf7-2f8a-49fe-b5ed-c6895e97622a service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:13.024329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f929bf7-2f8a-49fe-b5ed-c6895e97622a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:13.027000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7f929bf7-2f8a-49fe-b5ed-c6895e97622a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:13.132540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044399c-7edb-4f33-ae2d-b6d281f6ba07 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:13.143250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4aed2c-9526-4d93-bf1b-9a83bfb7178d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:13.144794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4aed2c-9526-4d93-bf1b-9a83bfb7178d service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:13.144794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4aed2c-9526-4d93-bf1b-9a83bfb7178d service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:13.146950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4aed2c-9526-4d93-bf1b-9a83bfb7178d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:13.157961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4aed2c-9526-4d93-bf1b-9a83bfb7178d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:13.159900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4aed2c-9526-4d93-bf1b-9a83bfb7178d service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:13.172977 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1388/2745] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:13:13.187756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f929bf7-2f8a-49fe-b5ed-c6895e97622a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:13.189631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f929bf7-2f8a-49fe-b5ed-c6895e97622a service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:13.215919 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1358/2746] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:13:13.251156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4aed2c-9526-4d93-bf1b-9a83bfb7178d service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:13.331574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4aed2c-9526-4d93-bf1b-9a83bfb7178d service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:13.339860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db3659-d3d7-4ede-bf96-3069a41ef516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:13.340928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db3659-d3d7-4ede-bf96-3069a41ef516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:13.341272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db3659-d3d7-4ede-bf96-3069a41ef516 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:13.341612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db3659-d3d7-4ede-bf96-3069a41ef516 admin admin] PATH_INFO: `/v3/users/7df7e10e748644f69d80d85195f81dba` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:13.347733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db3659-d3d7-4ede-bf96-3069a41ef516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7df7e10e748644f69d80d85195f81dba)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:13.347733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db3659-d3d7-4ede-bf96-3069a41ef516 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:13.479933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:13.569916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-06db3659-d3d7-4ede-bf96-3069a41ef516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7df7e10e748644f69d80d85195f81dba'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:13.579652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-06db3659-d3d7-4ede-bf96-3069a41ef516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7df7e10e748644f69d80d85195f81dba'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:13.719302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-06db3659-d3d7-4ede-bf96-3069a41ef516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7df7e10e748644f69d80d85195f81dba'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:13.720024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-06db3659-d3d7-4ede-bf96-3069a41ef516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7df7e10e748644f69d80d85195f81dba'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:13.736658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:13.749846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-06db3659-d3d7-4ede-bf96-3069a41ef516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7df7e10e748644f69d80d85195f81dba'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:13.768454 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1389/2747] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:13:13 2022] DELETE /identity/v3/users/7df7e10e748644f69d80d85195f81dba => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:13.773850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278db56-aacb-4a2b-8d79-c131e24fa719 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:13.774592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278db56-aacb-4a2b-8d79-c131e24fa719 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:13.775153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278db56-aacb-4a2b-8d79-c131e24fa719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:13.829652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e278db56-aacb-4a2b-8d79-c131e24fa719 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:13.831262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e278db56-aacb-4a2b-8d79-c131e24fa719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:13.937909 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1359/2748] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:13:13.947889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db3659-d3d7-4ede-bf96-3069a41ef516 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:13.949638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-06db3659-d3d7-4ede-bf96-3069a41ef516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:14.075096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db3659-d3d7-4ede-bf96-3069a41ef516 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:14.083772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d63c7-8096-4e35-8049-29f6508d1db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:14.084797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d63c7-8096-4e35-8049-29f6508d1db4 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:14.085821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d63c7-8096-4e35-8049-29f6508d1db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:14.086331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d63c7-8096-4e35-8049-29f6508d1db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:14.108588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d63c7-8096-4e35-8049-29f6508d1db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:14.111309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d63c7-8096-4e35-8049-29f6508d1db4 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:14.134965 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1390/2749] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:13:15.022610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278db56-aacb-4a2b-8d79-c131e24fa719 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:15.022610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e278db56-aacb-4a2b-8d79-c131e24fa719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:15.057552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278db56-aacb-4a2b-8d79-c131e24fa719 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:15.062251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06784c87-5538-4f79-b52b-a059a586c5e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:15.062921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06784c87-5538-4f79-b52b-a059a586c5e2 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:15.063228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06784c87-5538-4f79-b52b-a059a586c5e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:15.063880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06784c87-5538-4f79-b52b-a059a586c5e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:15.068375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-06784c87-5538-4f79-b52b-a059a586c5e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:15.193242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06784c87-5538-4f79-b52b-a059a586c5e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:15.197344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06784c87-5538-4f79-b52b-a059a586c5e2 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:15.218578 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1360/2750] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:13:15.246189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d63c7-8096-4e35-8049-29f6508d1db4 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:15.253564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-010d63c7-8096-4e35-8049-29f6508d1db4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:15.271153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d63c7-8096-4e35-8049-29f6508d1db4 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:15.282525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc45dc-3566-4a4b-a477-dc7d750a1103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:15.282525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc45dc-3566-4a4b-a477-dc7d750a1103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:15.282525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc45dc-3566-4a4b-a477-dc7d750a1103 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:15.282525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc45dc-3566-4a4b-a477-dc7d750a1103 admin admin] PATH_INFO: `/v3/users/2dfcad8d2b57481bb33aa8f5d7483c51` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:15.283164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc45dc-3566-4a4b-a477-dc7d750a1103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dfcad8d2b57481bb33aa8f5d7483c51)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:15.283466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc45dc-3566-4a4b-a477-dc7d750a1103 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:15.547407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-84fc45dc-3566-4a4b-a477-dc7d750a1103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dfcad8d2b57481bb33aa8f5d7483c51'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:15.573125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-84fc45dc-3566-4a4b-a477-dc7d750a1103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dfcad8d2b57481bb33aa8f5d7483c51'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:15.667495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-84fc45dc-3566-4a4b-a477-dc7d750a1103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dfcad8d2b57481bb33aa8f5d7483c51'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:15.667495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-84fc45dc-3566-4a4b-a477-dc7d750a1103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dfcad8d2b57481bb33aa8f5d7483c51'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:15.686479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-84fc45dc-3566-4a4b-a477-dc7d750a1103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dfcad8d2b57481bb33aa8f5d7483c51'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:15.698452 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1391/2751] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:13:15 2022] DELETE /identity/v3/users/2dfcad8d2b57481bb33aa8f5d7483c51 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:15.872127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06784c87-5538-4f79-b52b-a059a586c5e2 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:15.873634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-06784c87-5538-4f79-b52b-a059a586c5e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:15.900451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06784c87-5538-4f79-b52b-a059a586c5e2 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:16.056797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:16.095826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d09fd-5102-4932-aa64-7e2783413995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:16.096709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d09fd-5102-4932-aa64-7e2783413995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:16.096985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d09fd-5102-4932-aa64-7e2783413995 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:16.097302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d09fd-5102-4932-aa64-7e2783413995 admin admin] PATH_INFO: `/v3/projects/c9c8dc8ef2ad4bffbaf3b6b837c569b9` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:16.098501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d09fd-5102-4932-aa64-7e2783413995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c8dc8ef2ad4bffbaf3b6b837c569b9)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:16.101040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d09fd-5102-4932-aa64-7e2783413995 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:16.262382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1b3d09fd-5102-4932-aa64-7e2783413995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c8dc8ef2ad4bffbaf3b6b837c569b9', 'request_id': 'req-1b3d09fd-5102-4932-aa64-7e2783413995'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:16.298916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1b3d09fd-5102-4932-aa64-7e2783413995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c8dc8ef2ad4bffbaf3b6b837c569b9', 'request_id': 'req-1b3d09fd-5102-4932-aa64-7e2783413995'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:16.301563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1b3d09fd-5102-4932-aa64-7e2783413995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c8dc8ef2ad4bffbaf3b6b837c569b9', 'request_id': 'req-1b3d09fd-5102-4932-aa64-7e2783413995'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:16.404724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1b3d09fd-5102-4932-aa64-7e2783413995 admin admin] The token cache is being invalidate because project c9c8dc8ef2ad4bffbaf3b6b837c569b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:13:16.404724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1b3d09fd-5102-4932-aa64-7e2783413995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:16.405332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1b3d09fd-5102-4932-aa64-7e2783413995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:16.406904 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1361/2752] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:13:15 2022] DELETE /identity/v3/projects/c9c8dc8ef2ad4bffbaf3b6b837c569b9 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:16.411191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc45dc-3566-4a4b-a477-dc7d750a1103 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:16.412756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-84fc45dc-3566-4a4b-a477-dc7d750a1103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:16.428249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc45dc-3566-4a4b-a477-dc7d750a1103 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:16.443730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:16.464907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d09fd-5102-4932-aa64-7e2783413995 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:16.467760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1b3d09fd-5102-4932-aa64-7e2783413995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:16.559937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c766e90-26c6-4509-a8fc-6e7e675fbdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:16.562407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c766e90-26c6-4509-a8fc-6e7e675fbdb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:16.565065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c766e90-26c6-4509-a8fc-6e7e675fbdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:16.565381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c766e90-26c6-4509-a8fc-6e7e675fbdb8 admin admin] PATH_INFO: `/v3/users/ba95e60c421f48ccbb937981cbfd9957` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:16.583129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c766e90-26c6-4509-a8fc-6e7e675fbdb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba95e60c421f48ccbb937981cbfd9957)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:16.592270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c766e90-26c6-4509-a8fc-6e7e675fbdb8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:16.601589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d09fd-5102-4932-aa64-7e2783413995 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:16.607597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06050d4e-09aa-4a60-8c42-0f3afb97054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:16.608590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06050d4e-09aa-4a60-8c42-0f3afb97054c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:16.608933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06050d4e-09aa-4a60-8c42-0f3afb97054c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:16.609217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06050d4e-09aa-4a60-8c42-0f3afb97054c admin admin] PATH_INFO: `/v3/projects/cda86413e74b4c1e8e09bd4df4926664` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:16.610661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06050d4e-09aa-4a60-8c42-0f3afb97054c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cda86413e74b4c1e8e09bd4df4926664)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:16.612686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06050d4e-09aa-4a60-8c42-0f3afb97054c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:16.894545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-06050d4e-09aa-4a60-8c42-0f3afb97054c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cda86413e74b4c1e8e09bd4df4926664', 'request_id': 'req-06050d4e-09aa-4a60-8c42-0f3afb97054c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:16.898403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3c766e90-26c6-4509-a8fc-6e7e675fbdb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba95e60c421f48ccbb937981cbfd9957'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:16.904386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-06050d4e-09aa-4a60-8c42-0f3afb97054c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cda86413e74b4c1e8e09bd4df4926664', 'request_id': 'req-06050d4e-09aa-4a60-8c42-0f3afb97054c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:16.910955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-06050d4e-09aa-4a60-8c42-0f3afb97054c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cda86413e74b4c1e8e09bd4df4926664', 'request_id': 'req-06050d4e-09aa-4a60-8c42-0f3afb97054c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:16.912299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3c766e90-26c6-4509-a8fc-6e7e675fbdb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba95e60c421f48ccbb937981cbfd9957'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:17.117684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-06050d4e-09aa-4a60-8c42-0f3afb97054c admin admin] The token cache is being invalidate because project cda86413e74b4c1e8e09bd4df4926664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:13:17.118248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-06050d4e-09aa-4a60-8c42-0f3afb97054c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:17.119325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-06050d4e-09aa-4a60-8c42-0f3afb97054c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:17.125755 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1362/2753] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:13:16 2022] DELETE /identity/v3/projects/cda86413e74b4c1e8e09bd4df4926664 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:17.128324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978eda0-e3f1-446a-b822-32e4c00ae01f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:17.128613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978eda0-e3f1-446a-b822-32e4c00ae01f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:17.129088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978eda0-e3f1-446a-b822-32e4c00ae01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:17.180083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8978eda0-e3f1-446a-b822-32e4c00ae01f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:17.181603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8978eda0-e3f1-446a-b822-32e4c00ae01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:17.192720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:17.198546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3c766e90-26c6-4509-a8fc-6e7e675fbdb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba95e60c421f48ccbb937981cbfd9957'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:17.199203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3c766e90-26c6-4509-a8fc-6e7e675fbdb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba95e60c421f48ccbb937981cbfd9957'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:17.224084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3c766e90-26c6-4509-a8fc-6e7e675fbdb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba95e60c421f48ccbb937981cbfd9957'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:17.236820 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1392/2754] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:13:16 2022] DELETE /identity/v3/users/ba95e60c421f48ccbb937981cbfd9957 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:17.323833 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1363/2755] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:17.332091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7ec27-a9ba-4726-b2d5-c2ca75e05949 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:17.333318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7ec27-a9ba-4726-b2d5-c2ca75e05949 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:17.334104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7ec27-a9ba-4726-b2d5-c2ca75e05949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:17.374708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d6d7ec27-a9ba-4726-b2d5-c2ca75e05949 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:17.377238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d6d7ec27-a9ba-4726-b2d5-c2ca75e05949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:17.522038 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1393/2756] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:17.526492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978eda0-e3f1-446a-b822-32e4c00ae01f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:17.548398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978eda0-e3f1-446a-b822-32e4c00ae01f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:17.554186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45a6bc-ec7a-4b30-9cef-285d63478f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:17.554869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45a6bc-ec7a-4b30-9cef-285d63478f41 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:17.555197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45a6bc-ec7a-4b30-9cef-285d63478f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:17.560372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45a6bc-ec7a-4b30-9cef-285d63478f41 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:17.560372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45a6bc-ec7a-4b30-9cef-285d63478f41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:13:17.560372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45a6bc-ec7a-4b30-9cef-285d63478f41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:17.560372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45a6bc-ec7a-4b30-9cef-285d63478f41 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:17.570690 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1364/2757] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:13:17.575140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7ec27-a9ba-4726-b2d5-c2ca75e05949 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:17.584561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7ec27-a9ba-4726-b2d5-c2ca75e05949 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:17.590143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22433acb-29cc-405b-9d83-39c935717cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:17.590805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22433acb-29cc-405b-9d83-39c935717cfb admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:17.591150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22433acb-29cc-405b-9d83-39c935717cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:17.591424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22433acb-29cc-405b-9d83-39c935717cfb admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:17.592121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22433acb-29cc-405b-9d83-39c935717cfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:17.594018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22433acb-29cc-405b-9d83-39c935717cfb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:17.732378 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1394/2758] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:13:17 2022] POST /identity/v3/projects => generated 413 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:13:17.733133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45a6bc-ec7a-4b30-9cef-285d63478f41 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:17.744453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45a6bc-ec7a-4b30-9cef-285d63478f41 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:17.844099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacff59b-b028-4c26-94c3-6d9267d2154f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:17.844863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacff59b-b028-4c26-94c3-6d9267d2154f admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:17.845216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacff59b-b028-4c26-94c3-6d9267d2154f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:17.845567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacff59b-b028-4c26-94c3-6d9267d2154f admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:17.846338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacff59b-b028-4c26-94c3-6d9267d2154f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:17.848654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacff59b-b028-4c26-94c3-6d9267d2154f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:18.011132 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1365/2759] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:13:17 2022] POST /identity/v3/users => generated 307 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:13:18.015943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22433acb-29cc-405b-9d83-39c935717cfb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:18.027817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22433acb-29cc-405b-9d83-39c935717cfb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:18.033461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544494d-acba-4b58-9419-5092fc0d4625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:18.034186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544494d-acba-4b58-9419-5092fc0d4625 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:18.034496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544494d-acba-4b58-9419-5092fc0d4625 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:18.034775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544494d-acba-4b58-9419-5092fc0d4625 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:18.035532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544494d-acba-4b58-9419-5092fc0d4625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:18.037205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544494d-acba-4b58-9419-5092fc0d4625 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:18.048939 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1395/2760] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:13:18.053080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacff59b-b028-4c26-94c3-6d9267d2154f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:18.066498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacff59b-b028-4c26-94c3-6d9267d2154f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:18.072272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad2e2f-3499-4c4e-bb0e-3d9a31425b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:18.072974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad2e2f-3499-4c4e-bb0e-3d9a31425b19 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:18.073253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad2e2f-3499-4c4e-bb0e-3d9a31425b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:18.073524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad2e2f-3499-4c4e-bb0e-3d9a31425b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:18.074303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad2e2f-3499-4c4e-bb0e-3d9a31425b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:18.075917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad2e2f-3499-4c4e-bb0e-3d9a31425b19 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:18.087701 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1366/2761] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:13:18.091845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544494d-acba-4b58-9419-5092fc0d4625 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:18.098738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:18.106334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544494d-acba-4b58-9419-5092fc0d4625 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:18.108310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45699c27-5ea5-4077-bedd-2262d13f160b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:18.109309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45699c27-5ea5-4077-bedd-2262d13f160b admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:18.111099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45699c27-5ea5-4077-bedd-2262d13f160b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:18.111099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45699c27-5ea5-4077-bedd-2262d13f160b admin admin] PATH_INFO: `/v3/projects/6c2095f96f8d45bb9e62c517678c3dcd/users/2eba2ac21c344394a7d3f605775b8713/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:18.127657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45699c27-5ea5-4077-bedd-2262d13f160b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2095f96f8d45bb9e62c517678c3dcd, user_id=2eba2ac21c344394a7d3f605775b8713, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:18.130563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45699c27-5ea5-4077-bedd-2262d13f160b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:18.207421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad2e2f-3499-4c4e-bb0e-3d9a31425b19 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:18.212335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f0ad2e2f-3499-4c4e-bb0e-3d9a31425b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:18.229107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad2e2f-3499-4c4e-bb0e-3d9a31425b19 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:18.231894 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1396/2762] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:13:18 2022] PUT /identity/v3/projects/6c2095f96f8d45bb9e62c517678c3dcd/users/2eba2ac21c344394a7d3f605775b8713/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:18.233249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127bf14-e126-412d-91e2-cc407b5bc521 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:18.233933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127bf14-e126-412d-91e2-cc407b5bc521 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:18.233933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127bf14-e126-412d-91e2-cc407b5bc521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:18.274105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e127bf14-e126-412d-91e2-cc407b5bc521 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:18.275718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e127bf14-e126-412d-91e2-cc407b5bc521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:18.351458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6b33d-3f29-426a-902e-6b06d1eba056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:18.352543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6b33d-3f29-426a-902e-6b06d1eba056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:18.353451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6b33d-3f29-426a-902e-6b06d1eba056 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:18.354808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6b33d-3f29-426a-902e-6b06d1eba056 admin admin] PATH_INFO: `/v3/projects/5c54651ad88c4649a702e18ed8f73c0f` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:18.356111 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1397/2763] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:18.357056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127bf14-e126-412d-91e2-cc407b5bc521 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:18.363354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6b33d-3f29-426a-902e-6b06d1eba056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c54651ad88c4649a702e18ed8f73c0f)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:18.363760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e127bf14-e126-412d-91e2-cc407b5bc521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:18.363862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6b33d-3f29-426a-902e-6b06d1eba056 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:18.378704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127bf14-e126-412d-91e2-cc407b5bc521 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:18.383984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de502c54-7c2c-4255-8fe4-716650a88c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:18.389332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de502c54-7c2c-4255-8fe4-716650a88c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:18.389332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de502c54-7c2c-4255-8fe4-716650a88c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:18.389332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de502c54-7c2c-4255-8fe4-716650a88c76 admin admin] PATH_INFO: `/v3/users/034c11cc3f174c6fb44c8d64e55cf8b9` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:18.389332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de502c54-7c2c-4255-8fe4-716650a88c76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=034c11cc3f174c6fb44c8d64e55cf8b9)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:18.389332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de502c54-7c2c-4255-8fe4-716650a88c76 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:18.502342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-74c6b33d-3f29-426a-902e-6b06d1eba056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c54651ad88c4649a702e18ed8f73c0f', 'request_id': 'req-74c6b33d-3f29-426a-902e-6b06d1eba056'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:18.508053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-74c6b33d-3f29-426a-902e-6b06d1eba056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c54651ad88c4649a702e18ed8f73c0f', 'request_id': 'req-74c6b33d-3f29-426a-902e-6b06d1eba056'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:18.514969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-74c6b33d-3f29-426a-902e-6b06d1eba056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c54651ad88c4649a702e18ed8f73c0f', 'request_id': 'req-74c6b33d-3f29-426a-902e-6b06d1eba056'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:18.629396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-74c6b33d-3f29-426a-902e-6b06d1eba056 admin admin] The token cache is being invalidate because project 5c54651ad88c4649a702e18ed8f73c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:13:18.629693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-74c6b33d-3f29-426a-902e-6b06d1eba056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:18.630545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-74c6b33d-3f29-426a-902e-6b06d1eba056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:18.633760 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1367/2764] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:13:18 2022] DELETE /identity/v3/projects/5c54651ad88c4649a702e18ed8f73c0f => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:13:18.636584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-de502c54-7c2c-4255-8fe4-716650a88c76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '034c11cc3f174c6fb44c8d64e55cf8b9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:18.638741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6b33d-3f29-426a-902e-6b06d1eba056 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:18.640975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-74c6b33d-3f29-426a-902e-6b06d1eba056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:18.644307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-de502c54-7c2c-4255-8fe4-716650a88c76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '034c11cc3f174c6fb44c8d64e55cf8b9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:18.703481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6b33d-3f29-426a-902e-6b06d1eba056 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:18.707426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b3929-893b-4730-9073-a4dc172d09cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:18.708154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b3929-893b-4730-9073-a4dc172d09cf service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:18.708446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b3929-893b-4730-9073-a4dc172d09cf service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:18.708721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b3929-893b-4730-9073-a4dc172d09cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:18.711345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1a7b3929-893b-4730-9073-a4dc172d09cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:18.780590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b3929-893b-4730-9073-a4dc172d09cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:18.782061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b3929-893b-4730-9073-a4dc172d09cf service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:18.792868 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1368/2765] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:13:18.793903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b3929-893b-4730-9073-a4dc172d09cf service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:18.795303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1a7b3929-893b-4730-9073-a4dc172d09cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:18.807688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b3929-893b-4730-9073-a4dc172d09cf service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:18.818828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d27cb-24c9-4a03-9678-df1f0c37992d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:18.822191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d27cb-24c9-4a03-9678-df1f0c37992d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:18.822371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d27cb-24c9-4a03-9678-df1f0c37992d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:18.822580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d27cb-24c9-4a03-9678-df1f0c37992d admin admin] PATH_INFO: `/v3/users/2db871d6aa9746d2b660efbfbdb1dc75` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:18.824060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d27cb-24c9-4a03-9678-df1f0c37992d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2db871d6aa9746d2b660efbfbdb1dc75)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:18.826631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-de502c54-7c2c-4255-8fe4-716650a88c76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '034c11cc3f174c6fb44c8d64e55cf8b9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:18.826788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d27cb-24c9-4a03-9678-df1f0c37992d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:18.827321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-de502c54-7c2c-4255-8fe4-716650a88c76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '034c11cc3f174c6fb44c8d64e55cf8b9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:18.843331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-de502c54-7c2c-4255-8fe4-716650a88c76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '034c11cc3f174c6fb44c8d64e55cf8b9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:18.850049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:18.850221 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1398/2766] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:13:18 2022] DELETE /identity/v3/users/034c11cc3f174c6fb44c8d64e55cf8b9 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:18.859221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2db392-de20-47c0-8a8e-3dbea0a46368 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:18.859221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2db392-de20-47c0-8a8e-3dbea0a46368 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:18.859221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2db392-de20-47c0-8a8e-3dbea0a46368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:18.877906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7b2db392-de20-47c0-8a8e-3dbea0a46368 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:18.879148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7b2db392-de20-47c0-8a8e-3dbea0a46368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:18.982377 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1399/2767] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:18.986771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed1180-7858-48f6-be0a-b81a68671e71 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:18.987272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed1180-7858-48f6-be0a-b81a68671e71 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:18.987639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed1180-7858-48f6-be0a-b81a68671e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:19.012766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f6ed1180-7858-48f6-be0a-b81a68671e71 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:19.014376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f6ed1180-7858-48f6-be0a-b81a68671e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:19.028455 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1400/2768] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:19.031590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed1180-7858-48f6-be0a-b81a68671e71 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:19.042788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed1180-7858-48f6-be0a-b81a68671e71 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:19.049079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599a2e3-e27d-4e55-8673-fb5d718bc4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:19.050013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599a2e3-e27d-4e55-8673-fb5d718bc4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:19.050291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599a2e3-e27d-4e55-8673-fb5d718bc4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:19.050566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599a2e3-e27d-4e55-8673-fb5d718bc4b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:19.051328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599a2e3-e27d-4e55-8673-fb5d718bc4b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:13:19.051631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599a2e3-e27d-4e55-8673-fb5d718bc4b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:19.053223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599a2e3-e27d-4e55-8673-fb5d718bc4b1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:19.070731 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1401/2769] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:13:19.072765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599a2e3-e27d-4e55-8673-fb5d718bc4b1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:19.084307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599a2e3-e27d-4e55-8673-fb5d718bc4b1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:19.090394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288c9d1-64dc-4f00-9254-919facb17022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:19.091196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288c9d1-64dc-4f00-9254-919facb17022 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:19.091550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288c9d1-64dc-4f00-9254-919facb17022 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:19.091837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288c9d1-64dc-4f00-9254-919facb17022 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:19.092675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288c9d1-64dc-4f00-9254-919facb17022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:19.094600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288c9d1-64dc-4f00-9254-919facb17022 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:19.118443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-433d27cb-24c9-4a03-9678-df1f0c37992d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2db871d6aa9746d2b660efbfbdb1dc75'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:19.131154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-433d27cb-24c9-4a03-9678-df1f0c37992d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2db871d6aa9746d2b660efbfbdb1dc75'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:19.302128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-433d27cb-24c9-4a03-9678-df1f0c37992d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2db871d6aa9746d2b660efbfbdb1dc75'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:19.311076 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1402/2770] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:13:19 2022] POST /identity/v3/projects => generated 407 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:13:19.311990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288c9d1-64dc-4f00-9254-919facb17022 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:19.313822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-433d27cb-24c9-4a03-9678-df1f0c37992d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2db871d6aa9746d2b660efbfbdb1dc75'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:19.314165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0288c9d1-64dc-4f00-9254-919facb17022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:19.314262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-433d27cb-24c9-4a03-9678-df1f0c37992d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2db871d6aa9746d2b660efbfbdb1dc75'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:19.327152 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1369/2771] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:13:18 2022] DELETE /identity/v3/users/2db871d6aa9746d2b660efbfbdb1dc75 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:19.328626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d27cb-24c9-4a03-9678-df1f0c37992d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:19.330164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-433d27cb-24c9-4a03-9678-df1f0c37992d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:19.465265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d27cb-24c9-4a03-9678-df1f0c37992d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:19.471514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80d517-a1c2-4e6f-a359-7dbfe0f5fb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:19.475100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80d517-a1c2-4e6f-a359-7dbfe0f5fb01 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:19.475811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80d517-a1c2-4e6f-a359-7dbfe0f5fb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:19.476376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288c9d1-64dc-4f00-9254-919facb17022 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:19.476837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80d517-a1c2-4e6f-a359-7dbfe0f5fb01 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:19.477829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80d517-a1c2-4e6f-a359-7dbfe0f5fb01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:19.479934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80d517-a1c2-4e6f-a359-7dbfe0f5fb01 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:19.492345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b65045-da84-48bb-951c-8da6db1f0d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:19.493291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b65045-da84-48bb-951c-8da6db1f0d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:19.493571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b65045-da84-48bb-951c-8da6db1f0d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:19.494013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b65045-da84-48bb-951c-8da6db1f0d01 admin admin] PATH_INFO: `/v3/projects/fb4ff5d7e42940cdb7be71dadd895ee4` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:19.495584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b65045-da84-48bb-951c-8da6db1f0d01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb4ff5d7e42940cdb7be71dadd895ee4)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:19.497846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b65045-da84-48bb-951c-8da6db1f0d01 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:19.577915 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1370/2772] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:13:19 2022] POST /identity/v3/users => generated 304 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:13:19.581029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f65eec-f482-4f1f-a54d-cea6b0be713f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:19.581029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f65eec-f482-4f1f-a54d-cea6b0be713f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:19.581029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f65eec-f482-4f1f-a54d-cea6b0be713f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:19.602508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b9f65eec-f482-4f1f-a54d-cea6b0be713f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:19.603898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b9f65eec-f482-4f1f-a54d-cea6b0be713f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:19.612285 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1371/2773] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:19.613247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f65eec-f482-4f1f-a54d-cea6b0be713f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:19.627560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f65eec-f482-4f1f-a54d-cea6b0be713f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:19.638705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409fd82-fda4-4b22-ba07-6ad9f529f5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:19.638705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409fd82-fda4-4b22-ba07-6ad9f529f5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:19.638705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409fd82-fda4-4b22-ba07-6ad9f529f5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:19.638705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409fd82-fda4-4b22-ba07-6ad9f529f5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:19.639172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409fd82-fda4-4b22-ba07-6ad9f529f5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:19.639172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409fd82-fda4-4b22-ba07-6ad9f529f5f0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:19.655145 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1372/2774] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:13:19.660024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409fd82-fda4-4b22-ba07-6ad9f529f5f0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:19.664429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0409fd82-fda4-4b22-ba07-6ad9f529f5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:19.732545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409fd82-fda4-4b22-ba07-6ad9f529f5f0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:19.744996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a1b65045-da84-48bb-951c-8da6db1f0d01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb4ff5d7e42940cdb7be71dadd895ee4', 'request_id': 'req-a1b65045-da84-48bb-951c-8da6db1f0d01'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:19.751445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a1b65045-da84-48bb-951c-8da6db1f0d01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb4ff5d7e42940cdb7be71dadd895ee4', 'request_id': 'req-a1b65045-da84-48bb-951c-8da6db1f0d01'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:19.760043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a1b65045-da84-48bb-951c-8da6db1f0d01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb4ff5d7e42940cdb7be71dadd895ee4', 'request_id': 'req-a1b65045-da84-48bb-951c-8da6db1f0d01'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:19.791781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c47f8-0e22-4793-8c22-35c64a5439d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:19.792503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c47f8-0e22-4793-8c22-35c64a5439d4 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:19.792791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c47f8-0e22-4793-8c22-35c64a5439d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:19.793073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c47f8-0e22-4793-8c22-35c64a5439d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:19.871491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c47f8-0e22-4793-8c22-35c64a5439d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:19.872954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c47f8-0e22-4793-8c22-35c64a5439d4 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:19.893152 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1373/2775] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:13:19.893152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c47f8-0e22-4793-8c22-35c64a5439d4 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:19.893475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a1b65045-da84-48bb-951c-8da6db1f0d01 admin admin] The token cache is being invalidate because project fb4ff5d7e42940cdb7be71dadd895ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:13:19.893475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a1b65045-da84-48bb-951c-8da6db1f0d01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:19.893475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a1b65045-da84-48bb-951c-8da6db1f0d01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:19.893475 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1403/2776] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:13:19 2022] DELETE /identity/v3/projects/fb4ff5d7e42940cdb7be71dadd895ee4 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:19.894332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1f05c-69e8-48e1-9ba7-b0cc58d1cecb None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:19.894643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1f05c-69e8-48e1-9ba7-b0cc58d1cecb None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:19.894995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1f05c-69e8-48e1-9ba7-b0cc58d1cecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:19.903614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c47f8-0e22-4793-8c22-35c64a5439d4 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:19.909863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5dc46-6df3-4658-ab26-10faf9bc2375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:19.910550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5dc46-6df3-4658-ab26-10faf9bc2375 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:19.910838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5dc46-6df3-4658-ab26-10faf9bc2375 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:19.911153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5dc46-6df3-4658-ab26-10faf9bc2375 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:19.912227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5dc46-6df3-4658-ab26-10faf9bc2375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:19.914332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5dc46-6df3-4658-ab26-10faf9bc2375 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:19.923225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-28f1f05c-69e8-48e1-9ba7-b0cc58d1cecb None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:19.924824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-28f1f05c-69e8-48e1-9ba7-b0cc58d1cecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:19.932670 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1374/2777] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:13:19.937450 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1404/2778] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:13:19.950988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5dc46-6df3-4658-ab26-10faf9bc2375 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:19.955809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54dfef-8883-4ab8-af0f-4decf654ec8f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:19.956335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54dfef-8883-4ab8-af0f-4decf654ec8f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:19.957044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ffc5dc46-6df3-4658-ab26-10faf9bc2375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:19.957176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54dfef-8883-4ab8-af0f-4decf654ec8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:19.973246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5dc46-6df3-4658-ab26-10faf9bc2375 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:19.979346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e7c49-444a-48b1-93eb-2bcce2e53dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:19.980257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e7c49-444a-48b1-93eb-2bcce2e53dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:19.980536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e7c49-444a-48b1-93eb-2bcce2e53dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:19.980813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e7c49-444a-48b1-93eb-2bcce2e53dc2 admin admin] PATH_INFO: `/v3/projects/61d182411dbf423bb29beca95e3fea26/users/783a5d7c178742b1b037fd6528e18ecd/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:19.981615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5a54dfef-8883-4ab8-af0f-4decf654ec8f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:19.983248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5a54dfef-8883-4ab8-af0f-4decf654ec8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:20.000999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e7c49-444a-48b1-93eb-2bcce2e53dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d182411dbf423bb29beca95e3fea26, user_id=783a5d7c178742b1b037fd6528e18ecd, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:20.003751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e7c49-444a-48b1-93eb-2bcce2e53dc2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:20.006825 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1405/2779] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:20.012959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54dfef-8883-4ab8-af0f-4decf654ec8f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:20.024395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54dfef-8883-4ab8-af0f-4decf654ec8f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:20.029534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c5f64-96eb-4a81-aeea-8c98bdb7b1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:20.030511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c5f64-96eb-4a81-aeea-8c98bdb7b1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:20.031022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c5f64-96eb-4a81-aeea-8c98bdb7b1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:20.031637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c5f64-96eb-4a81-aeea-8c98bdb7b1e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:20.032636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c5f64-96eb-4a81-aeea-8c98bdb7b1e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:13:20.033166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c5f64-96eb-4a81-aeea-8c98bdb7b1e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:20.035070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c5f64-96eb-4a81-aeea-8c98bdb7b1e3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:20.052379 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1406/2780] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:13:20.058353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c5f64-96eb-4a81-aeea-8c98bdb7b1e3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:20.075938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c5f64-96eb-4a81-aeea-8c98bdb7b1e3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:20.079886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3ec83-639f-4d39-b932-2ffe50965a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:20.080951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3ec83-639f-4d39-b932-2ffe50965a58 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:20.081376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3ec83-639f-4d39-b932-2ffe50965a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:20.081720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3ec83-639f-4d39-b932-2ffe50965a58 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:20.082768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3ec83-639f-4d39-b932-2ffe50965a58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:20.086033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3ec83-639f-4d39-b932-2ffe50965a58 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:20.142043 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1375/2781] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:13:19 2022] PUT /identity/v3/projects/61d182411dbf423bb29beca95e3fea26/users/783a5d7c178742b1b037fd6528e18ecd/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:20.153263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f0a20-6f16-4497-9aca-81d9b0bf4501 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:20.153565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f0a20-6f16-4497-9aca-81d9b0bf4501 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:20.153919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f0a20-6f16-4497-9aca-81d9b0bf4501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:20.160264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:20.186450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-369f0a20-6f16-4497-9aca-81d9b0bf4501 None None] MFA Rules not processed for user `783a5d7c178742b1b037fd6528e18ecd`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:20.187808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-369f0a20-6f16-4497-9aca-81d9b0bf4501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:20.234810 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1407/2782] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:13:20 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:13:20.235773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3ec83-639f-4d39-b932-2ffe50965a58 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:20.237734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-70f3ec83-639f-4d39-b932-2ffe50965a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:20.245805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:20.293019 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1376/2783] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:20 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:20.294033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f0a20-6f16-4497-9aca-81d9b0bf4501 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:20.327922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3ec83-639f-4d39-b932-2ffe50965a58 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:20.333296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da965a0d-327a-4c47-a08e-f61f89e9546f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:20.334205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da965a0d-327a-4c47-a08e-f61f89e9546f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:20.335574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da965a0d-327a-4c47-a08e-f61f89e9546f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:20.335877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da965a0d-327a-4c47-a08e-f61f89e9546f admin admin] PATH_INFO: `/v3/projects/cad2f07400d54ef9825022d5b3489db0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:20.337670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da965a0d-327a-4c47-a08e-f61f89e9546f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cad2f07400d54ef9825022d5b3489db0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:20.340248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da965a0d-327a-4c47-a08e-f61f89e9546f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:20.400530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f0a20-6f16-4497-9aca-81d9b0bf4501 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:20.406119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b26651-ab92-4e15-97be-0a397bb4b4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:20.407256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b26651-ab92-4e15-97be-0a397bb4b4fb admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:20.407576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b26651-ab92-4e15-97be-0a397bb4b4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:20.407882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b26651-ab92-4e15-97be-0a397bb4b4fb admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:20.408768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b26651-ab92-4e15-97be-0a397bb4b4fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:20.410896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b26651-ab92-4e15-97be-0a397bb4b4fb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:20.510293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-da965a0d-327a-4c47-a08e-f61f89e9546f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cad2f07400d54ef9825022d5b3489db0', 'request_id': 'req-da965a0d-327a-4c47-a08e-f61f89e9546f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:20.516999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-da965a0d-327a-4c47-a08e-f61f89e9546f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cad2f07400d54ef9825022d5b3489db0', 'request_id': 'req-da965a0d-327a-4c47-a08e-f61f89e9546f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:20.527776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-da965a0d-327a-4c47-a08e-f61f89e9546f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cad2f07400d54ef9825022d5b3489db0', 'request_id': 'req-da965a0d-327a-4c47-a08e-f61f89e9546f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:20.528187 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1377/2784] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:13:20 2022] POST /identity/v3/users => generated 287 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:13:20.529202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b26651-ab92-4e15-97be-0a397bb4b4fb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:20.540053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b26651-ab92-4e15-97be-0a397bb4b4fb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:20.623751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338f5e3-6111-4d6a-80a7-d161b6a3dd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:20.623751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338f5e3-6111-4d6a-80a7-d161b6a3dd13 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:20.623751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338f5e3-6111-4d6a-80a7-d161b6a3dd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:20.623751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338f5e3-6111-4d6a-80a7-d161b6a3dd13 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:20.624230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338f5e3-6111-4d6a-80a7-d161b6a3dd13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:20.625992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338f5e3-6111-4d6a-80a7-d161b6a3dd13 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:21.228399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-da965a0d-327a-4c47-a08e-f61f89e9546f admin admin] The token cache is being invalidate because project cad2f07400d54ef9825022d5b3489db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:13:21.273295 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1378/2785] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:13:20 2022] POST /identity/v3/projects => generated 409 bytes in 700 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:13:21.273295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338f5e3-6111-4d6a-80a7-d161b6a3dd13 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:21.273713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-da965a0d-327a-4c47-a08e-f61f89e9546f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:21.273713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-da965a0d-327a-4c47-a08e-f61f89e9546f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:21.273713 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1408/2786] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:13:20 2022] DELETE /identity/v3/projects/cad2f07400d54ef9825022d5b3489db0 => generated 0 bytes in 999 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:21.273713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da965a0d-327a-4c47-a08e-f61f89e9546f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:21.273713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-da965a0d-327a-4c47-a08e-f61f89e9546f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:21.274166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da965a0d-327a-4c47-a08e-f61f89e9546f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:21.315945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338f5e3-6111-4d6a-80a7-d161b6a3dd13 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:21.322121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9f867-db25-430d-82b3-9d38ef8522d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:21.322798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9f867-db25-430d-82b3-9d38ef8522d0 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:21.323116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9f867-db25-430d-82b3-9d38ef8522d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:21.323404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9f867-db25-430d-82b3-9d38ef8522d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:21.324151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc9f867-db25-430d-82b3-9d38ef8522d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:21.325763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc9f867-db25-430d-82b3-9d38ef8522d0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:21.344446 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1379/2787] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:13:21.345373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9f867-db25-430d-82b3-9d38ef8522d0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:21.353173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-afc9f867-db25-430d-82b3-9d38ef8522d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:21.353380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03677a0-5719-475c-b975-a6a616dbe7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:21.353679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03677a0-5719-475c-b975-a6a616dbe7da admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:21.354360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03677a0-5719-475c-b975-a6a616dbe7da admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:21.354726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03677a0-5719-475c-b975-a6a616dbe7da admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:21.355518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03677a0-5719-475c-b975-a6a616dbe7da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:21.357686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03677a0-5719-475c-b975-a6a616dbe7da admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:21.375683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9f867-db25-430d-82b3-9d38ef8522d0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:21.380917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac8d3b-22ad-4a1a-b244-9a47d603b025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:21.387875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac8d3b-22ad-4a1a-b244-9a47d603b025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:21.389202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac8d3b-22ad-4a1a-b244-9a47d603b025 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:21.389885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac8d3b-22ad-4a1a-b244-9a47d603b025 admin admin] PATH_INFO: `/v3/users/966ec65300104fa7ae2e57ab46b4a219` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:21.392063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac8d3b-22ad-4a1a-b244-9a47d603b025 admin admin] RBAC: Authorizing `identity:delete_user(user_id=966ec65300104fa7ae2e57ab46b4a219)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:21.394669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac8d3b-22ad-4a1a-b244-9a47d603b025 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:21.705367 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1409/2788] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:13:21 2022] POST /identity/v3/users => generated 311 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:13:21.706491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03677a0-5719-475c-b975-a6a616dbe7da admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:21.710473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e03677a0-5719-475c-b975-a6a616dbe7da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:21.723646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03677a0-5719-475c-b975-a6a616dbe7da admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:21.729427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff740a1-1f8a-479c-936c-33cb7b7568e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:21.730097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff740a1-1f8a-479c-936c-33cb7b7568e4 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:21.730382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff740a1-1f8a-479c-936c-33cb7b7568e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:21.730798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff740a1-1f8a-479c-936c-33cb7b7568e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:21.731532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff740a1-1f8a-479c-936c-33cb7b7568e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:21.733331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff740a1-1f8a-479c-936c-33cb7b7568e4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:21.746798 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1410/2789] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:13:21.748076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff740a1-1f8a-479c-936c-33cb7b7568e4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:21.762747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff740a1-1f8a-479c-936c-33cb7b7568e4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:21.774320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0db80-1283-4685-8d6d-144e002a11c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:21.775407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0db80-1283-4685-8d6d-144e002a11c7 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:21.775914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0db80-1283-4685-8d6d-144e002a11c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:21.776290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0db80-1283-4685-8d6d-144e002a11c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:21.777220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0db80-1283-4685-8d6d-144e002a11c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:21.779052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0db80-1283-4685-8d6d-144e002a11c7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:21.792019 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1411/2790] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:13:21.792940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0db80-1283-4685-8d6d-144e002a11c7 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:21.806900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0db80-1283-4685-8d6d-144e002a11c7 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:21.812436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b892604-649a-4114-b0fd-f62627964ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:21.814347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b892604-649a-4114-b0fd-f62627964ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:21.814347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b892604-649a-4114-b0fd-f62627964ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:21.814347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b892604-649a-4114-b0fd-f62627964ed6 admin admin] PATH_INFO: `/v3/projects/bb1ede0d0b6941cc97278e6c617f9b01/users/53af488f3b0242a797f539284b78d59e/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:21.833656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b892604-649a-4114-b0fd-f62627964ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1ede0d0b6941cc97278e6c617f9b01, user_id=53af488f3b0242a797f539284b78d59e, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:21.837698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b892604-649a-4114-b0fd-f62627964ed6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:21.918228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a3ac8d3b-22ad-4a1a-b244-9a47d603b025 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966ec65300104fa7ae2e57ab46b4a219'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:21.936617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a3ac8d3b-22ad-4a1a-b244-9a47d603b025 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966ec65300104fa7ae2e57ab46b4a219'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:21.995519 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1412/2791] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:13:21 2022] PUT /identity/v3/projects/bb1ede0d0b6941cc97278e6c617f9b01/users/53af488f3b0242a797f539284b78d59e/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:21.996291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b892604-649a-4114-b0fd-f62627964ed6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:22.022293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a3ac8d3b-22ad-4a1a-b244-9a47d603b025 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966ec65300104fa7ae2e57ab46b4a219'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:22.035919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a3ac8d3b-22ad-4a1a-b244-9a47d603b025 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966ec65300104fa7ae2e57ab46b4a219'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:22.037242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a3ac8d3b-22ad-4a1a-b244-9a47d603b025 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966ec65300104fa7ae2e57ab46b4a219'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:22.052816 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1380/2792] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:13:21 2022] DELETE /identity/v3/users/966ec65300104fa7ae2e57ab46b4a219 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:22.061794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc4864-af93-4b75-b04b-f22c92d528ea None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:22.061794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc4864-af93-4b75-b04b-f22c92d528ea None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:22.061794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc4864-af93-4b75-b04b-f22c92d528ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:22.118252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-cddc4864-af93-4b75-b04b-f22c92d528ea None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:22.120671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cddc4864-af93-4b75-b04b-f22c92d528ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:22.131044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b892604-649a-4114-b0fd-f62627964ed6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:22.211894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d759c-1580-4ec6-a36d-6cd5e5cef55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:22.212955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d759c-1580-4ec6-a36d-6cd5e5cef55a admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:22.213375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d759c-1580-4ec6-a36d-6cd5e5cef55a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:22.213756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d759c-1580-4ec6-a36d-6cd5e5cef55a admin admin] PATH_INFO: `/v3/projects/1a34953aff484e62a526829fd8065a1b/users/892b4ef9c5db4462a6e134f12519f254/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:22.255928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d759c-1580-4ec6-a36d-6cd5e5cef55a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a34953aff484e62a526829fd8065a1b, user_id=892b4ef9c5db4462a6e134f12519f254, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:22.262611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d759c-1580-4ec6-a36d-6cd5e5cef55a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:22.263788 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1381/2793] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:22.285625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc4864-af93-4b75-b04b-f22c92d528ea None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:22.290568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cddc4864-af93-4b75-b04b-f22c92d528ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:22.365411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc4864-af93-4b75-b04b-f22c92d528ea None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:22.370338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd3f9d-7835-4e2e-873f-f13c4e98b04e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:22.371181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd3f9d-7835-4e2e-873f-f13c4e98b04e service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:22.371474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd3f9d-7835-4e2e-873f-f13c4e98b04e service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:22.371760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd3f9d-7835-4e2e-873f-f13c4e98b04e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:22.418721 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1413/2794] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:13:21 2022] PUT /identity/v3/projects/1a34953aff484e62a526829fd8065a1b/users/892b4ef9c5db4462a6e134f12519f254/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:22.420350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd3f9d-7835-4e2e-873f-f13c4e98b04e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:22.422005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd3f9d-7835-4e2e-873f-f13c4e98b04e service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:22.423340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d759c-1580-4ec6-a36d-6cd5e5cef55a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:22.426248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-615d759c-1580-4ec6-a36d-6cd5e5cef55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:22.453090 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1382/2795] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:13:22.562548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d759c-1580-4ec6-a36d-6cd5e5cef55a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:22.571060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c197c6c-23a5-4bcd-84b8-77b59debcb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:22.571060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c197c6c-23a5-4bcd-84b8-77b59debcb89 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:22.577812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c197c6c-23a5-4bcd-84b8-77b59debcb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:22.577812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c197c6c-23a5-4bcd-84b8-77b59debcb89 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:22.577812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c197c6c-23a5-4bcd-84b8-77b59debcb89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:22.577812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c197c6c-23a5-4bcd-84b8-77b59debcb89 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:22.589469 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1414/2796] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:13:22.590225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd3f9d-7835-4e2e-873f-f13c4e98b04e service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:22.607506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd3f9d-7835-4e2e-873f-f13c4e98b04e service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:22.617490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59b51c-bcd4-493c-bffa-e00b1549762c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:22.618850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59b51c-bcd4-493c-bffa-e00b1549762c admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:22.619301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59b51c-bcd4-493c-bffa-e00b1549762c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:22.620008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59b51c-bcd4-493c-bffa-e00b1549762c admin admin] PATH_INFO: `/v3/projects/1a34953aff484e62a526829fd8065a1b/users/892b4ef9c5db4462a6e134f12519f254/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:22.623534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59b51c-bcd4-493c-bffa-e00b1549762c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a34953aff484e62a526829fd8065a1b, user_id=892b4ef9c5db4462a6e134f12519f254, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:22.628366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59b51c-bcd4-493c-bffa-e00b1549762c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:22.644837 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1383/2797] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:13:22 2022] PUT /identity/v3/projects/1a34953aff484e62a526829fd8065a1b/users/892b4ef9c5db4462a6e134f12519f254/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:22.655187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291f693-3f23-47d5-a3d9-76936f847823 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:22.655472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291f693-3f23-47d5-a3d9-76936f847823 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:22.655750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291f693-3f23-47d5-a3d9-76936f847823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:22.696416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b291f693-3f23-47d5-a3d9-76936f847823 None None] MFA Rules not processed for user `892b4ef9c5db4462a6e134f12519f254`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:22.698722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b291f693-3f23-47d5-a3d9-76936f847823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:22.808039 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1415/2798] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:22.814887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59b51c-bcd4-493c-bffa-e00b1549762c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:22.909138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291f693-3f23-47d5-a3d9-76936f847823 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:22.910131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b291f693-3f23-47d5-a3d9-76936f847823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:22.920672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59b51c-bcd4-493c-bffa-e00b1549762c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:22.935683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5b001-7040-49ec-b405-f01a36cce586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:22.936587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5b001-7040-49ec-b405-f01a36cce586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:22.936874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5b001-7040-49ec-b405-f01a36cce586 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:22.937157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5b001-7040-49ec-b405-f01a36cce586 admin admin] PATH_INFO: `/v3/users/783a5d7c178742b1b037fd6528e18ecd` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:22.938546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5b001-7040-49ec-b405-f01a36cce586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=783a5d7c178742b1b037fd6528e18ecd)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:22.941272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5b001-7040-49ec-b405-f01a36cce586 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:23.014688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291f693-3f23-47d5-a3d9-76936f847823 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:23.018724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c9156-e784-4375-971e-3c6f0987a99a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:23.019451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c9156-e784-4375-971e-3c6f0987a99a service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:23.019731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c9156-e784-4375-971e-3c6f0987a99a service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:23.020005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c9156-e784-4375-971e-3c6f0987a99a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:23.021834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-492c9156-e784-4375-971e-3c6f0987a99a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:23.033552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c9156-e784-4375-971e-3c6f0987a99a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:23.035084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c9156-e784-4375-971e-3c6f0987a99a service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:23.052926 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1416/2799] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:13:23.056623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c9156-e784-4375-971e-3c6f0987a99a service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:23.061221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-492c9156-e784-4375-971e-3c6f0987a99a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:23.084357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c9156-e784-4375-971e-3c6f0987a99a service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:23.089953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c39169-58e1-4d61-a783-da87c9838edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:23.090827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c39169-58e1-4d61-a783-da87c9838edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:23.091171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c39169-58e1-4d61-a783-da87c9838edc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:23.091606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c39169-58e1-4d61-a783-da87c9838edc admin admin] PATH_INFO: `/v3/projects/6e81dc2f67894c5e99512041283174fb` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:23.092705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c39169-58e1-4d61-a783-da87c9838edc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e81dc2f67894c5e99512041283174fb)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:23.095036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c39169-58e1-4d61-a783-da87c9838edc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:23.223996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-06b5b001-7040-49ec-b405-f01a36cce586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '783a5d7c178742b1b037fd6528e18ecd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:23.227790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:23.255775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-06b5b001-7040-49ec-b405-f01a36cce586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '783a5d7c178742b1b037fd6528e18ecd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:23.271122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-36c39169-58e1-4d61-a783-da87c9838edc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e81dc2f67894c5e99512041283174fb', 'request_id': 'req-36c39169-58e1-4d61-a783-da87c9838edc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:23.281940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-36c39169-58e1-4d61-a783-da87c9838edc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e81dc2f67894c5e99512041283174fb', 'request_id': 'req-36c39169-58e1-4d61-a783-da87c9838edc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:23.284182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:23.292359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-36c39169-58e1-4d61-a783-da87c9838edc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e81dc2f67894c5e99512041283174fb', 'request_id': 'req-36c39169-58e1-4d61-a783-da87c9838edc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:23.394223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-06b5b001-7040-49ec-b405-f01a36cce586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '783a5d7c178742b1b037fd6528e18ecd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:23.409341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-06b5b001-7040-49ec-b405-f01a36cce586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '783a5d7c178742b1b037fd6528e18ecd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:23.411276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-06b5b001-7040-49ec-b405-f01a36cce586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '783a5d7c178742b1b037fd6528e18ecd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:23.432945 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1384/2800] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:13:22 2022] DELETE /identity/v3/users/783a5d7c178742b1b037fd6528e18ecd => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:23.440422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c23d4d-82ea-4e37-a1ac-9c5a3258a53e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:23.440847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c23d4d-82ea-4e37-a1ac-9c5a3258a53e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:23.441138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c23d4d-82ea-4e37-a1ac-9c5a3258a53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:23.474877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-46c23d4d-82ea-4e37-a1ac-9c5a3258a53e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:23.477235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-46c23d4d-82ea-4e37-a1ac-9c5a3258a53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:23.500632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-36c39169-58e1-4d61-a783-da87c9838edc admin admin] The token cache is being invalidate because project 6e81dc2f67894c5e99512041283174fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:13:23.501500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-36c39169-58e1-4d61-a783-da87c9838edc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:23.505764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-36c39169-58e1-4d61-a783-da87c9838edc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:23.508218 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1417/2801] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:13:23 2022] DELETE /identity/v3/projects/6e81dc2f67894c5e99512041283174fb => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:23.518407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e983fd-c95b-4320-bcf9-63246c1f80ce None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:23.519427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e983fd-c95b-4320-bcf9-63246c1f80ce None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:23.519945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e983fd-c95b-4320-bcf9-63246c1f80ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:23.571538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-43e983fd-c95b-4320-bcf9-63246c1f80ce None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:23.573880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-43e983fd-c95b-4320-bcf9-63246c1f80ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:23.637165 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1385/2802] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:23.739660 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1418/2803] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:13:23.742965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a76e8-7cad-4614-9f3e-1bdecf0541a5 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:23.743394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a76e8-7cad-4614-9f3e-1bdecf0541a5 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:23.743775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a76e8-7cad-4614-9f3e-1bdecf0541a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:23.795980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e983fd-c95b-4320-bcf9-63246c1f80ce None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:23.795980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-43e983fd-c95b-4320-bcf9-63246c1f80ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:23.820798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1f4a76e8-7cad-4614-9f3e-1bdecf0541a5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:23.829755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1f4a76e8-7cad-4614-9f3e-1bdecf0541a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:23.893090 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1386/2804] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:13:23.899263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a76e8-7cad-4614-9f3e-1bdecf0541a5 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:23.923177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a76e8-7cad-4614-9f3e-1bdecf0541a5 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:23.931243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ab60c-5f1b-430b-8555-fa25c09a16a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:23.932328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ab60c-5f1b-430b-8555-fa25c09a16a7 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:23.932889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ab60c-5f1b-430b-8555-fa25c09a16a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:23.933386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ab60c-5f1b-430b-8555-fa25c09a16a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:23.936623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ab60c-5f1b-430b-8555-fa25c09a16a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:13:23.937153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ab60c-5f1b-430b-8555-fa25c09a16a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:23.939322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ab60c-5f1b-430b-8555-fa25c09a16a7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:23.965454 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1387/2805] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:13:23.972355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ab60c-5f1b-430b-8555-fa25c09a16a7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:23.992895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ab60c-5f1b-430b-8555-fa25c09a16a7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:24.005824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920bfa6-735c-4bb5-b497-5a95ced19a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:24.007658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920bfa6-735c-4bb5-b497-5a95ced19a03 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:24.008601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920bfa6-735c-4bb5-b497-5a95ced19a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:24.008601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920bfa6-735c-4bb5-b497-5a95ced19a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:24.008837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920bfa6-735c-4bb5-b497-5a95ced19a03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:24.015323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920bfa6-735c-4bb5-b497-5a95ced19a03 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:24.023467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e983fd-c95b-4320-bcf9-63246c1f80ce None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:24.031872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc23e1-2a69-4137-8bd5-1a5aebc69afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:24.034286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc23e1-2a69-4137-8bd5-1a5aebc69afb service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:24.034591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc23e1-2a69-4137-8bd5-1a5aebc69afb service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:24.034873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc23e1-2a69-4137-8bd5-1a5aebc69afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:24.062127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc23e1-2a69-4137-8bd5-1a5aebc69afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:24.064996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc23e1-2a69-4137-8bd5-1a5aebc69afb service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:24.090806 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1419/2806] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:13:24.185955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc23e1-2a69-4137-8bd5-1a5aebc69afb service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:24.186719 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1388/2807] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:13:23 2022] POST /identity/v3/projects => generated 397 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:13:24.217871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc23e1-2a69-4137-8bd5-1a5aebc69afb service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:24.360580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863456a7-c3f6-44e3-87f1-c2ebe71fbe01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:24.361792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863456a7-c3f6-44e3-87f1-c2ebe71fbe01 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:24.362196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863456a7-c3f6-44e3-87f1-c2ebe71fbe01 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:24.368168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863456a7-c3f6-44e3-87f1-c2ebe71fbe01 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:24.369043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863456a7-c3f6-44e3-87f1-c2ebe71fbe01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:24.375844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863456a7-c3f6-44e3-87f1-c2ebe71fbe01 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:24.516851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920bfa6-735c-4bb5-b497-5a95ced19a03 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:24.527894 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1420/2808] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:13:24 2022] POST /identity/v3/users => generated 299 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:13:24.533299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920bfa6-735c-4bb5-b497-5a95ced19a03 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:24.540468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52611329-4222-4cb3-b382-b7aea52fbbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:24.542429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52611329-4222-4cb3-b382-b7aea52fbbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:24.542429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52611329-4222-4cb3-b382-b7aea52fbbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:24.542429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52611329-4222-4cb3-b382-b7aea52fbbd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:24.542713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52611329-4222-4cb3-b382-b7aea52fbbd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:24.544537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52611329-4222-4cb3-b382-b7aea52fbbd9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:24.559373 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1389/2809] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:13:24.563612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863456a7-c3f6-44e3-87f1-c2ebe71fbe01 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:24.577003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863456a7-c3f6-44e3-87f1-c2ebe71fbe01 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:24.586865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89590dd-d435-4cba-8bf5-88cc5b6ff8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:24.587476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89590dd-d435-4cba-8bf5-88cc5b6ff8fa admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:24.587844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89590dd-d435-4cba-8bf5-88cc5b6ff8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:24.588180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89590dd-d435-4cba-8bf5-88cc5b6ff8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:24.589244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89590dd-d435-4cba-8bf5-88cc5b6ff8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:24.591336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89590dd-d435-4cba-8bf5-88cc5b6ff8fa admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:24.618635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52611329-4222-4cb3-b382-b7aea52fbbd9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:24.623429 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1421/2810] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:13:24.632532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52611329-4222-4cb3-b382-b7aea52fbbd9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:24.652121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1ec04-4e9f-4247-90bd-2c3cdc3c5dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:24.652121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1ec04-4e9f-4247-90bd-2c3cdc3c5dac admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:24.652121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1ec04-4e9f-4247-90bd-2c3cdc3c5dac admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:24.652121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1ec04-4e9f-4247-90bd-2c3cdc3c5dac admin admin] PATH_INFO: `/v3/projects/4337575622d04a26942905c9dc044ba7/users/4e9df82f95ac4779859972403869096a/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:24.668746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1ec04-4e9f-4247-90bd-2c3cdc3c5dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4337575622d04a26942905c9dc044ba7, user_id=4e9df82f95ac4779859972403869096a, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:24.672349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1ec04-4e9f-4247-90bd-2c3cdc3c5dac admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:24.790701 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1390/2811] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:13:24 2022] PUT /identity/v3/projects/4337575622d04a26942905c9dc044ba7/users/4e9df82f95ac4779859972403869096a/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:24.791774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f1b67-db6c-4fe0-8ac0-80c788dba109 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:24.792070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f1b67-db6c-4fe0-8ac0-80c788dba109 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:24.792349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f1b67-db6c-4fe0-8ac0-80c788dba109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:24.820313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-577f1b67-db6c-4fe0-8ac0-80c788dba109 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:24.821707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-577f1b67-db6c-4fe0-8ac0-80c788dba109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:24.912994 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1422/2812] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:13:24.931683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1ec04-4e9f-4247-90bd-2c3cdc3c5dac admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:24.934268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a5c1ec04-4e9f-4247-90bd-2c3cdc3c5dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:25.061313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1ec04-4e9f-4247-90bd-2c3cdc3c5dac admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:25.075910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27301a-42f4-4bcc-b195-8e2423023abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:25.076661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27301a-42f4-4bcc-b195-8e2423023abe service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:25.076946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27301a-42f4-4bcc-b195-8e2423023abe service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:25.077223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27301a-42f4-4bcc-b195-8e2423023abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:25.101682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27301a-42f4-4bcc-b195-8e2423023abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:25.109495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27301a-42f4-4bcc-b195-8e2423023abe service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:25.114257 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1391/2813] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:13:25.271239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f1b67-db6c-4fe0-8ac0-80c788dba109 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:25.272017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-577f1b67-db6c-4fe0-8ac0-80c788dba109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:25.297297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f1b67-db6c-4fe0-8ac0-80c788dba109 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:25.305411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf4a19-2272-45c5-af67-dd7d1bb1e097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:25.306768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf4a19-2272-45c5-af67-dd7d1bb1e097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:25.307089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf4a19-2272-45c5-af67-dd7d1bb1e097 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:25.308248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf4a19-2272-45c5-af67-dd7d1bb1e097 admin admin] PATH_INFO: `/v3/projects/61d182411dbf423bb29beca95e3fea26` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:25.321660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf4a19-2272-45c5-af67-dd7d1bb1e097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d182411dbf423bb29beca95e3fea26)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:25.323696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf4a19-2272-45c5-af67-dd7d1bb1e097 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:25.513907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-28cf4a19-2272-45c5-af67-dd7d1bb1e097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d182411dbf423bb29beca95e3fea26', 'request_id': 'req-28cf4a19-2272-45c5-af67-dd7d1bb1e097'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:25.524568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-28cf4a19-2272-45c5-af67-dd7d1bb1e097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d182411dbf423bb29beca95e3fea26', 'request_id': 'req-28cf4a19-2272-45c5-af67-dd7d1bb1e097'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:25.539678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-28cf4a19-2272-45c5-af67-dd7d1bb1e097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d182411dbf423bb29beca95e3fea26', 'request_id': 'req-28cf4a19-2272-45c5-af67-dd7d1bb1e097'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:25.628803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-28cf4a19-2272-45c5-af67-dd7d1bb1e097 admin admin] The token cache is being invalidate because project 61d182411dbf423bb29beca95e3fea26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:13:25.629662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-28cf4a19-2272-45c5-af67-dd7d1bb1e097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:25.630422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-28cf4a19-2272-45c5-af67-dd7d1bb1e097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:25.633721 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1423/2814] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:13:25 2022] DELETE /identity/v3/projects/61d182411dbf423bb29beca95e3fea26 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:25.637554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27301a-42f4-4bcc-b195-8e2423023abe service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:25.651002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27301a-42f4-4bcc-b195-8e2423023abe service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:25.707484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:25.790192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe5808-3201-4cbe-a989-7ad348dfe666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:25.791209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe5808-3201-4cbe-a989-7ad348dfe666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:25.792090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe5808-3201-4cbe-a989-7ad348dfe666 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:25.792429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe5808-3201-4cbe-a989-7ad348dfe666 admin admin] PATH_INFO: `/v3/users/892b4ef9c5db4462a6e134f12519f254` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:25.793844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe5808-3201-4cbe-a989-7ad348dfe666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=892b4ef9c5db4462a6e134f12519f254)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:25.796152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe5808-3201-4cbe-a989-7ad348dfe666 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:26.039688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a6fe5808-3201-4cbe-a989-7ad348dfe666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '892b4ef9c5db4462a6e134f12519f254'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:26.062877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a6fe5808-3201-4cbe-a989-7ad348dfe666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '892b4ef9c5db4462a6e134f12519f254'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:26.101848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:26.152547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a6fe5808-3201-4cbe-a989-7ad348dfe666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '892b4ef9c5db4462a6e134f12519f254'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:26.166277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a6fe5808-3201-4cbe-a989-7ad348dfe666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '892b4ef9c5db4462a6e134f12519f254'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:26.168009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a6fe5808-3201-4cbe-a989-7ad348dfe666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '892b4ef9c5db4462a6e134f12519f254'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:26.181463 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1392/2815] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:13:25 2022] DELETE /identity/v3/users/892b4ef9c5db4462a6e134f12519f254 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:27.436721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:27.716407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf4a19-2272-45c5-af67-dd7d1bb1e097 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:27.718172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-28cf4a19-2272-45c5-af67-dd7d1bb1e097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:27.746278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf4a19-2272-45c5-af67-dd7d1bb1e097 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:27.845164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:27.941910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9257ab-5ae5-4b62-8d03-47e767575755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:27.941910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9257ab-5ae5-4b62-8d03-47e767575755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:27.941910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9257ab-5ae5-4b62-8d03-47e767575755 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:27.941910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9257ab-5ae5-4b62-8d03-47e767575755 admin admin] PATH_INFO: `/v3/projects/1a34953aff484e62a526829fd8065a1b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:27.943328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9257ab-5ae5-4b62-8d03-47e767575755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a34953aff484e62a526829fd8065a1b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:27.946661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9257ab-5ae5-4b62-8d03-47e767575755 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:28.542840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8f9257ab-5ae5-4b62-8d03-47e767575755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a34953aff484e62a526829fd8065a1b', 'request_id': 'req-8f9257ab-5ae5-4b62-8d03-47e767575755'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:28.556010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8f9257ab-5ae5-4b62-8d03-47e767575755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a34953aff484e62a526829fd8065a1b', 'request_id': 'req-8f9257ab-5ae5-4b62-8d03-47e767575755'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:28.574663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8f9257ab-5ae5-4b62-8d03-47e767575755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a34953aff484e62a526829fd8065a1b', 'request_id': 'req-8f9257ab-5ae5-4b62-8d03-47e767575755'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:28.696168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8f9257ab-5ae5-4b62-8d03-47e767575755 admin admin] The token cache is being invalidate because project 1a34953aff484e62a526829fd8065a1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:13:28.696752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8f9257ab-5ae5-4b62-8d03-47e767575755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:28.697619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8f9257ab-5ae5-4b62-8d03-47e767575755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:13:28.700117 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1424/2816] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:13:27 2022] DELETE /identity/v3/projects/1a34953aff484e62a526829fd8065a1b => generated 0 bytes in 984 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:28.709694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cb682-9f64-456e-8974-8e98b8d767f8 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:28.710130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cb682-9f64-456e-8974-8e98b8d767f8 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:28.710265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cb682-9f64-456e-8974-8e98b8d767f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:28.752049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-316cb682-9f64-456e-8974-8e98b8d767f8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:28.757235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-316cb682-9f64-456e-8974-8e98b8d767f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:28.955708 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1393/2817] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:29.034919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dd116-3353-4e6d-8f13-b122ba8116ea None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:29.035445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dd116-3353-4e6d-8f13-b122ba8116ea None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:29.035550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dd116-3353-4e6d-8f13-b122ba8116ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:29.083210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-744dd116-3353-4e6d-8f13-b122ba8116ea None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:29.085066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-744dd116-3353-4e6d-8f13-b122ba8116ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:29.110339 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1425/2818] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:13:29.114853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cb682-9f64-456e-8974-8e98b8d767f8 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:29.136736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cb682-9f64-456e-8974-8e98b8d767f8 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:29.151230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2398ba-c39c-4112-b991-d9a64217df27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:29.151911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2398ba-c39c-4112-b991-d9a64217df27 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:29.152197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2398ba-c39c-4112-b991-d9a64217df27 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:29.152476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2398ba-c39c-4112-b991-d9a64217df27 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:29.153283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2398ba-c39c-4112-b991-d9a64217df27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:13:29.153530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2398ba-c39c-4112-b991-d9a64217df27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:29.164653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2398ba-c39c-4112-b991-d9a64217df27 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:29.204140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dd116-3353-4e6d-8f13-b122ba8116ea None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:29.206186 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1394/2819] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:13:29.228102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dd116-3353-4e6d-8f13-b122ba8116ea None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:29.245495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa82bb2-7460-4af3-971e-38906818e498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:29.246176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa82bb2-7460-4af3-971e-38906818e498 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:29.246456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa82bb2-7460-4af3-971e-38906818e498 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:29.246802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa82bb2-7460-4af3-971e-38906818e498 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:29.247527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa82bb2-7460-4af3-971e-38906818e498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:29.259399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa82bb2-7460-4af3-971e-38906818e498 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:29.400260 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1426/2820] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:13:29 2022] POST /identity/v3/projects => generated 393 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:13:29.402744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2398ba-c39c-4112-b991-d9a64217df27 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:29.422213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2398ba-c39c-4112-b991-d9a64217df27 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:29.541327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:29.581221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10d2b5-6f8c-4862-8a6c-ac7fd3023324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:29.582340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10d2b5-6f8c-4862-8a6c-ac7fd3023324 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:29.582866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10d2b5-6f8c-4862-8a6c-ac7fd3023324 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:29.583393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10d2b5-6f8c-4862-8a6c-ac7fd3023324 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:29.584583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10d2b5-6f8c-4862-8a6c-ac7fd3023324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:29.593868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10d2b5-6f8c-4862-8a6c-ac7fd3023324 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:29.729586 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1395/2821] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:13:29 2022] POST /identity/v3/users => generated 297 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:13:29.733795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa82bb2-7460-4af3-971e-38906818e498 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:29.755897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa82bb2-7460-4af3-971e-38906818e498 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:29.771054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777c37d-9bc6-4787-aa15-4edea1a730a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:29.774452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777c37d-9bc6-4787-aa15-4edea1a730a8 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:29.775836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777c37d-9bc6-4787-aa15-4edea1a730a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:29.777500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777c37d-9bc6-4787-aa15-4edea1a730a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:29.778382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777c37d-9bc6-4787-aa15-4edea1a730a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:29.788150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:INSERT=2,keystone:DELETE=2,keystone:SELECT=96 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:29.789930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777c37d-9bc6-4787-aa15-4edea1a730a8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:29.829529 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1427/2822] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:13:29.833927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10d2b5-6f8c-4862-8a6c-ac7fd3023324 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:29.857331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10d2b5-6f8c-4862-8a6c-ac7fd3023324 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:29.887658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df88bd-29e9-4f75-bcab-94ae41bb4abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:29.889473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df88bd-29e9-4f75-bcab-94ae41bb4abb admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:29.891347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df88bd-29e9-4f75-bcab-94ae41bb4abb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:29.892560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df88bd-29e9-4f75-bcab-94ae41bb4abb admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:29.893498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df88bd-29e9-4f75-bcab-94ae41bb4abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:29.900809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df88bd-29e9-4f75-bcab-94ae41bb4abb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:29.939511 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1396/2823] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:13:29.941658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777c37d-9bc6-4787-aa15-4edea1a730a8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:29.955486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777c37d-9bc6-4787-aa15-4edea1a730a8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:29.965888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b078f6a-132a-41cd-aee1-698621501d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:29.966901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b078f6a-132a-41cd-aee1-698621501d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:29.967202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b078f6a-132a-41cd-aee1-698621501d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:29.968553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b078f6a-132a-41cd-aee1-698621501d89 admin admin] PATH_INFO: `/v3/projects/45d9edd2fe854483a6f0d676efbd6622/users/c1aea87154224f1c81428ddef4438801/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:30.008285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b078f6a-132a-41cd-aee1-698621501d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d9edd2fe854483a6f0d676efbd6622, user_id=c1aea87154224f1c81428ddef4438801, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:30.019356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b078f6a-132a-41cd-aee1-698621501d89 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:30.120757 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1428/2824] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:13:29 2022] PUT /identity/v3/projects/45d9edd2fe854483a6f0d676efbd6622/users/c1aea87154224f1c81428ddef4438801/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:30.134336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526e0a9-8137-4595-bf1b-bbe24d780ae6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:30.134631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526e0a9-8137-4595-bf1b-bbe24d780ae6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:30.134922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526e0a9-8137-4595-bf1b-bbe24d780ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:30.271090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b526e0a9-8137-4595-bf1b-bbe24d780ae6 None None] MFA Rules not processed for user `c1aea87154224f1c81428ddef4438801`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:30.271090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b526e0a9-8137-4595-bf1b-bbe24d780ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:30.385090 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1397/2825] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:30.391829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b078f6a-132a-41cd-aee1-698621501d89 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:30.529172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b078f6a-132a-41cd-aee1-698621501d89 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:30.534140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f57f3-6c12-4e79-9297-12bafff18902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:30.535193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f57f3-6c12-4e79-9297-12bafff18902 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:30.536192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f57f3-6c12-4e79-9297-12bafff18902 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:30.536476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f57f3-6c12-4e79-9297-12bafff18902 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:30.538045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f57f3-6c12-4e79-9297-12bafff18902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:30.541323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f57f3-6c12-4e79-9297-12bafff18902 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:30.682701 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1429/2826] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:13:30 2022] POST /identity/v3/projects => generated 393 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:13:30.684007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526e0a9-8137-4595-bf1b-bbe24d780ae6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:30.703509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526e0a9-8137-4595-bf1b-bbe24d780ae6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:30.900418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414abb33-fc25-461a-a39c-5d55cff87f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:30.901115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414abb33-fc25-461a-a39c-5d55cff87f21 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:30.901581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414abb33-fc25-461a-a39c-5d55cff87f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:30.903180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414abb33-fc25-461a-a39c-5d55cff87f21 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:30.904080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414abb33-fc25-461a-a39c-5d55cff87f21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:30.907583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414abb33-fc25-461a-a39c-5d55cff87f21 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:31.002851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f57f3-6c12-4e79-9297-12bafff18902 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:31.005542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1d9f57f3-6c12-4e79-9297-12bafff18902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:31.069281 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1398/2827] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:13:30 2022] POST /identity/v3/users => generated 303 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:13:31.076829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414abb33-fc25-461a-a39c-5d55cff87f21 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:31.102099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414abb33-fc25-461a-a39c-5d55cff87f21 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:31.125064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a85199-944c-44ac-8abd-4c8a8660253a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:31.126056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a85199-944c-44ac-8abd-4c8a8660253a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:31.126503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a85199-944c-44ac-8abd-4c8a8660253a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:31.126958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a85199-944c-44ac-8abd-4c8a8660253a admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:31.127903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a85199-944c-44ac-8abd-4c8a8660253a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:31.136870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a85199-944c-44ac-8abd-4c8a8660253a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:31.166609 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1399/2828] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:13:31.171182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a85199-944c-44ac-8abd-4c8a8660253a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:31.188992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f57f3-6c12-4e79-9297-12bafff18902 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:31.204200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a85199-944c-44ac-8abd-4c8a8660253a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:31.206518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558694f-a379-4002-bba4-6869d14e1fb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:31.207471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558694f-a379-4002-bba4-6869d14e1fb0 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:31.209794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558694f-a379-4002-bba4-6869d14e1fb0 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:31.210412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558694f-a379-4002-bba4-6869d14e1fb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:31.213171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100c927-f17d-4e33-9850-7b3380ce84b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:31.216139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100c927-f17d-4e33-9850-7b3380ce84b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:31.216429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100c927-f17d-4e33-9850-7b3380ce84b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:31.216594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0558694f-a379-4002-bba4-6869d14e1fb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:31.216717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100c927-f17d-4e33-9850-7b3380ce84b7 admin admin] PATH_INFO: `/v3/projects/38594b6bc3354178a22f0abb698e98a6/users/27aeaef0a671464493a8cac846186af7/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:31.250673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558694f-a379-4002-bba4-6869d14e1fb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:31.255837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558694f-a379-4002-bba4-6869d14e1fb0 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:31.258784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100c927-f17d-4e33-9850-7b3380ce84b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38594b6bc3354178a22f0abb698e98a6, user_id=27aeaef0a671464493a8cac846186af7, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:31.261543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100c927-f17d-4e33-9850-7b3380ce84b7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:31.295447 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1430/2829] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:13:31.372998 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1400/2830] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:13:31 2022] PUT /identity/v3/projects/38594b6bc3354178a22f0abb698e98a6/users/27aeaef0a671464493a8cac846186af7/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:13:31.377263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558694f-a379-4002-bba4-6869d14e1fb0 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:31.402069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558694f-a379-4002-bba4-6869d14e1fb0 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:31.583050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d07bd-8605-430e-b427-389740fa9d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:31.586917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d07bd-8605-430e-b427-389740fa9d93 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:31.588991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d07bd-8605-430e-b427-389740fa9d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:31.589451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d07bd-8605-430e-b427-389740fa9d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:31.601178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d07bd-8605-430e-b427-389740fa9d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:31.603142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d07bd-8605-430e-b427-389740fa9d93 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:31.632193 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1431/2831] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:13:31.632417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100c927-f17d-4e33-9850-7b3380ce84b7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:31.657440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100c927-f17d-4e33-9850-7b3380ce84b7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:31.676816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9e717-5329-40a7-aaa7-7fc9e7be6f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:31.677723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9e717-5329-40a7-aaa7-7fc9e7be6f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:31.678135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9e717-5329-40a7-aaa7-7fc9e7be6f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:31.678780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9e717-5329-40a7-aaa7-7fc9e7be6f55 admin admin] PATH_INFO: `/v3/projects/38594b6bc3354178a22f0abb698e98a6/users/27aeaef0a671464493a8cac846186af7/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:31.689027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9e717-5329-40a7-aaa7-7fc9e7be6f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38594b6bc3354178a22f0abb698e98a6, user_id=27aeaef0a671464493a8cac846186af7, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:31.697697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9e717-5329-40a7-aaa7-7fc9e7be6f55 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:31.742836 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1401/2832] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:13:31 2022] PUT /identity/v3/projects/38594b6bc3354178a22f0abb698e98a6/users/27aeaef0a671464493a8cac846186af7/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:13:31.745273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82e026-e805-4b79-b560-250901b32eab None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:31.746585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82e026-e805-4b79-b560-250901b32eab None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:31.747103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82e026-e805-4b79-b560-250901b32eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:31.757735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:31.866171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1d82e026-e805-4b79-b560-250901b32eab None None] MFA Rules not processed for user `27aeaef0a671464493a8cac846186af7`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:31.872259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1d82e026-e805-4b79-b560-250901b32eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:32.078555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:32.091263 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1432/2833] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:32.092673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbea518-ed44-4cf0-868f-7dd7d3091395 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:32.092982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbea518-ed44-4cf0-868f-7dd7d3091395 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:32.093243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbea518-ed44-4cf0-868f-7dd7d3091395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:32.135999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1cbea518-ed44-4cf0-868f-7dd7d3091395 None None] MFA Rules not processed for user `c1aea87154224f1c81428ddef4438801`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:32.137551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1cbea518-ed44-4cf0-868f-7dd7d3091395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:32.308965 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1402/2834] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:13:32.320809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82e026-e805-4b79-b560-250901b32eab None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:32.325872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1d82e026-e805-4b79-b560-250901b32eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:32.592282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82e026-e805-4b79-b560-250901b32eab None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:32.611226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02e7b5-0b7b-4558-b31f-996518da1064 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:32.612200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02e7b5-0b7b-4558-b31f-996518da1064 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:32.612656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02e7b5-0b7b-4558-b31f-996518da1064 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:32.613122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02e7b5-0b7b-4558-b31f-996518da1064 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:32.641940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02e7b5-0b7b-4558-b31f-996518da1064 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:32.641940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02e7b5-0b7b-4558-b31f-996518da1064 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:32.663543 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1433/2835] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:13:32.946766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:33.941306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:34.286288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbea518-ed44-4cf0-868f-7dd7d3091395 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:34.289133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1cbea518-ed44-4cf0-868f-7dd7d3091395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:34.464599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbea518-ed44-4cf0-868f-7dd7d3091395 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:34.487762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba80c8b-cdcc-4ae9-84a2-a5d79581b9c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:34.488689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba80c8b-cdcc-4ae9-84a2-a5d79581b9c2 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:34.489210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba80c8b-cdcc-4ae9-84a2-a5d79581b9c2 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:34.489701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba80c8b-cdcc-4ae9-84a2-a5d79581b9c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:34.495943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-eba80c8b-cdcc-4ae9-84a2-a5d79581b9c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:34.528569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba80c8b-cdcc-4ae9-84a2-a5d79581b9c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:34.530344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba80c8b-cdcc-4ae9-84a2-a5d79581b9c2 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:34.557013 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1403/2836] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:13:35.038700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:36.562644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:36.861383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a94f70-d94e-4e3d-b7b1-78c7550e42ae None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:36.862301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a94f70-d94e-4e3d-b7b1-78c7550e42ae None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:36.862823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a94f70-d94e-4e3d-b7b1-78c7550e42ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:37.006016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-15a94f70-d94e-4e3d-b7b1-78c7550e42ae None None] MFA Rules not processed for user `2eba2ac21c344394a7d3f605775b8713`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:37.009414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-15a94f70-d94e-4e3d-b7b1-78c7550e42ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:37.287737 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1434/2837] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:36 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:37.378142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb20701-1da6-4bae-93b5-620d1ed76f11 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:37.378689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb20701-1da6-4bae-93b5-620d1ed76f11 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:37.379190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb20701-1da6-4bae-93b5-620d1ed76f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:37.404176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-bbb20701-1da6-4bae-93b5-620d1ed76f11 None None] MFA Rules not processed for user `2eba2ac21c344394a7d3f605775b8713`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:37.405991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bbb20701-1da6-4bae-93b5-620d1ed76f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:37.420026 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1404/2838] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:37.435297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a94f70-d94e-4e3d-b7b1-78c7550e42ae None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:37.458941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a94f70-d94e-4e3d-b7b1-78c7550e42ae None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:37.469603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712645d5-5d70-4bdd-a6ee-500f0c049287 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:37.470818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712645d5-5d70-4bdd-a6ee-500f0c049287 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:37.472099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712645d5-5d70-4bdd-a6ee-500f0c049287 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:37.472602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712645d5-5d70-4bdd-a6ee-500f0c049287 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:37.484887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712645d5-5d70-4bdd-a6ee-500f0c049287 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:37.487832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712645d5-5d70-4bdd-a6ee-500f0c049287 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:37.500867 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1435/2839] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:37 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:13:37.695188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:38.616276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761198b-c5bc-4369-821b-1c95c772d1c9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:38.616276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761198b-c5bc-4369-821b-1c95c772d1c9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:38.616276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761198b-c5bc-4369-821b-1c95c772d1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:38.621876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:38.694645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f761198b-c5bc-4369-821b-1c95c772d1c9 None None] MFA Rules not processed for user `53af488f3b0242a797f539284b78d59e`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:38.698797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f761198b-c5bc-4369-821b-1c95c772d1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:38.853065 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1405/2840] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:38.953053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712645d5-5d70-4bdd-a6ee-500f0c049287 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:38.955218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-712645d5-5d70-4bdd-a6ee-500f0c049287 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:39.043831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761198b-c5bc-4369-821b-1c95c772d1c9 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:39.071781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761198b-c5bc-4369-821b-1c95c772d1c9 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:39.090596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712645d5-5d70-4bdd-a6ee-500f0c049287 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:39.096756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6412c-9ade-4997-a6eb-055eaf4006c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:39.097442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252b73d-cf76-4519-9aa4-f4ce8f33a240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:39.098166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252b73d-cf76-4519-9aa4-f4ce8f33a240 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:39.098454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252b73d-cf76-4519-9aa4-f4ce8f33a240 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:39.098730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252b73d-cf76-4519-9aa4-f4ce8f33a240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:39.099983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6412c-9ade-4997-a6eb-055eaf4006c3 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:39.100556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6412c-9ade-4997-a6eb-055eaf4006c3 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:39.102193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6412c-9ade-4997-a6eb-055eaf4006c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:39.107178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-84b6412c-9ade-4997-a6eb-055eaf4006c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:39.110126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252b73d-cf76-4519-9aa4-f4ce8f33a240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:39.111894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252b73d-cf76-4519-9aa4-f4ce8f33a240 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:39.126887 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1436/2841] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:13:39.368221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6412c-9ade-4997-a6eb-055eaf4006c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:39.374126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6412c-9ade-4997-a6eb-055eaf4006c3 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:39.393952 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1406/2842] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:13:41.424134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252b73d-cf76-4519-9aa4-f4ce8f33a240 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:41.448653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252b73d-cf76-4519-9aa4-f4ce8f33a240 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:41.484665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f90c36-ea52-4d96-b05e-506d1cfae7af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:41.485594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f90c36-ea52-4d96-b05e-506d1cfae7af service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:41.486148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f90c36-ea52-4d96-b05e-506d1cfae7af service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:41.487253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f90c36-ea52-4d96-b05e-506d1cfae7af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:41.489794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-06f90c36-ea52-4d96-b05e-506d1cfae7af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:41.590546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f90c36-ea52-4d96-b05e-506d1cfae7af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:41.600356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f90c36-ea52-4d96-b05e-506d1cfae7af service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:41.708990 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1437/2843] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:13:45.743509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353d184-f0c9-4aa1-b304-0a62a61b4a8a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:45.745224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353d184-f0c9-4aa1-b304-0a62a61b4a8a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:45.745224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353d184-f0c9-4aa1-b304-0a62a61b4a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:45.809263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7353d184-f0c9-4aa1-b304-0a62a61b4a8a None None] MFA Rules not processed for user `4e9df82f95ac4779859972403869096a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:45.810780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7353d184-f0c9-4aa1-b304-0a62a61b4a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:46.047094 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1407/2844] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:46.049033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf83dd-1206-4bab-b570-0ad7869d9984 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:46.049569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf83dd-1206-4bab-b570-0ad7869d9984 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:46.050023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf83dd-1206-4bab-b570-0ad7869d9984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:46.100524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c1cf83dd-1206-4bab-b570-0ad7869d9984 None None] MFA Rules not processed for user `4e9df82f95ac4779859972403869096a`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:46.110942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c1cf83dd-1206-4bab-b570-0ad7869d9984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:46.138630 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1438/2845] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:46.837401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353d184-f0c9-4aa1-b304-0a62a61b4a8a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:46.879629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353d184-f0c9-4aa1-b304-0a62a61b4a8a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:46.896838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba7972-7fe9-445e-9282-d4746cf19be9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:46.897618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba7972-7fe9-445e-9282-d4746cf19be9 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:46.898082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba7972-7fe9-445e-9282-d4746cf19be9 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:46.913716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba7972-7fe9-445e-9282-d4746cf19be9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:46.946898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba7972-7fe9-445e-9282-d4746cf19be9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:46.954873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba7972-7fe9-445e-9282-d4746cf19be9 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:47.006677 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1408/2846] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:13:49.889999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65744dc-12fd-44bf-b741-f1cc17844639 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:49.890581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65744dc-12fd-44bf-b741-f1cc17844639 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:49.890581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65744dc-12fd-44bf-b741-f1cc17844639 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:49.892242 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1439/2847] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:13:49.902676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c31014-950a-4089-b2f0-4328d64841e3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:49.903649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c31014-950a-4089-b2f0-4328d64841e3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:49.903649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c31014-950a-4089-b2f0-4328d64841e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:49.917861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4c2ab-650e-4a9e-a7b9-5ee22c96c503 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:49.918828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4c2ab-650e-4a9e-a7b9-5ee22c96c503 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:49.919340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4c2ab-650e-4a9e-a7b9-5ee22c96c503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:49.923464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:13:49.952871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3eb4c2ab-650e-4a9e-a7b9-5ee22c96c503 None None] MFA Rules not processed for user `53af488f3b0242a797f539284b78d59e`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:49.954568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3eb4c2ab-650e-4a9e-a7b9-5ee22c96c503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:49.961140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a3c31014-950a-4089-b2f0-4328d64841e3 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:13:49.962472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a3c31014-950a-4089-b2f0-4328d64841e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:49.965231 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1440/2848] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:13:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:13:49.982494 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1409/2849] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:13:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:13:50.048963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4c2ab-650e-4a9e-a7b9-5ee22c96c503 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:50.048963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4c2ab-650e-4a9e-a7b9-5ee22c96c503 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:50.055858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6583a-4721-40ad-bc53-c1454065162e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:50.056533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6583a-4721-40ad-bc53-c1454065162e service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:50.057012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6583a-4721-40ad-bc53-c1454065162e service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:50.057453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6583a-4721-40ad-bc53-c1454065162e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:50.083357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6583a-4721-40ad-bc53-c1454065162e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:50.085268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6583a-4721-40ad-bc53-c1454065162e service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:50.109730 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1441/2850] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:13:50.315619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c31014-950a-4089-b2f0-4328d64841e3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:50.317297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a3c31014-950a-4089-b2f0-4328d64841e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:50.338772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c31014-950a-4089-b2f0-4328d64841e3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:50.344464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a671f7f-bce0-470c-93e3-54aec8ebd136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:50.360681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a671f7f-bce0-470c-93e3-54aec8ebd136 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:50.361340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a671f7f-bce0-470c-93e3-54aec8ebd136 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:50.363380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a671f7f-bce0-470c-93e3-54aec8ebd136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:50.369899 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0a671f7f-bce0-470c-93e3-54aec8ebd136 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:13:50.376679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6583a-4721-40ad-bc53-c1454065162e service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:13:50.392263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a671f7f-bce0-470c-93e3-54aec8ebd136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:50.392515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6583a-4721-40ad-bc53-c1454065162e service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:13:50.392630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a671f7f-bce0-470c-93e3-54aec8ebd136 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:50.397360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e2e77-b0e2-4307-9d2e-59ceaa9dfa18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:13:50.398113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e2e77-b0e2-4307-9d2e-59ceaa9dfa18 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:13:50.398395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e2e77-b0e2-4307-9d2e-59ceaa9dfa18 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:13:50.398666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e2e77-b0e2-4307-9d2e-59ceaa9dfa18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:13:50.404421 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1410/2851] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:13:50.413400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e2e77-b0e2-4307-9d2e-59ceaa9dfa18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:13:50.415193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e2e77-b0e2-4307-9d2e-59ceaa9dfa18 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:13:50.453491 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1442/2852] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:13:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:14:00.441929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:02.833563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a671f7f-bce0-470c-93e3-54aec8ebd136 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:02.852994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a671f7f-bce0-470c-93e3-54aec8ebd136 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:02.859176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5159d00-c59f-49d4-9c28-081c9b8471e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:02.862760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5159d00-c59f-49d4-9c28-081c9b8471e9 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:02.862760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5159d00-c59f-49d4-9c28-081c9b8471e9 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:02.867322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5159d00-c59f-49d4-9c28-081c9b8471e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:02.879469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5159d00-c59f-49d4-9c28-081c9b8471e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:02.898778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5159d00-c59f-49d4-9c28-081c9b8471e9 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:02.916743 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1411/2853] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:14:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:14:02.946206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316766c0-40d7-4cab-98a2-fe563b59ff17 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:02.946785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316766c0-40d7-4cab-98a2-fe563b59ff17 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:02.946946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316766c0-40d7-4cab-98a2-fe563b59ff17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:02.990099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-316766c0-40d7-4cab-98a2-fe563b59ff17 None None] MFA Rules not processed for user `c1aea87154224f1c81428ddef4438801`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:02.990099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-316766c0-40d7-4cab-98a2-fe563b59ff17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:03.003499 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1443/2854] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:03.022334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5159d00-c59f-49d4-9c28-081c9b8471e9 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:03.024258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c5159d00-c59f-49d4-9c28-081c9b8471e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:03.115505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5159d00-c59f-49d4-9c28-081c9b8471e9 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:03.123378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b50dc1-bc3f-4340-9ae3-474e90344de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:03.124616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b50dc1-bc3f-4340-9ae3-474e90344de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:03.125198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b50dc1-bc3f-4340-9ae3-474e90344de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:03.125583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b50dc1-bc3f-4340-9ae3-474e90344de9 admin admin] PATH_INFO: `/v3/users/52281b3989a04ca2a50b0bc93bf783f0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:03.127423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b50dc1-bc3f-4340-9ae3-474e90344de9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52281b3989a04ca2a50b0bc93bf783f0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:03.130004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b50dc1-bc3f-4340-9ae3-474e90344de9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:03.439468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d7b50dc1-bc3f-4340-9ae3-474e90344de9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52281b3989a04ca2a50b0bc93bf783f0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:03.453762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d7b50dc1-bc3f-4340-9ae3-474e90344de9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52281b3989a04ca2a50b0bc93bf783f0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:03.580030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d7b50dc1-bc3f-4340-9ae3-474e90344de9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52281b3989a04ca2a50b0bc93bf783f0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:03.588828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d7b50dc1-bc3f-4340-9ae3-474e90344de9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52281b3989a04ca2a50b0bc93bf783f0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:03.592029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d7b50dc1-bc3f-4340-9ae3-474e90344de9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52281b3989a04ca2a50b0bc93bf783f0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:03.610967 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1412/2855] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:14:03 2022] DELETE /identity/v3/users/52281b3989a04ca2a50b0bc93bf783f0 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:04.099484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316766c0-40d7-4cab-98a2-fe563b59ff17 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:04.113873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316766c0-40d7-4cab-98a2-fe563b59ff17 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:04.209662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f33924-4e76-4918-bc69-41d9a621f72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:04.210889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f33924-4e76-4918-bc69-41d9a621f72a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:04.211268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f33924-4e76-4918-bc69-41d9a621f72a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:04.211751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f33924-4e76-4918-bc69-41d9a621f72a admin admin] PATH_INFO: `/v3/projects/30d028fa9b854c8fb71c8cbed2985c27` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:04.213238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f33924-4e76-4918-bc69-41d9a621f72a admin admin] RBAC: Authorizing `identity:delete_project(project_id=30d028fa9b854c8fb71c8cbed2985c27)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:04.215409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f33924-4e76-4918-bc69-41d9a621f72a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:04.446602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-85f33924-4e76-4918-bc69-41d9a621f72a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d028fa9b854c8fb71c8cbed2985c27', 'request_id': 'req-85f33924-4e76-4918-bc69-41d9a621f72a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:04.471792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-85f33924-4e76-4918-bc69-41d9a621f72a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d028fa9b854c8fb71c8cbed2985c27', 'request_id': 'req-85f33924-4e76-4918-bc69-41d9a621f72a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:04.489459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-85f33924-4e76-4918-bc69-41d9a621f72a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d028fa9b854c8fb71c8cbed2985c27', 'request_id': 'req-85f33924-4e76-4918-bc69-41d9a621f72a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:04.604041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-85f33924-4e76-4918-bc69-41d9a621f72a admin admin] The token cache is being invalidate because project 30d028fa9b854c8fb71c8cbed2985c27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:14:04.610690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-85f33924-4e76-4918-bc69-41d9a621f72a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:04.610690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-85f33924-4e76-4918-bc69-41d9a621f72a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:04.610690 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1444/2856] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:14:04 2022] DELETE /identity/v3/projects/30d028fa9b854c8fb71c8cbed2985c27 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:04.611036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b50dc1-bc3f-4340-9ae3-474e90344de9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:04.612720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d7b50dc1-bc3f-4340-9ae3-474e90344de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:04.629365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b50dc1-bc3f-4340-9ae3-474e90344de9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:04.731271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:04.747326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86817f-d824-49e0-ac9c-b6375bc84694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:04.750607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86817f-d824-49e0-ac9c-b6375bc84694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:04.750607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86817f-d824-49e0-ac9c-b6375bc84694 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:04.750607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86817f-d824-49e0-ac9c-b6375bc84694 admin admin] PATH_INFO: `/v3/users/6dfd80a71b204625b5401e5249a0bbed` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:04.752844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86817f-d824-49e0-ac9c-b6375bc84694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dfd80a71b204625b5401e5249a0bbed)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:04.756005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86817f-d824-49e0-ac9c-b6375bc84694 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:05.043657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7b86817f-d824-49e0-ac9c-b6375bc84694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dfd80a71b204625b5401e5249a0bbed'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:05.071865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7b86817f-d824-49e0-ac9c-b6375bc84694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dfd80a71b204625b5401e5249a0bbed'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:05.210536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7b86817f-d824-49e0-ac9c-b6375bc84694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dfd80a71b204625b5401e5249a0bbed'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:05.212047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7b86817f-d824-49e0-ac9c-b6375bc84694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dfd80a71b204625b5401e5249a0bbed'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:05.213000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7b86817f-d824-49e0-ac9c-b6375bc84694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dfd80a71b204625b5401e5249a0bbed'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:05.225385 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1413/2857] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:14:04 2022] DELETE /identity/v3/users/6dfd80a71b204625b5401e5249a0bbed => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:05.592213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f33924-4e76-4918-bc69-41d9a621f72a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:05.594227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-85f33924-4e76-4918-bc69-41d9a621f72a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:05.643098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f33924-4e76-4918-bc69-41d9a621f72a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:05.785449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd304e3-fbcc-414c-9d9f-75f458e8c06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:05.787600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd304e3-fbcc-414c-9d9f-75f458e8c06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:05.787992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd304e3-fbcc-414c-9d9f-75f458e8c06f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:05.789166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd304e3-fbcc-414c-9d9f-75f458e8c06f admin admin] PATH_INFO: `/v3/projects/f27ffd13e54d41ebb9e79a74725cb3bf` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:05.790855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd304e3-fbcc-414c-9d9f-75f458e8c06f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f27ffd13e54d41ebb9e79a74725cb3bf)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:05.793151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd304e3-fbcc-414c-9d9f-75f458e8c06f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:05.955468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:05.978059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ecd304e3-fbcc-414c-9d9f-75f458e8c06f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f27ffd13e54d41ebb9e79a74725cb3bf', 'request_id': 'req-ecd304e3-fbcc-414c-9d9f-75f458e8c06f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:05.987613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ecd304e3-fbcc-414c-9d9f-75f458e8c06f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f27ffd13e54d41ebb9e79a74725cb3bf', 'request_id': 'req-ecd304e3-fbcc-414c-9d9f-75f458e8c06f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:05.995939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ecd304e3-fbcc-414c-9d9f-75f458e8c06f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f27ffd13e54d41ebb9e79a74725cb3bf', 'request_id': 'req-ecd304e3-fbcc-414c-9d9f-75f458e8c06f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:06.187063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ecd304e3-fbcc-414c-9d9f-75f458e8c06f admin admin] The token cache is being invalidate because project f27ffd13e54d41ebb9e79a74725cb3bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:14:06.187453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ecd304e3-fbcc-414c-9d9f-75f458e8c06f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:06.188569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ecd304e3-fbcc-414c-9d9f-75f458e8c06f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:06.190440 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1445/2858] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:14:05 2022] DELETE /identity/v3/projects/f27ffd13e54d41ebb9e79a74725cb3bf => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:06.197139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf726b-b25f-42fb-8b8a-5941b1a553ff None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:06.198068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf726b-b25f-42fb-8b8a-5941b1a553ff None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:06.204154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf726b-b25f-42fb-8b8a-5941b1a553ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:06.217654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-54bf726b-b25f-42fb-8b8a-5941b1a553ff None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:06.218898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-54bf726b-b25f-42fb-8b8a-5941b1a553ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:06.310774 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1414/2859] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:14:06.318767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc16b9-798e-40d0-98d2-9d02def9b22a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:06.319125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc16b9-798e-40d0-98d2-9d02def9b22a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:06.319862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc16b9-798e-40d0-98d2-9d02def9b22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:06.345539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-65bc16b9-798e-40d0-98d2-9d02def9b22a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:06.346938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-65bc16b9-798e-40d0-98d2-9d02def9b22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:06.357892 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1446/2860] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:06.361997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf726b-b25f-42fb-8b8a-5941b1a553ff None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:06.373785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf726b-b25f-42fb-8b8a-5941b1a553ff None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:06.380469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327c886-37f2-40dd-bdbe-f845f1398de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:06.381139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327c886-37f2-40dd-bdbe-f845f1398de8 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:06.381419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327c886-37f2-40dd-bdbe-f845f1398de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:06.381689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327c886-37f2-40dd-bdbe-f845f1398de8 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:06.383480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327c886-37f2-40dd-bdbe-f845f1398de8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:14:06.383979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327c886-37f2-40dd-bdbe-f845f1398de8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:06.385596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327c886-37f2-40dd-bdbe-f845f1398de8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:06.402243 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1415/2861] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:14:06.407039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc16b9-798e-40d0-98d2-9d02def9b22a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:06.428394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc16b9-798e-40d0-98d2-9d02def9b22a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:06.428394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f711cc4-a9b4-4d99-977c-3632bc054aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:06.428394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f711cc4-a9b4-4d99-977c-3632bc054aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:06.428394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f711cc4-a9b4-4d99-977c-3632bc054aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:06.428770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f711cc4-a9b4-4d99-977c-3632bc054aa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:06.428770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f711cc4-a9b4-4d99-977c-3632bc054aa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:06.428770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f711cc4-a9b4-4d99-977c-3632bc054aa3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:06.552847 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1447/2862] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:14:06 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:14:06.554350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327c886-37f2-40dd-bdbe-f845f1398de8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:06.569149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327c886-37f2-40dd-bdbe-f845f1398de8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:06.631502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615078ef-3883-45a7-b106-d610bb91ecfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:06.633234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615078ef-3883-45a7-b106-d610bb91ecfa admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:06.633366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615078ef-3883-45a7-b106-d610bb91ecfa admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:06.633832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615078ef-3883-45a7-b106-d610bb91ecfa admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:06.634685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615078ef-3883-45a7-b106-d610bb91ecfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:06.636703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615078ef-3883-45a7-b106-d610bb91ecfa admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:06.743909 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1416/2863] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:14:06 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:14:06.745759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f711cc4-a9b4-4d99-977c-3632bc054aa3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:06.757605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f711cc4-a9b4-4d99-977c-3632bc054aa3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:06.762435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788a780-42af-4948-a1de-ef53cb9e5be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:06.763155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788a780-42af-4948-a1de-ef53cb9e5be0 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:06.763449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788a780-42af-4948-a1de-ef53cb9e5be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:06.763729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788a780-42af-4948-a1de-ef53cb9e5be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:06.764468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788a780-42af-4948-a1de-ef53cb9e5be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:06.766205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788a780-42af-4948-a1de-ef53cb9e5be0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:06.782383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615078ef-3883-45a7-b106-d610bb91ecfa admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:06.789680 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1448/2864] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:14:06.793783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615078ef-3883-45a7-b106-d610bb91ecfa admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:06.799536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37704454-ddfd-4e03-9b75-788f77cea5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:06.800300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37704454-ddfd-4e03-9b75-788f77cea5ad admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:06.800647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37704454-ddfd-4e03-9b75-788f77cea5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:06.801118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37704454-ddfd-4e03-9b75-788f77cea5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:06.801971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37704454-ddfd-4e03-9b75-788f77cea5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:06.803846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37704454-ddfd-4e03-9b75-788f77cea5ad admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:06.815077 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1417/2865] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:14:06.819678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788a780-42af-4948-a1de-ef53cb9e5be0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:06.845191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788a780-42af-4948-a1de-ef53cb9e5be0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:06.870651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c6c5f-52c8-44a3-b13e-4fddffc571ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:06.879333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c6c5f-52c8-44a3-b13e-4fddffc571ee admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:06.891500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c6c5f-52c8-44a3-b13e-4fddffc571ee admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:06.891794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c6c5f-52c8-44a3-b13e-4fddffc571ee admin admin] PATH_INFO: `/v3/projects/538d051aac0f4b66a7f4738f367a1ba8/users/348961e36710431387915e2220ee3431/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:06.917311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c6c5f-52c8-44a3-b13e-4fddffc571ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=538d051aac0f4b66a7f4738f367a1ba8, user_id=348961e36710431387915e2220ee3431, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:06.920073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c6c5f-52c8-44a3-b13e-4fddffc571ee admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:07.170617 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1449/2866] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:14:06 2022] PUT /identity/v3/projects/538d051aac0f4b66a7f4738f367a1ba8/users/348961e36710431387915e2220ee3431/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:14:07.175636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558a6da-92cc-4810-ad59-7ca6719424bd None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:07.175931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558a6da-92cc-4810-ad59-7ca6719424bd None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:07.176219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558a6da-92cc-4810-ad59-7ca6719424bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:07.203945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d558a6da-92cc-4810-ad59-7ca6719424bd None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:07.215240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d558a6da-92cc-4810-ad59-7ca6719424bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:07.346137 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1418/2867] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:07.359853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c6c5f-52c8-44a3-b13e-4fddffc571ee admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:07.362389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c31c6c5f-52c8-44a3-b13e-4fddffc571ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:07.458119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c6c5f-52c8-44a3-b13e-4fddffc571ee admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:07.463251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80046773-d50d-406b-a597-8e06dbaf5ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:07.464135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80046773-d50d-406b-a597-8e06dbaf5ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:07.464482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80046773-d50d-406b-a597-8e06dbaf5ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:07.465195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80046773-d50d-406b-a597-8e06dbaf5ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:07.486616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80046773-d50d-406b-a597-8e06dbaf5ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:07.488299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80046773-d50d-406b-a597-8e06dbaf5ee6 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:07.500721 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1450/2868] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:14:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:14:08.847777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:15.098244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d433c67-f388-44a1-8f71-e63a9d14e0a9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:15.098244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d433c67-f388-44a1-8f71-e63a9d14e0a9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:15.098244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d433c67-f388-44a1-8f71-e63a9d14e0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:15.128860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3d433c67-f388-44a1-8f71-e63a9d14e0a9 None None] MFA Rules not processed for user `348961e36710431387915e2220ee3431`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:15.130681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3d433c67-f388-44a1-8f71-e63a9d14e0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:15.239102 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1419/2869] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:16.870898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80046773-d50d-406b-a597-8e06dbaf5ee6 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:16.872426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-80046773-d50d-406b-a597-8e06dbaf5ee6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:16.971024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:16.994748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80046773-d50d-406b-a597-8e06dbaf5ee6 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:17.001356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec0108-658d-4d65-afac-cf02db15f704 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:17.002042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec0108-658d-4d65-afac-cf02db15f704 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:17.002328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec0108-658d-4d65-afac-cf02db15f704 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:17.002606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec0108-658d-4d65-afac-cf02db15f704 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:17.013689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec0108-658d-4d65-afac-cf02db15f704 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:17.015783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec0108-658d-4d65-afac-cf02db15f704 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:17.029952 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1451/2870] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:14:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:14:17.395860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d433c67-f388-44a1-8f71-e63a9d14e0a9 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:17.398121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3d433c67-f388-44a1-8f71-e63a9d14e0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:17.421016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d433c67-f388-44a1-8f71-e63a9d14e0a9 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:17.431373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bc99f-788c-4994-8baf-b34b712aa319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:17.432264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bc99f-788c-4994-8baf-b34b712aa319 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:17.432594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bc99f-788c-4994-8baf-b34b712aa319 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:17.432873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bc99f-788c-4994-8baf-b34b712aa319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:17.437116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-603bc99f-788c-4994-8baf-b34b712aa319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:17.452934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bc99f-788c-4994-8baf-b34b712aa319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:17.455223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bc99f-788c-4994-8baf-b34b712aa319 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:17.467273 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1420/2871] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:14:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:14:27.178745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec0108-658d-4d65-afac-cf02db15f704 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:27.180121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-faec0108-658d-4d65-afac-cf02db15f704 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:27.274278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec0108-658d-4d65-afac-cf02db15f704 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:27.288424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22456df5-4fa4-4856-8ba0-30f880d11ea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:27.288424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22456df5-4fa4-4856-8ba0-30f880d11ea2 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:27.288424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22456df5-4fa4-4856-8ba0-30f880d11ea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:27.288424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22456df5-4fa4-4856-8ba0-30f880d11ea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:27.289286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-22456df5-4fa4-4856-8ba0-30f880d11ea2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:27.363376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22456df5-4fa4-4856-8ba0-30f880d11ea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:27.364986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22456df5-4fa4-4856-8ba0-30f880d11ea2 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:27.376573 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1452/2872] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:14:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:14:27.462075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:INSERT=3,keystone:SELECT=72 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:34.388938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bc99f-788c-4994-8baf-b34b712aa319 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:34.430926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bc99f-788c-4994-8baf-b34b712aa319 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:34.436034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220fdd5-d4f1-484a-84c0-35cc8f26ba51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:34.437490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220fdd5-d4f1-484a-84c0-35cc8f26ba51 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:34.438228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220fdd5-d4f1-484a-84c0-35cc8f26ba51 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:34.438703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220fdd5-d4f1-484a-84c0-35cc8f26ba51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:34.440793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3220fdd5-d4f1-484a-84c0-35cc8f26ba51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:34.453729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220fdd5-d4f1-484a-84c0-35cc8f26ba51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:34.455809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220fdd5-d4f1-484a-84c0-35cc8f26ba51 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:34.468262 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1421/2873] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:14:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:14:35.742105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22456df5-4fa4-4856-8ba0-30f880d11ea2 service cinder] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:35.747662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-22456df5-4fa4-4856-8ba0-30f880d11ea2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:35.784115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22456df5-4fa4-4856-8ba0-30f880d11ea2 service cinder] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:35.789681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023a093-fa2d-4d1b-828c-5847194cd230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:35.790920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023a093-fa2d-4d1b-828c-5847194cd230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:35.791470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023a093-fa2d-4d1b-828c-5847194cd230 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:35.791960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023a093-fa2d-4d1b-828c-5847194cd230 admin admin] PATH_INFO: `/v3/users/a9b68dacc4b8463ba07fae6372131117` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:35.803986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023a093-fa2d-4d1b-828c-5847194cd230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9b68dacc4b8463ba07fae6372131117)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:35.808408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023a093-fa2d-4d1b-828c-5847194cd230 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:36.248576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5023a093-fa2d-4d1b-828c-5847194cd230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9b68dacc4b8463ba07fae6372131117'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:36.256322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5023a093-fa2d-4d1b-828c-5847194cd230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9b68dacc4b8463ba07fae6372131117'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:36.360299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5023a093-fa2d-4d1b-828c-5847194cd230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9b68dacc4b8463ba07fae6372131117'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:36.361195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5023a093-fa2d-4d1b-828c-5847194cd230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9b68dacc4b8463ba07fae6372131117'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:36.366902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:36.376096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5023a093-fa2d-4d1b-828c-5847194cd230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9b68dacc4b8463ba07fae6372131117'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:36.384869 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1453/2874] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:14:35 2022] DELETE /identity/v3/users/a9b68dacc4b8463ba07fae6372131117 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:36.389792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a5be-2855-4700-ab88-6378cb481f09 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:36.392029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a5be-2855-4700-ab88-6378cb481f09 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:36.392680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a5be-2855-4700-ab88-6378cb481f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:36.415989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8f67a5be-2855-4700-ab88-6378cb481f09 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:36.417321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8f67a5be-2855-4700-ab88-6378cb481f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:36.483589 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1422/2875] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:36.494296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023a093-fa2d-4d1b-828c-5847194cd230 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:36.495746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5023a093-fa2d-4d1b-828c-5847194cd230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:36.594937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023a093-fa2d-4d1b-828c-5847194cd230 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:36.598910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4152519-c723-4b36-a86a-5d6ece52320b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:36.600209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4152519-c723-4b36-a86a-5d6ece52320b service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:36.600490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4152519-c723-4b36-a86a-5d6ece52320b service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:36.600917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4152519-c723-4b36-a86a-5d6ece52320b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:36.611450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4152519-c723-4b36-a86a-5d6ece52320b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:36.612974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4152519-c723-4b36-a86a-5d6ece52320b service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:36.624332 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1454/2876] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:14:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:14:37.038055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67a5be-2855-4700-ab88-6378cb481f09 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:37.040094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8f67a5be-2855-4700-ab88-6378cb481f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:37.053570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67a5be-2855-4700-ab88-6378cb481f09 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:37.059649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00145c7-6ab5-4bc1-b610-f0eafaf53a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:37.061578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00145c7-6ab5-4bc1-b610-f0eafaf53a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:37.062182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00145c7-6ab5-4bc1-b610-f0eafaf53a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:37.062621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00145c7-6ab5-4bc1-b610-f0eafaf53a8c admin admin] PATH_INFO: `/v3/projects/55a19b7a4682457a9132f5fc80110712` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:37.065433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00145c7-6ab5-4bc1-b610-f0eafaf53a8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a19b7a4682457a9132f5fc80110712)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:37.070024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00145c7-6ab5-4bc1-b610-f0eafaf53a8c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:37.294717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e00145c7-6ab5-4bc1-b610-f0eafaf53a8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a19b7a4682457a9132f5fc80110712', 'request_id': 'req-e00145c7-6ab5-4bc1-b610-f0eafaf53a8c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:37.294717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e00145c7-6ab5-4bc1-b610-f0eafaf53a8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a19b7a4682457a9132f5fc80110712', 'request_id': 'req-e00145c7-6ab5-4bc1-b610-f0eafaf53a8c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:37.294717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e00145c7-6ab5-4bc1-b610-f0eafaf53a8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a19b7a4682457a9132f5fc80110712', 'request_id': 'req-e00145c7-6ab5-4bc1-b610-f0eafaf53a8c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:37.440891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e00145c7-6ab5-4bc1-b610-f0eafaf53a8c admin admin] The token cache is being invalidate because project 55a19b7a4682457a9132f5fc80110712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:14:37.441707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e00145c7-6ab5-4bc1-b610-f0eafaf53a8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:37.442302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e00145c7-6ab5-4bc1-b610-f0eafaf53a8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:37.445058 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1423/2877] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:14:37 2022] DELETE /identity/v3/projects/55a19b7a4682457a9132f5fc80110712 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:37.448719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4152519-c723-4b36-a86a-5d6ece52320b service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:37.460212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4152519-c723-4b36-a86a-5d6ece52320b service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:37.541639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9ebde-4498-40cc-80c2-61bf5e3a9ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:37.543870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9ebde-4498-40cc-80c2-61bf5e3a9ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:37.546732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9ebde-4498-40cc-80c2-61bf5e3a9ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:37.546732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9ebde-4498-40cc-80c2-61bf5e3a9ad6 admin admin] PATH_INFO: `/v3/users/1ead1619fabc4552b11f712b28cc6187` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:37.546732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9ebde-4498-40cc-80c2-61bf5e3a9ad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ead1619fabc4552b11f712b28cc6187)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:37.549407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9ebde-4498-40cc-80c2-61bf5e3a9ad6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:37.781368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-05f9ebde-4498-40cc-80c2-61bf5e3a9ad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ead1619fabc4552b11f712b28cc6187'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:37.790581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-05f9ebde-4498-40cc-80c2-61bf5e3a9ad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ead1619fabc4552b11f712b28cc6187'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:37.885493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-05f9ebde-4498-40cc-80c2-61bf5e3a9ad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ead1619fabc4552b11f712b28cc6187'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:37.885493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-05f9ebde-4498-40cc-80c2-61bf5e3a9ad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ead1619fabc4552b11f712b28cc6187'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:37.907557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-05f9ebde-4498-40cc-80c2-61bf5e3a9ad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ead1619fabc4552b11f712b28cc6187'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:37.919503 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1455/2878] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:14:37 2022] DELETE /identity/v3/users/1ead1619fabc4552b11f712b28cc6187 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:14:38.447549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb18032-e9c9-4f9e-818d-7554df9768fb None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:38.448052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb18032-e9c9-4f9e-818d-7554df9768fb None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:38.448336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb18032-e9c9-4f9e-818d-7554df9768fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:38.459963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9ebde-4498-40cc-80c2-61bf5e3a9ad6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:38.461386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-05f9ebde-4498-40cc-80c2-61bf5e3a9ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:38.475731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-fcb18032-e9c9-4f9e-818d-7554df9768fb None None] MFA Rules not processed for user `578b87f863b34f57a571f7e56d44f118`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:38.477209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fcb18032-e9c9-4f9e-818d-7554df9768fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:38.486506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:38.599267 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1424/2879] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:38.625779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9ebde-4498-40cc-80c2-61bf5e3a9ad6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:38.633737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb396eb1-667c-4b06-a6c8-bb6f2b302bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:38.634683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb396eb1-667c-4b06-a6c8-bb6f2b302bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:38.635067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb396eb1-667c-4b06-a6c8-bb6f2b302bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:38.635354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb396eb1-667c-4b06-a6c8-bb6f2b302bdd admin admin] PATH_INFO: `/v3/projects/cbbed051cbaf450f92a79d71d58ba7a2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:38.637617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb396eb1-667c-4b06-a6c8-bb6f2b302bdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbbed051cbaf450f92a79d71d58ba7a2)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:38.640953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb396eb1-667c-4b06-a6c8-bb6f2b302bdd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:38.893776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cb396eb1-667c-4b06-a6c8-bb6f2b302bdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbbed051cbaf450f92a79d71d58ba7a2', 'request_id': 'req-cb396eb1-667c-4b06-a6c8-bb6f2b302bdd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:38.903666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cb396eb1-667c-4b06-a6c8-bb6f2b302bdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbbed051cbaf450f92a79d71d58ba7a2', 'request_id': 'req-cb396eb1-667c-4b06-a6c8-bb6f2b302bdd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:38.919381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cb396eb1-667c-4b06-a6c8-bb6f2b302bdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbbed051cbaf450f92a79d71d58ba7a2', 'request_id': 'req-cb396eb1-667c-4b06-a6c8-bb6f2b302bdd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:39.184346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cb396eb1-667c-4b06-a6c8-bb6f2b302bdd admin admin] The token cache is being invalidate because project cbbed051cbaf450f92a79d71d58ba7a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:14:39.185017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cb396eb1-667c-4b06-a6c8-bb6f2b302bdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:39.186289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cb396eb1-667c-4b06-a6c8-bb6f2b302bdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:39.188923 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1456/2880] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:14:38 2022] DELETE /identity/v3/projects/cbbed051cbaf450f92a79d71d58ba7a2 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:39.194148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033324e-fa7a-43bf-81fd-93020580a911 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:39.194712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033324e-fa7a-43bf-81fd-93020580a911 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:39.194996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033324e-fa7a-43bf-81fd-93020580a911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:39.216197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d033324e-fa7a-43bf-81fd-93020580a911 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:39.218739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d033324e-fa7a-43bf-81fd-93020580a911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:39.256659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:39.334129 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1425/2881] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:39.335788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b685bc-ef30-4cab-85f2-97d4b30b878f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:39.336078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b685bc-ef30-4cab-85f2-97d4b30b878f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:39.336361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b685bc-ef30-4cab-85f2-97d4b30b878f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:39.362554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-85b685bc-ef30-4cab-85f2-97d4b30b878f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:39.363838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-85b685bc-ef30-4cab-85f2-97d4b30b878f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:39.373362 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1457/2882] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:14:39.378174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033324e-fa7a-43bf-81fd-93020580a911 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:39.391589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033324e-fa7a-43bf-81fd-93020580a911 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:39.399384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9d333-135a-4cf7-94e4-67e28a41774d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:39.400441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d333-135a-4cf7-94e4-67e28a41774d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:39.402572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d333-135a-4cf7-94e4-67e28a41774d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:39.402572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d333-135a-4cf7-94e4-67e28a41774d admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:39.410910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9d333-135a-4cf7-94e4-67e28a41774d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:14:39.410910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9d333-135a-4cf7-94e4-67e28a41774d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:39.410910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9d333-135a-4cf7-94e4-67e28a41774d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:39.446910 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1426/2883] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:14:39.447628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b685bc-ef30-4cab-85f2-97d4b30b878f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:39.472447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b685bc-ef30-4cab-85f2-97d4b30b878f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:39.480062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d2cec-50d1-4dba-9d6e-955f3e3a034f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:39.481095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d2cec-50d1-4dba-9d6e-955f3e3a034f admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:39.481600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d2cec-50d1-4dba-9d6e-955f3e3a034f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:39.483967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d2cec-50d1-4dba-9d6e-955f3e3a034f admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:39.484688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d2cec-50d1-4dba-9d6e-955f3e3a034f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:39.487210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d2cec-50d1-4dba-9d6e-955f3e3a034f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:39.598456 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1458/2884] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:14:39 2022] POST /identity/v3/projects => generated 357 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:14:39.604182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9d333-135a-4cf7-94e4-67e28a41774d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:39.618207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9d333-135a-4cf7-94e4-67e28a41774d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:39.707326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bece00-3a43-4cd5-ac14-76a9677f70c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:39.708450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bece00-3a43-4cd5-ac14-76a9677f70c4 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:39.709070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bece00-3a43-4cd5-ac14-76a9677f70c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:39.709517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bece00-3a43-4cd5-ac14-76a9677f70c4 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:39.710401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bece00-3a43-4cd5-ac14-76a9677f70c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:39.712681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bece00-3a43-4cd5-ac14-76a9677f70c4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:39.873683 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1427/2885] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:14:39 2022] POST /identity/v3/users => generated 279 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:14:39.880927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d2cec-50d1-4dba-9d6e-955f3e3a034f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:39.914164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d2cec-50d1-4dba-9d6e-955f3e3a034f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:39.931695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd78c2-9e34-4c1e-b334-3f26f0e7dffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:39.932489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd78c2-9e34-4c1e-b334-3f26f0e7dffe admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:39.933090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd78c2-9e34-4c1e-b334-3f26f0e7dffe admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:39.933654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd78c2-9e34-4c1e-b334-3f26f0e7dffe admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:39.935848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd78c2-9e34-4c1e-b334-3f26f0e7dffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:39.938526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd78c2-9e34-4c1e-b334-3f26f0e7dffe admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:39.954473 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1459/2886] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:14:39.959413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bece00-3a43-4cd5-ac14-76a9677f70c4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:39.972636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bece00-3a43-4cd5-ac14-76a9677f70c4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:39.979544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab810f9-324f-4c3d-8267-d1578a0e6870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:39.982797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab810f9-324f-4c3d-8267-d1578a0e6870 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:39.982797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab810f9-324f-4c3d-8267-d1578a0e6870 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:39.982797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab810f9-324f-4c3d-8267-d1578a0e6870 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:39.982797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab810f9-324f-4c3d-8267-d1578a0e6870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:39.986391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab810f9-324f-4c3d-8267-d1578a0e6870 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:40.015513 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1428/2887] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:14:40.019555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd78c2-9e34-4c1e-b334-3f26f0e7dffe admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:40.033446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd78c2-9e34-4c1e-b334-3f26f0e7dffe admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:40.041230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84771a85-4d93-409a-a5de-fdd9c34bdb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:40.042798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84771a85-4d93-409a-a5de-fdd9c34bdb2e admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:40.043135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84771a85-4d93-409a-a5de-fdd9c34bdb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:40.043473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84771a85-4d93-409a-a5de-fdd9c34bdb2e admin admin] PATH_INFO: `/v3/projects/1ec25d2b786949b3bb128241b6d01463/users/feac98c083944ca1926e8b4e2ddc1fef/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:40.088177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84771a85-4d93-409a-a5de-fdd9c34bdb2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec25d2b786949b3bb128241b6d01463, user_id=feac98c083944ca1926e8b4e2ddc1fef, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:40.090775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84771a85-4d93-409a-a5de-fdd9c34bdb2e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:40.205467 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1460/2888] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:14:40 2022] PUT /identity/v3/projects/1ec25d2b786949b3bb128241b6d01463/users/feac98c083944ca1926e8b4e2ddc1fef/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:40.221911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963da837-2de8-489c-b1f3-b812538e10e2 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:40.221911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963da837-2de8-489c-b1f3-b812538e10e2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:40.221911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963da837-2de8-489c-b1f3-b812538e10e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:40.284353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-963da837-2de8-489c-b1f3-b812538e10e2 None None] MFA Rules not processed for user `feac98c083944ca1926e8b4e2ddc1fef`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:40.285721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-963da837-2de8-489c-b1f3-b812538e10e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:40.425698 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1429/2889] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:40 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:40.427976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84771a85-4d93-409a-a5de-fdd9c34bdb2e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:40.478732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:40.535037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84771a85-4d93-409a-a5de-fdd9c34bdb2e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:40.541428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc216ec4-d779-460e-b740-3575933edfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:40.542282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc216ec4-d779-460e-b740-3575933edfb4 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:40.542562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc216ec4-d779-460e-b740-3575933edfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:40.542901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc216ec4-d779-460e-b740-3575933edfb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:40.543665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc216ec4-d779-460e-b740-3575933edfb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:40.545893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc216ec4-d779-460e-b740-3575933edfb4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:40.639649 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1461/2890] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:14:40 2022] POST /identity/v3/projects => generated 359 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:14:40.643707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963da837-2de8-489c-b1f3-b812538e10e2 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:40.656016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963da837-2de8-489c-b1f3-b812538e10e2 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:40.666206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:40.716298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b801aa2-a401-4a9e-ba21-75a273f58bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:40.717074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b801aa2-a401-4a9e-ba21-75a273f58bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:40.717431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b801aa2-a401-4a9e-ba21-75a273f58bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:40.717786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b801aa2-a401-4a9e-ba21-75a273f58bb1 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:40.718613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b801aa2-a401-4a9e-ba21-75a273f58bb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:40.720618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b801aa2-a401-4a9e-ba21-75a273f58bb1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:40.796600 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1430/2891] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:14:40 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:14:40.801012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc216ec4-d779-460e-b740-3575933edfb4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:40.813698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc216ec4-d779-460e-b740-3575933edfb4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:40.822300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba43da5-a8c1-460f-ba69-4226608a20ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:40.823190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba43da5-a8c1-460f-ba69-4226608a20ec admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:40.823752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba43da5-a8c1-460f-ba69-4226608a20ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:40.824413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba43da5-a8c1-460f-ba69-4226608a20ec admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:40.825367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba43da5-a8c1-460f-ba69-4226608a20ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:40.827269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba43da5-a8c1-460f-ba69-4226608a20ec admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:40.840609 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1462/2892] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:14:40.845200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b801aa2-a401-4a9e-ba21-75a273f58bb1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:40.888304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b801aa2-a401-4a9e-ba21-75a273f58bb1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:40.904225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4ba1f-739d-43d8-940b-1799594eb1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:40.905246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4ba1f-739d-43d8-940b-1799594eb1e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:40.905534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4ba1f-739d-43d8-940b-1799594eb1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:40.905811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4ba1f-739d-43d8-940b-1799594eb1e7 admin admin] PATH_INFO: `/v3/projects/71134bee5dd04e37a9384ec6df049c5b/users/2aad83649da74506ba10452eb99eedd8/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:40.930072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4ba1f-739d-43d8-940b-1799594eb1e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71134bee5dd04e37a9384ec6df049c5b, user_id=2aad83649da74506ba10452eb99eedd8, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:40.933315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4ba1f-739d-43d8-940b-1799594eb1e7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:41.010659 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1431/2893] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:14:40 2022] PUT /identity/v3/projects/71134bee5dd04e37a9384ec6df049c5b/users/2aad83649da74506ba10452eb99eedd8/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:41.014938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba43da5-a8c1-460f-ba69-4226608a20ec admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:41.025991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba43da5-a8c1-460f-ba69-4226608a20ec admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:41.120663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1f77a-82e5-4883-8c8e-ea39b91a05b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:41.121623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1f77a-82e5-4883-8c8e-ea39b91a05b7 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:41.122263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1f77a-82e5-4883-8c8e-ea39b91a05b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:41.122759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1f77a-82e5-4883-8c8e-ea39b91a05b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:41.123946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1f77a-82e5-4883-8c8e-ea39b91a05b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:41.126126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1f77a-82e5-4883-8c8e-ea39b91a05b7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:41.140027 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1463/2894] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:14:41.144326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4ba1f-739d-43d8-940b-1799594eb1e7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:41.156081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4ba1f-739d-43d8-940b-1799594eb1e7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:41.161356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f66e90-8589-4ac1-a10c-dedf97680b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:41.162285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f66e90-8589-4ac1-a10c-dedf97680b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:41.162625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f66e90-8589-4ac1-a10c-dedf97680b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:41.162997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f66e90-8589-4ac1-a10c-dedf97680b71 admin admin] PATH_INFO: `/v3/projects/71134bee5dd04e37a9384ec6df049c5b/users/2aad83649da74506ba10452eb99eedd8/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:41.165394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f66e90-8589-4ac1-a10c-dedf97680b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71134bee5dd04e37a9384ec6df049c5b, user_id=2aad83649da74506ba10452eb99eedd8, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:41.168676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f66e90-8589-4ac1-a10c-dedf97680b71 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:41.193327 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1432/2895] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:14:41 2022] PUT /identity/v3/projects/71134bee5dd04e37a9384ec6df049c5b/users/2aad83649da74506ba10452eb99eedd8/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:41.209192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364a74c-8a14-465c-b660-f082d38e3e5e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:41.209962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364a74c-8a14-465c-b660-f082d38e3e5e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:41.210566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364a74c-8a14-465c-b660-f082d38e3e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:41.259642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b364a74c-8a14-465c-b660-f082d38e3e5e None None] MFA Rules not processed for user `2aad83649da74506ba10452eb99eedd8`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:41.261171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b364a74c-8a14-465c-b660-f082d38e3e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:41.408490 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1464/2896] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:41 2022] POST /identity/v3/auth/tokens => generated 3293 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:41.492969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f66e90-8589-4ac1-a10c-dedf97680b71 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:41.495130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f8f66e90-8589-4ac1-a10c-dedf97680b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:41.603311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f66e90-8589-4ac1-a10c-dedf97680b71 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:41.612111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f21411-72bd-455d-a487-c76f971719c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:41.613009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f21411-72bd-455d-a487-c76f971719c8 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:41.613300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f21411-72bd-455d-a487-c76f971719c8 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:41.613580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f21411-72bd-455d-a487-c76f971719c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:41.637773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f21411-72bd-455d-a487-c76f971719c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:41.639155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f21411-72bd-455d-a487-c76f971719c8 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:41.654838 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1433/2897] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:14:41 2022] GET /identity/v3/auth/tokens => generated 3293 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:14:42.324499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364a74c-8a14-465c-b660-f082d38e3e5e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:42.376896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:42.436253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364a74c-8a14-465c-b660-f082d38e3e5e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:42.453910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eb061-15ff-4a5f-898e-e660f775fba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:42.462939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eb061-15ff-4a5f-898e-e660f775fba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:42.462939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eb061-15ff-4a5f-898e-e660f775fba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:42.462939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eb061-15ff-4a5f-898e-e660f775fba7 admin admin] PATH_INFO: `/v3/users/feac98c083944ca1926e8b4e2ddc1fef` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:42.462939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eb061-15ff-4a5f-898e-e660f775fba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feac98c083944ca1926e8b4e2ddc1fef)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:42.462939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eb061-15ff-4a5f-898e-e660f775fba7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:42.662562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f21411-72bd-455d-a487-c76f971719c8 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:42.664872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-50f21411-72bd-455d-a487-c76f971719c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:42.716668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-325eb061-15ff-4a5f-898e-e660f775fba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feac98c083944ca1926e8b4e2ddc1fef'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:42.726531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-325eb061-15ff-4a5f-898e-e660f775fba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feac98c083944ca1926e8b4e2ddc1fef'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:42.784703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:42.806403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f21411-72bd-455d-a487-c76f971719c8 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:42.811416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e5181-9056-4c51-9701-449f6bd1aec5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:42.812103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e5181-9056-4c51-9701-449f6bd1aec5 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:42.812381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e5181-9056-4c51-9701-449f6bd1aec5 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:42.812662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e5181-9056-4c51-9701-449f6bd1aec5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:42.814492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-435e5181-9056-4c51-9701-449f6bd1aec5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:42.837269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-325eb061-15ff-4a5f-898e-e660f775fba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feac98c083944ca1926e8b4e2ddc1fef'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:42.838548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-325eb061-15ff-4a5f-898e-e660f775fba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feac98c083944ca1926e8b4e2ddc1fef'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:42.873228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e5181-9056-4c51-9701-449f6bd1aec5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:42.875646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e5181-9056-4c51-9701-449f6bd1aec5 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:42.885140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-325eb061-15ff-4a5f-898e-e660f775fba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feac98c083944ca1926e8b4e2ddc1fef'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:42.893929 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1434/2898] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:14:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:14:42.895475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e5181-9056-4c51-9701-449f6bd1aec5 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:42.898606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-435e5181-9056-4c51-9701-449f6bd1aec5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:42.910648 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1465/2899] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:14:42 2022] DELETE /identity/v3/users/feac98c083944ca1926e8b4e2ddc1fef => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:42.920141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e5181-9056-4c51-9701-449f6bd1aec5 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:42.927878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa9c89-dc28-4e88-8011-0176774956fe None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:42.928448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa9c89-dc28-4e88-8011-0176774956fe None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:42.929124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa9c89-dc28-4e88-8011-0176774956fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:42.952653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f2aa9c89-dc28-4e88-8011-0176774956fe None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:42.954302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f2aa9c89-dc28-4e88-8011-0176774956fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:43.075808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197f435-a36c-4b49-9d3c-cde7f7ea975b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:43.077164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197f435-a36c-4b49-9d3c-cde7f7ea975b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:43.077933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197f435-a36c-4b49-9d3c-cde7f7ea975b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:43.078336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197f435-a36c-4b49-9d3c-cde7f7ea975b admin admin] PATH_INFO: `/v3/users/348961e36710431387915e2220ee3431` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:43.081245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197f435-a36c-4b49-9d3c-cde7f7ea975b admin admin] RBAC: Authorizing `identity:delete_user(user_id=348961e36710431387915e2220ee3431)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:43.083983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197f435-a36c-4b49-9d3c-cde7f7ea975b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:43.088714 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1466/2900] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:43.098595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa9c89-dc28-4e88-8011-0176774956fe None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:43.101093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f2aa9c89-dc28-4e88-8011-0176774956fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:43.162569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:43.166776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa9c89-dc28-4e88-8011-0176774956fe None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:43.170610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd292fbf-5972-4ae8-8ca6-0565b73e929b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:43.171298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd292fbf-5972-4ae8-8ca6-0565b73e929b service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:43.171634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd292fbf-5972-4ae8-8ca6-0565b73e929b service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:43.171968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd292fbf-5972-4ae8-8ca6-0565b73e929b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:43.182056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd292fbf-5972-4ae8-8ca6-0565b73e929b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:43.183882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd292fbf-5972-4ae8-8ca6-0565b73e929b service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:43.195108 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1467/2901] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:14:43.345837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d197f435-a36c-4b49-9d3c-cde7f7ea975b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '348961e36710431387915e2220ee3431'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:43.363802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d197f435-a36c-4b49-9d3c-cde7f7ea975b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '348961e36710431387915e2220ee3431'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:43.489901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d197f435-a36c-4b49-9d3c-cde7f7ea975b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '348961e36710431387915e2220ee3431'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:43.498760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d197f435-a36c-4b49-9d3c-cde7f7ea975b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '348961e36710431387915e2220ee3431'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:43.501114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d197f435-a36c-4b49-9d3c-cde7f7ea975b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '348961e36710431387915e2220ee3431'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:43.513332 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1435/2902] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:14:42 2022] DELETE /identity/v3/users/348961e36710431387915e2220ee3431 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:43.940864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd292fbf-5972-4ae8-8ca6-0565b73e929b service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:43.947777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dd292fbf-5972-4ae8-8ca6-0565b73e929b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:43.990639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197f435-a36c-4b49-9d3c-cde7f7ea975b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:43.992498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d197f435-a36c-4b49-9d3c-cde7f7ea975b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:43.993209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd292fbf-5972-4ae8-8ca6-0565b73e929b service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:44.081426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23185d-ab01-40ee-8b03-fc9b2fdf00f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:44.082694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23185d-ab01-40ee-8b03-fc9b2fdf00f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:44.088506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23185d-ab01-40ee-8b03-fc9b2fdf00f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:44.089074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23185d-ab01-40ee-8b03-fc9b2fdf00f8 admin admin] PATH_INFO: `/v3/projects/1ec25d2b786949b3bb128241b6d01463` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:44.090762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23185d-ab01-40ee-8b03-fc9b2fdf00f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ec25d2b786949b3bb128241b6d01463)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:44.093356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23185d-ab01-40ee-8b03-fc9b2fdf00f8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:44.174586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:44.179738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197f435-a36c-4b49-9d3c-cde7f7ea975b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:44.184837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1c945-e920-4c07-ae4d-66933400673f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:44.185793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1c945-e920-4c07-ae4d-66933400673f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:44.186078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1c945-e920-4c07-ae4d-66933400673f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:44.186354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1c945-e920-4c07-ae4d-66933400673f admin admin] PATH_INFO: `/v3/projects/538d051aac0f4b66a7f4738f367a1ba8` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:44.187651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1c945-e920-4c07-ae4d-66933400673f admin admin] RBAC: Authorizing `identity:delete_project(project_id=538d051aac0f4b66a7f4738f367a1ba8)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:44.189678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1c945-e920-4c07-ae4d-66933400673f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:44.348860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3f23185d-ab01-40ee-8b03-fc9b2fdf00f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ec25d2b786949b3bb128241b6d01463', 'request_id': 'req-3f23185d-ab01-40ee-8b03-fc9b2fdf00f8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:44.356471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3f23185d-ab01-40ee-8b03-fc9b2fdf00f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ec25d2b786949b3bb128241b6d01463', 'request_id': 'req-3f23185d-ab01-40ee-8b03-fc9b2fdf00f8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:44.368241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-82e1c945-e920-4c07-ae4d-66933400673f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538d051aac0f4b66a7f4738f367a1ba8', 'request_id': 'req-82e1c945-e920-4c07-ae4d-66933400673f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:44.368586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3f23185d-ab01-40ee-8b03-fc9b2fdf00f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ec25d2b786949b3bb128241b6d01463', 'request_id': 'req-3f23185d-ab01-40ee-8b03-fc9b2fdf00f8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:44.377248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-82e1c945-e920-4c07-ae4d-66933400673f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538d051aac0f4b66a7f4738f367a1ba8', 'request_id': 'req-82e1c945-e920-4c07-ae4d-66933400673f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:44.386061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-82e1c945-e920-4c07-ae4d-66933400673f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538d051aac0f4b66a7f4738f367a1ba8', 'request_id': 'req-82e1c945-e920-4c07-ae4d-66933400673f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:44.475181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3f23185d-ab01-40ee-8b03-fc9b2fdf00f8 admin admin] The token cache is being invalidate because project 1ec25d2b786949b3bb128241b6d01463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:14:44.475757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3f23185d-ab01-40ee-8b03-fc9b2fdf00f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:44.476634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3f23185d-ab01-40ee-8b03-fc9b2fdf00f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:44.478975 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1468/2903] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:14:43 2022] DELETE /identity/v3/projects/1ec25d2b786949b3bb128241b6d01463 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:44.482584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23185d-ab01-40ee-8b03-fc9b2fdf00f8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:44.485905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3f23185d-ab01-40ee-8b03-fc9b2fdf00f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:44.595962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23185d-ab01-40ee-8b03-fc9b2fdf00f8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:44.625861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-82e1c945-e920-4c07-ae4d-66933400673f admin admin] The token cache is being invalidate because project 538d051aac0f4b66a7f4738f367a1ba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:14:44.626321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-82e1c945-e920-4c07-ae4d-66933400673f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:44.627502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-82e1c945-e920-4c07-ae4d-66933400673f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:44.632732 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1436/2904] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:14:43 2022] DELETE /identity/v3/projects/538d051aac0f4b66a7f4738f367a1ba8 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:44.637039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70a05a-ebc3-4476-bf51-7397e952ceb0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:44.637346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70a05a-ebc3-4476-bf51-7397e952ceb0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:44.637621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70a05a-ebc3-4476-bf51-7397e952ceb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:44.661725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8d70a05a-ebc3-4476-bf51-7397e952ceb0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:44.663191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8d70a05a-ebc3-4476-bf51-7397e952ceb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:44.690576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af662645-e6c3-4378-bdee-25d168b377c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:44.691545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af662645-e6c3-4378-bdee-25d168b377c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:44.693934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af662645-e6c3-4378-bdee-25d168b377c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:44.693934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af662645-e6c3-4378-bdee-25d168b377c2 admin admin] PATH_INFO: `/v3/users/2aad83649da74506ba10452eb99eedd8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:44.700493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af662645-e6c3-4378-bdee-25d168b377c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aad83649da74506ba10452eb99eedd8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:44.703807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af662645-e6c3-4378-bdee-25d168b377c2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:44.751620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:44.788121 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1437/2905] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:44.806215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe47bf3-2d7e-470c-91f5-b2a1a8eb4b6b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:44.806613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe47bf3-2d7e-470c-91f5-b2a1a8eb4b6b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:44.809326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe47bf3-2d7e-470c-91f5-b2a1a8eb4b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:44.851307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-abe47bf3-2d7e-470c-91f5-b2a1a8eb4b6b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:44.852547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-abe47bf3-2d7e-470c-91f5-b2a1a8eb4b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:44.861718 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1438/2906] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:14:44.866292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe47bf3-2d7e-470c-91f5-b2a1a8eb4b6b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:44.885004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe47bf3-2d7e-470c-91f5-b2a1a8eb4b6b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:44.891468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43135d33-d0d0-4113-a47f-f7fc3bcab597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:44.898172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43135d33-d0d0-4113-a47f-f7fc3bcab597 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:44.898172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43135d33-d0d0-4113-a47f-f7fc3bcab597 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:44.898172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43135d33-d0d0-4113-a47f-f7fc3bcab597 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:44.898172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43135d33-d0d0-4113-a47f-f7fc3bcab597 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:14:44.898172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43135d33-d0d0-4113-a47f-f7fc3bcab597 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:44.898172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43135d33-d0d0-4113-a47f-f7fc3bcab597 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:44.918098 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1439/2907] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:14:44.919911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43135d33-d0d0-4113-a47f-f7fc3bcab597 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:44.933500 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43135d33-d0d0-4113-a47f-f7fc3bcab597 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:44.939469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900790b-efd6-4de5-b4c4-b751460db7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:44.940336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900790b-efd6-4de5-b4c4-b751460db7bd admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:44.940652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900790b-efd6-4de5-b4c4-b751460db7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:44.941070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900790b-efd6-4de5-b4c4-b751460db7bd admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:44.941952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900790b-efd6-4de5-b4c4-b751460db7bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:44.945342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900790b-efd6-4de5-b4c4-b751460db7bd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:45.069076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-af662645-e6c3-4378-bdee-25d168b377c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aad83649da74506ba10452eb99eedd8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:45.085682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-af662645-e6c3-4378-bdee-25d168b377c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aad83649da74506ba10452eb99eedd8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:45.097282 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1440/2908] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:14:44 2022] POST /identity/v3/projects => generated 401 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:14:45.101733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900790b-efd6-4de5-b4c4-b751460db7bd admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:45.207073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900790b-efd6-4de5-b4c4-b751460db7bd admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:45.215059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-af662645-e6c3-4378-bdee-25d168b377c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aad83649da74506ba10452eb99eedd8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:45.216165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-af662645-e6c3-4378-bdee-25d168b377c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aad83649da74506ba10452eb99eedd8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:45.225539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc4088-db3c-4f6a-82f7-bf2414b6e57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:45.226826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc4088-db3c-4f6a-82f7-bf2414b6e57a admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:45.227161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc4088-db3c-4f6a-82f7-bf2414b6e57a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:45.227445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc4088-db3c-4f6a-82f7-bf2414b6e57a admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:45.228582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc4088-db3c-4f6a-82f7-bf2414b6e57a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:45.231345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc4088-db3c-4f6a-82f7-bf2414b6e57a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:45.236460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-af662645-e6c3-4378-bdee-25d168b377c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aad83649da74506ba10452eb99eedd8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:45.248426 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1469/2909] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:14:44 2022] DELETE /identity/v3/users/2aad83649da74506ba10452eb99eedd8 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:14:45.396173 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1441/2910] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:14:45 2022] POST /identity/v3/users => generated 301 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:14:45.400687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af662645-e6c3-4378-bdee-25d168b377c2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:45.402244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-af662645-e6c3-4378-bdee-25d168b377c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:45.470933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af662645-e6c3-4378-bdee-25d168b377c2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:45.477851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abdc28-246e-42c5-9880-0c5bcbe0a1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:45.478523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abdc28-246e-42c5-9880-0c5bcbe0a1dc admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:45.478807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abdc28-246e-42c5-9880-0c5bcbe0a1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:45.479151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abdc28-246e-42c5-9880-0c5bcbe0a1dc admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:45.479960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abdc28-246e-42c5-9880-0c5bcbe0a1dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:45.481564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abdc28-246e-42c5-9880-0c5bcbe0a1dc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:45.498247 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1470/2911] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:14:45.499498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc4088-db3c-4f6a-82f7-bf2414b6e57a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:45.512110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc4088-db3c-4f6a-82f7-bf2414b6e57a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:45.528344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0af5f-5403-4b6f-8013-724553bfaaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:45.528344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0af5f-5403-4b6f-8013-724553bfaaff admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:45.528344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0af5f-5403-4b6f-8013-724553bfaaff admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:45.528344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0af5f-5403-4b6f-8013-724553bfaaff admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:45.528735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0af5f-5403-4b6f-8013-724553bfaaff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:45.528735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0af5f-5403-4b6f-8013-724553bfaaff admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:45.532408 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1442/2912] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:14:45.537956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abdc28-246e-42c5-9880-0c5bcbe0a1dc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:45.552687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abdc28-246e-42c5-9880-0c5bcbe0a1dc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:45.557625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31850b94-b77d-41de-a42f-4ecd28d084b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:45.559068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31850b94-b77d-41de-a42f-4ecd28d084b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:45.559492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31850b94-b77d-41de-a42f-4ecd28d084b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:45.560088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31850b94-b77d-41de-a42f-4ecd28d084b1 admin admin] PATH_INFO: `/v3/projects/31216bba3e1148f2b00f59a6913ce35b/users/94649762be79464785b4412c9b9a61fa/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:45.579930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31850b94-b77d-41de-a42f-4ecd28d084b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31216bba3e1148f2b00f59a6913ce35b, user_id=94649762be79464785b4412c9b9a61fa, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:45.583529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31850b94-b77d-41de-a42f-4ecd28d084b1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:45.706667 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1471/2913] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:14:45 2022] PUT /identity/v3/projects/31216bba3e1148f2b00f59a6913ce35b/users/94649762be79464785b4412c9b9a61fa/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:45.712223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda0445-5fdb-4acf-958c-a3a146a2eb0e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:45.716510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda0445-5fdb-4acf-958c-a3a146a2eb0e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:45.716510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda0445-5fdb-4acf-958c-a3a146a2eb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:45.744822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4bda0445-5fdb-4acf-958c-a3a146a2eb0e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:45.746072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4bda0445-5fdb-4acf-958c-a3a146a2eb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:45.846798 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1443/2914] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:45.858737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31850b94-b77d-41de-a42f-4ecd28d084b1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:45.866047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-31850b94-b77d-41de-a42f-4ecd28d084b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:45.941414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda0445-5fdb-4acf-958c-a3a146a2eb0e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:45.943051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4bda0445-5fdb-4acf-958c-a3a146a2eb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:45.967486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda0445-5fdb-4acf-958c-a3a146a2eb0e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:45.972876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31850b94-b77d-41de-a42f-4ecd28d084b1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:45.973608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cc464-d558-4bb4-80ad-6a8dd98895af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:45.975727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cc464-d558-4bb4-80ad-6a8dd98895af admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:45.976172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cc464-d558-4bb4-80ad-6a8dd98895af admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:45.976610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cc464-d558-4bb4-80ad-6a8dd98895af admin admin] PATH_INFO: `/v3/projects/71134bee5dd04e37a9384ec6df049c5b` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:45.978497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6280ab1-3466-4693-87a4-48e1187c68db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:45.978690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cc464-d558-4bb4-80ad-6a8dd98895af admin admin] RBAC: Authorizing `identity:delete_project(project_id=71134bee5dd04e37a9384ec6df049c5b)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:45.980622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6280ab1-3466-4693-87a4-48e1187c68db service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:45.981477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6280ab1-3466-4693-87a4-48e1187c68db service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:45.981917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cc464-d558-4bb4-80ad-6a8dd98895af admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:45.984322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6280ab1-3466-4693-87a4-48e1187c68db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:45.996687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6280ab1-3466-4693-87a4-48e1187c68db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:45.999208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6280ab1-3466-4693-87a4-48e1187c68db service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:46.014604 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1472/2915] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:14:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:14:46.177539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-910cc464-d558-4bb4-80ad-6a8dd98895af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71134bee5dd04e37a9384ec6df049c5b', 'request_id': 'req-910cc464-d558-4bb4-80ad-6a8dd98895af'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:46.186010 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-910cc464-d558-4bb4-80ad-6a8dd98895af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71134bee5dd04e37a9384ec6df049c5b', 'request_id': 'req-910cc464-d558-4bb4-80ad-6a8dd98895af'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:46.192538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-910cc464-d558-4bb4-80ad-6a8dd98895af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71134bee5dd04e37a9384ec6df049c5b', 'request_id': 'req-910cc464-d558-4bb4-80ad-6a8dd98895af'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:46.278387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-910cc464-d558-4bb4-80ad-6a8dd98895af admin admin] The token cache is being invalidate because project 71134bee5dd04e37a9384ec6df049c5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:14:46.289108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-910cc464-d558-4bb4-80ad-6a8dd98895af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:46.289108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-910cc464-d558-4bb4-80ad-6a8dd98895af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:46.290815 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1444/2916] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:14:45 2022] DELETE /identity/v3/projects/71134bee5dd04e37a9384ec6df049c5b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:46.291421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69a165-6dc2-4ede-a8d8-8c52dd6e9825 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:46.291956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69a165-6dc2-4ede-a8d8-8c52dd6e9825 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:46.292138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69a165-6dc2-4ede-a8d8-8c52dd6e9825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:46.327518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-eb69a165-6dc2-4ede-a8d8-8c52dd6e9825 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:46.329000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-eb69a165-6dc2-4ede-a8d8-8c52dd6e9825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:46.406079 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1473/2917] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:46.414505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d7a55-5f66-4f60-8e35-80e8fe0eea93 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:46.415057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d7a55-5f66-4f60-8e35-80e8fe0eea93 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:46.415473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d7a55-5f66-4f60-8e35-80e8fe0eea93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:46.443123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-932d7a55-5f66-4f60-8e35-80e8fe0eea93 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:46.444615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-932d7a55-5f66-4f60-8e35-80e8fe0eea93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:46.453789 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1445/2918] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:14:46.462379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69a165-6dc2-4ede-a8d8-8c52dd6e9825 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:46.472950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69a165-6dc2-4ede-a8d8-8c52dd6e9825 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:46.478725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929546b5-f9e5-40da-b933-0de7abd4b428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:46.479517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929546b5-f9e5-40da-b933-0de7abd4b428 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:46.479862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929546b5-f9e5-40da-b933-0de7abd4b428 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:46.480193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929546b5-f9e5-40da-b933-0de7abd4b428 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:46.481007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929546b5-f9e5-40da-b933-0de7abd4b428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:14:46.481377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929546b5-f9e5-40da-b933-0de7abd4b428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:46.483103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929546b5-f9e5-40da-b933-0de7abd4b428 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:46.497395 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1474/2919] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:14:46.502320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d7a55-5f66-4f60-8e35-80e8fe0eea93 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:46.528326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d7a55-5f66-4f60-8e35-80e8fe0eea93 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:46.553888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2160fb8-d47c-4f2a-865b-fc62c354f08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:46.555419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2160fb8-d47c-4f2a-865b-fc62c354f08a admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:46.556341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2160fb8-d47c-4f2a-865b-fc62c354f08a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:46.557813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2160fb8-d47c-4f2a-865b-fc62c354f08a admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:46.558856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2160fb8-d47c-4f2a-865b-fc62c354f08a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:46.565685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2160fb8-d47c-4f2a-865b-fc62c354f08a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:46.809095 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1446/2920] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:14:46 2022] POST /identity/v3/projects => generated 393 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:14:46.812949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929546b5-f9e5-40da-b933-0de7abd4b428 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:46.841043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929546b5-f9e5-40da-b933-0de7abd4b428 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:46.909673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb337c-4c66-4fe2-baf5-3e8f2593cdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:46.910363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb337c-4c66-4fe2-baf5-3e8f2593cdd4 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:46.910643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb337c-4c66-4fe2-baf5-3e8f2593cdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:46.910918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb337c-4c66-4fe2-baf5-3e8f2593cdd4 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:46.912183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb337c-4c66-4fe2-baf5-3e8f2593cdd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:46.914083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb337c-4c66-4fe2-baf5-3e8f2593cdd4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:46.965330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:47.018099 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1475/2921] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:14:46 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:14:47.025096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2160fb8-d47c-4f2a-865b-fc62c354f08a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:47.035213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2160fb8-d47c-4f2a-865b-fc62c354f08a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:47.040475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133aaba-0437-4a56-bed0-dc4ccb35b47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:47.041662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133aaba-0437-4a56-bed0-dc4ccb35b47e admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:47.042197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133aaba-0437-4a56-bed0-dc4ccb35b47e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:47.042644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133aaba-0437-4a56-bed0-dc4ccb35b47e admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:47.043658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133aaba-0437-4a56-bed0-dc4ccb35b47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:47.045677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133aaba-0437-4a56-bed0-dc4ccb35b47e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:47.061384 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1447/2922] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:14:47.065661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb337c-4c66-4fe2-baf5-3e8f2593cdd4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:47.076875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb337c-4c66-4fe2-baf5-3e8f2593cdd4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:47.082285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6100eea-4d80-4ef6-97a4-f7a9b3fb6ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:47.083035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6100eea-4d80-4ef6-97a4-f7a9b3fb6ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:47.083830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6100eea-4d80-4ef6-97a4-f7a9b3fb6ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:47.084860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6100eea-4d80-4ef6-97a4-f7a9b3fb6ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:47.085594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6100eea-4d80-4ef6-97a4-f7a9b3fb6ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:47.087282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6100eea-4d80-4ef6-97a4-f7a9b3fb6ac5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:47.097883 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1476/2923] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:14:47.103476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133aaba-0437-4a56-bed0-dc4ccb35b47e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:47.120591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133aaba-0437-4a56-bed0-dc4ccb35b47e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:47.126593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e0077-25f5-4aa5-aed7-6a332b4c6053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:47.128263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e0077-25f5-4aa5-aed7-6a332b4c6053 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:47.128629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e0077-25f5-4aa5-aed7-6a332b4c6053 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:47.128970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e0077-25f5-4aa5-aed7-6a332b4c6053 admin admin] PATH_INFO: `/v3/projects/9b260142a0b749f29fef8f948a33ac69/users/99b41c7e1ab3428495058e583156f0a0/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:47.150175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e0077-25f5-4aa5-aed7-6a332b4c6053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b260142a0b749f29fef8f948a33ac69, user_id=99b41c7e1ab3428495058e583156f0a0, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:47.154036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e0077-25f5-4aa5-aed7-6a332b4c6053 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:47.248857 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1448/2924] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:14:47 2022] PUT /identity/v3/projects/9b260142a0b749f29fef8f948a33ac69/users/99b41c7e1ab3428495058e583156f0a0/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:14:47.260255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f5a35-c4b3-41a2-9f0f-710c2b8aa806 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:47.260543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f5a35-c4b3-41a2-9f0f-710c2b8aa806 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:47.261250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f5a35-c4b3-41a2-9f0f-710c2b8aa806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:47.294734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-fb2f5a35-c4b3-41a2-9f0f-710c2b8aa806 None None] MFA Rules not processed for user `99b41c7e1ab3428495058e583156f0a0`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:47.299619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fb2f5a35-c4b3-41a2-9f0f-710c2b8aa806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:47.383048 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1477/2925] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:47.386576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e0077-25f5-4aa5-aed7-6a332b4c6053 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:47.468798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e0077-25f5-4aa5-aed7-6a332b4c6053 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:47.485819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb3e66-8936-4922-94a1-94981378e551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:47.486435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb3e66-8936-4922-94a1-94981378e551 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:47.486717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb3e66-8936-4922-94a1-94981378e551 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:47.486995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb3e66-8936-4922-94a1-94981378e551 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:47.487732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb3e66-8936-4922-94a1-94981378e551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:47.490549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb3e66-8936-4922-94a1-94981378e551 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:47.649148 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1449/2926] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:14:47 2022] POST /identity/v3/projects => generated 393 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:14:47.653983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f5a35-c4b3-41a2-9f0f-710c2b8aa806 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:47.665206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f5a35-c4b3-41a2-9f0f-710c2b8aa806 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:47.688054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:47.744763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663447c8-ac26-4513-aa59-82bf6ea3095c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:47.745613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663447c8-ac26-4513-aa59-82bf6ea3095c admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:47.746009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663447c8-ac26-4513-aa59-82bf6ea3095c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:47.746640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663447c8-ac26-4513-aa59-82bf6ea3095c admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:47.748429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663447c8-ac26-4513-aa59-82bf6ea3095c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:47.750621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663447c8-ac26-4513-aa59-82bf6ea3095c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:47.872960 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1478/2927] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:14:47 2022] POST /identity/v3/users => generated 303 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:14:47.876770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb3e66-8936-4922-94a1-94981378e551 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:47.890410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb3e66-8936-4922-94a1-94981378e551 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:47.897896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bbf21-b4a0-4539-a922-23253715c569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:47.898586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bbf21-b4a0-4539-a922-23253715c569 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:47.898884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bbf21-b4a0-4539-a922-23253715c569 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:47.899205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bbf21-b4a0-4539-a922-23253715c569 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:47.899935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bbf21-b4a0-4539-a922-23253715c569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:47.901607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bbf21-b4a0-4539-a922-23253715c569 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:47.913659 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1450/2928] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:14:47.918068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663447c8-ac26-4513-aa59-82bf6ea3095c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:47.929223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663447c8-ac26-4513-aa59-82bf6ea3095c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:47.934153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9703238-bc70-4ecf-9f53-3efd4f1fd8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:47.935064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9703238-bc70-4ecf-9f53-3efd4f1fd8fa admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:47.935329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9703238-bc70-4ecf-9f53-3efd4f1fd8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:47.935602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9703238-bc70-4ecf-9f53-3efd4f1fd8fa admin admin] PATH_INFO: `/v3/projects/db035c9138754b57b83510fca1331059/users/c900ca5debac4b64a2da9b3abdc431e1/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:47.952935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9703238-bc70-4ecf-9f53-3efd4f1fd8fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=db035c9138754b57b83510fca1331059, user_id=c900ca5debac4b64a2da9b3abdc431e1, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:47.955636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9703238-bc70-4ecf-9f53-3efd4f1fd8fa admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:48.098291 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1479/2929] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:14:47 2022] PUT /identity/v3/projects/db035c9138754b57b83510fca1331059/users/c900ca5debac4b64a2da9b3abdc431e1/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:48.102976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bbf21-b4a0-4539-a922-23253715c569 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:48.115983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bbf21-b4a0-4539-a922-23253715c569 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:48.191654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab763e72-5ab1-424c-a5a5-677042755221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:48.192346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab763e72-5ab1-424c-a5a5-677042755221 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:48.192746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab763e72-5ab1-424c-a5a5-677042755221 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:48.193025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab763e72-5ab1-424c-a5a5-677042755221 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:48.193768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab763e72-5ab1-424c-a5a5-677042755221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:48.195569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab763e72-5ab1-424c-a5a5-677042755221 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:48.210579 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1451/2930] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:14:48.214348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9703238-bc70-4ecf-9f53-3efd4f1fd8fa admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:48.257416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9703238-bc70-4ecf-9f53-3efd4f1fd8fa admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:48.281429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c460959-233b-4b50-bf78-3eb3dbefae93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:48.283227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c460959-233b-4b50-bf78-3eb3dbefae93 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:48.283617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c460959-233b-4b50-bf78-3eb3dbefae93 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:48.284527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c460959-233b-4b50-bf78-3eb3dbefae93 admin admin] PATH_INFO: `/v3/projects/db035c9138754b57b83510fca1331059/users/c900ca5debac4b64a2da9b3abdc431e1/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:48.303963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c460959-233b-4b50-bf78-3eb3dbefae93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db035c9138754b57b83510fca1331059, user_id=c900ca5debac4b64a2da9b3abdc431e1, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:48.303963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c460959-233b-4b50-bf78-3eb3dbefae93 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:48.324755 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1480/2931] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:14:48 2022] PUT /identity/v3/projects/db035c9138754b57b83510fca1331059/users/c900ca5debac4b64a2da9b3abdc431e1/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:48.340938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d90915-5007-42a9-97fe-4aac8bd62f7e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:48.341876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d90915-5007-42a9-97fe-4aac8bd62f7e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:48.342317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d90915-5007-42a9-97fe-4aac8bd62f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:48.396749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b9d90915-5007-42a9-97fe-4aac8bd62f7e None None] MFA Rules not processed for user `c900ca5debac4b64a2da9b3abdc431e1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:48.398615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b9d90915-5007-42a9-97fe-4aac8bd62f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:48.616706 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1452/2932] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:14:48.652289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c460959-233b-4b50-bf78-3eb3dbefae93 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:48.657285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9c460959-233b-4b50-bf78-3eb3dbefae93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:48.829950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c460959-233b-4b50-bf78-3eb3dbefae93 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:48.836530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bd45d-28b7-48c2-bf07-40701fbfc63d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:48.837283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bd45d-28b7-48c2-bf07-40701fbfc63d service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:48.837457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bd45d-28b7-48c2-bf07-40701fbfc63d service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:48.837732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bd45d-28b7-48c2-bf07-40701fbfc63d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:48.848028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bd45d-28b7-48c2-bf07-40701fbfc63d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:48.850286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bd45d-28b7-48c2-bf07-40701fbfc63d service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:48.866154 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1481/2933] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:14:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:14:48.935145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d90915-5007-42a9-97fe-4aac8bd62f7e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:48.968585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d90915-5007-42a9-97fe-4aac8bd62f7e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:48.979274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d81ba2-0c9a-458f-b444-d3f8e4c37743 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:48.982378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d81ba2-0c9a-458f-b444-d3f8e4c37743 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:48.982378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d81ba2-0c9a-458f-b444-d3f8e4c37743 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:48.982378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d81ba2-0c9a-458f-b444-d3f8e4c37743 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:49.052378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d81ba2-0c9a-458f-b444-d3f8e4c37743 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:49.054054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d81ba2-0c9a-458f-b444-d3f8e4c37743 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:49.063758 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1453/2934] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:14:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:14:49.093199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bd45d-28b7-48c2-bf07-40701fbfc63d service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:49.195421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bd45d-28b7-48c2-bf07-40701fbfc63d service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:49.207304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135d3aa-7c2e-4134-8382-049419c385fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:49.208592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135d3aa-7c2e-4134-8382-049419c385fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:49.209090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135d3aa-7c2e-4134-8382-049419c385fd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:49.209526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135d3aa-7c2e-4134-8382-049419c385fd admin admin] PATH_INFO: `/v3/users/99b41c7e1ab3428495058e583156f0a0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:49.211208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135d3aa-7c2e-4134-8382-049419c385fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=99b41c7e1ab3428495058e583156f0a0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:49.213542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135d3aa-7c2e-4134-8382-049419c385fd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:49.559213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8135d3aa-7c2e-4134-8382-049419c385fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99b41c7e1ab3428495058e583156f0a0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:49.565266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8135d3aa-7c2e-4134-8382-049419c385fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99b41c7e1ab3428495058e583156f0a0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:49.703433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8135d3aa-7c2e-4134-8382-049419c385fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99b41c7e1ab3428495058e583156f0a0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:49.703433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8135d3aa-7c2e-4134-8382-049419c385fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99b41c7e1ab3428495058e583156f0a0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:49.720811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8135d3aa-7c2e-4134-8382-049419c385fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99b41c7e1ab3428495058e583156f0a0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:49.744418 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1482/2935] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:14:49 2022] DELETE /identity/v3/users/99b41c7e1ab3428495058e583156f0a0 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:49.747608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1c26a-6de8-410b-a8b9-84c17b353be6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:49.748453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1c26a-6de8-410b-a8b9-84c17b353be6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:49.748731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1c26a-6de8-410b-a8b9-84c17b353be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:49.777342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1bf1c26a-6de8-410b-a8b9-84c17b353be6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:49.779363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1bf1c26a-6de8-410b-a8b9-84c17b353be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:49.882627 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1454/2936] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:49.901204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135d3aa-7c2e-4134-8382-049419c385fd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:49.902682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8135d3aa-7c2e-4134-8382-049419c385fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:50.001908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135d3aa-7c2e-4134-8382-049419c385fd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:50.011780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03519f90-7f90-44c8-a943-106b2de26460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:50.012547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03519f90-7f90-44c8-a943-106b2de26460 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:50.013277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03519f90-7f90-44c8-a943-106b2de26460 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:50.013794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03519f90-7f90-44c8-a943-106b2de26460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:50.038463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03519f90-7f90-44c8-a943-106b2de26460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:50.040470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03519f90-7f90-44c8-a943-106b2de26460 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:50.069126 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1483/2937] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:14:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:14:50.129684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:50.758630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:51.129104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1c26a-6de8-410b-a8b9-84c17b353be6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:51.132199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1bf1c26a-6de8-410b-a8b9-84c17b353be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:51.158339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1c26a-6de8-410b-a8b9-84c17b353be6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:51.179167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cdf77-0409-47ec-a3e0-79209c51f361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:51.180635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cdf77-0409-47ec-a3e0-79209c51f361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:51.182591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cdf77-0409-47ec-a3e0-79209c51f361 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:51.183774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cdf77-0409-47ec-a3e0-79209c51f361 admin admin] PATH_INFO: `/v3/projects/9b260142a0b749f29fef8f948a33ac69` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:51.188103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cdf77-0409-47ec-a3e0-79209c51f361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b260142a0b749f29fef8f948a33ac69)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:51.191144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cdf77-0409-47ec-a3e0-79209c51f361 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:51.396532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3b8cdf77-0409-47ec-a3e0-79209c51f361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b260142a0b749f29fef8f948a33ac69', 'request_id': 'req-3b8cdf77-0409-47ec-a3e0-79209c51f361'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:51.408651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3b8cdf77-0409-47ec-a3e0-79209c51f361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b260142a0b749f29fef8f948a33ac69', 'request_id': 'req-3b8cdf77-0409-47ec-a3e0-79209c51f361'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:51.426126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3b8cdf77-0409-47ec-a3e0-79209c51f361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b260142a0b749f29fef8f948a33ac69', 'request_id': 'req-3b8cdf77-0409-47ec-a3e0-79209c51f361'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:51.505404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3b8cdf77-0409-47ec-a3e0-79209c51f361 admin admin] The token cache is being invalidate because project 9b260142a0b749f29fef8f948a33ac69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:14:51.506135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3b8cdf77-0409-47ec-a3e0-79209c51f361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:51.507052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3b8cdf77-0409-47ec-a3e0-79209c51f361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:51.509426 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1455/2938] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:14:51 2022] DELETE /identity/v3/projects/9b260142a0b749f29fef8f948a33ac69 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:51.513963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03519f90-7f90-44c8-a943-106b2de26460 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:51.533747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03519f90-7f90-44c8-a943-106b2de26460 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:51.631104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2d4b1-b3c9-4c40-8ac0-9eae58b2031f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:51.632605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2d4b1-b3c9-4c40-8ac0-9eae58b2031f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:51.633058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2d4b1-b3c9-4c40-8ac0-9eae58b2031f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:51.633495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2d4b1-b3c9-4c40-8ac0-9eae58b2031f admin admin] PATH_INFO: `/v3/users/c900ca5debac4b64a2da9b3abdc431e1` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:51.636328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2d4b1-b3c9-4c40-8ac0-9eae58b2031f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c900ca5debac4b64a2da9b3abdc431e1)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:51.638863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2d4b1-b3c9-4c40-8ac0-9eae58b2031f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:51.800590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fef413-9440-4b89-aa36-a0788ebb76b9 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:51.800590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fef413-9440-4b89-aa36-a0788ebb76b9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:51.800590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fef413-9440-4b89-aa36-a0788ebb76b9 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:51.800590 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1456/2939] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 21:14:51.809233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207fb33-8d26-4921-b87f-b9939c21e6af None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:51.809535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207fb33-8d26-4921-b87f-b9939c21e6af None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:51.809888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207fb33-8d26-4921-b87f-b9939c21e6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:51.852294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e207fb33-8d26-4921-b87f-b9939c21e6af None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:51.853953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e207fb33-8d26-4921-b87f-b9939c21e6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:51.936532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51a2d4b1-b3c9-4c40-8ac0-9eae58b2031f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c900ca5debac4b64a2da9b3abdc431e1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:51.958853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51a2d4b1-b3c9-4c40-8ac0-9eae58b2031f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c900ca5debac4b64a2da9b3abdc431e1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:52.034627 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1457/2940] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:14:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:14:52.039261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207fb33-8d26-4921-b87f-b9939c21e6af None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:52.042958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e207fb33-8d26-4921-b87f-b9939c21e6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:52.064326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207fb33-8d26-4921-b87f-b9939c21e6af None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:52.072698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0a0bf-12af-4a2f-80ab-20216198cb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:52.074145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0a0bf-12af-4a2f-80ab-20216198cb2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:52.074427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0a0bf-12af-4a2f-80ab-20216198cb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:52.074748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0a0bf-12af-4a2f-80ab-20216198cb2e admin admin] PATH_INFO: `/v3/users/c1aea87154224f1c81428ddef4438801` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:52.076147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0a0bf-12af-4a2f-80ab-20216198cb2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1aea87154224f1c81428ddef4438801)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:52.078522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0a0bf-12af-4a2f-80ab-20216198cb2e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:52.117088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51a2d4b1-b3c9-4c40-8ac0-9eae58b2031f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c900ca5debac4b64a2da9b3abdc431e1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:52.117747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51a2d4b1-b3c9-4c40-8ac0-9eae58b2031f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c900ca5debac4b64a2da9b3abdc431e1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:52.136749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51a2d4b1-b3c9-4c40-8ac0-9eae58b2031f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c900ca5debac4b64a2da9b3abdc431e1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:52.163574 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1484/2941] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:14:51 2022] DELETE /identity/v3/users/c900ca5debac4b64a2da9b3abdc431e1 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:52.164311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2d4b1-b3c9-4c40-8ac0-9eae58b2031f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:52.169548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-51a2d4b1-b3c9-4c40-8ac0-9eae58b2031f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:52.320885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2d4b1-b3c9-4c40-8ac0-9eae58b2031f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:52.358294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7177b28-8eab-4ba1-aee9-c1d26d42f1de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:52.360003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7177b28-8eab-4ba1-aee9-c1d26d42f1de service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:52.362734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6ee0a0bf-12af-4a2f-80ab-20216198cb2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1aea87154224f1c81428ddef4438801'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:52.363670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7177b28-8eab-4ba1-aee9-c1d26d42f1de service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:52.365024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7177b28-8eab-4ba1-aee9-c1d26d42f1de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:52.377926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a7177b28-8eab-4ba1-aee9-c1d26d42f1de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:52.407658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6ee0a0bf-12af-4a2f-80ab-20216198cb2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1aea87154224f1c81428ddef4438801'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:52.416021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7177b28-8eab-4ba1-aee9-c1d26d42f1de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:52.417949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7177b28-8eab-4ba1-aee9-c1d26d42f1de service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:52.445731 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1485/2942] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:14:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:14:52.510913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6ee0a0bf-12af-4a2f-80ab-20216198cb2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1aea87154224f1c81428ddef4438801'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:52.526070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6ee0a0bf-12af-4a2f-80ab-20216198cb2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1aea87154224f1c81428ddef4438801'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:52.529727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6ee0a0bf-12af-4a2f-80ab-20216198cb2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1aea87154224f1c81428ddef4438801'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:52.551454 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1458/2943] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:14:52 2022] DELETE /identity/v3/users/c1aea87154224f1c81428ddef4438801 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:52.556839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5c3e2-4caf-469d-adab-c7de2c7e8c5e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:52.557144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5c3e2-4caf-469d-adab-c7de2c7e8c5e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:52.557754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5c3e2-4caf-469d-adab-c7de2c7e8c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:52.580980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-caf5c3e2-4caf-469d-adab-c7de2c7e8c5e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:52.582576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-caf5c3e2-4caf-469d-adab-c7de2c7e8c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:52.676221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:52.697351 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1486/2944] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:52.715335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0a0bf-12af-4a2f-80ab-20216198cb2e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:52.715335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6ee0a0bf-12af-4a2f-80ab-20216198cb2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:52.857960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0a0bf-12af-4a2f-80ab-20216198cb2e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:52.869134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c571f0e-0231-4cb5-8a0b-363b29a23c08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:52.870476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c571f0e-0231-4cb5-8a0b-363b29a23c08 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:52.874861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c571f0e-0231-4cb5-8a0b-363b29a23c08 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:52.875320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c571f0e-0231-4cb5-8a0b-363b29a23c08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:52.915253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c571f0e-0231-4cb5-8a0b-363b29a23c08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:52.924499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c571f0e-0231-4cb5-8a0b-363b29a23c08 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:52.963500 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1459/2945] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:14:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:14:53.056258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5c3e2-4caf-469d-adab-c7de2c7e8c5e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:53.059346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-caf5c3e2-4caf-469d-adab-c7de2c7e8c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:53.082635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5c3e2-4caf-469d-adab-c7de2c7e8c5e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:53.091432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6273931-49a1-4d62-8a00-2a351d1a707c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:53.093397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6273931-49a1-4d62-8a00-2a351d1a707c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:53.093931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6273931-49a1-4d62-8a00-2a351d1a707c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:53.094396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6273931-49a1-4d62-8a00-2a351d1a707c admin admin] PATH_INFO: `/v3/projects/db035c9138754b57b83510fca1331059` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:53.095946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6273931-49a1-4d62-8a00-2a351d1a707c admin admin] RBAC: Authorizing `identity:delete_project(project_id=db035c9138754b57b83510fca1331059)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:53.099383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6273931-49a1-4d62-8a00-2a351d1a707c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:53.277042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:53.294760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6273931-49a1-4d62-8a00-2a351d1a707c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db035c9138754b57b83510fca1331059', 'request_id': 'req-c6273931-49a1-4d62-8a00-2a351d1a707c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:53.311248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6273931-49a1-4d62-8a00-2a351d1a707c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db035c9138754b57b83510fca1331059', 'request_id': 'req-c6273931-49a1-4d62-8a00-2a351d1a707c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:53.328512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6273931-49a1-4d62-8a00-2a351d1a707c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db035c9138754b57b83510fca1331059', 'request_id': 'req-c6273931-49a1-4d62-8a00-2a351d1a707c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:53.424547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6273931-49a1-4d62-8a00-2a351d1a707c admin admin] The token cache is being invalidate because project db035c9138754b57b83510fca1331059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:14:53.424886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6273931-49a1-4d62-8a00-2a351d1a707c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:53.425494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6273931-49a1-4d62-8a00-2a351d1a707c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:53.427930 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1487/2946] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:14:53 2022] DELETE /identity/v3/projects/db035c9138754b57b83510fca1331059 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:53.435155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24815dc2-fc4f-4511-97f4-bfd60318a23c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:53.440180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24815dc2-fc4f-4511-97f4-bfd60318a23c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:53.440180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24815dc2-fc4f-4511-97f4-bfd60318a23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:53.480659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-24815dc2-fc4f-4511-97f4-bfd60318a23c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:53.483472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-24815dc2-fc4f-4511-97f4-bfd60318a23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:53.635991 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1460/2947] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:53.637935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b53b5-c78d-4587-b4f8-d8dbfc47b756 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:53.638227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b53b5-c78d-4587-b4f8-d8dbfc47b756 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:53.638501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b53b5-c78d-4587-b4f8-d8dbfc47b756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:53.687797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f91b53b5-c78d-4587-b4f8-d8dbfc47b756 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:53.689048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f91b53b5-c78d-4587-b4f8-d8dbfc47b756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:53.717594 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1488/2948] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:53.721726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24815dc2-fc4f-4511-97f4-bfd60318a23c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:53.742798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24815dc2-fc4f-4511-97f4-bfd60318a23c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:53.759262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d2bd3-5e0f-4f08-9bdc-ce190a960abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:53.760317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d2bd3-5e0f-4f08-9bdc-ce190a960abf admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:53.760896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d2bd3-5e0f-4f08-9bdc-ce190a960abf admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:53.761173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d2bd3-5e0f-4f08-9bdc-ce190a960abf admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:53.761924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d2bd3-5e0f-4f08-9bdc-ce190a960abf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:14:53.762399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d2bd3-5e0f-4f08-9bdc-ce190a960abf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:53.765724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d2bd3-5e0f-4f08-9bdc-ce190a960abf admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:53.799953 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1461/2949] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:14:53.804873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b53b5-c78d-4587-b4f8-d8dbfc47b756 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:53.833367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b53b5-c78d-4587-b4f8-d8dbfc47b756 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:53.861165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990297be-13d0-46d5-9cd1-e32a81cb5d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:53.862145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990297be-13d0-46d5-9cd1-e32a81cb5d38 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:53.862583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990297be-13d0-46d5-9cd1-e32a81cb5d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:53.863124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990297be-13d0-46d5-9cd1-e32a81cb5d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:53.864014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990297be-13d0-46d5-9cd1-e32a81cb5d38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:53.867401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990297be-13d0-46d5-9cd1-e32a81cb5d38 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:53.997334 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1489/2950] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:14:53 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:14:54.001615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d2bd3-5e0f-4f08-9bdc-ce190a960abf admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:54.025065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d2bd3-5e0f-4f08-9bdc-ce190a960abf admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:54.229635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1518145-5f8c-4c51-b755-829a98a27037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:54.233002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1518145-5f8c-4c51-b755-829a98a27037 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:54.233396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1518145-5f8c-4c51-b755-829a98a27037 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:54.233569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1518145-5f8c-4c51-b755-829a98a27037 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:54.234281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1518145-5f8c-4c51-b755-829a98a27037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:54.241779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1518145-5f8c-4c51-b755-829a98a27037 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:54.470393 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1462/2951] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:14:54 2022] POST /identity/v3/users => generated 291 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:14:54.471652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990297be-13d0-46d5-9cd1-e32a81cb5d38 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:54.482592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:54.486208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990297be-13d0-46d5-9cd1-e32a81cb5d38 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:54.499978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de44f2-992e-44be-8869-3b2cd97779af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:54.500574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de44f2-992e-44be-8869-3b2cd97779af admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:54.500870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de44f2-992e-44be-8869-3b2cd97779af admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:54.501966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de44f2-992e-44be-8869-3b2cd97779af admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:54.502766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de44f2-992e-44be-8869-3b2cd97779af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:54.507413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de44f2-992e-44be-8869-3b2cd97779af admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:54.517923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1518145-5f8c-4c51-b755-829a98a27037 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:54.520244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a1518145-5f8c-4c51-b755-829a98a27037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:54.536883 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1490/2952] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:14:54.538999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de44f2-992e-44be-8869-3b2cd97779af admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:54.546104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1518145-5f8c-4c51-b755-829a98a27037 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:54.558616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de44f2-992e-44be-8869-3b2cd97779af admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:54.559941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e3ddd-9a28-4547-af36-f114a8d32c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:54.560312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e3ddd-9a28-4547-af36-f114a8d32c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:54.560590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e3ddd-9a28-4547-af36-f114a8d32c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:54.561813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e3ddd-9a28-4547-af36-f114a8d32c40 admin admin] PATH_INFO: `/v3/projects/45d9edd2fe854483a6f0d676efbd6622` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:54.563906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9274b-a539-4837-96cb-d546bcddce40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:54.564565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9274b-a539-4837-96cb-d546bcddce40 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:54.564852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9274b-a539-4837-96cb-d546bcddce40 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:54.565115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9274b-a539-4837-96cb-d546bcddce40 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:54.565665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e3ddd-9a28-4547-af36-f114a8d32c40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d9edd2fe854483a6f0d676efbd6622)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:54.565896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9274b-a539-4837-96cb-d546bcddce40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:54.568469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9274b-a539-4837-96cb-d546bcddce40 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:54.569631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e3ddd-9a28-4547-af36-f114a8d32c40 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:54.579768 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1491/2953] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:14:54.584836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9274b-a539-4837-96cb-d546bcddce40 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:54.601461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9274b-a539-4837-96cb-d546bcddce40 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:54.608674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a68318-92fb-415b-a03c-5d8b6b800650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:54.609784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a68318-92fb-415b-a03c-5d8b6b800650 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:54.610236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a68318-92fb-415b-a03c-5d8b6b800650 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:54.610804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a68318-92fb-415b-a03c-5d8b6b800650 admin admin] PATH_INFO: `/v3/projects/a30b6074cef24df6ba020b01fc85b3e3/users/bd9e72b27f304a9383d7f3fdcd718972/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:54.642074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a68318-92fb-415b-a03c-5d8b6b800650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a30b6074cef24df6ba020b01fc85b3e3, user_id=bd9e72b27f304a9383d7f3fdcd718972, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:54.646003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a68318-92fb-415b-a03c-5d8b6b800650 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:54.787787 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1492/2954] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:14:54 2022] PUT /identity/v3/projects/a30b6074cef24df6ba020b01fc85b3e3/users/bd9e72b27f304a9383d7f3fdcd718972/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:14:54.802216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dfdf3-a3de-4bdd-84ef-b48053d9e3f6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:54.802831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dfdf3-a3de-4bdd-84ef-b48053d9e3f6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:54.803328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dfdf3-a3de-4bdd-84ef-b48053d9e3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:54.827128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5d5e3ddd-9a28-4547-af36-f114a8d32c40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d9edd2fe854483a6f0d676efbd6622', 'request_id': 'req-5d5e3ddd-9a28-4547-af36-f114a8d32c40'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:54.840324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5d5e3ddd-9a28-4547-af36-f114a8d32c40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d9edd2fe854483a6f0d676efbd6622', 'request_id': 'req-5d5e3ddd-9a28-4547-af36-f114a8d32c40'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:54.847979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5d5e3ddd-9a28-4547-af36-f114a8d32c40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d9edd2fe854483a6f0d676efbd6622', 'request_id': 'req-5d5e3ddd-9a28-4547-af36-f114a8d32c40'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:54.867625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-052dfdf3-a3de-4bdd-84ef-b48053d9e3f6 None None] MFA Rules not processed for user `bd9e72b27f304a9383d7f3fdcd718972`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:54.869332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-052dfdf3-a3de-4bdd-84ef-b48053d9e3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:54.974708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5d5e3ddd-9a28-4547-af36-f114a8d32c40 admin admin] The token cache is being invalidate because project 45d9edd2fe854483a6f0d676efbd6622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:14:54.976125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5d5e3ddd-9a28-4547-af36-f114a8d32c40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:54.981255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5d5e3ddd-9a28-4547-af36-f114a8d32c40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:54.989541 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1463/2955] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:14:54 2022] DELETE /identity/v3/projects/45d9edd2fe854483a6f0d676efbd6622 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:14:54.994293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e3ddd-9a28-4547-af36-f114a8d32c40 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:54.996468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5d5e3ddd-9a28-4547-af36-f114a8d32c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:55.056494 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1493/2956] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:14:55.070708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052dfdf3-a3de-4bdd-84ef-b48053d9e3f6 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:55.072633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-052dfdf3-a3de-4bdd-84ef-b48053d9e3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:55.100881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:55.229465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052dfdf3-a3de-4bdd-84ef-b48053d9e3f6 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:55.236261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf90c9-dd0c-4b73-875f-47c675b3799d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:55.237287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf90c9-dd0c-4b73-875f-47c675b3799d service glance] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:55.237807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf90c9-dd0c-4b73-875f-47c675b3799d service glance] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:55.238453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf90c9-dd0c-4b73-875f-47c675b3799d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:55.250976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf90c9-dd0c-4b73-875f-47c675b3799d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:55.253326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf90c9-dd0c-4b73-875f-47c675b3799d service glance] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:55.268064 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1494/2957] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:14:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:14:55.292157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e3ddd-9a28-4547-af36-f114a8d32c40 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:55.298540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36edbad-4237-42f1-bdb6-21858b2c966e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:55.299924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36edbad-4237-42f1-bdb6-21858b2c966e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:55.300439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36edbad-4237-42f1-bdb6-21858b2c966e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:55.300902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36edbad-4237-42f1-bdb6-21858b2c966e admin admin] PATH_INFO: `/v3/users/27aeaef0a671464493a8cac846186af7` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:55.303093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36edbad-4237-42f1-bdb6-21858b2c966e admin admin] RBAC: Authorizing `identity:delete_user(user_id=27aeaef0a671464493a8cac846186af7)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:55.306165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36edbad-4237-42f1-bdb6-21858b2c966e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:55.560330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e36edbad-4237-42f1-bdb6-21858b2c966e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27aeaef0a671464493a8cac846186af7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:55.581303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e36edbad-4237-42f1-bdb6-21858b2c966e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27aeaef0a671464493a8cac846186af7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:55.669147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e36edbad-4237-42f1-bdb6-21858b2c966e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27aeaef0a671464493a8cac846186af7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:55.678013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e36edbad-4237-42f1-bdb6-21858b2c966e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27aeaef0a671464493a8cac846186af7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:55.679992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e36edbad-4237-42f1-bdb6-21858b2c966e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27aeaef0a671464493a8cac846186af7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:55.690278 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1464/2958] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:14:54 2022] DELETE /identity/v3/users/27aeaef0a671464493a8cac846186af7 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:55.715532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4f116-0dfa-4731-94e5-f2531057ab9e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:55.716874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4f116-0dfa-4731-94e5-f2531057ab9e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:55.717258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4f116-0dfa-4731-94e5-f2531057ab9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:55.746792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f8e4f116-0dfa-4731-94e5-f2531057ab9e None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:55.749005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f8e4f116-0dfa-4731-94e5-f2531057ab9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:55.896087 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1495/2959] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:14:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:55.956679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36edbad-4237-42f1-bdb6-21858b2c966e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:55.975230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e36edbad-4237-42f1-bdb6-21858b2c966e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:56.092624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36edbad-4237-42f1-bdb6-21858b2c966e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:56.111677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f96b6e-d303-43a8-a511-146e5dcad828 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:56.112684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f96b6e-d303-43a8-a511-146e5dcad828 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:56.113128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f96b6e-d303-43a8-a511-146e5dcad828 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:56.113603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f96b6e-d303-43a8-a511-146e5dcad828 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:56.132848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f96b6e-d303-43a8-a511-146e5dcad828 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:56.137973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f96b6e-d303-43a8-a511-146e5dcad828 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:56.168146 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1465/2960] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:14:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:14:56.596643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4f116-0dfa-4731-94e5-f2531057ab9e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:56.600350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f8e4f116-0dfa-4731-94e5-f2531057ab9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:56.894146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4f116-0dfa-4731-94e5-f2531057ab9e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:56.915871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84edd94b-810f-4316-a543-f79ef1e5791f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:56.916771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edd94b-810f-4316-a543-f79ef1e5791f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:56.917179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edd94b-810f-4316-a543-f79ef1e5791f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:56.917307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edd94b-810f-4316-a543-f79ef1e5791f admin admin] PATH_INFO: `/v3/projects/38594b6bc3354178a22f0abb698e98a6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:56.918895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84edd94b-810f-4316-a543-f79ef1e5791f admin admin] RBAC: Authorizing `identity:delete_project(project_id=38594b6bc3354178a22f0abb698e98a6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:56.921406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84edd94b-810f-4316-a543-f79ef1e5791f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:57.026038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:57.140037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-84edd94b-810f-4316-a543-f79ef1e5791f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38594b6bc3354178a22f0abb698e98a6', 'request_id': 'req-84edd94b-810f-4316-a543-f79ef1e5791f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:57.155572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-84edd94b-810f-4316-a543-f79ef1e5791f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38594b6bc3354178a22f0abb698e98a6', 'request_id': 'req-84edd94b-810f-4316-a543-f79ef1e5791f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:57.168989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-84edd94b-810f-4316-a543-f79ef1e5791f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38594b6bc3354178a22f0abb698e98a6', 'request_id': 'req-84edd94b-810f-4316-a543-f79ef1e5791f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:57.253057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-84edd94b-810f-4316-a543-f79ef1e5791f admin admin] The token cache is being invalidate because project 38594b6bc3354178a22f0abb698e98a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:14:57.253760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-84edd94b-810f-4316-a543-f79ef1e5791f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:57.259070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-84edd94b-810f-4316-a543-f79ef1e5791f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:57.259070 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1496/2961] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:14:56 2022] DELETE /identity/v3/projects/38594b6bc3354178a22f0abb698e98a6 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:57.266839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9e5cb-316b-46d9-be00-18fe8292f259 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:57.267355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9e5cb-316b-46d9-be00-18fe8292f259 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:57.268961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9e5cb-316b-46d9-be00-18fe8292f259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:57.307062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8db9e5cb-316b-46d9-be00-18fe8292f259 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:57.309261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8db9e5cb-316b-46d9-be00-18fe8292f259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:57.440986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:57.451236 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1466/2962] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:57.462915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c11681-3a21-4105-bec0-c1e867c61374 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:57.463344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c11681-3a21-4105-bec0-c1e867c61374 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:57.463646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c11681-3a21-4105-bec0-c1e867c61374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:57.503456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-91c11681-3a21-4105-bec0-c1e867c61374 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:57.505794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-91c11681-3a21-4105-bec0-c1e867c61374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:57.525293 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1497/2963] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:57.529514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9e5cb-316b-46d9-be00-18fe8292f259 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:57.546819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9e5cb-316b-46d9-be00-18fe8292f259 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:57.584107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f872e4-1d94-4df8-8b29-c26770870288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:57.585079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f872e4-1d94-4df8-8b29-c26770870288 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:57.585379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f872e4-1d94-4df8-8b29-c26770870288 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:57.585660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f872e4-1d94-4df8-8b29-c26770870288 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:57.586428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f872e4-1d94-4df8-8b29-c26770870288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:14:57.586761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f872e4-1d94-4df8-8b29-c26770870288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:57.606945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f872e4-1d94-4df8-8b29-c26770870288 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:57.632479 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1467/2964] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:14:57.633302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c11681-3a21-4105-bec0-c1e867c61374 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:57.648595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c11681-3a21-4105-bec0-c1e867c61374 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:57.668128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b1af8-b368-4615-a7f2-fc7af03a7058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:57.668812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b1af8-b368-4615-a7f2-fc7af03a7058 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:57.669111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b1af8-b368-4615-a7f2-fc7af03a7058 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:57.671025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b1af8-b368-4615-a7f2-fc7af03a7058 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:57.673963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b1af8-b368-4615-a7f2-fc7af03a7058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:57.677141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b1af8-b368-4615-a7f2-fc7af03a7058 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:57.681379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f872e4-1d94-4df8-8b29-c26770870288 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:57.683697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-15f872e4-1d94-4df8-8b29-c26770870288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:57.724575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f872e4-1d94-4df8-8b29-c26770870288 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:57.752884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bb9ad-4f27-4911-b61c-b8dbc74c1874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:57.753889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bb9ad-4f27-4911-b61c-b8dbc74c1874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:57.754300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bb9ad-4f27-4911-b61c-b8dbc74c1874 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:57.755618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bb9ad-4f27-4911-b61c-b8dbc74c1874 admin admin] PATH_INFO: `/v3/users/2eba2ac21c344394a7d3f605775b8713` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:57.764013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07bb9ad-4f27-4911-b61c-b8dbc74c1874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eba2ac21c344394a7d3f605775b8713)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:57.764013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07bb9ad-4f27-4911-b61c-b8dbc74c1874 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:57.851274 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1498/2965] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:14:57 2022] POST /identity/v3/projects => generated 379 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:14:57.857637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b1af8-b368-4615-a7f2-fc7af03a7058 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:57.955077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b1af8-b368-4615-a7f2-fc7af03a7058 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:57.961844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9f170-6637-455f-8a63-e9908202e092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:57.963030 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9f170-6637-455f-8a63-e9908202e092 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:57.963478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9f170-6637-455f-8a63-e9908202e092 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:57.963953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9f170-6637-455f-8a63-e9908202e092 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:57.964939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9f170-6637-455f-8a63-e9908202e092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:57.967591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9f170-6637-455f-8a63-e9908202e092 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:58.059691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c07bb9ad-4f27-4911-b61c-b8dbc74c1874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eba2ac21c344394a7d3f605775b8713'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:58.078694 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1499/2966] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:14:57 2022] POST /identity/v3/users => generated 290 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:14:58.080845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3a8ea-5f58-481b-96e3-ce858751f4bc None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:58.081288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3a8ea-5f58-481b-96e3-ce858751f4bc None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:58.081666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3a8ea-5f58-481b-96e3-ce858751f4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:58.095473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c07bb9ad-4f27-4911-b61c-b8dbc74c1874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eba2ac21c344394a7d3f605775b8713'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:58.158274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7fe3a8ea-5f58-481b-96e3-ce858751f4bc None None] MFA Rules not processed for user `94649762be79464785b4412c9b9a61fa`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:58.159696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7fe3a8ea-5f58-481b-96e3-ce858751f4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:58.259388 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1500/2967] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:58.260616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3a8ea-5f58-481b-96e3-ce858751f4bc None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:58.266668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c07bb9ad-4f27-4911-b61c-b8dbc74c1874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eba2ac21c344394a7d3f605775b8713'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:58.275851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c07bb9ad-4f27-4911-b61c-b8dbc74c1874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eba2ac21c344394a7d3f605775b8713'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:58.278289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c07bb9ad-4f27-4911-b61c-b8dbc74c1874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eba2ac21c344394a7d3f605775b8713'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:58.287853 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1468/2968] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:14:57 2022] DELETE /identity/v3/users/2eba2ac21c344394a7d3f605775b8713 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:58.289374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bb9ad-4f27-4911-b61c-b8dbc74c1874 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:58.292292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3a8ea-5f58-481b-96e3-ce858751f4bc None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:58.300794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c07bb9ad-4f27-4911-b61c-b8dbc74c1874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:58.442960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d43914-1ad3-4478-857f-cd104a8937f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:58.444278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d43914-1ad3-4478-857f-cd104a8937f9 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:58.446658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d43914-1ad3-4478-857f-cd104a8937f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:58.447310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d43914-1ad3-4478-857f-cd104a8937f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:58.448322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d43914-1ad3-4478-857f-cd104a8937f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:58.457057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d43914-1ad3-4478-857f-cd104a8937f9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:58.483414 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1501/2969] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:14:58.487572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d43914-1ad3-4478-857f-cd104a8937f9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:58.491425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-50d43914-1ad3-4478-857f-cd104a8937f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:58.526415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d43914-1ad3-4478-857f-cd104a8937f9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:58.538470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bb9ad-4f27-4911-b61c-b8dbc74c1874 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:58.549603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f5e3e-efdb-4882-a778-de3a72c7b26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:58.550659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f5e3e-efdb-4882-a778-de3a72c7b26c admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:58.551042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f5e3e-efdb-4882-a778-de3a72c7b26c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:58.551859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f5e3e-efdb-4882-a778-de3a72c7b26c admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:58.554441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f5e3e-efdb-4882-a778-de3a72c7b26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:58.556013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1e46e-bf6b-4d1c-adba-44325da6a855 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:58.556899 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1e46e-bf6b-4d1c-adba-44325da6a855 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:58.557347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1e46e-bf6b-4d1c-adba-44325da6a855 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:58.557783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1e46e-bf6b-4d1c-adba-44325da6a855 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:58.557923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f5e3e-efdb-4882-a778-de3a72c7b26c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:58.560779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9ba1e46e-bf6b-4d1c-adba-44325da6a855 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:58.586046 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1502/2970] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:14:58.590180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f5e3e-efdb-4882-a778-de3a72c7b26c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:58.615129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f5e3e-efdb-4882-a778-de3a72c7b26c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:58.630757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5e28f-bd54-4683-913e-87563bfb3f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:58.631737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5e28f-bd54-4683-913e-87563bfb3f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:58.632019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5e28f-bd54-4683-913e-87563bfb3f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:58.632327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5e28f-bd54-4683-913e-87563bfb3f87 admin admin] PATH_INFO: `/v3/projects/bf3b90d53acb44479975ab2f5217d5a6/users/730f67eb5f1f41e9ab9da831340f4f49/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:58.659673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5e28f-bd54-4683-913e-87563bfb3f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf3b90d53acb44479975ab2f5217d5a6, user_id=730f67eb5f1f41e9ab9da831340f4f49, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:58.663585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5e28f-bd54-4683-913e-87563bfb3f87 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:58.674038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1e46e-bf6b-4d1c-adba-44325da6a855 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:58.676404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1e46e-bf6b-4d1c-adba-44325da6a855 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:58.689482 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1469/2971] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:14:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:14:58.690853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689306b2-65f8-4a89-9889-48e531edbf30 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:58.691261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689306b2-65f8-4a89-9889-48e531edbf30 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:58.692572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689306b2-65f8-4a89-9889-48e531edbf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:58.715914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-689306b2-65f8-4a89-9889-48e531edbf30 None None] MFA Rules not processed for user `4e9df82f95ac4779859972403869096a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:58.717365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-689306b2-65f8-4a89-9889-48e531edbf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:58.759687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:58.766877 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1503/2972] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:14:58 2022] PUT /identity/v3/projects/bf3b90d53acb44479975ab2f5217d5a6/users/730f67eb5f1f41e9ab9da831340f4f49/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:58.778235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadfd94-afa7-4c9f-b888-0fa496ebe8df None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:58.779103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadfd94-afa7-4c9f-b888-0fa496ebe8df None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:58.779452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadfd94-afa7-4c9f-b888-0fa496ebe8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:58.858253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7dadfd94-afa7-4c9f-b888-0fa496ebe8df None None] MFA Rules not processed for user `730f67eb5f1f41e9ab9da831340f4f49`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:58.863180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7dadfd94-afa7-4c9f-b888-0fa496ebe8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:58.901421 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1470/2973] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:58.965341 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1504/2974] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:59.191557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689306b2-65f8-4a89-9889-48e531edbf30 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:59.194932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-689306b2-65f8-4a89-9889-48e531edbf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:59.236614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689306b2-65f8-4a89-9889-48e531edbf30 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:59.326849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb3f89-8c1c-4314-b572-9244d0457bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:59.328642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb3f89-8c1c-4314-b572-9244d0457bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:59.328928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb3f89-8c1c-4314-b572-9244d0457bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:59.329205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb3f89-8c1c-4314-b572-9244d0457bc8 admin admin] PATH_INFO: `/v3/projects/6c2095f96f8d45bb9e62c517678c3dcd` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:59.330833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb3f89-8c1c-4314-b572-9244d0457bc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c2095f96f8d45bb9e62c517678c3dcd)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:59.333688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb3f89-8c1c-4314-b572-9244d0457bc8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:59.345203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:14:59.469590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fefb3f89-8c1c-4314-b572-9244d0457bc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c2095f96f8d45bb9e62c517678c3dcd', 'request_id': 'req-fefb3f89-8c1c-4314-b572-9244d0457bc8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:59.479739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fefb3f89-8c1c-4314-b572-9244d0457bc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c2095f96f8d45bb9e62c517678c3dcd', 'request_id': 'req-fefb3f89-8c1c-4314-b572-9244d0457bc8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:59.495981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fefb3f89-8c1c-4314-b572-9244d0457bc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c2095f96f8d45bb9e62c517678c3dcd', 'request_id': 'req-fefb3f89-8c1c-4314-b572-9244d0457bc8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:59.639031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fefb3f89-8c1c-4314-b572-9244d0457bc8 admin admin] The token cache is being invalidate because project 6c2095f96f8d45bb9e62c517678c3dcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:14:59.639693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fefb3f89-8c1c-4314-b572-9244d0457bc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:59.640804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fefb3f89-8c1c-4314-b572-9244d0457bc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:14:59.644667 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1471/2975] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:14:59 2022] DELETE /identity/v3/projects/6c2095f96f8d45bb9e62c517678c3dcd => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:14:59.649524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8864089-512f-441a-ba29-58305e015c52 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:59.650113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8864089-512f-441a-ba29-58305e015c52 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:59.650597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8864089-512f-441a-ba29-58305e015c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:59.696159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a8864089-512f-441a-ba29-58305e015c52 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:59.698761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a8864089-512f-441a-ba29-58305e015c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:59.824037 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1505/2976] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:59.831830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9048e8b-f247-4f19-b4ce-3c6dfcf189f3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:59.833203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9048e8b-f247-4f19-b4ce-3c6dfcf189f3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:59.834250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9048e8b-f247-4f19-b4ce-3c6dfcf189f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:59.890831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d9048e8b-f247-4f19-b4ce-3c6dfcf189f3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:14:59.892113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d9048e8b-f247-4f19-b4ce-3c6dfcf189f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:14:59.909101 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1472/2977] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:14:59.914487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8864089-512f-441a-ba29-58305e015c52 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:14:59.929250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8864089-512f-441a-ba29-58305e015c52 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:14:59.943810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d97f4-7444-4ccd-a927-79beaf4c27b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:14:59.944959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d97f4-7444-4ccd-a927-79beaf4c27b8 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:14:59.945251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d97f4-7444-4ccd-a927-79beaf4c27b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:14:59.945528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d97f4-7444-4ccd-a927-79beaf4c27b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:14:59.946722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d97f4-7444-4ccd-a927-79beaf4c27b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:14:59.946976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d97f4-7444-4ccd-a927-79beaf4c27b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:14:59.949794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d97f4-7444-4ccd-a927-79beaf4c27b8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:14:59.980155 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1506/2978] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:14:59.986916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9048e8b-f247-4f19-b4ce-3c6dfcf189f3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:00.001162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9048e8b-f247-4f19-b4ce-3c6dfcf189f3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:00.008734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5520e1-20a9-4c06-a822-11d1891e09c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:00.009424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5520e1-20a9-4c06-a822-11d1891e09c7 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:00.009738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5520e1-20a9-4c06-a822-11d1891e09c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:00.012563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5520e1-20a9-4c06-a822-11d1891e09c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:00.015824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5520e1-20a9-4c06-a822-11d1891e09c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:00.019278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5520e1-20a9-4c06-a822-11d1891e09c7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:00.161944 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1473/2979] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:14:59 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:15:00.171229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d97f4-7444-4ccd-a927-79beaf4c27b8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:00.187074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d97f4-7444-4ccd-a927-79beaf4c27b8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:00.303286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7f445-56c5-472b-9f77-a47e522e8435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:00.304498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7f445-56c5-472b-9f77-a47e522e8435 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:00.304962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7f445-56c5-472b-9f77-a47e522e8435 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:00.305396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7f445-56c5-472b-9f77-a47e522e8435 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:00.306582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7f445-56c5-472b-9f77-a47e522e8435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:00.311914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7f445-56c5-472b-9f77-a47e522e8435 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:00.322956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751214fb-6ca8-4e92-a419-47cca9f97395 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:00.325349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751214fb-6ca8-4e92-a419-47cca9f97395 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:00.327446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751214fb-6ca8-4e92-a419-47cca9f97395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:00.378103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-751214fb-6ca8-4e92-a419-47cca9f97395 None None] MFA Rules not processed for user `53af488f3b0242a797f539284b78d59e`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:00.380308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-751214fb-6ca8-4e92-a419-47cca9f97395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:00.461453 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1474/2980] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:00.521279 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1507/2981] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:15:00 2022] POST /identity/v3/users => generated 294 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:15:00.524926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751214fb-6ca8-4e92-a419-47cca9f97395 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:00.539400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7f445-56c5-472b-9f77-a47e522e8435 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:00.541483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-80c7f445-56c5-472b-9f77-a47e522e8435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:00.550260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751214fb-6ca8-4e92-a419-47cca9f97395 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:00.562927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c924d-4e8b-4e51-ad71-8eb4af5f2e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:00.564512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c924d-4e8b-4e51-ad71-8eb4af5f2e8c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:00.564909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c924d-4e8b-4e51-ad71-8eb4af5f2e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:00.565322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c924d-4e8b-4e51-ad71-8eb4af5f2e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:00.566965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c924d-4e8b-4e51-ad71-8eb4af5f2e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:00.569925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c924d-4e8b-4e51-ad71-8eb4af5f2e8c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:00.586308 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1475/2982] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:15:00.587941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c924d-4e8b-4e51-ad71-8eb4af5f2e8c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:00.603565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c924d-4e8b-4e51-ad71-8eb4af5f2e8c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:00.614709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed2a6c-87df-45eb-a3af-ff697ee90e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:00.616542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed2a6c-87df-45eb-a3af-ff697ee90e57 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:00.617290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed2a6c-87df-45eb-a3af-ff697ee90e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:00.617948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed2a6c-87df-45eb-a3af-ff697ee90e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:00.619697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed2a6c-87df-45eb-a3af-ff697ee90e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:00.624232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed2a6c-87df-45eb-a3af-ff697ee90e57 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:00.639058 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1476/2983] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:15:00.646458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed2a6c-87df-45eb-a3af-ff697ee90e57 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:00.665917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed2a6c-87df-45eb-a3af-ff697ee90e57 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:00.671177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016e3cc-d5fd-4ab2-ad6a-b690cde7c568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:00.672232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016e3cc-d5fd-4ab2-ad6a-b690cde7c568 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:00.682334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016e3cc-d5fd-4ab2-ad6a-b690cde7c568 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:00.682729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016e3cc-d5fd-4ab2-ad6a-b690cde7c568 admin admin] PATH_INFO: `/v3/projects/48a760c6b53c4c689351d149f359af09/users/8c8c4b59d1264f26ac123e54da950ad0/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:00.735368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7f445-56c5-472b-9f77-a47e522e8435 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:00.759501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016e3cc-d5fd-4ab2-ad6a-b690cde7c568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a760c6b53c4c689351d149f359af09, user_id=8c8c4b59d1264f26ac123e54da950ad0, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:00.770895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016e3cc-d5fd-4ab2-ad6a-b690cde7c568 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:00.773681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f927a-b3f2-4c79-ab15-7e66cd91028a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:00.775757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f927a-b3f2-4c79-ab15-7e66cd91028a service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:00.777214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f927a-b3f2-4c79-ab15-7e66cd91028a service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:00.778430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f927a-b3f2-4c79-ab15-7e66cd91028a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:00.786613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c63f927a-b3f2-4c79-ab15-7e66cd91028a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:00.923502 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1477/2984] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:15:00 2022] PUT /identity/v3/projects/48a760c6b53c4c689351d149f359af09/users/8c8c4b59d1264f26ac123e54da950ad0/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:15:00.928771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc8f3a-826e-4153-9d07-54235bafa897 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:00.929265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc8f3a-826e-4153-9d07-54235bafa897 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:00.929741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc8f3a-826e-4153-9d07-54235bafa897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:00.948043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:00.970699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f927a-b3f2-4c79-ab15-7e66cd91028a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:00.979821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f927a-b3f2-4c79-ab15-7e66cd91028a service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:01.011795 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1508/2985] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:01.013006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a4fc8f3a-826e-4153-9d07-54235bafa897 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:01.015632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a4fc8f3a-826e-4153-9d07-54235bafa897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:01.256274 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1478/2986] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:15:01.286254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f927a-b3f2-4c79-ab15-7e66cd91028a service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:01.291373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c63f927a-b3f2-4c79-ab15-7e66cd91028a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:01.408550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f927a-b3f2-4c79-ab15-7e66cd91028a service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:01.552992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5bbe6-c0b5-4bd4-a9b3-261cfaf8e750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:01.553697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5bbe6-c0b5-4bd4-a9b3-261cfaf8e750 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:01.553981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5bbe6-c0b5-4bd4-a9b3-261cfaf8e750 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:01.554260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5bbe6-c0b5-4bd4-a9b3-261cfaf8e750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:01.567860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5bbe6-c0b5-4bd4-a9b3-261cfaf8e750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:01.570204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5bbe6-c0b5-4bd4-a9b3-261cfaf8e750 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:01.584877 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1509/2987] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:01.592067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:01.627469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc2857-5fbf-47c0-b57a-e775eb4e0802 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:01.627758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc2857-5fbf-47c0-b57a-e775eb4e0802 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:01.628036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc2857-5fbf-47c0-b57a-e775eb4e0802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:01.660388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c7fc2857-5fbf-47c0-b57a-e775eb4e0802 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:01.663219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c7fc2857-5fbf-47c0-b57a-e775eb4e0802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:01.766928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:01.834974 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1479/2988] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:15:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:01.855943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5bbe6-c0b5-4bd4-a9b3-261cfaf8e750 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:01.857544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-aca5bbe6-c0b5-4bd4-a9b3-261cfaf8e750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:02.017753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5bbe6-c0b5-4bd4-a9b3-261cfaf8e750 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:02.023930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f6244-1bb6-4fd9-9708-fac4916d0382 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:02.024734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f6244-1bb6-4fd9-9708-fac4916d0382 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:02.025122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f6244-1bb6-4fd9-9708-fac4916d0382 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:02.025656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f6244-1bb6-4fd9-9708-fac4916d0382 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:02.044610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f6244-1bb6-4fd9-9708-fac4916d0382 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:02.053116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f6244-1bb6-4fd9-9708-fac4916d0382 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:02.083679 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1510/2989] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:15:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:15:02.850673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a20d8-3b75-4221-bafa-075721053c1b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:02.851422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a20d8-3b75-4221-bafa-075721053c1b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:02.851422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a20d8-3b75-4221-bafa-075721053c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:02.889497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-074a20d8-3b75-4221-bafa-075721053c1b None None] MFA Rules not processed for user `730f67eb5f1f41e9ab9da831340f4f49`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:02.890844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-074a20d8-3b75-4221-bafa-075721053c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:03.142129 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1480/2990] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:04.407767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:04.598516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:05.289873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cc7e9-369f-42e4-93a4-7bb984a1a904 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:05.291954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cc7e9-369f-42e4-93a4-7bb984a1a904 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:05.291954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cc7e9-369f-42e4-93a4-7bb984a1a904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:05.327975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2d9cc7e9-369f-42e4-93a4-7bb984a1a904 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:05.329205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2d9cc7e9-369f-42e4-93a4-7bb984a1a904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:05.340839 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1511/2991] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:15:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:05.357679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a20d8-3b75-4221-bafa-075721053c1b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:05.400440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a20d8-3b75-4221-bafa-075721053c1b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:05.435871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be537beb-7c85-43c0-90a8-d3b7a8447317 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:05.437682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be537beb-7c85-43c0-90a8-d3b7a8447317 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:05.438227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be537beb-7c85-43c0-90a8-d3b7a8447317 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:05.438516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be537beb-7c85-43c0-90a8-d3b7a8447317 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:05.456551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be537beb-7c85-43c0-90a8-d3b7a8447317 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:05.463870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be537beb-7c85-43c0-90a8-d3b7a8447317 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:05.518042 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1481/2992] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:15:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:15:06.303679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cc7e9-369f-42e4-93a4-7bb984a1a904 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:06.305828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2d9cc7e9-369f-42e4-93a4-7bb984a1a904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:06.339806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cc7e9-369f-42e4-93a4-7bb984a1a904 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:06.363198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7802a44-99e5-4dcb-ba38-ef8d8d7d2746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:06.366471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7802a44-99e5-4dcb-ba38-ef8d8d7d2746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:06.366471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7802a44-99e5-4dcb-ba38-ef8d8d7d2746 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:06.366471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7802a44-99e5-4dcb-ba38-ef8d8d7d2746 admin admin] PATH_INFO: `/v3/users/730f67eb5f1f41e9ab9da831340f4f49` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:06.367114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7802a44-99e5-4dcb-ba38-ef8d8d7d2746 admin admin] RBAC: Authorizing `identity:delete_user(user_id=730f67eb5f1f41e9ab9da831340f4f49)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:06.383457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7802a44-99e5-4dcb-ba38-ef8d8d7d2746 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:06.670202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c7802a44-99e5-4dcb-ba38-ef8d8d7d2746 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '730f67eb5f1f41e9ab9da831340f4f49'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:06.683561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c7802a44-99e5-4dcb-ba38-ef8d8d7d2746 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '730f67eb5f1f41e9ab9da831340f4f49'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:06.765366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c7802a44-99e5-4dcb-ba38-ef8d8d7d2746 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '730f67eb5f1f41e9ab9da831340f4f49'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:06.765366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c7802a44-99e5-4dcb-ba38-ef8d8d7d2746 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '730f67eb5f1f41e9ab9da831340f4f49'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:06.786746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c7802a44-99e5-4dcb-ba38-ef8d8d7d2746 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '730f67eb5f1f41e9ab9da831340f4f49'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:06.808650 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1512/2993] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:15:06 2022] DELETE /identity/v3/users/730f67eb5f1f41e9ab9da831340f4f49 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:15:06.813189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44724e56-01e1-4014-acdc-1d3d7fbc9362 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:06.814221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44724e56-01e1-4014-acdc-1d3d7fbc9362 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:06.814749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44724e56-01e1-4014-acdc-1d3d7fbc9362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:06.874225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-44724e56-01e1-4014-acdc-1d3d7fbc9362 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:06.878772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-44724e56-01e1-4014-acdc-1d3d7fbc9362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:06.954948 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1482/2994] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:07.074603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7802a44-99e5-4dcb-ba38-ef8d8d7d2746 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:07.076588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c7802a44-99e5-4dcb-ba38-ef8d8d7d2746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:07.207917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7802a44-99e5-4dcb-ba38-ef8d8d7d2746 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:07.214859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bb8df-d243-454d-b7d6-84a23a76e2a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:07.217230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bb8df-d243-454d-b7d6-84a23a76e2a8 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:07.218058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bb8df-d243-454d-b7d6-84a23a76e2a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:07.218851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bb8df-d243-454d-b7d6-84a23a76e2a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:07.235977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520bb8df-d243-454d-b7d6-84a23a76e2a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:07.239817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520bb8df-d243-454d-b7d6-84a23a76e2a8 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:07.263230 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1513/2995] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:07.504828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:08.314115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:09.295814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44724e56-01e1-4014-acdc-1d3d7fbc9362 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:09.303206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-44724e56-01e1-4014-acdc-1d3d7fbc9362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:09.347446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44724e56-01e1-4014-acdc-1d3d7fbc9362 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:09.355952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c55728-b19c-4520-a537-a2c1811c01a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:09.357288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c55728-b19c-4520-a537-a2c1811c01a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:09.357932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c55728-b19c-4520-a537-a2c1811c01a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:09.365481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c55728-b19c-4520-a537-a2c1811c01a7 admin admin] PATH_INFO: `/v3/projects/bf3b90d53acb44479975ab2f5217d5a6` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:09.367192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c55728-b19c-4520-a537-a2c1811c01a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf3b90d53acb44479975ab2f5217d5a6)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:09.369648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c55728-b19c-4520-a537-a2c1811c01a7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:09.530876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-71c55728-b19c-4520-a537-a2c1811c01a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf3b90d53acb44479975ab2f5217d5a6', 'request_id': 'req-71c55728-b19c-4520-a537-a2c1811c01a7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:09.544866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-71c55728-b19c-4520-a537-a2c1811c01a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf3b90d53acb44479975ab2f5217d5a6', 'request_id': 'req-71c55728-b19c-4520-a537-a2c1811c01a7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:09.554350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-71c55728-b19c-4520-a537-a2c1811c01a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf3b90d53acb44479975ab2f5217d5a6', 'request_id': 'req-71c55728-b19c-4520-a537-a2c1811c01a7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:09.577605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:09.676942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-71c55728-b19c-4520-a537-a2c1811c01a7 admin admin] The token cache is being invalidate because project bf3b90d53acb44479975ab2f5217d5a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:15:09.679711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-71c55728-b19c-4520-a537-a2c1811c01a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:09.680730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-71c55728-b19c-4520-a537-a2c1811c01a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:09.683116 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1483/2996] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:15:09 2022] DELETE /identity/v3/projects/bf3b90d53acb44479975ab2f5217d5a6 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:15:09.688050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6638b4-1002-41ed-826c-40d98cccb5b6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:09.688374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6638b4-1002-41ed-826c-40d98cccb5b6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:09.688621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6638b4-1002-41ed-826c-40d98cccb5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:09.715065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-cb6638b4-1002-41ed-826c-40d98cccb5b6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:09.717273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cb6638b4-1002-41ed-826c-40d98cccb5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:09.855825 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1514/2997] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:09.870773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e73dba-e9ce-4fd5-938d-a33438383d74 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:09.870773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e73dba-e9ce-4fd5-938d-a33438383d74 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:09.870773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e73dba-e9ce-4fd5-938d-a33438383d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:09.924484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-07e73dba-e9ce-4fd5-938d-a33438383d74 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:09.926803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-07e73dba-e9ce-4fd5-938d-a33438383d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:09.959203 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1484/2998] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:09.964791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6638b4-1002-41ed-826c-40d98cccb5b6 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:09.979286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6638b4-1002-41ed-826c-40d98cccb5b6 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:10.189773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a59df-c5a4-437b-b313-a79f85beb42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:10.189773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a59df-c5a4-437b-b313-a79f85beb42b admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:10.189773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a59df-c5a4-437b-b313-a79f85beb42b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:10.189773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a59df-c5a4-437b-b313-a79f85beb42b admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:10.194821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a59df-c5a4-437b-b313-a79f85beb42b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:15:10.194821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a59df-c5a4-437b-b313-a79f85beb42b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:10.194821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a59df-c5a4-437b-b313-a79f85beb42b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:10.194821 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1515/2999] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:15:10.197089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e73dba-e9ce-4fd5-938d-a33438383d74 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:10.206551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e73dba-e9ce-4fd5-938d-a33438383d74 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:10.224801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6ab1f-5ea0-4a61-8f97-400b59eecfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:10.233205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6ab1f-5ea0-4a61-8f97-400b59eecfde admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:10.233205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6ab1f-5ea0-4a61-8f97-400b59eecfde admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:10.233205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6ab1f-5ea0-4a61-8f97-400b59eecfde admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:10.233205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6ab1f-5ea0-4a61-8f97-400b59eecfde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:10.233205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6ab1f-5ea0-4a61-8f97-400b59eecfde admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:10.640617 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1485/3000] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:15:10 2022] POST /identity/v3/projects => generated 365 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:15:10.644974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a59df-c5a4-437b-b313-a79f85beb42b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:10.656194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a59df-c5a4-437b-b313-a79f85beb42b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:10.741949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6ab1f-5ea0-4a61-8f97-400b59eecfde admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:10.742699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-81a6ab1f-5ea0-4a61-8f97-400b59eecfde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:10.802044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ceb52-6739-4076-abe1-e5138a566c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:10.802729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ceb52-6739-4076-abe1-e5138a566c24 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:10.803059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ceb52-6739-4076-abe1-e5138a566c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:10.803308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ceb52-6739-4076-abe1-e5138a566c24 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:10.804012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ceb52-6739-4076-abe1-e5138a566c24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:10.805990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ceb52-6739-4076-abe1-e5138a566c24 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:10.884390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6ab1f-5ea0-4a61-8f97-400b59eecfde admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:10.897359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ed414-1ee1-46c0-b8df-a1f4e8bc22d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:10.898435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ed414-1ee1-46c0-b8df-a1f4e8bc22d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:10.899074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ed414-1ee1-46c0-b8df-a1f4e8bc22d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:10.899456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ed414-1ee1-46c0-b8df-a1f4e8bc22d2 admin admin] PATH_INFO: `/v3/users/94649762be79464785b4412c9b9a61fa` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:10.901134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ed414-1ee1-46c0-b8df-a1f4e8bc22d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94649762be79464785b4412c9b9a61fa)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:10.904179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ed414-1ee1-46c0-b8df-a1f4e8bc22d2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:10.945332 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1516/3001] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:15:10 2022] POST /identity/v3/users => generated 283 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:15:10.952740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ceb52-6739-4076-abe1-e5138a566c24 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:10.975555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ceb52-6739-4076-abe1-e5138a566c24 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:10.990944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4facbc-15dd-452d-ab4e-4f49631cdf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:10.992031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4facbc-15dd-452d-ab4e-4f49631cdf02 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:10.992805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4facbc-15dd-452d-ab4e-4f49631cdf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:10.993375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4facbc-15dd-452d-ab4e-4f49631cdf02 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:10.994415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4facbc-15dd-452d-ab4e-4f49631cdf02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:10.996453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4facbc-15dd-452d-ab4e-4f49631cdf02 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:11.026105 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1517/3002] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:15:11.027410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4facbc-15dd-452d-ab4e-4f49631cdf02 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:11.054915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4facbc-15dd-452d-ab4e-4f49631cdf02 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:11.068904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8dd19-53b4-4b62-93ee-46902bb87e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:11.069759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8dd19-53b4-4b62-93ee-46902bb87e33 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:11.070142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8dd19-53b4-4b62-93ee-46902bb87e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:11.070524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8dd19-53b4-4b62-93ee-46902bb87e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:11.071388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8dd19-53b4-4b62-93ee-46902bb87e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:11.073140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8dd19-53b4-4b62-93ee-46902bb87e33 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:11.098903 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1518/3003] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:15:11.103264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8dd19-53b4-4b62-93ee-46902bb87e33 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:11.133167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8dd19-53b4-4b62-93ee-46902bb87e33 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:11.141938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b9a8b-4083-4a88-98c6-b53a071247fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:11.143639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b9a8b-4083-4a88-98c6-b53a071247fe admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:11.144463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b9a8b-4083-4a88-98c6-b53a071247fe admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:11.145778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b9a8b-4083-4a88-98c6-b53a071247fe admin admin] PATH_INFO: `/v3/projects/24c64db8082648c8837c16352252f96d/users/daf3c9e6634e4ae1bfb492eae1f44c93/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:11.189475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b9a8b-4083-4a88-98c6-b53a071247fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=24c64db8082648c8837c16352252f96d, user_id=daf3c9e6634e4ae1bfb492eae1f44c93, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:11.198025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b9a8b-4083-4a88-98c6-b53a071247fe admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:11.305181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-084ed414-1ee1-46c0-b8df-a1f4e8bc22d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94649762be79464785b4412c9b9a61fa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:11.309789 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1519/3004] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:15:11 2022] PUT /identity/v3/projects/24c64db8082648c8837c16352252f96d/users/daf3c9e6634e4ae1bfb492eae1f44c93/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:15:11.311521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a263c4f-04ab-4d37-a82a-bb660aa8d839 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:11.312034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a263c4f-04ab-4d37-a82a-bb660aa8d839 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:11.312553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a263c4f-04ab-4d37-a82a-bb660aa8d839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:11.326738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-084ed414-1ee1-46c0-b8df-a1f4e8bc22d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94649762be79464785b4412c9b9a61fa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:11.350147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2a263c4f-04ab-4d37-a82a-bb660aa8d839 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:11.351730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2a263c4f-04ab-4d37-a82a-bb660aa8d839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:11.441613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-084ed414-1ee1-46c0-b8df-a1f4e8bc22d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94649762be79464785b4412c9b9a61fa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:11.463669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-084ed414-1ee1-46c0-b8df-a1f4e8bc22d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94649762be79464785b4412c9b9a61fa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:11.464600 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1520/3005] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:15:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:11.465379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-084ed414-1ee1-46c0-b8df-a1f4e8bc22d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94649762be79464785b4412c9b9a61fa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:11.466442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38af13-c8e5-40ab-9c30-65d7377c2b9f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:11.468517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38af13-c8e5-40ab-9c30-65d7377c2b9f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:11.469823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38af13-c8e5-40ab-9c30-65d7377c2b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:11.487998 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1486/3006] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:15:10 2022] DELETE /identity/v3/users/94649762be79464785b4412c9b9a61fa => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:15:11.493893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ed414-1ee1-46c0-b8df-a1f4e8bc22d2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:11.495798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-084ed414-1ee1-46c0-b8df-a1f4e8bc22d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:11.503131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4c38af13-c8e5-40ab-9c30-65d7377c2b9f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:11.506748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4c38af13-c8e5-40ab-9c30-65d7377c2b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:11.675298 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1521/3007] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:11.716820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ed414-1ee1-46c0-b8df-a1f4e8bc22d2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:11.722306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e66d5-fc79-4672-9b50-7aeba0631e57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:11.723313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e66d5-fc79-4672-9b50-7aeba0631e57 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:11.724073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e66d5-fc79-4672-9b50-7aeba0631e57 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:11.724545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e66d5-fc79-4672-9b50-7aeba0631e57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:11.727170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0d0e66d5-fc79-4672-9b50-7aeba0631e57 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:11.819400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e66d5-fc79-4672-9b50-7aeba0631e57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:11.821244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e66d5-fc79-4672-9b50-7aeba0631e57 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:11.838622 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1487/3008] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:15:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:15:11.864408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38af13-c8e5-40ab-9c30-65d7377c2b9f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:11.866927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4c38af13-c8e5-40ab-9c30-65d7377c2b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:11.916041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:12.000548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38af13-c8e5-40ab-9c30-65d7377c2b9f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:12.005666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c9373-514f-4583-a0c8-8fc4eb9419ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:12.006379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c9373-514f-4583-a0c8-8fc4eb9419ff service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:12.006660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c9373-514f-4583-a0c8-8fc4eb9419ff service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:12.006933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c9373-514f-4583-a0c8-8fc4eb9419ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:12.019234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c9373-514f-4583-a0c8-8fc4eb9419ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:12.022394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c9373-514f-4583-a0c8-8fc4eb9419ff service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:12.041451 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1522/3009] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:12.264668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:12.405595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e66d5-fc79-4672-9b50-7aeba0631e57 service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:12.407169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0d0e66d5-fc79-4672-9b50-7aeba0631e57 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:12.442390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e66d5-fc79-4672-9b50-7aeba0631e57 service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:12.456293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db0f3e-f02d-4fc3-8ce0-57820b1e2c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:12.457257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db0f3e-f02d-4fc3-8ce0-57820b1e2c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:12.457740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db0f3e-f02d-4fc3-8ce0-57820b1e2c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:12.458177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db0f3e-f02d-4fc3-8ce0-57820b1e2c26 admin admin] PATH_INFO: `/v3/users/bd9e72b27f304a9383d7f3fdcd718972` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:12.459840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db0f3e-f02d-4fc3-8ce0-57820b1e2c26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd9e72b27f304a9383d7f3fdcd718972)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:12.463531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db0f3e-f02d-4fc3-8ce0-57820b1e2c26 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:12.658967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c9373-514f-4583-a0c8-8fc4eb9419ff service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:12.660322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-387c9373-514f-4583-a0c8-8fc4eb9419ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:12.674158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c9373-514f-4583-a0c8-8fc4eb9419ff service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:12.681093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd18d2-dc77-4225-9410-97178c6cccad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:12.682320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd18d2-dc77-4225-9410-97178c6cccad admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:12.682601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd18d2-dc77-4225-9410-97178c6cccad admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:12.683361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd18d2-dc77-4225-9410-97178c6cccad admin admin] PATH_INFO: `/v3/projects/31216bba3e1148f2b00f59a6913ce35b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:12.684943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd18d2-dc77-4225-9410-97178c6cccad admin admin] RBAC: Authorizing `identity:delete_project(project_id=31216bba3e1148f2b00f59a6913ce35b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:12.687517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd18d2-dc77-4225-9410-97178c6cccad admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:12.745176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-81db0f3e-f02d-4fc3-8ce0-57820b1e2c26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd9e72b27f304a9383d7f3fdcd718972'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:12.774368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-81db0f3e-f02d-4fc3-8ce0-57820b1e2c26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd9e72b27f304a9383d7f3fdcd718972'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:12.822721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bfbd18d2-dc77-4225-9410-97178c6cccad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31216bba3e1148f2b00f59a6913ce35b', 'request_id': 'req-bfbd18d2-dc77-4225-9410-97178c6cccad'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:12.833579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bfbd18d2-dc77-4225-9410-97178c6cccad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31216bba3e1148f2b00f59a6913ce35b', 'request_id': 'req-bfbd18d2-dc77-4225-9410-97178c6cccad'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:12.841014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bfbd18d2-dc77-4225-9410-97178c6cccad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31216bba3e1148f2b00f59a6913ce35b', 'request_id': 'req-bfbd18d2-dc77-4225-9410-97178c6cccad'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:12.898567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-81db0f3e-f02d-4fc3-8ce0-57820b1e2c26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd9e72b27f304a9383d7f3fdcd718972'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:12.921978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-81db0f3e-f02d-4fc3-8ce0-57820b1e2c26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd9e72b27f304a9383d7f3fdcd718972'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:12.923362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-81db0f3e-f02d-4fc3-8ce0-57820b1e2c26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd9e72b27f304a9383d7f3fdcd718972'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:12.938967 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1488/3010] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:15:12 2022] DELETE /identity/v3/users/bd9e72b27f304a9383d7f3fdcd718972 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:15:12.958004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48b607-80bd-4f45-a020-475756d61fd3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:12.958823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48b607-80bd-4f45-a020-475756d61fd3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:12.959300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48b607-80bd-4f45-a020-475756d61fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:12.985898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7d48b607-80bd-4f45-a020-475756d61fd3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:12.987270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7d48b607-80bd-4f45-a020-475756d61fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:13.025443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bfbd18d2-dc77-4225-9410-97178c6cccad admin admin] The token cache is being invalidate because project 31216bba3e1148f2b00f59a6913ce35b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:15:13.026114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bfbd18d2-dc77-4225-9410-97178c6cccad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:13.027229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bfbd18d2-dc77-4225-9410-97178c6cccad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:13.029567 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1523/3011] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:15:12 2022] DELETE /identity/v3/projects/31216bba3e1148f2b00f59a6913ce35b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:15:13.035693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549b641-64c6-46c8-8352-3dac8767e905 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:13.044090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549b641-64c6-46c8-8352-3dac8767e905 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:13.044867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549b641-64c6-46c8-8352-3dac8767e905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:13.086818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4549b641-64c6-46c8-8352-3dac8767e905 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:13.088163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4549b641-64c6-46c8-8352-3dac8767e905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:13.138898 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1489/3012] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:13.165890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48b607-80bd-4f45-a020-475756d61fd3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:13.167844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7d48b607-80bd-4f45-a020-475756d61fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:13.294050 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1524/3013] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:15:13.296314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bece1ee-29a6-46ae-ab95-6f7d388c9d4e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:13.298214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bece1ee-29a6-46ae-ab95-6f7d388c9d4e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:13.300177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bece1ee-29a6-46ae-ab95-6f7d388c9d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:13.360372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1bece1ee-29a6-46ae-ab95-6f7d388c9d4e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:13.362032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1bece1ee-29a6-46ae-ab95-6f7d388c9d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:13.394347 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1525/3014] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:13.396191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bece1ee-29a6-46ae-ab95-6f7d388c9d4e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:13.412729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48b607-80bd-4f45-a020-475756d61fd3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:13.416798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bece1ee-29a6-46ae-ab95-6f7d388c9d4e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:13.425337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fdea5-2167-483d-9de8-abe1806aab48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:13.426510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5f953-8b76-49ca-8519-a40f74bf4a80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:13.426891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fdea5-2167-483d-9de8-abe1806aab48 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:13.427290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fdea5-2167-483d-9de8-abe1806aab48 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:13.427661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fdea5-2167-483d-9de8-abe1806aab48 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:13.428504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fdea5-2167-483d-9de8-abe1806aab48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:15:13.428905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5f953-8b76-49ca-8519-a40f74bf4a80 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:13.429313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fdea5-2167-483d-9de8-abe1806aab48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:13.431266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5f953-8b76-49ca-8519-a40f74bf4a80 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:13.431696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5f953-8b76-49ca-8519-a40f74bf4a80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:13.433161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fdea5-2167-483d-9de8-abe1806aab48 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:13.461705 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1526/3015] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:15:13.466653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fdea5-2167-483d-9de8-abe1806aab48 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:13.480141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5f953-8b76-49ca-8519-a40f74bf4a80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:13.483216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5f953-8b76-49ca-8519-a40f74bf4a80 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:13.485894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fdea5-2167-483d-9de8-abe1806aab48 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:13.493494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7ffcf-bfe6-4659-aa47-44b841a37520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:13.500938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7ffcf-bfe6-4659-aa47-44b841a37520 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:13.500938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7ffcf-bfe6-4659-aa47-44b841a37520 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:13.500938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7ffcf-bfe6-4659-aa47-44b841a37520 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:13.500938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7ffcf-bfe6-4659-aa47-44b841a37520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:13.500938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7ffcf-bfe6-4659-aa47-44b841a37520 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:13.515978 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1490/3016] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:13.621584 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1527/3017] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:15:13 2022] POST /identity/v3/projects => generated 391 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:15:13.625725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5f953-8b76-49ca-8519-a40f74bf4a80 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:13.642231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5f953-8b76-49ca-8519-a40f74bf4a80 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:13.826139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca72da-30d4-4921-9067-01a5508f7e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:13.828473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca72da-30d4-4921-9067-01a5508f7e4e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:13.828959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca72da-30d4-4921-9067-01a5508f7e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:13.829479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca72da-30d4-4921-9067-01a5508f7e4e admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:13.830795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca72da-30d4-4921-9067-01a5508f7e4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:13.835245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca72da-30d4-4921-9067-01a5508f7e4e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:13.968216 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1491/3018] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:15:13 2022] POST /identity/v3/users => generated 296 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:15:13.971591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7ffcf-bfe6-4659-aa47-44b841a37520 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:13.991849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7ffcf-bfe6-4659-aa47-44b841a37520 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:14.006662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3afc06-a018-4933-b1dd-731795eba457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:14.007526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3afc06-a018-4933-b1dd-731795eba457 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:14.007881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3afc06-a018-4933-b1dd-731795eba457 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:14.008399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3afc06-a018-4933-b1dd-731795eba457 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:14.009211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3afc06-a018-4933-b1dd-731795eba457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:14.020491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3afc06-a018-4933-b1dd-731795eba457 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:14.042024 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1528/3019] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:15:14.046158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca72da-30d4-4921-9067-01a5508f7e4e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:14.074653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca72da-30d4-4921-9067-01a5508f7e4e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:14.087887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f497a3-28cf-41e3-bda9-6b85f9bde11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:14.089451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f497a3-28cf-41e3-bda9-6b85f9bde11d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:14.089451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f497a3-28cf-41e3-bda9-6b85f9bde11d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:14.090240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f497a3-28cf-41e3-bda9-6b85f9bde11d admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:14.091450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f497a3-28cf-41e3-bda9-6b85f9bde11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:14.093424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f497a3-28cf-41e3-bda9-6b85f9bde11d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:14.126930 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1492/3020] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:15:14.130830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3afc06-a018-4933-b1dd-731795eba457 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:14.153007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3afc06-a018-4933-b1dd-731795eba457 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:14.167819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a0509-e4fe-4f37-8bb2-a6ebc9bf461b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:14.169628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a0509-e4fe-4f37-8bb2-a6ebc9bf461b admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:14.170153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a0509-e4fe-4f37-8bb2-a6ebc9bf461b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:14.171254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a0509-e4fe-4f37-8bb2-a6ebc9bf461b admin admin] PATH_INFO: `/v3/projects/a01b0a9bea9f4e09bcebcb9bbc0e5678/users/cd263c351cf044fabf45e0f4f2c0ce98/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:14.200524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a0509-e4fe-4f37-8bb2-a6ebc9bf461b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a01b0a9bea9f4e09bcebcb9bbc0e5678, user_id=cd263c351cf044fabf45e0f4f2c0ce98, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:14.203763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a0509-e4fe-4f37-8bb2-a6ebc9bf461b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:14.206293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f497a3-28cf-41e3-bda9-6b85f9bde11d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:14.209566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-82f497a3-28cf-41e3-bda9-6b85f9bde11d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:14.335073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f497a3-28cf-41e3-bda9-6b85f9bde11d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:14.352315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e132b71-67e4-4956-b9ae-59d133b31c7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:14.352735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e132b71-67e4-4956-b9ae-59d133b31c7a service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:14.356551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e132b71-67e4-4956-b9ae-59d133b31c7a service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:14.357036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e132b71-67e4-4956-b9ae-59d133b31c7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:14.359259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0e132b71-67e4-4956-b9ae-59d133b31c7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:14.382247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e132b71-67e4-4956-b9ae-59d133b31c7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:14.383669 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1529/3021] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:15:14 2022] PUT /identity/v3/projects/a01b0a9bea9f4e09bcebcb9bbc0e5678/users/cd263c351cf044fabf45e0f4f2c0ce98/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:15:14.395582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e132b71-67e4-4956-b9ae-59d133b31c7a service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:14.398717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e52ae-63f4-41d0-9b44-f68511c6acf9 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:14.399062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e52ae-63f4-41d0-9b44-f68511c6acf9 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:14.399446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e52ae-63f4-41d0-9b44-f68511c6acf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:14.405012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:14.414777 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1493/3022] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:14.467252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:14.530656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-128e52ae-63f4-41d0-9b44-f68511c6acf9 None None] MFA Rules not processed for user `cd263c351cf044fabf45e0f4f2c0ce98`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:14.532933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-128e52ae-63f4-41d0-9b44-f68511c6acf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:14.719981 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1530/3023] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:15.003107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e132b71-67e4-4956-b9ae-59d133b31c7a service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:15.005296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0e132b71-67e4-4956-b9ae-59d133b31c7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:15.027461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e132b71-67e4-4956-b9ae-59d133b31c7a service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:15.157363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df003cce-11b0-4617-a930-e940bf3e82e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:15.158332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df003cce-11b0-4617-a930-e940bf3e82e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:15.158638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df003cce-11b0-4617-a930-e940bf3e82e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:15.159225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df003cce-11b0-4617-a930-e940bf3e82e9 admin admin] PATH_INFO: `/v3/projects/a30b6074cef24df6ba020b01fc85b3e3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:15.173846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df003cce-11b0-4617-a930-e940bf3e82e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a30b6074cef24df6ba020b01fc85b3e3)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:15.176668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df003cce-11b0-4617-a930-e940bf3e82e9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:15.331728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-df003cce-11b0-4617-a930-e940bf3e82e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a30b6074cef24df6ba020b01fc85b3e3', 'request_id': 'req-df003cce-11b0-4617-a930-e940bf3e82e9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:15.342252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-df003cce-11b0-4617-a930-e940bf3e82e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a30b6074cef24df6ba020b01fc85b3e3', 'request_id': 'req-df003cce-11b0-4617-a930-e940bf3e82e9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:15.350736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-df003cce-11b0-4617-a930-e940bf3e82e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a30b6074cef24df6ba020b01fc85b3e3', 'request_id': 'req-df003cce-11b0-4617-a930-e940bf3e82e9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:15.452618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-df003cce-11b0-4617-a930-e940bf3e82e9 admin admin] The token cache is being invalidate because project a30b6074cef24df6ba020b01fc85b3e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:15:15.453623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-df003cce-11b0-4617-a930-e940bf3e82e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:15.454549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-df003cce-11b0-4617-a930-e940bf3e82e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:15.458664 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1494/3024] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:15:15 2022] DELETE /identity/v3/projects/a30b6074cef24df6ba020b01fc85b3e3 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:15:15.463705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b758e-c906-4199-b6b4-8a6e7c79b0f2 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:15.464214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b758e-c906-4199-b6b4-8a6e7c79b0f2 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:15.464327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b758e-c906-4199-b6b4-8a6e7c79b0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:15.506404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-293b758e-c906-4199-b6b4-8a6e7c79b0f2 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:15.510765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-293b758e-c906-4199-b6b4-8a6e7c79b0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:15.554631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df003cce-11b0-4617-a930-e940bf3e82e9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:15.556307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-df003cce-11b0-4617-a930-e940bf3e82e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:15.641012 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1531/3025] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:15.649028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e8821-9a4e-439a-a47c-993a33739753 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:15.649596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e8821-9a4e-439a-a47c-993a33739753 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:15.649880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e8821-9a4e-439a-a47c-993a33739753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:15.697976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-339e8821-9a4e-439a-a47c-993a33739753 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:15.702272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-339e8821-9a4e-439a-a47c-993a33739753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:15.724611 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1532/3026] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:15:15.728919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e8821-9a4e-439a-a47c-993a33739753 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:15.757112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e8821-9a4e-439a-a47c-993a33739753 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:15.759631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df003cce-11b0-4617-a930-e940bf3e82e9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:15.765437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f38c9-578c-41db-8302-456b592b8a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:15.766138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f38c9-578c-41db-8302-456b592b8a45 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:15.766421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f38c9-578c-41db-8302-456b592b8a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:15.766695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f38c9-578c-41db-8302-456b592b8a45 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:15.767475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f38c9-578c-41db-8302-456b592b8a45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:15:15.767787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f38c9-578c-41db-8302-456b592b8a45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:15.770358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f38c9-578c-41db-8302-456b592b8a45 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:15.778257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ce75c-5b6b-4c63-be9a-ae9085ad8dbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:15.779070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ce75c-5b6b-4c63-be9a-ae9085ad8dbf service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:15.779070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ce75c-5b6b-4c63-be9a-ae9085ad8dbf service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:15.779464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ce75c-5b6b-4c63-be9a-ae9085ad8dbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:15.791183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-213ce75c-5b6b-4c63-be9a-ae9085ad8dbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:15.800346 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1533/3027] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:15:15.804415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f38c9-578c-41db-8302-456b592b8a45 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:15.820402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f38c9-578c-41db-8302-456b592b8a45 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:15.837282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5abbb-2c1e-4e22-8805-bebb1a84c128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:15.838262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5abbb-2c1e-4e22-8805-bebb1a84c128 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:15.838727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5abbb-2c1e-4e22-8805-bebb1a84c128 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:15.839193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5abbb-2c1e-4e22-8805-bebb1a84c128 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:15.840195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5abbb-2c1e-4e22-8805-bebb1a84c128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:15.842326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5abbb-2c1e-4e22-8805-bebb1a84c128 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:15.981441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ce75c-5b6b-4c63-be9a-ae9085ad8dbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:15.983144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ce75c-5b6b-4c63-be9a-ae9085ad8dbf service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:16.012558 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1495/3028] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:16.049415 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1534/3029] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:15:15 2022] POST /identity/v3/projects => generated 397 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:15:16.054813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ce75c-5b6b-4c63-be9a-ae9085ad8dbf service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:16.072329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ce75c-5b6b-4c63-be9a-ae9085ad8dbf service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:16.184383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7dbf70-3ef9-40ef-bb25-c776ac28c7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:16.185399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7dbf70-3ef9-40ef-bb25-c776ac28c7fc admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:16.185851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7dbf70-3ef9-40ef-bb25-c776ac28c7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:16.187485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7dbf70-3ef9-40ef-bb25-c776ac28c7fc admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:16.189139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7dbf70-3ef9-40ef-bb25-c776ac28c7fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:16.193699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7dbf70-3ef9-40ef-bb25-c776ac28c7fc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:16.225824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:16.303799 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1496/3030] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:15:16 2022] POST /identity/v3/users => generated 299 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:15:16.304856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5abbb-2c1e-4e22-8805-bebb1a84c128 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:16.344125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5abbb-2c1e-4e22-8805-bebb1a84c128 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:16.373795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca23caf-0e25-4996-8520-c175647d6bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:16.374896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca23caf-0e25-4996-8520-c175647d6bda admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:16.375482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca23caf-0e25-4996-8520-c175647d6bda admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:16.376133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca23caf-0e25-4996-8520-c175647d6bda admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:16.377162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca23caf-0e25-4996-8520-c175647d6bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:16.383301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca23caf-0e25-4996-8520-c175647d6bda admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:16.388325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:16.412251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7dbf70-3ef9-40ef-bb25-c776ac28c7fc admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:16.412484 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1535/3031] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:15:16.433685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7dbf70-3ef9-40ef-bb25-c776ac28c7fc admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:16.447890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae5af9-3606-40b7-91c8-30ebd47c4fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:16.449163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae5af9-3606-40b7-91c8-30ebd47c4fee admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:16.449607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae5af9-3606-40b7-91c8-30ebd47c4fee admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:16.450038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae5af9-3606-40b7-91c8-30ebd47c4fee admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:16.450993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae5af9-3606-40b7-91c8-30ebd47c4fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:16.464373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae5af9-3606-40b7-91c8-30ebd47c4fee admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:16.489658 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1497/3032] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:15:16.502469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca23caf-0e25-4996-8520-c175647d6bda admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:16.538491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca23caf-0e25-4996-8520-c175647d6bda admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:16.573548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600d02b-2112-41a9-ba9b-1bd732c354c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:16.583874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600d02b-2112-41a9-ba9b-1bd732c354c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:16.584999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600d02b-2112-41a9-ba9b-1bd732c354c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:16.588699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600d02b-2112-41a9-ba9b-1bd732c354c1 admin admin] PATH_INFO: `/v3/projects/160fd40061294ac49b70ecaba1be9432/users/bb2272990663498a8de9e5af940b0b54/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:16.698504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600d02b-2112-41a9-ba9b-1bd732c354c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=160fd40061294ac49b70ecaba1be9432, user_id=bb2272990663498a8de9e5af940b0b54, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:16.711842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600d02b-2112-41a9-ba9b-1bd732c354c1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:16.845811 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1536/3033] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:15:16 2022] PUT /identity/v3/projects/160fd40061294ac49b70ecaba1be9432/users/bb2272990663498a8de9e5af940b0b54/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:15:16.857680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b574f2-46b6-48b1-8c17-1fcb4de952fd None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:16.858029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b574f2-46b6-48b1-8c17-1fcb4de952fd None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:16.858317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b574f2-46b6-48b1-8c17-1fcb4de952fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:16.897728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d3b574f2-46b6-48b1-8c17-1fcb4de952fd None None] MFA Rules not processed for user `bb2272990663498a8de9e5af940b0b54`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:16.899120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d3b574f2-46b6-48b1-8c17-1fcb4de952fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:17.058879 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1498/3034] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:17.537374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600d02b-2112-41a9-ba9b-1bd732c354c1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:17.541107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7600d02b-2112-41a9-ba9b-1bd732c354c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:17.721789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600d02b-2112-41a9-ba9b-1bd732c354c1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:17.744545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372b707-b76f-47d2-a89e-2bda59b0ea61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:17.745275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372b707-b76f-47d2-a89e-2bda59b0ea61 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:17.745561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372b707-b76f-47d2-a89e-2bda59b0ea61 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:17.745841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372b707-b76f-47d2-a89e-2bda59b0ea61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:17.774954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372b707-b76f-47d2-a89e-2bda59b0ea61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:17.776864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372b707-b76f-47d2-a89e-2bda59b0ea61 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:17.797421 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1537/3035] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:17.922461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd61772-412b-47d6-8d6e-44325c23fe48 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:17.922762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd61772-412b-47d6-8d6e-44325c23fe48 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:17.926469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd61772-412b-47d6-8d6e-44325c23fe48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:17.966293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1bd61772-412b-47d6-8d6e-44325c23fe48 None None] MFA Rules not processed for user `bb2272990663498a8de9e5af940b0b54`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:17.967679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1bd61772-412b-47d6-8d6e-44325c23fe48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:17.978634 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1499/3036] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:18.016378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372b707-b76f-47d2-a89e-2bda59b0ea61 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:18.017887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0372b707-b76f-47d2-a89e-2bda59b0ea61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:18.147532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372b707-b76f-47d2-a89e-2bda59b0ea61 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:18.154952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7bedeb-e809-4219-b5e3-a06976cdfdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:18.156035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bedeb-e809-4219-b5e3-a06976cdfdf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:18.156416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bedeb-e809-4219-b5e3-a06976cdfdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:18.156792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bedeb-e809-4219-b5e3-a06976cdfdf6 admin admin] PATH_INFO: `/v3/users/cd263c351cf044fabf45e0f4f2c0ce98` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:18.158123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7bedeb-e809-4219-b5e3-a06976cdfdf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd263c351cf044fabf45e0f4f2c0ce98)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:18.161245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7bedeb-e809-4219-b5e3-a06976cdfdf6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:18.343577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5f7bedeb-e809-4219-b5e3-a06976cdfdf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd263c351cf044fabf45e0f4f2c0ce98'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:18.354719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5f7bedeb-e809-4219-b5e3-a06976cdfdf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd263c351cf044fabf45e0f4f2c0ce98'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:18.376698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00570159-4087-419b-ae56-c73636e38b57 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:18.377132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00570159-4087-419b-ae56-c73636e38b57 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:18.377248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00570159-4087-419b-ae56-c73636e38b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:18.468532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-00570159-4087-419b-ae56-c73636e38b57 None None] MFA Rules not processed for user `8c8c4b59d1264f26ac123e54da950ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:18.469770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-00570159-4087-419b-ae56-c73636e38b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:18.488773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5f7bedeb-e809-4219-b5e3-a06976cdfdf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd263c351cf044fabf45e0f4f2c0ce98'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:18.489956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5f7bedeb-e809-4219-b5e3-a06976cdfdf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd263c351cf044fabf45e0f4f2c0ce98'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:18.542312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5f7bedeb-e809-4219-b5e3-a06976cdfdf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd263c351cf044fabf45e0f4f2c0ce98'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:18.551688 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1538/3037] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:15:18 2022] DELETE /identity/v3/users/cd263c351cf044fabf45e0f4f2c0ce98 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:15:18.557769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500fdd6-7756-4d97-b88b-7817bc09e55a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:18.558302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500fdd6-7756-4d97-b88b-7817bc09e55a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:18.558746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500fdd6-7756-4d97-b88b-7817bc09e55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:18.613398 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7500fdd6-7756-4d97-b88b-7817bc09e55a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:18.614656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7500fdd6-7756-4d97-b88b-7817bc09e55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:18.645481 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1500/3038] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:18.704166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:18.732729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:18.753239 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1539/3039] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:18.761177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00570159-4087-419b-ae56-c73636e38b57 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:18.763900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-00570159-4087-419b-ae56-c73636e38b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:18.857872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00570159-4087-419b-ae56-c73636e38b57 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:18.953209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0621049-a01b-4eb2-a4d5-360fabee5ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:18.953965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0621049-a01b-4eb2-a4d5-360fabee5ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:18.954255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0621049-a01b-4eb2-a4d5-360fabee5ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:18.954533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0621049-a01b-4eb2-a4d5-360fabee5ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:18.970544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0621049-a01b-4eb2-a4d5-360fabee5ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:18.972124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0621049-a01b-4eb2-a4d5-360fabee5ef7 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:18.985935 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1501/3040] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:19.933839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500fdd6-7756-4d97-b88b-7817bc09e55a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:19.935468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7500fdd6-7756-4d97-b88b-7817bc09e55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:19.945148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:19.955105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0621049-a01b-4eb2-a4d5-360fabee5ef7 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:19.955105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f0621049-a01b-4eb2-a4d5-360fabee5ef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:19.962896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500fdd6-7756-4d97-b88b-7817bc09e55a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:19.971602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0621049-a01b-4eb2-a4d5-360fabee5ef7 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:19.985424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11358132-d1cb-49db-be0a-28850445c781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:19.986310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11358132-d1cb-49db-be0a-28850445c781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:19.986592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11358132-d1cb-49db-be0a-28850445c781 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:19.986867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11358132-d1cb-49db-be0a-28850445c781 admin admin] PATH_INFO: `/v3/users/bb2272990663498a8de9e5af940b0b54` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:19.988318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2155d8-ebf4-47ca-9e3f-57908784c5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:19.988653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11358132-d1cb-49db-be0a-28850445c781 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb2272990663498a8de9e5af940b0b54)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:19.989378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2155d8-ebf4-47ca-9e3f-57908784c5c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:19.989662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2155d8-ebf4-47ca-9e3f-57908784c5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:19.989943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2155d8-ebf4-47ca-9e3f-57908784c5c7 admin admin] PATH_INFO: `/v3/projects/a01b0a9bea9f4e09bcebcb9bbc0e5678` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:19.991373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11358132-d1cb-49db-be0a-28850445c781 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:20.008830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2155d8-ebf4-47ca-9e3f-57908784c5c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a01b0a9bea9f4e09bcebcb9bbc0e5678)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:20.011776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2155d8-ebf4-47ca-9e3f-57908784c5c7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:20.347780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-11358132-d1cb-49db-be0a-28850445c781 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb2272990663498a8de9e5af940b0b54'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:20.349108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5c2155d8-ebf4-47ca-9e3f-57908784c5c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a01b0a9bea9f4e09bcebcb9bbc0e5678', 'request_id': 'req-5c2155d8-ebf4-47ca-9e3f-57908784c5c7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:20.366703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5c2155d8-ebf4-47ca-9e3f-57908784c5c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a01b0a9bea9f4e09bcebcb9bbc0e5678', 'request_id': 'req-5c2155d8-ebf4-47ca-9e3f-57908784c5c7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:20.371329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-11358132-d1cb-49db-be0a-28850445c781 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb2272990663498a8de9e5af940b0b54'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:20.392684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5c2155d8-ebf4-47ca-9e3f-57908784c5c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a01b0a9bea9f4e09bcebcb9bbc0e5678', 'request_id': 'req-5c2155d8-ebf4-47ca-9e3f-57908784c5c7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:20.502635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:20.538615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-11358132-d1cb-49db-be0a-28850445c781 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb2272990663498a8de9e5af940b0b54'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:20.539481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-11358132-d1cb-49db-be0a-28850445c781 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb2272990663498a8de9e5af940b0b54'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:20.572590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-11358132-d1cb-49db-be0a-28850445c781 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb2272990663498a8de9e5af940b0b54'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:20.582788 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1540/3041] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:15:19 2022] DELETE /identity/v3/users/bb2272990663498a8de9e5af940b0b54 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:15:20.584366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11358132-d1cb-49db-be0a-28850445c781 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:20.609620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-11358132-d1cb-49db-be0a-28850445c781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:20.684978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5c2155d8-ebf4-47ca-9e3f-57908784c5c7 admin admin] The token cache is being invalidate because project a01b0a9bea9f4e09bcebcb9bbc0e5678 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:15:20.685648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5c2155d8-ebf4-47ca-9e3f-57908784c5c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:20.686828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5c2155d8-ebf4-47ca-9e3f-57908784c5c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:20.689674 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1502/3042] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:15:19 2022] DELETE /identity/v3/projects/a01b0a9bea9f4e09bcebcb9bbc0e5678 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:15:20.695389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34958ffb-75e4-4149-a930-d0f42698c9c7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:20.696161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34958ffb-75e4-4149-a930-d0f42698c9c7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:20.696807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34958ffb-75e4-4149-a930-d0f42698c9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:20.750232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-34958ffb-75e4-4149-a930-d0f42698c9c7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:20.757675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-34958ffb-75e4-4149-a930-d0f42698c9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:20.781757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11358132-d1cb-49db-be0a-28850445c781 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:20.794561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a84f8f-8ae8-4dfe-9d9f-8001d20c5b51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:20.797615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a84f8f-8ae8-4dfe-9d9f-8001d20c5b51 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:20.798753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a84f8f-8ae8-4dfe-9d9f-8001d20c5b51 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:20.800722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a84f8f-8ae8-4dfe-9d9f-8001d20c5b51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:20.809034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-40a84f8f-8ae8-4dfe-9d9f-8001d20c5b51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:20.926044 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1503/3043] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:20.929500 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dec6c-7e43-452f-9873-888347281c7c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:20.931690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dec6c-7e43-452f-9873-888347281c7c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:20.933171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dec6c-7e43-452f-9873-888347281c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:20.979439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-336dec6c-7e43-452f-9873-888347281c7c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:20.981924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-336dec6c-7e43-452f-9873-888347281c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:20.994936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a84f8f-8ae8-4dfe-9d9f-8001d20c5b51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:20.997574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a84f8f-8ae8-4dfe-9d9f-8001d20c5b51 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:21.000258 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1504/3044] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:21.009388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332a443-24d8-4f4a-a97f-f7c74f8893c0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:21.013758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332a443-24d8-4f4a-a97f-f7c74f8893c0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:21.013758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332a443-24d8-4f4a-a97f-f7c74f8893c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:21.043974 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1541/3045] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:21.045299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a84f8f-8ae8-4dfe-9d9f-8001d20c5b51 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:21.057654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-40a84f8f-8ae8-4dfe-9d9f-8001d20c5b51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:21.065445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4332a443-24d8-4f4a-a97f-f7c74f8893c0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:21.067662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4332a443-24d8-4f4a-a97f-f7c74f8893c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:21.096025 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1505/3046] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:21.098053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332a443-24d8-4f4a-a97f-f7c74f8893c0 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:21.124954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332a443-24d8-4f4a-a97f-f7c74f8893c0 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:21.145942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e45144-51da-4119-bb01-f7fa985d0c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:21.146639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e45144-51da-4119-bb01-f7fa985d0c90 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:21.146922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e45144-51da-4119-bb01-f7fa985d0c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:21.147227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e45144-51da-4119-bb01-f7fa985d0c90 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:21.148035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e45144-51da-4119-bb01-f7fa985d0c90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:15:21.148457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e45144-51da-4119-bb01-f7fa985d0c90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:21.150408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e45144-51da-4119-bb01-f7fa985d0c90 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:21.187023 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1506/3047] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:15:21.187978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e45144-51da-4119-bb01-f7fa985d0c90 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:21.213821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a84f8f-8ae8-4dfe-9d9f-8001d20c5b51 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:21.214065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e45144-51da-4119-bb01-f7fa985d0c90 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:21.222463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89d59f-a0ef-457b-9ede-2e02e25a1d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:21.223789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89d59f-a0ef-457b-9ede-2e02e25a1d96 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:21.224237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89d59f-a0ef-457b-9ede-2e02e25a1d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:21.224709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89d59f-a0ef-457b-9ede-2e02e25a1d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:21.230776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c94cb-c4ba-4e21-8e15-f88d3d1eb7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:21.231646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c94cb-c4ba-4e21-8e15-f88d3d1eb7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:21.232161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c94cb-c4ba-4e21-8e15-f88d3d1eb7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:21.232860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c94cb-c4ba-4e21-8e15-f88d3d1eb7e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:21.234004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c94cb-c4ba-4e21-8e15-f88d3d1eb7e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:21.236280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c94cb-c4ba-4e21-8e15-f88d3d1eb7e9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:21.247001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89d59f-a0ef-457b-9ede-2e02e25a1d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:21.249103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89d59f-a0ef-457b-9ede-2e02e25a1d96 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:21.283789 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1542/3048] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:21.387862 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1507/3049] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:15:21 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:15:21.388649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89d59f-a0ef-457b-9ede-2e02e25a1d96 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:21.423963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:21.435396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89d59f-a0ef-457b-9ede-2e02e25a1d96 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:21.552019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:21.576601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923548c-7769-4c7f-a9e1-404e185c7626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:21.577477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923548c-7769-4c7f-a9e1-404e185c7626 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:21.577951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923548c-7769-4c7f-a9e1-404e185c7626 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:21.578417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923548c-7769-4c7f-a9e1-404e185c7626 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:21.579309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d923548c-7769-4c7f-a9e1-404e185c7626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:21.584612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d923548c-7769-4c7f-a9e1-404e185c7626 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:21.696015 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1543/3050] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:15:21 2022] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:15:21.706123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c94cb-c4ba-4e21-8e15-f88d3d1eb7e9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:21.719675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c94cb-c4ba-4e21-8e15-f88d3d1eb7e9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:21.736227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d258d6-d11a-4ccd-87e9-da491927ea7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:21.739687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d258d6-d11a-4ccd-87e9-da491927ea7f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:21.745392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d258d6-d11a-4ccd-87e9-da491927ea7f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:21.746089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d258d6-d11a-4ccd-87e9-da491927ea7f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:21.748188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d258d6-d11a-4ccd-87e9-da491927ea7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:21.751154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d258d6-d11a-4ccd-87e9-da491927ea7f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:21.781824 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1508/3051] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:15:21.787525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923548c-7769-4c7f-a9e1-404e185c7626 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:21.802814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923548c-7769-4c7f-a9e1-404e185c7626 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:21.812985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48601d51-2fb7-4745-b49c-b524df33315b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:21.816289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48601d51-2fb7-4745-b49c-b524df33315b admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:21.816868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48601d51-2fb7-4745-b49c-b524df33315b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:21.817139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48601d51-2fb7-4745-b49c-b524df33315b admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:21.823394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48601d51-2fb7-4745-b49c-b524df33315b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:21.823773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48601d51-2fb7-4745-b49c-b524df33315b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:21.854143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d258d6-d11a-4ccd-87e9-da491927ea7f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:21.861226 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1544/3052] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:15:21.873718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d258d6-d11a-4ccd-87e9-da491927ea7f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:21.888362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f52ef-2b17-4ad0-bccb-641e65066f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:21.892080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f52ef-2b17-4ad0-bccb-641e65066f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:21.892503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f52ef-2b17-4ad0-bccb-641e65066f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:21.892911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f52ef-2b17-4ad0-bccb-641e65066f3b admin admin] PATH_INFO: `/v3/projects/71aa49f99a7647329b40abfd7e10a606/users/29baab42d8c64f5480701a768f793d5e/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:21.913236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f52ef-2b17-4ad0-bccb-641e65066f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=71aa49f99a7647329b40abfd7e10a606, user_id=29baab42d8c64f5480701a768f793d5e, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:21.918174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f52ef-2b17-4ad0-bccb-641e65066f3b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:22.095681 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1509/3053] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:15:21 2022] PUT /identity/v3/projects/71aa49f99a7647329b40abfd7e10a606/users/29baab42d8c64f5480701a768f793d5e/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:15:22.099378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd46df6-8f8b-436c-baf4-78fbed3cfa63 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:22.100270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd46df6-8f8b-436c-baf4-78fbed3cfa63 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:22.100717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd46df6-8f8b-436c-baf4-78fbed3cfa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:22.139667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2cd46df6-8f8b-436c-baf4-78fbed3cfa63 None None] MFA Rules not processed for user `29baab42d8c64f5480701a768f793d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:22.141198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2cd46df6-8f8b-436c-baf4-78fbed3cfa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:22.257206 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1545/3054] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:22.973490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:23.142491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:23.590460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:24.255185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f52ef-2b17-4ad0-bccb-641e65066f3b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:24.258003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9b8f52ef-2b17-4ad0-bccb-641e65066f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:24.294945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd46df6-8f8b-436c-baf4-78fbed3cfa63 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:24.294945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2cd46df6-8f8b-436c-baf4-78fbed3cfa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:24.339680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f52ef-2b17-4ad0-bccb-641e65066f3b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:24.347777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803eb6eb-06ff-439f-b2d3-a4ba4f41c400 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:24.349024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803eb6eb-06ff-439f-b2d3-a4ba4f41c400 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:24.349473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803eb6eb-06ff-439f-b2d3-a4ba4f41c400 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:24.349953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803eb6eb-06ff-439f-b2d3-a4ba4f41c400 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:24.360794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803eb6eb-06ff-439f-b2d3-a4ba4f41c400 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:24.363461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803eb6eb-06ff-439f-b2d3-a4ba4f41c400 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:24.390292 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1510/3055] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:24.433782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd46df6-8f8b-436c-baf4-78fbed3cfa63 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:24.442301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1bbe0-ce59-4e66-88bd-0c5c270dbd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:24.444258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1bbe0-ce59-4e66-88bd-0c5c270dbd0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:24.444548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1bbe0-ce59-4e66-88bd-0c5c270dbd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:24.444824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1bbe0-ce59-4e66-88bd-0c5c270dbd0e admin admin] PATH_INFO: `/v3/projects/160fd40061294ac49b70ecaba1be9432` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:24.451348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1bbe0-ce59-4e66-88bd-0c5c270dbd0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=160fd40061294ac49b70ecaba1be9432)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:24.453322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1bbe0-ce59-4e66-88bd-0c5c270dbd0e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:24.671701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4d1bbe0-ce59-4e66-88bd-0c5c270dbd0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '160fd40061294ac49b70ecaba1be9432', 'request_id': 'req-c4d1bbe0-ce59-4e66-88bd-0c5c270dbd0e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:24.685058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4d1bbe0-ce59-4e66-88bd-0c5c270dbd0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '160fd40061294ac49b70ecaba1be9432', 'request_id': 'req-c4d1bbe0-ce59-4e66-88bd-0c5c270dbd0e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:24.700982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4d1bbe0-ce59-4e66-88bd-0c5c270dbd0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '160fd40061294ac49b70ecaba1be9432', 'request_id': 'req-c4d1bbe0-ce59-4e66-88bd-0c5c270dbd0e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:24.801165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4d1bbe0-ce59-4e66-88bd-0c5c270dbd0e admin admin] The token cache is being invalidate because project 160fd40061294ac49b70ecaba1be9432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:15:24.801918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4d1bbe0-ce59-4e66-88bd-0c5c270dbd0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:24.802785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4d1bbe0-ce59-4e66-88bd-0c5c270dbd0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:24.808734 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1546/3056] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:15:24 2022] DELETE /identity/v3/projects/160fd40061294ac49b70ecaba1be9432 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:15:24.810320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bf464-c89d-4f35-9724-4793ce9e81bb None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:24.810824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bf464-c89d-4f35-9724-4793ce9e81bb None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:24.810926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bf464-c89d-4f35-9724-4793ce9e81bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:24.859166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b27bf464-c89d-4f35-9724-4793ce9e81bb None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:24.861101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b27bf464-c89d-4f35-9724-4793ce9e81bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:24.978992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:25.037430 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1511/3057] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:25.039508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b2dce-ec85-407b-a115-b23e26e89ee0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:25.050763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b2dce-ec85-407b-a115-b23e26e89ee0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:25.050763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b2dce-ec85-407b-a115-b23e26e89ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:25.079774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1c9b2dce-ec85-407b-a115-b23e26e89ee0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:25.081378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1c9b2dce-ec85-407b-a115-b23e26e89ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:25.122010 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1547/3058] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:25.126554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bf464-c89d-4f35-9724-4793ce9e81bb None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:25.144013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bf464-c89d-4f35-9724-4793ce9e81bb None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:25.161126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f72fb-fd43-4b24-a29e-bbe612eefde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:25.161887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f72fb-fd43-4b24-a29e-bbe612eefde6 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:25.162177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f72fb-fd43-4b24-a29e-bbe612eefde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:25.162463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f72fb-fd43-4b24-a29e-bbe612eefde6 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:25.164006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f72fb-fd43-4b24-a29e-bbe612eefde6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:15:25.164542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f72fb-fd43-4b24-a29e-bbe612eefde6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:25.170317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f72fb-fd43-4b24-a29e-bbe612eefde6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:25.198803 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1512/3059] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:15:25.211113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b2dce-ec85-407b-a115-b23e26e89ee0 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:25.226167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ae24b-2169-4a9e-b30e-d1e0315e6f9e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:25.226167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ae24b-2169-4a9e-b30e-d1e0315e6f9e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:25.226167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ae24b-2169-4a9e-b30e-d1e0315e6f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:25.226495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b2dce-ec85-407b-a115-b23e26e89ee0 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:25.236978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b997c-1a54-479d-857f-ddd9669910a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:25.238246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b997c-1a54-479d-857f-ddd9669910a1 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:25.238507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b997c-1a54-479d-857f-ddd9669910a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:25.238858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b997c-1a54-479d-857f-ddd9669910a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:25.239586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b997c-1a54-479d-857f-ddd9669910a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:25.241519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b997c-1a54-479d-857f-ddd9669910a1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:25.280971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9b1ae24b-2169-4a9e-b30e-d1e0315e6f9e None None] MFA Rules not processed for user `daf3c9e6634e4ae1bfb492eae1f44c93`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:25.282955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9b1ae24b-2169-4a9e-b30e-d1e0315e6f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:25.387492 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1548/3060] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:15:25 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:15:25.390915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b997c-1a54-479d-857f-ddd9669910a1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:25.394419 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1513/3061] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:25.396987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a9587-76df-4173-bf87-c4aae95285ac None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:25.397354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a9587-76df-4173-bf87-c4aae95285ac None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:25.397891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a9587-76df-4173-bf87-c4aae95285ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:25.427797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c88a9587-76df-4173-bf87-c4aae95285ac None None] MFA Rules not processed for user `daf3c9e6634e4ae1bfb492eae1f44c93`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:25.429654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c88a9587-76df-4173-bf87-c4aae95285ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:25.452197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:25.527132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b997c-1a54-479d-857f-ddd9669910a1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:25.529932 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1514/3062] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:25.533621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d293a-2e84-41fb-982e-5d1c53a92bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:25.534312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d293a-2e84-41fb-982e-5d1c53a92bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:25.535422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d293a-2e84-41fb-982e-5d1c53a92bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:25.535699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d293a-2e84-41fb-982e-5d1c53a92bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:25.536531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d293a-2e84-41fb-982e-5d1c53a92bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:25.538522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d293a-2e84-41fb-982e-5d1c53a92bf0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:25.662586 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1549/3063] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:15:25 2022] POST /identity/v3/users => generated 294 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:15:25.662783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a9587-76df-4173-bf87-c4aae95285ac None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:25.681808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a9587-76df-4173-bf87-c4aae95285ac None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:25.687153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa803b0-1fa4-44d2-a337-8e0ce4a7e733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:25.687839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa803b0-1fa4-44d2-a337-8e0ce4a7e733 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:25.688118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa803b0-1fa4-44d2-a337-8e0ce4a7e733 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:25.688591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa803b0-1fa4-44d2-a337-8e0ce4a7e733 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:25.689376 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa803b0-1fa4-44d2-a337-8e0ce4a7e733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:25.692483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa803b0-1fa4-44d2-a337-8e0ce4a7e733 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:25.705149 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1515/3064] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:15:25.709757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d293a-2e84-41fb-982e-5d1c53a92bf0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:25.723184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d293a-2e84-41fb-982e-5d1c53a92bf0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:25.750634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3610d98-0686-465f-93fa-c88fb4c40296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:25.762014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3610d98-0686-465f-93fa-c88fb4c40296 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:25.763880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3610d98-0686-465f-93fa-c88fb4c40296 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:25.764597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3610d98-0686-465f-93fa-c88fb4c40296 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:25.765661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3610d98-0686-465f-93fa-c88fb4c40296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:25.767750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3610d98-0686-465f-93fa-c88fb4c40296 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:25.784688 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1550/3065] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:15:25.789331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa803b0-1fa4-44d2-a337-8e0ce4a7e733 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:25.801096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa803b0-1fa4-44d2-a337-8e0ce4a7e733 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:25.811270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de0900-eb89-4d6f-9e5c-50adcaf3b2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:25.812299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de0900-eb89-4d6f-9e5c-50adcaf3b2c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:25.814295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de0900-eb89-4d6f-9e5c-50adcaf3b2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:25.814295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de0900-eb89-4d6f-9e5c-50adcaf3b2c7 admin admin] PATH_INFO: `/v3/projects/d82c2d92c67f469e863eb70bb7f9af84/users/1aa99be675e946fd995d71465b4cbec6/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:25.847236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de0900-eb89-4d6f-9e5c-50adcaf3b2c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d82c2d92c67f469e863eb70bb7f9af84, user_id=1aa99be675e946fd995d71465b4cbec6, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:25.851145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de0900-eb89-4d6f-9e5c-50adcaf3b2c7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:25.965164 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1516/3066] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:15:25 2022] PUT /identity/v3/projects/d82c2d92c67f469e863eb70bb7f9af84/users/1aa99be675e946fd995d71465b4cbec6/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:15:25.966853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fbd89-37eb-4b28-80c2-3cbb66ffed90 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:25.967188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fbd89-37eb-4b28-80c2-3cbb66ffed90 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:25.967491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fbd89-37eb-4b28-80c2-3cbb66ffed90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:25.982527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:25.990126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-893fbd89-37eb-4b28-80c2-3cbb66ffed90 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:25.991356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-893fbd89-37eb-4b28-80c2-3cbb66ffed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:26.080190 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1551/3067] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:15:26.091774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de0900-eb89-4d6f-9e5c-50adcaf3b2c7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:26.093178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e7de0900-eb89-4d6f-9e5c-50adcaf3b2c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:26.145644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fbd89-37eb-4b28-80c2-3cbb66ffed90 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:26.148031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-893fbd89-37eb-4b28-80c2-3cbb66ffed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:26.214027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de0900-eb89-4d6f-9e5c-50adcaf3b2c7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:26.223541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0394472-767e-4dde-9cd5-70925983a9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:26.224225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0394472-767e-4dde-9cd5-70925983a9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:26.224701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0394472-767e-4dde-9cd5-70925983a9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:26.224999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0394472-767e-4dde-9cd5-70925983a9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:26.261165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0394472-767e-4dde-9cd5-70925983a9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:26.265318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0394472-767e-4dde-9cd5-70925983a9f8 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:26.298991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fbd89-37eb-4b28-80c2-3cbb66ffed90 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:26.303254 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1517/3068] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:26.307462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e6b19-da7c-4ff1-8261-e1f5c83123ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:26.308275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e6b19-da7c-4ff1-8261-e1f5c83123ef service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:26.308654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e6b19-da7c-4ff1-8261-e1f5c83123ef service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:26.309028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e6b19-da7c-4ff1-8261-e1f5c83123ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:26.417710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e6b19-da7c-4ff1-8261-e1f5c83123ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:26.422776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e6b19-da7c-4ff1-8261-e1f5c83123ef service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:26.450841 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1552/3069] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:27.309524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:29.854317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0394472-767e-4dde-9cd5-70925983a9f8 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:29.855791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b0394472-767e-4dde-9cd5-70925983a9f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:29.888780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0394472-767e-4dde-9cd5-70925983a9f8 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:29.903886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b64d55-07e1-4ebd-ba34-84248099a152 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:29.903886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b64d55-07e1-4ebd-ba34-84248099a152 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:29.903886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b64d55-07e1-4ebd-ba34-84248099a152 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:29.903886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b64d55-07e1-4ebd-ba34-84248099a152 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:29.906269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a9b64d55-07e1-4ebd-ba34-84248099a152 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:30.054929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b64d55-07e1-4ebd-ba34-84248099a152 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:30.062509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b64d55-07e1-4ebd-ba34-84248099a152 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:30.093427 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1518/3070] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:29 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:34.138633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b64d55-07e1-4ebd-ba34-84248099a152 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:34.139208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980b8d0-eb48-4a15-997e-1aad1816d1d9 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:34.139208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980b8d0-eb48-4a15-997e-1aad1816d1d9 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:34.139208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980b8d0-eb48-4a15-997e-1aad1816d1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:34.139739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a9b64d55-07e1-4ebd-ba34-84248099a152 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:34.160918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b64d55-07e1-4ebd-ba34-84248099a152 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:34.165728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210cebe-c457-4491-a6a7-818800b78242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:34.166641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210cebe-c457-4491-a6a7-818800b78242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:34.167140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210cebe-c457-4491-a6a7-818800b78242 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:34.167594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210cebe-c457-4491-a6a7-818800b78242 admin admin] PATH_INFO: `/v3/users/29baab42d8c64f5480701a768f793d5e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:34.168962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210cebe-c457-4491-a6a7-818800b78242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29baab42d8c64f5480701a768f793d5e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:34.172294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210cebe-c457-4491-a6a7-818800b78242 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:34.200286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a980b8d0-eb48-4a15-997e-1aad1816d1d9 None None] MFA Rules not processed for user `1aa99be675e946fd995d71465b4cbec6`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:34.201519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a980b8d0-eb48-4a15-997e-1aad1816d1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:34.331612 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1553/3071] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:34.449403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8210cebe-c457-4491-a6a7-818800b78242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29baab42d8c64f5480701a768f793d5e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:34.469260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8210cebe-c457-4491-a6a7-818800b78242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29baab42d8c64f5480701a768f793d5e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:34.553975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8210cebe-c457-4491-a6a7-818800b78242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29baab42d8c64f5480701a768f793d5e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:34.582235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:34.591876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8210cebe-c457-4491-a6a7-818800b78242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29baab42d8c64f5480701a768f793d5e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:34.594439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8210cebe-c457-4491-a6a7-818800b78242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29baab42d8c64f5480701a768f793d5e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:34.622605 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1519/3072] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:15:34 2022] DELETE /identity/v3/users/29baab42d8c64f5480701a768f793d5e => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:15:34.628376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6452f4-6a66-4355-b63e-a5775925cd76 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:34.628880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6452f4-6a66-4355-b63e-a5775925cd76 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:34.629259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6452f4-6a66-4355-b63e-a5775925cd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:34.660268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5c6452f4-6a66-4355-b63e-a5775925cd76 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:34.661973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5c6452f4-6a66-4355-b63e-a5775925cd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:34.759054 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1554/3073] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:34.769121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210cebe-c457-4491-a6a7-818800b78242 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:34.773849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8210cebe-c457-4491-a6a7-818800b78242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:34.852773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6452f4-6a66-4355-b63e-a5775925cd76 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:34.852972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210cebe-c457-4491-a6a7-818800b78242 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:34.854667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5c6452f4-6a66-4355-b63e-a5775925cd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:34.857319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba7543-745f-43eb-8616-6f1a5f91c8da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:34.858156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba7543-745f-43eb-8616-6f1a5f91c8da service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:34.858445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba7543-745f-43eb-8616-6f1a5f91c8da service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:34.858723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba7543-745f-43eb-8616-6f1a5f91c8da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:34.880896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba7543-745f-43eb-8616-6f1a5f91c8da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:34.882448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba7543-745f-43eb-8616-6f1a5f91c8da service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:34.900780 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1520/3074] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:35.035392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:35.057542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6452f4-6a66-4355-b63e-a5775925cd76 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:35.066540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2232f-9f3e-4f01-9b0c-2727ca51d321 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:35.067780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2232f-9f3e-4f01-9b0c-2727ca51d321 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:35.068069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2232f-9f3e-4f01-9b0c-2727ca51d321 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:35.068348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2232f-9f3e-4f01-9b0c-2727ca51d321 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:35.072471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-62c2232f-9f3e-4f01-9b0c-2727ca51d321 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:35.223072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2232f-9f3e-4f01-9b0c-2727ca51d321 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:35.224990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2232f-9f3e-4f01-9b0c-2727ca51d321 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:35.240358 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1555/3075] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:15:35.357498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581cc43-7b2c-44c5-acaf-4aefbc49217c None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:35.358031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581cc43-7b2c-44c5-acaf-4aefbc49217c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:35.358031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581cc43-7b2c-44c5-acaf-4aefbc49217c None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:35.359753 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1521/3076] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:15:35.365925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db61cf-c5eb-48de-b7b7-ae4b844c9ded None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:35.366219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db61cf-c5eb-48de-b7b7-ae4b844c9ded None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:35.366525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db61cf-c5eb-48de-b7b7-ae4b844c9ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:35.388848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d8db61cf-c5eb-48de-b7b7-ae4b844c9ded None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:35.390408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d8db61cf-c5eb-48de-b7b7-ae4b844c9ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:35.543947 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1556/3077] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:15:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:35.571281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581cc43-7b2c-44c5-acaf-4aefbc49217c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:35.573495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5581cc43-7b2c-44c5-acaf-4aefbc49217c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:35.614240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581cc43-7b2c-44c5-acaf-4aefbc49217c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:35.631248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b009503-347d-4565-94cf-2948ac0bf850 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:35.631901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b009503-347d-4565-94cf-2948ac0bf850 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:35.632453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b009503-347d-4565-94cf-2948ac0bf850 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:35.632896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b009503-347d-4565-94cf-2948ac0bf850 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:35.652388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b009503-347d-4565-94cf-2948ac0bf850 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:35.655996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b009503-347d-4565-94cf-2948ac0bf850 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:35.675856 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1522/3078] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:36.227498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db61cf-c5eb-48de-b7b7-ae4b844c9ded None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:36.229088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d8db61cf-c5eb-48de-b7b7-ae4b844c9ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:36.248827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db61cf-c5eb-48de-b7b7-ae4b844c9ded None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:36.255909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75224c9-55fc-42d1-a84e-afe20796ff12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:36.257061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75224c9-55fc-42d1-a84e-afe20796ff12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:36.257509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75224c9-55fc-42d1-a84e-afe20796ff12 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:36.258285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75224c9-55fc-42d1-a84e-afe20796ff12 admin admin] PATH_INFO: `/v3/projects/71aa49f99a7647329b40abfd7e10a606` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:36.259755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75224c9-55fc-42d1-a84e-afe20796ff12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71aa49f99a7647329b40abfd7e10a606)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:36.263232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75224c9-55fc-42d1-a84e-afe20796ff12 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:36.290291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b009503-347d-4565-94cf-2948ac0bf850 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:36.310571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b009503-347d-4565-94cf-2948ac0bf850 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:36.315595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe359a-3c75-4724-b997-758d5a1c5204 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:36.316892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe359a-3c75-4724-b997-758d5a1c5204 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:36.317225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe359a-3c75-4724-b997-758d5a1c5204 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:36.318600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe359a-3c75-4724-b997-758d5a1c5204 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:36.320907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-63fe359a-3c75-4724-b997-758d5a1c5204 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:36.339209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe359a-3c75-4724-b997-758d5a1c5204 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:36.340920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe359a-3c75-4724-b997-758d5a1c5204 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:36.366455 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1523/3079] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:36.381909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c75224c9-55fc-42d1-a84e-afe20796ff12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71aa49f99a7647329b40abfd7e10a606', 'request_id': 'req-c75224c9-55fc-42d1-a84e-afe20796ff12'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:36.390532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c75224c9-55fc-42d1-a84e-afe20796ff12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71aa49f99a7647329b40abfd7e10a606', 'request_id': 'req-c75224c9-55fc-42d1-a84e-afe20796ff12'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:36.399424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c75224c9-55fc-42d1-a84e-afe20796ff12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71aa49f99a7647329b40abfd7e10a606', 'request_id': 'req-c75224c9-55fc-42d1-a84e-afe20796ff12'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:36.500533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c75224c9-55fc-42d1-a84e-afe20796ff12 admin admin] The token cache is being invalidate because project 71aa49f99a7647329b40abfd7e10a606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:15:36.500833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c75224c9-55fc-42d1-a84e-afe20796ff12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:36.503655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c75224c9-55fc-42d1-a84e-afe20796ff12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:15:36.505907 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1557/3080] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:15:36 2022] DELETE /identity/v3/projects/71aa49f99a7647329b40abfd7e10a606 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:15:36.512129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d039c2-a572-4534-9637-0929781f3819 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:36.512445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d039c2-a572-4534-9637-0929781f3819 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:36.512725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d039c2-a572-4534-9637-0929781f3819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:36.535872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-18d039c2-a572-4534-9637-0929781f3819 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:36.537416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-18d039c2-a572-4534-9637-0929781f3819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:36.654982 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1524/3081] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:36.657585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69ac12-298a-4c15-93de-00d387e7632f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:36.657959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69ac12-298a-4c15-93de-00d387e7632f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:36.658727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69ac12-298a-4c15-93de-00d387e7632f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:36.700216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-fe69ac12-298a-4c15-93de-00d387e7632f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:36.701892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fe69ac12-298a-4c15-93de-00d387e7632f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:36.730147 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1558/3082] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:36.731185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d039c2-a572-4534-9637-0929781f3819 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:36.745218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d039c2-a572-4534-9637-0929781f3819 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:36.751849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db12d72-290f-4b5f-b85f-b15e4276663a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:36.753475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db12d72-290f-4b5f-b85f-b15e4276663a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:36.753985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db12d72-290f-4b5f-b85f-b15e4276663a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:36.755035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db12d72-290f-4b5f-b85f-b15e4276663a admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:36.755879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db12d72-290f-4b5f-b85f-b15e4276663a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:15:36.756255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db12d72-290f-4b5f-b85f-b15e4276663a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:36.758277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db12d72-290f-4b5f-b85f-b15e4276663a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:36.782095 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1525/3083] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:15:36.787684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69ac12-298a-4c15-93de-00d387e7632f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:36.803980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69ac12-298a-4c15-93de-00d387e7632f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:36.816642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e6662-b5f8-4ab2-ae95-77d14a10701f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:36.817544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e6662-b5f8-4ab2-ae95-77d14a10701f admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:36.817883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e6662-b5f8-4ab2-ae95-77d14a10701f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:36.818159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e6662-b5f8-4ab2-ae95-77d14a10701f admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:36.819503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e6662-b5f8-4ab2-ae95-77d14a10701f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:36.822869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e6662-b5f8-4ab2-ae95-77d14a10701f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:36.838403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:36.957296 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1559/3084] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:15:36 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:15:36.961660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db12d72-290f-4b5f-b85f-b15e4276663a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:36.973134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db12d72-290f-4b5f-b85f-b15e4276663a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:37.029079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:37.039750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3caf7-34e0-4a0a-8aba-3708500c0926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:37.041142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3caf7-34e0-4a0a-8aba-3708500c0926 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:37.041926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3caf7-34e0-4a0a-8aba-3708500c0926 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:37.042218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3caf7-34e0-4a0a-8aba-3708500c0926 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:37.043758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3caf7-34e0-4a0a-8aba-3708500c0926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:37.046948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3caf7-34e0-4a0a-8aba-3708500c0926 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:37.217219 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1526/3085] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:15:36 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:15:37.222538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e6662-b5f8-4ab2-ae95-77d14a10701f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:37.236515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e6662-b5f8-4ab2-ae95-77d14a10701f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:37.242155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071329e-30b5-46d1-8644-8e8d7c84898d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:37.242860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071329e-30b5-46d1-8644-8e8d7c84898d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:37.243322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071329e-30b5-46d1-8644-8e8d7c84898d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:37.244055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071329e-30b5-46d1-8644-8e8d7c84898d admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:37.244592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071329e-30b5-46d1-8644-8e8d7c84898d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:37.246245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071329e-30b5-46d1-8644-8e8d7c84898d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:37.259736 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1560/3086] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:15:37.264128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3caf7-34e0-4a0a-8aba-3708500c0926 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:37.275545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3caf7-34e0-4a0a-8aba-3708500c0926 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:37.283070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def490a9-0a95-477e-acd3-f35e7613b9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:37.283746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def490a9-0a95-477e-acd3-f35e7613b9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:37.284901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def490a9-0a95-477e-acd3-f35e7613b9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:37.285202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def490a9-0a95-477e-acd3-f35e7613b9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:37.285942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def490a9-0a95-477e-acd3-f35e7613b9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:37.287585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def490a9-0a95-477e-acd3-f35e7613b9c2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:37.299172 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1527/3087] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:15:37.303770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071329e-30b5-46d1-8644-8e8d7c84898d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:37.314842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071329e-30b5-46d1-8644-8e8d7c84898d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:37.320999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fabc6c-dfe6-4fe3-be1c-de09dd372aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:37.322189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fabc6c-dfe6-4fe3-be1c-de09dd372aee admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:37.322597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fabc6c-dfe6-4fe3-be1c-de09dd372aee admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:37.322970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fabc6c-dfe6-4fe3-be1c-de09dd372aee admin admin] PATH_INFO: `/v3/projects/a90d4bcd25ff4bf68bdc194180fbbe09/users/dd4144b5388b46a989a41a2f556bb508/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:37.344408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fabc6c-dfe6-4fe3-be1c-de09dd372aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a90d4bcd25ff4bf68bdc194180fbbe09, user_id=dd4144b5388b46a989a41a2f556bb508, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:37.348842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fabc6c-dfe6-4fe3-be1c-de09dd372aee admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:37.442843 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1561/3088] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:15:37 2022] PUT /identity/v3/projects/a90d4bcd25ff4bf68bdc194180fbbe09/users/dd4144b5388b46a989a41a2f556bb508/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:15:37.448715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faa3d7-32d3-4955-935c-23ccd8558ed0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:37.449243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faa3d7-32d3-4955-935c-23ccd8558ed0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:37.449243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faa3d7-32d3-4955-935c-23ccd8558ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:37.480922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-07faa3d7-32d3-4955-935c-23ccd8558ed0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:37.482546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-07faa3d7-32d3-4955-935c-23ccd8558ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:37.578758 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1528/3089] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:37.590117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fabc6c-dfe6-4fe3-be1c-de09dd372aee admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:37.592029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-51fabc6c-dfe6-4fe3-be1c-de09dd372aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:37.660042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fabc6c-dfe6-4fe3-be1c-de09dd372aee admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:37.670190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef393bda-0c66-4127-b225-d1025dce8749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:37.671347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef393bda-0c66-4127-b225-d1025dce8749 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:37.673284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef393bda-0c66-4127-b225-d1025dce8749 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:37.673284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef393bda-0c66-4127-b225-d1025dce8749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:37.731892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef393bda-0c66-4127-b225-d1025dce8749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:37.736593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef393bda-0c66-4127-b225-d1025dce8749 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:37.769224 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1562/3090] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:15:38.222026 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07faa3d7-32d3-4955-935c-23ccd8558ed0 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:38.223942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-07faa3d7-32d3-4955-935c-23ccd8558ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:38.244602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07faa3d7-32d3-4955-935c-23ccd8558ed0 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:38.256387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e07f8-4b1b-4b02-a453-013f2f5d2caf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:38.257231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e07f8-4b1b-4b02-a453-013f2f5d2caf service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:38.257443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e07f8-4b1b-4b02-a453-013f2f5d2caf service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:38.257722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e07f8-4b1b-4b02-a453-013f2f5d2caf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:38.262265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c14e07f8-4b1b-4b02-a453-013f2f5d2caf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:38.367325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e07f8-4b1b-4b02-a453-013f2f5d2caf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:38.369498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e07f8-4b1b-4b02-a453-013f2f5d2caf service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:38.405796 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1529/3091] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:38.452148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef393bda-0c66-4127-b225-d1025dce8749 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:38.465735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef393bda-0c66-4127-b225-d1025dce8749 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:38.477573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850cbe0-5ca2-4d95-9ee9-ce37754964b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:38.480351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850cbe0-5ca2-4d95-9ee9-ce37754964b5 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:38.480746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850cbe0-5ca2-4d95-9ee9-ce37754964b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:38.481335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850cbe0-5ca2-4d95-9ee9-ce37754964b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:38.486274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e850cbe0-5ca2-4d95-9ee9-ce37754964b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:38.501607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850cbe0-5ca2-4d95-9ee9-ce37754964b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:38.505605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850cbe0-5ca2-4d95-9ee9-ce37754964b5 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:38.520918 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1563/3092] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:39.018254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807935a6-6569-41f6-af95-04c4ea34e8e9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:39.018840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807935a6-6569-41f6-af95-04c4ea34e8e9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:39.018949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807935a6-6569-41f6-af95-04c4ea34e8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:39.040652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-807935a6-6569-41f6-af95-04c4ea34e8e9 None None] MFA Rules not processed for user `1aa99be675e946fd995d71465b4cbec6`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:39.042468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-807935a6-6569-41f6-af95-04c4ea34e8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:39.142417 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1530/3093] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:41.800768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ee44e-f999-4cc9-8995-ad4e9a0882d3 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:41.806225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ee44e-f999-4cc9-8995-ad4e9a0882d3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:41.806225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ee44e-f999-4cc9-8995-ad4e9a0882d3 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:41.806225 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1564/3094] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:15:41.816940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65ca8d-d579-4d6f-8a97-718794f35111 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:41.817612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65ca8d-d579-4d6f-8a97-718794f35111 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:41.817612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65ca8d-d579-4d6f-8a97-718794f35111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:41.851396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:41.970784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-bf65ca8d-d579-4d6f-8a97-718794f35111 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:41.972820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bf65ca8d-d579-4d6f-8a97-718794f35111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:42.154475 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1531/3095] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:15:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:42.180498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ee44e-f999-4cc9-8995-ad4e9a0882d3 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:42.182457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9d4ee44e-f999-4cc9-8995-ad4e9a0882d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:42.207765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ee44e-f999-4cc9-8995-ad4e9a0882d3 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:42.214535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041c479-b5aa-4c66-b9af-c0257d454d19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:42.215587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041c479-b5aa-4c66-b9af-c0257d454d19 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:42.216269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041c479-b5aa-4c66-b9af-c0257d454d19 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:42.216717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041c479-b5aa-4c66-b9af-c0257d454d19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:42.229833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041c479-b5aa-4c66-b9af-c0257d454d19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:42.231723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041c479-b5aa-4c66-b9af-c0257d454d19 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:42.265235 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1565/3096] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:43.804656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65ca8d-d579-4d6f-8a97-718794f35111 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:43.820354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65ca8d-d579-4d6f-8a97-718794f35111 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:43.830425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711bdc0-471d-4d38-b714-14d9ea475993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:43.832036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711bdc0-471d-4d38-b714-14d9ea475993 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:43.832368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711bdc0-471d-4d38-b714-14d9ea475993 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:43.832544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711bdc0-471d-4d38-b714-14d9ea475993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:43.837736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a711bdc0-471d-4d38-b714-14d9ea475993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:43.876058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711bdc0-471d-4d38-b714-14d9ea475993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:43.881282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711bdc0-471d-4d38-b714-14d9ea475993 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:43.913852 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1532/3097] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:43.982324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041c479-b5aa-4c66-b9af-c0257d454d19 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:44.008246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041c479-b5aa-4c66-b9af-c0257d454d19 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:44.019334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c95e5-6ba0-4a0c-a6d4-61268ed71567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:44.021703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c95e5-6ba0-4a0c-a6d4-61268ed71567 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:44.026672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c95e5-6ba0-4a0c-a6d4-61268ed71567 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:44.027583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c95e5-6ba0-4a0c-a6d4-61268ed71567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:44.032551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-db8c95e5-6ba0-4a0c-a6d4-61268ed71567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:44.052703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c95e5-6ba0-4a0c-a6d4-61268ed71567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:44.054349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c95e5-6ba0-4a0c-a6d4-61268ed71567 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:44.064465 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1566/3098] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:46.342356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711bdc0-471d-4d38-b714-14d9ea475993 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:46.356247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711bdc0-471d-4d38-b714-14d9ea475993 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:46.373084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a3852-3c37-48fc-921b-31c2321486c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:46.373084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a3852-3c37-48fc-921b-31c2321486c8 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:46.373084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a3852-3c37-48fc-921b-31c2321486c8 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:46.373084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a3852-3c37-48fc-921b-31c2321486c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:46.374090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c90a3852-3c37-48fc-921b-31c2321486c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:46.390237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a3852-3c37-48fc-921b-31c2321486c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:46.394059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a3852-3c37-48fc-921b-31c2321486c8 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:46.406243 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1533/3099] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:15:46.506731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c95e5-6ba0-4a0c-a6d4-61268ed71567 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:46.508354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-db8c95e5-6ba0-4a0c-a6d4-61268ed71567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:46.510747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4679382-f7f3-46bd-94eb-f4c719a6ac85 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:46.511102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4679382-f7f3-46bd-94eb-f4c719a6ac85 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:46.511512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4679382-f7f3-46bd-94eb-f4c719a6ac85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:46.561325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c95e5-6ba0-4a0c-a6d4-61268ed71567 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:46.562340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d4679382-f7f3-46bd-94eb-f4c719a6ac85 None None] MFA Rules not processed for user `4e9df82f95ac4779859972403869096a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:46.565225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d4679382-f7f3-46bd-94eb-f4c719a6ac85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:46.579093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfb30e-0843-4be5-8061-7dc1326c0582 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:46.588486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfb30e-0843-4be5-8061-7dc1326c0582 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:46.588486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfb30e-0843-4be5-8061-7dc1326c0582 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:46.588486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfb30e-0843-4be5-8061-7dc1326c0582 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:46.598871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c1dfb30e-0843-4be5-8061-7dc1326c0582 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:46.685664 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1534/3100] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:46.727378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfb30e-0843-4be5-8061-7dc1326c0582 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:46.729566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfb30e-0843-4be5-8061-7dc1326c0582 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:46.746423 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1567/3101] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:47.225332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f7d68-ff8e-462d-a82f-81cbf84a7498 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:47.226971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f7d68-ff8e-462d-a82f-81cbf84a7498 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:47.226971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f7d68-ff8e-462d-a82f-81cbf84a7498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:47.266676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-313f7d68-ff8e-462d-a82f-81cbf84a7498 None None] MFA Rules not processed for user `dd4144b5388b46a989a41a2f556bb508`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:47.269526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-313f7d68-ff8e-462d-a82f-81cbf84a7498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:47.319337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:47.355828 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1535/3102] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:15:47.364433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4fccf-399e-42e6-9534-28a2eb42e475 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:47.365135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4fccf-399e-42e6-9534-28a2eb42e475 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:47.365743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4fccf-399e-42e6-9534-28a2eb42e475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:47.388658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e1e4fccf-399e-42e6-9534-28a2eb42e475 None None] MFA Rules not processed for user `dd4144b5388b46a989a41a2f556bb508`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:47.390363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e1e4fccf-399e-42e6-9534-28a2eb42e475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:47.401676 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1568/3103] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:15:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:15:49.681870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f7d68-ff8e-462d-a82f-81cbf84a7498 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:49.699996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f7d68-ff8e-462d-a82f-81cbf84a7498 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:49.719086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19eb16-94d2-4955-b5f8-c5b0ebcf64ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:49.720048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19eb16-94d2-4955-b5f8-c5b0ebcf64ad service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:49.720355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19eb16-94d2-4955-b5f8-c5b0ebcf64ad service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:49.721491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19eb16-94d2-4955-b5f8-c5b0ebcf64ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:49.723910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1b19eb16-94d2-4955-b5f8-c5b0ebcf64ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:15:49.746862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19eb16-94d2-4955-b5f8-c5b0ebcf64ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:49.764267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19eb16-94d2-4955-b5f8-c5b0ebcf64ad service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:49.768309 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1536/3104] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:50.695966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4fccf-399e-42e6-9534-28a2eb42e475 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:15:50.731886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4fccf-399e-42e6-9534-28a2eb42e475 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:15:50.750945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd400677-eaa6-4046-a82a-462ef69f4696 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:15:50.751646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd400677-eaa6-4046-a82a-462ef69f4696 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:50.752040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd400677-eaa6-4046-a82a-462ef69f4696 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:50.753024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd400677-eaa6-4046-a82a-462ef69f4696 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:50.780845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd400677-eaa6-4046-a82a-462ef69f4696 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:15:50.783078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd400677-eaa6-4046-a82a-462ef69f4696 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:15:50.801103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:50.818744 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1569/3105] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:15:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:15:59.762172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=16 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:15:59.861801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c346dd1-e207-4b0f-985f-bb89b4fc7fd0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:15:59.863862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c346dd1-e207-4b0f-985f-bb89b4fc7fd0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:15:59.864090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c346dd1-e207-4b0f-985f-bb89b4fc7fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:15:59.887433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3c346dd1-e207-4b0f-985f-bb89b4fc7fd0 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:15:59.889038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3c346dd1-e207-4b0f-985f-bb89b4fc7fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:00.001205 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1537/3106] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:15:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:16:00.025585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd400677-eaa6-4046-a82a-462ef69f4696 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:00.027080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fd400677-eaa6-4046-a82a-462ef69f4696 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:00.150629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd400677-eaa6-4046-a82a-462ef69f4696 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:00.159776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64fa9c-c37b-4015-b398-e4437b74b879 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:00.160459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64fa9c-c37b-4015-b398-e4437b74b879 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:00.161315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64fa9c-c37b-4015-b398-e4437b74b879 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:00.161315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64fa9c-c37b-4015-b398-e4437b74b879 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:00.179218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64fa9c-c37b-4015-b398-e4437b74b879 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:00.184043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64fa9c-c37b-4015-b398-e4437b74b879 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:00.210455 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1570/3107] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:16:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:16:05.306508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c346dd1-e207-4b0f-985f-bb89b4fc7fd0 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:05.308233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3c346dd1-e207-4b0f-985f-bb89b4fc7fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:05.494917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c346dd1-e207-4b0f-985f-bb89b4fc7fd0 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:05.501200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b83b76-ad9a-442a-b52e-bf87e411ec22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:05.502204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b83b76-ad9a-442a-b52e-bf87e411ec22 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:05.502683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b83b76-ad9a-442a-b52e-bf87e411ec22 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:05.503146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b83b76-ad9a-442a-b52e-bf87e411ec22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:05.516293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c3b83b76-ad9a-442a-b52e-bf87e411ec22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:05.785446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b83b76-ad9a-442a-b52e-bf87e411ec22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:05.791590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b83b76-ad9a-442a-b52e-bf87e411ec22 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:05.815408 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1538/3108] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:16:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:16:07.292015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64fa9c-c37b-4015-b398-e4437b74b879 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:07.293496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8e64fa9c-c37b-4015-b398-e4437b74b879 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:07.310492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64fa9c-c37b-4015-b398-e4437b74b879 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:07.316737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cfbd9-8920-47f9-ad64-3ec297642500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:07.323617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cfbd9-8920-47f9-ad64-3ec297642500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:07.323617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cfbd9-8920-47f9-ad64-3ec297642500 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:07.323617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cfbd9-8920-47f9-ad64-3ec297642500 admin admin] PATH_INFO: `/v3/users/8c8c4b59d1264f26ac123e54da950ad0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:07.323617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0cfbd9-8920-47f9-ad64-3ec297642500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c8c4b59d1264f26ac123e54da950ad0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:07.323617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0cfbd9-8920-47f9-ad64-3ec297642500 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:07.598562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fe0cfbd9-8920-47f9-ad64-3ec297642500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c8c4b59d1264f26ac123e54da950ad0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:07.608802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fe0cfbd9-8920-47f9-ad64-3ec297642500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c8c4b59d1264f26ac123e54da950ad0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:07.699858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fe0cfbd9-8920-47f9-ad64-3ec297642500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c8c4b59d1264f26ac123e54da950ad0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:07.705468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fe0cfbd9-8920-47f9-ad64-3ec297642500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c8c4b59d1264f26ac123e54da950ad0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:07.736850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fe0cfbd9-8920-47f9-ad64-3ec297642500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c8c4b59d1264f26ac123e54da950ad0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:07.750934 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1571/3109] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:16:07 2022] DELETE /identity/v3/users/8c8c4b59d1264f26ac123e54da950ad0 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:16:08.103471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b83b76-ad9a-442a-b52e-bf87e411ec22 service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:08.121648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b83b76-ad9a-442a-b52e-bf87e411ec22 service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:08.208858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:08.216335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efbe8a-cdff-46c1-bdd8-7f080ab818be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:08.217839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efbe8a-cdff-46c1-bdd8-7f080ab818be admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:08.218347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efbe8a-cdff-46c1-bdd8-7f080ab818be admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:08.218792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efbe8a-cdff-46c1-bdd8-7f080ab818be admin admin] PATH_INFO: `/v3/projects/48a760c6b53c4c689351d149f359af09` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:08.221184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efbe8a-cdff-46c1-bdd8-7f080ab818be admin admin] RBAC: Authorizing `identity:delete_project(project_id=48a760c6b53c4c689351d149f359af09)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:08.225844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efbe8a-cdff-46c1-bdd8-7f080ab818be admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:08.389721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-88efbe8a-cdff-46c1-bdd8-7f080ab818be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a760c6b53c4c689351d149f359af09', 'request_id': 'req-88efbe8a-cdff-46c1-bdd8-7f080ab818be'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:08.397125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-88efbe8a-cdff-46c1-bdd8-7f080ab818be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a760c6b53c4c689351d149f359af09', 'request_id': 'req-88efbe8a-cdff-46c1-bdd8-7f080ab818be'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:08.405545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-88efbe8a-cdff-46c1-bdd8-7f080ab818be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a760c6b53c4c689351d149f359af09', 'request_id': 'req-88efbe8a-cdff-46c1-bdd8-7f080ab818be'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:08.558647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-88efbe8a-cdff-46c1-bdd8-7f080ab818be admin admin] The token cache is being invalidate because project 48a760c6b53c4c689351d149f359af09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:16:08.559097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-88efbe8a-cdff-46c1-bdd8-7f080ab818be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:08.559931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-88efbe8a-cdff-46c1-bdd8-7f080ab818be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:08.571391 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1539/3110] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:16:08 2022] DELETE /identity/v3/projects/48a760c6b53c4c689351d149f359af09 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:16:08.574789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f714268-2de3-4e17-85ad-ced12cccf921 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:08.575403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f714268-2de3-4e17-85ad-ced12cccf921 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:08.575403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f714268-2de3-4e17-85ad-ced12cccf921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:08.598301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8f714268-2de3-4e17-85ad-ced12cccf921 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:08.599883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8f714268-2de3-4e17-85ad-ced12cccf921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:08.724486 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1572/3111] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:16:08.732424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0c30-a429-4bda-8b1f-7cc228e5f3aa None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:08.732877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0c30-a429-4bda-8b1f-7cc228e5f3aa None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:08.733867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0c30-a429-4bda-8b1f-7cc228e5f3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:08.763856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9c0c0c30-a429-4bda-8b1f-7cc228e5f3aa None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:08.766414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9c0c0c30-a429-4bda-8b1f-7cc228e5f3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:08.788205 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1540/3112] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:16:08.794506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f714268-2de3-4e17-85ad-ced12cccf921 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:08.809852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:08.819988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f714268-2de3-4e17-85ad-ced12cccf921 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:08.847447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6546d6b-690f-45d7-853a-69b90dccfd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:08.849346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6546d6b-690f-45d7-853a-69b90dccfd1c admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:08.849802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6546d6b-690f-45d7-853a-69b90dccfd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:08.850246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6546d6b-690f-45d7-853a-69b90dccfd1c admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:08.851194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6546d6b-690f-45d7-853a-69b90dccfd1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:16:08.851701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6546d6b-690f-45d7-853a-69b90dccfd1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:08.861965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6546d6b-690f-45d7-853a-69b90dccfd1c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:08.877425 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1573/3113] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:16:08.882135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0c30-a429-4bda-8b1f-7cc228e5f3aa None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:08.904946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0c30-a429-4bda-8b1f-7cc228e5f3aa None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:08.913098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3b56a-40ef-49b6-a237-57b00459f1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:08.916212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3b56a-40ef-49b6-a237-57b00459f1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:08.916212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3b56a-40ef-49b6-a237-57b00459f1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:08.916212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3b56a-40ef-49b6-a237-57b00459f1c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:08.916212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3b56a-40ef-49b6-a237-57b00459f1c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:08.917644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3b56a-40ef-49b6-a237-57b00459f1c2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:09.049332 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1541/3114] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:16:08 2022] POST /identity/v3/projects => generated 395 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:16:09.050628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6546d6b-690f-45d7-853a-69b90dccfd1c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:09.082301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6546d6b-690f-45d7-853a-69b90dccfd1c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:09.168354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95be52b-31f7-4dd6-b633-4a2660ce1387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:09.169367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95be52b-31f7-4dd6-b633-4a2660ce1387 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:09.169847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95be52b-31f7-4dd6-b633-4a2660ce1387 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:09.170288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95be52b-31f7-4dd6-b633-4a2660ce1387 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:09.171632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95be52b-31f7-4dd6-b633-4a2660ce1387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:09.176590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95be52b-31f7-4dd6-b633-4a2660ce1387 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:09.353013 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1574/3115] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:16:09 2022] POST /identity/v3/users => generated 298 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:16:09.357417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3b56a-40ef-49b6-a237-57b00459f1c2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:09.373920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3b56a-40ef-49b6-a237-57b00459f1c2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:09.380828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f9adf-b3ec-491f-aff2-218edc101b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:09.381622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f9adf-b3ec-491f-aff2-218edc101b1b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:09.382153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f9adf-b3ec-491f-aff2-218edc101b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:09.382504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f9adf-b3ec-491f-aff2-218edc101b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:09.383669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f9adf-b3ec-491f-aff2-218edc101b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:09.385378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f9adf-b3ec-491f-aff2-218edc101b1b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:09.418049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95be52b-31f7-4dd6-b633-4a2660ce1387 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:09.419202 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1542/3116] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:16:09.429508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95be52b-31f7-4dd6-b633-4a2660ce1387 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:09.454056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77e45b-9396-4824-ac79-97901d6b6116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:09.455081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77e45b-9396-4824-ac79-97901d6b6116 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:09.455556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77e45b-9396-4824-ac79-97901d6b6116 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:09.455837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77e45b-9396-4824-ac79-97901d6b6116 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:09.456574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77e45b-9396-4824-ac79-97901d6b6116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:09.458223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77e45b-9396-4824-ac79-97901d6b6116 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:09.502365 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1575/3117] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:16:09.502502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f9adf-b3ec-491f-aff2-218edc101b1b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:09.502502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f9adf-b3ec-491f-aff2-218edc101b1b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:09.502502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf00090-4646-4e3b-9c14-e467c39399e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:09.502502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf00090-4646-4e3b-9c14-e467c39399e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:09.503135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf00090-4646-4e3b-9c14-e467c39399e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:09.503135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf00090-4646-4e3b-9c14-e467c39399e9 admin admin] PATH_INFO: `/v3/projects/5163e91b263949d2b4ac6cf1e110eb62/users/b3b5f2d7a35b44649de7c41e5fdebaac/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:09.525772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf00090-4646-4e3b-9c14-e467c39399e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5163e91b263949d2b4ac6cf1e110eb62, user_id=b3b5f2d7a35b44649de7c41e5fdebaac, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:09.528636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf00090-4646-4e3b-9c14-e467c39399e9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:09.689964 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1543/3118] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:16:09 2022] PUT /identity/v3/projects/5163e91b263949d2b4ac6cf1e110eb62/users/b3b5f2d7a35b44649de7c41e5fdebaac/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:16:09.701085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6053f07-177f-4f66-b293-805fc6ab7efa None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:09.702204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6053f07-177f-4f66-b293-805fc6ab7efa None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:09.702650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6053f07-177f-4f66-b293-805fc6ab7efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:09.755806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d6053f07-177f-4f66-b293-805fc6ab7efa None None] MFA Rules not processed for user `b3b5f2d7a35b44649de7c41e5fdebaac`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:09.757147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d6053f07-177f-4f66-b293-805fc6ab7efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:09.899175 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1576/3119] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:16:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:16:10.498168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf00090-4646-4e3b-9c14-e467c39399e9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:10.504120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4cf00090-4646-4e3b-9c14-e467c39399e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:10.640915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf00090-4646-4e3b-9c14-e467c39399e9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:10.655875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d1a35-087f-4b9e-9890-f931e56efd9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:10.656594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d1a35-087f-4b9e-9890-f931e56efd9c service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:10.656875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d1a35-087f-4b9e-9890-f931e56efd9c service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:10.657147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d1a35-087f-4b9e-9890-f931e56efd9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:10.670386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d1a35-087f-4b9e-9890-f931e56efd9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:10.672707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d1a35-087f-4b9e-9890-f931e56efd9c service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:10.701858 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1544/3120] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:16:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:16:13.880750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6053f07-177f-4f66-b293-805fc6ab7efa None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:14.159325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:14.169527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6053f07-177f-4f66-b293-805fc6ab7efa None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:14.181057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb8e30-6dbf-403c-a122-bbcbe084e8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:14.181961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb8e30-6dbf-403c-a122-bbcbe084e8c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:14.182244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb8e30-6dbf-403c-a122-bbcbe084e8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:14.185766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb8e30-6dbf-403c-a122-bbcbe084e8c5 admin admin] PATH_INFO: `/v3/users/b3b5f2d7a35b44649de7c41e5fdebaac` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:14.187907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb8e30-6dbf-403c-a122-bbcbe084e8c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3b5f2d7a35b44649de7c41e5fdebaac)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:14.196360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb8e30-6dbf-403c-a122-bbcbe084e8c5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:14.555358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-dbdb8e30-6dbf-403c-a122-bbcbe084e8c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3b5f2d7a35b44649de7c41e5fdebaac'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:14.598022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-dbdb8e30-6dbf-403c-a122-bbcbe084e8c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3b5f2d7a35b44649de7c41e5fdebaac'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:14.742647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-dbdb8e30-6dbf-403c-a122-bbcbe084e8c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3b5f2d7a35b44649de7c41e5fdebaac'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:14.751789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-dbdb8e30-6dbf-403c-a122-bbcbe084e8c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3b5f2d7a35b44649de7c41e5fdebaac'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:14.775429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-dbdb8e30-6dbf-403c-a122-bbcbe084e8c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3b5f2d7a35b44649de7c41e5fdebaac'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:14.792124 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1577/3121] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:16:13 2022] DELETE /identity/v3/users/b3b5f2d7a35b44649de7c41e5fdebaac => generated 0 bytes in 912 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:16:14.798375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a0f06-4cca-4e7e-96ef-b6a08d1fa705 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:14.798375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a0f06-4cca-4e7e-96ef-b6a08d1fa705 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:14.798375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a0f06-4cca-4e7e-96ef-b6a08d1fa705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:14.834998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:14.847793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-357a0f06-4cca-4e7e-96ef-b6a08d1fa705 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:14.854615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-357a0f06-4cca-4e7e-96ef-b6a08d1fa705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:14.990458 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1545/3122] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:16:15.004399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb8e30-6dbf-403c-a122-bbcbe084e8c5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:15.006443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dbdb8e30-6dbf-403c-a122-bbcbe084e8c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:15.129682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb8e30-6dbf-403c-a122-bbcbe084e8c5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:15.136233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c94ab2-f4fa-469f-b824-89c149d50315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:15.138343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c94ab2-f4fa-469f-b824-89c149d50315 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:15.138962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c94ab2-f4fa-469f-b824-89c149d50315 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:15.140608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c94ab2-f4fa-469f-b824-89c149d50315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:15.162849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c94ab2-f4fa-469f-b824-89c149d50315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:15.164618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c94ab2-f4fa-469f-b824-89c149d50315 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:15.191366 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1578/3123] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:16:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:16:17.221469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a0f06-4cca-4e7e-96ef-b6a08d1fa705 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:17.223800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-357a0f06-4cca-4e7e-96ef-b6a08d1fa705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:17.246644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a0f06-4cca-4e7e-96ef-b6a08d1fa705 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:17.265214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cfd3f-87b6-4dd6-a58d-c0a823b47650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:17.267022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cfd3f-87b6-4dd6-a58d-c0a823b47650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:17.268575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cfd3f-87b6-4dd6-a58d-c0a823b47650 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:17.272666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cfd3f-87b6-4dd6-a58d-c0a823b47650 admin admin] PATH_INFO: `/v3/projects/5163e91b263949d2b4ac6cf1e110eb62` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:17.275704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cfd3f-87b6-4dd6-a58d-c0a823b47650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5163e91b263949d2b4ac6cf1e110eb62)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:17.280899 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cfd3f-87b6-4dd6-a58d-c0a823b47650 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:17.371902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c94ab2-f4fa-469f-b824-89c149d50315 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:17.371902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f3c94ab2-f4fa-469f-b824-89c149d50315 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:17.396022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c94ab2-f4fa-469f-b824-89c149d50315 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:17.415966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315a443-6826-4ccc-b82d-ca143f9ee6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:17.415966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315a443-6826-4ccc-b82d-ca143f9ee6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:17.417007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315a443-6826-4ccc-b82d-ca143f9ee6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:17.417338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315a443-6826-4ccc-b82d-ca143f9ee6d8 admin admin] PATH_INFO: `/v3/users/53af488f3b0242a797f539284b78d59e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:17.418642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315a443-6826-4ccc-b82d-ca143f9ee6d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53af488f3b0242a797f539284b78d59e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:17.422068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315a443-6826-4ccc-b82d-ca143f9ee6d8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:17.527204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5b2cfd3f-87b6-4dd6-a58d-c0a823b47650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5163e91b263949d2b4ac6cf1e110eb62', 'request_id': 'req-5b2cfd3f-87b6-4dd6-a58d-c0a823b47650'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:17.534383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5b2cfd3f-87b6-4dd6-a58d-c0a823b47650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5163e91b263949d2b4ac6cf1e110eb62', 'request_id': 'req-5b2cfd3f-87b6-4dd6-a58d-c0a823b47650'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:17.544012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5b2cfd3f-87b6-4dd6-a58d-c0a823b47650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5163e91b263949d2b4ac6cf1e110eb62', 'request_id': 'req-5b2cfd3f-87b6-4dd6-a58d-c0a823b47650'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:17.743353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5b2cfd3f-87b6-4dd6-a58d-c0a823b47650 admin admin] The token cache is being invalidate because project 5163e91b263949d2b4ac6cf1e110eb62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:16:17.743762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5b2cfd3f-87b6-4dd6-a58d-c0a823b47650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:17.746393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5b2cfd3f-87b6-4dd6-a58d-c0a823b47650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:17.762559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c315a443-6826-4ccc-b82d-ca143f9ee6d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53af488f3b0242a797f539284b78d59e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:17.764167 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1546/3124] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:16:17 2022] DELETE /identity/v3/projects/5163e91b263949d2b4ac6cf1e110eb62 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:16:17.772315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5edbe-34f3-4cba-aa17-40af92073eaa None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:17.772570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c315a443-6826-4ccc-b82d-ca143f9ee6d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53af488f3b0242a797f539284b78d59e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:17.772682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5edbe-34f3-4cba-aa17-40af92073eaa None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:17.776088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5edbe-34f3-4cba-aa17-40af92073eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:17.811522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3df5edbe-34f3-4cba-aa17-40af92073eaa None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:17.812800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3df5edbe-34f3-4cba-aa17-40af92073eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:17.913098 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1547/3125] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:16:17.920597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82b11c-3964-4774-811e-e2f8ebf58d6f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:17.920938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82b11c-3964-4774-811e-e2f8ebf58d6f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:17.921322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82b11c-3964-4774-811e-e2f8ebf58d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:17.939306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c315a443-6826-4ccc-b82d-ca143f9ee6d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53af488f3b0242a797f539284b78d59e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:17.939306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c315a443-6826-4ccc-b82d-ca143f9ee6d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53af488f3b0242a797f539284b78d59e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:17.963427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:17.975716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c315a443-6826-4ccc-b82d-ca143f9ee6d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53af488f3b0242a797f539284b78d59e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:18.003396 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1579/3126] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:16:17 2022] DELETE /identity/v3/users/53af488f3b0242a797f539284b78d59e => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:16:18.006689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ae82b11c-3964-4774-811e-e2f8ebf58d6f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:18.007491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ae82b11c-3964-4774-811e-e2f8ebf58d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:18.086188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:18.144856 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1548/3127] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:16:18.146197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315a443-6826-4ccc-b82d-ca143f9ee6d8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:18.160988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315a443-6826-4ccc-b82d-ca143f9ee6d8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:18.179306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf99a5c-017a-4bc9-ae37-7b33a1b4d8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:18.179306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf99a5c-017a-4bc9-ae37-7b33a1b4d8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:18.179306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf99a5c-017a-4bc9-ae37-7b33a1b4d8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:18.179306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf99a5c-017a-4bc9-ae37-7b33a1b4d8a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:18.179712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf99a5c-017a-4bc9-ae37-7b33a1b4d8a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:16:18.179712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf99a5c-017a-4bc9-ae37-7b33a1b4d8a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:18.180405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf99a5c-017a-4bc9-ae37-7b33a1b4d8a5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:18.213148 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1580/3128] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:16:18.216637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82b11c-3964-4774-811e-e2f8ebf58d6f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:18.229883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82b11c-3964-4774-811e-e2f8ebf58d6f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:18.237312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324ac9e-7d30-4941-8923-d075c60e373f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:18.238441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324ac9e-7d30-4941-8923-d075c60e373f admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:18.238980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324ac9e-7d30-4941-8923-d075c60e373f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:18.239544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324ac9e-7d30-4941-8923-d075c60e373f admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:18.241510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324ac9e-7d30-4941-8923-d075c60e373f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:18.261170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324ac9e-7d30-4941-8923-d075c60e373f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:18.813651 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1549/3129] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:16:18 2022] POST /identity/v3/projects => generated 381 bytes in 598 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:16:18.818251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf99a5c-017a-4bc9-ae37-7b33a1b4d8a5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:18.846695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324ac9e-7d30-4941-8923-d075c60e373f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:18.849889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a324ac9e-7d30-4941-8923-d075c60e373f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:18.854455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf99a5c-017a-4bc9-ae37-7b33a1b4d8a5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:19.120104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324ac9e-7d30-4941-8923-d075c60e373f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:19.130467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2716ccd-bf4b-4a47-a8ba-8486a20f1ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:19.131635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2716ccd-bf4b-4a47-a8ba-8486a20f1ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:19.132082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2716ccd-bf4b-4a47-a8ba-8486a20f1ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:19.132527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2716ccd-bf4b-4a47-a8ba-8486a20f1ba9 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:19.133257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33dae7-3d39-4390-bd0e-3f06b6e80d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:19.134078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2716ccd-bf4b-4a47-a8ba-8486a20f1ba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:19.134386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33dae7-3d39-4390-bd0e-3f06b6e80d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:19.139113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33dae7-3d39-4390-bd0e-3f06b6e80d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:19.140546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33dae7-3d39-4390-bd0e-3f06b6e80d6b admin admin] PATH_INFO: `/v3/projects/bb1ede0d0b6941cc97278e6c617f9b01` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:19.143950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33dae7-3d39-4390-bd0e-3f06b6e80d6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb1ede0d0b6941cc97278e6c617f9b01)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:19.150859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33dae7-3d39-4390-bd0e-3f06b6e80d6b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:19.151671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2716ccd-bf4b-4a47-a8ba-8486a20f1ba9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:19.302410 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1581/3130] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:16:18 2022] POST /identity/v3/users => generated 291 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:16:19.303425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2716ccd-bf4b-4a47-a8ba-8486a20f1ba9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:19.323154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2716ccd-bf4b-4a47-a8ba-8486a20f1ba9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:19.329630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aec8c1-efd1-464d-980f-6732c076c455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:19.330658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aec8c1-efd1-464d-980f-6732c076c455 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:19.331176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aec8c1-efd1-464d-980f-6732c076c455 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:19.331660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aec8c1-efd1-464d-980f-6732c076c455 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:19.333058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aec8c1-efd1-464d-980f-6732c076c455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:19.335747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aec8c1-efd1-464d-980f-6732c076c455 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:19.356292 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1582/3131] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:16:19.358175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aec8c1-efd1-464d-980f-6732c076c455 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:19.371884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aec8c1-efd1-464d-980f-6732c076c455 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:19.377728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2f33dae7-3d39-4390-bd0e-3f06b6e80d6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb1ede0d0b6941cc97278e6c617f9b01', 'request_id': 'req-2f33dae7-3d39-4390-bd0e-3f06b6e80d6b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:19.399572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2f33dae7-3d39-4390-bd0e-3f06b6e80d6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb1ede0d0b6941cc97278e6c617f9b01', 'request_id': 'req-2f33dae7-3d39-4390-bd0e-3f06b6e80d6b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:19.442591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2f33dae7-3d39-4390-bd0e-3f06b6e80d6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb1ede0d0b6941cc97278e6c617f9b01', 'request_id': 'req-2f33dae7-3d39-4390-bd0e-3f06b6e80d6b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:19.522538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda27e2-0889-4290-b8e0-24b17d143bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:19.523640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda27e2-0889-4290-b8e0-24b17d143bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:19.524096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda27e2-0889-4290-b8e0-24b17d143bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:19.524796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda27e2-0889-4290-b8e0-24b17d143bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:19.525826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda27e2-0889-4290-b8e0-24b17d143bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:19.529811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda27e2-0889-4290-b8e0-24b17d143bb3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:19.557245 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1583/3132] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:16:19.562307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda27e2-0889-4290-b8e0-24b17d143bb3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:19.575469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda27e2-0889-4290-b8e0-24b17d143bb3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:19.588638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fbec6-5c6e-4a0a-9d06-4e204ecc6bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:19.589877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fbec6-5c6e-4a0a-9d06-4e204ecc6bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:19.590162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fbec6-5c6e-4a0a-9d06-4e204ecc6bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:19.590461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fbec6-5c6e-4a0a-9d06-4e204ecc6bb1 admin admin] PATH_INFO: `/v3/projects/57c1e99ad9884d79812e95fbc81512da/users/b7a14721381b4f2cb4def5be76b7b645/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:19.595306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2f33dae7-3d39-4390-bd0e-3f06b6e80d6b admin admin] The token cache is being invalidate because project bb1ede0d0b6941cc97278e6c617f9b01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:16:19.595942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2f33dae7-3d39-4390-bd0e-3f06b6e80d6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:19.604396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2f33dae7-3d39-4390-bd0e-3f06b6e80d6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:19.606906 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1550/3133] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:16:18 2022] DELETE /identity/v3/projects/bb1ede0d0b6941cc97278e6c617f9b01 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:16:19.616001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b446fc9-2942-440f-8b42-e3d9d3175206 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:19.616540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b446fc9-2942-440f-8b42-e3d9d3175206 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:19.616952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b446fc9-2942-440f-8b42-e3d9d3175206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:19.626281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fbec6-5c6e-4a0a-9d06-4e204ecc6bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57c1e99ad9884d79812e95fbc81512da, user_id=b7a14721381b4f2cb4def5be76b7b645, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:19.629630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fbec6-5c6e-4a0a-9d06-4e204ecc6bb1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:19.640601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7b446fc9-2942-440f-8b42-e3d9d3175206 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:19.668437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7b446fc9-2942-440f-8b42-e3d9d3175206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:19.668437 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1551/3134] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:16:19.675893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df126613-4ad8-4237-8b6b-2ad932a0124d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:19.676327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df126613-4ad8-4237-8b6b-2ad932a0124d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:19.676663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df126613-4ad8-4237-8b6b-2ad932a0124d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:19.695485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-df126613-4ad8-4237-8b6b-2ad932a0124d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:19.696806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-df126613-4ad8-4237-8b6b-2ad932a0124d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:19.706080 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1552/3135] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:16:19.710353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df126613-4ad8-4237-8b6b-2ad932a0124d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:19.720759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df126613-4ad8-4237-8b6b-2ad932a0124d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:19.725470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c26f70-06f2-4fc9-9888-743de3912894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:19.726445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c26f70-06f2-4fc9-9888-743de3912894 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:19.726445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c26f70-06f2-4fc9-9888-743de3912894 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:19.726692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c26f70-06f2-4fc9-9888-743de3912894 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:19.727515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c26f70-06f2-4fc9-9888-743de3912894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:16:19.727823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c26f70-06f2-4fc9-9888-743de3912894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:19.729483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c26f70-06f2-4fc9-9888-743de3912894 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:19.743904 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1553/3136] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:16:19.747405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c26f70-06f2-4fc9-9888-743de3912894 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:19.760503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c26f70-06f2-4fc9-9888-743de3912894 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:19.768064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0e897-1b38-45a9-b2e7-f8587442009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:19.769246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0e897-1b38-45a9-b2e7-f8587442009f admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:19.769840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0e897-1b38-45a9-b2e7-f8587442009f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:19.770174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0e897-1b38-45a9-b2e7-f8587442009f admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:19.771357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0e897-1b38-45a9-b2e7-f8587442009f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:19.774874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0e897-1b38-45a9-b2e7-f8587442009f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:19.880103 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1584/3137] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:16:19 2022] PUT /identity/v3/projects/57c1e99ad9884d79812e95fbc81512da/users/b7a14721381b4f2cb4def5be76b7b645/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:16:19.882058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02898f-d0d3-4683-98b0-a7c9e93d4302 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:19.882282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02898f-d0d3-4683-98b0-a7c9e93d4302 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:19.882512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02898f-d0d3-4683-98b0-a7c9e93d4302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:19.910077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9d02898f-d0d3-4683-98b0-a7c9e93d4302 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:19.911637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9d02898f-d0d3-4683-98b0-a7c9e93d4302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:19.917397 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1554/3138] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:16:19 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:16:19.918574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0e897-1b38-45a9-b2e7-f8587442009f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:20.005512 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1585/3139] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:16:20.006328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0e897-1b38-45a9-b2e7-f8587442009f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:20.013325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab73a12-7643-4c13-be6e-a3ad24cf903f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:20.014066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab73a12-7643-4c13-be6e-a3ad24cf903f admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:20.014846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab73a12-7643-4c13-be6e-a3ad24cf903f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:20.015359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab73a12-7643-4c13-be6e-a3ad24cf903f admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:20.017299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab73a12-7643-4c13-be6e-a3ad24cf903f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:20.024591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab73a12-7643-4c13-be6e-a3ad24cf903f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:20.043067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02898f-d0d3-4683-98b0-a7c9e93d4302 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:20.048979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9d02898f-d0d3-4683-98b0-a7c9e93d4302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:20.118015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02898f-d0d3-4683-98b0-a7c9e93d4302 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:20.121849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e78e35-ae6c-4f63-a603-82917d945a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:20.122480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e78e35-ae6c-4f63-a603-82917d945a7e service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:20.122760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e78e35-ae6c-4f63-a603-82917d945a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:20.123054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e78e35-ae6c-4f63-a603-82917d945a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:20.133931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e78e35-ae6c-4f63-a603-82917d945a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:20.135418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e78e35-ae6c-4f63-a603-82917d945a7e service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:20.147419 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1586/3140] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:16:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:16:20.189169 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1555/3141] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:16:19 2022] POST /identity/v3/users => generated 287 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:16:20.194201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e78e35-ae6c-4f63-a603-82917d945a7e service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:20.206150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e78e35-ae6c-4f63-a603-82917d945a7e service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:20.219973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06706d5f-b1d0-4c17-9dd3-aafa2ce39a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:20.219973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06706d5f-b1d0-4c17-9dd3-aafa2ce39a9d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:20.219973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06706d5f-b1d0-4c17-9dd3-aafa2ce39a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:20.219973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06706d5f-b1d0-4c17-9dd3-aafa2ce39a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:20.220385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06706d5f-b1d0-4c17-9dd3-aafa2ce39a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:20.220385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06706d5f-b1d0-4c17-9dd3-aafa2ce39a9d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:20.231372 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1587/3142] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:16:20.235532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab73a12-7643-4c13-be6e-a3ad24cf903f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:20.258792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab73a12-7643-4c13-be6e-a3ad24cf903f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:20.270351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351c10b-d49d-4fd6-9a66-7027f34104ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:20.271212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351c10b-d49d-4fd6-9a66-7027f34104ae admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:20.271615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351c10b-d49d-4fd6-9a66-7027f34104ae admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:20.272475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351c10b-d49d-4fd6-9a66-7027f34104ae admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:20.273425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351c10b-d49d-4fd6-9a66-7027f34104ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:20.275267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351c10b-d49d-4fd6-9a66-7027f34104ae admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:20.304078 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1556/3143] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:16:20.308820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06706d5f-b1d0-4c17-9dd3-aafa2ce39a9d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:20.331608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06706d5f-b1d0-4c17-9dd3-aafa2ce39a9d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:20.337565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd436baf-61ec-4d44-8647-a04bc0c44025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:20.340343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd436baf-61ec-4d44-8647-a04bc0c44025 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:20.340722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd436baf-61ec-4d44-8647-a04bc0c44025 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:20.341170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd436baf-61ec-4d44-8647-a04bc0c44025 admin admin] PATH_INFO: `/v3/projects/9f5f03e09936489fa1505188cefe3445/users/015ac1bbb2df487e99e5bddc60ee6923/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:20.362884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd436baf-61ec-4d44-8647-a04bc0c44025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5f03e09936489fa1505188cefe3445, user_id=015ac1bbb2df487e99e5bddc60ee6923, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:20.366181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd436baf-61ec-4d44-8647-a04bc0c44025 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:20.499791 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1588/3144] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:16:20 2022] PUT /identity/v3/projects/9f5f03e09936489fa1505188cefe3445/users/015ac1bbb2df487e99e5bddc60ee6923/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:16:20.507563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a67a6-4083-4d09-8552-a5ab7cc2faf0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:20.508754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a67a6-4083-4d09-8552-a5ab7cc2faf0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:20.509315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a67a6-4083-4d09-8552-a5ab7cc2faf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:20.558473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a83a67a6-4083-4d09-8552-a5ab7cc2faf0 None None] MFA Rules not processed for user `015ac1bbb2df487e99e5bddc60ee6923`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:20.560200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a83a67a6-4083-4d09-8552-a5ab7cc2faf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:20.656194 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1557/3145] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:16:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:16:20.668094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea7f90-dac1-4033-8083-ecd04a533ee1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:20.671479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea7f90-dac1-4033-8083-ecd04a533ee1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:20.671479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea7f90-dac1-4033-8083-ecd04a533ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:20.701929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-54ea7f90-dac1-4033-8083-ecd04a533ee1 None None] MFA Rules not processed for user `015ac1bbb2df487e99e5bddc60ee6923`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:20.701929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-54ea7f90-dac1-4033-8083-ecd04a533ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:20.715056 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1589/3146] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:16:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:16:20.782088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a67a6-4083-4d09-8552-a5ab7cc2faf0 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:20.783923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a83a67a6-4083-4d09-8552-a5ab7cc2faf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:20.893706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec275f-eec7-4fd4-995d-708cce1f2d39 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:20.894218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec275f-eec7-4fd4-995d-708cce1f2d39 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:20.894324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec275f-eec7-4fd4-995d-708cce1f2d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:20.914293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6fec275f-eec7-4fd4-995d-708cce1f2d39 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:20.915543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6fec275f-eec7-4fd4-995d-708cce1f2d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:20.955266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a67a6-4083-4d09-8552-a5ab7cc2faf0 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:20.962129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b84f8-892e-43ff-85a5-de49b88f97f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:20.963211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b84f8-892e-43ff-85a5-de49b88f97f0 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:20.963728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b84f8-892e-43ff-85a5-de49b88f97f0 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:20.964216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b84f8-892e-43ff-85a5-de49b88f97f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:20.987813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b84f8-892e-43ff-85a5-de49b88f97f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:20.990592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b84f8-892e-43ff-85a5-de49b88f97f0 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:21.005494 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1558/3147] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:16:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:16:21.074893 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1590/3148] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:16:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:16:21.089765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b84f8-892e-43ff-85a5-de49b88f97f0 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:21.095556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-de9b84f8-892e-43ff-85a5-de49b88f97f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:21.146653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:21.194003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b84f8-892e-43ff-85a5-de49b88f97f0 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:21.205088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be58ff-87f8-40e5-a702-d069d081f64a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:21.205386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be58ff-87f8-40e5-a702-d069d081f64a service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:21.205746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be58ff-87f8-40e5-a702-d069d081f64a service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:21.206278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be58ff-87f8-40e5-a702-d069d081f64a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:21.217246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be58ff-87f8-40e5-a702-d069d081f64a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:21.218975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be58ff-87f8-40e5-a702-d069d081f64a service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:21.231333 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1559/3149] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:16:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:16:21.375137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:21.884106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde36e0-3e68-44ed-b61e-92b6474d8641 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:21.884486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde36e0-3e68-44ed-b61e-92b6474d8641 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:21.884839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde36e0-3e68-44ed-b61e-92b6474d8641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:21.914656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-acde36e0-3e68-44ed-b61e-92b6474d8641 None None] MFA Rules not processed for user `015ac1bbb2df487e99e5bddc60ee6923`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:21.916291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-acde36e0-3e68-44ed-b61e-92b6474d8641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:21.930237 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1591/3150] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:16:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:16:23.503169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abc79a-d5b9-4299-b115-3affd9415cf1 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:23.504115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abc79a-d5b9-4299-b115-3affd9415cf1 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:23.504704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abc79a-d5b9-4299-b115-3affd9415cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:23.544880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b7abc79a-d5b9-4299-b115-3affd9415cf1 None None] MFA Rules not processed for user `daf3c9e6634e4ae1bfb492eae1f44c93`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:23.556287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b7abc79a-d5b9-4299-b115-3affd9415cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:23.706801 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1560/3151] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:16:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:16:24.375882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:31.304643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23328bdc-f5b8-4fa5-88b9-4f69ee30a2d4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:31.307990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23328bdc-f5b8-4fa5-88b9-4f69ee30a2d4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:31.307990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23328bdc-f5b8-4fa5-88b9-4f69ee30a2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:31.366243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-23328bdc-f5b8-4fa5-88b9-4f69ee30a2d4 None None] MFA Rules not processed for user `b7a14721381b4f2cb4def5be76b7b645`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:31.367884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-23328bdc-f5b8-4fa5-88b9-4f69ee30a2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:31.415035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:31.648117 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1592/3152] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:16:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:16:31.661116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4415e-2561-41cb-af56-001a74caae6d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:31.662121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4415e-2561-41cb-af56-001a74caae6d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:31.662571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4415e-2561-41cb-af56-001a74caae6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:31.709988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-dcb4415e-2561-41cb-af56-001a74caae6d None None] MFA Rules not processed for user `b7a14721381b4f2cb4def5be76b7b645`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:31.716189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-dcb4415e-2561-41cb-af56-001a74caae6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:31.759188 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1561/3153] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:16:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:16:31.853452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23328bdc-f5b8-4fa5-88b9-4f69ee30a2d4 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:31.892336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23328bdc-f5b8-4fa5-88b9-4f69ee30a2d4 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:31.909753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c6de2-6a1e-4afe-94d2-0d764db27259 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:31.919194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c6de2-6a1e-4afe-94d2-0d764db27259 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:31.919194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c6de2-6a1e-4afe-94d2-0d764db27259 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:31.919194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c6de2-6a1e-4afe-94d2-0d764db27259 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:31.933197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c6de2-6a1e-4afe-94d2-0d764db27259 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:31.934841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c6de2-6a1e-4afe-94d2-0d764db27259 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:31.963835 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1593/3154] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:16:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:16:37.491537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4415e-2561-41cb-af56-001a74caae6d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:37.493551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-dcb4415e-2561-41cb-af56-001a74caae6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:37.610680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:37.635750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4415e-2561-41cb-af56-001a74caae6d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:37.653551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55be24-b0d2-4479-a813-49f3f52eb6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:37.655229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55be24-b0d2-4479-a813-49f3f52eb6e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:37.655539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55be24-b0d2-4479-a813-49f3f52eb6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:37.655795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55be24-b0d2-4479-a813-49f3f52eb6e4 admin admin] PATH_INFO: `/v3/users/4e9df82f95ac4779859972403869096a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:37.657999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55be24-b0d2-4479-a813-49f3f52eb6e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e9df82f95ac4779859972403869096a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:37.662099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55be24-b0d2-4479-a813-49f3f52eb6e4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:38.002029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5e55be24-b0d2-4479-a813-49f3f52eb6e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e9df82f95ac4779859972403869096a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:38.018002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5e55be24-b0d2-4479-a813-49f3f52eb6e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e9df82f95ac4779859972403869096a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:38.147777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5e55be24-b0d2-4479-a813-49f3f52eb6e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e9df82f95ac4779859972403869096a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:38.156214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5e55be24-b0d2-4479-a813-49f3f52eb6e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e9df82f95ac4779859972403869096a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:38.157078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5e55be24-b0d2-4479-a813-49f3f52eb6e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e9df82f95ac4779859972403869096a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:38.163952 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1562/3155] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:16:37 2022] DELETE /identity/v3/users/4e9df82f95ac4779859972403869096a => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:16:39.165058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c6de2-6a1e-4afe-94d2-0d764db27259 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:39.165058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c6de2-6a1e-4afe-94d2-0d764db27259 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:39.165058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155ed95-2874-4f46-9542-bcce72fcc3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:39.165058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155ed95-2874-4f46-9542-bcce72fcc3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:39.168766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155ed95-2874-4f46-9542-bcce72fcc3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:39.168766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155ed95-2874-4f46-9542-bcce72fcc3c5 admin admin] PATH_INFO: `/v3/projects/4337575622d04a26942905c9dc044ba7` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:39.168766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155ed95-2874-4f46-9542-bcce72fcc3c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4337575622d04a26942905c9dc044ba7)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:39.168766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155ed95-2874-4f46-9542-bcce72fcc3c5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:39.461086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4155ed95-2874-4f46-9542-bcce72fcc3c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4337575622d04a26942905c9dc044ba7', 'request_id': 'req-4155ed95-2874-4f46-9542-bcce72fcc3c5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:39.472738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4155ed95-2874-4f46-9542-bcce72fcc3c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4337575622d04a26942905c9dc044ba7', 'request_id': 'req-4155ed95-2874-4f46-9542-bcce72fcc3c5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:39.481397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4155ed95-2874-4f46-9542-bcce72fcc3c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4337575622d04a26942905c9dc044ba7', 'request_id': 'req-4155ed95-2874-4f46-9542-bcce72fcc3c5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:39.594401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4155ed95-2874-4f46-9542-bcce72fcc3c5 admin admin] The token cache is being invalidate because project 4337575622d04a26942905c9dc044ba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:16:39.594706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4155ed95-2874-4f46-9542-bcce72fcc3c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:39.595662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4155ed95-2874-4f46-9542-bcce72fcc3c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:39.598031 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1594/3156] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:16:38 2022] DELETE /identity/v3/projects/4337575622d04a26942905c9dc044ba7 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:16:39.603771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f928a33-f642-480f-b674-1d7d2dda3752 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:39.603771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f928a33-f642-480f-b674-1d7d2dda3752 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:39.604301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f928a33-f642-480f-b674-1d7d2dda3752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:39.638285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3f928a33-f642-480f-b674-1d7d2dda3752 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:39.638285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3f928a33-f642-480f-b674-1d7d2dda3752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:39.774982 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1563/3157] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:16:39.783611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e560eb5-ce98-4366-b6b1-76a85da4cc8f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:39.783946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e560eb5-ce98-4366-b6b1-76a85da4cc8f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:39.784466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e560eb5-ce98-4366-b6b1-76a85da4cc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:39.816764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3e560eb5-ce98-4366-b6b1-76a85da4cc8f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:39.818578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3e560eb5-ce98-4366-b6b1-76a85da4cc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:39.829746 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1595/3158] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:16:39.834335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f928a33-f642-480f-b674-1d7d2dda3752 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:39.856114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f928a33-f642-480f-b674-1d7d2dda3752 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:39.862266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4a2d1-81d6-47a7-b9c7-15ce2a834422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:39.862970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4a2d1-81d6-47a7-b9c7-15ce2a834422 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:39.863490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4a2d1-81d6-47a7-b9c7-15ce2a834422 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:39.863979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4a2d1-81d6-47a7-b9c7-15ce2a834422 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:39.864950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4a2d1-81d6-47a7-b9c7-15ce2a834422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:16:39.865586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4a2d1-81d6-47a7-b9c7-15ce2a834422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:39.867573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4a2d1-81d6-47a7-b9c7-15ce2a834422 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:39.896960 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1564/3159] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:16:39.901183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e560eb5-ce98-4366-b6b1-76a85da4cc8f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:39.916949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e560eb5-ce98-4366-b6b1-76a85da4cc8f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:39.930557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abfbf9-6cfb-4b97-8b19-7b9968fe9f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:39.939177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abfbf9-6cfb-4b97-8b19-7b9968fe9f39 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:39.939532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abfbf9-6cfb-4b97-8b19-7b9968fe9f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:39.939748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abfbf9-6cfb-4b97-8b19-7b9968fe9f39 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:39.940479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abfbf9-6cfb-4b97-8b19-7b9968fe9f39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:39.942427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abfbf9-6cfb-4b97-8b19-7b9968fe9f39 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:40.126076 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1596/3160] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:16:39 2022] POST /identity/v3/projects => generated 385 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:16:40.130310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4a2d1-81d6-47a7-b9c7-15ce2a834422 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:40.149414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4a2d1-81d6-47a7-b9c7-15ce2a834422 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:40.300112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:40.334778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f30e8-5eed-427e-aff6-24d4b6270095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:40.335549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f30e8-5eed-427e-aff6-24d4b6270095 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:40.342150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f30e8-5eed-427e-aff6-24d4b6270095 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:40.342150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f30e8-5eed-427e-aff6-24d4b6270095 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:40.342150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f30e8-5eed-427e-aff6-24d4b6270095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:40.342636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f30e8-5eed-427e-aff6-24d4b6270095 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:40.461027 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1565/3161] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:16:40 2022] POST /identity/v3/users => generated 293 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:16:40.462686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abfbf9-6cfb-4b97-8b19-7b9968fe9f39 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:40.491482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abfbf9-6cfb-4b97-8b19-7b9968fe9f39 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:40.507928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26955a6-7a29-4ff1-b506-f11f9f03bbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:40.511505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26955a6-7a29-4ff1-b506-f11f9f03bbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:40.512180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26955a6-7a29-4ff1-b506-f11f9f03bbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:40.519980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26955a6-7a29-4ff1-b506-f11f9f03bbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:40.522275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26955a6-7a29-4ff1-b506-f11f9f03bbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:40.525639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26955a6-7a29-4ff1-b506-f11f9f03bbe3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:40.528321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:40.548077 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1597/3162] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:16:40.551846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f30e8-5eed-427e-aff6-24d4b6270095 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:40.573416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f30e8-5eed-427e-aff6-24d4b6270095 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:40.586411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf261c1-d4b5-4bd6-b09c-8498fef7f301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:40.598231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf261c1-d4b5-4bd6-b09c-8498fef7f301 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:40.598627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf261c1-d4b5-4bd6-b09c-8498fef7f301 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:40.598915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf261c1-d4b5-4bd6-b09c-8498fef7f301 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:40.599744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf261c1-d4b5-4bd6-b09c-8498fef7f301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:40.610072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf261c1-d4b5-4bd6-b09c-8498fef7f301 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:40.645075 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1566/3163] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:16:40.657637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26955a6-7a29-4ff1-b506-f11f9f03bbe3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:40.672884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26955a6-7a29-4ff1-b506-f11f9f03bbe3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:40.689870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f35ea-62e9-4a5b-a39e-9e60cf9bfff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:40.689870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f35ea-62e9-4a5b-a39e-9e60cf9bfff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:40.689870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f35ea-62e9-4a5b-a39e-9e60cf9bfff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:40.689870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f35ea-62e9-4a5b-a39e-9e60cf9bfff0 admin admin] PATH_INFO: `/v3/projects/7e84496d78d4481e9d7648128868bca2/users/71e9304fc50447d6aac99703b5b6e4e1/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:40.724272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f35ea-62e9-4a5b-a39e-9e60cf9bfff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e84496d78d4481e9d7648128868bca2, user_id=71e9304fc50447d6aac99703b5b6e4e1, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:40.729992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f35ea-62e9-4a5b-a39e-9e60cf9bfff0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:40.885580 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1598/3164] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:16:40 2022] PUT /identity/v3/projects/7e84496d78d4481e9d7648128868bca2/users/71e9304fc50447d6aac99703b5b6e4e1/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:16:40.896786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb56df5-f3b0-4ac6-af98-ad9152ff2f05 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:40.899265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb56df5-f3b0-4ac6-af98-ad9152ff2f05 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:40.899265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb56df5-f3b0-4ac6-af98-ad9152ff2f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:40.957956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0bb56df5-f3b0-4ac6-af98-ad9152ff2f05 None None] MFA Rules not processed for user `71e9304fc50447d6aac99703b5b6e4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:40.963982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0bb56df5-f3b0-4ac6-af98-ad9152ff2f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:41.075789 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1567/3165] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:16:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:16:41.089603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f35ea-62e9-4a5b-a39e-9e60cf9bfff0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:41.095281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9d2f35ea-62e9-4a5b-a39e-9e60cf9bfff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:41.170380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f35ea-62e9-4a5b-a39e-9e60cf9bfff0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:41.175546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c189c4-7276-47be-adc2-86ae7dfbd05e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:41.177487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c189c4-7276-47be-adc2-86ae7dfbd05e service glance] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:41.178160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c189c4-7276-47be-adc2-86ae7dfbd05e service glance] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:41.179447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c189c4-7276-47be-adc2-86ae7dfbd05e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:41.213703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c189c4-7276-47be-adc2-86ae7dfbd05e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:41.216573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c189c4-7276-47be-adc2-86ae7dfbd05e service glance] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:41.235221 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1599/3166] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:16:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:16:42.528346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7dedc-a29d-4b93-9430-fddf8ac197d3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:42.528870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7dedc-a29d-4b93-9430-fddf8ac197d3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:42.529002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7dedc-a29d-4b93-9430-fddf8ac197d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:42.549928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ecb7dedc-a29d-4b93-9430-fddf8ac197d3 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:42.551305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ecb7dedc-a29d-4b93-9430-fddf8ac197d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:42.619981 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1568/3167] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:16:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:16:42.632634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c189c4-7276-47be-adc2-86ae7dfbd05e service glance] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:42.634105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-48c189c4-7276-47be-adc2-86ae7dfbd05e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:42.740171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c189c4-7276-47be-adc2-86ae7dfbd05e service glance] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:42.746744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed23b5-a8d1-4f05-98bb-ef42cfd8e4b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:42.752160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed23b5-a8d1-4f05-98bb-ef42cfd8e4b3 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:42.752160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed23b5-a8d1-4f05-98bb-ef42cfd8e4b3 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:42.752160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed23b5-a8d1-4f05-98bb-ef42cfd8e4b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:42.758805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed23b5-a8d1-4f05-98bb-ef42cfd8e4b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:42.760448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed23b5-a8d1-4f05-98bb-ef42cfd8e4b3 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:42.771507 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1600/3168] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:16:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:16:43.387288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7dedc-a29d-4b93-9430-fddf8ac197d3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:43.389330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ecb7dedc-a29d-4b93-9430-fddf8ac197d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:43.456744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7dedc-a29d-4b93-9430-fddf8ac197d3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:43.461943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c139af4-1dbe-4cc0-bf2e-21ca9613ac2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:43.463625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c139af4-1dbe-4cc0-bf2e-21ca9613ac2c service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:43.464150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c139af4-1dbe-4cc0-bf2e-21ca9613ac2c service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:43.464631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c139af4-1dbe-4cc0-bf2e-21ca9613ac2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:43.470818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0c139af4-1dbe-4cc0-bf2e-21ca9613ac2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:43.563807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c139af4-1dbe-4cc0-bf2e-21ca9613ac2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:43.565447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c139af4-1dbe-4cc0-bf2e-21ca9613ac2c service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:43.577994 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1569/3169] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:16:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:16:43.750423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:45.041079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9cb66-2ed3-4eab-ad93-7bce84b0491d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:45.043588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9cb66-2ed3-4eab-ad93-7bce84b0491d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:45.043588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9cb66-2ed3-4eab-ad93-7bce84b0491d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:45.062825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-43f9cb66-2ed3-4eab-ad93-7bce84b0491d None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:45.064260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-43f9cb66-2ed3-4eab-ad93-7bce84b0491d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:45.074283 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1601/3170] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:16:45.092288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c139af4-1dbe-4cc0-bf2e-21ca9613ac2c service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:45.105899 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c139af4-1dbe-4cc0-bf2e-21ca9613ac2c service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:45.114455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb72890-9d3e-441d-ad9b-84d0ef02777b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:45.115225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb72890-9d3e-441d-ad9b-84d0ef02777b service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:45.115770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb72890-9d3e-441d-ad9b-84d0ef02777b service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:45.116290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb72890-9d3e-441d-ad9b-84d0ef02777b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:45.127789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb72890-9d3e-441d-ad9b-84d0ef02777b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:45.130331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb72890-9d3e-441d-ad9b-84d0ef02777b service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:45.142640 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1570/3171] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:16:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:16:47.101691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3036f9-a1ca-4fae-9502-0267aa0fa42b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:47.102267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3036f9-a1ca-4fae-9502-0267aa0fa42b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:47.102267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3036f9-a1ca-4fae-9502-0267aa0fa42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:47.125212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ec3036f9-a1ca-4fae-9502-0267aa0fa42b None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:47.126435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ec3036f9-a1ca-4fae-9502-0267aa0fa42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:47.141842 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1602/3172] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:16:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:16:47.176818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb72890-9d3e-441d-ad9b-84d0ef02777b service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:47.188714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb72890-9d3e-441d-ad9b-84d0ef02777b service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:47.203363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18660a39-6b95-4da9-a7fc-4a3167325324 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:47.204151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18660a39-6b95-4da9-a7fc-4a3167325324 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:47.204449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18660a39-6b95-4da9-a7fc-4a3167325324 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:47.204837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18660a39-6b95-4da9-a7fc-4a3167325324 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:47.220249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18660a39-6b95-4da9-a7fc-4a3167325324 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:47.222413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18660a39-6b95-4da9-a7fc-4a3167325324 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:47.232467 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1571/3173] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:16:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:16:48.330411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab69b2a-6105-45af-a83d-73ad9a42c15d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:48.330920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab69b2a-6105-45af-a83d-73ad9a42c15d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:48.331259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab69b2a-6105-45af-a83d-73ad9a42c15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:48.355646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-bab69b2a-6105-45af-a83d-73ad9a42c15d None None] MFA Rules not processed for user `71e9304fc50447d6aac99703b5b6e4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:48.355646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bab69b2a-6105-45af-a83d-73ad9a42c15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:48.368368 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1603/3174] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:16:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:16:48.914275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf509b-a5b4-4a5b-a09b-249229d6c058 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:48.915197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf509b-a5b4-4a5b-a09b-249229d6c058 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:48.915480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf509b-a5b4-4a5b-a09b-249229d6c058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:48.937419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-00cf509b-a5b4-4a5b-a09b-249229d6c058 None None] MFA Rules not processed for user `71e9304fc50447d6aac99703b5b6e4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:16:48.939214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-00cf509b-a5b4-4a5b-a09b-249229d6c058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:48.952832 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1572/3175] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:16:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:16:54.274948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab69b2a-6105-45af-a83d-73ad9a42c15d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:54.282175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab69b2a-6105-45af-a83d-73ad9a42c15d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:54.285988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235fba3-2efe-4145-be62-9472e097df7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:54.286667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235fba3-2efe-4145-be62-9472e097df7c service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:54.286990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235fba3-2efe-4145-be62-9472e097df7c service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:54.287312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235fba3-2efe-4145-be62-9472e097df7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:54.289282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3235fba3-2efe-4145-be62-9472e097df7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:54.302800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235fba3-2efe-4145-be62-9472e097df7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:54.304301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235fba3-2efe-4145-be62-9472e097df7c service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:54.315336 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1604/3176] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:16:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:16:57.005321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf509b-a5b4-4a5b-a09b-249229d6c058 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:57.007324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-00cf509b-a5b4-4a5b-a09b-249229d6c058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:57.028873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf509b-a5b4-4a5b-a09b-249229d6c058 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:57.035078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f24ece-e700-42fb-befa-e7ad47ca99e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:57.036356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f24ece-e700-42fb-befa-e7ad47ca99e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:57.036763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f24ece-e700-42fb-befa-e7ad47ca99e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:57.037206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f24ece-e700-42fb-befa-e7ad47ca99e8 admin admin] PATH_INFO: `/v3/users/6a69f9dee03d43beaafa966216b9e289` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:57.038616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f24ece-e700-42fb-befa-e7ad47ca99e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a69f9dee03d43beaafa966216b9e289)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:57.040747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f24ece-e700-42fb-befa-e7ad47ca99e8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:57.332749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-09f24ece-e700-42fb-befa-e7ad47ca99e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a69f9dee03d43beaafa966216b9e289'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:57.365194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-09f24ece-e700-42fb-befa-e7ad47ca99e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a69f9dee03d43beaafa966216b9e289'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:57.471463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-09f24ece-e700-42fb-befa-e7ad47ca99e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a69f9dee03d43beaafa966216b9e289'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:57.486455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-09f24ece-e700-42fb-befa-e7ad47ca99e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a69f9dee03d43beaafa966216b9e289'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:57.487315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-09f24ece-e700-42fb-befa-e7ad47ca99e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a69f9dee03d43beaafa966216b9e289'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:57.497928 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1573/3177] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:16:57 2022] DELETE /identity/v3/users/6a69f9dee03d43beaafa966216b9e289 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:16:58.250278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235fba3-2efe-4145-be62-9472e097df7c service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:58.269366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235fba3-2efe-4145-be62-9472e097df7c service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:58.342166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:58.395393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0939d7e-a594-432a-845c-4d684934e074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:58.396789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0939d7e-a594-432a-845c-4d684934e074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:58.397219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0939d7e-a594-432a-845c-4d684934e074 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:58.397634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0939d7e-a594-432a-845c-4d684934e074 admin admin] PATH_INFO: `/v3/projects/9b769bf8f3ea4e368bf68de1df6538f9` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:58.399822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0939d7e-a594-432a-845c-4d684934e074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b769bf8f3ea4e368bf68de1df6538f9)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:58.407584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0939d7e-a594-432a-845c-4d684934e074 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:58.550009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e0939d7e-a594-432a-845c-4d684934e074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b769bf8f3ea4e368bf68de1df6538f9', 'request_id': 'req-e0939d7e-a594-432a-845c-4d684934e074'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:58.560583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e0939d7e-a594-432a-845c-4d684934e074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b769bf8f3ea4e368bf68de1df6538f9', 'request_id': 'req-e0939d7e-a594-432a-845c-4d684934e074'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:58.567761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e0939d7e-a594-432a-845c-4d684934e074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b769bf8f3ea4e368bf68de1df6538f9', 'request_id': 'req-e0939d7e-a594-432a-845c-4d684934e074'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:58.728054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e0939d7e-a594-432a-845c-4d684934e074 admin admin] The token cache is being invalidate because project 9b769bf8f3ea4e368bf68de1df6538f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:16:58.728348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e0939d7e-a594-432a-845c-4d684934e074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:58.729171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e0939d7e-a594-432a-845c-4d684934e074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:58.731259 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1605/3178] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:16:58 2022] DELETE /identity/v3/projects/9b769bf8f3ea4e368bf68de1df6538f9 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:16:58.736387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f24ece-e700-42fb-befa-e7ad47ca99e8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:16:58.738639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-09f24ece-e700-42fb-befa-e7ad47ca99e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:16:58.761335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f24ece-e700-42fb-befa-e7ad47ca99e8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:16:58.865525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:16:58.876480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf23b60-9f65-415e-97ab-d615f4bee06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:16:58.881998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf23b60-9f65-415e-97ab-d615f4bee06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:16:58.882990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf23b60-9f65-415e-97ab-d615f4bee06e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:16:58.884505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf23b60-9f65-415e-97ab-d615f4bee06e admin admin] PATH_INFO: `/v3/users/ff57da59f5c5440dbcc198885643e41d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:16:58.888145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf23b60-9f65-415e-97ab-d615f4bee06e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff57da59f5c5440dbcc198885643e41d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:16:58.918947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf23b60-9f65-415e-97ab-d615f4bee06e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:16:59.304332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4cf23b60-9f65-415e-97ab-d615f4bee06e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff57da59f5c5440dbcc198885643e41d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:59.333383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4cf23b60-9f65-415e-97ab-d615f4bee06e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff57da59f5c5440dbcc198885643e41d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:59.416437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4cf23b60-9f65-415e-97ab-d615f4bee06e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff57da59f5c5440dbcc198885643e41d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:59.425115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4cf23b60-9f65-415e-97ab-d615f4bee06e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff57da59f5c5440dbcc198885643e41d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:59.425837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4cf23b60-9f65-415e-97ab-d615f4bee06e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff57da59f5c5440dbcc198885643e41d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:16:59.432289 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1574/3179] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:16:58 2022] DELETE /identity/v3/users/ff57da59f5c5440dbcc198885643e41d => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:00.212436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0939d7e-a594-432a-845c-4d684934e074 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:00.215580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e0939d7e-a594-432a-845c-4d684934e074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:00.232098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0939d7e-a594-432a-845c-4d684934e074 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:00.335063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1794e-3067-4837-9119-8987e4f4a4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:00.336045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1794e-3067-4837-9119-8987e4f4a4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:00.336492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1794e-3067-4837-9119-8987e4f4a4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:00.336771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1794e-3067-4837-9119-8987e4f4a4e1 admin admin] PATH_INFO: `/v3/projects/e90ff42dcff94dbf8474491e7c7a5376` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:00.338061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1794e-3067-4837-9119-8987e4f4a4e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e90ff42dcff94dbf8474491e7c7a5376)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:00.340235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1794e-3067-4837-9119-8987e4f4a4e1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:00.489183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c2a1794e-3067-4837-9119-8987e4f4a4e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e90ff42dcff94dbf8474491e7c7a5376', 'request_id': 'req-c2a1794e-3067-4837-9119-8987e4f4a4e1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:00.501482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c2a1794e-3067-4837-9119-8987e4f4a4e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e90ff42dcff94dbf8474491e7c7a5376', 'request_id': 'req-c2a1794e-3067-4837-9119-8987e4f4a4e1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:00.518938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c2a1794e-3067-4837-9119-8987e4f4a4e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e90ff42dcff94dbf8474491e7c7a5376', 'request_id': 'req-c2a1794e-3067-4837-9119-8987e4f4a4e1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:00.523442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:00.627315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c2a1794e-3067-4837-9119-8987e4f4a4e1 admin admin] The token cache is being invalidate because project e90ff42dcff94dbf8474491e7c7a5376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:17:00.630237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c2a1794e-3067-4837-9119-8987e4f4a4e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:00.630468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c2a1794e-3067-4837-9119-8987e4f4a4e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:00.633352 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1606/3180] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:17:00 2022] DELETE /identity/v3/projects/e90ff42dcff94dbf8474491e7c7a5376 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:00.638458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96410fd4-4b3a-4358-a913-ddc815c7497e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:00.639046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96410fd4-4b3a-4358-a913-ddc815c7497e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:00.639046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96410fd4-4b3a-4358-a913-ddc815c7497e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:00.662176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-96410fd4-4b3a-4358-a913-ddc815c7497e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:00.663485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-96410fd4-4b3a-4358-a913-ddc815c7497e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:00.765524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829f2fc-73f3-4aaa-bcb8-db5927e3245b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:00.765735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829f2fc-73f3-4aaa-bcb8-db5927e3245b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:00.766018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829f2fc-73f3-4aaa-bcb8-db5927e3245b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:00.768796 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1575/3181] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:00.795254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e829f2fc-73f3-4aaa-bcb8-db5927e3245b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:00.797229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e829f2fc-73f3-4aaa-bcb8-db5927e3245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:00.807762 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1607/3182] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:00.813400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96410fd4-4b3a-4358-a913-ddc815c7497e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:00.826230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96410fd4-4b3a-4358-a913-ddc815c7497e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:00.832293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d850c8-e852-4a66-be0f-a16cd21c960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:00.833222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d850c8-e852-4a66-be0f-a16cd21c960a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:00.833637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d850c8-e852-4a66-be0f-a16cd21c960a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:00.834164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d850c8-e852-4a66-be0f-a16cd21c960a admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:00.834961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d850c8-e852-4a66-be0f-a16cd21c960a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:17:00.835454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d850c8-e852-4a66-be0f-a16cd21c960a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:00.837480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d850c8-e852-4a66-be0f-a16cd21c960a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:00.855130 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1576/3183] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:17:00.855988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829f2fc-73f3-4aaa-bcb8-db5927e3245b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:00.874798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829f2fc-73f3-4aaa-bcb8-db5927e3245b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:00.880512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32321dc9-4c20-4718-bd1a-5d1615d0f0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:00.881182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32321dc9-4c20-4718-bd1a-5d1615d0f0bc admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:00.881468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32321dc9-4c20-4718-bd1a-5d1615d0f0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:00.881991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32321dc9-4c20-4718-bd1a-5d1615d0f0bc admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:00.882759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32321dc9-4c20-4718-bd1a-5d1615d0f0bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:00.885182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32321dc9-4c20-4718-bd1a-5d1615d0f0bc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:01.021020 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1608/3184] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:17:00 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:17:01.024988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d850c8-e852-4a66-be0f-a16cd21c960a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:01.038621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d850c8-e852-4a66-be0f-a16cd21c960a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:01.231966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd959f40-c15f-4378-b8a2-9eae1b6ca01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:01.232938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd959f40-c15f-4378-b8a2-9eae1b6ca01e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:01.233365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd959f40-c15f-4378-b8a2-9eae1b6ca01e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:01.233931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd959f40-c15f-4378-b8a2-9eae1b6ca01e admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:01.234800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd959f40-c15f-4378-b8a2-9eae1b6ca01e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:01.237117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd959f40-c15f-4378-b8a2-9eae1b6ca01e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:01.402994 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1577/3185] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:17:01 2022] POST /identity/v3/users => generated 289 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:17:01.404979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32321dc9-4c20-4718-bd1a-5d1615d0f0bc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:01.438342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32321dc9-4c20-4718-bd1a-5d1615d0f0bc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:01.455247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22519e5d-8f13-431f-a5e9-0afa119a188f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:01.462156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22519e5d-8f13-431f-a5e9-0afa119a188f admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:01.462460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22519e5d-8f13-431f-a5e9-0afa119a188f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:01.462750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22519e5d-8f13-431f-a5e9-0afa119a188f admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:01.464331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22519e5d-8f13-431f-a5e9-0afa119a188f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:01.468385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22519e5d-8f13-431f-a5e9-0afa119a188f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:01.488250 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1609/3186] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:17:01.491962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd959f40-c15f-4378-b8a2-9eae1b6ca01e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:01.517479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd959f40-c15f-4378-b8a2-9eae1b6ca01e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:01.564659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31602ea1-bbaa-4395-b9bd-7246e97e1286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:01.566852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31602ea1-bbaa-4395-b9bd-7246e97e1286 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:01.567667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31602ea1-bbaa-4395-b9bd-7246e97e1286 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:01.567954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31602ea1-bbaa-4395-b9bd-7246e97e1286 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:01.569155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31602ea1-bbaa-4395-b9bd-7246e97e1286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:01.571653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31602ea1-bbaa-4395-b9bd-7246e97e1286 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:01.585792 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1578/3187] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:17:01.589581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22519e5d-8f13-431f-a5e9-0afa119a188f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:01.604438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22519e5d-8f13-431f-a5e9-0afa119a188f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:01.610985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da7b0d-f011-4e17-a959-0b0de5a7d05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:01.611929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da7b0d-f011-4e17-a959-0b0de5a7d05b admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:01.612210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da7b0d-f011-4e17-a959-0b0de5a7d05b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:01.612481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da7b0d-f011-4e17-a959-0b0de5a7d05b admin admin] PATH_INFO: `/v3/projects/65d5bcfa02af4e8284ba1342197e2860/users/2f5bc1f2209f4eb186d80e385b67c774/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:01.630503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da7b0d-f011-4e17-a959-0b0de5a7d05b admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d5bcfa02af4e8284ba1342197e2860, user_id=2f5bc1f2209f4eb186d80e385b67c774, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:01.633765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da7b0d-f011-4e17-a959-0b0de5a7d05b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:01.716265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4bbcd-cfc3-403d-8385-ad42bb7b1b18 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:01.716265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4bbcd-cfc3-403d-8385-ad42bb7b1b18 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:01.718655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4bbcd-cfc3-403d-8385-ad42bb7b1b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:01.745007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-75e4bbcd-cfc3-403d-8385-ad42bb7b1b18 None None] MFA Rules not processed for user `dd4144b5388b46a989a41a2f556bb508`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:01.750872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-75e4bbcd-cfc3-403d-8385-ad42bb7b1b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:01.788157 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1610/3188] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:17:01 2022] PUT /identity/v3/projects/65d5bcfa02af4e8284ba1342197e2860/users/2f5bc1f2209f4eb186d80e385b67c774/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:01.790233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf15ba-1286-460d-b9f4-159a055b07cc None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:01.790527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf15ba-1286-460d-b9f4-159a055b07cc None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:01.790902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf15ba-1286-460d-b9f4-159a055b07cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:01.825676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-92bf15ba-1286-460d-b9f4-159a055b07cc None None] MFA Rules not processed for user `2f5bc1f2209f4eb186d80e385b67c774`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:01.827340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-92bf15ba-1286-460d-b9f4-159a055b07cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:01.864531 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1579/3189] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:01.923800 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1611/3190] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:01.928097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4bbcd-cfc3-403d-8385-ad42bb7b1b18 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:01.940945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4bbcd-cfc3-403d-8385-ad42bb7b1b18 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:02.046715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383a66b-2738-4d10-87a9-5fe7d99a71e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:02.047962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383a66b-2738-4d10-87a9-5fe7d99a71e4 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:02.048261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383a66b-2738-4d10-87a9-5fe7d99a71e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:02.048542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383a66b-2738-4d10-87a9-5fe7d99a71e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:02.050027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383a66b-2738-4d10-87a9-5fe7d99a71e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:02.052633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383a66b-2738-4d10-87a9-5fe7d99a71e4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:02.080990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:02.160490 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1580/3191] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:17:01 2022] POST /identity/v3/projects => generated 377 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:17:02.161177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf15ba-1286-460d-b9f4-159a055b07cc None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:02.172938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf15ba-1286-460d-b9f4-159a055b07cc None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:02.293257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579dce0a-9a6c-453e-bf8f-0260f827e38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:02.296131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dce0a-9a6c-453e-bf8f-0260f827e38b admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:02.296765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dce0a-9a6c-453e-bf8f-0260f827e38b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:02.297183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dce0a-9a6c-453e-bf8f-0260f827e38b admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:02.298250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579dce0a-9a6c-453e-bf8f-0260f827e38b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:02.300942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579dce0a-9a6c-453e-bf8f-0260f827e38b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:02.425620 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1612/3192] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:17:02 2022] POST /identity/v3/users => generated 295 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:17:02.429315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383a66b-2738-4d10-87a9-5fe7d99a71e4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:02.446740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383a66b-2738-4d10-87a9-5fe7d99a71e4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:02.454260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a483c26-6320-4b68-bdf1-28c11f4febb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:02.456506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a483c26-6320-4b68-bdf1-28c11f4febb5 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:02.456889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a483c26-6320-4b68-bdf1-28c11f4febb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:02.457062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a483c26-6320-4b68-bdf1-28c11f4febb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:02.458619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a483c26-6320-4b68-bdf1-28c11f4febb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:02.459939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a483c26-6320-4b68-bdf1-28c11f4febb5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:02.520122 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1581/3193] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:17:02.524450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579dce0a-9a6c-453e-bf8f-0260f827e38b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:02.544596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579dce0a-9a6c-453e-bf8f-0260f827e38b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:02.557787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b9be9-0721-43a3-8458-a36e368e7de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:02.563182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b9be9-0721-43a3-8458-a36e368e7de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:02.563182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b9be9-0721-43a3-8458-a36e368e7de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:02.563182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b9be9-0721-43a3-8458-a36e368e7de0 admin admin] PATH_INFO: `/v3/projects/d9472fdbbcfb4b3cb81b052cc93d714b/users/b8b803460d624372aaa2da4fe69350ae/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:02.589277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b9be9-0721-43a3-8458-a36e368e7de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9472fdbbcfb4b3cb81b052cc93d714b, user_id=b8b803460d624372aaa2da4fe69350ae, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:02.589277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b9be9-0721-43a3-8458-a36e368e7de0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:02.691490 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1613/3194] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:17:02 2022] PUT /identity/v3/projects/d9472fdbbcfb4b3cb81b052cc93d714b/users/b8b803460d624372aaa2da4fe69350ae/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:17:02.692880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a483c26-6320-4b68-bdf1-28c11f4febb5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:02.705392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a483c26-6320-4b68-bdf1-28c11f4febb5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:02.841357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f2f06-5fd0-4964-a1ca-f425bcf1a33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:02.842158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f2f06-5fd0-4964-a1ca-f425bcf1a33e admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:02.842981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f2f06-5fd0-4964-a1ca-f425bcf1a33e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:02.844081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f2f06-5fd0-4964-a1ca-f425bcf1a33e admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:02.844978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f2f06-5fd0-4964-a1ca-f425bcf1a33e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:02.863738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f2f06-5fd0-4964-a1ca-f425bcf1a33e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:02.887567 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1582/3195] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:17:02.893107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b9be9-0721-43a3-8458-a36e368e7de0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:02.905869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b9be9-0721-43a3-8458-a36e368e7de0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:02.912588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a7e1c-79ba-40e2-9b98-fd8edf159dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:02.913798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a7e1c-79ba-40e2-9b98-fd8edf159dc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:02.914258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a7e1c-79ba-40e2-9b98-fd8edf159dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:02.914711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a7e1c-79ba-40e2-9b98-fd8edf159dc5 admin admin] PATH_INFO: `/v3/projects/d9472fdbbcfb4b3cb81b052cc93d714b/users/b8b803460d624372aaa2da4fe69350ae/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:02.917208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a7e1c-79ba-40e2-9b98-fd8edf159dc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9472fdbbcfb4b3cb81b052cc93d714b, user_id=b8b803460d624372aaa2da4fe69350ae, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:02.920370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a7e1c-79ba-40e2-9b98-fd8edf159dc5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:02.935678 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1614/3196] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:17:02 2022] PUT /identity/v3/projects/d9472fdbbcfb4b3cb81b052cc93d714b/users/b8b803460d624372aaa2da4fe69350ae/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:17:02.947217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e2f1c-fdb8-4f2b-beb0-3fe02a682b46 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:02.947874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e2f1c-fdb8-4f2b-beb0-3fe02a682b46 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:02.948331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e2f1c-fdb8-4f2b-beb0-3fe02a682b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:03.001465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-589e2f1c-fdb8-4f2b-beb0-3fe02a682b46 None None] MFA Rules not processed for user `b8b803460d624372aaa2da4fe69350ae`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:03.003818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-589e2f1c-fdb8-4f2b-beb0-3fe02a682b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:03.137792 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1583/3197] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:03.221078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86c874-9741-42a8-b476-793807e1fbb6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:03.221386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86c874-9741-42a8-b476-793807e1fbb6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:03.221672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86c874-9741-42a8-b476-793807e1fbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:03.243154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2d86c874-9741-42a8-b476-793807e1fbb6 None None] MFA Rules not processed for user `2f5bc1f2209f4eb186d80e385b67c774`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:03.244405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2d86c874-9741-42a8-b476-793807e1fbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:03.324165 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1615/3198] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:03.425411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=6,keystone:DELETE=1,keystone:SELECT=93 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:03.616526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e2f1c-fdb8-4f2b-beb0-3fe02a682b46 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:03.618202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-589e2f1c-fdb8-4f2b-beb0-3fe02a682b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:03.785469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e2f1c-fdb8-4f2b-beb0-3fe02a682b46 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:03.792771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fe402-1c18-49e5-a36f-631f7fd1909f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:03.793669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fe402-1c18-49e5-a36f-631f7fd1909f service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:03.794028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fe402-1c18-49e5-a36f-631f7fd1909f service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:03.794372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fe402-1c18-49e5-a36f-631f7fd1909f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:03.805246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65fe402-1c18-49e5-a36f-631f7fd1909f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:03.812762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65fe402-1c18-49e5-a36f-631f7fd1909f service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:03.819181 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1584/3199] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:17:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:17:05.437543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cd25e-d6d7-4d5c-bfba-a0a444f13bc7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:05.438066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cd25e-d6d7-4d5c-bfba-a0a444f13bc7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:05.438459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cd25e-d6d7-4d5c-bfba-a0a444f13bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:05.499787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9d2cd25e-d6d7-4d5c-bfba-a0a444f13bc7 None None] MFA Rules not processed for user `2f5bc1f2209f4eb186d80e385b67c774`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:05.501664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9d2cd25e-d6d7-4d5c-bfba-a0a444f13bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:05.516833 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1616/3200] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:05.846407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:06.049402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fe402-1c18-49e5-a36f-631f7fd1909f service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:06.050854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c65fe402-1c18-49e5-a36f-631f7fd1909f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:06.169103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fe402-1c18-49e5-a36f-631f7fd1909f service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:06.175639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a07b2b-6e4f-4642-a4a7-fe2a8b1c4767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:06.176980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a07b2b-6e4f-4642-a4a7-fe2a8b1c4767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:06.177427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a07b2b-6e4f-4642-a4a7-fe2a8b1c4767 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:06.177933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a07b2b-6e4f-4642-a4a7-fe2a8b1c4767 admin admin] PATH_INFO: `/v3/users/b7a14721381b4f2cb4def5be76b7b645` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:06.179430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a07b2b-6e4f-4642-a4a7-fe2a8b1c4767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7a14721381b4f2cb4def5be76b7b645)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:06.181461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a07b2b-6e4f-4642-a4a7-fe2a8b1c4767 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:06.532726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d0a07b2b-6e4f-4642-a4a7-fe2a8b1c4767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7a14721381b4f2cb4def5be76b7b645'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:06.556348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d0a07b2b-6e4f-4642-a4a7-fe2a8b1c4767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7a14721381b4f2cb4def5be76b7b645'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:06.641726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d0a07b2b-6e4f-4642-a4a7-fe2a8b1c4767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7a14721381b4f2cb4def5be76b7b645'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:06.656118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d0a07b2b-6e4f-4642-a4a7-fe2a8b1c4767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7a14721381b4f2cb4def5be76b7b645'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:06.656883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d0a07b2b-6e4f-4642-a4a7-fe2a8b1c4767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7a14721381b4f2cb4def5be76b7b645'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:06.666461 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1585/3201] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:17:06 2022] DELETE /identity/v3/users/b7a14721381b4f2cb4def5be76b7b645 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:07.297689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cd25e-d6d7-4d5c-bfba-a0a444f13bc7 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:07.314553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cd25e-d6d7-4d5c-bfba-a0a444f13bc7 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:07.411533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924cdd19-49fd-45ae-a45f-88a142677a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:07.414217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cdd19-49fd-45ae-a45f-88a142677a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:07.414764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cdd19-49fd-45ae-a45f-88a142677a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:07.415127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cdd19-49fd-45ae-a45f-88a142677a5c admin admin] PATH_INFO: `/v3/projects/57c1e99ad9884d79812e95fbc81512da` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:07.416886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924cdd19-49fd-45ae-a45f-88a142677a5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=57c1e99ad9884d79812e95fbc81512da)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:07.419332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924cdd19-49fd-45ae-a45f-88a142677a5c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:07.554350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-924cdd19-49fd-45ae-a45f-88a142677a5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57c1e99ad9884d79812e95fbc81512da', 'request_id': 'req-924cdd19-49fd-45ae-a45f-88a142677a5c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:07.563839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-924cdd19-49fd-45ae-a45f-88a142677a5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57c1e99ad9884d79812e95fbc81512da', 'request_id': 'req-924cdd19-49fd-45ae-a45f-88a142677a5c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:07.571050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-924cdd19-49fd-45ae-a45f-88a142677a5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57c1e99ad9884d79812e95fbc81512da', 'request_id': 'req-924cdd19-49fd-45ae-a45f-88a142677a5c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:07.714402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:07.720269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-924cdd19-49fd-45ae-a45f-88a142677a5c admin admin] The token cache is being invalidate because project 57c1e99ad9884d79812e95fbc81512da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:17:07.720916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-924cdd19-49fd-45ae-a45f-88a142677a5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:07.723906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-924cdd19-49fd-45ae-a45f-88a142677a5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:07.727509 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1617/3202] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:17:07 2022] DELETE /identity/v3/projects/57c1e99ad9884d79812e95fbc81512da => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:07.734635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134ab51-d2d7-40f3-964a-74102f6cfbd9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:07.735714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134ab51-d2d7-40f3-964a-74102f6cfbd9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:07.736136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134ab51-d2d7-40f3-964a-74102f6cfbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:07.772025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b134ab51-d2d7-40f3-964a-74102f6cfbd9 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:07.773262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b134ab51-d2d7-40f3-964a-74102f6cfbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:07.910285 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1586/3203] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:07.918384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c14810-2c52-4184-b062-07fc480641c2 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:07.918810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c14810-2c52-4184-b062-07fc480641c2 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:07.919234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c14810-2c52-4184-b062-07fc480641c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:07.941468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a1c14810-2c52-4184-b062-07fc480641c2 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:07.942764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a1c14810-2c52-4184-b062-07fc480641c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:07.984345 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1618/3204] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:07.992161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134ab51-d2d7-40f3-964a-74102f6cfbd9 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:08.004465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134ab51-d2d7-40f3-964a-74102f6cfbd9 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:08.022047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdb2c7-8bac-4961-bc8c-2b24fd842d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:08.022857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdb2c7-8bac-4961-bc8c-2b24fd842d2f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:08.023264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdb2c7-8bac-4961-bc8c-2b24fd842d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:08.023637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdb2c7-8bac-4961-bc8c-2b24fd842d2f admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:08.024489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdb2c7-8bac-4961-bc8c-2b24fd842d2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:17:08.025013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdb2c7-8bac-4961-bc8c-2b24fd842d2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:08.030036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdb2c7-8bac-4961-bc8c-2b24fd842d2f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:08.079225 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1587/3205] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:17:08.084998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c14810-2c52-4184-b062-07fc480641c2 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:08.101736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c14810-2c52-4184-b062-07fc480641c2 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:08.116574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c919c-f381-4181-8972-afb730da2ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:08.118367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c919c-f381-4181-8972-afb730da2ccd admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:08.119183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c919c-f381-4181-8972-afb730da2ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:08.119696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c919c-f381-4181-8972-afb730da2ccd admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:08.121670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c919c-f381-4181-8972-afb730da2ccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:08.131174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c919c-f381-4181-8972-afb730da2ccd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:08.261900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:08.374439 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1619/3206] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:17:08 2022] POST /identity/v3/projects => generated 399 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:17:08.379302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdb2c7-8bac-4961-bc8c-2b24fd842d2f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:08.400965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdb2c7-8bac-4961-bc8c-2b24fd842d2f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:08.500969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb45f4-9a71-45d6-b361-fd6a54ec6213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:08.502504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb45f4-9a71-45d6-b361-fd6a54ec6213 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:08.503390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb45f4-9a71-45d6-b361-fd6a54ec6213 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:08.503789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb45f4-9a71-45d6-b361-fd6a54ec6213 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:08.504661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb45f4-9a71-45d6-b361-fd6a54ec6213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:08.506972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb45f4-9a71-45d6-b361-fd6a54ec6213 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:08.698088 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1588/3207] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:17:08 2022] POST /identity/v3/users => generated 300 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:17:08.703553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c919c-f381-4181-8972-afb730da2ccd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:08.722085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c919c-f381-4181-8972-afb730da2ccd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:08.742590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a564b67-0ce4-4b3e-a5c0-6d0a11a56f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:08.745483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a564b67-0ce4-4b3e-a5c0-6d0a11a56f7a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:08.746955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a564b67-0ce4-4b3e-a5c0-6d0a11a56f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:08.747989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a564b67-0ce4-4b3e-a5c0-6d0a11a56f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:08.750311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a564b67-0ce4-4b3e-a5c0-6d0a11a56f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:08.752868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a564b67-0ce4-4b3e-a5c0-6d0a11a56f7a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:08.772576 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1620/3208] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:17:08.776431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb45f4-9a71-45d6-b361-fd6a54ec6213 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:08.794217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb45f4-9a71-45d6-b361-fd6a54ec6213 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:08.802357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb1e3d-c1e4-4025-b50b-ec599249157e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:08.803114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb1e3d-c1e4-4025-b50b-ec599249157e admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:08.803408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb1e3d-c1e4-4025-b50b-ec599249157e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:08.803692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb1e3d-c1e4-4025-b50b-ec599249157e admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:08.804433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb1e3d-c1e4-4025-b50b-ec599249157e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:08.807165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb1e3d-c1e4-4025-b50b-ec599249157e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:08.829767 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1589/3209] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:17:08.835045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a564b67-0ce4-4b3e-a5c0-6d0a11a56f7a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:08.850167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a564b67-0ce4-4b3e-a5c0-6d0a11a56f7a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:08.859480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f7901-b979-4201-bfb5-9a669fb633af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:08.860647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f7901-b979-4201-bfb5-9a669fb633af admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:08.860939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f7901-b979-4201-bfb5-9a669fb633af admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:08.861632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f7901-b979-4201-bfb5-9a669fb633af admin admin] PATH_INFO: `/v3/projects/2e8eb118531a44d3872ca521c699dee5/users/1fd5581f5cf04fd798b9c0ac68a93f77/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:08.906968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f7901-b979-4201-bfb5-9a669fb633af admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e8eb118531a44d3872ca521c699dee5, user_id=1fd5581f5cf04fd798b9c0ac68a93f77, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:08.909694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f7901-b979-4201-bfb5-9a669fb633af admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:09.054912 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1621/3210] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:17:08 2022] PUT /identity/v3/projects/2e8eb118531a44d3872ca521c699dee5/users/1fd5581f5cf04fd798b9c0ac68a93f77/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:09.058527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0003746-de21-43e7-a1a0-a3948f75ca81 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:09.058823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0003746-de21-43e7-a1a0-a3948f75ca81 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:09.059163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0003746-de21-43e7-a1a0-a3948f75ca81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:09.111364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f0003746-de21-43e7-a1a0-a3948f75ca81 None None] MFA Rules not processed for user `1fd5581f5cf04fd798b9c0ac68a93f77`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:09.112908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f0003746-de21-43e7-a1a0-a3948f75ca81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:09.213308 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1590/3211] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:09.312237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f7901-b979-4201-bfb5-9a669fb633af admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:09.314527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-378f7901-b979-4201-bfb5-9a669fb633af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:09.470084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f7901-b979-4201-bfb5-9a669fb633af admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:09.490416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc14a6d-8ce3-4094-a562-a9fd81831b21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:09.491299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc14a6d-8ce3-4094-a562-a9fd81831b21 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:09.491732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc14a6d-8ce3-4094-a562-a9fd81831b21 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:09.492155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc14a6d-8ce3-4094-a562-a9fd81831b21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:09.512461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc14a6d-8ce3-4094-a562-a9fd81831b21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:09.515295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc14a6d-8ce3-4094-a562-a9fd81831b21 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:09.543764 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1622/3212] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:17:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:17:09.612013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0003746-de21-43e7-a1a0-a3948f75ca81 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:09.794500 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:09.802443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0003746-de21-43e7-a1a0-a3948f75ca81 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:09.807739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeba296-de12-4303-8b0b-0522e64f7515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:09.808863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeba296-de12-4303-8b0b-0522e64f7515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:09.809361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeba296-de12-4303-8b0b-0522e64f7515 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:09.809816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeba296-de12-4303-8b0b-0522e64f7515 admin admin] PATH_INFO: `/v3/users/1fd5581f5cf04fd798b9c0ac68a93f77` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:09.812662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeba296-de12-4303-8b0b-0522e64f7515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fd5581f5cf04fd798b9c0ac68a93f77)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:09.814966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeba296-de12-4303-8b0b-0522e64f7515 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:10.042182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bdeba296-de12-4303-8b0b-0522e64f7515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fd5581f5cf04fd798b9c0ac68a93f77'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:10.067248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bdeba296-de12-4303-8b0b-0522e64f7515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fd5581f5cf04fd798b9c0ac68a93f77'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:10.169746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bdeba296-de12-4303-8b0b-0522e64f7515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fd5581f5cf04fd798b9c0ac68a93f77'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:10.181152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bdeba296-de12-4303-8b0b-0522e64f7515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fd5581f5cf04fd798b9c0ac68a93f77'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:10.181901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bdeba296-de12-4303-8b0b-0522e64f7515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fd5581f5cf04fd798b9c0ac68a93f77'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:10.231444 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1591/3213] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:17:09 2022] DELETE /identity/v3/users/1fd5581f5cf04fd798b9c0ac68a93f77 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:10.235799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772400f2-5e6d-4f8d-9234-a77ce56865c4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:10.236322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772400f2-5e6d-4f8d-9234-a77ce56865c4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:10.236803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772400f2-5e6d-4f8d-9234-a77ce56865c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:10.257502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-772400f2-5e6d-4f8d-9234-a77ce56865c4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:10.258713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-772400f2-5e6d-4f8d-9234-a77ce56865c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:10.372868 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1623/3214] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:10.384237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeba296-de12-4303-8b0b-0522e64f7515 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:10.386843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bdeba296-de12-4303-8b0b-0522e64f7515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:10.479044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeba296-de12-4303-8b0b-0522e64f7515 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:10.485762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17328b67-b5f9-41c8-b068-4a11a86e72b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:10.486737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17328b67-b5f9-41c8-b068-4a11a86e72b1 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:10.487135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17328b67-b5f9-41c8-b068-4a11a86e72b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:10.487504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17328b67-b5f9-41c8-b068-4a11a86e72b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:10.509213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17328b67-b5f9-41c8-b068-4a11a86e72b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:10.510744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17328b67-b5f9-41c8-b068-4a11a86e72b1 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:10.525025 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1592/3215] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:17:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:17:11.165985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772400f2-5e6d-4f8d-9234-a77ce56865c4 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:11.167629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-772400f2-5e6d-4f8d-9234-a77ce56865c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:11.182926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772400f2-5e6d-4f8d-9234-a77ce56865c4 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:11.190245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158eb234-e3e4-4eee-9728-d6e938b563ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:11.191455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158eb234-e3e4-4eee-9728-d6e938b563ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:11.192051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158eb234-e3e4-4eee-9728-d6e938b563ea admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:11.192510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158eb234-e3e4-4eee-9728-d6e938b563ea admin admin] PATH_INFO: `/v3/projects/2e8eb118531a44d3872ca521c699dee5` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:11.197215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158eb234-e3e4-4eee-9728-d6e938b563ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e8eb118531a44d3872ca521c699dee5)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:11.198551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158eb234-e3e4-4eee-9728-d6e938b563ea admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:11.383358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-158eb234-e3e4-4eee-9728-d6e938b563ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e8eb118531a44d3872ca521c699dee5', 'request_id': 'req-158eb234-e3e4-4eee-9728-d6e938b563ea'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:11.409214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17328b67-b5f9-41c8-b068-4a11a86e72b1 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:11.411665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-17328b67-b5f9-41c8-b068-4a11a86e72b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:11.412813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-158eb234-e3e4-4eee-9728-d6e938b563ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e8eb118531a44d3872ca521c699dee5', 'request_id': 'req-158eb234-e3e4-4eee-9728-d6e938b563ea'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:11.420716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-158eb234-e3e4-4eee-9728-d6e938b563ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e8eb118531a44d3872ca521c699dee5', 'request_id': 'req-158eb234-e3e4-4eee-9728-d6e938b563ea'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:11.425779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17328b67-b5f9-41c8-b068-4a11a86e72b1 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:11.492488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3feb093-01af-4f29-86d1-70be34dfe4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:11.493768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3feb093-01af-4f29-86d1-70be34dfe4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:11.494243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3feb093-01af-4f29-86d1-70be34dfe4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:11.494817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3feb093-01af-4f29-86d1-70be34dfe4b5 admin admin] PATH_INFO: `/v3/users/578b87f863b34f57a571f7e56d44f118` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:11.496929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3feb093-01af-4f29-86d1-70be34dfe4b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=578b87f863b34f57a571f7e56d44f118)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:11.499996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3feb093-01af-4f29-86d1-70be34dfe4b5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:11.547845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-158eb234-e3e4-4eee-9728-d6e938b563ea admin admin] The token cache is being invalidate because project 2e8eb118531a44d3872ca521c699dee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:17:11.548391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-158eb234-e3e4-4eee-9728-d6e938b563ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:11.549063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-158eb234-e3e4-4eee-9728-d6e938b563ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:11.551107 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1624/3216] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:17:11 2022] DELETE /identity/v3/projects/2e8eb118531a44d3872ca521c699dee5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:11.556050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58931a-5237-4fc8-93ce-d543e0173d19 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:11.556402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58931a-5237-4fc8-93ce-d543e0173d19 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:11.556686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58931a-5237-4fc8-93ce-d543e0173d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:11.576083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0b58931a-5237-4fc8-93ce-d543e0173d19 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:11.577386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0b58931a-5237-4fc8-93ce-d543e0173d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:11.588442 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1625/3217] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:11.597936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ced677-6069-47b3-8118-542e3c77eeb6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:11.597936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ced677-6069-47b3-8118-542e3c77eeb6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:11.598099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ced677-6069-47b3-8118-542e3c77eeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:11.618726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f1ced677-6069-47b3-8118-542e3c77eeb6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:11.619994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f1ced677-6069-47b3-8118-542e3c77eeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:11.629168 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1626/3218] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:17:11.633527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ced677-6069-47b3-8118-542e3c77eeb6 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:11.644173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ced677-6069-47b3-8118-542e3c77eeb6 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:11.653536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148e6bf-5027-44be-9309-f2728a55849b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:11.654782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148e6bf-5027-44be-9309-f2728a55849b admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:11.655105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148e6bf-5027-44be-9309-f2728a55849b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:11.655382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148e6bf-5027-44be-9309-f2728a55849b admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:11.656296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148e6bf-5027-44be-9309-f2728a55849b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:17:11.656634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148e6bf-5027-44be-9309-f2728a55849b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:11.658271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148e6bf-5027-44be-9309-f2728a55849b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:11.671364 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1627/3219] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:17:11.675944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148e6bf-5027-44be-9309-f2728a55849b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:11.686218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148e6bf-5027-44be-9309-f2728a55849b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:11.690912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a4b2a-3197-4089-b75a-84bc09e778e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:11.691608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a4b2a-3197-4089-b75a-84bc09e778e7 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:11.691886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a4b2a-3197-4089-b75a-84bc09e778e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:11.692160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a4b2a-3197-4089-b75a-84bc09e778e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:11.692845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a4b2a-3197-4089-b75a-84bc09e778e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:11.694731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a4b2a-3197-4089-b75a-84bc09e778e7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:11.715636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b3feb093-01af-4f29-86d1-70be34dfe4b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '578b87f863b34f57a571f7e56d44f118'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:11.727795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b3feb093-01af-4f29-86d1-70be34dfe4b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '578b87f863b34f57a571f7e56d44f118'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:11.847806 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1628/3220] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:17:11 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:17:11.851952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a4b2a-3197-4089-b75a-84bc09e778e7 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:11.860963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b3feb093-01af-4f29-86d1-70be34dfe4b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '578b87f863b34f57a571f7e56d44f118'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:11.870993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:11.891694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b3feb093-01af-4f29-86d1-70be34dfe4b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '578b87f863b34f57a571f7e56d44f118'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:11.893913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b3feb093-01af-4f29-86d1-70be34dfe4b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '578b87f863b34f57a571f7e56d44f118'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:11.936025 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1593/3221] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:17:11 2022] DELETE /identity/v3/users/578b87f863b34f57a571f7e56d44f118 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:17:11.959038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a4b2a-3197-4089-b75a-84bc09e778e7 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:12.050222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f97d6-d5f6-4419-a5ed-09c2f4dde97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:12.051096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f97d6-d5f6-4419-a5ed-09c2f4dde97a admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:12.051480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f97d6-d5f6-4419-a5ed-09c2f4dde97a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:12.051855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f97d6-d5f6-4419-a5ed-09c2f4dde97a admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:12.052714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f97d6-d5f6-4419-a5ed-09c2f4dde97a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:12.054831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f97d6-d5f6-4419-a5ed-09c2f4dde97a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:12.199179 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1629/3222] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:17:11 2022] POST /identity/v3/users => generated 290 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:17:12.203987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3feb093-01af-4f29-86d1-70be34dfe4b5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:12.205964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b3feb093-01af-4f29-86d1-70be34dfe4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:12.221132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3feb093-01af-4f29-86d1-70be34dfe4b5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:12.226747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b376a-2a25-40e1-aab8-fce60d4c826c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:12.227593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b376a-2a25-40e1-aab8-fce60d4c826c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:12.228098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b376a-2a25-40e1-aab8-fce60d4c826c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:12.228516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b376a-2a25-40e1-aab8-fce60d4c826c admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:12.229378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b376a-2a25-40e1-aab8-fce60d4c826c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:12.231237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b376a-2a25-40e1-aab8-fce60d4c826c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:12.249326 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1594/3223] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:17:12.250523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f97d6-d5f6-4419-a5ed-09c2f4dde97a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:12.263453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f97d6-d5f6-4419-a5ed-09c2f4dde97a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:12.277795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80288aa-6ddc-4bca-8445-b9395493d2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:12.278596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80288aa-6ddc-4bca-8445-b9395493d2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:12.279081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80288aa-6ddc-4bca-8445-b9395493d2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:12.279681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80288aa-6ddc-4bca-8445-b9395493d2d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:12.280643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80288aa-6ddc-4bca-8445-b9395493d2d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:12.282539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80288aa-6ddc-4bca-8445-b9395493d2d9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:12.302680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b376a-2a25-40e1-aab8-fce60d4c826c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:12.311177 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1630/3224] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:17:12.316853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b376a-2a25-40e1-aab8-fce60d4c826c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:12.325639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb01949-2602-4fb4-8e58-615957b81682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:12.328195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb01949-2602-4fb4-8e58-615957b81682 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:12.328573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb01949-2602-4fb4-8e58-615957b81682 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:12.329125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb01949-2602-4fb4-8e58-615957b81682 admin admin] PATH_INFO: `/v3/projects/e353258f9c3048ef84683294e2b8579d/users/d0008fffad8e4708b2c01e03da92c47d/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:12.353098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb01949-2602-4fb4-8e58-615957b81682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e353258f9c3048ef84683294e2b8579d, user_id=d0008fffad8e4708b2c01e03da92c47d, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:12.356130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb01949-2602-4fb4-8e58-615957b81682 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:12.476945 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1595/3225] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:17:12 2022] PUT /identity/v3/projects/e353258f9c3048ef84683294e2b8579d/users/d0008fffad8e4708b2c01e03da92c47d/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:12.483794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f6ec3-2388-4d25-9807-f2f5f521bf3e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:12.484464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f6ec3-2388-4d25-9807-f2f5f521bf3e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:12.485192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f6ec3-2388-4d25-9807-f2f5f521bf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:12.496483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb01949-2602-4fb4-8e58-615957b81682 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:12.503843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-afb01949-2602-4fb4-8e58-615957b81682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:12.530552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5f3f6ec3-2388-4d25-9807-f2f5f521bf3e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:12.535122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5f3f6ec3-2388-4d25-9807-f2f5f521bf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:12.603559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb01949-2602-4fb4-8e58-615957b81682 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:12.609621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf260df7-b91d-44b0-b4c4-64cd3069a601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:12.611349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf260df7-b91d-44b0-b4c4-64cd3069a601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:12.611349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf260df7-b91d-44b0-b4c4-64cd3069a601 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:12.611349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf260df7-b91d-44b0-b4c4-64cd3069a601 admin admin] PATH_INFO: `/v3/projects/d9b92fc544c544f686ac2ab7ff5123b6` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:12.613536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf260df7-b91d-44b0-b4c4-64cd3069a601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9b92fc544c544f686ac2ab7ff5123b6)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:12.615464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf260df7-b91d-44b0-b4c4-64cd3069a601 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:12.636718 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1631/3226] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:12.649276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f6ec3-2388-4d25-9807-f2f5f521bf3e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:12.650791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5f3f6ec3-2388-4d25-9807-f2f5f521bf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:12.744557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f6ec3-2388-4d25-9807-f2f5f521bf3e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:12.745040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cf260df7-b91d-44b0-b4c4-64cd3069a601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b92fc544c544f686ac2ab7ff5123b6', 'request_id': 'req-cf260df7-b91d-44b0-b4c4-64cd3069a601'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:12.752355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cf260df7-b91d-44b0-b4c4-64cd3069a601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b92fc544c544f686ac2ab7ff5123b6', 'request_id': 'req-cf260df7-b91d-44b0-b4c4-64cd3069a601'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:12.762149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cf260df7-b91d-44b0-b4c4-64cd3069a601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b92fc544c544f686ac2ab7ff5123b6', 'request_id': 'req-cf260df7-b91d-44b0-b4c4-64cd3069a601'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:12.857400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18897b-de45-43f0-8221-992739d2912a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:12.858395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18897b-de45-43f0-8221-992739d2912a service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:12.858521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18897b-de45-43f0-8221-992739d2912a service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:12.858802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18897b-de45-43f0-8221-992739d2912a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:12.878470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cf260df7-b91d-44b0-b4c4-64cd3069a601 admin admin] The token cache is being invalidate because project d9b92fc544c544f686ac2ab7ff5123b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:17:12.879440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cf260df7-b91d-44b0-b4c4-64cd3069a601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:12.882813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cf260df7-b91d-44b0-b4c4-64cd3069a601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:12.894783 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1596/3227] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:17:12 2022] DELETE /identity/v3/projects/d9b92fc544c544f686ac2ab7ff5123b6 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:12.899148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf260df7-b91d-44b0-b4c4-64cd3069a601 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:12.900861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cf260df7-b91d-44b0-b4c4-64cd3069a601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:13.019762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf260df7-b91d-44b0-b4c4-64cd3069a601 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:13.032045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:13.037402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18897b-de45-43f0-8221-992739d2912a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:13.040021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18897b-de45-43f0-8221-992739d2912a service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:13.042257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfdb1f-727d-46e1-93da-49dfeea6585d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:13.043882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfdb1f-727d-46e1-93da-49dfeea6585d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:13.046171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfdb1f-727d-46e1-93da-49dfeea6585d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:13.046171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfdb1f-727d-46e1-93da-49dfeea6585d admin admin] PATH_INFO: `/v3/users/2022d33a84b6457abb0ae42747dac56e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:13.047902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbfdb1f-727d-46e1-93da-49dfeea6585d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2022d33a84b6457abb0ae42747dac56e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:13.050749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbfdb1f-727d-46e1-93da-49dfeea6585d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:13.053557 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1632/3228] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:17:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:17:13.569888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cfbfdb1f-727d-46e1-93da-49dfeea6585d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2022d33a84b6457abb0ae42747dac56e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:13.612831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:13.614580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cfbfdb1f-727d-46e1-93da-49dfeea6585d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2022d33a84b6457abb0ae42747dac56e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:13.728235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cfbfdb1f-727d-46e1-93da-49dfeea6585d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2022d33a84b6457abb0ae42747dac56e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:13.741223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cfbfdb1f-727d-46e1-93da-49dfeea6585d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2022d33a84b6457abb0ae42747dac56e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:13.742595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cfbfdb1f-727d-46e1-93da-49dfeea6585d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2022d33a84b6457abb0ae42747dac56e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:13.752992 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1597/3229] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:17:12 2022] DELETE /identity/v3/users/2022d33a84b6457abb0ae42747dac56e => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:14.634453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18897b-de45-43f0-8221-992739d2912a service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:14.671767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18897b-de45-43f0-8221-992739d2912a service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:14.757270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cb678-c14b-4c67-8d58-b336365e30ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:14.758994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cb678-c14b-4c67-8d58-b336365e30ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:14.759533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cb678-c14b-4c67-8d58-b336365e30ca admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:14.760146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cb678-c14b-4c67-8d58-b336365e30ca admin admin] PATH_INFO: `/v3/projects/f3135f7cb65242db8aa7f75a3468e9e0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:14.763130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cb678-c14b-4c67-8d58-b336365e30ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3135f7cb65242db8aa7f75a3468e9e0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:14.767172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cb678-c14b-4c67-8d58-b336365e30ca admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:14.943927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bd9cb678-c14b-4c67-8d58-b336365e30ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3135f7cb65242db8aa7f75a3468e9e0', 'request_id': 'req-bd9cb678-c14b-4c67-8d58-b336365e30ca'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:14.951970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bd9cb678-c14b-4c67-8d58-b336365e30ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3135f7cb65242db8aa7f75a3468e9e0', 'request_id': 'req-bd9cb678-c14b-4c67-8d58-b336365e30ca'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:14.968102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bd9cb678-c14b-4c67-8d58-b336365e30ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3135f7cb65242db8aa7f75a3468e9e0', 'request_id': 'req-bd9cb678-c14b-4c67-8d58-b336365e30ca'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:15.113748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bd9cb678-c14b-4c67-8d58-b336365e30ca admin admin] The token cache is being invalidate because project f3135f7cb65242db8aa7f75a3468e9e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:17:15.114088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bd9cb678-c14b-4c67-8d58-b336365e30ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:15.114782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bd9cb678-c14b-4c67-8d58-b336365e30ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:15.116795 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1633/3230] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:17:14 2022] DELETE /identity/v3/projects/f3135f7cb65242db8aa7f75a3468e9e0 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:15.121708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc5844-8108-4587-82d8-3a5457287fba None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:15.122156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc5844-8108-4587-82d8-3a5457287fba None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:15.122449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc5844-8108-4587-82d8-3a5457287fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:15.156084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-75dc5844-8108-4587-82d8-3a5457287fba None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:15.157715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-75dc5844-8108-4587-82d8-3a5457287fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:15.316038 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1598/3231] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:15.324445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec238f86-054f-4d7f-a4c0-287cd7c16f51 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:15.324735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec238f86-054f-4d7f-a4c0-287cd7c16f51 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:15.325387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec238f86-054f-4d7f-a4c0-287cd7c16f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:15.350091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ec238f86-054f-4d7f-a4c0-287cd7c16f51 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:15.351336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ec238f86-054f-4d7f-a4c0-287cd7c16f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:15.363051 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1634/3232] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:15.366456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc5844-8108-4587-82d8-3a5457287fba None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:15.378648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc5844-8108-4587-82d8-3a5457287fba None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:15.392806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3dd8a7-b116-46c6-bc33-edf1f1c0c21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:15.393498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3dd8a7-b116-46c6-bc33-edf1f1c0c21f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:15.393785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3dd8a7-b116-46c6-bc33-edf1f1c0c21f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:15.394080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3dd8a7-b116-46c6-bc33-edf1f1c0c21f admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:15.395063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3dd8a7-b116-46c6-bc33-edf1f1c0c21f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:17:15.395384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3dd8a7-b116-46c6-bc33-edf1f1c0c21f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:15.399348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3dd8a7-b116-46c6-bc33-edf1f1c0c21f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:15.433842 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1599/3233] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:17:15.438416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec238f86-054f-4d7f-a4c0-287cd7c16f51 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:15.451980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec238f86-054f-4d7f-a4c0-287cd7c16f51 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:15.459886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff998f-98c3-46be-8ab0-7bb5389f93f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:15.460715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff998f-98c3-46be-8ab0-7bb5389f93f2 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:15.460824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff998f-98c3-46be-8ab0-7bb5389f93f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:15.463080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff998f-98c3-46be-8ab0-7bb5389f93f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:15.463941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff998f-98c3-46be-8ab0-7bb5389f93f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:15.471863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff998f-98c3-46be-8ab0-7bb5389f93f2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:15.552693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:15.635451 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1635/3234] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:17:15 2022] POST /identity/v3/projects => generated 387 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:17:15.640083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3dd8a7-b116-46c6-bc33-edf1f1c0c21f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:15.650726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3dd8a7-b116-46c6-bc33-edf1f1c0c21f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:15.742147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3b6b3-0a01-4b28-8d6a-3c57abb17b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:15.743893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3b6b3-0a01-4b28-8d6a-3c57abb17b21 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:15.744335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3b6b3-0a01-4b28-8d6a-3c57abb17b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:15.745544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3b6b3-0a01-4b28-8d6a-3c57abb17b21 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:15.747655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3b6b3-0a01-4b28-8d6a-3c57abb17b21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:15.755133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3b6b3-0a01-4b28-8d6a-3c57abb17b21 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:15.933007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff998f-98c3-46be-8ab0-7bb5389f93f2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:15.935269 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1600/3235] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:17:15 2022] POST /identity/v3/users => generated 294 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:17:15.952445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff998f-98c3-46be-8ab0-7bb5389f93f2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:15.959899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82dc1b-7f03-41c5-b8e0-2e8f007685da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:15.960590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82dc1b-7f03-41c5-b8e0-2e8f007685da admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:15.960876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82dc1b-7f03-41c5-b8e0-2e8f007685da admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:15.961156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82dc1b-7f03-41c5-b8e0-2e8f007685da admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:15.961956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82dc1b-7f03-41c5-b8e0-2e8f007685da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:15.963646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82dc1b-7f03-41c5-b8e0-2e8f007685da admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:15.989042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3b6b3-0a01-4b28-8d6a-3c57abb17b21 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:15.997224 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1636/3236] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:17:16.009289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3b6b3-0a01-4b28-8d6a-3c57abb17b21 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:16.016484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d710d1c-15ca-4aa1-9456-97f02760c82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:16.017561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d710d1c-15ca-4aa1-9456-97f02760c82e admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:16.018056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d710d1c-15ca-4aa1-9456-97f02760c82e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:16.018408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d710d1c-15ca-4aa1-9456-97f02760c82e admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:16.019335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d710d1c-15ca-4aa1-9456-97f02760c82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:16.021172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d710d1c-15ca-4aa1-9456-97f02760c82e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:16.040994 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1601/3237] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:17:16.046185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82dc1b-7f03-41c5-b8e0-2e8f007685da admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:16.061851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82dc1b-7f03-41c5-b8e0-2e8f007685da admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:16.066578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea55d22-8b72-4d24-a661-cacabd299f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:16.067509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea55d22-8b72-4d24-a661-cacabd299f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:16.067789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea55d22-8b72-4d24-a661-cacabd299f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:16.068068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea55d22-8b72-4d24-a661-cacabd299f13 admin admin] PATH_INFO: `/v3/projects/93f69c6c5de141a3a2059f21054d7b4b/users/26052bcf2727489b99a931f9e8c0e6de/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:16.106653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea55d22-8b72-4d24-a661-cacabd299f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f69c6c5de141a3a2059f21054d7b4b, user_id=26052bcf2727489b99a931f9e8c0e6de, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:16.110986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea55d22-8b72-4d24-a661-cacabd299f13 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:16.251508 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1637/3238] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:17:16 2022] PUT /identity/v3/projects/93f69c6c5de141a3a2059f21054d7b4b/users/26052bcf2727489b99a931f9e8c0e6de/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:16.262931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c8c99-54af-459c-b635-bace7f66cf76 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:16.263492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c8c99-54af-459c-b635-bace7f66cf76 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:16.264199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c8c99-54af-459c-b635-bace7f66cf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:16.308245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4c6c8c99-54af-459c-b635-bace7f66cf76 None None] MFA Rules not processed for user `26052bcf2727489b99a931f9e8c0e6de`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:16.311071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4c6c8c99-54af-459c-b635-bace7f66cf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:16.427073 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1602/3239] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:17:16.432404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea55d22-8b72-4d24-a661-cacabd299f13 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:16.495391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:16.523526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea55d22-8b72-4d24-a661-cacabd299f13 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:16.528697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafeb8b-b4c7-48d1-944f-82a54a3da4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:16.530000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafeb8b-b4c7-48d1-944f-82a54a3da4cd admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:16.530278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafeb8b-b4c7-48d1-944f-82a54a3da4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:16.530706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafeb8b-b4c7-48d1-944f-82a54a3da4cd admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:16.531689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafeb8b-b4c7-48d1-944f-82a54a3da4cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:16.533521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafeb8b-b4c7-48d1-944f-82a54a3da4cd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:16.710422 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1638/3240] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:17:16 2022] POST /identity/v3/projects => generated 387 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:17:16.714642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c8c99-54af-459c-b635-bace7f66cf76 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:16.733235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c8c99-54af-459c-b635-bace7f66cf76 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:16.857882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab11f1b-c1cd-4e3e-8da4-70ba09feeadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:16.868939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab11f1b-c1cd-4e3e-8da4-70ba09feeadc admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:16.869288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab11f1b-c1cd-4e3e-8da4-70ba09feeadc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:16.869810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab11f1b-c1cd-4e3e-8da4-70ba09feeadc admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:16.871402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab11f1b-c1cd-4e3e-8da4-70ba09feeadc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:16.875782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab11f1b-c1cd-4e3e-8da4-70ba09feeadc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:17.042820 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1603/3241] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:17:16 2022] POST /identity/v3/users => generated 300 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:17:17.048623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafeb8b-b4c7-48d1-944f-82a54a3da4cd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:17.074372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafeb8b-b4c7-48d1-944f-82a54a3da4cd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:17.086841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa8295-4906-4bf1-9fa5-be151e04a939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:17.087770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa8295-4906-4bf1-9fa5-be151e04a939 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:17.088050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa8295-4906-4bf1-9fa5-be151e04a939 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:17.092993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa8295-4906-4bf1-9fa5-be151e04a939 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:17.092993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa8295-4906-4bf1-9fa5-be151e04a939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:17.092993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa8295-4906-4bf1-9fa5-be151e04a939 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:17.104573 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1639/3242] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:17:17.109306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab11f1b-c1cd-4e3e-8da4-70ba09feeadc admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:17.131935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab11f1b-c1cd-4e3e-8da4-70ba09feeadc admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:17.140014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b4fce-f717-4edd-84e6-7f18aece88c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:17.141226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b4fce-f717-4edd-84e6-7f18aece88c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:17.141742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b4fce-f717-4edd-84e6-7f18aece88c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:17.142450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b4fce-f717-4edd-84e6-7f18aece88c1 admin admin] PATH_INFO: `/v3/projects/076be6e436ab4ab09c71132d391385a9/users/90883c28ae6f4a3aafb39a7f549e8c3c/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:17.177479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b4fce-f717-4edd-84e6-7f18aece88c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=076be6e436ab4ab09c71132d391385a9, user_id=90883c28ae6f4a3aafb39a7f549e8c3c, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:17.180816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b4fce-f717-4edd-84e6-7f18aece88c1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:17.307270 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1604/3243] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:17:17 2022] PUT /identity/v3/projects/076be6e436ab4ab09c71132d391385a9/users/90883c28ae6f4a3aafb39a7f549e8c3c/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:17:17.309200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa8295-4906-4bf1-9fa5-be151e04a939 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:17.321237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa8295-4906-4bf1-9fa5-be151e04a939 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:17.392107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ededa4-1928-4341-8936-db17f2fc01f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:17.393025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ededa4-1928-4341-8936-db17f2fc01f0 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:17.393381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ededa4-1928-4341-8936-db17f2fc01f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:17.394123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ededa4-1928-4341-8936-db17f2fc01f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:17.395044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ededa4-1928-4341-8936-db17f2fc01f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:17.396827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ededa4-1928-4341-8936-db17f2fc01f0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:17.410140 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1640/3244] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:17:17.413971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b4fce-f717-4edd-84e6-7f18aece88c1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:17.425229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b4fce-f717-4edd-84e6-7f18aece88c1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:17.430575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20890b00-1b65-417e-986f-1aeed8a5d145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:17.431926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20890b00-1b65-417e-986f-1aeed8a5d145 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:17.432360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20890b00-1b65-417e-986f-1aeed8a5d145 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:17.432959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20890b00-1b65-417e-986f-1aeed8a5d145 admin admin] PATH_INFO: `/v3/projects/076be6e436ab4ab09c71132d391385a9/users/90883c28ae6f4a3aafb39a7f549e8c3c/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:17.435359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20890b00-1b65-417e-986f-1aeed8a5d145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=076be6e436ab4ab09c71132d391385a9, user_id=90883c28ae6f4a3aafb39a7f549e8c3c, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:17.438714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20890b00-1b65-417e-986f-1aeed8a5d145 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:17.454602 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1605/3245] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:17:17 2022] PUT /identity/v3/projects/076be6e436ab4ab09c71132d391385a9/users/90883c28ae6f4a3aafb39a7f549e8c3c/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:17.465827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b64740-108b-4cc2-94f9-c02dd7eb63e0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:17.466112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b64740-108b-4cc2-94f9-c02dd7eb63e0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:17.466388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b64740-108b-4cc2-94f9-c02dd7eb63e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:17.495840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-65b64740-108b-4cc2-94f9-c02dd7eb63e0 None None] MFA Rules not processed for user `90883c28ae6f4a3aafb39a7f549e8c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:17.497041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-65b64740-108b-4cc2-94f9-c02dd7eb63e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:17.605634 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1641/3246] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:17.702767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20890b00-1b65-417e-986f-1aeed8a5d145 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:17.704864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-20890b00-1b65-417e-986f-1aeed8a5d145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:17.801619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20890b00-1b65-417e-986f-1aeed8a5d145 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:17.807557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f933e6e-4296-40bd-8f1b-7ec8f43a1edf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:17.808224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f933e6e-4296-40bd-8f1b-7ec8f43a1edf service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:17.808505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f933e6e-4296-40bd-8f1b-7ec8f43a1edf service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:17.808788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f933e6e-4296-40bd-8f1b-7ec8f43a1edf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:17.818436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f933e6e-4296-40bd-8f1b-7ec8f43a1edf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:17.820442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f933e6e-4296-40bd-8f1b-7ec8f43a1edf service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:17.833380 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1606/3247] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:17:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:17:18.256522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:18.604219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:18.626578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d8415-7865-42ed-bf1c-f962df4bad55 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:18.626805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d8415-7865-42ed-bf1c-f962df4bad55 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:18.626891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d8415-7865-42ed-bf1c-f962df4bad55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:18.672329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-cd9d8415-7865-42ed-bf1c-f962df4bad55 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:18.673786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cd9d8415-7865-42ed-bf1c-f962df4bad55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:18.859029 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1642/3248] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:17:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:18.882720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f933e6e-4296-40bd-8f1b-7ec8f43a1edf service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:18.884680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2f933e6e-4296-40bd-8f1b-7ec8f43a1edf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:19.036258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f933e6e-4296-40bd-8f1b-7ec8f43a1edf service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:19.041859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c210ec5-ae7e-49d3-b3c6-267a80c7192f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:19.042807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c210ec5-ae7e-49d3-b3c6-267a80c7192f service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:19.043213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c210ec5-ae7e-49d3-b3c6-267a80c7192f service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:19.043708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c210ec5-ae7e-49d3-b3c6-267a80c7192f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:19.057704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c210ec5-ae7e-49d3-b3c6-267a80c7192f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:19.074227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c210ec5-ae7e-49d3-b3c6-267a80c7192f service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:19.076691 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1607/3249] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:17:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:17:21.182478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d8415-7865-42ed-bf1c-f962df4bad55 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:21.184638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cd9d8415-7865-42ed-bf1c-f962df4bad55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:21.310732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d8415-7865-42ed-bf1c-f962df4bad55 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:21.322234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81934905-42be-4c07-815e-4414f38819de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:21.323162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81934905-42be-4c07-815e-4414f38819de admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:21.323442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81934905-42be-4c07-815e-4414f38819de admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:21.323764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81934905-42be-4c07-815e-4414f38819de admin admin] PATH_INFO: `/v3/users/015ac1bbb2df487e99e5bddc60ee6923` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:21.325116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81934905-42be-4c07-815e-4414f38819de admin admin] RBAC: Authorizing `identity:delete_user(user_id=015ac1bbb2df487e99e5bddc60ee6923)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:21.328118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81934905-42be-4c07-815e-4414f38819de admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:21.644673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c210ec5-ae7e-49d3-b3c6-267a80c7192f service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:21.660492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c210ec5-ae7e-49d3-b3c6-267a80c7192f service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:21.672303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcc712-8696-4686-971b-0b451a04bc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:21.673706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcc712-8696-4686-971b-0b451a04bc72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:21.673993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcc712-8696-4686-971b-0b451a04bc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:21.674288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcc712-8696-4686-971b-0b451a04bc72 admin admin] PATH_INFO: `/v3/users/26052bcf2727489b99a931f9e8c0e6de` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:21.675514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcc712-8696-4686-971b-0b451a04bc72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26052bcf2727489b99a931f9e8c0e6de)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:21.678722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcc712-8696-4686-971b-0b451a04bc72 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:21.726107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-81934905-42be-4c07-815e-4414f38819de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '015ac1bbb2df487e99e5bddc60ee6923'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:21.745784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-81934905-42be-4c07-815e-4414f38819de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '015ac1bbb2df487e99e5bddc60ee6923'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:21.967296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-81934905-42be-4c07-815e-4414f38819de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '015ac1bbb2df487e99e5bddc60ee6923'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:21.972754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-81934905-42be-4c07-815e-4414f38819de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '015ac1bbb2df487e99e5bddc60ee6923'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:21.994770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-81934905-42be-4c07-815e-4414f38819de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '015ac1bbb2df487e99e5bddc60ee6923'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:22.016163 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1643/3250] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:17:21 2022] DELETE /identity/v3/users/015ac1bbb2df487e99e5bddc60ee6923 => generated 0 bytes in 830 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:22.020600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84066c-3eb9-4f6f-b6a9-44e1600afc25 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:22.023291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84066c-3eb9-4f6f-b6a9-44e1600afc25 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:22.023291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84066c-3eb9-4f6f-b6a9-44e1600afc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:22.071831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7d84066c-3eb9-4f6f-b6a9-44e1600afc25 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:22.086092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7d84066c-3eb9-4f6f-b6a9-44e1600afc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:22.113951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dedcc712-8696-4686-971b-0b451a04bc72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26052bcf2727489b99a931f9e8c0e6de'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:22.184544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dedcc712-8696-4686-971b-0b451a04bc72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26052bcf2727489b99a931f9e8c0e6de'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:22.231086 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1644/3251] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:22.242354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84066c-3eb9-4f6f-b6a9-44e1600afc25 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:22.244343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7d84066c-3eb9-4f6f-b6a9-44e1600afc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:22.304977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dedcc712-8696-4686-971b-0b451a04bc72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26052bcf2727489b99a931f9e8c0e6de'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:22.319740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dedcc712-8696-4686-971b-0b451a04bc72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26052bcf2727489b99a931f9e8c0e6de'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:22.320590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dedcc712-8696-4686-971b-0b451a04bc72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26052bcf2727489b99a931f9e8c0e6de'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:22.334806 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1608/3252] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:17:21 2022] DELETE /identity/v3/users/26052bcf2727489b99a931f9e8c0e6de => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:22.339659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f8097-f899-4e6c-9e55-965619e15d77 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:22.342197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f8097-f899-4e6c-9e55-965619e15d77 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:22.342197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f8097-f899-4e6c-9e55-965619e15d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:22.403122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-844f8097-f899-4e6c-9e55-965619e15d77 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:22.407746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-844f8097-f899-4e6c-9e55-965619e15d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:22.421682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84066c-3eb9-4f6f-b6a9-44e1600afc25 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:22.577153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1aee2-3b25-44da-a02d-b6934c5017f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:22.577983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1aee2-3b25-44da-a02d-b6934c5017f6 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:22.579533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1aee2-3b25-44da-a02d-b6934c5017f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:22.580055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1aee2-3b25-44da-a02d-b6934c5017f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:22.582163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a3a1aee2-3b25-44da-a02d-b6934c5017f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:22.728598 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1609/3253] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:17:22.742013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f8097-f899-4e6c-9e55-965619e15d77 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:22.748601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-844f8097-f899-4e6c-9e55-965619e15d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:22.765141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1aee2-3b25-44da-a02d-b6934c5017f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:22.767574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1aee2-3b25-44da-a02d-b6934c5017f6 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:22.782891 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1645/3254] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:17:22.788855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f8097-f899-4e6c-9e55-965619e15d77 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:22.793100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86aa16-0df7-4a1c-8eca-15d239d50672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:22.795876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86aa16-0df7-4a1c-8eca-15d239d50672 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:22.796356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86aa16-0df7-4a1c-8eca-15d239d50672 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:22.796875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86aa16-0df7-4a1c-8eca-15d239d50672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:22.808274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86aa16-0df7-4a1c-8eca-15d239d50672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:22.810996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86aa16-0df7-4a1c-8eca-15d239d50672 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:22.828237 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1610/3255] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:17:23.173653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b0167-883c-4181-89c7-d1818ef6eadc None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:23.174548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b0167-883c-4181-89c7-d1818ef6eadc None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:23.174929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b0167-883c-4181-89c7-d1818ef6eadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:23.226176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-da6b0167-883c-4181-89c7-d1818ef6eadc None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:23.230519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:23.233414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-da6b0167-883c-4181-89c7-d1818ef6eadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:23.403526 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1646/3256] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:17:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:23.427512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86aa16-0df7-4a1c-8eca-15d239d50672 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:23.430037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6a86aa16-0df7-4a1c-8eca-15d239d50672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:23.492851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:23.598575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86aa16-0df7-4a1c-8eca-15d239d50672 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:23.604255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54da4f-e193-46e9-91a1-c0101ca6de71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:23.606077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54da4f-e193-46e9-91a1-c0101ca6de71 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:23.606596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54da4f-e193-46e9-91a1-c0101ca6de71 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:23.608565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54da4f-e193-46e9-91a1-c0101ca6de71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:23.621946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54da4f-e193-46e9-91a1-c0101ca6de71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:23.624996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54da4f-e193-46e9-91a1-c0101ca6de71 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:23.640607 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1611/3257] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:17:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:17:23.896839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b0167-883c-4181-89c7-d1818ef6eadc None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:23.898328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-da6b0167-883c-4181-89c7-d1818ef6eadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:23.928078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b0167-883c-4181-89c7-d1818ef6eadc None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:23.951094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164d6f4-18e5-4172-b5a8-10d4818e6d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:23.953674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164d6f4-18e5-4172-b5a8-10d4818e6d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:23.954165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164d6f4-18e5-4172-b5a8-10d4818e6d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:23.954702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164d6f4-18e5-4172-b5a8-10d4818e6d72 admin admin] PATH_INFO: `/v3/projects/9f5f03e09936489fa1505188cefe3445` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:23.960312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164d6f4-18e5-4172-b5a8-10d4818e6d72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f5f03e09936489fa1505188cefe3445)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:23.967081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164d6f4-18e5-4172-b5a8-10d4818e6d72 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:24.142614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930ba0b-980b-4d75-952e-f9f86df306a2 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:24.143189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930ba0b-980b-4d75-952e-f9f86df306a2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:24.143536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930ba0b-980b-4d75-952e-f9f86df306a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:24.223541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7930ba0b-980b-4d75-952e-f9f86df306a2 None None] MFA Rules not processed for user `d0008fffad8e4708b2c01e03da92c47d`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:24.225469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7930ba0b-980b-4d75-952e-f9f86df306a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:24.241598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7164d6f4-18e5-4172-b5a8-10d4818e6d72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f5f03e09936489fa1505188cefe3445', 'request_id': 'req-7164d6f4-18e5-4172-b5a8-10d4818e6d72'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:24.268250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7164d6f4-18e5-4172-b5a8-10d4818e6d72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f5f03e09936489fa1505188cefe3445', 'request_id': 'req-7164d6f4-18e5-4172-b5a8-10d4818e6d72'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:24.291798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7164d6f4-18e5-4172-b5a8-10d4818e6d72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f5f03e09936489fa1505188cefe3445', 'request_id': 'req-7164d6f4-18e5-4172-b5a8-10d4818e6d72'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:24.334647 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1612/3258] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:17:24.335759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930ba0b-980b-4d75-952e-f9f86df306a2 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:24.347600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7930ba0b-980b-4d75-952e-f9f86df306a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:24.411313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7164d6f4-18e5-4172-b5a8-10d4818e6d72 admin admin] The token cache is being invalidate because project 9f5f03e09936489fa1505188cefe3445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:17:24.412081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7164d6f4-18e5-4172-b5a8-10d4818e6d72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:24.413006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7164d6f4-18e5-4172-b5a8-10d4818e6d72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:24.417387 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1647/3259] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:17:23 2022] DELETE /identity/v3/projects/9f5f03e09936489fa1505188cefe3445 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:24.422994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d148869-f353-4475-9a34-942161bd73b9 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:24.423375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d148869-f353-4475-9a34-942161bd73b9 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:24.423720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d148869-f353-4475-9a34-942161bd73b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:24.505108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0d148869-f353-4475-9a34-942161bd73b9 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:24.505281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930ba0b-980b-4d75-952e-f9f86df306a2 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:24.505370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0d148869-f353-4475-9a34-942161bd73b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:24.517265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ffb63-331b-4f5c-b1fd-f3aa93940aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:24.518750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ffb63-331b-4f5c-b1fd-f3aa93940aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:24.519320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ffb63-331b-4f5c-b1fd-f3aa93940aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:24.519978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ffb63-331b-4f5c-b1fd-f3aa93940aeb admin admin] PATH_INFO: `/v3/projects/93f69c6c5de141a3a2059f21054d7b4b` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:24.521384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ffb63-331b-4f5c-b1fd-f3aa93940aeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=93f69c6c5de141a3a2059f21054d7b4b)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:24.523830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ffb63-331b-4f5c-b1fd-f3aa93940aeb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:24.541764 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1648/3260] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:24.551503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbe28a-3d35-4867-946e-14075fe19388 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:24.551801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbe28a-3d35-4867-946e-14075fe19388 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:24.552083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbe28a-3d35-4867-946e-14075fe19388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:24.616537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1cfbe28a-3d35-4867-946e-14075fe19388 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:24.617788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1cfbe28a-3d35-4867-946e-14075fe19388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:24.656894 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1649/3261] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:17:24.661328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbe28a-3d35-4867-946e-14075fe19388 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:24.684105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbe28a-3d35-4867-946e-14075fe19388 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:24.708377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-615ffb63-331b-4f5c-b1fd-f3aa93940aeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93f69c6c5de141a3a2059f21054d7b4b', 'request_id': 'req-615ffb63-331b-4f5c-b1fd-f3aa93940aeb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:24.727342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-615ffb63-331b-4f5c-b1fd-f3aa93940aeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93f69c6c5de141a3a2059f21054d7b4b', 'request_id': 'req-615ffb63-331b-4f5c-b1fd-f3aa93940aeb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:24.745637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-615ffb63-331b-4f5c-b1fd-f3aa93940aeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93f69c6c5de141a3a2059f21054d7b4b', 'request_id': 'req-615ffb63-331b-4f5c-b1fd-f3aa93940aeb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:24.854980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-615ffb63-331b-4f5c-b1fd-f3aa93940aeb admin admin] The token cache is being invalidate because project 93f69c6c5de141a3a2059f21054d7b4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:17:24.855316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-615ffb63-331b-4f5c-b1fd-f3aa93940aeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:24.856564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-615ffb63-331b-4f5c-b1fd-f3aa93940aeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:24.858635 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1613/3262] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:17:24 2022] DELETE /identity/v3/projects/93f69c6c5de141a3a2059f21054d7b4b => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:24.867571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ffb63-331b-4f5c-b1fd-f3aa93940aeb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:24.870259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-615ffb63-331b-4f5c-b1fd-f3aa93940aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:24.877520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf6479-1c75-42b7-bde8-6c2981d74251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:24.882314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf6479-1c75-42b7-bde8-6c2981d74251 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:24.882314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf6479-1c75-42b7-bde8-6c2981d74251 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:24.882314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf6479-1c75-42b7-bde8-6c2981d74251 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:24.882314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf6479-1c75-42b7-bde8-6c2981d74251 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:17:24.882314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf6479-1c75-42b7-bde8-6c2981d74251 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:24.883498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf6479-1c75-42b7-bde8-6c2981d74251 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:24.909942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ffb63-331b-4f5c-b1fd-f3aa93940aeb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:24.919785 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1650/3263] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:17:24.926144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf6479-1c75-42b7-bde8-6c2981d74251 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:24.928686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67707ec-935a-48b4-bd8e-a25aa88421cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:24.929584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67707ec-935a-48b4-bd8e-a25aa88421cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:24.929872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67707ec-935a-48b4-bd8e-a25aa88421cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:24.930146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67707ec-935a-48b4-bd8e-a25aa88421cd admin admin] PATH_INFO: `/v3/users/90883c28ae6f4a3aafb39a7f549e8c3c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:24.931719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67707ec-935a-48b4-bd8e-a25aa88421cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=90883c28ae6f4a3aafb39a7f549e8c3c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:24.933658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67707ec-935a-48b4-bd8e-a25aa88421cd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:24.943708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fedf6479-1c75-42b7-bde8-6c2981d74251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:24.979915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf6479-1c75-42b7-bde8-6c2981d74251 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:25.001322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120749b2-50d8-439e-bde5-0c76c4f7cfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:25.002002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120749b2-50d8-439e-bde5-0c76c4f7cfdb admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:25.002354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120749b2-50d8-439e-bde5-0c76c4f7cfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:25.002557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120749b2-50d8-439e-bde5-0c76c4f7cfdb admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:25.003292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120749b2-50d8-439e-bde5-0c76c4f7cfdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:25.005226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120749b2-50d8-439e-bde5-0c76c4f7cfdb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:25.221819 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1651/3264] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:17:24 2022] POST /identity/v3/projects => generated 405 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:17:25.225123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120749b2-50d8-439e-bde5-0c76c4f7cfdb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:25.299062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:25.359605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a67707ec-935a-48b4-bd8e-a25aa88421cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90883c28ae6f4a3aafb39a7f549e8c3c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:25.377323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a67707ec-935a-48b4-bd8e-a25aa88421cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90883c28ae6f4a3aafb39a7f549e8c3c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:25.383313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120749b2-50d8-439e-bde5-0c76c4f7cfdb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:25.393308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891d6c2-37a6-45b8-ae73-57cca03a45f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:25.393998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891d6c2-37a6-45b8-ae73-57cca03a45f0 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:25.394634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891d6c2-37a6-45b8-ae73-57cca03a45f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:25.395654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891d6c2-37a6-45b8-ae73-57cca03a45f0 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:25.396681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891d6c2-37a6-45b8-ae73-57cca03a45f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:25.400695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891d6c2-37a6-45b8-ae73-57cca03a45f0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:25.462131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a67707ec-935a-48b4-bd8e-a25aa88421cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90883c28ae6f4a3aafb39a7f549e8c3c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:25.471451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a67707ec-935a-48b4-bd8e-a25aa88421cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90883c28ae6f4a3aafb39a7f549e8c3c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:25.472534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a67707ec-935a-48b4-bd8e-a25aa88421cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90883c28ae6f4a3aafb39a7f549e8c3c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:25.488470 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1614/3265] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:17:24 2022] DELETE /identity/v3/users/90883c28ae6f4a3aafb39a7f549e8c3c => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:25.581898 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1652/3266] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:17:25 2022] POST /identity/v3/users => generated 303 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:17:25.587188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67707ec-935a-48b4-bd8e-a25aa88421cd admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:25.589149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a67707ec-935a-48b4-bd8e-a25aa88421cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:25.706218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67707ec-935a-48b4-bd8e-a25aa88421cd admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:25.714445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb8031-df36-42b8-bc7c-924c072dbfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:25.714445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb8031-df36-42b8-bc7c-924c072dbfec admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:25.714445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb8031-df36-42b8-bc7c-924c072dbfec admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:25.714785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb8031-df36-42b8-bc7c-924c072dbfec admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:25.715384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb8031-df36-42b8-bc7c-924c072dbfec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:25.719264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb8031-df36-42b8-bc7c-924c072dbfec admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:25.734553 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1615/3267] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:17:25.738677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891d6c2-37a6-45b8-ae73-57cca03a45f0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:25.760747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891d6c2-37a6-45b8-ae73-57cca03a45f0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:25.788964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848583c-6acd-48b6-8328-c4d36004a574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:25.789962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848583c-6acd-48b6-8328-c4d36004a574 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:25.790502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848583c-6acd-48b6-8328-c4d36004a574 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:25.790932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848583c-6acd-48b6-8328-c4d36004a574 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:25.792797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848583c-6acd-48b6-8328-c4d36004a574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:25.797293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848583c-6acd-48b6-8328-c4d36004a574 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:25.823285 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1653/3268] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:17:25.827875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb8031-df36-42b8-bc7c-924c072dbfec admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:25.845408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb8031-df36-42b8-bc7c-924c072dbfec admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:25.859815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb719c00-cabf-45e5-a666-092b476ea840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:25.866824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb719c00-cabf-45e5-a666-092b476ea840 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:25.867168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb719c00-cabf-45e5-a666-092b476ea840 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:25.867448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb719c00-cabf-45e5-a666-092b476ea840 admin admin] PATH_INFO: `/v3/projects/ba229aaef0ec4ddcadd1d940376c31ac/users/50cdc134e712487196f6623c5cf14592/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:25.891186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb719c00-cabf-45e5-a666-092b476ea840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba229aaef0ec4ddcadd1d940376c31ac, user_id=50cdc134e712487196f6623c5cf14592, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:25.897016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb719c00-cabf-45e5-a666-092b476ea840 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:25.970647 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1616/3269] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:17:25 2022] PUT /identity/v3/projects/ba229aaef0ec4ddcadd1d940376c31ac/users/50cdc134e712487196f6623c5cf14592/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:17:25.976007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7236ab-4a0d-49ca-8888-90a053701e65 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:25.976600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7236ab-4a0d-49ca-8888-90a053701e65 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:25.977096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7236ab-4a0d-49ca-8888-90a053701e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:26.001471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ce7236ab-4a0d-49ca-8888-90a053701e65 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:26.003231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ce7236ab-4a0d-49ca-8888-90a053701e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:26.116536 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1654/3270] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:26.134386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb719c00-cabf-45e5-a666-092b476ea840 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:26.139846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bb719c00-cabf-45e5-a666-092b476ea840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:26.236638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb719c00-cabf-45e5-a666-092b476ea840 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:26.241038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd36b8-1d2e-4b91-b3cb-1f8bb8d67de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:26.241857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd36b8-1d2e-4b91-b3cb-1f8bb8d67de3 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:26.242233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd36b8-1d2e-4b91-b3cb-1f8bb8d67de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:26.242645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd36b8-1d2e-4b91-b3cb-1f8bb8d67de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:26.262259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd36b8-1d2e-4b91-b3cb-1f8bb8d67de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:26.265032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd36b8-1d2e-4b91-b3cb-1f8bb8d67de3 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:26.280990 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1617/3271] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:17:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:17:26.373338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7236ab-4a0d-49ca-8888-90a053701e65 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:26.375952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ce7236ab-4a0d-49ca-8888-90a053701e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:26.413280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7236ab-4a0d-49ca-8888-90a053701e65 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:26.433834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2000e-26e9-4423-b017-f09368f11531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:26.435645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2000e-26e9-4423-b017-f09368f11531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:26.436711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2000e-26e9-4423-b017-f09368f11531 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:26.437232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2000e-26e9-4423-b017-f09368f11531 admin admin] PATH_INFO: `/v3/projects/076be6e436ab4ab09c71132d391385a9` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:26.439959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2000e-26e9-4423-b017-f09368f11531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=076be6e436ab4ab09c71132d391385a9)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:26.445659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2000e-26e9-4423-b017-f09368f11531 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:26.481153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:26.661441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b3d2000e-26e9-4423-b017-f09368f11531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '076be6e436ab4ab09c71132d391385a9', 'request_id': 'req-b3d2000e-26e9-4423-b017-f09368f11531'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:26.678902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b3d2000e-26e9-4423-b017-f09368f11531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '076be6e436ab4ab09c71132d391385a9', 'request_id': 'req-b3d2000e-26e9-4423-b017-f09368f11531'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:26.687202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b3d2000e-26e9-4423-b017-f09368f11531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '076be6e436ab4ab09c71132d391385a9', 'request_id': 'req-b3d2000e-26e9-4423-b017-f09368f11531'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:26.793360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b3d2000e-26e9-4423-b017-f09368f11531 admin admin] The token cache is being invalidate because project 076be6e436ab4ab09c71132d391385a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:17:26.795352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b3d2000e-26e9-4423-b017-f09368f11531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:26.796390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b3d2000e-26e9-4423-b017-f09368f11531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:26.798700 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1655/3272] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:17:26 2022] DELETE /identity/v3/projects/076be6e436ab4ab09c71132d391385a9 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:26.803618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195aba1f-967c-4f37-9e1d-b2ccec566189 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:26.803905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195aba1f-967c-4f37-9e1d-b2ccec566189 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:26.804179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195aba1f-967c-4f37-9e1d-b2ccec566189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:26.885856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-195aba1f-967c-4f37-9e1d-b2ccec566189 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:26.893715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-195aba1f-967c-4f37-9e1d-b2ccec566189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:27.088390 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1618/3273] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:27.096746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14171b-edf2-4078-8a79-682086696bb8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:27.097034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14171b-edf2-4078-8a79-682086696bb8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:27.097802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14171b-edf2-4078-8a79-682086696bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:27.140878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7c14171b-edf2-4078-8a79-682086696bb8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:27.142121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7c14171b-edf2-4078-8a79-682086696bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:27.174390 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1656/3274] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:27.178583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195aba1f-967c-4f37-9e1d-b2ccec566189 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:27.203040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195aba1f-967c-4f37-9e1d-b2ccec566189 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:27.216936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218791a-4b75-42f4-8efc-0b40127a884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:27.217668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218791a-4b75-42f4-8efc-0b40127a884a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:27.219186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218791a-4b75-42f4-8efc-0b40127a884a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:27.220234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218791a-4b75-42f4-8efc-0b40127a884a admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:27.221708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218791a-4b75-42f4-8efc-0b40127a884a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:17:27.223490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218791a-4b75-42f4-8efc-0b40127a884a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:27.227556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218791a-4b75-42f4-8efc-0b40127a884a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:27.296273 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1619/3275] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:17:27.298276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14171b-edf2-4078-8a79-682086696bb8 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:27.313727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14171b-edf2-4078-8a79-682086696bb8 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:27.329980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da85eec-6168-447b-bda9-2d8a476a7142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:27.330513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da85eec-6168-447b-bda9-2d8a476a7142 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:27.330793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da85eec-6168-447b-bda9-2d8a476a7142 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:27.331093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da85eec-6168-447b-bda9-2d8a476a7142 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:27.331810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da85eec-6168-447b-bda9-2d8a476a7142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:27.338553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da85eec-6168-447b-bda9-2d8a476a7142 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:27.518554 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1657/3276] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:17:27 2022] POST /identity/v3/projects => generated 373 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:17:27.522984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218791a-4b75-42f4-8efc-0b40127a884a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:27.538083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218791a-4b75-42f4-8efc-0b40127a884a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:27.723434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155e3db-0083-415a-84cc-46f2e600fb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:27.725792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155e3db-0083-415a-84cc-46f2e600fb8e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:27.726474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155e3db-0083-415a-84cc-46f2e600fb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:27.726912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155e3db-0083-415a-84cc-46f2e600fb8e admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:27.728467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155e3db-0083-415a-84cc-46f2e600fb8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:27.734459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155e3db-0083-415a-84cc-46f2e600fb8e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:27.865440 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1620/3277] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:17:27 2022] POST /identity/v3/users => generated 287 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:17:27.867703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da85eec-6168-447b-bda9-2d8a476a7142 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:27.886941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da85eec-6168-447b-bda9-2d8a476a7142 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:27.901578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f21659-0b55-4613-96ee-32cc24f88b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:27.902277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f21659-0b55-4613-96ee-32cc24f88b94 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:27.902560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f21659-0b55-4613-96ee-32cc24f88b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:27.902853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f21659-0b55-4613-96ee-32cc24f88b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:27.905174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f21659-0b55-4613-96ee-32cc24f88b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:27.914357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f21659-0b55-4613-96ee-32cc24f88b94 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:27.940195 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1658/3278] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:17:27.944069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155e3db-0083-415a-84cc-46f2e600fb8e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:27.965206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155e3db-0083-415a-84cc-46f2e600fb8e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:27.979353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34367b-bdb8-44a4-a8c0-4a0ccda6242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:27.981910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34367b-bdb8-44a4-a8c0-4a0ccda6242f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:27.982337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34367b-bdb8-44a4-a8c0-4a0ccda6242f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:27.982630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34367b-bdb8-44a4-a8c0-4a0ccda6242f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:27.983402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34367b-bdb8-44a4-a8c0-4a0ccda6242f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:27.989677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34367b-bdb8-44a4-a8c0-4a0ccda6242f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:28.024654 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1621/3279] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:17:28.025861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f21659-0b55-4613-96ee-32cc24f88b94 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:28.050500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f21659-0b55-4613-96ee-32cc24f88b94 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:28.062657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5155b0-cfaa-4b79-9b07-15da3ad84b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:28.063801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5155b0-cfaa-4b79-9b07-15da3ad84b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:28.064029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5155b0-cfaa-4b79-9b07-15da3ad84b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:28.064400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5155b0-cfaa-4b79-9b07-15da3ad84b20 admin admin] PATH_INFO: `/v3/projects/91b1f5c0b05b4bcaaf82c7ed60e812b3/users/c9a289918456454689e5383cc94871cd/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:28.109936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5155b0-cfaa-4b79-9b07-15da3ad84b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b1f5c0b05b4bcaaf82c7ed60e812b3, user_id=c9a289918456454689e5383cc94871cd, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:28.115144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5155b0-cfaa-4b79-9b07-15da3ad84b20 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:28.141106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:28.242497 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1659/3280] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:17:28 2022] PUT /identity/v3/projects/91b1f5c0b05b4bcaaf82c7ed60e812b3/users/c9a289918456454689e5383cc94871cd/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:28.246912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad320562-2fa9-4e67-9205-7655d9775501 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:28.247848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad320562-2fa9-4e67-9205-7655d9775501 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:28.248271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad320562-2fa9-4e67-9205-7655d9775501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:28.308036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ad320562-2fa9-4e67-9205-7655d9775501 None None] MFA Rules not processed for user `c9a289918456454689e5383cc94871cd`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:28.310845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ad320562-2fa9-4e67-9205-7655d9775501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:28.366518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:28.461906 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1622/3281] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:28.466265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5155b0-cfaa-4b79-9b07-15da3ad84b20 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:28.701522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5155b0-cfaa-4b79-9b07-15da3ad84b20 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:28.727449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f9571-1702-4528-83b3-08b08a7d8485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:28.728929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f9571-1702-4528-83b3-08b08a7d8485 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:28.729564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f9571-1702-4528-83b3-08b08a7d8485 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:28.730162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f9571-1702-4528-83b3-08b08a7d8485 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:28.731261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f9571-1702-4528-83b3-08b08a7d8485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:28.734384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f9571-1702-4528-83b3-08b08a7d8485 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:29.038996 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1660/3282] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:17:28 2022] POST /identity/v3/projects => generated 375 bytes in 570 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:17:29.046160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad320562-2fa9-4e67-9205-7655d9775501 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:29.062798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad320562-2fa9-4e67-9205-7655d9775501 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:29.215141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78fa69-a76c-43e6-9fac-5e50ae5e0ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:29.219170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78fa69-a76c-43e6-9fac-5e50ae5e0ece admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:29.219756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78fa69-a76c-43e6-9fac-5e50ae5e0ece admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:29.220150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78fa69-a76c-43e6-9fac-5e50ae5e0ece admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:29.222871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78fa69-a76c-43e6-9fac-5e50ae5e0ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:29.226209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78fa69-a76c-43e6-9fac-5e50ae5e0ece admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:29.475383 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1623/3283] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:17:29 2022] POST /identity/v3/users => generated 294 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:17:29.477814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f9571-1702-4528-83b3-08b08a7d8485 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:29.490063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f9571-1702-4528-83b3-08b08a7d8485 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:29.501321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b430d40-92cd-4110-9bf3-8eff96571c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:29.501321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b430d40-92cd-4110-9bf3-8eff96571c06 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:29.501321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b430d40-92cd-4110-9bf3-8eff96571c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:29.501321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b430d40-92cd-4110-9bf3-8eff96571c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:29.501981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b430d40-92cd-4110-9bf3-8eff96571c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:29.502710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b430d40-92cd-4110-9bf3-8eff96571c06 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:29.525109 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1661/3284] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:17:29.530732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78fa69-a76c-43e6-9fac-5e50ae5e0ece admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:29.552155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78fa69-a76c-43e6-9fac-5e50ae5e0ece admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:29.557834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fe8dc-0140-4af0-a818-441b48b5a61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:29.559021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fe8dc-0140-4af0-a818-441b48b5a61c admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:29.559344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fe8dc-0140-4af0-a818-441b48b5a61c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:29.559624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fe8dc-0140-4af0-a818-441b48b5a61c admin admin] PATH_INFO: `/v3/projects/96c9b8cbc0c040dabd6595296810ae98/users/9860b365b5c14af683786463d396e54e/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:29.578397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fe8dc-0140-4af0-a818-441b48b5a61c admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c9b8cbc0c040dabd6595296810ae98, user_id=9860b365b5c14af683786463d396e54e, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:29.582242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fe8dc-0140-4af0-a818-441b48b5a61c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:29.624944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:29.695229 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1624/3285] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:17:29 2022] PUT /identity/v3/projects/96c9b8cbc0c040dabd6595296810ae98/users/9860b365b5c14af683786463d396e54e/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:29.700041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b430d40-92cd-4110-9bf3-8eff96571c06 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:29.721661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b430d40-92cd-4110-9bf3-8eff96571c06 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:29.846897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03199d-3ee3-49d9-919d-e4fe8546be73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:29.850145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03199d-3ee3-49d9-919d-e4fe8546be73 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:29.850866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03199d-3ee3-49d9-919d-e4fe8546be73 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:29.851433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03199d-3ee3-49d9-919d-e4fe8546be73 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:29.852821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03199d-3ee3-49d9-919d-e4fe8546be73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:29.854764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03199d-3ee3-49d9-919d-e4fe8546be73 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:29.876791 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1662/3286] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:17:29.881273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fe8dc-0140-4af0-a818-441b48b5a61c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:29.915774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fe8dc-0140-4af0-a818-441b48b5a61c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:29.956144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1efe7-9d5f-43c6-9b1f-20380e9dc76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:29.957082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1efe7-9d5f-43c6-9b1f-20380e9dc76b admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:29.957367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1efe7-9d5f-43c6-9b1f-20380e9dc76b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:29.957707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1efe7-9d5f-43c6-9b1f-20380e9dc76b admin admin] PATH_INFO: `/v3/projects/96c9b8cbc0c040dabd6595296810ae98/users/9860b365b5c14af683786463d396e54e/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:29.962993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1efe7-9d5f-43c6-9b1f-20380e9dc76b admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c9b8cbc0c040dabd6595296810ae98, user_id=9860b365b5c14af683786463d396e54e, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:29.971438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1efe7-9d5f-43c6-9b1f-20380e9dc76b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:30.010204 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1625/3287] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:17:29 2022] PUT /identity/v3/projects/96c9b8cbc0c040dabd6595296810ae98/users/9860b365b5c14af683786463d396e54e/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:30.031916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50309742-8ff2-4524-a297-2e62c9af452d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:30.032590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50309742-8ff2-4524-a297-2e62c9af452d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:30.033088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50309742-8ff2-4524-a297-2e62c9af452d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:30.127933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-50309742-8ff2-4524-a297-2e62c9af452d None None] MFA Rules not processed for user `9860b365b5c14af683786463d396e54e`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:30.130147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-50309742-8ff2-4524-a297-2e62c9af452d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:30.353390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1efe7-9d5f-43c6-9b1f-20380e9dc76b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:30.354072 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1663/3288] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:30.369395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1efe7-9d5f-43c6-9b1f-20380e9dc76b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:30.387058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de930f79-234a-43d8-afd3-95f7cefb0e84 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9860b365b5c14af683786463d396e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c9b8cbc0c040dabd6595296810ae98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:30.387338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de930f79-234a-43d8-afd3-95f7cefb0e84 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:30.387883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de930f79-234a-43d8-afd3-95f7cefb0e84 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:30.388008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de930f79-234a-43d8-afd3-95f7cefb0e84 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:30.389177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de930f79-234a-43d8-afd3-95f7cefb0e84 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:17:30.389299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de930f79-234a-43d8-afd3-95f7cefb0e84 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:30.391228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de930f79-234a-43d8-afd3-95f7cefb0e84 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:30.453195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50309742-8ff2-4524-a297-2e62c9af452d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:30.459260 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1626/3289] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:17:30.464238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50309742-8ff2-4524-a297-2e62c9af452d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:30.478215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c39f5-ba90-4667-9dab-47499da70f43 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9860b365b5c14af683786463d396e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c9b8cbc0c040dabd6595296810ae98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:30.478900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c39f5-ba90-4667-9dab-47499da70f43 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:30.479215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c39f5-ba90-4667-9dab-47499da70f43 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:30.479490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c39f5-ba90-4667-9dab-47499da70f43 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:30.480207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c39f5-ba90-4667-9dab-47499da70f43 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:30.482410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c39f5-ba90-4667-9dab-47499da70f43 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:30.621231 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1664/3290] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:17:30 2022] POST /identity/v3/projects => generated 369 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:17:30.623352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de930f79-234a-43d8-afd3-95f7cefb0e84 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:30.635558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de930f79-234a-43d8-afd3-95f7cefb0e84 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:30.724029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72df15f-fdf9-4847-90f6-dd4ac9a7dc24 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9860b365b5c14af683786463d396e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c9b8cbc0c040dabd6595296810ae98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:30.726006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72df15f-fdf9-4847-90f6-dd4ac9a7dc24 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:30.726340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72df15f-fdf9-4847-90f6-dd4ac9a7dc24 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:30.726625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72df15f-fdf9-4847-90f6-dd4ac9a7dc24 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:30.727478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72df15f-fdf9-4847-90f6-dd4ac9a7dc24 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:17:30.727970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72df15f-fdf9-4847-90f6-dd4ac9a7dc24 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:30.735357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72df15f-fdf9-4847-90f6-dd4ac9a7dc24 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:30.777726 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1627/3291] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:17:31.106817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:31.797035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:31.890580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:33.322047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:33.406555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:34.821053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:37.976901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c39f5-ba90-4667-9dab-47499da70f43 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:37.978968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d88c39f5-ba90-4667-9dab-47499da70f43 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:37.982510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7894d3-ae45-44f7-b830-9562d4add117 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:37.983404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7894d3-ae45-44f7-b830-9562d4add117 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:37.983850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7894d3-ae45-44f7-b830-9562d4add117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:38.072842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c39f5-ba90-4667-9dab-47499da70f43 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:38.083883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27fca1-35aa-423e-bb1e-38039bad4e50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:38.083883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27fca1-35aa-423e-bb1e-38039bad4e50 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:38.083883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27fca1-35aa-423e-bb1e-38039bad4e50 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:38.083883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27fca1-35aa-423e-bb1e-38039bad4e50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:38.084261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7b7894d3-ae45-44f7-b830-9562d4add117 None None] MFA Rules not processed for user `50cdc134e712487196f6623c5cf14592`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:38.084261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7b7894d3-ae45-44f7-b830-9562d4add117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:38.084437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-df27fca1-35aa-423e-bb1e-38039bad4e50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:38.196048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27fca1-35aa-423e-bb1e-38039bad4e50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:38.197810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27fca1-35aa-423e-bb1e-38039bad4e50 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:38.225116 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1665/3292] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:17:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:17:38.255222 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1628/3293] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:37 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:17:38.263412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27fca1-35aa-423e-bb1e-38039bad4e50 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:38.265570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-df27fca1-35aa-423e-bb1e-38039bad4e50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:38.319868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:38.368917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27fca1-35aa-423e-bb1e-38039bad4e50 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:38.377041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb40f85-fc11-4dab-b424-c1db9492ce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:38.377727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb40f85-fc11-4dab-b424-c1db9492ce1a admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:38.378716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb40f85-fc11-4dab-b424-c1db9492ce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:38.379150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb40f85-fc11-4dab-b424-c1db9492ce1a admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:38.379857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb40f85-fc11-4dab-b424-c1db9492ce1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:38.388572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb40f85-fc11-4dab-b424-c1db9492ce1a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:38.620754 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1666/3294] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:17:38 2022] POST /identity/v3/projects => generated 403 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:17:38.625564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7894d3-ae45-44f7-b830-9562d4add117 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:38.646920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7894d3-ae45-44f7-b830-9562d4add117 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:38.747847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f071ba9-ff8e-4883-9795-172fd7ebce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:38.749026 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f071ba9-ff8e-4883-9795-172fd7ebce57 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:38.749509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f071ba9-ff8e-4883-9795-172fd7ebce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:38.749939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f071ba9-ff8e-4883-9795-172fd7ebce57 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:38.750865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f071ba9-ff8e-4883-9795-172fd7ebce57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:38.753295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f071ba9-ff8e-4883-9795-172fd7ebce57 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:38.853359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb40f85-fc11-4dab-b424-c1db9492ce1a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:38.857298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dfb40f85-fc11-4dab-b424-c1db9492ce1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:39.006032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb40f85-fc11-4dab-b424-c1db9492ce1a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:39.006032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3198446-1e5d-4da1-9cab-a4e047d1806a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:39.006032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3198446-1e5d-4da1-9cab-a4e047d1806a service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:39.006032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3198446-1e5d-4da1-9cab-a4e047d1806a service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:39.007154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3198446-1e5d-4da1-9cab-a4e047d1806a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:39.066360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3198446-1e5d-4da1-9cab-a4e047d1806a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:39.068015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3198446-1e5d-4da1-9cab-a4e047d1806a service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:39.079913 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1667/3295] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:17:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:17:39.099603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea7d8c-fd3b-43b8-be15-ddd0be6e8c7d None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:39.099920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea7d8c-fd3b-43b8-be15-ddd0be6e8c7d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:39.100195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea7d8c-fd3b-43b8-be15-ddd0be6e8c7d None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:39.102343 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1668/3296] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:17:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 21:17:39.106771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea7d8c-fd3b-43b8-be15-ddd0be6e8c7d None None] Authenticating service token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:17:39.122544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea7d8c-fd3b-43b8-be15-ddd0be6e8c7d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:39.135273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea7d8c-fd3b-43b8-be15-ddd0be6e8c7d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:39.141923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af4f9e-a65a-4817-807f-63a6b4099fff tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9860b365b5c14af683786463d396e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c9b8cbc0c040dabd6595296810ae98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:39.143069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af4f9e-a65a-4817-807f-63a6b4099fff tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:39.143362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af4f9e-a65a-4817-807f-63a6b4099fff tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:39.143637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af4f9e-a65a-4817-807f-63a6b4099fff tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] PATH_INFO: `/v3/projects/13e0f52a884440db827dba9fe97e8fef` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:39.144879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af4f9e-a65a-4817-807f-63a6b4099fff tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorizing `identity:get_project(project_id=13e0f52a884440db827dba9fe97e8fef)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:39.147340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af4f9e-a65a-4817-807f-63a6b4099fff tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:39.149278 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1669/3297] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:17:39 2022] GET /identity/v3/projects/13e0f52a884440db827dba9fe97e8fef => generated 369 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:17:39.493508 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1629/3298] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:17:38 2022] POST /identity/v3/users => generated 302 bytes in 868 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:17:39.495862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af4f9e-a65a-4817-807f-63a6b4099fff tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:39.519390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af4f9e-a65a-4817-807f-63a6b4099fff tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:39.536604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c536ab-ece8-448a-ac19-47bd9bc190ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:39.541434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c536ab-ece8-448a-ac19-47bd9bc190ed admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:39.542152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c536ab-ece8-448a-ac19-47bd9bc190ed admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:39.543388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c536ab-ece8-448a-ac19-47bd9bc190ed admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:39.544504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c536ab-ece8-448a-ac19-47bd9bc190ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:39.549751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c536ab-ece8-448a-ac19-47bd9bc190ed admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:39.607215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f071ba9-ff8e-4883-9795-172fd7ebce57 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:39.607962 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1670/3299] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:17:39.613799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:39.626763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f071ba9-ff8e-4883-9795-172fd7ebce57 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:39.647027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a764b0c-37d4-4794-8a4e-94fe0aa2a248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:39.647766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a764b0c-37d4-4794-8a4e-94fe0aa2a248 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:39.648054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a764b0c-37d4-4794-8a4e-94fe0aa2a248 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:39.648328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a764b0c-37d4-4794-8a4e-94fe0aa2a248 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:39.656317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a764b0c-37d4-4794-8a4e-94fe0aa2a248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:39.661058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a764b0c-37d4-4794-8a4e-94fe0aa2a248 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:39.701489 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1630/3300] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:17:39.702694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c536ab-ece8-448a-ac19-47bd9bc190ed admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:39.730148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c536ab-ece8-448a-ac19-47bd9bc190ed admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:39.742467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b7e78-0dcb-428b-a7a2-71d807433308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:39.745251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b7e78-0dcb-428b-a7a2-71d807433308 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:39.748179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b7e78-0dcb-428b-a7a2-71d807433308 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:39.752220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b7e78-0dcb-428b-a7a2-71d807433308 admin admin] PATH_INFO: `/v3/projects/d498eaa349e84dcab5c975eeb69d1d6a/users/d35b09fb00874c05ac96b0a20e61ba10/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:39.786402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b7e78-0dcb-428b-a7a2-71d807433308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d498eaa349e84dcab5c975eeb69d1d6a, user_id=d35b09fb00874c05ac96b0a20e61ba10, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:39.791099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b7e78-0dcb-428b-a7a2-71d807433308 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:39.917687 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1671/3301] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:17:39 2022] PUT /identity/v3/projects/d498eaa349e84dcab5c975eeb69d1d6a/users/d35b09fb00874c05ac96b0a20e61ba10/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:39.939293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6c1b4-3172-456d-b4ec-64804437ee13 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:39.947416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6c1b4-3172-456d-b4ec-64804437ee13 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:39.947741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6c1b4-3172-456d-b4ec-64804437ee13 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:39.949394 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1631/3302] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:17:39 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:17:39.971421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b7e78-0dcb-428b-a7a2-71d807433308 admin admin] Authenticating service token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:17:40.084083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b7e78-0dcb-428b-a7a2-71d807433308 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:40.125276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:40.197875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b7e78-0dcb-428b-a7a2-71d807433308 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:40.209517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c0604-88f1-4e00-b255-d1e4fb484e9e tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9860b365b5c14af683786463d396e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c9b8cbc0c040dabd6595296810ae98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:40.210422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c0604-88f1-4e00-b255-d1e4fb484e9e tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:40.213218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c0604-88f1-4e00-b255-d1e4fb484e9e tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:40.213218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c0604-88f1-4e00-b255-d1e4fb484e9e tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] PATH_INFO: `/v3/projects/13e0f52a884440db827dba9fe97e8fef` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:40.213218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c0604-88f1-4e00-b255-d1e4fb484e9e tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorizing `identity:get_project(project_id=13e0f52a884440db827dba9fe97e8fef)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:40.214462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c0604-88f1-4e00-b255-d1e4fb484e9e tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:40.216801 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1672/3303] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:17:39 2022] GET /identity/v3/projects/13e0f52a884440db827dba9fe97e8fef => generated 369 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:17:40.252071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40104d4-f399-4200-bf0a-1a4c3e3958c2 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:40.252504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40104d4-f399-4200-bf0a-1a4c3e3958c2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:40.252882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40104d4-f399-4200-bf0a-1a4c3e3958c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:40.300096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c0604-88f1-4e00-b255-d1e4fb484e9e tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:40.305859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e40104d4-f399-4200-bf0a-1a4c3e3958c2 None None] MFA Rules not processed for user `d0008fffad8e4708b2c01e03da92c47d`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:40.310901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e40104d4-f399-4200-bf0a-1a4c3e3958c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:40.339224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c0604-88f1-4e00-b255-d1e4fb484e9e tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:40.371406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7057d5c-1bc3-4d23-b139-1cf2f21e7836 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9860b365b5c14af683786463d396e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c9b8cbc0c040dabd6595296810ae98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:40.373875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7057d5c-1bc3-4d23-b139-1cf2f21e7836 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:40.373875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7057d5c-1bc3-4d23-b139-1cf2f21e7836 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:40.374086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7057d5c-1bc3-4d23-b139-1cf2f21e7836 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:40.375052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7057d5c-1bc3-4d23-b139-1cf2f21e7836 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:17:40.375378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7057d5c-1bc3-4d23-b139-1cf2f21e7836 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:40.386537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7057d5c-1bc3-4d23-b139-1cf2f21e7836 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:40.425688 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1673/3304] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:17:40.446404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7057d5c-1bc3-4d23-b139-1cf2f21e7836 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:40.460605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7057d5c-1bc3-4d23-b139-1cf2f21e7836 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:40.499121 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1632/3305] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:40.503694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a41f2-06c4-4b14-b013-2c9d91680b6e tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9860b365b5c14af683786463d396e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c9b8cbc0c040dabd6595296810ae98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:40.504446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a41f2-06c4-4b14-b013-2c9d91680b6e tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:40.504781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a41f2-06c4-4b14-b013-2c9d91680b6e tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:40.505063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a41f2-06c4-4b14-b013-2c9d91680b6e tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:40.506450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a41f2-06c4-4b14-b013-2c9d91680b6e tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:40.508442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a41f2-06c4-4b14-b013-2c9d91680b6e tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:40.756581 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1674/3306] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:17:40 2022] POST /identity/v3/users => generated 381 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:17:40.760784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40104d4-f399-4200-bf0a-1a4c3e3958c2 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:40.774276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40104d4-f399-4200-bf0a-1a4c3e3958c2 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:40.796859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1871d-e093-4488-82e0-e27e549bdd94 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9860b365b5c14af683786463d396e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c9b8cbc0c040dabd6595296810ae98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:40.796859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1871d-e093-4488-82e0-e27e549bdd94 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:40.796859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1871d-e093-4488-82e0-e27e549bdd94 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:40.797186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1871d-e093-4488-82e0-e27e549bdd94 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:40.797264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1871d-e093-4488-82e0-e27e549bdd94 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:17:40.797544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1871d-e093-4488-82e0-e27e549bdd94 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:40.800392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1871d-e093-4488-82e0-e27e549bdd94 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:40.849989 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1633/3307] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:17:41.659569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed30d1e-82e6-43e7-96c7-29099664ab2c None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:41.660119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed30d1e-82e6-43e7-96c7-29099664ab2c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:41.660119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed30d1e-82e6-43e7-96c7-29099664ab2c None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:41.661474 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1675/3308] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:17:41.678266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1871d-e093-4488-82e0-e27e549bdd94 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:17:41.704303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1871d-e093-4488-82e0-e27e549bdd94 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:41.720379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1871d-e093-4488-82e0-e27e549bdd94 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:41.726793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6701c5-4dbc-4d8c-86c5-086a6615092a tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9860b365b5c14af683786463d396e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c9b8cbc0c040dabd6595296810ae98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:41.727785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6701c5-4dbc-4d8c-86c5-086a6615092a tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:41.728264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6701c5-4dbc-4d8c-86c5-086a6615092a tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:41.728720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6701c5-4dbc-4d8c-86c5-086a6615092a tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] PATH_INFO: `/v3/projects/13e0f52a884440db827dba9fe97e8fef` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:41.730365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6701c5-4dbc-4d8c-86c5-086a6615092a tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorizing `identity:get_project(project_id=13e0f52a884440db827dba9fe97e8fef)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:41.732793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6701c5-4dbc-4d8c-86c5-086a6615092a tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:41.734737 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1634/3309] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:17:41 2022] GET /identity/v3/projects/13e0f52a884440db827dba9fe97e8fef => generated 369 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:17:42.330668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48aa36b-f3a4-40c3-8e85-beb3850cabec None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:42.331525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48aa36b-f3a4-40c3-8e85-beb3850cabec None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:42.331525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48aa36b-f3a4-40c3-8e85-beb3850cabec None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:42.334046 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1676/3310] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:17:42.347180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6701c5-4dbc-4d8c-86c5-086a6615092a tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:17:42.367846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6701c5-4dbc-4d8c-86c5-086a6615092a tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:42.394653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6701c5-4dbc-4d8c-86c5-086a6615092a tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:42.408995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957de15-afe8-4a05-9503-73c071efc976 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9860b365b5c14af683786463d396e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c9b8cbc0c040dabd6595296810ae98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:42.409863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957de15-afe8-4a05-9503-73c071efc976 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:42.410736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957de15-afe8-4a05-9503-73c071efc976 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:42.411356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957de15-afe8-4a05-9503-73c071efc976 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] PATH_INFO: `/v3/projects/13e0f52a884440db827dba9fe97e8fef` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:42.414053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957de15-afe8-4a05-9503-73c071efc976 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorizing `identity:get_project(project_id=13e0f52a884440db827dba9fe97e8fef)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:42.417031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957de15-afe8-4a05-9503-73c071efc976 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:42.419827 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1635/3311] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:17:42 2022] GET /identity/v3/projects/13e0f52a884440db827dba9fe97e8fef => generated 369 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:17:42.482904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48aa36b-f3a4-40c3-8e85-beb3850cabec None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:42.500830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48aa36b-f3a4-40c3-8e85-beb3850cabec None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:42.507617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99d27b-aef3-4f85-8bd4-6407685549f4 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9860b365b5c14af683786463d396e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c9b8cbc0c040dabd6595296810ae98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:42.508710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99d27b-aef3-4f85-8bd4-6407685549f4 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:42.513418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99d27b-aef3-4f85-8bd4-6407685549f4 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:42.513418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99d27b-aef3-4f85-8bd4-6407685549f4 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] PATH_INFO: `/v3/users/435411be15364e74a547015105a29c53` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:42.543621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99d27b-aef3-4f85-8bd4-6407685549f4 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorizing `identity:delete_user(user_id=435411be15364e74a547015105a29c53)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:42.543621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99d27b-aef3-4f85-8bd4-6407685549f4 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:42.566468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e74be1-e440-465a-a7cb-ec369cec939c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:42.566468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e74be1-e440-465a-a7cb-ec369cec939c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:42.566468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e74be1-e440-465a-a7cb-ec369cec939c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:42.593495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c9e74be1-e440-465a-a7cb-ec369cec939c None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:42.594743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c9e74be1-e440-465a-a7cb-ec369cec939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:42.678857 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1636/3312] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:17:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:42.702894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e74be1-e440-465a-a7cb-ec369cec939c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:42.702894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c9e74be1-e440-465a-a7cb-ec369cec939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:42.758209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f99d27b-aef3-4f85-8bd4-6407685549f4 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435411be15364e74a547015105a29c53'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:42.773375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f99d27b-aef3-4f85-8bd4-6407685549f4 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435411be15364e74a547015105a29c53'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:42.776577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:42.800344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e74be1-e440-465a-a7cb-ec369cec939c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:42.804034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76b0c6-378d-4b05-9010-7c0fe8fb4361 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:42.805146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76b0c6-378d-4b05-9010-7c0fe8fb4361 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:42.805631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76b0c6-378d-4b05-9010-7c0fe8fb4361 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:42.806094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76b0c6-378d-4b05-9010-7c0fe8fb4361 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:42.820861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76b0c6-378d-4b05-9010-7c0fe8fb4361 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:42.824212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76b0c6-378d-4b05-9010-7c0fe8fb4361 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:42.830752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:42.839804 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1637/3313] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:17:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:17:42.894181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f99d27b-aef3-4f85-8bd4-6407685549f4 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435411be15364e74a547015105a29c53'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:42.894817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f99d27b-aef3-4f85-8bd4-6407685549f4 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435411be15364e74a547015105a29c53'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:42.912484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f99d27b-aef3-4f85-8bd4-6407685549f4 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435411be15364e74a547015105a29c53'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:42.922242 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1677/3314] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:17:42 2022] DELETE /identity/v3/users/435411be15364e74a547015105a29c53 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:42.926468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76b0c6-378d-4b05-9010-7c0fe8fb4361 service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:42.942156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76b0c6-378d-4b05-9010-7c0fe8fb4361 service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:43.017274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb1f08-993e-418c-a636-907b1e50caf7 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9860b365b5c14af683786463d396e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c9b8cbc0c040dabd6595296810ae98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:43.019293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb1f08-993e-418c-a636-907b1e50caf7 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:43.019610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb1f08-993e-418c-a636-907b1e50caf7 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:43.019853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb1f08-993e-418c-a636-907b1e50caf7 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] PATH_INFO: `/v3/projects/13e0f52a884440db827dba9fe97e8fef` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:43.021160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb1f08-993e-418c-a636-907b1e50caf7 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorizing `identity:delete_project(project_id=13e0f52a884440db827dba9fe97e8fef)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:43.023464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb1f08-993e-418c-a636-907b1e50caf7 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:43.243897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8cdb1f08-993e-418c-a636-907b1e50caf7 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e0f52a884440db827dba9fe97e8fef', 'request_id': 'req-8cdb1f08-993e-418c-a636-907b1e50caf7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:43.255072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8cdb1f08-993e-418c-a636-907b1e50caf7 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e0f52a884440db827dba9fe97e8fef', 'request_id': 'req-8cdb1f08-993e-418c-a636-907b1e50caf7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:43.292109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8cdb1f08-993e-418c-a636-907b1e50caf7 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e0f52a884440db827dba9fe97e8fef', 'request_id': 'req-8cdb1f08-993e-418c-a636-907b1e50caf7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:43.482534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8cdb1f08-993e-418c-a636-907b1e50caf7 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] The token cache is being invalidate because project 13e0f52a884440db827dba9fe97e8fef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:17:43.483100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8cdb1f08-993e-418c-a636-907b1e50caf7 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:43.483970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8cdb1f08-993e-418c-a636-907b1e50caf7 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:43.485216 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1638/3315] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:17:42 2022] DELETE /identity/v3/projects/13e0f52a884440db827dba9fe97e8fef => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:43.490665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99d27b-aef3-4f85-8bd4-6407685549f4 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:43.492770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1f99d27b-aef3-4f85-8bd4-6407685549f4 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:43.582636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99d27b-aef3-4f85-8bd4-6407685549f4 tempest-QuotasAdminTestV236-2041262956 tempest-QuotasAdminTestV236-2041262956-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:43.673403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1dcd99-d91d-4884-ae0f-dc1ca6beeece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:43.674899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1dcd99-d91d-4884-ae0f-dc1ca6beeece admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:43.675310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1dcd99-d91d-4884-ae0f-dc1ca6beeece admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:43.675827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1dcd99-d91d-4884-ae0f-dc1ca6beeece admin admin] PATH_INFO: `/v3/users/c9a289918456454689e5383cc94871cd` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:43.677700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1dcd99-d91d-4884-ae0f-dc1ca6beeece admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9a289918456454689e5383cc94871cd)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:43.680497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1dcd99-d91d-4884-ae0f-dc1ca6beeece admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:43.936413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ae1dcd99-d91d-4884-ae0f-dc1ca6beeece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9a289918456454689e5383cc94871cd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:43.948219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ae1dcd99-d91d-4884-ae0f-dc1ca6beeece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9a289918456454689e5383cc94871cd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:44.067233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ae1dcd99-d91d-4884-ae0f-dc1ca6beeece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9a289918456454689e5383cc94871cd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:44.072044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ae1dcd99-d91d-4884-ae0f-dc1ca6beeece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9a289918456454689e5383cc94871cd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:44.090143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ae1dcd99-d91d-4884-ae0f-dc1ca6beeece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9a289918456454689e5383cc94871cd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:44.097263 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1678/3316] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:17:43 2022] DELETE /identity/v3/users/c9a289918456454689e5383cc94871cd => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:44.104810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07675d9f-68cc-43bb-a70f-13b28c30c766 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:44.105205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07675d9f-68cc-43bb-a70f-13b28c30c766 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:44.105361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07675d9f-68cc-43bb-a70f-13b28c30c766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:44.127045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-07675d9f-68cc-43bb-a70f-13b28c30c766 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:44.130733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-07675d9f-68cc-43bb-a70f-13b28c30c766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:44.213728 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1639/3317] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:44.224661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1dcd99-d91d-4884-ae0f-dc1ca6beeece admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:44.226313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ae1dcd99-d91d-4884-ae0f-dc1ca6beeece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:44.313677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1dcd99-d91d-4884-ae0f-dc1ca6beeece admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:44.326696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923df9a1-048a-42f9-8280-5503e8409839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:44.327556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923df9a1-048a-42f9-8280-5503e8409839 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:44.328074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923df9a1-048a-42f9-8280-5503e8409839 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:44.328658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923df9a1-048a-42f9-8280-5503e8409839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:44.342117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a30236-4db8-4eb7-8aa2-a4bd5f43d409 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:44.342416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a30236-4db8-4eb7-8aa2-a4bd5f43d409 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:44.342694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a30236-4db8-4eb7-8aa2-a4bd5f43d409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:44.342942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923df9a1-048a-42f9-8280-5503e8409839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:44.344530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923df9a1-048a-42f9-8280-5503e8409839 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:44.357075 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1679/3318] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:17:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:17:44.364961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-13a30236-4db8-4eb7-8aa2-a4bd5f43d409 None None] MFA Rules not processed for user `2f5bc1f2209f4eb186d80e385b67c774`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:44.366584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-13a30236-4db8-4eb7-8aa2-a4bd5f43d409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:44.398202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:44.452293 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1640/3319] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:17:44.854394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cf654-fb7f-49ce-a019-ab455e3bab48 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:44.854691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cf654-fb7f-49ce-a019-ab455e3bab48 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:44.855093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cf654-fb7f-49ce-a019-ab455e3bab48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:44.889590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d24cf654-fb7f-49ce-a019-ab455e3bab48 None None] MFA Rules not processed for user `daf3c9e6634e4ae1bfb492eae1f44c93`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:44.890849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d24cf654-fb7f-49ce-a019-ab455e3bab48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:44.976702 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1680/3320] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:45.358428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:45.447357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a30236-4db8-4eb7-8aa2-a4bd5f43d409 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:45.449400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-13a30236-4db8-4eb7-8aa2-a4bd5f43d409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:45.471994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a30236-4db8-4eb7-8aa2-a4bd5f43d409 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:45.488511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c72666-cc14-4479-81cf-70df7949e6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:45.489642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c72666-cc14-4479-81cf-70df7949e6a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:45.490091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c72666-cc14-4479-81cf-70df7949e6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:45.490431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c72666-cc14-4479-81cf-70df7949e6a4 admin admin] PATH_INFO: `/v3/projects/91b1f5c0b05b4bcaaf82c7ed60e812b3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:45.492793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c72666-cc14-4479-81cf-70df7949e6a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b1f5c0b05b4bcaaf82c7ed60e812b3)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:45.495815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c72666-cc14-4479-81cf-70df7949e6a4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:45.719356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-38c72666-cc14-4479-81cf-70df7949e6a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b1f5c0b05b4bcaaf82c7ed60e812b3', 'request_id': 'req-38c72666-cc14-4479-81cf-70df7949e6a4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:45.733496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-38c72666-cc14-4479-81cf-70df7949e6a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b1f5c0b05b4bcaaf82c7ed60e812b3', 'request_id': 'req-38c72666-cc14-4479-81cf-70df7949e6a4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:45.740425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-38c72666-cc14-4479-81cf-70df7949e6a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b1f5c0b05b4bcaaf82c7ed60e812b3', 'request_id': 'req-38c72666-cc14-4479-81cf-70df7949e6a4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:45.881121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-38c72666-cc14-4479-81cf-70df7949e6a4 admin admin] The token cache is being invalidate because project 91b1f5c0b05b4bcaaf82c7ed60e812b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:17:45.881415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-38c72666-cc14-4479-81cf-70df7949e6a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:45.882381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-38c72666-cc14-4479-81cf-70df7949e6a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:45.884187 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1641/3321] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:17:45 2022] DELETE /identity/v3/projects/91b1f5c0b05b4bcaaf82c7ed60e812b3 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:45.888844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24cf654-fb7f-49ce-a019-ab455e3bab48 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:45.901466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24cf654-fb7f-49ce-a019-ab455e3bab48 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:45.961978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cafd3d-57c9-4662-8c9b-05aeb665dbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:45.963238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cafd3d-57c9-4662-8c9b-05aeb665dbf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:45.963523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cafd3d-57c9-4662-8c9b-05aeb665dbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:45.963795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cafd3d-57c9-4662-8c9b-05aeb665dbf2 admin admin] PATH_INFO: `/v3/users/9860b365b5c14af683786463d396e54e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:45.966166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cafd3d-57c9-4662-8c9b-05aeb665dbf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9860b365b5c14af683786463d396e54e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:45.968410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cafd3d-57c9-4662-8c9b-05aeb665dbf2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:46.316707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c9cafd3d-57c9-4662-8c9b-05aeb665dbf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9860b365b5c14af683786463d396e54e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:46.342866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c9cafd3d-57c9-4662-8c9b-05aeb665dbf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9860b365b5c14af683786463d396e54e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:46.421966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c9cafd3d-57c9-4662-8c9b-05aeb665dbf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9860b365b5c14af683786463d396e54e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:46.423453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c9cafd3d-57c9-4662-8c9b-05aeb665dbf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9860b365b5c14af683786463d396e54e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:46.451884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c9cafd3d-57c9-4662-8c9b-05aeb665dbf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9860b365b5c14af683786463d396e54e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:46.472379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44612014-ad24-41f6-898d-8b6d63323abe None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:46.472914 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1681/3322] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:17:45 2022] DELETE /identity/v3/users/9860b365b5c14af683786463d396e54e => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:46.473110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44612014-ad24-41f6-898d-8b6d63323abe None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:46.473624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44612014-ad24-41f6-898d-8b6d63323abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:46.504146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-44612014-ad24-41f6-898d-8b6d63323abe None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:46.505829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-44612014-ad24-41f6-898d-8b6d63323abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:46.612481 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1642/3323] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:17:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:17:46.630014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cafd3d-57c9-4662-8c9b-05aeb665dbf2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:46.632046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c9cafd3d-57c9-4662-8c9b-05aeb665dbf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:46.732509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cafd3d-57c9-4662-8c9b-05aeb665dbf2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:46.739659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac080a6-339f-4e33-90d5-1cdc53a76fde service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:46.740603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac080a6-339f-4e33-90d5-1cdc53a76fde service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:46.741171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac080a6-339f-4e33-90d5-1cdc53a76fde service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:46.741677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac080a6-339f-4e33-90d5-1cdc53a76fde service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:46.753508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac080a6-339f-4e33-90d5-1cdc53a76fde service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:46.756492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac080a6-339f-4e33-90d5-1cdc53a76fde service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:46.773801 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1682/3324] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:17:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:17:47.343206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44612014-ad24-41f6-898d-8b6d63323abe None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:47.347325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-44612014-ad24-41f6-898d-8b6d63323abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:47.634815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44612014-ad24-41f6-898d-8b6d63323abe None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:47.646777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb92a4d-3c75-40f3-bc4d-346c8c69a6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:47.647862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb92a4d-3c75-40f3-bc4d-346c8c69a6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:47.649842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb92a4d-3c75-40f3-bc4d-346c8c69a6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:47.650392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb92a4d-3c75-40f3-bc4d-346c8c69a6cd admin admin] PATH_INFO: `/v3/projects/96c9b8cbc0c040dabd6595296810ae98` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:47.654298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb92a4d-3c75-40f3-bc4d-346c8c69a6cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=96c9b8cbc0c040dabd6595296810ae98)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:47.658764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb92a4d-3c75-40f3-bc4d-346c8c69a6cd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:47.675594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:47.858063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2fb92a4d-3c75-40f3-bc4d-346c8c69a6cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96c9b8cbc0c040dabd6595296810ae98', 'request_id': 'req-2fb92a4d-3c75-40f3-bc4d-346c8c69a6cd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:47.878158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2fb92a4d-3c75-40f3-bc4d-346c8c69a6cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96c9b8cbc0c040dabd6595296810ae98', 'request_id': 'req-2fb92a4d-3c75-40f3-bc4d-346c8c69a6cd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:47.892289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2fb92a4d-3c75-40f3-bc4d-346c8c69a6cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96c9b8cbc0c040dabd6595296810ae98', 'request_id': 'req-2fb92a4d-3c75-40f3-bc4d-346c8c69a6cd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:48.023929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2fb92a4d-3c75-40f3-bc4d-346c8c69a6cd admin admin] The token cache is being invalidate because project 96c9b8cbc0c040dabd6595296810ae98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:17:48.024143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2fb92a4d-3c75-40f3-bc4d-346c8c69a6cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:48.025005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2fb92a4d-3c75-40f3-bc4d-346c8c69a6cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:48.027131 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1643/3325] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:17:47 2022] DELETE /identity/v3/projects/96c9b8cbc0c040dabd6595296810ae98 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:48.034033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41657ac0-6740-4ee0-8d1d-fde35e073497 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:48.034932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41657ac0-6740-4ee0-8d1d-fde35e073497 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:48.035388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41657ac0-6740-4ee0-8d1d-fde35e073497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:48.071897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-41657ac0-6740-4ee0-8d1d-fde35e073497 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:48.073805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:48.075357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-41657ac0-6740-4ee0-8d1d-fde35e073497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:48.222935 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1683/3326] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:48.232754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0cae8-52b8-40f5-aefa-342db7429e7e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:48.233053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0cae8-52b8-40f5-aefa-342db7429e7e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:48.233341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0cae8-52b8-40f5-aefa-342db7429e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:48.271527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-59b0cae8-52b8-40f5-aefa-342db7429e7e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:48.272768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-59b0cae8-52b8-40f5-aefa-342db7429e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:48.295890 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1644/3327] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:48.297284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41657ac0-6740-4ee0-8d1d-fde35e073497 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:48.310768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41657ac0-6740-4ee0-8d1d-fde35e073497 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:48.324551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea859b2-072c-4ec6-a5a0-ec847865506d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:48.325241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea859b2-072c-4ec6-a5a0-ec847865506d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:48.325524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea859b2-072c-4ec6-a5a0-ec847865506d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:48.325800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea859b2-072c-4ec6-a5a0-ec847865506d admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:48.326557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea859b2-072c-4ec6-a5a0-ec847865506d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:17:48.326851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea859b2-072c-4ec6-a5a0-ec847865506d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:48.328576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea859b2-072c-4ec6-a5a0-ec847865506d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:48.362310 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1684/3328] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:17:48.363495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0cae8-52b8-40f5-aefa-342db7429e7e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:48.374893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0cae8-52b8-40f5-aefa-342db7429e7e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:48.386501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06d68b-52b0-4739-9459-75cf51a4bb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:48.387246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06d68b-52b0-4739-9459-75cf51a4bb51 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:48.387526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06d68b-52b0-4739-9459-75cf51a4bb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:48.389880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06d68b-52b0-4739-9459-75cf51a4bb51 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:48.389880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06d68b-52b0-4739-9459-75cf51a4bb51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:48.397928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06d68b-52b0-4739-9459-75cf51a4bb51 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:48.654245 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1645/3329] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:17:48 2022] POST /identity/v3/projects => generated 373 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:17:48.657711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea859b2-072c-4ec6-a5a0-ec847865506d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:48.676124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea859b2-072c-4ec6-a5a0-ec847865506d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:48.754813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25d381-3e13-44d6-a271-393e91c79611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:48.756062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25d381-3e13-44d6-a271-393e91c79611 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:48.756572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25d381-3e13-44d6-a271-393e91c79611 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:48.757216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25d381-3e13-44d6-a271-393e91c79611 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:48.758105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25d381-3e13-44d6-a271-393e91c79611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:48.761497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25d381-3e13-44d6-a271-393e91c79611 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:48.896529 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1685/3330] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:17:48 2022] POST /identity/v3/users => generated 287 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:17:48.897734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06d68b-52b0-4739-9459-75cf51a4bb51 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:48.921764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06d68b-52b0-4739-9459-75cf51a4bb51 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:48.941652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2f7d2-9f1d-4d64-aeb5-d50e0f8c49a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:48.944329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2f7d2-9f1d-4d64-aeb5-d50e0f8c49a0 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:48.944996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2f7d2-9f1d-4d64-aeb5-d50e0f8c49a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:48.945484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2f7d2-9f1d-4d64-aeb5-d50e0f8c49a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:48.946592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f2f7d2-9f1d-4d64-aeb5-d50e0f8c49a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:48.949070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f2f7d2-9f1d-4d64-aeb5-d50e0f8c49a0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:48.978511 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1646/3331] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:17:48.983669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25d381-3e13-44d6-a271-393e91c79611 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:49.001840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25d381-3e13-44d6-a271-393e91c79611 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:49.019954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b435c-16c2-4d13-8dbb-bd54d192084d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:49.020656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b435c-16c2-4d13-8dbb-bd54d192084d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:49.020942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b435c-16c2-4d13-8dbb-bd54d192084d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:49.022031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b435c-16c2-4d13-8dbb-bd54d192084d admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:49.023789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b435c-16c2-4d13-8dbb-bd54d192084d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:49.028659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b435c-16c2-4d13-8dbb-bd54d192084d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:49.057786 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1686/3332] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:17:49.062844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2f7d2-9f1d-4d64-aeb5-d50e0f8c49a0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:49.096214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2f7d2-9f1d-4d64-aeb5-d50e0f8c49a0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:49.132791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cafe93-e566-410e-8b70-5f88ff874999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:49.135751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cafe93-e566-410e-8b70-5f88ff874999 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:49.139062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cafe93-e566-410e-8b70-5f88ff874999 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:49.141765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cafe93-e566-410e-8b70-5f88ff874999 admin admin] PATH_INFO: `/v3/projects/49a57ae94e54478cafacc2f231a4a880/users/fd367cc349bc404dbf4cd1e4e6b9ff62/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:49.183048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cafe93-e566-410e-8b70-5f88ff874999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49a57ae94e54478cafacc2f231a4a880, user_id=fd367cc349bc404dbf4cd1e4e6b9ff62, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:49.191276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cafe93-e566-410e-8b70-5f88ff874999 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:49.332769 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1647/3333] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:17:49 2022] PUT /identity/v3/projects/49a57ae94e54478cafacc2f231a4a880/users/fd367cc349bc404dbf4cd1e4e6b9ff62/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:49.346427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaa481-c7e1-443b-a7eb-2fb4f89b129a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:49.346746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaa481-c7e1-443b-a7eb-2fb4f89b129a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:49.347914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaa481-c7e1-443b-a7eb-2fb4f89b129a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:49.388328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d2aaa481-c7e1-443b-a7eb-2fb4f89b129a None None] MFA Rules not processed for user `fd367cc349bc404dbf4cd1e4e6b9ff62`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:49.389894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d2aaa481-c7e1-443b-a7eb-2fb4f89b129a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:49.481566 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1687/3334] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:49.486416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cafe93-e566-410e-8b70-5f88ff874999 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:49.653269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cafe93-e566-410e-8b70-5f88ff874999 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:49.666368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621e4a3-6188-44b1-91bc-b077c3b914a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:49.667748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621e4a3-6188-44b1-91bc-b077c3b914a9 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:49.668719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621e4a3-6188-44b1-91bc-b077c3b914a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:49.669146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621e4a3-6188-44b1-91bc-b077c3b914a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:49.671564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c621e4a3-6188-44b1-91bc-b077c3b914a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:49.677166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c621e4a3-6188-44b1-91bc-b077c3b914a9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:49.852851 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1648/3335] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:17:49 2022] POST /identity/v3/projects => generated 375 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:17:49.857884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aaa481-c7e1-443b-a7eb-2fb4f89b129a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:49.888377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aaa481-c7e1-443b-a7eb-2fb4f89b129a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:50.003530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:50.113252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083b3ce-c2cf-4dad-ad16-bcbab85dbfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:50.117145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083b3ce-c2cf-4dad-ad16-bcbab85dbfb5 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:50.119022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083b3ce-c2cf-4dad-ad16-bcbab85dbfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:50.120908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083b3ce-c2cf-4dad-ad16-bcbab85dbfb5 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:50.134768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083b3ce-c2cf-4dad-ad16-bcbab85dbfb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:50.154668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083b3ce-c2cf-4dad-ad16-bcbab85dbfb5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:50.354278 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1688/3336] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:17:49 2022] POST /identity/v3/users => generated 294 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:17:50.358793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621e4a3-6188-44b1-91bc-b077c3b914a9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:50.377348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621e4a3-6188-44b1-91bc-b077c3b914a9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:50.400194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88a451-c7e4-4b39-8d7d-dd0fd8bd7871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:50.401267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88a451-c7e4-4b39-8d7d-dd0fd8bd7871 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:50.401267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88a451-c7e4-4b39-8d7d-dd0fd8bd7871 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:50.401461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88a451-c7e4-4b39-8d7d-dd0fd8bd7871 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:50.402162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88a451-c7e4-4b39-8d7d-dd0fd8bd7871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:50.403860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88a451-c7e4-4b39-8d7d-dd0fd8bd7871 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:50.480453 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1649/3337] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:17:50.486066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083b3ce-c2cf-4dad-ad16-bcbab85dbfb5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:50.514098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083b3ce-c2cf-4dad-ad16-bcbab85dbfb5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:50.549628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29486e-d27f-41eb-b342-3c1402556a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:50.551284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29486e-d27f-41eb-b342-3c1402556a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:50.551583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29486e-d27f-41eb-b342-3c1402556a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:50.551870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29486e-d27f-41eb-b342-3c1402556a12 admin admin] PATH_INFO: `/v3/projects/d42d8f6b939448c79933a741db7981b8/users/5fbcf502d5584bbdbf9664732fb72185/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:50.574289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29486e-d27f-41eb-b342-3c1402556a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d42d8f6b939448c79933a741db7981b8, user_id=5fbcf502d5584bbdbf9664732fb72185, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:50.578013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29486e-d27f-41eb-b342-3c1402556a12 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:50.664163 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1689/3338] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:17:50 2022] PUT /identity/v3/projects/d42d8f6b939448c79933a741db7981b8/users/5fbcf502d5584bbdbf9664732fb72185/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:17:50.669013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88a451-c7e4-4b39-8d7d-dd0fd8bd7871 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:50.676144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:50.682869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88a451-c7e4-4b39-8d7d-dd0fd8bd7871 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:50.789903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3df64-59b2-45f8-b6ef-893fdb519b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:50.790954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3df64-59b2-45f8-b6ef-893fdb519b5d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:50.791288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3df64-59b2-45f8-b6ef-893fdb519b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:50.791546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3df64-59b2-45f8-b6ef-893fdb519b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:50.792295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3df64-59b2-45f8-b6ef-893fdb519b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:50.801766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3df64-59b2-45f8-b6ef-893fdb519b5d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:50.831097 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1650/3339] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:17:50.831789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29486e-d27f-41eb-b342-3c1402556a12 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:50.858263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29486e-d27f-41eb-b342-3c1402556a12 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:50.877562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702705c-552f-4924-b5fa-abdeb8f85392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:50.877562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702705c-552f-4924-b5fa-abdeb8f85392 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:50.877562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702705c-552f-4924-b5fa-abdeb8f85392 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:50.877562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702705c-552f-4924-b5fa-abdeb8f85392 admin admin] PATH_INFO: `/v3/projects/d42d8f6b939448c79933a741db7981b8/users/5fbcf502d5584bbdbf9664732fb72185/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:50.880872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702705c-552f-4924-b5fa-abdeb8f85392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d42d8f6b939448c79933a741db7981b8, user_id=5fbcf502d5584bbdbf9664732fb72185, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:50.883630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702705c-552f-4924-b5fa-abdeb8f85392 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:50.910010 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1690/3340] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:17:50 2022] PUT /identity/v3/projects/d42d8f6b939448c79933a741db7981b8/users/5fbcf502d5584bbdbf9664732fb72185/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:17:50.921684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad87da-7770-43ca-a1e8-865f24cb5877 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:50.921886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad87da-7770-43ca-a1e8-865f24cb5877 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:50.922553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad87da-7770-43ca-a1e8-865f24cb5877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:50.988745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6aad87da-7770-43ca-a1e8-865f24cb5877 None None] MFA Rules not processed for user `5fbcf502d5584bbdbf9664732fb72185`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:50.990225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6aad87da-7770-43ca-a1e8-865f24cb5877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:51.140236 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1651/3341] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:51.149588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702705c-552f-4924-b5fa-abdeb8f85392 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:51.184381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702705c-552f-4924-b5fa-abdeb8f85392 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:51.194114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029fe17-1fb4-449c-972d-3aebe7f02b60 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fbcf502d5584bbdbf9664732fb72185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd42d8f6b939448c79933a741db7981b8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:51.196013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029fe17-1fb4-449c-972d-3aebe7f02b60 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:51.196495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029fe17-1fb4-449c-972d-3aebe7f02b60 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:51.202280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029fe17-1fb4-449c-972d-3aebe7f02b60 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:51.203541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029fe17-1fb4-449c-972d-3aebe7f02b60 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:17:51.204074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029fe17-1fb4-449c-972d-3aebe7f02b60 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:51.206082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029fe17-1fb4-449c-972d-3aebe7f02b60 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:51.228519 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1691/3342] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:17:51.238199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad87da-7770-43ca-a1e8-865f24cb5877 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:51.254702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad87da-7770-43ca-a1e8-865f24cb5877 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:51.263493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebd4e1-541c-4893-a234-1618f8572644 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fbcf502d5584bbdbf9664732fb72185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd42d8f6b939448c79933a741db7981b8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:51.265613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebd4e1-541c-4893-a234-1618f8572644 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:51.266319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebd4e1-541c-4893-a234-1618f8572644 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:51.266875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebd4e1-541c-4893-a234-1618f8572644 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:51.267886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebd4e1-541c-4893-a234-1618f8572644 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:51.275396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebd4e1-541c-4893-a234-1618f8572644 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:51.460782 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1652/3343] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:17:51 2022] POST /identity/v3/projects => generated 371 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:17:51.467726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029fe17-1fb4-449c-972d-3aebe7f02b60 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:51.485007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029fe17-1fb4-449c-972d-3aebe7f02b60 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:51.748018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efb81c-8c88-4e49-8677-2bb2a79a35ac tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fbcf502d5584bbdbf9664732fb72185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd42d8f6b939448c79933a741db7981b8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:51.748711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efb81c-8c88-4e49-8677-2bb2a79a35ac tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:51.749019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efb81c-8c88-4e49-8677-2bb2a79a35ac tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:51.749348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efb81c-8c88-4e49-8677-2bb2a79a35ac tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:51.750019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99efb81c-8c88-4e49-8677-2bb2a79a35ac tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:17:51.750342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99efb81c-8c88-4e49-8677-2bb2a79a35ac tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:51.752041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99efb81c-8c88-4e49-8677-2bb2a79a35ac tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:51.773836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e273d39-11f0-43a1-a4f4-19b4e4468de6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:51.778350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e273d39-11f0-43a1-a4f4-19b4e4468de6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:51.778350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e273d39-11f0-43a1-a4f4-19b4e4468de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:51.806961 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1692/3344] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:17:51.894007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5e273d39-11f0-43a1-a4f4-19b4e4468de6 None None] MFA Rules not processed for user `d35b09fb00874c05ac96b0a20e61ba10`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:51.895380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5e273d39-11f0-43a1-a4f4-19b4e4468de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:52.048826 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1653/3345] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:52.061646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349118f-2b05-47f6-9321-9f802cdc6705 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:52.062093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349118f-2b05-47f6-9321-9f802cdc6705 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:52.062477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349118f-2b05-47f6-9321-9f802cdc6705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:52.089765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2349118f-2b05-47f6-9321-9f802cdc6705 None None] MFA Rules not processed for user `50cdc134e712487196f6623c5cf14592`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:17:52.092438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2349118f-2b05-47f6-9321-9f802cdc6705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:52.148135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e273d39-11f0-43a1-a4f4-19b4e4468de6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:52.150281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5e273d39-11f0-43a1-a4f4-19b4e4468de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:52.233360 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1693/3346] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:17:52 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:17:52.249398 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349118f-2b05-47f6-9321-9f802cdc6705 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:52.251170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2349118f-2b05-47f6-9321-9f802cdc6705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:52.289825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e273d39-11f0-43a1-a4f4-19b4e4468de6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:52.300205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f04bcb-25c7-47ba-ad4f-fcae02957999 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:52.302377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f04bcb-25c7-47ba-ad4f-fcae02957999 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:52.302834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f04bcb-25c7-47ba-ad4f-fcae02957999 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:52.303333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f04bcb-25c7-47ba-ad4f-fcae02957999 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:52.322312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f04bcb-25c7-47ba-ad4f-fcae02957999 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:52.324501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f04bcb-25c7-47ba-ad4f-fcae02957999 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:52.365942 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1654/3347] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:17:52 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:17:52.409049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2837073-a3f2-4fa7-9ed7-60639fd7ee54 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:52.409479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2837073-a3f2-4fa7-9ed7-60639fd7ee54 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:52.409865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2837073-a3f2-4fa7-9ed7-60639fd7ee54 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:52.412280 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1655/3348] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:17:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 21:17:52.420161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2837073-a3f2-4fa7-9ed7-60639fd7ee54 None None] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:17:52.463871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:52.477954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349118f-2b05-47f6-9321-9f802cdc6705 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:52.488280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2837073-a3f2-4fa7-9ed7-60639fd7ee54 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:52.488475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454603e1-6531-4555-93e5-3af9b74cdc75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:52.490591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454603e1-6531-4555-93e5-3af9b74cdc75 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:52.491478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454603e1-6531-4555-93e5-3af9b74cdc75 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:52.491758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454603e1-6531-4555-93e5-3af9b74cdc75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:52.498075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-454603e1-6531-4555-93e5-3af9b74cdc75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:52.523254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454603e1-6531-4555-93e5-3af9b74cdc75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:52.523340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2837073-a3f2-4fa7-9ed7-60639fd7ee54 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:52.523416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454603e1-6531-4555-93e5-3af9b74cdc75 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:52.538753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94156f04-13a1-47bb-b27e-372738fa13e1 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fbcf502d5584bbdbf9664732fb72185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd42d8f6b939448c79933a741db7981b8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:52.539912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94156f04-13a1-47bb-b27e-372738fa13e1 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:52.540409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94156f04-13a1-47bb-b27e-372738fa13e1 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:52.540918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94156f04-13a1-47bb-b27e-372738fa13e1 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] PATH_INFO: `/v3/projects/243dfbefda284034b9973693c393cf42` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:52.543940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94156f04-13a1-47bb-b27e-372738fa13e1 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorizing `identity:get_project(project_id=243dfbefda284034b9973693c393cf42)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:52.546945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94156f04-13a1-47bb-b27e-372738fa13e1 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:52.557401 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1656/3349] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:17:52 2022] GET /identity/v3/projects/243dfbefda284034b9973693c393cf42 => generated 371 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:17:52.564975 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1694/3350] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:17:52 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:17:53.595330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:56.393478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e82b9d-c9e3-44f2-a7e1-f967e46165b2 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:56.404026 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e82b9d-c9e3-44f2-a7e1-f967e46165b2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:56.404026 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e82b9d-c9e3-44f2-a7e1-f967e46165b2 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:56.404026 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1657/3351] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:17:56.404346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454603e1-6531-4555-93e5-3af9b74cdc75 service nova] Authenticating service token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:17:56.419550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454603e1-6531-4555-93e5-3af9b74cdc75 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:56.465975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454603e1-6531-4555-93e5-3af9b74cdc75 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:56.477433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e05a99-849c-4b4c-8f7f-56b14e212cef tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fbcf502d5584bbdbf9664732fb72185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd42d8f6b939448c79933a741db7981b8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:56.479152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e05a99-849c-4b4c-8f7f-56b14e212cef tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:56.479823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e05a99-849c-4b4c-8f7f-56b14e212cef tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:56.481140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e05a99-849c-4b4c-8f7f-56b14e212cef tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] PATH_INFO: `/v3/projects/243dfbefda284034b9973693c393cf42` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:56.487953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e05a99-849c-4b4c-8f7f-56b14e212cef tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorizing `identity:get_project(project_id=243dfbefda284034b9973693c393cf42)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:56.508101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e05a99-849c-4b4c-8f7f-56b14e212cef tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:56.508101 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1695/3352] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:17:56 2022] GET /identity/v3/projects/243dfbefda284034b9973693c393cf42 => generated 371 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:17:56.609220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e82b9d-c9e3-44f2-a7e1-f967e46165b2 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:56.631371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e82b9d-c9e3-44f2-a7e1-f967e46165b2 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:56.645023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ec2af-b085-4d7a-8291-fa7a413ff1d3 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fbcf502d5584bbdbf9664732fb72185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd42d8f6b939448c79933a741db7981b8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:56.646286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ec2af-b085-4d7a-8291-fa7a413ff1d3 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:56.646755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ec2af-b085-4d7a-8291-fa7a413ff1d3 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:56.651560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ec2af-b085-4d7a-8291-fa7a413ff1d3 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:56.651560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ec2af-b085-4d7a-8291-fa7a413ff1d3 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:17:56.651560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ec2af-b085-4d7a-8291-fa7a413ff1d3 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:56.656731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ec2af-b085-4d7a-8291-fa7a413ff1d3 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:56.694502 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1658/3353] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:17:56.698787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e05a99-849c-4b4c-8f7f-56b14e212cef tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:56.721373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e05a99-849c-4b4c-8f7f-56b14e212cef tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:56.743397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e19ef-908e-400d-ad23-ea6916a03467 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fbcf502d5584bbdbf9664732fb72185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd42d8f6b939448c79933a741db7981b8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:56.748596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e19ef-908e-400d-ad23-ea6916a03467 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:56.748896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e19ef-908e-400d-ad23-ea6916a03467 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:56.749179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e19ef-908e-400d-ad23-ea6916a03467 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:56.749887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e19ef-908e-400d-ad23-ea6916a03467 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:56.763139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e19ef-908e-400d-ad23-ea6916a03467 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:56.802312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:17:56.911229 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1696/3354] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:17:56 2022] POST /identity/v3/users => generated 381 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:17:56.915850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ec2af-b085-4d7a-8291-fa7a413ff1d3 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:56.932815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ec2af-b085-4d7a-8291-fa7a413ff1d3 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:56.939239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a2adb-eff8-4167-bf95-62860adc6dc1 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fbcf502d5584bbdbf9664732fb72185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd42d8f6b939448c79933a741db7981b8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:56.939912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a2adb-eff8-4167-bf95-62860adc6dc1 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:56.940193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a2adb-eff8-4167-bf95-62860adc6dc1 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:56.940469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a2adb-eff8-4167-bf95-62860adc6dc1 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:56.941201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a2adb-eff8-4167-bf95-62860adc6dc1 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:17:56.941508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a2adb-eff8-4167-bf95-62860adc6dc1 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:56.943620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a2adb-eff8-4167-bf95-62860adc6dc1 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:56.981341 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1659/3355] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:17:57.928164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1861a7-03e6-4918-a2f1-83bd028d997e None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:57.931385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1861a7-03e6-4918-a2f1-83bd028d997e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:57.931385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1861a7-03e6-4918-a2f1-83bd028d997e None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:57.931385 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1697/3356] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:17:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:17:57.942115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a2adb-eff8-4167-bf95-62860adc6dc1 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:17:57.980025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a2adb-eff8-4167-bf95-62860adc6dc1 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:58.001125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a2adb-eff8-4167-bf95-62860adc6dc1 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:58.008488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f58391-0ea2-497e-9f07-98e1a8814c22 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fbcf502d5584bbdbf9664732fb72185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd42d8f6b939448c79933a741db7981b8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:58.010264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f58391-0ea2-497e-9f07-98e1a8814c22 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:58.010720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f58391-0ea2-497e-9f07-98e1a8814c22 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:58.011302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f58391-0ea2-497e-9f07-98e1a8814c22 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] PATH_INFO: `/v3/projects/243dfbefda284034b9973693c393cf42` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:58.025434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f58391-0ea2-497e-9f07-98e1a8814c22 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorizing `identity:get_project(project_id=243dfbefda284034b9973693c393cf42)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:58.029264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f58391-0ea2-497e-9f07-98e1a8814c22 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:58.040954 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1660/3357] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:17:57 2022] GET /identity/v3/projects/243dfbefda284034b9973693c393cf42 => generated 371 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:17:59.189067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c445f-4e3a-4430-b314-da9f04ce6436 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:59.190404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c445f-4e3a-4430-b314-da9f04ce6436 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:59.190849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c445f-4e3a-4430-b314-da9f04ce6436 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:59.192970 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1698/3358] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:17:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:17:59.198505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f58391-0ea2-497e-9f07-98e1a8814c22 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:17:59.217109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f58391-0ea2-497e-9f07-98e1a8814c22 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:59.245451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f58391-0ea2-497e-9f07-98e1a8814c22 tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:59.261075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8b1d2-4bd2-486c-bb25-3fffa5e071fe tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fbcf502d5584bbdbf9664732fb72185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd42d8f6b939448c79933a741db7981b8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:59.262615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8b1d2-4bd2-486c-bb25-3fffa5e071fe tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:59.263968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8b1d2-4bd2-486c-bb25-3fffa5e071fe tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:59.264251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8b1d2-4bd2-486c-bb25-3fffa5e071fe tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] PATH_INFO: `/v3/projects/243dfbefda284034b9973693c393cf42` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:59.267897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8b1d2-4bd2-486c-bb25-3fffa5e071fe tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorizing `identity:get_project(project_id=243dfbefda284034b9973693c393cf42)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:59.271570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8b1d2-4bd2-486c-bb25-3fffa5e071fe tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:59.288530 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1661/3359] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:17:59 2022] GET /identity/v3/projects/243dfbefda284034b9973693c393cf42 => generated 371 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:17:59.315002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c445f-4e3a-4430-b314-da9f04ce6436 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:59.338201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c445f-4e3a-4430-b314-da9f04ce6436 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:59.354731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fc961-89a9-45e8-973e-f818c4c48acb tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fbcf502d5584bbdbf9664732fb72185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd42d8f6b939448c79933a741db7981b8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:59.356921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fc961-89a9-45e8-973e-f818c4c48acb tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:59.357541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fc961-89a9-45e8-973e-f818c4c48acb tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:59.358185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fc961-89a9-45e8-973e-f818c4c48acb tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] PATH_INFO: `/v3/users/26aed09f0744445aa4d9ae07f3c07dbe` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:59.377038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fc961-89a9-45e8-973e-f818c4c48acb tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorizing `identity:delete_user(user_id=26aed09f0744445aa4d9ae07f3c07dbe)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:59.379386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fc961-89a9-45e8-973e-f818c4c48acb tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:17:59.585450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-048fc961-89a9-45e8-973e-f818c4c48acb tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26aed09f0744445aa4d9ae07f3c07dbe'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:59.610324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-048fc961-89a9-45e8-973e-f818c4c48acb tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26aed09f0744445aa4d9ae07f3c07dbe'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:59.743677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-048fc961-89a9-45e8-973e-f818c4c48acb tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26aed09f0744445aa4d9ae07f3c07dbe'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:59.744755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-048fc961-89a9-45e8-973e-f818c4c48acb tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26aed09f0744445aa4d9ae07f3c07dbe'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:59.783247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-048fc961-89a9-45e8-973e-f818c4c48acb tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26aed09f0744445aa4d9ae07f3c07dbe'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:17:59.792934 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1699/3360] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:17:59 2022] DELETE /identity/v3/users/26aed09f0744445aa4d9ae07f3c07dbe => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:17:59.796963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8b1d2-4bd2-486c-bb25-3fffa5e071fe tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:17:59.799116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4dc8b1d2-4bd2-486c-bb25-3fffa5e071fe tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:17:59.815358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8b1d2-4bd2-486c-bb25-3fffa5e071fe tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:17:59.907201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efee3a-55bc-455c-9971-00e8f20f657e tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fbcf502d5584bbdbf9664732fb72185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd42d8f6b939448c79933a741db7981b8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:17:59.910720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efee3a-55bc-455c-9971-00e8f20f657e tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:17:59.911725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efee3a-55bc-455c-9971-00e8f20f657e tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:17:59.914575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efee3a-55bc-455c-9971-00e8f20f657e tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] PATH_INFO: `/v3/projects/243dfbefda284034b9973693c393cf42` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:17:59.916324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efee3a-55bc-455c-9971-00e8f20f657e tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorizing `identity:delete_project(project_id=243dfbefda284034b9973693c393cf42)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:17:59.924933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efee3a-55bc-455c-9971-00e8f20f657e tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:00.109335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:00.139877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-62efee3a-55bc-455c-9971-00e8f20f657e tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '243dfbefda284034b9973693c393cf42', 'request_id': 'req-62efee3a-55bc-455c-9971-00e8f20f657e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:00.159608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-62efee3a-55bc-455c-9971-00e8f20f657e tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '243dfbefda284034b9973693c393cf42', 'request_id': 'req-62efee3a-55bc-455c-9971-00e8f20f657e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:00.184471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-62efee3a-55bc-455c-9971-00e8f20f657e tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '243dfbefda284034b9973693c393cf42', 'request_id': 'req-62efee3a-55bc-455c-9971-00e8f20f657e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:00.283182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-62efee3a-55bc-455c-9971-00e8f20f657e tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] The token cache is being invalidate because project 243dfbefda284034b9973693c393cf42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:18:00.283878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-62efee3a-55bc-455c-9971-00e8f20f657e tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:00.286182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-62efee3a-55bc-455c-9971-00e8f20f657e tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:00.286182 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1662/3361] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:17:59 2022] DELETE /identity/v3/projects/243dfbefda284034b9973693c393cf42 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:00.291594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fc961-89a9-45e8-973e-f818c4c48acb tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:00.293409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-048fc961-89a9-45e8-973e-f818c4c48acb tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:00.459479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fc961-89a9-45e8-973e-f818c4c48acb tempest-QuotasAdminTestV257-1554560177 tempest-QuotasAdminTestV257-1554560177-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:00.565276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408a199-5e14-481f-9684-2f3e37b82110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:00.565780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408a199-5e14-481f-9684-2f3e37b82110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:00.566008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408a199-5e14-481f-9684-2f3e37b82110 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:00.567065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408a199-5e14-481f-9684-2f3e37b82110 admin admin] PATH_INFO: `/v3/users/fd367cc349bc404dbf4cd1e4e6b9ff62` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:00.567639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408a199-5e14-481f-9684-2f3e37b82110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd367cc349bc404dbf4cd1e4e6b9ff62)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:00.569713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408a199-5e14-481f-9684-2f3e37b82110 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:00.571880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:01.291913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b408a199-5e14-481f-9684-2f3e37b82110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd367cc349bc404dbf4cd1e4e6b9ff62'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:01.309084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b408a199-5e14-481f-9684-2f3e37b82110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd367cc349bc404dbf4cd1e4e6b9ff62'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:01.403582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b408a199-5e14-481f-9684-2f3e37b82110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd367cc349bc404dbf4cd1e4e6b9ff62'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:01.404397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b408a199-5e14-481f-9684-2f3e37b82110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd367cc349bc404dbf4cd1e4e6b9ff62'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:01.429025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b408a199-5e14-481f-9684-2f3e37b82110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd367cc349bc404dbf4cd1e4e6b9ff62'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:01.456735 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1700/3362] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:18:00 2022] DELETE /identity/v3/users/fd367cc349bc404dbf4cd1e4e6b9ff62 => generated 0 bytes in 1158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:01.457402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7fca7-9a8d-478d-b740-730d5336721b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:01.457402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7fca7-9a8d-478d-b740-730d5336721b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:01.457402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7fca7-9a8d-478d-b740-730d5336721b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:01.491789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-bff7fca7-9a8d-478d-b740-730d5336721b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:01.494318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bff7fca7-9a8d-478d-b740-730d5336721b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:01.609252 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1663/3363] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:01.617226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408a199-5e14-481f-9684-2f3e37b82110 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:01.619258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b408a199-5e14-481f-9684-2f3e37b82110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:01.713831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408a199-5e14-481f-9684-2f3e37b82110 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:01.720403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e202ee-6165-4c34-bd42-ad674a056a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:01.721430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e202ee-6165-4c34-bd42-ad674a056a52 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:01.722045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e202ee-6165-4c34-bd42-ad674a056a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:01.722601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e202ee-6165-4c34-bd42-ad674a056a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:01.735837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e202ee-6165-4c34-bd42-ad674a056a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:01.737633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e202ee-6165-4c34-bd42-ad674a056a52 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:01.751145 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1701/3364] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:18:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:18:02.350962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7fca7-9a8d-478d-b740-730d5336721b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:02.352617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bff7fca7-9a8d-478d-b740-730d5336721b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:02.382656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7fca7-9a8d-478d-b740-730d5336721b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:02.394148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1b150-a261-498a-8889-c79b2324aa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:02.395557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1b150-a261-498a-8889-c79b2324aa87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:02.396542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1b150-a261-498a-8889-c79b2324aa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:02.397123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1b150-a261-498a-8889-c79b2324aa87 admin admin] PATH_INFO: `/v3/projects/49a57ae94e54478cafacc2f231a4a880` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:02.400752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1b150-a261-498a-8889-c79b2324aa87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49a57ae94e54478cafacc2f231a4a880)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:02.407285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1b150-a261-498a-8889-c79b2324aa87 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:02.617234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-86d1b150-a261-498a-8889-c79b2324aa87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49a57ae94e54478cafacc2f231a4a880', 'request_id': 'req-86d1b150-a261-498a-8889-c79b2324aa87'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:02.626856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-86d1b150-a261-498a-8889-c79b2324aa87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49a57ae94e54478cafacc2f231a4a880', 'request_id': 'req-86d1b150-a261-498a-8889-c79b2324aa87'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:02.640132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-86d1b150-a261-498a-8889-c79b2324aa87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49a57ae94e54478cafacc2f231a4a880', 'request_id': 'req-86d1b150-a261-498a-8889-c79b2324aa87'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:02.686292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298dfe8-918f-47a1-a252-09983548d9fe None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:02.686754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298dfe8-918f-47a1-a252-09983548d9fe None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:02.688582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298dfe8-918f-47a1-a252-09983548d9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:02.712179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6298dfe8-918f-47a1-a252-09983548d9fe None None] MFA Rules not processed for user `dd4144b5388b46a989a41a2f556bb508`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:02.713732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6298dfe8-918f-47a1-a252-09983548d9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:02.740318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-86d1b150-a261-498a-8889-c79b2324aa87 admin admin] The token cache is being invalidate because project 49a57ae94e54478cafacc2f231a4a880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:18:02.740606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-86d1b150-a261-498a-8889-c79b2324aa87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:02.742930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-86d1b150-a261-498a-8889-c79b2324aa87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:02.745076 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1664/3365] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:18:02 2022] DELETE /identity/v3/projects/49a57ae94e54478cafacc2f231a4a880 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:02.749863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1b150-a261-498a-8889-c79b2324aa87 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:02.751573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-86d1b150-a261-498a-8889-c79b2324aa87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:02.835926 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1702/3366] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:02.849402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:02.875061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1b150-a261-498a-8889-c79b2324aa87 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:02.881806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bf70b-e65e-4a55-bf41-5055742e0c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:02.882897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bf70b-e65e-4a55-bf41-5055742e0c5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:02.883414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bf70b-e65e-4a55-bf41-5055742e0c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:02.883857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bf70b-e65e-4a55-bf41-5055742e0c5e admin admin] PATH_INFO: `/v3/users/5fbcf502d5584bbdbf9664732fb72185` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:02.887768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bf70b-e65e-4a55-bf41-5055742e0c5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fbcf502d5584bbdbf9664732fb72185)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:02.890024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bf70b-e65e-4a55-bf41-5055742e0c5e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:03.198428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-247bf70b-e65e-4a55-bf41-5055742e0c5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fbcf502d5584bbdbf9664732fb72185'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:03.214552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-247bf70b-e65e-4a55-bf41-5055742e0c5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fbcf502d5584bbdbf9664732fb72185'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:03.290200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-247bf70b-e65e-4a55-bf41-5055742e0c5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fbcf502d5584bbdbf9664732fb72185'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:03.302659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-247bf70b-e65e-4a55-bf41-5055742e0c5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fbcf502d5584bbdbf9664732fb72185'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:03.307995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-247bf70b-e65e-4a55-bf41-5055742e0c5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fbcf502d5584bbdbf9664732fb72185'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:03.326818 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1665/3367] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:18:02 2022] DELETE /identity/v3/users/5fbcf502d5584bbdbf9664732fb72185 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:03.937610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298dfe8-918f-47a1-a252-09983548d9fe None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:03.976988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298dfe8-918f-47a1-a252-09983548d9fe None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:04.061561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:04.120169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6837d82-6994-4df4-9b57-3b93ead77cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:04.124433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6837d82-6994-4df4-9b57-3b93ead77cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:04.124433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6837d82-6994-4df4-9b57-3b93ead77cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:04.124433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6837d82-6994-4df4-9b57-3b93ead77cfd admin admin] PATH_INFO: `/v3/projects/d42d8f6b939448c79933a741db7981b8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:04.124433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6837d82-6994-4df4-9b57-3b93ead77cfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d42d8f6b939448c79933a741db7981b8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:04.126456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6837d82-6994-4df4-9b57-3b93ead77cfd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:04.419505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6837d82-6994-4df4-9b57-3b93ead77cfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd42d8f6b939448c79933a741db7981b8', 'request_id': 'req-c6837d82-6994-4df4-9b57-3b93ead77cfd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:04.443551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6837d82-6994-4df4-9b57-3b93ead77cfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd42d8f6b939448c79933a741db7981b8', 'request_id': 'req-c6837d82-6994-4df4-9b57-3b93ead77cfd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:04.465970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6837d82-6994-4df4-9b57-3b93ead77cfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd42d8f6b939448c79933a741db7981b8', 'request_id': 'req-c6837d82-6994-4df4-9b57-3b93ead77cfd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:04.567837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6837d82-6994-4df4-9b57-3b93ead77cfd admin admin] The token cache is being invalidate because project d42d8f6b939448c79933a741db7981b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:18:04.568149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6837d82-6994-4df4-9b57-3b93ead77cfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:04.569643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6837d82-6994-4df4-9b57-3b93ead77cfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:04.573120 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1703/3368] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:18:03 2022] DELETE /identity/v3/projects/d42d8f6b939448c79933a741db7981b8 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:04.580667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8174a-2757-4b95-9310-2df5f94c5fea None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:04.581658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8174a-2757-4b95-9310-2df5f94c5fea None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:04.582138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8174a-2757-4b95-9310-2df5f94c5fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:04.610950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-18f8174a-2757-4b95-9310-2df5f94c5fea None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:04.612467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-18f8174a-2757-4b95-9310-2df5f94c5fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:04.724413 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1666/3369] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:18:04.734301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac12b3-6a89-4dc9-945a-161dfe1b7d2f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:04.734612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac12b3-6a89-4dc9-945a-161dfe1b7d2f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:04.734905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac12b3-6a89-4dc9-945a-161dfe1b7d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:04.761303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-02ac12b3-6a89-4dc9-945a-161dfe1b7d2f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:04.763151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-02ac12b3-6a89-4dc9-945a-161dfe1b7d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:04.778256 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1704/3370] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:04.778769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8174a-2757-4b95-9310-2df5f94c5fea None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:04.791346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8174a-2757-4b95-9310-2df5f94c5fea None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:04.799150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5f7e0-cf45-4a8b-b7a9-1436220323fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:04.800579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5f7e0-cf45-4a8b-b7a9-1436220323fb admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:04.800921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5f7e0-cf45-4a8b-b7a9-1436220323fb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:04.801204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5f7e0-cf45-4a8b-b7a9-1436220323fb admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:04.802357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5f7e0-cf45-4a8b-b7a9-1436220323fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:18:04.813804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5f7e0-cf45-4a8b-b7a9-1436220323fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:04.815775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5f7e0-cf45-4a8b-b7a9-1436220323fb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:04.850519 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1667/3371] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:18:04.852208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac12b3-6a89-4dc9-945a-161dfe1b7d2f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:04.884903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac12b3-6a89-4dc9-945a-161dfe1b7d2f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:04.897162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ff2d5-3f5f-4d34-ba19-1239efb46a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:04.897883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ff2d5-3f5f-4d34-ba19-1239efb46a09 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:04.898353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ff2d5-3f5f-4d34-ba19-1239efb46a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:04.898730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ff2d5-3f5f-4d34-ba19-1239efb46a09 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:04.899645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ff2d5-3f5f-4d34-ba19-1239efb46a09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:04.902446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ff2d5-3f5f-4d34-ba19-1239efb46a09 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:05.132688 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1705/3372] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:18:04 2022] POST /identity/v3/projects => generated 391 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:18:05.137510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5f7e0-cf45-4a8b-b7a9-1436220323fb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:05.154733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5f7e0-cf45-4a8b-b7a9-1436220323fb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:05.262989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:05.307494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36fc2e-8660-4b81-acd3-3f99e07ddd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:05.308229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36fc2e-8660-4b81-acd3-3f99e07ddd3b admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:05.308520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36fc2e-8660-4b81-acd3-3f99e07ddd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:05.308796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36fc2e-8660-4b81-acd3-3f99e07ddd3b admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:05.316857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36fc2e-8660-4b81-acd3-3f99e07ddd3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:05.318856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36fc2e-8660-4b81-acd3-3f99e07ddd3b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:05.523081 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1668/3373] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:18:05 2022] POST /identity/v3/users => generated 296 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:18:05.523537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ff2d5-3f5f-4d34-ba19-1239efb46a09 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:05.551365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ff2d5-3f5f-4d34-ba19-1239efb46a09 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:05.563501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64093338-3aa1-4e52-9197-5ca12a635076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:05.564424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64093338-3aa1-4e52-9197-5ca12a635076 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:05.564705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64093338-3aa1-4e52-9197-5ca12a635076 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:05.565042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64093338-3aa1-4e52-9197-5ca12a635076 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:05.565793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64093338-3aa1-4e52-9197-5ca12a635076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:05.567477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64093338-3aa1-4e52-9197-5ca12a635076 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:05.590337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36fc2e-8660-4b81-acd3-3f99e07ddd3b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:05.599101 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1706/3374] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:18:05.603975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36fc2e-8660-4b81-acd3-3f99e07ddd3b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:05.610056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1e15a-df4c-465d-bf4f-596f02d5eec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:05.611437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1e15a-df4c-465d-bf4f-596f02d5eec0 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:05.612739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1e15a-df4c-465d-bf4f-596f02d5eec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:05.613124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1e15a-df4c-465d-bf4f-596f02d5eec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:05.613981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1e15a-df4c-465d-bf4f-596f02d5eec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:05.623667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1e15a-df4c-465d-bf4f-596f02d5eec0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:05.641002 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1669/3375] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:18:05.650103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64093338-3aa1-4e52-9197-5ca12a635076 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:05.688302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64093338-3aa1-4e52-9197-5ca12a635076 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:05.688302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f614060-c20a-494a-b1e8-fc10885ecd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:05.688302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f614060-c20a-494a-b1e8-fc10885ecd86 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:05.689153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f614060-c20a-494a-b1e8-fc10885ecd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:05.689881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f614060-c20a-494a-b1e8-fc10885ecd86 admin admin] PATH_INFO: `/v3/projects/662a3dce95094971b0cdf2a82814c3f6/users/9f261ce062c14abc83521cf580745f1e/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:05.759208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f614060-c20a-494a-b1e8-fc10885ecd86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=662a3dce95094971b0cdf2a82814c3f6, user_id=9f261ce062c14abc83521cf580745f1e, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:05.762466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f614060-c20a-494a-b1e8-fc10885ecd86 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:06.250050 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1707/3376] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:18:05 2022] PUT /identity/v3/projects/662a3dce95094971b0cdf2a82814c3f6/users/9f261ce062c14abc83521cf580745f1e/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:06.262852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908eb8f-7e9a-4d5e-b4a7-4d76cd03fe88 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:06.264082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908eb8f-7e9a-4d5e-b4a7-4d76cd03fe88 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:06.264457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908eb8f-7e9a-4d5e-b4a7-4d76cd03fe88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:06.305158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f908eb8f-7e9a-4d5e-b4a7-4d76cd03fe88 None None] MFA Rules not processed for user `9f261ce062c14abc83521cf580745f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:06.306850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f908eb8f-7e9a-4d5e-b4a7-4d76cd03fe88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:06.443780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f614060-c20a-494a-b1e8-fc10885ecd86 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:06.453708 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1670/3377] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:06.591341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:06.677449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f614060-c20a-494a-b1e8-fc10885ecd86 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:06.703128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1786f5-4bfc-4b75-a5bf-c94df0877c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:06.703128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1786f5-4bfc-4b75-a5bf-c94df0877c61 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:06.703128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1786f5-4bfc-4b75-a5bf-c94df0877c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:06.703434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1786f5-4bfc-4b75-a5bf-c94df0877c61 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:06.711132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1786f5-4bfc-4b75-a5bf-c94df0877c61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:06.715063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1786f5-4bfc-4b75-a5bf-c94df0877c61 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:06.840316 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1708/3378] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:18:06 2022] POST /identity/v3/projects => generated 391 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:18:06.848665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908eb8f-7e9a-4d5e-b4a7-4d76cd03fe88 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:06.862475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908eb8f-7e9a-4d5e-b4a7-4d76cd03fe88 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:06.951674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db330e05-6b02-4e61-9b22-d1d701b5592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:06.952740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db330e05-6b02-4e61-9b22-d1d701b5592b admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:06.953505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db330e05-6b02-4e61-9b22-d1d701b5592b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:06.954348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db330e05-6b02-4e61-9b22-d1d701b5592b admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:06.955639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db330e05-6b02-4e61-9b22-d1d701b5592b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:06.958319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db330e05-6b02-4e61-9b22-d1d701b5592b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:07.099816 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1671/3379] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:18:06 2022] POST /identity/v3/users => generated 302 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:18:07.100438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1786f5-4bfc-4b75-a5bf-c94df0877c61 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:07.138363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1786f5-4bfc-4b75-a5bf-c94df0877c61 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:07.155227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759eed57-22f5-4c35-9761-2d58181d1679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:07.156058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759eed57-22f5-4c35-9761-2d58181d1679 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:07.156441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759eed57-22f5-4c35-9761-2d58181d1679 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:07.156922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759eed57-22f5-4c35-9761-2d58181d1679 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:07.157897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759eed57-22f5-4c35-9761-2d58181d1679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:07.160699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759eed57-22f5-4c35-9761-2d58181d1679 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:07.194690 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1709/3380] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:18:07.199857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db330e05-6b02-4e61-9b22-d1d701b5592b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:07.218025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db330e05-6b02-4e61-9b22-d1d701b5592b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:07.235885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549ad22-7d2d-40af-8a51-f2faabbe6f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:07.237713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549ad22-7d2d-40af-8a51-f2faabbe6f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:07.238447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549ad22-7d2d-40af-8a51-f2faabbe6f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:07.239257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549ad22-7d2d-40af-8a51-f2faabbe6f12 admin admin] PATH_INFO: `/v3/projects/31a2b55f20034a43a5466d57dff0cf6e/users/ea1fc0747d4c488f8de0e504fde44268/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:07.279474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549ad22-7d2d-40af-8a51-f2faabbe6f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a2b55f20034a43a5466d57dff0cf6e, user_id=ea1fc0747d4c488f8de0e504fde44268, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:07.289121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549ad22-7d2d-40af-8a51-f2faabbe6f12 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:07.425307 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1672/3381] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:18:07 2022] PUT /identity/v3/projects/31a2b55f20034a43a5466d57dff0cf6e/users/ea1fc0747d4c488f8de0e504fde44268/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:07.426904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759eed57-22f5-4c35-9761-2d58181d1679 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:07.455190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759eed57-22f5-4c35-9761-2d58181d1679 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:07.644993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f4cc6-2f59-445e-b381-271aca7c2e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:07.645800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f4cc6-2f59-445e-b381-271aca7c2e26 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:07.646094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f4cc6-2f59-445e-b381-271aca7c2e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:07.646370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f4cc6-2f59-445e-b381-271aca7c2e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:07.647503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f4cc6-2f59-445e-b381-271aca7c2e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:07.649388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f4cc6-2f59-445e-b381-271aca7c2e26 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:07.672703 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1710/3382] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:18:07.674155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549ad22-7d2d-40af-8a51-f2faabbe6f12 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:07.711658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549ad22-7d2d-40af-8a51-f2faabbe6f12 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:07.721305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c98979-1266-4576-a456-0e408ffcafae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:07.723740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c98979-1266-4576-a456-0e408ffcafae admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:07.724282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c98979-1266-4576-a456-0e408ffcafae admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:07.724882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c98979-1266-4576-a456-0e408ffcafae admin admin] PATH_INFO: `/v3/projects/31a2b55f20034a43a5466d57dff0cf6e/users/ea1fc0747d4c488f8de0e504fde44268/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:07.737752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c98979-1266-4576-a456-0e408ffcafae admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a2b55f20034a43a5466d57dff0cf6e, user_id=ea1fc0747d4c488f8de0e504fde44268, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:07.742370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c98979-1266-4576-a456-0e408ffcafae admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:07.782980 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1673/3383] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:18:07 2022] PUT /identity/v3/projects/31a2b55f20034a43a5466d57dff0cf6e/users/ea1fc0747d4c488f8de0e504fde44268/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:07.785236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fbbc7-a9c8-492b-a8ad-3af8ffec0dd1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:07.785635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fbbc7-a9c8-492b-a8ad-3af8ffec0dd1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:07.786113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fbbc7-a9c8-492b-a8ad-3af8ffec0dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:07.837481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-929fbbc7-a9c8-492b-a8ad-3af8ffec0dd1 None None] MFA Rules not processed for user `ea1fc0747d4c488f8de0e504fde44268`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:07.838947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-929fbbc7-a9c8-492b-a8ad-3af8ffec0dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:07.962287 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1711/3384] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:07 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:08.361362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c98979-1266-4576-a456-0e408ffcafae admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:08.364962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a8c98979-1266-4576-a456-0e408ffcafae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:08.380464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:08.520552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c98979-1266-4576-a456-0e408ffcafae admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:08.538218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22848551-bae6-4ff3-bc9d-9bce1e31d708 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:08.538910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22848551-bae6-4ff3-bc9d-9bce1e31d708 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:08.543098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22848551-bae6-4ff3-bc9d-9bce1e31d708 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:08.543098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22848551-bae6-4ff3-bc9d-9bce1e31d708 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:08.644246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22848551-bae6-4ff3-bc9d-9bce1e31d708 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:08.645208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22848551-bae6-4ff3-bc9d-9bce1e31d708 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:08.661789 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1674/3385] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:18:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:18:12.649107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fbbc7-a9c8-492b-a8ad-3af8ffec0dd1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:12.664629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fbbc7-a9c8-492b-a8ad-3af8ffec0dd1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:12.674065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b79133-4e01-4e4c-aa6e-6cf57cf3e643 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:12.674755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b79133-4e01-4e4c-aa6e-6cf57cf3e643 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:12.675114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b79133-4e01-4e4c-aa6e-6cf57cf3e643 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:12.675392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b79133-4e01-4e4c-aa6e-6cf57cf3e643 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:12.686466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b79133-4e01-4e4c-aa6e-6cf57cf3e643 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:12.688181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b79133-4e01-4e4c-aa6e-6cf57cf3e643 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:12.698736 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1712/3386] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:18:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:18:13.675435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22848551-bae6-4ff3-bc9d-9bce1e31d708 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:13.678202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-22848551-bae6-4ff3-bc9d-9bce1e31d708 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:13.738502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22848551-bae6-4ff3-bc9d-9bce1e31d708 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:13.742101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737db1b9-a0d2-473b-b8ef-28ca90d3e426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:13.742768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737db1b9-a0d2-473b-b8ef-28ca90d3e426 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:13.743073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737db1b9-a0d2-473b-b8ef-28ca90d3e426 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:13.743350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737db1b9-a0d2-473b-b8ef-28ca90d3e426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:13.745604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-737db1b9-a0d2-473b-b8ef-28ca90d3e426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:13.762926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737db1b9-a0d2-473b-b8ef-28ca90d3e426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:13.764396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737db1b9-a0d2-473b-b8ef-28ca90d3e426 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:13.776441 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1675/3387] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:18:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:18:14.704459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b79133-4e01-4e4c-aa6e-6cf57cf3e643 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:14.705925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-64b79133-4e01-4e4c-aa6e-6cf57cf3e643 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:14.723796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b79133-4e01-4e4c-aa6e-6cf57cf3e643 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:14.730813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966f406-ac48-4f63-ac32-24d8f90e7e79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:14.731744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966f406-ac48-4f63-ac32-24d8f90e7e79 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:14.732511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966f406-ac48-4f63-ac32-24d8f90e7e79 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:14.733070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966f406-ac48-4f63-ac32-24d8f90e7e79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:14.735320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d966f406-ac48-4f63-ac32-24d8f90e7e79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:14.773621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:14.804848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966f406-ac48-4f63-ac32-24d8f90e7e79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:14.806454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966f406-ac48-4f63-ac32-24d8f90e7e79 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:14.816527 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1713/3388] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:18:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:18:15.854405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737db1b9-a0d2-473b-b8ef-28ca90d3e426 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:15.864908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737db1b9-a0d2-473b-b8ef-28ca90d3e426 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:15.871553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dfe46-0964-4f3f-9c01-05f09928e6fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:15.872197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dfe46-0964-4f3f-9c01-05f09928e6fd service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:15.872664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dfe46-0964-4f3f-9c01-05f09928e6fd service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:15.872942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dfe46-0964-4f3f-9c01-05f09928e6fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:15.874698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5c7dfe46-0964-4f3f-9c01-05f09928e6fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:15.891075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dfe46-0964-4f3f-9c01-05f09928e6fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:15.892511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dfe46-0964-4f3f-9c01-05f09928e6fd service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:15.905962 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1676/3389] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:18:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:18:18.501082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac669d0-1b04-4d38-93b9-6c64653ed808 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:18.501900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac669d0-1b04-4d38-93b9-6c64653ed808 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:18.502325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac669d0-1b04-4d38-93b9-6c64653ed808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:18.566433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9ac669d0-1b04-4d38-93b9-6c64653ed808 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:18.567914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9ac669d0-1b04-4d38-93b9-6c64653ed808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:18.671651 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1714/3390] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:18:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:18.696763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dfe46-0964-4f3f-9c01-05f09928e6fd service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:18.698384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5c7dfe46-0964-4f3f-9c01-05f09928e6fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:18.753540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:18.798566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dfe46-0964-4f3f-9c01-05f09928e6fd service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:18.804037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbbb91-21b0-4ef3-800c-d8530dc3fd0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:18.804946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbbb91-21b0-4ef3-800c-d8530dc3fd0a service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:18.805393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbbb91-21b0-4ef3-800c-d8530dc3fd0a service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:18.805770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbbb91-21b0-4ef3-800c-d8530dc3fd0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:18.817275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbbb91-21b0-4ef3-800c-d8530dc3fd0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:18.823849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbbb91-21b0-4ef3-800c-d8530dc3fd0a service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:18.829193 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1677/3391] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:18:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:18:21.481128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac669d0-1b04-4d38-93b9-6c64653ed808 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:21.668266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac669d0-1b04-4d38-93b9-6c64653ed808 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:21.673560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c0650-6883-4620-aa89-bc33ccddaeb3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:21.674402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c0650-6883-4620-aa89-bc33ccddaeb3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:21.674961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c0650-6883-4620-aa89-bc33ccddaeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:21.679781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0702d2-9443-4dff-8ee2-ebde8daa03d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:21.680886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0702d2-9443-4dff-8ee2-ebde8daa03d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:21.681337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0702d2-9443-4dff-8ee2-ebde8daa03d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:21.681615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0702d2-9443-4dff-8ee2-ebde8daa03d9 admin admin] PATH_INFO: `/v3/users/9f261ce062c14abc83521cf580745f1e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:21.690405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0702d2-9443-4dff-8ee2-ebde8daa03d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f261ce062c14abc83521cf580745f1e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:21.695450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0702d2-9443-4dff-8ee2-ebde8daa03d9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:21.704299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-919c0650-6883-4620-aa89-bc33ccddaeb3 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:21.705626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-919c0650-6883-4620-aa89-bc33ccddaeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:21.726025 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1678/3392] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:18:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:21.727767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c0650-6883-4620-aa89-bc33ccddaeb3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:21.748006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c0650-6883-4620-aa89-bc33ccddaeb3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:21.757257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4646f-443e-4130-8fa9-7869919f59b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:21.758622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4646f-443e-4130-8fa9-7869919f59b1 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:21.758622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4646f-443e-4130-8fa9-7869919f59b1 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:21.758622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4646f-443e-4130-8fa9-7869919f59b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:21.761343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1ef4646f-443e-4130-8fa9-7869919f59b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:21.846467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4646f-443e-4130-8fa9-7869919f59b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:21.848030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4646f-443e-4130-8fa9-7869919f59b1 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:21.876449 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1679/3393] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:18:21 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:18:21.876449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4646f-443e-4130-8fa9-7869919f59b1 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:21.930953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4646f-443e-4130-8fa9-7869919f59b1 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:21.954666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b3fe0-77d5-4444-af53-7a62ca9287ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:21.955381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b3fe0-77d5-4444-af53-7a62ca9287ea service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:21.955671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b3fe0-77d5-4444-af53-7a62ca9287ea service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:21.955947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b3fe0-77d5-4444-af53-7a62ca9287ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:21.992182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b3fe0-77d5-4444-af53-7a62ca9287ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:21.994409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b3fe0-77d5-4444-af53-7a62ca9287ea service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:22.006077 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1680/3394] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:18:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:18:22.132029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:22.133265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7d0702d2-9443-4dff-8ee2-ebde8daa03d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f261ce062c14abc83521cf580745f1e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:22.168525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7d0702d2-9443-4dff-8ee2-ebde8daa03d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f261ce062c14abc83521cf580745f1e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:22.973681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7d0702d2-9443-4dff-8ee2-ebde8daa03d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f261ce062c14abc83521cf580745f1e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:22.980223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7d0702d2-9443-4dff-8ee2-ebde8daa03d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f261ce062c14abc83521cf580745f1e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:23.022147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7d0702d2-9443-4dff-8ee2-ebde8daa03d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f261ce062c14abc83521cf580745f1e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:23.031808 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1715/3395] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:18:21 2022] DELETE /identity/v3/users/9f261ce062c14abc83521cf580745f1e => generated 0 bytes in 1552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:23.035960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c344bc-7477-41e4-9800-03737308390b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:23.039304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c344bc-7477-41e4-9800-03737308390b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:23.040061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c344bc-7477-41e4-9800-03737308390b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:23.082815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e7c344bc-7477-41e4-9800-03737308390b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:23.086164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e7c344bc-7477-41e4-9800-03737308390b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:23.243533 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1681/3396] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:23.255931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0702d2-9443-4dff-8ee2-ebde8daa03d9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:23.257828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7d0702d2-9443-4dff-8ee2-ebde8daa03d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:23.369886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0702d2-9443-4dff-8ee2-ebde8daa03d9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:23.374432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c7c33-29a0-4c13-a7fe-04336ebccd90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:23.375161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c7c33-29a0-4c13-a7fe-04336ebccd90 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:23.375611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c7c33-29a0-4c13-a7fe-04336ebccd90 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:23.379533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c7c33-29a0-4c13-a7fe-04336ebccd90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:23.396062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c7c33-29a0-4c13-a7fe-04336ebccd90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:23.398049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c7c33-29a0-4c13-a7fe-04336ebccd90 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:23.415829 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1716/3397] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:18:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:18:23.797643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c344bc-7477-41e4-9800-03737308390b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:23.799220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e7c344bc-7477-41e4-9800-03737308390b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:23.835872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c344bc-7477-41e4-9800-03737308390b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:23.843529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a4fa3-9c55-4f80-afa0-16da53e9f3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:23.856626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a4fa3-9c55-4f80-afa0-16da53e9f3db admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:23.857147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a4fa3-9c55-4f80-afa0-16da53e9f3db admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:23.858334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a4fa3-9c55-4f80-afa0-16da53e9f3db admin admin] PATH_INFO: `/v3/projects/662a3dce95094971b0cdf2a82814c3f6` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:23.869542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a4fa3-9c55-4f80-afa0-16da53e9f3db admin admin] RBAC: Authorizing `identity:delete_project(project_id=662a3dce95094971b0cdf2a82814c3f6)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:23.872052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a4fa3-9c55-4f80-afa0-16da53e9f3db admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:24.049794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:24.081553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9d4a4fa3-9c55-4f80-afa0-16da53e9f3db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '662a3dce95094971b0cdf2a82814c3f6', 'request_id': 'req-9d4a4fa3-9c55-4f80-afa0-16da53e9f3db'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:24.095750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9d4a4fa3-9c55-4f80-afa0-16da53e9f3db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '662a3dce95094971b0cdf2a82814c3f6', 'request_id': 'req-9d4a4fa3-9c55-4f80-afa0-16da53e9f3db'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:24.106744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9d4a4fa3-9c55-4f80-afa0-16da53e9f3db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '662a3dce95094971b0cdf2a82814c3f6', 'request_id': 'req-9d4a4fa3-9c55-4f80-afa0-16da53e9f3db'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:24.201533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9d4a4fa3-9c55-4f80-afa0-16da53e9f3db admin admin] The token cache is being invalidate because project 662a3dce95094971b0cdf2a82814c3f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:18:24.201784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9d4a4fa3-9c55-4f80-afa0-16da53e9f3db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:24.202450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9d4a4fa3-9c55-4f80-afa0-16da53e9f3db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:24.204058 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1682/3398] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:18:23 2022] DELETE /identity/v3/projects/662a3dce95094971b0cdf2a82814c3f6 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:24.208191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c7c33-29a0-4c13-a7fe-04336ebccd90 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:24.219885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c7c33-29a0-4c13-a7fe-04336ebccd90 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:24.311666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5dca63-25a6-4d3d-a34d-100986bda6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:24.312839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dca63-25a6-4d3d-a34d-100986bda6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:24.315376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dca63-25a6-4d3d-a34d-100986bda6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:24.315843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dca63-25a6-4d3d-a34d-100986bda6cd admin admin] PATH_INFO: `/v3/users/ea1fc0747d4c488f8de0e504fde44268` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:24.320149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5dca63-25a6-4d3d-a34d-100986bda6cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea1fc0747d4c488f8de0e504fde44268)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:24.322579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5dca63-25a6-4d3d-a34d-100986bda6cd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:24.608541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7a5dca63-25a6-4d3d-a34d-100986bda6cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea1fc0747d4c488f8de0e504fde44268'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:24.625332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7a5dca63-25a6-4d3d-a34d-100986bda6cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea1fc0747d4c488f8de0e504fde44268'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:24.710594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7a5dca63-25a6-4d3d-a34d-100986bda6cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea1fc0747d4c488f8de0e504fde44268'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:24.711267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7a5dca63-25a6-4d3d-a34d-100986bda6cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea1fc0747d4c488f8de0e504fde44268'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:24.714600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:24.736733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7a5dca63-25a6-4d3d-a34d-100986bda6cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea1fc0747d4c488f8de0e504fde44268'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:24.756982 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1717/3399] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:18:24 2022] DELETE /identity/v3/users/ea1fc0747d4c488f8de0e504fde44268 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:25.136449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a4fa3-9c55-4f80-afa0-16da53e9f3db admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:25.138924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9d4a4fa3-9c55-4f80-afa0-16da53e9f3db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:25.153279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a4fa3-9c55-4f80-afa0-16da53e9f3db admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:25.224649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e6932-f16d-4c22-9228-4c070250abb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:25.225681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e6932-f16d-4c22-9228-4c070250abb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:25.225856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e6932-f16d-4c22-9228-4c070250abb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:25.226128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e6932-f16d-4c22-9228-4c070250abb3 admin admin] PATH_INFO: `/v3/projects/31a2b55f20034a43a5466d57dff0cf6e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:25.227477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e6932-f16d-4c22-9228-4c070250abb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31a2b55f20034a43a5466d57dff0cf6e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:25.229655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e6932-f16d-4c22-9228-4c070250abb3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:25.362944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-605e6932-f16d-4c22-9228-4c070250abb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31a2b55f20034a43a5466d57dff0cf6e', 'request_id': 'req-605e6932-f16d-4c22-9228-4c070250abb3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:25.373454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-605e6932-f16d-4c22-9228-4c070250abb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31a2b55f20034a43a5466d57dff0cf6e', 'request_id': 'req-605e6932-f16d-4c22-9228-4c070250abb3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:25.382900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-605e6932-f16d-4c22-9228-4c070250abb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31a2b55f20034a43a5466d57dff0cf6e', 'request_id': 'req-605e6932-f16d-4c22-9228-4c070250abb3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:25.873579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-605e6932-f16d-4c22-9228-4c070250abb3 admin admin] The token cache is being invalidate because project 31a2b55f20034a43a5466d57dff0cf6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:18:25.873942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-605e6932-f16d-4c22-9228-4c070250abb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:25.875312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-605e6932-f16d-4c22-9228-4c070250abb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:25.877592 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1683/3400] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:18:25 2022] DELETE /identity/v3/projects/31a2b55f20034a43a5466d57dff0cf6e => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:25.883513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdd2b0-25e9-41cc-9e69-b4736b608670 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:25.883513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdd2b0-25e9-41cc-9e69-b4736b608670 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:25.883513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdd2b0-25e9-41cc-9e69-b4736b608670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:25.910282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-78fdd2b0-25e9-41cc-9e69-b4736b608670 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:25.914612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-78fdd2b0-25e9-41cc-9e69-b4736b608670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:26.033412 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1718/3401] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:26.035238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e0cbb-d966-437f-88e7-f5bff99959e4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:26.035531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e0cbb-d966-437f-88e7-f5bff99959e4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:26.035814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e0cbb-d966-437f-88e7-f5bff99959e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:26.091986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-436e0cbb-d966-437f-88e7-f5bff99959e4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:26.095697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-436e0cbb-d966-437f-88e7-f5bff99959e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:26.111471 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1684/3402] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:26.116125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdd2b0-25e9-41cc-9e69-b4736b608670 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:26.134208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdd2b0-25e9-41cc-9e69-b4736b608670 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:26.140714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674650a-a816-4ee8-90a4-1263bfe99ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:26.141396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674650a-a816-4ee8-90a4-1263bfe99ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:26.141746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674650a-a816-4ee8-90a4-1263bfe99ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:26.142057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674650a-a816-4ee8-90a4-1263bfe99ca1 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:26.142764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674650a-a816-4ee8-90a4-1263bfe99ca1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:18:26.143407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674650a-a816-4ee8-90a4-1263bfe99ca1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:26.144934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674650a-a816-4ee8-90a4-1263bfe99ca1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:26.161738 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1719/3403] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:18:26.165999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e0cbb-d966-437f-88e7-f5bff99959e4 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:26.181730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e0cbb-d966-437f-88e7-f5bff99959e4 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:26.191551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b724d02-0456-45c6-b7e0-0948231e36b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:26.192267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b724d02-0456-45c6-b7e0-0948231e36b3 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:26.192551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b724d02-0456-45c6-b7e0-0948231e36b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:26.192828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b724d02-0456-45c6-b7e0-0948231e36b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:26.193549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b724d02-0456-45c6-b7e0-0948231e36b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:26.195762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b724d02-0456-45c6-b7e0-0948231e36b3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:26.341911 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1685/3404] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:18:26 2022] POST /identity/v3/projects => generated 371 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:18:26.346757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674650a-a816-4ee8-90a4-1263bfe99ca1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:26.363943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674650a-a816-4ee8-90a4-1263bfe99ca1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:26.466811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f7160-b297-4381-8e88-363a2af5074c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:26.467691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f7160-b297-4381-8e88-363a2af5074c admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:26.468741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f7160-b297-4381-8e88-363a2af5074c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:26.469110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f7160-b297-4381-8e88-363a2af5074c admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:26.469925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f7160-b297-4381-8e88-363a2af5074c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:26.472348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f7160-b297-4381-8e88-363a2af5074c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:26.737382 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1720/3405] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:18:26 2022] POST /identity/v3/users => generated 286 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:18:26.739665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b724d02-0456-45c6-b7e0-0948231e36b3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:26.751245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b724d02-0456-45c6-b7e0-0948231e36b3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:26.766800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df80b6-2404-4fa7-b61c-8fbab7ce18f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:26.766800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df80b6-2404-4fa7-b61c-8fbab7ce18f9 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:26.766800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df80b6-2404-4fa7-b61c-8fbab7ce18f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:26.766800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df80b6-2404-4fa7-b61c-8fbab7ce18f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:26.767259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df80b6-2404-4fa7-b61c-8fbab7ce18f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:26.768846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df80b6-2404-4fa7-b61c-8fbab7ce18f9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:26.792880 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1686/3406] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:18:26.794231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f7160-b297-4381-8e88-363a2af5074c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:26.804984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f7160-b297-4381-8e88-363a2af5074c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:26.813585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4702818-5744-4d26-b673-3b94162a5094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:26.814426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4702818-5744-4d26-b673-3b94162a5094 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:26.814814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4702818-5744-4d26-b673-3b94162a5094 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:26.815376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4702818-5744-4d26-b673-3b94162a5094 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:26.816322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4702818-5744-4d26-b673-3b94162a5094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:26.822768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4702818-5744-4d26-b673-3b94162a5094 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:26.833860 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1721/3407] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:18:26.835205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df80b6-2404-4fa7-b61c-8fbab7ce18f9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:26.865350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df80b6-2404-4fa7-b61c-8fbab7ce18f9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:26.880102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee422d39-d425-4c7c-a921-9bb65fd87f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:26.881120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee422d39-d425-4c7c-a921-9bb65fd87f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:26.881613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee422d39-d425-4c7c-a921-9bb65fd87f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:26.882861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee422d39-d425-4c7c-a921-9bb65fd87f1b admin admin] PATH_INFO: `/v3/projects/cb2b1bc5dd5d441699674ad70befbf9f/users/53a1ede2787d443d93773b37a64a62f8/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:26.888893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:26.922966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee422d39-d425-4c7c-a921-9bb65fd87f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb2b1bc5dd5d441699674ad70befbf9f, user_id=53a1ede2787d443d93773b37a64a62f8, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:26.926326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee422d39-d425-4c7c-a921-9bb65fd87f1b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:27.036625 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1687/3408] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:18:26 2022] PUT /identity/v3/projects/cb2b1bc5dd5d441699674ad70befbf9f/users/53a1ede2787d443d93773b37a64a62f8/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:27.049631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2fa7a-8a39-459f-9169-7e774c89ff04 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:27.052119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2fa7a-8a39-459f-9169-7e774c89ff04 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:27.053806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2fa7a-8a39-459f-9169-7e774c89ff04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:27.100973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-dde2fa7a-8a39-459f-9169-7e774c89ff04 None None] MFA Rules not processed for user `53a1ede2787d443d93773b37a64a62f8`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:27.103030 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dde2fa7a-8a39-459f-9169-7e774c89ff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:27.171844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:27.209893 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1722/3409] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:32.176173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee422d39-d425-4c7c-a921-9bb65fd87f1b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:32.178071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ee422d39-d425-4c7c-a921-9bb65fd87f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:32.293941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee422d39-d425-4c7c-a921-9bb65fd87f1b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:32.301306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a28a9-04de-48cb-a7e0-ea1b3fce6a6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:32.301985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a28a9-04de-48cb-a7e0-ea1b3fce6a6e service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:32.302407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a28a9-04de-48cb-a7e0-ea1b3fce6a6e service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:32.302691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a28a9-04de-48cb-a7e0-ea1b3fce6a6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:32.313721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a28a9-04de-48cb-a7e0-ea1b3fce6a6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:32.315846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a28a9-04de-48cb-a7e0-ea1b3fce6a6e service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:32.337627 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1688/3410] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:18:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:18:33.934801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2fa7a-8a39-459f-9169-7e774c89ff04 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:34.027350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2fa7a-8a39-459f-9169-7e774c89ff04 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:34.032122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfa515-2890-4d98-94c9-b7b5b562d75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:34.032966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfa515-2890-4d98-94c9-b7b5b562d75c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:34.033242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfa515-2890-4d98-94c9-b7b5b562d75c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:34.033513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfa515-2890-4d98-94c9-b7b5b562d75c admin admin] PATH_INFO: `/v3/users/53a1ede2787d443d93773b37a64a62f8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:34.034941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfa515-2890-4d98-94c9-b7b5b562d75c admin admin] RBAC: Authorizing `identity:delete_user(user_id=53a1ede2787d443d93773b37a64a62f8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:34.037337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfa515-2890-4d98-94c9-b7b5b562d75c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:34.308520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8ecfa515-2890-4d98-94c9-b7b5b562d75c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53a1ede2787d443d93773b37a64a62f8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:34.317000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8ecfa515-2890-4d98-94c9-b7b5b562d75c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53a1ede2787d443d93773b37a64a62f8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:34.427564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8ecfa515-2890-4d98-94c9-b7b5b562d75c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53a1ede2787d443d93773b37a64a62f8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:34.428436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8ecfa515-2890-4d98-94c9-b7b5b562d75c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53a1ede2787d443d93773b37a64a62f8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:34.480139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8ecfa515-2890-4d98-94c9-b7b5b562d75c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53a1ede2787d443d93773b37a64a62f8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:34.495056 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1723/3411] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:18:33 2022] DELETE /identity/v3/users/53a1ede2787d443d93773b37a64a62f8 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:34.500256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd8660-2197-4634-9f95-f445e744a4f9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:34.500768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd8660-2197-4634-9f95-f445e744a4f9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:34.501347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd8660-2197-4634-9f95-f445e744a4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:34.523115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-51fd8660-2197-4634-9f95-f445e744a4f9 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:34.524693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-51fd8660-2197-4634-9f95-f445e744a4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:34.602034 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1689/3412] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:34.612502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfa515-2890-4d98-94c9-b7b5b562d75c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:34.614030 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8ecfa515-2890-4d98-94c9-b7b5b562d75c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:34.676561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfa515-2890-4d98-94c9-b7b5b562d75c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:34.683937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fa507-4772-4758-b7b3-804251807f80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:34.684764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fa507-4772-4758-b7b3-804251807f80 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:34.685137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fa507-4772-4758-b7b3-804251807f80 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:34.685409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fa507-4772-4758-b7b3-804251807f80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:34.696744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303fa507-4772-4758-b7b3-804251807f80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:34.698462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303fa507-4772-4758-b7b3-804251807f80 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:34.703787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:34.709541 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1724/3413] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:18:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:18:35.229872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd8660-2197-4634-9f95-f445e744a4f9 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:35.231595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-51fd8660-2197-4634-9f95-f445e744a4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:35.250432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd8660-2197-4634-9f95-f445e744a4f9 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:35.255966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0320879-0084-4fa1-bba7-5392cad5660e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:35.257167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0320879-0084-4fa1-bba7-5392cad5660e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:35.257513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0320879-0084-4fa1-bba7-5392cad5660e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:35.257856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0320879-0084-4fa1-bba7-5392cad5660e admin admin] PATH_INFO: `/v3/projects/cb2b1bc5dd5d441699674ad70befbf9f` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:35.265116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0320879-0084-4fa1-bba7-5392cad5660e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb2b1bc5dd5d441699674ad70befbf9f)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:35.268284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0320879-0084-4fa1-bba7-5392cad5660e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:35.363192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fa507-4772-4758-b7b3-804251807f80 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:35.364668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-303fa507-4772-4758-b7b3-804251807f80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:35.474872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fa507-4772-4758-b7b3-804251807f80 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:35.479484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0320879-0084-4fa1-bba7-5392cad5660e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb2b1bc5dd5d441699674ad70befbf9f', 'request_id': 'req-b0320879-0084-4fa1-bba7-5392cad5660e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:35.486629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0320879-0084-4fa1-bba7-5392cad5660e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb2b1bc5dd5d441699674ad70befbf9f', 'request_id': 'req-b0320879-0084-4fa1-bba7-5392cad5660e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:35.500672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0320879-0084-4fa1-bba7-5392cad5660e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb2b1bc5dd5d441699674ad70befbf9f', 'request_id': 'req-b0320879-0084-4fa1-bba7-5392cad5660e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:35.502434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:35.558928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf3d14-1860-402a-b67f-3365d3bd82c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:35.559626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf3d14-1860-402a-b67f-3365d3bd82c1 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:35.559983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf3d14-1860-402a-b67f-3365d3bd82c1 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:35.560259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf3d14-1860-402a-b67f-3365d3bd82c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:35.562063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cfaf3d14-1860-402a-b67f-3365d3bd82c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:35.575860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf3d14-1860-402a-b67f-3365d3bd82c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:35.578304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf3d14-1860-402a-b67f-3365d3bd82c1 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:35.590972 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1725/3414] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:18:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:18:35.621687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0320879-0084-4fa1-bba7-5392cad5660e admin admin] The token cache is being invalidate because project cb2b1bc5dd5d441699674ad70befbf9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:18:35.621993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0320879-0084-4fa1-bba7-5392cad5660e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:35.622618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0320879-0084-4fa1-bba7-5392cad5660e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:35.624644 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1690/3415] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:18:35 2022] DELETE /identity/v3/projects/cb2b1bc5dd5d441699674ad70befbf9f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:18:35.630141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bcd79-a3e9-4774-b6af-08c699f380d3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:35.630426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bcd79-a3e9-4774-b6af-08c699f380d3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:35.630849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bcd79-a3e9-4774-b6af-08c699f380d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:35.650109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2f5bcd79-a3e9-4774-b6af-08c699f380d3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:35.651738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2f5bcd79-a3e9-4774-b6af-08c699f380d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:35.714018 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1726/3416] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:18:35.722109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296cb64-7dde-4576-85f5-dd452900d566 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:35.722593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296cb64-7dde-4576-85f5-dd452900d566 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:35.723197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296cb64-7dde-4576-85f5-dd452900d566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:35.746790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1296cb64-7dde-4576-85f5-dd452900d566 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:35.748150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1296cb64-7dde-4576-85f5-dd452900d566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:35.759774 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1691/3417] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:35.764665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bcd79-a3e9-4774-b6af-08c699f380d3 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:35.775140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bcd79-a3e9-4774-b6af-08c699f380d3 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:35.781167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5256e2-619e-495a-83ba-0ac41b2883e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:35.781766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5256e2-619e-495a-83ba-0ac41b2883e1 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:35.782046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5256e2-619e-495a-83ba-0ac41b2883e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:35.782322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5256e2-619e-495a-83ba-0ac41b2883e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:35.783545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5256e2-619e-495a-83ba-0ac41b2883e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:18:35.783545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5256e2-619e-495a-83ba-0ac41b2883e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:35.785176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5256e2-619e-495a-83ba-0ac41b2883e1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:35.798163 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1727/3418] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:18:35.802716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296cb64-7dde-4576-85f5-dd452900d566 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:35.815786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296cb64-7dde-4576-85f5-dd452900d566 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:35.821305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ad84e-4f11-4a94-b6cb-728a35a3f223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:35.822046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ad84e-4f11-4a94-b6cb-728a35a3f223 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:35.823081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ad84e-4f11-4a94-b6cb-728a35a3f223 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:35.823649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ad84e-4f11-4a94-b6cb-728a35a3f223 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:35.824456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ad84e-4f11-4a94-b6cb-728a35a3f223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:35.827180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ad84e-4f11-4a94-b6cb-728a35a3f223 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:35.929530 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1692/3419] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:18:35 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:18:35.929981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5256e2-619e-495a-83ba-0ac41b2883e1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:35.944065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5256e2-619e-495a-83ba-0ac41b2883e1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:36.018547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbff0d7-07c2-4722-8ba3-e8ccc33e4817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:36.019389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbff0d7-07c2-4722-8ba3-e8ccc33e4817 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:36.019757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbff0d7-07c2-4722-8ba3-e8ccc33e4817 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:36.020095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbff0d7-07c2-4722-8ba3-e8ccc33e4817 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:36.020845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbff0d7-07c2-4722-8ba3-e8ccc33e4817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:36.022862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbff0d7-07c2-4722-8ba3-e8ccc33e4817 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:36.028278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:36.183820 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1728/3420] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:18:35 2022] POST /identity/v3/users => generated 285 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:18:36.188163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ad84e-4f11-4a94-b6cb-728a35a3f223 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:36.199821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ad84e-4f11-4a94-b6cb-728a35a3f223 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:36.211118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be982e-1675-45f9-9a7e-7655e38f6ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:36.212127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be982e-1675-45f9-9a7e-7655e38f6ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:36.212410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be982e-1675-45f9-9a7e-7655e38f6ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:36.212689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be982e-1675-45f9-9a7e-7655e38f6ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:36.229651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be982e-1675-45f9-9a7e-7655e38f6ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:36.229651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be982e-1675-45f9-9a7e-7655e38f6ec1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:36.229651 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1693/3421] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:18:36.232511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbff0d7-07c2-4722-8ba3-e8ccc33e4817 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:36.245871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbff0d7-07c2-4722-8ba3-e8ccc33e4817 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:36.255908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8ae0d-ea39-42d1-9a18-99c07f1906fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:36.255908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8ae0d-ea39-42d1-9a18-99c07f1906fb admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:36.255908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8ae0d-ea39-42d1-9a18-99c07f1906fb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:36.255908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8ae0d-ea39-42d1-9a18-99c07f1906fb admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:36.256226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8ae0d-ea39-42d1-9a18-99c07f1906fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:36.256226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8ae0d-ea39-42d1-9a18-99c07f1906fb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:36.270382 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1729/3422] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:18:36.271853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be982e-1675-45f9-9a7e-7655e38f6ec1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:36.296703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be982e-1675-45f9-9a7e-7655e38f6ec1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:36.308243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390b5ba-b692-4f42-a350-dacc55a871f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:36.310213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390b5ba-b692-4f42-a350-dacc55a871f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:36.310213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390b5ba-b692-4f42-a350-dacc55a871f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:36.310213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390b5ba-b692-4f42-a350-dacc55a871f1 admin admin] PATH_INFO: `/v3/projects/205121b2249944eb9b2e1401cf693663/users/e848e24fe4344314a82f574a1bf1283f/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:36.328013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390b5ba-b692-4f42-a350-dacc55a871f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=205121b2249944eb9b2e1401cf693663, user_id=e848e24fe4344314a82f574a1bf1283f, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:36.330786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390b5ba-b692-4f42-a350-dacc55a871f1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:36.557511 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1694/3423] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:18:36 2022] PUT /identity/v3/projects/205121b2249944eb9b2e1401cf693663/users/e848e24fe4344314a82f574a1bf1283f/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:36.569079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a773d-ccfc-4f35-917d-90d0c5c62e23 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:36.569541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a773d-ccfc-4f35-917d-90d0c5c62e23 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:36.569649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a773d-ccfc-4f35-917d-90d0c5c62e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:36.608683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-896a773d-ccfc-4f35-917d-90d0c5c62e23 None None] MFA Rules not processed for user `e848e24fe4344314a82f574a1bf1283f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:36.609981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-896a773d-ccfc-4f35-917d-90d0c5c62e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:36.620005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a09608-af1e-46ed-9c48-9735e04f0e52 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:36.620005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a09608-af1e-46ed-9c48-9735e04f0e52 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:36.620005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a09608-af1e-46ed-9c48-9735e04f0e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:36.637926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-81a09608-af1e-46ed-9c48-9735e04f0e52 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:36.643281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-81a09608-af1e-46ed-9c48-9735e04f0e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:36.680046 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1730/3424] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:36.700330 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1695/3425] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:18:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:18:36.711069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a773d-ccfc-4f35-917d-90d0c5c62e23 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:36.711210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-896a773d-ccfc-4f35-917d-90d0c5c62e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:36.794417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a773d-ccfc-4f35-917d-90d0c5c62e23 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:36.799544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4583bad-7f54-41a2-afc9-487a68fa7722 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:36.800217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4583bad-7f54-41a2-afc9-487a68fa7722 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:36.800506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4583bad-7f54-41a2-afc9-487a68fa7722 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:36.800785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4583bad-7f54-41a2-afc9-487a68fa7722 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:36.809342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4583bad-7f54-41a2-afc9-487a68fa7722 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:36.810930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4583bad-7f54-41a2-afc9-487a68fa7722 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:36.814644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:36.829312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ba0f6-c86f-4ea9-8a29-3b0d99cbece0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:36.829743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ba0f6-c86f-4ea9-8a29-3b0d99cbece0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:36.830027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ba0f6-c86f-4ea9-8a29-3b0d99cbece0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:36.832760 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1731/3426] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:18:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:18:36.854006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-109ba0f6-c86f-4ea9-8a29-3b0d99cbece0 None None] MFA Rules not processed for user `d0008fffad8e4708b2c01e03da92c47d`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:36.855321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-109ba0f6-c86f-4ea9-8a29-3b0d99cbece0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:36.921976 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1696/3427] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:18:37.346762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4583bad-7f54-41a2-afc9-487a68fa7722 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:37.348592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d4583bad-7f54-41a2-afc9-487a68fa7722 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:37.424917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4583bad-7f54-41a2-afc9-487a68fa7722 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:37.430317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91908b-d6e8-4d21-9a1c-08e5e32e8d96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:37.431077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91908b-d6e8-4d21-9a1c-08e5e32e8d96 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:37.431388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91908b-d6e8-4d21-9a1c-08e5e32e8d96 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:37.432764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91908b-d6e8-4d21-9a1c-08e5e32e8d96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:37.441642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91908b-d6e8-4d21-9a1c-08e5e32e8d96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:37.442948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91908b-d6e8-4d21-9a1c-08e5e32e8d96 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:37.453264 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1732/3428] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:18:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:18:38.456252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ba0f6-c86f-4ea9-8a29-3b0d99cbece0 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:38.457847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-109ba0f6-c86f-4ea9-8a29-3b0d99cbece0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:38.531704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:38.582185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ba0f6-c86f-4ea9-8a29-3b0d99cbece0 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:38.588802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467958a-ebd7-4d09-84a4-0b5c884ad5c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:38.589587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467958a-ebd7-4d09-84a4-0b5c884ad5c2 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:38.589953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467958a-ebd7-4d09-84a4-0b5c884ad5c2 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:38.590328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467958a-ebd7-4d09-84a4-0b5c884ad5c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:38.596089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2467958a-ebd7-4d09-84a4-0b5c884ad5c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:38.633685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467958a-ebd7-4d09-84a4-0b5c884ad5c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:38.636126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467958a-ebd7-4d09-84a4-0b5c884ad5c2 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:38.647527 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1697/3429] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:18:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:18:38.787525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303a04d-fc40-4f1e-b7dd-4736bb021e8d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:38.789193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303a04d-fc40-4f1e-b7dd-4736bb021e8d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:38.790991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303a04d-fc40-4f1e-b7dd-4736bb021e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:38.829069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e303a04d-fc40-4f1e-b7dd-4736bb021e8d None None] MFA Rules not processed for user `daf3c9e6634e4ae1bfb492eae1f44c93`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:38.830965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e303a04d-fc40-4f1e-b7dd-4736bb021e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:38.962447 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1733/3430] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:41.465466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4b6bb-ca04-4f17-8b02-8bd748d9c755 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:41.465944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4b6bb-ca04-4f17-8b02-8bd748d9c755 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:41.466021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4b6bb-ca04-4f17-8b02-8bd748d9c755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:41.511852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-79c4b6bb-ca04-4f17-8b02-8bd748d9c755 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:41.513288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-79c4b6bb-ca04-4f17-8b02-8bd748d9c755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:41.532528 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1698/3431] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:18:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:41.546797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303a04d-fc40-4f1e-b7dd-4736bb021e8d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:41.574014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303a04d-fc40-4f1e-b7dd-4736bb021e8d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:41.580292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ddbf9-5eab-421e-9aa6-3084aa9d1eb3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:41.580978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ddbf9-5eab-421e-9aa6-3084aa9d1eb3 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:41.581255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ddbf9-5eab-421e-9aa6-3084aa9d1eb3 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:41.581708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ddbf9-5eab-421e-9aa6-3084aa9d1eb3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:41.605420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ddbf9-5eab-421e-9aa6-3084aa9d1eb3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:41.607248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ddbf9-5eab-421e-9aa6-3084aa9d1eb3 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:41.629275 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1734/3432] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:18:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:18:42.183867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4b6bb-ca04-4f17-8b02-8bd748d9c755 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:42.292418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4b6bb-ca04-4f17-8b02-8bd748d9c755 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:42.297949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa33f0-9ef5-4553-b820-eeb143375c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:42.300104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa33f0-9ef5-4553-b820-eeb143375c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:42.300555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa33f0-9ef5-4553-b820-eeb143375c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:42.301045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa33f0-9ef5-4553-b820-eeb143375c8d admin admin] PATH_INFO: `/v3/users/e848e24fe4344314a82f574a1bf1283f` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:42.302824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa33f0-9ef5-4553-b820-eeb143375c8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e848e24fe4344314a82f574a1bf1283f)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:42.304994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa33f0-9ef5-4553-b820-eeb143375c8d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:42.738677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4afa33f0-9ef5-4553-b820-eeb143375c8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e848e24fe4344314a82f574a1bf1283f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:42.764587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4afa33f0-9ef5-4553-b820-eeb143375c8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e848e24fe4344314a82f574a1bf1283f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:42.930117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4afa33f0-9ef5-4553-b820-eeb143375c8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e848e24fe4344314a82f574a1bf1283f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:42.945382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4afa33f0-9ef5-4553-b820-eeb143375c8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e848e24fe4344314a82f574a1bf1283f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:42.946323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4afa33f0-9ef5-4553-b820-eeb143375c8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e848e24fe4344314a82f574a1bf1283f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:42.961997 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1699/3433] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:18:42 2022] DELETE /identity/v3/users/e848e24fe4344314a82f574a1bf1283f => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:42.967574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a093b-8de8-4796-9d1a-72dfba688a73 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:42.968484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a093b-8de8-4796-9d1a-72dfba688a73 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:42.969434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a093b-8de8-4796-9d1a-72dfba688a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:43.015304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b72a093b-8de8-4796-9d1a-72dfba688a73 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:43.021604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b72a093b-8de8-4796-9d1a-72dfba688a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:43.038360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d6370-6214-4359-9fde-724ac1432efe None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:43.038360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d6370-6214-4359-9fde-724ac1432efe None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:43.038360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d6370-6214-4359-9fde-724ac1432efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:43.108256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e63d6370-6214-4359-9fde-724ac1432efe None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:43.109485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e63d6370-6214-4359-9fde-724ac1432efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:43.225652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:43.233834 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1735/3434] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:43.235439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a093b-8de8-4796-9d1a-72dfba688a73 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:43.238422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b72a093b-8de8-4796-9d1a-72dfba688a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:43.275845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:43.295627 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1700/3435] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:18:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:18:43.296864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d6370-6214-4359-9fde-724ac1432efe None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:43.303437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e63d6370-6214-4359-9fde-724ac1432efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:43.353804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a093b-8de8-4796-9d1a-72dfba688a73 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:43.359694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039f101-78de-41e8-b36e-b6661fecfa89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:43.360364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039f101-78de-41e8-b36e-b6661fecfa89 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:43.360680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039f101-78de-41e8-b36e-b6661fecfa89 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:43.360962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039f101-78de-41e8-b36e-b6661fecfa89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:43.363957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1039f101-78de-41e8-b36e-b6661fecfa89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:43.376361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039f101-78de-41e8-b36e-b6661fecfa89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:43.378759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039f101-78de-41e8-b36e-b6661fecfa89 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:43.391033 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1736/3436] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:18:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:18:43.392475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039f101-78de-41e8-b36e-b6661fecfa89 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:43.402117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1039f101-78de-41e8-b36e-b6661fecfa89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:43.464787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d6370-6214-4359-9fde-724ac1432efe None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:43.477458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074da583-453f-430e-90da-7f94f198cc05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:43.479226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074da583-453f-430e-90da-7f94f198cc05 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:43.479867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074da583-453f-430e-90da-7f94f198cc05 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:43.480544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074da583-453f-430e-90da-7f94f198cc05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:43.506013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074da583-453f-430e-90da-7f94f198cc05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:43.507721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074da583-453f-430e-90da-7f94f198cc05 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:43.521242 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1701/3437] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:18:43.576131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039f101-78de-41e8-b36e-b6661fecfa89 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:43.588071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979bf90-ed07-4b12-aede-c192cba0c346 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:43.589203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979bf90-ed07-4b12-aede-c192cba0c346 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:43.589538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979bf90-ed07-4b12-aede-c192cba0c346 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:43.589816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979bf90-ed07-4b12-aede-c192cba0c346 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:43.600101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f979bf90-ed07-4b12-aede-c192cba0c346 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:43.604575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f979bf90-ed07-4b12-aede-c192cba0c346 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:43.647567 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1737/3438] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:18:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:18:45.066828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074da583-453f-430e-90da-7f94f198cc05 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:45.068747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-074da583-453f-430e-90da-7f94f198cc05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:45.092146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074da583-453f-430e-90da-7f94f198cc05 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:45.127536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236f35e-36c3-4077-835e-0e52cf569780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:45.130950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236f35e-36c3-4077-835e-0e52cf569780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:45.130950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236f35e-36c3-4077-835e-0e52cf569780 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:45.130950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236f35e-36c3-4077-835e-0e52cf569780 admin admin] PATH_INFO: `/v3/projects/205121b2249944eb9b2e1401cf693663` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:45.133803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236f35e-36c3-4077-835e-0e52cf569780 admin admin] RBAC: Authorizing `identity:delete_project(project_id=205121b2249944eb9b2e1401cf693663)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:45.136620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236f35e-36c3-4077-835e-0e52cf569780 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:45.250251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cc3a5-eca0-4b5f-b2d6-58a05bd48219 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:45.250745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cc3a5-eca0-4b5f-b2d6-58a05bd48219 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:45.250852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cc3a5-eca0-4b5f-b2d6-58a05bd48219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:45.282700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-401cc3a5-eca0-4b5f-b2d6-58a05bd48219 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:45.283831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-401cc3a5-eca0-4b5f-b2d6-58a05bd48219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:45.303306 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1738/3439] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:18:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:18:45.318123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cc3a5-eca0-4b5f-b2d6-58a05bd48219 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:45.334114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cc3a5-eca0-4b5f-b2d6-58a05bd48219 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:45.339873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0236f35e-36c3-4077-835e-0e52cf569780 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '205121b2249944eb9b2e1401cf693663', 'request_id': 'req-0236f35e-36c3-4077-835e-0e52cf569780'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:45.350565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0236f35e-36c3-4077-835e-0e52cf569780 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '205121b2249944eb9b2e1401cf693663', 'request_id': 'req-0236f35e-36c3-4077-835e-0e52cf569780'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:45.364039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0236f35e-36c3-4077-835e-0e52cf569780 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '205121b2249944eb9b2e1401cf693663', 'request_id': 'req-0236f35e-36c3-4077-835e-0e52cf569780'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:45.453873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e9a79-0f1a-438a-82c4-9791f647303e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:45.454994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e9a79-0f1a-438a-82c4-9791f647303e service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:45.455626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e9a79-0f1a-438a-82c4-9791f647303e service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:45.455913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e9a79-0f1a-438a-82c4-9791f647303e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:45.470875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0236f35e-36c3-4077-835e-0e52cf569780 admin admin] The token cache is being invalidate because project 205121b2249944eb9b2e1401cf693663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:18:45.473375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0236f35e-36c3-4077-835e-0e52cf569780 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:45.473375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0236f35e-36c3-4077-835e-0e52cf569780 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:45.474487 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1702/3440] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:18:45 2022] DELETE /identity/v3/projects/205121b2249944eb9b2e1401cf693663 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:45.480106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7cff0-1203-4fee-947e-2fb6274e4dce None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:45.483851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7cff0-1203-4fee-947e-2fb6274e4dce None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:45.484347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7cff0-1203-4fee-947e-2fb6274e4dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:45.523295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8fe7cff0-1203-4fee-947e-2fb6274e4dce None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:45.524598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8fe7cff0-1203-4fee-947e-2fb6274e4dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:45.547341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:45.565054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e9a79-0f1a-438a-82c4-9791f647303e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:45.567486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e9a79-0f1a-438a-82c4-9791f647303e service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:45.580582 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1739/3441] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:18:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:18:45.649060 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1703/3442] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:45.652277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8619d47-e431-4d9b-9205-0f996713f989 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:45.652886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8619d47-e431-4d9b-9205-0f996713f989 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:45.653184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8619d47-e431-4d9b-9205-0f996713f989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:45.676870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c8619d47-e431-4d9b-9205-0f996713f989 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:45.678102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c8619d47-e431-4d9b-9205-0f996713f989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:45.691147 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1740/3443] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:45.692298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7cff0-1203-4fee-947e-2fb6274e4dce None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:45.703135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7cff0-1203-4fee-947e-2fb6274e4dce None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:45.709801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf29199-6992-48a8-bda7-b4894247451c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:45.710672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf29199-6992-48a8-bda7-b4894247451c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:45.711661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf29199-6992-48a8-bda7-b4894247451c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:45.713067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf29199-6992-48a8-bda7-b4894247451c admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:45.713740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf29199-6992-48a8-bda7-b4894247451c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:18:45.714312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf29199-6992-48a8-bda7-b4894247451c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:45.716108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf29199-6992-48a8-bda7-b4894247451c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:45.726802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:45.732889 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1704/3444] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:18:45.736805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8619d47-e431-4d9b-9205-0f996713f989 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:45.748901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8619d47-e431-4d9b-9205-0f996713f989 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:45.757187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36e98a-b899-4409-9c7f-e46cf5670301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:45.758130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36e98a-b899-4409-9c7f-e46cf5670301 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:45.758463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36e98a-b899-4409-9c7f-e46cf5670301 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:45.760511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36e98a-b899-4409-9c7f-e46cf5670301 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:45.761731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36e98a-b899-4409-9c7f-e46cf5670301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:45.763965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36e98a-b899-4409-9c7f-e46cf5670301 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:45.905539 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1741/3445] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:18:45 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:18:45.912675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf29199-6992-48a8-bda7-b4894247451c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:45.929866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf29199-6992-48a8-bda7-b4894247451c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:46.032441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54913ce5-13a7-4411-be49-fee25d11f8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:46.033749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54913ce5-13a7-4411-be49-fee25d11f8c7 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:46.034314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54913ce5-13a7-4411-be49-fee25d11f8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:46.034714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54913ce5-13a7-4411-be49-fee25d11f8c7 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:46.035708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54913ce5-13a7-4411-be49-fee25d11f8c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:46.038574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54913ce5-13a7-4411-be49-fee25d11f8c7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:46.145227 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1705/3446] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:18:45 2022] POST /identity/v3/users => generated 287 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:18:46.149699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36e98a-b899-4409-9c7f-e46cf5670301 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:46.162634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36e98a-b899-4409-9c7f-e46cf5670301 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:46.196333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeaa866-162a-400a-9520-f015ad1bc0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:46.196333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaa866-162a-400a-9520-f015ad1bc0cd admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:46.196333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaa866-162a-400a-9520-f015ad1bc0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:46.196333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaa866-162a-400a-9520-f015ad1bc0cd admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:46.196726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeaa866-162a-400a-9520-f015ad1bc0cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:46.198318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeaa866-162a-400a-9520-f015ad1bc0cd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:46.228344 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1742/3447] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:18:46.232411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54913ce5-13a7-4411-be49-fee25d11f8c7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:46.287321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54913ce5-13a7-4411-be49-fee25d11f8c7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:46.305323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594b4eb-f231-4a2c-8b35-19fa310ab932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:46.306936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594b4eb-f231-4a2c-8b35-19fa310ab932 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:46.307570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594b4eb-f231-4a2c-8b35-19fa310ab932 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:46.310948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594b4eb-f231-4a2c-8b35-19fa310ab932 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:46.314706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594b4eb-f231-4a2c-8b35-19fa310ab932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:46.328594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594b4eb-f231-4a2c-8b35-19fa310ab932 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:46.349174 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1706/3448] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:18:46.352044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeaa866-162a-400a-9520-f015ad1bc0cd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:46.366805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeaa866-162a-400a-9520-f015ad1bc0cd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:46.380969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c2bfd-e90e-4c29-b4a7-1c0807261dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:46.383728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c2bfd-e90e-4c29-b4a7-1c0807261dce admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:46.385205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c2bfd-e90e-4c29-b4a7-1c0807261dce admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:46.385729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c2bfd-e90e-4c29-b4a7-1c0807261dce admin admin] PATH_INFO: `/v3/projects/50e54e839e35463898c9c47af127a018/users/ee0b62d71e9b4610b77eedd8f9d3d0a0/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:46.406896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c2bfd-e90e-4c29-b4a7-1c0807261dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e54e839e35463898c9c47af127a018, user_id=ee0b62d71e9b4610b77eedd8f9d3d0a0, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:46.411358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c2bfd-e90e-4c29-b4a7-1c0807261dce admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:46.547830 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1743/3449] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:18:46 2022] PUT /identity/v3/projects/50e54e839e35463898c9c47af127a018/users/ee0b62d71e9b4610b77eedd8f9d3d0a0/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:46.558506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1d42c-cae0-4a28-abab-f691a9a1a2fa None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:46.558803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1d42c-cae0-4a28-abab-f691a9a1a2fa None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:46.559118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1d42c-cae0-4a28-abab-f691a9a1a2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:46.627857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f0b1d42c-cae0-4a28-abab-f691a9a1a2fa None None] MFA Rules not processed for user `ee0b62d71e9b4610b77eedd8f9d3d0a0`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:46.629349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f0b1d42c-cae0-4a28-abab-f691a9a1a2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:46.753695 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1707/3450] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:47.156165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c2bfd-e90e-4c29-b4a7-1c0807261dce admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:47.158353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-268c2bfd-e90e-4c29-b4a7-1c0807261dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:47.268142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c2bfd-e90e-4c29-b4a7-1c0807261dce admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:47.278639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bd758-860e-45ec-9c27-2eed6deea180 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:47.278639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bd758-860e-45ec-9c27-2eed6deea180 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:47.278639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bd758-860e-45ec-9c27-2eed6deea180 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:47.278639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bd758-860e-45ec-9c27-2eed6deea180 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:47.284853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bd758-860e-45ec-9c27-2eed6deea180 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:47.286522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bd758-860e-45ec-9c27-2eed6deea180 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:47.301217 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1744/3451] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:18:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:18:50.502887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1d42c-cae0-4a28-abab-f691a9a1a2fa None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:50.505005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f0b1d42c-cae0-4a28-abab-f691a9a1a2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:50.541532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bd758-860e-45ec-9c27-2eed6deea180 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:50.543353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e74bd758-860e-45ec-9c27-2eed6deea180 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:50.601758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1d42c-cae0-4a28-abab-f691a9a1a2fa None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:50.615621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6176f-d6df-4ea1-8d88-8d211641d53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:50.617235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6176f-d6df-4ea1-8d88-8d211641d53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:50.618068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6176f-d6df-4ea1-8d88-8d211641d53b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:50.619314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6176f-d6df-4ea1-8d88-8d211641d53b admin admin] PATH_INFO: `/v3/users/50cdc134e712487196f6623c5cf14592` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:50.620092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bd758-860e-45ec-9c27-2eed6deea180 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:50.622713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6176f-d6df-4ea1-8d88-8d211641d53b admin admin] RBAC: Authorizing `identity:delete_user(user_id=50cdc134e712487196f6623c5cf14592)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:50.625748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6176f-d6df-4ea1-8d88-8d211641d53b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:50.639460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:50.646880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6e82a-f40c-4233-9d4d-ac2b5acfe8e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:50.650287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6e82a-f40c-4233-9d4d-ac2b5acfe8e5 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:50.650654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6e82a-f40c-4233-9d4d-ac2b5acfe8e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:50.651262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6e82a-f40c-4233-9d4d-ac2b5acfe8e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:50.664205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e4a6e82a-f40c-4233-9d4d-ac2b5acfe8e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:50.681827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6e82a-f40c-4233-9d4d-ac2b5acfe8e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:50.683388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6e82a-f40c-4233-9d4d-ac2b5acfe8e5 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:50.693519 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1745/3452] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:18:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:18:50.882746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6da6176f-d6df-4ea1-8d88-8d211641d53b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50cdc134e712487196f6623c5cf14592'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:50.932550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6da6176f-d6df-4ea1-8d88-8d211641d53b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50cdc134e712487196f6623c5cf14592'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:51.022011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6da6176f-d6df-4ea1-8d88-8d211641d53b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50cdc134e712487196f6623c5cf14592'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:51.032877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6da6176f-d6df-4ea1-8d88-8d211641d53b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50cdc134e712487196f6623c5cf14592'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:51.033684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6da6176f-d6df-4ea1-8d88-8d211641d53b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50cdc134e712487196f6623c5cf14592'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:51.049846 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1708/3453] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:18:50 2022] DELETE /identity/v3/users/50cdc134e712487196f6623c5cf14592 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:51.645312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6e82a-f40c-4233-9d4d-ac2b5acfe8e5 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:51.646856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e4a6e82a-f40c-4233-9d4d-ac2b5acfe8e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:51.670233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6e82a-f40c-4233-9d4d-ac2b5acfe8e5 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:51.674447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:51.734729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bf586-8ca0-4d3d-93aa-64933edb0f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:51.735734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bf586-8ca0-4d3d-93aa-64933edb0f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:51.736129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bf586-8ca0-4d3d-93aa-64933edb0f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:51.736465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bf586-8ca0-4d3d-93aa-64933edb0f60 admin admin] PATH_INFO: `/v3/users/dd4144b5388b46a989a41a2f556bb508` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:51.738463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bf586-8ca0-4d3d-93aa-64933edb0f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd4144b5388b46a989a41a2f556bb508)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:51.746313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bf586-8ca0-4d3d-93aa-64933edb0f60 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:52.026965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6d7bf586-8ca0-4d3d-93aa-64933edb0f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd4144b5388b46a989a41a2f556bb508'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:52.054566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6d7bf586-8ca0-4d3d-93aa-64933edb0f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd4144b5388b46a989a41a2f556bb508'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:52.154139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6176f-d6df-4ea1-8d88-8d211641d53b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:52.154672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6d7bf586-8ca0-4d3d-93aa-64933edb0f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd4144b5388b46a989a41a2f556bb508'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:52.155328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6d7bf586-8ca0-4d3d-93aa-64933edb0f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd4144b5388b46a989a41a2f556bb508'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:52.156663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6da6176f-d6df-4ea1-8d88-8d211641d53b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:52.171811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6d7bf586-8ca0-4d3d-93aa-64933edb0f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd4144b5388b46a989a41a2f556bb508'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:52.172952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6176f-d6df-4ea1-8d88-8d211641d53b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:52.178096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad7e64-b5bc-4537-8af0-121c89e49adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:52.178501 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1746/3454] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:18:51 2022] DELETE /identity/v3/users/dd4144b5388b46a989a41a2f556bb508 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:52.180198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad7e64-b5bc-4537-8af0-121c89e49adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:52.192110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad7e64-b5bc-4537-8af0-121c89e49adb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:52.192110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad7e64-b5bc-4537-8af0-121c89e49adb admin admin] PATH_INFO: `/v3/projects/ba229aaef0ec4ddcadd1d940376c31ac` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:52.192110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad7e64-b5bc-4537-8af0-121c89e49adb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba229aaef0ec4ddcadd1d940376c31ac)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:52.192110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad7e64-b5bc-4537-8af0-121c89e49adb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:52.366247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2cad7e64-b5bc-4537-8af0-121c89e49adb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba229aaef0ec4ddcadd1d940376c31ac', 'request_id': 'req-2cad7e64-b5bc-4537-8af0-121c89e49adb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:52.375109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2cad7e64-b5bc-4537-8af0-121c89e49adb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba229aaef0ec4ddcadd1d940376c31ac', 'request_id': 'req-2cad7e64-b5bc-4537-8af0-121c89e49adb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:52.383416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2cad7e64-b5bc-4537-8af0-121c89e49adb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba229aaef0ec4ddcadd1d940376c31ac', 'request_id': 'req-2cad7e64-b5bc-4537-8af0-121c89e49adb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:52.490633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2cad7e64-b5bc-4537-8af0-121c89e49adb admin admin] The token cache is being invalidate because project ba229aaef0ec4ddcadd1d940376c31ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:18:52.490927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2cad7e64-b5bc-4537-8af0-121c89e49adb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:52.491609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2cad7e64-b5bc-4537-8af0-121c89e49adb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:52.493320 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1709/3455] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:18:52 2022] DELETE /identity/v3/projects/ba229aaef0ec4ddcadd1d940376c31ac => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:52.497872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bf586-8ca0-4d3d-93aa-64933edb0f60 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:52.500325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6d7bf586-8ca0-4d3d-93aa-64933edb0f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:52.528093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad7e64-b5bc-4537-8af0-121c89e49adb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:52.529672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2cad7e64-b5bc-4537-8af0-121c89e49adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:52.588047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bf586-8ca0-4d3d-93aa-64933edb0f60 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:52.660220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad7e64-b5bc-4537-8af0-121c89e49adb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:52.665941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6341da-8912-4abf-a11c-27fd76284565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:52.667439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6341da-8912-4abf-a11c-27fd76284565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:52.672639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6341da-8912-4abf-a11c-27fd76284565 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:52.672639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6341da-8912-4abf-a11c-27fd76284565 admin admin] PATH_INFO: `/v3/projects/a90d4bcd25ff4bf68bdc194180fbbe09` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:52.672639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6341da-8912-4abf-a11c-27fd76284565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a90d4bcd25ff4bf68bdc194180fbbe09)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:52.672639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6341da-8912-4abf-a11c-27fd76284565 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:52.684241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf33c4c-8e6c-447b-97fb-483b09f2b1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:52.685425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf33c4c-8e6c-447b-97fb-483b09f2b1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:52.685723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf33c4c-8e6c-447b-97fb-483b09f2b1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:52.691184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf33c4c-8e6c-447b-97fb-483b09f2b1b3 admin admin] PATH_INFO: `/v3/users/d35b09fb00874c05ac96b0a20e61ba10` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:52.691719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:52.691817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf33c4c-8e6c-447b-97fb-483b09f2b1b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d35b09fb00874c05ac96b0a20e61ba10)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:52.691817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf33c4c-8e6c-447b-97fb-483b09f2b1b3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:52.713440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:52.968202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9bf33c4c-8e6c-447b-97fb-483b09f2b1b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd35b09fb00874c05ac96b0a20e61ba10'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:52.972124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fc6341da-8912-4abf-a11c-27fd76284565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a90d4bcd25ff4bf68bdc194180fbbe09', 'request_id': 'req-fc6341da-8912-4abf-a11c-27fd76284565'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:52.975907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9bf33c4c-8e6c-447b-97fb-483b09f2b1b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd35b09fb00874c05ac96b0a20e61ba10'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:52.983710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fc6341da-8912-4abf-a11c-27fd76284565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a90d4bcd25ff4bf68bdc194180fbbe09', 'request_id': 'req-fc6341da-8912-4abf-a11c-27fd76284565'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:52.990667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fc6341da-8912-4abf-a11c-27fd76284565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a90d4bcd25ff4bf68bdc194180fbbe09', 'request_id': 'req-fc6341da-8912-4abf-a11c-27fd76284565'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:53.091452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9bf33c4c-8e6c-447b-97fb-483b09f2b1b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd35b09fb00874c05ac96b0a20e61ba10'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:53.092125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9bf33c4c-8e6c-447b-97fb-483b09f2b1b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd35b09fb00874c05ac96b0a20e61ba10'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:53.108614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9bf33c4c-8e6c-447b-97fb-483b09f2b1b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd35b09fb00874c05ac96b0a20e61ba10'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:53.121621 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1747/3456] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:18:52 2022] DELETE /identity/v3/users/d35b09fb00874c05ac96b0a20e61ba10 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:53.176073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fc6341da-8912-4abf-a11c-27fd76284565 admin admin] The token cache is being invalidate because project a90d4bcd25ff4bf68bdc194180fbbe09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:18:53.177209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fc6341da-8912-4abf-a11c-27fd76284565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:53.179175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fc6341da-8912-4abf-a11c-27fd76284565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:53.183496 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1710/3457] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:18:52 2022] DELETE /identity/v3/projects/a90d4bcd25ff4bf68bdc194180fbbe09 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:53.186711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676105c8-39a5-4561-97d4-518cb6cc60b5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:53.187036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676105c8-39a5-4561-97d4-518cb6cc60b5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:53.187320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676105c8-39a5-4561-97d4-518cb6cc60b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:53.220970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-676105c8-39a5-4561-97d4-518cb6cc60b5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:53.222729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-676105c8-39a5-4561-97d4-518cb6cc60b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:53.286189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6341da-8912-4abf-a11c-27fd76284565 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:53.288178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fc6341da-8912-4abf-a11c-27fd76284565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:53.324223 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1748/3458] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:53.335374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d231f-515a-4b71-b6aa-93a2ab6ce3c8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:53.336746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d231f-515a-4b71-b6aa-93a2ab6ce3c8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:53.341590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d231f-515a-4b71-b6aa-93a2ab6ce3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:53.377827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b68d231f-515a-4b71-b6aa-93a2ab6ce3c8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:53.379431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b68d231f-515a-4b71-b6aa-93a2ab6ce3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:53.389182 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1749/3459] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:53.393028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d231f-515a-4b71-b6aa-93a2ab6ce3c8 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:53.394746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6341da-8912-4abf-a11c-27fd76284565 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:53.403256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d231f-515a-4b71-b6aa-93a2ab6ce3c8 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:53.408787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e989aa-5e4c-45c0-ba73-df1c3613f27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:53.409685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e989aa-5e4c-45c0-ba73-df1c3613f27e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:53.410049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e989aa-5e4c-45c0-ba73-df1c3613f27e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:53.410499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e989aa-5e4c-45c0-ba73-df1c3613f27e admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:53.411233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e989aa-5e4c-45c0-ba73-df1c3613f27e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:18:53.411562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e989aa-5e4c-45c0-ba73-df1c3613f27e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:53.413152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e989aa-5e4c-45c0-ba73-df1c3613f27e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:53.468735 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1750/3460] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:18:53.468735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e989aa-5e4c-45c0-ba73-df1c3613f27e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:53.468735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e989aa-5e4c-45c0-ba73-df1c3613f27e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:53.468735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682ed11-6f1a-41a0-8069-d4e5a028574e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:53.469546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682ed11-6f1a-41a0-8069-d4e5a028574e admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:53.469546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682ed11-6f1a-41a0-8069-d4e5a028574e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:53.469546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682ed11-6f1a-41a0-8069-d4e5a028574e admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:53.469546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682ed11-6f1a-41a0-8069-d4e5a028574e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:53.469546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682ed11-6f1a-41a0-8069-d4e5a028574e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:53.470321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fddacd-9561-4ea0-a717-7e177c5bb4e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:53.470989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fddacd-9561-4ea0-a717-7e177c5bb4e5 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:53.471304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fddacd-9561-4ea0-a717-7e177c5bb4e5 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:53.471582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fddacd-9561-4ea0-a717-7e177c5bb4e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:53.473386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a3fddacd-9561-4ea0-a717-7e177c5bb4e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:53.486409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fddacd-9561-4ea0-a717-7e177c5bb4e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:53.488069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fddacd-9561-4ea0-a717-7e177c5bb4e5 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:53.500372 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1711/3461] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:18:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:18:53.635605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fddacd-9561-4ea0-a717-7e177c5bb4e5 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:53.637126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a3fddacd-9561-4ea0-a717-7e177c5bb4e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:53.654875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fddacd-9561-4ea0-a717-7e177c5bb4e5 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:53.660076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1418226-05de-4815-9d5b-71cb553f10db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:53.660993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1418226-05de-4815-9d5b-71cb553f10db admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:53.662046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1418226-05de-4815-9d5b-71cb553f10db admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:53.662351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1418226-05de-4815-9d5b-71cb553f10db admin admin] PATH_INFO: `/v3/projects/d498eaa349e84dcab5c975eeb69d1d6a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:53.663971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1418226-05de-4815-9d5b-71cb553f10db admin admin] RBAC: Authorizing `identity:delete_project(project_id=d498eaa349e84dcab5c975eeb69d1d6a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:53.668010 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1418226-05de-4815-9d5b-71cb553f10db admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:53.682510 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1751/3462] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:18:53 2022] POST /identity/v3/projects => generated 379 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:18:53.686160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682ed11-6f1a-41a0-8069-d4e5a028574e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:53.781799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682ed11-6f1a-41a0-8069-d4e5a028574e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:53.787195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6cc05-782c-441b-99bb-b1e8f361ded4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:53.787811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6cc05-782c-441b-99bb-b1e8f361ded4 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:53.788094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6cc05-782c-441b-99bb-b1e8f361ded4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:53.788369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6cc05-782c-441b-99bb-b1e8f361ded4 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:53.789057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6cc05-782c-441b-99bb-b1e8f361ded4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:53.791935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6cc05-782c-441b-99bb-b1e8f361ded4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:53.866015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e1418226-05de-4815-9d5b-71cb553f10db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd498eaa349e84dcab5c975eeb69d1d6a', 'request_id': 'req-e1418226-05de-4815-9d5b-71cb553f10db'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:53.870599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e1418226-05de-4815-9d5b-71cb553f10db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd498eaa349e84dcab5c975eeb69d1d6a', 'request_id': 'req-e1418226-05de-4815-9d5b-71cb553f10db'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:53.877752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e1418226-05de-4815-9d5b-71cb553f10db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd498eaa349e84dcab5c975eeb69d1d6a', 'request_id': 'req-e1418226-05de-4815-9d5b-71cb553f10db'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:53.912495 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1752/3463] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:18:53 2022] POST /identity/v3/users => generated 290 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:18:53.916780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6cc05-782c-441b-99bb-b1e8f361ded4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:53.926231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6cc05-782c-441b-99bb-b1e8f361ded4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:53.949917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e1418226-05de-4815-9d5b-71cb553f10db admin admin] The token cache is being invalidate because project d498eaa349e84dcab5c975eeb69d1d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:18:53.950189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e1418226-05de-4815-9d5b-71cb553f10db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:53.950855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e1418226-05de-4815-9d5b-71cb553f10db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:53.952464 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1712/3464] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:18:53 2022] DELETE /identity/v3/projects/d498eaa349e84dcab5c975eeb69d1d6a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:18:53.953218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1418226-05de-4815-9d5b-71cb553f10db admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:53.954485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e1418226-05de-4815-9d5b-71cb553f10db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:53.989644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f527f-e212-485b-b781-0a196d19ce4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:53.990200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f527f-e212-485b-b781-0a196d19ce4d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:53.990515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f527f-e212-485b-b781-0a196d19ce4d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:53.990746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f527f-e212-485b-b781-0a196d19ce4d admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:53.991500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f527f-e212-485b-b781-0a196d19ce4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:53.993106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f527f-e212-485b-b781-0a196d19ce4d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:54.004485 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1753/3465] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:18:54.005598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c13b0-a539-4b61-a2ca-f8c965e720bb None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:54.005887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c13b0-a539-4b61-a2ca-f8c965e720bb None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:54.006164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c13b0-a539-4b61-a2ca-f8c965e720bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:54.024374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5e5c13b0-a539-4b61-a2ca-f8c965e720bb None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:54.024739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1418226-05de-4815-9d5b-71cb553f10db admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:54.025744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5e5c13b0-a539-4b61-a2ca-f8c965e720bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:54.029532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2254c-fed2-4b6f-814e-a5878421d714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:54.030408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2254c-fed2-4b6f-814e-a5878421d714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:54.030738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2254c-fed2-4b6f-814e-a5878421d714 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:54.030969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2254c-fed2-4b6f-814e-a5878421d714 admin admin] PATH_INFO: `/v3/users/ee0b62d71e9b4610b77eedd8f9d3d0a0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:54.032259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2254c-fed2-4b6f-814e-a5878421d714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee0b62d71e9b4610b77eedd8f9d3d0a0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:54.034178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2254c-fed2-4b6f-814e-a5878421d714 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:54.034908 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1754/3466] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:54.035731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c13b0-a539-4b61-a2ca-f8c965e720bb None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:54.037145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5e5c13b0-a539-4b61-a2ca-f8c965e720bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:54.049812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c13b0-a539-4b61-a2ca-f8c965e720bb None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:54.054603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99b89f-2a7f-4307-a5db-0be1f20f7311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:54.055296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99b89f-2a7f-4307-a5db-0be1f20f7311 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:54.055581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99b89f-2a7f-4307-a5db-0be1f20f7311 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:54.056512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99b89f-2a7f-4307-a5db-0be1f20f7311 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:54.057355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99b89f-2a7f-4307-a5db-0be1f20f7311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:54.058945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99b89f-2a7f-4307-a5db-0be1f20f7311 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:54.069286 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1755/3467] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:18:54.070625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5a582-1f43-49d0-9985-4e772978249d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:54.070919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5a582-1f43-49d0-9985-4e772978249d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:54.071269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5a582-1f43-49d0-9985-4e772978249d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:54.089838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-cea5a582-1f43-49d0-9985-4e772978249d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:54.091064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cea5a582-1f43-49d0-9985-4e772978249d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:54.103273 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1756/3468] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:54.103273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5a582-1f43-49d0-9985-4e772978249d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:54.113695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5a582-1f43-49d0-9985-4e772978249d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:54.119596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43914050-3e85-470e-bbdf-fda74b4ef13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:54.122185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43914050-3e85-470e-bbdf-fda74b4ef13e admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:54.122185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43914050-3e85-470e-bbdf-fda74b4ef13e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:54.122185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43914050-3e85-470e-bbdf-fda74b4ef13e admin admin] PATH_INFO: `/v3/projects/a092ce9ef40943f6b6ace6cd28481b71/users/eebb224a56814f92b12ebebebc6bc8a3/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:54.137701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43914050-3e85-470e-bbdf-fda74b4ef13e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a092ce9ef40943f6b6ace6cd28481b71, user_id=eebb224a56814f92b12ebebebc6bc8a3, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:54.140419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43914050-3e85-470e-bbdf-fda74b4ef13e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:54.282579 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1757/3469] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:18:54 2022] PUT /identity/v3/projects/a092ce9ef40943f6b6ace6cd28481b71/users/eebb224a56814f92b12ebebebc6bc8a3/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:54.283482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43914050-3e85-470e-bbdf-fda74b4ef13e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:54.295684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7bb2254c-fed2-4b6f-814e-a5878421d714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee0b62d71e9b4610b77eedd8f9d3d0a0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:54.312664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7bb2254c-fed2-4b6f-814e-a5878421d714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee0b62d71e9b4610b77eedd8f9d3d0a0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:54.351133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43914050-3e85-470e-bbdf-fda74b4ef13e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:54.356713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ce121-4536-41b7-b6e5-fbb5856d8224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:54.363956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ce121-4536-41b7-b6e5-fbb5856d8224 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:54.363956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ce121-4536-41b7-b6e5-fbb5856d8224 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:54.363956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ce121-4536-41b7-b6e5-fbb5856d8224 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:54.363956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ce121-4536-41b7-b6e5-fbb5856d8224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:18:54.363956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ce121-4536-41b7-b6e5-fbb5856d8224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:54.363956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ce121-4536-41b7-b6e5-fbb5856d8224 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:54.375845 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1758/3470] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:18:54.375845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190897de-5bed-4f98-8436-7b0c094ae48c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:54.375845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190897de-5bed-4f98-8436-7b0c094ae48c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:54.375845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190897de-5bed-4f98-8436-7b0c094ae48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:54.392258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-190897de-5bed-4f98-8436-7b0c094ae48c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:54.393468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-190897de-5bed-4f98-8436-7b0c094ae48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:54.401849 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1759/3471] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:54.402874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190897de-5bed-4f98-8436-7b0c094ae48c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:54.414097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190897de-5bed-4f98-8436-7b0c094ae48c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:54.420507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd8ba5-7190-4078-86f0-b87d2f57cbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:54.420778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd8ba5-7190-4078-86f0-b87d2f57cbfb admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:54.421062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd8ba5-7190-4078-86f0-b87d2f57cbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:54.421341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd8ba5-7190-4078-86f0-b87d2f57cbfb admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:54.422039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd8ba5-7190-4078-86f0-b87d2f57cbfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:54.424147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd8ba5-7190-4078-86f0-b87d2f57cbfb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:54.442893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7bb2254c-fed2-4b6f-814e-a5878421d714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee0b62d71e9b4610b77eedd8f9d3d0a0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:54.451839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7bb2254c-fed2-4b6f-814e-a5878421d714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee0b62d71e9b4610b77eedd8f9d3d0a0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:54.452680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7bb2254c-fed2-4b6f-814e-a5878421d714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee0b62d71e9b4610b77eedd8f9d3d0a0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:54.458960 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1713/3472] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:18:53 2022] DELETE /identity/v3/users/ee0b62d71e9b4610b77eedd8f9d3d0a0 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:54.463972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2254c-fed2-4b6f-814e-a5878421d714 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:54.465372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7bb2254c-fed2-4b6f-814e-a5878421d714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:54.528978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2254c-fed2-4b6f-814e-a5878421d714 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:54.532811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd54871-ec9d-4f46-81c6-47e1a7a8facc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:54.533446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd54871-ec9d-4f46-81c6-47e1a7a8facc service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:54.533797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd54871-ec9d-4f46-81c6-47e1a7a8facc service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:54.534006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd54871-ec9d-4f46-81c6-47e1a7a8facc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:54.535840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0cd54871-ec9d-4f46-81c6-47e1a7a8facc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:54.606353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd54871-ec9d-4f46-81c6-47e1a7a8facc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:54.607935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd54871-ec9d-4f46-81c6-47e1a7a8facc service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:54.611784 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1760/3473] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:18:54 2022] POST /identity/v3/projects => generated 383 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:18:54.611784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf00f8-1a79-483c-af24-47344f6fd849 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:54.611784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf00f8-1a79-483c-af24-47344f6fd849 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:54.611784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf00f8-1a79-483c-af24-47344f6fd849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:54.621324 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1714/3474] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:18:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:18:54.622501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd54871-ec9d-4f46-81c6-47e1a7a8facc service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:54.624102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0cd54871-ec9d-4f46-81c6-47e1a7a8facc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:54.632780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-febf00f8-1a79-483c-af24-47344f6fd849 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:54.634553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-febf00f8-1a79-483c-af24-47344f6fd849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:54.640509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd54871-ec9d-4f46-81c6-47e1a7a8facc service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:54.700522 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1761/3475] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:54.708009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56c2a9-f38b-4182-9602-889e796c3160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:54.708882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56c2a9-f38b-4182-9602-889e796c3160 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:54.709178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56c2a9-f38b-4182-9602-889e796c3160 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:54.709463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56c2a9-f38b-4182-9602-889e796c3160 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:54.709836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf00f8-1a79-483c-af24-47344f6fd849 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:54.710163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56c2a9-f38b-4182-9602-889e796c3160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:54.711277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-febf00f8-1a79-483c-af24-47344f6fd849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:54.717447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56c2a9-f38b-4182-9602-889e796c3160 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:54.747209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:54.773915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf00f8-1a79-483c-af24-47344f6fd849 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:54.777752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d488f-6b2c-4886-a748-450f95b7aba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:54.778413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d488f-6b2c-4886-a748-450f95b7aba0 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:54.778877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d488f-6b2c-4886-a748-450f95b7aba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:54.778994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d488f-6b2c-4886-a748-450f95b7aba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:54.793419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d488f-6b2c-4886-a748-450f95b7aba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:54.795057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d488f-6b2c-4886-a748-450f95b7aba0 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:54.805751 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1762/3476] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:18:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:18:54.809294 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1715/3477] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:18:54 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:18:54.813297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d488f-6b2c-4886-a748-450f95b7aba0 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:54.825034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d488f-6b2c-4886-a748-450f95b7aba0 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:54.830787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401b031-a851-4494-b5ab-a34a0cb71f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:54.832412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401b031-a851-4494-b5ab-a34a0cb71f43 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:54.834297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:54.834703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401b031-a851-4494-b5ab-a34a0cb71f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:54.835266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401b031-a851-4494-b5ab-a34a0cb71f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:54.837708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401b031-a851-4494-b5ab-a34a0cb71f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:54.839726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401b031-a851-4494-b5ab-a34a0cb71f43 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:54.853690 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1763/3478] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:18:54.857717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56c2a9-f38b-4182-9602-889e796c3160 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:54.875265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56c2a9-f38b-4182-9602-889e796c3160 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:54.883446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14c132-1ffc-43c5-9ed8-62031389c524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:54.884611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14c132-1ffc-43c5-9ed8-62031389c524 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:54.884906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14c132-1ffc-43c5-9ed8-62031389c524 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:54.885188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14c132-1ffc-43c5-9ed8-62031389c524 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:54.885937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14c132-1ffc-43c5-9ed8-62031389c524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:54.888057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14c132-1ffc-43c5-9ed8-62031389c524 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:54.901198 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1716/3479] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:18:54.905612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401b031-a851-4494-b5ab-a34a0cb71f43 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:54.925742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401b031-a851-4494-b5ab-a34a0cb71f43 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:54.942192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a03ae-a16e-4eb7-aeba-732f72a7594e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:54.945059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a03ae-a16e-4eb7-aeba-732f72a7594e admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:54.946230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a03ae-a16e-4eb7-aeba-732f72a7594e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:54.946660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a03ae-a16e-4eb7-aeba-732f72a7594e admin admin] PATH_INFO: `/v3/projects/942725b966874321b6ccd6f628787d06/users/6a3dbbb2b39447d884c56dfd0db7e42e/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:54.968580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a03ae-a16e-4eb7-aeba-732f72a7594e admin admin] RBAC: Authorizing `identity:create_grant(project_id=942725b966874321b6ccd6f628787d06, user_id=6a3dbbb2b39447d884c56dfd0db7e42e, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:54.973952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a03ae-a16e-4eb7-aeba-732f72a7594e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:55.111308 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1764/3480] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:18:54 2022] PUT /identity/v3/projects/942725b966874321b6ccd6f628787d06/users/6a3dbbb2b39447d884c56dfd0db7e42e/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:18:55.121474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43f4ff-5062-4862-969d-13bf2d45226c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:55.121891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43f4ff-5062-4862-969d-13bf2d45226c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:55.122249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43f4ff-5062-4862-969d-13bf2d45226c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:55.170080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8e43f4ff-5062-4862-969d-13bf2d45226c None None] MFA Rules not processed for user `6a3dbbb2b39447d884c56dfd0db7e42e`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:55.170080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8e43f4ff-5062-4862-969d-13bf2d45226c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:55.238644 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1717/3481] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:55.251930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a03ae-a16e-4eb7-aeba-732f72a7594e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:55.253950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-732a03ae-a16e-4eb7-aeba-732f72a7594e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:55.340541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a03ae-a16e-4eb7-aeba-732f72a7594e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:55.348522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2494252-8364-45d7-a47e-60c2b18620a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:55.349192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2494252-8364-45d7-a47e-60c2b18620a8 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:55.349477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2494252-8364-45d7-a47e-60c2b18620a8 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:55.349755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2494252-8364-45d7-a47e-60c2b18620a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:55.362448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2494252-8364-45d7-a47e-60c2b18620a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:55.375292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2494252-8364-45d7-a47e-60c2b18620a8 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:55.377111 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1765/3482] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:18:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:18:55.807712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43f4ff-5062-4862-969d-13bf2d45226c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:55.809942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8e43f4ff-5062-4862-969d-13bf2d45226c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:55.940702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43f4ff-5062-4862-969d-13bf2d45226c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:55.948742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c78562-cd18-49f5-ad6a-6e6aa2b48fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:55.949709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c78562-cd18-49f5-ad6a-6e6aa2b48fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:55.949891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c78562-cd18-49f5-ad6a-6e6aa2b48fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:55.950172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c78562-cd18-49f5-ad6a-6e6aa2b48fc2 admin admin] PATH_INFO: `/v3/projects/50e54e839e35463898c9c47af127a018` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:55.951595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c78562-cd18-49f5-ad6a-6e6aa2b48fc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50e54e839e35463898c9c47af127a018)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:55.953537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c78562-cd18-49f5-ad6a-6e6aa2b48fc2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:56.075582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-75c78562-cd18-49f5-ad6a-6e6aa2b48fc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50e54e839e35463898c9c47af127a018', 'request_id': 'req-75c78562-cd18-49f5-ad6a-6e6aa2b48fc2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:56.081022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-75c78562-cd18-49f5-ad6a-6e6aa2b48fc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50e54e839e35463898c9c47af127a018', 'request_id': 'req-75c78562-cd18-49f5-ad6a-6e6aa2b48fc2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:56.087903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-75c78562-cd18-49f5-ad6a-6e6aa2b48fc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50e54e839e35463898c9c47af127a018', 'request_id': 'req-75c78562-cd18-49f5-ad6a-6e6aa2b48fc2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:56.214467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-75c78562-cd18-49f5-ad6a-6e6aa2b48fc2 admin admin] The token cache is being invalidate because project 50e54e839e35463898c9c47af127a018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:18:56.215042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-75c78562-cd18-49f5-ad6a-6e6aa2b48fc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:56.215884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-75c78562-cd18-49f5-ad6a-6e6aa2b48fc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:18:56.221445 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1718/3483] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:18:55 2022] DELETE /identity/v3/projects/50e54e839e35463898c9c47af127a018 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:18:56.223204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b226b2-dffa-4aa1-9b39-023dfa2f18ef None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:56.225089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b226b2-dffa-4aa1-9b39-023dfa2f18ef None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:56.225089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b226b2-dffa-4aa1-9b39-023dfa2f18ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:56.250418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d2b226b2-dffa-4aa1-9b39-023dfa2f18ef None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:56.251840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d2b226b2-dffa-4aa1-9b39-023dfa2f18ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:56.373280 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1766/3484] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:56.382308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784d498-60be-4318-9672-9971775a967d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:56.382597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784d498-60be-4318-9672-9971775a967d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:56.382879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784d498-60be-4318-9672-9971775a967d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:56.406168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1784d498-60be-4318-9672-9971775a967d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:56.407427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1784d498-60be-4318-9672-9971775a967d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:56.416730 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1719/3485] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:18:56.420979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b226b2-dffa-4aa1-9b39-023dfa2f18ef None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:56.431426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b226b2-dffa-4aa1-9b39-023dfa2f18ef None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:56.436085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0d534-5dc6-454b-b38e-c932f920f8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:56.436976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0d534-5dc6-454b-b38e-c932f920f8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:56.437411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0d534-5dc6-454b-b38e-c932f920f8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:56.437842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0d534-5dc6-454b-b38e-c932f920f8e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:56.438573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0d534-5dc6-454b-b38e-c932f920f8e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:18:56.438877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0d534-5dc6-454b-b38e-c932f920f8e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:56.440583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0d534-5dc6-454b-b38e-c932f920f8e0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:56.454030 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1767/3486] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:18:56.459536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784d498-60be-4318-9672-9971775a967d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:56.472974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784d498-60be-4318-9672-9971775a967d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:56.479418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4008e-e39a-4741-a544-e10aea3940e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:56.480877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4008e-e39a-4741-a544-e10aea3940e7 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:56.480877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4008e-e39a-4741-a544-e10aea3940e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:56.480877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4008e-e39a-4741-a544-e10aea3940e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:56.481646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4008e-e39a-4741-a544-e10aea3940e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:56.483558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4008e-e39a-4741-a544-e10aea3940e7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:56.530703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:56.581662 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1720/3487] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:18:56 2022] POST /identity/v3/projects => generated 405 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:18:56.587334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0d534-5dc6-454b-b38e-c932f920f8e0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:56.607925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0d534-5dc6-454b-b38e-c932f920f8e0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:56.680836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:56.710960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6890b-a7a6-452b-915c-b427396b1893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:56.717016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6890b-a7a6-452b-915c-b427396b1893 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:56.717016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6890b-a7a6-452b-915c-b427396b1893 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:56.717016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6890b-a7a6-452b-915c-b427396b1893 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:56.717016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6890b-a7a6-452b-915c-b427396b1893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:56.717016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6890b-a7a6-452b-915c-b427396b1893 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:56.800732 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1768/3488] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:18:56 2022] POST /identity/v3/users => generated 303 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:18:56.805631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4008e-e39a-4741-a544-e10aea3940e7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:56.820215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4008e-e39a-4741-a544-e10aea3940e7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:56.825526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a4716-d6bb-4a0e-bd70-71349f6aa101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:56.826235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a4716-d6bb-4a0e-bd70-71349f6aa101 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:56.830598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a4716-d6bb-4a0e-bd70-71349f6aa101 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:56.830598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a4716-d6bb-4a0e-bd70-71349f6aa101 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:56.830598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a4716-d6bb-4a0e-bd70-71349f6aa101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:56.830598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a4716-d6bb-4a0e-bd70-71349f6aa101 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:56.845350 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1721/3489] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:18:56.849423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6890b-a7a6-452b-915c-b427396b1893 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:56.861757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6890b-a7a6-452b-915c-b427396b1893 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:56.870473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329f17e-6087-4f0f-886c-cbd1b42fcc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:56.872005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329f17e-6087-4f0f-886c-cbd1b42fcc80 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:56.872005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329f17e-6087-4f0f-886c-cbd1b42fcc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:56.872005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329f17e-6087-4f0f-886c-cbd1b42fcc80 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:56.872484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329f17e-6087-4f0f-886c-cbd1b42fcc80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:56.874136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329f17e-6087-4f0f-886c-cbd1b42fcc80 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:56.892882 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1769/3490] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:18:56.893646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a4716-d6bb-4a0e-bd70-71349f6aa101 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:56.906337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a4716-d6bb-4a0e-bd70-71349f6aa101 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:56.911854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a89cc8-0436-48a0-b6d0-6e7d2a193e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:56.914293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a89cc8-0436-48a0-b6d0-6e7d2a193e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:56.914293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a89cc8-0436-48a0-b6d0-6e7d2a193e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:56.914293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a89cc8-0436-48a0-b6d0-6e7d2a193e60 admin admin] PATH_INFO: `/v3/projects/89b4d12252b94d54b50cc15238af6c2f/users/7ea30eb37fbf469194845261a19e8d4f/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:56.932987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a89cc8-0436-48a0-b6d0-6e7d2a193e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b4d12252b94d54b50cc15238af6c2f, user_id=7ea30eb37fbf469194845261a19e8d4f, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:56.937197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a89cc8-0436-48a0-b6d0-6e7d2a193e60 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:56.999095 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1722/3491] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:18:56 2022] PUT /identity/v3/projects/89b4d12252b94d54b50cc15238af6c2f/users/7ea30eb37fbf469194845261a19e8d4f/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:18:57.000763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57945e-d359-4daf-8bd3-9b0c854601f4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:57.001059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57945e-d359-4daf-8bd3-9b0c854601f4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:57.001329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57945e-d359-4daf-8bd3-9b0c854601f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:57.034922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1e57945e-d359-4daf-8bd3-9b0c854601f4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:18:57.041244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1e57945e-d359-4daf-8bd3-9b0c854601f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:57.145004 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1770/3492] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:18:57.158891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a89cc8-0436-48a0-b6d0-6e7d2a193e60 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:18:57.163634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-17a89cc8-0436-48a0-b6d0-6e7d2a193e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:18:57.262068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a89cc8-0436-48a0-b6d0-6e7d2a193e60 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:18:57.266070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefb8e4-be0a-4e40-83a5-ebd148d290ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:18:57.266822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefb8e4-be0a-4e40-83a5-ebd148d290ae service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:18:57.267281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefb8e4-be0a-4e40-83a5-ebd148d290ae service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:18:57.267752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefb8e4-be0a-4e40-83a5-ebd148d290ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:18:57.278733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefb8e4-be0a-4e40-83a5-ebd148d290ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:18:57.280287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefb8e4-be0a-4e40-83a5-ebd148d290ae service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:18:57.295650 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1723/3493] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:18:58.479001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:18:59.138714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:00.090109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:00.705193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:01.904888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2629749-0d17-41d9-b1ed-eb8a4eda7439 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:01.905441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2629749-0d17-41d9-b1ed-eb8a4eda7439 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:01.905441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2629749-0d17-41d9-b1ed-eb8a4eda7439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:01.945189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e2629749-0d17-41d9-b1ed-eb8a4eda7439 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:01.949475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e2629749-0d17-41d9-b1ed-eb8a4eda7439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:02.086073 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1771/3494] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:19:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:02.120280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefb8e4-be0a-4e40-83a5-ebd148d290ae service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:02.121897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bcefb8e4-be0a-4e40-83a5-ebd148d290ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:02.268132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefb8e4-be0a-4e40-83a5-ebd148d290ae service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:02.285164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af133047-fb62-4659-9165-c7c0c4c85384 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:02.285840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af133047-fb62-4659-9165-c7c0c4c85384 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:02.286143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af133047-fb62-4659-9165-c7c0c4c85384 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:02.286429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af133047-fb62-4659-9165-c7c0c4c85384 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:02.301307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af133047-fb62-4659-9165-c7c0c4c85384 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:02.303460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af133047-fb62-4659-9165-c7c0c4c85384 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:02.320493 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1724/3495] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:19:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:19:03.429577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83ffc9-ae0a-47b6-b248-c3862b76f488 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:03.430082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83ffc9-ae0a-47b6-b248-c3862b76f488 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:03.430234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83ffc9-ae0a-47b6-b248-c3862b76f488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:03.479719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2a83ffc9-ae0a-47b6-b248-c3862b76f488 None None] MFA Rules not processed for user `eebb224a56814f92b12ebebebc6bc8a3`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:03.483923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2a83ffc9-ae0a-47b6-b248-c3862b76f488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:03.614735 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1772/3496] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:03.614829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c2005-64bf-446d-a61c-6e5746f55300 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:03.615637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c2005-64bf-446d-a61c-6e5746f55300 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:03.618527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c2005-64bf-446d-a61c-6e5746f55300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:03.642607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc0d80-f5b9-4a66-8c73-659c50d652ce None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:03.642954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc0d80-f5b9-4a66-8c73-659c50d652ce None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:03.643200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc0d80-f5b9-4a66-8c73-659c50d652ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:03.671219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0f6c2005-64bf-446d-a61c-6e5746f55300 None None] MFA Rules not processed for user `eebb224a56814f92b12ebebebc6bc8a3`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:03.675714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0f6c2005-64bf-446d-a61c-6e5746f55300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:03.731340 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1725/3497] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:03.736043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-20cc0d80-f5b9-4a66-8c73-659c50d652ce None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:03.738510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-20cc0d80-f5b9-4a66-8c73-659c50d652ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:03.750289 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1773/3498] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:19:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:03.783331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c2005-64bf-446d-a61c-6e5746f55300 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:03.801804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c2005-64bf-446d-a61c-6e5746f55300 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:03.815060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77351531-9511-4764-a50c-5bdfa811cce7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:03.816146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77351531-9511-4764-a50c-5bdfa811cce7 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:03.817275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77351531-9511-4764-a50c-5bdfa811cce7 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:03.817560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77351531-9511-4764-a50c-5bdfa811cce7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:03.834996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77351531-9511-4764-a50c-5bdfa811cce7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:03.838068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77351531-9511-4764-a50c-5bdfa811cce7 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:03.847727 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1726/3499] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:19:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:19:04.523794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc0d80-f5b9-4a66-8c73-659c50d652ce None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:04.526858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-20cc0d80-f5b9-4a66-8c73-659c50d652ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:04.621091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:04.708825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc0d80-f5b9-4a66-8c73-659c50d652ce None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:04.732553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2f062-8d14-414b-b4ec-e29a6aa38556 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:04.733258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2f062-8d14-414b-b4ec-e29a6aa38556 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:04.733543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2f062-8d14-414b-b4ec-e29a6aa38556 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:04.733975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2f062-8d14-414b-b4ec-e29a6aa38556 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:04.762765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2f062-8d14-414b-b4ec-e29a6aa38556 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:04.770057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2f062-8d14-414b-b4ec-e29a6aa38556 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:04.813919 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1774/3500] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:19:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:19:05.739022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619400c3-c70b-4903-97e0-d1f8a9c27b3c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:05.739615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619400c3-c70b-4903-97e0-d1f8a9c27b3c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:05.739615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619400c3-c70b-4903-97e0-d1f8a9c27b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:05.771307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-619400c3-c70b-4903-97e0-d1f8a9c27b3c None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:05.774545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-619400c3-c70b-4903-97e0-d1f8a9c27b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:05.788401 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1727/3501] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:19:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:19:05.800677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2f062-8d14-414b-b4ec-e29a6aa38556 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:05.814502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2f062-8d14-414b-b4ec-e29a6aa38556 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:05.831188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67c157-b7fa-487c-97cf-67ce1a819b24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:05.831962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67c157-b7fa-487c-97cf-67ce1a819b24 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:05.832418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67c157-b7fa-487c-97cf-67ce1a819b24 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:05.832884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67c157-b7fa-487c-97cf-67ce1a819b24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:05.852980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67c157-b7fa-487c-97cf-67ce1a819b24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:05.854974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67c157-b7fa-487c-97cf-67ce1a819b24 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:05.866961 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1775/3502] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:19:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:19:06.339042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619400c3-c70b-4903-97e0-d1f8a9c27b3c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:06.341297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-619400c3-c70b-4903-97e0-d1f8a9c27b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:06.392251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619400c3-c70b-4903-97e0-d1f8a9c27b3c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:06.400205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff10ea-08bf-4ab9-ad34-19d039c78561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:06.401643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff10ea-08bf-4ab9-ad34-19d039c78561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:06.402014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff10ea-08bf-4ab9-ad34-19d039c78561 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:06.402891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff10ea-08bf-4ab9-ad34-19d039c78561 admin admin] PATH_INFO: `/v3/users/71e9304fc50447d6aac99703b5b6e4e1` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:06.404758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff10ea-08bf-4ab9-ad34-19d039c78561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e9304fc50447d6aac99703b5b6e4e1)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:06.407920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff10ea-08bf-4ab9-ad34-19d039c78561 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:06.678148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ceff10ea-08bf-4ab9-ad34-19d039c78561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e9304fc50447d6aac99703b5b6e4e1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:06.715089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ceff10ea-08bf-4ab9-ad34-19d039c78561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e9304fc50447d6aac99703b5b6e4e1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:06.734411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:06.848936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ceff10ea-08bf-4ab9-ad34-19d039c78561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e9304fc50447d6aac99703b5b6e4e1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:06.873932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ceff10ea-08bf-4ab9-ad34-19d039c78561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e9304fc50447d6aac99703b5b6e4e1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:06.875112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ceff10ea-08bf-4ab9-ad34-19d039c78561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e9304fc50447d6aac99703b5b6e4e1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:06.885335 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1728/3503] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:19:06 2022] DELETE /identity/v3/users/71e9304fc50447d6aac99703b5b6e4e1 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:06.890622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664ed6f-5ec2-426b-b557-02a1f14be279 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:06.891699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664ed6f-5ec2-426b-b557-02a1f14be279 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:06.892145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664ed6f-5ec2-426b-b557-02a1f14be279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:06.932134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0664ed6f-5ec2-426b-b557-02a1f14be279 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:06.942658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0664ed6f-5ec2-426b-b557-02a1f14be279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:07.094044 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1776/3504] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:07.138125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff10ea-08bf-4ab9-ad34-19d039c78561 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:07.144604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ceff10ea-08bf-4ab9-ad34-19d039c78561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:07.385978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff10ea-08bf-4ab9-ad34-19d039c78561 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:07.394182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205f35f-dd3c-4c42-b216-07b563083ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:07.397299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205f35f-dd3c-4c42-b216-07b563083ddc service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:07.397823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205f35f-dd3c-4c42-b216-07b563083ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:07.398328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205f35f-dd3c-4c42-b216-07b563083ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:07.413271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205f35f-dd3c-4c42-b216-07b563083ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:07.415552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205f35f-dd3c-4c42-b216-07b563083ddc service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:07.430170 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1729/3505] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:19:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:19:08.078437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664ed6f-5ec2-426b-b557-02a1f14be279 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:08.079993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0664ed6f-5ec2-426b-b557-02a1f14be279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:08.100071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664ed6f-5ec2-426b-b557-02a1f14be279 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:08.111703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acc9ba-82be-4d2d-8101-a261c1858a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:08.112681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acc9ba-82be-4d2d-8101-a261c1858a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:08.112969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acc9ba-82be-4d2d-8101-a261c1858a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:08.113242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acc9ba-82be-4d2d-8101-a261c1858a3a admin admin] PATH_INFO: `/v3/projects/7e84496d78d4481e9d7648128868bca2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:08.114819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acc9ba-82be-4d2d-8101-a261c1858a3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e84496d78d4481e9d7648128868bca2)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:08.119051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acc9ba-82be-4d2d-8101-a261c1858a3a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:08.395821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f1acc9ba-82be-4d2d-8101-a261c1858a3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e84496d78d4481e9d7648128868bca2', 'request_id': 'req-f1acc9ba-82be-4d2d-8101-a261c1858a3a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:08.414825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f1acc9ba-82be-4d2d-8101-a261c1858a3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e84496d78d4481e9d7648128868bca2', 'request_id': 'req-f1acc9ba-82be-4d2d-8101-a261c1858a3a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:08.430891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f1acc9ba-82be-4d2d-8101-a261c1858a3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e84496d78d4481e9d7648128868bca2', 'request_id': 'req-f1acc9ba-82be-4d2d-8101-a261c1858a3a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:08.549161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f1acc9ba-82be-4d2d-8101-a261c1858a3a admin admin] The token cache is being invalidate because project 7e84496d78d4481e9d7648128868bca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:19:08.549875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f1acc9ba-82be-4d2d-8101-a261c1858a3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:08.550393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f1acc9ba-82be-4d2d-8101-a261c1858a3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:08.558279 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1777/3506] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:19:08 2022] DELETE /identity/v3/projects/7e84496d78d4481e9d7648128868bca2 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:08.560779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0dc1e-869a-46fd-9769-c47abf40ae00 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:08.561618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0dc1e-869a-46fd-9769-c47abf40ae00 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:08.562039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0dc1e-869a-46fd-9769-c47abf40ae00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:08.610908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b9e0dc1e-869a-46fd-9769-c47abf40ae00 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:08.615238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b9e0dc1e-869a-46fd-9769-c47abf40ae00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:08.798969 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1730/3507] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:08.801375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005d68d-bbea-4955-bf89-5a258d566e6b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:08.802083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005d68d-bbea-4955-bf89-5a258d566e6b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:08.802186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005d68d-bbea-4955-bf89-5a258d566e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:08.867151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f005d68d-bbea-4955-bf89-5a258d566e6b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:08.872535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f005d68d-bbea-4955-bf89-5a258d566e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:08.896949 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1778/3508] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:08.902297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0dc1e-869a-46fd-9769-c47abf40ae00 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:08.916727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0dc1e-869a-46fd-9769-c47abf40ae00 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:08.940921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d8529-d473-496d-a0e7-f5641265ab1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:08.942169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d8529-d473-496d-a0e7-f5641265ab1e admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:08.946625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d8529-d473-496d-a0e7-f5641265ab1e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:08.947304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d8529-d473-496d-a0e7-f5641265ab1e admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:08.948257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d8529-d473-496d-a0e7-f5641265ab1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:19:08.950679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d8529-d473-496d-a0e7-f5641265ab1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:08.959225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d8529-d473-496d-a0e7-f5641265ab1e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:08.989564 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1731/3509] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:19:08.994741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005d68d-bbea-4955-bf89-5a258d566e6b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:09.009865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005d68d-bbea-4955-bf89-5a258d566e6b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:09.041007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3772b26-4285-4519-9cb7-722923c259d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:09.042940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3772b26-4285-4519-9cb7-722923c259d4 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:09.043302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3772b26-4285-4519-9cb7-722923c259d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:09.043597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3772b26-4285-4519-9cb7-722923c259d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:09.047281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3772b26-4285-4519-9cb7-722923c259d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:09.050565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3772b26-4285-4519-9cb7-722923c259d4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:09.234438 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1779/3510] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:19:08 2022] POST /identity/v3/projects => generated 377 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:09.246665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d8529-d473-496d-a0e7-f5641265ab1e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:09.278963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d8529-d473-496d-a0e7-f5641265ab1e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:09.500443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7679703-31a6-44e4-8f0d-64fca3c801a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:09.501288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7679703-31a6-44e4-8f0d-64fca3c801a1 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:09.501577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7679703-31a6-44e4-8f0d-64fca3c801a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:09.501860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7679703-31a6-44e4-8f0d-64fca3c801a1 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:09.503242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7679703-31a6-44e4-8f0d-64fca3c801a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:09.508881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7679703-31a6-44e4-8f0d-64fca3c801a1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:09.686362 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1732/3511] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:19:09 2022] POST /identity/v3/users => generated 289 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:09.690987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3772b26-4285-4519-9cb7-722923c259d4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:09.714501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3772b26-4285-4519-9cb7-722923c259d4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:09.740304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacd6bf-29f6-438d-9204-309240d02a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:09.742160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacd6bf-29f6-438d-9204-309240d02a00 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:09.746109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacd6bf-29f6-438d-9204-309240d02a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:09.746504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacd6bf-29f6-438d-9204-309240d02a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:09.747456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bacd6bf-29f6-438d-9204-309240d02a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:09.749282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bacd6bf-29f6-438d-9204-309240d02a00 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:09.755681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:09.765704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ff915-9a04-49b2-9222-a818f7898487 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:09.767360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ff915-9a04-49b2-9222-a818f7898487 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:09.767837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ff915-9a04-49b2-9222-a818f7898487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:09.777942 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1780/3512] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:09.779149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacd6bf-29f6-438d-9204-309240d02a00 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:09.791243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacd6bf-29f6-438d-9204-309240d02a00 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:09.792704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:09.797980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bbc67-aad4-45a7-8b96-8a593e4390a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:09.798674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bbc67-aad4-45a7-8b96-8a593e4390a0 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:09.798957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bbc67-aad4-45a7-8b96-8a593e4390a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:09.799319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bbc67-aad4-45a7-8b96-8a593e4390a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:09.800051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04bbc67-aad4-45a7-8b96-8a593e4390a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:09.801907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04bbc67-aad4-45a7-8b96-8a593e4390a0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:09.812007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c92ff915-9a04-49b2-9222-a818f7898487 None None] MFA Rules not processed for user `7ea30eb37fbf469194845261a19e8d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:09.813412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c92ff915-9a04-49b2-9222-a818f7898487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:09.818697 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1781/3513] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:09.819673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bbc67-aad4-45a7-8b96-8a593e4390a0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:09.831303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bbc67-aad4-45a7-8b96-8a593e4390a0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:09.842414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75524ba-b7e9-40cd-b297-457efe0c09a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:09.845817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75524ba-b7e9-40cd-b297-457efe0c09a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:09.846180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75524ba-b7e9-40cd-b297-457efe0c09a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:09.846524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75524ba-b7e9-40cd-b297-457efe0c09a1 admin admin] PATH_INFO: `/v3/projects/f2984288b4cd4610b2f32e895f3e5d72/users/a8d48b52db1545a4a51027a5c2c7fcce/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:09.883387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75524ba-b7e9-40cd-b297-457efe0c09a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2984288b4cd4610b2f32e895f3e5d72, user_id=a8d48b52db1545a4a51027a5c2c7fcce, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:09.886794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75524ba-b7e9-40cd-b297-457efe0c09a1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:09.898322 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1733/3514] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:10.021930 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1782/3515] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:19:09 2022] PUT /identity/v3/projects/f2984288b4cd4610b2f32e895f3e5d72/users/a8d48b52db1545a4a51027a5c2c7fcce/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:10.022768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69faf3b2-ea44-4a89-a8c7-a3b32a719344 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:10.023256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69faf3b2-ea44-4a89-a8c7-a3b32a719344 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:10.024283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69faf3b2-ea44-4a89-a8c7-a3b32a719344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:10.115936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-69faf3b2-ea44-4a89-a8c7-a3b32a719344 None None] MFA Rules not processed for user `a8d48b52db1545a4a51027a5c2c7fcce`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:10.117407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-69faf3b2-ea44-4a89-a8c7-a3b32a719344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:10.167655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75524ba-b7e9-40cd-b297-457efe0c09a1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:10.169638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c75524ba-b7e9-40cd-b297-457efe0c09a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:10.228283 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1734/3516] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:19:10.237909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2330eb1-eecf-4ee3-b946-ccd8798267d2 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:10.238192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2330eb1-eecf-4ee3-b946-ccd8798267d2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:10.238476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2330eb1-eecf-4ee3-b946-ccd8798267d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:10.271928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a2330eb1-eecf-4ee3-b946-ccd8798267d2 None None] MFA Rules not processed for user `a8d48b52db1545a4a51027a5c2c7fcce`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:10.275561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a2330eb1-eecf-4ee3-b946-ccd8798267d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:10.296582 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1735/3517] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:19:10.406230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75524ba-b7e9-40cd-b297-457efe0c09a1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:10.428018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03824b71-1d89-49c9-897c-6d8c1a3984dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:10.431740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03824b71-1d89-49c9-897c-6d8c1a3984dc service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:10.432144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03824b71-1d89-49c9-897c-6d8c1a3984dc service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:10.432434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03824b71-1d89-49c9-897c-6d8c1a3984dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:10.563383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03824b71-1d89-49c9-897c-6d8c1a3984dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:10.565292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03824b71-1d89-49c9-897c-6d8c1a3984dc service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:10.579564 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1783/3518] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:19:10 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:19:11.157928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2330eb1-eecf-4ee3-b946-ccd8798267d2 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:11.159853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a2330eb1-eecf-4ee3-b946-ccd8798267d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:11.182158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2330eb1-eecf-4ee3-b946-ccd8798267d2 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:11.196471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2609e3-fe95-44a5-956a-3994bb8d2e2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:11.196471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2609e3-fe95-44a5-956a-3994bb8d2e2b service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:11.196471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2609e3-fe95-44a5-956a-3994bb8d2e2b service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:11.196471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2609e3-fe95-44a5-956a-3994bb8d2e2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:11.221699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2609e3-fe95-44a5-956a-3994bb8d2e2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:11.225722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2609e3-fe95-44a5-956a-3994bb8d2e2b service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:11.244341 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1736/3519] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:19:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:19:17.979905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03824b71-1d89-49c9-897c-6d8c1a3984dc service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:17.985013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-03824b71-1d89-49c9-897c-6d8c1a3984dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:18.085397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03824b71-1d89-49c9-897c-6d8c1a3984dc service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:18.092181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5824e-0d08-4ba7-8234-5a4438ec2fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:18.093084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5824e-0d08-4ba7-8234-5a4438ec2fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:18.093368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5824e-0d08-4ba7-8234-5a4438ec2fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:18.093647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5824e-0d08-4ba7-8234-5a4438ec2fa1 admin admin] PATH_INFO: `/v3/users/6a3dbbb2b39447d884c56dfd0db7e42e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:18.094880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5824e-0d08-4ba7-8234-5a4438ec2fa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a3dbbb2b39447d884c56dfd0db7e42e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:18.097099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5824e-0d08-4ba7-8234-5a4438ec2fa1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:18.099634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:18.370245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5fc5824e-0d08-4ba7-8234-5a4438ec2fa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a3dbbb2b39447d884c56dfd0db7e42e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:18.395929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5fc5824e-0d08-4ba7-8234-5a4438ec2fa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a3dbbb2b39447d884c56dfd0db7e42e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:18.499356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5fc5824e-0d08-4ba7-8234-5a4438ec2fa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a3dbbb2b39447d884c56dfd0db7e42e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:18.500140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5fc5824e-0d08-4ba7-8234-5a4438ec2fa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a3dbbb2b39447d884c56dfd0db7e42e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:18.515536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5fc5824e-0d08-4ba7-8234-5a4438ec2fa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a3dbbb2b39447d884c56dfd0db7e42e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:18.522100 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1784/3520] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:19:17 2022] DELETE /identity/v3/users/6a3dbbb2b39447d884c56dfd0db7e42e => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:18.527584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84358fb-a337-4624-b5f1-6ef8e0574676 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:18.528116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84358fb-a337-4624-b5f1-6ef8e0574676 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:18.528116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84358fb-a337-4624-b5f1-6ef8e0574676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:18.551406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f84358fb-a337-4624-b5f1-6ef8e0574676 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:18.554198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f84358fb-a337-4624-b5f1-6ef8e0574676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:18.634563 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1737/3521] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:18.644418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5824e-0d08-4ba7-8234-5a4438ec2fa1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:18.645846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5fc5824e-0d08-4ba7-8234-5a4438ec2fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:18.705971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5824e-0d08-4ba7-8234-5a4438ec2fa1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:18.709648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310a77a-c03d-48b9-8b3b-92a54d64e16d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:18.710291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310a77a-c03d-48b9-8b3b-92a54d64e16d service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:18.710569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310a77a-c03d-48b9-8b3b-92a54d64e16d service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:18.710876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310a77a-c03d-48b9-8b3b-92a54d64e16d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:18.720041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310a77a-c03d-48b9-8b3b-92a54d64e16d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:18.721498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310a77a-c03d-48b9-8b3b-92a54d64e16d service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:18.731857 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1785/3522] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:19:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:19:19.550008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84358fb-a337-4624-b5f1-6ef8e0574676 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:19.551979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f84358fb-a337-4624-b5f1-6ef8e0574676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:19.582020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84358fb-a337-4624-b5f1-6ef8e0574676 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:19.588479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd19530-e6c3-4746-8591-677e4d81569c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:19.590327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd19530-e6c3-4746-8591-677e4d81569c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:19.590327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd19530-e6c3-4746-8591-677e4d81569c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:19.590698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd19530-e6c3-4746-8591-677e4d81569c admin admin] PATH_INFO: `/v3/projects/942725b966874321b6ccd6f628787d06` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:19.592168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd19530-e6c3-4746-8591-677e4d81569c admin admin] RBAC: Authorizing `identity:delete_project(project_id=942725b966874321b6ccd6f628787d06)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:19.594918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd19530-e6c3-4746-8591-677e4d81569c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:19.598199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:19.770646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2cd19530-e6c3-4746-8591-677e4d81569c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '942725b966874321b6ccd6f628787d06', 'request_id': 'req-2cd19530-e6c3-4746-8591-677e4d81569c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:19.779409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2cd19530-e6c3-4746-8591-677e4d81569c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '942725b966874321b6ccd6f628787d06', 'request_id': 'req-2cd19530-e6c3-4746-8591-677e4d81569c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:19.788365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2cd19530-e6c3-4746-8591-677e4d81569c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '942725b966874321b6ccd6f628787d06', 'request_id': 'req-2cd19530-e6c3-4746-8591-677e4d81569c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:19.875696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2cd19530-e6c3-4746-8591-677e4d81569c admin admin] The token cache is being invalidate because project 942725b966874321b6ccd6f628787d06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:19:19.876065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2cd19530-e6c3-4746-8591-677e4d81569c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:19.876878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2cd19530-e6c3-4746-8591-677e4d81569c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:19.881291 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1738/3523] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:19:19 2022] DELETE /identity/v3/projects/942725b966874321b6ccd6f628787d06 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:19.892131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587fdda-74fd-44b6-a359-cd352995cff6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:19.892598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587fdda-74fd-44b6-a359-cd352995cff6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:19.892843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587fdda-74fd-44b6-a359-cd352995cff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:19.937656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3587fdda-74fd-44b6-a359-cd352995cff6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:19.942473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3587fdda-74fd-44b6-a359-cd352995cff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:20.067682 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1786/3524] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:20.070844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3fec3-a68e-4dec-8214-c9e0a6d39f55 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:20.071333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3fec3-a68e-4dec-8214-c9e0a6d39f55 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:20.071765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3fec3-a68e-4dec-8214-c9e0a6d39f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:20.102158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-57a3fec3-a68e-4dec-8214-c9e0a6d39f55 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:20.104760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-57a3fec3-a68e-4dec-8214-c9e0a6d39f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:20.123354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587fdda-74fd-44b6-a359-cd352995cff6 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:20.123498 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1739/3525] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:20.138287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587fdda-74fd-44b6-a359-cd352995cff6 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:20.150724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81bca2-fcb7-48fa-a872-ccb26c65444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:20.153119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81bca2-fcb7-48fa-a872-ccb26c65444d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:20.153735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81bca2-fcb7-48fa-a872-ccb26c65444d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:20.154232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81bca2-fcb7-48fa-a872-ccb26c65444d admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:20.156613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81bca2-fcb7-48fa-a872-ccb26c65444d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:19:20.157146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81bca2-fcb7-48fa-a872-ccb26c65444d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:20.158902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81bca2-fcb7-48fa-a872-ccb26c65444d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:20.191197 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1787/3526] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:19:20.195348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3fec3-a68e-4dec-8214-c9e0a6d39f55 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:20.206034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3fec3-a68e-4dec-8214-c9e0a6d39f55 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:20.212870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef5c77-f19e-4cb4-98b6-a153c900399a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:20.213884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef5c77-f19e-4cb4-98b6-a153c900399a admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:20.214377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef5c77-f19e-4cb4-98b6-a153c900399a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:20.214900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef5c77-f19e-4cb4-98b6-a153c900399a admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:20.215858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef5c77-f19e-4cb4-98b6-a153c900399a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:20.223261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef5c77-f19e-4cb4-98b6-a153c900399a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:20.326251 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1740/3527] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:19:20 2022] POST /identity/v3/projects => generated 391 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:19:20.330714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81bca2-fcb7-48fa-a872-ccb26c65444d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:20.345247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81bca2-fcb7-48fa-a872-ccb26c65444d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:20.359243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:20.444275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c82fb-2bf8-45c7-a1a6-e985dd912ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:20.445006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c82fb-2bf8-45c7-a1a6-e985dd912ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:20.445287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c82fb-2bf8-45c7-a1a6-e985dd912ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:20.445861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c82fb-2bf8-45c7-a1a6-e985dd912ef1 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:20.446963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c82fb-2bf8-45c7-a1a6-e985dd912ef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:20.449245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c82fb-2bf8-45c7-a1a6-e985dd912ef1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:20.602723 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1788/3528] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:19:20 2022] POST /identity/v3/users => generated 296 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:19:20.604289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef5c77-f19e-4cb4-98b6-a153c900399a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:20.623734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef5c77-f19e-4cb4-98b6-a153c900399a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:20.639833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12d6f4-85ca-4f44-ab8e-dc7c9cfb3ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:20.640641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12d6f4-85ca-4f44-ab8e-dc7c9cfb3ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:20.640770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12d6f4-85ca-4f44-ab8e-dc7c9cfb3ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:20.641056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12d6f4-85ca-4f44-ab8e-dc7c9cfb3ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:20.642057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12d6f4-85ca-4f44-ab8e-dc7c9cfb3ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:20.646917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12d6f4-85ca-4f44-ab8e-dc7c9cfb3ff3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:20.671818 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1741/3529] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:20.676072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c82fb-2bf8-45c7-a1a6-e985dd912ef1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:20.689550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c82fb-2bf8-45c7-a1a6-e985dd912ef1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:20.700594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03afda2-baa3-41a5-bf4e-17489c0c0a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:20.702145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03afda2-baa3-41a5-bf4e-17489c0c0a03 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:20.703898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03afda2-baa3-41a5-bf4e-17489c0c0a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:20.704331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03afda2-baa3-41a5-bf4e-17489c0c0a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:20.705241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03afda2-baa3-41a5-bf4e-17489c0c0a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:20.708615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03afda2-baa3-41a5-bf4e-17489c0c0a03 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:20.742330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12d6f4-85ca-4f44-ab8e-dc7c9cfb3ff3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:20.752989 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1789/3530] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:20.755231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12d6f4-85ca-4f44-ab8e-dc7c9cfb3ff3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:20.768301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ddc7c-9a1a-4aca-89f6-9d3b36704bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:20.771801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ddc7c-9a1a-4aca-89f6-9d3b36704bda admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:20.772248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ddc7c-9a1a-4aca-89f6-9d3b36704bda admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:20.772677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ddc7c-9a1a-4aca-89f6-9d3b36704bda admin admin] PATH_INFO: `/v3/projects/bbeff4e7ee0e417c8fbaa4322772d5f3/users/d4c7b7b2aaaa403f9fe38c995756955a/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:20.806300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ddc7c-9a1a-4aca-89f6-9d3b36704bda admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbeff4e7ee0e417c8fbaa4322772d5f3, user_id=d4c7b7b2aaaa403f9fe38c995756955a, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:20.809127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ddc7c-9a1a-4aca-89f6-9d3b36704bda admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:20.895873 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1742/3531] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:19:20 2022] PUT /identity/v3/projects/bbeff4e7ee0e417c8fbaa4322772d5f3/users/d4c7b7b2aaaa403f9fe38c995756955a/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:19:20.908465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee1a13-f97b-4aed-89b9-4f1458767da5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:20.909650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee1a13-f97b-4aed-89b9-4f1458767da5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:20.910177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee1a13-f97b-4aed-89b9-4f1458767da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:20.966737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-83ee1a13-f97b-4aed-89b9-4f1458767da5 None None] MFA Rules not processed for user `d4c7b7b2aaaa403f9fe38c995756955a`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:20.968509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-83ee1a13-f97b-4aed-89b9-4f1458767da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:21.048216 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1790/3532] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:21.052850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ddc7c-9a1a-4aca-89f6-9d3b36704bda admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:21.145795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ddc7c-9a1a-4aca-89f6-9d3b36704bda admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:21.153499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb396136-d48e-42d0-9ca6-17beb63575cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:21.154083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb396136-d48e-42d0-9ca6-17beb63575cd admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:21.154357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb396136-d48e-42d0-9ca6-17beb63575cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:21.154630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb396136-d48e-42d0-9ca6-17beb63575cd admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:21.158075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb396136-d48e-42d0-9ca6-17beb63575cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:21.158228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb396136-d48e-42d0-9ca6-17beb63575cd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:21.258161 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1743/3533] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:19:21 2022] POST /identity/v3/projects => generated 391 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:19:21.262430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee1a13-f97b-4aed-89b9-4f1458767da5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:21.291870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee1a13-f97b-4aed-89b9-4f1458767da5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:21.378638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a506cd3-79b1-42b6-ae20-d38746757ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:21.379693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a506cd3-79b1-42b6-ae20-d38746757ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:21.380156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a506cd3-79b1-42b6-ae20-d38746757ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:21.380606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a506cd3-79b1-42b6-ae20-d38746757ae0 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:21.381638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a506cd3-79b1-42b6-ae20-d38746757ae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:21.384163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a506cd3-79b1-42b6-ae20-d38746757ae0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:21.544389 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1791/3534] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:19:21 2022] POST /identity/v3/users => generated 302 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:21.548746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb396136-d48e-42d0-9ca6-17beb63575cd admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:21.561166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb396136-d48e-42d0-9ca6-17beb63575cd admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:21.567506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdd731-74d1-43a8-8c74-a35382185abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:21.568427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdd731-74d1-43a8-8c74-a35382185abe admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:21.568880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdd731-74d1-43a8-8c74-a35382185abe admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:21.569308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdd731-74d1-43a8-8c74-a35382185abe admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:21.570386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdd731-74d1-43a8-8c74-a35382185abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:21.572334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdd731-74d1-43a8-8c74-a35382185abe admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:21.579245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:21.590388 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1744/3535] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:21.590997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a506cd3-79b1-42b6-ae20-d38746757ae0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:21.606976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a506cd3-79b1-42b6-ae20-d38746757ae0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:21.614633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabde621-d477-4819-b144-5934c5421b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:21.615728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabde621-d477-4819-b144-5934c5421b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:21.616108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabde621-d477-4819-b144-5934c5421b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:21.616483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabde621-d477-4819-b144-5934c5421b59 admin admin] PATH_INFO: `/v3/projects/a839a9676e7341fda1e9a11187ca68c0/users/94391e4486fe4cd1bf79937a5547a87c/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:21.644198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabde621-d477-4819-b144-5934c5421b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a839a9676e7341fda1e9a11187ca68c0, user_id=94391e4486fe4cd1bf79937a5547a87c, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:21.647201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabde621-d477-4819-b144-5934c5421b59 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:21.786471 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1792/3536] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:19:21 2022] PUT /identity/v3/projects/a839a9676e7341fda1e9a11187ca68c0/users/94391e4486fe4cd1bf79937a5547a87c/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:21.788060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdd731-74d1-43a8-8c74-a35382185abe admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:21.807833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdd731-74d1-43a8-8c74-a35382185abe admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:21.892101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc04116-7e2a-4492-a14f-eafab82aba60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:21.893526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc04116-7e2a-4492-a14f-eafab82aba60 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:21.894142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc04116-7e2a-4492-a14f-eafab82aba60 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:21.894525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc04116-7e2a-4492-a14f-eafab82aba60 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:21.895539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc04116-7e2a-4492-a14f-eafab82aba60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:21.897242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc04116-7e2a-4492-a14f-eafab82aba60 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:21.910693 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1745/3537] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:21.916007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabde621-d477-4819-b144-5934c5421b59 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:21.928691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabde621-d477-4819-b144-5934c5421b59 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:21.936986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4d637-3733-4dd9-8a7f-2f6301a27718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:21.937974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4d637-3733-4dd9-8a7f-2f6301a27718 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:21.938331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4d637-3733-4dd9-8a7f-2f6301a27718 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:21.938671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4d637-3733-4dd9-8a7f-2f6301a27718 admin admin] PATH_INFO: `/v3/projects/a839a9676e7341fda1e9a11187ca68c0/users/94391e4486fe4cd1bf79937a5547a87c/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:21.940829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4d637-3733-4dd9-8a7f-2f6301a27718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a839a9676e7341fda1e9a11187ca68c0, user_id=94391e4486fe4cd1bf79937a5547a87c, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:21.945223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4d637-3733-4dd9-8a7f-2f6301a27718 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:21.957202 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1793/3538] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:19:21 2022] PUT /identity/v3/projects/a839a9676e7341fda1e9a11187ca68c0/users/94391e4486fe4cd1bf79937a5547a87c/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:21.968764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb7665-cbd6-4d2a-b874-c1456cb7fc8d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:21.969049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb7665-cbd6-4d2a-b874-c1456cb7fc8d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:21.969325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb7665-cbd6-4d2a-b874-c1456cb7fc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:22.001542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c3bb7665-cbd6-4d2a-b874-c1456cb7fc8d None None] MFA Rules not processed for user `94391e4486fe4cd1bf79937a5547a87c`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:22.004084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c3bb7665-cbd6-4d2a-b874-c1456cb7fc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:22.156367 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1746/3539] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:22.162813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4d637-3733-4dd9-8a7f-2f6301a27718 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:22.197461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4d637-3733-4dd9-8a7f-2f6301a27718 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:22.205227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898f905-4a2d-4042-b7e0-abcba0d69b08 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:22.205908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898f905-4a2d-4042-b7e0-abcba0d69b08 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:22.206192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898f905-4a2d-4042-b7e0-abcba0d69b08 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:22.206691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898f905-4a2d-4042-b7e0-abcba0d69b08 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:22.207467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898f905-4a2d-4042-b7e0-abcba0d69b08 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:22.208694 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-9898f905-4a2d-4042-b7e0-abcba0d69b08 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:22.208694 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:19:22.208694 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:19:22.211435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898f905-4a2d-4042-b7e0-abcba0d69b08 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:22.348720 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1794/3540] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:19:22 2022] POST /identity/v3/domains => generated 275 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:22.353972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb7665-cbd6-4d2a-b874-c1456cb7fc8d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:22.375781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb7665-cbd6-4d2a-b874-c1456cb7fc8d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:22.534837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cdda2-185e-4eab-a015-7a7b0a50284c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:22.536912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cdda2-185e-4eab-a015-7a7b0a50284c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:22.537203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cdda2-185e-4eab-a015-7a7b0a50284c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:22.537499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cdda2-185e-4eab-a015-7a7b0a50284c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/4100c533a4084e69a87fb239a339e353/config` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:22.539516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2cdda2-185e-4eab-a015-7a7b0a50284c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=4100c533a4084e69a87fb239a339e353)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:22.543059 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-5a2cdda2-185e-4eab-a015-7a7b0a50284c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:22.543059 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:19:22.543059 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:19:22.544561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2cdda2-185e-4eab-a015-7a7b0a50284c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:22.734200 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1747/3541] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Jul 16 21:19:22 2022] PUT /identity/v3/domains/4100c533a4084e69a87fb239a339e353/config => generated 138 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:19:22.734343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898f905-4a2d-4042-b7e0-abcba0d69b08 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:22.749220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898f905-4a2d-4042-b7e0-abcba0d69b08 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:22.766275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe2fde-a48b-4216-9d17-213643f68f7d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:22.767592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe2fde-a48b-4216-9d17-213643f68f7d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:22.768035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe2fde-a48b-4216-9d17-213643f68f7d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:22.768492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe2fde-a48b-4216-9d17-213643f68f7d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/4100c533a4084e69a87fb239a339e353/config/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:22.770429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe2fde-a48b-4216-9d17-213643f68f7d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=4100c533a4084e69a87fb239a339e353, group=identity)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:22.774148 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-3dbe2fde-a48b-4216-9d17-213643f68f7d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:22.774148 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:19:22.774148 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:19:22.776250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe2fde-a48b-4216-9d17-213643f68f7d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:22.789774 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1795/3542] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Jul 16 21:19:22 2022] GET /identity/v3/domains/4100c533a4084e69a87fb239a339e353/config/identity => generated 45 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:22.793493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cdda2-185e-4eab-a015-7a7b0a50284c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:22.811978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cdda2-185e-4eab-a015-7a7b0a50284c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:22.815830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:22.829090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4517f-f71d-48f9-b89d-6dbce6f710a5 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:22.843758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4517f-f71d-48f9-b89d-6dbce6f710a5 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:22.844093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4517f-f71d-48f9-b89d-6dbce6f710a5 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:22.844440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4517f-f71d-48f9-b89d-6dbce6f710a5 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/4100c533a4084e69a87fb239a339e353/config/identity/driver` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:22.846225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4517f-f71d-48f9-b89d-6dbce6f710a5 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=4100c533a4084e69a87fb239a339e353, group=identity, option=driver)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:22.849367 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-47e4517f-f71d-48f9-b89d-6dbce6f710a5 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:22.849367 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:19:22.849367 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:19:22.850270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4517f-f71d-48f9-b89d-6dbce6f710a5 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:22.876373 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1748/3543] 10.222.0.16 () {58 vars in 1295 bytes} [Sat Jul 16 21:19:22 2022] GET /identity/v3/domains/4100c533a4084e69a87fb239a339e353/config/identity/driver => generated 31 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:22.880573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe2fde-a48b-4216-9d17-213643f68f7d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:22.895979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe2fde-a48b-4216-9d17-213643f68f7d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:22.903323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72985753-8fba-41f7-952a-f69b4092bbac tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:22.904192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72985753-8fba-41f7-952a-f69b4092bbac tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:22.904477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72985753-8fba-41f7-952a-f69b4092bbac tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:22.904756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72985753-8fba-41f7-952a-f69b4092bbac tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/4100c533a4084e69a87fb239a339e353/config/ldap` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:22.906074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72985753-8fba-41f7-952a-f69b4092bbac tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=4100c533a4084e69a87fb239a339e353, group=ldap)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:22.907891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72985753-8fba-41f7-952a-f69b4092bbac tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:22.915549 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1796/3544] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Jul 16 21:19:22 2022] GET /identity/v3/domains/4100c533a4084e69a87fb239a339e353/config/ldap => generated 106 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:19:22.929781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4517f-f71d-48f9-b89d-6dbce6f710a5 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:22.936753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4517f-f71d-48f9-b89d-6dbce6f710a5 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:22.943756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d98a9-7edb-4917-8dba-b2978f30d301 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:22.945103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d98a9-7edb-4917-8dba-b2978f30d301 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:22.945800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d98a9-7edb-4917-8dba-b2978f30d301 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:22.946491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d98a9-7edb-4917-8dba-b2978f30d301 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/4100c533a4084e69a87fb239a339e353/config/ldap/url` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:22.948252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d98a9-7edb-4917-8dba-b2978f30d301 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=4100c533a4084e69a87fb239a339e353, group=ldap, option=url)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:22.950773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d98a9-7edb-4917-8dba-b2978f30d301 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:22.961698 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1749/3545] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Jul 16 21:19:22 2022] GET /identity/v3/domains/4100c533a4084e69a87fb239a339e353/config/ldap/url => generated 46 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:22.962157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72985753-8fba-41f7-952a-f69b4092bbac tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:22.973365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72985753-8fba-41f7-952a-f69b4092bbac tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:22.984332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69788e2-63e8-4288-86d6-a503f9cbbc07 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:22.985963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69788e2-63e8-4288-86d6-a503f9cbbc07 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:22.986554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69788e2-63e8-4288-86d6-a503f9cbbc07 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:22.986998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69788e2-63e8-4288-86d6-a503f9cbbc07 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/4100c533a4084e69a87fb239a339e353/config/ldap/user_tree_dn` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:22.988788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69788e2-63e8-4288-86d6-a503f9cbbc07 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=4100c533a4084e69a87fb239a339e353, group=ldap, option=user_tree_dn)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:22.991511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69788e2-63e8-4288-86d6-a503f9cbbc07 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:23.000729 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1797/3546] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Jul 16 21:19:22 2022] GET /identity/v3/domains/4100c533a4084e69a87fb239a339e353/config/ldap/user_tree_dn => generated 63 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:23.005274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d98a9-7edb-4917-8dba-b2978f30d301 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:23.017911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d98a9-7edb-4917-8dba-b2978f30d301 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:23.025665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aded779-074e-4688-be21-d4490b8d2d5a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:23.026968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aded779-074e-4688-be21-d4490b8d2d5a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:23.028196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aded779-074e-4688-be21-d4490b8d2d5a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:23.029133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aded779-074e-4688-be21-d4490b8d2d5a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/4100c533a4084e69a87fb239a339e353/config` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:23.030359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aded779-074e-4688-be21-d4490b8d2d5a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=4100c533a4084e69a87fb239a339e353)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:23.032002 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-4aded779-074e-4688-be21-d4490b8d2d5a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:23.032002 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:19:23.032002 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:19:23.034211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aded779-074e-4688-be21-d4490b8d2d5a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:23.146970 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1750/3547] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jul 16 21:19:23 2022] DELETE /identity/v3/domains/4100c533a4084e69a87fb239a339e353/config => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:23.152155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69788e2-63e8-4288-86d6-a503f9cbbc07 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:23.168427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69788e2-63e8-4288-86d6-a503f9cbbc07 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:23.181277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfc5f6-1f24-422c-92c2-8a80a4bf6f78 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:23.182928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfc5f6-1f24-422c-92c2-8a80a4bf6f78 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:23.183390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfc5f6-1f24-422c-92c2-8a80a4bf6f78 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:23.184185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfc5f6-1f24-422c-92c2-8a80a4bf6f78 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/4100c533a4084e69a87fb239a339e353` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:23.186109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcfc5f6-1f24-422c-92c2-8a80a4bf6f78 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4100c533a4084e69a87fb239a339e353)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:23.187447 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-5bcfc5f6-1f24-422c-92c2-8a80a4bf6f78 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:23.187447 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:19:23.187447 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:19:23.188757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcfc5f6-1f24-422c-92c2-8a80a4bf6f78 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:23.224132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5bcfc5f6-1f24-422c-92c2-8a80a4bf6f78 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4100c533a4084e69a87fb239a339e353'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:23.225351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5bcfc5f6-1f24-422c-92c2-8a80a4bf6f78 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4100c533a4084e69a87fb239a339e353'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:23.373648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5bcfc5f6-1f24-422c-92c2-8a80a4bf6f78 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4100c533a4084e69a87fb239a339e353'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:23.374305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5bcfc5f6-1f24-422c-92c2-8a80a4bf6f78 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4100c533a4084e69a87fb239a339e353'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:23.381554 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1798/3548] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:19:23 2022] PATCH /identity/v3/domains/4100c533a4084e69a87fb239a339e353 => generated 276 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:19:23.385676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aded779-074e-4688-be21-d4490b8d2d5a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:23.387932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4aded779-074e-4688-be21-d4490b8d2d5a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:23.425532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aded779-074e-4688-be21-d4490b8d2d5a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:23.521132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d2592-4255-40a9-97d4-e11e5bd57e1d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:23.522228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d2592-4255-40a9-97d4-e11e5bd57e1d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:23.522642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d2592-4255-40a9-97d4-e11e5bd57e1d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:23.523613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d2592-4255-40a9-97d4-e11e5bd57e1d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/4100c533a4084e69a87fb239a339e353` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:23.541557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d2592-4255-40a9-97d4-e11e5bd57e1d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4100c533a4084e69a87fb239a339e353)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:23.542837 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-134d2592-4255-40a9-97d4-e11e5bd57e1d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:23.542837 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:19:23.542837 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:19:23.544049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d2592-4255-40a9-97d4-e11e5bd57e1d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:23.583211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-134d2592-4255-40a9-97d4-e11e5bd57e1d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4100c533a4084e69a87fb239a339e353'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:23.615547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-134d2592-4255-40a9-97d4-e11e5bd57e1d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4100c533a4084e69a87fb239a339e353'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:23.824920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-134d2592-4255-40a9-97d4-e11e5bd57e1d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4100c533a4084e69a87fb239a339e353', 'request_id': 'req-134d2592-4255-40a9-97d4-e11e5bd57e1d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:23.839819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-134d2592-4255-40a9-97d4-e11e5bd57e1d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4100c533a4084e69a87fb239a339e353', 'request_id': 'req-134d2592-4255-40a9-97d4-e11e5bd57e1d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:23.857027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-134d2592-4255-40a9-97d4-e11e5bd57e1d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4100c533a4084e69a87fb239a339e353', 'request_id': 'req-134d2592-4255-40a9-97d4-e11e5bd57e1d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:23.951923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-134d2592-4255-40a9-97d4-e11e5bd57e1d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] The token cache is being invalidate because project 4100c533a4084e69a87fb239a339e353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:19:23.953749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-134d2592-4255-40a9-97d4-e11e5bd57e1d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:23.953749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-134d2592-4255-40a9-97d4-e11e5bd57e1d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:23.965192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-134d2592-4255-40a9-97d4-e11e5bd57e1d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4100c533a4084e69a87fb239a339e353', 'request_id': 'req-134d2592-4255-40a9-97d4-e11e5bd57e1d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:23.966210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-134d2592-4255-40a9-97d4-e11e5bd57e1d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4100c533a4084e69a87fb239a339e353', 'request_id': 'req-134d2592-4255-40a9-97d4-e11e5bd57e1d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:23.967378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-134d2592-4255-40a9-97d4-e11e5bd57e1d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4100c533a4084e69a87fb239a339e353', 'request_id': 'req-134d2592-4255-40a9-97d4-e11e5bd57e1d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:23.990980 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1751/3549] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:19:23 2022] DELETE /identity/v3/domains/4100c533a4084e69a87fb239a339e353 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:19:23.992969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfc5f6-1f24-422c-92c2-8a80a4bf6f78 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:23.995643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:24.008455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfc5f6-1f24-422c-92c2-8a80a4bf6f78 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:24.048719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d2592-4255-40a9-97d4-e11e5bd57e1d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:24.051310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-134d2592-4255-40a9-97d4-e11e5bd57e1d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:24.140180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abc04f-0a59-442e-9b18-7c578e0f70c2 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:24.144436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abc04f-0a59-442e-9b18-7c578e0f70c2 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:24.144981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abc04f-0a59-442e-9b18-7c578e0f70c2 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:24.145473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abc04f-0a59-442e-9b18-7c578e0f70c2 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:24.147303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abc04f-0a59-442e-9b18-7c578e0f70c2 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:24.149457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abc04f-0a59-442e-9b18-7c578e0f70c2 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:24.166136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d2592-4255-40a9-97d4-e11e5bd57e1d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:24.172413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd7dc8-33a9-41f3-bb28-fa4c6aa31ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:24.176978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd7dc8-33a9-41f3-bb28-fa4c6aa31ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:24.176978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd7dc8-33a9-41f3-bb28-fa4c6aa31ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:24.176978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd7dc8-33a9-41f3-bb28-fa4c6aa31ee2 admin admin] PATH_INFO: `/v3/users/daf3c9e6634e4ae1bfb492eae1f44c93` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:24.176978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd7dc8-33a9-41f3-bb28-fa4c6aa31ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daf3c9e6634e4ae1bfb492eae1f44c93)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:24.177878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd7dc8-33a9-41f3-bb28-fa4c6aa31ee2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:24.349819 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1799/3550] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:19:23 2022] POST /identity/v3/domains => generated 277 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:24.354017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abc04f-0a59-442e-9b18-7c578e0f70c2 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:24.356152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-24abc04f-0a59-442e-9b18-7c578e0f70c2 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:24.436085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abc04f-0a59-442e-9b18-7c578e0f70c2 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:24.440847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50904489-6e62-4b65-9cec-52f9f2f58e80 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:24.441675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50904489-6e62-4b65-9cec-52f9f2f58e80 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:24.442135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50904489-6e62-4b65-9cec-52f9f2f58e80 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:24.442698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50904489-6e62-4b65-9cec-52f9f2f58e80 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/355580fe66324585bd5cb8d57ffba985/config` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:24.443643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50904489-6e62-4b65-9cec-52f9f2f58e80 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=355580fe66324585bd5cb8d57ffba985)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:24.454865 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-50904489-6e62-4b65-9cec-52f9f2f58e80 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:24.454865 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:19:24.454865 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:19:24.454865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50904489-6e62-4b65-9cec-52f9f2f58e80 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:24.963401 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1800/3551] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Jul 16 21:19:24 2022] PUT /identity/v3/domains/355580fe66324585bd5cb8d57ffba985/config => generated 138 bytes in 606 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:24.964495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50904489-6e62-4b65-9cec-52f9f2f58e80 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:24.974868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4cbd7dc8-33a9-41f3-bb28-fa4c6aa31ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daf3c9e6634e4ae1bfb492eae1f44c93'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:24.982543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50904489-6e62-4b65-9cec-52f9f2f58e80 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:24.990108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde673ec-3a03-4b94-bb68-83891f9bf6dc tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:24.991221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde673ec-3a03-4b94-bb68-83891f9bf6dc tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:24.991427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde673ec-3a03-4b94-bb68-83891f9bf6dc tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:24.992347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde673ec-3a03-4b94-bb68-83891f9bf6dc tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/355580fe66324585bd5cb8d57ffba985/config` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:24.993512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4cbd7dc8-33a9-41f3-bb28-fa4c6aa31ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daf3c9e6634e4ae1bfb492eae1f44c93'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:24.994170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde673ec-3a03-4b94-bb68-83891f9bf6dc tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=355580fe66324585bd5cb8d57ffba985)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:24.995234 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-dde673ec-3a03-4b94-bb68-83891f9bf6dc tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:24.995234 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:19:24.995234 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:19:24.996950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde673ec-3a03-4b94-bb68-83891f9bf6dc tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:25.104145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4cbd7dc8-33a9-41f3-bb28-fa4c6aa31ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daf3c9e6634e4ae1bfb492eae1f44c93'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:25.118429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4cbd7dc8-33a9-41f3-bb28-fa4c6aa31ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daf3c9e6634e4ae1bfb492eae1f44c93'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:25.118429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4cbd7dc8-33a9-41f3-bb28-fa4c6aa31ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daf3c9e6634e4ae1bfb492eae1f44c93'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:25.137434 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1752/3552] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:19:24 2022] DELETE /identity/v3/users/daf3c9e6634e4ae1bfb492eae1f44c93 => generated 0 bytes in 1084 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:25.150833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd7dc8-33a9-41f3-bb28-fa4c6aa31ee2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:25.153244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4cbd7dc8-33a9-41f3-bb28-fa4c6aa31ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:25.219120 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1801/3553] 10.222.0.16 () {60 vars in 1270 bytes} [Sat Jul 16 21:19:24 2022] PATCH /identity/v3/domains/355580fe66324585bd5cb8d57ffba985/config => generated 142 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:19:25.222960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde673ec-3a03-4b94-bb68-83891f9bf6dc tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:25.225583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dde673ec-3a03-4b94-bb68-83891f9bf6dc tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:25.256303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde673ec-3a03-4b94-bb68-83891f9bf6dc tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:25.283698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd7dc8-33a9-41f3-bb28-fa4c6aa31ee2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:25.289528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4dc00a-0b74-4970-854e-362b95627945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:25.290403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dc00a-0b74-4970-854e-362b95627945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:25.290789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dc00a-0b74-4970-854e-362b95627945 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:25.291288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dc00a-0b74-4970-854e-362b95627945 admin admin] PATH_INFO: `/v3/users/a8d48b52db1545a4a51027a5c2c7fcce` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:25.292773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4dc00a-0b74-4970-854e-362b95627945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8d48b52db1545a4a51027a5c2c7fcce)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:25.295039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4dc00a-0b74-4970-854e-362b95627945 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:25.379796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086db4d6-5bc6-4a77-9b84-0743f8b62446 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:25.380874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086db4d6-5bc6-4a77-9b84-0743f8b62446 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:25.381849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086db4d6-5bc6-4a77-9b84-0743f8b62446 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:25.384035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086db4d6-5bc6-4a77-9b84-0743f8b62446 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/355580fe66324585bd5cb8d57ffba985/config` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:25.385454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086db4d6-5bc6-4a77-9b84-0743f8b62446 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=355580fe66324585bd5cb8d57ffba985)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:25.387428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086db4d6-5bc6-4a77-9b84-0743f8b62446 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:25.394170 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1802/3554] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Jul 16 21:19:25 2022] GET /identity/v3/domains/355580fe66324585bd5cb8d57ffba985/config => generated 142 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:19:25.398018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086db4d6-5bc6-4a77-9b84-0743f8b62446 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:25.410070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086db4d6-5bc6-4a77-9b84-0743f8b62446 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:25.418757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d15e22-d520-48e1-8e4a-13de9294164d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:25.420042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d15e22-d520-48e1-8e4a-13de9294164d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:25.421110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d15e22-d520-48e1-8e4a-13de9294164d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:25.421605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d15e22-d520-48e1-8e4a-13de9294164d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/355580fe66324585bd5cb8d57ffba985/config` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:25.422487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d15e22-d520-48e1-8e4a-13de9294164d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=355580fe66324585bd5cb8d57ffba985)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:25.423671 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-70d15e22-d520-48e1-8e4a-13de9294164d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:25.423671 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:19:25.423671 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:19:25.428268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d15e22-d520-48e1-8e4a-13de9294164d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:25.533636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:25.540391 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1803/3555] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jul 16 21:19:25 2022] DELETE /identity/v3/domains/355580fe66324585bd5cb8d57ffba985/config => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:25.541315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d15e22-d520-48e1-8e4a-13de9294164d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:25.553562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d15e22-d520-48e1-8e4a-13de9294164d tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:25.561717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ee4dc00a-0b74-4970-854e-362b95627945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8d48b52db1545a4a51027a5c2c7fcce'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:25.561855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c558b0-4f82-4b4c-a211-dbcdcce9229c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:25.561855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c558b0-4f82-4b4c-a211-dbcdcce9229c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:25.562576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c558b0-4f82-4b4c-a211-dbcdcce9229c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:25.562576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c558b0-4f82-4b4c-a211-dbcdcce9229c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/355580fe66324585bd5cb8d57ffba985/config` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:25.563743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c558b0-4f82-4b4c-a211-dbcdcce9229c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=355580fe66324585bd5cb8d57ffba985)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:25.565308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c558b0-4f82-4b4c-a211-dbcdcce9229c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:25.575960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ee4dc00a-0b74-4970-854e-362b95627945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8d48b52db1545a4a51027a5c2c7fcce'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:25.580867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-55c558b0-4f82-4b4c-a211-dbcdcce9229c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Could not find any options in domain configuration for domain 355580fe66324585bd5cb8d57ffba985.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 355580fe66324585bd5cb8d57ffba985. Jul 16 21:19:25.580867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:19:25.580867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:19:25.580867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:19:25.580867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:19:25.580867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:19:25.580867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:19:25.580867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:19:25.580867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:19:25.580867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:19:25.580867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:19:25.580867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:19:25.580867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 16 21:19:25.583358 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 16 21:19:25.583358 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 16 21:19:25.583358 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 16 21:19:25.583358 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:19:25.583358 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:19:25.583358 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 16 21:19:25.583358 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 16 21:19:25.583358 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 355580fe66324585bd5cb8d57ffba985. Jul 16 21:19:25.583358 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:19:25.583358 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1804/3556] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Jul 16 21:19:25 2022] GET /identity/v3/domains/355580fe66324585bd5cb8d57ffba985/config => generated 151 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:19:25.587290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c558b0-4f82-4b4c-a211-dbcdcce9229c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:25.598004 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c558b0-4f82-4b4c-a211-dbcdcce9229c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:25.604595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62350df-17b3-44d5-b808-c6e6f0f46140 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:25.605637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62350df-17b3-44d5-b808-c6e6f0f46140 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:25.606031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62350df-17b3-44d5-b808-c6e6f0f46140 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:25.606315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62350df-17b3-44d5-b808-c6e6f0f46140 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/355580fe66324585bd5cb8d57ffba985/config` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:25.606976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62350df-17b3-44d5-b808-c6e6f0f46140 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=355580fe66324585bd5cb8d57ffba985)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:25.608670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62350df-17b3-44d5-b808-c6e6f0f46140 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:25.615045 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1805/3557] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jul 16 21:19:25 2022] DELETE /identity/v3/domains/355580fe66324585bd5cb8d57ffba985/config => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:19:25.620757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62350df-17b3-44d5-b808-c6e6f0f46140 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:25.659300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62350df-17b3-44d5-b808-c6e6f0f46140 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:25.659300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ab89b-f37d-47bf-a90b-95b6e5dbfe96 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:25.659300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ab89b-f37d-47bf-a90b-95b6e5dbfe96 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:25.660235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ab89b-f37d-47bf-a90b-95b6e5dbfe96 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:25.660235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ab89b-f37d-47bf-a90b-95b6e5dbfe96 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/355580fe66324585bd5cb8d57ffba985` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:25.660235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ab89b-f37d-47bf-a90b-95b6e5dbfe96 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=355580fe66324585bd5cb8d57ffba985)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:25.660235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ab89b-f37d-47bf-a90b-95b6e5dbfe96 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:25.674635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-593ab89b-f37d-47bf-a90b-95b6e5dbfe96 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '355580fe66324585bd5cb8d57ffba985'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:25.675428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-593ab89b-f37d-47bf-a90b-95b6e5dbfe96 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '355580fe66324585bd5cb8d57ffba985'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:25.715085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ee4dc00a-0b74-4970-854e-362b95627945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8d48b52db1545a4a51027a5c2c7fcce'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:25.729260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ee4dc00a-0b74-4970-854e-362b95627945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8d48b52db1545a4a51027a5c2c7fcce'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:25.730743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ee4dc00a-0b74-4970-854e-362b95627945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8d48b52db1545a4a51027a5c2c7fcce'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:25.745801 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1753/3558] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:19:25 2022] DELETE /identity/v3/users/a8d48b52db1545a4a51027a5c2c7fcce => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:19:25.745801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50ab1e-5aeb-4433-b0d9-8ae89d782ee6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:25.746106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50ab1e-5aeb-4433-b0d9-8ae89d782ee6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:25.746495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50ab1e-5aeb-4433-b0d9-8ae89d782ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:25.777956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9f50ab1e-5aeb-4433-b0d9-8ae89d782ee6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:25.779457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9f50ab1e-5aeb-4433-b0d9-8ae89d782ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:25.829964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-593ab89b-f37d-47bf-a90b-95b6e5dbfe96 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '355580fe66324585bd5cb8d57ffba985'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:25.831764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-593ab89b-f37d-47bf-a90b-95b6e5dbfe96 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '355580fe66324585bd5cb8d57ffba985'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:25.850491 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1806/3559] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:19:25 2022] PATCH /identity/v3/domains/355580fe66324585bd5cb8d57ffba985 => generated 278 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:19:25.850491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ab89b-f37d-47bf-a90b-95b6e5dbfe96 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:25.852950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-593ab89b-f37d-47bf-a90b-95b6e5dbfe96 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:25.927863 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1754/3560] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:25.928911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50ab1e-5aeb-4433-b0d9-8ae89d782ee6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:25.935794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9f50ab1e-5aeb-4433-b0d9-8ae89d782ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:26.022506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ab89b-f37d-47bf-a90b-95b6e5dbfe96 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:26.029285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180d4f3-ad30-4a82-9703-ff486e431ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:26.030241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180d4f3-ad30-4a82-9703-ff486e431ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:26.030596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180d4f3-ad30-4a82-9703-ff486e431ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:26.030934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180d4f3-ad30-4a82-9703-ff486e431ac5 admin admin] PATH_INFO: `/v3/projects/24c64db8082648c8837c16352252f96d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:26.032211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180d4f3-ad30-4a82-9703-ff486e431ac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24c64db8082648c8837c16352252f96d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:26.034181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180d4f3-ad30-4a82-9703-ff486e431ac5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:26.069581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50ab1e-5aeb-4433-b0d9-8ae89d782ee6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:26.075087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b9c85-af12-4a1e-be64-6eef75439118 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:26.076247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9c85-af12-4a1e-be64-6eef75439118 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:26.076825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9c85-af12-4a1e-be64-6eef75439118 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:26.077240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9c85-af12-4a1e-be64-6eef75439118 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/355580fe66324585bd5cb8d57ffba985` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:26.090311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b9c85-af12-4a1e-be64-6eef75439118 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=355580fe66324585bd5cb8d57ffba985)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:26.091973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b9c85-af12-4a1e-be64-6eef75439118 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:26.117639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d91b9c85-af12-4a1e-be64-6eef75439118 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '355580fe66324585bd5cb8d57ffba985'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:26.128751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d91b9c85-af12-4a1e-be64-6eef75439118 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '355580fe66324585bd5cb8d57ffba985'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:26.209066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5180d4f3-ad30-4a82-9703-ff486e431ac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24c64db8082648c8837c16352252f96d', 'request_id': 'req-5180d4f3-ad30-4a82-9703-ff486e431ac5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:26.217648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5180d4f3-ad30-4a82-9703-ff486e431ac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24c64db8082648c8837c16352252f96d', 'request_id': 'req-5180d4f3-ad30-4a82-9703-ff486e431ac5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:26.223807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5180d4f3-ad30-4a82-9703-ff486e431ac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24c64db8082648c8837c16352252f96d', 'request_id': 'req-5180d4f3-ad30-4a82-9703-ff486e431ac5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:26.251820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d91b9c85-af12-4a1e-be64-6eef75439118 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '355580fe66324585bd5cb8d57ffba985', 'request_id': 'req-d91b9c85-af12-4a1e-be64-6eef75439118'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:26.261331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d91b9c85-af12-4a1e-be64-6eef75439118 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '355580fe66324585bd5cb8d57ffba985', 'request_id': 'req-d91b9c85-af12-4a1e-be64-6eef75439118'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:26.277071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d91b9c85-af12-4a1e-be64-6eef75439118 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '355580fe66324585bd5cb8d57ffba985', 'request_id': 'req-d91b9c85-af12-4a1e-be64-6eef75439118'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:26.356365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5180d4f3-ad30-4a82-9703-ff486e431ac5 admin admin] The token cache is being invalidate because project 24c64db8082648c8837c16352252f96d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:19:26.357225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5180d4f3-ad30-4a82-9703-ff486e431ac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:26.357607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5180d4f3-ad30-4a82-9703-ff486e431ac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:26.363251 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1807/3561] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:19:25 2022] DELETE /identity/v3/projects/24c64db8082648c8837c16352252f96d => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:26.363251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180d4f3-ad30-4a82-9703-ff486e431ac5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:26.363251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5180d4f3-ad30-4a82-9703-ff486e431ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:26.408944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d91b9c85-af12-4a1e-be64-6eef75439118 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] The token cache is being invalidate because project 355580fe66324585bd5cb8d57ffba985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:19:26.409294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d91b9c85-af12-4a1e-be64-6eef75439118 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:26.415625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d91b9c85-af12-4a1e-be64-6eef75439118 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:26.425337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d91b9c85-af12-4a1e-be64-6eef75439118 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '355580fe66324585bd5cb8d57ffba985', 'request_id': 'req-d91b9c85-af12-4a1e-be64-6eef75439118'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:26.426662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d91b9c85-af12-4a1e-be64-6eef75439118 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '355580fe66324585bd5cb8d57ffba985', 'request_id': 'req-d91b9c85-af12-4a1e-be64-6eef75439118'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:26.426800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d91b9c85-af12-4a1e-be64-6eef75439118 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '355580fe66324585bd5cb8d57ffba985', 'request_id': 'req-d91b9c85-af12-4a1e-be64-6eef75439118'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:26.435355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180d4f3-ad30-4a82-9703-ff486e431ac5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:26.439748 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1755/3562] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:19:25 2022] DELETE /identity/v3/domains/355580fe66324585bd5cb8d57ffba985 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:26.441119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f762d21-61cd-44a7-b023-a58ad994f3a1 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:26.441402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f762d21-61cd-44a7-b023-a58ad994f3a1 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:26.441678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f762d21-61cd-44a7-b023-a58ad994f3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:26.465074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3f762d21-61cd-44a7-b023-a58ad994f3a1 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:26.466317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3f762d21-61cd-44a7-b023-a58ad994f3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:26.522075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76de45-0d2c-440b-8580-9ed072dea4e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:26.523482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76de45-0d2c-440b-8580-9ed072dea4e9 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:26.523820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76de45-0d2c-440b-8580-9ed072dea4e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:26.524105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76de45-0d2c-440b-8580-9ed072dea4e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:26.525981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0e76de45-0d2c-440b-8580-9ed072dea4e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:26.543932 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1756/3563] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:26.544832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f762d21-61cd-44a7-b023-a58ad994f3a1 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:26.546141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3f762d21-61cd-44a7-b023-a58ad994f3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:26.604833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76de45-0d2c-440b-8580-9ed072dea4e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:26.604833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76de45-0d2c-440b-8580-9ed072dea4e9 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:26.615125 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1808/3564] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:19:26.616431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abb923-1773-4314-b9df-43a0e40f557b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:26.617020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abb923-1773-4314-b9df-43a0e40f557b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:26.617020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abb923-1773-4314-b9df-43a0e40f557b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:26.634491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f762d21-61cd-44a7-b023-a58ad994f3a1 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:26.644418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cca58-5efc-4604-ba20-f11853c09d7c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:26.645182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cca58-5efc-4604-ba20-f11853c09d7c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:26.645546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cca58-5efc-4604-ba20-f11853c09d7c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:26.645896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cca58-5efc-4604-ba20-f11853c09d7c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:26.647296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cca58-5efc-4604-ba20-f11853c09d7c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:26.649546 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-7a6cca58-5efc-4604-ba20-f11853c09d7c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:26.649546 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:19:26.649546 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:19:26.650854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cca58-5efc-4604-ba20-f11853c09d7c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:26.657896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b6abb923-1773-4314-b9df-43a0e40f557b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:26.659268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b6abb923-1773-4314-b9df-43a0e40f557b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:26.671086 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1809/3565] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:26.674504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abb923-1773-4314-b9df-43a0e40f557b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:26.694385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abb923-1773-4314-b9df-43a0e40f557b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:26.700405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1fe98d-d6de-42d8-a551-9e36949bf7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:26.701510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fe98d-d6de-42d8-a551-9e36949bf7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:26.701804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fe98d-d6de-42d8-a551-9e36949bf7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:26.702086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fe98d-d6de-42d8-a551-9e36949bf7e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:26.702916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1fe98d-d6de-42d8-a551-9e36949bf7e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:19:26.703333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1fe98d-d6de-42d8-a551-9e36949bf7e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:26.705233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1fe98d-d6de-42d8-a551-9e36949bf7e4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:26.731873 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1810/3566] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:19:26.737463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1fe98d-d6de-42d8-a551-9e36949bf7e4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:26.746317 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1757/3567] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:19:26 2022] POST /identity/v3/domains => generated 276 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:26.749342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cca58-5efc-4604-ba20-f11853c09d7c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:26.751148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1fe98d-d6de-42d8-a551-9e36949bf7e4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:26.886907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7a898-6379-4d20-8f95-e27f338674ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:26.887724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7a898-6379-4d20-8f95-e27f338674ce admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:26.888005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7a898-6379-4d20-8f95-e27f338674ce admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:26.888283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7a898-6379-4d20-8f95-e27f338674ce admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:26.888980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7a898-6379-4d20-8f95-e27f338674ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:26.891087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7a898-6379-4d20-8f95-e27f338674ce admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:26.927122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cca58-5efc-4604-ba20-f11853c09d7c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:26.933745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e21755-0b3a-49ea-91e2-fac68cce0dff tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:26.935063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e21755-0b3a-49ea-91e2-fac68cce0dff tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:26.935205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e21755-0b3a-49ea-91e2-fac68cce0dff tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:26.937533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e21755-0b3a-49ea-91e2-fac68cce0dff tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/eb5be2d5b6d24f3ea212fadb5e722b61/config` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:26.938400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e21755-0b3a-49ea-91e2-fac68cce0dff tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=eb5be2d5b6d24f3ea212fadb5e722b61)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:26.940263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e21755-0b3a-49ea-91e2-fac68cce0dff tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:27.021106 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1811/3568] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:19:26 2022] POST /identity/v3/projects => generated 379 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:27.026385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7a898-6379-4d20-8f95-e27f338674ce admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:27.061329 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1758/3569] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Jul 16 21:19:26 2022] PUT /identity/v3/domains/eb5be2d5b6d24f3ea212fadb5e722b61/config => generated 138 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:19:27.065530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e21755-0b3a-49ea-91e2-fac68cce0dff tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:27.078868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e21755-0b3a-49ea-91e2-fac68cce0dff tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:27.115844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7a898-6379-4d20-8f95-e27f338674ce admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:27.122154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd87886-4bd9-4bf5-8c52-e2ca0a4bb5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:27.123329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd87886-4bd9-4bf5-8c52-e2ca0a4bb5d6 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:27.123719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd87886-4bd9-4bf5-8c52-e2ca0a4bb5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:27.124183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd87886-4bd9-4bf5-8c52-e2ca0a4bb5d6 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:27.125131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd87886-4bd9-4bf5-8c52-e2ca0a4bb5d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:27.127845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd87886-4bd9-4bf5-8c52-e2ca0a4bb5d6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:27.175655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6d8a8-696d-48fb-ac9b-333b49314dd0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:27.176651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6d8a8-696d-48fb-ac9b-333b49314dd0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:27.177019 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6d8a8-696d-48fb-ac9b-333b49314dd0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:27.177392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6d8a8-696d-48fb-ac9b-333b49314dd0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/eb5be2d5b6d24f3ea212fadb5e722b61/config/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:27.178634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6d8a8-696d-48fb-ac9b-333b49314dd0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=eb5be2d5b6d24f3ea212fadb5e722b61, group=identity)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:27.180758 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-93f6d8a8-696d-48fb-ac9b-333b49314dd0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:27.180758 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:19:27.180758 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:19:27.181999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6d8a8-696d-48fb-ac9b-333b49314dd0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:27.266097 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1812/3570] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:19:27 2022] POST /identity/v3/users => generated 290 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:19:27.267143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd87886-4bd9-4bf5-8c52-e2ca0a4bb5d6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:27.279356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd87886-4bd9-4bf5-8c52-e2ca0a4bb5d6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:27.284425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d37ba-0d3f-417d-bc89-9132f5fe556d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:27.285189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d37ba-0d3f-417d-bc89-9132f5fe556d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:27.285560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d37ba-0d3f-417d-bc89-9132f5fe556d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:27.285907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d37ba-0d3f-417d-bc89-9132f5fe556d admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:27.286699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d37ba-0d3f-417d-bc89-9132f5fe556d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:27.288461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d37ba-0d3f-417d-bc89-9132f5fe556d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:27.300367 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1813/3571] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:27.303913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d37ba-0d3f-417d-bc89-9132f5fe556d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:27.318669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d37ba-0d3f-417d-bc89-9132f5fe556d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:27.318788 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1759/3572] 10.222.0.16 () {60 vars in 1296 bytes} [Sat Jul 16 21:19:27 2022] PATCH /identity/v3/domains/eb5be2d5b6d24f3ea212fadb5e722b61/config/identity => generated 176 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:19:27.322359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6d8a8-696d-48fb-ac9b-333b49314dd0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:27.323435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848f57b-c03c-4187-8c6b-1b989ef11fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:27.324204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848f57b-c03c-4187-8c6b-1b989ef11fff admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:27.324525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848f57b-c03c-4187-8c6b-1b989ef11fff admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:27.324779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848f57b-c03c-4187-8c6b-1b989ef11fff admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:27.336344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6d8a8-696d-48fb-ac9b-333b49314dd0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:27.342330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848f57b-c03c-4187-8c6b-1b989ef11fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:27.342330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848f57b-c03c-4187-8c6b-1b989ef11fff admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:27.347528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88bddf-a01f-4626-a1c9-b151871915c8 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:27.348576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88bddf-a01f-4626-a1c9-b151871915c8 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:27.348939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88bddf-a01f-4626-a1c9-b151871915c8 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:27.349286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88bddf-a01f-4626-a1c9-b151871915c8 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/eb5be2d5b6d24f3ea212fadb5e722b61/config/identity/driver` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:27.350102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88bddf-a01f-4626-a1c9-b151871915c8 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=eb5be2d5b6d24f3ea212fadb5e722b61, group=identity, option=driver)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:27.352610 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1814/3573] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:19:27.354484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88bddf-a01f-4626-a1c9-b151871915c8 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:27.356651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848f57b-c03c-4187-8c6b-1b989ef11fff admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:27.377387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:INSERT=2,keystone:SELECT=85,keystone:DELETE=13 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:27.380096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848f57b-c03c-4187-8c6b-1b989ef11fff admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:27.388818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d96437-0d16-4010-974c-a7adb9f797e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:27.393503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d96437-0d16-4010-974c-a7adb9f797e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:27.393503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d96437-0d16-4010-974c-a7adb9f797e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:27.393503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d96437-0d16-4010-974c-a7adb9f797e2 admin admin] PATH_INFO: `/v3/projects/924d77495f2c4d0bad9e19a2b875063a/users/687b97cda0f644ec9c95e7e53237f4a9/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:27.414601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d96437-0d16-4010-974c-a7adb9f797e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=924d77495f2c4d0bad9e19a2b875063a, user_id=687b97cda0f644ec9c95e7e53237f4a9, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:27.417920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d96437-0d16-4010-974c-a7adb9f797e2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:27.496352 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1760/3574] 10.222.0.16 () {60 vars in 1317 bytes} [Sat Jul 16 21:19:27 2022] PATCH /identity/v3/domains/eb5be2d5b6d24f3ea212fadb5e722b61/config/identity/driver => generated 177 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:19:27.501402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88bddf-a01f-4626-a1c9-b151871915c8 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:27.515790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-df88bddf-a01f-4626-a1c9-b151871915c8 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:27.531643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88bddf-a01f-4626-a1c9-b151871915c8 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:27.545463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1db3f-73dc-44a1-ae7a-9c172e1e23a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:27.546347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1db3f-73dc-44a1-ae7a-9c172e1e23a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:27.546628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1db3f-73dc-44a1-ae7a-9c172e1e23a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:27.547096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1db3f-73dc-44a1-ae7a-9c172e1e23a0 admin admin] PATH_INFO: `/v3/projects/f2984288b4cd4610b2f32e895f3e5d72` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:27.549159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1db3f-73dc-44a1-ae7a-9c172e1e23a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2984288b4cd4610b2f32e895f3e5d72)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:27.551317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1db3f-73dc-44a1-ae7a-9c172e1e23a0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:27.567635 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1815/3575] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:19:27 2022] PUT /identity/v3/projects/924d77495f2c4d0bad9e19a2b875063a/users/687b97cda0f644ec9c95e7e53237f4a9/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:27.568666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d96437-0d16-4010-974c-a7adb9f797e2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:27.662540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d96437-0d16-4010-974c-a7adb9f797e2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:27.669101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c4696-93c2-4c3a-a6d8-87f8ff7811db tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:27.670166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c4696-93c2-4c3a-a6d8-87f8ff7811db tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:27.670481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c4696-93c2-4c3a-a6d8-87f8ff7811db tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:27.675037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c4696-93c2-4c3a-a6d8-87f8ff7811db tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/eb5be2d5b6d24f3ea212fadb5e722b61/config/identity/driver` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:27.675037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c4696-93c2-4c3a-a6d8-87f8ff7811db tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=eb5be2d5b6d24f3ea212fadb5e722b61, group=identity, option=driver)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:27.675037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c4696-93c2-4c3a-a6d8-87f8ff7811db tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:27.735548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-49e1db3f-73dc-44a1-ae7a-9c172e1e23a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2984288b4cd4610b2f32e895f3e5d72', 'request_id': 'req-49e1db3f-73dc-44a1-ae7a-9c172e1e23a0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:27.741253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-49e1db3f-73dc-44a1-ae7a-9c172e1e23a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2984288b4cd4610b2f32e895f3e5d72', 'request_id': 'req-49e1db3f-73dc-44a1-ae7a-9c172e1e23a0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:27.751370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-49e1db3f-73dc-44a1-ae7a-9c172e1e23a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2984288b4cd4610b2f32e895f3e5d72', 'request_id': 'req-49e1db3f-73dc-44a1-ae7a-9c172e1e23a0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:27.752960 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1816/3576] 10.222.0.16 () {58 vars in 1298 bytes} [Sat Jul 16 21:19:27 2022] DELETE /identity/v3/domains/eb5be2d5b6d24f3ea212fadb5e722b61/config/identity/driver => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:27.754550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de622d95-d980-4a0f-8a55-0aab65f1d28e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:27.754852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de622d95-d980-4a0f-8a55-0aab65f1d28e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:27.755233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de622d95-d980-4a0f-8a55-0aab65f1d28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:27.785418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-de622d95-d980-4a0f-8a55-0aab65f1d28e None None] MFA Rules not processed for user `687b97cda0f644ec9c95e7e53237f4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:27.786722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-de622d95-d980-4a0f-8a55-0aab65f1d28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:27.852493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-49e1db3f-73dc-44a1-ae7a-9c172e1e23a0 admin admin] The token cache is being invalidate because project f2984288b4cd4610b2f32e895f3e5d72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:19:27.852860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-49e1db3f-73dc-44a1-ae7a-9c172e1e23a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:27.853807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-49e1db3f-73dc-44a1-ae7a-9c172e1e23a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:27.855292 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1761/3577] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:19:27 2022] DELETE /identity/v3/projects/f2984288b4cd4610b2f32e895f3e5d72 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:27.856291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1db3f-73dc-44a1-ae7a-9c172e1e23a0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:27.857361 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1817/3578] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:27.857601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-49e1db3f-73dc-44a1-ae7a-9c172e1e23a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:27.860386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5acaf2-1a99-4193-8320-7f57ffef629b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:27.860784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5acaf2-1a99-4193-8320-7f57ffef629b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:27.861163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5acaf2-1a99-4193-8320-7f57ffef629b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:27.905761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4b5acaf2-1a99-4193-8320-7f57ffef629b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:27.907722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4b5acaf2-1a99-4193-8320-7f57ffef629b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:27.936057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1db3f-73dc-44a1-ae7a-9c172e1e23a0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:27.943462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b8cbb-955f-4b6e-9716-3249949d9f24 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:27.945442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b8cbb-955f-4b6e-9716-3249949d9f24 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:27.945850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b8cbb-955f-4b6e-9716-3249949d9f24 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:27.946202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b8cbb-955f-4b6e-9716-3249949d9f24 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/eb5be2d5b6d24f3ea212fadb5e722b61/config/identity/driver` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:27.947933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b8cbb-955f-4b6e-9716-3249949d9f24 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=eb5be2d5b6d24f3ea212fadb5e722b61, group=identity, option=driver)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:27.951375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b8cbb-955f-4b6e-9716-3249949d9f24 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:27.971269 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-6a2b8cbb-955f-4b6e-9716-3249949d9f24 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Could not find option driver in group identity in domain configuration for domain eb5be2d5b6d24f3ea212fadb5e722b61.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain eb5be2d5b6d24f3ea212fadb5e722b61. Jul 16 21:19:27.971269 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:19:27.971269 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:19:27.971269 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:19:27.971269 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:19:27.971269 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:19:27.971269 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:19:27.971269 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:19:27.971269 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:19:27.971269 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:19:27.971269 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:19:27.971269 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:19:27.971269 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 16 21:19:27.972238 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 16 21:19:27.972238 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 16 21:19:27.972238 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 16 21:19:27.972238 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:19:27.972238 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:19:27.972238 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 16 21:19:27.972238 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 16 21:19:27.972238 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain eb5be2d5b6d24f3ea212fadb5e722b61. Jul 16 21:19:27.972238 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:19:27.973445 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1762/3579] 10.222.0.16 () {58 vars in 1295 bytes} [Sat Jul 16 21:19:27 2022] GET /identity/v3/domains/eb5be2d5b6d24f3ea212fadb5e722b61/config/identity/driver => generated 171 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:19:27.974377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b8cbb-955f-4b6e-9716-3249949d9f24 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:27.984188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6a2b8cbb-955f-4b6e-9716-3249949d9f24 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:27.984544 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1818/3580] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:27.985253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5acaf2-1a99-4193-8320-7f57ffef629b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:28.038287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5acaf2-1a99-4193-8320-7f57ffef629b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:28.052415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eb7f0-c523-41ec-b53d-d9f416aa2515 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:28.055212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eb7f0-c523-41ec-b53d-d9f416aa2515 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:28.055212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eb7f0-c523-41ec-b53d-d9f416aa2515 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:28.055212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eb7f0-c523-41ec-b53d-d9f416aa2515 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/eb5be2d5b6d24f3ea212fadb5e722b61/config/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:28.055212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6eb7f0-c523-41ec-b53d-d9f416aa2515 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=eb5be2d5b6d24f3ea212fadb5e722b61, group=identity)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:28.056776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6eb7f0-c523-41ec-b53d-d9f416aa2515 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:28.090909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b8cbb-955f-4b6e-9716-3249949d9f24 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:28.097592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cae1b-b1b9-47ba-93ff-888288469a6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:28.098341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cae1b-b1b9-47ba-93ff-888288469a6d service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:28.098703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cae1b-b1b9-47ba-93ff-888288469a6d service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:28.099095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cae1b-b1b9-47ba-93ff-888288469a6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:28.103675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a84cae1b-b1b9-47ba-93ff-888288469a6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:28.119695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cae1b-b1b9-47ba-93ff-888288469a6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:28.121346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cae1b-b1b9-47ba-93ff-888288469a6d service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:28.137486 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1763/3581] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:19:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:19:28.138962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47304c-59a5-4c9a-8185-25cdebe57b40 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:28.139341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47304c-59a5-4c9a-8185-25cdebe57b40 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:28.139621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47304c-59a5-4c9a-8185-25cdebe57b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:28.165508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0a47304c-59a5-4c9a-8185-25cdebe57b40 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:28.167279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0a47304c-59a5-4c9a-8185-25cdebe57b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:28.177318 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1764/3582] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:28.181335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47304c-59a5-4c9a-8185-25cdebe57b40 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:28.186766 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1819/3583] 10.222.0.16 () {58 vars in 1277 bytes} [Sat Jul 16 21:19:27 2022] DELETE /identity/v3/domains/eb5be2d5b6d24f3ea212fadb5e722b61/config/identity => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:28.190899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eb7f0-c523-41ec-b53d-d9f416aa2515 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:28.196584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47304c-59a5-4c9a-8185-25cdebe57b40 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:28.202658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e21a4-d72e-44b7-98d7-3a8932c3c3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:28.203687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e21a4-d72e-44b7-98d7-3a8932c3c3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:28.204041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e21a4-d72e-44b7-98d7-3a8932c3c3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:28.204481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e21a4-d72e-44b7-98d7-3a8932c3c3c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:28.205489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e21a4-d72e-44b7-98d7-3a8932c3c3c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:19:28.205899 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e21a4-d72e-44b7-98d7-3a8932c3c3c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:28.208187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e21a4-d72e-44b7-98d7-3a8932c3c3c6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:28.209585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eb7f0-c523-41ec-b53d-d9f416aa2515 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:28.223304 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1765/3584] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:19:28.228506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d97eb-d240-4d66-be1a-a18cce870606 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:28.229525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d97eb-d240-4d66-be1a-a18cce870606 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:28.229814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d97eb-d240-4d66-be1a-a18cce870606 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:28.230119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d97eb-d240-4d66-be1a-a18cce870606 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/eb5be2d5b6d24f3ea212fadb5e722b61/config/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:28.230725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e21a4-d72e-44b7-98d7-3a8932c3c3c6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:28.234377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d97eb-d240-4d66-be1a-a18cce870606 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=eb5be2d5b6d24f3ea212fadb5e722b61, group=identity)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:28.239081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d97eb-d240-4d66-be1a-a18cce870606 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:28.244318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e21a4-d72e-44b7-98d7-3a8932c3c3c6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:28.256119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f6ebf-ab39-4b0f-af58-b5c420ce5f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:28.256119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f6ebf-ab39-4b0f-af58-b5c420ce5f51 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:28.256119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f6ebf-ab39-4b0f-af58-b5c420ce5f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:28.256119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f6ebf-ab39-4b0f-af58-b5c420ce5f51 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:28.256616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f6ebf-ab39-4b0f-af58-b5c420ce5f51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:28.256616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f6ebf-ab39-4b0f-af58-b5c420ce5f51 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:28.269835 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-5a4d97eb-d240-4d66-be1a-a18cce870606 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Could not find group identity in domain configuration for domain eb5be2d5b6d24f3ea212fadb5e722b61.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain eb5be2d5b6d24f3ea212fadb5e722b61. Jul 16 21:19:28.269835 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:19:28.269835 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:19:28.269835 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:19:28.269835 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:19:28.269835 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:19:28.269835 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:19:28.269835 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:19:28.269835 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:19:28.269835 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:19:28.269835 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:19:28.269835 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:19:28.269835 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 16 21:19:28.270833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 16 21:19:28.270833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 16 21:19:28.270833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 16 21:19:28.270833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:19:28.270833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:19:28.270833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 16 21:19:28.270833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 16 21:19:28.270833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain eb5be2d5b6d24f3ea212fadb5e722b61. Jul 16 21:19:28.270833 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:19:28.278784 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1820/3585] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Jul 16 21:19:28 2022] GET /identity/v3/domains/eb5be2d5b6d24f3ea212fadb5e722b61/config/identity => generated 154 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 16 21:19:28.280759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d97eb-d240-4d66-be1a-a18cce870606 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:28.300241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d97eb-d240-4d66-be1a-a18cce870606 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:28.308676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066d872-4284-4285-a253-9383443de7c8 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:28.310039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066d872-4284-4285-a253-9383443de7c8 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:28.310532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066d872-4284-4285-a253-9383443de7c8 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:28.311100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066d872-4284-4285-a253-9383443de7c8 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/eb5be2d5b6d24f3ea212fadb5e722b61/config` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:28.317474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066d872-4284-4285-a253-9383443de7c8 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=eb5be2d5b6d24f3ea212fadb5e722b61)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:28.317474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066d872-4284-4285-a253-9383443de7c8 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:28.353048 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1766/3586] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:19:28 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:28.353048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f6ebf-ab39-4b0f-af58-b5c420ce5f51 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:28.355756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-386f6ebf-ab39-4b0f-af58-b5c420ce5f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:28.401426 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1821/3587] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jul 16 21:19:28 2022] DELETE /identity/v3/domains/eb5be2d5b6d24f3ea212fadb5e722b61/config => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:28.405371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066d872-4284-4285-a253-9383443de7c8 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:28.421701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066d872-4284-4285-a253-9383443de7c8 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:28.493434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f6ebf-ab39-4b0f-af58-b5c420ce5f51 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:28.508448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d99ea2-9a34-44ad-a773-21eed677d945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:28.513959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d99ea2-9a34-44ad-a773-21eed677d945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:28.514259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d99ea2-9a34-44ad-a773-21eed677d945 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:28.514631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d99ea2-9a34-44ad-a773-21eed677d945 admin admin] PATH_INFO: `/v3/users/687b97cda0f644ec9c95e7e53237f4a9` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:28.516506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d99ea2-9a34-44ad-a773-21eed677d945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=687b97cda0f644ec9c95e7e53237f4a9)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:28.519914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d99ea2-9a34-44ad-a773-21eed677d945 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:28.563323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e16b40-e78b-457c-9323-c4a5599dce0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:28.563702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e16b40-e78b-457c-9323-c4a5599dce0a admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:28.564026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e16b40-e78b-457c-9323-c4a5599dce0a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:28.564484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e16b40-e78b-457c-9323-c4a5599dce0a admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:28.565179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e16b40-e78b-457c-9323-c4a5599dce0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:28.568108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e16b40-e78b-457c-9323-c4a5599dce0a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:28.800735 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1822/3588] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:19:28 2022] POST /identity/v3/users => generated 288 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:28.801299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e16b40-e78b-457c-9323-c4a5599dce0a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:28.857283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-27d99ea2-9a34-44ad-a773-21eed677d945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '687b97cda0f644ec9c95e7e53237f4a9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:28.883336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-27d99ea2-9a34-44ad-a773-21eed677d945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '687b97cda0f644ec9c95e7e53237f4a9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:28.951894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e16b40-e78b-457c-9323-c4a5599dce0a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:28.961013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-27d99ea2-9a34-44ad-a773-21eed677d945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '687b97cda0f644ec9c95e7e53237f4a9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:28.965883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15899a5a-d8ee-4077-9c95-b222eb0afffe tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:28.966877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15899a5a-d8ee-4077-9c95-b222eb0afffe tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:28.973409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15899a5a-d8ee-4077-9c95-b222eb0afffe tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:28.973409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15899a5a-d8ee-4077-9c95-b222eb0afffe tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/eb5be2d5b6d24f3ea212fadb5e722b61` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:28.973660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-27d99ea2-9a34-44ad-a773-21eed677d945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '687b97cda0f644ec9c95e7e53237f4a9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:28.973781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15899a5a-d8ee-4077-9c95-b222eb0afffe tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=eb5be2d5b6d24f3ea212fadb5e722b61)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:28.973781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15899a5a-d8ee-4077-9c95-b222eb0afffe tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:28.975510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-27d99ea2-9a34-44ad-a773-21eed677d945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '687b97cda0f644ec9c95e7e53237f4a9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:28.987681 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1767/3589] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:19:28 2022] DELETE /identity/v3/users/687b97cda0f644ec9c95e7e53237f4a9 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:28.988774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d99ea2-9a34-44ad-a773-21eed677d945 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:28.991643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-27d99ea2-9a34-44ad-a773-21eed677d945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:28.999685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-15899a5a-d8ee-4077-9c95-b222eb0afffe tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'eb5be2d5b6d24f3ea212fadb5e722b61'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:29.002476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-15899a5a-d8ee-4077-9c95-b222eb0afffe tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'eb5be2d5b6d24f3ea212fadb5e722b61'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:29.080992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=83,keystone:DELETE=12,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:29.090402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d99ea2-9a34-44ad-a773-21eed677d945 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:29.151929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-15899a5a-d8ee-4077-9c95-b222eb0afffe tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'eb5be2d5b6d24f3ea212fadb5e722b61'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:29.152876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-15899a5a-d8ee-4077-9c95-b222eb0afffe tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'eb5be2d5b6d24f3ea212fadb5e722b61'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:29.158584 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1823/3590] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:19:28 2022] PATCH /identity/v3/domains/eb5be2d5b6d24f3ea212fadb5e722b61 => generated 277 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:19:29.158584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786a08d-7a1e-4d26-a985-a13674269f60 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:29.158584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786a08d-7a1e-4d26-a985-a13674269f60 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:29.158584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786a08d-7a1e-4d26-a985-a13674269f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:29.178881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f786a08d-7a1e-4d26-a985-a13674269f60 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:29.181010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f786a08d-7a1e-4d26-a985-a13674269f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:29.201342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef570df0-090f-4036-b574-1295fe3594aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:29.201854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef570df0-090f-4036-b574-1295fe3594aa admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:29.201854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef570df0-090f-4036-b574-1295fe3594aa admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:29.202049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef570df0-090f-4036-b574-1295fe3594aa admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:29.202724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef570df0-090f-4036-b574-1295fe3594aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:29.204424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef570df0-090f-4036-b574-1295fe3594aa admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:29.220525 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1768/3591] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:29.221837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef570df0-090f-4036-b574-1295fe3594aa admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:29.225096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ef570df0-090f-4036-b574-1295fe3594aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:29.263952 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1824/3592] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:29.263952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786a08d-7a1e-4d26-a985-a13674269f60 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:29.263952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f786a08d-7a1e-4d26-a985-a13674269f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:29.278020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786a08d-7a1e-4d26-a985-a13674269f60 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:29.282671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97f5db-0d56-4a61-a8f7-9991da78a817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:29.283373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97f5db-0d56-4a61-a8f7-9991da78a817 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:29.283638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97f5db-0d56-4a61-a8f7-9991da78a817 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:29.283922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97f5db-0d56-4a61-a8f7-9991da78a817 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:29.284650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97f5db-0d56-4a61-a8f7-9991da78a817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:29.286409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97f5db-0d56-4a61-a8f7-9991da78a817 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:29.302664 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1825/3593] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:29.303657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97f5db-0d56-4a61-a8f7-9991da78a817 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:29.306353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-de97f5db-0d56-4a61-a8f7-9991da78a817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:29.327059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef570df0-090f-4036-b574-1295fe3594aa admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:29.334174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215e189-74e2-4d85-b6f3-e5972833ee79 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:29.335491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215e189-74e2-4d85-b6f3-e5972833ee79 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:29.336511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215e189-74e2-4d85-b6f3-e5972833ee79 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:29.347557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215e189-74e2-4d85-b6f3-e5972833ee79 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/eb5be2d5b6d24f3ea212fadb5e722b61` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:29.362200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215e189-74e2-4d85-b6f3-e5972833ee79 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=eb5be2d5b6d24f3ea212fadb5e722b61)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:29.364695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215e189-74e2-4d85-b6f3-e5972833ee79 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:29.380067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97f5db-0d56-4a61-a8f7-9991da78a817 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:29.384166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648c24a-a327-4856-9f8f-daa3e4578032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:29.384854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648c24a-a327-4856-9f8f-daa3e4578032 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:29.385139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648c24a-a327-4856-9f8f-daa3e4578032 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:29.385414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648c24a-a327-4856-9f8f-daa3e4578032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:29.392176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e215e189-74e2-4d85-b6f3-e5972833ee79 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'eb5be2d5b6d24f3ea212fadb5e722b61'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:29.396280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648c24a-a327-4856-9f8f-daa3e4578032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:29.398021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648c24a-a327-4856-9f8f-daa3e4578032 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:29.406173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e215e189-74e2-4d85-b6f3-e5972833ee79 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'eb5be2d5b6d24f3ea212fadb5e722b61'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:29.409567 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1826/3594] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:19:29.410430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648c24a-a327-4856-9f8f-daa3e4578032 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:29.415842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f648c24a-a327-4856-9f8f-daa3e4578032 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:29.439263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648c24a-a327-4856-9f8f-daa3e4578032 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:29.446998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b67e7-8647-4256-bb51-7f33497bf83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:29.447956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b67e7-8647-4256-bb51-7f33497bf83d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:29.448248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b67e7-8647-4256-bb51-7f33497bf83d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:29.448529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b67e7-8647-4256-bb51-7f33497bf83d admin admin] PATH_INFO: `/v3/users/7ea30eb37fbf469194845261a19e8d4f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:29.450000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b67e7-8647-4256-bb51-7f33497bf83d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea30eb37fbf469194845261a19e8d4f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:29.456565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b67e7-8647-4256-bb51-7f33497bf83d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:29.559036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e215e189-74e2-4d85-b6f3-e5972833ee79 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb5be2d5b6d24f3ea212fadb5e722b61', 'request_id': 'req-e215e189-74e2-4d85-b6f3-e5972833ee79'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:29.564692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e215e189-74e2-4d85-b6f3-e5972833ee79 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb5be2d5b6d24f3ea212fadb5e722b61', 'request_id': 'req-e215e189-74e2-4d85-b6f3-e5972833ee79'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:29.571536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e215e189-74e2-4d85-b6f3-e5972833ee79 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb5be2d5b6d24f3ea212fadb5e722b61', 'request_id': 'req-e215e189-74e2-4d85-b6f3-e5972833ee79'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:29.723285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e215e189-74e2-4d85-b6f3-e5972833ee79 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] The token cache is being invalidate because project eb5be2d5b6d24f3ea212fadb5e722b61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:19:29.723815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e215e189-74e2-4d85-b6f3-e5972833ee79 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:29.724513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e215e189-74e2-4d85-b6f3-e5972833ee79 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:29.734802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e215e189-74e2-4d85-b6f3-e5972833ee79 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'eb5be2d5b6d24f3ea212fadb5e722b61', 'request_id': 'req-e215e189-74e2-4d85-b6f3-e5972833ee79'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:29.735532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e215e189-74e2-4d85-b6f3-e5972833ee79 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'eb5be2d5b6d24f3ea212fadb5e722b61', 'request_id': 'req-e215e189-74e2-4d85-b6f3-e5972833ee79'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:29.736977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e215e189-74e2-4d85-b6f3-e5972833ee79 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'eb5be2d5b6d24f3ea212fadb5e722b61', 'request_id': 'req-e215e189-74e2-4d85-b6f3-e5972833ee79'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:29.746384 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1769/3595] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:19:29 2022] DELETE /identity/v3/domains/eb5be2d5b6d24f3ea212fadb5e722b61 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:29.747198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215e189-74e2-4d85-b6f3-e5972833ee79 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:29.750373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e215e189-74e2-4d85-b6f3-e5972833ee79 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:29.816796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215e189-74e2-4d85-b6f3-e5972833ee79 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:29.823029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31bf81-18ae-4235-9356-9c4f81d07ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:29.824053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31bf81-18ae-4235-9356-9c4f81d07ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:29.824334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31bf81-18ae-4235-9356-9c4f81d07ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:29.824603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31bf81-18ae-4235-9356-9c4f81d07ca8 admin admin] PATH_INFO: `/v3/projects/772bd01188344e288824730238fee49b/users/fe680ccdc60e410b812794de8aa73e0f/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:29.828777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa5b67e7-8647-4256-bb51-7f33497bf83d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea30eb37fbf469194845261a19e8d4f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:29.837666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa5b67e7-8647-4256-bb51-7f33497bf83d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea30eb37fbf469194845261a19e8d4f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:29.845428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31bf81-18ae-4235-9356-9c4f81d07ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=772bd01188344e288824730238fee49b, user_id=fe680ccdc60e410b812794de8aa73e0f, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:29.849743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31bf81-18ae-4235-9356-9c4f81d07ca8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:29.940031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa5b67e7-8647-4256-bb51-7f33497bf83d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea30eb37fbf469194845261a19e8d4f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:29.940477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa5b67e7-8647-4256-bb51-7f33497bf83d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea30eb37fbf469194845261a19e8d4f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:29.953528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa5b67e7-8647-4256-bb51-7f33497bf83d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea30eb37fbf469194845261a19e8d4f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:29.959674 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1827/3596] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:19:29 2022] DELETE /identity/v3/users/7ea30eb37fbf469194845261a19e8d4f => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:29.961125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b67e7-8647-4256-bb51-7f33497bf83d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:29.962479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-aa5b67e7-8647-4256-bb51-7f33497bf83d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:29.986000 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1770/3597] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:19:29 2022] PUT /identity/v3/projects/772bd01188344e288824730238fee49b/users/fe680ccdc60e410b812794de8aa73e0f/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:29.987448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cd679-fd11-4cb1-8d51-a66df8a6b6a3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:29.992799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cd679-fd11-4cb1-8d51-a66df8a6b6a3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:29.993460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cd679-fd11-4cb1-8d51-a66df8a6b6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:30.018686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-088cd679-fd11-4cb1-8d51-a66df8a6b6a3 None None] MFA Rules not processed for user `eebb224a56814f92b12ebebebc6bc8a3`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:30.020256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-088cd679-fd11-4cb1-8d51-a66df8a6b6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:30.093116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b67e7-8647-4256-bb51-7f33497bf83d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:30.156717 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1771/3598] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:30.159303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf9628-dc2f-4640-9378-787511353490 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:30.159773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf9628-dc2f-4640-9378-787511353490 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:30.171452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db96a74-1f4b-4373-9eea-f54904fcc6af tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:30.174394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db96a74-1f4b-4373-9eea-f54904fcc6af tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:30.174794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db96a74-1f4b-4373-9eea-f54904fcc6af tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:30.175621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db96a74-1f4b-4373-9eea-f54904fcc6af tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:30.175951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db96a74-1f4b-4373-9eea-f54904fcc6af tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:30.176306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf9628-dc2f-4640-9378-787511353490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:30.177443 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-0db96a74-1f4b-4373-9eea-f54904fcc6af tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:30.177443 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:19:30.177443 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:19:30.182349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db96a74-1f4b-4373-9eea-f54904fcc6af tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:30.191343 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1828/3599] 10.222.0.16 () {58 vars in 1172 bytes} [Sat Jul 16 21:19:29 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:30.195368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db96a74-1f4b-4373-9eea-f54904fcc6af tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:30.198267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0db96a74-1f4b-4373-9eea-f54904fcc6af tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:30.231321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9baf9628-dc2f-4640-9378-787511353490 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:30.232137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9baf9628-dc2f-4640-9378-787511353490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:30.356001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db96a74-1f4b-4373-9eea-f54904fcc6af tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:30.367809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0b566-2ea7-4328-9fca-715a9bd3523e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:30.368926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0b566-2ea7-4328-9fca-715a9bd3523e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:30.369207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0b566-2ea7-4328-9fca-715a9bd3523e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:30.369481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0b566-2ea7-4328-9fca-715a9bd3523e admin admin] PATH_INFO: `/v3/projects/924d77495f2c4d0bad9e19a2b875063a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:30.379901 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1772/3600] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:30.379901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf9628-dc2f-4640-9378-787511353490 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:30.385599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0b566-2ea7-4328-9fca-715a9bd3523e admin admin] RBAC: Authorizing `identity:delete_project(project_id=924d77495f2c4d0bad9e19a2b875063a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:30.387716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0b566-2ea7-4328-9fca-715a9bd3523e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:30.391177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf9628-dc2f-4640-9378-787511353490 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:30.397208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8339903-d317-446d-b7cf-b2b0a52f6528 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:30.405211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8339903-d317-446d-b7cf-b2b0a52f6528 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:30.409634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8339903-d317-446d-b7cf-b2b0a52f6528 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:30.409634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8339903-d317-446d-b7cf-b2b0a52f6528 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:30.409634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8339903-d317-446d-b7cf-b2b0a52f6528 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:30.409634 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-d8339903-d317-446d-b7cf-b2b0a52f6528 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:30.409634 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:19:30.409634 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:19:30.410090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8339903-d317-446d-b7cf-b2b0a52f6528 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:30.414335 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1773/3601] 10.222.0.16 () {58 vars in 1199 bytes} [Sat Jul 16 21:19:30 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:30.415634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8339903-d317-446d-b7cf-b2b0a52f6528 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:30.417560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d8339903-d317-446d-b7cf-b2b0a52f6528 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:30.529385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8339903-d317-446d-b7cf-b2b0a52f6528 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:30.533681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6deb46-8ec7-4adc-97fc-a8e685113cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:30.534166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6deb46-8ec7-4adc-97fc-a8e685113cdd service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:30.534452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6deb46-8ec7-4adc-97fc-a8e685113cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:30.535089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6deb46-8ec7-4adc-97fc-a8e685113cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:30.547276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6deb46-8ec7-4adc-97fc-a8e685113cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:30.548848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6deb46-8ec7-4adc-97fc-a8e685113cdd service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:30.561590 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1774/3602] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:19:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:19:30.562696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6deb46-8ec7-4adc-97fc-a8e685113cdd service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:30.570571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:30.577175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6deb46-8ec7-4adc-97fc-a8e685113cdd service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:30.603762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-13c0b566-2ea7-4328-9fca-715a9bd3523e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '924d77495f2c4d0bad9e19a2b875063a', 'request_id': 'req-13c0b566-2ea7-4328-9fca-715a9bd3523e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:30.621860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-13c0b566-2ea7-4328-9fca-715a9bd3523e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '924d77495f2c4d0bad9e19a2b875063a', 'request_id': 'req-13c0b566-2ea7-4328-9fca-715a9bd3523e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:30.634372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-13c0b566-2ea7-4328-9fca-715a9bd3523e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '924d77495f2c4d0bad9e19a2b875063a', 'request_id': 'req-13c0b566-2ea7-4328-9fca-715a9bd3523e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:30.670000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e1281-e26d-4446-b567-9fd687fa0785 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:30.670789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e1281-e26d-4446-b567-9fd687fa0785 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:30.671148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e1281-e26d-4446-b567-9fd687fa0785 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:30.671438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e1281-e26d-4446-b567-9fd687fa0785 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:30.672094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e1281-e26d-4446-b567-9fd687fa0785 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:30.673722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e1281-e26d-4446-b567-9fd687fa0785 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:30.677816 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1775/3603] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Jul 16 21:19:30 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:30.677816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e1281-e26d-4446-b567-9fd687fa0785 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:30.677816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-de2e1281-e26d-4446-b567-9fd687fa0785 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:30.762891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e1281-e26d-4446-b567-9fd687fa0785 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:30.775927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f364d8-750c-43d1-9fb5-aa7f7c96b3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:30.776298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-13c0b566-2ea7-4328-9fca-715a9bd3523e admin admin] The token cache is being invalidate because project 924d77495f2c4d0bad9e19a2b875063a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:19:30.776783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-13c0b566-2ea7-4328-9fca-715a9bd3523e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:30.777462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-13c0b566-2ea7-4328-9fca-715a9bd3523e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:30.777703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f364d8-750c-43d1-9fb5-aa7f7c96b3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:30.778000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f364d8-750c-43d1-9fb5-aa7f7c96b3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:30.778286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f364d8-750c-43d1-9fb5-aa7f7c96b3e1 admin admin] PATH_INFO: `/v3/projects/89b4d12252b94d54b50cc15238af6c2f` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:30.779609 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1829/3604] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:19:30 2022] DELETE /identity/v3/projects/924d77495f2c4d0bad9e19a2b875063a => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:30.780554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0b566-2ea7-4328-9fca-715a9bd3523e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:30.781927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-13c0b566-2ea7-4328-9fca-715a9bd3523e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:30.786723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f364d8-750c-43d1-9fb5-aa7f7c96b3e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89b4d12252b94d54b50cc15238af6c2f)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:30.789414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f364d8-750c-43d1-9fb5-aa7f7c96b3e1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:30.801649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0b566-2ea7-4328-9fca-715a9bd3523e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:30.808055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a6793-b96b-4dbb-b2e7-1c5a74ca658e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:30.809137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a6793-b96b-4dbb-b2e7-1c5a74ca658e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:30.809425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a6793-b96b-4dbb-b2e7-1c5a74ca658e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:30.809709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a6793-b96b-4dbb-b2e7-1c5a74ca658e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:30.811628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a6793-b96b-4dbb-b2e7-1c5a74ca658e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:30.813262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a6793-b96b-4dbb-b2e7-1c5a74ca658e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:30.815081 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1830/3605] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:19:30 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:30.816373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf83b27-e021-4522-ac11-6e88c39c7d6f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:30.817044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf83b27-e021-4522-ac11-6e88c39c7d6f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:30.817330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf83b27-e021-4522-ac11-6e88c39c7d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:30.846654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-faf83b27-e021-4522-ac11-6e88c39c7d6f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:30.847938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-faf83b27-e021-4522-ac11-6e88c39c7d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:30.859464 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1831/3606] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:30.860739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf83b27-e021-4522-ac11-6e88c39c7d6f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:30.889926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf83b27-e021-4522-ac11-6e88c39c7d6f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:30.896323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8ae50-d5e4-4981-81d1-24fb10ea89d0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:30.897979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8ae50-d5e4-4981-81d1-24fb10ea89d0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:30.898650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8ae50-d5e4-4981-81d1-24fb10ea89d0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:30.899261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8ae50-d5e4-4981-81d1-24fb10ea89d0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:30.901002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8ae50-d5e4-4981-81d1-24fb10ea89d0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:30.902989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8ae50-d5e4-4981-81d1-24fb10ea89d0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:30.910615 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1832/3607] 10.222.0.16 () {58 vars in 1187 bytes} [Sat Jul 16 21:19:30 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:30.910615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef401af0-0482-4eff-b640-1d217f588ea9 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:30.910615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef401af0-0482-4eff-b640-1d217f588ea9 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:30.910615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef401af0-0482-4eff-b640-1d217f588ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:30.932741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ef401af0-0482-4eff-b640-1d217f588ea9 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:30.934661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ef401af0-0482-4eff-b640-1d217f588ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:30.955323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-47f364d8-750c-43d1-9fb5-aa7f7c96b3e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89b4d12252b94d54b50cc15238af6c2f', 'request_id': 'req-47f364d8-750c-43d1-9fb5-aa7f7c96b3e1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:30.964382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-47f364d8-750c-43d1-9fb5-aa7f7c96b3e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89b4d12252b94d54b50cc15238af6c2f', 'request_id': 'req-47f364d8-750c-43d1-9fb5-aa7f7c96b3e1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:30.974564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-47f364d8-750c-43d1-9fb5-aa7f7c96b3e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89b4d12252b94d54b50cc15238af6c2f', 'request_id': 'req-47f364d8-750c-43d1-9fb5-aa7f7c96b3e1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:31.020180 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1833/3608] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:31.023140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef401af0-0482-4eff-b640-1d217f588ea9 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:31.095900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef401af0-0482-4eff-b640-1d217f588ea9 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:31.101443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337dd8f-a12f-4179-a710-7ee23139724b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:31.102991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337dd8f-a12f-4179-a710-7ee23139724b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:31.102991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337dd8f-a12f-4179-a710-7ee23139724b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:31.103222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337dd8f-a12f-4179-a710-7ee23139724b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:31.103727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337dd8f-a12f-4179-a710-7ee23139724b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:31.105362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337dd8f-a12f-4179-a710-7ee23139724b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:31.109850 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1834/3609] 10.222.0.16 () {58 vars in 1199 bytes} [Sat Jul 16 21:19:31 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:31.110771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337dd8f-a12f-4179-a710-7ee23139724b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:31.126743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-47f364d8-750c-43d1-9fb5-aa7f7c96b3e1 admin admin] The token cache is being invalidate because project 89b4d12252b94d54b50cc15238af6c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:19:31.127519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-47f364d8-750c-43d1-9fb5-aa7f7c96b3e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:31.128579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-47f364d8-750c-43d1-9fb5-aa7f7c96b3e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:31.131218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337dd8f-a12f-4179-a710-7ee23139724b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:31.132912 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1776/3610] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:19:30 2022] DELETE /identity/v3/projects/89b4d12252b94d54b50cc15238af6c2f => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:31.134083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f364d8-750c-43d1-9fb5-aa7f7c96b3e1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:31.138409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-47f364d8-750c-43d1-9fb5-aa7f7c96b3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:31.140911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16b649-36f2-4521-9403-e0d4257df864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:31.141678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16b649-36f2-4521-9403-e0d4257df864 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:31.142220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16b649-36f2-4521-9403-e0d4257df864 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:31.142561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16b649-36f2-4521-9403-e0d4257df864 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:31.143330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16b649-36f2-4521-9403-e0d4257df864 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:19:31.143647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16b649-36f2-4521-9403-e0d4257df864 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:31.146355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16b649-36f2-4521-9403-e0d4257df864 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:31.165863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f364d8-750c-43d1-9fb5-aa7f7c96b3e1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:31.171191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc379eb-f226-4942-9ca8-d9d222143b28 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:31.171765 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1835/3611] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:19:31.173319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d2c7b-eee7-4f79-b882-947c129def97 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:31.173617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d2c7b-eee7-4f79-b882-947c129def97 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:31.173901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d2c7b-eee7-4f79-b882-947c129def97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:31.177492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc379eb-f226-4942-9ca8-d9d222143b28 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:31.178245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc379eb-f226-4942-9ca8-d9d222143b28 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:31.178245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc379eb-f226-4942-9ca8-d9d222143b28 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:31.179696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc379eb-f226-4942-9ca8-d9d222143b28 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:31.181426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc379eb-f226-4942-9ca8-d9d222143b28 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:31.183415 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1777/3612] 10.222.0.16 () {58 vars in 1202 bytes} [Sat Jul 16 21:19:31 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:31.184302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc379eb-f226-4942-9ca8-d9d222143b28 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:31.187282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2bc379eb-f226-4942-9ca8-d9d222143b28 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:31.201357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e74d2c7b-eee7-4f79-b882-947c129def97 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:31.203804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e74d2c7b-eee7-4f79-b882-947c129def97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:31.211892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc379eb-f226-4942-9ca8-d9d222143b28 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:31.221748 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1836/3613] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:31.221748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d2c7b-eee7-4f79-b882-947c129def97 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:31.225030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bf92b-97c6-472f-abd8-84412f038d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:31.226008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bf92b-97c6-472f-abd8-84412f038d02 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:31.226506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bf92b-97c6-472f-abd8-84412f038d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:31.226880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bf92b-97c6-472f-abd8-84412f038d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:31.228216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bf92b-97c6-472f-abd8-84412f038d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:31.230229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bf92b-97c6-472f-abd8-84412f038d02 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:31.241919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d2c7b-eee7-4f79-b882-947c129def97 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:31.248324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b5e42-1cbb-465f-9890-6ee0a7adebdb tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:31.249858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b5e42-1cbb-465f-9890-6ee0a7adebdb tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:31.250430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b5e42-1cbb-465f-9890-6ee0a7adebdb tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:31.250863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b5e42-1cbb-465f-9890-6ee0a7adebdb tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:31.251786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b5e42-1cbb-465f-9890-6ee0a7adebdb tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:31.255229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b5e42-1cbb-465f-9890-6ee0a7adebdb tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:31.256939 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1837/3614] 10.222.0.16 () {58 vars in 1208 bytes} [Sat Jul 16 21:19:31 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:31.259047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c805761-f6f1-44c8-b52a-46f9a7a28a7c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:31.259343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c805761-f6f1-44c8-b52a-46f9a7a28a7c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:31.259948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c805761-f6f1-44c8-b52a-46f9a7a28a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:31.282145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3c805761-f6f1-44c8-b52a-46f9a7a28a7c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:31.283414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3c805761-f6f1-44c8-b52a-46f9a7a28a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:31.293897 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1838/3615] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:31.298392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c805761-f6f1-44c8-b52a-46f9a7a28a7c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:31.310385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c805761-f6f1-44c8-b52a-46f9a7a28a7c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:31.315566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262f401-b1a0-4cce-b345-9455b564acbc tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:31.316615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262f401-b1a0-4cce-b345-9455b564acbc tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:31.316990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262f401-b1a0-4cce-b345-9455b564acbc tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:31.317182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262f401-b1a0-4cce-b345-9455b564acbc tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:31.318207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262f401-b1a0-4cce-b345-9455b564acbc tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:31.320433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262f401-b1a0-4cce-b345-9455b564acbc tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:31.321989 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1839/3616] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:19:31 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:31.324296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262f401-b1a0-4cce-b345-9455b564acbc tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:31.338016 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1778/3617] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:19:31 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:31.338614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262f401-b1a0-4cce-b345-9455b564acbc tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:31.340390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bf92b-97c6-472f-abd8-84412f038d02 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:31.434341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c90af-99f0-45b1-9cdf-bfac2cbdeb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:31.435327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c90af-99f0-45b1-9cdf-bfac2cbdeb49 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:31.435852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c90af-99f0-45b1-9cdf-bfac2cbdeb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:31.436425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c90af-99f0-45b1-9cdf-bfac2cbdeb49 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:31.437718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c90af-99f0-45b1-9cdf-bfac2cbdeb49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:19:31.438187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c90af-99f0-45b1-9cdf-bfac2cbdeb49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:31.441624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c90af-99f0-45b1-9cdf-bfac2cbdeb49 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:31.461770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bf92b-97c6-472f-abd8-84412f038d02 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:31.469051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac1f6c-1c4a-4f63-b3a0-f4ac6fe8aa34 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:31.469954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac1f6c-1c4a-4f63-b3a0-f4ac6fe8aa34 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:31.470332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac1f6c-1c4a-4f63-b3a0-f4ac6fe8aa34 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:31.471289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac1f6c-1c4a-4f63-b3a0-f4ac6fe8aa34 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:31.472058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac1f6c-1c4a-4f63-b3a0-f4ac6fe8aa34 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:31.481864 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1840/3618] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:19:31.482272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac1f6c-1c4a-4f63-b3a0-f4ac6fe8aa34 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:31.487283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c90af-99f0-45b1-9cdf-bfac2cbdeb49 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:31.487455 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1779/3619] 10.222.0.16 () {58 vars in 1217 bytes} [Sat Jul 16 21:19:31 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:31.487455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac1f6c-1c4a-4f63-b3a0-f4ac6fe8aa34 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:31.499827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac1f6c-1c4a-4f63-b3a0-f4ac6fe8aa34 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:31.506227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee6cc4-6619-43eb-af64-ebb063f0ad74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:31.507625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee6cc4-6619-43eb-af64-ebb063f0ad74 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:31.508357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee6cc4-6619-43eb-af64-ebb063f0ad74 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:31.508357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee6cc4-6619-43eb-af64-ebb063f0ad74 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:31.508992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c90af-99f0-45b1-9cdf-bfac2cbdeb49 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:31.509233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee6cc4-6619-43eb-af64-ebb063f0ad74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:31.511270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee6cc4-6619-43eb-af64-ebb063f0ad74 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:31.523160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e2028-32f0-40c6-93be-ca4fb9c2042c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:31.523888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e2028-32f0-40c6-93be-ca4fb9c2042c admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:31.524178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e2028-32f0-40c6-93be-ca4fb9c2042c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:31.524455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e2028-32f0-40c6-93be-ca4fb9c2042c admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:31.526983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e2028-32f0-40c6-93be-ca4fb9c2042c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:31.534129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e2028-32f0-40c6-93be-ca4fb9c2042c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:31.699991 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1841/3620] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:19:31 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:31.702458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e2028-32f0-40c6-93be-ca4fb9c2042c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:31.710397 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1780/3621] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:19:31 2022] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:31.714152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee6cc4-6619-43eb-af64-ebb063f0ad74 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:31.728670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e2028-32f0-40c6-93be-ca4fb9c2042c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:31.838195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee6cc4-6619-43eb-af64-ebb063f0ad74 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:31.856950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f2f48-4b88-4381-8c1a-bee211cbc89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:31.856950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f2f48-4b88-4381-8c1a-bee211cbc89b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:31.856950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f2f48-4b88-4381-8c1a-bee211cbc89b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:31.857475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f2f48-4b88-4381-8c1a-bee211cbc89b admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:31.857870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f2f48-4b88-4381-8c1a-bee211cbc89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:31.866478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f2f48-4b88-4381-8c1a-bee211cbc89b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:31.883677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff6783-eb61-46ad-9452-758309e2c912 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:31.884468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff6783-eb61-46ad-9452-758309e2c912 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:31.884759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff6783-eb61-46ad-9452-758309e2c912 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:31.885088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff6783-eb61-46ad-9452-758309e2c912 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:31.885758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff6783-eb61-46ad-9452-758309e2c912 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:31.891279 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1781/3622] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:31.891279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f2f48-4b88-4381-8c1a-bee211cbc89b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:31.907633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff6783-eb61-46ad-9452-758309e2c912 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:31.921433 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1842/3623] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Jul 16 21:19:31 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:31.921433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff6783-eb61-46ad-9452-758309e2c912 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:31.924573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f2f48-4b88-4381-8c1a-bee211cbc89b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:31.937783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed3e36-93c0-4a92-b265-e19ee349feb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:31.938469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed3e36-93c0-4a92-b265-e19ee349feb8 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:31.938751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed3e36-93c0-4a92-b265-e19ee349feb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:31.939082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed3e36-93c0-4a92-b265-e19ee349feb8 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:31.940379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed3e36-93c0-4a92-b265-e19ee349feb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:31.944907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed3e36-93c0-4a92-b265-e19ee349feb8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:31.957413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff6783-eb61-46ad-9452-758309e2c912 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:31.996734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd219f-6e5d-46db-9d7f-79c40c81abfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:31.997522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd219f-6e5d-46db-9d7f-79c40c81abfc admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:31.997813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd219f-6e5d-46db-9d7f-79c40c81abfc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:31.998151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd219f-6e5d-46db-9d7f-79c40c81abfc admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:31.998818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd219f-6e5d-46db-9d7f-79c40c81abfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:32.000488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd219f-6e5d-46db-9d7f-79c40c81abfc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:32.042605 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1843/3624] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:32.043661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd219f-6e5d-46db-9d7f-79c40c81abfc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:32.070933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd219f-6e5d-46db-9d7f-79c40c81abfc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:32.080366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb85eac-f1f9-4abf-9f26-592e40fa150c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:32.081374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb85eac-f1f9-4abf-9f26-592e40fa150c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:32.081741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb85eac-f1f9-4abf-9f26-592e40fa150c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:32.082092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb85eac-f1f9-4abf-9f26-592e40fa150c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:32.082979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb85eac-f1f9-4abf-9f26-592e40fa150c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:32.087798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb85eac-f1f9-4abf-9f26-592e40fa150c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:32.091046 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1844/3625] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:19:32 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:32.092013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb85eac-f1f9-4abf-9f26-592e40fa150c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:32.106152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb85eac-f1f9-4abf-9f26-592e40fa150c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:32.115974 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1782/3626] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:19:31 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:32.115974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed3e36-93c0-4a92-b265-e19ee349feb8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:32.116216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab86f4-a5ae-4525-9f61-cbc379c44312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:32.116216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab86f4-a5ae-4525-9f61-cbc379c44312 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:32.116216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab86f4-a5ae-4525-9f61-cbc379c44312 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:32.116216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab86f4-a5ae-4525-9f61-cbc379c44312 admin admin] PATH_INFO: `/v3/projects/0be222897b3a4864a39e9fc7d481340a/users/1f72b1e0b4124480bfd53b5c22a343e0/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:32.137436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed3e36-93c0-4a92-b265-e19ee349feb8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:32.151038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc78bd8-07a9-4eb1-83ac-1119dbaf411c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:32.151780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc78bd8-07a9-4eb1-83ac-1119dbaf411c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:32.152065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc78bd8-07a9-4eb1-83ac-1119dbaf411c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:32.152621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc78bd8-07a9-4eb1-83ac-1119dbaf411c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:32.153337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc78bd8-07a9-4eb1-83ac-1119dbaf411c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:32.154959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc78bd8-07a9-4eb1-83ac-1119dbaf411c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:32.160934 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1783/3627] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jul 16 21:19:32 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:32.163449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc78bd8-07a9-4eb1-83ac-1119dbaf411c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:32.183718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab86f4-a5ae-4525-9f61-cbc379c44312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be222897b3a4864a39e9fc7d481340a, user_id=1f72b1e0b4124480bfd53b5c22a343e0, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:32.192024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc78bd8-07a9-4eb1-83ac-1119dbaf411c tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:32.193563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab86f4-a5ae-4525-9f61-cbc379c44312 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:32.209897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76152f48-6c83-4c8c-9d98-3d1a872dbdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:32.209897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76152f48-6c83-4c8c-9d98-3d1a872dbdbc admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:32.209897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76152f48-6c83-4c8c-9d98-3d1a872dbdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:32.209897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76152f48-6c83-4c8c-9d98-3d1a872dbdbc admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:32.210861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76152f48-6c83-4c8c-9d98-3d1a872dbdbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:32.215873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76152f48-6c83-4c8c-9d98-3d1a872dbdbc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:32.241475 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1784/3628] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:32.242622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76152f48-6c83-4c8c-9d98-3d1a872dbdbc admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:32.271802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76152f48-6c83-4c8c-9d98-3d1a872dbdbc admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:32.298422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26239e5-0c85-47a0-9362-c06b59d4a08e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:32.298422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26239e5-0c85-47a0-9362-c06b59d4a08e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:32.298422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26239e5-0c85-47a0-9362-c06b59d4a08e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:32.299175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26239e5-0c85-47a0-9362-c06b59d4a08e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:32.299175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26239e5-0c85-47a0-9362-c06b59d4a08e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:32.299175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26239e5-0c85-47a0-9362-c06b59d4a08e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:32.301469 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1785/3629] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Jul 16 21:19:32 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:32.302455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26239e5-0c85-47a0-9362-c06b59d4a08e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:32.334685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26239e5-0c85-47a0-9362-c06b59d4a08e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:32.345543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b7900-78e3-4b19-8eb0-d36f24c598ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:32.346227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b7900-78e3-4b19-8eb0-d36f24c598ad admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:32.346510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b7900-78e3-4b19-8eb0-d36f24c598ad admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:32.346792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b7900-78e3-4b19-8eb0-d36f24c598ad admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:32.347564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b7900-78e3-4b19-8eb0-d36f24c598ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:32.349162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b7900-78e3-4b19-8eb0-d36f24c598ad admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:32.355879 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1845/3630] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:19:32 2022] PUT /identity/v3/projects/0be222897b3a4864a39e9fc7d481340a/users/1f72b1e0b4124480bfd53b5c22a343e0/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:32.356948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab86f4-a5ae-4525-9f61-cbc379c44312 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:32.376537 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1786/3631] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:32.378230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a9ad9-3119-4a3d-89c0-728f381d2ce5 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:32.378522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a9ad9-3119-4a3d-89c0-728f381d2ce5 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:32.380068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a9ad9-3119-4a3d-89c0-728f381d2ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:32.423960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-357a9ad9-3119-4a3d-89c0-728f381d2ce5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:32.425204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-357a9ad9-3119-4a3d-89c0-728f381d2ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:32.463061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab86f4-a5ae-4525-9f61-cbc379c44312 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:32.470312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd247f-435d-434c-a5ab-ab2e2f7e6c97 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:32.471453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd247f-435d-434c-a5ab-ab2e2f7e6c97 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:32.471852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd247f-435d-434c-a5ab-ab2e2f7e6c97 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:32.472366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd247f-435d-434c-a5ab-ab2e2f7e6c97 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:32.473159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd247f-435d-434c-a5ab-ab2e2f7e6c97 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:32.475046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd247f-435d-434c-a5ab-ab2e2f7e6c97 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:32.480917 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1846/3632] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:19:32 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:32.481885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd247f-435d-434c-a5ab-ab2e2f7e6c97 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:32.519418 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1787/3633] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:32.520493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a9ad9-3119-4a3d-89c0-728f381d2ce5 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:32.551691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a9ad9-3119-4a3d-89c0-728f381d2ce5 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:32.575988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aea68-36e9-4f4c-9546-58bc4b2c1258 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:32.576798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aea68-36e9-4f4c-9546-58bc4b2c1258 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:32.577082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aea68-36e9-4f4c-9546-58bc4b2c1258 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:32.577362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aea68-36e9-4f4c-9546-58bc4b2c1258 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:32.578027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834aea68-36e9-4f4c-9546-58bc4b2c1258 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:32.579681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834aea68-36e9-4f4c-9546-58bc4b2c1258 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:32.580953 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1788/3634] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jul 16 21:19:32 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:32.582334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aea68-36e9-4f4c-9546-58bc4b2c1258 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:32.584129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-834aea68-36e9-4f4c-9546-58bc4b2c1258 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:32.653749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd247f-435d-434c-a5ab-ab2e2f7e6c97 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:32.659225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e3cd5-3411-4416-bd7d-e280a481b8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:32.663019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e3cd5-3411-4416-bd7d-e280a481b8c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:32.663019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e3cd5-3411-4416-bd7d-e280a481b8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:32.663019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e3cd5-3411-4416-bd7d-e280a481b8c6 admin admin] PATH_INFO: `/v3/projects/837a8f9e06e141dcbd5f7bd895016d49/users/c6ba562873fa4f4fbd0b635f1c9dcdf2/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:32.678880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e3cd5-3411-4416-bd7d-e280a481b8c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=837a8f9e06e141dcbd5f7bd895016d49, user_id=c6ba562873fa4f4fbd0b635f1c9dcdf2, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:32.682759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e3cd5-3411-4416-bd7d-e280a481b8c6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:32.683466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aea68-36e9-4f4c-9546-58bc4b2c1258 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:32.709249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c196b-ac32-41c9-9977-6fb6181f3500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:32.709249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c196b-ac32-41c9-9977-6fb6181f3500 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:32.709249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c196b-ac32-41c9-9977-6fb6181f3500 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:32.709249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c196b-ac32-41c9-9977-6fb6181f3500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:32.709875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c196b-ac32-41c9-9977-6fb6181f3500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:32.709875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c196b-ac32-41c9-9977-6fb6181f3500 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:32.727653 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1789/3635] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:19:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:19:32.728581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c196b-ac32-41c9-9977-6fb6181f3500 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:32.751332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c196b-ac32-41c9-9977-6fb6181f3500 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:32.760412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1769a-3abc-4919-be0e-f60d85bc9229 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:32.761567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1769a-3abc-4919-be0e-f60d85bc9229 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:32.761853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1769a-3abc-4919-be0e-f60d85bc9229 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:32.762749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1769a-3abc-4919-be0e-f60d85bc9229 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:32.763210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1769a-3abc-4919-be0e-f60d85bc9229 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:32.778375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1769a-3abc-4919-be0e-f60d85bc9229 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:32.780339 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1790/3636] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Jul 16 21:19:32 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:32.784699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1769a-3abc-4919-be0e-f60d85bc9229 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:32.795586 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1847/3637] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:19:32 2022] PUT /identity/v3/projects/837a8f9e06e141dcbd5f7bd895016d49/users/c6ba562873fa4f4fbd0b635f1c9dcdf2/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:32.800573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfe827-72b7-4e6f-a0ae-662ca6207efd None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:32.801344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfe827-72b7-4e6f-a0ae-662ca6207efd None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:32.801642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1769a-3abc-4919-be0e-f60d85bc9229 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:32.802025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfe827-72b7-4e6f-a0ae-662ca6207efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:32.846063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-23cfe827-72b7-4e6f-a0ae-662ca6207efd None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:32.847428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-23cfe827-72b7-4e6f-a0ae-662ca6207efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:32.887154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db193b-d4f0-4af0-a8f3-0ea99ff0d864 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:32.888167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db193b-d4f0-4af0-a8f3-0ea99ff0d864 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:32.888269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db193b-d4f0-4af0-a8f3-0ea99ff0d864 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:32.888513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db193b-d4f0-4af0-a8f3-0ea99ff0d864 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:32.889185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db193b-d4f0-4af0-a8f3-0ea99ff0d864 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:32.890825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db193b-d4f0-4af0-a8f3-0ea99ff0d864 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:32.893632 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1791/3638] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Jul 16 21:19:32 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 16 21:19:32.908232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db193b-d4f0-4af0-a8f3-0ea99ff0d864 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:32.938624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db193b-d4f0-4af0-a8f3-0ea99ff0d864 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:32.938624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ab365-24ff-4191-b0f9-1ea7c4059821 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:32.938624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ab365-24ff-4191-b0f9-1ea7c4059821 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:32.939514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ab365-24ff-4191-b0f9-1ea7c4059821 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:32.939514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ab365-24ff-4191-b0f9-1ea7c4059821 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:32.939514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ab365-24ff-4191-b0f9-1ea7c4059821 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:32.940048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ab365-24ff-4191-b0f9-1ea7c4059821 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:32.942081 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1792/3639] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Jul 16 21:19:32 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:32.946786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ab365-24ff-4191-b0f9-1ea7c4059821 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:32.968397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ab365-24ff-4191-b0f9-1ea7c4059821 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:32.985001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80716353-e991-4017-a79b-6c354740fd6e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:32.985937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80716353-e991-4017-a79b-6c354740fd6e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:32.986362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80716353-e991-4017-a79b-6c354740fd6e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:32.986807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80716353-e991-4017-a79b-6c354740fd6e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:32.987845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80716353-e991-4017-a79b-6c354740fd6e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:32.990966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80716353-e991-4017-a79b-6c354740fd6e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.012912 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1793/3640] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Jul 16 21:19:32 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 16 21:19:33.016364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80716353-e991-4017-a79b-6c354740fd6e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.019215 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1848/3641] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:19:33.030582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80716353-e991-4017-a79b-6c354740fd6e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.033727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfe827-72b7-4e6f-a0ae-662ca6207efd None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.035876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-23cfe827-72b7-4e6f-a0ae-662ca6207efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:33.039025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca378178-ecf6-45a9-8f69-6537b92d1e7b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.040040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca378178-ecf6-45a9-8f69-6537b92d1e7b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.040860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca378178-ecf6-45a9-8f69-6537b92d1e7b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.041262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca378178-ecf6-45a9-8f69-6537b92d1e7b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.042158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca378178-ecf6-45a9-8f69-6537b92d1e7b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.043976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca378178-ecf6-45a9-8f69-6537b92d1e7b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.045958 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1794/3642] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:33.062643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca378178-ecf6-45a9-8f69-6537b92d1e7b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.091687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca378178-ecf6-45a9-8f69-6537b92d1e7b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.104123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc76c5-cd47-4971-b6ea-0bfae17d7a88 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.104939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc76c5-cd47-4971-b6ea-0bfae17d7a88 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.105948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc76c5-cd47-4971-b6ea-0bfae17d7a88 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.106240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc76c5-cd47-4971-b6ea-0bfae17d7a88 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.106966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc76c5-cd47-4971-b6ea-0bfae17d7a88 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.111932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc76c5-cd47-4971-b6ea-0bfae17d7a88 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.113602 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1795/3643] 10.222.0.16 () {58 vars in 1256 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:33.128074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc76c5-cd47-4971-b6ea-0bfae17d7a88 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.156190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc76c5-cd47-4971-b6ea-0bfae17d7a88 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.162124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb12192-3235-4a3f-8025-9d762b76704b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.162934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb12192-3235-4a3f-8025-9d762b76704b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.166694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb12192-3235-4a3f-8025-9d762b76704b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.167132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb12192-3235-4a3f-8025-9d762b76704b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.167914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb12192-3235-4a3f-8025-9d762b76704b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.172906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb12192-3235-4a3f-8025-9d762b76704b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.176461 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1796/3644] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:33.177469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb12192-3235-4a3f-8025-9d762b76704b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.180253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfe827-72b7-4e6f-a0ae-662ca6207efd None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.185871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b476eb-6040-4321-94c6-cc5ca5ff7c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.186873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b476eb-6040-4321-94c6-cc5ca5ff7c56 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.187366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b476eb-6040-4321-94c6-cc5ca5ff7c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.187800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b476eb-6040-4321-94c6-cc5ca5ff7c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.204214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb12192-3235-4a3f-8025-9d762b76704b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.206636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b476eb-6040-4321-94c6-cc5ca5ff7c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.209017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b476eb-6040-4321-94c6-cc5ca5ff7c56 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.215620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ccaef-4b66-4422-8487-69d2a7ced0c7 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.218989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ccaef-4b66-4422-8487-69d2a7ced0c7 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.219438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ccaef-4b66-4422-8487-69d2a7ced0c7 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.224818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ccaef-4b66-4422-8487-69d2a7ced0c7 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.224818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ccaef-4b66-4422-8487-69d2a7ced0c7 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.226209 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1849/3645] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:19:33.226551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ccaef-4b66-4422-8487-69d2a7ced0c7 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.232785 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1797/3646] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:33.233500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b476eb-6040-4321-94c6-cc5ca5ff7c56 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.247911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b476eb-6040-4321-94c6-cc5ca5ff7c56 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.253397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072f79d-3b18-40a8-8c58-1e1f55ba058b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.254254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072f79d-3b18-40a8-8c58-1e1f55ba058b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.254468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072f79d-3b18-40a8-8c58-1e1f55ba058b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.254737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072f79d-3b18-40a8-8c58-1e1f55ba058b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.255465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072f79d-3b18-40a8-8c58-1e1f55ba058b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.257142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072f79d-3b18-40a8-8c58-1e1f55ba058b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.258306 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1850/3647] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:33.262483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ccaef-4b66-4422-8487-69d2a7ced0c7 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.277903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ccaef-4b66-4422-8487-69d2a7ced0c7 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.282908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253a29e-1fc1-4fd1-84ac-438bca4e7fa0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.283723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253a29e-1fc1-4fd1-84ac-438bca4e7fa0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.284012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253a29e-1fc1-4fd1-84ac-438bca4e7fa0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.284296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253a29e-1fc1-4fd1-84ac-438bca4e7fa0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.285015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253a29e-1fc1-4fd1-84ac-438bca4e7fa0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.286613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253a29e-1fc1-4fd1-84ac-438bca4e7fa0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.287939 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1798/3648] 10.222.0.16 () {58 vars in 1253 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:33.299792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072f79d-3b18-40a8-8c58-1e1f55ba058b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.311475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072f79d-3b18-40a8-8c58-1e1f55ba058b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.316488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2586c0-cff8-4e92-88cb-b6eace54e682 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.317291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2586c0-cff8-4e92-88cb-b6eace54e682 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.317573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2586c0-cff8-4e92-88cb-b6eace54e682 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.317875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2586c0-cff8-4e92-88cb-b6eace54e682 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.318767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2586c0-cff8-4e92-88cb-b6eace54e682 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.320424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2586c0-cff8-4e92-88cb-b6eace54e682 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.321562 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1851/3649] 10.222.0.16 () {58 vars in 1289 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 16 21:19:33.327901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253a29e-1fc1-4fd1-84ac-438bca4e7fa0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.342372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253a29e-1fc1-4fd1-84ac-438bca4e7fa0 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.348311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234e42b-e00f-41ee-a798-ed7b957f2dbd tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.349238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234e42b-e00f-41ee-a798-ed7b957f2dbd tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.349507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234e42b-e00f-41ee-a798-ed7b957f2dbd tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.350436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234e42b-e00f-41ee-a798-ed7b957f2dbd tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.352148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234e42b-e00f-41ee-a798-ed7b957f2dbd tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.353550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234e42b-e00f-41ee-a798-ed7b957f2dbd tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.354839 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1799/3650] 10.222.0.16 () {58 vars in 1256 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:33.358976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2586c0-cff8-4e92-88cb-b6eace54e682 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.370371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2586c0-cff8-4e92-88cb-b6eace54e682 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.375290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e2f2c-b80a-4780-a150-3ff568652633 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.376093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e2f2c-b80a-4780-a150-3ff568652633 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.376384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e2f2c-b80a-4780-a150-3ff568652633 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.376672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e2f2c-b80a-4780-a150-3ff568652633 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.377600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e2f2c-b80a-4780-a150-3ff568652633 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.379264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e2f2c-b80a-4780-a150-3ff568652633 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.383088 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1852/3651] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 16 21:19:33.385490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234e42b-e00f-41ee-a798-ed7b957f2dbd tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.408781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234e42b-e00f-41ee-a798-ed7b957f2dbd tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.414508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befde9da-6f08-4846-bb22-fb2397990dc6 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.415367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befde9da-6f08-4846-bb22-fb2397990dc6 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.415655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befde9da-6f08-4846-bb22-fb2397990dc6 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.415932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befde9da-6f08-4846-bb22-fb2397990dc6 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.416598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befde9da-6f08-4846-bb22-fb2397990dc6 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.418315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befde9da-6f08-4846-bb22-fb2397990dc6 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.419724 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1800/3652] 10.222.0.16 () {58 vars in 1307 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:33.423991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e2f2c-b80a-4780-a150-3ff568652633 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.435863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e2f2c-b80a-4780-a150-3ff568652633 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.441378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da92111-0423-4341-ab59-ecb33016c5d1 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.442366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da92111-0423-4341-ab59-ecb33016c5d1 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.442840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da92111-0423-4341-ab59-ecb33016c5d1 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.443051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da92111-0423-4341-ab59-ecb33016c5d1 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.443921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da92111-0423-4341-ab59-ecb33016c5d1 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.445761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da92111-0423-4341-ab59-ecb33016c5d1 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.448032 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1853/3653] 10.222.0.16 () {58 vars in 1289 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 16 21:19:33.451877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befde9da-6f08-4846-bb22-fb2397990dc6 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.471028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befde9da-6f08-4846-bb22-fb2397990dc6 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.484849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e5a3f-1b61-45e3-bf4e-ad893d370963 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.484849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e5a3f-1b61-45e3-bf4e-ad893d370963 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.484849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e5a3f-1b61-45e3-bf4e-ad893d370963 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.485259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e5a3f-1b61-45e3-bf4e-ad893d370963 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.485259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e5a3f-1b61-45e3-bf4e-ad893d370963 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.485786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e5a3f-1b61-45e3-bf4e-ad893d370963 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.487164 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1801/3654] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:33.492104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da92111-0423-4341-ab59-ecb33016c5d1 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.503964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da92111-0423-4341-ab59-ecb33016c5d1 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.509125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425e2bf-78ac-455a-a11d-fc48d847af1e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.509912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425e2bf-78ac-455a-a11d-fc48d847af1e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.510195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425e2bf-78ac-455a-a11d-fc48d847af1e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.510852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425e2bf-78ac-455a-a11d-fc48d847af1e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.511541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425e2bf-78ac-455a-a11d-fc48d847af1e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.513244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425e2bf-78ac-455a-a11d-fc48d847af1e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.514390 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1854/3655] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:33.518731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e5a3f-1b61-45e3-bf4e-ad893d370963 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.530236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e5a3f-1b61-45e3-bf4e-ad893d370963 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.536005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2a9bc-17ab-4b2d-9825-15bfca7dcd4e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.537366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2a9bc-17ab-4b2d-9825-15bfca7dcd4e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.537366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2a9bc-17ab-4b2d-9825-15bfca7dcd4e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.553035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2a9bc-17ab-4b2d-9825-15bfca7dcd4e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.554508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2a9bc-17ab-4b2d-9825-15bfca7dcd4e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.556972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2a9bc-17ab-4b2d-9825-15bfca7dcd4e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.561249 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1802/3656] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:33.562315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425e2bf-78ac-455a-a11d-fc48d847af1e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.584562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425e2bf-78ac-455a-a11d-fc48d847af1e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.599238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b6449-7d2d-480e-9577-66a858321fe3 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.602607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b6449-7d2d-480e-9577-66a858321fe3 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.602903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b6449-7d2d-480e-9577-66a858321fe3 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.603288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b6449-7d2d-480e-9577-66a858321fe3 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.603970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b6449-7d2d-480e-9577-66a858321fe3 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.608052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b6449-7d2d-480e-9577-66a858321fe3 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.612163 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1855/3657] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:33.614556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2a9bc-17ab-4b2d-9825-15bfca7dcd4e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.630672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2a9bc-17ab-4b2d-9825-15bfca7dcd4e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.645784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13780bd-3c8b-44c0-a3a0-6964c59e8633 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.647072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13780bd-3c8b-44c0-a3a0-6964c59e8633 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.647397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13780bd-3c8b-44c0-a3a0-6964c59e8633 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.647740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13780bd-3c8b-44c0-a3a0-6964c59e8633 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.648466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13780bd-3c8b-44c0-a3a0-6964c59e8633 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.651600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13780bd-3c8b-44c0-a3a0-6964c59e8633 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.652009 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1803/3658] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:33.656569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b6449-7d2d-480e-9577-66a858321fe3 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.671329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b6449-7d2d-480e-9577-66a858321fe3 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.678307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb1448-c6f5-4a25-8309-029e7282c262 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.680375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb1448-c6f5-4a25-8309-029e7282c262 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.680802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb1448-c6f5-4a25-8309-029e7282c262 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.681377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb1448-c6f5-4a25-8309-029e7282c262 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.682236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb1448-c6f5-4a25-8309-029e7282c262 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.685786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb1448-c6f5-4a25-8309-029e7282c262 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.687599 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1856/3659] 10.222.0.16 () {58 vars in 1253 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:33.691425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13780bd-3c8b-44c0-a3a0-6964c59e8633 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.705252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13780bd-3c8b-44c0-a3a0-6964c59e8633 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.714320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95ad18-3a28-4d15-8c36-b4c32f96aea2 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.716011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95ad18-3a28-4d15-8c36-b4c32f96aea2 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.720420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95ad18-3a28-4d15-8c36-b4c32f96aea2 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.720420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95ad18-3a28-4d15-8c36-b4c32f96aea2 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.720420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95ad18-3a28-4d15-8c36-b4c32f96aea2 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.720420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95ad18-3a28-4d15-8c36-b4c32f96aea2 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.723101 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1804/3660] 10.222.0.16 () {58 vars in 1256 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 16 21:19:33.734318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb1448-c6f5-4a25-8309-029e7282c262 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.750877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb1448-c6f5-4a25-8309-029e7282c262 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.758514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb78de-3256-46ef-ae93-bb97b4eeb7cb tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.759398 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb78de-3256-46ef-ae93-bb97b4eeb7cb tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.759607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb78de-3256-46ef-ae93-bb97b4eeb7cb tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.760371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb78de-3256-46ef-ae93-bb97b4eeb7cb tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.761633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb78de-3256-46ef-ae93-bb97b4eeb7cb tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.763433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb78de-3256-46ef-ae93-bb97b4eeb7cb tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.764941 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1857/3661] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:33.769806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95ad18-3a28-4d15-8c36-b4c32f96aea2 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.786048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95ad18-3a28-4d15-8c36-b4c32f96aea2 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.799444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfc694-9d4a-4fa1-93da-29ee37c5873e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.800340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfc694-9d4a-4fa1-93da-29ee37c5873e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.800824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfc694-9d4a-4fa1-93da-29ee37c5873e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.802827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfc694-9d4a-4fa1-93da-29ee37c5873e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.805031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfc694-9d4a-4fa1-93da-29ee37c5873e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.809479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfc694-9d4a-4fa1-93da-29ee37c5873e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.812079 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1805/3662] 10.222.0.16 () {58 vars in 1256 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:33.817728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb78de-3256-46ef-ae93-bb97b4eeb7cb tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.838598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb78de-3256-46ef-ae93-bb97b4eeb7cb tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.844398 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332b68f-a0e0-4ee4-a29b-f5befdd73daa tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.845222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332b68f-a0e0-4ee4-a29b-f5befdd73daa tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.845606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332b68f-a0e0-4ee4-a29b-f5befdd73daa tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.845889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332b68f-a0e0-4ee4-a29b-f5befdd73daa tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.847132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332b68f-a0e0-4ee4-a29b-f5befdd73daa tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.848986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332b68f-a0e0-4ee4-a29b-f5befdd73daa tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.855663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfc694-9d4a-4fa1-93da-29ee37c5873e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.861939 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1858/3663] 10.222.0.16 () {58 vars in 1292 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:33.869884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfc694-9d4a-4fa1-93da-29ee37c5873e tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.879542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44b859-7a86-417f-ad65-7abbcd880413 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.879542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44b859-7a86-417f-ad65-7abbcd880413 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.879542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44b859-7a86-417f-ad65-7abbcd880413 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.880119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44b859-7a86-417f-ad65-7abbcd880413 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.880119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44b859-7a86-417f-ad65-7abbcd880413 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.880119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44b859-7a86-417f-ad65-7abbcd880413 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.887072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332b68f-a0e0-4ee4-a29b-f5befdd73daa tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.894944 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1806/3664] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 16 21:19:33.901599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332b68f-a0e0-4ee4-a29b-f5befdd73daa tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.904255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:33.911728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa485e8-bb38-474a-bd5f-63f4c450f464 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.914159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa485e8-bb38-474a-bd5f-63f4c450f464 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.914669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa485e8-bb38-474a-bd5f-63f4c450f464 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.920679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa485e8-bb38-474a-bd5f-63f4c450f464 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.926894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa485e8-bb38-474a-bd5f-63f4c450f464 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.941618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa485e8-bb38-474a-bd5f-63f4c450f464 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.943827 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1859/3665] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:33.947875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44b859-7a86-417f-ad65-7abbcd880413 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:33.960301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44b859-7a86-417f-ad65-7abbcd880413 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:33.978863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b4b1c-adf3-41aa-96dc-37cd33477c11 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:33.979683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b4b1c-adf3-41aa-96dc-37cd33477c11 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:33.979972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b4b1c-adf3-41aa-96dc-37cd33477c11 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:33.980253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b4b1c-adf3-41aa-96dc-37cd33477c11 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:33.981686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b4b1c-adf3-41aa-96dc-37cd33477c11 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:33.982766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b4b1c-adf3-41aa-96dc-37cd33477c11 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:33.984314 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1807/3666] 10.222.0.16 () {58 vars in 1211 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:33.988396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa485e8-bb38-474a-bd5f-63f4c450f464 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:34.003118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa485e8-bb38-474a-bd5f-63f4c450f464 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:34.021691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5668652-6b17-491c-8769-f862ba11ddfa tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:34.023177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5668652-6b17-491c-8769-f862ba11ddfa tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:34.023587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5668652-6b17-491c-8769-f862ba11ddfa tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:34.023967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5668652-6b17-491c-8769-f862ba11ddfa tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:34.024734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5668652-6b17-491c-8769-f862ba11ddfa tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:34.026453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5668652-6b17-491c-8769-f862ba11ddfa tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:34.027774 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1860/3667] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Jul 16 21:19:33 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:34.032382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b4b1c-adf3-41aa-96dc-37cd33477c11 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:34.054947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b4b1c-adf3-41aa-96dc-37cd33477c11 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:34.067532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082fa2c-6642-4e6b-a882-474fc1250538 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:34.071154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082fa2c-6642-4e6b-a882-474fc1250538 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:34.071468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082fa2c-6642-4e6b-a882-474fc1250538 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:34.071762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082fa2c-6642-4e6b-a882-474fc1250538 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:34.074549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082fa2c-6642-4e6b-a882-474fc1250538 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:34.076312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082fa2c-6642-4e6b-a882-474fc1250538 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:34.081048 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1808/3668] 10.222.0.16 () {58 vars in 1214 bytes} [Sat Jul 16 21:19:34 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:34.082180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5668652-6b17-491c-8769-f862ba11ddfa tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:34.096620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5668652-6b17-491c-8769-f862ba11ddfa tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:34.103505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2174c5-5a7c-472f-8c03-dc473c6f7373 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:34.104706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2174c5-5a7c-472f-8c03-dc473c6f7373 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:34.105183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2174c5-5a7c-472f-8c03-dc473c6f7373 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:34.105694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2174c5-5a7c-472f-8c03-dc473c6f7373 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:34.106374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2174c5-5a7c-472f-8c03-dc473c6f7373 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:34.110139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2174c5-5a7c-472f-8c03-dc473c6f7373 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:34.117702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082fa2c-6642-4e6b-a882-474fc1250538 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:34.126994 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1861/3669] 10.222.0.16 () {58 vars in 1217 bytes} [Sat Jul 16 21:19:34 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:34.131911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082fa2c-6642-4e6b-a882-474fc1250538 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:34.138277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5ec15-f8de-4720-8098-7b034f3ad898 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:34.140914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5ec15-f8de-4720-8098-7b034f3ad898 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:34.140914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5ec15-f8de-4720-8098-7b034f3ad898 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:34.140914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5ec15-f8de-4720-8098-7b034f3ad898 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:34.140914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5ec15-f8de-4720-8098-7b034f3ad898 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:34.143764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5ec15-f8de-4720-8098-7b034f3ad898 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:34.150348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2174c5-5a7c-472f-8c03-dc473c6f7373 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:34.159194 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1809/3670] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:19:34 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:34.174604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2174c5-5a7c-472f-8c03-dc473c6f7373 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:34.180603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b6557-5b93-4c86-9028-a4453952c535 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:34.181653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b6557-5b93-4c86-9028-a4453952c535 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:34.181967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b6557-5b93-4c86-9028-a4453952c535 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:34.182921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b6557-5b93-4c86-9028-a4453952c535 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:34.183642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b6557-5b93-4c86-9028-a4453952c535 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:34.185284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b6557-5b93-4c86-9028-a4453952c535 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:34.189903 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1862/3671] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Jul 16 21:19:34 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:34.191483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5ec15-f8de-4720-8098-7b034f3ad898 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:34.208408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5ec15-f8de-4720-8098-7b034f3ad898 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:34.239036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695ff81-3d6f-4026-b78f-0469ea071a1a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:34.239908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695ff81-3d6f-4026-b78f-0469ea071a1a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:34.240215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695ff81-3d6f-4026-b78f-0469ea071a1a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:34.240487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695ff81-3d6f-4026-b78f-0469ea071a1a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:34.243507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695ff81-3d6f-4026-b78f-0469ea071a1a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:34.253228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695ff81-3d6f-4026-b78f-0469ea071a1a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:34.259834 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1810/3672] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Jul 16 21:19:34 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:34.260979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b6557-5b93-4c86-9028-a4453952c535 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:34.275434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b6557-5b93-4c86-9028-a4453952c535 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:34.293739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d8c1b-3e8c-49ba-ba98-09161277dc25 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:34.295148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d8c1b-3e8c-49ba-ba98-09161277dc25 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:34.295833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d8c1b-3e8c-49ba-ba98-09161277dc25 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:34.296381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d8c1b-3e8c-49ba-ba98-09161277dc25 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:34.297250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d8c1b-3e8c-49ba-ba98-09161277dc25 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:34.299138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d8c1b-3e8c-49ba-ba98-09161277dc25 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:34.304570 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1863/3673] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Jul 16 21:19:34 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:34.305187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695ff81-3d6f-4026-b78f-0469ea071a1a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:34.326887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695ff81-3d6f-4026-b78f-0469ea071a1a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:34.336602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e849c-435e-49a4-b92a-22c5c6d3f33a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:34.337362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e849c-435e-49a4-b92a-22c5c6d3f33a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:34.337660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e849c-435e-49a4-b92a-22c5c6d3f33a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:34.337942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e849c-435e-49a4-b92a-22c5c6d3f33a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:34.338638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e849c-435e-49a4-b92a-22c5c6d3f33a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:34.345651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e849c-435e-49a4-b92a-22c5c6d3f33a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:34.351288 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1811/3674] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:19:34 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:34.358445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d8c1b-3e8c-49ba-ba98-09161277dc25 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:34.373760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d8c1b-3e8c-49ba-ba98-09161277dc25 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:34.384943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988d955-7e80-43b4-b34c-d5442705c01a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:34.386172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988d955-7e80-43b4-b34c-d5442705c01a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:34.388054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988d955-7e80-43b4-b34c-d5442705c01a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:34.388620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988d955-7e80-43b4-b34c-d5442705c01a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:34.389621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988d955-7e80-43b4-b34c-d5442705c01a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:34.394801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988d955-7e80-43b4-b34c-d5442705c01a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:34.401996 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1864/3675] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:19:34 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:34.402868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e849c-435e-49a4-b92a-22c5c6d3f33a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:34.418541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e849c-435e-49a4-b92a-22c5c6d3f33a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:34.443225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd1a7c-3055-4d64-af1f-946df1142b0b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:34.444057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd1a7c-3055-4d64-af1f-946df1142b0b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:34.444385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd1a7c-3055-4d64-af1f-946df1142b0b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:34.444668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd1a7c-3055-4d64-af1f-946df1142b0b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:34.445374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd1a7c-3055-4d64-af1f-946df1142b0b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:34.446989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd1a7c-3055-4d64-af1f-946df1142b0b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:34.448295 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1812/3676] 10.222.0.16 () {58 vars in 1277 bytes} [Sat Jul 16 21:19:34 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:19:34.456500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988d955-7e80-43b4-b34c-d5442705c01a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:34.456769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:34.473792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988d955-7e80-43b4-b34c-d5442705c01a tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:34.483938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab71a07-027b-41c3-969f-9f0eaecc43b7 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:34.486944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab71a07-027b-41c3-969f-9f0eaecc43b7 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:34.493638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab71a07-027b-41c3-969f-9f0eaecc43b7 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:34.496990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab71a07-027b-41c3-969f-9f0eaecc43b7 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/eb5be2d5b6d24f3ea212fadb5e722b61` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:34.512997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab71a07-027b-41c3-969f-9f0eaecc43b7 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 21:19:34.526209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-0ab71a07-027b-41c3-969f-9f0eaecc43b7 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Could not find domain: eb5be2d5b6d24f3ea212fadb5e722b61.: keystone.exception.DomainNotFound: Could not find domain: eb5be2d5b6d24f3ea212fadb5e722b61. Jul 16 21:19:34.526209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:19:34.526209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 16 21:19:34.526209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 16 21:19:34.526209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 21:19:34.526209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 21:19:34.526209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 21:19:34.526209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 21:19:34.526209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: eb5be2d5b6d24f3ea212fadb5e722b61. Jul 16 21:19:34.526209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:19:34.526209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:19:34.526209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:19:34.526209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:19:34.526209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:19:34.526209 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:19:34.527199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:19:34.527199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:19:34.527199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:19:34.527199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:19:34.527199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:19:34.527199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:19:34.527199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:19:34.527199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:19:34.527199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 16 21:19:34.527199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 16 21:19:34.527199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 21:19:34.527199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 21:19:34.527199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 21:19:34.527199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 21:19:34.527199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:19:34.527199 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:19:34.532817 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:19:34.532817 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:19:34.532817 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:19:34.532817 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:19:34.532817 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:19:34.532817 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 21:19:34.532817 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:19:34.532817 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:19:34.532817 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:19:34.532817 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:19:34.532817 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:19:34.532817 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:19:34.532817 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:19:34.532817 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:19:34.532817 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 16 21:19:34.532817 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 21:19:34.532817 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: eb5be2d5b6d24f3ea212fadb5e722b61. Jul 16 21:19:34.534101 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:19:34.534101 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1865/3677] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:19:34 2022] PATCH /identity/v3/domains/eb5be2d5b6d24f3ea212fadb5e722b61 => generated 112 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:19:34.534242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd1a7c-3055-4d64-af1f-946df1142b0b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:34.554068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd1a7c-3055-4d64-af1f-946df1142b0b tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:34.565898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c05fb5-6a97-4f39-8938-0b597aba48ed tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:34.566788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c05fb5-6a97-4f39-8938-0b597aba48ed tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:34.567135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c05fb5-6a97-4f39-8938-0b597aba48ed tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:34.567420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c05fb5-6a97-4f39-8938-0b597aba48ed tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/355580fe66324585bd5cb8d57ffba985` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:34.583424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c05fb5-6a97-4f39-8938-0b597aba48ed tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 21:19:34.595482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-73c05fb5-6a97-4f39-8938-0b597aba48ed tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Could not find domain: 355580fe66324585bd5cb8d57ffba985.: keystone.exception.DomainNotFound: Could not find domain: 355580fe66324585bd5cb8d57ffba985. Jul 16 21:19:34.595482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:19:34.595482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 16 21:19:34.595482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 16 21:19:34.595482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 21:19:34.595482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 21:19:34.595482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 21:19:34.595482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 21:19:34.595482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 355580fe66324585bd5cb8d57ffba985. Jul 16 21:19:34.595482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:19:34.595482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:19:34.595482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:19:34.595482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:19:34.595482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:19:34.595482 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:19:34.596535 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:19:34.596535 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:19:34.596535 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:19:34.596535 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:19:34.596535 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:19:34.596535 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:19:34.596535 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:19:34.596535 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:19:34.596535 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 16 21:19:34.596535 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 16 21:19:34.596535 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 21:19:34.596535 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 21:19:34.596535 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 21:19:34.596535 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 21:19:34.596535 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:19:34.596535 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:19:34.600014 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:19:34.600014 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:19:34.600014 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:19:34.600014 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:19:34.600014 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:19:34.600014 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 21:19:34.600014 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:19:34.600014 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:19:34.600014 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:19:34.600014 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:19:34.600014 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:19:34.600014 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:19:34.600014 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:19:34.600014 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:19:34.600014 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 16 21:19:34.600014 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 21:19:34.600014 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 355580fe66324585bd5cb8d57ffba985. Jul 16 21:19:34.601532 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:19:34.601532 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1813/3678] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:19:34 2022] PATCH /identity/v3/domains/355580fe66324585bd5cb8d57ffba985 => generated 112 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:19:34.602747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab71a07-027b-41c3-969f-9f0eaecc43b7 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:34.616022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab71a07-027b-41c3-969f-9f0eaecc43b7 tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:34.622229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d53d0-0989-47e0-a81d-9cefcd274afb tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94391e4486fe4cd1bf79937a5547a87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a839a9676e7341fda1e9a11187ca68c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:34.623120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d53d0-0989-47e0-a81d-9cefcd274afb tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:34.624003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d53d0-0989-47e0-a81d-9cefcd274afb tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:34.624510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d53d0-0989-47e0-a81d-9cefcd274afb tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] PATH_INFO: `/v3/domains/4100c533a4084e69a87fb239a339e353` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:34.637041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d53d0-0989-47e0-a81d-9cefcd274afb tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 21:19:34.650412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-da2d53d0-0989-47e0-a81d-9cefcd274afb tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Could not find domain: 4100c533a4084e69a87fb239a339e353.: keystone.exception.DomainNotFound: Could not find domain: 4100c533a4084e69a87fb239a339e353. Jul 16 21:19:34.650412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:19:34.650412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 16 21:19:34.650412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 16 21:19:34.650412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 21:19:34.650412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 21:19:34.650412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 21:19:34.650412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 21:19:34.650412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 4100c533a4084e69a87fb239a339e353. Jul 16 21:19:34.650412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:19:34.650412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:19:34.650412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:19:34.650412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:19:34.650412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:19:34.650412 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:19:34.651480 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:19:34.651480 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:19:34.651480 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:19:34.651480 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:19:34.651480 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:19:34.651480 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:19:34.651480 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:19:34.651480 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:19:34.651480 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 16 21:19:34.651480 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 16 21:19:34.651480 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 21:19:34.651480 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 21:19:34.651480 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 21:19:34.651480 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 21:19:34.651480 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:19:34.651480 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:19:34.652349 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:19:34.652349 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:19:34.652349 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:19:34.652349 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:19:34.652349 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:19:34.652349 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 21:19:34.652349 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:19:34.652349 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:19:34.652349 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:19:34.652349 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:19:34.652349 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:19:34.652349 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:19:34.652349 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:19:34.652349 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:19:34.652349 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 16 21:19:34.652349 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 21:19:34.652349 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 4100c533a4084e69a87fb239a339e353. Jul 16 21:19:34.653785 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:19:34.655847 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1866/3679] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:19:34 2022] PATCH /identity/v3/domains/4100c533a4084e69a87fb239a339e353 => generated 112 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:19:34.660067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c05fb5-6a97-4f39-8938-0b597aba48ed tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:34.662284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-73c05fb5-6a97-4f39-8938-0b597aba48ed tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:34.681734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c05fb5-6a97-4f39-8938-0b597aba48ed tempest-DomainConfigurationTestJSON-1946149574 tempest-DomainConfigurationTestJSON-1946149574-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:34.690115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56c310-1cbf-4c7b-891e-cc23d17a9c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:34.691543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56c310-1cbf-4c7b-891e-cc23d17a9c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:34.691996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56c310-1cbf-4c7b-891e-cc23d17a9c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:34.692539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56c310-1cbf-4c7b-891e-cc23d17a9c67 admin admin] PATH_INFO: `/v3/users/d4c7b7b2aaaa403f9fe38c995756955a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:34.694494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56c310-1cbf-4c7b-891e-cc23d17a9c67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4c7b7b2aaaa403f9fe38c995756955a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:34.697873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56c310-1cbf-4c7b-891e-cc23d17a9c67 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:35.025523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ce56c310-1cbf-4c7b-891e-cc23d17a9c67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4c7b7b2aaaa403f9fe38c995756955a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:35.064597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ce56c310-1cbf-4c7b-891e-cc23d17a9c67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4c7b7b2aaaa403f9fe38c995756955a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:35.180909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ce56c310-1cbf-4c7b-891e-cc23d17a9c67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4c7b7b2aaaa403f9fe38c995756955a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:35.191909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ce56c310-1cbf-4c7b-891e-cc23d17a9c67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4c7b7b2aaaa403f9fe38c995756955a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:35.195543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ce56c310-1cbf-4c7b-891e-cc23d17a9c67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4c7b7b2aaaa403f9fe38c995756955a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:35.216933 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1814/3680] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:19:34 2022] DELETE /identity/v3/users/d4c7b7b2aaaa403f9fe38c995756955a => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:35.221899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8412b27-5772-4cf1-b76d-59b76ac24185 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:35.223962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8412b27-5772-4cf1-b76d-59b76ac24185 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:35.225336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8412b27-5772-4cf1-b76d-59b76ac24185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:35.263572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c8412b27-5772-4cf1-b76d-59b76ac24185 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:35.264599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c8412b27-5772-4cf1-b76d-59b76ac24185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:35.410251 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1867/3681] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:19:35.438313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56c310-1cbf-4c7b-891e-cc23d17a9c67 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:35.439855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ce56c310-1cbf-4c7b-891e-cc23d17a9c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:35.535257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56c310-1cbf-4c7b-891e-cc23d17a9c67 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:35.543503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0417b8e-bc3c-4b3b-88e9-d643d82627bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:35.544181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0417b8e-bc3c-4b3b-88e9-d643d82627bf service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:35.544598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0417b8e-bc3c-4b3b-88e9-d643d82627bf service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:35.548413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0417b8e-bc3c-4b3b-88e9-d643d82627bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:35.555350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0417b8e-bc3c-4b3b-88e9-d643d82627bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:35.556701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0417b8e-bc3c-4b3b-88e9-d643d82627bf service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:35.566740 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1815/3682] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:19:35.598933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8412b27-5772-4cf1-b76d-59b76ac24185 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:35.600729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c8412b27-5772-4cf1-b76d-59b76ac24185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:35.630722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8412b27-5772-4cf1-b76d-59b76ac24185 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:35.647820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90349938-c27f-48c1-9c7d-3b0a2e4a7228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:35.648877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90349938-c27f-48c1-9c7d-3b0a2e4a7228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:35.649217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90349938-c27f-48c1-9c7d-3b0a2e4a7228 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:35.649491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90349938-c27f-48c1-9c7d-3b0a2e4a7228 admin admin] PATH_INFO: `/v3/users/d0008fffad8e4708b2c01e03da92c47d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:35.650913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90349938-c27f-48c1-9c7d-3b0a2e4a7228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0008fffad8e4708b2c01e03da92c47d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:35.652987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90349938-c27f-48c1-9c7d-3b0a2e4a7228 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:36.046725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-90349938-c27f-48c1-9c7d-3b0a2e4a7228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0008fffad8e4708b2c01e03da92c47d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:36.061273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-90349938-c27f-48c1-9c7d-3b0a2e4a7228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0008fffad8e4708b2c01e03da92c47d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:36.212640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-90349938-c27f-48c1-9c7d-3b0a2e4a7228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0008fffad8e4708b2c01e03da92c47d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:36.213423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-90349938-c27f-48c1-9c7d-3b0a2e4a7228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0008fffad8e4708b2c01e03da92c47d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:36.237677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-90349938-c27f-48c1-9c7d-3b0a2e4a7228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0008fffad8e4708b2c01e03da92c47d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:36.246227 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1868/3683] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:19:35 2022] DELETE /identity/v3/users/d0008fffad8e4708b2c01e03da92c47d => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:36.766835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0417b8e-bc3c-4b3b-88e9-d643d82627bf service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:36.768457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c0417b8e-bc3c-4b3b-88e9-d643d82627bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:36.794653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0417b8e-bc3c-4b3b-88e9-d643d82627bf service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:36.935740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb7c7b-c750-4a8b-b34a-549954f614db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:36.936773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb7c7b-c750-4a8b-b34a-549954f614db admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:36.937156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb7c7b-c750-4a8b-b34a-549954f614db admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:36.937536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb7c7b-c750-4a8b-b34a-549954f614db admin admin] PATH_INFO: `/v3/projects/bbeff4e7ee0e417c8fbaa4322772d5f3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:36.939675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb7c7b-c750-4a8b-b34a-549954f614db admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbeff4e7ee0e417c8fbaa4322772d5f3)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:36.942335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb7c7b-c750-4a8b-b34a-549954f614db admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:37.177826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4ffb7c7b-c750-4a8b-b34a-549954f614db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbeff4e7ee0e417c8fbaa4322772d5f3', 'request_id': 'req-4ffb7c7b-c750-4a8b-b34a-549954f614db'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:37.190195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4ffb7c7b-c750-4a8b-b34a-549954f614db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbeff4e7ee0e417c8fbaa4322772d5f3', 'request_id': 'req-4ffb7c7b-c750-4a8b-b34a-549954f614db'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:37.199387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4ffb7c7b-c750-4a8b-b34a-549954f614db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbeff4e7ee0e417c8fbaa4322772d5f3', 'request_id': 'req-4ffb7c7b-c750-4a8b-b34a-549954f614db'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:37.415491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4ffb7c7b-c750-4a8b-b34a-549954f614db admin admin] The token cache is being invalidate because project bbeff4e7ee0e417c8fbaa4322772d5f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:19:37.415774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4ffb7c7b-c750-4a8b-b34a-549954f614db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:37.416466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4ffb7c7b-c750-4a8b-b34a-549954f614db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:37.422045 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1816/3684] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:19:36 2022] DELETE /identity/v3/projects/bbeff4e7ee0e417c8fbaa4322772d5f3 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:37.425918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90349938-c27f-48c1-9c7d-3b0a2e4a7228 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:37.427623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-90349938-c27f-48c1-9c7d-3b0a2e4a7228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:37.449175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90349938-c27f-48c1-9c7d-3b0a2e4a7228 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:37.545550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46edde-09ac-4a6d-9c95-db38e78744bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:37.546666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46edde-09ac-4a6d-9c95-db38e78744bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:37.547170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46edde-09ac-4a6d-9c95-db38e78744bb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:37.547934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46edde-09ac-4a6d-9c95-db38e78744bb admin admin] PATH_INFO: `/v3/users/94391e4486fe4cd1bf79937a5547a87c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:37.549426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46edde-09ac-4a6d-9c95-db38e78744bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=94391e4486fe4cd1bf79937a5547a87c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:37.551749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46edde-09ac-4a6d-9c95-db38e78744bb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:37.900156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2b46edde-09ac-4a6d-9c95-db38e78744bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94391e4486fe4cd1bf79937a5547a87c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:37.919844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2b46edde-09ac-4a6d-9c95-db38e78744bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94391e4486fe4cd1bf79937a5547a87c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:38.043191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2b46edde-09ac-4a6d-9c95-db38e78744bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94391e4486fe4cd1bf79937a5547a87c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:38.046037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2b46edde-09ac-4a6d-9c95-db38e78744bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94391e4486fe4cd1bf79937a5547a87c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:38.115024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2b46edde-09ac-4a6d-9c95-db38e78744bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94391e4486fe4cd1bf79937a5547a87c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:38.122485 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1869/3685] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:19:37 2022] DELETE /identity/v3/users/94391e4486fe4cd1bf79937a5547a87c => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:38.128793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:38.153862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb7c7b-c750-4a8b-b34a-549954f614db admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:38.156049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4ffb7c7b-c750-4a8b-b34a-549954f614db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:38.182172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb7c7b-c750-4a8b-b34a-549954f614db admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:38.341946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:38.431589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6adef-e61d-45b9-b45b-9fb5f021c77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:38.435973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6adef-e61d-45b9-b45b-9fb5f021c77a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:38.437080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6adef-e61d-45b9-b45b-9fb5f021c77a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:38.438249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6adef-e61d-45b9-b45b-9fb5f021c77a admin admin] PATH_INFO: `/v3/projects/e353258f9c3048ef84683294e2b8579d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:38.449001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6adef-e61d-45b9-b45b-9fb5f021c77a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e353258f9c3048ef84683294e2b8579d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:38.459198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6adef-e61d-45b9-b45b-9fb5f021c77a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:38.680993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8bc6adef-e61d-45b9-b45b-9fb5f021c77a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e353258f9c3048ef84683294e2b8579d', 'request_id': 'req-8bc6adef-e61d-45b9-b45b-9fb5f021c77a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:38.688363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8bc6adef-e61d-45b9-b45b-9fb5f021c77a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e353258f9c3048ef84683294e2b8579d', 'request_id': 'req-8bc6adef-e61d-45b9-b45b-9fb5f021c77a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:38.695852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8bc6adef-e61d-45b9-b45b-9fb5f021c77a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e353258f9c3048ef84683294e2b8579d', 'request_id': 'req-8bc6adef-e61d-45b9-b45b-9fb5f021c77a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:38.802841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8bc6adef-e61d-45b9-b45b-9fb5f021c77a admin admin] The token cache is being invalidate because project e353258f9c3048ef84683294e2b8579d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:19:38.803392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8bc6adef-e61d-45b9-b45b-9fb5f021c77a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:38.814434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8bc6adef-e61d-45b9-b45b-9fb5f021c77a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:38.816682 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1817/3686] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:19:38 2022] DELETE /identity/v3/projects/e353258f9c3048ef84683294e2b8579d => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:38.825276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b669b16-2e73-44d3-a7c8-891ba5905527 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:38.825276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b669b16-2e73-44d3-a7c8-891ba5905527 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:38.825276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b669b16-2e73-44d3-a7c8-891ba5905527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:38.902137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0b669b16-2e73-44d3-a7c8-891ba5905527 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:38.907367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0b669b16-2e73-44d3-a7c8-891ba5905527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:39.171575 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1870/3687] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:39.175758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ea929-7ef5-4ff8-8f77-72e45d595b18 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:39.176609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ea929-7ef5-4ff8-8f77-72e45d595b18 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:39.177047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ea929-7ef5-4ff8-8f77-72e45d595b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:39.220626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3d3ea929-7ef5-4ff8-8f77-72e45d595b18 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:39.222247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3d3ea929-7ef5-4ff8-8f77-72e45d595b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:39.260535 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1818/3688] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:39.265177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b669b16-2e73-44d3-a7c8-891ba5905527 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:39.284545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b669b16-2e73-44d3-a7c8-891ba5905527 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:39.297046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608a543-ac9f-449f-9c32-e7114649cfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:39.298285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608a543-ac9f-449f-9c32-e7114649cfd1 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:39.298787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608a543-ac9f-449f-9c32-e7114649cfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:39.299290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608a543-ac9f-449f-9c32-e7114649cfd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:39.300412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608a543-ac9f-449f-9c32-e7114649cfd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:19:39.300931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608a543-ac9f-449f-9c32-e7114649cfd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:39.306101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608a543-ac9f-449f-9c32-e7114649cfd1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:39.395871 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1871/3689] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:19:39.401260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ea929-7ef5-4ff8-8f77-72e45d595b18 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:39.419439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ea929-7ef5-4ff8-8f77-72e45d595b18 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:39.434527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb02ce-2bc2-429f-a9e0-b48ca0118e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:39.435624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb02ce-2bc2-429f-a9e0-b48ca0118e92 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:39.436138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb02ce-2bc2-429f-a9e0-b48ca0118e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:39.436575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb02ce-2bc2-429f-a9e0-b48ca0118e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:39.437439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb02ce-2bc2-429f-a9e0-b48ca0118e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:39.442536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb02ce-2bc2-429f-a9e0-b48ca0118e92 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:39.631454 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1819/3690] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:19:39 2022] POST /identity/v3/projects => generated 395 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:39.637828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608a543-ac9f-449f-9c32-e7114649cfd1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:39.654701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608a543-ac9f-449f-9c32-e7114649cfd1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:39.778923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc8f5d-500a-4b18-a29d-5f20bfb10950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:39.779739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc8f5d-500a-4b18-a29d-5f20bfb10950 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:39.780026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc8f5d-500a-4b18-a29d-5f20bfb10950 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:39.780351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc8f5d-500a-4b18-a29d-5f20bfb10950 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:39.781206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc8f5d-500a-4b18-a29d-5f20bfb10950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:39.783765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc8f5d-500a-4b18-a29d-5f20bfb10950 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:39.909456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:39.926106 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1872/3691] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:19:39 2022] POST /identity/v3/users => generated 298 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:39.932049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb02ce-2bc2-429f-a9e0-b48ca0118e92 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:39.946768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb02ce-2bc2-429f-a9e0-b48ca0118e92 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:39.962825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e531345-01b4-4678-a53e-b9da6741f64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:39.963739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e531345-01b4-4678-a53e-b9da6741f64c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:39.964168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e531345-01b4-4678-a53e-b9da6741f64c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:39.964586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e531345-01b4-4678-a53e-b9da6741f64c admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:39.965753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e531345-01b4-4678-a53e-b9da6741f64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:39.973220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e531345-01b4-4678-a53e-b9da6741f64c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:40.007163 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1820/3692] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:40.007367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc8f5d-500a-4b18-a29d-5f20bfb10950 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:40.062220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc8f5d-500a-4b18-a29d-5f20bfb10950 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:40.074145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eea30f-7251-4b78-afa2-7c8cd72d75c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:40.074986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eea30f-7251-4b78-afa2-7c8cd72d75c2 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:40.075359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eea30f-7251-4b78-afa2-7c8cd72d75c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:40.075796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eea30f-7251-4b78-afa2-7c8cd72d75c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:40.076653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eea30f-7251-4b78-afa2-7c8cd72d75c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:40.078399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eea30f-7251-4b78-afa2-7c8cd72d75c2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:40.093757 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1873/3693] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:40.098336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e531345-01b4-4678-a53e-b9da6741f64c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:40.113652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e531345-01b4-4678-a53e-b9da6741f64c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:40.126886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f4bca-eaf1-4d73-8815-0044941e947d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:40.128297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f4bca-eaf1-4d73-8815-0044941e947d admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:40.128739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f4bca-eaf1-4d73-8815-0044941e947d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:40.129209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f4bca-eaf1-4d73-8815-0044941e947d admin admin] PATH_INFO: `/v3/projects/6f40e610a1bf49a2a6913c4c6c6735b6/users/27a08402c73946178157b98e3e4f1e82/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:40.148647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f4bca-eaf1-4d73-8815-0044941e947d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f40e610a1bf49a2a6913c4c6c6735b6, user_id=27a08402c73946178157b98e3e4f1e82, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:40.152229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f4bca-eaf1-4d73-8815-0044941e947d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:40.275245 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1821/3694] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:19:40 2022] PUT /identity/v3/projects/6f40e610a1bf49a2a6913c4c6c6735b6/users/27a08402c73946178157b98e3e4f1e82/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:40.276576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bc68b-439d-4bd4-99d1-300b09d2430f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:40.276922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bc68b-439d-4bd4-99d1-300b09d2430f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:40.277211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bc68b-439d-4bd4-99d1-300b09d2430f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:40.313878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-124bc68b-439d-4bd4-99d1-300b09d2430f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:40.315519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-124bc68b-439d-4bd4-99d1-300b09d2430f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:40.461359 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1874/3695] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:40.478572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f4bca-eaf1-4d73-8815-0044941e947d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:40.481504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a17f4bca-eaf1-4d73-8815-0044941e947d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:40.619280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f4bca-eaf1-4d73-8815-0044941e947d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:40.625283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4bda9-0f2d-4237-bd20-1aa9acfac868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:40.626114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4bda9-0f2d-4237-bd20-1aa9acfac868 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:40.627048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4bda9-0f2d-4237-bd20-1aa9acfac868 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:40.627828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4bda9-0f2d-4237-bd20-1aa9acfac868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:40.641479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4bda9-0f2d-4237-bd20-1aa9acfac868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:40.643763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4bda9-0f2d-4237-bd20-1aa9acfac868 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:40.660963 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1822/3696] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:19:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:19:40.860259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bc68b-439d-4bd4-99d1-300b09d2430f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:40.862882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-124bc68b-439d-4bd4-99d1-300b09d2430f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:40.863550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:40.884495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bc68b-439d-4bd4-99d1-300b09d2430f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:40.906153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfe59d-0ab5-4883-8fef-355c0a800a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:40.907531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfe59d-0ab5-4883-8fef-355c0a800a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:40.907968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfe59d-0ab5-4883-8fef-355c0a800a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:40.908425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfe59d-0ab5-4883-8fef-355c0a800a84 admin admin] PATH_INFO: `/v3/projects/a839a9676e7341fda1e9a11187ca68c0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:40.910304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfe59d-0ab5-4883-8fef-355c0a800a84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a839a9676e7341fda1e9a11187ca68c0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:40.915689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfe59d-0ab5-4883-8fef-355c0a800a84 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:41.185228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-62cfe59d-0ab5-4883-8fef-355c0a800a84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a839a9676e7341fda1e9a11187ca68c0', 'request_id': 'req-62cfe59d-0ab5-4883-8fef-355c0a800a84'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:41.204971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-62cfe59d-0ab5-4883-8fef-355c0a800a84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a839a9676e7341fda1e9a11187ca68c0', 'request_id': 'req-62cfe59d-0ab5-4883-8fef-355c0a800a84'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:41.219795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-62cfe59d-0ab5-4883-8fef-355c0a800a84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a839a9676e7341fda1e9a11187ca68c0', 'request_id': 'req-62cfe59d-0ab5-4883-8fef-355c0a800a84'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:41.348974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-62cfe59d-0ab5-4883-8fef-355c0a800a84 admin admin] The token cache is being invalidate because project a839a9676e7341fda1e9a11187ca68c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:19:41.349694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-62cfe59d-0ab5-4883-8fef-355c0a800a84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:41.351747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-62cfe59d-0ab5-4883-8fef-355c0a800a84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:41.354905 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1875/3697] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:19:40 2022] DELETE /identity/v3/projects/a839a9676e7341fda1e9a11187ca68c0 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:41.359920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd86f3-33e2-4ce8-a51a-d394e13c6407 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:41.360957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd86f3-33e2-4ce8-a51a-d394e13c6407 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:41.361393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd86f3-33e2-4ce8-a51a-d394e13c6407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:41.389850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2acd86f3-33e2-4ce8-a51a-d394e13c6407 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:41.391484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2acd86f3-33e2-4ce8-a51a-d394e13c6407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:41.487645 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1823/3698] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:41.497472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda967f-054c-463d-bec8-b00ce10c7e76 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:41.497758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda967f-054c-463d-bec8-b00ce10c7e76 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:41.498028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda967f-054c-463d-bec8-b00ce10c7e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:41.539604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2eda967f-054c-463d-bec8-b00ce10c7e76 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:41.540945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2eda967f-054c-463d-bec8-b00ce10c7e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:41.564960 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1876/3699] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:41.570381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd86f3-33e2-4ce8-a51a-d394e13c6407 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:41.586101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd86f3-33e2-4ce8-a51a-d394e13c6407 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:41.607103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0888dc7-a9ab-4779-9dcf-546ba01728e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:41.609795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0888dc7-a9ab-4779-9dcf-546ba01728e6 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:41.610411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0888dc7-a9ab-4779-9dcf-546ba01728e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:41.610846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0888dc7-a9ab-4779-9dcf-546ba01728e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:41.613589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0888dc7-a9ab-4779-9dcf-546ba01728e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:19:41.614092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0888dc7-a9ab-4779-9dcf-546ba01728e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:41.621918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0888dc7-a9ab-4779-9dcf-546ba01728e6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:41.694670 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1824/3700] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:19:41.696242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda967f-054c-463d-bec8-b00ce10c7e76 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:41.711832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda967f-054c-463d-bec8-b00ce10c7e76 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:41.732842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee1e29-599d-449b-a5c6-29aa521b5153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:41.738131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee1e29-599d-449b-a5c6-29aa521b5153 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:41.738762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee1e29-599d-449b-a5c6-29aa521b5153 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:41.742378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee1e29-599d-449b-a5c6-29aa521b5153 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:41.745052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee1e29-599d-449b-a5c6-29aa521b5153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:41.753724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee1e29-599d-449b-a5c6-29aa521b5153 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:41.915523 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1877/3701] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:19:41 2022] POST /identity/v3/projects => generated 371 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:19:41.919778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0888dc7-a9ab-4779-9dcf-546ba01728e6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:41.937197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0888dc7-a9ab-4779-9dcf-546ba01728e6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:42.027366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bb24f-94f7-479a-9a78-8fa358420b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:42.028677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bb24f-94f7-479a-9a78-8fa358420b1b admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:42.029499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bb24f-94f7-479a-9a78-8fa358420b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:42.029950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bb24f-94f7-479a-9a78-8fa358420b1b admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:42.030822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bb24f-94f7-479a-9a78-8fa358420b1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:42.032699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bb24f-94f7-479a-9a78-8fa358420b1b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:42.051347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:42.261587 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1825/3702] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:19:41 2022] POST /identity/v3/users => generated 286 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:19:42.264328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee1e29-599d-449b-a5c6-29aa521b5153 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:42.302577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee1e29-599d-449b-a5c6-29aa521b5153 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:42.333474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8f063-8dac-474f-99c6-4da282ea0e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:42.338019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8f063-8dac-474f-99c6-4da282ea0e09 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:42.339923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8f063-8dac-474f-99c6-4da282ea0e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:42.340467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8f063-8dac-474f-99c6-4da282ea0e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:42.343922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8f063-8dac-474f-99c6-4da282ea0e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:42.350094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8f063-8dac-474f-99c6-4da282ea0e09 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:42.384965 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1878/3703] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:42.389642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bb24f-94f7-479a-9a78-8fa358420b1b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:42.412746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bb24f-94f7-479a-9a78-8fa358420b1b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:42.425957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0fc92-b45a-470b-af1e-142c310d8454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:42.428239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0fc92-b45a-470b-af1e-142c310d8454 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:42.428735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0fc92-b45a-470b-af1e-142c310d8454 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:42.431784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0fc92-b45a-470b-af1e-142c310d8454 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:42.436126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0fc92-b45a-470b-af1e-142c310d8454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:42.448682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0fc92-b45a-470b-af1e-142c310d8454 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:42.486418 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1826/3704] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:42.490867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8f063-8dac-474f-99c6-4da282ea0e09 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:42.508803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8f063-8dac-474f-99c6-4da282ea0e09 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:42.523266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2741b-4545-4816-bfc8-49f2c22c7c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:42.524452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2741b-4545-4816-bfc8-49f2c22c7c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:42.524910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2741b-4545-4816-bfc8-49f2c22c7c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:42.525355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2741b-4545-4816-bfc8-49f2c22c7c27 admin admin] PATH_INFO: `/v3/projects/67cef6bbb8aa45699a91e9343c1646ec/users/b39d9ca4bd9541f19e1736a64de09eb4/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:42.565501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2741b-4545-4816-bfc8-49f2c22c7c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67cef6bbb8aa45699a91e9343c1646ec, user_id=b39d9ca4bd9541f19e1736a64de09eb4, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:42.568350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2741b-4545-4816-bfc8-49f2c22c7c27 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:42.752992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c10822-9b1a-413b-be2a-76fae055e9f4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:42.753374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c10822-9b1a-413b-be2a-76fae055e9f4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:42.753731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c10822-9b1a-413b-be2a-76fae055e9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:42.755234 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1879/3705] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:19:42 2022] PUT /identity/v3/projects/67cef6bbb8aa45699a91e9343c1646ec/users/b39d9ca4bd9541f19e1736a64de09eb4/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:42.832047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-79c10822-9b1a-413b-be2a-76fae055e9f4 None None] MFA Rules not processed for user `b39d9ca4bd9541f19e1736a64de09eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:42.836733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-79c10822-9b1a-413b-be2a-76fae055e9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:43.009585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2741b-4545-4816-bfc8-49f2c22c7c27 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:43.015576 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1827/3706] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:43.134503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2741b-4545-4816-bfc8-49f2c22c7c27 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:43.148666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c3259-d3b0-48bf-9023-9f1e53f22181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:43.151631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c3259-d3b0-48bf-9023-9f1e53f22181 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:43.151631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c3259-d3b0-48bf-9023-9f1e53f22181 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:43.151631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c3259-d3b0-48bf-9023-9f1e53f22181 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:43.151631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c3259-d3b0-48bf-9023-9f1e53f22181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:43.154898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c3259-d3b0-48bf-9023-9f1e53f22181 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:43.389093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c10822-9b1a-413b-be2a-76fae055e9f4 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:43.404940 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1880/3707] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:19:43 2022] POST /identity/v3/projects => generated 371 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:43.410240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c10822-9b1a-413b-be2a-76fae055e9f4 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:43.536634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9d923-9de5-4b5f-b4b1-82444bd58047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:43.537895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9d923-9de5-4b5f-b4b1-82444bd58047 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:43.538498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9d923-9de5-4b5f-b4b1-82444bd58047 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:43.539209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9d923-9de5-4b5f-b4b1-82444bd58047 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:43.540740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9d923-9de5-4b5f-b4b1-82444bd58047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:43.543040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9d923-9de5-4b5f-b4b1-82444bd58047 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:43.556782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:43.690683 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1828/3708] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:19:43 2022] POST /identity/v3/users => generated 292 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:43.694617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c3259-d3b0-48bf-9023-9f1e53f22181 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:43.715483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c3259-d3b0-48bf-9023-9f1e53f22181 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:43.730299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638d16e-06b0-4ba7-b1d7-53863bbcb1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:43.731606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638d16e-06b0-4ba7-b1d7-53863bbcb1cf admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:43.732255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638d16e-06b0-4ba7-b1d7-53863bbcb1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:43.732793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638d16e-06b0-4ba7-b1d7-53863bbcb1cf admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:43.737061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638d16e-06b0-4ba7-b1d7-53863bbcb1cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:43.739196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638d16e-06b0-4ba7-b1d7-53863bbcb1cf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:43.780159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9d923-9de5-4b5f-b4b1-82444bd58047 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:43.792128 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1881/3709] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:43.795889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9d923-9de5-4b5f-b4b1-82444bd58047 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:43.820392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb1d3c-27b5-4df3-9e41-beff168ce8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:43.822155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb1d3c-27b5-4df3-9e41-beff168ce8e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:43.822708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb1d3c-27b5-4df3-9e41-beff168ce8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:43.823246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb1d3c-27b5-4df3-9e41-beff168ce8e3 admin admin] PATH_INFO: `/v3/projects/cfa259c59a104ad3a8e1b87aed19b38a/users/abea7729e6784bb0b33fe9ae3c147c68/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:43.873210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb1d3c-27b5-4df3-9e41-beff168ce8e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa259c59a104ad3a8e1b87aed19b38a, user_id=abea7729e6784bb0b33fe9ae3c147c68, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:43.898842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb1d3c-27b5-4df3-9e41-beff168ce8e3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:43.998168 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1829/3710] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:19:43 2022] PUT /identity/v3/projects/cfa259c59a104ad3a8e1b87aed19b38a/users/abea7729e6784bb0b33fe9ae3c147c68/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:43.999940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638d16e-06b0-4ba7-b1d7-53863bbcb1cf admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:44.022680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638d16e-06b0-4ba7-b1d7-53863bbcb1cf admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:44.170989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb94ae3-f758-4b7c-9a49-df73f9b4c048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:44.171863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb94ae3-f758-4b7c-9a49-df73f9b4c048 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:44.172321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb94ae3-f758-4b7c-9a49-df73f9b4c048 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:44.172702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb94ae3-f758-4b7c-9a49-df73f9b4c048 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:44.173571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb94ae3-f758-4b7c-9a49-df73f9b4c048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:44.181632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb94ae3-f758-4b7c-9a49-df73f9b4c048 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:44.212644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb1d3c-27b5-4df3-9e41-beff168ce8e3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:44.223158 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1882/3711] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:19:44.228754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb1d3c-27b5-4df3-9e41-beff168ce8e3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:44.244828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740084e-7aef-44bd-82ce-95c1b87a229c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:44.245892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740084e-7aef-44bd-82ce-95c1b87a229c admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:44.246609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740084e-7aef-44bd-82ce-95c1b87a229c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:44.247034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740084e-7aef-44bd-82ce-95c1b87a229c admin admin] PATH_INFO: `/v3/projects/cfa259c59a104ad3a8e1b87aed19b38a/users/abea7729e6784bb0b33fe9ae3c147c68/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:44.253140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740084e-7aef-44bd-82ce-95c1b87a229c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa259c59a104ad3a8e1b87aed19b38a, user_id=abea7729e6784bb0b33fe9ae3c147c68, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:44.256090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740084e-7aef-44bd-82ce-95c1b87a229c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:44.288541 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1830/3712] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:19:44 2022] PUT /identity/v3/projects/cfa259c59a104ad3a8e1b87aed19b38a/users/abea7729e6784bb0b33fe9ae3c147c68/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:19:44.299875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f23ba0-aeb4-425d-8a60-9ee74990ce82 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:44.304020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f23ba0-aeb4-425d-8a60-9ee74990ce82 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:44.304020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f23ba0-aeb4-425d-8a60-9ee74990ce82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:44.366911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-50f23ba0-aeb4-425d-8a60-9ee74990ce82 None None] MFA Rules not processed for user `abea7729e6784bb0b33fe9ae3c147c68`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:44.375420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-50f23ba0-aeb4-425d-8a60-9ee74990ce82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:44.558323 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1883/3713] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:44 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:44.562727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740084e-7aef-44bd-82ce-95c1b87a229c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:44.584123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740084e-7aef-44bd-82ce-95c1b87a229c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:44.600898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26602178-4374-498e-8ae4-10347ba90a75 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:44.601987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26602178-4374-498e-8ae4-10347ba90a75 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:44.602439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26602178-4374-498e-8ae4-10347ba90a75 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:44.603237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26602178-4374-498e-8ae4-10347ba90a75 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:44.605094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26602178-4374-498e-8ae4-10347ba90a75 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:44.606177 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-26602178-4374-498e-8ae4-10347ba90a75 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:44.606177 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:19:44.606177 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:19:44.607117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26602178-4374-498e-8ae4-10347ba90a75 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:44.707335 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1831/3714] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:19:44 2022] POST /identity/v3/services => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:44.708470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f23ba0-aeb4-425d-8a60-9ee74990ce82 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:44.727580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f23ba0-aeb4-425d-8a60-9ee74990ce82 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:44.762369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6966d-10a7-4f60-8540-e62a03944e1a tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:44.763060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6966d-10a7-4f60-8540-e62a03944e1a tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:44.763349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6966d-10a7-4f60-8540-e62a03944e1a tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:44.763628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6966d-10a7-4f60-8540-e62a03944e1a tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:44.764478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6966d-10a7-4f60-8540-e62a03944e1a tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:44.765507 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-aab6966d-10a7-4f60-8540-e62a03944e1a tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:44.765507 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:19:44.765507 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:19:44.766412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6966d-10a7-4f60-8540-e62a03944e1a tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:44.976658 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-aab6966d-10a7-4f60-8540-e62a03944e1a tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-292581853. To ensure interoperability, identifiers should be a valid uuid. Jul 16 21:19:44.976658 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 16 21:19:44.976658 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:19:45.245959 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1884/3715] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Jul 16 21:19:44 2022] POST /identity/v3/endpoints => generated 359 bytes in 538 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:45.250044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26602178-4374-498e-8ae4-10347ba90a75 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:45.276381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26602178-4374-498e-8ae4-10347ba90a75 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:45.299190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828d13b-05e4-4f54-9f23-d9e33a8182ce tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:45.300070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828d13b-05e4-4f54-9f23-d9e33a8182ce tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:45.300553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828d13b-05e4-4f54-9f23-d9e33a8182ce tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:45.300997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828d13b-05e4-4f54-9f23-d9e33a8182ce tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/regions/tempest-region-292581853` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:45.303001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828d13b-05e4-4f54-9f23-d9e33a8182ce tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-292581853)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:45.304991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828d13b-05e4-4f54-9f23-d9e33a8182ce tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:45.307349 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1832/3716] 10.222.0.16 () {58 vars in 1202 bytes} [Sat Jul 16 21:19:45 2022] GET /identity/v3/regions/tempest-region-292581853 => generated 178 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:19:45.311657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6966d-10a7-4f60-8540-e62a03944e1a tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:45.326082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6966d-10a7-4f60-8540-e62a03944e1a tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:45.335186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:45.340081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd2647-79f9-45eb-b43d-042fc1a75da1 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:45.340976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd2647-79f9-45eb-b43d-042fc1a75da1 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:45.341431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd2647-79f9-45eb-b43d-042fc1a75da1 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:45.341793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd2647-79f9-45eb-b43d-042fc1a75da1 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:45.342747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd2647-79f9-45eb-b43d-042fc1a75da1 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:45.354906 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-f7bd2647-79f9-45eb-b43d-042fc1a75da1 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:45.354906 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:19:45.354906 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:19:45.362690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd2647-79f9-45eb-b43d-042fc1a75da1 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:45.503504 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1885/3717] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:19:45 2022] POST /identity/v3/services => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:45.507639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828d13b-05e4-4f54-9f23-d9e33a8182ce tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:45.523161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828d13b-05e4-4f54-9f23-d9e33a8182ce tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:45.564527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fca779-8f84-4bff-ae6a-c248f7f4059c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:45.565198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fca779-8f84-4bff-ae6a-c248f7f4059c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:45.565198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fca779-8f84-4bff-ae6a-c248f7f4059c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:45.565410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fca779-8f84-4bff-ae6a-c248f7f4059c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:45.566136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fca779-8f84-4bff-ae6a-c248f7f4059c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:45.567194 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-88fca779-8f84-4bff-ae6a-c248f7f4059c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:45.567194 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:19:45.567194 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:19:45.568078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fca779-8f84-4bff-ae6a-c248f7f4059c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:45.716491 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-88fca779-8f84-4bff-ae6a-c248f7f4059c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1341024243. To ensure interoperability, identifiers should be a valid uuid. Jul 16 21:19:45.716491 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 16 21:19:45.716491 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:19:45.879964 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1833/3718] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Jul 16 21:19:45 2022] POST /identity/v3/endpoints => generated 363 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:45.884715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd2647-79f9-45eb-b43d-042fc1a75da1 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:45.901173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd2647-79f9-45eb-b43d-042fc1a75da1 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:45.962707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beff979-6be5-4ab4-8041-44bc24c340d3 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:45.963837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beff979-6be5-4ab4-8041-44bc24c340d3 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:45.964634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beff979-6be5-4ab4-8041-44bc24c340d3 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:45.965894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beff979-6be5-4ab4-8041-44bc24c340d3 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/regions/tempest-region-1341024243` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:45.967690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beff979-6be5-4ab4-8041-44bc24c340d3 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1341024243)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:45.974195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beff979-6be5-4ab4-8041-44bc24c340d3 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:45.983273 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1886/3719] 10.222.0.16 () {58 vars in 1205 bytes} [Sat Jul 16 21:19:45 2022] GET /identity/v3/regions/tempest-region-1341024243 => generated 180 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:19:45.984817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fca779-8f84-4bff-ae6a-c248f7f4059c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:46.000779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fca779-8f84-4bff-ae6a-c248f7f4059c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:46.015650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24986194-39de-4cb1-a45b-149e194a8fea tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:46.017081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24986194-39de-4cb1-a45b-149e194a8fea tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:46.017532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24986194-39de-4cb1-a45b-149e194a8fea tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:46.017970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24986194-39de-4cb1-a45b-149e194a8fea tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:46.018908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24986194-39de-4cb1-a45b-149e194a8fea tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:46.020723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24986194-39de-4cb1-a45b-149e194a8fea tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:46.047662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ed0b3-22ef-4c6d-b778-7fbca3b728de None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:46.049234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ed0b3-22ef-4c6d-b778-7fbca3b728de None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:46.049764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ed0b3-22ef-4c6d-b778-7fbca3b728de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:46.096748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f04ed0b3-22ef-4c6d-b778-7fbca3b728de None None] MFA Rules not processed for user `1f72b1e0b4124480bfd53b5c22a343e0`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:46.098330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f04ed0b3-22ef-4c6d-b778-7fbca3b728de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:46.120021 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-24986194-39de-4cb1-a45b-149e194a8fea tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-369744987. To ensure interoperability, identifiers should be a valid uuid. Jul 16 21:19:46.120021 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 16 21:19:46.120021 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:19:46.228339 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1887/3720] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:46 2022] POST /identity/v3/auth/tokens => generated 3877 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:19:46.275217 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1834/3721] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Jul 16 21:19:45 2022] POST /identity/v3/endpoints => generated 359 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:46.278466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ed0b3-22ef-4c6d-b778-7fbca3b728de None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:46.331243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ed0b3-22ef-4c6d-b778-7fbca3b728de None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:46.364672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24986194-39de-4cb1-a45b-149e194a8fea tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:46.367370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-24986194-39de-4cb1-a45b-149e194a8fea tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:46.415193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb37a9e-4e25-491f-8084-13c8fbbbd66d tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:46.420819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb37a9e-4e25-491f-8084-13c8fbbbd66d tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:46.420819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb37a9e-4e25-491f-8084-13c8fbbbd66d tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:46.420819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb37a9e-4e25-491f-8084-13c8fbbbd66d tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/regions/tempest-region-369744987` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:46.420819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb37a9e-4e25-491f-8084-13c8fbbbd66d tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-369744987)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:46.429893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb37a9e-4e25-491f-8084-13c8fbbbd66d tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:46.439756 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1888/3722] 10.222.0.16 () {58 vars in 1202 bytes} [Sat Jul 16 21:19:46 2022] GET /identity/v3/regions/tempest-region-369744987 => generated 178 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:19:46.442191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb37a9e-4e25-491f-8084-13c8fbbbd66d tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:46.469725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb37a9e-4e25-491f-8084-13c8fbbbd66d tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:46.481940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dc45e-4a48-400a-8fa4-17b6eb582719 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:46.482607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dc45e-4a48-400a-8fa4-17b6eb582719 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:46.484474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dc45e-4a48-400a-8fa4-17b6eb582719 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:46.488588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dc45e-4a48-400a-8fa4-17b6eb582719 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:46.489553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557dc45e-4a48-400a-8fa4-17b6eb582719 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:46.492007 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-557dc45e-4a48-400a-8fa4-17b6eb582719 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:46.492007 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:19:46.492007 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:19:46.493450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557dc45e-4a48-400a-8fa4-17b6eb582719 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:46.520550 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1889/3723] 10.222.0.16 () {58 vars in 1133 bytes} [Sat Jul 16 21:19:46 2022] GET /identity/v3/endpoints => generated 4385 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:46.525017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dc45e-4a48-400a-8fa4-17b6eb582719 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:46.546721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dc45e-4a48-400a-8fa4-17b6eb582719 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:46.574911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ac729-6912-4029-9d29-38d541d8f2a7 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:46.576178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ac729-6912-4029-9d29-38d541d8f2a7 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:46.576473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ac729-6912-4029-9d29-38d541d8f2a7 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:46.576744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ac729-6912-4029-9d29-38d541d8f2a7 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/endpoints/967c40ac23a94412a8c87083d7f97ca0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:46.596168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ac729-6912-4029-9d29-38d541d8f2a7 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=967c40ac23a94412a8c87083d7f97ca0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:46.600601 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-1d8ac729-6912-4029-9d29-38d541d8f2a7 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:46.600601 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:19:46.600601 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:19:46.601787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ac729-6912-4029-9d29-38d541d8f2a7 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:46.609927 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1890/3724] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:19:46 2022] GET /identity/v3/endpoints/967c40ac23a94412a8c87083d7f97ca0 => generated 359 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:19:46.613812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ac729-6912-4029-9d29-38d541d8f2a7 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:46.617014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24986194-39de-4cb1-a45b-149e194a8fea tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:46.625658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:46.630773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ac729-6912-4029-9d29-38d541d8f2a7 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:46.635086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba08d3-63af-4f70-aac9-53c1e63fda02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:46.635915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba08d3-63af-4f70-aac9-53c1e63fda02 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:46.636740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba08d3-63af-4f70-aac9-53c1e63fda02 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:46.637024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba08d3-63af-4f70-aac9-53c1e63fda02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:46.647339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1cc617-09b4-484f-85cb-b10b0b9d9ea9 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:46.648218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1cc617-09b4-484f-85cb-b10b0b9d9ea9 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:46.648504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1cc617-09b4-484f-85cb-b10b0b9d9ea9 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:46.648782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1cc617-09b4-484f-85cb-b10b0b9d9ea9 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/endpoints/967c40ac23a94412a8c87083d7f97ca0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:46.651365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1cc617-09b4-484f-85cb-b10b0b9d9ea9 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=967c40ac23a94412a8c87083d7f97ca0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:46.652857 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-9b1cc617-09b4-484f-85cb-b10b0b9d9ea9 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:46.652857 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:19:46.652857 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:19:46.653737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1cc617-09b4-484f-85cb-b10b0b9d9ea9 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:46.656663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba08d3-63af-4f70-aac9-53c1e63fda02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:46.658288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba08d3-63af-4f70-aac9-53c1e63fda02 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:46.684983 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1835/3725] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:19:46 2022] GET /identity/v3/auth/tokens => generated 4060 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:19:46.761487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9b1cc617-09b4-484f-85cb-b10b0b9d9ea9 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '967c40ac23a94412a8c87083d7f97ca0', 'request_id': 'req-9b1cc617-09b4-484f-85cb-b10b0b9d9ea9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:46.781191 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1891/3726] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jul 16 21:19:46 2022] DELETE /identity/v3/endpoints/967c40ac23a94412a8c87083d7f97ca0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:46.785119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba08d3-63af-4f70-aac9-53c1e63fda02 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:46.802961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba08d3-63af-4f70-aac9-53c1e63fda02 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:46.838564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41665f4-483b-4a84-8ada-b10e6a7f2ad2 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:46.842008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41665f4-483b-4a84-8ada-b10e6a7f2ad2 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:46.847523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41665f4-483b-4a84-8ada-b10e6a7f2ad2 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:46.847523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41665f4-483b-4a84-8ada-b10e6a7f2ad2 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:46.847523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41665f4-483b-4a84-8ada-b10e6a7f2ad2 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:46.852040 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-c41665f4-483b-4a84-8ada-b10e6a7f2ad2 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:46.852040 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:19:46.852040 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:19:46.852988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41665f4-483b-4a84-8ada-b10e6a7f2ad2 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:46.894786 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1836/3727] 10.222.0.16 () {58 vars in 1133 bytes} [Sat Jul 16 21:19:46 2022] GET /identity/v3/endpoints => generated 4039 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:46.903434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1cc617-09b4-484f-85cb-b10b0b9d9ea9 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:46.919263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1cc617-09b4-484f-85cb-b10b0b9d9ea9 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:46.931861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356c1d2-ba87-4519-a471-5a9b5f1fd05c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:46.933024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356c1d2-ba87-4519-a471-5a9b5f1fd05c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:46.933531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356c1d2-ba87-4519-a471-5a9b5f1fd05c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:46.934012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356c1d2-ba87-4519-a471-5a9b5f1fd05c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/endpoints/967c40ac23a94412a8c87083d7f97ca0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:46.950183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356c1d2-ba87-4519-a471-5a9b5f1fd05c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 21:19:46.989798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-d356c1d2-ba87-4519-a471-5a9b5f1fd05c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Could not find endpoint: 967c40ac23a94412a8c87083d7f97ca0.: keystone.exception.EndpointNotFound: Could not find endpoint: 967c40ac23a94412a8c87083d7f97ca0. Jul 16 21:19:46.989798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:19:46.989798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Jul 16 21:19:46.989798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Jul 16 21:19:46.989798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 16 21:19:46.989798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._iter().one() Jul 16 21:19:46.989798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 16 21:19:46.989798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._only_one_row( Jul 16 21:19:46.989798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 16 21:19:46.989798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 16 21:19:46.989798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 16 21:19:46.989798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:19:46.989798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:19:46.989798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:19:46.989798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:19:46.989798 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Jul 16 21:19:46.993087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Jul 16 21:19:46.993087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Jul 16 21:19:46.993087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Jul 16 21:19:46.993087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Jul 16 21:19:46.993087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jul 16 21:19:46.993087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 967c40ac23a94412a8c87083d7f97ca0. Jul 16 21:19:46.993087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:19:46.993087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:19:46.993087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:19:46.993087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:19:46.993087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:19:46.993087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:19:46.993087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:19:46.993087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:19:46.993087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:19:46.993087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:19:46.993087 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:19:46.994245 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:19:46.994245 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:19:46.994245 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:19:46.994245 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Jul 16 21:19:46.994245 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Jul 16 21:19:46.994245 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 21:19:46.994245 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 21:19:46.994245 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 21:19:46.994245 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 21:19:46.994245 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:19:46.994245 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:19:46.994245 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:19:46.994245 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:19:46.994245 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:19:46.994245 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:19:46.994245 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:19:46.995547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 21:19:46.995547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:19:46.995547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:19:46.995547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:19:46.995547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:19:46.995547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:19:46.995547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:19:46.995547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:19:46.995547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:19:46.995547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Jul 16 21:19:46.995547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jul 16 21:19:46.995547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 967c40ac23a94412a8c87083d7f97ca0. Jul 16 21:19:46.995547 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:19:46.995547 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1892/3728] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jul 16 21:19:46 2022] DELETE /identity/v3/endpoints/967c40ac23a94412a8c87083d7f97ca0 => generated 114 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:19:46.997654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41665f4-483b-4a84-8ada-b10e6a7f2ad2 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:47.012879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41665f4-483b-4a84-8ada-b10e6a7f2ad2 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:47.029955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c8bc1-5262-40c4-9eb4-4f7389510e47 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:47.030830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c8bc1-5262-40c4-9eb4-4f7389510e47 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:47.031148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c8bc1-5262-40c4-9eb4-4f7389510e47 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:47.031492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c8bc1-5262-40c4-9eb4-4f7389510e47 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/regions/tempest-region-369744987` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:47.032162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c8bc1-5262-40c4-9eb4-4f7389510e47 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-369744987)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:47.033341 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-7a5c8bc1-5262-40c4-9eb4-4f7389510e47 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:47.033341 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:19:47.033341 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:19:47.034241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c8bc1-5262-40c4-9eb4-4f7389510e47 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:47.220566 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1837/3729] 10.222.0.16 () {58 vars in 1205 bytes} [Sat Jul 16 21:19:46 2022] DELETE /identity/v3/regions/tempest-region-369744987 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:47.226806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356c1d2-ba87-4519-a471-5a9b5f1fd05c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:47.242734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356c1d2-ba87-4519-a471-5a9b5f1fd05c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:47.296426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202dd25d-1a64-4af9-b932-b1ea3955887b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:47.298056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202dd25d-1a64-4af9-b932-b1ea3955887b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:47.298529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202dd25d-1a64-4af9-b932-b1ea3955887b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:47.298966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202dd25d-1a64-4af9-b932-b1ea3955887b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:47.299943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202dd25d-1a64-4af9-b932-b1ea3955887b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:47.302483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202dd25d-1a64-4af9-b932-b1ea3955887b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:47.314799 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1893/3730] 10.222.0.16 () {58 vars in 1133 bytes} [Sat Jul 16 21:19:47 2022] GET /identity/v3/endpoints => generated 4039 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:47.325890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c8bc1-5262-40c4-9eb4-4f7389510e47 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:47.336571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c8bc1-5262-40c4-9eb4-4f7389510e47 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:47.342686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498b07d-0b07-43ef-bac8-d4a35eb9fce4 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:47.344130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498b07d-0b07-43ef-bac8-d4a35eb9fce4 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:47.344627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498b07d-0b07-43ef-bac8-d4a35eb9fce4 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:47.344909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498b07d-0b07-43ef-bac8-d4a35eb9fce4 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:47.346030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498b07d-0b07-43ef-bac8-d4a35eb9fce4 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Adding query filter params (service_id=b4600013692d4a2fb3b2bec4aeb5bfba) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:19:47.346846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498b07d-0b07-43ef-bac8-d4a35eb9fce4 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:47.348957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498b07d-0b07-43ef-bac8-d4a35eb9fce4 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:47.358155 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1838/3731] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Jul 16 21:19:47 2022] GET /identity/v3/endpoints?service_id=b4600013692d4a2fb3b2bec4aeb5bfba => generated 501 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:19:47.363659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202dd25d-1a64-4af9-b932-b1ea3955887b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:47.374198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202dd25d-1a64-4af9-b932-b1ea3955887b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:47.380310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27841629-7dc5-4e4d-98e0-c596ea4e898b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:47.381678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27841629-7dc5-4e4d-98e0-c596ea4e898b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:47.382247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27841629-7dc5-4e4d-98e0-c596ea4e898b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:47.383291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27841629-7dc5-4e4d-98e0-c596ea4e898b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:47.384263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27841629-7dc5-4e4d-98e0-c596ea4e898b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Adding query filter params (service_id=0ce3005245c84b0a8c457f1cbf0f2b88) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:19:47.384727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27841629-7dc5-4e4d-98e0-c596ea4e898b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:47.386777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27841629-7dc5-4e4d-98e0-c596ea4e898b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:47.395831 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1894/3732] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Jul 16 21:19:47 2022] GET /identity/v3/endpoints?service_id=0ce3005245c84b0a8c457f1cbf0f2b88 => generated 505 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:19:47.401322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498b07d-0b07-43ef-bac8-d4a35eb9fce4 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:47.413425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498b07d-0b07-43ef-bac8-d4a35eb9fce4 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:47.421129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c387d8-c2bb-4b6b-b65a-0b063ffbe51b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:47.422230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c387d8-c2bb-4b6b-b65a-0b063ffbe51b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:47.422686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c387d8-c2bb-4b6b-b65a-0b063ffbe51b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:47.423341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c387d8-c2bb-4b6b-b65a-0b063ffbe51b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:47.424375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c387d8-c2bb-4b6b-b65a-0b063ffbe51b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:19:47.425097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c387d8-c2bb-4b6b-b65a-0b063ffbe51b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:47.427591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c387d8-c2bb-4b6b-b65a-0b063ffbe51b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:47.448253 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1839/3733] 10.222.0.16 () {58 vars in 1166 bytes} [Sat Jul 16 21:19:47 2022] GET /identity/v3/endpoints?interface=public => generated 3394 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:47.449380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27841629-7dc5-4e4d-98e0-c596ea4e898b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:47.463703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27841629-7dc5-4e4d-98e0-c596ea4e898b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:47.469615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453c665-4b28-406c-b924-f4ad0042750d tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:47.470585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453c665-4b28-406c-b924-f4ad0042750d tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:47.471655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453c665-4b28-406c-b924-f4ad0042750d tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:47.472095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453c665-4b28-406c-b924-f4ad0042750d tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:47.474279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453c665-4b28-406c-b924-f4ad0042750d tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:19:47.475257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453c665-4b28-406c-b924-f4ad0042750d tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:47.479495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453c665-4b28-406c-b924-f4ad0042750d tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:47.497611 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1895/3734] 10.222.0.16 () {58 vars in 1170 bytes} [Sat Jul 16 21:19:47 2022] GET /identity/v3/endpoints?interface=internal => generated 480 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:19:47.505602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c387d8-c2bb-4b6b-b65a-0b063ffbe51b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:47.518358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c387d8-c2bb-4b6b-b65a-0b063ffbe51b tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:47.526038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebd21b-dcad-4eb2-a839-6ad220681d63 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:47.527084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebd21b-dcad-4eb2-a839-6ad220681d63 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:47.527594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebd21b-dcad-4eb2-a839-6ad220681d63 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:47.528110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebd21b-dcad-4eb2-a839-6ad220681d63 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:47.529048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ebd21b-dcad-4eb2-a839-6ad220681d63 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:47.536898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ebd21b-dcad-4eb2-a839-6ad220681d63 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:47.639557 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1840/3735] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:19:47 2022] POST /identity/v3/services => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:47.643393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453c665-4b28-406c-b924-f4ad0042750d tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:47.654845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453c665-4b28-406c-b924-f4ad0042750d tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:47.675901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb34e6-22be-4a5f-850c-aab2f9073af8 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:47.676764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb34e6-22be-4a5f-850c-aab2f9073af8 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:47.677235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb34e6-22be-4a5f-850c-aab2f9073af8 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:47.679291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb34e6-22be-4a5f-850c-aab2f9073af8 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:47.680243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb34e6-22be-4a5f-850c-aab2f9073af8 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:47.682159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb34e6-22be-4a5f-850c-aab2f9073af8 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:47.862192 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-e8fb34e6-22be-4a5f-850c-aab2f9073af8 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-936025066. To ensure interoperability, identifiers should be a valid uuid. Jul 16 21:19:47.862192 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 16 21:19:47.862192 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:19:48.035693 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1896/3736] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Jul 16 21:19:47 2022] POST /identity/v3/endpoints => generated 357 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:48.036912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebd21b-dcad-4eb2-a839-6ad220681d63 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:48.056761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebd21b-dcad-4eb2-a839-6ad220681d63 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:48.101479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27094c90-aefb-4d45-9d05-18272a44c55e tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:48.102390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27094c90-aefb-4d45-9d05-18272a44c55e tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:48.102862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27094c90-aefb-4d45-9d05-18272a44c55e tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:48.114863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27094c90-aefb-4d45-9d05-18272a44c55e tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/regions/tempest-region-936025066` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:48.114863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27094c90-aefb-4d45-9d05-18272a44c55e tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-936025066)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:48.114863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27094c90-aefb-4d45-9d05-18272a44c55e tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:48.114863 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1841/3737] 10.222.0.16 () {58 vars in 1202 bytes} [Sat Jul 16 21:19:48 2022] GET /identity/v3/regions/tempest-region-936025066 => generated 178 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:19:48.115400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb34e6-22be-4a5f-850c-aab2f9073af8 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:48.125377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb34e6-22be-4a5f-850c-aab2f9073af8 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:48.130876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0beb531-da42-4658-a9d7-9ac65eb72255 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:48.133681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beb531-da42-4658-a9d7-9ac65eb72255 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:48.134763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beb531-da42-4658-a9d7-9ac65eb72255 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:48.135165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beb531-da42-4658-a9d7-9ac65eb72255 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/endpoints/b30a2eeaa4da4c4a84b7a5de8a8d3080` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:48.142884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0beb531-da42-4658-a9d7-9ac65eb72255 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=b30a2eeaa4da4c4a84b7a5de8a8d3080)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:48.144112 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-d0beb531-da42-4658-a9d7-9ac65eb72255 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:48.144112 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:19:48.144112 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:19:48.145031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0beb531-da42-4658-a9d7-9ac65eb72255 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:48.315797 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-d0beb531-da42-4658-a9d7-9ac65eb72255 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-939858757. To ensure interoperability, identifiers should be a valid uuid. Jul 16 21:19:48.315797 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 16 21:19:48.315797 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:19:48.560124 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1897/3738] 10.222.0.16 () {60 vars in 1255 bytes} [Sat Jul 16 21:19:48 2022] PATCH /identity/v3/endpoints/b30a2eeaa4da4c4a84b7a5de8a8d3080 => generated 361 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:19:48.564642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27094c90-aefb-4d45-9d05-18272a44c55e tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:48.598630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27094c90-aefb-4d45-9d05-18272a44c55e tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:48.641074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb20367-ffc0-4d50-8996-177418385102 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:48.642689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb20367-ffc0-4d50-8996-177418385102 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:48.643252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb20367-ffc0-4d50-8996-177418385102 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:48.643988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb20367-ffc0-4d50-8996-177418385102 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/regions/tempest-region-939858757` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:48.644813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb20367-ffc0-4d50-8996-177418385102 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-939858757)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:48.646082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb20367-ffc0-4d50-8996-177418385102 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:48.649619 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1842/3739] 10.222.0.16 () {58 vars in 1202 bytes} [Sat Jul 16 21:19:48 2022] GET /identity/v3/regions/tempest-region-939858757 => generated 178 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:19:48.654415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0beb531-da42-4658-a9d7-9ac65eb72255 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:48.673847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0beb531-da42-4658-a9d7-9ac65eb72255 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:48.686793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a531ee-f981-47e0-bef0-ccef82aa28e0 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:48.687749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a531ee-f981-47e0-bef0-ccef82aa28e0 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:48.688038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a531ee-f981-47e0-bef0-ccef82aa28e0 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:48.688442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a531ee-f981-47e0-bef0-ccef82aa28e0 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/endpoints/b30a2eeaa4da4c4a84b7a5de8a8d3080` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:48.694880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a531ee-f981-47e0-bef0-ccef82aa28e0 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=b30a2eeaa4da4c4a84b7a5de8a8d3080)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:48.697175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a531ee-f981-47e0-bef0-ccef82aa28e0 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:48.779427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-47a531ee-f981-47e0-bef0-ccef82aa28e0 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'b30a2eeaa4da4c4a84b7a5de8a8d3080', 'request_id': 'req-47a531ee-f981-47e0-bef0-ccef82aa28e0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:48.796049 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1898/3740] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jul 16 21:19:48 2022] DELETE /identity/v3/endpoints/b30a2eeaa4da4c4a84b7a5de8a8d3080 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:48.799262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb20367-ffc0-4d50-8996-177418385102 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:48.816264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb20367-ffc0-4d50-8996-177418385102 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:48.851886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050c3cb-3ac5-4a0c-abdc-0fefa429334c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:48.853108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050c3cb-3ac5-4a0c-abdc-0fefa429334c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:48.853770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050c3cb-3ac5-4a0c-abdc-0fefa429334c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:48.854297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050c3cb-3ac5-4a0c-abdc-0fefa429334c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/regions/tempest-region-939858757` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:48.855218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050c3cb-3ac5-4a0c-abdc-0fefa429334c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-939858757)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:48.862878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050c3cb-3ac5-4a0c-abdc-0fefa429334c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:49.005620 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-e050c3cb-3ac5-4a0c-abdc-0fefa429334c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-939858757. To ensure interoperability, identifiers should be a valid uuid. Jul 16 21:19:49.005620 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 16 21:19:49.005620 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:19:49.018144 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1843/3741] 10.222.0.16 () {58 vars in 1205 bytes} [Sat Jul 16 21:19:48 2022] DELETE /identity/v3/regions/tempest-region-939858757 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:49.019538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a531ee-f981-47e0-bef0-ccef82aa28e0 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:49.047623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a531ee-f981-47e0-bef0-ccef82aa28e0 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:49.089841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab6eb8-1131-4638-bf05-3ab4cbb88bad tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:49.091829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab6eb8-1131-4638-bf05-3ab4cbb88bad tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:49.092278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab6eb8-1131-4638-bf05-3ab4cbb88bad tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:49.092708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab6eb8-1131-4638-bf05-3ab4cbb88bad tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/regions/tempest-region-936025066` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:49.093531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab6eb8-1131-4638-bf05-3ab4cbb88bad tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-936025066)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:49.100384 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-c5ab6eb8-1131-4638-bf05-3ab4cbb88bad tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:49.100384 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:19:49.100384 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:19:49.101537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab6eb8-1131-4638-bf05-3ab4cbb88bad tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:49.243112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:49.255492 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1899/3742] 10.222.0.16 () {58 vars in 1205 bytes} [Sat Jul 16 21:19:49 2022] DELETE /identity/v3/regions/tempest-region-936025066 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:49.257393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050c3cb-3ac5-4a0c-abdc-0fefa429334c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:49.273746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050c3cb-3ac5-4a0c-abdc-0fefa429334c tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:49.319609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8a916-218f-4550-ba23-8f334b47e4a7 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:49.320843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8a916-218f-4550-ba23-8f334b47e4a7 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:49.321229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8a916-218f-4550-ba23-8f334b47e4a7 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:49.322778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8a916-218f-4550-ba23-8f334b47e4a7 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/services/2f1146f49e29489eaf9a0c6992fefe95` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:49.323711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8a916-218f-4550-ba23-8f334b47e4a7 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:delete_service(service_id=2f1146f49e29489eaf9a0c6992fefe95)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:49.324752 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-edb8a916-218f-4550-ba23-8f334b47e4a7 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:49.324752 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:19:49.324752 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:19:49.326676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8a916-218f-4550-ba23-8f334b47e4a7 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:49.389174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:49.485265 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1844/3743] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:19:49 2022] DELETE /identity/v3/services/2f1146f49e29489eaf9a0c6992fefe95 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:49.491418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab6eb8-1131-4638-bf05-3ab4cbb88bad tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:49.510988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab6eb8-1131-4638-bf05-3ab4cbb88bad tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:49.555251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bffd98-22ba-43ba-8566-ccbed2dbddb5 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:49.555251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bffd98-22ba-43ba-8566-ccbed2dbddb5 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:49.555251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bffd98-22ba-43ba-8566-ccbed2dbddb5 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:49.555506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bffd98-22ba-43ba-8566-ccbed2dbddb5 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/endpoints/5864d49e3a234f9280bc56c7ae2e105e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:49.568718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bffd98-22ba-43ba-8566-ccbed2dbddb5 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=5864d49e3a234f9280bc56c7ae2e105e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:49.570941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bffd98-22ba-43ba-8566-ccbed2dbddb5 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:49.681676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-37bffd98-22ba-43ba-8566-ccbed2dbddb5 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '5864d49e3a234f9280bc56c7ae2e105e', 'request_id': 'req-37bffd98-22ba-43ba-8566-ccbed2dbddb5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:49.696533 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1900/3744] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jul 16 21:19:49 2022] DELETE /identity/v3/endpoints/5864d49e3a234f9280bc56c7ae2e105e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:49.700569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8a916-218f-4550-ba23-8f334b47e4a7 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:49.715062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8a916-218f-4550-ba23-8f334b47e4a7 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:49.732696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f2610-820e-4424-b241-42d8303469f2 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:49.733954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f2610-820e-4424-b241-42d8303469f2 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:49.736498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f2610-820e-4424-b241-42d8303469f2 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:49.736498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f2610-820e-4424-b241-42d8303469f2 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/regions/tempest-region-1341024243` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:49.736498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f2610-820e-4424-b241-42d8303469f2 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1341024243)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:49.737758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f2610-820e-4424-b241-42d8303469f2 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:49.848673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bffd98-22ba-43ba-8566-ccbed2dbddb5 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:49.872700 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1845/3745] 10.222.0.16 () {58 vars in 1208 bytes} [Sat Jul 16 21:19:49 2022] DELETE /identity/v3/regions/tempest-region-1341024243 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:49.877767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bffd98-22ba-43ba-8566-ccbed2dbddb5 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:49.916576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06245b-8ee6-422f-a5df-0814e52c8f05 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:49.917786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06245b-8ee6-422f-a5df-0814e52c8f05 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:49.918317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06245b-8ee6-422f-a5df-0814e52c8f05 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:49.918864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06245b-8ee6-422f-a5df-0814e52c8f05 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/services/0ce3005245c84b0a8c457f1cbf0f2b88` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:49.920594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06245b-8ee6-422f-a5df-0814e52c8f05 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0ce3005245c84b0a8c457f1cbf0f2b88)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:49.921854 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-7f06245b-8ee6-422f-a5df-0814e52c8f05 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:49.921854 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:19:49.921854 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:19:49.923318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06245b-8ee6-422f-a5df-0814e52c8f05 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:50.048916 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1901/3746] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:19:49 2022] DELETE /identity/v3/services/0ce3005245c84b0a8c457f1cbf0f2b88 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:50.053387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f2610-820e-4424-b241-42d8303469f2 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:50.069598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f2610-820e-4424-b241-42d8303469f2 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:50.106207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc03e41-818f-4345-ab2d-5b3501e3451a tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:50.107510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc03e41-818f-4345-ab2d-5b3501e3451a tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:50.108153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc03e41-818f-4345-ab2d-5b3501e3451a tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:50.108657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc03e41-818f-4345-ab2d-5b3501e3451a tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/endpoints/09511652a9634554aeefc4f3dc4aad35` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:50.127806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc03e41-818f-4345-ab2d-5b3501e3451a tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=09511652a9634554aeefc4f3dc4aad35)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:50.129270 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-bcc03e41-818f-4345-ab2d-5b3501e3451a tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:50.129270 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:19:50.129270 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:19:50.130992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc03e41-818f-4345-ab2d-5b3501e3451a tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:50.280539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bcc03e41-818f-4345-ab2d-5b3501e3451a tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '09511652a9634554aeefc4f3dc4aad35', 'request_id': 'req-bcc03e41-818f-4345-ab2d-5b3501e3451a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:50.308329 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1846/3747] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jul 16 21:19:50 2022] DELETE /identity/v3/endpoints/09511652a9634554aeefc4f3dc4aad35 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:50.313123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06245b-8ee6-422f-a5df-0814e52c8f05 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:50.350443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06245b-8ee6-422f-a5df-0814e52c8f05 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:50.394449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089d4f1-0e72-4bc9-961e-5ba3585080e1 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:50.395510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089d4f1-0e72-4bc9-961e-5ba3585080e1 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:50.395798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089d4f1-0e72-4bc9-961e-5ba3585080e1 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:50.396080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089d4f1-0e72-4bc9-961e-5ba3585080e1 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/regions/tempest-region-292581853` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:50.397613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089d4f1-0e72-4bc9-961e-5ba3585080e1 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-292581853)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:50.400827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089d4f1-0e72-4bc9-961e-5ba3585080e1 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:50.536734 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1902/3748] 10.222.0.16 () {58 vars in 1205 bytes} [Sat Jul 16 21:19:50 2022] DELETE /identity/v3/regions/tempest-region-292581853 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:50.542423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc03e41-818f-4345-ab2d-5b3501e3451a tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:50.559536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc03e41-818f-4345-ab2d-5b3501e3451a tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:50.606017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6092918-90d1-4a88-ac40-c3faebeb20bf tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abea7729e6784bb0b33fe9ae3c147c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa259c59a104ad3a8e1b87aed19b38a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:50.612930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6092918-90d1-4a88-ac40-c3faebeb20bf tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:50.612930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6092918-90d1-4a88-ac40-c3faebeb20bf tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:50.612930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6092918-90d1-4a88-ac40-c3faebeb20bf tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] PATH_INFO: `/v3/services/b4600013692d4a2fb3b2bec4aeb5bfba` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:50.612930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6092918-90d1-4a88-ac40-c3faebeb20bf tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b4600013692d4a2fb3b2bec4aeb5bfba)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:50.612930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6092918-90d1-4a88-ac40-c3faebeb20bf tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:50.757078 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1847/3749] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:19:50 2022] DELETE /identity/v3/services/b4600013692d4a2fb3b2bec4aeb5bfba => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:50.760839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089d4f1-0e72-4bc9-961e-5ba3585080e1 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:51.015552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089d4f1-0e72-4bc9-961e-5ba3585080e1 tempest-EndPointsTestJSON-1343325242 tempest-EndPointsTestJSON-1343325242-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:51.023687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:51.082422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f8594-8ab4-4081-855d-2f0e670cae07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:51.083686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f8594-8ab4-4081-855d-2f0e670cae07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:51.084176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f8594-8ab4-4081-855d-2f0e670cae07 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:51.084716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f8594-8ab4-4081-855d-2f0e670cae07 admin admin] PATH_INFO: `/v3/users/b39d9ca4bd9541f19e1736a64de09eb4` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:51.086523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f8594-8ab4-4081-855d-2f0e670cae07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b39d9ca4bd9541f19e1736a64de09eb4)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:51.088704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f8594-8ab4-4081-855d-2f0e670cae07 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:51.413792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0e8f8594-8ab4-4081-855d-2f0e670cae07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b39d9ca4bd9541f19e1736a64de09eb4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:51.424076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0e8f8594-8ab4-4081-855d-2f0e670cae07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b39d9ca4bd9541f19e1736a64de09eb4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:51.501038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0e8f8594-8ab4-4081-855d-2f0e670cae07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b39d9ca4bd9541f19e1736a64de09eb4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:51.501983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0e8f8594-8ab4-4081-855d-2f0e670cae07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b39d9ca4bd9541f19e1736a64de09eb4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:51.566326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0e8f8594-8ab4-4081-855d-2f0e670cae07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b39d9ca4bd9541f19e1736a64de09eb4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:51.577738 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1903/3750] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:19:50 2022] DELETE /identity/v3/users/b39d9ca4bd9541f19e1736a64de09eb4 => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:51.582343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dd1ca-8b0a-497d-8469-55220d699e7f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:51.582654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dd1ca-8b0a-497d-8469-55220d699e7f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:51.583118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dd1ca-8b0a-497d-8469-55220d699e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:51.614291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ff7dd1ca-8b0a-497d-8469-55220d699e7f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:51.620444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ff7dd1ca-8b0a-497d-8469-55220d699e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:51.782049 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1848/3751] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:51.824979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f8594-8ab4-4081-855d-2f0e670cae07 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:51.827826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0e8f8594-8ab4-4081-855d-2f0e670cae07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:52.008123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f8594-8ab4-4081-855d-2f0e670cae07 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:52.016373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8a343-31be-4760-8db3-00c529c56160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:52.024197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8a343-31be-4760-8db3-00c529c56160 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:52.024864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8a343-31be-4760-8db3-00c529c56160 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:52.025249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8a343-31be-4760-8db3-00c529c56160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:52.039955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:52.047935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8a343-31be-4760-8db3-00c529c56160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:52.050022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8a343-31be-4760-8db3-00c529c56160 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:52.075998 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1904/3752] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:19:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:19:53.023053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99c4c0-85eb-4e08-85e1-120060b91456 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:53.023601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99c4c0-85eb-4e08-85e1-120060b91456 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:53.023698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99c4c0-85eb-4e08-85e1-120060b91456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:53.081161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-bf99c4c0-85eb-4e08-85e1-120060b91456 None None] MFA Rules not processed for user `1f72b1e0b4124480bfd53b5c22a343e0`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:53.088140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bf99c4c0-85eb-4e08-85e1-120060b91456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:53.199692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8a343-31be-4760-8db3-00c529c56160 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:53.201535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-28d8a343-31be-4760-8db3-00c529c56160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:53.234646 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1849/3753] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:53.259847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8a343-31be-4760-8db3-00c529c56160 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:53.277838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd8e33-a490-4f03-a153-8aa8335bbe78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:53.279918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd8e33-a490-4f03-a153-8aa8335bbe78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:53.280611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd8e33-a490-4f03-a153-8aa8335bbe78 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:53.284300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd8e33-a490-4f03-a153-8aa8335bbe78 admin admin] PATH_INFO: `/v3/projects/67cef6bbb8aa45699a91e9343c1646ec` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:53.287986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd8e33-a490-4f03-a153-8aa8335bbe78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67cef6bbb8aa45699a91e9343c1646ec)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:53.293702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd8e33-a490-4f03-a153-8aa8335bbe78 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:53.519546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-67fd8e33-a490-4f03-a153-8aa8335bbe78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67cef6bbb8aa45699a91e9343c1646ec', 'request_id': 'req-67fd8e33-a490-4f03-a153-8aa8335bbe78'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:53.539675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-67fd8e33-a490-4f03-a153-8aa8335bbe78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67cef6bbb8aa45699a91e9343c1646ec', 'request_id': 'req-67fd8e33-a490-4f03-a153-8aa8335bbe78'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:53.556535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-67fd8e33-a490-4f03-a153-8aa8335bbe78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67cef6bbb8aa45699a91e9343c1646ec', 'request_id': 'req-67fd8e33-a490-4f03-a153-8aa8335bbe78'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:53.648114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-67fd8e33-a490-4f03-a153-8aa8335bbe78 admin admin] The token cache is being invalidate because project 67cef6bbb8aa45699a91e9343c1646ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:19:53.648701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-67fd8e33-a490-4f03-a153-8aa8335bbe78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:53.649457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-67fd8e33-a490-4f03-a153-8aa8335bbe78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:53.651154 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1905/3754] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:19:53 2022] DELETE /identity/v3/projects/67cef6bbb8aa45699a91e9343c1646ec => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:53.655244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99c4c0-85eb-4e08-85e1-120060b91456 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:53.669320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:53.677562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99c4c0-85eb-4e08-85e1-120060b91456 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:53.745619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:53.819396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21514ac-ff12-410d-8a5e-2231e3fd5bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:53.821639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21514ac-ff12-410d-8a5e-2231e3fd5bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:53.822223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21514ac-ff12-410d-8a5e-2231e3fd5bad admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:53.823184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21514ac-ff12-410d-8a5e-2231e3fd5bad admin admin] PATH_INFO: `/v3/users/abea7729e6784bb0b33fe9ae3c147c68` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:53.825364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21514ac-ff12-410d-8a5e-2231e3fd5bad admin admin] RBAC: Authorizing `identity:delete_user(user_id=abea7729e6784bb0b33fe9ae3c147c68)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:53.828030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21514ac-ff12-410d-8a5e-2231e3fd5bad admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:54.058702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d21514ac-ff12-410d-8a5e-2231e3fd5bad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abea7729e6784bb0b33fe9ae3c147c68'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:54.080828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d21514ac-ff12-410d-8a5e-2231e3fd5bad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abea7729e6784bb0b33fe9ae3c147c68'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:54.250999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d21514ac-ff12-410d-8a5e-2231e3fd5bad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abea7729e6784bb0b33fe9ae3c147c68'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:54.260525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d21514ac-ff12-410d-8a5e-2231e3fd5bad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abea7729e6784bb0b33fe9ae3c147c68'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:54.261255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d21514ac-ff12-410d-8a5e-2231e3fd5bad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abea7729e6784bb0b33fe9ae3c147c68'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:54.268243 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1850/3755] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:19:53 2022] DELETE /identity/v3/users/abea7729e6784bb0b33fe9ae3c147c68 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:54.690292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421f011-2c2d-4d2a-8d66-60ce2c2cc861 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:54.691145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421f011-2c2d-4d2a-8d66-60ce2c2cc861 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:54.691594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421f011-2c2d-4d2a-8d66-60ce2c2cc861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:54.736923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2421f011-2c2d-4d2a-8d66-60ce2c2cc861 None None] MFA Rules not processed for user `fe680ccdc60e410b812794de8aa73e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:54.739044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2421f011-2c2d-4d2a-8d66-60ce2c2cc861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:54.765326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21514ac-ff12-410d-8a5e-2231e3fd5bad admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:54.768579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d21514ac-ff12-410d-8a5e-2231e3fd5bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:54.857646 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1906/3756] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:54.859629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421f011-2c2d-4d2a-8d66-60ce2c2cc861 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:54.861829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2421f011-2c2d-4d2a-8d66-60ce2c2cc861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:54.963765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21514ac-ff12-410d-8a5e-2231e3fd5bad admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:54.975648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399706de-5f3e-4b6a-9f2b-faf09fd71e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:54.976635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399706de-5f3e-4b6a-9f2b-faf09fd71e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:54.977269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399706de-5f3e-4b6a-9f2b-faf09fd71e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:54.977709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399706de-5f3e-4b6a-9f2b-faf09fd71e2c admin admin] PATH_INFO: `/v3/projects/cfa259c59a104ad3a8e1b87aed19b38a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:54.979273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399706de-5f3e-4b6a-9f2b-faf09fd71e2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa259c59a104ad3a8e1b87aed19b38a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:54.981399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399706de-5f3e-4b6a-9f2b-faf09fd71e2c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:55.012576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421f011-2c2d-4d2a-8d66-60ce2c2cc861 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:55.056091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d52ddf-298d-420e-8467-da850310e514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:55.057051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d52ddf-298d-420e-8467-da850310e514 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:55.058007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d52ddf-298d-420e-8467-da850310e514 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:55.058451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d52ddf-298d-420e-8467-da850310e514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:55.060822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-83d52ddf-298d-420e-8467-da850310e514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:55.081966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d52ddf-298d-420e-8467-da850310e514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:55.085171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d52ddf-298d-420e-8467-da850310e514 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:55.095325 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1907/3757] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:19:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:19:55.096547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d52ddf-298d-420e-8467-da850310e514 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:55.098093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-83d52ddf-298d-420e-8467-da850310e514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:55.159989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:55.182782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-399706de-5f3e-4b6a-9f2b-faf09fd71e2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa259c59a104ad3a8e1b87aed19b38a', 'request_id': 'req-399706de-5f3e-4b6a-9f2b-faf09fd71e2c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:55.191701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-399706de-5f3e-4b6a-9f2b-faf09fd71e2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa259c59a104ad3a8e1b87aed19b38a', 'request_id': 'req-399706de-5f3e-4b6a-9f2b-faf09fd71e2c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:55.202341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-399706de-5f3e-4b6a-9f2b-faf09fd71e2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa259c59a104ad3a8e1b87aed19b38a', 'request_id': 'req-399706de-5f3e-4b6a-9f2b-faf09fd71e2c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:55.255357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d52ddf-298d-420e-8467-da850310e514 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:55.398717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5525dfd-530d-4302-bb2e-a2fb3031ca9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:55.400133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5525dfd-530d-4302-bb2e-a2fb3031ca9f service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:55.400133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5525dfd-530d-4302-bb2e-a2fb3031ca9f service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:55.400133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5525dfd-530d-4302-bb2e-a2fb3031ca9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:55.440508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-399706de-5f3e-4b6a-9f2b-faf09fd71e2c admin admin] The token cache is being invalidate because project cfa259c59a104ad3a8e1b87aed19b38a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:19:55.441098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-399706de-5f3e-4b6a-9f2b-faf09fd71e2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:55.442580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-399706de-5f3e-4b6a-9f2b-faf09fd71e2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:55.450340 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1851/3758] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:19:54 2022] DELETE /identity/v3/projects/cfa259c59a104ad3a8e1b87aed19b38a => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:55.452523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7de05-a7cc-4a61-b0a4-b8751aaa8c17 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:55.453133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7de05-a7cc-4a61-b0a4-b8751aaa8c17 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:55.456587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7de05-a7cc-4a61-b0a4-b8751aaa8c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:55.503492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a0d7de05-a7cc-4a61-b0a4-b8751aaa8c17 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:55.507183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a0d7de05-a7cc-4a61-b0a4-b8751aaa8c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:55.546226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5525dfd-530d-4302-bb2e-a2fb3031ca9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:55.550440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5525dfd-530d-4302-bb2e-a2fb3031ca9f service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:55.583600 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1908/3759] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:19:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:19:55.745909 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1852/3760] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:55.755601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58c8e8-6323-4dda-a096-4d264892af23 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:55.758465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58c8e8-6323-4dda-a096-4d264892af23 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:55.758465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58c8e8-6323-4dda-a096-4d264892af23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:55.789147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-cd58c8e8-6323-4dda-a096-4d264892af23 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:55.791340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cd58c8e8-6323-4dda-a096-4d264892af23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:55.814451 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1909/3761] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:55.818838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7de05-a7cc-4a61-b0a4-b8751aaa8c17 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:55.840370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7de05-a7cc-4a61-b0a4-b8751aaa8c17 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:55.856560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c2913-d417-4ae0-ba18-15a5a03d0373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:55.857637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c2913-d417-4ae0-ba18-15a5a03d0373 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:55.857970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c2913-d417-4ae0-ba18-15a5a03d0373 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:55.858391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c2913-d417-4ae0-ba18-15a5a03d0373 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:55.861635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c2913-d417-4ae0-ba18-15a5a03d0373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:19:55.864391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c2913-d417-4ae0-ba18-15a5a03d0373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:55.864391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c2913-d417-4ae0-ba18-15a5a03d0373 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:55.905552 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1853/3762] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:19:55.906906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58c8e8-6323-4dda-a096-4d264892af23 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:55.920215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58c8e8-6323-4dda-a096-4d264892af23 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:55.936934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33c5a2-e9ff-4779-9a48-2b1566e739d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:55.937904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33c5a2-e9ff-4779-9a48-2b1566e739d2 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:55.938727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33c5a2-e9ff-4779-9a48-2b1566e739d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:55.939266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33c5a2-e9ff-4779-9a48-2b1566e739d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:55.940174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33c5a2-e9ff-4779-9a48-2b1566e739d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:55.944738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33c5a2-e9ff-4779-9a48-2b1566e739d2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:56.148036 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1910/3763] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:19:55 2022] POST /identity/v3/projects => generated 375 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:56.160880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c2913-d417-4ae0-ba18-15a5a03d0373 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:56.162838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3ae0a-d0e2-4f31-8dcb-c0ba958f766e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:56.163368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3ae0a-d0e2-4f31-8dcb-c0ba958f766e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:56.163846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3ae0a-d0e2-4f31-8dcb-c0ba958f766e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:56.177688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c2913-d417-4ae0-ba18-15a5a03d0373 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:56.203426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-71b3ae0a-d0e2-4f31-8dcb-c0ba958f766e None None] MFA Rules not processed for user `c6ba562873fa4f4fbd0b635f1c9dcdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:56.205255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-71b3ae0a-d0e2-4f31-8dcb-c0ba958f766e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:56.322474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436dbe44-80f7-49c6-a4e8-c655092208a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:56.325069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436dbe44-80f7-49c6-a4e8-c655092208a2 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:56.333209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436dbe44-80f7-49c6-a4e8-c655092208a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:56.333209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436dbe44-80f7-49c6-a4e8-c655092208a2 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:56.333209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436dbe44-80f7-49c6-a4e8-c655092208a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:56.333209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436dbe44-80f7-49c6-a4e8-c655092208a2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:56.350452 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1911/3764] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:19:56.438316 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1854/3765] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:19:56 2022] POST /identity/v3/users => generated 288 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:56.442897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3ae0a-d0e2-4f31-8dcb-c0ba958f766e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:56.468072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3ae0a-d0e2-4f31-8dcb-c0ba958f766e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:56.478493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46642a-9d7c-4e6b-96c9-29d4fdeb58dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:56.481586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46642a-9d7c-4e6b-96c9-29d4fdeb58dd admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:56.481586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46642a-9d7c-4e6b-96c9-29d4fdeb58dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:56.481818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46642a-9d7c-4e6b-96c9-29d4fdeb58dd admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:56.484410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46642a-9d7c-4e6b-96c9-29d4fdeb58dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:56.486181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46642a-9d7c-4e6b-96c9-29d4fdeb58dd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:56.494643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:56.545883 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1912/3766] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:56.547132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436dbe44-80f7-49c6-a4e8-c655092208a2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:56.564283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436dbe44-80f7-49c6-a4e8-c655092208a2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:56.578517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df267b-3c03-49a6-96c4-3463731cc60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:56.580785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df267b-3c03-49a6-96c4-3463731cc60c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:56.582213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df267b-3c03-49a6-96c4-3463731cc60c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:56.582600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df267b-3c03-49a6-96c4-3463731cc60c admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:56.585262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df267b-3c03-49a6-96c4-3463731cc60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:56.590630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df267b-3c03-49a6-96c4-3463731cc60c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:56.610845 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1855/3767] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:56.612326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46642a-9d7c-4e6b-96c9-29d4fdeb58dd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:56.620533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df267b-3c03-49a6-96c4-3463731cc60c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:56.623931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-04df267b-3c03-49a6-96c4-3463731cc60c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:56.625362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46642a-9d7c-4e6b-96c9-29d4fdeb58dd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:56.633319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63681397-c140-42dd-adb1-c6da514d639d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:56.634148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63681397-c140-42dd-adb1-c6da514d639d admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:56.634939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63681397-c140-42dd-adb1-c6da514d639d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:56.634939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63681397-c140-42dd-adb1-c6da514d639d admin admin] PATH_INFO: `/v3/projects/dde1b0eb92854d97a5aabf312dbb193b/users/d7fdab227c7148b7ade2fc2cc66a1092/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:56.674943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63681397-c140-42dd-adb1-c6da514d639d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde1b0eb92854d97a5aabf312dbb193b, user_id=d7fdab227c7148b7ade2fc2cc66a1092, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:56.679748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63681397-c140-42dd-adb1-c6da514d639d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:56.807635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df267b-3c03-49a6-96c4-3463731cc60c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:56.814798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f156063-faf9-449d-8a5d-2bda1e62519d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:56.815573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f156063-faf9-449d-8a5d-2bda1e62519d service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:56.815847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f156063-faf9-449d-8a5d-2bda1e62519d service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:56.816128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f156063-faf9-449d-8a5d-2bda1e62519d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:56.832769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f156063-faf9-449d-8a5d-2bda1e62519d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:56.835668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f156063-faf9-449d-8a5d-2bda1e62519d service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:56.858325 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1913/3768] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:19:56 2022] PUT /identity/v3/projects/dde1b0eb92854d97a5aabf312dbb193b/users/d7fdab227c7148b7ade2fc2cc66a1092/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:56.859910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0442b9-0ce3-4ef9-bfcd-878959ef65c8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:56.860198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0442b9-0ce3-4ef9-bfcd-878959ef65c8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:56.860471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0442b9-0ce3-4ef9-bfcd-878959ef65c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:56.866316 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1856/3769] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:19:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:19:56.921839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ca0442b9-0ce3-4ef9-bfcd-878959ef65c8 None None] MFA Rules not processed for user `d7fdab227c7148b7ade2fc2cc66a1092`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:56.923661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ca0442b9-0ce3-4ef9-bfcd-878959ef65c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:57.042609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f156063-faf9-449d-8a5d-2bda1e62519d service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:57.069274 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1914/3770] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:19:57.073003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f156063-faf9-449d-8a5d-2bda1e62519d service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:57.159721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990ca0d-b2ef-4ba0-a5e8-f4fe76dff853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:57.164524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990ca0d-b2ef-4ba0-a5e8-f4fe76dff853 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:57.165331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990ca0d-b2ef-4ba0-a5e8-f4fe76dff853 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:57.166115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990ca0d-b2ef-4ba0-a5e8-f4fe76dff853 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:57.168976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990ca0d-b2ef-4ba0-a5e8-f4fe76dff853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:57.174951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990ca0d-b2ef-4ba0-a5e8-f4fe76dff853 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:57.358778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:57.367135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0442b9-0ce3-4ef9-bfcd-878959ef65c8 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:57.386644 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1857/3771] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:19:57 2022] POST /identity/v3/projects => generated 375 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:57.402803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0442b9-0ce3-4ef9-bfcd-878959ef65c8 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:57.478985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ea822-12fb-4000-954e-34d940200ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:57.480053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ea822-12fb-4000-954e-34d940200ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:57.480505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ea822-12fb-4000-954e-34d940200ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:57.480946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ea822-12fb-4000-954e-34d940200ab3 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:57.481794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ea822-12fb-4000-954e-34d940200ab3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:57.483946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ea822-12fb-4000-954e-34d940200ab3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:57.579435 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1915/3772] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:19:57 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:57.584549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990ca0d-b2ef-4ba0-a5e8-f4fe76dff853 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:57.599441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990ca0d-b2ef-4ba0-a5e8-f4fe76dff853 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:57.623622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fbb48-63e7-4386-ae04-94c71641b71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:57.624627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fbb48-63e7-4386-ae04-94c71641b71e admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:57.630592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fbb48-63e7-4386-ae04-94c71641b71e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:57.631678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fbb48-63e7-4386-ae04-94c71641b71e admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:57.632636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fbb48-63e7-4386-ae04-94c71641b71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:57.640239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fbb48-63e7-4386-ae04-94c71641b71e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:57.674616 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1858/3773] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:57.679692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ea822-12fb-4000-954e-34d940200ab3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:57.691061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ea822-12fb-4000-954e-34d940200ab3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:57.706259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f781be-2a9d-4890-bf50-234ad54aa04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:57.707531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f781be-2a9d-4890-bf50-234ad54aa04a admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:57.707717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f781be-2a9d-4890-bf50-234ad54aa04a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:57.708023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f781be-2a9d-4890-bf50-234ad54aa04a admin admin] PATH_INFO: `/v3/projects/e78870e5ba844cfca8d7f63b88105deb/users/5987353b163a4d9ab0639989b93d7706/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:57.778703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f781be-2a9d-4890-bf50-234ad54aa04a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78870e5ba844cfca8d7f63b88105deb, user_id=5987353b163a4d9ab0639989b93d7706, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:57.783636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f781be-2a9d-4890-bf50-234ad54aa04a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:57.886800 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1916/3774] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:19:57 2022] PUT /identity/v3/projects/e78870e5ba844cfca8d7f63b88105deb/users/5987353b163a4d9ab0639989b93d7706/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:57.890708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fbb48-63e7-4386-ae04-94c71641b71e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:57.906439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fbb48-63e7-4386-ae04-94c71641b71e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:57.983527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a65e7-faa0-4df7-92e2-f7419964afbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:57.984265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a65e7-faa0-4df7-92e2-f7419964afbc admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:57.984528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a65e7-faa0-4df7-92e2-f7419964afbc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:57.984813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a65e7-faa0-4df7-92e2-f7419964afbc admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:57.985548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a65e7-faa0-4df7-92e2-f7419964afbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:57.987291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a65e7-faa0-4df7-92e2-f7419964afbc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:58.009087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f781be-2a9d-4890-bf50-234ad54aa04a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:58.009228 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1859/3775] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:19:58.039591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f781be-2a9d-4890-bf50-234ad54aa04a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:58.052018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fd1a1-bb26-4932-a48d-182742014f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:58.053836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fd1a1-bb26-4932-a48d-182742014f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:58.054325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fd1a1-bb26-4932-a48d-182742014f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:58.054792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fd1a1-bb26-4932-a48d-182742014f2f admin admin] PATH_INFO: `/v3/projects/e78870e5ba844cfca8d7f63b88105deb/users/5987353b163a4d9ab0639989b93d7706/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:58.057858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fd1a1-bb26-4932-a48d-182742014f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78870e5ba844cfca8d7f63b88105deb, user_id=5987353b163a4d9ab0639989b93d7706, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:58.061672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fd1a1-bb26-4932-a48d-182742014f2f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:58.081701 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1917/3776] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:19:58 2022] PUT /identity/v3/projects/e78870e5ba844cfca8d7f63b88105deb/users/5987353b163a4d9ab0639989b93d7706/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:19:58.094181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78294457-c2b8-4295-9bd2-c29d6de9dc3e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:58.094470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78294457-c2b8-4295-9bd2-c29d6de9dc3e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:58.095604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78294457-c2b8-4295-9bd2-c29d6de9dc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:58.196370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-78294457-c2b8-4295-9bd2-c29d6de9dc3e None None] MFA Rules not processed for user `5987353b163a4d9ab0639989b93d7706`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:58.198165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-78294457-c2b8-4295-9bd2-c29d6de9dc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:58.362276 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1860/3777] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:58.368228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fd1a1-bb26-4932-a48d-182742014f2f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:58.384767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fd1a1-bb26-4932-a48d-182742014f2f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:58.391079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb47ff-fc25-41a4-98c9-15c6768d4033 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5987353b163a4d9ab0639989b93d7706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78870e5ba844cfca8d7f63b88105deb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:58.391782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb47ff-fc25-41a4-98c9-15c6768d4033 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:58.392074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb47ff-fc25-41a4-98c9-15c6768d4033 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:58.392707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb47ff-fc25-41a4-98c9-15c6768d4033 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:58.394733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb47ff-fc25-41a4-98c9-15c6768d4033 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:58.395864 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-eeeb47ff-fc25-41a4-98c9-15c6768d4033 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:58.395864 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:19:58.395864 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:19:58.399039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb47ff-fc25-41a4-98c9-15c6768d4033 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:58.509760 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1918/3778] 10.222.0.16 () {60 vars in 1184 bytes} [Sat Jul 16 21:19:58 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 265 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:58.517289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78294457-c2b8-4295-9bd2-c29d6de9dc3e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:58.527454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78294457-c2b8-4295-9bd2-c29d6de9dc3e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:58.562945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b08b0-3a20-48cd-a840-7806c8f77b9d tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5987353b163a4d9ab0639989b93d7706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78870e5ba844cfca8d7f63b88105deb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:58.570755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b08b0-3a20-48cd-a840-7806c8f77b9d tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:58.571083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b08b0-3a20-48cd-a840-7806c8f77b9d tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:58.571360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b08b0-3a20-48cd-a840-7806c8f77b9d tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/21911e5e37d2478488dbe9d4827677da` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:58.574496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b08b0-3a20-48cd-a840-7806c8f77b9d tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=21911e5e37d2478488dbe9d4827677da)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:58.580593 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-184b08b0-3a20-48cd-a840-7806c8f77b9d tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:58.580593 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:19:58.580593 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:19:58.581520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b08b0-3a20-48cd-a840-7806c8f77b9d tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:58.609143 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1861/3779] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Jul 16 21:19:58 2022] GET /identity/v3/OS-OAUTH1/consumers/21911e5e37d2478488dbe9d4827677da => generated 219 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:19:58.613785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb47ff-fc25-41a4-98c9-15c6768d4033 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:58.628205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb47ff-fc25-41a4-98c9-15c6768d4033 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:58.654075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be57cd-dfed-4232-8ba9-d32b91a5c6d4 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5987353b163a4d9ab0639989b93d7706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78870e5ba844cfca8d7f63b88105deb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:58.654944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be57cd-dfed-4232-8ba9-d32b91a5c6d4 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:58.655257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be57cd-dfed-4232-8ba9-d32b91a5c6d4 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:58.655542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be57cd-dfed-4232-8ba9-d32b91a5c6d4 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/21911e5e37d2478488dbe9d4827677da` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:58.664939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be57cd-dfed-4232-8ba9-d32b91a5c6d4 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=21911e5e37d2478488dbe9d4827677da)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:58.666214 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-13be57cd-dfed-4232-8ba9-d32b91a5c6d4 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:58.666214 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:19:58.666214 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:19:58.671989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be57cd-dfed-4232-8ba9-d32b91a5c6d4 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:58.672311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-13be57cd-dfed-4232-8ba9-d32b91a5c6d4 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invalidating token cache because consumer 21911e5e37d2478488dbe9d4827677da has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:19:58.672606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-13be57cd-dfed-4232-8ba9-d32b91a5c6d4 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:58.676505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-13be57cd-dfed-4232-8ba9-d32b91a5c6d4 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:58.831278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-13be57cd-dfed-4232-8ba9-d32b91a5c6d4 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '21911e5e37d2478488dbe9d4827677da', 'request_id': 'req-13be57cd-dfed-4232-8ba9-d32b91a5c6d4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:58.953314 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1919/3780] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Jul 16 21:19:58 2022] DELETE /identity/v3/OS-OAUTH1/consumers/21911e5e37d2478488dbe9d4827677da => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:58.958645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b08b0-3a20-48cd-a840-7806c8f77b9d tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:58.961420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-184b08b0-3a20-48cd-a840-7806c8f77b9d tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:58.977553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b08b0-3a20-48cd-a840-7806c8f77b9d tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:58.983967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2600f7-7d0b-4d1d-8f68-2a483670f9e6 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5987353b163a4d9ab0639989b93d7706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78870e5ba844cfca8d7f63b88105deb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:58.985563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2600f7-7d0b-4d1d-8f68-2a483670f9e6 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:58.986098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2600f7-7d0b-4d1d-8f68-2a483670f9e6 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:58.986737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2600f7-7d0b-4d1d-8f68-2a483670f9e6 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:58.987890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2600f7-7d0b-4d1d-8f68-2a483670f9e6 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:58.989503 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-cc2600f7-7d0b-4d1d-8f68-2a483670f9e6 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:58.989503 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:19:58.989503 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:19:58.991688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2600f7-7d0b-4d1d-8f68-2a483670f9e6 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:59.049457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84f80f-e17f-4448-9b44-98681a5d71a3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:59.049749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84f80f-e17f-4448-9b44-98681a5d71a3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:59.050032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84f80f-e17f-4448-9b44-98681a5d71a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:59.106513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0d84f80f-e17f-4448-9b44-98681a5d71a3 None None] MFA Rules not processed for user `27a08402c73946178157b98e3e4f1e82`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:59.108068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0d84f80f-e17f-4448-9b44-98681a5d71a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:59.238964 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1862/3781] 10.222.0.16 () {60 vars in 1184 bytes} [Sat Jul 16 21:19:58 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:19:59.243244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2600f7-7d0b-4d1d-8f68-2a483670f9e6 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:59.251896 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1920/3782] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:19:59.267898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2600f7-7d0b-4d1d-8f68-2a483670f9e6 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:59.287826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d65786-ec3f-4cca-8492-39215a58bb36 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5987353b163a4d9ab0639989b93d7706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78870e5ba844cfca8d7f63b88105deb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:59.289487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d65786-ec3f-4cca-8492-39215a58bb36 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:59.290557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d65786-ec3f-4cca-8492-39215a58bb36 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:59.290933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d65786-ec3f-4cca-8492-39215a58bb36 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a51e0407543241169da5c50bf96cab5c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:59.291867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d65786-ec3f-4cca-8492-39215a58bb36 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=a51e0407543241169da5c50bf96cab5c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:59.293580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d65786-ec3f-4cca-8492-39215a58bb36 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:59.307078 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1863/3783] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Jul 16 21:19:59 2022] GET /identity/v3/OS-OAUTH1/consumers/a51e0407543241169da5c50bf96cab5c => generated 221 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:19:59.308327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84f80f-e17f-4448-9b44-98681a5d71a3 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:59.321073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:19:59.325321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84f80f-e17f-4448-9b44-98681a5d71a3 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:59.331756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e29b08-c28c-4341-aab0-41d03ea274d5 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5987353b163a4d9ab0639989b93d7706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78870e5ba844cfca8d7f63b88105deb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:59.332616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e29b08-c28c-4341-aab0-41d03ea274d5 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:59.333013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e29b08-c28c-4341-aab0-41d03ea274d5 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:59.333231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e29b08-c28c-4341-aab0-41d03ea274d5 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a51e0407543241169da5c50bf96cab5c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:59.334882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e29b08-c28c-4341-aab0-41d03ea274d5 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=a51e0407543241169da5c50bf96cab5c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:59.336542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e29b08-c28c-4341-aab0-41d03ea274d5 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:59.336953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b6e29b08-c28c-4341-aab0-41d03ea274d5 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invalidating token cache because consumer a51e0407543241169da5c50bf96cab5c has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:19:59.337421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b6e29b08-c28c-4341-aab0-41d03ea274d5 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:59.338153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b6e29b08-c28c-4341-aab0-41d03ea274d5 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:59.457919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d65786-ec3f-4cca-8492-39215a58bb36 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:59.460294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b0d65786-ec3f-4cca-8492-39215a58bb36 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:59.493108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b6e29b08-c28c-4341-aab0-41d03ea274d5 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'a51e0407543241169da5c50bf96cab5c', 'request_id': 'req-b6e29b08-c28c-4341-aab0-41d03ea274d5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:59.550710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d65786-ec3f-4cca-8492-39215a58bb36 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:59.563465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bfc73-e4a4-4170-938d-3e2a8805aad6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:59.564255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bfc73-e4a4-4170-938d-3e2a8805aad6 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:59.564700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bfc73-e4a4-4170-938d-3e2a8805aad6 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:59.565135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bfc73-e4a4-4170-938d-3e2a8805aad6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:59.568587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5b7bfc73-e4a4-4170-938d-3e2a8805aad6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:59.580870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7bfc73-e4a4-4170-938d-3e2a8805aad6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:59.583163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7bfc73-e4a4-4170-938d-3e2a8805aad6 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:59.607445 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1864/3784] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:19:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:19:59.655580 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1921/3785] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Jul 16 21:19:59 2022] DELETE /identity/v3/OS-OAUTH1/consumers/a51e0407543241169da5c50bf96cab5c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:19:59.660590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bfc73-e4a4-4170-938d-3e2a8805aad6 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:59.662800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5b7bfc73-e4a4-4170-938d-3e2a8805aad6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:59.691593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bfc73-e4a4-4170-938d-3e2a8805aad6 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:59.692322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec46207-0d0b-430b-9433-cd92de2be336 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:59.692895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec46207-0d0b-430b-9433-cd92de2be336 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:59.693411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec46207-0d0b-430b-9433-cd92de2be336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:59.701112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b217a24-52ef-432d-8665-2545fe1c19e9 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5987353b163a4d9ab0639989b93d7706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78870e5ba844cfca8d7f63b88105deb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:59.702133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b217a24-52ef-432d-8665-2545fe1c19e9 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:59.702386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b217a24-52ef-432d-8665-2545fe1c19e9 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:59.702957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b217a24-52ef-432d-8665-2545fe1c19e9 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a51e0407543241169da5c50bf96cab5c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:59.703751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b217a24-52ef-432d-8665-2545fe1c19e9 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=a51e0407543241169da5c50bf96cab5c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:59.705401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b217a24-52ef-432d-8665-2545fe1c19e9 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:59.734753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6ec46207-0d0b-430b-9433-cd92de2be336 None None] MFA Rules not processed for user `fe680ccdc60e410b812794de8aa73e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:19:59.737232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6ec46207-0d0b-430b-9433-cd92de2be336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:59.747987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-1b217a24-52ef-432d-8665-2545fe1c19e9 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jul 16 21:19:59.747987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:19:59.747987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:19:59.747987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:19:59.747987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:19:59.747987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:19:59.747987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:19:59.747987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:19:59.747987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:19:59.747987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:19:59.747987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:19:59.747987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:19:59.747987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Jul 16 21:19:59.747987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Jul 16 21:19:59.747987 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Jul 16 21:19:59.749313 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Jul 16 21:19:59.749313 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Jul 16 21:19:59.749313 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Jul 16 21:19:59.749313 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Jul 16 21:19:59.749313 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jul 16 21:19:59.749313 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jul 16 21:19:59.749313 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jul 16 21:19:59.749313 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jul 16 21:19:59.749313 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:19:59.753309 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1865/3786] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Jul 16 21:19:59 2022] GET /identity/v3/OS-OAUTH1/consumers/a51e0407543241169da5c50bf96cab5c => generated 74 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 21:19:59.753826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b217a24-52ef-432d-8665-2545fe1c19e9 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:59.770251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b217a24-52ef-432d-8665-2545fe1c19e9 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:59.790125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be44a95-ce0d-4d38-a3be-28d51bab5499 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5987353b163a4d9ab0639989b93d7706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78870e5ba844cfca8d7f63b88105deb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:59.790125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be44a95-ce0d-4d38-a3be-28d51bab5499 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:59.790125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be44a95-ce0d-4d38-a3be-28d51bab5499 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:59.790397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be44a95-ce0d-4d38-a3be-28d51bab5499 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a51e0407543241169da5c50bf96cab5c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:59.790397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be44a95-ce0d-4d38-a3be-28d51bab5499 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=a51e0407543241169da5c50bf96cab5c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:59.790397 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-6be44a95-ce0d-4d38-a3be-28d51bab5499 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:19:59.790397 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:19:59.790397 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:19:59.790397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be44a95-ce0d-4d38-a3be-28d51bab5499 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:19:59.790795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6be44a95-ce0d-4d38-a3be-28d51bab5499 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invalidating token cache because consumer a51e0407543241169da5c50bf96cab5c has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:19:59.790795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6be44a95-ce0d-4d38-a3be-28d51bab5499 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:59.790795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6be44a95-ce0d-4d38-a3be-28d51bab5499 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:19:59.825028 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1922/3787] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:19:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:19:59.826578 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-6be44a95-ce0d-4d38-a3be-28d51bab5499 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jul 16 21:19:59.826578 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:19:59.826578 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:19:59.826578 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:19:59.826578 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:19:59.826578 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:19:59.826578 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:19:59.826578 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:19:59.826578 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:19:59.826578 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:19:59.826578 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:19:59.826578 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:19:59.826578 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Jul 16 21:19:59.826578 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Jul 16 21:19:59.826578 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:19:59.827644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:19:59.827644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Jul 16 21:19:59.827644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Jul 16 21:19:59.827644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Jul 16 21:19:59.827644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Jul 16 21:19:59.827644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Jul 16 21:19:59.827644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jul 16 21:19:59.827644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jul 16 21:19:59.827644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jul 16 21:19:59.827644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jul 16 21:19:59.827644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:19:59.832455 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1866/3788] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Jul 16 21:19:59 2022] DELETE /identity/v3/OS-OAUTH1/consumers/a51e0407543241169da5c50bf96cab5c => generated 74 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 21:19:59.833369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec46207-0d0b-430b-9433-cd92de2be336 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:19:59.841215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6ec46207-0d0b-430b-9433-cd92de2be336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:19:59.880031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec46207-0d0b-430b-9433-cd92de2be336 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:19:59.897755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10e1e5-8c84-4785-b91f-f20fd3b2cf1b tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5987353b163a4d9ab0639989b93d7706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78870e5ba844cfca8d7f63b88105deb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:19:59.901670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10e1e5-8c84-4785-b91f-f20fd3b2cf1b tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:19:59.901670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10e1e5-8c84-4785-b91f-f20fd3b2cf1b tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:19:59.901670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10e1e5-8c84-4785-b91f-f20fd3b2cf1b tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:19:59.901670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10e1e5-8c84-4785-b91f-f20fd3b2cf1b tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:19:59.901670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10e1e5-8c84-4785-b91f-f20fd3b2cf1b tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:00.082874 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1923/3789] 10.222.0.16 () {60 vars in 1184 bytes} [Sat Jul 16 21:19:59 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:00.087905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be44a95-ce0d-4d38-a3be-28d51bab5499 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:00.101832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be44a95-ce0d-4d38-a3be-28d51bab5499 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:00.114686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961aa1f-bc5b-4995-8dea-6212c3b3aaec tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5987353b163a4d9ab0639989b93d7706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78870e5ba844cfca8d7f63b88105deb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:00.115964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961aa1f-bc5b-4995-8dea-6212c3b3aaec tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:00.118646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961aa1f-bc5b-4995-8dea-6212c3b3aaec tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:00.119857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961aa1f-bc5b-4995-8dea-6212c3b3aaec tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:00.121576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6961aa1f-bc5b-4995-8dea-6212c3b3aaec tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:00.126962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6961aa1f-bc5b-4995-8dea-6212c3b3aaec tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:00.253214 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1867/3790] 10.222.0.16 () {60 vars in 1184 bytes} [Sat Jul 16 21:20:00 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:20:00.257794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10e1e5-8c84-4785-b91f-f20fd3b2cf1b tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:00.274505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10e1e5-8c84-4785-b91f-f20fd3b2cf1b tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:00.322467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226390e3-5bce-453d-90a5-afb49bb2c008 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5987353b163a4d9ab0639989b93d7706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78870e5ba844cfca8d7f63b88105deb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:00.323184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226390e3-5bce-453d-90a5-afb49bb2c008 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:00.323554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226390e3-5bce-453d-90a5-afb49bb2c008 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:00.323718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226390e3-5bce-453d-90a5-afb49bb2c008 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:00.327279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226390e3-5bce-453d-90a5-afb49bb2c008 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:00.329548 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-226390e3-5bce-453d-90a5-afb49bb2c008 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:00.329548 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:20:00.329548 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:20:00.335618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226390e3-5bce-453d-90a5-afb49bb2c008 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:00.364126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961aa1f-bc5b-4995-8dea-6212c3b3aaec tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:00.387596 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1924/3791] 10.222.0.16 () {58 vars in 1163 bytes} [Sat Jul 16 21:20:00 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:00.388590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961aa1f-bc5b-4995-8dea-6212c3b3aaec tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:00.407231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c0390-d5d0-47a6-bbb9-103b8b26c741 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5987353b163a4d9ab0639989b93d7706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78870e5ba844cfca8d7f63b88105deb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:00.408486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c0390-d5d0-47a6-bbb9-103b8b26c741 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:00.408781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c0390-d5d0-47a6-bbb9-103b8b26c741 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:00.409061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c0390-d5d0-47a6-bbb9-103b8b26c741 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/56c20fc568084d62bad932ba9f8beadf` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:00.409751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c0390-d5d0-47a6-bbb9-103b8b26c741 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=56c20fc568084d62bad932ba9f8beadf)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:00.411416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c0390-d5d0-47a6-bbb9-103b8b26c741 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:00.411690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0c8c0390-d5d0-47a6-bbb9-103b8b26c741 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invalidating token cache because consumer 56c20fc568084d62bad932ba9f8beadf has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:00.412016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0c8c0390-d5d0-47a6-bbb9-103b8b26c741 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:00.426995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0c8c0390-d5d0-47a6-bbb9-103b8b26c741 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:00.562934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0c8c0390-d5d0-47a6-bbb9-103b8b26c741 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '56c20fc568084d62bad932ba9f8beadf', 'request_id': 'req-0c8c0390-d5d0-47a6-bbb9-103b8b26c741'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:00.685967 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1868/3792] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Jul 16 21:20:00 2022] DELETE /identity/v3/OS-OAUTH1/consumers/56c20fc568084d62bad932ba9f8beadf => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:00.689348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226390e3-5bce-453d-90a5-afb49bb2c008 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:00.694119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-226390e3-5bce-453d-90a5-afb49bb2c008 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:00.734095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226390e3-5bce-453d-90a5-afb49bb2c008 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:00.754492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58107b87-b1b8-4a49-b1b4-ed37b78d893c tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5987353b163a4d9ab0639989b93d7706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78870e5ba844cfca8d7f63b88105deb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:00.755715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58107b87-b1b8-4a49-b1b4-ed37b78d893c tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:00.756259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58107b87-b1b8-4a49-b1b4-ed37b78d893c tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:00.756751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58107b87-b1b8-4a49-b1b4-ed37b78d893c tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/43c5a84792b7400dae467ae8c909e0c3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:00.757631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58107b87-b1b8-4a49-b1b4-ed37b78d893c tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=43c5a84792b7400dae467ae8c909e0c3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:00.763785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58107b87-b1b8-4a49-b1b4-ed37b78d893c tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:00.768668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-58107b87-b1b8-4a49-b1b4-ed37b78d893c tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invalidating token cache because consumer 43c5a84792b7400dae467ae8c909e0c3 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:00.769270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-58107b87-b1b8-4a49-b1b4-ed37b78d893c tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:00.776608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-58107b87-b1b8-4a49-b1b4-ed37b78d893c tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:00.794611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:00.919772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-58107b87-b1b8-4a49-b1b4-ed37b78d893c tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '43c5a84792b7400dae467ae8c909e0c3', 'request_id': 'req-58107b87-b1b8-4a49-b1b4-ed37b78d893c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:01.027547 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1925/3793] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Jul 16 21:20:00 2022] DELETE /identity/v3/OS-OAUTH1/consumers/43c5a84792b7400dae467ae8c909e0c3 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:20:01.033043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c0390-d5d0-47a6-bbb9-103b8b26c741 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:01.049597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c0390-d5d0-47a6-bbb9-103b8b26c741 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:01.067381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b2f76-72f0-44a2-a6f9-ed9009e22179 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5987353b163a4d9ab0639989b93d7706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78870e5ba844cfca8d7f63b88105deb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:01.068123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b2f76-72f0-44a2-a6f9-ed9009e22179 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:01.068604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b2f76-72f0-44a2-a6f9-ed9009e22179 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:01.068984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b2f76-72f0-44a2-a6f9-ed9009e22179 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:01.069736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b2f76-72f0-44a2-a6f9-ed9009e22179 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:01.072022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b2f76-72f0-44a2-a6f9-ed9009e22179 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:01.223566 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1869/3794] 10.222.0.16 () {60 vars in 1184 bytes} [Sat Jul 16 21:20:01 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:01.228368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58107b87-b1b8-4a49-b1b4-ed37b78d893c tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:01.230354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-58107b87-b1b8-4a49-b1b4-ed37b78d893c tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:01.252115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58107b87-b1b8-4a49-b1b4-ed37b78d893c tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:01.271416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c1751-7802-4742-a29e-cf75def3d1dd tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5987353b163a4d9ab0639989b93d7706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78870e5ba844cfca8d7f63b88105deb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:01.272531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c1751-7802-4742-a29e-cf75def3d1dd tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:01.273012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c1751-7802-4742-a29e-cf75def3d1dd tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:01.273443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c1751-7802-4742-a29e-cf75def3d1dd tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2723d1447630411fb718b241ed479280` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:01.274349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c1751-7802-4742-a29e-cf75def3d1dd tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=2723d1447630411fb718b241ed479280)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:01.275782 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-b30c1751-7802-4742-a29e-cf75def3d1dd tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:01.275782 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:20:01.275782 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:20:01.279822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c1751-7802-4742-a29e-cf75def3d1dd tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:01.440790 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1926/3795] 10.222.0.16 () {60 vars in 1284 bytes} [Sat Jul 16 21:20:01 2022] PATCH /identity/v3/OS-OAUTH1/consumers/2723d1447630411fb718b241ed479280 => generated 220 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:01.444722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b2f76-72f0-44a2-a6f9-ed9009e22179 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:01.463039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b2f76-72f0-44a2-a6f9-ed9009e22179 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:01.475715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c0c42-753e-4abf-961c-a496fb0b7d52 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5987353b163a4d9ab0639989b93d7706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78870e5ba844cfca8d7f63b88105deb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:01.485625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c0c42-753e-4abf-961c-a496fb0b7d52 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:01.490638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c0c42-753e-4abf-961c-a496fb0b7d52 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:01.490638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c0c42-753e-4abf-961c-a496fb0b7d52 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2723d1447630411fb718b241ed479280` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:01.490638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c0c42-753e-4abf-961c-a496fb0b7d52 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=2723d1447630411fb718b241ed479280)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:01.490638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c0c42-753e-4abf-961c-a496fb0b7d52 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:01.506668 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1870/3796] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Jul 16 21:20:01 2022] GET /identity/v3/OS-OAUTH1/consumers/2723d1447630411fb718b241ed479280 => generated 220 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:01.509048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c1751-7802-4742-a29e-cf75def3d1dd tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:01.530529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c1751-7802-4742-a29e-cf75def3d1dd tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:01.544675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76298cb-277c-4410-a913-4e408041f5b3 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5987353b163a4d9ab0639989b93d7706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78870e5ba844cfca8d7f63b88105deb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:01.551178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76298cb-277c-4410-a913-4e408041f5b3 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:01.551178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76298cb-277c-4410-a913-4e408041f5b3 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:01.551178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76298cb-277c-4410-a913-4e408041f5b3 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2723d1447630411fb718b241ed479280` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:01.551178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76298cb-277c-4410-a913-4e408041f5b3 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=2723d1447630411fb718b241ed479280)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:01.551564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76298cb-277c-4410-a913-4e408041f5b3 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:01.551564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c76298cb-277c-4410-a913-4e408041f5b3 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invalidating token cache because consumer 2723d1447630411fb718b241ed479280 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:01.551564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c76298cb-277c-4410-a913-4e408041f5b3 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:01.565569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c76298cb-277c-4410-a913-4e408041f5b3 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:01.646623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:01.674490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c76298cb-277c-4410-a913-4e408041f5b3 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '2723d1447630411fb718b241ed479280', 'request_id': 'req-c76298cb-277c-4410-a913-4e408041f5b3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:01.805530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c0c42-753e-4abf-961c-a496fb0b7d52 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:01.806033 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1927/3797] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Jul 16 21:20:01 2022] DELETE /identity/v3/OS-OAUTH1/consumers/2723d1447630411fb718b241ed479280 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:01.806139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-db4c0c42-753e-4abf-961c-a496fb0b7d52 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:01.953078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c0c42-753e-4abf-961c-a496fb0b7d52 tempest-OAUTHConsumersV3Test-424560811 tempest-OAUTHConsumersV3Test-424560811-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:01.965132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce514da-4979-445c-a84b-f6751c4c8dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:01.966298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce514da-4979-445c-a84b-f6751c4c8dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:01.966728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce514da-4979-445c-a84b-f6751c4c8dff admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:01.967210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce514da-4979-445c-a84b-f6751c4c8dff admin admin] PATH_INFO: `/v3/users/d7fdab227c7148b7ade2fc2cc66a1092` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:01.968623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce514da-4979-445c-a84b-f6751c4c8dff admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7fdab227c7148b7ade2fc2cc66a1092)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:01.970735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce514da-4979-445c-a84b-f6751c4c8dff admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:02.307390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5ce514da-4979-445c-a84b-f6751c4c8dff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7fdab227c7148b7ade2fc2cc66a1092'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:02.368534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5ce514da-4979-445c-a84b-f6751c4c8dff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7fdab227c7148b7ade2fc2cc66a1092'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:02.448881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5ce514da-4979-445c-a84b-f6751c4c8dff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7fdab227c7148b7ade2fc2cc66a1092'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:02.460204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5ce514da-4979-445c-a84b-f6751c4c8dff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7fdab227c7148b7ade2fc2cc66a1092'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:02.461554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5ce514da-4979-445c-a84b-f6751c4c8dff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7fdab227c7148b7ade2fc2cc66a1092'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:02.471391 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1871/3798] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:01 2022] DELETE /identity/v3/users/d7fdab227c7148b7ade2fc2cc66a1092 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:20:02.476960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbbb56-42ac-4d1e-a8d2-d058e6818a3d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:02.477496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbbb56-42ac-4d1e-a8d2-d058e6818a3d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:02.477897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbbb56-42ac-4d1e-a8d2-d058e6818a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:02.524351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-49bbbb56-42ac-4d1e-a8d2-d058e6818a3d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:02.528441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-49bbbb56-42ac-4d1e-a8d2-d058e6818a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:02.760021 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1928/3799] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:02.842676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce514da-4979-445c-a84b-f6751c4c8dff admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:02.848541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5ce514da-4979-445c-a84b-f6751c4c8dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:03.012282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce514da-4979-445c-a84b-f6751c4c8dff admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:03.019727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc15a2-aae0-4399-9c74-1cbd4149252d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:03.021676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc15a2-aae0-4399-9c74-1cbd4149252d service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:03.022911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc15a2-aae0-4399-9c74-1cbd4149252d service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:03.023516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc15a2-aae0-4399-9c74-1cbd4149252d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:03.053794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc15a2-aae0-4399-9c74-1cbd4149252d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:03.055657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc15a2-aae0-4399-9c74-1cbd4149252d service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:03.097346 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1872/3800] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:20:03.398315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc40301-9ec9-4bc4-8f55-4a769afea9d8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:03.398841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc40301-9ec9-4bc4-8f55-4a769afea9d8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:03.399423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc40301-9ec9-4bc4-8f55-4a769afea9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:03.428606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3dc40301-9ec9-4bc4-8f55-4a769afea9d8 None None] MFA Rules not processed for user `c6ba562873fa4f4fbd0b635f1c9dcdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:03.446710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3dc40301-9ec9-4bc4-8f55-4a769afea9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:03.632325 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1929/3801] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:04.383278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:04.714246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:05.114446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc15a2-aae0-4399-9c74-1cbd4149252d service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:05.117553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c9cc15a2-aae0-4399-9c74-1cbd4149252d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:05.144983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc15a2-aae0-4399-9c74-1cbd4149252d service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:05.159224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3846141-66f3-4c8e-a0bd-7a6433f5e47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:05.160366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3846141-66f3-4c8e-a0bd-7a6433f5e47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:05.160693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3846141-66f3-4c8e-a0bd-7a6433f5e47b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:05.160972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3846141-66f3-4c8e-a0bd-7a6433f5e47b admin admin] PATH_INFO: `/v3/projects/dde1b0eb92854d97a5aabf312dbb193b` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:05.162566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3846141-66f3-4c8e-a0bd-7a6433f5e47b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dde1b0eb92854d97a5aabf312dbb193b)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:05.164839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3846141-66f3-4c8e-a0bd-7a6433f5e47b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:05.444924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e3846141-66f3-4c8e-a0bd-7a6433f5e47b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dde1b0eb92854d97a5aabf312dbb193b', 'request_id': 'req-e3846141-66f3-4c8e-a0bd-7a6433f5e47b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:05.452891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e3846141-66f3-4c8e-a0bd-7a6433f5e47b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dde1b0eb92854d97a5aabf312dbb193b', 'request_id': 'req-e3846141-66f3-4c8e-a0bd-7a6433f5e47b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:05.460735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e3846141-66f3-4c8e-a0bd-7a6433f5e47b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dde1b0eb92854d97a5aabf312dbb193b', 'request_id': 'req-e3846141-66f3-4c8e-a0bd-7a6433f5e47b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:05.562161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e3846141-66f3-4c8e-a0bd-7a6433f5e47b admin admin] The token cache is being invalidate because project dde1b0eb92854d97a5aabf312dbb193b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:05.562480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e3846141-66f3-4c8e-a0bd-7a6433f5e47b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:05.564155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e3846141-66f3-4c8e-a0bd-7a6433f5e47b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:05.567758 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1873/3802] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:05 2022] DELETE /identity/v3/projects/dde1b0eb92854d97a5aabf312dbb193b => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:05.572114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc40301-9ec9-4bc4-8f55-4a769afea9d8 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:05.589541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc40301-9ec9-4bc4-8f55-4a769afea9d8 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:05.678139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d8968-f506-42e4-9ccd-3aa642d37166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:05.679050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d8968-f506-42e4-9ccd-3aa642d37166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:05.679522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d8968-f506-42e4-9ccd-3aa642d37166 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:05.679961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d8968-f506-42e4-9ccd-3aa642d37166 admin admin] PATH_INFO: `/v3/users/5987353b163a4d9ab0639989b93d7706` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:05.681380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d8968-f506-42e4-9ccd-3aa642d37166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5987353b163a4d9ab0639989b93d7706)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:05.683592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d8968-f506-42e4-9ccd-3aa642d37166 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:05.964500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ba5d8968-f506-42e4-9ccd-3aa642d37166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5987353b163a4d9ab0639989b93d7706'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:05.987224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ba5d8968-f506-42e4-9ccd-3aa642d37166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5987353b163a4d9ab0639989b93d7706'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:06.099212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ba5d8968-f506-42e4-9ccd-3aa642d37166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5987353b163a4d9ab0639989b93d7706'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:06.099983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ba5d8968-f506-42e4-9ccd-3aa642d37166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5987353b163a4d9ab0639989b93d7706'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:06.129858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ba5d8968-f506-42e4-9ccd-3aa642d37166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5987353b163a4d9ab0639989b93d7706'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:06.147049 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1930/3803] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:05 2022] DELETE /identity/v3/users/5987353b163a4d9ab0639989b93d7706 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:20:06.744909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3846141-66f3-4c8e-a0bd-7a6433f5e47b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:06.746958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e3846141-66f3-4c8e-a0bd-7a6433f5e47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:06.781185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3846141-66f3-4c8e-a0bd-7a6433f5e47b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:06.887029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363bec9e-9bc4-44f5-8c97-d9286813c7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:06.887920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bec9e-9bc4-44f5-8c97-d9286813c7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:06.888314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bec9e-9bc4-44f5-8c97-d9286813c7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:06.888555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bec9e-9bc4-44f5-8c97-d9286813c7d3 admin admin] PATH_INFO: `/v3/projects/e78870e5ba844cfca8d7f63b88105deb` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:06.890046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363bec9e-9bc4-44f5-8c97-d9286813c7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78870e5ba844cfca8d7f63b88105deb)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:06.892371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363bec9e-9bc4-44f5-8c97-d9286813c7d3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:07.010960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-363bec9e-9bc4-44f5-8c97-d9286813c7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78870e5ba844cfca8d7f63b88105deb', 'request_id': 'req-363bec9e-9bc4-44f5-8c97-d9286813c7d3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:07.018057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-363bec9e-9bc4-44f5-8c97-d9286813c7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78870e5ba844cfca8d7f63b88105deb', 'request_id': 'req-363bec9e-9bc4-44f5-8c97-d9286813c7d3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:07.026579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-363bec9e-9bc4-44f5-8c97-d9286813c7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78870e5ba844cfca8d7f63b88105deb', 'request_id': 'req-363bec9e-9bc4-44f5-8c97-d9286813c7d3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:07.102705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:07.110774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-363bec9e-9bc4-44f5-8c97-d9286813c7d3 admin admin] The token cache is being invalidate because project e78870e5ba844cfca8d7f63b88105deb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:07.111110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-363bec9e-9bc4-44f5-8c97-d9286813c7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:07.111775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-363bec9e-9bc4-44f5-8c97-d9286813c7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:07.113408 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1874/3804] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:06 2022] DELETE /identity/v3/projects/e78870e5ba844cfca8d7f63b88105deb => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:07.119491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d5f34-c0cd-4e31-922f-2250fef312fa None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:07.120115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d5f34-c0cd-4e31-922f-2250fef312fa None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:07.120115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d5f34-c0cd-4e31-922f-2250fef312fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:07.141101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-857d5f34-c0cd-4e31-922f-2250fef312fa None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:07.142841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-857d5f34-c0cd-4e31-922f-2250fef312fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:07.243317 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1931/3805] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:07.253495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dfb00-be9f-4151-8be2-a1e81dfb0d94 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:07.253798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dfb00-be9f-4151-8be2-a1e81dfb0d94 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:07.254084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dfb00-be9f-4151-8be2-a1e81dfb0d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:07.292514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2d5dfb00-be9f-4151-8be2-a1e81dfb0d94 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:07.294543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2d5dfb00-be9f-4151-8be2-a1e81dfb0d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:07.307576 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1875/3806] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:07.312639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d5f34-c0cd-4e31-922f-2250fef312fa None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:07.323854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d5f34-c0cd-4e31-922f-2250fef312fa None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:07.331818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d97693-689d-4610-88ae-99df2c54c759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:07.331818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d97693-689d-4610-88ae-99df2c54c759 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:07.331818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d97693-689d-4610-88ae-99df2c54c759 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:07.331818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d97693-689d-4610-88ae-99df2c54c759 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:07.332245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d97693-689d-4610-88ae-99df2c54c759 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:20:07.332245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d97693-689d-4610-88ae-99df2c54c759 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:07.334746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d97693-689d-4610-88ae-99df2c54c759 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:07.353961 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1932/3807] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:07.358847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5dfb00-be9f-4151-8be2-a1e81dfb0d94 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:07.380858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5dfb00-be9f-4151-8be2-a1e81dfb0d94 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:07.391091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db666112-a215-452f-b3f9-a81834c317c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:07.391091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db666112-a215-452f-b3f9-a81834c317c1 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:07.391091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db666112-a215-452f-b3f9-a81834c317c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:07.391415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db666112-a215-452f-b3f9-a81834c317c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:07.391983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db666112-a215-452f-b3f9-a81834c317c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:07.395253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db666112-a215-452f-b3f9-a81834c317c1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:07.547048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d97693-689d-4610-88ae-99df2c54c759 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:07.547830 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1876/3808] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:20:07 2022] POST /identity/v3/projects => generated 369 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:07.562108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d97693-689d-4610-88ae-99df2c54c759 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:07.681679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bfc09-2cc6-4d2e-9c35-97660d8fb9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:07.682474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bfc09-2cc6-4d2e-9c35-97660d8fb9c1 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:07.682856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bfc09-2cc6-4d2e-9c35-97660d8fb9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:07.683508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bfc09-2cc6-4d2e-9c35-97660d8fb9c1 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:07.684474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bfc09-2cc6-4d2e-9c35-97660d8fb9c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:07.686731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bfc09-2cc6-4d2e-9c35-97660d8fb9c1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:07.801881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:07.905536 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1933/3809] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:07 2022] POST /identity/v3/users => generated 285 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:07.909360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db666112-a215-452f-b3f9-a81834c317c1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:07.927328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db666112-a215-452f-b3f9-a81834c317c1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:07.932695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3c296-bb05-4a5a-b59e-716fbe5a3f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:07.933375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3c296-bb05-4a5a-b59e-716fbe5a3f09 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:07.933653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3c296-bb05-4a5a-b59e-716fbe5a3f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:07.933928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3c296-bb05-4a5a-b59e-716fbe5a3f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:07.934656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3c296-bb05-4a5a-b59e-716fbe5a3f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:07.936318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3c296-bb05-4a5a-b59e-716fbe5a3f09 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:07.951721 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1877/3810] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:07.953217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bfc09-2cc6-4d2e-9c35-97660d8fb9c1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:07.964689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bfc09-2cc6-4d2e-9c35-97660d8fb9c1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:07.973382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2b371-3998-4ad8-84fb-403d83e40a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:07.974788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2b371-3998-4ad8-84fb-403d83e40a67 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:07.975086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2b371-3998-4ad8-84fb-403d83e40a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:07.975372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2b371-3998-4ad8-84fb-403d83e40a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:07.976316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2b371-3998-4ad8-84fb-403d83e40a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:07.981383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2b371-3998-4ad8-84fb-403d83e40a67 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:08.010165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3c296-bb05-4a5a-b59e-716fbe5a3f09 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:08.012068 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1934/3811] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:20:08.021853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3c296-bb05-4a5a-b59e-716fbe5a3f09 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:08.030546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253f812-a9cc-43e7-ae5c-14a2fbc9deec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:08.031693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253f812-a9cc-43e7-ae5c-14a2fbc9deec admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:08.032177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253f812-a9cc-43e7-ae5c-14a2fbc9deec admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:08.032452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253f812-a9cc-43e7-ae5c-14a2fbc9deec admin admin] PATH_INFO: `/v3/projects/9b2cc7a71d7f4f5fbf4d752db5351e0a/users/25ecde401ea740b8b93a865316fdc64e/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:08.050125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253f812-a9cc-43e7-ae5c-14a2fbc9deec admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b2cc7a71d7f4f5fbf4d752db5351e0a, user_id=25ecde401ea740b8b93a865316fdc64e, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:08.054402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253f812-a9cc-43e7-ae5c-14a2fbc9deec admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:08.155507 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1878/3812] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:08 2022] PUT /identity/v3/projects/9b2cc7a71d7f4f5fbf4d752db5351e0a/users/25ecde401ea740b8b93a865316fdc64e/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:20:08.167185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4a93b-1a89-4b41-a0b3-2a570578898f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:08.167702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4a93b-1a89-4b41-a0b3-2a570578898f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:08.167899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4a93b-1a89-4b41-a0b3-2a570578898f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:08.205425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7ca4a93b-1a89-4b41-a0b3-2a570578898f None None] MFA Rules not processed for user `25ecde401ea740b8b93a865316fdc64e`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:08.205425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7ca4a93b-1a89-4b41-a0b3-2a570578898f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:08.278372 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1935/3813] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:08 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:20:08.283090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253f812-a9cc-43e7-ae5c-14a2fbc9deec admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:08.350328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253f812-a9cc-43e7-ae5c-14a2fbc9deec admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:08.355518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d9612-55d5-4bfe-aa4e-75d868c0cdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:08.356197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d9612-55d5-4bfe-aa4e-75d868c0cdd0 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:08.356483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d9612-55d5-4bfe-aa4e-75d868c0cdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:08.356761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d9612-55d5-4bfe-aa4e-75d868c0cdd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:08.357476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d9612-55d5-4bfe-aa4e-75d868c0cdd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:08.359602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d9612-55d5-4bfe-aa4e-75d868c0cdd0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:08.447729 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1879/3814] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:20:08 2022] POST /identity/v3/projects => generated 369 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:08.447951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4a93b-1a89-4b41-a0b3-2a570578898f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:08.459657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4a93b-1a89-4b41-a0b3-2a570578898f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:08.517145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55b0f7-0559-48be-823f-af4a885c3780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:08.517834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55b0f7-0559-48be-823f-af4a885c3780 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:08.518114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55b0f7-0559-48be-823f-af4a885c3780 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:08.518388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55b0f7-0559-48be-823f-af4a885c3780 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:08.519108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55b0f7-0559-48be-823f-af4a885c3780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:08.521619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55b0f7-0559-48be-823f-af4a885c3780 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:08.695129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d9612-55d5-4bfe-aa4e-75d868c0cdd0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:08.699855 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1936/3815] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:08 2022] POST /identity/v3/users => generated 291 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:08.710962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d9612-55d5-4bfe-aa4e-75d868c0cdd0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:08.742121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07f369-f97f-43c3-b4ac-8429e08f4296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:08.743050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07f369-f97f-43c3-b4ac-8429e08f4296 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:08.743504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07f369-f97f-43c3-b4ac-8429e08f4296 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:08.743948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07f369-f97f-43c3-b4ac-8429e08f4296 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:08.745016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07f369-f97f-43c3-b4ac-8429e08f4296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:08.746782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07f369-f97f-43c3-b4ac-8429e08f4296 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:08.769748 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1880/3816] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:20:08.774498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55b0f7-0559-48be-823f-af4a885c3780 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:08.788859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55b0f7-0559-48be-823f-af4a885c3780 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:08.799679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e4a71-1de6-4c2e-84f9-52a956decb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:08.800585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e4a71-1de6-4c2e-84f9-52a956decb4a admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:08.800864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e4a71-1de6-4c2e-84f9-52a956decb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:08.801141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e4a71-1de6-4c2e-84f9-52a956decb4a admin admin] PATH_INFO: `/v3/projects/4db38c74056247049eeb081686960b98/users/67ea46b6d7d147bd803f766ed79b2ee1/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:08.831101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e4a71-1de6-4c2e-84f9-52a956decb4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4db38c74056247049eeb081686960b98, user_id=67ea46b6d7d147bd803f766ed79b2ee1, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:08.834261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e4a71-1de6-4c2e-84f9-52a956decb4a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:08.930163 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1937/3817] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:08 2022] PUT /identity/v3/projects/4db38c74056247049eeb081686960b98/users/67ea46b6d7d147bd803f766ed79b2ee1/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:08.931602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07f369-f97f-43c3-b4ac-8429e08f4296 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:08.946088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07f369-f97f-43c3-b4ac-8429e08f4296 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:09.094852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d09c4-431a-4302-a0ce-c5e25e09d1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:09.097252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d09c4-431a-4302-a0ce-c5e25e09d1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:09.097252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d09c4-431a-4302-a0ce-c5e25e09d1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:09.097252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d09c4-431a-4302-a0ce-c5e25e09d1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:09.098276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d09c4-431a-4302-a0ce-c5e25e09d1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:09.100260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d09c4-431a-4302-a0ce-c5e25e09d1d6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:09.122230 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1881/3818] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:20:09.127049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e4a71-1de6-4c2e-84f9-52a956decb4a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:09.145171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e4a71-1de6-4c2e-84f9-52a956decb4a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:09.164912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1edff0-6dfc-4ca9-8ce7-1ea09dba3aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:09.166031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1edff0-6dfc-4ca9-8ce7-1ea09dba3aca admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:09.166400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1edff0-6dfc-4ca9-8ce7-1ea09dba3aca admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:09.166772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1edff0-6dfc-4ca9-8ce7-1ea09dba3aca admin admin] PATH_INFO: `/v3/projects/4db38c74056247049eeb081686960b98/users/67ea46b6d7d147bd803f766ed79b2ee1/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:09.170619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1edff0-6dfc-4ca9-8ce7-1ea09dba3aca admin admin] RBAC: Authorizing `identity:create_grant(project_id=4db38c74056247049eeb081686960b98, user_id=67ea46b6d7d147bd803f766ed79b2ee1, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:09.173626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1edff0-6dfc-4ca9-8ce7-1ea09dba3aca admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:09.201804 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1938/3819] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:09 2022] PUT /identity/v3/projects/4db38c74056247049eeb081686960b98/users/67ea46b6d7d147bd803f766ed79b2ee1/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:20:09.215289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974495d-8618-40ac-8536-58986f18f405 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:09.217143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974495d-8618-40ac-8536-58986f18f405 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:09.217143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974495d-8618-40ac-8536-58986f18f405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:09.277224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a974495d-8618-40ac-8536-58986f18f405 None None] MFA Rules not processed for user `67ea46b6d7d147bd803f766ed79b2ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:09.281200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a974495d-8618-40ac-8536-58986f18f405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:09.442012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1edff0-6dfc-4ca9-8ce7-1ea09dba3aca admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:09.443276 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1882/3820] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:09 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:09.460172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1edff0-6dfc-4ca9-8ce7-1ea09dba3aca admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:09.469035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c25d31-d14a-45cf-a208-c3571857611a tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ea46b6d7d147bd803f766ed79b2ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4db38c74056247049eeb081686960b98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:09.470020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c25d31-d14a-45cf-a208-c3571857611a tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:09.470519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c25d31-d14a-45cf-a208-c3571857611a tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:09.471135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c25d31-d14a-45cf-a208-c3571857611a tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] PATH_INFO: `/v3/policies` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:09.472719 ncdv-master-1 devstack@keystone.service[98196]: WARNING oslo_log.versionutils [None req-b2c25d31-d14a-45cf-a208-c3571857611a tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 16 21:20:09.473450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c25d31-d14a-45cf-a208-c3571857611a tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:09.476376 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-b2c25d31-d14a-45cf-a208-c3571857611a tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:09.476376 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:20:09.476376 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:20:09.478775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c25d31-d14a-45cf-a208-c3571857611a tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:09.583894 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1939/3821] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Jul 16 21:20:09 2022] POST /identity/v3/policies => generated 230 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:20:09.588526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974495d-8618-40ac-8536-58986f18f405 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:09.606641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974495d-8618-40ac-8536-58986f18f405 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:09.627544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248537c-aaef-4d64-a87b-6bd3226f02d2 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ea46b6d7d147bd803f766ed79b2ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4db38c74056247049eeb081686960b98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:09.631983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248537c-aaef-4d64-a87b-6bd3226f02d2 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:09.633431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248537c-aaef-4d64-a87b-6bd3226f02d2 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:09.636913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248537c-aaef-4d64-a87b-6bd3226f02d2 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] PATH_INFO: `/v3/policies/b1efc206f09d45a8b7fcdf43ba67b145` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:09.639491 ncdv-master-1 devstack@keystone.service[98195]: WARNING oslo_log.versionutils [None req-2248537c-aaef-4d64-a87b-6bd3226f02d2 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 16 21:20:09.644130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248537c-aaef-4d64-a87b-6bd3226f02d2 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=b1efc206f09d45a8b7fcdf43ba67b145)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:09.648765 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-2248537c-aaef-4d64-a87b-6bd3226f02d2 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:09.648765 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:20:09.648765 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:20:09.653017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248537c-aaef-4d64-a87b-6bd3226f02d2 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:09.665173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:09.830823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:09.831058 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1883/3822] 10.222.0.16 () {60 vars in 1251 bytes} [Sat Jul 16 21:20:09 2022] PATCH /identity/v3/policies/b1efc206f09d45a8b7fcdf43ba67b145 => generated 236 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:09.833453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c25d31-d14a-45cf-a208-c3571857611a tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:09.847313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c25d31-d14a-45cf-a208-c3571857611a tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:09.854034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfca94-b5ba-4174-8981-dae8c7cb65f6 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ea46b6d7d147bd803f766ed79b2ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4db38c74056247049eeb081686960b98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:09.855663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfca94-b5ba-4174-8981-dae8c7cb65f6 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:09.856203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfca94-b5ba-4174-8981-dae8c7cb65f6 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:09.856683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfca94-b5ba-4174-8981-dae8c7cb65f6 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] PATH_INFO: `/v3/policies/b1efc206f09d45a8b7fcdf43ba67b145` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:09.857756 ncdv-master-1 devstack@keystone.service[98196]: WARNING oslo_log.versionutils [None req-43dfca94-b5ba-4174-8981-dae8c7cb65f6 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 16 21:20:09.858949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dfca94-b5ba-4174-8981-dae8c7cb65f6 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=b1efc206f09d45a8b7fcdf43ba67b145)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:09.861219 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-43dfca94-b5ba-4174-8981-dae8c7cb65f6 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:09.861219 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:20:09.861219 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:20:09.862594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dfca94-b5ba-4174-8981-dae8c7cb65f6 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:09.902326 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1940/3823] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:20:09 2022] GET /identity/v3/policies/b1efc206f09d45a8b7fcdf43ba67b145 => generated 236 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:09.916425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248537c-aaef-4d64-a87b-6bd3226f02d2 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:09.921615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfca94-b5ba-4174-8981-dae8c7cb65f6 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:09.927732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248537c-aaef-4d64-a87b-6bd3226f02d2 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:09.929420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-43dfca94-b5ba-4174-8981-dae8c7cb65f6 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:09.953923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8c91e-e749-41dc-b391-9ddfa4d661cf tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ea46b6d7d147bd803f766ed79b2ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4db38c74056247049eeb081686960b98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:09.957071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8c91e-e749-41dc-b391-9ddfa4d661cf tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:09.957647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8c91e-e749-41dc-b391-9ddfa4d661cf tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:09.958154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8c91e-e749-41dc-b391-9ddfa4d661cf tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] PATH_INFO: `/v3/policies/b1efc206f09d45a8b7fcdf43ba67b145` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:09.960516 ncdv-master-1 devstack@keystone.service[98195]: WARNING oslo_log.versionutils [None req-95a8c91e-e749-41dc-b391-9ddfa4d661cf tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 16 21:20:09.962282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8c91e-e749-41dc-b391-9ddfa4d661cf tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=b1efc206f09d45a8b7fcdf43ba67b145)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:09.964398 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-95a8c91e-e749-41dc-b391-9ddfa4d661cf tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:09.964398 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:20:09.964398 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:20:09.965735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8c91e-e749-41dc-b391-9ddfa4d661cf tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:10.053066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfca94-b5ba-4174-8981-dae8c7cb65f6 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:10.064448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290db4e6-76c8-4d31-8d1c-ad56e483ca26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:10.066527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290db4e6-76c8-4d31-8d1c-ad56e483ca26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:10.067118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290db4e6-76c8-4d31-8d1c-ad56e483ca26 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:10.067731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290db4e6-76c8-4d31-8d1c-ad56e483ca26 admin admin] PATH_INFO: `/v3/users/2f5bc1f2209f4eb186d80e385b67c774` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:10.070215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290db4e6-76c8-4d31-8d1c-ad56e483ca26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f5bc1f2209f4eb186d80e385b67c774)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:10.073450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290db4e6-76c8-4d31-8d1c-ad56e483ca26 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:10.118158 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1884/3824] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:09 2022] DELETE /identity/v3/policies/b1efc206f09d45a8b7fcdf43ba67b145 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:10.136982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8c91e-e749-41dc-b391-9ddfa4d661cf tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:10.155047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8c91e-e749-41dc-b391-9ddfa4d661cf tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:10.163848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b477ae-2230-4c79-b670-d439e39e90a3 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ea46b6d7d147bd803f766ed79b2ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4db38c74056247049eeb081686960b98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:10.164925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b477ae-2230-4c79-b670-d439e39e90a3 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:10.165444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b477ae-2230-4c79-b670-d439e39e90a3 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:10.165889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b477ae-2230-4c79-b670-d439e39e90a3 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] PATH_INFO: `/v3/policies` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:10.167919 ncdv-master-1 devstack@keystone.service[98195]: WARNING oslo_log.versionutils [None req-f6b477ae-2230-4c79-b670-d439e39e90a3 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 16 21:20:10.168631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b477ae-2230-4c79-b670-d439e39e90a3 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:10.170122 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-f6b477ae-2230-4c79-b670-d439e39e90a3 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:10.170122 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:20:10.170122 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:20:10.171423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b477ae-2230-4c79-b670-d439e39e90a3 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:10.307956 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1885/3825] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Jul 16 21:20:10 2022] POST /identity/v3/policies => generated 230 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:10.310013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-290db4e6-76c8-4d31-8d1c-ad56e483ca26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f5bc1f2209f4eb186d80e385b67c774'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:10.313170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b477ae-2230-4c79-b670-d439e39e90a3 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:10.329388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-290db4e6-76c8-4d31-8d1c-ad56e483ca26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f5bc1f2209f4eb186d80e385b67c774'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:10.340519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b477ae-2230-4c79-b670-d439e39e90a3 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:10.378828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c40f59-731e-48d7-8932-bb9f0c913ee6 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ea46b6d7d147bd803f766ed79b2ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4db38c74056247049eeb081686960b98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:10.379581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c40f59-731e-48d7-8932-bb9f0c913ee6 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:10.379871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c40f59-731e-48d7-8932-bb9f0c913ee6 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:10.380699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c40f59-731e-48d7-8932-bb9f0c913ee6 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] PATH_INFO: `/v3/policies` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:10.381942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c40f59-731e-48d7-8932-bb9f0c913ee6 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:10.383931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c40f59-731e-48d7-8932-bb9f0c913ee6 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:10.424322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-290db4e6-76c8-4d31-8d1c-ad56e483ca26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f5bc1f2209f4eb186d80e385b67c774'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:10.425061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-290db4e6-76c8-4d31-8d1c-ad56e483ca26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f5bc1f2209f4eb186d80e385b67c774'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:10.440703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-290db4e6-76c8-4d31-8d1c-ad56e483ca26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f5bc1f2209f4eb186d80e385b67c774'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:10.450344 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1941/3826] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:09 2022] DELETE /identity/v3/users/2f5bc1f2209f4eb186d80e385b67c774 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:10.454683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8f4fa-3e70-4f2b-8fd0-c2f96c3966ab None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:10.454978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8f4fa-3e70-4f2b-8fd0-c2f96c3966ab None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:10.455282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8f4fa-3e70-4f2b-8fd0-c2f96c3966ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:10.490418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-00a8f4fa-3e70-4f2b-8fd0-c2f96c3966ab None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:10.492000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-00a8f4fa-3e70-4f2b-8fd0-c2f96c3966ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:10.536233 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1886/3827] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Jul 16 21:20:10 2022] POST /identity/v3/policies => generated 229 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:10.537411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c40f59-731e-48d7-8932-bb9f0c913ee6 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:10.544581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-58c40f59-731e-48d7-8932-bb9f0c913ee6 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:10.591209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c40f59-731e-48d7-8932-bb9f0c913ee6 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:10.615379 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1942/3828] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:10.640705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8f4fa-3e70-4f2b-8fd0-c2f96c3966ab None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:10.644643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-00a8f4fa-3e70-4f2b-8fd0-c2f96c3966ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:10.752641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037a5de-1b10-40f0-97b6-472b44a6dbed tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ea46b6d7d147bd803f766ed79b2ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4db38c74056247049eeb081686960b98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:10.753515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037a5de-1b10-40f0-97b6-472b44a6dbed tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:10.753635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037a5de-1b10-40f0-97b6-472b44a6dbed tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:10.754323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037a5de-1b10-40f0-97b6-472b44a6dbed tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] PATH_INFO: `/v3/policies` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:10.757355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037a5de-1b10-40f0-97b6-472b44a6dbed tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:10.760121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037a5de-1b10-40f0-97b6-472b44a6dbed tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:10.794173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8f4fa-3e70-4f2b-8fd0-c2f96c3966ab None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:10.805883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc6341-b560-4477-b3b5-0919efb272ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:10.805883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc6341-b560-4477-b3b5-0919efb272ef service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:10.805883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc6341-b560-4477-b3b5-0919efb272ef service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:10.806282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc6341-b560-4477-b3b5-0919efb272ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:10.854343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc6341-b560-4477-b3b5-0919efb272ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:10.856669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc6341-b560-4477-b3b5-0919efb272ef service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:10.873629 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1943/3829] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:20:10.907371 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1887/3830] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Jul 16 21:20:10 2022] POST /identity/v3/policies => generated 229 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:10.911730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc6341-b560-4477-b3b5-0919efb272ef service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:10.926125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc6341-b560-4477-b3b5-0919efb272ef service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:10.933556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd68c4-4b57-48b5-a989-4b27d0130921 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ea46b6d7d147bd803f766ed79b2ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4db38c74056247049eeb081686960b98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:10.934724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd68c4-4b57-48b5-a989-4b27d0130921 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:10.935149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd68c4-4b57-48b5-a989-4b27d0130921 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:10.935529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd68c4-4b57-48b5-a989-4b27d0130921 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] PATH_INFO: `/v3/policies` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:10.936442 ncdv-master-1 devstack@keystone.service[98196]: WARNING oslo_log.versionutils [None req-01cd68c4-4b57-48b5-a989-4b27d0130921 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 16 21:20:10.937296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd68c4-4b57-48b5-a989-4b27d0130921 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:10.938856 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-01cd68c4-4b57-48b5-a989-4b27d0130921 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:10.938856 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:20:10.938856 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:20:10.940264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd68c4-4b57-48b5-a989-4b27d0130921 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:10.959052 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1944/3831] 10.222.0.16 () {58 vars in 1130 bytes} [Sat Jul 16 21:20:10 2022] GET /identity/v3/policies => generated 764 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:10.959213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037a5de-1b10-40f0-97b6-472b44a6dbed tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:10.997277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037a5de-1b10-40f0-97b6-472b44a6dbed tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:11.029128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f2e62-9e70-4986-bf1b-1ac2b8b116bb tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ea46b6d7d147bd803f766ed79b2ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4db38c74056247049eeb081686960b98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:11.032546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f2e62-9e70-4986-bf1b-1ac2b8b116bb tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:11.041417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f2e62-9e70-4986-bf1b-1ac2b8b116bb tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:11.047096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f2e62-9e70-4986-bf1b-1ac2b8b116bb tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] PATH_INFO: `/v3/policies/b50b95f528194629b172e04d3d6dbfc7` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:11.050713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f2e62-9e70-4986-bf1b-1ac2b8b116bb tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=b50b95f528194629b172e04d3d6dbfc7)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:11.062754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f2e62-9e70-4986-bf1b-1ac2b8b116bb tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:11.190065 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1888/3832] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:10 2022] DELETE /identity/v3/policies/b50b95f528194629b172e04d3d6dbfc7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:11.195551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd68c4-4b57-48b5-a989-4b27d0130921 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:11.219790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd68c4-4b57-48b5-a989-4b27d0130921 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:11.241368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729a8d4-8414-4758-be01-6b52e449844a tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ea46b6d7d147bd803f766ed79b2ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4db38c74056247049eeb081686960b98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:11.242566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729a8d4-8414-4758-be01-6b52e449844a tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:11.243032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729a8d4-8414-4758-be01-6b52e449844a tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:11.244050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729a8d4-8414-4758-be01-6b52e449844a tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] PATH_INFO: `/v3/policies/aec909375e674e199e9896b35a56efc0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:11.248785 ncdv-master-1 devstack@keystone.service[98196]: WARNING oslo_log.versionutils [None req-4729a8d4-8414-4758-be01-6b52e449844a tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 16 21:20:11.250265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729a8d4-8414-4758-be01-6b52e449844a tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=aec909375e674e199e9896b35a56efc0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:11.252780 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-4729a8d4-8414-4758-be01-6b52e449844a tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:11.252780 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:20:11.252780 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:20:11.263665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729a8d4-8414-4758-be01-6b52e449844a tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:11.374663 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1945/3833] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:11 2022] DELETE /identity/v3/policies/aec909375e674e199e9896b35a56efc0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:11.380775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f2e62-9e70-4986-bf1b-1ac2b8b116bb tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:11.404862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f2e62-9e70-4986-bf1b-1ac2b8b116bb tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:11.417991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8863c9-46e0-4864-9cb6-41693e717782 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ea46b6d7d147bd803f766ed79b2ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4db38c74056247049eeb081686960b98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:11.418882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8863c9-46e0-4864-9cb6-41693e717782 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:11.419205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8863c9-46e0-4864-9cb6-41693e717782 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:11.419806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8863c9-46e0-4864-9cb6-41693e717782 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] PATH_INFO: `/v3/policies/03c212f2f3d34de2914add65e455a4c4` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:11.421298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8863c9-46e0-4864-9cb6-41693e717782 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=03c212f2f3d34de2914add65e455a4c4)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:11.422990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8863c9-46e0-4864-9cb6-41693e717782 tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:11.557609 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1889/3834] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:11 2022] DELETE /identity/v3/policies/03c212f2f3d34de2914add65e455a4c4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:11.560779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729a8d4-8414-4758-be01-6b52e449844a tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:11.562798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4729a8d4-8414-4758-be01-6b52e449844a tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:11.609383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729a8d4-8414-4758-be01-6b52e449844a tempest-PoliciesTestJSON-1894235302 tempest-PoliciesTestJSON-1894235302-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:11.631114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95134a-203b-489a-9a6a-18c4fb2fa40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:11.631994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95134a-203b-489a-9a6a-18c4fb2fa40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:11.632280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95134a-203b-489a-9a6a-18c4fb2fa40a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:11.632556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95134a-203b-489a-9a6a-18c4fb2fa40a admin admin] PATH_INFO: `/v3/users/25ecde401ea740b8b93a865316fdc64e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:11.635972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95134a-203b-489a-9a6a-18c4fb2fa40a admin admin] RBAC: Authorizing `identity:delete_user(user_id=25ecde401ea740b8b93a865316fdc64e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:11.638101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95134a-203b-489a-9a6a-18c4fb2fa40a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:11.799844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:11.876043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:11.934802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fd95134a-203b-489a-9a6a-18c4fb2fa40a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25ecde401ea740b8b93a865316fdc64e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:11.961275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fd95134a-203b-489a-9a6a-18c4fb2fa40a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25ecde401ea740b8b93a865316fdc64e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:12.121543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fd95134a-203b-489a-9a6a-18c4fb2fa40a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25ecde401ea740b8b93a865316fdc64e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:12.122594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fd95134a-203b-489a-9a6a-18c4fb2fa40a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25ecde401ea740b8b93a865316fdc64e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:12.150953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fd95134a-203b-489a-9a6a-18c4fb2fa40a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25ecde401ea740b8b93a865316fdc64e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:12.165924 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1946/3835] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:11 2022] DELETE /identity/v3/users/25ecde401ea740b8b93a865316fdc64e => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:12.167674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9e67f-1600-4763-a3d9-9f3a7c19cb7a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:12.168128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9e67f-1600-4763-a3d9-9f3a7c19cb7a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:12.168236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9e67f-1600-4763-a3d9-9f3a7c19cb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:12.240264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7ca9e67f-1600-4763-a3d9-9f3a7c19cb7a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:12.245018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7ca9e67f-1600-4763-a3d9-9f3a7c19cb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:12.394500 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1890/3836] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:20:12.443819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95134a-203b-489a-9a6a-18c4fb2fa40a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:12.445297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fd95134a-203b-489a-9a6a-18c4fb2fa40a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:12.483723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9e67f-1600-4763-a3d9-9f3a7c19cb7a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:12.485732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7ca9e67f-1600-4763-a3d9-9f3a7c19cb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:12.585657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95134a-203b-489a-9a6a-18c4fb2fa40a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:12.596802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5a0a1-93dd-458d-8998-97ad95d5b179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:12.597523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5a0a1-93dd-458d-8998-97ad95d5b179 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:12.597953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5a0a1-93dd-458d-8998-97ad95d5b179 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:12.598233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5a0a1-93dd-458d-8998-97ad95d5b179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:12.610428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5a0a1-93dd-458d-8998-97ad95d5b179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:12.612078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5a0a1-93dd-458d-8998-97ad95d5b179 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:12.657070 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1947/3837] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:20:12.665472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5a0a1-93dd-458d-8998-97ad95d5b179 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:12.671101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9e67f-1600-4763-a3d9-9f3a7c19cb7a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:12.671422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a9d5a0a1-93dd-458d-8998-97ad95d5b179 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:12.684745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae233d-7a3e-4f40-b4d1-a06528cc3a86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:12.686917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae233d-7a3e-4f40-b4d1-a06528cc3a86 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:12.687888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae233d-7a3e-4f40-b4d1-a06528cc3a86 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:12.688403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae233d-7a3e-4f40-b4d1-a06528cc3a86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:12.692833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-71ae233d-7a3e-4f40-b4d1-a06528cc3a86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:12.706055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5a0a1-93dd-458d-8998-97ad95d5b179 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:12.712445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c53cb-9e85-4084-9602-5c081e756e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:12.713325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c53cb-9e85-4084-9602-5c081e756e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:12.713606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c53cb-9e85-4084-9602-5c081e756e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:12.713880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c53cb-9e85-4084-9602-5c081e756e2e admin admin] PATH_INFO: `/v3/projects/65d5bcfa02af4e8284ba1342197e2860` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:12.715994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae233d-7a3e-4f40-b4d1-a06528cc3a86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:12.716136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c53cb-9e85-4084-9602-5c081e756e2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=65d5bcfa02af4e8284ba1342197e2860)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:12.718206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c53cb-9e85-4084-9602-5c081e756e2e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:12.719190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae233d-7a3e-4f40-b4d1-a06528cc3a86 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:12.758172 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1891/3838] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:20:12.759692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae233d-7a3e-4f40-b4d1-a06528cc3a86 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:12.761168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-71ae233d-7a3e-4f40-b4d1-a06528cc3a86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:12.791781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae233d-7a3e-4f40-b4d1-a06528cc3a86 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:12.791781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3758f-4630-4402-8d52-04de701861aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:12.792248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3758f-4630-4402-8d52-04de701861aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:12.792652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3758f-4630-4402-8d52-04de701861aa admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:12.792901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3758f-4630-4402-8d52-04de701861aa admin admin] PATH_INFO: `/v3/users/27a08402c73946178157b98e3e4f1e82` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:12.794180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3758f-4630-4402-8d52-04de701861aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=27a08402c73946178157b98e3e4f1e82)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:12.797122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3758f-4630-4402-8d52-04de701861aa admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:12.886323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6f5c53cb-9e85-4084-9602-5c081e756e2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65d5bcfa02af4e8284ba1342197e2860', 'request_id': 'req-6f5c53cb-9e85-4084-9602-5c081e756e2e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:12.897592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6f5c53cb-9e85-4084-9602-5c081e756e2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65d5bcfa02af4e8284ba1342197e2860', 'request_id': 'req-6f5c53cb-9e85-4084-9602-5c081e756e2e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:12.905335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6f5c53cb-9e85-4084-9602-5c081e756e2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65d5bcfa02af4e8284ba1342197e2860', 'request_id': 'req-6f5c53cb-9e85-4084-9602-5c081e756e2e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:13.060308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6f5c53cb-9e85-4084-9602-5c081e756e2e admin admin] The token cache is being invalidate because project 65d5bcfa02af4e8284ba1342197e2860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:13.060599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6f5c53cb-9e85-4084-9602-5c081e756e2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:13.061506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6f5c53cb-9e85-4084-9602-5c081e756e2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:13.063534 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1948/3839] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:12 2022] DELETE /identity/v3/projects/65d5bcfa02af4e8284ba1342197e2860 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:13.067640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c53cb-9e85-4084-9602-5c081e756e2e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:13.069283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6f5c53cb-9e85-4084-9602-5c081e756e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:13.123282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-42c3758f-4630-4402-8d52-04de701861aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27a08402c73946178157b98e3e4f1e82'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:13.140809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-42c3758f-4630-4402-8d52-04de701861aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27a08402c73946178157b98e3e4f1e82'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:13.162376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c53cb-9e85-4084-9602-5c081e756e2e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:13.167944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6869d-42cc-401c-8e27-a3cec41930a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:13.168832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6869d-42cc-401c-8e27-a3cec41930a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:13.169121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6869d-42cc-401c-8e27-a3cec41930a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:13.169400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6869d-42cc-401c-8e27-a3cec41930a0 admin admin] PATH_INFO: `/v3/users/b8b803460d624372aaa2da4fe69350ae` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:13.170776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6869d-42cc-401c-8e27-a3cec41930a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8b803460d624372aaa2da4fe69350ae)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:13.172994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6869d-42cc-401c-8e27-a3cec41930a0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:13.259575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-42c3758f-4630-4402-8d52-04de701861aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27a08402c73946178157b98e3e4f1e82'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:13.275532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-42c3758f-4630-4402-8d52-04de701861aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27a08402c73946178157b98e3e4f1e82'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:13.276394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-42c3758f-4630-4402-8d52-04de701861aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27a08402c73946178157b98e3e4f1e82'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:13.283673 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1892/3840] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:12 2022] DELETE /identity/v3/users/27a08402c73946178157b98e3e4f1e82 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:13.429739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-74b6869d-42cc-401c-8e27-a3cec41930a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8b803460d624372aaa2da4fe69350ae'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:13.437056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-74b6869d-42cc-401c-8e27-a3cec41930a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8b803460d624372aaa2da4fe69350ae'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:13.560893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-74b6869d-42cc-401c-8e27-a3cec41930a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8b803460d624372aaa2da4fe69350ae'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:13.561858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-74b6869d-42cc-401c-8e27-a3cec41930a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8b803460d624372aaa2da4fe69350ae'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:13.578941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-74b6869d-42cc-401c-8e27-a3cec41930a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8b803460d624372aaa2da4fe69350ae'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:13.590223 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1949/3841] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:13 2022] DELETE /identity/v3/users/b8b803460d624372aaa2da4fe69350ae => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:20:13.936855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3758f-4630-4402-8d52-04de701861aa admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:13.938629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-42c3758f-4630-4402-8d52-04de701861aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:14.032791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6869d-42cc-401c-8e27-a3cec41930a0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:14.034384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-74b6869d-42cc-401c-8e27-a3cec41930a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:14.079386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3758f-4630-4402-8d52-04de701861aa admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:14.176134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6869d-42cc-401c-8e27-a3cec41930a0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:14.182249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fda95c-9c13-455a-9eee-27b10cd63671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:14.183345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fda95c-9c13-455a-9eee-27b10cd63671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:14.183784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fda95c-9c13-455a-9eee-27b10cd63671 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:14.187195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fda95c-9c13-455a-9eee-27b10cd63671 admin admin] PATH_INFO: `/v3/projects/d9472fdbbcfb4b3cb81b052cc93d714b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:14.187195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fda95c-9c13-455a-9eee-27b10cd63671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9472fdbbcfb4b3cb81b052cc93d714b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:14.193055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fda95c-9c13-455a-9eee-27b10cd63671 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:14.231987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e73ea-eb9f-439a-8b8a-22248c4b1153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:14.234154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e73ea-eb9f-439a-8b8a-22248c4b1153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:14.234154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e73ea-eb9f-439a-8b8a-22248c4b1153 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:14.234154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e73ea-eb9f-439a-8b8a-22248c4b1153 admin admin] PATH_INFO: `/v3/projects/6f40e610a1bf49a2a6913c4c6c6735b6` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:14.236144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e73ea-eb9f-439a-8b8a-22248c4b1153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f40e610a1bf49a2a6913c4c6c6735b6)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:14.252619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e73ea-eb9f-439a-8b8a-22248c4b1153 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:14.316509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:14.366533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-04fda95c-9c13-455a-9eee-27b10cd63671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9472fdbbcfb4b3cb81b052cc93d714b', 'request_id': 'req-04fda95c-9c13-455a-9eee-27b10cd63671'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:14.376863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-04fda95c-9c13-455a-9eee-27b10cd63671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9472fdbbcfb4b3cb81b052cc93d714b', 'request_id': 'req-04fda95c-9c13-455a-9eee-27b10cd63671'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:14.382728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-04fda95c-9c13-455a-9eee-27b10cd63671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9472fdbbcfb4b3cb81b052cc93d714b', 'request_id': 'req-04fda95c-9c13-455a-9eee-27b10cd63671'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:14.415639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cc7e73ea-eb9f-439a-8b8a-22248c4b1153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f40e610a1bf49a2a6913c4c6c6735b6', 'request_id': 'req-cc7e73ea-eb9f-439a-8b8a-22248c4b1153'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:14.446147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cc7e73ea-eb9f-439a-8b8a-22248c4b1153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f40e610a1bf49a2a6913c4c6c6735b6', 'request_id': 'req-cc7e73ea-eb9f-439a-8b8a-22248c4b1153'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:14.451332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cc7e73ea-eb9f-439a-8b8a-22248c4b1153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f40e610a1bf49a2a6913c4c6c6735b6', 'request_id': 'req-cc7e73ea-eb9f-439a-8b8a-22248c4b1153'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:14.495364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-04fda95c-9c13-455a-9eee-27b10cd63671 admin admin] The token cache is being invalidate because project d9472fdbbcfb4b3cb81b052cc93d714b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:14.495649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-04fda95c-9c13-455a-9eee-27b10cd63671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:14.496545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-04fda95c-9c13-455a-9eee-27b10cd63671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:14.498675 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1950/3842] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:14 2022] DELETE /identity/v3/projects/d9472fdbbcfb4b3cb81b052cc93d714b => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:14.499713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fda95c-9c13-455a-9eee-27b10cd63671 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:14.501553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-04fda95c-9c13-455a-9eee-27b10cd63671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:14.588323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fda95c-9c13-455a-9eee-27b10cd63671 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:14.652618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cc7e73ea-eb9f-439a-8b8a-22248c4b1153 admin admin] The token cache is being invalidate because project 6f40e610a1bf49a2a6913c4c6c6735b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:14.653311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cc7e73ea-eb9f-439a-8b8a-22248c4b1153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:14.654697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cc7e73ea-eb9f-439a-8b8a-22248c4b1153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:14.657892 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1893/3843] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:13 2022] DELETE /identity/v3/projects/6f40e610a1bf49a2a6913c4c6c6735b6 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:14.659217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e73ea-eb9f-439a-8b8a-22248c4b1153 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:14.662302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cc7e73ea-eb9f-439a-8b8a-22248c4b1153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:14.662802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203c796-6e12-4ffa-859d-ebccb38605ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:14.663699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203c796-6e12-4ffa-859d-ebccb38605ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:14.663984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203c796-6e12-4ffa-859d-ebccb38605ce admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:14.664262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203c796-6e12-4ffa-859d-ebccb38605ce admin admin] PATH_INFO: `/v3/projects/9b2cc7a71d7f4f5fbf4d752db5351e0a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:14.665574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203c796-6e12-4ffa-859d-ebccb38605ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b2cc7a71d7f4f5fbf4d752db5351e0a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:14.671623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203c796-6e12-4ffa-859d-ebccb38605ce admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:14.796706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e73ea-eb9f-439a-8b8a-22248c4b1153 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:14.806019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b203c796-6e12-4ffa-859d-ebccb38605ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b2cc7a71d7f4f5fbf4d752db5351e0a', 'request_id': 'req-b203c796-6e12-4ffa-859d-ebccb38605ce'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:14.813267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b203c796-6e12-4ffa-859d-ebccb38605ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b2cc7a71d7f4f5fbf4d752db5351e0a', 'request_id': 'req-b203c796-6e12-4ffa-859d-ebccb38605ce'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:14.825698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b203c796-6e12-4ffa-859d-ebccb38605ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b2cc7a71d7f4f5fbf4d752db5351e0a', 'request_id': 'req-b203c796-6e12-4ffa-859d-ebccb38605ce'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:14.867683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5c312-45e3-45dc-bcad-2fa44387384f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:14.868938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5c312-45e3-45dc-bcad-2fa44387384f service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:14.868938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5c312-45e3-45dc-bcad-2fa44387384f service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:14.868938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5c312-45e3-45dc-bcad-2fa44387384f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:14.870808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4aa5c312-45e3-45dc-bcad-2fa44387384f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:14.885155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5c312-45e3-45dc-bcad-2fa44387384f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:14.886758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5c312-45e3-45dc-bcad-2fa44387384f service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:14.899049 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1894/3844] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:20:14.900455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc240ad2-e7a5-406e-9ec4-5bc18b3a7706 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:14.902911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc240ad2-e7a5-406e-9ec4-5bc18b3a7706 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:14.903240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc240ad2-e7a5-406e-9ec4-5bc18b3a7706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:14.909473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b203c796-6e12-4ffa-859d-ebccb38605ce admin admin] The token cache is being invalidate because project 9b2cc7a71d7f4f5fbf4d752db5351e0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:14.909775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b203c796-6e12-4ffa-859d-ebccb38605ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:14.912879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b203c796-6e12-4ffa-859d-ebccb38605ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:14.915211 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1951/3845] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:14 2022] DELETE /identity/v3/projects/9b2cc7a71d7f4f5fbf4d752db5351e0a => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:14.916639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798ba80-41db-467e-81fa-48fb2d661bbb None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:14.917362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798ba80-41db-467e-81fa-48fb2d661bbb None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:14.917875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798ba80-41db-467e-81fa-48fb2d661bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:14.930824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-bc240ad2-e7a5-406e-9ec4-5bc18b3a7706 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:14.943684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bc240ad2-e7a5-406e-9ec4-5bc18b3a7706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:14.963850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f798ba80-41db-467e-81fa-48fb2d661bbb None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:14.965193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f798ba80-41db-467e-81fa-48fb2d661bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:15.017097 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1895/3846] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:15.017816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc240ad2-e7a5-406e-9ec4-5bc18b3a7706 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:15.019162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bc240ad2-e7a5-406e-9ec4-5bc18b3a7706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:15.035271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc240ad2-e7a5-406e-9ec4-5bc18b3a7706 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:15.041517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d09bf5-d466-4557-a0a2-191c08a37e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:15.042430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d09bf5-d466-4557-a0a2-191c08a37e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:15.042716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d09bf5-d466-4557-a0a2-191c08a37e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:15.042986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d09bf5-d466-4557-a0a2-191c08a37e01 admin admin] PATH_INFO: `/v3/users/67ea46b6d7d147bd803f766ed79b2ee1` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:15.051314 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1952/3847] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:15.053997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37269e-08d3-4084-aa19-fa4c2c654e9d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:15.054291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37269e-08d3-4084-aa19-fa4c2c654e9d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:15.054569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37269e-08d3-4084-aa19-fa4c2c654e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:15.055751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d09bf5-d466-4557-a0a2-191c08a37e01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ea46b6d7d147bd803f766ed79b2ee1)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:15.084941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d09bf5-d466-4557-a0a2-191c08a37e01 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:15.095877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6c37269e-08d3-4084-aa19-fa4c2c654e9d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:15.097171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6c37269e-08d3-4084-aa19-fa4c2c654e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:15.108416 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1953/3848] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:15.109884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84721ada-d1c2-4b20-bd28-6710deba96fb None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:15.110181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84721ada-d1c2-4b20-bd28-6710deba96fb None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:15.110451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84721ada-d1c2-4b20-bd28-6710deba96fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:15.139434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-84721ada-d1c2-4b20-bd28-6710deba96fb None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:15.141094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-84721ada-d1c2-4b20-bd28-6710deba96fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:15.157925 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1954/3849] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:15.157925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84721ada-d1c2-4b20-bd28-6710deba96fb None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:15.170348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84721ada-d1c2-4b20-bd28-6710deba96fb None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:15.175908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4f47a-c30e-4ca9-ad64-490d338e146a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:15.176873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4f47a-c30e-4ca9-ad64-490d338e146a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:15.177572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4f47a-c30e-4ca9-ad64-490d338e146a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:15.178077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4f47a-c30e-4ca9-ad64-490d338e146a admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:15.178994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4f47a-c30e-4ca9-ad64-490d338e146a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:20:15.179696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4f47a-c30e-4ca9-ad64-490d338e146a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:15.181658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4f47a-c30e-4ca9-ad64-490d338e146a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:15.198989 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1955/3850] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:15.200671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4f47a-c30e-4ca9-ad64-490d338e146a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:15.213836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4f47a-c30e-4ca9-ad64-490d338e146a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:15.219233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e849cb-f53f-4afa-ae5e-464a97009912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:15.219968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e849cb-f53f-4afa-ae5e-464a97009912 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:15.220254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e849cb-f53f-4afa-ae5e-464a97009912 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:15.220529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e849cb-f53f-4afa-ae5e-464a97009912 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:15.221549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e849cb-f53f-4afa-ae5e-464a97009912 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:20:15.221859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e849cb-f53f-4afa-ae5e-464a97009912 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:15.223891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e849cb-f53f-4afa-ae5e-464a97009912 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:15.241781 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1956/3851] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:15.244037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e849cb-f53f-4afa-ae5e-464a97009912 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:15.258634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e849cb-f53f-4afa-ae5e-464a97009912 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:15.264654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1c89f-b49b-4a92-b643-835670098da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:15.265378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1c89f-b49b-4a92-b643-835670098da6 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:15.266813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1c89f-b49b-4a92-b643-835670098da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:15.267119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1c89f-b49b-4a92-b643-835670098da6 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:15.267848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1c89f-b49b-4a92-b643-835670098da6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:15.270029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1c89f-b49b-4a92-b643-835670098da6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:15.344848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-59d09bf5-d466-4557-a0a2-191c08a37e01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ea46b6d7d147bd803f766ed79b2ee1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:15.366147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-59d09bf5-d466-4557-a0a2-191c08a37e01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ea46b6d7d147bd803f766ed79b2ee1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:15.405027 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1957/3852] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:20:15 2022] POST /identity/v3/projects => generated 393 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:15.406236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1c89f-b49b-4a92-b643-835670098da6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:15.455396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-59d09bf5-d466-4557-a0a2-191c08a37e01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ea46b6d7d147bd803f766ed79b2ee1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:15.464373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-59d09bf5-d466-4557-a0a2-191c08a37e01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ea46b6d7d147bd803f766ed79b2ee1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:15.466295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-59d09bf5-d466-4557-a0a2-191c08a37e01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ea46b6d7d147bd803f766ed79b2ee1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:15.476682 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1896/3853] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:15 2022] DELETE /identity/v3/users/67ea46b6d7d147bd803f766ed79b2ee1 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:15.477780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d09bf5-d466-4557-a0a2-191c08a37e01 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:15.480722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-59d09bf5-d466-4557-a0a2-191c08a37e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:15.506507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1c89f-b49b-4a92-b643-835670098da6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:15.572270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d09bf5-d466-4557-a0a2-191c08a37e01 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:15.578296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93149502-562f-45af-ad2c-70bdcaddc7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:15.583535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93149502-562f-45af-ad2c-70bdcaddc7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:15.584134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93149502-562f-45af-ad2c-70bdcaddc7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:15.584664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93149502-562f-45af-ad2c-70bdcaddc7b1 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:15.585970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93149502-562f-45af-ad2c-70bdcaddc7b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:15.588374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93149502-562f-45af-ad2c-70bdcaddc7b1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:15.595699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d0b3f-fb3c-41c7-b8a9-0bf5609348ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:15.596685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d0b3f-fb3c-41c7-b8a9-0bf5609348ba admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:15.597043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d0b3f-fb3c-41c7-b8a9-0bf5609348ba admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:15.597430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d0b3f-fb3c-41c7-b8a9-0bf5609348ba admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:15.598311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d0b3f-fb3c-41c7-b8a9-0bf5609348ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:15.601518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d0b3f-fb3c-41c7-b8a9-0bf5609348ba admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:15.709233 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1897/3854] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:15 2022] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:15.713499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93149502-562f-45af-ad2c-70bdcaddc7b1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:15.715525 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1958/3855] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:20:15 2022] POST /identity/v3/projects => generated 359 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:15.720724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d0b3f-fb3c-41c7-b8a9-0bf5609348ba admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:15.722477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-665d0b3f-fb3c-41c7-b8a9-0bf5609348ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:15.728826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93149502-562f-45af-ad2c-70bdcaddc7b1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:15.834810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d0b3f-fb3c-41c7-b8a9-0bf5609348ba admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:15.839693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6dd7a0-3191-4c54-b5fd-4c02d21eee83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:15.846489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dd7a0-3191-4c54-b5fd-4c02d21eee83 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:15.846489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dd7a0-3191-4c54-b5fd-4c02d21eee83 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:15.846489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dd7a0-3191-4c54-b5fd-4c02d21eee83 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:15.846489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6dd7a0-3191-4c54-b5fd-4c02d21eee83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:15.846489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6dd7a0-3191-4c54-b5fd-4c02d21eee83 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:15.875386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52003f29-a867-46a6-993a-7ec8a28ce24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:15.876451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52003f29-a867-46a6-993a-7ec8a28ce24d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:15.876700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52003f29-a867-46a6-993a-7ec8a28ce24d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:15.876977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52003f29-a867-46a6-993a-7ec8a28ce24d admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:15.877735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52003f29-a867-46a6-993a-7ec8a28ce24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:15.879520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52003f29-a867-46a6-993a-7ec8a28ce24d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:15.892225 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1898/3856] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:15.896184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52003f29-a867-46a6-993a-7ec8a28ce24d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:15.909378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52003f29-a867-46a6-993a-7ec8a28ce24d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:15.917993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacb729-dfd5-4f3e-946c-f97c4483014f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:15.918625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacb729-dfd5-4f3e-946c-f97c4483014f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:15.918964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacb729-dfd5-4f3e-946c-f97c4483014f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:15.919371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacb729-dfd5-4f3e-946c-f97c4483014f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:15.921211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacb729-dfd5-4f3e-946c-f97c4483014f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:15.922871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacb729-dfd5-4f3e-946c-f97c4483014f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:15.958175 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1899/3857] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:20:15.964265 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1959/3858] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:15 2022] POST /identity/v3/users => generated 280 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:15.965206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacb729-dfd5-4f3e-946c-f97c4483014f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:15.968232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6dd7a0-3191-4c54-b5fd-4c02d21eee83 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:15.977956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacb729-dfd5-4f3e-946c-f97c4483014f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:15.982238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6dd7a0-3191-4c54-b5fd-4c02d21eee83 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:15.986000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a0bf55-8d69-4548-956d-2bab31793665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:15.987322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0bf55-8d69-4548-956d-2bab31793665 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:15.988266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0bf55-8d69-4548-956d-2bab31793665 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:15.988266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0bf55-8d69-4548-956d-2bab31793665 admin admin] PATH_INFO: `/v3/projects/21b58c588e03487795f46b458b5a8094/users/9df596bcfbfc48ff8fa292551b14b9fa/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:15.993500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c19db0-38d4-4e5c-859d-88d5feff1741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:15.995544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c19db0-38d4-4e5c-859d-88d5feff1741 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:15.996135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c19db0-38d4-4e5c-859d-88d5feff1741 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:15.996599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c19db0-38d4-4e5c-859d-88d5feff1741 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:15.998256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c19db0-38d4-4e5c-859d-88d5feff1741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:16.001434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c19db0-38d4-4e5c-859d-88d5feff1741 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:16.012906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a0bf55-8d69-4548-956d-2bab31793665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21b58c588e03487795f46b458b5a8094, user_id=9df596bcfbfc48ff8fa292551b14b9fa, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:16.016192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a0bf55-8d69-4548-956d-2bab31793665 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:16.021917 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1960/3859] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:16.024836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c19db0-38d4-4e5c-859d-88d5feff1741 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:16.037664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c19db0-38d4-4e5c-859d-88d5feff1741 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:16.042265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aadb3c-6a14-4004-931d-f70e351cfc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:16.042947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aadb3c-6a14-4004-931d-f70e351cfc31 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:16.043917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aadb3c-6a14-4004-931d-f70e351cfc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:16.044305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aadb3c-6a14-4004-931d-f70e351cfc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:16.045141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aadb3c-6a14-4004-931d-f70e351cfc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:16.047259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aadb3c-6a14-4004-931d-f70e351cfc31 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:16.068365 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1961/3860] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:16.072422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aadb3c-6a14-4004-931d-f70e351cfc31 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:16.084493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aadb3c-6a14-4004-931d-f70e351cfc31 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:16.090930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bc986-1b85-4362-817f-4322db892cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:16.091873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bc986-1b85-4362-817f-4322db892cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:16.092166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bc986-1b85-4362-817f-4322db892cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:16.092432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bc986-1b85-4362-817f-4322db892cd4 admin admin] PATH_INFO: `/v3/projects/63a2349dcff748d9b0961168da258f3c/users/57d1e23d70bf4a29bf8070b9f52ffeb4/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:16.110534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bc986-1b85-4362-817f-4322db892cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a2349dcff748d9b0961168da258f3c, user_id=57d1e23d70bf4a29bf8070b9f52ffeb4, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:16.114045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bc986-1b85-4362-817f-4322db892cd4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:16.120555 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1900/3861] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:15 2022] PUT /identity/v3/projects/21b58c588e03487795f46b458b5a8094/users/9df596bcfbfc48ff8fa292551b14b9fa/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:16.131957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3e782-f3b9-42aa-b9a0-d7cb590495ae None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:16.132307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3e782-f3b9-42aa-b9a0-d7cb590495ae None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:16.132668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3e782-f3b9-42aa-b9a0-d7cb590495ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:16.162506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-06e3e782-f3b9-42aa-b9a0-d7cb590495ae None None] MFA Rules not processed for user `9df596bcfbfc48ff8fa292551b14b9fa`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:16.164412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-06e3e782-f3b9-42aa-b9a0-d7cb590495ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:16.216070 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1962/3862] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:16 2022] PUT /identity/v3/projects/63a2349dcff748d9b0961168da258f3c/users/57d1e23d70bf4a29bf8070b9f52ffeb4/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:20:16.228008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07490767-8f3e-457b-b10d-531c04f5d866 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:16.228406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07490767-8f3e-457b-b10d-531c04f5d866 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:16.228785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07490767-8f3e-457b-b10d-531c04f5d866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:16.252762 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1901/3863] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:20:16.252762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3e782-f3b9-42aa-b9a0-d7cb590495ae None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:16.252762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-06e3e782-f3b9-42aa-b9a0-d7cb590495ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:16.264152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-07490767-8f3e-457b-b10d-531c04f5d866 None None] MFA Rules not processed for user `57d1e23d70bf4a29bf8070b9f52ffeb4`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:16.265377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-07490767-8f3e-457b-b10d-531c04f5d866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:16.345512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3e782-f3b9-42aa-b9a0-d7cb590495ae None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:16.351783 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1963/3864] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:16 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:20:16.356889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07490767-8f3e-457b-b10d-531c04f5d866 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:16.413079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f78b4-787b-448c-8460-bcf69d0a76ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:16.414103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f78b4-787b-448c-8460-bcf69d0a76ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:16.414457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f78b4-787b-448c-8460-bcf69d0a76ac admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:16.414803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f78b4-787b-448c-8460-bcf69d0a76ac admin admin] PATH_INFO: `/v3/projects/4db38c74056247049eeb081686960b98` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:16.416249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f78b4-787b-448c-8460-bcf69d0a76ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=4db38c74056247049eeb081686960b98)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:16.418366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f78b4-787b-448c-8460-bcf69d0a76ac admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:16.432547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07490767-8f3e-457b-b10d-531c04f5d866 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:16.438962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=12 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:16.443971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ee36d-d1c4-4280-bfc9-5f2f5476b933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:16.444647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ee36d-d1c4-4280-bfc9-5f2f5476b933 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:16.444930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ee36d-d1c4-4280-bfc9-5f2f5476b933 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:16.445209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ee36d-d1c4-4280-bfc9-5f2f5476b933 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:16.445942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ee36d-d1c4-4280-bfc9-5f2f5476b933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:16.447910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ee36d-d1c4-4280-bfc9-5f2f5476b933 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:16.589237 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1964/3865] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:20:16 2022] POST /identity/v3/projects => generated 395 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:16.589237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ee36d-d1c4-4280-bfc9-5f2f5476b933 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:16.589237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-885ee36d-d1c4-4280-bfc9-5f2f5476b933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:16.596726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-496f78b4-787b-448c-8460-bcf69d0a76ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4db38c74056247049eeb081686960b98', 'request_id': 'req-496f78b4-787b-448c-8460-bcf69d0a76ac'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:16.602313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-496f78b4-787b-448c-8460-bcf69d0a76ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4db38c74056247049eeb081686960b98', 'request_id': 'req-496f78b4-787b-448c-8460-bcf69d0a76ac'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:16.608896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-496f78b4-787b-448c-8460-bcf69d0a76ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4db38c74056247049eeb081686960b98', 'request_id': 'req-496f78b4-787b-448c-8460-bcf69d0a76ac'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:16.665952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ee36d-d1c4-4280-bfc9-5f2f5476b933 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:16.672199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3b4c2-26b8-4258-88ba-18c07b96a68e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:16.672759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3b4c2-26b8-4258-88ba-18c07b96a68e service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:16.673045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3b4c2-26b8-4258-88ba-18c07b96a68e service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:16.680589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3b4c2-26b8-4258-88ba-18c07b96a68e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:16.702232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-496f78b4-787b-448c-8460-bcf69d0a76ac admin admin] The token cache is being invalidate because project 4db38c74056247049eeb081686960b98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:16.702452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-496f78b4-787b-448c-8460-bcf69d0a76ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:16.703149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-496f78b4-787b-448c-8460-bcf69d0a76ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:16.706087 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1902/3866] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:16 2022] DELETE /identity/v3/projects/4db38c74056247049eeb081686960b98 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:16.710903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f78b4-787b-448c-8460-bcf69d0a76ac admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:16.712659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-496f78b4-787b-448c-8460-bcf69d0a76ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:16.756385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3b4c2-26b8-4258-88ba-18c07b96a68e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:16.758354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3b4c2-26b8-4258-88ba-18c07b96a68e service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:16.769378 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1965/3867] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:16 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:20:16.771082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb4f09-6fa0-45bf-bbd7-34d338365840 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:16.771386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb4f09-6fa0-45bf-bbd7-34d338365840 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:16.771668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb4f09-6fa0-45bf-bbd7-34d338365840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:16.810429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-afbb4f09-6fa0-45bf-bbd7-34d338365840 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:16.812389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-afbb4f09-6fa0-45bf-bbd7-34d338365840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:16.839517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f78b4-787b-448c-8460-bcf69d0a76ac admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:16.929372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d944fc-d4c7-47ad-b512-332e1a4fc09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:16.930323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d944fc-d4c7-47ad-b512-332e1a4fc09b admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:16.931175 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1966/3868] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:16.936909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d944fc-d4c7-47ad-b512-332e1a4fc09b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:16.936909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d944fc-d4c7-47ad-b512-332e1a4fc09b admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:16.937126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb4f09-6fa0-45bf-bbd7-34d338365840 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:16.937205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d944fc-d4c7-47ad-b512-332e1a4fc09b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:16.937279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-afbb4f09-6fa0-45bf-bbd7-34d338365840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:16.937366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d944fc-d4c7-47ad-b512-332e1a4fc09b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:16.959871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb4f09-6fa0-45bf-bbd7-34d338365840 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:16.965102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b84f7-909a-4cc7-a3c6-714bc76f5aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:16.966081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b84f7-909a-4cc7-a3c6-714bc76f5aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:16.966726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b84f7-909a-4cc7-a3c6-714bc76f5aba admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:16.966726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b84f7-909a-4cc7-a3c6-714bc76f5aba admin admin] PATH_INFO: `/v3/users/57d1e23d70bf4a29bf8070b9f52ffeb4` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:16.969076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b84f7-909a-4cc7-a3c6-714bc76f5aba admin admin] RBAC: Authorizing `identity:delete_user(user_id=57d1e23d70bf4a29bf8070b9f52ffeb4)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:16.974619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b84f7-909a-4cc7-a3c6-714bc76f5aba admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:17.032430 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1903/3869] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:16 2022] POST /identity/v3/users => generated 304 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:17.034521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81be60-793d-4d1d-b0d4-665ba06c667d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:17.035355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81be60-793d-4d1d-b0d4-665ba06c667d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:17.035533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81be60-793d-4d1d-b0d4-665ba06c667d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:17.061522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-fb81be60-793d-4d1d-b0d4-665ba06c667d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:17.062814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fb81be60-793d-4d1d-b0d4-665ba06c667d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:17.074911 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1904/3870] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:17.075868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81be60-793d-4d1d-b0d4-665ba06c667d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:17.091031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81be60-793d-4d1d-b0d4-665ba06c667d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:17.097102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc929d-1199-470d-ba69-b776547cdd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:17.097883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc929d-1199-470d-ba69-b776547cdd9f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:17.098335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc929d-1199-470d-ba69-b776547cdd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:17.099344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc929d-1199-470d-ba69-b776547cdd9f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:17.100707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc929d-1199-470d-ba69-b776547cdd9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:17.103503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc929d-1199-470d-ba69-b776547cdd9f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:17.118185 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1905/3871] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:17.118185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc929d-1199-470d-ba69-b776547cdd9f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:17.133023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc929d-1199-470d-ba69-b776547cdd9f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:17.144197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35f866-8f8d-492e-bd9b-639f91975b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:17.145049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35f866-8f8d-492e-bd9b-639f91975b91 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:17.146425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35f866-8f8d-492e-bd9b-639f91975b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:17.146850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35f866-8f8d-492e-bd9b-639f91975b91 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:17.147730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35f866-8f8d-492e-bd9b-639f91975b91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:20:17.148138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35f866-8f8d-492e-bd9b-639f91975b91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:17.149836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35f866-8f8d-492e-bd9b-639f91975b91 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:17.170879 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1906/3872] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:17.170879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35f866-8f8d-492e-bd9b-639f91975b91 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:17.185805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35f866-8f8d-492e-bd9b-639f91975b91 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:17.192163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141c4fc-b5eb-4950-a9e8-57150ecf1b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:17.193815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141c4fc-b5eb-4950-a9e8-57150ecf1b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:17.193939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ee5b84f7-909a-4cc7-a3c6-714bc76f5aba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57d1e23d70bf4a29bf8070b9f52ffeb4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:17.194452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141c4fc-b5eb-4950-a9e8-57150ecf1b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:17.199268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141c4fc-b5eb-4950-a9e8-57150ecf1b27 admin admin] PATH_INFO: `/v3/projects/ccd5ae48864b4b36a824f060dc255a1e/users/0a949c357be444e3946c718c5f3b6c55/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:17.202817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ee5b84f7-909a-4cc7-a3c6-714bc76f5aba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57d1e23d70bf4a29bf8070b9f52ffeb4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:17.216020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141c4fc-b5eb-4950-a9e8-57150ecf1b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd5ae48864b4b36a824f060dc255a1e, user_id=0a949c357be444e3946c718c5f3b6c55, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:17.219036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141c4fc-b5eb-4950-a9e8-57150ecf1b27 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:17.335825 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1907/3873] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:17 2022] PUT /identity/v3/projects/ccd5ae48864b4b36a824f060dc255a1e/users/0a949c357be444e3946c718c5f3b6c55/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:17.336595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141c4fc-b5eb-4950-a9e8-57150ecf1b27 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:17.395997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ee5b84f7-909a-4cc7-a3c6-714bc76f5aba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57d1e23d70bf4a29bf8070b9f52ffeb4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:17.396975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ee5b84f7-909a-4cc7-a3c6-714bc76f5aba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57d1e23d70bf4a29bf8070b9f52ffeb4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:17.404749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141c4fc-b5eb-4950-a9e8-57150ecf1b27 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:17.414117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd670fde-5fac-4845-a151-f35ac99f935c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:17.414948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd670fde-5fac-4845-a151-f35ac99f935c admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:17.415588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd670fde-5fac-4845-a151-f35ac99f935c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:17.415958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd670fde-5fac-4845-a151-f35ac99f935c admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:17.416917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd670fde-5fac-4845-a151-f35ac99f935c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:17.419287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd670fde-5fac-4845-a151-f35ac99f935c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:17.421660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ee5b84f7-909a-4cc7-a3c6-714bc76f5aba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57d1e23d70bf4a29bf8070b9f52ffeb4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:17.431640 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1967/3874] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:16 2022] DELETE /identity/v3/users/57d1e23d70bf4a29bf8070b9f52ffeb4 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:17.433572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b84f7-909a-4cc7-a3c6-714bc76f5aba admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:17.436836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ee5b84f7-909a-4cc7-a3c6-714bc76f5aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:17.516149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b84f7-909a-4cc7-a3c6-714bc76f5aba admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:17.522041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbf7b2-a6e6-474b-a726-6d25a3e03430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:17.522778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbf7b2-a6e6-474b-a726-6d25a3e03430 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:17.523249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbf7b2-a6e6-474b-a726-6d25a3e03430 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:17.523561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbf7b2-a6e6-474b-a726-6d25a3e03430 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:17.524379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbf7b2-a6e6-474b-a726-6d25a3e03430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:17.526043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbf7b2-a6e6-474b-a726-6d25a3e03430 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:17.537611 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1968/3875] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:17.542494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d0f5f-e4c4-4a71-810c-7d8808859595 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:17.542861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d0f5f-e4c4-4a71-810c-7d8808859595 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:17.543219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d0f5f-e4c4-4a71-810c-7d8808859595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:17.546439 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1908/3876] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:20:17 2022] POST /identity/v3/projects => generated 369 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:17.547821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd670fde-5fac-4845-a151-f35ac99f935c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:17.556557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:17.564872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c41d0f5f-e4c4-4a71-810c-7d8808859595 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:17.566163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c41d0f5f-e4c4-4a71-810c-7d8808859595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:17.635250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd670fde-5fac-4845-a151-f35ac99f935c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:17.640417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf3e95-1aef-4e5a-ae28-e28d30a7910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:17.640853 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1969/3877] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:17.641873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf3e95-1aef-4e5a-ae28-e28d30a7910e admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:17.642131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d0f5f-e4c4-4a71-810c-7d8808859595 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:17.642287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf3e95-1aef-4e5a-ae28-e28d30a7910e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:17.642726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf3e95-1aef-4e5a-ae28-e28d30a7910e admin admin] PATH_INFO: `/v3/projects/ccd5ae48864b4b36a824f060dc255a1e/users/0a949c357be444e3946c718c5f3b6c55/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:17.645633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf3e95-1aef-4e5a-ae28-e28d30a7910e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd5ae48864b4b36a824f060dc255a1e, user_id=0a949c357be444e3946c718c5f3b6c55, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:17.648539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf3e95-1aef-4e5a-ae28-e28d30a7910e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:17.652239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c41d0f5f-e4c4-4a71-810c-7d8808859595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:17.665499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d0f5f-e4c4-4a71-810c-7d8808859595 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:17.665822 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1909/3878] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:17 2022] PUT /identity/v3/projects/ccd5ae48864b4b36a824f060dc255a1e/users/0a949c357be444e3946c718c5f3b6c55/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:17.671959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf3e95-1aef-4e5a-ae28-e28d30a7910e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:17.674763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ccaf3e95-1aef-4e5a-ae28-e28d30a7910e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:17.732746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281a784-812f-45de-b2a5-5bdeb4c48a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:17.733564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281a784-812f-45de-b2a5-5bdeb4c48a7f admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:17.733914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281a784-812f-45de-b2a5-5bdeb4c48a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:17.734265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281a784-812f-45de-b2a5-5bdeb4c48a7f admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:17.735155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281a784-812f-45de-b2a5-5bdeb4c48a7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:17.737404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281a784-812f-45de-b2a5-5bdeb4c48a7f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:17.756800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf3e95-1aef-4e5a-ae28-e28d30a7910e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:17.760936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519e869-ae08-41f5-96a6-a6ea9305deb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:17.761738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519e869-ae08-41f5-96a6-a6ea9305deb6 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:17.762178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519e869-ae08-41f5-96a6-a6ea9305deb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:17.762992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519e869-ae08-41f5-96a6-a6ea9305deb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:17.775298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519e869-ae08-41f5-96a6-a6ea9305deb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:17.776910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519e869-ae08-41f5-96a6-a6ea9305deb6 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:17.788866 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1910/3879] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:20:17.791220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153eae7-b89a-477d-83b7-5901ba8959e5 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:17.791220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153eae7-b89a-477d-83b7-5901ba8959e5 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:17.791220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153eae7-b89a-477d-83b7-5901ba8959e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:17.833962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6153eae7-b89a-477d-83b7-5901ba8959e5 None None] MFA Rules not processed for user `0a949c357be444e3946c718c5f3b6c55`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:17.835365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6153eae7-b89a-477d-83b7-5901ba8959e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:17.850679 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1970/3880] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:17 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:17.852271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281a784-812f-45de-b2a5-5bdeb4c48a7f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:17.868852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281a784-812f-45de-b2a5-5bdeb4c48a7f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:17.887655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d008150-d7d9-42ac-a1eb-7516ffc4ffdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:17.889883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d008150-d7d9-42ac-a1eb-7516ffc4ffdc admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:17.891835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d008150-d7d9-42ac-a1eb-7516ffc4ffdc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:17.892288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d008150-d7d9-42ac-a1eb-7516ffc4ffdc admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:17.895523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d008150-d7d9-42ac-a1eb-7516ffc4ffdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:17.897902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d008150-d7d9-42ac-a1eb-7516ffc4ffdc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:17.938388 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1971/3881] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:17.939635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d008150-d7d9-42ac-a1eb-7516ffc4ffdc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:17.962219 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1911/3882] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:17.962435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d008150-d7d9-42ac-a1eb-7516ffc4ffdc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:17.964784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bc704-d797-4e40-ac1b-9ea5d00f8101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:17.965855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bc704-d797-4e40-ac1b-9ea5d00f8101 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:17.966142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bc704-d797-4e40-ac1b-9ea5d00f8101 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:17.966419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bc704-d797-4e40-ac1b-9ea5d00f8101 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:17.967525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bc704-d797-4e40-ac1b-9ea5d00f8101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:17.970828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153eae7-b89a-477d-83b7-5901ba8959e5 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:17.972652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6153eae7-b89a-477d-83b7-5901ba8959e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:17.979820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bc704-d797-4e40-ac1b-9ea5d00f8101 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:18.015169 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1972/3883] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:18.028248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bc704-d797-4e40-ac1b-9ea5d00f8101 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:18.053179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bc704-d797-4e40-ac1b-9ea5d00f8101 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:18.063306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f255f6d-4f54-4c02-89b6-4ef9bd647b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:18.064623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f255f6d-4f54-4c02-89b6-4ef9bd647b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:18.064623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f255f6d-4f54-4c02-89b6-4ef9bd647b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:18.064807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f255f6d-4f54-4c02-89b6-4ef9bd647b24 admin admin] PATH_INFO: `/v3/projects/903ce82a28fe4373b3b8ac45e5d426d8/users/9e6f6e76df824266a137423c3da6fdc8/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:18.085413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f255f6d-4f54-4c02-89b6-4ef9bd647b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=903ce82a28fe4373b3b8ac45e5d426d8, user_id=9e6f6e76df824266a137423c3da6fdc8, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:18.089964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f255f6d-4f54-4c02-89b6-4ef9bd647b24 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:18.139250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153eae7-b89a-477d-83b7-5901ba8959e5 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:18.150099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e0820-ea0c-4ef1-b66d-1f16c1e4bf47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:18.150768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e0820-ea0c-4ef1-b66d-1f16c1e4bf47 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:18.151201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e0820-ea0c-4ef1-b66d-1f16c1e4bf47 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:18.151661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e0820-ea0c-4ef1-b66d-1f16c1e4bf47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:18.162385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e0820-ea0c-4ef1-b66d-1f16c1e4bf47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:18.164134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e0820-ea0c-4ef1-b66d-1f16c1e4bf47 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:18.177811 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1912/3884] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:20:18.199098 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1973/3885] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:18 2022] PUT /identity/v3/projects/903ce82a28fe4373b3b8ac45e5d426d8/users/9e6f6e76df824266a137423c3da6fdc8/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:18.206615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094edaf-35e2-47fa-a1dc-0b90480887b5 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:18.207278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094edaf-35e2-47fa-a1dc-0b90480887b5 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:18.207821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094edaf-35e2-47fa-a1dc-0b90480887b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:18.246889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8094edaf-35e2-47fa-a1dc-0b90480887b5 None None] MFA Rules not processed for user `9e6f6e76df824266a137423c3da6fdc8`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:18.249011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8094edaf-35e2-47fa-a1dc-0b90480887b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:18.274307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:18.342489 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1913/3886] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:18.344677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f255f6d-4f54-4c02-89b6-4ef9bd647b24 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:18.429796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f255f6d-4f54-4c02-89b6-4ef9bd647b24 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:18.436972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa761e5b-5cee-4ca6-b71e-108902e17f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:18.436972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa761e5b-5cee-4ca6-b71e-108902e17f45 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:18.436972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa761e5b-5cee-4ca6-b71e-108902e17f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:18.438238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa761e5b-5cee-4ca6-b71e-108902e17f45 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:18.439129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa761e5b-5cee-4ca6-b71e-108902e17f45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:18.454231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa761e5b-5cee-4ca6-b71e-108902e17f45 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:18.508542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094edaf-35e2-47fa-a1dc-0b90480887b5 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:18.509339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8094edaf-35e2-47fa-a1dc-0b90480887b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:18.596949 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1974/3887] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:20:18 2022] POST /identity/v3/projects => generated 367 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:18.618711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa761e5b-5cee-4ca6-b71e-108902e17f45 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:18.648624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094edaf-35e2-47fa-a1dc-0b90480887b5 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:18.790610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f131612-2f0b-4eae-b175-873232c7b7dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:18.792129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f131612-2f0b-4eae-b175-873232c7b7dd service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:18.794401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f131612-2f0b-4eae-b175-873232c7b7dd service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:18.794799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f131612-2f0b-4eae-b175-873232c7b7dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:18.803689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5f131612-2f0b-4eae-b175-873232c7b7dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:18.862993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa761e5b-5cee-4ca6-b71e-108902e17f45 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:18.875740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45ef1b-8fa8-4445-b284-7f906158c0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:18.876432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45ef1b-8fa8-4445-b284-7f906158c0ee admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:18.876967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45ef1b-8fa8-4445-b284-7f906158c0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:18.877248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45ef1b-8fa8-4445-b284-7f906158c0ee admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:18.878153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45ef1b-8fa8-4445-b284-7f906158c0ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:18.882048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45ef1b-8fa8-4445-b284-7f906158c0ee admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:18.926169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f131612-2f0b-4eae-b175-873232c7b7dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:18.928995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f131612-2f0b-4eae-b175-873232c7b7dd service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:18.956852 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1914/3888] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:20:18.958000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f131612-2f0b-4eae-b175-873232c7b7dd service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:18.970396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5f131612-2f0b-4eae-b175-873232c7b7dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:19.001879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f131612-2f0b-4eae-b175-873232c7b7dd service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:19.015368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407c315-9e28-45aa-88b8-aa71e9e711f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:19.016412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407c315-9e28-45aa-88b8-aa71e9e711f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:19.019177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407c315-9e28-45aa-88b8-aa71e9e711f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:19.021138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407c315-9e28-45aa-88b8-aa71e9e711f1 admin admin] PATH_INFO: `/v3/projects/63a2349dcff748d9b0961168da258f3c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:19.023950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407c315-9e28-45aa-88b8-aa71e9e711f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a2349dcff748d9b0961168da258f3c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:19.028288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407c315-9e28-45aa-88b8-aa71e9e711f1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:19.043534 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1975/3889] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:18 2022] POST /identity/v3/users => generated 290 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:19.044793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45ef1b-8fa8-4445-b284-7f906158c0ee admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:19.075389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45ef1b-8fa8-4445-b284-7f906158c0ee admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:19.104262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86d95d-5fd1-484f-86ee-610c228d654d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:19.105161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86d95d-5fd1-484f-86ee-610c228d654d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:19.109137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86d95d-5fd1-484f-86ee-610c228d654d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:19.109137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86d95d-5fd1-484f-86ee-610c228d654d admin admin] PATH_INFO: `/v3/users/9df596bcfbfc48ff8fa292551b14b9fa` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:19.112629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86d95d-5fd1-484f-86ee-610c228d654d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df596bcfbfc48ff8fa292551b14b9fa)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:19.116041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86d95d-5fd1-484f-86ee-610c228d654d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:19.146412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:19.258838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a407c315-9e28-45aa-88b8-aa71e9e711f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a2349dcff748d9b0961168da258f3c', 'request_id': 'req-a407c315-9e28-45aa-88b8-aa71e9e711f1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:19.279674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a407c315-9e28-45aa-88b8-aa71e9e711f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a2349dcff748d9b0961168da258f3c', 'request_id': 'req-a407c315-9e28-45aa-88b8-aa71e9e711f1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:19.291781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a407c315-9e28-45aa-88b8-aa71e9e711f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a2349dcff748d9b0961168da258f3c', 'request_id': 'req-a407c315-9e28-45aa-88b8-aa71e9e711f1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:19.392859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a407c315-9e28-45aa-88b8-aa71e9e711f1 admin admin] The token cache is being invalidate because project 63a2349dcff748d9b0961168da258f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:19.393257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a407c315-9e28-45aa-88b8-aa71e9e711f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:19.396554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a407c315-9e28-45aa-88b8-aa71e9e711f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:19.402586 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1915/3890] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:18 2022] DELETE /identity/v3/projects/63a2349dcff748d9b0961168da258f3c => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:19.404675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407c315-9e28-45aa-88b8-aa71e9e711f1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:19.409345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a407c315-9e28-45aa-88b8-aa71e9e711f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:19.415624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7f86d95d-5fd1-484f-86ee-610c228d654d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df596bcfbfc48ff8fa292551b14b9fa'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:19.440835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7f86d95d-5fd1-484f-86ee-610c228d654d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df596bcfbfc48ff8fa292551b14b9fa'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:19.533642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7f86d95d-5fd1-484f-86ee-610c228d654d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df596bcfbfc48ff8fa292551b14b9fa'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:19.536377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7f86d95d-5fd1-484f-86ee-610c228d654d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df596bcfbfc48ff8fa292551b14b9fa'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:19.566408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7f86d95d-5fd1-484f-86ee-610c228d654d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df596bcfbfc48ff8fa292551b14b9fa'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:19.569368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407c315-9e28-45aa-88b8-aa71e9e711f1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:19.580899 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1976/3891] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:19 2022] DELETE /identity/v3/users/9df596bcfbfc48ff8fa292551b14b9fa => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:19.580899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9830c9d-fccf-45d4-a080-7e335643408c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:19.581159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9830c9d-fccf-45d4-a080-7e335643408c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:19.583613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9830c9d-fccf-45d4-a080-7e335643408c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:19.587962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc6a42-ac2a-49f9-8145-559c810a1d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:19.592187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6a42-ac2a-49f9-8145-559c810a1d21 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:19.592187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6a42-ac2a-49f9-8145-559c810a1d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:19.592187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6a42-ac2a-49f9-8145-559c810a1d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:19.592187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc6a42-ac2a-49f9-8145-559c810a1d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:19.592187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc6a42-ac2a-49f9-8145-559c810a1d21 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:19.615687 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1916/3892] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:19.616024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b9830c9d-fccf-45d4-a080-7e335643408c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:19.617079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3905e-582a-42d4-a024-9cac1d41a92a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:19.617370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3905e-582a-42d4-a024-9cac1d41a92a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:19.617647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3905e-582a-42d4-a024-9cac1d41a92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:19.618165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b9830c9d-fccf-45d4-a080-7e335643408c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:19.642072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-60d3905e-582a-42d4-a024-9cac1d41a92a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:19.643346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-60d3905e-582a-42d4-a024-9cac1d41a92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:19.715161 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1977/3893] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:19.716570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9830c9d-fccf-45d4-a080-7e335643408c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:19.718132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b9830c9d-fccf-45d4-a080-7e335643408c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:19.739810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9830c9d-fccf-45d4-a080-7e335643408c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:19.760311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa5357-7f41-4721-80fd-f7068f5e40ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:19.761538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa5357-7f41-4721-80fd-f7068f5e40ae admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:19.761973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa5357-7f41-4721-80fd-f7068f5e40ae admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:19.762886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa5357-7f41-4721-80fd-f7068f5e40ae admin admin] PATH_INFO: `/v3/projects/12ac4abf4d674356bb4a2eece79bd807/users/6d875a84cf59442391ca5a8e74f6fb58/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:19.769096 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1917/3894] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:19.775725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88aa1f1-0b2b-4831-8a42-b3b7f620660c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:19.776129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88aa1f1-0b2b-4831-8a42-b3b7f620660c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:19.776520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88aa1f1-0b2b-4831-8a42-b3b7f620660c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:19.785918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa5357-7f41-4721-80fd-f7068f5e40ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ac4abf4d674356bb4a2eece79bd807, user_id=6d875a84cf59442391ca5a8e74f6fb58, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:19.792275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa5357-7f41-4721-80fd-f7068f5e40ae admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:19.813417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a88aa1f1-0b2b-4831-8a42-b3b7f620660c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:19.816313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a88aa1f1-0b2b-4831-8a42-b3b7f620660c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:19.830688 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1918/3895] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:19.831740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88aa1f1-0b2b-4831-8a42-b3b7f620660c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:19.840941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a88aa1f1-0b2b-4831-8a42-b3b7f620660c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:19.945919 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1978/3896] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:19 2022] PUT /identity/v3/projects/12ac4abf4d674356bb4a2eece79bd807/users/6d875a84cf59442391ca5a8e74f6fb58/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:19.946863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa5357-7f41-4721-80fd-f7068f5e40ae admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:20.010266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88aa1f1-0b2b-4831-8a42-b3b7f620660c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:20.103393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa5357-7f41-4721-80fd-f7068f5e40ae admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:20.109905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967ffd0-445f-4053-b5d1-2a4ca832ad05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:20.111187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967ffd0-445f-4053-b5d1-2a4ca832ad05 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:20.111513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967ffd0-445f-4053-b5d1-2a4ca832ad05 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:20.112573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a21ae7-bedb-41b2-b5e8-841ab3d88298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:20.113369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a21ae7-bedb-41b2-b5e8-841ab3d88298 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:20.113656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a21ae7-bedb-41b2-b5e8-841ab3d88298 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:20.113934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a21ae7-bedb-41b2-b5e8-841ab3d88298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:20.120107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967ffd0-445f-4053-b5d1-2a4ca832ad05 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:20.123169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967ffd0-445f-4053-b5d1-2a4ca832ad05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:20:20.123169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967ffd0-445f-4053-b5d1-2a4ca832ad05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:20.125178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967ffd0-445f-4053-b5d1-2a4ca832ad05 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:20.133681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a21ae7-bedb-41b2-b5e8-841ab3d88298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:20.136135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a21ae7-bedb-41b2-b5e8-841ab3d88298 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:20.143070 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1979/3897] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:20.149104 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1919/3898] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:20:20.150321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a21ae7-bedb-41b2-b5e8-841ab3d88298 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:20.150786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967ffd0-445f-4053-b5d1-2a4ca832ad05 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:20.166782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a21ae7-bedb-41b2-b5e8-841ab3d88298 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:20.168932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967ffd0-445f-4053-b5d1-2a4ca832ad05 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:20.178839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4462fdb-963b-40b9-ac70-3f9fa9f377b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:20.179944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4462fdb-963b-40b9-ac70-3f9fa9f377b4 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:20.180231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4462fdb-963b-40b9-ac70-3f9fa9f377b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:20.180513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4462fdb-963b-40b9-ac70-3f9fa9f377b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:20.181307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4462fdb-963b-40b9-ac70-3f9fa9f377b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:20.184152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4462fdb-963b-40b9-ac70-3f9fa9f377b4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:20.190025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d128569-9f78-4e43-9bd7-11d90d41f188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:20.195629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d128569-9f78-4e43-9bd7-11d90d41f188 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:20.196049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d128569-9f78-4e43-9bd7-11d90d41f188 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:20.199686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d128569-9f78-4e43-9bd7-11d90d41f188 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:20.202613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d128569-9f78-4e43-9bd7-11d90d41f188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:20.205006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d128569-9f78-4e43-9bd7-11d90d41f188 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:20.220329 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1980/3899] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:20.221420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4462fdb-963b-40b9-ac70-3f9fa9f377b4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:20.256326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4462fdb-963b-40b9-ac70-3f9fa9f377b4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:20.284358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b939ee7-2ee3-4056-b29d-f6620213fd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:20.285590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b939ee7-2ee3-4056-b29d-f6620213fd18 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:20.286433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b939ee7-2ee3-4056-b29d-f6620213fd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:20.286710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b939ee7-2ee3-4056-b29d-f6620213fd18 admin admin] PATH_INFO: `/v3/projects/12ac4abf4d674356bb4a2eece79bd807/users/6d875a84cf59442391ca5a8e74f6fb58/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:20.292193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b939ee7-2ee3-4056-b29d-f6620213fd18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ac4abf4d674356bb4a2eece79bd807, user_id=6d875a84cf59442391ca5a8e74f6fb58, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:20.295073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b939ee7-2ee3-4056-b29d-f6620213fd18 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:20.331093 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1981/3900] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:20 2022] PUT /identity/v3/projects/12ac4abf4d674356bb4a2eece79bd807/users/6d875a84cf59442391ca5a8e74f6fb58/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:20.400205 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1920/3901] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:20:20 2022] POST /identity/v3/projects => generated 373 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:20.404661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b939ee7-2ee3-4056-b29d-f6620213fd18 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:20.431259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75398994-63f6-4619-aeec-28a29b4238c5 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:20.431546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75398994-63f6-4619-aeec-28a29b4238c5 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:20.431833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75398994-63f6-4619-aeec-28a29b4238c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:20.462322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-75398994-63f6-4619-aeec-28a29b4238c5 None None] MFA Rules not processed for user `6d875a84cf59442391ca5a8e74f6fb58`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:20.465494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-75398994-63f6-4619-aeec-28a29b4238c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:20.527288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:20.531909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b939ee7-2ee3-4056-b29d-f6620213fd18 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:20.574932 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1921/3902] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:20 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:20:20.581706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75398994-63f6-4619-aeec-28a29b4238c5 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:20.595325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75398994-63f6-4619-aeec-28a29b4238c5 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:20.601318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fbc75-ded9-4683-8d8e-d85c16237c2b tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d875a84cf59442391ca5a8e74f6fb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ac4abf4d674356bb4a2eece79bd807', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:20.602171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fbc75-ded9-4683-8d8e-d85c16237c2b tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:20.604046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fbc75-ded9-4683-8d8e-d85c16237c2b tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:20.604386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fbc75-ded9-4683-8d8e-d85c16237c2b tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:20.605138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2fbc75-ded9-4683-8d8e-d85c16237c2b tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:20.606764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2fbc75-ded9-4683-8d8e-d85c16237c2b tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:20.611872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff7553-a24e-4671-bdae-0eda7bc60c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:20.612543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff7553-a24e-4671-bdae-0eda7bc60c7b admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:20.612825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff7553-a24e-4671-bdae-0eda7bc60c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:20.613097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff7553-a24e-4671-bdae-0eda7bc60c7b admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:20.614491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff7553-a24e-4671-bdae-0eda7bc60c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:20.616817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff7553-a24e-4671-bdae-0eda7bc60c7b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:20.698919 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1922/3903] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Jul 16 21:20:20 2022] POST /identity/v3/services => generated 239 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:20.702779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fbc75-ded9-4683-8d8e-d85c16237c2b tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:20.721122 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1982/3904] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:20 2022] POST /identity/v3/users => generated 287 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:20.726577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff7553-a24e-4671-bdae-0eda7bc60c7b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:20.733007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fbc75-ded9-4683-8d8e-d85c16237c2b tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:20.738056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff7553-a24e-4671-bdae-0eda7bc60c7b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:20.741231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3818b-34b0-4865-8690-f1a5a19ab63d tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d875a84cf59442391ca5a8e74f6fb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ac4abf4d674356bb4a2eece79bd807', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:20.742128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3818b-34b0-4865-8690-f1a5a19ab63d tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:20.742408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3818b-34b0-4865-8690-f1a5a19ab63d tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:20.742694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3818b-34b0-4865-8690-f1a5a19ab63d tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] PATH_INFO: `/v3/services/7f8353020c7b48b7ba00727cd064722b` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:20.744314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3818b-34b0-4865-8690-f1a5a19ab63d tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorizing `identity:delete_service(service_id=7f8353020c7b48b7ba00727cd064722b)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:20.746045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3818b-34b0-4865-8690-f1a5a19ab63d tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:20.757388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce968e25-5e68-4ccb-aed3-9fe5051efeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:20.758393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce968e25-5e68-4ccb-aed3-9fe5051efeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:20.758909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce968e25-5e68-4ccb-aed3-9fe5051efeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:20.759417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce968e25-5e68-4ccb-aed3-9fe5051efeb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:20.760221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce968e25-5e68-4ccb-aed3-9fe5051efeb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:20.761897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce968e25-5e68-4ccb-aed3-9fe5051efeb1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:20.772790 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1983/3905] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:20:20.776981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce968e25-5e68-4ccb-aed3-9fe5051efeb1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:20.787692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce968e25-5e68-4ccb-aed3-9fe5051efeb1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:20.794453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ad8f9-fdf8-4808-8f0e-54e2384a6524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:20.795177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ad8f9-fdf8-4808-8f0e-54e2384a6524 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:20.795475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ad8f9-fdf8-4808-8f0e-54e2384a6524 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:20.795739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ad8f9-fdf8-4808-8f0e-54e2384a6524 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:20.796465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ad8f9-fdf8-4808-8f0e-54e2384a6524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:20.798069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ad8f9-fdf8-4808-8f0e-54e2384a6524 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:20.824763 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1984/3906] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:20:20.824763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ad8f9-fdf8-4808-8f0e-54e2384a6524 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:20.845312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ad8f9-fdf8-4808-8f0e-54e2384a6524 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:20.854421 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1923/3907] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:20 2022] DELETE /identity/v3/services/7f8353020c7b48b7ba00727cd064722b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:20.854421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3818b-34b0-4865-8690-f1a5a19ab63d tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:20.865372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5cb3818b-34b0-4865-8690-f1a5a19ab63d tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:20.893938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19af0c5-d078-4c71-af6a-d6fce251a931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:20.894886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19af0c5-d078-4c71-af6a-d6fce251a931 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:20.895668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19af0c5-d078-4c71-af6a-d6fce251a931 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:20.896944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19af0c5-d078-4c71-af6a-d6fce251a931 admin admin] PATH_INFO: `/v3/projects/28489f72346f422f9d44afcf5393acc4/users/9fb89c3c454243dfbb48e3a1971c9491/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:20.921136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3818b-34b0-4865-8690-f1a5a19ab63d tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:20.921347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19af0c5-d078-4c71-af6a-d6fce251a931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28489f72346f422f9d44afcf5393acc4, user_id=9fb89c3c454243dfbb48e3a1971c9491, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:20.924496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19af0c5-d078-4c71-af6a-d6fce251a931 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:20.930317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9c446-ed17-4ec8-920a-c6fa6aa832c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:20.931968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9c446-ed17-4ec8-920a-c6fa6aa832c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:20.932420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9c446-ed17-4ec8-920a-c6fa6aa832c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:20.932769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9c446-ed17-4ec8-920a-c6fa6aa832c1 admin admin] PATH_INFO: `/v3/projects/21b58c588e03487795f46b458b5a8094` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:20.936951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9c446-ed17-4ec8-920a-c6fa6aa832c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21b58c588e03487795f46b458b5a8094)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:20.939168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9c446-ed17-4ec8-920a-c6fa6aa832c1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:21.076181 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1985/3908] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:20 2022] PUT /identity/v3/projects/28489f72346f422f9d44afcf5393acc4/users/9fb89c3c454243dfbb48e3a1971c9491/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:21.081309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19af0c5-d078-4c71-af6a-d6fce251a931 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:21.161743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d2a9c446-ed17-4ec8-920a-c6fa6aa832c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21b58c588e03487795f46b458b5a8094', 'request_id': 'req-d2a9c446-ed17-4ec8-920a-c6fa6aa832c1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:21.174205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d2a9c446-ed17-4ec8-920a-c6fa6aa832c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21b58c588e03487795f46b458b5a8094', 'request_id': 'req-d2a9c446-ed17-4ec8-920a-c6fa6aa832c1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:21.197209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d2a9c446-ed17-4ec8-920a-c6fa6aa832c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21b58c588e03487795f46b458b5a8094', 'request_id': 'req-d2a9c446-ed17-4ec8-920a-c6fa6aa832c1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:21.250711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19af0c5-d078-4c71-af6a-d6fce251a931 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:21.300079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d2a9c446-ed17-4ec8-920a-c6fa6aa832c1 admin admin] The token cache is being invalidate because project 21b58c588e03487795f46b458b5a8094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:21.300323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d2a9c446-ed17-4ec8-920a-c6fa6aa832c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:21.301350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d2a9c446-ed17-4ec8-920a-c6fa6aa832c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:21.302646 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1924/3909] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:20 2022] DELETE /identity/v3/projects/21b58c588e03487795f46b458b5a8094 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:21.306466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25680c-661b-4e4b-b463-fa58e5d82283 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:21.306757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25680c-661b-4e4b-b463-fa58e5d82283 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:21.307639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25680c-661b-4e4b-b463-fa58e5d82283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:21.331027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece421d-1508-4b64-ab0c-880d4f2ea8cd tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d875a84cf59442391ca5a8e74f6fb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ac4abf4d674356bb4a2eece79bd807', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:21.331691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece421d-1508-4b64-ab0c-880d4f2ea8cd tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:21.331977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece421d-1508-4b64-ab0c-880d4f2ea8cd tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:21.332255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece421d-1508-4b64-ab0c-880d4f2ea8cd tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:21.333537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece421d-1508-4b64-ab0c-880d4f2ea8cd tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:21.335510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece421d-1508-4b64-ab0c-880d4f2ea8cd tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:21.336321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4d25680c-661b-4e4b-b463-fa58e5d82283 None None] MFA Rules not processed for user `9fb89c3c454243dfbb48e3a1971c9491`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:21.337532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4d25680c-661b-4e4b-b463-fa58e5d82283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:21.344469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:21.408825 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1925/3910] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:21.409765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25680c-661b-4e4b-b463-fa58e5d82283 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:21.415057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4d25680c-661b-4e4b-b463-fa58e5d82283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:21.429973 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1986/3911] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:20:21 2022] POST /identity/v3/services => generated 288 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:21.430904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece421d-1508-4b64-ab0c-880d4f2ea8cd tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:21.432763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dece421d-1508-4b64-ab0c-880d4f2ea8cd tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:21.496552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:21.503571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25680c-661b-4e4b-b463-fa58e5d82283 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:21.532350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa3f6a-71e5-4f72-81d7-24e1d2fe855b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:21.533635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa3f6a-71e5-4f72-81d7-24e1d2fe855b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:21.534103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa3f6a-71e5-4f72-81d7-24e1d2fe855b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:21.534377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa3f6a-71e5-4f72-81d7-24e1d2fe855b admin admin] PATH_INFO: `/v3/users/0a949c357be444e3946c718c5f3b6c55` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:21.535658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa3f6a-71e5-4f72-81d7-24e1d2fe855b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a949c357be444e3946c718c5f3b6c55)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:21.538924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa3f6a-71e5-4f72-81d7-24e1d2fe855b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:21.569290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece421d-1508-4b64-ab0c-880d4f2ea8cd tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:21.589479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09967895-9ea6-4152-8ca8-ece059ae950f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:21.590685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09967895-9ea6-4152-8ca8-ece059ae950f service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:21.590685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09967895-9ea6-4152-8ca8-ece059ae950f service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:21.590922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09967895-9ea6-4152-8ca8-ece059ae950f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:21.600952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09967895-9ea6-4152-8ca8-ece059ae950f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:21.602865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09967895-9ea6-4152-8ca8-ece059ae950f service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:21.628738 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1987/3912] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:21 2022] GET /identity/v3/auth/tokens => generated 3373 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:20:21.630275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09967895-9ea6-4152-8ca8-ece059ae950f service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:21.631831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-09967895-9ea6-4152-8ca8-ece059ae950f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:21.675823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09967895-9ea6-4152-8ca8-ece059ae950f service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:21.695817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707e250-c478-4763-8078-3b8a3a19eec3 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d875a84cf59442391ca5a8e74f6fb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ac4abf4d674356bb4a2eece79bd807', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:21.697222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707e250-c478-4763-8078-3b8a3a19eec3 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:21.698806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707e250-c478-4763-8078-3b8a3a19eec3 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:21.699222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707e250-c478-4763-8078-3b8a3a19eec3 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] PATH_INFO: `/v3/services/2c7a37fd6bbf4c988ac18b05cadb44a6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:21.700777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707e250-c478-4763-8078-3b8a3a19eec3 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorizing `identity:update_service(service_id=2c7a37fd6bbf4c988ac18b05cadb44a6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:21.702076 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-f707e250-c478-4763-8078-3b8a3a19eec3 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:21.702076 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:20:21.702076 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:20:21.708927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707e250-c478-4763-8078-3b8a3a19eec3 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:21.789918 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1988/3913] 10.222.0.16 () {60 vars in 1251 bytes} [Sat Jul 16 21:20:21 2022] PATCH /identity/v3/services/2c7a37fd6bbf4c988ac18b05cadb44a6 => generated 282 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:21.794700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707e250-c478-4763-8078-3b8a3a19eec3 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:21.807317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-10aa3f6a-71e5-4f72-81d7-24e1d2fe855b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a949c357be444e3946c718c5f3b6c55'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:21.836830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707e250-c478-4763-8078-3b8a3a19eec3 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:21.839708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-10aa3f6a-71e5-4f72-81d7-24e1d2fe855b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a949c357be444e3946c718c5f3b6c55'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:21.842280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4e321-b6ab-479a-b805-f2e76264d49a tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d875a84cf59442391ca5a8e74f6fb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ac4abf4d674356bb4a2eece79bd807', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:21.843229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4e321-b6ab-479a-b805-f2e76264d49a tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:21.843527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4e321-b6ab-479a-b805-f2e76264d49a tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:21.843852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4e321-b6ab-479a-b805-f2e76264d49a tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] PATH_INFO: `/v3/services/2c7a37fd6bbf4c988ac18b05cadb44a6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:21.844672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4e321-b6ab-479a-b805-f2e76264d49a tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorizing `identity:get_service(service_id=2c7a37fd6bbf4c988ac18b05cadb44a6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:21.845691 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-75f4e321-b6ab-479a-b805-f2e76264d49a tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:21.845691 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:20:21.845691 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:20:21.846616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4e321-b6ab-479a-b805-f2e76264d49a tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:21.855086 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1989/3914] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:20:21 2022] GET /identity/v3/services/2c7a37fd6bbf4c988ac18b05cadb44a6 => generated 282 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:21.858950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4e321-b6ab-479a-b805-f2e76264d49a tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:21.878700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4e321-b6ab-479a-b805-f2e76264d49a tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:21.884433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5912b5-9298-453e-93be-f8c2e3a940bb tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d875a84cf59442391ca5a8e74f6fb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ac4abf4d674356bb4a2eece79bd807', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:21.885734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5912b5-9298-453e-93be-f8c2e3a940bb tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:21.886262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5912b5-9298-453e-93be-f8c2e3a940bb tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:21.886818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5912b5-9298-453e-93be-f8c2e3a940bb tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] PATH_INFO: `/v3/services/2c7a37fd6bbf4c988ac18b05cadb44a6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:21.888189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5912b5-9298-453e-93be-f8c2e3a940bb tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorizing `identity:delete_service(service_id=2c7a37fd6bbf4c988ac18b05cadb44a6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:21.890825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5912b5-9298-453e-93be-f8c2e3a940bb tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:21.952885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-10aa3f6a-71e5-4f72-81d7-24e1d2fe855b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a949c357be444e3946c718c5f3b6c55'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:21.985983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-10aa3f6a-71e5-4f72-81d7-24e1d2fe855b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a949c357be444e3946c718c5f3b6c55'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:21.988563 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1990/3915] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:21 2022] DELETE /identity/v3/services/2c7a37fd6bbf4c988ac18b05cadb44a6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:21.993104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-10aa3f6a-71e5-4f72-81d7-24e1d2fe855b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a949c357be444e3946c718c5f3b6c55'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:21.993343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5912b5-9298-453e-93be-f8c2e3a940bb tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:22.012377 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1926/3916] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:21 2022] DELETE /identity/v3/users/0a949c357be444e3946c718c5f3b6c55 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:22.017006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5912b5-9298-453e-93be-f8c2e3a940bb tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:22.118544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae921f-3c50-46d6-80fb-079072d0017c tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d875a84cf59442391ca5a8e74f6fb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ac4abf4d674356bb4a2eece79bd807', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:22.120240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae921f-3c50-46d6-80fb-079072d0017c tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:22.120767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae921f-3c50-46d6-80fb-079072d0017c tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:22.120852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae921f-3c50-46d6-80fb-079072d0017c tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] PATH_INFO: `/v3/services/2c7a37fd6bbf4c988ac18b05cadb44a6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:22.121774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae921f-3c50-46d6-80fb-079072d0017c tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorizing `identity:get_service(service_id=2c7a37fd6bbf4c988ac18b05cadb44a6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:22.123763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae921f-3c50-46d6-80fb-079072d0017c tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:22.143861 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-73ae921f-3c50-46d6-80fb-079072d0017c tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Could not find service: 2c7a37fd6bbf4c988ac18b05cadb44a6.: keystone.exception.ServiceNotFound: Could not find service: 2c7a37fd6bbf4c988ac18b05cadb44a6. Jul 16 21:20:22.143861 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:20:22.143861 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 16 21:20:22.143861 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 16 21:20:22.143861 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 16 21:20:22.143861 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 16 21:20:22.143861 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 16 21:20:22.143861 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 21:20:22.143861 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 2c7a37fd6bbf4c988ac18b05cadb44a6. Jul 16 21:20:22.143861 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:20:22.143861 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:20:22.143861 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:20:22.143861 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:20:22.143861 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:20:22.143861 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:20:22.143861 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:20:22.144907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:20:22.144907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:20:22.144907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:20:22.144907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:20:22.144907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:20:22.144907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:20:22.144907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:20:22.144907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 16 21:20:22.144907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 16 21:20:22.144907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 16 21:20:22.144907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 16 21:20:22.144907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:20:22.144907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:20:22.144907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:20:22.144907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:20:22.144907 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:20:22.146414 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:20:22.146414 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:20:22.146414 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 21:20:22.146414 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:20:22.146414 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:20:22.146414 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:20:22.146414 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:20:22.146414 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:20:22.146414 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:20:22.146414 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:20:22.146414 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:20:22.146414 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 16 21:20:22.146414 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 16 21:20:22.146414 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 2c7a37fd6bbf4c988ac18b05cadb44a6. Jul 16 21:20:22.146414 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:20:22.146414 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1991/3917] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:20:21 2022] GET /identity/v3/services/2c7a37fd6bbf4c988ac18b05cadb44a6 => generated 113 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 16 21:20:22.150827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa3f6a-71e5-4f72-81d7-24e1d2fe855b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:22.152544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-10aa3f6a-71e5-4f72-81d7-24e1d2fe855b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:22.168387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa3f6a-71e5-4f72-81d7-24e1d2fe855b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:22.173452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e361c60-1f9a-40b9-b10f-5d99c2101886 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d875a84cf59442391ca5a8e74f6fb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ac4abf4d674356bb4a2eece79bd807', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:22.174202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e361c60-1f9a-40b9-b10f-5d99c2101886 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:22.174518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e361c60-1f9a-40b9-b10f-5d99c2101886 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:22.174764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e361c60-1f9a-40b9-b10f-5d99c2101886 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:22.175546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e361c60-1f9a-40b9-b10f-5d99c2101886 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:22.178096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e361c60-1f9a-40b9-b10f-5d99c2101886 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:22.245182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae921f-3c50-46d6-80fb-079072d0017c tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:22.247903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-73ae921f-3c50-46d6-80fb-079072d0017c tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:22.273976 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1927/3918] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:20:22 2022] POST /identity/v3/services => generated 274 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:20:22.275165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e361c60-1f9a-40b9-b10f-5d99c2101886 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:22.299687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e361c60-1f9a-40b9-b10f-5d99c2101886 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:22.306033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615de17-ed8d-449f-964f-c214e0de0765 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d875a84cf59442391ca5a8e74f6fb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ac4abf4d674356bb4a2eece79bd807', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:22.307089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615de17-ed8d-449f-964f-c214e0de0765 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:22.307385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615de17-ed8d-449f-964f-c214e0de0765 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:22.307680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615de17-ed8d-449f-964f-c214e0de0765 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:22.308750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615de17-ed8d-449f-964f-c214e0de0765 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:22.310537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615de17-ed8d-449f-964f-c214e0de0765 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:22.340076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae921f-3c50-46d6-80fb-079072d0017c tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:22.360589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c8847-c8eb-4594-8828-365ab0976c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:22.361492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c8847-c8eb-4594-8828-365ab0976c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:22.361775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c8847-c8eb-4594-8828-365ab0976c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:22.362065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c8847-c8eb-4594-8828-365ab0976c1e admin admin] PATH_INFO: `/v3/users/eebb224a56814f92b12ebebebc6bc8a3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:22.363356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c8847-c8eb-4594-8828-365ab0976c1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eebb224a56814f92b12ebebebc6bc8a3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:22.367340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c8847-c8eb-4594-8828-365ab0976c1e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:22.449193 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1928/3919] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:20:22 2022] POST /identity/v3/services => generated 274 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:22.453256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615de17-ed8d-449f-964f-c214e0de0765 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:22.479363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615de17-ed8d-449f-964f-c214e0de0765 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:22.486424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668629f-a8d8-4407-9fe4-b671a191fd66 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d875a84cf59442391ca5a8e74f6fb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ac4abf4d674356bb4a2eece79bd807', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:22.487395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668629f-a8d8-4407-9fe4-b671a191fd66 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:22.488009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668629f-a8d8-4407-9fe4-b671a191fd66 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:22.488432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668629f-a8d8-4407-9fe4-b671a191fd66 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:22.490455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668629f-a8d8-4407-9fe4-b671a191fd66 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:22.492562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668629f-a8d8-4407-9fe4-b671a191fd66 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:22.624229 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1929/3920] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:20:22 2022] POST /identity/v3/services => generated 275 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:20:22.628895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668629f-a8d8-4407-9fe4-b671a191fd66 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:22.667208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-648c8847-c8eb-4594-8828-365ab0976c1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eebb224a56814f92b12ebebebc6bc8a3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:22.678186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-648c8847-c8eb-4594-8828-365ab0976c1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eebb224a56814f92b12ebebebc6bc8a3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:22.679713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668629f-a8d8-4407-9fe4-b671a191fd66 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:22.689590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e7558-79f6-470b-9599-699075d73c67 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d875a84cf59442391ca5a8e74f6fb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ac4abf4d674356bb4a2eece79bd807', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:22.690719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e7558-79f6-470b-9599-699075d73c67 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:22.691149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e7558-79f6-470b-9599-699075d73c67 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:22.691641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e7558-79f6-470b-9599-699075d73c67 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:22.692534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e7558-79f6-470b-9599-699075d73c67 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:22.693690 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-613e7558-79f6-470b-9599-699075d73c67 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:22.693690 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:20:22.693690 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:20:22.695037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e7558-79f6-470b-9599-699075d73c67 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:22.706282 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1930/3921] 10.222.0.16 () {58 vars in 1130 bytes} [Sat Jul 16 21:20:22 2022] GET /identity/v3/services => generated 2978 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:20:22.708609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e7558-79f6-470b-9599-699075d73c67 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:22.709669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-613e7558-79f6-470b-9599-699075d73c67 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:22.733085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:DELETE=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:22.747893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e7558-79f6-470b-9599-699075d73c67 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:22.754101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ba317-2e70-4f18-bd86-f492ed57866f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:22.755542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ba317-2e70-4f18-bd86-f492ed57866f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:22.755542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ba317-2e70-4f18-bd86-f492ed57866f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:22.755844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ba317-2e70-4f18-bd86-f492ed57866f admin admin] PATH_INFO: `/v3/projects/ccd5ae48864b4b36a824f060dc255a1e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:22.757101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ba317-2e70-4f18-bd86-f492ed57866f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd5ae48864b4b36a824f060dc255a1e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:22.759104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ba317-2e70-4f18-bd86-f492ed57866f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:22.764698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-648c8847-c8eb-4594-8828-365ab0976c1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eebb224a56814f92b12ebebebc6bc8a3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:22.766398 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-648c8847-c8eb-4594-8828-365ab0976c1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eebb224a56814f92b12ebebebc6bc8a3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:22.793712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-648c8847-c8eb-4594-8828-365ab0976c1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eebb224a56814f92b12ebebebc6bc8a3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:22.807234 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1992/3922] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:22 2022] DELETE /identity/v3/users/eebb224a56814f92b12ebebebc6bc8a3 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:22.808360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c8847-c8eb-4594-8828-365ab0976c1e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:22.809900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-648c8847-c8eb-4594-8828-365ab0976c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:22.897129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c8847-c8eb-4594-8828-365ab0976c1e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:22.901742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7749f9b-1e56-43a8-a9e3-cbb3a46e9431 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d875a84cf59442391ca5a8e74f6fb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ac4abf4d674356bb4a2eece79bd807', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:22.902406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7749f9b-1e56-43a8-a9e3-cbb3a46e9431 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:22.902720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7749f9b-1e56-43a8-a9e3-cbb3a46e9431 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:22.902998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7749f9b-1e56-43a8-a9e3-cbb3a46e9431 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:22.903742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7749f9b-1e56-43a8-a9e3-cbb3a46e9431 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-548273090) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:20:22.904079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7749f9b-1e56-43a8-a9e3-cbb3a46e9431 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:22.905100 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-e7749f9b-1e56-43a8-a9e3-cbb3a46e9431 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:22.905100 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:20:22.905100 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:20:22.906056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7749f9b-1e56-43a8-a9e3-cbb3a46e9431 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:22.915326 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1993/3923] 10.222.0.16 () {58 vars in 1219 bytes} [Sat Jul 16 21:20:22 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-548273090 => generated 416 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:22.920157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7749f9b-1e56-43a8-a9e3-cbb3a46e9431 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:22.930553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7749f9b-1e56-43a8-a9e3-cbb3a46e9431 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:22.940916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d60ba317-2e70-4f18-bd86-f492ed57866f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd5ae48864b4b36a824f060dc255a1e', 'request_id': 'req-d60ba317-2e70-4f18-bd86-f492ed57866f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:22.947402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d60ba317-2e70-4f18-bd86-f492ed57866f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd5ae48864b4b36a824f060dc255a1e', 'request_id': 'req-d60ba317-2e70-4f18-bd86-f492ed57866f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:22.954827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d60ba317-2e70-4f18-bd86-f492ed57866f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd5ae48864b4b36a824f060dc255a1e', 'request_id': 'req-d60ba317-2e70-4f18-bd86-f492ed57866f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:23.003899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6744e-bdf6-414e-90d7-28487c3507e9 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d875a84cf59442391ca5a8e74f6fb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ac4abf4d674356bb4a2eece79bd807', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:23.004918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6744e-bdf6-414e-90d7-28487c3507e9 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:23.005208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6744e-bdf6-414e-90d7-28487c3507e9 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:23.005878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6744e-bdf6-414e-90d7-28487c3507e9 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:23.006682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6744e-bdf6-414e-90d7-28487c3507e9 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1332170213) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:20:23.007190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6744e-bdf6-414e-90d7-28487c3507e9 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:23.009217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6744e-bdf6-414e-90d7-28487c3507e9 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:23.022841 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1994/3924] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Jul 16 21:20:22 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1332170213 => generated 417 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:23.029801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6744e-bdf6-414e-90d7-28487c3507e9 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:23.039807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6744e-bdf6-414e-90d7-28487c3507e9 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:23.045031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9233e-bf3c-4d7f-81f8-d47c5276ad1b tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d875a84cf59442391ca5a8e74f6fb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ac4abf4d674356bb4a2eece79bd807', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:23.045846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9233e-bf3c-4d7f-81f8-d47c5276ad1b tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:23.046133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9233e-bf3c-4d7f-81f8-d47c5276ad1b tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:23.046463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9233e-bf3c-4d7f-81f8-d47c5276ad1b tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:23.047151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9233e-bf3c-4d7f-81f8-d47c5276ad1b tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1558477218) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:20:23.047528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9233e-bf3c-4d7f-81f8-d47c5276ad1b tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:23.049167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9233e-bf3c-4d7f-81f8-d47c5276ad1b tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:23.056011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d60ba317-2e70-4f18-bd86-f492ed57866f admin admin] The token cache is being invalidate because project ccd5ae48864b4b36a824f060dc255a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:23.056011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d60ba317-2e70-4f18-bd86-f492ed57866f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:23.056011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d60ba317-2e70-4f18-bd86-f492ed57866f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:23.059130 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1995/3926] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Jul 16 21:20:23 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1558477218 => generated 418 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:23.060148 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1931/3926] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:22 2022] DELETE /identity/v3/projects/ccd5ae48864b4b36a824f060dc255a1e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:23.060768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9233e-bf3c-4d7f-81f8-d47c5276ad1b tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:23.061693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f611e-3d61-45db-99f2-caf022ddadaa None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:23.062007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f611e-3d61-45db-99f2-caf022ddadaa None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:23.062336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f611e-3d61-45db-99f2-caf022ddadaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:23.062661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bfa9233e-bf3c-4d7f-81f8-d47c5276ad1b tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:23.081325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9233e-bf3c-4d7f-81f8-d47c5276ad1b tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:23.084142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-291f611e-3d61-45db-99f2-caf022ddadaa None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:23.085144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b712e29-efc8-4f2a-984a-18dd8b3d9123 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d875a84cf59442391ca5a8e74f6fb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ac4abf4d674356bb4a2eece79bd807', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:23.085668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-291f611e-3d61-45db-99f2-caf022ddadaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:23.086219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b712e29-efc8-4f2a-984a-18dd8b3d9123 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:23.087279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b712e29-efc8-4f2a-984a-18dd8b3d9123 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:23.087894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b712e29-efc8-4f2a-984a-18dd8b3d9123 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] PATH_INFO: `/v3/services/9e4d95a8b19a4ea3b43bf043c71d590d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:23.088999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b712e29-efc8-4f2a-984a-18dd8b3d9123 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorizing `identity:delete_service(service_id=9e4d95a8b19a4ea3b43bf043c71d590d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:23.090892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b712e29-efc8-4f2a-984a-18dd8b3d9123 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:23.151831 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1932/3927] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:23 2022] POST /identity/v3/auth/tokens => generated 3731 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:23.159593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ef7b2-b794-4c55-b724-158f26164445 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:23.159883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ef7b2-b794-4c55-b724-158f26164445 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:23.160161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ef7b2-b794-4c55-b724-158f26164445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:23.178472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e56ef7b2-b794-4c55-b724-158f26164445 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:23.179685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e56ef7b2-b794-4c55-b724-158f26164445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:23.187772 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1933/3928] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:23 2022] POST /identity/v3/auth/tokens => generated 3731 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:20:23.191919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ef7b2-b794-4c55-b724-158f26164445 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:23.203515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ef7b2-b794-4c55-b724-158f26164445 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:23.209474 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1996/3929] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:23 2022] DELETE /identity/v3/services/9e4d95a8b19a4ea3b43bf043c71d590d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:23.211190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b712e29-efc8-4f2a-984a-18dd8b3d9123 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:23.214947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4b712e29-efc8-4f2a-984a-18dd8b3d9123 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:23.224745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c6b82-89e4-4a75-908a-4f73fdb92c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:23.225307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c6b82-89e4-4a75-908a-4f73fdb92c76 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:23.225613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c6b82-89e4-4a75-908a-4f73fdb92c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:23.225829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c6b82-89e4-4a75-908a-4f73fdb92c76 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:23.226557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c6b82-89e4-4a75-908a-4f73fdb92c76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:20:23.226865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c6b82-89e4-4a75-908a-4f73fdb92c76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:23.228507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c6b82-89e4-4a75-908a-4f73fdb92c76 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:23.235120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b712e29-efc8-4f2a-984a-18dd8b3d9123 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:23.241994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f496e99-6558-4514-93d8-207c8f66b83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:23.245769 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1934/3930] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:20:23.245901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f496e99-6558-4514-93d8-207c8f66b83a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:23.245901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f496e99-6558-4514-93d8-207c8f66b83a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:23.246062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c6b82-89e4-4a75-908a-4f73fdb92c76 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:23.246160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f496e99-6558-4514-93d8-207c8f66b83a admin admin] PATH_INFO: `/v3/projects/a092ce9ef40943f6b6ace6cd28481b71` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:23.246160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f496e99-6558-4514-93d8-207c8f66b83a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a092ce9ef40943f6b6ace6cd28481b71)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:23.246727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f496e99-6558-4514-93d8-207c8f66b83a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:23.266227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c6b82-89e4-4a75-908a-4f73fdb92c76 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:23.270903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4567a7-4472-4365-a63a-8609becfa596 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d875a84cf59442391ca5a8e74f6fb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ac4abf4d674356bb4a2eece79bd807', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:23.271790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4567a7-4472-4365-a63a-8609becfa596 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:23.272074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4567a7-4472-4365-a63a-8609becfa596 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:23.272352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4567a7-4472-4365-a63a-8609becfa596 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] PATH_INFO: `/v3/services/c8cbbb378036411cbdd933d0b0a38207` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:23.273006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4567a7-4472-4365-a63a-8609becfa596 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c8cbbb378036411cbdd933d0b0a38207)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:23.274702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4567a7-4472-4365-a63a-8609becfa596 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:23.430613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4f496e99-6558-4514-93d8-207c8f66b83a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a092ce9ef40943f6b6ace6cd28481b71', 'request_id': 'req-4f496e99-6558-4514-93d8-207c8f66b83a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:23.431542 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1935/3931] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:23 2022] DELETE /identity/v3/services/c8cbbb378036411cbdd933d0b0a38207 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:23.432641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4567a7-4472-4365-a63a-8609becfa596 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:23.437015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4f496e99-6558-4514-93d8-207c8f66b83a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a092ce9ef40943f6b6ace6cd28481b71', 'request_id': 'req-4f496e99-6558-4514-93d8-207c8f66b83a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:23.442677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4f496e99-6558-4514-93d8-207c8f66b83a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a092ce9ef40943f6b6ace6cd28481b71', 'request_id': 'req-4f496e99-6558-4514-93d8-207c8f66b83a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:23.455201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4567a7-4472-4365-a63a-8609becfa596 tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:23.512208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e81b0-72b3-4e54-8a44-5c4eae02b926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:23.512906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e81b0-72b3-4e54-8a44-5c4eae02b926 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:23.513192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e81b0-72b3-4e54-8a44-5c4eae02b926 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:23.513468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e81b0-72b3-4e54-8a44-5c4eae02b926 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:23.514187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e81b0-72b3-4e54-8a44-5c4eae02b926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:23.516178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e81b0-72b3-4e54-8a44-5c4eae02b926 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:23.525256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4f496e99-6558-4514-93d8-207c8f66b83a admin admin] The token cache is being invalidate because project a092ce9ef40943f6b6ace6cd28481b71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:23.525548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4f496e99-6558-4514-93d8-207c8f66b83a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:23.526343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4f496e99-6558-4514-93d8-207c8f66b83a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:23.527999 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1997/3932] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:23 2022] DELETE /identity/v3/projects/a092ce9ef40943f6b6ace6cd28481b71 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:23.528839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f496e99-6558-4514-93d8-207c8f66b83a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:23.530182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4f496e99-6558-4514-93d8-207c8f66b83a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:23.547584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:23.595678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f496e99-6558-4514-93d8-207c8f66b83a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:23.611501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4cd83-7239-453c-a88f-d4e6a757a78f tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d875a84cf59442391ca5a8e74f6fb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ac4abf4d674356bb4a2eece79bd807', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:23.612390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4cd83-7239-453c-a88f-d4e6a757a78f tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:23.612678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4cd83-7239-453c-a88f-d4e6a757a78f tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:23.612957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4cd83-7239-453c-a88f-d4e6a757a78f tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] PATH_INFO: `/v3/services/1aed099d2e5e4d6d9c1decc3a2c6cb6d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:23.613613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4cd83-7239-453c-a88f-d4e6a757a78f tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1aed099d2e5e4d6d9c1decc3a2c6cb6d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:23.614926 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1936/3933] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:20:23 2022] POST /identity/v3/projects => generated 383 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:23.616486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ec29e-30e9-4217-8b09-bbfd74804da3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:23.616773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ec29e-30e9-4217-8b09-bbfd74804da3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:23.617049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ec29e-30e9-4217-8b09-bbfd74804da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:23.618626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4cd83-7239-453c-a88f-d4e6a757a78f tempest-ServicesTestJSON-615761531 tempest-ServicesTestJSON-615761531-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:23.635138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0f9ec29e-30e9-4217-8b09-bbfd74804da3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:23.636349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0f9ec29e-30e9-4217-8b09-bbfd74804da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:23.703895 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1937/3934] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:23 2022] POST /identity/v3/auth/tokens => generated 3396 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:23.703895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ec29e-30e9-4217-8b09-bbfd74804da3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:23.705137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0f9ec29e-30e9-4217-8b09-bbfd74804da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:23.718055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ec29e-30e9-4217-8b09-bbfd74804da3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:23.722613 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1998/3935] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:23 2022] DELETE /identity/v3/services/1aed099d2e5e4d6d9c1decc3a2c6cb6d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:23.724518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1847a-daad-4873-84dd-0891736087e5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:23.724800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1847a-daad-4873-84dd-0891736087e5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:23.725063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1847a-daad-4873-84dd-0891736087e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:23.735217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4c4f7-670e-4957-8e6d-2c556d3fdfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:23.735889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4c4f7-670e-4957-8e6d-2c556d3fdfcf admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:23.736271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4c4f7-670e-4957-8e6d-2c556d3fdfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:23.736548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4c4f7-670e-4957-8e6d-2c556d3fdfcf admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:23.737228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4c4f7-670e-4957-8e6d-2c556d3fdfcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:23.739424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4c4f7-670e-4957-8e6d-2c556d3fdfcf admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:23.744648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-10d1847a-daad-4873-84dd-0891736087e5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:23.745860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-10d1847a-daad-4873-84dd-0891736087e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:23.756259 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 1999/3936] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:23.757154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1847a-daad-4873-84dd-0891736087e5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:23.758385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-10d1847a-daad-4873-84dd-0891736087e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:23.770847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1847a-daad-4873-84dd-0891736087e5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:23.775683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1bb79-e4b2-45ff-aaaa-bce98c6d14dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:23.776543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1bb79-e4b2-45ff-aaaa-bce98c6d14dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:23.776830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1bb79-e4b2-45ff-aaaa-bce98c6d14dc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:23.777127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1bb79-e4b2-45ff-aaaa-bce98c6d14dc admin admin] PATH_INFO: `/v3/users/9e6f6e76df824266a137423c3da6fdc8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:23.778316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1bb79-e4b2-45ff-aaaa-bce98c6d14dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e6f6e76df824266a137423c3da6fdc8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:23.780288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1bb79-e4b2-45ff-aaaa-bce98c6d14dc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:23.909658 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1938/3937] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:23 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:23.910742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4c4f7-670e-4957-8e6d-2c556d3fdfcf admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:23.923545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4c4f7-670e-4957-8e6d-2c556d3fdfcf admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:23.930612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935932d9-ebcf-400d-8845-c86ea6aeb8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:23.931648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935932d9-ebcf-400d-8845-c86ea6aeb8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:23.931945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935932d9-ebcf-400d-8845-c86ea6aeb8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:23.932226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935932d9-ebcf-400d-8845-c86ea6aeb8e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:23.933483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935932d9-ebcf-400d-8845-c86ea6aeb8e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:20:23.933797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935932d9-ebcf-400d-8845-c86ea6aeb8e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:23.935872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935932d9-ebcf-400d-8845-c86ea6aeb8e4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:23.960228 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1939/3938] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:23.960228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935932d9-ebcf-400d-8845-c86ea6aeb8e4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:23.972176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935932d9-ebcf-400d-8845-c86ea6aeb8e4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:23.977934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8c92d-bb0f-4b2e-af25-f74ef6377496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:23.978712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8c92d-bb0f-4b2e-af25-f74ef6377496 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:23.979102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8c92d-bb0f-4b2e-af25-f74ef6377496 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:23.979452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8c92d-bb0f-4b2e-af25-f74ef6377496 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:23.980548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8c92d-bb0f-4b2e-af25-f74ef6377496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:23.982300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8c92d-bb0f-4b2e-af25-f74ef6377496 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:23.998567 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1940/3939] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:23.999532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8c92d-bb0f-4b2e-af25-f74ef6377496 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:24.012916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8c92d-bb0f-4b2e-af25-f74ef6377496 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:24.020795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6f1a4-f0dd-44da-8b5f-2c985c3ac826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:24.021964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6f1a4-f0dd-44da-8b5f-2c985c3ac826 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:24.024145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6f1a4-f0dd-44da-8b5f-2c985c3ac826 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:24.024463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6f1a4-f0dd-44da-8b5f-2c985c3ac826 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:24.025197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6f1a4-f0dd-44da-8b5f-2c985c3ac826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:24.030402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6f1a4-f0dd-44da-8b5f-2c985c3ac826 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:24.071347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-39c1bb79-e4b2-45ff-aaaa-bce98c6d14dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e6f6e76df824266a137423c3da6fdc8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:24.083259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-39c1bb79-e4b2-45ff-aaaa-bce98c6d14dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e6f6e76df824266a137423c3da6fdc8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:24.170157 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1941/3940] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:20:23 2022] POST /identity/v3/projects => generated 381 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:24.171146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6f1a4-f0dd-44da-8b5f-2c985c3ac826 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:24.191617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-39c1bb79-e4b2-45ff-aaaa-bce98c6d14dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e6f6e76df824266a137423c3da6fdc8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:24.192845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-39c1bb79-e4b2-45ff-aaaa-bce98c6d14dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e6f6e76df824266a137423c3da6fdc8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:24.216045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-39c1bb79-e4b2-45ff-aaaa-bce98c6d14dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e6f6e76df824266a137423c3da6fdc8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:24.227281 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2000/3941] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:23 2022] DELETE /identity/v3/users/9e6f6e76df824266a137423c3da6fdc8 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:24.228741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1bb79-e4b2-45ff-aaaa-bce98c6d14dc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:24.230648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-39c1bb79-e4b2-45ff-aaaa-bce98c6d14dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:24.287188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6f1a4-f0dd-44da-8b5f-2c985c3ac826 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:24.342449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1bb79-e4b2-45ff-aaaa-bce98c6d14dc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:24.347648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262219f3-56c8-4724-b80c-a06543399cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:24.350340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262219f3-56c8-4724-b80c-a06543399cac admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:24.350551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262219f3-56c8-4724-b80c-a06543399cac admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:24.352737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262219f3-56c8-4724-b80c-a06543399cac admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:24.352737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262219f3-56c8-4724-b80c-a06543399cac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:24.353683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262219f3-56c8-4724-b80c-a06543399cac admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:24.363200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888d49a-2fa7-4b30-9bbc-fcb613cac2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:24.364565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888d49a-2fa7-4b30-9bbc-fcb613cac2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:24.364856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888d49a-2fa7-4b30-9bbc-fcb613cac2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:24.365137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888d49a-2fa7-4b30-9bbc-fcb613cac2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:24.365885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888d49a-2fa7-4b30-9bbc-fcb613cac2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:24.367866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888d49a-2fa7-4b30-9bbc-fcb613cac2f9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:24.378625 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1942/3942] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:24.380479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde99bc-dacf-4179-9d53-bbf576228fcc None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:24.380773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde99bc-dacf-4179-9d53-bbf576228fcc None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:24.381053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde99bc-dacf-4179-9d53-bbf576228fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:24.398868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9fde99bc-dacf-4179-9d53-bbf576228fcc None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:24.400181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9fde99bc-dacf-4179-9d53-bbf576228fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:24.409720 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1943/3943] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:24.410860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde99bc-dacf-4179-9d53-bbf576228fcc None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:24.412160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9fde99bc-dacf-4179-9d53-bbf576228fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:24.425438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde99bc-dacf-4179-9d53-bbf576228fcc None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:24.432067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a46ac-7944-4b15-bb5e-f970c63edea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:24.433095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a46ac-7944-4b15-bb5e-f970c63edea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:24.433336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a46ac-7944-4b15-bb5e-f970c63edea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:24.433603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a46ac-7944-4b15-bb5e-f970c63edea0 admin admin] PATH_INFO: `/v3/projects/3e1f6ffc3fb64dba8c4474641e796fb8/users/029f1334779e4bcdb3f4f2aed564a075/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:24.450398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a46ac-7944-4b15-bb5e-f970c63edea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e1f6ffc3fb64dba8c4474641e796fb8, user_id=029f1334779e4bcdb3f4f2aed564a075, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:24.453081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a46ac-7944-4b15-bb5e-f970c63edea0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:24.491763 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2001/3944] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:24 2022] POST /identity/v3/users => generated 291 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:24.492709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262219f3-56c8-4724-b80c-a06543399cac admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:24.494271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-262219f3-56c8-4724-b80c-a06543399cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:24.562324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262219f3-56c8-4724-b80c-a06543399cac admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:24.567885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cef0ec-dc8d-4612-bb11-76b724db4ba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:24.574737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cef0ec-dc8d-4612-bb11-76b724db4ba3 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:24.574737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cef0ec-dc8d-4612-bb11-76b724db4ba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:24.574737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cef0ec-dc8d-4612-bb11-76b724db4ba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:24.581809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cef0ec-dc8d-4612-bb11-76b724db4ba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:24.582251 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1944/3945] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:24 2022] PUT /identity/v3/projects/3e1f6ffc3fb64dba8c4474641e796fb8/users/029f1334779e4bcdb3f4f2aed564a075/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:24.582689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cef0ec-dc8d-4612-bb11-76b724db4ba3 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:24.583683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a46ac-7944-4b15-bb5e-f970c63edea0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:24.593126 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2002/3946] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:20:24.594460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723f3dd-4b91-48e6-b20c-6a7ea525c742 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:24.598213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723f3dd-4b91-48e6-b20c-6a7ea525c742 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:24.598213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723f3dd-4b91-48e6-b20c-6a7ea525c742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:24.619593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f723f3dd-4b91-48e6-b20c-6a7ea525c742 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:24.621222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f723f3dd-4b91-48e6-b20c-6a7ea525c742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:24.655223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a46ac-7944-4b15-bb5e-f970c63edea0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:24.660423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb2162-e25d-426e-9c0d-1a6e63e75c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:24.661942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb2162-e25d-426e-9c0d-1a6e63e75c5d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:24.662435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb2162-e25d-426e-9c0d-1a6e63e75c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:24.662757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb2162-e25d-426e-9c0d-1a6e63e75c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:24.663589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb2162-e25d-426e-9c0d-1a6e63e75c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:24.667886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb2162-e25d-426e-9c0d-1a6e63e75c5d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:24.680538 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1945/3947] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:24.686046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb2162-e25d-426e-9c0d-1a6e63e75c5d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:24.692660 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2003/3948] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:24.697288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb2162-e25d-426e-9c0d-1a6e63e75c5d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:24.702458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58404a-6084-46b1-bab0-1a0ea9ac3a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:24.702940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723f3dd-4b91-48e6-b20c-6a7ea525c742 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:24.703178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58404a-6084-46b1-bab0-1a0ea9ac3a4b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:24.703469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58404a-6084-46b1-bab0-1a0ea9ac3a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:24.703753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58404a-6084-46b1-bab0-1a0ea9ac3a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:24.704476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58404a-6084-46b1-bab0-1a0ea9ac3a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:24.706110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58404a-6084-46b1-bab0-1a0ea9ac3a4b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:24.718215 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1946/3949] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:24.722345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58404a-6084-46b1-bab0-1a0ea9ac3a4b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:24.733005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58404a-6084-46b1-bab0-1a0ea9ac3a4b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:24.739891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a94e8-a5ee-4aa0-8465-7d6f5ae97a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:24.742469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a94e8-a5ee-4aa0-8465-7d6f5ae97a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:24.742469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a94e8-a5ee-4aa0-8465-7d6f5ae97a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:24.742469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a94e8-a5ee-4aa0-8465-7d6f5ae97a30 admin admin] PATH_INFO: `/v3/projects/f163566907554620bc94de3b960a4f13/users/d3bb6f6d546c4bd090e72c149afe5660/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:24.756806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a94e8-a5ee-4aa0-8465-7d6f5ae97a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f163566907554620bc94de3b960a4f13, user_id=d3bb6f6d546c4bd090e72c149afe5660, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:24.759514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a94e8-a5ee-4aa0-8465-7d6f5ae97a30 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:24.759649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723f3dd-4b91-48e6-b20c-6a7ea525c742 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:24.763316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09b0d2-45b6-422f-9df7-930ed145843c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:24.763951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09b0d2-45b6-422f-9df7-930ed145843c service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:24.764230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09b0d2-45b6-422f-9df7-930ed145843c service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:24.764501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09b0d2-45b6-422f-9df7-930ed145843c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:24.773938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09b0d2-45b6-422f-9df7-930ed145843c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:24.775438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09b0d2-45b6-422f-9df7-930ed145843c service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:24.785042 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2004/3950] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:20:24.843692 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1947/3951] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:24 2022] PUT /identity/v3/projects/f163566907554620bc94de3b960a4f13/users/d3bb6f6d546c4bd090e72c149afe5660/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:20:24.850264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba3243-123e-4244-8883-9dc64bdb9250 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:24.850545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba3243-123e-4244-8883-9dc64bdb9250 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:24.851047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba3243-123e-4244-8883-9dc64bdb9250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:24.879471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-fcba3243-123e-4244-8883-9dc64bdb9250 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:24.881583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fcba3243-123e-4244-8883-9dc64bdb9250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:24.970082 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2005/3952] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:20:24.982311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a94e8-a5ee-4aa0-8465-7d6f5ae97a30 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:24.985446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-535a94e8-a5ee-4aa0-8465-7d6f5ae97a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:25.109749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a94e8-a5ee-4aa0-8465-7d6f5ae97a30 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:25.122235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1e5e0-931c-4480-adc1-60e005fe0b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:25.123263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1e5e0-931c-4480-adc1-60e005fe0b73 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:25.123849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1e5e0-931c-4480-adc1-60e005fe0b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:25.124384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1e5e0-931c-4480-adc1-60e005fe0b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:25.158203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1e5e0-931c-4480-adc1-60e005fe0b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:25.160668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1e5e0-931c-4480-adc1-60e005fe0b73 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:25.162007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:25.174149 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1948/3953] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:20:25.388835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba3243-123e-4244-8883-9dc64bdb9250 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:25.391029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fcba3243-123e-4244-8883-9dc64bdb9250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:25.414273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba3243-123e-4244-8883-9dc64bdb9250 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:25.423856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610bc95-31ff-4107-8050-5baee7fa3b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:25.425376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610bc95-31ff-4107-8050-5baee7fa3b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:25.425789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610bc95-31ff-4107-8050-5baee7fa3b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:25.426896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610bc95-31ff-4107-8050-5baee7fa3b23 admin admin] PATH_INFO: `/v3/projects/903ce82a28fe4373b3b8ac45e5d426d8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:25.429004 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610bc95-31ff-4107-8050-5baee7fa3b23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=903ce82a28fe4373b3b8ac45e5d426d8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:25.435468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610bc95-31ff-4107-8050-5baee7fa3b23 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:25.493236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:25.683545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6610bc95-31ff-4107-8050-5baee7fa3b23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '903ce82a28fe4373b3b8ac45e5d426d8', 'request_id': 'req-6610bc95-31ff-4107-8050-5baee7fa3b23'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:25.691137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6610bc95-31ff-4107-8050-5baee7fa3b23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '903ce82a28fe4373b3b8ac45e5d426d8', 'request_id': 'req-6610bc95-31ff-4107-8050-5baee7fa3b23'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:25.698411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6610bc95-31ff-4107-8050-5baee7fa3b23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '903ce82a28fe4373b3b8ac45e5d426d8', 'request_id': 'req-6610bc95-31ff-4107-8050-5baee7fa3b23'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:25.842971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6610bc95-31ff-4107-8050-5baee7fa3b23 admin admin] The token cache is being invalidate because project 903ce82a28fe4373b3b8ac45e5d426d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:25.843505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6610bc95-31ff-4107-8050-5baee7fa3b23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:25.844308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6610bc95-31ff-4107-8050-5baee7fa3b23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:25.846480 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2006/3954] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:25 2022] DELETE /identity/v3/projects/903ce82a28fe4373b3b8ac45e5d426d8 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:20:25.851145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1e5e0-931c-4480-adc1-60e005fe0b73 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:25.861196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1e5e0-931c-4480-adc1-60e005fe0b73 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:25.942055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972e7c8-6763-48b7-b713-69a72808ff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:25.942989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972e7c8-6763-48b7-b713-69a72808ff3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:25.943348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972e7c8-6763-48b7-b713-69a72808ff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:25.943664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972e7c8-6763-48b7-b713-69a72808ff3c admin admin] PATH_INFO: `/v3/users/6d875a84cf59442391ca5a8e74f6fb58` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:25.944875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972e7c8-6763-48b7-b713-69a72808ff3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d875a84cf59442391ca5a8e74f6fb58)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:25.947809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972e7c8-6763-48b7-b713-69a72808ff3c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:26.195965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e972e7c8-6763-48b7-b713-69a72808ff3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d875a84cf59442391ca5a8e74f6fb58'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:26.214010 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e972e7c8-6763-48b7-b713-69a72808ff3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d875a84cf59442391ca5a8e74f6fb58'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:26.649847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e972e7c8-6763-48b7-b713-69a72808ff3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d875a84cf59442391ca5a8e74f6fb58'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:26.658153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e972e7c8-6763-48b7-b713-69a72808ff3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d875a84cf59442391ca5a8e74f6fb58'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:26.659225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e972e7c8-6763-48b7-b713-69a72808ff3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d875a84cf59442391ca5a8e74f6fb58'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:26.667319 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1949/3955] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:25 2022] DELETE /identity/v3/users/6d875a84cf59442391ca5a8e74f6fb58 => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:27.776577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610bc95-31ff-4107-8050-5baee7fa3b23 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:27.778010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6610bc95-31ff-4107-8050-5baee7fa3b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:27.799140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610bc95-31ff-4107-8050-5baee7fa3b23 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:27.892119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d86ee-4e04-4ea3-8985-43306e44b913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:27.893706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d86ee-4e04-4ea3-8985-43306e44b913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:27.894113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d86ee-4e04-4ea3-8985-43306e44b913 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:27.895946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d86ee-4e04-4ea3-8985-43306e44b913 admin admin] PATH_INFO: `/v3/projects/12ac4abf4d674356bb4a2eece79bd807` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:27.899461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d86ee-4e04-4ea3-8985-43306e44b913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ac4abf4d674356bb4a2eece79bd807)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:27.902619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d86ee-4e04-4ea3-8985-43306e44b913 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:28.057469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fb8d86ee-4e04-4ea3-8985-43306e44b913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ac4abf4d674356bb4a2eece79bd807', 'request_id': 'req-fb8d86ee-4e04-4ea3-8985-43306e44b913'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:28.069231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fb8d86ee-4e04-4ea3-8985-43306e44b913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ac4abf4d674356bb4a2eece79bd807', 'request_id': 'req-fb8d86ee-4e04-4ea3-8985-43306e44b913'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:28.080472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fb8d86ee-4e04-4ea3-8985-43306e44b913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ac4abf4d674356bb4a2eece79bd807', 'request_id': 'req-fb8d86ee-4e04-4ea3-8985-43306e44b913'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:28.205510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fb8d86ee-4e04-4ea3-8985-43306e44b913 admin admin] The token cache is being invalidate because project 12ac4abf4d674356bb4a2eece79bd807 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:28.206122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fb8d86ee-4e04-4ea3-8985-43306e44b913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:28.207267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fb8d86ee-4e04-4ea3-8985-43306e44b913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:28.209920 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2007/3956] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:27 2022] DELETE /identity/v3/projects/12ac4abf4d674356bb4a2eece79bd807 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:28.215717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94ef0b-cd7e-4711-b4c4-36aea79b23a1 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:28.216685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94ef0b-cd7e-4711-b4c4-36aea79b23a1 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:28.217186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94ef0b-cd7e-4711-b4c4-36aea79b23a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:28.247061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5a94ef0b-cd7e-4711-b4c4-36aea79b23a1 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:28.249193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5a94ef0b-cd7e-4711-b4c4-36aea79b23a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:28.385950 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1950/3957] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:28.393995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d955a-f0a5-4db9-9a47-458199bcbaf8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:28.394247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d955a-f0a5-4db9-9a47-458199bcbaf8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:28.394730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d955a-f0a5-4db9-9a47-458199bcbaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:28.428655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-771d955a-f0a5-4db9-9a47-458199bcbaf8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:28.430157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-771d955a-f0a5-4db9-9a47-458199bcbaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:28.447636 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2008/3958] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:28.451759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94ef0b-cd7e-4711-b4c4-36aea79b23a1 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:28.465481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94ef0b-cd7e-4711-b4c4-36aea79b23a1 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:28.471766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfb451-242f-4e28-a906-c6b70703c6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:28.473919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfb451-242f-4e28-a906-c6b70703c6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:28.475528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfb451-242f-4e28-a906-c6b70703c6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:28.476084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfb451-242f-4e28-a906-c6b70703c6b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:28.478278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfb451-242f-4e28-a906-c6b70703c6b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:20:28.480331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfb451-242f-4e28-a906-c6b70703c6b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:28.482711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfb451-242f-4e28-a906-c6b70703c6b4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:28.521686 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1951/3959] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:28.526301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d955a-f0a5-4db9-9a47-458199bcbaf8 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:28.541405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d955a-f0a5-4db9-9a47-458199bcbaf8 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:28.558421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5cb41-a35a-40e4-8393-27fb1f5262de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:28.561097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5cb41-a35a-40e4-8393-27fb1f5262de admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:28.564321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5cb41-a35a-40e4-8393-27fb1f5262de admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:28.565610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:28.565755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5cb41-a35a-40e4-8393-27fb1f5262de admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:28.566537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5cb41-a35a-40e4-8393-27fb1f5262de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:28.579897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5cb41-a35a-40e4-8393-27fb1f5262de admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:28.761040 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2009/3960] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:20:28 2022] POST /identity/v3/projects => generated 367 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:20:28.762185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfb451-242f-4e28-a906-c6b70703c6b4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:28.779444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfb451-242f-4e28-a906-c6b70703c6b4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:28.915156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eca6d1-7460-4a3c-8dd1-b0189ec7c6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:28.915898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eca6d1-7460-4a3c-8dd1-b0189ec7c6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:28.917228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eca6d1-7460-4a3c-8dd1-b0189ec7c6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:28.917228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eca6d1-7460-4a3c-8dd1-b0189ec7c6c2 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:28.917676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eca6d1-7460-4a3c-8dd1-b0189ec7c6c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:28.920031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eca6d1-7460-4a3c-8dd1-b0189ec7c6c2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:28.978410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:29.046170 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1952/3961] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:28 2022] POST /identity/v3/users => generated 284 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:29.050884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5cb41-a35a-40e4-8393-27fb1f5262de admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:29.069658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5cb41-a35a-40e4-8393-27fb1f5262de admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:29.078285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a1b93-611d-4aed-9c4f-3ca6e93e9db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:29.079381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a1b93-611d-4aed-9c4f-3ca6e93e9db0 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:29.079904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a1b93-611d-4aed-9c4f-3ca6e93e9db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:29.080519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a1b93-611d-4aed-9c4f-3ca6e93e9db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:29.081496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a1b93-611d-4aed-9c4f-3ca6e93e9db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:29.084416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a1b93-611d-4aed-9c4f-3ca6e93e9db0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:29.112072 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2010/3962] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:20:29.112902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eca6d1-7460-4a3c-8dd1-b0189ec7c6c2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:29.128643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eca6d1-7460-4a3c-8dd1-b0189ec7c6c2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:29.140579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023c6c4-8ed4-49b9-b27b-55f1ea1a835d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:29.141276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023c6c4-8ed4-49b9-b27b-55f1ea1a835d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:29.141558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023c6c4-8ed4-49b9-b27b-55f1ea1a835d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:29.142739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023c6c4-8ed4-49b9-b27b-55f1ea1a835d admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:29.143442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023c6c4-8ed4-49b9-b27b-55f1ea1a835d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:29.156091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023c6c4-8ed4-49b9-b27b-55f1ea1a835d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:29.175069 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1953/3963] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:29.180628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a1b93-611d-4aed-9c4f-3ca6e93e9db0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:29.229932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a1b93-611d-4aed-9c4f-3ca6e93e9db0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:29.247957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfd804-9885-4d68-9f7e-8155f6a7bbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:29.251981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfd804-9885-4d68-9f7e-8155f6a7bbfb admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:29.255395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfd804-9885-4d68-9f7e-8155f6a7bbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:29.255807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfd804-9885-4d68-9f7e-8155f6a7bbfb admin admin] PATH_INFO: `/v3/projects/bd98c73d37e34cec87e679ef58a653a4/users/f5606cca80d8424697771018218115e4/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:29.304643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bfd804-9885-4d68-9f7e-8155f6a7bbfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd98c73d37e34cec87e679ef58a653a4, user_id=f5606cca80d8424697771018218115e4, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:29.307636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bfd804-9885-4d68-9f7e-8155f6a7bbfb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:29.419322 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2011/3964] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:29 2022] PUT /identity/v3/projects/bd98c73d37e34cec87e679ef58a653a4/users/f5606cca80d8424697771018218115e4/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:29.432391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef981269-5bd4-4c34-937e-a8b4a91695d6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:29.432391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef981269-5bd4-4c34-937e-a8b4a91695d6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:29.432845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef981269-5bd4-4c34-937e-a8b4a91695d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:29.497363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ef981269-5bd4-4c34-937e-a8b4a91695d6 None None] MFA Rules not processed for user `f5606cca80d8424697771018218115e4`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:29.498622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ef981269-5bd4-4c34-937e-a8b4a91695d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:29.683300 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1954/3965] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:29.687949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfd804-9885-4d68-9f7e-8155f6a7bbfb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:29.814906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfd804-9885-4d68-9f7e-8155f6a7bbfb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:29.826801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9fe37-c440-4a36-adac-8d7375391209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:29.831425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9fe37-c440-4a36-adac-8d7375391209 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:29.831425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9fe37-c440-4a36-adac-8d7375391209 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:29.831425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9fe37-c440-4a36-adac-8d7375391209 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:29.831425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9fe37-c440-4a36-adac-8d7375391209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:29.831425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9fe37-c440-4a36-adac-8d7375391209 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:29.965345 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2012/3966] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:20:29 2022] POST /identity/v3/projects => generated 369 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:29.970592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef981269-5bd4-4c34-937e-a8b4a91695d6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:29.990581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef981269-5bd4-4c34-937e-a8b4a91695d6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:30.106463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff204373-2321-46e1-a8ba-4a417fca34ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:30.108297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff204373-2321-46e1-a8ba-4a417fca34ff admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:30.114478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff204373-2321-46e1-a8ba-4a417fca34ff admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:30.114478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff204373-2321-46e1-a8ba-4a417fca34ff admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:30.114478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff204373-2321-46e1-a8ba-4a417fca34ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:30.116766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff204373-2321-46e1-a8ba-4a417fca34ff admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:30.260412 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1955/3967] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:29 2022] POST /identity/v3/users => generated 291 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:30.264155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9fe37-c440-4a36-adac-8d7375391209 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:30.277117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9fe37-c440-4a36-adac-8d7375391209 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:30.286902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c1cc7-304f-4fef-ae48-5a26763f6318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:30.288404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c1cc7-304f-4fef-ae48-5a26763f6318 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:30.288905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c1cc7-304f-4fef-ae48-5a26763f6318 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:30.289635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c1cc7-304f-4fef-ae48-5a26763f6318 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:30.292010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c1cc7-304f-4fef-ae48-5a26763f6318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:30.295716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c1cc7-304f-4fef-ae48-5a26763f6318 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:30.310684 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2013/3968] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:30.315553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff204373-2321-46e1-a8ba-4a417fca34ff admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:30.341161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff204373-2321-46e1-a8ba-4a417fca34ff admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:30.359947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7f731-f314-48dc-a669-20f8587c7dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:30.361158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7f731-f314-48dc-a669-20f8587c7dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:30.361622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7f731-f314-48dc-a669-20f8587c7dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:30.362065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7f731-f314-48dc-a669-20f8587c7dcd admin admin] PATH_INFO: `/v3/projects/a78a13d940dc4700bda8f7dc4dabca0c/users/c5bb8e2353b54f97b6db2ecdb0aece9e/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:30.404514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7f731-f314-48dc-a669-20f8587c7dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78a13d940dc4700bda8f7dc4dabca0c, user_id=c5bb8e2353b54f97b6db2ecdb0aece9e, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:30.408895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7f731-f314-48dc-a669-20f8587c7dcd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:30.515680 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1956/3969] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:30 2022] PUT /identity/v3/projects/a78a13d940dc4700bda8f7dc4dabca0c/users/c5bb8e2353b54f97b6db2ecdb0aece9e/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:30.519593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c1cc7-304f-4fef-ae48-5a26763f6318 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:30.536809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c1cc7-304f-4fef-ae48-5a26763f6318 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:30.661914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:30.747570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275fbec-e8d0-47ea-b711-5f244355eef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:30.748257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275fbec-e8d0-47ea-b711-5f244355eef8 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:30.748976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275fbec-e8d0-47ea-b711-5f244355eef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:30.749468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275fbec-e8d0-47ea-b711-5f244355eef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:30.750464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275fbec-e8d0-47ea-b711-5f244355eef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:30.752298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275fbec-e8d0-47ea-b711-5f244355eef8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:30.772772 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2014/3970] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:30.772890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7f731-f314-48dc-a669-20f8587c7dcd admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:30.797330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7f731-f314-48dc-a669-20f8587c7dcd admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:30.808351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0d8f2-8028-4326-8146-7027953828b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:30.810313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0d8f2-8028-4326-8146-7027953828b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:30.810606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0d8f2-8028-4326-8146-7027953828b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:30.810881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0d8f2-8028-4326-8146-7027953828b0 admin admin] PATH_INFO: `/v3/projects/a78a13d940dc4700bda8f7dc4dabca0c/users/c5bb8e2353b54f97b6db2ecdb0aece9e/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:30.813032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0d8f2-8028-4326-8146-7027953828b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78a13d940dc4700bda8f7dc4dabca0c, user_id=c5bb8e2353b54f97b6db2ecdb0aece9e, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:30.817201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0d8f2-8028-4326-8146-7027953828b0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:30.849012 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1957/3971] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:30 2022] PUT /identity/v3/projects/a78a13d940dc4700bda8f7dc4dabca0c/users/c5bb8e2353b54f97b6db2ecdb0aece9e/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:30.861056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb8a82-4c34-4d57-9f9f-7bf5d269771a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:30.861418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb8a82-4c34-4d57-9f9f-7bf5d269771a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:30.861535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb8a82-4c34-4d57-9f9f-7bf5d269771a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:30.893238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-26cb8a82-4c34-4d57-9f9f-7bf5d269771a None None] MFA Rules not processed for user `c5bb8e2353b54f97b6db2ecdb0aece9e`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:30.895275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-26cb8a82-4c34-4d57-9f9f-7bf5d269771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:31.111789 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2015/3972] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:30 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:31.117531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0d8f2-8028-4326-8146-7027953828b0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:31.135309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0d8f2-8028-4326-8146-7027953828b0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:31.141017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:31.164973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f2df7-0627-44b2-9194-3473d270b1a0 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:31.168461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f2df7-0627-44b2-9194-3473d270b1a0 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:31.169067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f2df7-0627-44b2-9194-3473d270b1a0 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:31.169520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f2df7-0627-44b2-9194-3473d270b1a0 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:31.171054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f2df7-0627-44b2-9194-3473d270b1a0 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:31.174619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f2df7-0627-44b2-9194-3473d270b1a0 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:31.341650 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1958/3973] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Jul 16 21:20:31 2022] POST /identity/v3/projects => generated 329 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:31.346129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb8a82-4c34-4d57-9f9f-7bf5d269771a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:31.369503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb8a82-4c34-4d57-9f9f-7bf5d269771a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:31.474775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a7f4b-e14c-45b1-99f1-29ad068c814a tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:31.480396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a7f4b-e14c-45b1-99f1-29ad068c814a tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:31.481023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a7f4b-e14c-45b1-99f1-29ad068c814a tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:31.481517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a7f4b-e14c-45b1-99f1-29ad068c814a tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:31.483026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a7f4b-e14c-45b1-99f1-29ad068c814a tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:31.485929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a7f4b-e14c-45b1-99f1-29ad068c814a tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:31.681314 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2016/3974] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:31 2022] POST /identity/v3/users => generated 413 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:31.681571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f2df7-0627-44b2-9194-3473d270b1a0 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:31.693469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f2df7-0627-44b2-9194-3473d270b1a0 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:31.698813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18349bf4-51fe-4b90-a147-240384c3dbd8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:31.699959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18349bf4-51fe-4b90-a147-240384c3dbd8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:31.700409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18349bf4-51fe-4b90-a147-240384c3dbd8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:31.701114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18349bf4-51fe-4b90-a147-240384c3dbd8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:31.701937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18349bf4-51fe-4b90-a147-240384c3dbd8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:31.703182 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-18349bf4-51fe-4b90-a147-240384c3dbd8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:31.703182 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:20:31.703182 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:20:31.704499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18349bf4-51fe-4b90-a147-240384c3dbd8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:31.828944 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1959/3975] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:20:31 2022] POST /identity/v3/roles => generated 244 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:20:31.833850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a7f4b-e14c-45b1-99f1-29ad068c814a tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:31.865104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a7f4b-e14c-45b1-99f1-29ad068c814a tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:31.877610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70caea09-4764-4ee4-bcf0-f16e89c7f368 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:31.884224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70caea09-4764-4ee4-bcf0-f16e89c7f368 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:31.884704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70caea09-4764-4ee4-bcf0-f16e89c7f368 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:31.886350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70caea09-4764-4ee4-bcf0-f16e89c7f368 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:31.887273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70caea09-4764-4ee4-bcf0-f16e89c7f368 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:31.888347 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-70caea09-4764-4ee4-bcf0-f16e89c7f368 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:31.888347 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:20:31.888347 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:20:31.889292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70caea09-4764-4ee4-bcf0-f16e89c7f368 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:31.981352 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2017/3976] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:20:31 2022] POST /identity/v3/roles => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:31.985124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18349bf4-51fe-4b90-a147-240384c3dbd8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:32.010139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18349bf4-51fe-4b90-a147-240384c3dbd8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:32.017071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f407e-32da-4f3d-9617-37a8ab559eda tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:32.018372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f407e-32da-4f3d-9617-37a8ab559eda tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:32.018886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f407e-32da-4f3d-9617-37a8ab559eda tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:32.020254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f407e-32da-4f3d-9617-37a8ab559eda tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects/4ec9fcb356cf4dcbaa0d59758e1c0787/users/ca4204f9c5e24d3796a91b020cbe6ced/roles/85f075ced9f1467ab709a2f8f11caada` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:32.063778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f407e-32da-4f3d-9617-37a8ab559eda tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4ec9fcb356cf4dcbaa0d59758e1c0787, user_id=ca4204f9c5e24d3796a91b020cbe6ced, role_id=85f075ced9f1467ab709a2f8f11caada)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:32.067602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f407e-32da-4f3d-9617-37a8ab559eda tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:32.165833 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1960/3977] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:31 2022] PUT /identity/v3/projects/4ec9fcb356cf4dcbaa0d59758e1c0787/users/ca4204f9c5e24d3796a91b020cbe6ced/roles/85f075ced9f1467ab709a2f8f11caada => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:20:32.166413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70caea09-4764-4ee4-bcf0-f16e89c7f368 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:32.184596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70caea09-4764-4ee4-bcf0-f16e89c7f368 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:32.292521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504970bb-afac-4a6f-b7c3-f1f7827e8915 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:32.293426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504970bb-afac-4a6f-b7c3-f1f7827e8915 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:32.293704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504970bb-afac-4a6f-b7c3-f1f7827e8915 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:32.293979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504970bb-afac-4a6f-b7c3-f1f7827e8915 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects/4ec9fcb356cf4dcbaa0d59758e1c0787/users/ca4204f9c5e24d3796a91b020cbe6ced/roles/4749f7d3509442dfb58fd15ec17c10e8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:32.302703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504970bb-afac-4a6f-b7c3-f1f7827e8915 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4ec9fcb356cf4dcbaa0d59758e1c0787, user_id=ca4204f9c5e24d3796a91b020cbe6ced, role_id=4749f7d3509442dfb58fd15ec17c10e8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:32.302871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504970bb-afac-4a6f-b7c3-f1f7827e8915 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:32.403793 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2018/3978] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:32 2022] PUT /identity/v3/projects/4ec9fcb356cf4dcbaa0d59758e1c0787/users/ca4204f9c5e24d3796a91b020cbe6ced/roles/4749f7d3509442dfb58fd15ec17c10e8 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:20:32.407547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f407e-32da-4f3d-9617-37a8ab559eda tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:32.421040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f407e-32da-4f3d-9617-37a8ab559eda tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:32.471959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:32.495754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3fec6-5ec9-41bf-b7e7-671e61e5e18b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:32.495754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3fec6-5ec9-41bf-b7e7-671e61e5e18b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:32.495754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3fec6-5ec9-41bf-b7e7-671e61e5e18b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:32.496408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3fec6-5ec9-41bf-b7e7-671e61e5e18b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:32.496408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3fec6-5ec9-41bf-b7e7-671e61e5e18b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:32.498650 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-62d3fec6-5ec9-41bf-b7e7-671e61e5e18b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:32.498650 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:20:32.498650 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:20:32.499801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3fec6-5ec9-41bf-b7e7-671e61e5e18b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:32.548079 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1961/3979] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:32 2022] GET /identity/v3/users => generated 8050 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:32.554186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a20b40-75f7-4448-9d91-f5be2b742ff1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:32.554755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a20b40-75f7-4448-9d91-f5be2b742ff1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:32.554924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a20b40-75f7-4448-9d91-f5be2b742ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:32.611627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-04a20b40-75f7-4448-9d91-f5be2b742ff1 None None] MFA Rules not processed for user `ca4204f9c5e24d3796a91b020cbe6ced`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:32.614108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-04a20b40-75f7-4448-9d91-f5be2b742ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:32.699591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3fec6-5ec9-41bf-b7e7-671e61e5e18b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:32.701495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-62d3fec6-5ec9-41bf-b7e7-671e61e5e18b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:32.745111 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2019/3980] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:32 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:32.756611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c6cbf-2848-45fa-a482-08120aff0275 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:32.756932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c6cbf-2848-45fa-a482-08120aff0275 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:32.757616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c6cbf-2848-45fa-a482-08120aff0275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:32.808062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b72c6cbf-2848-45fa-a482-08120aff0275 None None] MFA Rules not processed for user `ca4204f9c5e24d3796a91b020cbe6ced`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:32.812880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b72c6cbf-2848-45fa-a482-08120aff0275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:32.832496 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2020/3981] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:32 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:32.832496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c6cbf-2848-45fa-a482-08120aff0275 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:32.832496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b72c6cbf-2848-45fa-a482-08120aff0275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:32.887917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3fec6-5ec9-41bf-b7e7-671e61e5e18b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:32.906237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:32.912956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9b80f-ad26-46b9-8d8b-9e15f84f4895 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:32.914795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9b80f-ad26-46b9-8d8b-9e15f84f4895 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:32.915449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9b80f-ad26-46b9-8d8b-9e15f84f4895 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:32.916934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9b80f-ad26-46b9-8d8b-9e15f84f4895 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:32.921441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a6c9b80f-ad26-46b9-8d8b-9e15f84f4895 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:32.938832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9b80f-ad26-46b9-8d8b-9e15f84f4895 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:32.941703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9b80f-ad26-46b9-8d8b-9e15f84f4895 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:32.953936 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1962/3982] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:20:32.955153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9b80f-ad26-46b9-8d8b-9e15f84f4895 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:32.970869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9b80f-ad26-46b9-8d8b-9e15f84f4895 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:32.980967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c6cbf-2848-45fa-a482-08120aff0275 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:32.988995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e737be8-f927-4a8a-92ac-612968a113b8 tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4204f9c5e24d3796a91b020cbe6ced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec9fcb356cf4dcbaa0d59758e1c0787', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-232192587', 'tempest-DelegatedRole-1592400456'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:32.990075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e737be8-f927-4a8a-92ac-612968a113b8 tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:32.991193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e737be8-f927-4a8a-92ac-612968a113b8 tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:32.991685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e737be8-f927-4a8a-92ac-612968a113b8 tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:32.993353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e737be8-f927-4a8a-92ac-612968a113b8 tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] RBAC: Authorizing `identity:create_trust()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:32.994749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e737be8-f927-4a8a-92ac-612968a113b8 tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:32.995668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25de995-f04f-4483-9917-090c389eb6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:32.996648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25de995-f04f-4483-9917-090c389eb6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:32.996937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25de995-f04f-4483-9917-090c389eb6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:32.997235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25de995-f04f-4483-9917-090c389eb6ce admin admin] PATH_INFO: `/v3/users/fe680ccdc60e410b812794de8aa73e0f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:32.998672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25de995-f04f-4483-9917-090c389eb6ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe680ccdc60e410b812794de8aa73e0f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:33.000960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25de995-f04f-4483-9917-090c389eb6ce admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:33.241862 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1963/3983] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Jul 16 21:20:32 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:33.247277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e737be8-f927-4a8a-92ac-612968a113b8 tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:33.279184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e737be8-f927-4a8a-92ac-612968a113b8 tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:33.292692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a25de995-f04f-4483-9917-090c389eb6ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe680ccdc60e410b812794de8aa73e0f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:33.296177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d200d6c-a747-4f9e-81e0-0edda6aa5f95 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:33.297501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d200d6c-a747-4f9e-81e0-0edda6aa5f95 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:33.302247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d200d6c-a747-4f9e-81e0-0edda6aa5f95 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:33.303322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d200d6c-a747-4f9e-81e0-0edda6aa5f95 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:33.306143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d200d6c-a747-4f9e-81e0-0edda6aa5f95 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:33.308978 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-9d200d6c-a747-4f9e-81e0-0edda6aa5f95 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:33.308978 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:20:33.308978 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:20:33.313190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d200d6c-a747-4f9e-81e0-0edda6aa5f95 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:33.319316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a25de995-f04f-4483-9917-090c389eb6ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe680ccdc60e410b812794de8aa73e0f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:33.333026 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1964/3984] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Jul 16 21:20:33 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:33.338090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d200d6c-a747-4f9e-81e0-0edda6aa5f95 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:33.366912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d200d6c-a747-4f9e-81e0-0edda6aa5f95 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:33.379791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb7515-59a9-48b4-b395-a4efe983b112 tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4204f9c5e24d3796a91b020cbe6ced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec9fcb356cf4dcbaa0d59758e1c0787', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-232192587', 'tempest-DelegatedRole-1592400456'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:33.380721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb7515-59a9-48b4-b395-a4efe983b112 tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:33.381008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb7515-59a9-48b4-b395-a4efe983b112 tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:33.381288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb7515-59a9-48b4-b395-a4efe983b112 tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] PATH_INFO: `/v3/OS-TRUST/trusts/08469a228316423eb61815470e50acb3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:33.404986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb7515-59a9-48b4-b395-a4efe983b112 tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] RBAC: Authorizing `identity:delete_trust(trust_id=08469a228316423eb61815470e50acb3)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:33.408786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb7515-59a9-48b4-b395-a4efe983b112 tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:33.486226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a25de995-f04f-4483-9917-090c389eb6ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe680ccdc60e410b812794de8aa73e0f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:33.487470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a25de995-f04f-4483-9917-090c389eb6ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe680ccdc60e410b812794de8aa73e0f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:33.502742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a25de995-f04f-4483-9917-090c389eb6ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe680ccdc60e410b812794de8aa73e0f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:33.518598 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2021/3985] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:32 2022] DELETE /identity/v3/users/fe680ccdc60e410b812794de8aa73e0f => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:33.606468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a7bb7515-59a9-48b4-b395-a4efe983b112 tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '08469a228316423eb61815470e50acb3', 'request_id': 'req-a7bb7515-59a9-48b4-b395-a4efe983b112'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:33.608572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a7bb7515-59a9-48b4-b395-a4efe983b112 tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '08469a228316423eb61815470e50acb3', 'request_id': 'req-a7bb7515-59a9-48b4-b395-a4efe983b112'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:33.610071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a7bb7515-59a9-48b4-b395-a4efe983b112 tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '08469a228316423eb61815470e50acb3', 'request_id': 'req-a7bb7515-59a9-48b4-b395-a4efe983b112'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:33.703873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:DELETE=3,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:33.762930 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1965/3986] 10.222.0.16 () {58 vars in 1253 bytes} [Sat Jul 16 21:20:33 2022] DELETE /identity/v3/OS-TRUST/trusts/08469a228316423eb61815470e50acb3 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:20:33.767261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25de995-f04f-4483-9917-090c389eb6ce admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:33.768855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a25de995-f04f-4483-9917-090c389eb6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:33.874496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25de995-f04f-4483-9917-090c389eb6ce admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:33.880117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5098708-cc26-44a2-baab-2d806a4a08df tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4204f9c5e24d3796a91b020cbe6ced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec9fcb356cf4dcbaa0d59758e1c0787', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-232192587', 'tempest-DelegatedRole-1592400456'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:33.881208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5098708-cc26-44a2-baab-2d806a4a08df tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:33.881732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5098708-cc26-44a2-baab-2d806a4a08df tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:33.882219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5098708-cc26-44a2-baab-2d806a4a08df tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] PATH_INFO: `/v3/OS-TRUST/trusts/08469a228316423eb61815470e50acb3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:33.921072 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-d5098708-cc26-44a2-baab-2d806a4a08df tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] Could not find trust: 08469a228316423eb61815470e50acb3.: keystone.exception.TrustNotFound: Could not find trust: 08469a228316423eb61815470e50acb3. Jul 16 21:20:33.921072 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:20:33.921072 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:20:33.921072 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:20:33.921072 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:20:33.921072 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:20:33.921072 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:20:33.921072 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:20:33.921072 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:20:33.921072 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:20:33.921072 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:20:33.921072 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:20:33.921072 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 16 21:20:33.921072 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 16 21:20:33.921072 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 16 21:20:33.922138 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 16 21:20:33.922138 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 16 21:20:33.922138 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 16 21:20:33.922138 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 16 21:20:33.922138 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 16 21:20:33.922138 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:20:33.922138 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:20:33.922138 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 16 21:20:33.922138 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 16 21:20:33.922138 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 16 21:20:33.922138 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 16 21:20:33.922138 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 08469a228316423eb61815470e50acb3. Jul 16 21:20:33.922138 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:20:33.925597 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2022/3987] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jul 16 21:20:33 2022] GET /identity/v3/OS-TRUST/trusts/08469a228316423eb61815470e50acb3 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:20:33.930221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb7515-59a9-48b4-b395-a4efe983b112 tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:33.931709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a7bb7515-59a9-48b4-b395-a4efe983b112 tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:33.954432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb7515-59a9-48b4-b395-a4efe983b112 tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:34.032742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5098708-cc26-44a2-baab-2d806a4a08df tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:34.036374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d5098708-cc26-44a2-baab-2d806a4a08df tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:34.120775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793153cc-3758-478f-982e-b655d6c770e1 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:34.121702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793153cc-3758-478f-982e-b655d6c770e1 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:34.121985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793153cc-3758-478f-982e-b655d6c770e1 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:34.122300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793153cc-3758-478f-982e-b655d6c770e1 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles/4749f7d3509442dfb58fd15ec17c10e8` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:34.124246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793153cc-3758-478f-982e-b655d6c770e1 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4749f7d3509442dfb58fd15ec17c10e8)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:34.125527 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-793153cc-3758-478f-982e-b655d6c770e1 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:34.125527 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:20:34.125527 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:20:34.126443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793153cc-3758-478f-982e-b655d6c770e1 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:34.133393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:34.216809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5098708-cc26-44a2-baab-2d806a4a08df tempest-TrustsV3TestJSON-2007919322 tempest-user-755220353] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:34.219798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29d0c4-da02-457e-a8a4-38eb72bec0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:34.220688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29d0c4-da02-457e-a8a4-38eb72bec0b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:34.220971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29d0c4-da02-457e-a8a4-38eb72bec0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:34.221260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29d0c4-da02-457e-a8a4-38eb72bec0b7 admin admin] PATH_INFO: `/v3/projects/772bd01188344e288824730238fee49b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:34.222780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29d0c4-da02-457e-a8a4-38eb72bec0b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=772bd01188344e288824730238fee49b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:34.224986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29d0c4-da02-457e-a8a4-38eb72bec0b7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:34.365001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa29d0c4-da02-457e-a8a4-38eb72bec0b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '772bd01188344e288824730238fee49b', 'request_id': 'req-aa29d0c4-da02-457e-a8a4-38eb72bec0b7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:34.374059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa29d0c4-da02-457e-a8a4-38eb72bec0b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '772bd01188344e288824730238fee49b', 'request_id': 'req-aa29d0c4-da02-457e-a8a4-38eb72bec0b7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:34.394454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-793153cc-3758-478f-982e-b655d6c770e1 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invalidating the token cache because role 4749f7d3509442dfb58fd15ec17c10e8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:34.397917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-793153cc-3758-478f-982e-b655d6c770e1 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:34.397917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-793153cc-3758-478f-982e-b655d6c770e1 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:34.398236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa29d0c4-da02-457e-a8a4-38eb72bec0b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '772bd01188344e288824730238fee49b', 'request_id': 'req-aa29d0c4-da02-457e-a8a4-38eb72bec0b7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:34.401715 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1966/3988] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:33 2022] DELETE /identity/v3/roles/4749f7d3509442dfb58fd15ec17c10e8 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:34.402735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793153cc-3758-478f-982e-b655d6c770e1 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:34.405058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-793153cc-3758-478f-982e-b655d6c770e1 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:34.537626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa29d0c4-da02-457e-a8a4-38eb72bec0b7 admin admin] The token cache is being invalidate because project 772bd01188344e288824730238fee49b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:34.538162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa29d0c4-da02-457e-a8a4-38eb72bec0b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:34.540058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa29d0c4-da02-457e-a8a4-38eb72bec0b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:34.542834 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2023/3989] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:34 2022] DELETE /identity/v3/projects/772bd01188344e288824730238fee49b => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:34.547558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeda286-37d8-429c-bede-6e8203104dc6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:34.547844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeda286-37d8-429c-bede-6e8203104dc6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:34.548121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeda286-37d8-429c-bede-6e8203104dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:34.617002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793153cc-3758-478f-982e-b655d6c770e1 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:34.634372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-bdeda286-37d8-429c-bede-6e8203104dc6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:34.649288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69eb423-9eed-4427-af4b-022fb868fc59 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:34.650663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bdeda286-37d8-429c-bede-6e8203104dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:34.656407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69eb423-9eed-4427-af4b-022fb868fc59 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:34.656407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69eb423-9eed-4427-af4b-022fb868fc59 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:34.657146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69eb423-9eed-4427-af4b-022fb868fc59 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles/85f075ced9f1467ab709a2f8f11caada` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:34.663528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69eb423-9eed-4427-af4b-022fb868fc59 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_role(role_id=85f075ced9f1467ab709a2f8f11caada)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:34.676561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69eb423-9eed-4427-af4b-022fb868fc59 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:34.840178 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2024/3990] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:20:34.854923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63f449-0a5b-4eaa-8a7f-6ecd5dd4ef58 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:34.856969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63f449-0a5b-4eaa-8a7f-6ecd5dd4ef58 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:34.857420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63f449-0a5b-4eaa-8a7f-6ecd5dd4ef58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:34.907339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4b63f449-0a5b-4eaa-8a7f-6ecd5dd4ef58 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:34.909757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4b63f449-0a5b-4eaa-8a7f-6ecd5dd4ef58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:34.927271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d69eb423-9eed-4427-af4b-022fb868fc59 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invalidating the token cache because role 85f075ced9f1467ab709a2f8f11caada has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:34.927824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d69eb423-9eed-4427-af4b-022fb868fc59 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:34.930110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d69eb423-9eed-4427-af4b-022fb868fc59 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:34.932517 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1967/3991] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:34 2022] DELETE /identity/v3/roles/85f075ced9f1467ab709a2f8f11caada => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:34.936688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69eb423-9eed-4427-af4b-022fb868fc59 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:34.943193 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2025/3992] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:34.946317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d69eb423-9eed-4427-af4b-022fb868fc59 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:34.948509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63f449-0a5b-4eaa-8a7f-6ecd5dd4ef58 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:34.962594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63f449-0a5b-4eaa-8a7f-6ecd5dd4ef58 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:35.101904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05477a51-a226-4ec5-8ac8-860f92d93fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:35.102952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05477a51-a226-4ec5-8ac8-860f92d93fcd admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:35.105604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05477a51-a226-4ec5-8ac8-860f92d93fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:35.105786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05477a51-a226-4ec5-8ac8-860f92d93fcd admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:35.106561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05477a51-a226-4ec5-8ac8-860f92d93fcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:20:35.107639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69eb423-9eed-4427-af4b-022fb868fc59 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:35.107762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05477a51-a226-4ec5-8ac8-860f92d93fcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:35.114160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05477a51-a226-4ec5-8ac8-860f92d93fcd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:35.119315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099194a-80be-4ca3-acc7-35498870f3c6 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:35.125719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099194a-80be-4ca3-acc7-35498870f3c6 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:35.128433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099194a-80be-4ca3-acc7-35498870f3c6 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:35.131445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099194a-80be-4ca3-acc7-35498870f3c6 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/users/ca4204f9c5e24d3796a91b020cbe6ced` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:35.134133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099194a-80be-4ca3-acc7-35498870f3c6 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ca4204f9c5e24d3796a91b020cbe6ced)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:35.143671 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2026/3993] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:35.149024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05477a51-a226-4ec5-8ac8-860f92d93fcd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:35.162747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099194a-80be-4ca3-acc7-35498870f3c6 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:35.167994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05477a51-a226-4ec5-8ac8-860f92d93fcd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:35.183116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d8b42-f657-49a2-b2d4-cca0f5dac486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:35.183810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d8b42-f657-49a2-b2d4-cca0f5dac486 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:35.184090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d8b42-f657-49a2-b2d4-cca0f5dac486 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:35.184992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d8b42-f657-49a2-b2d4-cca0f5dac486 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:35.185112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d8b42-f657-49a2-b2d4-cca0f5dac486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:35.187002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d8b42-f657-49a2-b2d4-cca0f5dac486 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:35.372481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3099194a-80be-4ca3-acc7-35498870f3c6 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca4204f9c5e24d3796a91b020cbe6ced'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:35.386972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3099194a-80be-4ca3-acc7-35498870f3c6 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca4204f9c5e24d3796a91b020cbe6ced'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:35.409179 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2027/3994] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:20:35 2022] POST /identity/v3/projects => generated 365 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:20:35.417947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d8b42-f657-49a2-b2d4-cca0f5dac486 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:35.481089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3099194a-80be-4ca3-acc7-35498870f3c6 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca4204f9c5e24d3796a91b020cbe6ced'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:35.495681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3099194a-80be-4ca3-acc7-35498870f3c6 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca4204f9c5e24d3796a91b020cbe6ced'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:35.496487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3099194a-80be-4ca3-acc7-35498870f3c6 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca4204f9c5e24d3796a91b020cbe6ced'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:35.511410 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1968/3995] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:34 2022] DELETE /identity/v3/users/ca4204f9c5e24d3796a91b020cbe6ced => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:20:35.518585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099194a-80be-4ca3-acc7-35498870f3c6 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:35.522876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3099194a-80be-4ca3-acc7-35498870f3c6 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:35.572878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d8b42-f657-49a2-b2d4-cca0f5dac486 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:35.727233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bf1d2-87b8-4190-8874-c241e4043457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:35.727851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bf1d2-87b8-4190-8874-c241e4043457 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:35.728209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bf1d2-87b8-4190-8874-c241e4043457 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:35.728564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bf1d2-87b8-4190-8874-c241e4043457 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:35.729358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bf1d2-87b8-4190-8874-c241e4043457 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:35.731893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bf1d2-87b8-4190-8874-c241e4043457 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:35.746422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099194a-80be-4ca3-acc7-35498870f3c6 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:35.753614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b48634-d07d-40d2-ba46-8d3d84be0985 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:35.755272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b48634-d07d-40d2-ba46-8d3d84be0985 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:35.755864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b48634-d07d-40d2-ba46-8d3d84be0985 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:35.756393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b48634-d07d-40d2-ba46-8d3d84be0985 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects/4ec9fcb356cf4dcbaa0d59758e1c0787` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:35.757961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b48634-d07d-40d2-ba46-8d3d84be0985 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4ec9fcb356cf4dcbaa0d59758e1c0787)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:35.760295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b48634-d07d-40d2-ba46-8d3d84be0985 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:35.844590 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2028/3996] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:35 2022] POST /identity/v3/users => generated 283 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:35.845464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bf1d2-87b8-4190-8874-c241e4043457 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:35.848054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2e2bf1d2-87b8-4190-8874-c241e4043457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:35.874772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bf1d2-87b8-4190-8874-c241e4043457 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:35.898556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40717e42-7285-409f-95af-e6349084d8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:35.901576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40717e42-7285-409f-95af-e6349084d8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:35.901576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40717e42-7285-409f-95af-e6349084d8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:35.901856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40717e42-7285-409f-95af-e6349084d8a7 admin admin] PATH_INFO: `/v3/users/9fb89c3c454243dfbb48e3a1971c9491` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:35.911731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40717e42-7285-409f-95af-e6349084d8a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fb89c3c454243dfbb48e3a1971c9491)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:35.914150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40717e42-7285-409f-95af-e6349084d8a7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:36.044884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-65b48634-d07d-40d2-ba46-8d3d84be0985 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec9fcb356cf4dcbaa0d59758e1c0787', 'request_id': 'req-65b48634-d07d-40d2-ba46-8d3d84be0985'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:36.058379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-65b48634-d07d-40d2-ba46-8d3d84be0985 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec9fcb356cf4dcbaa0d59758e1c0787', 'request_id': 'req-65b48634-d07d-40d2-ba46-8d3d84be0985'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:36.070508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-65b48634-d07d-40d2-ba46-8d3d84be0985 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec9fcb356cf4dcbaa0d59758e1c0787', 'request_id': 'req-65b48634-d07d-40d2-ba46-8d3d84be0985'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:36.164723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-40717e42-7285-409f-95af-e6349084d8a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fb89c3c454243dfbb48e3a1971c9491'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:36.167839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-65b48634-d07d-40d2-ba46-8d3d84be0985 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] The token cache is being invalidate because project 4ec9fcb356cf4dcbaa0d59758e1c0787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:36.168302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-65b48634-d07d-40d2-ba46-8d3d84be0985 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:36.169217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-65b48634-d07d-40d2-ba46-8d3d84be0985 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:36.172208 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1969/3997] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:35 2022] DELETE /identity/v3/projects/4ec9fcb356cf4dcbaa0d59758e1c0787 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:36.175024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b48634-d07d-40d2-ba46-8d3d84be0985 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:36.181066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-65b48634-d07d-40d2-ba46-8d3d84be0985 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:36.184798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-40717e42-7285-409f-95af-e6349084d8a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fb89c3c454243dfbb48e3a1971c9491'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:36.275218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:36.305523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b48634-d07d-40d2-ba46-8d3d84be0985 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:36.313025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-40717e42-7285-409f-95af-e6349084d8a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fb89c3c454243dfbb48e3a1971c9491'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:36.313697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-40717e42-7285-409f-95af-e6349084d8a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fb89c3c454243dfbb48e3a1971c9491'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:36.314305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b75f9-1742-47f3-85e6-efdbbb5b6978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:36.315325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b75f9-1742-47f3-85e6-efdbbb5b6978 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:36.315805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b75f9-1742-47f3-85e6-efdbbb5b6978 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:36.316490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b75f9-1742-47f3-85e6-efdbbb5b6978 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:36.317365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b75f9-1742-47f3-85e6-efdbbb5b6978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:36.320060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b75f9-1742-47f3-85e6-efdbbb5b6978 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:36.329801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-40717e42-7285-409f-95af-e6349084d8a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fb89c3c454243dfbb48e3a1971c9491'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:36.336222 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1970/3998] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:36.337304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b75f9-1742-47f3-85e6-efdbbb5b6978 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:36.340399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-de2b75f9-1742-47f3-85e6-efdbbb5b6978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:36.344015 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2029/3999] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:35 2022] DELETE /identity/v3/users/9fb89c3c454243dfbb48e3a1971c9491 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:36.344015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8b1d1-1789-42f9-b46e-3b1908527b7a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:36.344015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8b1d1-1789-42f9-b46e-3b1908527b7a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:36.344565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8b1d1-1789-42f9-b46e-3b1908527b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:36.404673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:36.413164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d1b8b1d1-1789-42f9-b46e-3b1908527b7a None None] MFA Rules not processed for user `029f1334779e4bcdb3f4f2aed564a075`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:36.414748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d1b8b1d1-1789-42f9-b46e-3b1908527b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:36.464513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b75f9-1742-47f3-85e6-efdbbb5b6978 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:36.539975 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2030/4000] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:36.543846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8b1d1-1789-42f9-b46e-3b1908527b7a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:36.545418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d1b8b1d1-1789-42f9-b46e-3b1908527b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:36.548129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41040800-03ad-457b-9a3c-bb3bd0e0d004 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:36.548129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41040800-03ad-457b-9a3c-bb3bd0e0d004 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:36.548129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41040800-03ad-457b-9a3c-bb3bd0e0d004 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:36.548777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41040800-03ad-457b-9a3c-bb3bd0e0d004 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:36.549742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41040800-03ad-457b-9a3c-bb3bd0e0d004 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:36.557394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41040800-03ad-457b-9a3c-bb3bd0e0d004 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:36.624215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8b1d1-1789-42f9-b46e-3b1908527b7a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:36.636861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4612a11-a31e-4f59-85e1-7b034bb3bc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:36.638503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4612a11-a31e-4f59-85e1-7b034bb3bc46 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:36.638805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4612a11-a31e-4f59-85e1-7b034bb3bc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:36.639187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4612a11-a31e-4f59-85e1-7b034bb3bc46 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:36.640192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4612a11-a31e-4f59-85e1-7b034bb3bc46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:36.642025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4612a11-a31e-4f59-85e1-7b034bb3bc46 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:36.661018 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2031/4001] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:36.662303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b3213-223f-49f5-920d-c3973298be2a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:36.662669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b3213-223f-49f5-920d-c3973298be2a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:36.663041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b3213-223f-49f5-920d-c3973298be2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:36.669304 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1971/4002] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Jul 16 21:20:36 2022] POST /identity/v3/projects => generated 329 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:36.670422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41040800-03ad-457b-9a3c-bb3bd0e0d004 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:36.676846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-41040800-03ad-457b-9a3c-bb3bd0e0d004 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:36.720463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-356b3213-223f-49f5-920d-c3973298be2a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:36.732440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-356b3213-223f-49f5-920d-c3973298be2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:36.839406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41040800-03ad-457b-9a3c-bb3bd0e0d004 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:36.844780 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2032/4003] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:36.845667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b3213-223f-49f5-920d-c3973298be2a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:36.856240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb448c1-f549-43bf-b0d0-a89c91a9c14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:36.857374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb448c1-f549-43bf-b0d0-a89c91a9c14e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:36.857872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb448c1-f549-43bf-b0d0-a89c91a9c14e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:36.858382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb448c1-f549-43bf-b0d0-a89c91a9c14e admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:36.860377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb448c1-f549-43bf-b0d0-a89c91a9c14e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:36.868644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b3213-223f-49f5-920d-c3973298be2a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:36.870166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb448c1-f549-43bf-b0d0-a89c91a9c14e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:36.890303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ce35b-0eab-4767-a98e-7031e5151bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:36.891387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ce35b-0eab-4767-a98e-7031e5151bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:36.891675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ce35b-0eab-4767-a98e-7031e5151bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:36.892014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ce35b-0eab-4767-a98e-7031e5151bf2 admin admin] PATH_INFO: `/v3/projects/c7b8d5d113e44e8a8e8e024c8bde9c1e/users/b99d79db9d374453803e7715cc6a8599/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:36.923350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ce35b-0eab-4767-a98e-7031e5151bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7b8d5d113e44e8a8e8e024c8bde9c1e, user_id=b99d79db9d374453803e7715cc6a8599, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:36.926881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ce35b-0eab-4767-a98e-7031e5151bf2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:36.985075 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1972/4004] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:20:36 2022] POST /identity/v3/projects => generated 383 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:36.986054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb448c1-f549-43bf-b0d0-a89c91a9c14e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:37.092238 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2033/4005] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:36 2022] PUT /identity/v3/projects/c7b8d5d113e44e8a8e8e024c8bde9c1e/users/b99d79db9d374453803e7715cc6a8599/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:37.093443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ce35b-0eab-4767-a98e-7031e5151bf2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:37.108226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a95ce35b-0eab-4767-a98e-7031e5151bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:37.138169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb448c1-f549-43bf-b0d0-a89c91a9c14e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:37.214949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ce35b-0eab-4767-a98e-7031e5151bf2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:37.226918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf4ec6-8bbc-40f5-bd95-1a5568205534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:37.227679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf4ec6-8bbc-40f5-bd95-1a5568205534 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:37.227976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf4ec6-8bbc-40f5-bd95-1a5568205534 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:37.228267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf4ec6-8bbc-40f5-bd95-1a5568205534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:37.258915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a721ab-5bf7-4682-8ebf-8605b3cde1b9 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:37.260043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a721ab-5bf7-4682-8ebf-8605b3cde1b9 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:37.260389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a721ab-5bf7-4682-8ebf-8605b3cde1b9 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:37.260666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a721ab-5bf7-4682-8ebf-8605b3cde1b9 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:37.261933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a721ab-5bf7-4682-8ebf-8605b3cde1b9 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:37.264352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a721ab-5bf7-4682-8ebf-8605b3cde1b9 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:37.303457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf4ec6-8bbc-40f5-bd95-1a5568205534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:37.305249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf4ec6-8bbc-40f5-bd95-1a5568205534 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:37.316946 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2034/4006] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:20:37.317740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf4ec6-8bbc-40f5-bd95-1a5568205534 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:37.328455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf4ec6-8bbc-40f5-bd95-1a5568205534 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:37.333897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a5239-d64d-4907-aa2e-e4fa5c05cca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:37.334890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a5239-d64d-4907-aa2e-e4fa5c05cca7 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:37.335115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a5239-d64d-4907-aa2e-e4fa5c05cca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:37.335329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a5239-d64d-4907-aa2e-e4fa5c05cca7 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:37.336256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a5239-d64d-4907-aa2e-e4fa5c05cca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:37.338779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a5239-d64d-4907-aa2e-e4fa5c05cca7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:37.388884 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1973/4007] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:36 2022] POST /identity/v3/users => generated 416 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:37.390604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05258d5-eb81-4bfd-bdfb-1bb4692214f7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:37.391156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05258d5-eb81-4bfd-bdfb-1bb4692214f7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:37.392280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05258d5-eb81-4bfd-bdfb-1bb4692214f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:37.423872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a05258d5-eb81-4bfd-bdfb-1bb4692214f7 None None] MFA Rules not processed for user `b99d79db9d374453803e7715cc6a8599`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:37.425110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a05258d5-eb81-4bfd-bdfb-1bb4692214f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:37.442924 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2035/4008] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:37 2022] POST /identity/v3/users => generated 298 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:37.444620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02171c5-7ef7-4fc9-b6da-fc2cb9095831 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:37.446930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02171c5-7ef7-4fc9-b6da-fc2cb9095831 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:37.446930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02171c5-7ef7-4fc9-b6da-fc2cb9095831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:37.474430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e02171c5-7ef7-4fc9-b6da-fc2cb9095831 None None] MFA Rules not processed for user `d3bb6f6d546c4bd090e72c149afe5660`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:37.475998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e02171c5-7ef7-4fc9-b6da-fc2cb9095831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:37.512933 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1974/4009] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:37.512933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05258d5-eb81-4bfd-bdfb-1bb4692214f7 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:37.522834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05258d5-eb81-4bfd-bdfb-1bb4692214f7 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:37.529027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1087b79-7ee5-49b9-b428-50f53ec451e2 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:37.529889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1087b79-7ee5-49b9-b428-50f53ec451e2 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:37.530319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1087b79-7ee5-49b9-b428-50f53ec451e2 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:37.530690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1087b79-7ee5-49b9-b428-50f53ec451e2 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:37.531736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1087b79-7ee5-49b9-b428-50f53ec451e2 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:37.534888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1087b79-7ee5-49b9-b428-50f53ec451e2 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:37.578103 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2036/4010] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:37.578103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02171c5-7ef7-4fc9-b6da-fc2cb9095831 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:37.595441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02171c5-7ef7-4fc9-b6da-fc2cb9095831 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:37.601748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15c3f6-9791-4a73-a215-51af971fdc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:37.602760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15c3f6-9791-4a73-a215-51af971fdc5c admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:37.603271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15c3f6-9791-4a73-a215-51af971fdc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:37.604217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15c3f6-9791-4a73-a215-51af971fdc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:37.604509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15c3f6-9791-4a73-a215-51af971fdc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:37.606191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15c3f6-9791-4a73-a215-51af971fdc5c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:37.626905 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2037/4011] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:37.628621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15c3f6-9791-4a73-a215-51af971fdc5c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:37.631730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3e15c3f6-9791-4a73-a215-51af971fdc5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:37.634201 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1975/4012] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:20:37 2022] POST /identity/v3/roles => generated 243 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:37.635684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100512ff-6d65-4578-8ab9-88272c7ac115 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:37.636040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100512ff-6d65-4578-8ab9-88272c7ac115 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:37.636400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100512ff-6d65-4578-8ab9-88272c7ac115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:37.672406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-100512ff-6d65-4578-8ab9-88272c7ac115 None None] MFA Rules not processed for user `d3bb6f6d546c4bd090e72c149afe5660`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:37.673751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-100512ff-6d65-4578-8ab9-88272c7ac115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:37.682857 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1976/4013] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:37.684053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100512ff-6d65-4578-8ab9-88272c7ac115 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:37.700109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100512ff-6d65-4578-8ab9-88272c7ac115 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:37.705593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86716c43-2205-4395-a290-c488a7a9cb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:37.706578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86716c43-2205-4395-a290-c488a7a9cb5f admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:37.707796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86716c43-2205-4395-a290-c488a7a9cb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:37.708369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86716c43-2205-4395-a290-c488a7a9cb5f admin admin] PATH_INFO: `/v3/projects/76f5320a44c24b1086bffdd1e81833d1/users/b7d013d2f9834ce0a8884e6f93a95d13/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:37.715678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:37.731191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86716c43-2205-4395-a290-c488a7a9cb5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f5320a44c24b1086bffdd1e81833d1, user_id=b7d013d2f9834ce0a8884e6f93a95d13, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:37.733876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86716c43-2205-4395-a290-c488a7a9cb5f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:37.793782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15c3f6-9791-4a73-a215-51af971fdc5c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:37.798458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca72cb8-266b-4942-be94-e059d137de8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:37.799163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca72cb8-266b-4942-be94-e059d137de8a service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:37.799447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca72cb8-266b-4942-be94-e059d137de8a service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:37.799724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca72cb8-266b-4942-be94-e059d137de8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:37.809080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca72cb8-266b-4942-be94-e059d137de8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:37.810652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca72cb8-266b-4942-be94-e059d137de8a service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:37.821642 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1977/4014] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:37 2022] PUT /identity/v3/projects/76f5320a44c24b1086bffdd1e81833d1/users/b7d013d2f9834ce0a8884e6f93a95d13/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:37.821642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86716c43-2205-4395-a290-c488a7a9cb5f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:37.825811 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2038/4015] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:20:37.826741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca72cb8-266b-4942-be94-e059d137de8a service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:37.828223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6ca72cb8-266b-4942-be94-e059d137de8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:37.845629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca72cb8-266b-4942-be94-e059d137de8a service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:37.934979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:37.951613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86716c43-2205-4395-a290-c488a7a9cb5f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:37.960298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f76506-e80b-46b5-b4d3-1cb9fa1364fe tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:37.961111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f76506-e80b-46b5-b4d3-1cb9fa1364fe tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:37.961391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f76506-e80b-46b5-b4d3-1cb9fa1364fe tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:37.961669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f76506-e80b-46b5-b4d3-1cb9fa1364fe tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:37.962522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f76506-e80b-46b5-b4d3-1cb9fa1364fe tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:37.963978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dea9b9-f361-46cc-9264-63848d294bbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:37.964191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f76506-e80b-46b5-b4d3-1cb9fa1364fe tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:37.965039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dea9b9-f361-46cc-9264-63848d294bbf service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:37.965500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dea9b9-f361-46cc-9264-63848d294bbf service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:37.965969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dea9b9-f361-46cc-9264-63848d294bbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:38.037188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dea9b9-f361-46cc-9264-63848d294bbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:38.038861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dea9b9-f361-46cc-9264-63848d294bbf service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:38.050679 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2039/4016] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:20:38.051796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dea9b9-f361-46cc-9264-63848d294bbf service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:38.057933 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1978/4017] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:20:37 2022] POST /identity/v3/roles => generated 246 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:38.057933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c66f0-3a02-4694-a246-89313e5734e4 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:38.057933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c66f0-3a02-4694-a246-89313e5734e4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:38.057933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c66f0-3a02-4694-a246-89313e5734e4 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:38.058815 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1979/4018] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:20:38.064020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c66f0-3a02-4694-a246-89313e5734e4 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:38.066125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-674c66f0-3a02-4694-a246-89313e5734e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:38.146441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dea9b9-f361-46cc-9264-63848d294bbf service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:38.151749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39c38a-6bb2-4da6-8c6d-64c17b92ee52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:38.152722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39c38a-6bb2-4da6-8c6d-64c17b92ee52 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:38.153102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39c38a-6bb2-4da6-8c6d-64c17b92ee52 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:38.153481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39c38a-6bb2-4da6-8c6d-64c17b92ee52 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:38.154471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39c38a-6bb2-4da6-8c6d-64c17b92ee52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:38.156245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39c38a-6bb2-4da6-8c6d-64c17b92ee52 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:38.166624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c66f0-3a02-4694-a246-89313e5734e4 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:38.171762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b1b7f-ab00-444e-8036-4434fd88f9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:38.173031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b1b7f-ab00-444e-8036-4434fd88f9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:38.173201 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2040/4019] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:38 2022] GET /identity/v3/roles => generated 1891 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:38.173519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b1b7f-ab00-444e-8036-4434fd88f9af admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:38.174294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b1b7f-ab00-444e-8036-4434fd88f9af admin admin] PATH_INFO: `/v3/projects/28489f72346f422f9d44afcf5393acc4` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:38.174624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39c38a-6bb2-4da6-8c6d-64c17b92ee52 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:38.175652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b1b7f-ab00-444e-8036-4434fd88f9af admin admin] RBAC: Authorizing `identity:delete_project(project_id=28489f72346f422f9d44afcf5393acc4)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:38.178234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b1b7f-ab00-444e-8036-4434fd88f9af admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:38.197685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39c38a-6bb2-4da6-8c6d-64c17b92ee52 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:38.206673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71687ca7-d1da-41ae-97ca-af1a566b4e84 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:38.209211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71687ca7-d1da-41ae-97ca-af1a566b4e84 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:38.209585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71687ca7-d1da-41ae-97ca-af1a566b4e84 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:38.209974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71687ca7-d1da-41ae-97ca-af1a566b4e84 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects/9dd0728bae4d44d79118ba77119f638a/users/cdefb2514af44e9e96cd0e3f3df25be1/roles/36d518865f5e4c03afbac4bbbdf2bb0e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:38.233213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71687ca7-d1da-41ae-97ca-af1a566b4e84 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9dd0728bae4d44d79118ba77119f638a, user_id=cdefb2514af44e9e96cd0e3f3df25be1, role_id=36d518865f5e4c03afbac4bbbdf2bb0e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:38.236948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71687ca7-d1da-41ae-97ca-af1a566b4e84 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:38.328761 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2041/4020] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:38 2022] PUT /identity/v3/projects/9dd0728bae4d44d79118ba77119f638a/users/cdefb2514af44e9e96cd0e3f3df25be1/roles/36d518865f5e4c03afbac4bbbdf2bb0e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:38.340597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71687ca7-d1da-41ae-97ca-af1a566b4e84 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating service token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:20:38.366430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-501b1b7f-ab00-444e-8036-4434fd88f9af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28489f72346f422f9d44afcf5393acc4', 'request_id': 'req-501b1b7f-ab00-444e-8036-4434fd88f9af'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:38.380245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-501b1b7f-ab00-444e-8036-4434fd88f9af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28489f72346f422f9d44afcf5393acc4', 'request_id': 'req-501b1b7f-ab00-444e-8036-4434fd88f9af'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:38.391239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-501b1b7f-ab00-444e-8036-4434fd88f9af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28489f72346f422f9d44afcf5393acc4', 'request_id': 'req-501b1b7f-ab00-444e-8036-4434fd88f9af'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:38.443428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71687ca7-d1da-41ae-97ca-af1a566b4e84 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:38.459199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-501b1b7f-ab00-444e-8036-4434fd88f9af admin admin] The token cache is being invalidate because project 28489f72346f422f9d44afcf5393acc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:38.462075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-501b1b7f-ab00-444e-8036-4434fd88f9af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:38.462075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-501b1b7f-ab00-444e-8036-4434fd88f9af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:38.462389 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1980/4021] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:38 2022] DELETE /identity/v3/projects/28489f72346f422f9d44afcf5393acc4 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:38.463432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b1b7f-ab00-444e-8036-4434fd88f9af admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:38.465120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-501b1b7f-ab00-444e-8036-4434fd88f9af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:38.522823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71687ca7-d1da-41ae-97ca-af1a566b4e84 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:38.541621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b1b7f-ab00-444e-8036-4434fd88f9af admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:38.548088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85499308-5bf0-469c-9efc-13ae47ff2cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:38.548088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85499308-5bf0-469c-9efc-13ae47ff2cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:38.548088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85499308-5bf0-469c-9efc-13ae47ff2cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:38.548876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85499308-5bf0-469c-9efc-13ae47ff2cbb admin admin] PATH_INFO: `/v3/projects/76f5320a44c24b1086bffdd1e81833d1/users/b7d013d2f9834ce0a8884e6f93a95d13/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:38.550857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85499308-5bf0-469c-9efc-13ae47ff2cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f5320a44c24b1086bffdd1e81833d1, user_id=b7d013d2f9834ce0a8884e6f93a95d13, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:38.554096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85499308-5bf0-469c-9efc-13ae47ff2cbb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:38.567488 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1981/4022] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:38 2022] PUT /identity/v3/projects/76f5320a44c24b1086bffdd1e81833d1/users/b7d013d2f9834ce0a8884e6f93a95d13/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:38.568137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85499308-5bf0-469c-9efc-13ae47ff2cbb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:38.569830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-85499308-5bf0-469c-9efc-13ae47ff2cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:38.609567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc3902-1558-4349-8c65-ab11d14ecad1 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99d79db9d374453803e7715cc6a8599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7b8d5d113e44e8a8e8e024c8bde9c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:38.611300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc3902-1558-4349-8c65-ab11d14ecad1 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:38.611641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc3902-1558-4349-8c65-ab11d14ecad1 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:38.612137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc3902-1558-4349-8c65-ab11d14ecad1 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] PATH_INFO: `/v3/projects/c7b8d5d113e44e8a8e8e024c8bde9c1e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:38.613569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc3902-1558-4349-8c65-ab11d14ecad1 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] RBAC: Authorizing `identity:get_project(project_id=c7b8d5d113e44e8a8e8e024c8bde9c1e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:38.616888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc3902-1558-4349-8c65-ab11d14ecad1 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:38.620212 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2042/4023] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:20:38 2022] GET /identity/v3/projects/c7b8d5d113e44e8a8e8e024c8bde9c1e => generated 365 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:38.620503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc3902-1558-4349-8c65-ab11d14ecad1 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:38.625268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-85fc3902-1558-4349-8c65-ab11d14ecad1 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:38.670204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85499308-5bf0-469c-9efc-13ae47ff2cbb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:38.679491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc81494-bf1d-4ae7-b419-5e8d40a66a52 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:38.680646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc81494-bf1d-4ae7-b419-5e8d40a66a52 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:38.680988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc81494-bf1d-4ae7-b419-5e8d40a66a52 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:38.681317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc81494-bf1d-4ae7-b419-5e8d40a66a52 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects/9dd0728bae4d44d79118ba77119f638a/users/cdefb2514af44e9e96cd0e3f3df25be1/roles/6ec0394d296d436587d63b9335eddff0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:38.685027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc81494-bf1d-4ae7-b419-5e8d40a66a52 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9dd0728bae4d44d79118ba77119f638a, user_id=cdefb2514af44e9e96cd0e3f3df25be1, role_id=6ec0394d296d436587d63b9335eddff0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:38.689211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc81494-bf1d-4ae7-b419-5e8d40a66a52 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:38.707821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc3902-1558-4349-8c65-ab11d14ecad1 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:38.789266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887e058-327a-46e7-8222-2e9ee7cd29ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:38.791146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887e058-327a-46e7-8222-2e9ee7cd29ce service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:38.791299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887e058-327a-46e7-8222-2e9ee7cd29ce service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:38.791661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887e058-327a-46e7-8222-2e9ee7cd29ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:38.793604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5887e058-327a-46e7-8222-2e9ee7cd29ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:38.812928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887e058-327a-46e7-8222-2e9ee7cd29ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:38.822160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887e058-327a-46e7-8222-2e9ee7cd29ce service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:38.852782 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2043/4024] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:20:38.854438 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1982/4025] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:38 2022] PUT /identity/v3/projects/9dd0728bae4d44d79118ba77119f638a/users/cdefb2514af44e9e96cd0e3f3df25be1/roles/6ec0394d296d436587d63b9335eddff0 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:38.854785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c6663-95db-49e3-a4e1-9d1b9ad66d03 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:38.855099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c6663-95db-49e3-a4e1-9d1b9ad66d03 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:38.857635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed09d8-91a5-42cf-9faf-a9d77762567e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:38.857750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed09d8-91a5-42cf-9faf-a9d77762567e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:38.858009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed09d8-91a5-42cf-9faf-a9d77762567e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:38.859587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c6663-95db-49e3-a4e1-9d1b9ad66d03 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:38.861333 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1983/4026] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:20:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:20:38.874968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c6663-95db-49e3-a4e1-9d1b9ad66d03 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:38.896234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-faed09d8-91a5-42cf-9faf-a9d77762567e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:38.903324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-faed09d8-91a5-42cf-9faf-a9d77762567e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:38.997781 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2044/4027] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:38.999511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed09d8-91a5-42cf-9faf-a9d77762567e None None] Authenticating service token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:20:39.001634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-faed09d8-91a5-42cf-9faf-a9d77762567e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:39.048448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c6663-95db-49e3-a4e1-9d1b9ad66d03 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:39.072541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71d453-d970-4ca5-9449-fdd41986cf6b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:39.073237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71d453-d970-4ca5-9449-fdd41986cf6b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:39.073556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71d453-d970-4ca5-9449-fdd41986cf6b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:39.074380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71d453-d970-4ca5-9449-fdd41986cf6b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:39.075287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71d453-d970-4ca5-9449-fdd41986cf6b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:39.085576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71d453-d970-4ca5-9449-fdd41986cf6b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:39.179205 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1984/4028] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:38 2022] GET /identity/v3/users => generated 8059 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:39.180590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f60615-5c4e-47db-b1ea-a7aa6f098fc7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:39.180884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f60615-5c4e-47db-b1ea-a7aa6f098fc7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:39.181167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f60615-5c4e-47db-b1ea-a7aa6f098fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:39.181567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed09d8-91a5-42cf-9faf-a9d77762567e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:39.187463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-faed09d8-91a5-42cf-9faf-a9d77762567e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:39.210471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a8f60615-5c4e-47db-b1ea-a7aa6f098fc7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:39.212088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a8f60615-5c4e-47db-b1ea-a7aa6f098fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:39.223671 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1985/4029] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:39.225674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c326c-3ebc-4799-b8f0-3f783fbbdcf4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:39.226336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c326c-3ebc-4799-b8f0-3f783fbbdcf4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:39.226997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c326c-3ebc-4799-b8f0-3f783fbbdcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:39.305863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f44c326c-3ebc-4799-b8f0-3f783fbbdcf4 None None] MFA Rules not processed for user `cdefb2514af44e9e96cd0e3f3df25be1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:39.307424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f44c326c-3ebc-4799-b8f0-3f783fbbdcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:39.308442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed09d8-91a5-42cf-9faf-a9d77762567e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:39.313855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1135b-cb9b-45f2-8af5-9db917d8c11b tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99d79db9d374453803e7715cc6a8599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7b8d5d113e44e8a8e8e024c8bde9c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:39.318766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1135b-cb9b-45f2-8af5-9db917d8c11b tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:39.318766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1135b-cb9b-45f2-8af5-9db917d8c11b tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:39.318766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1135b-cb9b-45f2-8af5-9db917d8c11b tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] PATH_INFO: `/v3/projects/c7b8d5d113e44e8a8e8e024c8bde9c1e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:39.318766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1135b-cb9b-45f2-8af5-9db917d8c11b tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] RBAC: Authorizing `identity:get_project(project_id=c7b8d5d113e44e8a8e8e024c8bde9c1e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:39.319192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1135b-cb9b-45f2-8af5-9db917d8c11b tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:39.321105 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2045/4030] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:20:38 2022] GET /identity/v3/projects/c7b8d5d113e44e8a8e8e024c8bde9c1e => generated 365 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:39.321832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1135b-cb9b-45f2-8af5-9db917d8c11b tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:39.334525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1135b-cb9b-45f2-8af5-9db917d8c11b tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:39.340343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df5a16-3194-4737-8e1c-94973751474c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:39.341011 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df5a16-3194-4737-8e1c-94973751474c admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:39.341297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df5a16-3194-4737-8e1c-94973751474c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:39.341570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df5a16-3194-4737-8e1c-94973751474c admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:39.342294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df5a16-3194-4737-8e1c-94973751474c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:20:39.342607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df5a16-3194-4737-8e1c-94973751474c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:39.345261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df5a16-3194-4737-8e1c-94973751474c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:39.358623 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2046/4031] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:39.363068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df5a16-3194-4737-8e1c-94973751474c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:39.385247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df5a16-3194-4737-8e1c-94973751474c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:39.411850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02a534-aa81-43c2-909c-f0cf475c8926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:39.412828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02a534-aa81-43c2-909c-f0cf475c8926 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:39.413265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02a534-aa81-43c2-909c-f0cf475c8926 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:39.413694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02a534-aa81-43c2-909c-f0cf475c8926 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:39.414540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02a534-aa81-43c2-909c-f0cf475c8926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:39.419735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02a534-aa81-43c2-909c-f0cf475c8926 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:39.476026 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1986/4032] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:39 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:39.487335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8a62c-2314-4f6c-8954-b7d75ab8dd96 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:39.487635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8a62c-2314-4f6c-8954-b7d75ab8dd96 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:39.487915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8a62c-2314-4f6c-8954-b7d75ab8dd96 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:39.499391 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1987/4033] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:20:39 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:20:39.503054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d5361-a26a-48ad-b599-4aa7efee08ee None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:39.503054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d5361-a26a-48ad-b599-4aa7efee08ee None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:39.503299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d5361-a26a-48ad-b599-4aa7efee08ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:39.526386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9e6d5361-a26a-48ad-b599-4aa7efee08ee None None] MFA Rules not processed for user `cdefb2514af44e9e96cd0e3f3df25be1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:39.528021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9e6d5361-a26a-48ad-b599-4aa7efee08ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:39.529846 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2047/4034] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:20:39 2022] POST /identity/v3/projects => generated 367 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:39.535715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02a534-aa81-43c2-909c-f0cf475c8926 admin admin] Authenticating service token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:20:39.705396 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1988/4035] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:39 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:39.706286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d5361-a26a-48ad-b599-4aa7efee08ee None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:39.726265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02a534-aa81-43c2-909c-f0cf475c8926 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:39.834487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02a534-aa81-43c2-909c-f0cf475c8926 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:39.843428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d5361-a26a-48ad-b599-4aa7efee08ee None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:39.848956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d766da-b390-455c-b08c-3bf4eb0963d4 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99d79db9d374453803e7715cc6a8599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7b8d5d113e44e8a8e8e024c8bde9c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:39.850495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d766da-b390-455c-b08c-3bf4eb0963d4 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:39.850767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d766da-b390-455c-b08c-3bf4eb0963d4 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:39.851069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d766da-b390-455c-b08c-3bf4eb0963d4 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] PATH_INFO: `/v3/projects/c7b8d5d113e44e8a8e8e024c8bde9c1e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:39.853063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d766da-b390-455c-b08c-3bf4eb0963d4 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] RBAC: Authorizing `identity:get_project(project_id=c7b8d5d113e44e8a8e8e024c8bde9c1e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:39.854859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d766da-b390-455c-b08c-3bf4eb0963d4 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:39.857287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020badc3-17e5-458c-8f47-8fbc671283bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:39.858074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020badc3-17e5-458c-8f47-8fbc671283bc admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:39.858363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020badc3-17e5-458c-8f47-8fbc671283bc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:39.858639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020badc3-17e5-458c-8f47-8fbc671283bc admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:39.859789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020badc3-17e5-458c-8f47-8fbc671283bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:39.863797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020badc3-17e5-458c-8f47-8fbc671283bc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:39.868448 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2048/4036] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:20:39 2022] GET /identity/v3/projects/c7b8d5d113e44e8a8e8e024c8bde9c1e => generated 365 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:39.868448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d766da-b390-455c-b08c-3bf4eb0963d4 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:39.907536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d766da-b390-455c-b08c-3bf4eb0963d4 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:39.917503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ef4ca-1cc9-4b33-bcba-1f23148c0fff tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdefb2514af44e9e96cd0e3f3df25be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd0728bae4d44d79118ba77119f638a', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-565892386', 'tempest-DelegatedRole-173810331'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:39.919143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ef4ca-1cc9-4b33-bcba-1f23148c0fff tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:39.919617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ef4ca-1cc9-4b33-bcba-1f23148c0fff tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:39.920135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ef4ca-1cc9-4b33-bcba-1f23148c0fff tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:39.921343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ef4ca-1cc9-4b33-bcba-1f23148c0fff tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] RBAC: Authorizing `identity:create_trust()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:39.922994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ef4ca-1cc9-4b33-bcba-1f23148c0fff tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:39.992389 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1989/4037] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:39 2022] POST /identity/v3/users => generated 284 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:39.994053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbdfd9-abda-477d-a4f0-2b5bf4382498 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:39.994716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbdfd9-abda-477d-a4f0-2b5bf4382498 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:39.995252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbdfd9-abda-477d-a4f0-2b5bf4382498 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:40.003697 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1990/4038] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:20:39 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:20:40.014357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:40.023267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbdfd9-abda-477d-a4f0-2b5bf4382498 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:40.054127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbdfd9-abda-477d-a4f0-2b5bf4382498 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:40.063199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def102e-1fb6-4c67-a670-f992f3e10f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:40.064589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def102e-1fb6-4c67-a670-f992f3e10f12 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:40.064589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def102e-1fb6-4c67-a670-f992f3e10f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:40.064589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def102e-1fb6-4c67-a670-f992f3e10f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:40.065392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def102e-1fb6-4c67-a670-f992f3e10f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:40.076596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def102e-1fb6-4c67-a670-f992f3e10f12 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:40.097249 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1991/4039] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:40 2022] GET /identity/v3/roles => generated 1891 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:40.098485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def102e-1fb6-4c67-a670-f992f3e10f12 admin admin] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:20:40.101591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9def102e-1fb6-4c67-a670-f992f3e10f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:40.142239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def102e-1fb6-4c67-a670-f992f3e10f12 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:40.162570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def102e-1fb6-4c67-a670-f992f3e10f12 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:40.180376 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb70368-1e2d-4eba-8c6a-a798fdbc61e3 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99d79db9d374453803e7715cc6a8599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7b8d5d113e44e8a8e8e024c8bde9c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:40.181459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb70368-1e2d-4eba-8c6a-a798fdbc61e3 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:40.182141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb70368-1e2d-4eba-8c6a-a798fdbc61e3 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:40.183405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb70368-1e2d-4eba-8c6a-a798fdbc61e3 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] PATH_INFO: `/v3/projects/c7b8d5d113e44e8a8e8e024c8bde9c1e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:40.184768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb70368-1e2d-4eba-8c6a-a798fdbc61e3 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] RBAC: Authorizing `identity:get_project(project_id=c7b8d5d113e44e8a8e8e024c8bde9c1e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:40.186576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb70368-1e2d-4eba-8c6a-a798fdbc61e3 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:40.193485 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1992/4040] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:20:40 2022] GET /identity/v3/projects/c7b8d5d113e44e8a8e8e024c8bde9c1e => generated 365 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:40.193485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb70368-1e2d-4eba-8c6a-a798fdbc61e3 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:40.196546 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2049/4041] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Jul 16 21:20:39 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:40.201991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ef4ca-1cc9-4b33-bcba-1f23148c0fff tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:40.224319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb70368-1e2d-4eba-8c6a-a798fdbc61e3 tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:40.241194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ef4ca-1cc9-4b33-bcba-1f23148c0fff tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:40.241429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc44319-9dc0-497e-b9f4-65672896d0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:40.242709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc44319-9dc0-497e-b9f4-65672896d0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:40.242709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc44319-9dc0-497e-b9f4-65672896d0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:40.242952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc44319-9dc0-497e-b9f4-65672896d0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:40.243851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc44319-9dc0-497e-b9f4-65672896d0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:40.246050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc44319-9dc0-497e-b9f4-65672896d0a2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:40.251122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83170a9e-47c2-4346-992e-6e4bf4489012 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdefb2514af44e9e96cd0e3f3df25be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd0728bae4d44d79118ba77119f638a', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-565892386', 'tempest-DelegatedRole-173810331'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:40.253141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83170a9e-47c2-4346-992e-6e4bf4489012 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:40.254633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83170a9e-47c2-4346-992e-6e4bf4489012 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:40.254932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83170a9e-47c2-4346-992e-6e4bf4489012 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:40.257068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83170a9e-47c2-4346-992e-6e4bf4489012 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:40.258260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83170a9e-47c2-4346-992e-6e4bf4489012 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:40.263597 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1993/4042] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:40 2022] GET /identity/v3/roles => generated 1891 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:40.265144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdafd14-3444-4920-827b-3ba750d8bc42 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:40.265438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdafd14-3444-4920-827b-3ba750d8bc42 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:40.265989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdafd14-3444-4920-827b-3ba750d8bc42 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:40.267596 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1994/4043] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:20:40.268706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdafd14-3444-4920-827b-3ba750d8bc42 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:40.276450 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2050/4044] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Jul 16 21:20:40 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=cdefb2514af44e9e96cd0e3f3df25be1 => generated 611 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:40.276450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83170a9e-47c2-4346-992e-6e4bf4489012 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] Authenticating service token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:20:40.299068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdafd14-3444-4920-827b-3ba750d8bc42 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:40.307373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83170a9e-47c2-4346-992e-6e4bf4489012 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:40.317145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f735237-340c-4dba-bc74-6f9070a03023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:40.317145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f735237-340c-4dba-bc74-6f9070a03023 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:40.317145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f735237-340c-4dba-bc74-6f9070a03023 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:40.317145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f735237-340c-4dba-bc74-6f9070a03023 admin admin] PATH_INFO: `/v3/projects/6d406dc312cf40f48cdd3f43fe139520/users/00d2b2c30bc7415e90f6bb6830a1a09b/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:40.336811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83170a9e-47c2-4346-992e-6e4bf4489012 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:40.343536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19497b3-8a66-46f9-8450-00906368c6bb tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99d79db9d374453803e7715cc6a8599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7b8d5d113e44e8a8e8e024c8bde9c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:40.351303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19497b3-8a66-46f9-8450-00906368c6bb tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:40.351303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19497b3-8a66-46f9-8450-00906368c6bb tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:40.351303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19497b3-8a66-46f9-8450-00906368c6bb tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] PATH_INFO: `/v3/projects/c7b8d5d113e44e8a8e8e024c8bde9c1e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:40.351303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19497b3-8a66-46f9-8450-00906368c6bb tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] RBAC: Authorizing `identity:get_project(project_id=c7b8d5d113e44e8a8e8e024c8bde9c1e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:40.351303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19497b3-8a66-46f9-8450-00906368c6bb tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:40.353727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f735237-340c-4dba-bc74-6f9070a03023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d406dc312cf40f48cdd3f43fe139520, user_id=00d2b2c30bc7415e90f6bb6830a1a09b, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:40.362130 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2051/4045] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:20:40 2022] GET /identity/v3/projects/c7b8d5d113e44e8a8e8e024c8bde9c1e => generated 365 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:40.364206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19497b3-8a66-46f9-8450-00906368c6bb tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:40.370770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f735237-340c-4dba-bc74-6f9070a03023 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:40.396314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19497b3-8a66-46f9-8450-00906368c6bb tempest-QuotasTestJSON-1382213646 tempest-QuotasTestJSON-1382213646-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:40.401793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7055e72-e362-441a-9f5a-ac6367cb85f7 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdefb2514af44e9e96cd0e3f3df25be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd0728bae4d44d79118ba77119f638a', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-565892386', 'tempest-DelegatedRole-173810331'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:40.402918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7055e72-e362-441a-9f5a-ac6367cb85f7 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:40.403419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7055e72-e362-441a-9f5a-ac6367cb85f7 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:40.403814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7055e72-e362-441a-9f5a-ac6367cb85f7 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] PATH_INFO: `/v3/OS-TRUST/trusts/3c4f0a572f3743a583b3b3e26df33e99` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:40.416289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7055e72-e362-441a-9f5a-ac6367cb85f7 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] RBAC: Authorizing `identity:delete_trust(trust_id=3c4f0a572f3743a583b3b3e26df33e99)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:40.416289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7055e72-e362-441a-9f5a-ac6367cb85f7 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:40.498304 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1995/4046] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:40 2022] PUT /identity/v3/projects/6d406dc312cf40f48cdd3f43fe139520/users/00d2b2c30bc7415e90f6bb6830a1a09b/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:40.499379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f735237-340c-4dba-bc74-6f9070a03023 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:40.501427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0f735237-340c-4dba-bc74-6f9070a03023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:40.526308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f7055e72-e362-441a-9f5a-ac6367cb85f7 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '3c4f0a572f3743a583b3b3e26df33e99', 'request_id': 'req-f7055e72-e362-441a-9f5a-ac6367cb85f7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:40.526949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f7055e72-e362-441a-9f5a-ac6367cb85f7 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '3c4f0a572f3743a583b3b3e26df33e99', 'request_id': 'req-f7055e72-e362-441a-9f5a-ac6367cb85f7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:40.574189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:40.599277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f735237-340c-4dba-bc74-6f9070a03023 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:40.605667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a51d5-d74e-4db2-b48f-fc762da15405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:40.606678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a51d5-d74e-4db2-b48f-fc762da15405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:40.607100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a51d5-d74e-4db2-b48f-fc762da15405 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:40.607444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a51d5-d74e-4db2-b48f-fc762da15405 admin admin] PATH_INFO: `/v3/users/b99d79db9d374453803e7715cc6a8599` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:40.608760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a51d5-d74e-4db2-b48f-fc762da15405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b99d79db9d374453803e7715cc6a8599)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:40.610853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a51d5-d74e-4db2-b48f-fc762da15405 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:40.623705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f7055e72-e362-441a-9f5a-ac6367cb85f7 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '3c4f0a572f3743a583b3b3e26df33e99', 'request_id': 'req-f7055e72-e362-441a-9f5a-ac6367cb85f7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:40.634263 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2052/4047] 10.222.0.16 () {58 vars in 1253 bytes} [Sat Jul 16 21:20:40 2022] DELETE /identity/v3/OS-TRUST/trusts/3c4f0a572f3743a583b3b3e26df33e99 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:40.636244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2b5a6-a936-4e32-baf6-17ef17dc31f3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:40.636781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2b5a6-a936-4e32-baf6-17ef17dc31f3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:40.637429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2b5a6-a936-4e32-baf6-17ef17dc31f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:40.675168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b1b2b5a6-a936-4e32-baf6-17ef17dc31f3 None None] MFA Rules not processed for user `00d2b2c30bc7415e90f6bb6830a1a09b`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:40.677472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b1b2b5a6-a936-4e32-baf6-17ef17dc31f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:40.794597 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2053/4048] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:40.796197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2b5a6-a936-4e32-baf6-17ef17dc31f3 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:40.798257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b1b2b5a6-a936-4e32-baf6-17ef17dc31f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:40.869837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2c9a51d5-d74e-4db2-b48f-fc762da15405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b99d79db9d374453803e7715cc6a8599'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:40.886515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2c9a51d5-d74e-4db2-b48f-fc762da15405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b99d79db9d374453803e7715cc6a8599'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:40.911200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2b5a6-a936-4e32-baf6-17ef17dc31f3 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:40.915802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67a61f-17f8-45bc-b7a0-93beda706050 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdefb2514af44e9e96cd0e3f3df25be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dd0728bae4d44d79118ba77119f638a', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-565892386', 'tempest-DelegatedRole-173810331'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:40.916782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67a61f-17f8-45bc-b7a0-93beda706050 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:40.917254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67a61f-17f8-45bc-b7a0-93beda706050 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:40.917381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67a61f-17f8-45bc-b7a0-93beda706050 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] PATH_INFO: `/v3/OS-TRUST/trusts/3c4f0a572f3743a583b3b3e26df33e99` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:40.931539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-6f67a61f-17f8-45bc-b7a0-93beda706050 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] Could not find trust: 3c4f0a572f3743a583b3b3e26df33e99.: keystone.exception.TrustNotFound: Could not find trust: 3c4f0a572f3743a583b3b3e26df33e99. Jul 16 21:20:40.931539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:20:40.931539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:20:40.931539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:20:40.931539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:20:40.931539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:20:40.931539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:20:40.931539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:20:40.931539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:20:40.931539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:20:40.931539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:20:40.931539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:20:40.931539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 16 21:20:40.931539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 16 21:20:40.931539 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 16 21:20:40.932731 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 16 21:20:40.932731 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 16 21:20:40.932731 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 16 21:20:40.932731 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 16 21:20:40.932731 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 16 21:20:40.932731 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:20:40.932731 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:20:40.932731 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 16 21:20:40.932731 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 16 21:20:40.932731 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 16 21:20:40.932731 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 16 21:20:40.932731 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 3c4f0a572f3743a583b3b3e26df33e99. Jul 16 21:20:40.932731 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:20:40.937546 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2054/4049] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jul 16 21:20:40 2022] GET /identity/v3/OS-TRUST/trusts/3c4f0a572f3743a583b3b3e26df33e99 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:20:40.940969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67a61f-17f8-45bc-b7a0-93beda706050 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:40.940969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6f67a61f-17f8-45bc-b7a0-93beda706050 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:40.968209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67a61f-17f8-45bc-b7a0-93beda706050 tempest-TrustsV3TestJSON-1601647545 tempest-user-1331118057] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:40.974515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d60f3-1f85-4558-8f16-11b9d52bc8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:40.976680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d60f3-1f85-4558-8f16-11b9d52bc8e8 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:40.976972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d60f3-1f85-4558-8f16-11b9d52bc8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:40.977253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d60f3-1f85-4558-8f16-11b9d52bc8e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:40.978370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d60f3-1f85-4558-8f16-11b9d52bc8e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:40.981798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d60f3-1f85-4558-8f16-11b9d52bc8e8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:40.988703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2c9a51d5-d74e-4db2-b48f-fc762da15405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b99d79db9d374453803e7715cc6a8599'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:41.001166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2c9a51d5-d74e-4db2-b48f-fc762da15405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b99d79db9d374453803e7715cc6a8599'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:41.002175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2c9a51d5-d74e-4db2-b48f-fc762da15405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b99d79db9d374453803e7715cc6a8599'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:41.017172 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1996/4050] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:40 2022] DELETE /identity/v3/users/b99d79db9d374453803e7715cc6a8599 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:41.021333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a51d5-d74e-4db2-b48f-fc762da15405 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:41.023432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2c9a51d5-d74e-4db2-b48f-fc762da15405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:41.119154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a51d5-d74e-4db2-b48f-fc762da15405 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:41.124095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d27c87-fd86-4434-994c-6ad872df8903 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:41.125435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d27c87-fd86-4434-994c-6ad872df8903 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:41.125728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d27c87-fd86-4434-994c-6ad872df8903 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:41.126012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d27c87-fd86-4434-994c-6ad872df8903 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles/6ec0394d296d436587d63b9335eddff0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:41.127583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d27c87-fd86-4434-994c-6ad872df8903 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6ec0394d296d436587d63b9335eddff0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:41.129967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d27c87-fd86-4434-994c-6ad872df8903 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:41.154492 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2055/4051] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:20:40 2022] POST /identity/v3/projects => generated 369 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:41.154492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d95fcf-792d-4f92-9609-f31005983ad2 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:41.154492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d95fcf-792d-4f92-9609-f31005983ad2 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:41.154492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d95fcf-792d-4f92-9609-f31005983ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:41.184334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b1d95fcf-792d-4f92-9609-f31005983ad2 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:41.185694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b1d95fcf-792d-4f92-9609-f31005983ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:41.283309 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2056/4052] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:41.284260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d95fcf-792d-4f92-9609-f31005983ad2 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:41.290805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b1d95fcf-792d-4f92-9609-f31005983ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:41.306505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d95fcf-792d-4f92-9609-f31005983ad2 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:41.315809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c99ff-5c16-4253-a84b-ce7cf13bcc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:41.318494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c99ff-5c16-4253-a84b-ce7cf13bcc26 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:41.318769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c99ff-5c16-4253-a84b-ce7cf13bcc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:41.321105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c99ff-5c16-4253-a84b-ce7cf13bcc26 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:41.321377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c99ff-5c16-4253-a84b-ce7cf13bcc26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:41.323330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c99ff-5c16-4253-a84b-ce7cf13bcc26 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:41.390296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-01d27c87-fd86-4434-994c-6ad872df8903 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invalidating the token cache because role 6ec0394d296d436587d63b9335eddff0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:41.391913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-01d27c87-fd86-4434-994c-6ad872df8903 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:41.393903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-01d27c87-fd86-4434-994c-6ad872df8903 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:41.396605 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1997/4053] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:41 2022] DELETE /identity/v3/roles/6ec0394d296d436587d63b9335eddff0 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:41.401220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d27c87-fd86-4434-994c-6ad872df8903 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:41.402925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-01d27c87-fd86-4434-994c-6ad872df8903 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:41.416108 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2057/4054] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:41 2022] POST /identity/v3/users => generated 291 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:41.419286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c99ff-5c16-4253-a84b-ce7cf13bcc26 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:41.421309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ab3c99ff-5c16-4253-a84b-ce7cf13bcc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:41.514357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d27c87-fd86-4434-994c-6ad872df8903 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:41.518144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a541405-8a06-46e9-b678-62bde6173749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:41.518955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a541405-8a06-46e9-b678-62bde6173749 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:41.519865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a541405-8a06-46e9-b678-62bde6173749 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:41.520154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a541405-8a06-46e9-b678-62bde6173749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:41.522351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8a541405-8a06-46e9-b678-62bde6173749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:41.560509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c99ff-5c16-4253-a84b-ce7cf13bcc26 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:41.624915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a541405-8a06-46e9-b678-62bde6173749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:41.626712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a541405-8a06-46e9-b678-62bde6173749 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:41.637947 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1998/4055] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:20:41.639122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a541405-8a06-46e9-b678-62bde6173749 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:41.645375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8a541405-8a06-46e9-b678-62bde6173749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:41.665796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a541405-8a06-46e9-b678-62bde6173749 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:41.676681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a536d-d4c5-4a42-a9f3-8e00cf7ba8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:41.677444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a536d-d4c5-4a42-a9f3-8e00cf7ba8db admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:41.677730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a536d-d4c5-4a42-a9f3-8e00cf7ba8db admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:41.678003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a536d-d4c5-4a42-a9f3-8e00cf7ba8db admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:41.678817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a536d-d4c5-4a42-a9f3-8e00cf7ba8db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:41.684145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a536d-d4c5-4a42-a9f3-8e00cf7ba8db admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:41.712411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ce0bb-4b5a-42a2-bffa-fa2b184741d3 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:41.713483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ce0bb-4b5a-42a2-bffa-fa2b184741d3 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:41.713767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ce0bb-4b5a-42a2-bffa-fa2b184741d3 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:41.714499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ce0bb-4b5a-42a2-bffa-fa2b184741d3 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles/36d518865f5e4c03afbac4bbbdf2bb0e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:41.716487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ce0bb-4b5a-42a2-bffa-fa2b184741d3 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_role(role_id=36d518865f5e4c03afbac4bbbdf2bb0e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:41.718434 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-a86ce0bb-4b5a-42a2-bffa-fa2b184741d3 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:41.718434 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:20:41.718434 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:20:41.720395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ce0bb-4b5a-42a2-bffa-fa2b184741d3 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:41.721252 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 1999/4056] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:41 2022] GET /identity/v3/roles => generated 1654 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:41.725694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a536d-d4c5-4a42-a9f3-8e00cf7ba8db admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:41.742042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a536d-d4c5-4a42-a9f3-8e00cf7ba8db admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:41.748796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ac399-af57-423a-a342-80ca3f2ec0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:41.754172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ac399-af57-423a-a342-80ca3f2ec0b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:41.754172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ac399-af57-423a-a342-80ca3f2ec0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:41.754172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ac399-af57-423a-a342-80ca3f2ec0b1 admin admin] PATH_INFO: `/v3/projects/b769f87a3fe44032a966f766295c5465/users/dcaaa4fa1f8c498789224ecdc2ada38d/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:41.776614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ac399-af57-423a-a342-80ca3f2ec0b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b769f87a3fe44032a966f766295c5465, user_id=dcaaa4fa1f8c498789224ecdc2ada38d, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:41.779389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ac399-af57-423a-a342-80ca3f2ec0b1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:42.047957 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2000/4057] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:41 2022] PUT /identity/v3/projects/b769f87a3fe44032a966f766295c5465/users/dcaaa4fa1f8c498789224ecdc2ada38d/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:20:42.052146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ac399-af57-423a-a342-80ca3f2ec0b1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:42.064734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a86ce0bb-4b5a-42a2-bffa-fa2b184741d3 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invalidating the token cache because role 36d518865f5e4c03afbac4bbbdf2bb0e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:42.065269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a86ce0bb-4b5a-42a2-bffa-fa2b184741d3 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:42.066745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a86ce0bb-4b5a-42a2-bffa-fa2b184741d3 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:42.072569 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2058/4058] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:41 2022] DELETE /identity/v3/roles/36d518865f5e4c03afbac4bbbdf2bb0e => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:42.076638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ce0bb-4b5a-42a2-bffa-fa2b184741d3 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:42.078659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a86ce0bb-4b5a-42a2-bffa-fa2b184741d3 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:42.207486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ac399-af57-423a-a342-80ca3f2ec0b1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:42.250931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ce0bb-4b5a-42a2-bffa-fa2b184741d3 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:42.256947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad88f2-6df6-4ac1-8a5b-dd3f8cd391db tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:42.258402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad88f2-6df6-4ac1-8a5b-dd3f8cd391db tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:42.258715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad88f2-6df6-4ac1-8a5b-dd3f8cd391db tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:42.258999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad88f2-6df6-4ac1-8a5b-dd3f8cd391db tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/users/cdefb2514af44e9e96cd0e3f3df25be1` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:42.261066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad88f2-6df6-4ac1-8a5b-dd3f8cd391db tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cdefb2514af44e9e96cd0e3f3df25be1)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:42.263148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad88f2-6df6-4ac1-8a5b-dd3f8cd391db tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:42.326486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:42.337508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fc7af-3afd-453c-890c-86cedb9dbe29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:42.338435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fc7af-3afd-453c-890c-86cedb9dbe29 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:42.338900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fc7af-3afd-453c-890c-86cedb9dbe29 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:42.339360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fc7af-3afd-453c-890c-86cedb9dbe29 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:42.341127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50fc7af-3afd-453c-890c-86cedb9dbe29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:42.343195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50fc7af-3afd-453c-890c-86cedb9dbe29 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:42.361464 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2001/4059] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:20:42.362828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fc7af-3afd-453c-890c-86cedb9dbe29 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:42.365467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e50fc7af-3afd-453c-890c-86cedb9dbe29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:42.381689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fc7af-3afd-453c-890c-86cedb9dbe29 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:42.387103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f907b-da0a-4358-b69c-ff012cefe820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:42.388056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f907b-da0a-4358-b69c-ff012cefe820 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:42.388335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f907b-da0a-4358-b69c-ff012cefe820 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:42.388612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f907b-da0a-4358-b69c-ff012cefe820 admin admin] PATH_INFO: `/v3/projects/b769f87a3fe44032a966f766295c5465/users/dcaaa4fa1f8c498789224ecdc2ada38d/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:42.390618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f907b-da0a-4358-b69c-ff012cefe820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b769f87a3fe44032a966f766295c5465, user_id=dcaaa4fa1f8c498789224ecdc2ada38d, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:42.393633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f907b-da0a-4358-b69c-ff012cefe820 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:42.405087 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2002/4060] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:42 2022] PUT /identity/v3/projects/b769f87a3fe44032a966f766295c5465/users/dcaaa4fa1f8c498789224ecdc2ada38d/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:20:42.415910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80909e24-a0f2-472e-88f6-fb2ae4b7d25f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:42.416257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80909e24-a0f2-472e-88f6-fb2ae4b7d25f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:42.420025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80909e24-a0f2-472e-88f6-fb2ae4b7d25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:42.447122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0cad88f2-6df6-4ac1-8a5b-dd3f8cd391db tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdefb2514af44e9e96cd0e3f3df25be1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:42.475584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0cad88f2-6df6-4ac1-8a5b-dd3f8cd391db tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdefb2514af44e9e96cd0e3f3df25be1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:42.476528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-80909e24-a0f2-472e-88f6-fb2ae4b7d25f None None] MFA Rules not processed for user `dcaaa4fa1f8c498789224ecdc2ada38d`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:42.477855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-80909e24-a0f2-472e-88f6-fb2ae4b7d25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:42.539601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0cad88f2-6df6-4ac1-8a5b-dd3f8cd391db tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdefb2514af44e9e96cd0e3f3df25be1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:42.540750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0cad88f2-6df6-4ac1-8a5b-dd3f8cd391db tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdefb2514af44e9e96cd0e3f3df25be1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:42.572607 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2003/4061] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:42 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:20:42.572607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80909e24-a0f2-472e-88f6-fb2ae4b7d25f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:42.572607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-80909e24-a0f2-472e-88f6-fb2ae4b7d25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:42.584840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0cad88f2-6df6-4ac1-8a5b-dd3f8cd391db tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdefb2514af44e9e96cd0e3f3df25be1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:42.604996 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2059/4062] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:42 2022] DELETE /identity/v3/users/cdefb2514af44e9e96cd0e3f3df25be1 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:20:42.609746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad88f2-6df6-4ac1-8a5b-dd3f8cd391db tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:42.728842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad88f2-6df6-4ac1-8a5b-dd3f8cd391db tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:42.744570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44231fc1-4e83-4b6e-9761-b4d3b0e5461d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:42.745268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44231fc1-4e83-4b6e-9761-b4d3b0e5461d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:42.745610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44231fc1-4e83-4b6e-9761-b4d3b0e5461d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:42.745891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44231fc1-4e83-4b6e-9761-b4d3b0e5461d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:42.746831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44231fc1-4e83-4b6e-9761-b4d3b0e5461d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:42.752750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44231fc1-4e83-4b6e-9761-b4d3b0e5461d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:42.796768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:42.808275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80909e24-a0f2-472e-88f6-fb2ae4b7d25f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:42.877841 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2060/4063] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:20:42 2022] POST /identity/v3/domains => generated 276 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:42.884234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44231fc1-4e83-4b6e-9761-b4d3b0e5461d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:42.891107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-44231fc1-4e83-4b6e-9761-b4d3b0e5461d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:43.036102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd7aa2-fee6-40cb-8d72-3908c41a566e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:43.044273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd7aa2-fee6-40cb-8d72-3908c41a566e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:43.044273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd7aa2-fee6-40cb-8d72-3908c41a566e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:43.047539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd7aa2-fee6-40cb-8d72-3908c41a566e admin admin] PATH_INFO: `/v3/projects/c7b8d5d113e44e8a8e8e024c8bde9c1e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:43.048892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd7aa2-fee6-40cb-8d72-3908c41a566e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7b8d5d113e44e8a8e8e024c8bde9c1e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:43.052433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd7aa2-fee6-40cb-8d72-3908c41a566e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:43.127803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44231fc1-4e83-4b6e-9761-b4d3b0e5461d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:43.142225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57734e71-4d7d-4762-95ed-ce42a1eab82b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:43.143162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57734e71-4d7d-4762-95ed-ce42a1eab82b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:43.143450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57734e71-4d7d-4762-95ed-ce42a1eab82b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:43.143732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57734e71-4d7d-4762-95ed-ce42a1eab82b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects/9dd0728bae4d44d79118ba77119f638a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:43.145297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57734e71-4d7d-4762-95ed-ce42a1eab82b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9dd0728bae4d44d79118ba77119f638a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:43.147656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57734e71-4d7d-4762-95ed-ce42a1eab82b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:43.219606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-89fd7aa2-fee6-40cb-8d72-3908c41a566e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7b8d5d113e44e8a8e8e024c8bde9c1e', 'request_id': 'req-89fd7aa2-fee6-40cb-8d72-3908c41a566e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:43.230328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-89fd7aa2-fee6-40cb-8d72-3908c41a566e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7b8d5d113e44e8a8e8e024c8bde9c1e', 'request_id': 'req-89fd7aa2-fee6-40cb-8d72-3908c41a566e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:43.244925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-89fd7aa2-fee6-40cb-8d72-3908c41a566e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7b8d5d113e44e8a8e8e024c8bde9c1e', 'request_id': 'req-89fd7aa2-fee6-40cb-8d72-3908c41a566e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:43.367893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-89fd7aa2-fee6-40cb-8d72-3908c41a566e admin admin] The token cache is being invalidate because project c7b8d5d113e44e8a8e8e024c8bde9c1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:43.368895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-89fd7aa2-fee6-40cb-8d72-3908c41a566e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:43.369777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-89fd7aa2-fee6-40cb-8d72-3908c41a566e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:43.385087 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2004/4064] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:42 2022] DELETE /identity/v3/projects/c7b8d5d113e44e8a8e8e024c8bde9c1e => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:43.385087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd7aa2-fee6-40cb-8d72-3908c41a566e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:43.385087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-89fd7aa2-fee6-40cb-8d72-3908c41a566e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:43.440012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-57734e71-4d7d-4762-95ed-ce42a1eab82b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd0728bae4d44d79118ba77119f638a', 'request_id': 'req-57734e71-4d7d-4762-95ed-ce42a1eab82b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:43.453207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-57734e71-4d7d-4762-95ed-ce42a1eab82b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd0728bae4d44d79118ba77119f638a', 'request_id': 'req-57734e71-4d7d-4762-95ed-ce42a1eab82b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:43.468762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-57734e71-4d7d-4762-95ed-ce42a1eab82b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd0728bae4d44d79118ba77119f638a', 'request_id': 'req-57734e71-4d7d-4762-95ed-ce42a1eab82b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:43.516526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd7aa2-fee6-40cb-8d72-3908c41a566e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:43.590913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fe17b-e9b9-41ea-909e-c165627dd52d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:43.591681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fe17b-e9b9-41ea-909e-c165627dd52d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:43.592025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fe17b-e9b9-41ea-909e-c165627dd52d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:43.592307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fe17b-e9b9-41ea-909e-c165627dd52d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:43.593306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9fe17b-e9b9-41ea-909e-c165627dd52d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:43.594508 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-7a9fe17b-e9b9-41ea-909e-c165627dd52d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:43.594508 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:20:43.594508 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:20:43.596170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9fe17b-e9b9-41ea-909e-c165627dd52d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:43.599650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-57734e71-4d7d-4762-95ed-ce42a1eab82b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] The token cache is being invalidate because project 9dd0728bae4d44d79118ba77119f638a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:43.600110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-57734e71-4d7d-4762-95ed-ce42a1eab82b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:43.601358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-57734e71-4d7d-4762-95ed-ce42a1eab82b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:43.608141 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2061/4065] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:42 2022] DELETE /identity/v3/projects/9dd0728bae4d44d79118ba77119f638a => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:43.610637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98236d-248b-444f-89d3-c958fa8ea34b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:43.618172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98236d-248b-444f-89d3-c958fa8ea34b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:43.618535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98236d-248b-444f-89d3-c958fa8ea34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:43.651295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-aa98236d-248b-444f-89d3-c958fa8ea34b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:43.652501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-aa98236d-248b-444f-89d3-c958fa8ea34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:43.727104 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2005/4066] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jul 16 21:20:43 2022] POST /identity/v3/groups => generated 281 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:43.728025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fe17b-e9b9-41ea-909e-c165627dd52d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:43.732941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7a9fe17b-e9b9-41ea-909e-c165627dd52d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:43.784540 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2062/4067] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:43.788182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98236d-248b-444f-89d3-c958fa8ea34b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:43.795664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-aa98236d-248b-444f-89d3-c958fa8ea34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:43.815302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98236d-248b-444f-89d3-c958fa8ea34b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:43.833738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7846d-62ee-4dbe-911d-d1eaeb276d73 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:43.834971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7846d-62ee-4dbe-911d-d1eaeb276d73 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:43.835577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7846d-62ee-4dbe-911d-d1eaeb276d73 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:43.835858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7846d-62ee-4dbe-911d-d1eaeb276d73 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/35334f3d5078490988cb5a75d4d905bd` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:43.844976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7846d-62ee-4dbe-911d-d1eaeb276d73 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:update_group(group_id=35334f3d5078490988cb5a75d4d905bd)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:43.846156 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-3ad7846d-62ee-4dbe-911d-d1eaeb276d73 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:43.846156 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:20:43.846156 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:20:43.847967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7846d-62ee-4dbe-911d-d1eaeb276d73 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:43.866004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fe17b-e9b9-41ea-909e-c165627dd52d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:43.880511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d5e31-84af-4bfa-8d32-2a27a7060988 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:43.881924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d5e31-84af-4bfa-8d32-2a27a7060988 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:43.882267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d5e31-84af-4bfa-8d32-2a27a7060988 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:43.882549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d5e31-84af-4bfa-8d32-2a27a7060988 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:43.883475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d5e31-84af-4bfa-8d32-2a27a7060988 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:43.885496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d5e31-84af-4bfa-8d32-2a27a7060988 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:43.952323 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2063/4068] 10.222.0.16 () {60 vars in 1246 bytes} [Sat Jul 16 21:20:43 2022] PATCH /identity/v3/groups/35334f3d5078490988cb5a75d4d905bd => generated 292 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:43.954652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ca8b0-2ebf-4459-b9b3-08fe6c028ac5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:43.955208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ca8b0-2ebf-4459-b9b3-08fe6c028ac5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:43.955606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ca8b0-2ebf-4459-b9b3-08fe6c028ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:43.983446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-703ca8b0-2ebf-4459-b9b3-08fe6c028ac5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:43.984682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-703ca8b0-2ebf-4459-b9b3-08fe6c028ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:43.995568 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2064/4069] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:43.996516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ca8b0-2ebf-4459-b9b3-08fe6c028ac5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:44.019723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ca8b0-2ebf-4459-b9b3-08fe6c028ac5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:44.027294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5cf91f-32a6-4e31-b929-511a8eb06920 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:44.033261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cf91f-32a6-4e31-b929-511a8eb06920 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:44.033261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cf91f-32a6-4e31-b929-511a8eb06920 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:44.033261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cf91f-32a6-4e31-b929-511a8eb06920 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/35334f3d5078490988cb5a75d4d905bd` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:44.038177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5cf91f-32a6-4e31-b929-511a8eb06920 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:get_group(group_id=35334f3d5078490988cb5a75d4d905bd)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:44.040113 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-9f5cf91f-32a6-4e31-b929-511a8eb06920 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:44.040113 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:20:44.040113 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:20:44.041892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5cf91f-32a6-4e31-b929-511a8eb06920 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:44.045326 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2065/4070] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:43 2022] GET /identity/v3/groups/35334f3d5078490988cb5a75d4d905bd => generated 292 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:44.046556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5cf91f-32a6-4e31-b929-511a8eb06920 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:44.061752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5cf91f-32a6-4e31-b929-511a8eb06920 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:44.062511 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2006/4071] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Jul 16 21:20:43 2022] POST /identity/v3/projects => generated 329 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:44.063462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d5e31-84af-4bfa-8d32-2a27a7060988 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:44.148229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29a818-7966-40dd-9f03-ac5c5f65deeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:44.149009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29a818-7966-40dd-9f03-ac5c5f65deeb admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:44.150123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29a818-7966-40dd-9f03-ac5c5f65deeb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:44.150123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29a818-7966-40dd-9f03-ac5c5f65deeb admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:44.153291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29a818-7966-40dd-9f03-ac5c5f65deeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:20:44.159188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29a818-7966-40dd-9f03-ac5c5f65deeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:44.159188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29a818-7966-40dd-9f03-ac5c5f65deeb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:44.182806 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2066/4072] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:44.189763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29a818-7966-40dd-9f03-ac5c5f65deeb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:44.205009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:44.211260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d5e31-84af-4bfa-8d32-2a27a7060988 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:44.222744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330d2d7-29b5-4922-856d-a5fe04b6dc8b tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:44.225737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330d2d7-29b5-4922-856d-a5fe04b6dc8b tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:44.225737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330d2d7-29b5-4922-856d-a5fe04b6dc8b tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:44.225737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330d2d7-29b5-4922-856d-a5fe04b6dc8b tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/35334f3d5078490988cb5a75d4d905bd` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:44.227141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330d2d7-29b5-4922-856d-a5fe04b6dc8b tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:update_group(group_id=35334f3d5078490988cb5a75d4d905bd)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:44.228192 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-d330d2d7-29b5-4922-856d-a5fe04b6dc8b tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:44.228192 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:20:44.228192 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:20:44.229676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330d2d7-29b5-4922-856d-a5fe04b6dc8b tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:44.336817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29a818-7966-40dd-9f03-ac5c5f65deeb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:44.346777 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2007/4073] 10.222.0.16 () {60 vars in 1245 bytes} [Sat Jul 16 21:20:44 2022] PATCH /identity/v3/groups/35334f3d5078490988cb5a75d4d905bd => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:44.346777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330d2d7-29b5-4922-856d-a5fe04b6dc8b tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:44.351889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8114b-6b43-47f6-bef0-5b69ff5b5e45 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:44.352730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8114b-6b43-47f6-bef0-5b69ff5b5e45 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:44.353039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8114b-6b43-47f6-bef0-5b69ff5b5e45 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:44.358425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8114b-6b43-47f6-bef0-5b69ff5b5e45 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:44.359323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8114b-6b43-47f6-bef0-5b69ff5b5e45 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:44.361378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8114b-6b43-47f6-bef0-5b69ff5b5e45 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:44.373392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330d2d7-29b5-4922-856d-a5fe04b6dc8b tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:44.386531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d1361-4ab0-4d96-8b88-768c30bb51bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:44.387682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d1361-4ab0-4d96-8b88-768c30bb51bf admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:44.387980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d1361-4ab0-4d96-8b88-768c30bb51bf admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:44.388259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d1361-4ab0-4d96-8b88-768c30bb51bf admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:44.388964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d1361-4ab0-4d96-8b88-768c30bb51bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:44.391920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d1361-4ab0-4d96-8b88-768c30bb51bf admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:44.519799 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2067/4074] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:44 2022] POST /identity/v3/users => generated 413 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:44.524635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8114b-6b43-47f6-bef0-5b69ff5b5e45 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:44.543422 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2008/4075] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:20:44 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:44.544980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d1361-4ab0-4d96-8b88-768c30bb51bf admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:44.546965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8114b-6b43-47f6-bef0-5b69ff5b5e45 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:44.594180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:44.732006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d1361-4ab0-4d96-8b88-768c30bb51bf admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:44.736024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589de84-4f9f-4caa-8e0e-eaf1231007b1 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:44.742705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589de84-4f9f-4caa-8e0e-eaf1231007b1 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:44.742705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589de84-4f9f-4caa-8e0e-eaf1231007b1 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:44.742705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589de84-4f9f-4caa-8e0e-eaf1231007b1 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/35334f3d5078490988cb5a75d4d905bd` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:44.748930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589de84-4f9f-4caa-8e0e-eaf1231007b1 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:delete_group(group_id=35334f3d5078490988cb5a75d4d905bd)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:44.750638 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-6589de84-4f9f-4caa-8e0e-eaf1231007b1 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:44.750638 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:20:44.750638 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:20:44.751947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15384af9-66f5-4676-80c4-55683ad4b4e8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:44.752675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15384af9-66f5-4676-80c4-55683ad4b4e8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:44.753002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15384af9-66f5-4676-80c4-55683ad4b4e8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:44.753287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15384af9-66f5-4676-80c4-55683ad4b4e8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:44.756981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589de84-4f9f-4caa-8e0e-eaf1231007b1 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:44.764814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15384af9-66f5-4676-80c4-55683ad4b4e8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:44.767532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15384af9-66f5-4676-80c4-55683ad4b4e8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:44.897489 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2009/4076] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:20:44 2022] POST /identity/v3/roles => generated 244 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:44.903183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15384af9-66f5-4676-80c4-55683ad4b4e8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:44.938451 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2068/4077] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Jul 16 21:20:44 2022] DELETE /identity/v3/groups/35334f3d5078490988cb5a75d4d905bd => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:44.939367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589de84-4f9f-4caa-8e0e-eaf1231007b1 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:45.062471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15384af9-66f5-4676-80c4-55683ad4b4e8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:45.107101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589de84-4f9f-4caa-8e0e-eaf1231007b1 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:45.118559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c784c04-b94a-46c8-93e3-212be2c903a1 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:45.119284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c784c04-b94a-46c8-93e3-212be2c903a1 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:45.119568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c784c04-b94a-46c8-93e3-212be2c903a1 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:45.119845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c784c04-b94a-46c8-93e3-212be2c903a1 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:45.120596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c784c04-b94a-46c8-93e3-212be2c903a1 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:45.125648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c784c04-b94a-46c8-93e3-212be2c903a1 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:45.169245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405de24c-03d0-4f2e-847b-009f9edfa558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:45.169957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405de24c-03d0-4f2e-847b-009f9edfa558 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:45.170238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405de24c-03d0-4f2e-847b-009f9edfa558 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:45.170596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405de24c-03d0-4f2e-847b-009f9edfa558 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:45.171425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405de24c-03d0-4f2e-847b-009f9edfa558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:45.173414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405de24c-03d0-4f2e-847b-009f9edfa558 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:45.241623 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2069/4078] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:20:44 2022] POST /identity/v3/roles => generated 247 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:45.242478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c784c04-b94a-46c8-93e3-212be2c903a1 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:45.315086 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2010/4079] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:44 2022] POST /identity/v3/users => generated 289 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:45.317494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405de24c-03d0-4f2e-847b-009f9edfa558 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:45.337922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405de24c-03d0-4f2e-847b-009f9edfa558 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:45.343920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737fe72-30a3-4791-9a14-62259101bbf4 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:45.345332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737fe72-30a3-4791-9a14-62259101bbf4 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:45.345774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737fe72-30a3-4791-9a14-62259101bbf4 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:45.346207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737fe72-30a3-4791-9a14-62259101bbf4 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects/e101d17b4a1444129e9485147eb70d81/users/7e3efe1b27554e1b84379410a9ae165d/roles/32be1e1fe0b447f28e59957b97884172` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:45.350435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c784c04-b94a-46c8-93e3-212be2c903a1 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:45.361670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94337f26-f315-4917-aa0c-abdd76fd06e9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:45.362533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94337f26-f315-4917-aa0c-abdd76fd06e9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:45.363588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94337f26-f315-4917-aa0c-abdd76fd06e9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:45.364629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94337f26-f315-4917-aa0c-abdd76fd06e9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:45.365547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94337f26-f315-4917-aa0c-abdd76fd06e9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:45.372140 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-94337f26-f315-4917-aa0c-abdd76fd06e9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:45.372140 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:20:45.372140 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:20:45.372567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737fe72-30a3-4791-9a14-62259101bbf4 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e101d17b4a1444129e9485147eb70d81, user_id=7e3efe1b27554e1b84379410a9ae165d, role_id=32be1e1fe0b447f28e59957b97884172)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:45.373957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94337f26-f315-4917-aa0c-abdd76fd06e9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:45.376413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737fe72-30a3-4791-9a14-62259101bbf4 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:45.482881 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2070/4080] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jul 16 21:20:45 2022] POST /identity/v3/groups => generated 325 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:45.483856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94337f26-f315-4917-aa0c-abdd76fd06e9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:45.500062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94337f26-f315-4917-aa0c-abdd76fd06e9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:45.506172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c968dc-58da-44f7-aafc-de37ee7defcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:45.507069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c968dc-58da-44f7-aafc-de37ee7defcb admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:45.507462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c968dc-58da-44f7-aafc-de37ee7defcb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:45.507843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c968dc-58da-44f7-aafc-de37ee7defcb admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:45.508727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c968dc-58da-44f7-aafc-de37ee7defcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:45.510524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c968dc-58da-44f7-aafc-de37ee7defcb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:45.527198 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2071/4081] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:45 2022] GET /identity/v3/roles => generated 1893 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:45.527198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c968dc-58da-44f7-aafc-de37ee7defcb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:45.541747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c968dc-58da-44f7-aafc-de37ee7defcb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:45.551633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5abce-e821-4824-8f94-8d25ac88ec8d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:45.552452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5abce-e821-4824-8f94-8d25ac88ec8d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:45.552858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5abce-e821-4824-8f94-8d25ac88ec8d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:45.553252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5abce-e821-4824-8f94-8d25ac88ec8d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:45.554045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5abce-e821-4824-8f94-8d25ac88ec8d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:45.556083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5abce-e821-4824-8f94-8d25ac88ec8d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:45.620699 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2011/4082] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:45 2022] PUT /identity/v3/projects/e101d17b4a1444129e9485147eb70d81/users/7e3efe1b27554e1b84379410a9ae165d/roles/32be1e1fe0b447f28e59957b97884172 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:45.621299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737fe72-30a3-4791-9a14-62259101bbf4 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:45.687681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737fe72-30a3-4791-9a14-62259101bbf4 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:45.691717 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2072/4083] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:45 2022] POST /identity/v3/users => generated 319 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:45.693040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5abce-e821-4824-8f94-8d25ac88ec8d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:45.693452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ba66a-f896-4d72-90a1-711fd65aa97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:45.694242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ba66a-f896-4d72-90a1-711fd65aa97c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:45.694597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ba66a-f896-4d72-90a1-711fd65aa97c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:45.694975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ba66a-f896-4d72-90a1-711fd65aa97c admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:45.696407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ba66a-f896-4d72-90a1-711fd65aa97c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:45.697689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ba66a-f896-4d72-90a1-711fd65aa97c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:45.705095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5abce-e821-4824-8f94-8d25ac88ec8d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:45.710408 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2012/4084] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:45 2022] GET /identity/v3/roles => generated 1893 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:45.711707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ba66a-f896-4d72-90a1-711fd65aa97c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:45.788039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f40af-6290-4890-8a27-4a2bfcb6a459 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:45.788943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f40af-6290-4890-8a27-4a2bfcb6a459 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:45.789226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f40af-6290-4890-8a27-4a2bfcb6a459 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:45.789501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f40af-6290-4890-8a27-4a2bfcb6a459 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects/e101d17b4a1444129e9485147eb70d81/users/7e3efe1b27554e1b84379410a9ae165d/roles/49f5b4ed4d3a4d30aada9c5d0a8bfbd9` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:45.792123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f40af-6290-4890-8a27-4a2bfcb6a459 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e101d17b4a1444129e9485147eb70d81, user_id=7e3efe1b27554e1b84379410a9ae165d, role_id=49f5b4ed4d3a4d30aada9c5d0a8bfbd9)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:45.792480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ba66a-f896-4d72-90a1-711fd65aa97c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:45.794959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f40af-6290-4890-8a27-4a2bfcb6a459 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:45.799259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feddefb-1e0d-456e-93fe-30c3e911ae11 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:45.800166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feddefb-1e0d-456e-93fe-30c3e911ae11 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:45.801233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feddefb-1e0d-456e-93fe-30c3e911ae11 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:45.801518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feddefb-1e0d-456e-93fe-30c3e911ae11 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/fdd40520537b446aa9c960a4f64df01c/users/8356279b69994daba7d7abaa41a0fccc` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:45.820054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feddefb-1e0d-456e-93fe-30c3e911ae11 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=fdd40520537b446aa9c960a4f64df01c, user_id=8356279b69994daba7d7abaa41a0fccc)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:45.822028 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-7feddefb-1e0d-456e-93fe-30c3e911ae11 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:45.822028 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:20:45.822028 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:20:45.823669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feddefb-1e0d-456e-93fe-30c3e911ae11 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:45.874277 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2073/4085] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:45 2022] PUT /identity/v3/projects/e101d17b4a1444129e9485147eb70d81/users/7e3efe1b27554e1b84379410a9ae165d/roles/49f5b4ed4d3a4d30aada9c5d0a8bfbd9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:45.875474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f40af-6290-4890-8a27-4a2bfcb6a459 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:45.955638 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2013/4086] 10.222.0.16 () {60 vars in 1359 bytes} [Sat Jul 16 21:20:45 2022] PUT /identity/v3/groups/fdd40520537b446aa9c960a4f64df01c/users/8356279b69994daba7d7abaa41a0fccc => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:45.956377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feddefb-1e0d-456e-93fe-30c3e911ae11 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:46.000088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f40af-6290-4890-8a27-4a2bfcb6a459 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:46.123721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feddefb-1e0d-456e-93fe-30c3e911ae11 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:46.130656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb9990-3057-4f92-aab8-4bc07cf07ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:46.131593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb9990-3057-4f92-aab8-4bc07cf07ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:46.131874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb9990-3057-4f92-aab8-4bc07cf07ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:46.132061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31eea6-b6bd-4f60-a95c-8eb14fe3cc68 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:46.132222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb9990-3057-4f92-aab8-4bc07cf07ed2 admin admin] PATH_INFO: `/v3/projects/22ca92a86e6c40d59071e58ce4085568/users/bba77f6ef42547f1aa8480e27868bd4a/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:46.133345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31eea6-b6bd-4f60-a95c-8eb14fe3cc68 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:46.133798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31eea6-b6bd-4f60-a95c-8eb14fe3cc68 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:46.134610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31eea6-b6bd-4f60-a95c-8eb14fe3cc68 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:46.136560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31eea6-b6bd-4f60-a95c-8eb14fe3cc68 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:46.139512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31eea6-b6bd-4f60-a95c-8eb14fe3cc68 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:46.154961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb9990-3057-4f92-aab8-4bc07cf07ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ca92a86e6c40d59071e58ce4085568, user_id=bba77f6ef42547f1aa8480e27868bd4a, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:46.159376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb9990-3057-4f92-aab8-4bc07cf07ed2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:46.218404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:46.276792 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2074/4087] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:45 2022] PUT /identity/v3/projects/22ca92a86e6c40d59071e58ce4085568/users/bba77f6ef42547f1aa8480e27868bd4a/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:46.278988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb9990-3057-4f92-aab8-4bc07cf07ed2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:46.474479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb9990-3057-4f92-aab8-4bc07cf07ed2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:46.480408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c9eb3-df56-4279-8620-685d9b8e8636 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:46.481340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c9eb3-df56-4279-8620-685d9b8e8636 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:46.481629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c9eb3-df56-4279-8620-685d9b8e8636 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:46.482280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c9eb3-df56-4279-8620-685d9b8e8636 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:46.482394 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2014/4088] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:45 2022] GET /identity/v3/users => generated 8929 bytes in 526 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:46.484416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d473567-5bb1-4615-90b1-87eaf689d5ee None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:46.484974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d473567-5bb1-4615-90b1-87eaf689d5ee None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:46.485632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d473567-5bb1-4615-90b1-87eaf689d5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:46.489268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c9eb3-df56-4279-8620-685d9b8e8636 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:46.492928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c9eb3-df56-4279-8620-685d9b8e8636 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:46.513033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1d473567-5bb1-4615-90b1-87eaf689d5ee None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:46.515143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1d473567-5bb1-4615-90b1-87eaf689d5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:46.628073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:46.633235 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2075/4089] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:46 2022] POST /identity/v3/users => generated 321 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:46.635040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784d29e-b369-4e90-83d4-2692dcd8d2ca None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:46.635866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784d29e-b369-4e90-83d4-2692dcd8d2ca None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:46.635866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784d29e-b369-4e90-83d4-2692dcd8d2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:46.670133 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2015/4090] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:46.671599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d473567-5bb1-4615-90b1-87eaf689d5ee None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:46.684309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d473567-5bb1-4615-90b1-87eaf689d5ee None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:46.689884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf12f68-6898-4000-ae6a-ad79c60274f1 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:46.691720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf12f68-6898-4000-ae6a-ad79c60274f1 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:46.692031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf12f68-6898-4000-ae6a-ad79c60274f1 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:46.692313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf12f68-6898-4000-ae6a-ad79c60274f1 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/fdd40520537b446aa9c960a4f64df01c/users/275694c5871349e9b1d8798ec55b6970` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:46.731735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf12f68-6898-4000-ae6a-ad79c60274f1 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=fdd40520537b446aa9c960a4f64df01c, user_id=275694c5871349e9b1d8798ec55b6970)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:46.734579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf12f68-6898-4000-ae6a-ad79c60274f1 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:46.948142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6784d29e-b369-4e90-83d4-2692dcd8d2ca None None] MFA Rules not processed for user `7e3efe1b27554e1b84379410a9ae165d`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:46.949995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6784d29e-b369-4e90-83d4-2692dcd8d2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:46.970151 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2016/4091] 10.222.0.16 () {60 vars in 1359 bytes} [Sat Jul 16 21:20:46 2022] PUT /identity/v3/groups/fdd40520537b446aa9c960a4f64df01c/users/275694c5871349e9b1d8798ec55b6970 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:46.971413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf12f68-6898-4000-ae6a-ad79c60274f1 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:46.975792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-adf12f68-6898-4000-ae6a-ad79c60274f1 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:47.088858 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2076/4092] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:47.089088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784d29e-b369-4e90-83d4-2692dcd8d2ca None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:47.125476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf12f68-6898-4000-ae6a-ad79c60274f1 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:47.131926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ccc79-fb08-435e-b0ca-9c5d36404b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:47.132603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ccc79-fb08-435e-b0ca-9c5d36404b3e service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:47.132888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ccc79-fb08-435e-b0ca-9c5d36404b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:47.133164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ccc79-fb08-435e-b0ca-9c5d36404b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:47.248197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784d29e-b369-4e90-83d4-2692dcd8d2ca None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:47.258697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e32f3a-0487-4611-b63c-378f37ecd524 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:47.259188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e32f3a-0487-4611-b63c-378f37ecd524 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:47.259809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e32f3a-0487-4611-b63c-378f37ecd524 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:47.260184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e32f3a-0487-4611-b63c-378f37ecd524 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:47.260982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e32f3a-0487-4611-b63c-378f37ecd524 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:47.263163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e32f3a-0487-4611-b63c-378f37ecd524 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:47.287732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ccc79-fb08-435e-b0ca-9c5d36404b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:47.292807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ccc79-fb08-435e-b0ca-9c5d36404b3e service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:47.309620 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2017/4093] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:20:47.310928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37812b24-f94a-4847-bb99-4cb15fc3399f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:47.311667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37812b24-f94a-4847-bb99-4cb15fc3399f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:47.311667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37812b24-f94a-4847-bb99-4cb15fc3399f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:47.334390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-37812b24-f94a-4847-bb99-4cb15fc3399f None None] MFA Rules not processed for user `7e3efe1b27554e1b84379410a9ae165d`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:47.335833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-37812b24-f94a-4847-bb99-4cb15fc3399f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:47.349460 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2018/4094] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:47.350359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37812b24-f94a-4847-bb99-4cb15fc3399f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:47.360383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37812b24-f94a-4847-bb99-4cb15fc3399f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:47.366143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405acde1-b243-4d59-b205-591790835e75 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e3efe1b27554e1b84379410a9ae165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e101d17b4a1444129e9485147eb70d81', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1350481662', 'tempest-DelegatedRole-1856416853'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:47.366818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405acde1-b243-4d59-b205-591790835e75 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:47.367190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405acde1-b243-4d59-b205-591790835e75 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:47.367965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405acde1-b243-4d59-b205-591790835e75 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:47.368726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405acde1-b243-4d59-b205-591790835e75 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: Authorizing `identity:create_trust()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:47.370374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405acde1-b243-4d59-b205-591790835e75 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:47.418686 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2077/4095] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:47 2022] POST /identity/v3/users => generated 323 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:47.420690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e32f3a-0487-4611-b63c-378f37ecd524 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:47.441554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e32f3a-0487-4611-b63c-378f37ecd524 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:47.454127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b51af-eb4b-4e98-8184-c24c4efd5ee0 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:47.456289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b51af-eb4b-4e98-8184-c24c4efd5ee0 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:47.457569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b51af-eb4b-4e98-8184-c24c4efd5ee0 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:47.458050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b51af-eb4b-4e98-8184-c24c4efd5ee0 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/fdd40520537b446aa9c960a4f64df01c/users/5876b92f274647ebbf87732f914114fd` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:47.477298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b51af-eb4b-4e98-8184-c24c4efd5ee0 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=fdd40520537b446aa9c960a4f64df01c, user_id=5876b92f274647ebbf87732f914114fd)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:47.478521 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-9d7b51af-eb4b-4e98-8184-c24c4efd5ee0 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:47.478521 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:20:47.478521 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:20:47.479969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b51af-eb4b-4e98-8184-c24c4efd5ee0 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:47.620375 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2019/4096] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Jul 16 21:20:47 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:47.621466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405acde1-b243-4d59-b205-591790835e75 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:47.650052 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2078/4097] 10.222.0.16 () {60 vars in 1359 bytes} [Sat Jul 16 21:20:47 2022] PUT /identity/v3/groups/fdd40520537b446aa9c960a4f64df01c/users/5876b92f274647ebbf87732f914114fd => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:47.650884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405acde1-b243-4d59-b205-591790835e75 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:47.651865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b51af-eb4b-4e98-8184-c24c4efd5ee0 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:47.758778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9db05-c55d-49d1-a2a8-3bb7f091947b tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e3efe1b27554e1b84379410a9ae165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e101d17b4a1444129e9485147eb70d81', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1350481662', 'tempest-DelegatedRole-1856416853'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:47.760067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9db05-c55d-49d1-a2a8-3bb7f091947b tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:47.760461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9db05-c55d-49d1-a2a8-3bb7f091947b tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:47.760870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9db05-c55d-49d1-a2a8-3bb7f091947b tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] PATH_INFO: `/v3/OS-TRUST/trusts/317861fa7052425eb469a74705d50a13` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:47.774000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9db05-c55d-49d1-a2a8-3bb7f091947b tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: Authorizing `identity:get_trust(trust_id=317861fa7052425eb469a74705d50a13)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:47.775632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9db05-c55d-49d1-a2a8-3bb7f091947b tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:47.783333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b51af-eb4b-4e98-8184-c24c4efd5ee0 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:47.791214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45037d93-6a01-4ee4-97d8-758a98be4c8d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:47.792853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45037d93-6a01-4ee4-97d8-758a98be4c8d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:47.792853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45037d93-6a01-4ee4-97d8-758a98be4c8d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:47.792853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45037d93-6a01-4ee4-97d8-758a98be4c8d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/fdd40520537b446aa9c960a4f64df01c/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:47.795571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45037d93-6a01-4ee4-97d8-758a98be4c8d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=fdd40520537b446aa9c960a4f64df01c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:47.796789 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-45037d93-6a01-4ee4-97d8-758a98be4c8d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:47.796789 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:20:47.796789 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:20:47.798269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45037d93-6a01-4ee4-97d8-758a98be4c8d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:47.799368 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2020/4098] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jul 16 21:20:47 2022] GET /identity/v3/OS-TRUST/trusts/317861fa7052425eb469a74705d50a13 => generated 859 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:47.801230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9db05-c55d-49d1-a2a8-3bb7f091947b tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:47.812354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9db05-c55d-49d1-a2a8-3bb7f091947b tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:47.817724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0aa0cb-5f4d-4efd-a043-e74119dac978 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e3efe1b27554e1b84379410a9ae165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e101d17b4a1444129e9485147eb70d81', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1350481662', 'tempest-DelegatedRole-1856416853'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:47.818642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0aa0cb-5f4d-4efd-a043-e74119dac978 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:47.819211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0aa0cb-5f4d-4efd-a043-e74119dac978 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:47.819643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0aa0cb-5f4d-4efd-a043-e74119dac978 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] PATH_INFO: `/v3/OS-TRUST/trusts/317861fa7052425eb469a74705d50a13/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:47.827165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0aa0cb-5f4d-4efd-a043-e74119dac978 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=317861fa7052425eb469a74705d50a13)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:47.828946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0aa0cb-5f4d-4efd-a043-e74119dac978 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:47.835371 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2079/4099] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Jul 16 21:20:47 2022] GET /identity/v3/groups/fdd40520537b446aa9c960a4f64df01c/users => generated 1079 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:47.839886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45037d93-6a01-4ee4-97d8-758a98be4c8d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:47.845984 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2021/4100] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Jul 16 21:20:47 2022] GET /identity/v3/OS-TRUST/trusts/317861fa7052425eb469a74705d50a13/roles => generated 371 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:47.846892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0aa0cb-5f4d-4efd-a043-e74119dac978 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:47.856545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45037d93-6a01-4ee4-97d8-758a98be4c8d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:47.859189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0aa0cb-5f4d-4efd-a043-e74119dac978 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:47.865855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067e920-b0fc-46a8-9343-74ced12c9333 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:47.870255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067e920-b0fc-46a8-9343-74ced12c9333 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `HEAD` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:47.870665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067e920-b0fc-46a8-9343-74ced12c9333 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:47.871217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067e920-b0fc-46a8-9343-74ced12c9333 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/fdd40520537b446aa9c960a4f64df01c/users/8356279b69994daba7d7abaa41a0fccc` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:47.871917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9b35a-2550-483d-a161-6b4f1305ed3c tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e3efe1b27554e1b84379410a9ae165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e101d17b4a1444129e9485147eb70d81', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1350481662', 'tempest-DelegatedRole-1856416853'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:47.872765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9b35a-2550-483d-a161-6b4f1305ed3c tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:47.873054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9b35a-2550-483d-a161-6b4f1305ed3c tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:47.873337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9b35a-2550-483d-a161-6b4f1305ed3c tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] PATH_INFO: `/v3/OS-TRUST/trusts/317861fa7052425eb469a74705d50a13/roles/32be1e1fe0b447f28e59957b97884172` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:47.874808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067e920-b0fc-46a8-9343-74ced12c9333 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=fdd40520537b446aa9c960a4f64df01c, user_id=8356279b69994daba7d7abaa41a0fccc)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:47.876022 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-8067e920-b0fc-46a8-9343-74ced12c9333 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:47.876022 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:20:47.876022 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:20:47.877733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067e920-b0fc-46a8-9343-74ced12c9333 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:47.893028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9b35a-2550-483d-a161-6b4f1305ed3c tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: Authorizing `identity:get_role_for_trust(trust_id=317861fa7052425eb469a74705d50a13, role_id=32be1e1fe0b447f28e59957b97884172)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:47.895132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9b35a-2550-483d-a161-6b4f1305ed3c tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:47.897855 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2080/4101] 10.222.0.16 () {58 vars in 1341 bytes} [Sat Jul 16 21:20:47 2022] HEAD /identity/v3/groups/fdd40520537b446aa9c960a4f64df01c/users/8356279b69994daba7d7abaa41a0fccc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:47.902084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067e920-b0fc-46a8-9343-74ced12c9333 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:47.904092 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2022/4102] 10.222.0.16 () {58 vars in 1367 bytes} [Sat Jul 16 21:20:47 2022] GET /identity/v3/OS-TRUST/trusts/317861fa7052425eb469a74705d50a13/roles/32be1e1fe0b447f28e59957b97884172 => generated 244 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:47.908115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9b35a-2550-483d-a161-6b4f1305ed3c tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:47.917685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9b35a-2550-483d-a161-6b4f1305ed3c tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:47.919742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067e920-b0fc-46a8-9343-74ced12c9333 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:47.922716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8958fa2-793c-46e2-bbe8-b9af90d30846 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e3efe1b27554e1b84379410a9ae165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e101d17b4a1444129e9485147eb70d81', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1350481662', 'tempest-DelegatedRole-1856416853'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:47.925279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8958fa2-793c-46e2-bbe8-b9af90d30846 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] REQUEST_METHOD: `HEAD` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:47.925279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8958fa2-793c-46e2-bbe8-b9af90d30846 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:47.925279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8958fa2-793c-46e2-bbe8-b9af90d30846 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] PATH_INFO: `/v3/OS-TRUST/trusts/317861fa7052425eb469a74705d50a13/roles/32be1e1fe0b447f28e59957b97884172` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:47.925861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87366ef-e6c9-49be-83b4-648f116e4b00 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:47.925861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87366ef-e6c9-49be-83b4-648f116e4b00 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:47.925861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87366ef-e6c9-49be-83b4-648f116e4b00 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:47.926106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87366ef-e6c9-49be-83b4-648f116e4b00 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/fdd40520537b446aa9c960a4f64df01c/users/8356279b69994daba7d7abaa41a0fccc` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:47.927701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87366ef-e6c9-49be-83b4-648f116e4b00 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=fdd40520537b446aa9c960a4f64df01c, user_id=8356279b69994daba7d7abaa41a0fccc)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:47.928724 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-b87366ef-e6c9-49be-83b4-648f116e4b00 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:47.928724 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:20:47.928724 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:20:47.929938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87366ef-e6c9-49be-83b4-648f116e4b00 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:47.931945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8958fa2-793c-46e2-bbe8-b9af90d30846 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: Authorizing `identity:get_role_for_trust(trust_id=317861fa7052425eb469a74705d50a13, role_id=32be1e1fe0b447f28e59957b97884172)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:47.933380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8958fa2-793c-46e2-bbe8-b9af90d30846 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:47.942325 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2023/4103] 10.222.0.16 () {58 vars in 1368 bytes} [Sat Jul 16 21:20:47 2022] HEAD /identity/v3/OS-TRUST/trusts/317861fa7052425eb469a74705d50a13/roles/32be1e1fe0b447f28e59957b97884172 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:47.947607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8958fa2-793c-46e2-bbe8-b9af90d30846 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:47.960303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8958fa2-793c-46e2-bbe8-b9af90d30846 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:47.964951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e0a50-c63a-4184-9ef6-3b3fb52f4531 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e3efe1b27554e1b84379410a9ae165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e101d17b4a1444129e9485147eb70d81', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1350481662', 'tempest-DelegatedRole-1856416853'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:47.965958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e0a50-c63a-4184-9ef6-3b3fb52f4531 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:47.966322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e0a50-c63a-4184-9ef6-3b3fb52f4531 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:47.966676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e0a50-c63a-4184-9ef6-3b3fb52f4531 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] PATH_INFO: `/v3/OS-TRUST/trusts/317861fa7052425eb469a74705d50a13/roles/49f5b4ed4d3a4d30aada9c5d0a8bfbd9` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:47.974564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e0a50-c63a-4184-9ef6-3b3fb52f4531 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: Authorizing `identity:get_role_for_trust(trust_id=317861fa7052425eb469a74705d50a13, role_id=49f5b4ed4d3a4d30aada9c5d0a8bfbd9)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:47.976853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e0a50-c63a-4184-9ef6-3b3fb52f4531 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:47.993957 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-fa7e0a50-c63a-4184-9ef6-3b3fb52f4531 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Could not find role: 49f5b4ed4d3a4d30aada9c5d0a8bfbd9.: keystone.exception.RoleNotFound: Could not find role: 49f5b4ed4d3a4d30aada9c5d0a8bfbd9. Jul 16 21:20:47.993957 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:20:47.993957 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:20:47.993957 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:20:47.993957 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:20:47.993957 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:20:47.993957 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:20:47.993957 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:20:47.993957 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:20:47.993957 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:20:47.993957 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:20:47.993957 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:20:47.993957 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 16 21:20:47.993957 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 21:20:47.995053 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 49f5b4ed4d3a4d30aada9c5d0a8bfbd9. Jul 16 21:20:47.995053 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:20:47.998524 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2024/4104] 10.222.0.16 () {58 vars in 1367 bytes} [Sat Jul 16 21:20:47 2022] GET /identity/v3/OS-TRUST/trusts/317861fa7052425eb469a74705d50a13/roles/49f5b4ed4d3a4d30aada9c5d0a8bfbd9 => generated 110 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 16 21:20:47.999966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e0a50-c63a-4184-9ef6-3b3fb52f4531 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:48.012983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e0a50-c63a-4184-9ef6-3b3fb52f4531 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:48.015192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b87366ef-e6c9-49be-83b4-648f116e4b00 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '8356279b69994daba7d7abaa41a0fccc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:48.025492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e1636-e98e-423d-bd11-5fa5a23ee8cd tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e3efe1b27554e1b84379410a9ae165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e101d17b4a1444129e9485147eb70d81', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1350481662', 'tempest-DelegatedRole-1856416853'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:48.026226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e1636-e98e-423d-bd11-5fa5a23ee8cd tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] REQUEST_METHOD: `HEAD` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:48.026509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e1636-e98e-423d-bd11-5fa5a23ee8cd tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:48.026785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e1636-e98e-423d-bd11-5fa5a23ee8cd tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] PATH_INFO: `/v3/OS-TRUST/trusts/317861fa7052425eb469a74705d50a13/roles/49f5b4ed4d3a4d30aada9c5d0a8bfbd9` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:48.036655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e1636-e98e-423d-bd11-5fa5a23ee8cd tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: Authorizing `identity:get_role_for_trust(trust_id=317861fa7052425eb469a74705d50a13, role_id=49f5b4ed4d3a4d30aada9c5d0a8bfbd9)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:48.038137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e1636-e98e-423d-bd11-5fa5a23ee8cd tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:48.060272 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-487e1636-e98e-423d-bd11-5fa5a23ee8cd tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Could not find role: 49f5b4ed4d3a4d30aada9c5d0a8bfbd9.: keystone.exception.RoleNotFound: Could not find role: 49f5b4ed4d3a4d30aada9c5d0a8bfbd9. Jul 16 21:20:48.060272 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:20:48.060272 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:20:48.060272 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:20:48.060272 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:20:48.060272 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:20:48.060272 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:20:48.060272 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:20:48.060272 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:20:48.060272 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:20:48.060272 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:20:48.060272 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:20:48.060272 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 16 21:20:48.060272 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 21:20:48.061187 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 49f5b4ed4d3a4d30aada9c5d0a8bfbd9. Jul 16 21:20:48.061187 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:20:48.061187 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2025/4105] 10.222.0.16 () {58 vars in 1368 bytes} [Sat Jul 16 21:20:47 2022] HEAD /identity/v3/OS-TRUST/trusts/317861fa7052425eb469a74705d50a13/roles/49f5b4ed4d3a4d30aada9c5d0a8bfbd9 => generated 0 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jul 16 21:20:48.062894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e1636-e98e-423d-bd11-5fa5a23ee8cd tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:48.077055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e1636-e98e-423d-bd11-5fa5a23ee8cd tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:48.084255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b031e7e-1b9c-42bd-87fc-1c6b54a044be tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e3efe1b27554e1b84379410a9ae165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e101d17b4a1444129e9485147eb70d81', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1350481662', 'tempest-DelegatedRole-1856416853'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:48.084699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b031e7e-1b9c-42bd-87fc-1c6b54a044be tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:48.085697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b031e7e-1b9c-42bd-87fc-1c6b54a044be tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:48.086008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b031e7e-1b9c-42bd-87fc-1c6b54a044be tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] PATH_INFO: `/v3/OS-TRUST/trusts/317861fa7052425eb469a74705d50a13` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:48.094460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b031e7e-1b9c-42bd-87fc-1c6b54a044be tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: Authorizing `identity:delete_trust(trust_id=317861fa7052425eb469a74705d50a13)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:48.095756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b031e7e-1b9c-42bd-87fc-1c6b54a044be tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:48.179679 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2081/4106] 10.222.0.16 () {58 vars in 1343 bytes} [Sat Jul 16 21:20:47 2022] DELETE /identity/v3/groups/fdd40520537b446aa9c960a4f64df01c/users/8356279b69994daba7d7abaa41a0fccc => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:48.184010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87366ef-e6c9-49be-83b4-648f116e4b00 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:48.217270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7b031e7e-1b9c-42bd-87fc-1c6b54a044be tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '317861fa7052425eb469a74705d50a13', 'request_id': 'req-7b031e7e-1b9c-42bd-87fc-1c6b54a044be'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:48.218422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7b031e7e-1b9c-42bd-87fc-1c6b54a044be tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '317861fa7052425eb469a74705d50a13', 'request_id': 'req-7b031e7e-1b9c-42bd-87fc-1c6b54a044be'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:48.219932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7b031e7e-1b9c-42bd-87fc-1c6b54a044be tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '317861fa7052425eb469a74705d50a13', 'request_id': 'req-7b031e7e-1b9c-42bd-87fc-1c6b54a044be'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:48.311458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87366ef-e6c9-49be-83b4-648f116e4b00 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:48.324083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04948852-08a1-49d3-882a-e3e00d94362e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:48.324083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04948852-08a1-49d3-882a-e3e00d94362e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `HEAD` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:48.324083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04948852-08a1-49d3-882a-e3e00d94362e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:48.324361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04948852-08a1-49d3-882a-e3e00d94362e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/fdd40520537b446aa9c960a4f64df01c/users/275694c5871349e9b1d8798ec55b6970` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:48.325386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04948852-08a1-49d3-882a-e3e00d94362e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=fdd40520537b446aa9c960a4f64df01c, user_id=275694c5871349e9b1d8798ec55b6970)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:48.333732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04948852-08a1-49d3-882a-e3e00d94362e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:48.354741 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2082/4107] 10.222.0.16 () {58 vars in 1341 bytes} [Sat Jul 16 21:20:48 2022] HEAD /identity/v3/groups/fdd40520537b446aa9c960a4f64df01c/users/275694c5871349e9b1d8798ec55b6970 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:48.354741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04948852-08a1-49d3-882a-e3e00d94362e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:48.355533 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2026/4108] 10.222.0.16 () {58 vars in 1253 bytes} [Sat Jul 16 21:20:48 2022] DELETE /identity/v3/OS-TRUST/trusts/317861fa7052425eb469a74705d50a13 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:20:48.360750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b031e7e-1b9c-42bd-87fc-1c6b54a044be tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:48.361722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-04948852-08a1-49d3-882a-e3e00d94362e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:48.369673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7b031e7e-1b9c-42bd-87fc-1c6b54a044be tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:48.390434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04948852-08a1-49d3-882a-e3e00d94362e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:48.410807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9912f59-8efc-4aae-9782-9b495e56f392 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:48.412156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9912f59-8efc-4aae-9782-9b495e56f392 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:48.413611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9912f59-8efc-4aae-9782-9b495e56f392 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:48.413968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9912f59-8efc-4aae-9782-9b495e56f392 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/fdd40520537b446aa9c960a4f64df01c/users/275694c5871349e9b1d8798ec55b6970` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:48.416206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9912f59-8efc-4aae-9782-9b495e56f392 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=fdd40520537b446aa9c960a4f64df01c, user_id=275694c5871349e9b1d8798ec55b6970)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:48.418210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9912f59-8efc-4aae-9782-9b495e56f392 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:48.420940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b031e7e-1b9c-42bd-87fc-1c6b54a044be tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:48.452094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:48.481658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d9912f59-8efc-4aae-9782-9b495e56f392 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '275694c5871349e9b1d8798ec55b6970'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:48.506381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad694c8-7615-46df-89d4-bccfb1155ce5 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e3efe1b27554e1b84379410a9ae165d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e101d17b4a1444129e9485147eb70d81', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1350481662', 'tempest-DelegatedRole-1856416853'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:48.507845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad694c8-7615-46df-89d4-bccfb1155ce5 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:48.508140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad694c8-7615-46df-89d4-bccfb1155ce5 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:48.508431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad694c8-7615-46df-89d4-bccfb1155ce5 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] PATH_INFO: `/v3/OS-TRUST/trusts/317861fa7052425eb469a74705d50a13` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:48.534235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-0ad694c8-7615-46df-89d4-bccfb1155ce5 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Could not find trust: 317861fa7052425eb469a74705d50a13.: keystone.exception.TrustNotFound: Could not find trust: 317861fa7052425eb469a74705d50a13. Jul 16 21:20:48.534235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:20:48.534235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:20:48.534235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:20:48.534235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:20:48.534235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:20:48.534235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:20:48.534235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:20:48.534235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:20:48.534235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:20:48.534235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:20:48.534235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:20:48.534235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 16 21:20:48.534235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 16 21:20:48.534235 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 16 21:20:48.536422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 16 21:20:48.536422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 16 21:20:48.536422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 16 21:20:48.536422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 16 21:20:48.536422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 16 21:20:48.536422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:20:48.536422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:20:48.536422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 16 21:20:48.536422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 16 21:20:48.536422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 16 21:20:48.536422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 16 21:20:48.536422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 317861fa7052425eb469a74705d50a13. Jul 16 21:20:48.536422 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:20:48.536422 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2027/4109] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jul 16 21:20:48 2022] GET /identity/v3/OS-TRUST/trusts/317861fa7052425eb469a74705d50a13 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 16 21:20:48.537405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad694c8-7615-46df-89d4-bccfb1155ce5 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:48.539307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0ad694c8-7615-46df-89d4-bccfb1155ce5 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:48.682310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad694c8-7615-46df-89d4-bccfb1155ce5 tempest-TrustsV3TestJSON-2085460613 tempest-user-639371449] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:48.696470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b08d33-04f4-4932-a29d-125f84d45377 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:48.702148 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2083/4110] 10.222.0.16 () {58 vars in 1343 bytes} [Sat Jul 16 21:20:48 2022] DELETE /identity/v3/groups/fdd40520537b446aa9c960a4f64df01c/users/275694c5871349e9b1d8798ec55b6970 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:48.703158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9912f59-8efc-4aae-9782-9b495e56f392 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:48.707163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b08d33-04f4-4932-a29d-125f84d45377 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:48.707459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b08d33-04f4-4932-a29d-125f84d45377 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:48.707973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b08d33-04f4-4932-a29d-125f84d45377 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles/49f5b4ed4d3a4d30aada9c5d0a8bfbd9` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:48.713030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b08d33-04f4-4932-a29d-125f84d45377 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_role(role_id=49f5b4ed4d3a4d30aada9c5d0a8bfbd9)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:48.717909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b08d33-04f4-4932-a29d-125f84d45377 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:48.812113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9912f59-8efc-4aae-9782-9b495e56f392 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:48.819541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cc2e8-9367-4e7d-9e92-e88cb2256c0c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:48.820707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cc2e8-9367-4e7d-9e92-e88cb2256c0c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `HEAD` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:48.821164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cc2e8-9367-4e7d-9e92-e88cb2256c0c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:48.821602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cc2e8-9367-4e7d-9e92-e88cb2256c0c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/fdd40520537b446aa9c960a4f64df01c/users/5876b92f274647ebbf87732f914114fd` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:48.823690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cc2e8-9367-4e7d-9e92-e88cb2256c0c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=fdd40520537b446aa9c960a4f64df01c, user_id=5876b92f274647ebbf87732f914114fd)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:48.828609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cc2e8-9367-4e7d-9e92-e88cb2256c0c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:48.846149 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2084/4111] 10.222.0.16 () {58 vars in 1341 bytes} [Sat Jul 16 21:20:48 2022] HEAD /identity/v3/groups/fdd40520537b446aa9c960a4f64df01c/users/5876b92f274647ebbf87732f914114fd => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:48.850422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cc2e8-9367-4e7d-9e92-e88cb2256c0c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:48.859258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:48.865822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cc2e8-9367-4e7d-9e92-e88cb2256c0c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:48.873463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d082d-d158-4429-94aa-7c61f0de998d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:48.874706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d082d-d158-4429-94aa-7c61f0de998d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:48.874987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d082d-d158-4429-94aa-7c61f0de998d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:48.875347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d082d-d158-4429-94aa-7c61f0de998d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/fdd40520537b446aa9c960a4f64df01c/users/5876b92f274647ebbf87732f914114fd` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:48.877300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d082d-d158-4429-94aa-7c61f0de998d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=fdd40520537b446aa9c960a4f64df01c, user_id=5876b92f274647ebbf87732f914114fd)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:48.880686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d082d-d158-4429-94aa-7c61f0de998d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:48.980548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a34d082d-d158-4429-94aa-7c61f0de998d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5876b92f274647ebbf87732f914114fd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:49.014339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-10b08d33-04f4-4932-a29d-125f84d45377 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invalidating the token cache because role 49f5b4ed4d3a4d30aada9c5d0a8bfbd9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:49.014750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-10b08d33-04f4-4932-a29d-125f84d45377 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:49.016326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-10b08d33-04f4-4932-a29d-125f84d45377 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:49.020944 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2028/4112] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:48 2022] DELETE /identity/v3/roles/49f5b4ed4d3a4d30aada9c5d0a8bfbd9 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:49.026637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b08d33-04f4-4932-a29d-125f84d45377 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:49.030373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-10b08d33-04f4-4932-a29d-125f84d45377 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:49.115493 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2085/4113] 10.222.0.16 () {58 vars in 1343 bytes} [Sat Jul 16 21:20:48 2022] DELETE /identity/v3/groups/fdd40520537b446aa9c960a4f64df01c/users/5876b92f274647ebbf87732f914114fd => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:49.119846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d082d-d158-4429-94aa-7c61f0de998d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:49.123673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a34d082d-d158-4429-94aa-7c61f0de998d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:49.181910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b08d33-04f4-4932-a29d-125f84d45377 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:49.296857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57044011-f956-4338-abe7-b1e6c8143f7c tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:49.298796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57044011-f956-4338-abe7-b1e6c8143f7c tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:49.306423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57044011-f956-4338-abe7-b1e6c8143f7c tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:49.306423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57044011-f956-4338-abe7-b1e6c8143f7c tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles/32be1e1fe0b447f28e59957b97884172` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:49.306638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d082d-d158-4429-94aa-7c61f0de998d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:49.306737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57044011-f956-4338-abe7-b1e6c8143f7c tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_role(role_id=32be1e1fe0b447f28e59957b97884172)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:49.310608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57044011-f956-4338-abe7-b1e6c8143f7c tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:49.321277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7bb3e-75b4-4ed4-adfa-77388f62061e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:49.322135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7bb3e-75b4-4ed4-adfa-77388f62061e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:49.322417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7bb3e-75b4-4ed4-adfa-77388f62061e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:49.322976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7bb3e-75b4-4ed4-adfa-77388f62061e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/fdd40520537b446aa9c960a4f64df01c/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:49.324032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7bb3e-75b4-4ed4-adfa-77388f62061e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=fdd40520537b446aa9c960a4f64df01c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:49.328177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7bb3e-75b4-4ed4-adfa-77388f62061e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:49.351950 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2086/4114] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Jul 16 21:20:49 2022] GET /identity/v3/groups/fdd40520537b446aa9c960a4f64df01c/users => generated 145 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:49.353957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7bb3e-75b4-4ed4-adfa-77388f62061e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:49.381423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7bb3e-75b4-4ed4-adfa-77388f62061e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:49.404572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced9ffa-3cc0-4b50-9ed4-fa745b03721d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:49.404572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced9ffa-3cc0-4b50-9ed4-fa745b03721d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:49.404572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced9ffa-3cc0-4b50-9ed4-fa745b03721d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:49.405142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced9ffa-3cc0-4b50-9ed4-fa745b03721d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/users/5876b92f274647ebbf87732f914114fd` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:49.405142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced9ffa-3cc0-4b50-9ed4-fa745b03721d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5876b92f274647ebbf87732f914114fd)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:49.408994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced9ffa-3cc0-4b50-9ed4-fa745b03721d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:49.547562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0ced9ffa-3cc0-4b50-9ed4-fa745b03721d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5876b92f274647ebbf87732f914114fd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:49.556486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-57044011-f956-4338-abe7-b1e6c8143f7c tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invalidating the token cache because role 32be1e1fe0b447f28e59957b97884172 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:49.556951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-57044011-f956-4338-abe7-b1e6c8143f7c tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:49.558472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-57044011-f956-4338-abe7-b1e6c8143f7c tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:49.559483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0ced9ffa-3cc0-4b50-9ed4-fa745b03721d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5876b92f274647ebbf87732f914114fd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:49.561277 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2029/4115] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:49 2022] DELETE /identity/v3/roles/32be1e1fe0b447f28e59957b97884172 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:49.562618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467b042-9dd6-4bf6-84c1-b70013b71981 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:49.562923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467b042-9dd6-4bf6-84c1-b70013b71981 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:49.563243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467b042-9dd6-4bf6-84c1-b70013b71981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:49.591266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3467b042-9dd6-4bf6-84c1-b70013b71981 None None] MFA Rules not processed for user `b7d013d2f9834ce0a8884e6f93a95d13`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:49.592487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3467b042-9dd6-4bf6-84c1-b70013b71981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:49.656266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0ced9ffa-3cc0-4b50-9ed4-fa745b03721d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5876b92f274647ebbf87732f914114fd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:49.656984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0ced9ffa-3cc0-4b50-9ed4-fa745b03721d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5876b92f274647ebbf87732f914114fd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:49.672978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0ced9ffa-3cc0-4b50-9ed4-fa745b03721d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5876b92f274647ebbf87732f914114fd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:49.676477 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2030/4116] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:49.677366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467b042-9dd6-4bf6-84c1-b70013b71981 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:49.678689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3467b042-9dd6-4bf6-84c1-b70013b71981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:49.690248 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2087/4117] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:49 2022] DELETE /identity/v3/users/5876b92f274647ebbf87732f914114fd => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:49.692012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced9ffa-3cc0-4b50-9ed4-fa745b03721d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:49.693637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0ced9ffa-3cc0-4b50-9ed4-fa745b03721d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:49.758205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467b042-9dd6-4bf6-84c1-b70013b71981 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:49.777538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced9ffa-3cc0-4b50-9ed4-fa745b03721d tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:49.783133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f128c68-150d-415e-84a0-955f71c616fd tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:49.784067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f128c68-150d-415e-84a0-955f71c616fd tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:49.784361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f128c68-150d-415e-84a0-955f71c616fd tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:49.785513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f128c68-150d-415e-84a0-955f71c616fd tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/users/275694c5871349e9b1d8798ec55b6970` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:49.786941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f128c68-150d-415e-84a0-955f71c616fd tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:delete_user(user_id=275694c5871349e9b1d8798ec55b6970)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:49.789203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f128c68-150d-415e-84a0-955f71c616fd tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:49.840021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063a453-0bd0-4b9b-8e4f-6c3ba7b3783a tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:49.840559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063a453-0bd0-4b9b-8e4f-6c3ba7b3783a tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:49.840848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063a453-0bd0-4b9b-8e4f-6c3ba7b3783a tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:49.841136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063a453-0bd0-4b9b-8e4f-6c3ba7b3783a tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/users/7e3efe1b27554e1b84379410a9ae165d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:49.842701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063a453-0bd0-4b9b-8e4f-6c3ba7b3783a tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7e3efe1b27554e1b84379410a9ae165d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:49.844808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063a453-0bd0-4b9b-8e4f-6c3ba7b3783a tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:49.965391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3f128c68-150d-415e-84a0-955f71c616fd tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275694c5871349e9b1d8798ec55b6970'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:49.974393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3f128c68-150d-415e-84a0-955f71c616fd tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275694c5871349e9b1d8798ec55b6970'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:50.015159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b063a453-0bd0-4b9b-8e4f-6c3ba7b3783a tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e3efe1b27554e1b84379410a9ae165d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:50.041310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b063a453-0bd0-4b9b-8e4f-6c3ba7b3783a tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e3efe1b27554e1b84379410a9ae165d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:50.067001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3f128c68-150d-415e-84a0-955f71c616fd tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275694c5871349e9b1d8798ec55b6970'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:50.069959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3f128c68-150d-415e-84a0-955f71c616fd tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275694c5871349e9b1d8798ec55b6970'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:50.084781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3f128c68-150d-415e-84a0-955f71c616fd tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275694c5871349e9b1d8798ec55b6970'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:50.092588 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2088/4118] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:49 2022] DELETE /identity/v3/users/275694c5871349e9b1d8798ec55b6970 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:50.096535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f128c68-150d-415e-84a0-955f71c616fd tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:50.099217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3f128c68-150d-415e-84a0-955f71c616fd tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:50.180899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f128c68-150d-415e-84a0-955f71c616fd tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:50.185185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880489b4-97a8-492a-8208-68e7175ccc08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:50.185848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880489b4-97a8-492a-8208-68e7175ccc08 service glance] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:50.186134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880489b4-97a8-492a-8208-68e7175ccc08 service glance] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:50.186408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880489b4-97a8-492a-8208-68e7175ccc08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:50.188273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-880489b4-97a8-492a-8208-68e7175ccc08 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:50.233580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b063a453-0bd0-4b9b-8e4f-6c3ba7b3783a tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e3efe1b27554e1b84379410a9ae165d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:50.244443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b063a453-0bd0-4b9b-8e4f-6c3ba7b3783a tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e3efe1b27554e1b84379410a9ae165d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:50.246308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b063a453-0bd0-4b9b-8e4f-6c3ba7b3783a tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e3efe1b27554e1b84379410a9ae165d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:50.257098 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2031/4119] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:49 2022] DELETE /identity/v3/users/7e3efe1b27554e1b84379410a9ae165d => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:50.258287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063a453-0bd0-4b9b-8e4f-6c3ba7b3783a tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:50.260289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b063a453-0bd0-4b9b-8e4f-6c3ba7b3783a tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:50.269735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880489b4-97a8-492a-8208-68e7175ccc08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:50.274697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880489b4-97a8-492a-8208-68e7175ccc08 service glance] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:50.283945 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2089/4120] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:20:50.285210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880489b4-97a8-492a-8208-68e7175ccc08 service glance] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:50.287430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-880489b4-97a8-492a-8208-68e7175ccc08 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:50.385827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880489b4-97a8-492a-8208-68e7175ccc08 service glance] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:50.411360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063a453-0bd0-4b9b-8e4f-6c3ba7b3783a tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:50.425779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb27ec-9ae7-49d6-8ee7-130be6264a01 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:50.433822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb27ec-9ae7-49d6-8ee7-130be6264a01 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:50.433822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb27ec-9ae7-49d6-8ee7-130be6264a01 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:50.433822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb27ec-9ae7-49d6-8ee7-130be6264a01 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/users/8356279b69994daba7d7abaa41a0fccc` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:50.433822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb27ec-9ae7-49d6-8ee7-130be6264a01 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8356279b69994daba7d7abaa41a0fccc)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:50.433822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb27ec-9ae7-49d6-8ee7-130be6264a01 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:50.507973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7ed60-1f6d-4e5b-84d8-4f3ff75a2891 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:50.509638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7ed60-1f6d-4e5b-84d8-4f3ff75a2891 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:50.510752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7ed60-1f6d-4e5b-84d8-4f3ff75a2891 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:50.511303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7ed60-1f6d-4e5b-84d8-4f3ff75a2891 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects/e101d17b4a1444129e9485147eb70d81` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:50.513337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7ed60-1f6d-4e5b-84d8-4f3ff75a2891 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e101d17b4a1444129e9485147eb70d81)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:50.516122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7ed60-1f6d-4e5b-84d8-4f3ff75a2891 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:50.669065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7ddb27ec-9ae7-49d6-8ee7-130be6264a01 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8356279b69994daba7d7abaa41a0fccc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:50.702801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7ddb27ec-9ae7-49d6-8ee7-130be6264a01 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8356279b69994daba7d7abaa41a0fccc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:50.838956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7ddb27ec-9ae7-49d6-8ee7-130be6264a01 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8356279b69994daba7d7abaa41a0fccc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:50.845205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-95c7ed60-1f6d-4e5b-84d8-4f3ff75a2891 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e101d17b4a1444129e9485147eb70d81', 'request_id': 'req-95c7ed60-1f6d-4e5b-84d8-4f3ff75a2891'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:50.850773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7ddb27ec-9ae7-49d6-8ee7-130be6264a01 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8356279b69994daba7d7abaa41a0fccc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:50.851545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7ddb27ec-9ae7-49d6-8ee7-130be6264a01 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8356279b69994daba7d7abaa41a0fccc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:50.853725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-95c7ed60-1f6d-4e5b-84d8-4f3ff75a2891 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e101d17b4a1444129e9485147eb70d81', 'request_id': 'req-95c7ed60-1f6d-4e5b-84d8-4f3ff75a2891'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:50.873569 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2032/4121] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:50 2022] DELETE /identity/v3/users/8356279b69994daba7d7abaa41a0fccc => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:50.873569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb27ec-9ae7-49d6-8ee7-130be6264a01 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:50.873833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-95c7ed60-1f6d-4e5b-84d8-4f3ff75a2891 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e101d17b4a1444129e9485147eb70d81', 'request_id': 'req-95c7ed60-1f6d-4e5b-84d8-4f3ff75a2891'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:50.876275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7ddb27ec-9ae7-49d6-8ee7-130be6264a01 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:51.063484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb27ec-9ae7-49d6-8ee7-130be6264a01 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:51.078323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-95c7ed60-1f6d-4e5b-84d8-4f3ff75a2891 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] The token cache is being invalidate because project e101d17b4a1444129e9485147eb70d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:51.078980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-95c7ed60-1f6d-4e5b-84d8-4f3ff75a2891 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:51.082169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-95c7ed60-1f6d-4e5b-84d8-4f3ff75a2891 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:51.093243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1dad3-6267-43ac-8904-56f53107fb8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:51.093680 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2090/4122] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:50 2022] DELETE /identity/v3/projects/e101d17b4a1444129e9485147eb70d81 => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:51.094664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7ed60-1f6d-4e5b-84d8-4f3ff75a2891 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:51.096214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-95c7ed60-1f6d-4e5b-84d8-4f3ff75a2891 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:51.097888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1dad3-6267-43ac-8904-56f53107fb8f service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:51.098406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1dad3-6267-43ac-8904-56f53107fb8f service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:51.099675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1dad3-6267-43ac-8904-56f53107fb8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:51.108034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-39e1dad3-6267-43ac-8904-56f53107fb8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:51.144630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1dad3-6267-43ac-8904-56f53107fb8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:51.152556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1dad3-6267-43ac-8904-56f53107fb8f service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:51.195833 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2033/4123] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:20:51.200531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1dad3-6267-43ac-8904-56f53107fb8f service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:51.202288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-39e1dad3-6267-43ac-8904-56f53107fb8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:51.323324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1dad3-6267-43ac-8904-56f53107fb8f service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:51.326054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7ed60-1f6d-4e5b-84d8-4f3ff75a2891 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:51.329298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e118b3-b719-42ba-b595-fbfeb263ce2d tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:51.330179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e118b3-b719-42ba-b595-fbfeb263ce2d tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:51.330826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e118b3-b719-42ba-b595-fbfeb263ce2d tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:51.331621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e118b3-b719-42ba-b595-fbfeb263ce2d tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:51.332799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e118b3-b719-42ba-b595-fbfeb263ce2d tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:51.335466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e118b3-b719-42ba-b595-fbfeb263ce2d tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:51.364704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:51.417995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace722aa-3066-47ff-b7fd-9db859da6735 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:51.419361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace722aa-3066-47ff-b7fd-9db859da6735 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:51.419772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace722aa-3066-47ff-b7fd-9db859da6735 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:51.419959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace722aa-3066-47ff-b7fd-9db859da6735 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/fdd40520537b446aa9c960a4f64df01c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:51.422008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace722aa-3066-47ff-b7fd-9db859da6735 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:delete_group(group_id=fdd40520537b446aa9c960a4f64df01c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:51.424665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace722aa-3066-47ff-b7fd-9db859da6735 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:51.491266 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2034/4124] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Jul 16 21:20:51 2022] POST /identity/v3/projects => generated 329 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:51.495763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e118b3-b719-42ba-b595-fbfeb263ce2d tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:51.578775 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2091/4125] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Jul 16 21:20:51 2022] DELETE /identity/v3/groups/fdd40520537b446aa9c960a4f64df01c => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:51.579922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace722aa-3066-47ff-b7fd-9db859da6735 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:51.626444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e118b3-b719-42ba-b595-fbfeb263ce2d tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:51.699534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace722aa-3066-47ff-b7fd-9db859da6735 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:51.713132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a496d-654f-4a00-ad3c-03fffe395f6f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:51.713945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a496d-654f-4a00-ad3c-03fffe395f6f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:51.714345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a496d-654f-4a00-ad3c-03fffe395f6f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:51.714735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a496d-654f-4a00-ad3c-03fffe395f6f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:51.715643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a496d-654f-4a00-ad3c-03fffe395f6f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:51.719968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a496d-654f-4a00-ad3c-03fffe395f6f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:51.754973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68e773-d921-4cec-a260-7f84eb0344bd tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:51.755883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68e773-d921-4cec-a260-7f84eb0344bd tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:51.756374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68e773-d921-4cec-a260-7f84eb0344bd tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:51.756766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68e773-d921-4cec-a260-7f84eb0344bd tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:51.757845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68e773-d921-4cec-a260-7f84eb0344bd tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:51.760254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68e773-d921-4cec-a260-7f84eb0344bd tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:51.813232 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2092/4126] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jul 16 21:20:51 2022] POST /identity/v3/groups => generated 327 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:51.814519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a496d-654f-4a00-ad3c-03fffe395f6f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:51.833391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a496d-654f-4a00-ad3c-03fffe395f6f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:51.862226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868d795-67be-4542-9556-197dfc5faa4a tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:51.864208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868d795-67be-4542-9556-197dfc5faa4a tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:51.864733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868d795-67be-4542-9556-197dfc5faa4a tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:51.865274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868d795-67be-4542-9556-197dfc5faa4a tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:51.866545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868d795-67be-4542-9556-197dfc5faa4a tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:51.869647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868d795-67be-4542-9556-197dfc5faa4a tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:51.898821 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2035/4127] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:51 2022] POST /identity/v3/users => generated 413 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:51.903332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68e773-d921-4cec-a260-7f84eb0344bd tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:51.939630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68e773-d921-4cec-a260-7f84eb0344bd tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:51.952704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b03e4-d81c-4884-89b6-2d848163af78 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:51.954282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b03e4-d81c-4884-89b6-2d848163af78 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:51.955458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b03e4-d81c-4884-89b6-2d848163af78 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:51.957465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b03e4-d81c-4884-89b6-2d848163af78 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:51.958879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b03e4-d81c-4884-89b6-2d848163af78 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:51.963157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b03e4-d81c-4884-89b6-2d848163af78 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:51.982322 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2093/4128] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jul 16 21:20:51 2022] POST /identity/v3/groups => generated 326 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:51.989971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868d795-67be-4542-9556-197dfc5faa4a tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:52.019388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868d795-67be-4542-9556-197dfc5faa4a tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:52.033545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce67da7-f4e2-4ab2-b671-f33d20ba6e45 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:52.034243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce67da7-f4e2-4ab2-b671-f33d20ba6e45 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:52.034664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce67da7-f4e2-4ab2-b671-f33d20ba6e45 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:52.035112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce67da7-f4e2-4ab2-b671-f33d20ba6e45 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:52.039925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce67da7-f4e2-4ab2-b671-f33d20ba6e45 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:52.042173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce67da7-f4e2-4ab2-b671-f33d20ba6e45 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:52.185880 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2036/4129] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:20:51 2022] POST /identity/v3/roles => generated 243 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:52.187417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b03e4-d81c-4884-89b6-2d848163af78 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:52.203366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:52.208289 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2094/4130] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jul 16 21:20:51 2022] POST /identity/v3/groups => generated 326 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:52.210681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce67da7-f4e2-4ab2-b671-f33d20ba6e45 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:52.231807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b03e4-d81c-4884-89b6-2d848163af78 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:52.239552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7eba81-af24-4903-912f-29f3a6a258b3 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:52.240523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eba81-af24-4903-912f-29f3a6a258b3 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:52.240997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eba81-af24-4903-912f-29f3a6a258b3 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:52.241435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eba81-af24-4903-912f-29f3a6a258b3 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:52.242650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7eba81-af24-4903-912f-29f3a6a258b3 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:52.244650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7eba81-af24-4903-912f-29f3a6a258b3 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:52.260456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce67da7-f4e2-4ab2-b671-f33d20ba6e45 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:52.273976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26a7d6-df97-4078-b55f-bdfaf1301129 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:52.274706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26a7d6-df97-4078-b55f-bdfaf1301129 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:52.274997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26a7d6-df97-4078-b55f-bdfaf1301129 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:52.275341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26a7d6-df97-4078-b55f-bdfaf1301129 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:52.276958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26a7d6-df97-4078-b55f-bdfaf1301129 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:52.279240 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-da26a7d6-df97-4078-b55f-bdfaf1301129 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:52.279240 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:20:52.279240 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:20:52.280485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26a7d6-df97-4078-b55f-bdfaf1301129 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:52.292620 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2095/4131] 10.222.0.16 () {58 vars in 1124 bytes} [Sat Jul 16 21:20:52 2022] GET /identity/v3/groups => generated 1489 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:52.296710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26a7d6-df97-4078-b55f-bdfaf1301129 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:52.326915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26a7d6-df97-4078-b55f-bdfaf1301129 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:52.333360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cf729-3dc9-41e7-bca8-c41ddb8104b9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:52.334331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cf729-3dc9-41e7-bca8-c41ddb8104b9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:52.334544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cf729-3dc9-41e7-bca8-c41ddb8104b9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:52.334825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cf729-3dc9-41e7-bca8-c41ddb8104b9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/d0a5980e14a24cd19aeae737a2b11f86` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:52.347684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cf729-3dc9-41e7-bca8-c41ddb8104b9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:delete_group(group_id=d0a5980e14a24cd19aeae737a2b11f86)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:52.349733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cf729-3dc9-41e7-bca8-c41ddb8104b9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:52.370563 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2037/4132] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:20:52 2022] POST /identity/v3/roles => generated 247 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:52.377254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7eba81-af24-4903-912f-29f3a6a258b3 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:52.397481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7eba81-af24-4903-912f-29f3a6a258b3 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:52.409099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dccc7a-3ae4-4285-994e-befa1ddc3158 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:52.411418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dccc7a-3ae4-4285-994e-befa1ddc3158 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:52.413119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dccc7a-3ae4-4285-994e-befa1ddc3158 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:52.413659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dccc7a-3ae4-4285-994e-befa1ddc3158 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects/3e9dbb80881a402a8d02808bb5841799/users/001d45938b494ebbbe0053104013115d/roles/061efb7677f44e9584d116e20f6462bb` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:52.439829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dccc7a-3ae4-4285-994e-befa1ddc3158 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3e9dbb80881a402a8d02808bb5841799, user_id=001d45938b494ebbbe0053104013115d, role_id=061efb7677f44e9584d116e20f6462bb)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:52.443367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dccc7a-3ae4-4285-994e-befa1ddc3158 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:52.549768 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2096/4133] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Jul 16 21:20:52 2022] DELETE /identity/v3/groups/d0a5980e14a24cd19aeae737a2b11f86 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:52.554681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cf729-3dc9-41e7-bca8-c41ddb8104b9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:52.557783 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2038/4134] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:52 2022] PUT /identity/v3/projects/3e9dbb80881a402a8d02808bb5841799/users/001d45938b494ebbbe0053104013115d/roles/061efb7677f44e9584d116e20f6462bb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:52.561739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dccc7a-3ae4-4285-994e-befa1ddc3158 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:52.655469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:52.679392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cf729-3dc9-41e7-bca8-c41ddb8104b9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:52.690415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a9b7f-b9c5-44fc-a764-9afbe25b241b tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:52.691604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a9b7f-b9c5-44fc-a764-9afbe25b241b tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:52.692183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a9b7f-b9c5-44fc-a764-9afbe25b241b tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:52.693786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a9b7f-b9c5-44fc-a764-9afbe25b241b tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/16c6a9c293204f0da62762bfa9cde090` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:52.699873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a9b7f-b9c5-44fc-a764-9afbe25b241b tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:delete_group(group_id=16c6a9c293204f0da62762bfa9cde090)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:52.703127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a9b7f-b9c5-44fc-a764-9afbe25b241b tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:52.710636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dccc7a-3ae4-4285-994e-befa1ddc3158 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:52.848017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0015f09-25e6-494c-a9dc-623dada253f5 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:52.851227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0015f09-25e6-494c-a9dc-623dada253f5 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:52.851605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0015f09-25e6-494c-a9dc-623dada253f5 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:52.856352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0015f09-25e6-494c-a9dc-623dada253f5 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects/3e9dbb80881a402a8d02808bb5841799/users/001d45938b494ebbbe0053104013115d/roles/ac37444b791d4d49aae4fcda52721c8a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:52.867749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0015f09-25e6-494c-a9dc-623dada253f5 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3e9dbb80881a402a8d02808bb5841799, user_id=001d45938b494ebbbe0053104013115d, role_id=ac37444b791d4d49aae4fcda52721c8a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:52.875479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0015f09-25e6-494c-a9dc-623dada253f5 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:52.894652 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2097/4135] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Jul 16 21:20:52 2022] DELETE /identity/v3/groups/16c6a9c293204f0da62762bfa9cde090 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:52.897008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a9b7f-b9c5-44fc-a764-9afbe25b241b tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:52.995645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a9b7f-b9c5-44fc-a764-9afbe25b241b tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:52.998287 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2039/4136] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:20:52 2022] PUT /identity/v3/projects/3e9dbb80881a402a8d02808bb5841799/users/001d45938b494ebbbe0053104013115d/roles/ac37444b791d4d49aae4fcda52721c8a => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:20:53.003613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0015f09-25e6-494c-a9dc-623dada253f5 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:53.086920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f96b0a-41c8-42f6-ae26-86246833c11e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:53.088103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f96b0a-41c8-42f6-ae26-86246833c11e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:53.088485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f96b0a-41c8-42f6-ae26-86246833c11e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:53.088772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f96b0a-41c8-42f6-ae26-86246833c11e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/d2a9acc2d16e46978060fc4a10aea795` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:53.095058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f96b0a-41c8-42f6-ae26-86246833c11e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:delete_group(group_id=d2a9acc2d16e46978060fc4a10aea795)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:53.098153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f96b0a-41c8-42f6-ae26-86246833c11e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:53.161714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0015f09-25e6-494c-a9dc-623dada253f5 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:53.183972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf90a32-2272-452d-824d-8cbd69de42d8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:53.184708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf90a32-2272-452d-824d-8cbd69de42d8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:53.185000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf90a32-2272-452d-824d-8cbd69de42d8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:53.185471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf90a32-2272-452d-824d-8cbd69de42d8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:53.186254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf90a32-2272-452d-824d-8cbd69de42d8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:53.188354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf90a32-2272-452d-824d-8cbd69de42d8 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:53.264383 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2098/4137] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Jul 16 21:20:52 2022] DELETE /identity/v3/groups/d2a9acc2d16e46978060fc4a10aea795 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:53.266412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f96b0a-41c8-42f6-ae26-86246833c11e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:53.288375 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2040/4138] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:20:53 2022] GET /identity/v3/users => generated 8619 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:20:53.302275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5f223-01ec-4ee7-b1c8-2eb137b48ccd None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:53.303738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5f223-01ec-4ee7-b1c8-2eb137b48ccd None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:53.305158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5f223-01ec-4ee7-b1c8-2eb137b48ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:53.429772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f96b0a-41c8-42f6-ae26-86246833c11e tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:53.441530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c4e06-2cb0-489a-9cf9-0604ce46ee64 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:53.442808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c4e06-2cb0-489a-9cf9-0604ce46ee64 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:53.443349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c4e06-2cb0-489a-9cf9-0604ce46ee64 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:53.443757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c4e06-2cb0-489a-9cf9-0604ce46ee64 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:53.444613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c4e06-2cb0-489a-9cf9-0604ce46ee64 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:53.446708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c4e06-2cb0-489a-9cf9-0604ce46ee64 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:53.495319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d6f5f223-01ec-4ee7-b1c8-2eb137b48ccd None None] MFA Rules not processed for user `001d45938b494ebbbe0053104013115d`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:53.508008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d6f5f223-01ec-4ee7-b1c8-2eb137b48ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:53.611081 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2099/4139] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:53 2022] POST /identity/v3/users => generated 323 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:53.617231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c4e06-2cb0-489a-9cf9-0604ce46ee64 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:53.650261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c4e06-2cb0-489a-9cf9-0604ce46ee64 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:53.663976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29bc5c-e20d-4eca-a022-00524bf23906 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:53.667151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29bc5c-e20d-4eca-a022-00524bf23906 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:53.667744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29bc5c-e20d-4eca-a022-00524bf23906 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:53.669814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29bc5c-e20d-4eca-a022-00524bf23906 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:53.671673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29bc5c-e20d-4eca-a022-00524bf23906 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:53.689380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29bc5c-e20d-4eca-a022-00524bf23906 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:53.760288 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2041/4140] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:53 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:53.772496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5952f7b-60b9-4e95-a3b7-c0305a12ca38 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:53.773215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5952f7b-60b9-4e95-a3b7-c0305a12ca38 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:53.773652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5952f7b-60b9-4e95-a3b7-c0305a12ca38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:53.837073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f5952f7b-60b9-4e95-a3b7-c0305a12ca38 None None] MFA Rules not processed for user `001d45938b494ebbbe0053104013115d`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:53.843885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f5952f7b-60b9-4e95-a3b7-c0305a12ca38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:53.875239 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2100/4141] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jul 16 21:20:53 2022] POST /identity/v3/groups => generated 327 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:53.880071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29bc5c-e20d-4eca-a022-00524bf23906 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:53.882046 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2042/4142] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:53 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:53.886340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5952f7b-60b9-4e95-a3b7-c0305a12ca38 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:53.904710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5952f7b-60b9-4e95-a3b7-c0305a12ca38 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:53.907850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29bc5c-e20d-4eca-a022-00524bf23906 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:53.916874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e26252-b600-4d9b-9dff-ebcfc54cf202 tempest-TrustsV3TestJSON-1840101927 tempest-user-881095167] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '001d45938b494ebbbe0053104013115d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e9dbb80881a402a8d02808bb5841799', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1608695318', 'tempest-DelegatedRole-242532035'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:53.922204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99453290-b81c-4b0e-a892-df6c6f9d854c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:53.922352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e26252-b600-4d9b-9dff-ebcfc54cf202 tempest-TrustsV3TestJSON-1840101927 tempest-user-881095167] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:53.922352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e26252-b600-4d9b-9dff-ebcfc54cf202 tempest-TrustsV3TestJSON-1840101927 tempest-user-881095167] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:53.922502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99453290-b81c-4b0e-a892-df6c6f9d854c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:53.922597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e26252-b600-4d9b-9dff-ebcfc54cf202 tempest-TrustsV3TestJSON-1840101927 tempest-user-881095167] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:53.922676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99453290-b81c-4b0e-a892-df6c6f9d854c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:53.922676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99453290-b81c-4b0e-a892-df6c6f9d854c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/9bef13cbc709455d8d99e90e56989eb6/users/718782d3fd3d43c291354314f2128575` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:53.922814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e26252-b600-4d9b-9dff-ebcfc54cf202 tempest-TrustsV3TestJSON-1840101927 tempest-user-881095167] RBAC: Authorizing `identity:create_trust()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:53.922814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e26252-b600-4d9b-9dff-ebcfc54cf202 tempest-TrustsV3TestJSON-1840101927 tempest-user-881095167] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:53.947644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99453290-b81c-4b0e-a892-df6c6f9d854c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=9bef13cbc709455d8d99e90e56989eb6, user_id=718782d3fd3d43c291354314f2128575)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:53.953716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99453290-b81c-4b0e-a892-df6c6f9d854c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:54.046118 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-13e26252-b600-4d9b-9dff-ebcfc54cf202 tempest-TrustsV3TestJSON-1840101927 tempest-user-881095167] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jul 16 21:20:54.046118 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:20:54.046118 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Jul 16 21:20:54.046118 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Jul 16 21:20:54.046118 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Jul 16 21:20:54.046118 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Jul 16 21:20:54.046118 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Jul 16 21:20:54.046118 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:20:54.046118 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:20:54.046118 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:20:54.046118 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:20:54.046118 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Jul 16 21:20:54.046118 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Jul 16 21:20:54.046118 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Jul 16 21:20:54.047636 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise ValueError(str(e)) Jul 16 21:20:54.047636 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Jul 16 21:20:54.047636 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:20:54.047636 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:20:54.047636 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:20:54.047636 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:20:54.047636 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:20:54.047636 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:20:54.047636 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:20:54.047636 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:20:54.047636 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:20:54.047636 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:20:54.047636 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:20:54.047636 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:20:54.047636 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:20:54.047636 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:20:54.047636 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Jul 16 21:20:54.047636 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Jul 16 21:20:54.048728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Jul 16 21:20:54.048728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Jul 16 21:20:54.048728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Jul 16 21:20:54.048728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Jul 16 21:20:54.048728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jul 16 21:20:54.048728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:20:54.051166 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2043/4143] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Jul 16 21:20:53 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 165 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 16 21:20:54.056348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e26252-b600-4d9b-9dff-ebcfc54cf202 tempest-TrustsV3TestJSON-1840101927 tempest-user-881095167] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:54.078211 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2101/4144] 10.222.0.16 () {60 vars in 1359 bytes} [Sat Jul 16 21:20:53 2022] PUT /identity/v3/groups/9bef13cbc709455d8d99e90e56989eb6/users/718782d3fd3d43c291354314f2128575 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:54.079464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99453290-b81c-4b0e-a892-df6c6f9d854c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:54.174406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e26252-b600-4d9b-9dff-ebcfc54cf202 tempest-TrustsV3TestJSON-1840101927 tempest-user-881095167] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:54.236940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:54.276372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a5945-69ac-4849-b688-8d558129edeb tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:54.277259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a5945-69ac-4849-b688-8d558129edeb tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:54.277544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a5945-69ac-4849-b688-8d558129edeb tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:54.277820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a5945-69ac-4849-b688-8d558129edeb tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles/ac37444b791d4d49aae4fcda52721c8a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:54.279590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a5945-69ac-4849-b688-8d558129edeb tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ac37444b791d4d49aae4fcda52721c8a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:54.282102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a5945-69ac-4849-b688-8d558129edeb tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:54.302485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99453290-b81c-4b0e-a892-df6c6f9d854c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:54.345186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe2d63-35c6-48c0-bed8-78bd9132e95c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:54.345816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe2d63-35c6-48c0-bed8-78bd9132e95c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:54.346106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe2d63-35c6-48c0-bed8-78bd9132e95c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:54.346390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe2d63-35c6-48c0-bed8-78bd9132e95c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:54.358331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe2d63-35c6-48c0-bed8-78bd9132e95c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:54.362025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe2d63-35c6-48c0-bed8-78bd9132e95c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:54.501886 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2102/4145] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jul 16 21:20:54 2022] POST /identity/v3/groups => generated 326 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:54.503507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe2d63-35c6-48c0-bed8-78bd9132e95c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:54.566229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe2d63-35c6-48c0-bed8-78bd9132e95c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:54.594538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b94e5-a616-4b75-9501-87b5a7e72eb9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:54.595520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b94e5-a616-4b75-9501-87b5a7e72eb9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:54.595747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b94e5-a616-4b75-9501-87b5a7e72eb9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:54.596030 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b94e5-a616-4b75-9501-87b5a7e72eb9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/0c48ae514f0646ed830e63a2910a1bfc/users/718782d3fd3d43c291354314f2128575` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:54.598528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cd8a5945-69ac-4849-b688-8d558129edeb tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invalidating the token cache because role ac37444b791d4d49aae4fcda52721c8a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:54.598955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cd8a5945-69ac-4849-b688-8d558129edeb tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:54.599732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cd8a5945-69ac-4849-b688-8d558129edeb tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:54.603956 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2044/4146] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:54 2022] DELETE /identity/v3/roles/ac37444b791d4d49aae4fcda52721c8a => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:54.607333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a5945-69ac-4849-b688-8d558129edeb tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:54.609925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cd8a5945-69ac-4849-b688-8d558129edeb tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:54.612202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b94e5-a616-4b75-9501-87b5a7e72eb9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=0c48ae514f0646ed830e63a2910a1bfc, user_id=718782d3fd3d43c291354314f2128575)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:54.617548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b94e5-a616-4b75-9501-87b5a7e72eb9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:54.797824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a5945-69ac-4849-b688-8d558129edeb tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:54.815180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e37d0-59ab-4340-b696-becd99d3cfbc tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:54.816757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e37d0-59ab-4340-b696-becd99d3cfbc tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:54.817050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e37d0-59ab-4340-b696-becd99d3cfbc tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:54.817331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e37d0-59ab-4340-b696-becd99d3cfbc tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles/061efb7677f44e9584d116e20f6462bb` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:54.827754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e37d0-59ab-4340-b696-becd99d3cfbc tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_role(role_id=061efb7677f44e9584d116e20f6462bb)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:54.829553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e37d0-59ab-4340-b696-becd99d3cfbc tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:55.371517 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2103/4147] 10.222.0.16 () {60 vars in 1359 bytes} [Sat Jul 16 21:20:54 2022] PUT /identity/v3/groups/0c48ae514f0646ed830e63a2910a1bfc/users/718782d3fd3d43c291354314f2128575 => generated 0 bytes in 862 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:55.383211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b94e5-a616-4b75-9501-87b5a7e72eb9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:55.383211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-309b94e5-a616-4b75-9501-87b5a7e72eb9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:55.573128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b94e5-a616-4b75-9501-87b5a7e72eb9 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:55.585717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790f283-777e-4782-84cc-08035966176f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:55.586620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790f283-777e-4782-84cc-08035966176f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:55.586910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790f283-777e-4782-84cc-08035966176f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:55.587399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790f283-777e-4782-84cc-08035966176f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/users/718782d3fd3d43c291354314f2128575/groups` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:55.592183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790f283-777e-4782-84cc-08035966176f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=718782d3fd3d43c291354314f2128575)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:55.598977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790f283-777e-4782-84cc-08035966176f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:55.606385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6f5e37d0-59ab-4340-b696-becd99d3cfbc tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invalidating the token cache because role 061efb7677f44e9584d116e20f6462bb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:55.607572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6f5e37d0-59ab-4340-b696-becd99d3cfbc tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:55.609038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6f5e37d0-59ab-4340-b696-becd99d3cfbc tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:55.617487 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2045/4148] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:54 2022] DELETE /identity/v3/roles/061efb7677f44e9584d116e20f6462bb => generated 0 bytes in 1006 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:55.619464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e37d0-59ab-4340-b696-becd99d3cfbc tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:55.626683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6f5e37d0-59ab-4340-b696-becd99d3cfbc tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:55.661697 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2104/4149] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Jul 16 21:20:55 2022] GET /identity/v3/users/718782d3fd3d43c291354314f2128575/groups => generated 839 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:55.664360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790f283-777e-4782-84cc-08035966176f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:55.671533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8790f283-777e-4782-84cc-08035966176f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:55.760715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790f283-777e-4782-84cc-08035966176f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:55.956950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cef0d9-1f79-4930-b283-afeac5c5e84f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:55.960575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:55.964632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cef0d9-1f79-4930-b283-afeac5c5e84f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:55.966321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cef0d9-1f79-4930-b283-afeac5c5e84f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:55.968173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cef0d9-1f79-4930-b283-afeac5c5e84f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/0c48ae514f0646ed830e63a2910a1bfc` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:55.976016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cef0d9-1f79-4930-b283-afeac5c5e84f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:delete_group(group_id=0c48ae514f0646ed830e63a2910a1bfc)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:55.978208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cef0d9-1f79-4930-b283-afeac5c5e84f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:56.007213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e37d0-59ab-4340-b696-becd99d3cfbc tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:56.049559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7b8b1-7e91-4cfe-9557-43080a44e19e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:56.055191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7b8b1-7e91-4cfe-9557-43080a44e19e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:56.058419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7b8b1-7e91-4cfe-9557-43080a44e19e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:56.058419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7b8b1-7e91-4cfe-9557-43080a44e19e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/users/001d45938b494ebbbe0053104013115d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:56.062532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7b8b1-7e91-4cfe-9557-43080a44e19e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_user(user_id=001d45938b494ebbbe0053104013115d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:56.073317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7b8b1-7e91-4cfe-9557-43080a44e19e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:56.214427 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2105/4150] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Jul 16 21:20:55 2022] DELETE /identity/v3/groups/0c48ae514f0646ed830e63a2910a1bfc => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:56.219383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cef0d9-1f79-4930-b283-afeac5c5e84f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:56.322225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cef0d9-1f79-4930-b283-afeac5c5e84f tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:56.325754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c8e7b8b1-7e91-4cfe-9557-43080a44e19e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '001d45938b494ebbbe0053104013115d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:56.332678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96980517-4573-4c65-aa74-00cfd6589429 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:56.333903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96980517-4573-4c65-aa74-00cfd6589429 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:56.335337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96980517-4573-4c65-aa74-00cfd6589429 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:56.335790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96980517-4573-4c65-aa74-00cfd6589429 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/groups/9bef13cbc709455d8d99e90e56989eb6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:56.339645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96980517-4573-4c65-aa74-00cfd6589429 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9bef13cbc709455d8d99e90e56989eb6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:56.345190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96980517-4573-4c65-aa74-00cfd6589429 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:56.372743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c8e7b8b1-7e91-4cfe-9557-43080a44e19e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '001d45938b494ebbbe0053104013115d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:56.474848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c8e7b8b1-7e91-4cfe-9557-43080a44e19e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '001d45938b494ebbbe0053104013115d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:56.506077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c8e7b8b1-7e91-4cfe-9557-43080a44e19e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '001d45938b494ebbbe0053104013115d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:56.510597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c8e7b8b1-7e91-4cfe-9557-43080a44e19e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '001d45938b494ebbbe0053104013115d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:56.556473 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2046/4151] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:55 2022] DELETE /identity/v3/users/001d45938b494ebbbe0053104013115d => generated 0 bytes in 935 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:56.567578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7b8b1-7e91-4cfe-9557-43080a44e19e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:56.567990 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2106/4152] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Jul 16 21:20:56 2022] DELETE /identity/v3/groups/9bef13cbc709455d8d99e90e56989eb6 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:56.568432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c8e7b8b1-7e91-4cfe-9557-43080a44e19e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:56.568709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96980517-4573-4c65-aa74-00cfd6589429 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:56.574109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-96980517-4573-4c65-aa74-00cfd6589429 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:56.806164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7b8b1-7e91-4cfe-9557-43080a44e19e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:56.810156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96980517-4573-4c65-aa74-00cfd6589429 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:56.826078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858b9b5-1c07-46c1-ba85-fffda39fa92c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:56.827084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858b9b5-1c07-46c1-ba85-fffda39fa92c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:56.827373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858b9b5-1c07-46c1-ba85-fffda39fa92c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:56.838253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858b9b5-1c07-46c1-ba85-fffda39fa92c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/users/718782d3fd3d43c291354314f2128575` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:56.838253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858b9b5-1c07-46c1-ba85-fffda39fa92c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:delete_user(user_id=718782d3fd3d43c291354314f2128575)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:56.838253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858b9b5-1c07-46c1-ba85-fffda39fa92c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:56.986446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffdaa0-933b-4e7e-9931-055f02bf3b28 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:56.988529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffdaa0-933b-4e7e-9931-055f02bf3b28 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:56.988802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffdaa0-933b-4e7e-9931-055f02bf3b28 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:56.989082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffdaa0-933b-4e7e-9931-055f02bf3b28 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects/3e9dbb80881a402a8d02808bb5841799` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:56.991775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffdaa0-933b-4e7e-9931-055f02bf3b28 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3e9dbb80881a402a8d02808bb5841799)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:56.993706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffdaa0-933b-4e7e-9931-055f02bf3b28 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:57.162558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8858b9b5-1c07-46c1-ba85-fffda39fa92c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '718782d3fd3d43c291354314f2128575'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:57.194627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8858b9b5-1c07-46c1-ba85-fffda39fa92c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '718782d3fd3d43c291354314f2128575'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:57.218873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-30ffdaa0-933b-4e7e-9931-055f02bf3b28 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e9dbb80881a402a8d02808bb5841799', 'request_id': 'req-30ffdaa0-933b-4e7e-9931-055f02bf3b28'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:57.233829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-30ffdaa0-933b-4e7e-9931-055f02bf3b28 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e9dbb80881a402a8d02808bb5841799', 'request_id': 'req-30ffdaa0-933b-4e7e-9931-055f02bf3b28'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:57.256701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-30ffdaa0-933b-4e7e-9931-055f02bf3b28 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e9dbb80881a402a8d02808bb5841799', 'request_id': 'req-30ffdaa0-933b-4e7e-9931-055f02bf3b28'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:57.280885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8858b9b5-1c07-46c1-ba85-fffda39fa92c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '718782d3fd3d43c291354314f2128575'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:57.281972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8858b9b5-1c07-46c1-ba85-fffda39fa92c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '718782d3fd3d43c291354314f2128575'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:57.306940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8858b9b5-1c07-46c1-ba85-fffda39fa92c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '718782d3fd3d43c291354314f2128575'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:57.321965 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2107/4153] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:56 2022] DELETE /identity/v3/users/718782d3fd3d43c291354314f2128575 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:57.327279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858b9b5-1c07-46c1-ba85-fffda39fa92c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:57.330713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8858b9b5-1c07-46c1-ba85-fffda39fa92c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:57.384303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-30ffdaa0-933b-4e7e-9931-055f02bf3b28 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] The token cache is being invalidate because project 3e9dbb80881a402a8d02808bb5841799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:57.384642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-30ffdaa0-933b-4e7e-9931-055f02bf3b28 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:57.390257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-30ffdaa0-933b-4e7e-9931-055f02bf3b28 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:57.393054 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2047/4154] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:20:56 2022] DELETE /identity/v3/projects/3e9dbb80881a402a8d02808bb5841799 => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:57.406070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffdaa0-933b-4e7e-9931-055f02bf3b28 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:57.408144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-30ffdaa0-933b-4e7e-9931-055f02bf3b28 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:57.436156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:57.524113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858b9b5-1c07-46c1-ba85-fffda39fa92c tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:57.535445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9503978-d1e0-4e65-8175-3da79dd13e44 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:57.536408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9503978-d1e0-4e65-8175-3da79dd13e44 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:57.536765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9503978-d1e0-4e65-8175-3da79dd13e44 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:57.537117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9503978-d1e0-4e65-8175-3da79dd13e44 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/domains/a0382e7edb4b4b26ac7e6943fe4f262e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:57.538612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9503978-d1e0-4e65-8175-3da79dd13e44 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a0382e7edb4b4b26ac7e6943fe4f262e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:57.539264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:57.541475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9503978-d1e0-4e65-8175-3da79dd13e44 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:57.586222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffdaa0-933b-4e7e-9931-055f02bf3b28 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:57.632713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f9503978-d1e0-4e65-8175-3da79dd13e44 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a0382e7edb4b4b26ac7e6943fe4f262e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:57.633479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f9503978-d1e0-4e65-8175-3da79dd13e44 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a0382e7edb4b4b26ac7e6943fe4f262e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:57.797403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe481a-113f-43d3-be9f-b7353cfcbf93 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:57.798289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe481a-113f-43d3-be9f-b7353cfcbf93 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:57.798584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe481a-113f-43d3-be9f-b7353cfcbf93 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:57.805715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe481a-113f-43d3-be9f-b7353cfcbf93 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:57.805715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe481a-113f-43d3-be9f-b7353cfcbf93 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:57.805715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe481a-113f-43d3-be9f-b7353cfcbf93 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:57.876963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f9503978-d1e0-4e65-8175-3da79dd13e44 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a0382e7edb4b4b26ac7e6943fe4f262e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:57.880807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f9503978-d1e0-4e65-8175-3da79dd13e44 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a0382e7edb4b4b26ac7e6943fe4f262e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:57.899624 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2108/4155] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:20:57 2022] PATCH /identity/v3/domains/a0382e7edb4b4b26ac7e6943fe4f262e => generated 277 bytes in 573 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:20:57.917579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9503978-d1e0-4e65-8175-3da79dd13e44 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:57.928877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f9503978-d1e0-4e65-8175-3da79dd13e44 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:58.044649 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2048/4156] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Jul 16 21:20:57 2022] POST /identity/v3/projects => generated 329 bytes in 642 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:58.045796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe481a-113f-43d3-be9f-b7353cfcbf93 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:58.047567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-abfe481a-113f-43d3-be9f-b7353cfcbf93 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:58.142754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9503978-d1e0-4e65-8175-3da79dd13e44 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:58.328675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe481a-113f-43d3-be9f-b7353cfcbf93 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:58.383271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc77353-2202-4f4f-9216-86ccbb9769b9 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:58.384376 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc77353-2202-4f4f-9216-86ccbb9769b9 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:58.384918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc77353-2202-4f4f-9216-86ccbb9769b9 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:58.385423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc77353-2202-4f4f-9216-86ccbb9769b9 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:58.387816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc77353-2202-4f4f-9216-86ccbb9769b9 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:58.396468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc77353-2202-4f4f-9216-86ccbb9769b9 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:58.421409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd963d5-7525-4fec-8e7a-c56e50a796b2 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcaaa4fa1f8c498789224ecdc2ada38d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b769f87a3fe44032a966f766295c5465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:58.426774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd963d5-7525-4fec-8e7a-c56e50a796b2 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:58.426774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd963d5-7525-4fec-8e7a-c56e50a796b2 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:58.426774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd963d5-7525-4fec-8e7a-c56e50a796b2 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] PATH_INFO: `/v3/domains/a0382e7edb4b4b26ac7e6943fe4f262e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:58.451301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd963d5-7525-4fec-8e7a-c56e50a796b2 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a0382e7edb4b4b26ac7e6943fe4f262e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:58.453396 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-1cd963d5-7525-4fec-8e7a-c56e50a796b2 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:20:58.453396 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:20:58.453396 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:20:58.455102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd963d5-7525-4fec-8e7a-c56e50a796b2 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:58.533890 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2049/4157] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:20:58 2022] POST /identity/v3/users => generated 416 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:58.535040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc77353-2202-4f4f-9216-86ccbb9769b9 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:58.588442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc77353-2202-4f4f-9216-86ccbb9769b9 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:58.589026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1cd963d5-7525-4fec-8e7a-c56e50a796b2 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a0382e7edb4b4b26ac7e6943fe4f262e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:58.594607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026be06-0f96-4c1c-b809-237f9c1017e2 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:58.595772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026be06-0f96-4c1c-b809-237f9c1017e2 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:58.596069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026be06-0f96-4c1c-b809-237f9c1017e2 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:58.597550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026be06-0f96-4c1c-b809-237f9c1017e2 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:58.598070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026be06-0f96-4c1c-b809-237f9c1017e2 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:58.601256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026be06-0f96-4c1c-b809-237f9c1017e2 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:58.661182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1cd963d5-7525-4fec-8e7a-c56e50a796b2 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a0382e7edb4b4b26ac7e6943fe4f262e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:58.695717 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2050/4158] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:20:58 2022] POST /identity/v3/roles => generated 243 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:58.700120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8439e2f-9d9e-4b53-9e72-82ce5dcef319 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:58.700410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8439e2f-9d9e-4b53-9e72-82ce5dcef319 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:58.703458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8439e2f-9d9e-4b53-9e72-82ce5dcef319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:58.769856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f8439e2f-9d9e-4b53-9e72-82ce5dcef319 None None] MFA Rules not processed for user `bba77f6ef42547f1aa8480e27868bd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:20:58.772857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f8439e2f-9d9e-4b53-9e72-82ce5dcef319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:58.892558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1cd963d5-7525-4fec-8e7a-c56e50a796b2 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0382e7edb4b4b26ac7e6943fe4f262e', 'request_id': 'req-1cd963d5-7525-4fec-8e7a-c56e50a796b2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:58.902355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1cd963d5-7525-4fec-8e7a-c56e50a796b2 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0382e7edb4b4b26ac7e6943fe4f262e', 'request_id': 'req-1cd963d5-7525-4fec-8e7a-c56e50a796b2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:58.927161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:58.928412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1cd963d5-7525-4fec-8e7a-c56e50a796b2 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0382e7edb4b4b26ac7e6943fe4f262e', 'request_id': 'req-1cd963d5-7525-4fec-8e7a-c56e50a796b2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:58.946088 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2051/4159] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:20:58.946088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8439e2f-9d9e-4b53-9e72-82ce5dcef319 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:58.954606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f8439e2f-9d9e-4b53-9e72-82ce5dcef319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:59.054809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1cd963d5-7525-4fec-8e7a-c56e50a796b2 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] The token cache is being invalidate because project a0382e7edb4b4b26ac7e6943fe4f262e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:20:59.055717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1cd963d5-7525-4fec-8e7a-c56e50a796b2 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:59.056632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1cd963d5-7525-4fec-8e7a-c56e50a796b2 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:59.095732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1cd963d5-7525-4fec-8e7a-c56e50a796b2 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a0382e7edb4b4b26ac7e6943fe4f262e', 'request_id': 'req-1cd963d5-7525-4fec-8e7a-c56e50a796b2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:59.113902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1cd963d5-7525-4fec-8e7a-c56e50a796b2 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a0382e7edb4b4b26ac7e6943fe4f262e', 'request_id': 'req-1cd963d5-7525-4fec-8e7a-c56e50a796b2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:59.118837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1cd963d5-7525-4fec-8e7a-c56e50a796b2 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a0382e7edb4b4b26ac7e6943fe4f262e', 'request_id': 'req-1cd963d5-7525-4fec-8e7a-c56e50a796b2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:20:59.144855 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2109/4160] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:20:57 2022] DELETE /identity/v3/domains/a0382e7edb4b4b26ac7e6943fe4f262e => generated 0 bytes in 1241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:20:59.146136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd963d5-7525-4fec-8e7a-c56e50a796b2 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:59.148589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1cd963d5-7525-4fec-8e7a-c56e50a796b2 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:59.219228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8439e2f-9d9e-4b53-9e72-82ce5dcef319 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:59.267678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd963d5-7525-4fec-8e7a-c56e50a796b2 tempest-GroupsV3TestJSON-1383441926 tempest-GroupsV3TestJSON-1383441926-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:59.277918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b06f4-73ef-4c98-84e6-1d82afe99ad0 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:59.278853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b06f4-73ef-4c98-84e6-1d82afe99ad0 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:59.279339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b06f4-73ef-4c98-84e6-1d82afe99ad0 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:59.279620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b06f4-73ef-4c98-84e6-1d82afe99ad0 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:59.280531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b06f4-73ef-4c98-84e6-1d82afe99ad0 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:59.282721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b06f4-73ef-4c98-84e6-1d82afe99ad0 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:59.382815 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2110/4161] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:20:59 2022] POST /identity/v3/roles => generated 247 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:20:59.382815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b06f4-73ef-4c98-84e6-1d82afe99ad0 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:59.386176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-761b06f4-73ef-4c98-84e6-1d82afe99ad0 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:59.500233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa977a6-c47c-4cfd-afdc-29b4f458a290 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:59.501335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa977a6-c47c-4cfd-afdc-29b4f458a290 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:59.504040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa977a6-c47c-4cfd-afdc-29b4f458a290 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:59.507536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa977a6-c47c-4cfd-afdc-29b4f458a290 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:59.515074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5fa977a6-c47c-4cfd-afdc-29b4f458a290 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:59.565195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:59.574498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa977a6-c47c-4cfd-afdc-29b4f458a290 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:59.576178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa977a6-c47c-4cfd-afdc-29b4f458a290 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:20:59.599555 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2052/4162] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:20:59.602062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa977a6-c47c-4cfd-afdc-29b4f458a290 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:20:59.606906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5fa977a6-c47c-4cfd-afdc-29b4f458a290 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:59.753593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b06f4-73ef-4c98-84e6-1d82afe99ad0 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:59.791105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac4961-c719-4b4a-8b0d-e85a724461cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:59.791612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac4961-c719-4b4a-8b0d-e85a724461cc service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:59.791898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac4961-c719-4b4a-8b0d-e85a724461cc service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:59.792220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac4961-c719-4b4a-8b0d-e85a724461cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:59.801252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8fac4961-c719-4b4a-8b0d-e85a724461cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:20:59.908253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa977a6-c47c-4cfd-afdc-29b4f458a290 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:20:59.937772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85c7ec-fc84-4b25-b296-630f95743f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:20:59.939964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85c7ec-fc84-4b25-b296-630f95743f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:20:59.942546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85c7ec-fc84-4b25-b296-630f95743f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:20:59.943379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85c7ec-fc84-4b25-b296-630f95743f4a admin admin] PATH_INFO: `/v3/users/00d2b2c30bc7415e90f6bb6830a1a09b` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:20:59.946877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85c7ec-fc84-4b25-b296-630f95743f4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=00d2b2c30bc7415e90f6bb6830a1a09b)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:20:59.951610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:20:59.951749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85c7ec-fc84-4b25-b296-630f95743f4a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:00.044718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac4961-c719-4b4a-8b0d-e85a724461cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:00.048581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac4961-c719-4b4a-8b0d-e85a724461cc service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:00.058305 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2111/4163] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:20:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:21:00.059494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac4961-c719-4b4a-8b0d-e85a724461cc service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:00.079442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac4961-c719-4b4a-8b0d-e85a724461cc service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:00.084982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ac7b4-824d-45e5-8069-8433feef091f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:00.085886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ac7b4-824d-45e5-8069-8433feef091f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:00.086169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ac7b4-824d-45e5-8069-8433feef091f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:00.086447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ac7b4-824d-45e5-8069-8433feef091f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects/7aa3b8c83c1d44ada240a408946820a1/users/2e9897fc240a41bfb6cbe095a18977b3/roles/862715cf59d745289b6cb813af26134c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:00.125257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ac7b4-824d-45e5-8069-8433feef091f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7aa3b8c83c1d44ada240a408946820a1, user_id=2e9897fc240a41bfb6cbe095a18977b3, role_id=862715cf59d745289b6cb813af26134c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:00.128507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ac7b4-824d-45e5-8069-8433feef091f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:00.260484 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2112/4164] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:00 2022] PUT /identity/v3/projects/7aa3b8c83c1d44ada240a408946820a1/users/2e9897fc240a41bfb6cbe095a18977b3/roles/862715cf59d745289b6cb813af26134c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:00.267364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ac7b4-824d-45e5-8069-8433feef091f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:00.317154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-df85c7ec-fc84-4b25-b296-630f95743f4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00d2b2c30bc7415e90f6bb6830a1a09b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:00.394559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-df85c7ec-fc84-4b25-b296-630f95743f4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00d2b2c30bc7415e90f6bb6830a1a09b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:00.396020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ac7b4-824d-45e5-8069-8433feef091f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:00.418101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fb8ea-4a69-4021-a81f-b7332c920f68 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:00.421311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fb8ea-4a69-4021-a81f-b7332c920f68 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:00.421607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fb8ea-4a69-4021-a81f-b7332c920f68 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:00.421892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fb8ea-4a69-4021-a81f-b7332c920f68 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects/7aa3b8c83c1d44ada240a408946820a1/users/2e9897fc240a41bfb6cbe095a18977b3/roles/9db52abd24eb42b986916ad39d7ad88c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:00.430002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fb8ea-4a69-4021-a81f-b7332c920f68 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7aa3b8c83c1d44ada240a408946820a1, user_id=2e9897fc240a41bfb6cbe095a18977b3, role_id=9db52abd24eb42b986916ad39d7ad88c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:00.433434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fb8ea-4a69-4021-a81f-b7332c920f68 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:00.549180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-df85c7ec-fc84-4b25-b296-630f95743f4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00d2b2c30bc7415e90f6bb6830a1a09b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:00.562674 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2113/4165] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:00 2022] PUT /identity/v3/projects/7aa3b8c83c1d44ada240a408946820a1/users/2e9897fc240a41bfb6cbe095a18977b3/roles/9db52abd24eb42b986916ad39d7ad88c => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:00.564164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fb8ea-4a69-4021-a81f-b7332c920f68 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:00.570533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-df85c7ec-fc84-4b25-b296-630f95743f4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00d2b2c30bc7415e90f6bb6830a1a09b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:00.571666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-df85c7ec-fc84-4b25-b296-630f95743f4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00d2b2c30bc7415e90f6bb6830a1a09b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:00.596921 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2053/4166] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:20:59 2022] DELETE /identity/v3/users/00d2b2c30bc7415e90f6bb6830a1a09b => generated 0 bytes in 996 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:00.602051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ede62-8f52-40b3-a942-fc014f9ad38f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:00.602549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ede62-8f52-40b3-a942-fc014f9ad38f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:00.604398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ede62-8f52-40b3-a942-fc014f9ad38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:00.651581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f86ede62-8f52-40b3-a942-fc014f9ad38f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:00.677107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f86ede62-8f52-40b3-a942-fc014f9ad38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:00.837503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fb8ea-4a69-4021-a81f-b7332c920f68 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:00.958812 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2054/4167] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:01.054288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202d82c-37f3-4844-aa0d-fabba156652f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:01.055154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202d82c-37f3-4844-aa0d-fabba156652f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:01.055376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202d82c-37f3-4844-aa0d-fabba156652f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:01.055610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202d82c-37f3-4844-aa0d-fabba156652f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:01.056393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202d82c-37f3-4844-aa0d-fabba156652f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:01.057435 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-3202d82c-37f3-4844-aa0d-fabba156652f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:01.057435 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:21:01.057435 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:21:01.058594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202d82c-37f3-4844-aa0d-fabba156652f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:01.061947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ede62-8f52-40b3-a942-fc014f9ad38f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:01.064233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f86ede62-8f52-40b3-a942-fc014f9ad38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:01.218369 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2114/4168] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:00 2022] GET /identity/v3/users => generated 8347 bytes in 651 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:21:01.223396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd602c-51a3-4a48-876d-3b4740d3b16a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:01.223690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd602c-51a3-4a48-876d-3b4740d3b16a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:01.224076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd602c-51a3-4a48-876d-3b4740d3b16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:01.271289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ede62-8f52-40b3-a942-fc014f9ad38f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:01.280845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77826b85-ab9c-46ce-9e11-433742e523b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:01.281435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77826b85-ab9c-46ce-9e11-433742e523b3 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:01.281713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77826b85-ab9c-46ce-9e11-433742e523b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:01.282007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77826b85-ab9c-46ce-9e11-433742e523b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:01.310164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77826b85-ab9c-46ce-9e11-433742e523b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:01.334131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77826b85-ab9c-46ce-9e11-433742e523b3 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:01.386648 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2055/4169] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:21:01.399273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a8fd602c-51a3-4a48-876d-3b4740d3b16a None None] MFA Rules not processed for user `2e9897fc240a41bfb6cbe095a18977b3`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:01.401470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a8fd602c-51a3-4a48-876d-3b4740d3b16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:01.478417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:01.655537 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2115/4170] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:01.677066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fe9bc-847e-4740-a7b3-f62ca9905bf5 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:01.678355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fe9bc-847e-4740-a7b3-f62ca9905bf5 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:01.678916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fe9bc-847e-4740-a7b3-f62ca9905bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:01.775192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c71fe9bc-847e-4740-a7b3-f62ca9905bf5 None None] MFA Rules not processed for user `2e9897fc240a41bfb6cbe095a18977b3`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:01.776449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c71fe9bc-847e-4740-a7b3-f62ca9905bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:01.832035 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2056/4171] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:01.834538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd602c-51a3-4a48-876d-3b4740d3b16a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:01.855438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd602c-51a3-4a48-876d-3b4740d3b16a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:01.876075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817a074-755e-4e22-a4bd-968558ef7828 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e9897fc240a41bfb6cbe095a18977b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa3b8c83c1d44ada240a408946820a1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-407223984', 'tempest-NotDelegatedRole-1306775443'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:01.879795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817a074-755e-4e22-a4bd-968558ef7828 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:01.880992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817a074-755e-4e22-a4bd-968558ef7828 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:01.881500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817a074-755e-4e22-a4bd-968558ef7828 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:01.883149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817a074-755e-4e22-a4bd-968558ef7828 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: Authorizing `identity:create_trust()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:01.884849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817a074-755e-4e22-a4bd-968558ef7828 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:01.963322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:02.110232 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2116/4172] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Jul 16 21:21:01 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:02.113346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fe9bc-847e-4740-a7b3-f62ca9905bf5 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:02.124935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fe9bc-847e-4740-a7b3-f62ca9905bf5 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:02.147871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77aec1-b513-46ad-b79f-35a115adb598 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e9897fc240a41bfb6cbe095a18977b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa3b8c83c1d44ada240a408946820a1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-407223984', 'tempest-NotDelegatedRole-1306775443'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:02.149820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77aec1-b513-46ad-b79f-35a115adb598 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:02.155058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77aec1-b513-46ad-b79f-35a115adb598 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:02.155732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77aec1-b513-46ad-b79f-35a115adb598 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] PATH_INFO: `/v3/OS-TRUST/trusts/0e55cd7188504ea6826ad1f81cfbb60a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:02.177236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77aec1-b513-46ad-b79f-35a115adb598 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: Authorizing `identity:get_trust(trust_id=0e55cd7188504ea6826ad1f81cfbb60a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:02.187641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77aec1-b513-46ad-b79f-35a115adb598 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:02.223425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817a074-755e-4e22-a4bd-968558ef7828 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:02.223775 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2057/4173] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jul 16 21:21:02 2022] GET /identity/v3/OS-TRUST/trusts/0e55cd7188504ea6826ad1f81cfbb60a => generated 833 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:02.239170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817a074-755e-4e22-a4bd-968558ef7828 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:02.252333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cca2e-1795-47fd-8f7d-3ccd819d097a tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e9897fc240a41bfb6cbe095a18977b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa3b8c83c1d44ada240a408946820a1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-407223984', 'tempest-NotDelegatedRole-1306775443'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:02.258525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cca2e-1795-47fd-8f7d-3ccd819d097a tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:02.259199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cca2e-1795-47fd-8f7d-3ccd819d097a tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:02.261063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cca2e-1795-47fd-8f7d-3ccd819d097a tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] PATH_INFO: `/v3/OS-TRUST/trusts/0e55cd7188504ea6826ad1f81cfbb60a/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:02.272873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2cca2e-1795-47fd-8f7d-3ccd819d097a tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=0e55cd7188504ea6826ad1f81cfbb60a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:02.274715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2cca2e-1795-47fd-8f7d-3ccd819d097a tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:02.303838 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2117/4174] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Jul 16 21:21:02 2022] GET /identity/v3/OS-TRUST/trusts/0e55cd7188504ea6826ad1f81cfbb60a/roles => generated 370 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:02.310728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77aec1-b513-46ad-b79f-35a115adb598 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:02.324718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77aec1-b513-46ad-b79f-35a115adb598 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:02.337043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df9e98-ae54-4d8f-a325-1e492df19216 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e9897fc240a41bfb6cbe095a18977b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa3b8c83c1d44ada240a408946820a1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-407223984', 'tempest-NotDelegatedRole-1306775443'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:02.341074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df9e98-ae54-4d8f-a325-1e492df19216 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:02.342751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df9e98-ae54-4d8f-a325-1e492df19216 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:02.348491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df9e98-ae54-4d8f-a325-1e492df19216 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] PATH_INFO: `/v3/OS-TRUST/trusts/0e55cd7188504ea6826ad1f81cfbb60a/roles/862715cf59d745289b6cb813af26134c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:02.362106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df9e98-ae54-4d8f-a325-1e492df19216 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0e55cd7188504ea6826ad1f81cfbb60a, role_id=862715cf59d745289b6cb813af26134c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:02.366751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df9e98-ae54-4d8f-a325-1e492df19216 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:02.409070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cca2e-1795-47fd-8f7d-3ccd819d097a tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:02.410529 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2058/4175] 10.222.0.16 () {58 vars in 1367 bytes} [Sat Jul 16 21:21:02 2022] GET /identity/v3/OS-TRUST/trusts/0e55cd7188504ea6826ad1f81cfbb60a/roles/862715cf59d745289b6cb813af26134c => generated 243 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:02.435433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cca2e-1795-47fd-8f7d-3ccd819d097a tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:02.459917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22835a5-ef46-4da7-88b8-6dbfd920fed5 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e9897fc240a41bfb6cbe095a18977b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa3b8c83c1d44ada240a408946820a1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-407223984', 'tempest-NotDelegatedRole-1306775443'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:02.467462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22835a5-ef46-4da7-88b8-6dbfd920fed5 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] REQUEST_METHOD: `HEAD` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:02.467810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22835a5-ef46-4da7-88b8-6dbfd920fed5 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:02.468098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22835a5-ef46-4da7-88b8-6dbfd920fed5 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] PATH_INFO: `/v3/OS-TRUST/trusts/0e55cd7188504ea6826ad1f81cfbb60a/roles/862715cf59d745289b6cb813af26134c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:02.496356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22835a5-ef46-4da7-88b8-6dbfd920fed5 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0e55cd7188504ea6826ad1f81cfbb60a, role_id=862715cf59d745289b6cb813af26134c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:02.499237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22835a5-ef46-4da7-88b8-6dbfd920fed5 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:02.520516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df9e98-ae54-4d8f-a325-1e492df19216 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:02.520860 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2118/4176] 10.222.0.16 () {58 vars in 1368 bytes} [Sat Jul 16 21:21:02 2022] HEAD /identity/v3/OS-TRUST/trusts/0e55cd7188504ea6826ad1f81cfbb60a/roles/862715cf59d745289b6cb813af26134c => generated 0 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 16 21:21:02.531880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df9e98-ae54-4d8f-a325-1e492df19216 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:02.540606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad34536-ada6-4558-ae56-7f5ad25c3882 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e9897fc240a41bfb6cbe095a18977b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa3b8c83c1d44ada240a408946820a1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-407223984', 'tempest-NotDelegatedRole-1306775443'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:02.553604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad34536-ada6-4558-ae56-7f5ad25c3882 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:02.558580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad34536-ada6-4558-ae56-7f5ad25c3882 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:02.559052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad34536-ada6-4558-ae56-7f5ad25c3882 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] PATH_INFO: `/v3/OS-TRUST/trusts/0e55cd7188504ea6826ad1f81cfbb60a/roles/9db52abd24eb42b986916ad39d7ad88c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:02.605573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad34536-ada6-4558-ae56-7f5ad25c3882 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0e55cd7188504ea6826ad1f81cfbb60a, role_id=9db52abd24eb42b986916ad39d7ad88c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:02.607487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad34536-ada6-4558-ae56-7f5ad25c3882 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:02.652828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-aad34536-ada6-4558-ae56-7f5ad25c3882 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Could not find role: 9db52abd24eb42b986916ad39d7ad88c.: keystone.exception.RoleNotFound: Could not find role: 9db52abd24eb42b986916ad39d7ad88c. Jul 16 21:21:02.652828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:02.652828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:21:02.652828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:21:02.652828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:21:02.652828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:21:02.652828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:21:02.652828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:21:02.652828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:21:02.652828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:21:02.652828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:21:02.652828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:21:02.652828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 16 21:21:02.652828 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 21:21:02.656779 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 9db52abd24eb42b986916ad39d7ad88c. Jul 16 21:21:02.656779 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:21:02.656779 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2059/4177] 10.222.0.16 () {58 vars in 1367 bytes} [Sat Jul 16 21:21:02 2022] GET /identity/v3/OS-TRUST/trusts/0e55cd7188504ea6826ad1f81cfbb60a/roles/9db52abd24eb42b986916ad39d7ad88c => generated 110 bytes in 135 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:21:02.657010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22835a5-ef46-4da7-88b8-6dbfd920fed5 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:02.685731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22835a5-ef46-4da7-88b8-6dbfd920fed5 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:02.696224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7aafe-1d8c-4b06-acd8-c8c097ba9f31 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e9897fc240a41bfb6cbe095a18977b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa3b8c83c1d44ada240a408946820a1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-407223984', 'tempest-NotDelegatedRole-1306775443'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:02.697441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7aafe-1d8c-4b06-acd8-c8c097ba9f31 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] REQUEST_METHOD: `HEAD` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:02.697904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7aafe-1d8c-4b06-acd8-c8c097ba9f31 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:02.701481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7aafe-1d8c-4b06-acd8-c8c097ba9f31 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] PATH_INFO: `/v3/OS-TRUST/trusts/0e55cd7188504ea6826ad1f81cfbb60a/roles/9db52abd24eb42b986916ad39d7ad88c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:02.706464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7aafe-1d8c-4b06-acd8-c8c097ba9f31 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0e55cd7188504ea6826ad1f81cfbb60a, role_id=9db52abd24eb42b986916ad39d7ad88c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:02.709709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7aafe-1d8c-4b06-acd8-c8c097ba9f31 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:02.760960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad34536-ada6-4558-ae56-7f5ad25c3882 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:02.771723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-aad34536-ada6-4558-ae56-7f5ad25c3882 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:02.789568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-d4d7aafe-1d8c-4b06-acd8-c8c097ba9f31 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Could not find role: 9db52abd24eb42b986916ad39d7ad88c.: keystone.exception.RoleNotFound: Could not find role: 9db52abd24eb42b986916ad39d7ad88c. Jul 16 21:21:02.789568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:02.789568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:21:02.789568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:21:02.789568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:21:02.789568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:21:02.789568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:21:02.789568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:21:02.789568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:21:02.789568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:21:02.789568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:21:02.789568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:21:02.789568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 16 21:21:02.789568 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 21:21:02.790570 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 9db52abd24eb42b986916ad39d7ad88c. Jul 16 21:21:02.790570 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:02.800066 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2119/4178] 10.222.0.16 () {58 vars in 1368 bytes} [Sat Jul 16 21:21:02 2022] HEAD /identity/v3/OS-TRUST/trusts/0e55cd7188504ea6826ad1f81cfbb60a/roles/9db52abd24eb42b986916ad39d7ad88c => generated 0 bytes in 139 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jul 16 21:21:02.805373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7aafe-1d8c-4b06-acd8-c8c097ba9f31 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:02.817702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad34536-ada6-4558-ae56-7f5ad25c3882 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:02.822129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7aafe-1d8c-4b06-acd8-c8c097ba9f31 tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:02.841090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d6136-cfde-4e5d-83d8-85c6d7320a8e tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e9897fc240a41bfb6cbe095a18977b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa3b8c83c1d44ada240a408946820a1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-407223984', 'tempest-NotDelegatedRole-1306775443'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:02.843075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af5e64-1c12-4fdb-86c7-f6f3ab435adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:02.844289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d6136-cfde-4e5d-83d8-85c6d7320a8e tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:02.844518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af5e64-1c12-4fdb-86c7-f6f3ab435adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:02.844628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d6136-cfde-4e5d-83d8-85c6d7320a8e tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:02.844872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d6136-cfde-4e5d-83d8-85c6d7320a8e tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] PATH_INFO: `/v3/OS-TRUST/trusts/0e55cd7188504ea6826ad1f81cfbb60a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:02.845338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af5e64-1c12-4fdb-86c7-f6f3ab435adf admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:02.845878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af5e64-1c12-4fdb-86c7-f6f3ab435adf admin admin] PATH_INFO: `/v3/projects/6d406dc312cf40f48cdd3f43fe139520` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:02.848346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af5e64-1c12-4fdb-86c7-f6f3ab435adf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d406dc312cf40f48cdd3f43fe139520)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:02.851362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af5e64-1c12-4fdb-86c7-f6f3ab435adf admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:02.855856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d6136-cfde-4e5d-83d8-85c6d7320a8e tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: Authorizing `identity:delete_trust(trust_id=0e55cd7188504ea6826ad1f81cfbb60a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:02.857505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d6136-cfde-4e5d-83d8-85c6d7320a8e tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:03.015110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d52d6136-cfde-4e5d-83d8-85c6d7320a8e tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '0e55cd7188504ea6826ad1f81cfbb60a', 'request_id': 'req-d52d6136-cfde-4e5d-83d8-85c6d7320a8e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:03.016185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d52d6136-cfde-4e5d-83d8-85c6d7320a8e tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '0e55cd7188504ea6826ad1f81cfbb60a', 'request_id': 'req-d52d6136-cfde-4e5d-83d8-85c6d7320a8e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:03.086825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-98af5e64-1c12-4fdb-86c7-f6f3ab435adf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d406dc312cf40f48cdd3f43fe139520', 'request_id': 'req-98af5e64-1c12-4fdb-86c7-f6f3ab435adf'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:03.097008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-98af5e64-1c12-4fdb-86c7-f6f3ab435adf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d406dc312cf40f48cdd3f43fe139520', 'request_id': 'req-98af5e64-1c12-4fdb-86c7-f6f3ab435adf'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:03.130752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-98af5e64-1c12-4fdb-86c7-f6f3ab435adf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d406dc312cf40f48cdd3f43fe139520', 'request_id': 'req-98af5e64-1c12-4fdb-86c7-f6f3ab435adf'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:03.135842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d52d6136-cfde-4e5d-83d8-85c6d7320a8e tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '0e55cd7188504ea6826ad1f81cfbb60a', 'request_id': 'req-d52d6136-cfde-4e5d-83d8-85c6d7320a8e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:03.150943 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2120/4179] 10.222.0.16 () {58 vars in 1253 bytes} [Sat Jul 16 21:21:02 2022] DELETE /identity/v3/OS-TRUST/trusts/0e55cd7188504ea6826ad1f81cfbb60a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:03.155547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d6136-cfde-4e5d-83d8-85c6d7320a8e tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:03.159543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d52d6136-cfde-4e5d-83d8-85c6d7320a8e tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:03.211707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d6136-cfde-4e5d-83d8-85c6d7320a8e tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:03.314884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-98af5e64-1c12-4fdb-86c7-f6f3ab435adf admin admin] The token cache is being invalidate because project 6d406dc312cf40f48cdd3f43fe139520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:03.315300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-98af5e64-1c12-4fdb-86c7-f6f3ab435adf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:03.316131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-98af5e64-1c12-4fdb-86c7-f6f3ab435adf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:03.323657 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2060/4180] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:02 2022] DELETE /identity/v3/projects/6d406dc312cf40f48cdd3f43fe139520 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:21:03.324739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af5e64-1c12-4fdb-86c7-f6f3ab435adf admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:03.330092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-98af5e64-1c12-4fdb-86c7-f6f3ab435adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:03.444709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39cc1a-7ad7-4154-8fe2-b087574ba56e tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e9897fc240a41bfb6cbe095a18977b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa3b8c83c1d44ada240a408946820a1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-407223984', 'tempest-NotDelegatedRole-1306775443'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:03.446703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39cc1a-7ad7-4154-8fe2-b087574ba56e tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:03.447655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39cc1a-7ad7-4154-8fe2-b087574ba56e tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:03.448534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39cc1a-7ad7-4154-8fe2-b087574ba56e tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] PATH_INFO: `/v3/OS-TRUST/trusts/0e55cd7188504ea6826ad1f81cfbb60a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:03.499185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-dd39cc1a-7ad7-4154-8fe2-b087574ba56e tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Could not find trust: 0e55cd7188504ea6826ad1f81cfbb60a.: keystone.exception.TrustNotFound: Could not find trust: 0e55cd7188504ea6826ad1f81cfbb60a. Jul 16 21:21:03.499185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:03.499185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:21:03.499185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:21:03.499185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:21:03.499185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:21:03.499185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:21:03.499185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:21:03.499185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:21:03.499185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:21:03.499185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:21:03.499185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:21:03.499185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 16 21:21:03.499185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 16 21:21:03.499185 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 16 21:21:03.500453 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 16 21:21:03.500453 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 16 21:21:03.500453 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 16 21:21:03.500453 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 16 21:21:03.500453 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 16 21:21:03.500453 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:21:03.500453 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:21:03.500453 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 16 21:21:03.500453 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 16 21:21:03.500453 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 16 21:21:03.500453 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 16 21:21:03.500453 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 0e55cd7188504ea6826ad1f81cfbb60a. Jul 16 21:21:03.500453 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:03.505875 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2121/4181] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jul 16 21:21:03 2022] GET /identity/v3/OS-TRUST/trusts/0e55cd7188504ea6826ad1f81cfbb60a => generated 111 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:21:03.509445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39cc1a-7ad7-4154-8fe2-b087574ba56e tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:03.517384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dd39cc1a-7ad7-4154-8fe2-b087574ba56e tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:03.567450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af5e64-1c12-4fdb-86c7-f6f3ab435adf admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:03.581804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7736d2-6734-4204-a90b-85c075725ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:03.582774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7736d2-6734-4204-a90b-85c075725ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:03.583452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7736d2-6734-4204-a90b-85c075725ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:03.583733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7736d2-6734-4204-a90b-85c075725ed9 admin admin] PATH_INFO: `/v3/users/dcaaa4fa1f8c498789224ecdc2ada38d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:03.587082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7736d2-6734-4204-a90b-85c075725ed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcaaa4fa1f8c498789224ecdc2ada38d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:03.591422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7736d2-6734-4204-a90b-85c075725ed9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:03.676227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39cc1a-7ad7-4154-8fe2-b087574ba56e tempest-TrustsV3TestJSON-1552110065 tempest-user-2079907550] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:03.681798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4b64e-64f3-4dbc-8bf7-b71ff6778536 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:03.682675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4b64e-64f3-4dbc-8bf7-b71ff6778536 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:03.683026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4b64e-64f3-4dbc-8bf7-b71ff6778536 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:03.683318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4b64e-64f3-4dbc-8bf7-b71ff6778536 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles/9db52abd24eb42b986916ad39d7ad88c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:03.685896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4b64e-64f3-4dbc-8bf7-b71ff6778536 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9db52abd24eb42b986916ad39d7ad88c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:03.688423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4b64e-64f3-4dbc-8bf7-b71ff6778536 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:03.939929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-32e4b64e-64f3-4dbc-8bf7-b71ff6778536 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invalidating the token cache because role 9db52abd24eb42b986916ad39d7ad88c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:03.942854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-32e4b64e-64f3-4dbc-8bf7-b71ff6778536 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:03.946581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-32e4b64e-64f3-4dbc-8bf7-b71ff6778536 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:03.955057 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2122/4182] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:03 2022] DELETE /identity/v3/roles/9db52abd24eb42b986916ad39d7ad88c => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:03.964123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4b64e-64f3-4dbc-8bf7-b71ff6778536 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:03.966738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-32e4b64e-64f3-4dbc-8bf7-b71ff6778536 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:03.982628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cb7736d2-6734-4204-a90b-85c075725ed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcaaa4fa1f8c498789224ecdc2ada38d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:04.001175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cb7736d2-6734-4204-a90b-85c075725ed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcaaa4fa1f8c498789224ecdc2ada38d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:04.058392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:04.117138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cb7736d2-6734-4204-a90b-85c075725ed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcaaa4fa1f8c498789224ecdc2ada38d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:04.130102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cb7736d2-6734-4204-a90b-85c075725ed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcaaa4fa1f8c498789224ecdc2ada38d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:04.134981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cb7736d2-6734-4204-a90b-85c075725ed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcaaa4fa1f8c498789224ecdc2ada38d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:04.151291 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2061/4183] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:03 2022] DELETE /identity/v3/users/dcaaa4fa1f8c498789224ecdc2ada38d => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:04.168440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4b64e-64f3-4dbc-8bf7-b71ff6778536 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:04.350064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200913a0-5d40-4bd1-8bcb-928864143cba tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:04.351407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200913a0-5d40-4bd1-8bcb-928864143cba tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:04.352050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200913a0-5d40-4bd1-8bcb-928864143cba tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:04.353010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200913a0-5d40-4bd1-8bcb-928864143cba tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles/862715cf59d745289b6cb813af26134c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:04.354153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200913a0-5d40-4bd1-8bcb-928864143cba tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_role(role_id=862715cf59d745289b6cb813af26134c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:04.355982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200913a0-5d40-4bd1-8bcb-928864143cba tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:04.489029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:04.617624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-200913a0-5d40-4bd1-8bcb-928864143cba tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invalidating the token cache because role 862715cf59d745289b6cb813af26134c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:04.618998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-200913a0-5d40-4bd1-8bcb-928864143cba tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:04.620049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-200913a0-5d40-4bd1-8bcb-928864143cba tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:04.628581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7736d2-6734-4204-a90b-85c075725ed9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:04.629480 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2123/4184] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:03 2022] DELETE /identity/v3/roles/862715cf59d745289b6cb813af26134c => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:04.630195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cb7736d2-6734-4204-a90b-85c075725ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:04.658079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7736d2-6734-4204-a90b-85c075725ed9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:04.731090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f5312-49c7-4d4b-9ec4-575a950d9924 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:04.732065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f5312-49c7-4d4b-9ec4-575a950d9924 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:04.732354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f5312-49c7-4d4b-9ec4-575a950d9924 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:04.732636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f5312-49c7-4d4b-9ec4-575a950d9924 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/users/2e9897fc240a41bfb6cbe095a18977b3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:04.737708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f5312-49c7-4d4b-9ec4-575a950d9924 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2e9897fc240a41bfb6cbe095a18977b3)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:04.740000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f5312-49c7-4d4b-9ec4-575a950d9924 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:04.749962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bfad1-7c1f-4fbd-bbca-a587c7aebd56 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:04.753889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bfad1-7c1f-4fbd-bbca-a587c7aebd56 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:04.753889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bfad1-7c1f-4fbd-bbca-a587c7aebd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:04.781062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-008bfad1-7c1f-4fbd-bbca-a587c7aebd56 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:04.782492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-008bfad1-7c1f-4fbd-bbca-a587c7aebd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:04.903764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2c3f5312-49c7-4d4b-9ec4-575a950d9924 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9897fc240a41bfb6cbe095a18977b3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:04.928076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2c3f5312-49c7-4d4b-9ec4-575a950d9924 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9897fc240a41bfb6cbe095a18977b3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:04.946104 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2124/4185] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:21:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:05.021332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2c3f5312-49c7-4d4b-9ec4-575a950d9924 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9897fc240a41bfb6cbe095a18977b3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:05.031686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2c3f5312-49c7-4d4b-9ec4-575a950d9924 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9897fc240a41bfb6cbe095a18977b3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:05.036529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2c3f5312-49c7-4d4b-9ec4-575a950d9924 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9897fc240a41bfb6cbe095a18977b3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:05.051562 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2062/4186] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:04 2022] DELETE /identity/v3/users/2e9897fc240a41bfb6cbe095a18977b3 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:05.055755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bfad1-7c1f-4fbd-bbca-a587c7aebd56 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:05.057717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-008bfad1-7c1f-4fbd-bbca-a587c7aebd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:05.095100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bfad1-7c1f-4fbd-bbca-a587c7aebd56 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:05.099755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f5312-49c7-4d4b-9ec4-575a950d9924 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:05.101429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2c3f5312-49c7-4d4b-9ec4-575a950d9924 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:05.220498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe24258-0a41-4560-b4c6-c9c4c7da0651 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:05.222786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe24258-0a41-4560-b4c6-c9c4c7da0651 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:05.223431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe24258-0a41-4560-b4c6-c9c4c7da0651 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:05.231736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe24258-0a41-4560-b4c6-c9c4c7da0651 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects/7aa3b8c83c1d44ada240a408946820a1` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:05.231736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe24258-0a41-4560-b4c6-c9c4c7da0651 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7aa3b8c83c1d44ada240a408946820a1)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:05.231736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe24258-0a41-4560-b4c6-c9c4c7da0651 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:05.237555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f5312-49c7-4d4b-9ec4-575a950d9924 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:05.245259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4b764-f610-4f86-af48-48e73bab8589 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:05.246058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4b764-f610-4f86-af48-48e73bab8589 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:05.246422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4b764-f610-4f86-af48-48e73bab8589 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:05.246890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4b764-f610-4f86-af48-48e73bab8589 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:05.249302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-01a4b764-f610-4f86-af48-48e73bab8589 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:05.355941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4b764-f610-4f86-af48-48e73bab8589 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:05.359270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4b764-f610-4f86-af48-48e73bab8589 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:05.398841 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2063/4187] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:21:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:21:05.646172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4b764-f610-4f86-af48-48e73bab8589 service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:05.650508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-01a4b764-f610-4f86-af48-48e73bab8589 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:05.683294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6fe24258-0a41-4560-b4c6-c9c4c7da0651 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aa3b8c83c1d44ada240a408946820a1', 'request_id': 'req-6fe24258-0a41-4560-b4c6-c9c4c7da0651'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:05.693322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6fe24258-0a41-4560-b4c6-c9c4c7da0651 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aa3b8c83c1d44ada240a408946820a1', 'request_id': 'req-6fe24258-0a41-4560-b4c6-c9c4c7da0651'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:05.738015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6fe24258-0a41-4560-b4c6-c9c4c7da0651 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aa3b8c83c1d44ada240a408946820a1', 'request_id': 'req-6fe24258-0a41-4560-b4c6-c9c4c7da0651'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:05.854415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6fe24258-0a41-4560-b4c6-c9c4c7da0651 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] The token cache is being invalidate because project 7aa3b8c83c1d44ada240a408946820a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:05.854770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6fe24258-0a41-4560-b4c6-c9c4c7da0651 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:05.858697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6fe24258-0a41-4560-b4c6-c9c4c7da0651 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:05.859780 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2125/4188] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:05 2022] DELETE /identity/v3/projects/7aa3b8c83c1d44ada240a408946820a1 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:21:05.869018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe24258-0a41-4560-b4c6-c9c4c7da0651 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:05.873479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6fe24258-0a41-4560-b4c6-c9c4c7da0651 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:05.956949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4b764-f610-4f86-af48-48e73bab8589 service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:06.105737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cddad1-fdba-49c2-9913-13133064b754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:06.107275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cddad1-fdba-49c2-9913-13133064b754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:06.107435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cddad1-fdba-49c2-9913-13133064b754 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:06.108533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cddad1-fdba-49c2-9913-13133064b754 admin admin] PATH_INFO: `/v3/projects/b769f87a3fe44032a966f766295c5465` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:06.110513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cddad1-fdba-49c2-9913-13133064b754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b769f87a3fe44032a966f766295c5465)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:06.115931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cddad1-fdba-49c2-9913-13133064b754 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:06.159264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe24258-0a41-4560-b4c6-c9c4c7da0651 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:06.173479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a0f16-a3e6-4d14-8422-f53b04ea0fae tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:06.176159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a0f16-a3e6-4d14-8422-f53b04ea0fae tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:06.177747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a0f16-a3e6-4d14-8422-f53b04ea0fae tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:06.177946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a0f16-a3e6-4d14-8422-f53b04ea0fae tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:06.181299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a0f16-a3e6-4d14-8422-f53b04ea0fae tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:06.190378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a0f16-a3e6-4d14-8422-f53b04ea0fae tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:06.302093 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2126/4189] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Jul 16 21:21:05 2022] POST /identity/v3/projects => generated 328 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:06.308323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a0f16-a3e6-4d14-8422-f53b04ea0fae tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:06.342198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-86cddad1-fdba-49c2-9913-13133064b754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b769f87a3fe44032a966f766295c5465', 'request_id': 'req-86cddad1-fdba-49c2-9913-13133064b754'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:06.377686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-86cddad1-fdba-49c2-9913-13133064b754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b769f87a3fe44032a966f766295c5465', 'request_id': 'req-86cddad1-fdba-49c2-9913-13133064b754'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:06.408750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-86cddad1-fdba-49c2-9913-13133064b754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b769f87a3fe44032a966f766295c5465', 'request_id': 'req-86cddad1-fdba-49c2-9913-13133064b754'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:06.454761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a0f16-a3e6-4d14-8422-f53b04ea0fae tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:06.462420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c987927-23fa-4b87-9eb4-877a056d646f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:06.464133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c987927-23fa-4b87-9eb4-877a056d646f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:06.464520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c987927-23fa-4b87-9eb4-877a056d646f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:06.465035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c987927-23fa-4b87-9eb4-877a056d646f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:06.466482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c987927-23fa-4b87-9eb4-877a056d646f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:06.469321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c987927-23fa-4b87-9eb4-877a056d646f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:06.515705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-86cddad1-fdba-49c2-9913-13133064b754 admin admin] The token cache is being invalidate because project b769f87a3fe44032a966f766295c5465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:06.517133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-86cddad1-fdba-49c2-9913-13133064b754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:06.517612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-86cddad1-fdba-49c2-9913-13133064b754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:06.526959 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2064/4190] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:05 2022] DELETE /identity/v3/projects/b769f87a3fe44032a966f766295c5465 => generated 0 bytes in 882 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:06.530036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80bf93-4a67-4d7a-925e-a4c7d20dfef8 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:06.530794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80bf93-4a67-4d7a-925e-a4c7d20dfef8 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:06.531826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80bf93-4a67-4d7a-925e-a4c7d20dfef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:06.601338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-fa80bf93-4a67-4d7a-925e-a4c7d20dfef8 None None] MFA Rules not processed for user `bba77f6ef42547f1aa8480e27868bd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:06.602593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fa80bf93-4a67-4d7a-925e-a4c7d20dfef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:06.621119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:06.635844 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2127/4191] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:21:06 2022] POST /identity/v3/users => generated 413 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:06.637374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd4376-08b8-4cc0-a419-ed1f3acf8d49 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:06.637670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd4376-08b8-4cc0-a419-ed1f3acf8d49 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:06.637980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd4376-08b8-4cc0-a419-ed1f3acf8d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:06.709291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-74bd4376-08b8-4cc0-a419-ed1f3acf8d49 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:06.710612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-74bd4376-08b8-4cc0-a419-ed1f3acf8d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:06.716097 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2065/4192] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:06.719767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80bf93-4a67-4d7a-925e-a4c7d20dfef8 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:06.725756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fa80bf93-4a67-4d7a-925e-a4c7d20dfef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:06.777544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80bf93-4a67-4d7a-925e-a4c7d20dfef8 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:06.804782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e27c4-dbb8-4482-99cb-f3e2e58c76ca tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:06.805925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e27c4-dbb8-4482-99cb-f3e2e58c76ca tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:06.806490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e27c4-dbb8-4482-99cb-f3e2e58c76ca tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:06.807129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e27c4-dbb8-4482-99cb-f3e2e58c76ca tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:06.808344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e27c4-dbb8-4482-99cb-f3e2e58c76ca tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:06.813982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e27c4-dbb8-4482-99cb-f3e2e58c76ca tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:06.871636 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2128/4193] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:06.882150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece4cef-4c6c-4d66-8b0a-e52202bf8329 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:06.887549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece4cef-4c6c-4d66-8b0a-e52202bf8329 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:06.888005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece4cef-4c6c-4d66-8b0a-e52202bf8329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:06.945942 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2066/4194] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:21:06 2022] POST /identity/v3/roles => generated 243 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:06.951916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-aece4cef-4c6c-4d66-8b0a-e52202bf8329 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:06.952318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e27c4-dbb8-4482-99cb-f3e2e58c76ca tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:06.956335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-aece4cef-4c6c-4d66-8b0a-e52202bf8329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:06.979985 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2129/4195] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:06.984951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece4cef-4c6c-4d66-8b0a-e52202bf8329 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:06.994738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e27c4-dbb8-4482-99cb-f3e2e58c76ca tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:07.017358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fa6dc-3a74-4bb9-9462-d9a8773f1aa5 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:07.017634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece4cef-4c6c-4d66-8b0a-e52202bf8329 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:07.018449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fa6dc-3a74-4bb9-9462-d9a8773f1aa5 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:07.018903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fa6dc-3a74-4bb9-9462-d9a8773f1aa5 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:07.019228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fa6dc-3a74-4bb9-9462-d9a8773f1aa5 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:07.022921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279a7d4-7bbf-4148-949e-21b2478639ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:07.023435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fa6dc-3a74-4bb9-9462-d9a8773f1aa5 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:07.023810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279a7d4-7bbf-4148-949e-21b2478639ab admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:07.024182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279a7d4-7bbf-4148-949e-21b2478639ab admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:07.024527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279a7d4-7bbf-4148-949e-21b2478639ab admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:07.025349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279a7d4-7bbf-4148-949e-21b2478639ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:21:07.025731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279a7d4-7bbf-4148-949e-21b2478639ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:07.026131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fa6dc-3a74-4bb9-9462-d9a8773f1aa5 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:07.027596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279a7d4-7bbf-4148-949e-21b2478639ab admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:07.044410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:07.052319 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2130/4196] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:07.053633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279a7d4-7bbf-4148-949e-21b2478639ab admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:07.083104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279a7d4-7bbf-4148-949e-21b2478639ab admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:07.089084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964cc27-0502-408d-bab6-fc6b872cbc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:07.089916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964cc27-0502-408d-bab6-fc6b872cbc87 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:07.090304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964cc27-0502-408d-bab6-fc6b872cbc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:07.090685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964cc27-0502-408d-bab6-fc6b872cbc87 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:07.091634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964cc27-0502-408d-bab6-fc6b872cbc87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:07.094360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964cc27-0502-408d-bab6-fc6b872cbc87 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:07.167377 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2067/4197] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:21:06 2022] POST /identity/v3/roles => generated 247 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:07.172226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fa6dc-3a74-4bb9-9462-d9a8773f1aa5 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:07.201688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fa6dc-3a74-4bb9-9462-d9a8773f1aa5 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:07.226505 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2131/4198] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:21:07 2022] POST /identity/v3/projects => generated 395 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:07.228205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7ac03-eb58-4060-bc8f-43c0c037bced tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:07.229236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7ac03-eb58-4060-bc8f-43c0c037bced tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:07.229572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964cc27-0502-408d-bab6-fc6b872cbc87 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:07.229709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7ac03-eb58-4060-bc8f-43c0c037bced tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:07.230069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7ac03-eb58-4060-bc8f-43c0c037bced tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects/b3f58e5c83ce4ccc875d998a32bdfc24/users/90dad8ad2f634c09b087c741e5ccf94b/roles/1b8860e7d1c84d599a6412eb26824fd9` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:07.284523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7ac03-eb58-4060-bc8f-43c0c037bced tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b3f58e5c83ce4ccc875d998a32bdfc24, user_id=90dad8ad2f634c09b087c741e5ccf94b, role_id=1b8860e7d1c84d599a6412eb26824fd9)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:07.288071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7ac03-eb58-4060-bc8f-43c0c037bced tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:07.370035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964cc27-0502-408d-bab6-fc6b872cbc87 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:07.376367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201087c3-dd61-426a-8886-0fd81fef221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:07.378235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201087c3-dd61-426a-8886-0fd81fef221d admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:07.378691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201087c3-dd61-426a-8886-0fd81fef221d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:07.379295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201087c3-dd61-426a-8886-0fd81fef221d admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:07.380249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201087c3-dd61-426a-8886-0fd81fef221d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:07.382514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201087c3-dd61-426a-8886-0fd81fef221d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:07.396096 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2068/4199] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:07 2022] PUT /identity/v3/projects/b3f58e5c83ce4ccc875d998a32bdfc24/users/90dad8ad2f634c09b087c741e5ccf94b/roles/1b8860e7d1c84d599a6412eb26824fd9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:07.400460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7ac03-eb58-4060-bc8f-43c0c037bced tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:07.476916 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2132/4200] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:21:07 2022] POST /identity/v3/users => generated 298 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:07.476916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201087c3-dd61-426a-8886-0fd81fef221d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:07.507806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201087c3-dd61-426a-8886-0fd81fef221d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:07.573265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7ac03-eb58-4060-bc8f-43c0c037bced tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:07.590080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa509525-e0f2-4453-adf5-2ea7dea9d50f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:07.591175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa509525-e0f2-4453-adf5-2ea7dea9d50f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:07.591731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa509525-e0f2-4453-adf5-2ea7dea9d50f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:07.592339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa509525-e0f2-4453-adf5-2ea7dea9d50f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects/b3f58e5c83ce4ccc875d998a32bdfc24/users/90dad8ad2f634c09b087c741e5ccf94b/roles/82ff5c0265a94749a0906d7571f29117` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:07.603363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa509525-e0f2-4453-adf5-2ea7dea9d50f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b3f58e5c83ce4ccc875d998a32bdfc24, user_id=90dad8ad2f634c09b087c741e5ccf94b, role_id=82ff5c0265a94749a0906d7571f29117)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:07.606067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa509525-e0f2-4453-adf5-2ea7dea9d50f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:07.677265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13951de7-448f-407b-839c-caa12321516c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:07.678572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13951de7-448f-407b-839c-caa12321516c admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:07.678856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13951de7-448f-407b-839c-caa12321516c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:07.679154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13951de7-448f-407b-839c-caa12321516c admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:07.680397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13951de7-448f-407b-839c-caa12321516c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:07.686539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13951de7-448f-407b-839c-caa12321516c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:07.710546 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2133/4201] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:07 2022] GET /identity/v3/roles => generated 1892 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:07.714405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13951de7-448f-407b-839c-caa12321516c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:07.734255 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2069/4202] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:07 2022] PUT /identity/v3/projects/b3f58e5c83ce4ccc875d998a32bdfc24/users/90dad8ad2f634c09b087c741e5ccf94b/roles/82ff5c0265a94749a0906d7571f29117 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:21:07.739354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa509525-e0f2-4453-adf5-2ea7dea9d50f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:07.739541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13951de7-448f-407b-839c-caa12321516c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:07.881644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa509525-e0f2-4453-adf5-2ea7dea9d50f tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:07.890580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6840d-fc00-4952-b30f-3d7341118f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:07.890907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e5d5a-a9fe-49d4-b0f4-9a5687275f8b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:07.891298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6840d-fc00-4952-b30f-3d7341118f2d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:07.891583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6840d-fc00-4952-b30f-3d7341118f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:07.891863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6840d-fc00-4952-b30f-3d7341118f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:07.892480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e5d5a-a9fe-49d4-b0f4-9a5687275f8b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:07.893382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e5d5a-a9fe-49d4-b0f4-9a5687275f8b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:07.893802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e5d5a-a9fe-49d4-b0f4-9a5687275f8b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:07.894784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6840d-fc00-4952-b30f-3d7341118f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:07.895322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e5d5a-a9fe-49d4-b0f4-9a5687275f8b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:07.897318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e5d5a-a9fe-49d4-b0f4-9a5687275f8b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:07.901704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6840d-fc00-4952-b30f-3d7341118f2d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:07.927710 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2134/4203] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:07 2022] GET /identity/v3/roles => generated 1892 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:07.934053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6840d-fc00-4952-b30f-3d7341118f2d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:07.952634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6840d-fc00-4952-b30f-3d7341118f2d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:07.959304 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2070/4204] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:07 2022] GET /identity/v3/users => generated 8351 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:07.964117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18596514-c2fa-4edb-b2ca-f2e21740e203 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:07.967325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18596514-c2fa-4edb-b2ca-f2e21740e203 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:07.967325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18596514-c2fa-4edb-b2ca-f2e21740e203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:07.973958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982cb42-5666-4429-89b0-85ae47b0bb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:07.975175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982cb42-5666-4429-89b0-85ae47b0bb15 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:07.975468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982cb42-5666-4429-89b0-85ae47b0bb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:07.975751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982cb42-5666-4429-89b0-85ae47b0bb15 admin admin] PATH_INFO: `/v3/projects/b34a195db6e143699e2f5beb376f3a47/users/65cc5e35069643b4831b03b0c547ab18/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:07.995570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982cb42-5666-4429-89b0-85ae47b0bb15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b34a195db6e143699e2f5beb376f3a47, user_id=65cc5e35069643b4831b03b0c547ab18, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:08.000078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982cb42-5666-4429-89b0-85ae47b0bb15 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:08.014430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:08.064202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-18596514-c2fa-4edb-b2ca-f2e21740e203 None None] MFA Rules not processed for user `90dad8ad2f634c09b087c741e5ccf94b`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:08.066487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-18596514-c2fa-4edb-b2ca-f2e21740e203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:08.139518 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2135/4205] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:07 2022] PUT /identity/v3/projects/b34a195db6e143699e2f5beb376f3a47/users/65cc5e35069643b4831b03b0c547ab18/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:08.144466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ee14d-9048-41d8-9775-c17f75f57ba6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:08.144466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ee14d-9048-41d8-9775-c17f75f57ba6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:08.147741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ee14d-9048-41d8-9775-c17f75f57ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:08.187644 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2071/4206] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:08.199233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbc314-a0f5-4f3d-ae9a-96c3ece26fbd None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:08.199992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbc314-a0f5-4f3d-ae9a-96c3ece26fbd None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:08.200746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbc314-a0f5-4f3d-ae9a-96c3ece26fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:08.225901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-66cbc314-a0f5-4f3d-ae9a-96c3ece26fbd None None] MFA Rules not processed for user `90dad8ad2f634c09b087c741e5ccf94b`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:08.227397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-66cbc314-a0f5-4f3d-ae9a-96c3ece26fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:08.231665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-007ee14d-9048-41d8-9775-c17f75f57ba6 None None] MFA Rules not processed for user `65cc5e35069643b4831b03b0c547ab18`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:08.232956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-007ee14d-9048-41d8-9775-c17f75f57ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:08.321776 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2072/4207] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:08.326340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbc314-a0f5-4f3d-ae9a-96c3ece26fbd None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:08.339513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbc314-a0f5-4f3d-ae9a-96c3ece26fbd None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:08.344996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3fdc1-7ced-4aed-8af3-0b28c3ac06b1 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad8ad2f634c09b087c741e5ccf94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3f58e5c83ce4ccc875d998a32bdfc24', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1714964496', 'tempest-DelegatedRole-880505611'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:08.347389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3fdc1-7ced-4aed-8af3-0b28c3ac06b1 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:08.347389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3fdc1-7ced-4aed-8af3-0b28c3ac06b1 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:08.347389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3fdc1-7ced-4aed-8af3-0b28c3ac06b1 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:08.348059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3fdc1-7ced-4aed-8af3-0b28c3ac06b1 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: Authorizing `identity:create_trust()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:08.349410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3fdc1-7ced-4aed-8af3-0b28c3ac06b1 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:08.429497 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2136/4208] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:08.434294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ee14d-9048-41d8-9775-c17f75f57ba6 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:08.519952 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2073/4209] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Jul 16 21:21:08 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:08.521681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3fdc1-7ced-4aed-8af3-0b28c3ac06b1 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:08.542906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3fdc1-7ced-4aed-8af3-0b28c3ac06b1 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:08.557990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84965b89-74ae-4f88-b932-e1f06189d945 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad8ad2f634c09b087c741e5ccf94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3f58e5c83ce4ccc875d998a32bdfc24', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1714964496', 'tempest-DelegatedRole-880505611'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:08.557990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84965b89-74ae-4f88-b932-e1f06189d945 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:08.558727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84965b89-74ae-4f88-b932-e1f06189d945 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:08.559323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84965b89-74ae-4f88-b932-e1f06189d945 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] PATH_INFO: `/v3/OS-TRUST/trusts/0587d637db9f4b319e22a9ed2b6a871a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:08.567738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84965b89-74ae-4f88-b932-e1f06189d945 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: Authorizing `identity:get_trust(trust_id=0587d637db9f4b319e22a9ed2b6a871a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:08.570288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84965b89-74ae-4f88-b932-e1f06189d945 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:08.581162 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2074/4210] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jul 16 21:21:08 2022] GET /identity/v3/OS-TRUST/trusts/0587d637db9f4b319e22a9ed2b6a871a => generated 834 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:21:08.581865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ee14d-9048-41d8-9775-c17f75f57ba6 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:08.586240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84965b89-74ae-4f88-b932-e1f06189d945 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:08.594032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2601c-4e79-4fd0-9d95-4a24a828790f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:08.594731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2601c-4e79-4fd0-9d95-4a24a828790f admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:08.595043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2601c-4e79-4fd0-9d95-4a24a828790f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:08.595342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2601c-4e79-4fd0-9d95-4a24a828790f admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:08.596078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2601c-4e79-4fd0-9d95-4a24a828790f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:08.600057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84965b89-74ae-4f88-b932-e1f06189d945 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:08.603220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2601c-4e79-4fd0-9d95-4a24a828790f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:08.606939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7b2f7-087a-469a-a229-574f61d5c2aa tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad8ad2f634c09b087c741e5ccf94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3f58e5c83ce4ccc875d998a32bdfc24', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1714964496', 'tempest-DelegatedRole-880505611'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:08.607962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7b2f7-087a-469a-a229-574f61d5c2aa tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:08.608815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7b2f7-087a-469a-a229-574f61d5c2aa tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:08.609182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7b2f7-087a-469a-a229-574f61d5c2aa tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] PATH_INFO: `/v3/OS-TRUST/trusts/0587d637db9f4b319e22a9ed2b6a871a/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:08.618415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7b2f7-087a-469a-a229-574f61d5c2aa tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=0587d637db9f4b319e22a9ed2b6a871a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:08.620546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7b2f7-087a-469a-a229-574f61d5c2aa tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:08.636820 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2075/4211] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Jul 16 21:21:08 2022] GET /identity/v3/OS-TRUST/trusts/0587d637db9f4b319e22a9ed2b6a871a/roles => generated 370 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:08.641471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7b2f7-087a-469a-a229-574f61d5c2aa tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:08.654315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7b2f7-087a-469a-a229-574f61d5c2aa tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:08.659787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220c2fb-6da1-4954-a100-358272905178 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad8ad2f634c09b087c741e5ccf94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3f58e5c83ce4ccc875d998a32bdfc24', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1714964496', 'tempest-DelegatedRole-880505611'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:08.663128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220c2fb-6da1-4954-a100-358272905178 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:08.663128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220c2fb-6da1-4954-a100-358272905178 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:08.663790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220c2fb-6da1-4954-a100-358272905178 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] PATH_INFO: `/v3/OS-TRUST/trusts/0587d637db9f4b319e22a9ed2b6a871a/roles/1b8860e7d1c84d599a6412eb26824fd9` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:08.678975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220c2fb-6da1-4954-a100-358272905178 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0587d637db9f4b319e22a9ed2b6a871a, role_id=1b8860e7d1c84d599a6412eb26824fd9)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:08.681188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220c2fb-6da1-4954-a100-358272905178 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:08.703971 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2076/4212] 10.222.0.16 () {58 vars in 1367 bytes} [Sat Jul 16 21:21:08 2022] GET /identity/v3/OS-TRUST/trusts/0587d637db9f4b319e22a9ed2b6a871a/roles/1b8860e7d1c84d599a6412eb26824fd9 => generated 243 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:08.721230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220c2fb-6da1-4954-a100-358272905178 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:08.723448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:08.735196 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2137/4213] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:21:08 2022] POST /identity/v3/projects => generated 393 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:21:08.738790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2601c-4e79-4fd0-9d95-4a24a828790f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:08.755572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220c2fb-6da1-4954-a100-358272905178 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:08.854072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2601c-4e79-4fd0-9d95-4a24a828790f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:08.869020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4a9e0-a1b8-4939-91e9-b055ec53da1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:08.869283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4a9e0-a1b8-4939-91e9-b055ec53da1e admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:08.869547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4a9e0-a1b8-4939-91e9-b055ec53da1e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:08.869832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4a9e0-a1b8-4939-91e9-b055ec53da1e admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:08.870529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4a9e0-a1b8-4939-91e9-b055ec53da1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:08.879418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4a9e0-a1b8-4939-91e9-b055ec53da1e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:08.940890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527c936-01e0-4d8a-abd0-73335ad73315 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad8ad2f634c09b087c741e5ccf94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3f58e5c83ce4ccc875d998a32bdfc24', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1714964496', 'tempest-DelegatedRole-880505611'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:08.942215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527c936-01e0-4d8a-abd0-73335ad73315 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] REQUEST_METHOD: `HEAD` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:08.942600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527c936-01e0-4d8a-abd0-73335ad73315 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:08.943021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527c936-01e0-4d8a-abd0-73335ad73315 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] PATH_INFO: `/v3/OS-TRUST/trusts/0587d637db9f4b319e22a9ed2b6a871a/roles/1b8860e7d1c84d599a6412eb26824fd9` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:08.949692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527c936-01e0-4d8a-abd0-73335ad73315 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0587d637db9f4b319e22a9ed2b6a871a, role_id=1b8860e7d1c84d599a6412eb26824fd9)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:08.951372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527c936-01e0-4d8a-abd0-73335ad73315 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:08.963075 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2077/4214] 10.222.0.16 () {58 vars in 1368 bytes} [Sat Jul 16 21:21:08 2022] HEAD /identity/v3/OS-TRUST/trusts/0587d637db9f4b319e22a9ed2b6a871a/roles/1b8860e7d1c84d599a6412eb26824fd9 => generated 0 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 16 21:21:08.967520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527c936-01e0-4d8a-abd0-73335ad73315 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:08.978824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527c936-01e0-4d8a-abd0-73335ad73315 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:08.984939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194973be-25bc-41e9-9de6-f6f38c3e11eb tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad8ad2f634c09b087c741e5ccf94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3f58e5c83ce4ccc875d998a32bdfc24', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1714964496', 'tempest-DelegatedRole-880505611'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:08.986308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194973be-25bc-41e9-9de6-f6f38c3e11eb tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:08.986595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194973be-25bc-41e9-9de6-f6f38c3e11eb tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:08.987668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194973be-25bc-41e9-9de6-f6f38c3e11eb tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] PATH_INFO: `/v3/OS-TRUST/trusts/0587d637db9f4b319e22a9ed2b6a871a/roles/82ff5c0265a94749a0906d7571f29117` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:08.996034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194973be-25bc-41e9-9de6-f6f38c3e11eb tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0587d637db9f4b319e22a9ed2b6a871a, role_id=82ff5c0265a94749a0906d7571f29117)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:08.997617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194973be-25bc-41e9-9de6-f6f38c3e11eb tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:08.998514 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2138/4215] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:21:08 2022] POST /identity/v3/users => generated 303 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:21:08.999820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4a9e0-a1b8-4939-91e9-b055ec53da1e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:09.010380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4a9e0-a1b8-4939-91e9-b055ec53da1e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:09.013869 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-194973be-25bc-41e9-9de6-f6f38c3e11eb tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Could not find role: 82ff5c0265a94749a0906d7571f29117.: keystone.exception.RoleNotFound: Could not find role: 82ff5c0265a94749a0906d7571f29117. Jul 16 21:21:09.013869 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:09.013869 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:21:09.013869 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:21:09.013869 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:21:09.013869 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:21:09.013869 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:21:09.013869 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:21:09.013869 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:21:09.013869 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:21:09.013869 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:21:09.013869 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:21:09.013869 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 16 21:21:09.013869 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 21:21:09.015755 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 82ff5c0265a94749a0906d7571f29117. Jul 16 21:21:09.015755 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:21:09.017526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d7a33-4373-418a-80e4-555df533767a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:09.018878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d7a33-4373-418a-80e4-555df533767a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:09.019233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d7a33-4373-418a-80e4-555df533767a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:09.019473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d7a33-4373-418a-80e4-555df533767a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:09.020401 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2078/4216] 10.222.0.16 () {58 vars in 1367 bytes} [Sat Jul 16 21:21:08 2022] GET /identity/v3/OS-TRUST/trusts/0587d637db9f4b319e22a9ed2b6a871a/roles/82ff5c0265a94749a0906d7571f29117 => generated 110 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 16 21:21:09.021329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194973be-25bc-41e9-9de6-f6f38c3e11eb tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:09.031842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d7a33-4373-418a-80e4-555df533767a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:09.032011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194973be-25bc-41e9-9de6-f6f38c3e11eb tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:09.040974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419281a7-e01b-437a-a443-751798223460 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad8ad2f634c09b087c741e5ccf94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3f58e5c83ce4ccc875d998a32bdfc24', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1714964496', 'tempest-DelegatedRole-880505611'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:09.042872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419281a7-e01b-437a-a443-751798223460 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] REQUEST_METHOD: `HEAD` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:09.043853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419281a7-e01b-437a-a443-751798223460 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:09.044308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419281a7-e01b-437a-a443-751798223460 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] PATH_INFO: `/v3/OS-TRUST/trusts/0587d637db9f4b319e22a9ed2b6a871a/roles/82ff5c0265a94749a0906d7571f29117` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:09.048235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d7a33-4373-418a-80e4-555df533767a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:09.057159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419281a7-e01b-437a-a443-751798223460 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0587d637db9f4b319e22a9ed2b6a871a, role_id=82ff5c0265a94749a0906d7571f29117)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:09.059078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419281a7-e01b-437a-a443-751798223460 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:09.075894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-419281a7-e01b-437a-a443-751798223460 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Could not find role: 82ff5c0265a94749a0906d7571f29117.: keystone.exception.RoleNotFound: Could not find role: 82ff5c0265a94749a0906d7571f29117. Jul 16 21:21:09.075894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:09.075894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:21:09.075894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:21:09.075894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:21:09.075894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:21:09.075894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:21:09.075894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:21:09.075894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:21:09.075894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:21:09.075894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:21:09.075894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:21:09.075894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 16 21:21:09.075894 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 21:21:09.076960 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 82ff5c0265a94749a0906d7571f29117. Jul 16 21:21:09.076960 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:21:09.077894 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2139/4217] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:08 2022] GET /identity/v3/roles => generated 1892 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:09.078731 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2079/4218] 10.222.0.16 () {58 vars in 1368 bytes} [Sat Jul 16 21:21:09 2022] HEAD /identity/v3/OS-TRUST/trusts/0587d637db9f4b319e22a9ed2b6a871a/roles/82ff5c0265a94749a0906d7571f29117 => generated 0 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jul 16 21:21:09.079001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d7a33-4373-418a-80e4-555df533767a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:09.084287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419281a7-e01b-437a-a443-751798223460 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:09.098787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419281a7-e01b-437a-a443-751798223460 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:09.099919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d7a33-4373-418a-80e4-555df533767a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:09.104844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87607bde-43f7-4a1e-ad2f-bcf09eb615ab tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad8ad2f634c09b087c741e5ccf94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3f58e5c83ce4ccc875d998a32bdfc24', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1714964496', 'tempest-DelegatedRole-880505611'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:09.106392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87607bde-43f7-4a1e-ad2f-bcf09eb615ab tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:09.106780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87607bde-43f7-4a1e-ad2f-bcf09eb615ab tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:09.107049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fe355-9bc8-4083-9852-206fe54d8a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:09.107925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87607bde-43f7-4a1e-ad2f-bcf09eb615ab tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] PATH_INFO: `/v3/OS-TRUST/trusts/0587d637db9f4b319e22a9ed2b6a871a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:09.108482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fe355-9bc8-4083-9852-206fe54d8a18 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:09.108926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fe355-9bc8-4083-9852-206fe54d8a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:09.109348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fe355-9bc8-4083-9852-206fe54d8a18 admin admin] PATH_INFO: `/v3/projects/6f8a693df0a84ebf8387d5325aac7bb1/users/f241735c131d415daaab8f1e36de33c2/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:09.137879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87607bde-43f7-4a1e-ad2f-bcf09eb615ab tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: Authorizing `identity:delete_trust(trust_id=0587d637db9f4b319e22a9ed2b6a871a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:09.139879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87607bde-43f7-4a1e-ad2f-bcf09eb615ab tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:09.147193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fe355-9bc8-4083-9852-206fe54d8a18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f8a693df0a84ebf8387d5325aac7bb1, user_id=f241735c131d415daaab8f1e36de33c2, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:09.156315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fe355-9bc8-4083-9852-206fe54d8a18 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:09.245274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:09.302886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-87607bde-43f7-4a1e-ad2f-bcf09eb615ab tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '0587d637db9f4b319e22a9ed2b6a871a', 'request_id': 'req-87607bde-43f7-4a1e-ad2f-bcf09eb615ab'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:09.305433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-87607bde-43f7-4a1e-ad2f-bcf09eb615ab tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '0587d637db9f4b319e22a9ed2b6a871a', 'request_id': 'req-87607bde-43f7-4a1e-ad2f-bcf09eb615ab'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:09.307483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-87607bde-43f7-4a1e-ad2f-bcf09eb615ab tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '0587d637db9f4b319e22a9ed2b6a871a', 'request_id': 'req-87607bde-43f7-4a1e-ad2f-bcf09eb615ab'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:09.313967 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2140/4219] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:09 2022] PUT /identity/v3/projects/6f8a693df0a84ebf8387d5325aac7bb1/users/f241735c131d415daaab8f1e36de33c2/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:09.321587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fe355-9bc8-4083-9852-206fe54d8a18 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:09.323523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-873fe355-9bc8-4083-9852-206fe54d8a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:09.455682 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2080/4220] 10.222.0.16 () {58 vars in 1253 bytes} [Sat Jul 16 21:21:09 2022] DELETE /identity/v3/OS-TRUST/trusts/0587d637db9f4b319e22a9ed2b6a871a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:09.456776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87607bde-43f7-4a1e-ad2f-bcf09eb615ab tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:09.466176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fe355-9bc8-4083-9852-206fe54d8a18 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:09.470901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-87607bde-43f7-4a1e-ad2f-bcf09eb615ab tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:09.493102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cd268-a944-485c-9fd4-94ffbbb1028b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:09.499236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cd268-a944-485c-9fd4-94ffbbb1028b admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:09.499236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cd268-a944-485c-9fd4-94ffbbb1028b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:09.499236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cd268-a944-485c-9fd4-94ffbbb1028b admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:09.499236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cd268-a944-485c-9fd4-94ffbbb1028b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:09.500181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87607bde-43f7-4a1e-ad2f-bcf09eb615ab tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:09.504917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cd268-a944-485c-9fd4-94ffbbb1028b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:09.538421 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2141/4221] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:09 2022] GET /identity/v3/roles => generated 1892 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:21:09.539608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cd268-a944-485c-9fd4-94ffbbb1028b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:09.555097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cd268-a944-485c-9fd4-94ffbbb1028b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:09.567037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334ebdb-9fb1-4aba-92c6-815ed03f7653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:09.567963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334ebdb-9fb1-4aba-92c6-815ed03f7653 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:09.568245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334ebdb-9fb1-4aba-92c6-815ed03f7653 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:09.568520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334ebdb-9fb1-4aba-92c6-815ed03f7653 admin admin] PATH_INFO: `/v3/projects/6f8a693df0a84ebf8387d5325aac7bb1/users/f241735c131d415daaab8f1e36de33c2/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:09.570881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334ebdb-9fb1-4aba-92c6-815ed03f7653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f8a693df0a84ebf8387d5325aac7bb1, user_id=f241735c131d415daaab8f1e36de33c2, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:09.573716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334ebdb-9fb1-4aba-92c6-815ed03f7653 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:09.596622 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2142/4222] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:09 2022] PUT /identity/v3/projects/6f8a693df0a84ebf8387d5325aac7bb1/users/f241735c131d415daaab8f1e36de33c2/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:09.598411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0af5e-6bbe-4773-be54-5227852650ad None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:09.598712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0af5e-6bbe-4773-be54-5227852650ad None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:09.598992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0af5e-6bbe-4773-be54-5227852650ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:09.617061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23144d0-4075-4969-8a3e-e8ca9e060350 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad8ad2f634c09b087c741e5ccf94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3f58e5c83ce4ccc875d998a32bdfc24', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1714964496', 'tempest-DelegatedRole-880505611'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:09.617973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23144d0-4075-4969-8a3e-e8ca9e060350 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:09.621853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23144d0-4075-4969-8a3e-e8ca9e060350 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:09.631410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23144d0-4075-4969-8a3e-e8ca9e060350 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] PATH_INFO: `/v3/OS-TRUST/trusts/0587d637db9f4b319e22a9ed2b6a871a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:09.633442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-36d0af5e-6bbe-4773-be54-5227852650ad None None] MFA Rules not processed for user `f241735c131d415daaab8f1e36de33c2`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:09.635337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-36d0af5e-6bbe-4773-be54-5227852650ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:09.653643 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-e23144d0-4075-4969-8a3e-e8ca9e060350 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Could not find trust: 0587d637db9f4b319e22a9ed2b6a871a.: keystone.exception.TrustNotFound: Could not find trust: 0587d637db9f4b319e22a9ed2b6a871a. Jul 16 21:21:09.653643 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:09.653643 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:21:09.653643 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:21:09.653643 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:21:09.653643 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:21:09.653643 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:21:09.653643 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:21:09.653643 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:21:09.653643 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:21:09.653643 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:21:09.653643 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:21:09.653643 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 16 21:21:09.653643 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 16 21:21:09.653643 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 16 21:21:09.660246 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 16 21:21:09.660246 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 16 21:21:09.660246 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 16 21:21:09.660246 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 16 21:21:09.660246 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 16 21:21:09.660246 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:21:09.660246 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:21:09.660246 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 16 21:21:09.660246 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 16 21:21:09.660246 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 16 21:21:09.660246 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 16 21:21:09.660246 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 0587d637db9f4b319e22a9ed2b6a871a. Jul 16 21:21:09.660246 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:21:09.660246 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2081/4223] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Jul 16 21:21:09 2022] GET /identity/v3/OS-TRUST/trusts/0587d637db9f4b319e22a9ed2b6a871a => generated 111 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:21:09.661793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23144d0-4075-4969-8a3e-e8ca9e060350 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:09.672886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e23144d0-4075-4969-8a3e-e8ca9e060350 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:09.790446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:09.800939 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2143/4224] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:09.802577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0af5e-6bbe-4773-be54-5227852650ad None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:09.805375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-36d0af5e-6bbe-4773-be54-5227852650ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:09.815374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23144d0-4075-4969-8a3e-e8ca9e060350 tempest-TrustsV3TestJSON-988320718 tempest-user-668758116] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:09.950461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0af5e-6bbe-4773-be54-5227852650ad None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:09.955355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569121d-e6b1-43a4-aaa6-d8d7451108d4 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:09.956923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569121d-e6b1-43a4-aaa6-d8d7451108d4 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:09.959447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569121d-e6b1-43a4-aaa6-d8d7451108d4 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:09.961327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569121d-e6b1-43a4-aaa6-d8d7451108d4 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles/82ff5c0265a94749a0906d7571f29117` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:09.965421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569121d-e6b1-43a4-aaa6-d8d7451108d4 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_role(role_id=82ff5c0265a94749a0906d7571f29117)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:09.969481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b300f5a-0d88-45c1-9254-017a4118b031 tempest-ProjectsNegativeStaticTestJSON-894575260 tempest-ProjectsNegativeStaticTestJSON-894575260-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65cc5e35069643b4831b03b0c547ab18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34a195db6e143699e2f5beb376f3a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:09.969481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b300f5a-0d88-45c1-9254-017a4118b031 tempest-ProjectsNegativeStaticTestJSON-894575260 tempest-ProjectsNegativeStaticTestJSON-894575260-project] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:09.969481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b300f5a-0d88-45c1-9254-017a4118b031 tempest-ProjectsNegativeStaticTestJSON-894575260 tempest-ProjectsNegativeStaticTestJSON-894575260-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:09.969874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b300f5a-0d88-45c1-9254-017a4118b031 tempest-ProjectsNegativeStaticTestJSON-894575260 tempest-ProjectsNegativeStaticTestJSON-894575260-project] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:09.969874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b300f5a-0d88-45c1-9254-017a4118b031 tempest-ProjectsNegativeStaticTestJSON-894575260 tempest-ProjectsNegativeStaticTestJSON-894575260-project] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:09.971361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569121d-e6b1-43a4-aaa6-d8d7451108d4 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:09.997991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-0b300f5a-0d88-45c1-9254-017a4118b031 tempest-ProjectsNegativeStaticTestJSON-894575260 tempest-ProjectsNegativeStaticTestJSON-894575260-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jul 16 21:21:09.997991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:09.997991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:21:09.997991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:21:09.997991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:21:09.997991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:21:09.997991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:21:09.997991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:21:09.997991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:21:09.997991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:21:09.997991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:21:09.997991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:21:09.997991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Jul 16 21:21:09.997991 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 16 21:21:09.999432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 16 21:21:09.999432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 16 21:21:09.999432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 16 21:21:09.999432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 16 21:21:09.999432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 16 21:21:09.999432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 16 21:21:09.999432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jul 16 21:21:09.999432 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:10.004206 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2144/4225] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Jul 16 21:21:09 2022] POST /identity/v3/projects => generated 136 bytes in 202 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:21:10.005172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b300f5a-0d88-45c1-9254-017a4118b031 tempest-ProjectsNegativeStaticTestJSON-894575260 tempest-ProjectsNegativeStaticTestJSON-894575260-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:10.055763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b300f5a-0d88-45c1-9254-017a4118b031 tempest-ProjectsNegativeStaticTestJSON-894575260 tempest-ProjectsNegativeStaticTestJSON-894575260-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:10.098291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c785f50-9bd7-4b43-a31d-2509d624d633 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f241735c131d415daaab8f1e36de33c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f8a693df0a84ebf8387d5325aac7bb1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:10.099344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c785f50-9bd7-4b43-a31d-2509d624d633 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:10.099781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c785f50-9bd7-4b43-a31d-2509d624d633 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:10.107185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c785f50-9bd7-4b43-a31d-2509d624d633 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:10.107185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c785f50-9bd7-4b43-a31d-2509d624d633 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:10.107185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c785f50-9bd7-4b43-a31d-2509d624d633 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-2c785f50-9bd7-4b43-a31d-2509d624d633 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Invalid input for field 'name': '' is too short Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: Failed validating 'minLength' in schema['properties']['name']: Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: On instance['name']: Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: Failed validating 'minLength' in schema['properties']['name']: Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: On instance['name']: Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: '' Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise error Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application On instance['name']: Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application '' Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:10.147331 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:21:10.148940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:10.148940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:10.148940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:21:10.148940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:21:10.148940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:21:10.148940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:21:10.148940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:21:10.148940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:21:10.148940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:21:10.148940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:21:10.148940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:21:10.148940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:21:10.148940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jul 16 21:21:10.148940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jul 16 21:21:10.148940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 16 21:21:10.148940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 16 21:21:10.148940 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 16 21:21:10.149938 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 16 21:21:10.149938 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 16 21:21:10.149938 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:10.149938 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 16 21:21:10.149938 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 16 21:21:10.149938 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:10.149938 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application On instance['name']: Jul 16 21:21:10.149938 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application '' Jul 16 21:21:10.149938 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:10.149938 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2145/4226] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Jul 16 21:21:10 2022] POST /identity/v3/projects => generated 283 bytes in 139 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 16 21:21:10.149938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c785f50-9bd7-4b43-a31d-2509d624d633 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:10.181131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c785f50-9bd7-4b43-a31d-2509d624d633 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:10.189131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556d424-a85b-486c-9334-7560555dcc3c tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f241735c131d415daaab8f1e36de33c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f8a693df0a84ebf8387d5325aac7bb1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:10.191208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556d424-a85b-486c-9334-7560555dcc3c tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:10.193478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556d424-a85b-486c-9334-7560555dcc3c tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:10.199464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556d424-a85b-486c-9334-7560555dcc3c tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:10.199464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556d424-a85b-486c-9334-7560555dcc3c tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:10.199464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556d424-a85b-486c-9334-7560555dcc3c tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:10.204217 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-6556d424-a85b-486c-9334-7560555dcc3c tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 16 21:21:10.204217 ncdv-master-1 devstack@keystone.service[98196]: Failed validating 'maxLength' in schema['properties']['name']: Jul 16 21:21:10.204217 ncdv-master-1 devstack@keystone.service[98196]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 16 21:21:10.204217 ncdv-master-1 devstack@keystone.service[98196]: On instance['name']: Jul 16 21:21:10.204217 ncdv-master-1 devstack@keystone.service[98196]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 16 21:21:10.204217 ncdv-master-1 devstack@keystone.service[98196]: Failed validating 'maxLength' in schema['properties']['name']: Jul 16 21:21:10.204217 ncdv-master-1 devstack@keystone.service[98196]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 16 21:21:10.204217 ncdv-master-1 devstack@keystone.service[98196]: On instance['name']: Jul 16 21:21:10.204217 ncdv-master-1 devstack@keystone.service[98196]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 16 21:21:10.204217 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:10.204217 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 16 21:21:10.204217 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 16 21:21:10.204217 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 16 21:21:10.204217 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise error Jul 16 21:21:10.204217 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 16 21:21:10.204217 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:10.204217 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 16 21:21:10.204217 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 16 21:21:10.204217 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:10.205646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application On instance['name']: Jul 16 21:21:10.205646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 16 21:21:10.205646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:10.205646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:21:10.205646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:10.205646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:10.205646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:21:10.205646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:21:10.205646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:21:10.205646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:21:10.205646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:21:10.205646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:21:10.205646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:21:10.205646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:21:10.205646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:21:10.205646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:21:10.205646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jul 16 21:21:10.205646 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jul 16 21:21:10.206820 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 16 21:21:10.206820 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 16 21:21:10.206820 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 16 21:21:10.206820 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 16 21:21:10.206820 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 16 21:21:10.206820 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:10.206820 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 16 21:21:10.206820 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 16 21:21:10.206820 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:10.206820 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application On instance['name']: Jul 16 21:21:10.206820 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 16 21:21:10.206820 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:10.209137 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2146/4227] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Jul 16 21:21:10 2022] POST /identity/v3/projects => generated 412 bytes in 60 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 16 21:21:10.214354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556d424-a85b-486c-9334-7560555dcc3c tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:10.222737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f569121d-e6b1-43a4-aaa6-d8d7451108d4 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invalidating the token cache because role 82ff5c0265a94749a0906d7571f29117 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:10.223047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f569121d-e6b1-43a4-aaa6-d8d7451108d4 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:10.224120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f569121d-e6b1-43a4-aaa6-d8d7451108d4 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:10.226439 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2082/4228] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:09 2022] DELETE /identity/v3/roles/82ff5c0265a94749a0906d7571f29117 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:10.235530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569121d-e6b1-43a4-aaa6-d8d7451108d4 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:10.238517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f569121d-e6b1-43a4-aaa6-d8d7451108d4 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:10.242470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556d424-a85b-486c-9334-7560555dcc3c tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:10.346433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d44dc2-75c0-4535-a86a-88a119fccc39 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f241735c131d415daaab8f1e36de33c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f8a693df0a84ebf8387d5325aac7bb1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:10.348470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d44dc2-75c0-4535-a86a-88a119fccc39 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:10.348974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d44dc2-75c0-4535-a86a-88a119fccc39 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:10.349597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d44dc2-75c0-4535-a86a-88a119fccc39 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] PATH_INFO: `/v3/projects/7d0eb9cb729c4786862cf9b136c8b9c9` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:10.352614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569121d-e6b1-43a4-aaa6-d8d7451108d4 tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:10.358961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7a238-318e-4dd9-97a1-c37f6811bf7e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:10.359626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7a238-318e-4dd9-97a1-c37f6811bf7e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:10.359910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7a238-318e-4dd9-97a1-c37f6811bf7e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:10.360190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7a238-318e-4dd9-97a1-c37f6811bf7e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/roles/1b8860e7d1c84d599a6412eb26824fd9` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:10.363284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7a238-318e-4dd9-97a1-c37f6811bf7e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1b8860e7d1c84d599a6412eb26824fd9)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:10.365317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7a238-318e-4dd9-97a1-c37f6811bf7e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:10.371963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d44dc2-75c0-4535-a86a-88a119fccc39 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7d0eb9cb729c4786862cf9b136c8b9c9)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:10.379135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d44dc2-75c0-4535-a86a-88a119fccc39 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:10.402194 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-d9d44dc2-75c0-4535-a86a-88a119fccc39 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Could not find project: 7d0eb9cb729c4786862cf9b136c8b9c9.: keystone.exception.ProjectNotFound: Could not find project: 7d0eb9cb729c4786862cf9b136c8b9c9. Jul 16 21:21:10.402194 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:10.402194 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:21:10.402194 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:21:10.402194 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:21:10.402194 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:21:10.402194 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:21:10.402194 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:21:10.402194 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:21:10.402194 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:21:10.402194 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:21:10.402194 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:21:10.402194 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 16 21:21:10.402194 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 16 21:21:10.403333 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:21:10.403333 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:21:10.403333 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 16 21:21:10.403333 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 16 21:21:10.403333 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 21:21:10.403333 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 21:21:10.403333 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 21:21:10.403333 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 21:21:10.403333 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 7d0eb9cb729c4786862cf9b136c8b9c9. Jul 16 21:21:10.403333 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:10.405923 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2147/4229] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:10 2022] DELETE /identity/v3/projects/7d0eb9cb729c4786862cf9b136c8b9c9 => generated 113 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:21:10.413114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d44dc2-75c0-4535-a86a-88a119fccc39 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:10.415634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d9d44dc2-75c0-4535-a86a-88a119fccc39 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:10.512776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d44dc2-75c0-4535-a86a-88a119fccc39 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:10.521195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a854429-8090-45fa-8566-c7fe61dca078 tempest-ProjectsNegativeStaticTestJSON-894575260 tempest-ProjectsNegativeStaticTestJSON-894575260-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65cc5e35069643b4831b03b0c547ab18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34a195db6e143699e2f5beb376f3a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:10.522844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a854429-8090-45fa-8566-c7fe61dca078 tempest-ProjectsNegativeStaticTestJSON-894575260 tempest-ProjectsNegativeStaticTestJSON-894575260-project] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:10.522844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a854429-8090-45fa-8566-c7fe61dca078 tempest-ProjectsNegativeStaticTestJSON-894575260 tempest-ProjectsNegativeStaticTestJSON-894575260-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:10.522844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a854429-8090-45fa-8566-c7fe61dca078 tempest-ProjectsNegativeStaticTestJSON-894575260 tempest-ProjectsNegativeStaticTestJSON-894575260-project] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:10.524238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a854429-8090-45fa-8566-c7fe61dca078 tempest-ProjectsNegativeStaticTestJSON-894575260 tempest-ProjectsNegativeStaticTestJSON-894575260-project] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:10.532039 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-2a854429-8090-45fa-8566-c7fe61dca078 tempest-ProjectsNegativeStaticTestJSON-894575260 tempest-ProjectsNegativeStaticTestJSON-894575260-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jul 16 21:21:10.532039 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:10.532039 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:21:10.532039 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:21:10.532039 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:21:10.532039 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:21:10.532039 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:21:10.532039 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:21:10.532039 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:21:10.532039 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:21:10.532039 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:21:10.532039 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:21:10.532039 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Jul 16 21:21:10.532039 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._list_projects() Jul 16 21:21:10.533127 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Jul 16 21:21:10.533127 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Jul 16 21:21:10.533127 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 16 21:21:10.533127 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 16 21:21:10.533127 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 16 21:21:10.533127 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 16 21:21:10.533127 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 16 21:21:10.533127 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 16 21:21:10.533127 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jul 16 21:21:10.533127 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:10.537442 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2148/4230] 10.222.0.16 () {58 vars in 1130 bytes} [Sat Jul 16 21:21:10 2022] GET /identity/v3/projects => generated 135 bytes in 126 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:21:10.544174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a854429-8090-45fa-8566-c7fe61dca078 tempest-ProjectsNegativeStaticTestJSON-894575260 tempest-ProjectsNegativeStaticTestJSON-894575260-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:10.547406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2a854429-8090-45fa-8566-c7fe61dca078 tempest-ProjectsNegativeStaticTestJSON-894575260 tempest-ProjectsNegativeStaticTestJSON-894575260-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:10.570062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a854429-8090-45fa-8566-c7fe61dca078 tempest-ProjectsNegativeStaticTestJSON-894575260 tempest-ProjectsNegativeStaticTestJSON-894575260-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:10.575521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5d8c8-9936-4b8c-9e2a-f971adbb415e tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f241735c131d415daaab8f1e36de33c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f8a693df0a84ebf8387d5325aac7bb1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:10.576161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5d8c8-9936-4b8c-9e2a-f971adbb415e tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:10.576445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5d8c8-9936-4b8c-9e2a-f971adbb415e tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:10.576720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5d8c8-9936-4b8c-9e2a-f971adbb415e tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:10.577560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5d8c8-9936-4b8c-9e2a-f971adbb415e tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:10.579733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5d8c8-9936-4b8c-9e2a-f971adbb415e tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:10.709418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-28b7a238-318e-4dd9-97a1-c37f6811bf7e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invalidating the token cache because role 1b8860e7d1c84d599a6412eb26824fd9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:10.709765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-28b7a238-318e-4dd9-97a1-c37f6811bf7e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:10.710733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-28b7a238-318e-4dd9-97a1-c37f6811bf7e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:10.716251 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2083/4231] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:10 2022] DELETE /identity/v3/roles/1b8860e7d1c84d599a6412eb26824fd9 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:10.725753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7a238-318e-4dd9-97a1-c37f6811bf7e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:10.727857 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2149/4232] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:21:10 2022] POST /identity/v3/projects => generated 358 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:10.729148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5d8c8-9936-4b8c-9e2a-f971adbb415e tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:10.733242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-28b7a238-318e-4dd9-97a1-c37f6811bf7e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:10.733375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-def5d8c8-9936-4b8c-9e2a-f971adbb415e tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:10.918233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7a238-318e-4dd9-97a1-c37f6811bf7e tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:10.922097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5d8c8-9936-4b8c-9e2a-f971adbb415e tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:10.950535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cf906-4dab-4d22-b007-9e821c86f798 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f241735c131d415daaab8f1e36de33c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f8a693df0a84ebf8387d5325aac7bb1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:10.950535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cf906-4dab-4d22-b007-9e821c86f798 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:10.950535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cf906-4dab-4d22-b007-9e821c86f798 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:10.951069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cf906-4dab-4d22-b007-9e821c86f798 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:10.951069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cf906-4dab-4d22-b007-9e821c86f798 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:10.955215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cf906-4dab-4d22-b007-9e821c86f798 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:10.973016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:11.062581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.sql.core [None req-140cf906-4dab-4d22-b007-9e821c86f798 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1300644356' for key 'project.ixu_project_name_domain_id'") Jul 16 21:21:11.062581 ncdv-master-1 devstack@keystone.service[98196]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 16 21:21:11.062581 ncdv-master-1 devstack@keystone.service[98196]: [parameters: {'id': '354f201a3f084f26a86fc2c5ab0ee923', 'name': 'tempest-project-dup-1300644356', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 16 21:21:11.062581 ncdv-master-1 devstack@keystone.service[98196]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98196) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 16 21:21:11.115797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d1562-a68c-4f39-8087-29b19273667b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:11.117297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d1562-a68c-4f39-8087-29b19273667b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:11.117751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d1562-a68c-4f39-8087-29b19273667b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:11.118387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d1562-a68c-4f39-8087-29b19273667b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/users/90dad8ad2f634c09b087c741e5ccf94b` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:11.120166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d1562-a68c-4f39-8087-29b19273667b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_user(user_id=90dad8ad2f634c09b087c741e5ccf94b)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:11.124435 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-140cf906-4dab-4d22-b007-9e821c86f798 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1300644356, project id 354f201a3f084f26a86fc2c5ab0ee923.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1300644356, project id 354f201a3f084f26a86fc2c5ab0ee923. Jul 16 21:21:11.124435 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:11.124435 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 16 21:21:11.124435 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 16 21:21:11.124435 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 16 21:21:11.124435 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 16 21:21:11.124435 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 16 21:21:11.124435 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application result = self._query(query) Jul 16 21:21:11.124435 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 16 21:21:11.124435 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application conn.query(q) Jul 16 21:21:11.124435 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 16 21:21:11.124435 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 16 21:21:11.129613 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 16 21:21:11.129613 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application result.read() Jul 16 21:21:11.129613 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 16 21:21:11.129613 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 16 21:21:11.129613 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 16 21:21:11.129613 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 16 21:21:11.129613 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 16 21:21:11.129613 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 16 21:21:11.129613 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 16 21:21:11.129613 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 16 21:21:11.129613 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-1300644356' for key 'project.ixu_project_name_domain_id'") Jul 16 21:21:11.129613 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:11.129613 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 16 21:21:11.129613 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:11.129613 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:11.129613 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 16 21:21:11.129613 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 16 21:21:11.131156 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 16 21:21:11.131156 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 16 21:21:11.131156 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 16 21:21:11.131156 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application next(self.gen) Jul 16 21:21:11.131156 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 16 21:21:11.131156 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application yield resource Jul 16 21:21:11.131156 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 16 21:21:11.131156 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application next(self.gen) Jul 16 21:21:11.131156 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 16 21:21:11.131156 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self.session.rollback() Jul 16 21:21:11.131156 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 16 21:21:11.131156 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self.force_reraise() Jul 16 21:21:11.131156 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 16 21:21:11.131156 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise self.value Jul 16 21:21:11.131156 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 16 21:21:11.131156 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 16 21:21:11.131156 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 16 21:21:11.131156 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application session.commit() Jul 16 21:21:11.132537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 16 21:21:11.132537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 16 21:21:11.132537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 16 21:21:11.132537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._prepare_impl() Jul 16 21:21:11.132537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 16 21:21:11.132537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self.session.flush() Jul 16 21:21:11.132537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 16 21:21:11.132537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._flush(objects) Jul 16 21:21:11.132537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 16 21:21:11.132537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 16 21:21:11.132537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 16 21:21:11.132537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application compat.raise_( Jul 16 21:21:11.132537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 16 21:21:11.132537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception Jul 16 21:21:11.132537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 16 21:21:11.132537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application flush_context.execute() Jul 16 21:21:11.132537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 16 21:21:11.133997 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rec.execute(self) Jul 16 21:21:11.133997 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 16 21:21:11.133997 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 16 21:21:11.133997 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 16 21:21:11.133997 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 16 21:21:11.133997 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 16 21:21:11.133997 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 16 21:21:11.133997 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 16 21:21:11.133997 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 16 21:21:11.133997 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 16 21:21:11.133997 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 16 21:21:11.133997 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 16 21:21:11.133997 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 16 21:21:11.133997 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 16 21:21:11.133997 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 16 21:21:11.133997 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 16 21:21:11.135700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 16 21:21:11.135700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 16 21:21:11.135700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception Jul 16 21:21:11.135700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 16 21:21:11.135700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 16 21:21:11.135700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 16 21:21:11.135700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 16 21:21:11.135700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 16 21:21:11.135700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application result = self._query(query) Jul 16 21:21:11.135700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 16 21:21:11.135700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application conn.query(q) Jul 16 21:21:11.135700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 16 21:21:11.135700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 16 21:21:11.135700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 16 21:21:11.135700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application result.read() Jul 16 21:21:11.135700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 16 21:21:11.135700 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 16 21:21:11.136955 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 16 21:21:11.136955 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 16 21:21:11.136955 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 16 21:21:11.136955 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 16 21:21:11.136955 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 16 21:21:11.136955 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 16 21:21:11.136955 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1300644356' for key 'project.ixu_project_name_domain_id'") Jul 16 21:21:11.136955 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 16 21:21:11.136955 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [parameters: {'id': '354f201a3f084f26a86fc2c5ab0ee923', 'name': 'tempest-project-dup-1300644356', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 16 21:21:11.136955 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 16 21:21:11.136955 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:11.136955 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:21:11.136955 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:11.136955 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:11.136955 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 16 21:21:11.138099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 16 21:21:11.138099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 16 21:21:11.138099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 16 21:21:11.138099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-1300644356 at domain ID default. Jul 16 21:21:11.138099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:11.138099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:21:11.138099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:11.138099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:11.138099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:21:11.138099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:21:11.138099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:21:11.138099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:21:11.138099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:21:11.138099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:21:11.138099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:21:11.138099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:21:11.138099 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:21:11.139327 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:21:11.139327 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 16 21:21:11.139327 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 16 21:21:11.139327 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:21:11.139327 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:21:11.139327 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 16 21:21:11.139327 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 16 21:21:11.139327 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1300644356, project id 354f201a3f084f26a86fc2c5ab0ee923. Jul 16 21:21:11.139327 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:11.140037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d1562-a68c-4f39-8087-29b19273667b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:11.140145 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2150/4233] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Jul 16 21:21:10 2022] POST /identity/v3/projects => generated 285 bytes in 402 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 16 21:21:11.140145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cf906-4dab-4d22-b007-9e821c86f798 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:11.152739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cf906-4dab-4d22-b007-9e821c86f798 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:11.168875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98695e-4fd5-470c-a8cf-5b23c51b1d45 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f241735c131d415daaab8f1e36de33c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f8a693df0a84ebf8387d5325aac7bb1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:11.169866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98695e-4fd5-470c-a8cf-5b23c51b1d45 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:11.170216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98695e-4fd5-470c-a8cf-5b23c51b1d45 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:11.170604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98695e-4fd5-470c-a8cf-5b23c51b1d45 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] PATH_INFO: `/v3/projects/8e97f5d9f19646ff97c968a355e20b10` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:11.176096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98695e-4fd5-470c-a8cf-5b23c51b1d45 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8e97f5d9f19646ff97c968a355e20b10)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:11.178407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98695e-4fd5-470c-a8cf-5b23c51b1d45 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:11.475072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5d4d1562-a68c-4f39-8087-29b19273667b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90dad8ad2f634c09b087c741e5ccf94b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:11.477675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9e98695e-4fd5-470c-a8cf-5b23c51b1d45 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e97f5d9f19646ff97c968a355e20b10', 'request_id': 'req-9e98695e-4fd5-470c-a8cf-5b23c51b1d45'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:11.501387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9e98695e-4fd5-470c-a8cf-5b23c51b1d45 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e97f5d9f19646ff97c968a355e20b10', 'request_id': 'req-9e98695e-4fd5-470c-a8cf-5b23c51b1d45'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:11.529435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5d4d1562-a68c-4f39-8087-29b19273667b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90dad8ad2f634c09b087c741e5ccf94b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:11.530686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9e98695e-4fd5-470c-a8cf-5b23c51b1d45 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e97f5d9f19646ff97c968a355e20b10', 'request_id': 'req-9e98695e-4fd5-470c-a8cf-5b23c51b1d45'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:11.627824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:11.665136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9e98695e-4fd5-470c-a8cf-5b23c51b1d45 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] The token cache is being invalidate because project 8e97f5d9f19646ff97c968a355e20b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:11.665526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9e98695e-4fd5-470c-a8cf-5b23c51b1d45 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:11.666374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9e98695e-4fd5-470c-a8cf-5b23c51b1d45 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:11.673141 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2151/4234] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:11 2022] DELETE /identity/v3/projects/8e97f5d9f19646ff97c968a355e20b10 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:11.674919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98695e-4fd5-470c-a8cf-5b23c51b1d45 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:11.696588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9e98695e-4fd5-470c-a8cf-5b23c51b1d45 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:11.853201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98695e-4fd5-470c-a8cf-5b23c51b1d45 tempest-ProjectsNegativeStaticTestJSON-83034984 tempest-ProjectsNegativeStaticTestJSON-83034984-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:11.872400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7046f9b-96f2-40dd-b3ed-a88e8abb4cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:11.873430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7046f9b-96f2-40dd-b3ed-a88e8abb4cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:11.874160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7046f9b-96f2-40dd-b3ed-a88e8abb4cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:11.874540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7046f9b-96f2-40dd-b3ed-a88e8abb4cb4 admin admin] PATH_INFO: `/v3/users/65cc5e35069643b4831b03b0c547ab18` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:11.876761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7046f9b-96f2-40dd-b3ed-a88e8abb4cb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65cc5e35069643b4831b03b0c547ab18)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:11.881168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7046f9b-96f2-40dd-b3ed-a88e8abb4cb4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:12.006380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5d4d1562-a68c-4f39-8087-29b19273667b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90dad8ad2f634c09b087c741e5ccf94b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:12.020283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5d4d1562-a68c-4f39-8087-29b19273667b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90dad8ad2f634c09b087c741e5ccf94b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:12.021635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5d4d1562-a68c-4f39-8087-29b19273667b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90dad8ad2f634c09b087c741e5ccf94b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:12.033273 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2084/4235] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:10 2022] DELETE /identity/v3/users/90dad8ad2f634c09b087c741e5ccf94b => generated 0 bytes in 1308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:12.039874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d1562-a68c-4f39-8087-29b19273667b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:12.044973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5d4d1562-a68c-4f39-8087-29b19273667b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:12.224418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d1562-a68c-4f39-8087-29b19273667b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:12.233201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407c855-66d0-4cae-ac2e-1683bebc7b4b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5bb8e2353b54f97b6db2ecdb0aece9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a78a13d940dc4700bda8f7dc4dabca0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:12.241234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407c855-66d0-4cae-ac2e-1683bebc7b4b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:12.241769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f7046f9b-96f2-40dd-b3ed-a88e8abb4cb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65cc5e35069643b4831b03b0c547ab18'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:12.243561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407c855-66d0-4cae-ac2e-1683bebc7b4b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:12.245017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407c855-66d0-4cae-ac2e-1683bebc7b4b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] PATH_INFO: `/v3/projects/b3f58e5c83ce4ccc875d998a32bdfc24` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:12.247938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407c855-66d0-4cae-ac2e-1683bebc7b4b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b3f58e5c83ce4ccc875d998a32bdfc24)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:12.253982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407c855-66d0-4cae-ac2e-1683bebc7b4b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:12.296607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f7046f9b-96f2-40dd-b3ed-a88e8abb4cb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65cc5e35069643b4831b03b0c547ab18'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:12.447599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f7046f9b-96f2-40dd-b3ed-a88e8abb4cb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65cc5e35069643b4831b03b0c547ab18'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:12.448537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f7046f9b-96f2-40dd-b3ed-a88e8abb4cb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65cc5e35069643b4831b03b0c547ab18'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:12.478202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f7046f9b-96f2-40dd-b3ed-a88e8abb4cb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65cc5e35069643b4831b03b0c547ab18'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:12.496518 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2152/4236] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:11 2022] DELETE /identity/v3/users/65cc5e35069643b4831b03b0c547ab18 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:12.502956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7817d56-1b17-4f93-8b3a-9adce6745041 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:12.504689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7817d56-1b17-4f93-8b3a-9adce6745041 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:12.504973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7817d56-1b17-4f93-8b3a-9adce6745041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:12.533615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a7817d56-1b17-4f93-8b3a-9adce6745041 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:12.535450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a7817d56-1b17-4f93-8b3a-9adce6745041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:12.569785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4407c855-66d0-4cae-ac2e-1683bebc7b4b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3f58e5c83ce4ccc875d998a32bdfc24', 'request_id': 'req-4407c855-66d0-4cae-ac2e-1683bebc7b4b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:12.587000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4407c855-66d0-4cae-ac2e-1683bebc7b4b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3f58e5c83ce4ccc875d998a32bdfc24', 'request_id': 'req-4407c855-66d0-4cae-ac2e-1683bebc7b4b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:12.600431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4407c855-66d0-4cae-ac2e-1683bebc7b4b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3f58e5c83ce4ccc875d998a32bdfc24', 'request_id': 'req-4407c855-66d0-4cae-ac2e-1683bebc7b4b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:12.635001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:12.649818 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2153/4237] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:12.674656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7817d56-1b17-4f93-8b3a-9adce6745041 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:12.680820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a7817d56-1b17-4f93-8b3a-9adce6745041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:12.697564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4407c855-66d0-4cae-ac2e-1683bebc7b4b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] The token cache is being invalidate because project b3f58e5c83ce4ccc875d998a32bdfc24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:12.697803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4407c855-66d0-4cae-ac2e-1683bebc7b4b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:12.699599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4407c855-66d0-4cae-ac2e-1683bebc7b4b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:12.703097 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2085/4238] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:12 2022] DELETE /identity/v3/projects/b3f58e5c83ce4ccc875d998a32bdfc24 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:12.709576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407c855-66d0-4cae-ac2e-1683bebc7b4b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:12.713705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4407c855-66d0-4cae-ac2e-1683bebc7b4b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:12.888894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407c855-66d0-4cae-ac2e-1683bebc7b4b tempest-TrustsV3TestJSON-1533876353 tempest-TrustsV3TestJSON-1533876353-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:12.899701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22a543-1860-477e-98b3-9205f101481c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:12.900069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7817d56-1b17-4f93-8b3a-9adce6745041 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:12.900882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22a543-1860-477e-98b3-9205f101481c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:12.901353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22a543-1860-477e-98b3-9205f101481c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:12.901747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22a543-1860-477e-98b3-9205f101481c admin admin] PATH_INFO: `/v3/users/f5606cca80d8424697771018218115e4` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:12.903110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22a543-1860-477e-98b3-9205f101481c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5606cca80d8424697771018218115e4)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:12.908062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22a543-1860-477e-98b3-9205f101481c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:12.947399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aecb26-122c-4ee9-890b-a3db876ea2f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:12.948083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aecb26-122c-4ee9-890b-a3db876ea2f2 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:12.948370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aecb26-122c-4ee9-890b-a3db876ea2f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:12.948650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aecb26-122c-4ee9-890b-a3db876ea2f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:12.951087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c4aecb26-122c-4ee9-890b-a3db876ea2f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:12.965466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:12.991901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aecb26-122c-4ee9-890b-a3db876ea2f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:12.993926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aecb26-122c-4ee9-890b-a3db876ea2f2 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:13.019065 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2154/4239] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:21:13.176643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3b22a543-1860-477e-98b3-9205f101481c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5606cca80d8424697771018218115e4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:13.201710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3b22a543-1860-477e-98b3-9205f101481c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5606cca80d8424697771018218115e4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:13.292701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3b22a543-1860-477e-98b3-9205f101481c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5606cca80d8424697771018218115e4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:13.305891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3b22a543-1860-477e-98b3-9205f101481c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5606cca80d8424697771018218115e4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:13.307230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3b22a543-1860-477e-98b3-9205f101481c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5606cca80d8424697771018218115e4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:13.320304 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2086/4240] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:12 2022] DELETE /identity/v3/users/f5606cca80d8424697771018218115e4 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:13.320976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c2e66-48f0-4c9f-99c3-345513bf6251 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:13.321390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c2e66-48f0-4c9f-99c3-345513bf6251 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:13.321716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c2e66-48f0-4c9f-99c3-345513bf6251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:13.355711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-449c2e66-48f0-4c9f-99c3-345513bf6251 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:13.360779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-449c2e66-48f0-4c9f-99c3-345513bf6251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:13.494992 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2155/4241] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:13.502042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22a543-1860-477e-98b3-9205f101481c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:13.504825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3b22a543-1860-477e-98b3-9205f101481c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:13.590277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22a543-1860-477e-98b3-9205f101481c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:13.594880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8480e30-d0b4-4f0a-942e-c4c72f6f80c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:13.596316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8480e30-d0b4-4f0a-942e-c4c72f6f80c1 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:13.596858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8480e30-d0b4-4f0a-942e-c4c72f6f80c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:13.597358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8480e30-d0b4-4f0a-942e-c4c72f6f80c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:13.624751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8480e30-d0b4-4f0a-942e-c4c72f6f80c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:13.626341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8480e30-d0b4-4f0a-942e-c4c72f6f80c1 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:13.640910 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2087/4242] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:21:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:21:13.690702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:13.903327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:14.373848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c2e66-48f0-4c9f-99c3-345513bf6251 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:14.376561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-449c2e66-48f0-4c9f-99c3-345513bf6251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:14.401529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c2e66-48f0-4c9f-99c3-345513bf6251 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:14.412409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d474ef-09af-4bc7-919a-90925062669e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:14.413288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d474ef-09af-4bc7-919a-90925062669e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:14.418312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d474ef-09af-4bc7-919a-90925062669e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:14.418642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d474ef-09af-4bc7-919a-90925062669e admin admin] PATH_INFO: `/v3/projects/b34a195db6e143699e2f5beb376f3a47` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:14.420206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d474ef-09af-4bc7-919a-90925062669e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b34a195db6e143699e2f5beb376f3a47)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:14.422284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d474ef-09af-4bc7-919a-90925062669e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:14.625031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-58d474ef-09af-4bc7-919a-90925062669e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b34a195db6e143699e2f5beb376f3a47', 'request_id': 'req-58d474ef-09af-4bc7-919a-90925062669e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:14.632033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-58d474ef-09af-4bc7-919a-90925062669e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b34a195db6e143699e2f5beb376f3a47', 'request_id': 'req-58d474ef-09af-4bc7-919a-90925062669e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:14.649463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-58d474ef-09af-4bc7-919a-90925062669e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b34a195db6e143699e2f5beb376f3a47', 'request_id': 'req-58d474ef-09af-4bc7-919a-90925062669e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:14.744043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-58d474ef-09af-4bc7-919a-90925062669e admin admin] The token cache is being invalidate because project b34a195db6e143699e2f5beb376f3a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:14.744343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-58d474ef-09af-4bc7-919a-90925062669e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:14.745039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-58d474ef-09af-4bc7-919a-90925062669e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:14.747048 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2156/4243] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:14 2022] DELETE /identity/v3/projects/b34a195db6e143699e2f5beb376f3a47 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:14.751110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8480e30-d0b4-4f0a-942e-c4c72f6f80c1 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:14.767507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8480e30-d0b4-4f0a-942e-c4c72f6f80c1 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:14.925334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a01af-5e79-45ce-9ea7-f8bafcf1f669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:14.926478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a01af-5e79-45ce-9ea7-f8bafcf1f669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:14.926937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a01af-5e79-45ce-9ea7-f8bafcf1f669 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:14.927554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a01af-5e79-45ce-9ea7-f8bafcf1f669 admin admin] PATH_INFO: `/v3/users/f241735c131d415daaab8f1e36de33c2` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:14.929602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a01af-5e79-45ce-9ea7-f8bafcf1f669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f241735c131d415daaab8f1e36de33c2)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:14.931782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a01af-5e79-45ce-9ea7-f8bafcf1f669 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:15.040219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:15.175984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6b4a01af-5e79-45ce-9ea7-f8bafcf1f669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f241735c131d415daaab8f1e36de33c2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:15.208122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6b4a01af-5e79-45ce-9ea7-f8bafcf1f669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f241735c131d415daaab8f1e36de33c2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:15.346966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6b4a01af-5e79-45ce-9ea7-f8bafcf1f669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f241735c131d415daaab8f1e36de33c2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:15.356067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6b4a01af-5e79-45ce-9ea7-f8bafcf1f669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f241735c131d415daaab8f1e36de33c2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:15.359898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6b4a01af-5e79-45ce-9ea7-f8bafcf1f669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f241735c131d415daaab8f1e36de33c2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:15.374834 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2088/4244] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:14 2022] DELETE /identity/v3/users/f241735c131d415daaab8f1e36de33c2 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:15.491257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d474ef-09af-4bc7-919a-90925062669e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:15.493201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-58d474ef-09af-4bc7-919a-90925062669e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:15.544035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d474ef-09af-4bc7-919a-90925062669e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:15.735868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291da9c-d0bb-47e3-83d0-a5e75ad4539d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:15.738653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291da9c-d0bb-47e3-83d0-a5e75ad4539d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:15.739326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291da9c-d0bb-47e3-83d0-a5e75ad4539d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:15.741247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291da9c-d0bb-47e3-83d0-a5e75ad4539d admin admin] PATH_INFO: `/v3/projects/bd98c73d37e34cec87e679ef58a653a4` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:15.744173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291da9c-d0bb-47e3-83d0-a5e75ad4539d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd98c73d37e34cec87e679ef58a653a4)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:15.748052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291da9c-d0bb-47e3-83d0-a5e75ad4539d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:16.021151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:16.029257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2291da9c-d0bb-47e3-83d0-a5e75ad4539d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd98c73d37e34cec87e679ef58a653a4', 'request_id': 'req-2291da9c-d0bb-47e3-83d0-a5e75ad4539d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:16.047414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2291da9c-d0bb-47e3-83d0-a5e75ad4539d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd98c73d37e34cec87e679ef58a653a4', 'request_id': 'req-2291da9c-d0bb-47e3-83d0-a5e75ad4539d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:16.067664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2291da9c-d0bb-47e3-83d0-a5e75ad4539d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd98c73d37e34cec87e679ef58a653a4', 'request_id': 'req-2291da9c-d0bb-47e3-83d0-a5e75ad4539d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:16.223141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2291da9c-d0bb-47e3-83d0-a5e75ad4539d admin admin] The token cache is being invalidate because project bd98c73d37e34cec87e679ef58a653a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:16.223828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2291da9c-d0bb-47e3-83d0-a5e75ad4539d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:16.225973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2291da9c-d0bb-47e3-83d0-a5e75ad4539d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:16.228974 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2157/4245] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:15 2022] DELETE /identity/v3/projects/bd98c73d37e34cec87e679ef58a653a4 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:16.233071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a01af-5e79-45ce-9ea7-f8bafcf1f669 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:16.234569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6b4a01af-5e79-45ce-9ea7-f8bafcf1f669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:16.268361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a01af-5e79-45ce-9ea7-f8bafcf1f669 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:16.422487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58258e05-ced3-485d-99df-784e86a32e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:16.425331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58258e05-ced3-485d-99df-784e86a32e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:16.425950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58258e05-ced3-485d-99df-784e86a32e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:16.426393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58258e05-ced3-485d-99df-784e86a32e36 admin admin] PATH_INFO: `/v3/users/c5bb8e2353b54f97b6db2ecdb0aece9e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:16.449908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58258e05-ced3-485d-99df-784e86a32e36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5bb8e2353b54f97b6db2ecdb0aece9e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:16.455433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58258e05-ced3-485d-99df-784e86a32e36 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:16.760346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-58258e05-ced3-485d-99df-784e86a32e36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5bb8e2353b54f97b6db2ecdb0aece9e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:16.830575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-58258e05-ced3-485d-99df-784e86a32e36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5bb8e2353b54f97b6db2ecdb0aece9e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:16.925841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:16.992053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-58258e05-ced3-485d-99df-784e86a32e36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5bb8e2353b54f97b6db2ecdb0aece9e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:17.003175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-58258e05-ced3-485d-99df-784e86a32e36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5bb8e2353b54f97b6db2ecdb0aece9e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:17.008462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-58258e05-ced3-485d-99df-784e86a32e36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5bb8e2353b54f97b6db2ecdb0aece9e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:17.059423 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2089/4246] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:16 2022] DELETE /identity/v3/users/c5bb8e2353b54f97b6db2ecdb0aece9e => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:17.083586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291da9c-d0bb-47e3-83d0-a5e75ad4539d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:17.085261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2291da9c-d0bb-47e3-83d0-a5e75ad4539d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:17.142671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291da9c-d0bb-47e3-83d0-a5e75ad4539d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:17.425601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58258e05-ced3-485d-99df-784e86a32e36 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:17.427490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-58258e05-ced3-485d-99df-784e86a32e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:17.437866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa67f1b-6885-4d23-a56b-b6700967a8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:17.441064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa67f1b-6885-4d23-a56b-b6700967a8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:17.445539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa67f1b-6885-4d23-a56b-b6700967a8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:17.446019 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58258e05-ced3-485d-99df-784e86a32e36 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:17.447474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa67f1b-6885-4d23-a56b-b6700967a8a5 admin admin] PATH_INFO: `/v3/users/d3bb6f6d546c4bd090e72c149afe5660` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:17.449517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa67f1b-6885-4d23-a56b-b6700967a8a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3bb6f6d546c4bd090e72c149afe5660)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:17.454195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa67f1b-6885-4d23-a56b-b6700967a8a5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:17.459304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d17d4-ffe1-433f-8391-b74f4f5b7723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:17.461094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d17d4-ffe1-433f-8391-b74f4f5b7723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:17.463667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d17d4-ffe1-433f-8391-b74f4f5b7723 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:17.464132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d17d4-ffe1-433f-8391-b74f4f5b7723 admin admin] PATH_INFO: `/v3/projects/6f8a693df0a84ebf8387d5325aac7bb1` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:17.468020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d17d4-ffe1-433f-8391-b74f4f5b7723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f8a693df0a84ebf8387d5325aac7bb1)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:17.472406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d17d4-ffe1-433f-8391-b74f4f5b7723 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:17.791167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8fa67f1b-6885-4d23-a56b-b6700967a8a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3bb6f6d546c4bd090e72c149afe5660'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:17.797193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-748d17d4-ffe1-433f-8391-b74f4f5b7723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f8a693df0a84ebf8387d5325aac7bb1', 'request_id': 'req-748d17d4-ffe1-433f-8391-b74f4f5b7723'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:17.813336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8fa67f1b-6885-4d23-a56b-b6700967a8a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3bb6f6d546c4bd090e72c149afe5660'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:17.876288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-748d17d4-ffe1-433f-8391-b74f4f5b7723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f8a693df0a84ebf8387d5325aac7bb1', 'request_id': 'req-748d17d4-ffe1-433f-8391-b74f4f5b7723'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:17.891277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-748d17d4-ffe1-433f-8391-b74f4f5b7723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f8a693df0a84ebf8387d5325aac7bb1', 'request_id': 'req-748d17d4-ffe1-433f-8391-b74f4f5b7723'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:17.971182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8fa67f1b-6885-4d23-a56b-b6700967a8a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3bb6f6d546c4bd090e72c149afe5660'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:17.972168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8fa67f1b-6885-4d23-a56b-b6700967a8a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3bb6f6d546c4bd090e72c149afe5660'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:17.996521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8fa67f1b-6885-4d23-a56b-b6700967a8a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3bb6f6d546c4bd090e72c149afe5660'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:18.007606 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2158/4247] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:17 2022] DELETE /identity/v3/users/d3bb6f6d546c4bd090e72c149afe5660 => generated 0 bytes in 925 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:18.078831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa67f1b-6885-4d23-a56b-b6700967a8a5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:18.081092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8fa67f1b-6885-4d23-a56b-b6700967a8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:18.118416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-748d17d4-ffe1-433f-8391-b74f4f5b7723 admin admin] The token cache is being invalidate because project 6f8a693df0a84ebf8387d5325aac7bb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:18.118972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-748d17d4-ffe1-433f-8391-b74f4f5b7723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:18.119400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-748d17d4-ffe1-433f-8391-b74f4f5b7723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:18.121362 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2090/4248] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:17 2022] DELETE /identity/v3/projects/6f8a693df0a84ebf8387d5325aac7bb1 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:18.126612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc2494-2937-49cf-a7c1-9cd912a7295a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:18.128268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc2494-2937-49cf-a7c1-9cd912a7295a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:18.128756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc2494-2937-49cf-a7c1-9cd912a7295a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:18.218878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-aebc2494-2937-49cf-a7c1-9cd912a7295a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:18.228960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-aebc2494-2937-49cf-a7c1-9cd912a7295a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:18.340364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa67f1b-6885-4d23-a56b-b6700967a8a5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:18.349965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52c095-72b7-4fff-89f6-c8c6aec496cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:18.350856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52c095-72b7-4fff-89f6-c8c6aec496cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:18.351168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52c095-72b7-4fff-89f6-c8c6aec496cf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:18.351445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52c095-72b7-4fff-89f6-c8c6aec496cf admin admin] PATH_INFO: `/v3/projects/a78a13d940dc4700bda8f7dc4dabca0c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:18.357088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52c095-72b7-4fff-89f6-c8c6aec496cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a78a13d940dc4700bda8f7dc4dabca0c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:18.359095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52c095-72b7-4fff-89f6-c8c6aec496cf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:18.411699 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2091/4249] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:18.424296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fff5b-ad82-4962-8487-1b24f7d0ec56 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:18.424819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fff5b-ad82-4962-8487-1b24f7d0ec56 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:18.425260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fff5b-ad82-4962-8487-1b24f7d0ec56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:18.467535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ad2fff5b-ad82-4962-8487-1b24f7d0ec56 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:18.469067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ad2fff5b-ad82-4962-8487-1b24f7d0ec56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:18.488158 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2092/4250] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:18.493115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fff5b-ad82-4962-8487-1b24f7d0ec56 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:18.513914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fff5b-ad82-4962-8487-1b24f7d0ec56 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:18.520459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f6808-b83d-4955-93f1-4e27c2e27e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:18.521432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f6808-b83d-4955-93f1-4e27c2e27e95 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:18.521878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f6808-b83d-4955-93f1-4e27c2e27e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:18.522828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f6808-b83d-4955-93f1-4e27c2e27e95 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:18.523799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f6808-b83d-4955-93f1-4e27c2e27e95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:21:18.524289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f6808-b83d-4955-93f1-4e27c2e27e95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:18.527559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f6808-b83d-4955-93f1-4e27c2e27e95 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:18.541285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:18.569229 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2093/4251] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:18.575313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f6808-b83d-4955-93f1-4e27c2e27e95 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:18.600344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f6808-b83d-4955-93f1-4e27c2e27e95 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:18.645068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3e52c095-72b7-4fff-89f6-c8c6aec496cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a78a13d940dc4700bda8f7dc4dabca0c', 'request_id': 'req-3e52c095-72b7-4fff-89f6-c8c6aec496cf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:18.661783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3e52c095-72b7-4fff-89f6-c8c6aec496cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a78a13d940dc4700bda8f7dc4dabca0c', 'request_id': 'req-3e52c095-72b7-4fff-89f6-c8c6aec496cf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:18.679083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3e52c095-72b7-4fff-89f6-c8c6aec496cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a78a13d940dc4700bda8f7dc4dabca0c', 'request_id': 'req-3e52c095-72b7-4fff-89f6-c8c6aec496cf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:18.706778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198feae-ec86-45d0-be33-820d12832a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:18.706985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198feae-ec86-45d0-be33-820d12832a8f admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:18.707475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198feae-ec86-45d0-be33-820d12832a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:18.708341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198feae-ec86-45d0-be33-820d12832a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:18.709161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198feae-ec86-45d0-be33-820d12832a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:18.711597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198feae-ec86-45d0-be33-820d12832a8f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:18.794004 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3e52c095-72b7-4fff-89f6-c8c6aec496cf admin admin] The token cache is being invalidate because project a78a13d940dc4700bda8f7dc4dabca0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:18.794296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3e52c095-72b7-4fff-89f6-c8c6aec496cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:18.799764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3e52c095-72b7-4fff-89f6-c8c6aec496cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:18.799764 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2159/4252] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:18 2022] DELETE /identity/v3/projects/a78a13d940dc4700bda8f7dc4dabca0c => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:21:18.806201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eae517-9d52-4409-86e4-53bd1e17256e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:18.806793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eae517-9d52-4409-86e4-53bd1e17256e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:18.807144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eae517-9d52-4409-86e4-53bd1e17256e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:18.832893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c4eae517-9d52-4409-86e4-53bd1e17256e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:18.834131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c4eae517-9d52-4409-86e4-53bd1e17256e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:18.849609 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2160/4253] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:18.851357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec82a80-a534-4630-838a-4e2251d8508a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:18.851657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec82a80-a534-4630-838a-4e2251d8508a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:18.851935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec82a80-a534-4630-838a-4e2251d8508a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:18.857010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:18.891309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4ec82a80-a534-4630-838a-4e2251d8508a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:18.892849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4ec82a80-a534-4630-838a-4e2251d8508a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:18.909629 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2094/4254] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:21:18 2022] POST /identity/v3/projects => generated 385 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:18.910592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198feae-ec86-45d0-be33-820d12832a8f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:18.915158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b198feae-ec86-45d0-be33-820d12832a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:18.919201 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2161/4255] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:18.920704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec82a80-a534-4630-838a-4e2251d8508a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:18.929481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4ec82a80-a534-4630-838a-4e2251d8508a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:18.944042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec82a80-a534-4630-838a-4e2251d8508a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:19.138556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cc6c0-4b07-44b7-aa1b-bb6871eb731a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:19.142721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cc6c0-4b07-44b7-aa1b-bb6871eb731a admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:19.143378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cc6c0-4b07-44b7-aa1b-bb6871eb731a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:19.143893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cc6c0-4b07-44b7-aa1b-bb6871eb731a admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:19.144837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186cc6c0-4b07-44b7-aa1b-bb6871eb731a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:19.149007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186cc6c0-4b07-44b7-aa1b-bb6871eb731a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:19.159087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198feae-ec86-45d0-be33-820d12832a8f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:19.171867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2127698-f440-42d5-9efc-93dd75fcdd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:19.173115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2127698-f440-42d5-9efc-93dd75fcdd75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:19.173403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2127698-f440-42d5-9efc-93dd75fcdd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:19.174280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2127698-f440-42d5-9efc-93dd75fcdd75 admin admin] PATH_INFO: `/v3/projects/f163566907554620bc94de3b960a4f13` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:19.192589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2127698-f440-42d5-9efc-93dd75fcdd75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f163566907554620bc94de3b960a4f13)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:19.199184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2127698-f440-42d5-9efc-93dd75fcdd75 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:19.287697 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2162/4256] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:21:18 2022] POST /identity/v3/users => generated 293 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:19.288889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cc6c0-4b07-44b7-aa1b-bb6871eb731a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:19.301301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cc6c0-4b07-44b7-aa1b-bb6871eb731a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:19.307183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71413cd2-4b73-4e04-bb45-fc201bfa7a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:19.307870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71413cd2-4b73-4e04-bb45-fc201bfa7a7f admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:19.308588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71413cd2-4b73-4e04-bb45-fc201bfa7a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:19.309084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71413cd2-4b73-4e04-bb45-fc201bfa7a7f admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:19.311060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71413cd2-4b73-4e04-bb45-fc201bfa7a7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:21:19.315323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71413cd2-4b73-4e04-bb45-fc201bfa7a7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:19.315323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71413cd2-4b73-4e04-bb45-fc201bfa7a7f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:19.328843 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2163/4257] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:19.330008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71413cd2-4b73-4e04-bb45-fc201bfa7a7f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:19.337194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-71413cd2-4b73-4e04-bb45-fc201bfa7a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:19.365969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71413cd2-4b73-4e04-bb45-fc201bfa7a7f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:19.373877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87ba1c-b352-46f3-b08b-0a211dcea102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:19.375785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87ba1c-b352-46f3-b08b-0a211dcea102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:19.376225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87ba1c-b352-46f3-b08b-0a211dcea102 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:19.380485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87ba1c-b352-46f3-b08b-0a211dcea102 admin admin] PATH_INFO: `/v3/users/1f72b1e0b4124480bfd53b5c22a343e0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:19.380485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87ba1c-b352-46f3-b08b-0a211dcea102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f72b1e0b4124480bfd53b5c22a343e0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:19.382623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87ba1c-b352-46f3-b08b-0a211dcea102 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:19.476571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c2127698-f440-42d5-9efc-93dd75fcdd75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f163566907554620bc94de3b960a4f13', 'request_id': 'req-c2127698-f440-42d5-9efc-93dd75fcdd75'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:19.497160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c2127698-f440-42d5-9efc-93dd75fcdd75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f163566907554620bc94de3b960a4f13', 'request_id': 'req-c2127698-f440-42d5-9efc-93dd75fcdd75'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:19.521848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c2127698-f440-42d5-9efc-93dd75fcdd75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f163566907554620bc94de3b960a4f13', 'request_id': 'req-c2127698-f440-42d5-9efc-93dd75fcdd75'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:20.053204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fd87ba1c-b352-46f3-b08b-0a211dcea102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f72b1e0b4124480bfd53b5c22a343e0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:20.060690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fd87ba1c-b352-46f3-b08b-0a211dcea102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f72b1e0b4124480bfd53b5c22a343e0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:20.096468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c2127698-f440-42d5-9efc-93dd75fcdd75 admin admin] The token cache is being invalidate because project f163566907554620bc94de3b960a4f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:20.096754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c2127698-f440-42d5-9efc-93dd75fcdd75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:20.097408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c2127698-f440-42d5-9efc-93dd75fcdd75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:20.098977 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2095/4258] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:18 2022] DELETE /identity/v3/projects/f163566907554620bc94de3b960a4f13 => generated 0 bytes in 1189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:20.099845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2127698-f440-42d5-9efc-93dd75fcdd75 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:20.101153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c2127698-f440-42d5-9efc-93dd75fcdd75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:20.177105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2127698-f440-42d5-9efc-93dd75fcdd75 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:20.181916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cbf0c-90c1-4cac-ac4b-107d7136af70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:20.182672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cbf0c-90c1-4cac-ac4b-107d7136af70 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:20.183048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cbf0c-90c1-4cac-ac4b-107d7136af70 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:20.183409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cbf0c-90c1-4cac-ac4b-107d7136af70 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:20.184214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cbf0c-90c1-4cac-ac4b-107d7136af70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:20.186222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cbf0c-90c1-4cac-ac4b-107d7136af70 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:20.207554 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2096/4259] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:20.210038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cbf0c-90c1-4cac-ac4b-107d7136af70 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:20.212861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-028cbf0c-90c1-4cac-ac4b-107d7136af70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:20.232138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cbf0c-90c1-4cac-ac4b-107d7136af70 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:20.240431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20725259-a420-47b4-a33b-adb556febb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:20.241433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20725259-a420-47b4-a33b-adb556febb9a admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:20.242058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20725259-a420-47b4-a33b-adb556febb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:20.242290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20725259-a420-47b4-a33b-adb556febb9a admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:20.242999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20725259-a420-47b4-a33b-adb556febb9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:20.245207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20725259-a420-47b4-a33b-adb556febb9a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:20.263387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fd87ba1c-b352-46f3-b08b-0a211dcea102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f72b1e0b4124480bfd53b5c22a343e0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:20.267091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fd87ba1c-b352-46f3-b08b-0a211dcea102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f72b1e0b4124480bfd53b5c22a343e0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:20.281050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fd87ba1c-b352-46f3-b08b-0a211dcea102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f72b1e0b4124480bfd53b5c22a343e0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:20.290879 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2164/4260] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:19 2022] DELETE /identity/v3/users/1f72b1e0b4124480bfd53b5c22a343e0 => generated 0 bytes in 961 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:20.292804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e644d-898b-4dde-8d91-f78344d585aa None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:20.293317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e644d-898b-4dde-8d91-f78344d585aa None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:20.293940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e644d-898b-4dde-8d91-f78344d585aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:20.320982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-200e644d-898b-4dde-8d91-f78344d585aa None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:20.323341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-200e644d-898b-4dde-8d91-f78344d585aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:20.347276 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2097/4261] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:21:20 2022] POST /identity/v3/projects => generated 397 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:20.348623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20725259-a420-47b4-a33b-adb556febb9a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:20.354313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-20725259-a420-47b4-a33b-adb556febb9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:20.505777 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2165/4262] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:20.509781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e644d-898b-4dde-8d91-f78344d585aa None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:20.515803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-200e644d-898b-4dde-8d91-f78344d585aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:20.546958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e644d-898b-4dde-8d91-f78344d585aa None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:20.560131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20725259-a420-47b4-a33b-adb556febb9a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:20.563448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acd0f2-5847-48aa-8980-0835a5180a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:20.565933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acd0f2-5847-48aa-8980-0835a5180a10 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:20.568709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acd0f2-5847-48aa-8980-0835a5180a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:20.568709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acd0f2-5847-48aa-8980-0835a5180a10 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:20.571913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91acd0f2-5847-48aa-8980-0835a5180a10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:20.573656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355bd552-0947-4144-b86a-0de9734d90df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:20.573800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91acd0f2-5847-48aa-8980-0835a5180a10 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:20.574353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bd552-0947-4144-b86a-0de9734d90df admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:20.574636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bd552-0947-4144-b86a-0de9734d90df admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:20.574911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bd552-0947-4144-b86a-0de9734d90df admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:20.576608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355bd552-0947-4144-b86a-0de9734d90df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:20.578940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355bd552-0947-4144-b86a-0de9734d90df admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:20.592965 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2098/4263] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:20.594723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c513b9c-fb24-4c08-b9f3-99ceaf3e77a3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:20.595049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c513b9c-fb24-4c08-b9f3-99ceaf3e77a3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:20.595326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c513b9c-fb24-4c08-b9f3-99ceaf3e77a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:20.619478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1c513b9c-fb24-4c08-b9f3-99ceaf3e77a3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:20.621015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1c513b9c-fb24-4c08-b9f3-99ceaf3e77a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:20.634945 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2099/4264] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:20.635897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c513b9c-fb24-4c08-b9f3-99ceaf3e77a3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:20.655081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c513b9c-fb24-4c08-b9f3-99ceaf3e77a3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:20.679302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1127a6-a513-4122-8b38-40bce1e528c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:20.680376 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1127a6-a513-4122-8b38-40bce1e528c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:20.680774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1127a6-a513-4122-8b38-40bce1e528c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:20.681155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1127a6-a513-4122-8b38-40bce1e528c1 admin admin] PATH_INFO: `/v3/projects/cb98ffde19fc4bb3b939ca6ab437004c/users/f8df94afe8534f76bed49da43fb3e4c8/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:20.713866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1127a6-a513-4122-8b38-40bce1e528c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb98ffde19fc4bb3b939ca6ab437004c, user_id=f8df94afe8534f76bed49da43fb3e4c8, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:20.719690 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2166/4265] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:21:20 2022] POST /identity/v3/users => generated 305 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:20.721846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acd0f2-5847-48aa-8980-0835a5180a10 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:20.729848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1127a6-a513-4122-8b38-40bce1e528c1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:20.746538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acd0f2-5847-48aa-8980-0835a5180a10 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:20.754768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf56b5d-1c83-4281-8428-15d8fc320df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:20.756467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf56b5d-1c83-4281-8428-15d8fc320df8 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:20.761576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf56b5d-1c83-4281-8428-15d8fc320df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:20.761576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf56b5d-1c83-4281-8428-15d8fc320df8 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:20.761576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf56b5d-1c83-4281-8428-15d8fc320df8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:21:20.761576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf56b5d-1c83-4281-8428-15d8fc320df8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:20.761576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf56b5d-1c83-4281-8428-15d8fc320df8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:20.781555 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2167/4266] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:20.782622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf56b5d-1c83-4281-8428-15d8fc320df8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:20.784686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-faf56b5d-1c83-4281-8428-15d8fc320df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:20.803777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf56b5d-1c83-4281-8428-15d8fc320df8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:20.808941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a40ea-bfbb-49ca-b385-7e67538ee691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:20.810043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a40ea-bfbb-49ca-b385-7e67538ee691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:20.810570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a40ea-bfbb-49ca-b385-7e67538ee691 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:20.811141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a40ea-bfbb-49ca-b385-7e67538ee691 admin admin] PATH_INFO: `/v3/projects/0be222897b3a4864a39e9fc7d481340a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:20.812448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a40ea-bfbb-49ca-b385-7e67538ee691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0be222897b3a4864a39e9fc7d481340a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:20.815261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a40ea-bfbb-49ca-b385-7e67538ee691 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:20.867940 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2100/4267] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:20 2022] PUT /identity/v3/projects/cb98ffde19fc4bb3b939ca6ab437004c/users/f8df94afe8534f76bed49da43fb3e4c8/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:20.869163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1127a6-a513-4122-8b38-40bce1e528c1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:20.996736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b87a40ea-bfbb-49ca-b385-7e67538ee691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0be222897b3a4864a39e9fc7d481340a', 'request_id': 'req-b87a40ea-bfbb-49ca-b385-7e67538ee691'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:21.001293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1127a6-a513-4122-8b38-40bce1e528c1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:21.006228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b87a40ea-bfbb-49ca-b385-7e67538ee691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0be222897b3a4864a39e9fc7d481340a', 'request_id': 'req-b87a40ea-bfbb-49ca-b385-7e67538ee691'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:21.014156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b87a40ea-bfbb-49ca-b385-7e67538ee691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0be222897b3a4864a39e9fc7d481340a', 'request_id': 'req-b87a40ea-bfbb-49ca-b385-7e67538ee691'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:21.101359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d975b-9b3c-4891-8b02-90ff9e86d038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:21.102456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d975b-9b3c-4891-8b02-90ff9e86d038 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:21.102741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d975b-9b3c-4891-8b02-90ff9e86d038 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:21.103045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d975b-9b3c-4891-8b02-90ff9e86d038 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:21.104173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d975b-9b3c-4891-8b02-90ff9e86d038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:21.106002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d975b-9b3c-4891-8b02-90ff9e86d038 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:21.123933 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2101/4268] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:21.123933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d975b-9b3c-4891-8b02-90ff9e86d038 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:21.125629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b87a40ea-bfbb-49ca-b385-7e67538ee691 admin admin] The token cache is being invalidate because project 0be222897b3a4864a39e9fc7d481340a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:21.125923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b87a40ea-bfbb-49ca-b385-7e67538ee691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:21.129910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b87a40ea-bfbb-49ca-b385-7e67538ee691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:21.132113 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2168/4269] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:20 2022] DELETE /identity/v3/projects/0be222897b3a4864a39e9fc7d481340a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:21.136773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43436a1-733e-4606-bad6-fd80ca105657 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:21.137066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43436a1-733e-4606-bad6-fd80ca105657 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:21.137346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43436a1-733e-4606-bad6-fd80ca105657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:21.152748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d975b-9b3c-4891-8b02-90ff9e86d038 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:21.164329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228227a-05da-4931-8a31-5572e7455bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:21.165110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228227a-05da-4931-8a31-5572e7455bbc admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:21.165467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228227a-05da-4931-8a31-5572e7455bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:21.165812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228227a-05da-4931-8a31-5572e7455bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:21.166588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228227a-05da-4931-8a31-5572e7455bbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:21.175305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228227a-05da-4931-8a31-5572e7455bbc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:21.183265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c43436a1-733e-4606-bad6-fd80ca105657 None None] MFA Rules not processed for user `f8df94afe8534f76bed49da43fb3e4c8`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:21.185532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c43436a1-733e-4606-bad6-fd80ca105657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:21.238714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:21.308498 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2102/4270] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:21:21 2022] POST /identity/v3/projects => generated 393 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:21.309052 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2169/4271] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:21.310090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43436a1-733e-4606-bad6-fd80ca105657 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:21.311368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb160600-ad29-4ef1-954f-5a669cc3f12b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:21.311822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb160600-ad29-4ef1-954f-5a669cc3f12b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:21.312037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c43436a1-733e-4606-bad6-fd80ca105657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:21.312417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb160600-ad29-4ef1-954f-5a669cc3f12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:21.331564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43436a1-733e-4606-bad6-fd80ca105657 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:21.336571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-fb160600-ad29-4ef1-954f-5a669cc3f12b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:21.338664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fb160600-ad29-4ef1-954f-5a669cc3f12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:21.402470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fc7d8-45f0-47f4-8d76-7fb679eec89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:21.403728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fc7d8-45f0-47f4-8d76-7fb679eec89b admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:21.403728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fc7d8-45f0-47f4-8d76-7fb679eec89b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:21.403933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fc7d8-45f0-47f4-8d76-7fb679eec89b admin admin] PATH_INFO: `/v3/projects/e6efca087da44732b7669382cd0d43f3/users/22d19fc167f24b77abd6f6851a308ae3/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:21.422318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fc7d8-45f0-47f4-8d76-7fb679eec89b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6efca087da44732b7669382cd0d43f3, user_id=22d19fc167f24b77abd6f6851a308ae3, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:21.428028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fc7d8-45f0-47f4-8d76-7fb679eec89b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:21.435596 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2103/4272] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:21.439927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb160600-ad29-4ef1-954f-5a669cc3f12b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:21.443179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fb160600-ad29-4ef1-954f-5a669cc3f12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:21.457148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb160600-ad29-4ef1-954f-5a669cc3f12b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:21.464321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e70070-ead8-4b3c-ae48-4b6f30abd720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:21.472659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e70070-ead8-4b3c-ae48-4b6f30abd720 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:21.472659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e70070-ead8-4b3c-ae48-4b6f30abd720 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:21.472659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e70070-ead8-4b3c-ae48-4b6f30abd720 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:21.472659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e70070-ead8-4b3c-ae48-4b6f30abd720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:21.472659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e70070-ead8-4b3c-ae48-4b6f30abd720 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:21.532183 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2170/4273] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:21 2022] PUT /identity/v3/projects/e6efca087da44732b7669382cd0d43f3/users/22d19fc167f24b77abd6f6851a308ae3/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:21.536218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fc7d8-45f0-47f4-8d76-7fb679eec89b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:21.538414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-722fc7d8-45f0-47f4-8d76-7fb679eec89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:21.572431 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2104/4274] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:21:21 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:21.574834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409ce85-d93e-4167-b13f-6bb27bd6f7f6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:21.576448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409ce85-d93e-4167-b13f-6bb27bd6f7f6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:21.576946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409ce85-d93e-4167-b13f-6bb27bd6f7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:21.611654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a409ce85-d93e-4167-b13f-6bb27bd6f7f6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:21.613538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a409ce85-d93e-4167-b13f-6bb27bd6f7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:21.682116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fc7d8-45f0-47f4-8d76-7fb679eec89b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:21.693022 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2105/4275] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:21.693788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409ce85-d93e-4167-b13f-6bb27bd6f7f6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:21.698711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af2cf5-c7e3-4af5-bf3f-29e4cd4894fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:21.698711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af2cf5-c7e3-4af5-bf3f-29e4cd4894fb admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:21.698711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af2cf5-c7e3-4af5-bf3f-29e4cd4894fb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:21.698711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af2cf5-c7e3-4af5-bf3f-29e4cd4894fb admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:21.699055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af2cf5-c7e3-4af5-bf3f-29e4cd4894fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:21.699055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af2cf5-c7e3-4af5-bf3f-29e4cd4894fb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:21.704377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409ce85-d93e-4167-b13f-6bb27bd6f7f6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:21.709756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6362d6c-e572-4175-97f5-fe0d5594df65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:21.710438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6362d6c-e572-4175-97f5-fe0d5594df65 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:21.710721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6362d6c-e572-4175-97f5-fe0d5594df65 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:21.710999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6362d6c-e572-4175-97f5-fe0d5594df65 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:21.711948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6362d6c-e572-4175-97f5-fe0d5594df65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:21.713991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6362d6c-e572-4175-97f5-fe0d5594df65 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:21.727100 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2106/4276] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:21.728037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6362d6c-e572-4175-97f5-fe0d5594df65 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:21.741959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6362d6c-e572-4175-97f5-fe0d5594df65 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:21.747614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434ae55-2f81-4125-8244-624bf40985ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:21.748279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434ae55-2f81-4125-8244-624bf40985ab admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:21.748814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434ae55-2f81-4125-8244-624bf40985ab admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:21.750558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434ae55-2f81-4125-8244-624bf40985ab admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:21.750558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434ae55-2f81-4125-8244-624bf40985ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:21.752658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434ae55-2f81-4125-8244-624bf40985ab admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:21.801353 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2171/4277] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:21:21 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:21.802248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af2cf5-c7e3-4af5-bf3f-29e4cd4894fb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:21.813777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af2cf5-c7e3-4af5-bf3f-29e4cd4894fb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:21.819938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffc954-422a-4833-84e3-28506b425f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:21.820747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffc954-422a-4833-84e3-28506b425f46 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:21.821032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffc954-422a-4833-84e3-28506b425f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:21.821308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffc954-422a-4833-84e3-28506b425f46 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:21.822068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffc954-422a-4833-84e3-28506b425f46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:21:21.822375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffc954-422a-4833-84e3-28506b425f46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:21.824026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffc954-422a-4833-84e3-28506b425f46 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:21.839475 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2172/4278] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:21.840859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:21.842408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffc954-422a-4833-84e3-28506b425f46 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:21.868052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffc954-422a-4833-84e3-28506b425f46 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:21.872931 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2107/4279] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:21:21 2022] POST /identity/v3/users => generated 299 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:21.874011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434ae55-2f81-4125-8244-624bf40985ab admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:21.878484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73c4df-d4d0-45e5-b849-ae6746480972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:21.899787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434ae55-2f81-4125-8244-624bf40985ab admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:21.900694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73c4df-d4d0-45e5-b849-ae6746480972 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:21.901077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73c4df-d4d0-45e5-b849-ae6746480972 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:21.902031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73c4df-d4d0-45e5-b849-ae6746480972 admin admin] PATH_INFO: `/v3/projects/e6efca087da44732b7669382cd0d43f3/users/22d19fc167f24b77abd6f6851a308ae3/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:21.904565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73c4df-d4d0-45e5-b849-ae6746480972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6efca087da44732b7669382cd0d43f3, user_id=22d19fc167f24b77abd6f6851a308ae3, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:21.909046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73c4df-d4d0-45e5-b849-ae6746480972 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:21.915358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924dcd2-250e-4334-a7c4-e4e870da01f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:21.915755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924dcd2-250e-4334-a7c4-e4e870da01f4 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:21.916044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924dcd2-250e-4334-a7c4-e4e870da01f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:21.916332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924dcd2-250e-4334-a7c4-e4e870da01f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:21.917770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924dcd2-250e-4334-a7c4-e4e870da01f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:21.925646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924dcd2-250e-4334-a7c4-e4e870da01f4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:21.935089 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2173/4280] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:21 2022] PUT /identity/v3/projects/e6efca087da44732b7669382cd0d43f3/users/22d19fc167f24b77abd6f6851a308ae3/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:21.935814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73c4df-d4d0-45e5-b849-ae6746480972 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:21.968263 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2108/4281] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:21.969274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924dcd2-250e-4334-a7c4-e4e870da01f4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:21.993717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924dcd2-250e-4334-a7c4-e4e870da01f4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:22.065718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73c4df-d4d0-45e5-b849-ae6746480972 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:22.078227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9a055-73e9-4c24-9773-4feda1214bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:22.081143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9a055-73e9-4c24-9773-4feda1214bee admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:22.081731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9a055-73e9-4c24-9773-4feda1214bee admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:22.082419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9a055-73e9-4c24-9773-4feda1214bee admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:22.083578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9a055-73e9-4c24-9773-4feda1214bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:22.096804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9a055-73e9-4c24-9773-4feda1214bee admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:22.148682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d049d-afbc-4cf7-862e-9187d84d216d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:22.150387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d049d-afbc-4cf7-862e-9187d84d216d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:22.150776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d049d-afbc-4cf7-862e-9187d84d216d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:22.151189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d049d-afbc-4cf7-862e-9187d84d216d admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:22.152623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d049d-afbc-4cf7-862e-9187d84d216d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:22.154653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d049d-afbc-4cf7-862e-9187d84d216d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:22.178677 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2109/4282] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:22.181501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374ddde-2108-4950-9e0c-c47c6f9d80bd None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:22.181940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374ddde-2108-4950-9e0c-c47c6f9d80bd None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:22.182316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374ddde-2108-4950-9e0c-c47c6f9d80bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:22.229431 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2174/4283] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:21:21 2022] POST /identity/v3/projects => generated 389 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:22.239456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9a055-73e9-4c24-9773-4feda1214bee admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:22.250083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c374ddde-2108-4950-9e0c-c47c6f9d80bd None None] MFA Rules not processed for user `22d19fc167f24b77abd6f6851a308ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:22.252301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c374ddde-2108-4950-9e0c-c47c6f9d80bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:22.331468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9a055-73e9-4c24-9773-4feda1214bee admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:22.340430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccfe44-3042-4865-bef5-33324717dac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:22.344816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccfe44-3042-4865-bef5-33324717dac1 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:22.344816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccfe44-3042-4865-bef5-33324717dac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:22.344816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccfe44-3042-4865-bef5-33324717dac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:22.344816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccfe44-3042-4865-bef5-33324717dac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:22.346296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccfe44-3042-4865-bef5-33324717dac1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:22.347456 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2110/4284] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:22.348844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374ddde-2108-4950-9e0c-c47c6f9d80bd None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:22.362208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374ddde-2108-4950-9e0c-c47c6f9d80bd None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:22.367855 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2175/4285] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:22.368872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccfe44-3042-4865-bef5-33324717dac1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:22.369224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d3266-40cc-4375-926a-73d319cff978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:22.371158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d3266-40cc-4375-926a-73d319cff978 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:22.371636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d3266-40cc-4375-926a-73d319cff978 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:22.374388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d3266-40cc-4375-926a-73d319cff978 admin admin] PATH_INFO: `/v3/projects/671c6b344c674cc99c4efd813844c30e/users/fcc0073a9f674e67b2f7815c541c3e22/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:22.382023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccfe44-3042-4865-bef5-33324717dac1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:22.390218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb53c4-df87-42b0-b3d6-c1fa8a0aead4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:22.390996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb53c4-df87-42b0-b3d6-c1fa8a0aead4 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:22.391404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb53c4-df87-42b0-b3d6-c1fa8a0aead4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:22.391683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d3266-40cc-4375-926a-73d319cff978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=671c6b344c674cc99c4efd813844c30e, user_id=fcc0073a9f674e67b2f7815c541c3e22, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:22.391811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb53c4-df87-42b0-b3d6-c1fa8a0aead4 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:22.393279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb53c4-df87-42b0-b3d6-c1fa8a0aead4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:22.395489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb53c4-df87-42b0-b3d6-c1fa8a0aead4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:22.396782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d3266-40cc-4375-926a-73d319cff978 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:22.398935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:22.475469 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2111/4286] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:22 2022] PUT /identity/v3/projects/671c6b344c674cc99c4efd813844c30e/users/fcc0073a9f674e67b2f7815c541c3e22/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:22.475469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d3266-40cc-4375-926a-73d319cff978 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:22.520342 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2176/4287] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:21:22 2022] POST /identity/v3/users => generated 295 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:22.524342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb53c4-df87-42b0-b3d6-c1fa8a0aead4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:22.545857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb53c4-df87-42b0-b3d6-c1fa8a0aead4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:22.566722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d3266-40cc-4375-926a-73d319cff978 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:22.572672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d5a9a-b900-4d74-a24f-c5581e7a9353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:22.573402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d5a9a-b900-4d74-a24f-c5581e7a9353 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:22.573748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d5a9a-b900-4d74-a24f-c5581e7a9353 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:22.574144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d5a9a-b900-4d74-a24f-c5581e7a9353 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:22.575600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d5a9a-b900-4d74-a24f-c5581e7a9353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:22.577692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d5a9a-b900-4d74-a24f-c5581e7a9353 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:22.637200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52e58c-3e77-458e-8959-9818d36547bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:22.638220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52e58c-3e77-458e-8959-9818d36547bb admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:22.638496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52e58c-3e77-458e-8959-9818d36547bb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:22.638781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52e58c-3e77-458e-8959-9818d36547bb admin admin] PATH_INFO: `/v3/projects/65644a8df5d84df3b35c894560e0a5c4/users/aaf2292818b749f0ae43c66bca929be9/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:22.655089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52e58c-3e77-458e-8959-9818d36547bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=65644a8df5d84df3b35c894560e0a5c4, user_id=aaf2292818b749f0ae43c66bca929be9, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:22.657769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52e58c-3e77-458e-8959-9818d36547bb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:22.670241 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2112/4288] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:21:22 2022] POST /identity/v3/projects => generated 395 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:22.675204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d5a9a-b900-4d74-a24f-c5581e7a9353 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:22.766942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d5a9a-b900-4d74-a24f-c5581e7a9353 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:22.768891 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2177/4289] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:22 2022] PUT /identity/v3/projects/65644a8df5d84df3b35c894560e0a5c4/users/aaf2292818b749f0ae43c66bca929be9/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:22.769893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52e58c-3e77-458e-8959-9818d36547bb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:22.858061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:22.895554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459843c-6a10-4937-aec2-19815783f8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:22.896508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459843c-6a10-4937-aec2-19815783f8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:22.896894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459843c-6a10-4937-aec2-19815783f8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:22.897268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459843c-6a10-4937-aec2-19815783f8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:22.898153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459843c-6a10-4937-aec2-19815783f8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:22.899909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459843c-6a10-4937-aec2-19815783f8f1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:22.916547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52e58c-3e77-458e-8959-9818d36547bb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:22.932602 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2113/4290] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:22.932602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459843c-6a10-4937-aec2-19815783f8f1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:22.937556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09787e56-004c-4b76-bdd1-c50211fc0005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:22.938512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09787e56-004c-4b76-bdd1-c50211fc0005 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:22.938969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09787e56-004c-4b76-bdd1-c50211fc0005 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:22.940168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09787e56-004c-4b76-bdd1-c50211fc0005 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:22.941879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09787e56-004c-4b76-bdd1-c50211fc0005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:22.945460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09787e56-004c-4b76-bdd1-c50211fc0005 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:22.951796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459843c-6a10-4937-aec2-19815783f8f1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:22.966231 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2178/4291] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:22.967920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac4cb3-a039-4177-9c5d-b95d684e38fd None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:22.971951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac4cb3-a039-4177-9c5d-b95d684e38fd None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:22.972427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac4cb3-a039-4177-9c5d-b95d684e38fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:22.983043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd29d17-4482-49fa-8a50-7a338015b993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:22.983043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd29d17-4482-49fa-8a50-7a338015b993 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:22.983043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd29d17-4482-49fa-8a50-7a338015b993 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:22.983043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd29d17-4482-49fa-8a50-7a338015b993 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:22.983527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd29d17-4482-49fa-8a50-7a338015b993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:22.987096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd29d17-4482-49fa-8a50-7a338015b993 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:23.024372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1cac4cb3-a039-4177-9c5d-b95d684e38fd None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:23.026247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1cac4cb3-a039-4177-9c5d-b95d684e38fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:23.038136 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2179/4292] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:23.039088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac4cb3-a039-4177-9c5d-b95d684e38fd None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:23.053037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac4cb3-a039-4177-9c5d-b95d684e38fd None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:23.059193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664d3ae-98e7-4eb1-8000-2bde44aec36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:23.060369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664d3ae-98e7-4eb1-8000-2bde44aec36c admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:23.060711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664d3ae-98e7-4eb1-8000-2bde44aec36c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:23.065199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664d3ae-98e7-4eb1-8000-2bde44aec36c admin admin] PATH_INFO: `/v3/projects/671c6b344c674cc99c4efd813844c30e/users/fcc0073a9f674e67b2f7815c541c3e22/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:23.065199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664d3ae-98e7-4eb1-8000-2bde44aec36c admin admin] RBAC: Authorizing `identity:create_grant(project_id=671c6b344c674cc99c4efd813844c30e, user_id=fcc0073a9f674e67b2f7815c541c3e22, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:23.069166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664d3ae-98e7-4eb1-8000-2bde44aec36c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:23.087054 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2180/4293] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:23 2022] PUT /identity/v3/projects/671c6b344c674cc99c4efd813844c30e/users/fcc0073a9f674e67b2f7815c541c3e22/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:23.087831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664d3ae-98e7-4eb1-8000-2bde44aec36c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:23.156348 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2114/4294] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:21:22 2022] POST /identity/v3/users => generated 298 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:23.157698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd29d17-4482-49fa-8a50-7a338015b993 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:23.162156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1fd29d17-4482-49fa-8a50-7a338015b993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:23.180232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664d3ae-98e7-4eb1-8000-2bde44aec36c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:23.187108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6422c-8c82-4640-9a07-af526948f6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:23.187786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6422c-8c82-4640-9a07-af526948f6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:23.188071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6422c-8c82-4640-9a07-af526948f6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:23.188347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6422c-8c82-4640-9a07-af526948f6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:23.190718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6422c-8c82-4640-9a07-af526948f6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:23.192809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6422c-8c82-4640-9a07-af526948f6d9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:23.209201 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2181/4295] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:23.211513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a908178-8dff-40fb-bbc8-a4db220027f0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:23.212129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a908178-8dff-40fb-bbc8-a4db220027f0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:23.212571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a908178-8dff-40fb-bbc8-a4db220027f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:23.273370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2a908178-8dff-40fb-bbc8-a4db220027f0 None None] MFA Rules not processed for user `fcc0073a9f674e67b2f7815c541c3e22`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:23.274962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2a908178-8dff-40fb-bbc8-a4db220027f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:23.298906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd29d17-4482-49fa-8a50-7a338015b993 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:23.336996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:23.389840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba577ab5-f409-49af-84de-1813dea86821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:23.393007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba577ab5-f409-49af-84de-1813dea86821 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:23.393847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba577ab5-f409-49af-84de-1813dea86821 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:23.394448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba577ab5-f409-49af-84de-1813dea86821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:23.406717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba577ab5-f409-49af-84de-1813dea86821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:23.409760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba577ab5-f409-49af-84de-1813dea86821 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:23.426170 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2115/4296] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:21:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:21:23.428605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba577ab5-f409-49af-84de-1813dea86821 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:23.441634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba577ab5-f409-49af-84de-1813dea86821 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:23.447548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df77772-561c-473d-85fc-5167e5ae9a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:23.448542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df77772-561c-473d-85fc-5167e5ae9a14 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:23.449439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df77772-561c-473d-85fc-5167e5ae9a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:23.450478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df77772-561c-473d-85fc-5167e5ae9a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:23.451460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df77772-561c-473d-85fc-5167e5ae9a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:23.452365 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2182/4297] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:23.453214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a908178-8dff-40fb-bbc8-a4db220027f0 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:23.454244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df77772-561c-473d-85fc-5167e5ae9a14 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:23.475107 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2116/4298] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:23.476652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df77772-561c-473d-85fc-5167e5ae9a14 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:23.477312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a908178-8dff-40fb-bbc8-a4db220027f0 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:23.487685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef8070-4566-4122-b300-cd26ab91bd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:23.488606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef8070-4566-4122-b300-cd26ab91bd7e admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:23.488897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef8070-4566-4122-b300-cd26ab91bd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:23.492870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef8070-4566-4122-b300-cd26ab91bd7e admin admin] PATH_INFO: `/v3/projects/c95a2d1e0a034c7ca4a2fcb9fd060d53/users/fa4c2791e14d4f88883a0af422e4ff0c/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:23.493117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df77772-561c-473d-85fc-5167e5ae9a14 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:23.507380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b9935-0f93-4cec-b5c2-c355d33968d9 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcc0073a9f674e67b2f7815c541c3e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '671c6b344c674cc99c4efd813844c30e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:23.508442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b9935-0f93-4cec-b5c2-c355d33968d9 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:23.509112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b9935-0f93-4cec-b5c2-c355d33968d9 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:23.509641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b9935-0f93-4cec-b5c2-c355d33968d9 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:23.510795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b9935-0f93-4cec-b5c2-c355d33968d9 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:23.514927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b9935-0f93-4cec-b5c2-c355d33968d9 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:23.523958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:23.531821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef8070-4566-4122-b300-cd26ab91bd7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95a2d1e0a034c7ca4a2fcb9fd060d53, user_id=fa4c2791e14d4f88883a0af422e4ff0c, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:23.535758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef8070-4566-4122-b300-cd26ab91bd7e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:23.667073 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2117/4299] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:21:23 2022] POST /identity/v3/projects => generated 359 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:23.672869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b9935-0f93-4cec-b5c2-c355d33968d9 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:23.676512 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2183/4300] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:23 2022] PUT /identity/v3/projects/c95a2d1e0a034c7ca4a2fcb9fd060d53/users/fa4c2791e14d4f88883a0af422e4ff0c/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:23.681429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef8070-4566-4122-b300-cd26ab91bd7e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:23.825059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b9935-0f93-4cec-b5c2-c355d33968d9 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:23.835286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8765b5-1f04-4cd9-8cd8-b73b799263fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:23.835952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8765b5-1f04-4cd9-8cd8-b73b799263fe admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:23.836239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8765b5-1f04-4cd9-8cd8-b73b799263fe admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:23.836515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8765b5-1f04-4cd9-8cd8-b73b799263fe admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:23.837249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8765b5-1f04-4cd9-8cd8-b73b799263fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:23.839059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8765b5-1f04-4cd9-8cd8-b73b799263fe admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:23.855395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef8070-4566-4122-b300-cd26ab91bd7e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:23.863299 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2118/4301] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:23.865175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b57cc-dce8-410d-8cfe-9d95ace9a074 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:23.865470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b57cc-dce8-410d-8cfe-9d95ace9a074 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:23.865750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b57cc-dce8-410d-8cfe-9d95ace9a074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:23.901862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9b6b57cc-dce8-410d-8cfe-9d95ace9a074 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:23.903865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9b6b57cc-dce8-410d-8cfe-9d95ace9a074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:23.916739 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2119/4302] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:23.933884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b57cc-dce8-410d-8cfe-9d95ace9a074 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:23.957996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:23.968451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b57cc-dce8-410d-8cfe-9d95ace9a074 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:23.984486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc04f3d-33de-421b-9d3a-2bc9da4ebb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:23.989847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc04f3d-33de-421b-9d3a-2bc9da4ebb2d admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:23.990141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc04f3d-33de-421b-9d3a-2bc9da4ebb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:23.990420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc04f3d-33de-421b-9d3a-2bc9da4ebb2d admin admin] PATH_INFO: `/v3/projects/1da0d5b86b824690ab6cb35b01cbf33c/users/9269eaceca6d4ef7b038160513201aed/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:23.995053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c5312-40ff-46b1-9f41-0117d1bf4e02 tempest-ProjectsNegativeTestJSON-1362768848 tempest-ProjectsNegativeTestJSON-1362768848-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8df94afe8534f76bed49da43fb3e4c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb98ffde19fc4bb3b939ca6ab437004c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:23.999197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c5312-40ff-46b1-9f41-0117d1bf4e02 tempest-ProjectsNegativeTestJSON-1362768848 tempest-ProjectsNegativeTestJSON-1362768848-project] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:23.999197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c5312-40ff-46b1-9f41-0117d1bf4e02 tempest-ProjectsNegativeTestJSON-1362768848 tempest-ProjectsNegativeTestJSON-1362768848-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:23.999197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c5312-40ff-46b1-9f41-0117d1bf4e02 tempest-ProjectsNegativeTestJSON-1362768848 tempest-ProjectsNegativeTestJSON-1362768848-project] PATH_INFO: `/v3/projects/a8cade640d82461e9d45a1be50c45702` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:23.999197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c5312-40ff-46b1-9f41-0117d1bf4e02 tempest-ProjectsNegativeTestJSON-1362768848 tempest-ProjectsNegativeTestJSON-1362768848-project] RBAC: Authorizing `identity:delete_project(project_id=a8cade640d82461e9d45a1be50c45702)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:24.014719 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-a45c5312-40ff-46b1-9f41-0117d1bf4e02 tempest-ProjectsNegativeTestJSON-1362768848 tempest-ProjectsNegativeTestJSON-1362768848-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jul 16 21:21:24.014719 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:24.014719 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:21:24.014719 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:21:24.014719 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:21:24.014719 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:21:24.014719 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:21:24.014719 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:21:24.014719 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:21:24.014719 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:21:24.014719 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:21:24.014719 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:21:24.014719 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Jul 16 21:21:24.014719 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 16 21:21:24.016647 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 16 21:21:24.016647 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 16 21:21:24.016647 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 16 21:21:24.016647 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 16 21:21:24.016647 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 16 21:21:24.016647 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 16 21:21:24.016647 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jul 16 21:21:24.016647 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:24.035051 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2184/4303] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:23 2022] DELETE /identity/v3/projects/a8cade640d82461e9d45a1be50c45702 => generated 136 bytes in 353 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:21:24.040247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c5312-40ff-46b1-9f41-0117d1bf4e02 tempest-ProjectsNegativeTestJSON-1362768848 tempest-ProjectsNegativeTestJSON-1362768848-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:24.043933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a45c5312-40ff-46b1-9f41-0117d1bf4e02 tempest-ProjectsNegativeTestJSON-1362768848 tempest-ProjectsNegativeTestJSON-1362768848-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:24.061312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc04f3d-33de-421b-9d3a-2bc9da4ebb2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da0d5b86b824690ab6cb35b01cbf33c, user_id=9269eaceca6d4ef7b038160513201aed, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:24.069391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc04f3d-33de-421b-9d3a-2bc9da4ebb2d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:24.195100 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2120/4304] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:23 2022] PUT /identity/v3/projects/1da0d5b86b824690ab6cb35b01cbf33c/users/9269eaceca6d4ef7b038160513201aed/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:24.196211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc04f3d-33de-421b-9d3a-2bc9da4ebb2d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:24.230692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c5312-40ff-46b1-9f41-0117d1bf4e02 tempest-ProjectsNegativeTestJSON-1362768848 tempest-ProjectsNegativeTestJSON-1362768848-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:24.349719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b67e2-daff-45c6-adad-2f697d9f365b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:24.354492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b67e2-daff-45c6-adad-2f697d9f365b service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:24.354951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b67e2-daff-45c6-adad-2f697d9f365b service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:24.355373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b67e2-daff-45c6-adad-2f697d9f365b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:24.355555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc04f3d-33de-421b-9d3a-2bc9da4ebb2d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:24.361198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef294868-4c0c-41d8-8ac9-24f62b1c1562 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcc0073a9f674e67b2f7815c541c3e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '671c6b344c674cc99c4efd813844c30e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:24.362772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef294868-4c0c-41d8-8ac9-24f62b1c1562 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:24.363104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef294868-4c0c-41d8-8ac9-24f62b1c1562 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:24.367920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef294868-4c0c-41d8-8ac9-24f62b1c1562 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] PATH_INFO: `/v3/projects/a8cade640d82461e9d45a1be50c45702` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:24.367920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef294868-4c0c-41d8-8ac9-24f62b1c1562 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a8cade640d82461e9d45a1be50c45702)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:24.367920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef294868-4c0c-41d8-8ac9-24f62b1c1562 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:24.415405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:24.487147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b67e2-daff-45c6-adad-2f697d9f365b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:24.489589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b67e2-daff-45c6-adad-2f697d9f365b service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:24.509548 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2185/4305] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:21:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:21:24.509548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf59e8a-ee59-4e8f-a586-bbfb26f8196e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:24.509548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf59e8a-ee59-4e8f-a586-bbfb26f8196e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:24.509548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf59e8a-ee59-4e8f-a586-bbfb26f8196e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:24.543725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7bf59e8a-ee59-4e8f-a586-bbfb26f8196e None None] MFA Rules not processed for user `9269eaceca6d4ef7b038160513201aed`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:24.545183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7bf59e8a-ee59-4e8f-a586-bbfb26f8196e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:24.606322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ef294868-4c0c-41d8-8ac9-24f62b1c1562 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8cade640d82461e9d45a1be50c45702', 'request_id': 'req-ef294868-4c0c-41d8-8ac9-24f62b1c1562'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:24.619275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ef294868-4c0c-41d8-8ac9-24f62b1c1562 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8cade640d82461e9d45a1be50c45702', 'request_id': 'req-ef294868-4c0c-41d8-8ac9-24f62b1c1562'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:24.637035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ef294868-4c0c-41d8-8ac9-24f62b1c1562 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8cade640d82461e9d45a1be50c45702', 'request_id': 'req-ef294868-4c0c-41d8-8ac9-24f62b1c1562'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:24.650548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:24.668395 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2186/4306] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:24.677058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf59e8a-ee59-4e8f-a586-bbfb26f8196e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:24.682450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7bf59e8a-ee59-4e8f-a586-bbfb26f8196e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:24.732287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ef294868-4c0c-41d8-8ac9-24f62b1c1562 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] The token cache is being invalidate because project a8cade640d82461e9d45a1be50c45702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:24.732583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ef294868-4c0c-41d8-8ac9-24f62b1c1562 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:24.734461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ef294868-4c0c-41d8-8ac9-24f62b1c1562 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:24.742984 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2121/4307] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:24 2022] DELETE /identity/v3/projects/a8cade640d82461e9d45a1be50c45702 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:24.743911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef294868-4c0c-41d8-8ac9-24f62b1c1562 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:24.752040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ef294868-4c0c-41d8-8ac9-24f62b1c1562 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:24.862765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf59e8a-ee59-4e8f-a586-bbfb26f8196e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:25.020617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef294868-4c0c-41d8-8ac9-24f62b1c1562 tempest-ProjectsNegativeTestJSON-2108606664 tempest-ProjectsNegativeTestJSON-2108606664-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:25.031823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61ea0f-dfeb-4228-95f1-065230436de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:25.033531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61ea0f-dfeb-4228-95f1-065230436de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:25.035417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61ea0f-dfeb-4228-95f1-065230436de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:25.036970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61ea0f-dfeb-4228-95f1-065230436de0 admin admin] PATH_INFO: `/v3/users/f8df94afe8534f76bed49da43fb3e4c8` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:25.040975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61ea0f-dfeb-4228-95f1-065230436de0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8df94afe8534f76bed49da43fb3e4c8)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:25.050128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61ea0f-dfeb-4228-95f1-065230436de0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:25.052618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b965b-9190-4a3e-98ed-cd9943935eca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:25.053292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b965b-9190-4a3e-98ed-cd9943935eca service glance] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:25.054604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b965b-9190-4a3e-98ed-cd9943935eca service glance] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:25.054920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b965b-9190-4a3e-98ed-cd9943935eca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:25.062413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:25.065863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9d8b965b-9190-4a3e-98ed-cd9943935eca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:25.277551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b965b-9190-4a3e-98ed-cd9943935eca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:25.279856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b965b-9190-4a3e-98ed-cd9943935eca service glance] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:25.301904 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2187/4308] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:21:24 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:21:25.354166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:25.368567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3f61ea0f-dfeb-4228-95f1-065230436de0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8df94afe8534f76bed49da43fb3e4c8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:25.392260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3f61ea0f-dfeb-4228-95f1-065230436de0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8df94afe8534f76bed49da43fb3e4c8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:25.787946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3f61ea0f-dfeb-4228-95f1-065230436de0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8df94afe8534f76bed49da43fb3e4c8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:25.798162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3f61ea0f-dfeb-4228-95f1-065230436de0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8df94afe8534f76bed49da43fb3e4c8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:25.799560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3f61ea0f-dfeb-4228-95f1-065230436de0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8df94afe8534f76bed49da43fb3e4c8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:25.818746 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2122/4309] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:24 2022] DELETE /identity/v3/users/f8df94afe8534f76bed49da43fb3e4c8 => generated 0 bytes in 1075 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:25.830255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36b342-bbe3-4461-8dfc-589402feb94c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:25.830547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36b342-bbe3-4461-8dfc-589402feb94c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:25.830826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36b342-bbe3-4461-8dfc-589402feb94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:25.875213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-bb36b342-bbe3-4461-8dfc-589402feb94c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:25.885045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bb36b342-bbe3-4461-8dfc-589402feb94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:26.015512 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2188/4310] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:26.059559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61ea0f-dfeb-4228-95f1-065230436de0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:26.061318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3f61ea0f-dfeb-4228-95f1-065230436de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:26.193711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61ea0f-dfeb-4228-95f1-065230436de0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:26.211036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ccb46-7bdb-479b-943f-0a435dfa9fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:26.211827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ccb46-7bdb-479b-943f-0a435dfa9fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:26.212354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ccb46-7bdb-479b-943f-0a435dfa9fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:26.213489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ccb46-7bdb-479b-943f-0a435dfa9fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:26.253920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ccb46-7bdb-479b-943f-0a435dfa9fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:26.255816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ccb46-7bdb-479b-943f-0a435dfa9fd4 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:26.285742 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2123/4311] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:21:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:21:26.916671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36b342-bbe3-4461-8dfc-589402feb94c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:26.918142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bb36b342-bbe3-4461-8dfc-589402feb94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:26.931104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36b342-bbe3-4461-8dfc-589402feb94c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:26.936183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71820ad4-1bb2-497b-89a9-ea3a9fb4e55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:26.937062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71820ad4-1bb2-497b-89a9-ea3a9fb4e55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:26.937341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71820ad4-1bb2-497b-89a9-ea3a9fb4e55a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:26.937802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71820ad4-1bb2-497b-89a9-ea3a9fb4e55a admin admin] PATH_INFO: `/v3/users/22d19fc167f24b77abd6f6851a308ae3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:26.939212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71820ad4-1bb2-497b-89a9-ea3a9fb4e55a admin admin] RBAC: Authorizing `identity:delete_user(user_id=22d19fc167f24b77abd6f6851a308ae3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:26.941581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71820ad4-1bb2-497b-89a9-ea3a9fb4e55a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:27.074391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ccb46-7bdb-479b-943f-0a435dfa9fd4 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:27.075977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a38ccb46-7bdb-479b-943f-0a435dfa9fd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:27.170717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ccb46-7bdb-479b-943f-0a435dfa9fd4 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:27.176873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72c4fd-9891-4b7d-8d5d-e7c05d48f339 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:27.177818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72c4fd-9891-4b7d-8d5d-e7c05d48f339 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:27.178276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72c4fd-9891-4b7d-8d5d-e7c05d48f339 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:27.178708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72c4fd-9891-4b7d-8d5d-e7c05d48f339 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:27.180901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2f72c4fd-9891-4b7d-8d5d-e7c05d48f339 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:27.213044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-71820ad4-1bb2-497b-89a9-ea3a9fb4e55a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d19fc167f24b77abd6f6851a308ae3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:27.222147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-71820ad4-1bb2-497b-89a9-ea3a9fb4e55a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d19fc167f24b77abd6f6851a308ae3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:27.244166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72c4fd-9891-4b7d-8d5d-e7c05d48f339 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:27.245783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72c4fd-9891-4b7d-8d5d-e7c05d48f339 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:27.257768 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2124/4312] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:21:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:21:27.335996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-71820ad4-1bb2-497b-89a9-ea3a9fb4e55a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d19fc167f24b77abd6f6851a308ae3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:27.336687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-71820ad4-1bb2-497b-89a9-ea3a9fb4e55a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d19fc167f24b77abd6f6851a308ae3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:27.350856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-71820ad4-1bb2-497b-89a9-ea3a9fb4e55a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d19fc167f24b77abd6f6851a308ae3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:27.357856 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2189/4313] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:26 2022] DELETE /identity/v3/users/22d19fc167f24b77abd6f6851a308ae3 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:27.365492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3afd3-70d2-468d-9606-6c6331594f60 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:27.370114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3afd3-70d2-468d-9606-6c6331594f60 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:27.370114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3afd3-70d2-468d-9606-6c6331594f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:27.387823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-17d3afd3-70d2-468d-9606-6c6331594f60 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:27.389109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-17d3afd3-70d2-468d-9606-6c6331594f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:27.475044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:27.485413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71820ad4-1bb2-497b-89a9-ea3a9fb4e55a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:27.493049 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2125/4314] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:27.495190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-71820ad4-1bb2-497b-89a9-ea3a9fb4e55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:27.515851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71820ad4-1bb2-497b-89a9-ea3a9fb4e55a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:27.523611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4cca5-b37d-4197-a502-a40bafd1a3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:27.524645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4cca5-b37d-4197-a502-a40bafd1a3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:27.530191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4cca5-b37d-4197-a502-a40bafd1a3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:27.530191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4cca5-b37d-4197-a502-a40bafd1a3f1 admin admin] PATH_INFO: `/v3/projects/cb98ffde19fc4bb3b939ca6ab437004c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:27.530191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4cca5-b37d-4197-a502-a40bafd1a3f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb98ffde19fc4bb3b939ca6ab437004c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:27.536424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3afd3-70d2-468d-9606-6c6331594f60 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:27.542418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-17d3afd3-70d2-468d-9606-6c6331594f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:27.552522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4cca5-b37d-4197-a502-a40bafd1a3f1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:27.650032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3afd3-70d2-468d-9606-6c6331594f60 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:27.654994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7027f-aa91-4749-bced-25a9ab055b53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:27.656248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7027f-aa91-4749-bced-25a9ab055b53 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:27.656734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7027f-aa91-4749-bced-25a9ab055b53 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:27.657169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7027f-aa91-4749-bced-25a9ab055b53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:27.671326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7027f-aa91-4749-bced-25a9ab055b53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:27.673346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7027f-aa91-4749-bced-25a9ab055b53 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:27.687865 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2126/4315] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:21:27.725171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4fc4cca5-b37d-4197-a502-a40bafd1a3f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb98ffde19fc4bb3b939ca6ab437004c', 'request_id': 'req-4fc4cca5-b37d-4197-a502-a40bafd1a3f1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:27.734932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4fc4cca5-b37d-4197-a502-a40bafd1a3f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb98ffde19fc4bb3b939ca6ab437004c', 'request_id': 'req-4fc4cca5-b37d-4197-a502-a40bafd1a3f1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:27.748377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4fc4cca5-b37d-4197-a502-a40bafd1a3f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb98ffde19fc4bb3b939ca6ab437004c', 'request_id': 'req-4fc4cca5-b37d-4197-a502-a40bafd1a3f1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:27.817002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:27.880458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4fc4cca5-b37d-4197-a502-a40bafd1a3f1 admin admin] The token cache is being invalidate because project cb98ffde19fc4bb3b939ca6ab437004c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:27.880884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4fc4cca5-b37d-4197-a502-a40bafd1a3f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:27.881990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4fc4cca5-b37d-4197-a502-a40bafd1a3f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:27.883853 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2190/4316] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:27 2022] DELETE /identity/v3/projects/cb98ffde19fc4bb3b939ca6ab437004c => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:21:27.888686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7027f-aa91-4749-bced-25a9ab055b53 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:27.902893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7027f-aa91-4749-bced-25a9ab055b53 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:28.025536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd407dd4-8e7b-456d-8f7a-4d503b9e238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:28.029182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd407dd4-8e7b-456d-8f7a-4d503b9e238c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:28.029516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd407dd4-8e7b-456d-8f7a-4d503b9e238c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:28.030004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd407dd4-8e7b-456d-8f7a-4d503b9e238c admin admin] PATH_INFO: `/v3/users/fcc0073a9f674e67b2f7815c541c3e22` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:28.035885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd407dd4-8e7b-456d-8f7a-4d503b9e238c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcc0073a9f674e67b2f7815c541c3e22)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:28.040272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd407dd4-8e7b-456d-8f7a-4d503b9e238c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:28.065782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4cca5-b37d-4197-a502-a40bafd1a3f1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:28.072767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4fc4cca5-b37d-4197-a502-a40bafd1a3f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:28.108192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4cca5-b37d-4197-a502-a40bafd1a3f1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:28.126601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d4d7c-8726-4487-b6bf-af2cc91e2b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:28.129394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d4d7c-8726-4487-b6bf-af2cc91e2b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:28.130194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d4d7c-8726-4487-b6bf-af2cc91e2b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:28.130872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d4d7c-8726-4487-b6bf-af2cc91e2b4f admin admin] PATH_INFO: `/v3/users/c6ba562873fa4f4fbd0b635f1c9dcdf2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:28.133015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d4d7c-8726-4487-b6bf-af2cc91e2b4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6ba562873fa4f4fbd0b635f1c9dcdf2)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:28.135543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d4d7c-8726-4487-b6bf-af2cc91e2b4f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:28.454247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dd407dd4-8e7b-456d-8f7a-4d503b9e238c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcc0073a9f674e67b2f7815c541c3e22'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:28.474658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dd407dd4-8e7b-456d-8f7a-4d503b9e238c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcc0073a9f674e67b2f7815c541c3e22'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:28.489511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fc1d4d7c-8726-4487-b6bf-af2cc91e2b4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6ba562873fa4f4fbd0b635f1c9dcdf2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:28.515072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fc1d4d7c-8726-4487-b6bf-af2cc91e2b4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6ba562873fa4f4fbd0b635f1c9dcdf2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:28.548221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dd407dd4-8e7b-456d-8f7a-4d503b9e238c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcc0073a9f674e67b2f7815c541c3e22'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:28.559585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dd407dd4-8e7b-456d-8f7a-4d503b9e238c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcc0073a9f674e67b2f7815c541c3e22'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:28.560713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dd407dd4-8e7b-456d-8f7a-4d503b9e238c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcc0073a9f674e67b2f7815c541c3e22'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:28.573687 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2127/4317] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:27 2022] DELETE /identity/v3/users/fcc0073a9f674e67b2f7815c541c3e22 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:28.650635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fc1d4d7c-8726-4487-b6bf-af2cc91e2b4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6ba562873fa4f4fbd0b635f1c9dcdf2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:28.653175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fc1d4d7c-8726-4487-b6bf-af2cc91e2b4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6ba562873fa4f4fbd0b635f1c9dcdf2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:28.666122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fc1d4d7c-8726-4487-b6bf-af2cc91e2b4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6ba562873fa4f4fbd0b635f1c9dcdf2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:28.672702 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2191/4318] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:28 2022] DELETE /identity/v3/users/c6ba562873fa4f4fbd0b635f1c9dcdf2 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:21:28.687119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd407dd4-8e7b-456d-8f7a-4d503b9e238c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:28.690210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-dd407dd4-8e7b-456d-8f7a-4d503b9e238c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:28.812398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd407dd4-8e7b-456d-8f7a-4d503b9e238c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:28.927307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc6cbb-b2c5-4d87-8783-a65d624e867c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:28.927307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc6cbb-b2c5-4d87-8783-a65d624e867c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:28.927940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc6cbb-b2c5-4d87-8783-a65d624e867c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:28.928769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc6cbb-b2c5-4d87-8783-a65d624e867c admin admin] PATH_INFO: `/v3/projects/e6efca087da44732b7669382cd0d43f3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:28.941706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc6cbb-b2c5-4d87-8783-a65d624e867c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6efca087da44732b7669382cd0d43f3)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:28.945228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc6cbb-b2c5-4d87-8783-a65d624e867c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:29.152275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8ebc6cbb-b2c5-4d87-8783-a65d624e867c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6efca087da44732b7669382cd0d43f3', 'request_id': 'req-8ebc6cbb-b2c5-4d87-8783-a65d624e867c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:29.160942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8ebc6cbb-b2c5-4d87-8783-a65d624e867c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6efca087da44732b7669382cd0d43f3', 'request_id': 'req-8ebc6cbb-b2c5-4d87-8783-a65d624e867c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:29.172814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8ebc6cbb-b2c5-4d87-8783-a65d624e867c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6efca087da44732b7669382cd0d43f3', 'request_id': 'req-8ebc6cbb-b2c5-4d87-8783-a65d624e867c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:29.271918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8ebc6cbb-b2c5-4d87-8783-a65d624e867c admin admin] The token cache is being invalidate because project e6efca087da44732b7669382cd0d43f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:29.272212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8ebc6cbb-b2c5-4d87-8783-a65d624e867c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:29.278238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8ebc6cbb-b2c5-4d87-8783-a65d624e867c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:29.278238 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2128/4319] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:28 2022] DELETE /identity/v3/projects/e6efca087da44732b7669382cd0d43f3 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:29.281313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d4d7c-8726-4487-b6bf-af2cc91e2b4f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:29.284901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fc1d4d7c-8726-4487-b6bf-af2cc91e2b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:29.293624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc6cbb-b2c5-4d87-8783-a65d624e867c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:29.297596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8ebc6cbb-b2c5-4d87-8783-a65d624e867c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:29.305871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d4d7c-8726-4487-b6bf-af2cc91e2b4f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:29.415475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc6cbb-b2c5-4d87-8783-a65d624e867c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:29.422735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0c7a0-b3d2-43c9-91b6-749f497c25ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:29.424992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0c7a0-b3d2-43c9-91b6-749f497c25ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:29.425544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0c7a0-b3d2-43c9-91b6-749f497c25ea admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:29.426976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0c7a0-b3d2-43c9-91b6-749f497c25ea admin admin] PATH_INFO: `/v3/users/9269eaceca6d4ef7b038160513201aed` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:29.428825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0c7a0-b3d2-43c9-91b6-749f497c25ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=9269eaceca6d4ef7b038160513201aed)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:29.431643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0c7a0-b3d2-43c9-91b6-749f497c25ea admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:29.441352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4618b21-5eb7-4573-b67d-2566326e3247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:29.447038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4618b21-5eb7-4573-b67d-2566326e3247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:29.447038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4618b21-5eb7-4573-b67d-2566326e3247 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:29.447038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4618b21-5eb7-4573-b67d-2566326e3247 admin admin] PATH_INFO: `/v3/projects/837a8f9e06e141dcbd5f7bd895016d49` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:29.447038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4618b21-5eb7-4573-b67d-2566326e3247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=837a8f9e06e141dcbd5f7bd895016d49)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:29.447038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4618b21-5eb7-4573-b67d-2566326e3247 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:29.767505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4618b21-5eb7-4573-b67d-2566326e3247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '837a8f9e06e141dcbd5f7bd895016d49', 'request_id': 'req-c4618b21-5eb7-4573-b67d-2566326e3247'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:29.773496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-57b0c7a0-b3d2-43c9-91b6-749f497c25ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9269eaceca6d4ef7b038160513201aed'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:29.778729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4618b21-5eb7-4573-b67d-2566326e3247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '837a8f9e06e141dcbd5f7bd895016d49', 'request_id': 'req-c4618b21-5eb7-4573-b67d-2566326e3247'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:29.793328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-57b0c7a0-b3d2-43c9-91b6-749f497c25ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9269eaceca6d4ef7b038160513201aed'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:29.794753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4618b21-5eb7-4573-b67d-2566326e3247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '837a8f9e06e141dcbd5f7bd895016d49', 'request_id': 'req-c4618b21-5eb7-4573-b67d-2566326e3247'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:29.870632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-57b0c7a0-b3d2-43c9-91b6-749f497c25ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9269eaceca6d4ef7b038160513201aed'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:29.884571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-57b0c7a0-b3d2-43c9-91b6-749f497c25ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9269eaceca6d4ef7b038160513201aed'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:29.885463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-57b0c7a0-b3d2-43c9-91b6-749f497c25ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9269eaceca6d4ef7b038160513201aed'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:29.901228 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2129/4320] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:29 2022] DELETE /identity/v3/users/9269eaceca6d4ef7b038160513201aed => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:29.902278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0c7a0-b3d2-43c9-91b6-749f497c25ea admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:29.903824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-57b0c7a0-b3d2-43c9-91b6-749f497c25ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:29.935997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4618b21-5eb7-4573-b67d-2566326e3247 admin admin] The token cache is being invalidate because project 837a8f9e06e141dcbd5f7bd895016d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:29.936287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4618b21-5eb7-4573-b67d-2566326e3247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:29.939537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4618b21-5eb7-4573-b67d-2566326e3247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:29.941287 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2192/4321] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:29 2022] DELETE /identity/v3/projects/837a8f9e06e141dcbd5f7bd895016d49 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:29.946124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bd350-96dd-4b22-b5e4-f7133828bd7b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:29.946412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bd350-96dd-4b22-b5e4-f7133828bd7b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:29.946698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bd350-96dd-4b22-b5e4-f7133828bd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:29.985093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d54bd350-96dd-4b22-b5e4-f7133828bd7b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:29.987342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d54bd350-96dd-4b22-b5e4-f7133828bd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:30.010989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0c7a0-b3d2-43c9-91b6-749f497c25ea admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:30.014699 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2193/4322] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:21:30.034368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360281f-7631-423d-bec2-173dca77559b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:30.035570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360281f-7631-423d-bec2-173dca77559b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:30.043309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360281f-7631-423d-bec2-173dca77559b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:30.043309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360281f-7631-423d-bec2-173dca77559b admin admin] PATH_INFO: `/v3/projects/671c6b344c674cc99c4efd813844c30e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:30.043309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360281f-7631-423d-bec2-173dca77559b admin admin] RBAC: Authorizing `identity:delete_project(project_id=671c6b344c674cc99c4efd813844c30e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:30.043309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360281f-7631-423d-bec2-173dca77559b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:30.107226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3873d-bfaa-4762-874a-f2a4891ba316 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:30.107344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3873d-bfaa-4762-874a-f2a4891ba316 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:30.107530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3873d-bfaa-4762-874a-f2a4891ba316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:30.143749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-18b3873d-bfaa-4762-874a-f2a4891ba316 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:30.143749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-18b3873d-bfaa-4762-874a-f2a4891ba316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:30.151076 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2194/4323] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:21:30.155612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3873d-bfaa-4762-874a-f2a4891ba316 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:30.177634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3873d-bfaa-4762-874a-f2a4891ba316 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:30.203104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cc8f8-f82d-4a84-b7c2-541d13256914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:30.205305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cc8f8-f82d-4a84-b7c2-541d13256914 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:30.205750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cc8f8-f82d-4a84-b7c2-541d13256914 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:30.206190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cc8f8-f82d-4a84-b7c2-541d13256914 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:30.207142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cc8f8-f82d-4a84-b7c2-541d13256914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:21:30.207800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cc8f8-f82d-4a84-b7c2-541d13256914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:30.209817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cc8f8-f82d-4a84-b7c2-541d13256914 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:30.224576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9360281f-7631-423d-bec2-173dca77559b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '671c6b344c674cc99c4efd813844c30e', 'request_id': 'req-9360281f-7631-423d-bec2-173dca77559b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:30.236307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9360281f-7631-423d-bec2-173dca77559b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '671c6b344c674cc99c4efd813844c30e', 'request_id': 'req-9360281f-7631-423d-bec2-173dca77559b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:30.249692 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2195/4324] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:21:30.254205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cc8f8-f82d-4a84-b7c2-541d13256914 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:30.256549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9360281f-7631-423d-bec2-173dca77559b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '671c6b344c674cc99c4efd813844c30e', 'request_id': 'req-9360281f-7631-423d-bec2-173dca77559b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:30.264858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cc8f8-f82d-4a84-b7c2-541d13256914 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:30.336941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298aade2-2e2d-4ac3-ba0a-46acf04db70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:30.337695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298aade2-2e2d-4ac3-ba0a-46acf04db70f admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:30.338206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298aade2-2e2d-4ac3-ba0a-46acf04db70f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:30.338952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298aade2-2e2d-4ac3-ba0a-46acf04db70f admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:30.340083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298aade2-2e2d-4ac3-ba0a-46acf04db70f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:30.343938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298aade2-2e2d-4ac3-ba0a-46acf04db70f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:30.347858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9360281f-7631-423d-bec2-173dca77559b admin admin] The token cache is being invalidate because project 671c6b344c674cc99c4efd813844c30e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:30.348466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9360281f-7631-423d-bec2-173dca77559b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:30.352198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9360281f-7631-423d-bec2-173dca77559b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:30.354484 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2130/4325] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:29 2022] DELETE /identity/v3/projects/671c6b344c674cc99c4efd813844c30e => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:30.359347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db44df-2a9c-41ff-b3eb-2b35187072d3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:30.359864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db44df-2a9c-41ff-b3eb-2b35187072d3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:30.360292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db44df-2a9c-41ff-b3eb-2b35187072d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:30.393771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-29db44df-2a9c-41ff-b3eb-2b35187072d3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:30.395051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-29db44df-2a9c-41ff-b3eb-2b35187072d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:30.406507 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2131/4326] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:21:30.510015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78b257-ad09-4c72-b586-cbde485c51cd None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:30.510015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78b257-ad09-4c72-b586-cbde485c51cd None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:30.513333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78b257-ad09-4c72-b586-cbde485c51cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:30.533818 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2196/4327] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:21:30 2022] POST /identity/v3/projects => generated 379 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:30.538315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298aade2-2e2d-4ac3-ba0a-46acf04db70f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:30.540710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0b78b257-ad09-4c72-b586-cbde485c51cd None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:30.541124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-298aade2-2e2d-4ac3-ba0a-46acf04db70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:30.542143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0b78b257-ad09-4c72-b586-cbde485c51cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:30.635508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:30.650985 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2132/4328] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:21:30.652039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78b257-ad09-4c72-b586-cbde485c51cd None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:30.676434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78b257-ad09-4c72-b586-cbde485c51cd None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:30.694659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6102e38-2e96-4bcd-8d1a-fcd04b1d9a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:30.696533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298aade2-2e2d-4ac3-ba0a-46acf04db70f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:30.701709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6102e38-2e96-4bcd-8d1a-fcd04b1d9a8f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:30.702223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6102e38-2e96-4bcd-8d1a-fcd04b1d9a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:30.703586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6102e38-2e96-4bcd-8d1a-fcd04b1d9a8f admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:30.705346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6102e38-2e96-4bcd-8d1a-fcd04b1d9a8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:21:30.707114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cae08b-836c-4481-8244-e73be940ea9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:30.707994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cae08b-836c-4481-8244-e73be940ea9a admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:30.708149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cae08b-836c-4481-8244-e73be940ea9a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:30.708395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cae08b-836c-4481-8244-e73be940ea9a admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:30.709085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cae08b-836c-4481-8244-e73be940ea9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:30.709666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6102e38-2e96-4bcd-8d1a-fcd04b1d9a8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:30.714185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cae08b-836c-4481-8244-e73be940ea9a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:30.724850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6102e38-2e96-4bcd-8d1a-fcd04b1d9a8f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:30.752062 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2133/4329] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:30.753323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6102e38-2e96-4bcd-8d1a-fcd04b1d9a8f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:30.756879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c6102e38-2e96-4bcd-8d1a-fcd04b1d9a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:30.776764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6102e38-2e96-4bcd-8d1a-fcd04b1d9a8f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:30.791353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b12e59-df99-44ec-9669-b7b6f057e86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:30.792238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b12e59-df99-44ec-9669-b7b6f057e86a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:30.792521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b12e59-df99-44ec-9669-b7b6f057e86a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:30.792799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b12e59-df99-44ec-9669-b7b6f057e86a admin admin] PATH_INFO: `/v3/projects/1da0d5b86b824690ab6cb35b01cbf33c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:30.796175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b12e59-df99-44ec-9669-b7b6f057e86a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da0d5b86b824690ab6cb35b01cbf33c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:30.798332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b12e59-df99-44ec-9669-b7b6f057e86a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:30.874471 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2197/4330] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:21:30 2022] POST /identity/v3/users => generated 290 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:30.875201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cae08b-836c-4481-8244-e73be940ea9a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:30.892627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cae08b-836c-4481-8244-e73be940ea9a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:30.907246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89af9c6-cd49-49ac-a865-4c049d75fb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:30.908372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89af9c6-cd49-49ac-a865-4c049d75fb7a admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:30.908865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89af9c6-cd49-49ac-a865-4c049d75fb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:30.909249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89af9c6-cd49-49ac-a865-4c049d75fb7a admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:30.910890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89af9c6-cd49-49ac-a865-4c049d75fb7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:30.913829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89af9c6-cd49-49ac-a865-4c049d75fb7a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:30.969163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b7b12e59-df99-44ec-9669-b7b6f057e86a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da0d5b86b824690ab6cb35b01cbf33c', 'request_id': 'req-b7b12e59-df99-44ec-9669-b7b6f057e86a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:30.978373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b7b12e59-df99-44ec-9669-b7b6f057e86a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da0d5b86b824690ab6cb35b01cbf33c', 'request_id': 'req-b7b12e59-df99-44ec-9669-b7b6f057e86a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:30.992815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b7b12e59-df99-44ec-9669-b7b6f057e86a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da0d5b86b824690ab6cb35b01cbf33c', 'request_id': 'req-b7b12e59-df99-44ec-9669-b7b6f057e86a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:31.050199 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2198/4331] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:21:30 2022] POST /identity/v3/projects => generated 367 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:31.054143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89af9c6-cd49-49ac-a865-4c049d75fb7a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:31.109769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b7b12e59-df99-44ec-9669-b7b6f057e86a admin admin] The token cache is being invalidate because project 1da0d5b86b824690ab6cb35b01cbf33c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:31.110046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b7b12e59-df99-44ec-9669-b7b6f057e86a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:31.111543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b7b12e59-df99-44ec-9669-b7b6f057e86a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:31.120773 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2134/4332] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:30 2022] DELETE /identity/v3/projects/1da0d5b86b824690ab6cb35b01cbf33c => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:31.121848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b12e59-df99-44ec-9669-b7b6f057e86a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:31.123672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b7b12e59-df99-44ec-9669-b7b6f057e86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:31.240602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89af9c6-cd49-49ac-a865-4c049d75fb7a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:31.260531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd7999-fe09-465d-986a-add18fe45812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:31.262562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd7999-fe09-465d-986a-add18fe45812 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:31.263713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd7999-fe09-465d-986a-add18fe45812 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:31.264944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd7999-fe09-465d-986a-add18fe45812 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:31.268049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd7999-fe09-465d-986a-add18fe45812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:31.272321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd7999-fe09-465d-986a-add18fe45812 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:31.310140 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2199/4333] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:31.321229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563a41b-a008-41e3-a857-bd202370a96f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:31.321785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563a41b-a008-41e3-a857-bd202370a96f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:31.322819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563a41b-a008-41e3-a857-bd202370a96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:31.326072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b12e59-df99-44ec-9669-b7b6f057e86a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:31.353577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0984ac0-cea9-4831-ac56-c6de8de3d452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:31.354876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0984ac0-cea9-4831-ac56-c6de8de3d452 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:31.357723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0984ac0-cea9-4831-ac56-c6de8de3d452 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:31.358701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0984ac0-cea9-4831-ac56-c6de8de3d452 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:31.361653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0984ac0-cea9-4831-ac56-c6de8de3d452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:31.366218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0984ac0-cea9-4831-ac56-c6de8de3d452 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:31.385515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d563a41b-a008-41e3-a857-bd202370a96f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:31.390918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d563a41b-a008-41e3-a857-bd202370a96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:31.416787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:31.417587 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2200/4334] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:31.420204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563a41b-a008-41e3-a857-bd202370a96f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:31.425016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d563a41b-a008-41e3-a857-bd202370a96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:31.471497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563a41b-a008-41e3-a857-bd202370a96f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:31.500490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42753287-d717-4540-9e14-fb5def4fdaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:31.505044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42753287-d717-4540-9e14-fb5def4fdaac admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:31.513098 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2135/4335] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:21:31 2022] POST /identity/v3/users => generated 284 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:31.516304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef136e6-c11b-4946-a655-6e513e567e2c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:31.516891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef136e6-c11b-4946-a655-6e513e567e2c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:31.517812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef136e6-c11b-4946-a655-6e513e567e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:31.520298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42753287-d717-4540-9e14-fb5def4fdaac admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:31.520736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42753287-d717-4540-9e14-fb5def4fdaac admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:31.521742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42753287-d717-4540-9e14-fb5def4fdaac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:31.524775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42753287-d717-4540-9e14-fb5def4fdaac admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:31.565172 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2201/4336] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:31.566704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42753287-d717-4540-9e14-fb5def4fdaac admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:31.580843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42753287-d717-4540-9e14-fb5def4fdaac admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:31.585231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cbb21-fef2-4252-a7d7-bfb67ee6cbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:31.586855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cbb21-fef2-4252-a7d7-bfb67ee6cbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:31.587404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cbb21-fef2-4252-a7d7-bfb67ee6cbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:31.587897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cbb21-fef2-4252-a7d7-bfb67ee6cbd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:31.588853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4cbb21-fef2-4252-a7d7-bfb67ee6cbd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:31.590715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4cbb21-fef2-4252-a7d7-bfb67ee6cbd0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:31.594528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-eef136e6-c11b-4946-a655-6e513e567e2c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:31.598289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-eef136e6-c11b-4946-a655-6e513e567e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:31.605336 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2202/4337] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:31.606599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cbb21-fef2-4252-a7d7-bfb67ee6cbd0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:31.620289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cbb21-fef2-4252-a7d7-bfb67ee6cbd0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:31.627528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070811ee-7c77-4c2a-b9f0-35526c9579dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:31.628923 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2136/4338] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:31.629356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070811ee-7c77-4c2a-b9f0-35526c9579dd admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:31.629854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070811ee-7c77-4c2a-b9f0-35526c9579dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:31.630330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070811ee-7c77-4c2a-b9f0-35526c9579dd admin admin] PATH_INFO: `/v3/projects/d31be8475a6a49d6bfe8132dd050c6c0/users/6f2e974ab5aa48dfb4b00f810dcedb63/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:31.638328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef136e6-c11b-4946-a655-6e513e567e2c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:31.650915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070811ee-7c77-4c2a-b9f0-35526c9579dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31be8475a6a49d6bfe8132dd050c6c0, user_id=6f2e974ab5aa48dfb4b00f810dcedb63, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:31.654336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070811ee-7c77-4c2a-b9f0-35526c9579dd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:31.665530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef136e6-c11b-4946-a655-6e513e567e2c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:31.674838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c467e2-ec05-4a0a-9ea4-eddad4d4a3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:31.675628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c467e2-ec05-4a0a-9ea4-eddad4d4a3bb admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:31.675870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c467e2-ec05-4a0a-9ea4-eddad4d4a3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:31.676138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c467e2-ec05-4a0a-9ea4-eddad4d4a3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:31.676909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c467e2-ec05-4a0a-9ea4-eddad4d4a3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:31.680245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c467e2-ec05-4a0a-9ea4-eddad4d4a3bb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:31.693392 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2137/4339] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:31.694604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c467e2-ec05-4a0a-9ea4-eddad4d4a3bb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:31.707482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c467e2-ec05-4a0a-9ea4-eddad4d4a3bb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:31.713055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc20fd-d1c4-4556-9ad3-25be6b7e4796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:31.713796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc20fd-d1c4-4556-9ad3-25be6b7e4796 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:31.714229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc20fd-d1c4-4556-9ad3-25be6b7e4796 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:31.714514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc20fd-d1c4-4556-9ad3-25be6b7e4796 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:31.716455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc20fd-d1c4-4556-9ad3-25be6b7e4796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:21:31.716587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc20fd-d1c4-4556-9ad3-25be6b7e4796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:31.721171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc20fd-d1c4-4556-9ad3-25be6b7e4796 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:31.747510 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2138/4340] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:31.750747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc20fd-d1c4-4556-9ad3-25be6b7e4796 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:31.754900 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2203/4341] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:31 2022] PUT /identity/v3/projects/d31be8475a6a49d6bfe8132dd050c6c0/users/6f2e974ab5aa48dfb4b00f810dcedb63/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:31.761629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070811ee-7c77-4c2a-b9f0-35526c9579dd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:31.776817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc20fd-d1c4-4556-9ad3-25be6b7e4796 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:31.926207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070811ee-7c77-4c2a-b9f0-35526c9579dd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:31.927362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69570df2-12a5-4445-9a2c-318b281b4db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:31.928361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69570df2-12a5-4445-9a2c-318b281b4db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:31.928875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69570df2-12a5-4445-9a2c-318b281b4db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:31.929170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69570df2-12a5-4445-9a2c-318b281b4db5 admin admin] PATH_INFO: `/v3/projects/fa16ebcffab741799fcbd30176908619/users/3e11efd60bf0462487909aacb277454d/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:31.948290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7fa05-1f9d-4c14-95b6-595e48a60735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:31.948765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69570df2-12a5-4445-9a2c-318b281b4db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa16ebcffab741799fcbd30176908619, user_id=3e11efd60bf0462487909aacb277454d, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:31.950396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7fa05-1f9d-4c14-95b6-595e48a60735 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:31.950759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7fa05-1f9d-4c14-95b6-595e48a60735 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:31.952687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69570df2-12a5-4445-9a2c-318b281b4db5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:31.953734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7fa05-1f9d-4c14-95b6-595e48a60735 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:31.956390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7fa05-1f9d-4c14-95b6-595e48a60735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:31.958973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7fa05-1f9d-4c14-95b6-595e48a60735 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:32.033277 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2139/4342] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:31 2022] PUT /identity/v3/projects/fa16ebcffab741799fcbd30176908619/users/3e11efd60bf0462487909aacb277454d/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:32.033277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a13eb-3323-4f00-8259-4f5ed29da561 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:32.033277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a13eb-3323-4f00-8259-4f5ed29da561 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:32.033277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a13eb-3323-4f00-8259-4f5ed29da561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:32.055772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3e4a13eb-3323-4f00-8259-4f5ed29da561 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:32.057022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3e4a13eb-3323-4f00-8259-4f5ed29da561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:32.075978 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2204/4343] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:21:31 2022] POST /identity/v3/projects => generated 379 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:32.077592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705642f-af2a-44da-b99e-3046854be0d8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:32.078989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705642f-af2a-44da-b99e-3046854be0d8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:32.079473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705642f-af2a-44da-b99e-3046854be0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:32.155045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6705642f-af2a-44da-b99e-3046854be0d8 None None] MFA Rules not processed for user `3e11efd60bf0462487909aacb277454d`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:32.162077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6705642f-af2a-44da-b99e-3046854be0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:32.162777 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2140/4344] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:32.163744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a13eb-3323-4f00-8259-4f5ed29da561 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:32.183821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a13eb-3323-4f00-8259-4f5ed29da561 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:32.308100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08b642-1ea9-45dd-aea0-056cda6e360f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:32.308822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08b642-1ea9-45dd-aea0-056cda6e360f admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:32.309107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08b642-1ea9-45dd-aea0-056cda6e360f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:32.309384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08b642-1ea9-45dd-aea0-056cda6e360f admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:32.312202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08b642-1ea9-45dd-aea0-056cda6e360f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:32.319051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08b642-1ea9-45dd-aea0-056cda6e360f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:32.353899 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2205/4345] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:32.355471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705642f-af2a-44da-b99e-3046854be0d8 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:32.358916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6705642f-af2a-44da-b99e-3046854be0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:32.432403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705642f-af2a-44da-b99e-3046854be0d8 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:32.437155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51712f71-e4b7-4b9f-9014-8c7065aaaf73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:32.437757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51712f71-e4b7-4b9f-9014-8c7065aaaf73 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:32.438042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51712f71-e4b7-4b9f-9014-8c7065aaaf73 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:32.438348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51712f71-e4b7-4b9f-9014-8c7065aaaf73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:32.453031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51712f71-e4b7-4b9f-9014-8c7065aaaf73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:32.465638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51712f71-e4b7-4b9f-9014-8c7065aaaf73 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:32.494966 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2141/4346] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:21:32 2022] POST /identity/v3/users => generated 296 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:32.496713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08b642-1ea9-45dd-aea0-056cda6e360f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:32.500571 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2206/4347] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:21:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:21:32.501463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51712f71-e4b7-4b9f-9014-8c7065aaaf73 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:32.514480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08b642-1ea9-45dd-aea0-056cda6e360f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:32.521935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d29d0a-0cf0-428f-a080-2d2aa53620c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:32.523783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d29d0a-0cf0-428f-a080-2d2aa53620c4 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:32.524402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d29d0a-0cf0-428f-a080-2d2aa53620c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:32.524902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d29d0a-0cf0-428f-a080-2d2aa53620c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:32.525017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51712f71-e4b7-4b9f-9014-8c7065aaaf73 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:32.526211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d29d0a-0cf0-428f-a080-2d2aa53620c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:32.528768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d29d0a-0cf0-428f-a080-2d2aa53620c4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:32.539272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7794d-cb31-4a49-a0ff-b7a6ea0a7b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:32.540109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7794d-cb31-4a49-a0ff-b7a6ea0a7b66 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:32.540402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7794d-cb31-4a49-a0ff-b7a6ea0a7b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:32.540713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7794d-cb31-4a49-a0ff-b7a6ea0a7b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:32.541509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7794d-cb31-4a49-a0ff-b7a6ea0a7b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:32.544742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7794d-cb31-4a49-a0ff-b7a6ea0a7b66 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:32.576581 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2207/4348] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:32.583618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7794d-cb31-4a49-a0ff-b7a6ea0a7b66 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:32.602495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7794d-cb31-4a49-a0ff-b7a6ea0a7b66 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:32.609574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8a8ab-0ea8-4f95-9148-6eb764a9b2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:32.611451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8a8ab-0ea8-4f95-9148-6eb764a9b2d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:32.612269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8a8ab-0ea8-4f95-9148-6eb764a9b2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:32.612805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8a8ab-0ea8-4f95-9148-6eb764a9b2d0 admin admin] PATH_INFO: `/v3/projects/f5ee1ace83414fcf9dc0d684db53ec71/users/7dca25bfc8964ef1aeffc902f9442302/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:32.635955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8a8ab-0ea8-4f95-9148-6eb764a9b2d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ee1ace83414fcf9dc0d684db53ec71, user_id=7dca25bfc8964ef1aeffc902f9442302, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:32.642872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8a8ab-0ea8-4f95-9148-6eb764a9b2d0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:32.663589 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2142/4349] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:21:32 2022] POST /identity/v3/projects => generated 365 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:32.669200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d29d0a-0cf0-428f-a080-2d2aa53620c4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:32.780625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d29d0a-0cf0-428f-a080-2d2aa53620c4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:32.787443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fea16-2e17-4de3-b97b-fa764902637f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:32.788214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fea16-2e17-4de3-b97b-fa764902637f admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:32.788571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fea16-2e17-4de3-b97b-fa764902637f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:32.788936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fea16-2e17-4de3-b97b-fa764902637f admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:32.790265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fea16-2e17-4de3-b97b-fa764902637f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:32.792562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fea16-2e17-4de3-b97b-fa764902637f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:32.800564 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2208/4350] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:32 2022] PUT /identity/v3/projects/f5ee1ace83414fcf9dc0d684db53ec71/users/7dca25bfc8964ef1aeffc902f9442302/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:21:32.804698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8a8ab-0ea8-4f95-9148-6eb764a9b2d0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:32.823781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:32.902228 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2143/4351] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:21:32 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:32.907083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fea16-2e17-4de3-b97b-fa764902637f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:32.932293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fea16-2e17-4de3-b97b-fa764902637f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:33.009400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8a8ab-0ea8-4f95-9148-6eb764a9b2d0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:33.022444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543c497-344f-4594-9a9a-3b0c1760f928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:33.023833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543c497-344f-4594-9a9a-3b0c1760f928 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:33.026319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543c497-344f-4594-9a9a-3b0c1760f928 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:33.026685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543c497-344f-4594-9a9a-3b0c1760f928 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:33.027598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543c497-344f-4594-9a9a-3b0c1760f928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:33.030630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543c497-344f-4594-9a9a-3b0c1760f928 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:33.033449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f92fb7-a048-46b2-be87-b6e9ea46f166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:33.034955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f92fb7-a048-46b2-be87-b6e9ea46f166 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:33.035300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f92fb7-a048-46b2-be87-b6e9ea46f166 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:33.035588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f92fb7-a048-46b2-be87-b6e9ea46f166 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:33.036493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f92fb7-a048-46b2-be87-b6e9ea46f166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:33.039817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f92fb7-a048-46b2-be87-b6e9ea46f166 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:33.058270 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2144/4352] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:33.062987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f92fb7-a048-46b2-be87-b6e9ea46f166 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:33.072196 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2209/4353] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:21:33.076381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543c497-344f-4594-9a9a-3b0c1760f928 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:33.084095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f92fb7-a048-46b2-be87-b6e9ea46f166 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:33.097641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543c497-344f-4594-9a9a-3b0c1760f928 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:33.098011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23d4ee-2ab7-481e-9f34-c7724a44f00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:33.099144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23d4ee-2ab7-481e-9f34-c7724a44f00a admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:33.099520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23d4ee-2ab7-481e-9f34-c7724a44f00a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:33.099840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23d4ee-2ab7-481e-9f34-c7724a44f00a admin admin] PATH_INFO: `/v3/projects/c347b158466a46ea9886d5b2ba3b95c8/users/48a88791844842b8ba56a415f67f224e/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:33.120271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c1a00-8fab-49b6-b867-66ab3029c594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:33.120517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23d4ee-2ab7-481e-9f34-c7724a44f00a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c347b158466a46ea9886d5b2ba3b95c8, user_id=48a88791844842b8ba56a415f67f224e, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:33.121181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c1a00-8fab-49b6-b867-66ab3029c594 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:33.121526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c1a00-8fab-49b6-b867-66ab3029c594 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:33.121798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c1a00-8fab-49b6-b867-66ab3029c594 admin admin] PATH_INFO: `/v3/projects/f5ee1ace83414fcf9dc0d684db53ec71/users/7dca25bfc8964ef1aeffc902f9442302/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:33.123767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23d4ee-2ab7-481e-9f34-c7724a44f00a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:33.124987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c1a00-8fab-49b6-b867-66ab3029c594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ee1ace83414fcf9dc0d684db53ec71, user_id=7dca25bfc8964ef1aeffc902f9442302, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:33.129332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c1a00-8fab-49b6-b867-66ab3029c594 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:33.142461 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2210/4354] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:33 2022] PUT /identity/v3/projects/f5ee1ace83414fcf9dc0d684db53ec71/users/7dca25bfc8964ef1aeffc902f9442302/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:33.154750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f22178-1bcc-44a6-bd7f-30b4569329bc None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:33.155140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f22178-1bcc-44a6-bd7f-30b4569329bc None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:33.155353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f22178-1bcc-44a6-bd7f-30b4569329bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:33.202219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c2f22178-1bcc-44a6-bd7f-30b4569329bc None None] MFA Rules not processed for user `7dca25bfc8964ef1aeffc902f9442302`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:33.203943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c2f22178-1bcc-44a6-bd7f-30b4569329bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:33.303935 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2145/4355] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:33 2022] PUT /identity/v3/projects/c347b158466a46ea9886d5b2ba3b95c8/users/48a88791844842b8ba56a415f67f224e/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:33.307844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23d4ee-2ab7-481e-9f34-c7724a44f00a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:33.347501 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2211/4356] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:21:33.353712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f22178-1bcc-44a6-bd7f-30b4569329bc None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:33.440805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23d4ee-2ab7-481e-9f34-c7724a44f00a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:33.462694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743c3ee-42fb-4a84-bf00-3fd15b172a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:33.465313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743c3ee-42fb-4a84-bf00-3fd15b172a2d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:33.465714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743c3ee-42fb-4a84-bf00-3fd15b172a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:33.466003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743c3ee-42fb-4a84-bf00-3fd15b172a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:33.466777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743c3ee-42fb-4a84-bf00-3fd15b172a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:33.472327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743c3ee-42fb-4a84-bf00-3fd15b172a2d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:33.492531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f22178-1bcc-44a6-bd7f-30b4569329bc None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:33.495393 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2146/4357] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:33.502780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743c3ee-42fb-4a84-bf00-3fd15b172a2d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:33.508871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520aefb6-1450-4500-8de6-d69dc0249a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:33.509953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520aefb6-1450-4500-8de6-d69dc0249a3d admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:33.510444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520aefb6-1450-4500-8de6-d69dc0249a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:33.511640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520aefb6-1450-4500-8de6-d69dc0249a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:33.516181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520aefb6-1450-4500-8de6-d69dc0249a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:33.521368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520aefb6-1450-4500-8de6-d69dc0249a3d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:33.525173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743c3ee-42fb-4a84-bf00-3fd15b172a2d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:33.550461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ced774-6bff-4475-837d-1ba7cfee0d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:33.554426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ced774-6bff-4475-837d-1ba7cfee0d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:33.554426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ced774-6bff-4475-837d-1ba7cfee0d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:33.554426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ced774-6bff-4475-837d-1ba7cfee0d7e admin admin] PATH_INFO: `/v3/projects/c347b158466a46ea9886d5b2ba3b95c8/users/48a88791844842b8ba56a415f67f224e/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:33.560755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ced774-6bff-4475-837d-1ba7cfee0d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c347b158466a46ea9886d5b2ba3b95c8, user_id=48a88791844842b8ba56a415f67f224e, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:33.570826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ced774-6bff-4475-837d-1ba7cfee0d7e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:33.607891 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2147/4358] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:33 2022] PUT /identity/v3/projects/c347b158466a46ea9886d5b2ba3b95c8/users/48a88791844842b8ba56a415f67f224e/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:33.609522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca547795-8f80-412a-b0a9-13f29cb61170 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:33.609819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca547795-8f80-412a-b0a9-13f29cb61170 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:33.612873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca547795-8f80-412a-b0a9-13f29cb61170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:33.671933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ca547795-8f80-412a-b0a9-13f29cb61170 None None] MFA Rules not processed for user `48a88791844842b8ba56a415f67f224e`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:33.676606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ca547795-8f80-412a-b0a9-13f29cb61170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:33.711598 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2212/4359] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:21:33 2022] POST /identity/v3/projects => generated 377 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:33.721554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520aefb6-1450-4500-8de6-d69dc0249a3d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:33.869725 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2148/4360] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:33.874244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719c891-cf9e-404c-8f6b-13c7607e0a6e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:33.882687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719c891-cf9e-404c-8f6b-13c7607e0a6e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:33.884444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719c891-cf9e-404c-8f6b-13c7607e0a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:33.952178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1719c891-cf9e-404c-8f6b-13c7607e0a6e None None] MFA Rules not processed for user `029f1334779e4bcdb3f4f2aed564a075`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:33.955788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520aefb6-1450-4500-8de6-d69dc0249a3d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:33.957704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1719c891-cf9e-404c-8f6b-13c7607e0a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:33.969495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3089a-a42d-466d-8046-7fc5f27628f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:33.981401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3089a-a42d-466d-8046-7fc5f27628f1 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:33.981401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3089a-a42d-466d-8046-7fc5f27628f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:33.981401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3089a-a42d-466d-8046-7fc5f27628f1 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:33.981401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3089a-a42d-466d-8046-7fc5f27628f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:33.982523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3089a-a42d-466d-8046-7fc5f27628f1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:34.084461 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2149/4361] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:34.085346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719c891-cf9e-404c-8f6b-13c7607e0a6e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:34.100034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:34.108544 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2213/4362] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:21:33 2022] POST /identity/v3/users => generated 289 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:34.112522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3089a-a42d-466d-8046-7fc5f27628f1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:34.131891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3089a-a42d-466d-8046-7fc5f27628f1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:34.144945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62999dff-480d-47cf-85ee-2a69b08d3cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:34.145636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62999dff-480d-47cf-85ee-2a69b08d3cfa admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:34.145922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62999dff-480d-47cf-85ee-2a69b08d3cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:34.146198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62999dff-480d-47cf-85ee-2a69b08d3cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:34.146929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62999dff-480d-47cf-85ee-2a69b08d3cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:34.156023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62999dff-480d-47cf-85ee-2a69b08d3cfa admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:34.185458 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2214/4363] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:34.188100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62999dff-480d-47cf-85ee-2a69b08d3cfa admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:34.210632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62999dff-480d-47cf-85ee-2a69b08d3cfa admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:34.227694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14101855-c34e-4bed-b964-2a0752571614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:34.227694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14101855-c34e-4bed-b964-2a0752571614 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:34.227694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14101855-c34e-4bed-b964-2a0752571614 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:34.227694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14101855-c34e-4bed-b964-2a0752571614 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:34.228544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14101855-c34e-4bed-b964-2a0752571614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:34.231047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14101855-c34e-4bed-b964-2a0752571614 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:34.255464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719c891-cf9e-404c-8f6b-13c7607e0a6e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:34.260551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd23d0-f684-4022-9994-f1c9c5230d2f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:34.261356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd23d0-f684-4022-9994-f1c9c5230d2f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:34.261720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd23d0-f684-4022-9994-f1c9c5230d2f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:34.262361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd23d0-f684-4022-9994-f1c9c5230d2f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:34.263890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd23d0-f684-4022-9994-f1c9c5230d2f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:34.265755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd23d0-f684-4022-9994-f1c9c5230d2f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:34.307158 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2215/4364] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:34.311583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14101855-c34e-4bed-b964-2a0752571614 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:34.325120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14101855-c34e-4bed-b964-2a0752571614 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:34.333269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19b0d1-33e8-4110-93a5-f3cfa80f451c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:34.334479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19b0d1-33e8-4110-93a5-f3cfa80f451c admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:34.334823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19b0d1-33e8-4110-93a5-f3cfa80f451c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:34.335251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19b0d1-33e8-4110-93a5-f3cfa80f451c admin admin] PATH_INFO: `/v3/projects/ac53481d9830400aae9c5f965341807e/users/29e32d5a19fb4da7a1d0947e19729446/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:34.360269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19b0d1-33e8-4110-93a5-f3cfa80f451c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac53481d9830400aae9c5f965341807e, user_id=29e32d5a19fb4da7a1d0947e19729446, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:34.368035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19b0d1-33e8-4110-93a5-f3cfa80f451c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:34.392931 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2150/4365] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:21:34 2022] POST /identity/v3/roles => generated 235 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:34.394232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd23d0-f684-4022-9994-f1c9c5230d2f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:34.417228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd23d0-f684-4022-9994-f1c9c5230d2f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:34.424390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83734767-56e3-467d-b8d4-8f80674ef022 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:34.425208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83734767-56e3-467d-b8d4-8f80674ef022 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:34.426077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83734767-56e3-467d-b8d4-8f80674ef022 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:34.426463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83734767-56e3-467d-b8d4-8f80674ef022 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:34.427459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83734767-56e3-467d-b8d4-8f80674ef022 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:34.438595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83734767-56e3-467d-b8d4-8f80674ef022 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:34.498798 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2216/4366] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:34 2022] PUT /identity/v3/projects/ac53481d9830400aae9c5f965341807e/users/29e32d5a19fb4da7a1d0947e19729446/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:34.509616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c63de3-986c-4208-a638-50c968c508c3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:34.518192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c63de3-986c-4208-a638-50c968c508c3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:34.518192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c63de3-986c-4208-a638-50c968c508c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:34.591290 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2151/4367] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:21:34 2022] POST /identity/v3/roles => generated 235 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:34.599538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83734767-56e3-467d-b8d4-8f80674ef022 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:34.628889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-71c63de3-986c-4208-a638-50c968c508c3 None None] MFA Rules not processed for user `29e32d5a19fb4da7a1d0947e19729446`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:34.631247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-71c63de3-986c-4208-a638-50c968c508c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:34.634006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83734767-56e3-467d-b8d4-8f80674ef022 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:34.850626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93670dd1-a967-41f6-a42b-bbb37262b8a6 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:34.851624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93670dd1-a967-41f6-a42b-bbb37262b8a6 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:34.852018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93670dd1-a967-41f6-a42b-bbb37262b8a6 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:34.855921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93670dd1-a967-41f6-a42b-bbb37262b8a6 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:34.856914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93670dd1-a967-41f6-a42b-bbb37262b8a6 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:34.862614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93670dd1-a967-41f6-a42b-bbb37262b8a6 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:34.878851 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2217/4368] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:34.887842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c63de3-986c-4208-a638-50c968c508c3 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:34.890057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-71c63de3-986c-4208-a638-50c968c508c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:34.929439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:35.135850 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2152/4369] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:21:34 2022] POST /identity/v3/roles => generated 233 bytes in 537 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:35.149847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93670dd1-a967-41f6-a42b-bbb37262b8a6 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:35.154671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c63de3-986c-4208-a638-50c968c508c3 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:35.166869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14981e60-8c83-4083-bf6b-2e25b345ef57 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:35.167536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14981e60-8c83-4083-bf6b-2e25b345ef57 service glance] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:35.167852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14981e60-8c83-4083-bf6b-2e25b345ef57 service glance] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:35.168135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14981e60-8c83-4083-bf6b-2e25b345ef57 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:35.180799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93670dd1-a967-41f6-a42b-bbb37262b8a6 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:35.199047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe0122-ca77-47a4-947a-c7a500f8c0bd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:35.199047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe0122-ca77-47a4-947a-c7a500f8c0bd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:35.199047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe0122-ca77-47a4-947a-c7a500f8c0bd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:35.204396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe0122-ca77-47a4-947a-c7a500f8c0bd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:35.205798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe0122-ca77-47a4-947a-c7a500f8c0bd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:35.207590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe0122-ca77-47a4-947a-c7a500f8c0bd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:35.310266 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2153/4370] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:21:35 2022] POST /identity/v3/domains => generated 277 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:35.316329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe0122-ca77-47a4-947a-c7a500f8c0bd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:35.362336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14981e60-8c83-4083-bf6b-2e25b345ef57 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:35.363616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14981e60-8c83-4083-bf6b-2e25b345ef57 service glance] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:35.401731 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2218/4371] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:21:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:21:35.486295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe0122-ca77-47a4-947a-c7a500f8c0bd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:35.499728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef137cd-6a32-4c84-b10d-bd4143b84c52 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:35.500720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef137cd-6a32-4c84-b10d-bd4143b84c52 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:35.501288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef137cd-6a32-4c84-b10d-bd4143b84c52 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:35.502479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef137cd-6a32-4c84-b10d-bd4143b84c52 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:35.503443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef137cd-6a32-4c84-b10d-bd4143b84c52 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:35.507395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef137cd-6a32-4c84-b10d-bd4143b84c52 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:35.537266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73e96f-57db-40b9-aa2a-3ec2d44c2b0b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:35.537848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73e96f-57db-40b9-aa2a-3ec2d44c2b0b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:35.537848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73e96f-57db-40b9-aa2a-3ec2d44c2b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:35.586197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2e73e96f-57db-40b9-aa2a-3ec2d44c2b0b None None] MFA Rules not processed for user `fa4c2791e14d4f88883a0af422e4ff0c`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:35.588088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2e73e96f-57db-40b9-aa2a-3ec2d44c2b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:35.656917 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2154/4372] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:21:35 2022] POST /identity/v3/projects => generated 400 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:35.666547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef137cd-6a32-4c84-b10d-bd4143b84c52 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:35.781158 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2219/4373] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:21:35.783758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4e8d1-d2cc-436c-9a71-753d7ffd42c4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:35.784053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4e8d1-d2cc-436c-9a71-753d7ffd42c4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:35.784335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4e8d1-d2cc-436c-9a71-753d7ffd42c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:35.811632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef137cd-6a32-4c84-b10d-bd4143b84c52 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:35.820321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef91e9-ac95-41e1-b47c-343a85bdf5ad tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:35.821162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef91e9-ac95-41e1-b47c-343a85bdf5ad tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:35.821454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef91e9-ac95-41e1-b47c-343a85bdf5ad tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:35.821740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef91e9-ac95-41e1-b47c-343a85bdf5ad tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/groups` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:35.822442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef91e9-ac95-41e1-b47c-343a85bdf5ad tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:35.827583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef91e9-ac95-41e1-b47c-343a85bdf5ad tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:35.896754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-36b4e8d1-d2cc-436c-9a71-753d7ffd42c4 None None] MFA Rules not processed for user `fa4c2791e14d4f88883a0af422e4ff0c`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:35.898456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-36b4e8d1-d2cc-436c-9a71-753d7ffd42c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:35.949696 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2155/4374] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jul 16 21:21:35 2022] POST /identity/v3/groups => generated 299 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:35.953948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef91e9-ac95-41e1-b47c-343a85bdf5ad tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:35.982347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef91e9-ac95-41e1-b47c-343a85bdf5ad tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:36.026092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc16a2-83c0-4d4a-9c28-719db3c78086 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:36.026788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc16a2-83c0-4d4a-9c28-719db3c78086 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:36.027107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc16a2-83c0-4d4a-9c28-719db3c78086 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:36.027394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc16a2-83c0-4d4a-9c28-719db3c78086 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:36.028146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc16a2-83c0-4d4a-9c28-719db3c78086 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:36.029779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc16a2-83c0-4d4a-9c28-719db3c78086 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:36.109363 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2220/4375] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:36.133152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4e8d1-d2cc-436c-9a71-753d7ffd42c4 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:36.134740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-36b4e8d1-d2cc-436c-9a71-753d7ffd42c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:36.140161 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2156/4376] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:21:35 2022] POST /identity/v3/roles => generated 235 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:21:36.141070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc16a2-83c0-4d4a-9c28-719db3c78086 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:36.188349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc16a2-83c0-4d4a-9c28-719db3c78086 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:36.203525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920d06d-3794-48ce-8037-2bcd2ecc4517 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:36.204761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920d06d-3794-48ce-8037-2bcd2ecc4517 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:36.205056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920d06d-3794-48ce-8037-2bcd2ecc4517 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:36.205393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920d06d-3794-48ce-8037-2bcd2ecc4517 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:36.206284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920d06d-3794-48ce-8037-2bcd2ecc4517 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:36.210694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920d06d-3794-48ce-8037-2bcd2ecc4517 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:36.312393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4e8d1-d2cc-436c-9a71-753d7ffd42c4 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:36.320960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b15e7-c1ba-4196-95f1-89e87f4efa5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:36.321970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b15e7-c1ba-4196-95f1-89e87f4efa5d service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:36.325513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b15e7-c1ba-4196-95f1-89e87f4efa5d service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:36.326038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b15e7-c1ba-4196-95f1-89e87f4efa5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:36.348716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b15e7-c1ba-4196-95f1-89e87f4efa5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:36.353101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b15e7-c1ba-4196-95f1-89e87f4efa5d service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:36.378347 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2221/4377] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:21:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:21:36.491731 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2157/4378] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:21:36 2022] POST /identity/v3/users => generated 442 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:36.497315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b15e7-c1ba-4196-95f1-89e87f4efa5d service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:36.559461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b15e7-c1ba-4196-95f1-89e87f4efa5d service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:36.587514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574d506-abec-4536-b52d-a4c5bab7da58 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:36.592851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574d506-abec-4536-b52d-a4c5bab7da58 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:36.593199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574d506-abec-4536-b52d-a4c5bab7da58 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:36.593687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574d506-abec-4536-b52d-a4c5bab7da58 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:36.596406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574d506-abec-4536-b52d-a4c5bab7da58 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:36.599528 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-3574d506-abec-4536-b52d-a4c5bab7da58 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:36.599528 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:21:36.599528 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:21:36.604382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574d506-abec-4536-b52d-a4c5bab7da58 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:36.649771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:UPDATE=2,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:36.692380 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2222/4379] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:21:36 2022] POST /identity/v3/roles => generated 270 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:36.696493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920d06d-3794-48ce-8037-2bcd2ecc4517 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:36.712755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920d06d-3794-48ce-8037-2bcd2ecc4517 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:36.726502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495af7e-6023-499f-9c20-5f4c71ae0306 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:36.727849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495af7e-6023-499f-9c20-5f4c71ae0306 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:36.728526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495af7e-6023-499f-9c20-5f4c71ae0306 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:36.729029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495af7e-6023-499f-9c20-5f4c71ae0306 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/projects/14f73d9f9df742988baa1e53192acb7f/users/c45754429aec40f096c1463d89f157b2/roles/33067bd1cedc4ece9053e3a40faace8f` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:36.741619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:36.790277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495af7e-6023-499f-9c20-5f4c71ae0306 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_grant(project_id=14f73d9f9df742988baa1e53192acb7f, user_id=c45754429aec40f096c1463d89f157b2, role_id=33067bd1cedc4ece9053e3a40faace8f)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:36.795468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495af7e-6023-499f-9c20-5f4c71ae0306 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:36.918011 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2158/4380] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:36 2022] PUT /identity/v3/projects/14f73d9f9df742988baa1e53192acb7f/users/c45754429aec40f096c1463d89f157b2/roles/33067bd1cedc4ece9053e3a40faace8f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:36.918176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574d506-abec-4536-b52d-a4c5bab7da58 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:36.931967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574d506-abec-4536-b52d-a4c5bab7da58 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:37.060187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4267ce-7801-4f0f-a312-a15fff4546de tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:37.060870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4267ce-7801-4f0f-a312-a15fff4546de tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:37.061161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4267ce-7801-4f0f-a312-a15fff4546de tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:37.061447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4267ce-7801-4f0f-a312-a15fff4546de tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:37.064690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4267ce-7801-4f0f-a312-a15fff4546de tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Adding query filter params (scope.project.id=14f73d9f9df742988baa1e53192acb7f, user.id=c45754429aec40f096c1463d89f157b2) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:21:37.064862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4267ce-7801-4f0f-a312-a15fff4546de tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:37.065961 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-1e4267ce-7801-4f0f-a312-a15fff4546de tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:37.065961 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:21:37.065961 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:21:37.071053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4267ce-7801-4f0f-a312-a15fff4546de tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:37.163358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495af7e-6023-499f-9c20-5f4c71ae0306 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:37.200181 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2223/4381] 10.222.0.16 () {58 vars in 1355 bytes} [Sat Jul 16 21:21:36 2022] GET /identity/v3/role_assignments?scope.project.id=14f73d9f9df742988baa1e53192acb7f&user.id=c45754429aec40f096c1463d89f157b2&effective => generated 228 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:37.201320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4267ce-7801-4f0f-a312-a15fff4546de tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:37.225252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4267ce-7801-4f0f-a312-a15fff4546de tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:37.246528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee960dd-b579-4af4-a067-c5ca8c264727 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:37.247607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee960dd-b579-4af4-a067-c5ca8c264727 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:37.255525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee960dd-b579-4af4-a067-c5ca8c264727 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:37.255987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee960dd-b579-4af4-a067-c5ca8c264727 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/projects/14f73d9f9df742988baa1e53192acb7f/users/c45754429aec40f096c1463d89f157b2/roles/33067bd1cedc4ece9053e3a40faace8f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:37.265318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee960dd-b579-4af4-a067-c5ca8c264727 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=14f73d9f9df742988baa1e53192acb7f, user_id=c45754429aec40f096c1463d89f157b2, role_id=33067bd1cedc4ece9053e3a40faace8f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:37.267115 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-aee960dd-b579-4af4-a067-c5ca8c264727 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:37.267115 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:21:37.267115 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:21:37.269386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee960dd-b579-4af4-a067-c5ca8c264727 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:37.286009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aee960dd-b579-4af4-a067-c5ca8c264727 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invalidating the token cache because role 33067bd1cedc4ece9053e3a40faace8f was removed from user c45754429aec40f096c1463d89f157b2 on project 14f73d9f9df742988baa1e53192acb7f. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:37.286669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aee960dd-b579-4af4-a067-c5ca8c264727 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:37.289801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aee960dd-b579-4af4-a067-c5ca8c264727 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:37.335529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495af7e-6023-499f-9c20-5f4c71ae0306 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:37.342363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f9597-71af-4863-a12c-2f860ebc8453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:37.343312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f9597-71af-4863-a12c-2f860ebc8453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:37.343597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f9597-71af-4863-a12c-2f860ebc8453 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:37.343949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f9597-71af-4863-a12c-2f860ebc8453 admin admin] PATH_INFO: `/v3/users/7dca25bfc8964ef1aeffc902f9442302` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:37.347079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f9597-71af-4863-a12c-2f860ebc8453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dca25bfc8964ef1aeffc902f9442302)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:37.349438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f9597-71af-4863-a12c-2f860ebc8453 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:37.429243 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2224/4382] 10.222.0.16 () {58 vars in 1466 bytes} [Sat Jul 16 21:21:37 2022] DELETE /identity/v3/projects/14f73d9f9df742988baa1e53192acb7f/users/c45754429aec40f096c1463d89f157b2/roles/33067bd1cedc4ece9053e3a40faace8f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:37.433714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee960dd-b579-4af4-a067-c5ca8c264727 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:37.436103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-aee960dd-b579-4af4-a067-c5ca8c264727 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:37.599224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee960dd-b579-4af4-a067-c5ca8c264727 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:37.606703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6023e3-6689-433e-aa91-8120d9f6ca9d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:37.607762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6023e3-6689-433e-aa91-8120d9f6ca9d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:37.608194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6023e3-6689-433e-aa91-8120d9f6ca9d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:37.608576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6023e3-6689-433e-aa91-8120d9f6ca9d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/33067bd1cedc4ece9053e3a40faace8f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:37.612040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6023e3-6689-433e-aa91-8120d9f6ca9d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=33067bd1cedc4ece9053e3a40faace8f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:37.613189 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-1f6023e3-6689-433e-aa91-8120d9f6ca9d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:37.613189 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:21:37.613189 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:21:37.614352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6023e3-6689-433e-aa91-8120d9f6ca9d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:37.630274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9c2f9597-71af-4863-a12c-2f860ebc8453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dca25bfc8964ef1aeffc902f9442302'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:37.661885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9c2f9597-71af-4863-a12c-2f860ebc8453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dca25bfc8964ef1aeffc902f9442302'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:37.791825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9c2f9597-71af-4863-a12c-2f860ebc8453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dca25bfc8964ef1aeffc902f9442302'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:37.802663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9c2f9597-71af-4863-a12c-2f860ebc8453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dca25bfc8964ef1aeffc902f9442302'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:37.803654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9c2f9597-71af-4863-a12c-2f860ebc8453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dca25bfc8964ef1aeffc902f9442302'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:37.825358 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2159/4383] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:37 2022] DELETE /identity/v3/users/7dca25bfc8964ef1aeffc902f9442302 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:37.827215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2ce9d-894d-4bf0-bf26-365ea967dc30 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:37.827595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2ce9d-894d-4bf0-bf26-365ea967dc30 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:37.827951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2ce9d-894d-4bf0-bf26-365ea967dc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:37.846762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f6023e3-6689-433e-aa91-8120d9f6ca9d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invalidating the token cache because role 33067bd1cedc4ece9053e3a40faace8f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:37.847230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f6023e3-6689-433e-aa91-8120d9f6ca9d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:37.849259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f6023e3-6689-433e-aa91-8120d9f6ca9d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:37.854088 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2225/4384] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:37 2022] DELETE /identity/v3/roles/33067bd1cedc4ece9053e3a40faace8f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:21:37.861427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd207d7-909d-43d3-9b10-5b867aeccd34 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:37.861427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd207d7-909d-43d3-9b10-5b867aeccd34 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:37.861427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd207d7-909d-43d3-9b10-5b867aeccd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:37.877716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-96a2ce9d-894d-4bf0-bf26-365ea967dc30 None None] MFA Rules not processed for user `aaf2292818b749f0ae43c66bca929be9`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:37.880424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-96a2ce9d-894d-4bf0-bf26-365ea967dc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:37.887486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9dd207d7-909d-43d3-9b10-5b867aeccd34 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:37.889426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9dd207d7-909d-43d3-9b10-5b867aeccd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:37.999460 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2160/4385] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:37.999460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2ce9d-894d-4bf0-bf26-365ea967dc30 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:37.999460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-96a2ce9d-894d-4bf0-bf26-365ea967dc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:38.030430 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2226/4386] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:38.030430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd4e5a-12df-48df-b9bc-78aacfe5588a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:38.030430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd4e5a-12df-48df-b9bc-78aacfe5588a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:38.030430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd4e5a-12df-48df-b9bc-78aacfe5588a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:38.068668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f1dd4e5a-12df-48df-b9bc-78aacfe5588a None None] MFA Rules not processed for user `aaf2292818b749f0ae43c66bca929be9`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:38.069992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f1dd4e5a-12df-48df-b9bc-78aacfe5588a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:38.082655 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2227/4387] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:38.082655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd4e5a-12df-48df-b9bc-78aacfe5588a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:38.084579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f1dd4e5a-12df-48df-b9bc-78aacfe5588a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:38.114111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2ce9d-894d-4bf0-bf26-365ea967dc30 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:38.119870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce53365-54ab-4e35-a086-e6518b4027e7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:38.121331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce53365-54ab-4e35-a086-e6518b4027e7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:38.134077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce53365-54ab-4e35-a086-e6518b4027e7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:38.134579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce53365-54ab-4e35-a086-e6518b4027e7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/projects/14f73d9f9df742988baa1e53192acb7f/users/c45754429aec40f096c1463d89f157b2/roles/c27ae8ee177b4b71b2ab962e88913533` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:38.145640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce53365-54ab-4e35-a086-e6518b4027e7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_grant(project_id=14f73d9f9df742988baa1e53192acb7f, user_id=c45754429aec40f096c1463d89f157b2, role_id=c27ae8ee177b4b71b2ab962e88913533)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:38.148752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce53365-54ab-4e35-a086-e6518b4027e7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:38.197692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd4e5a-12df-48df-b9bc-78aacfe5588a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:38.209500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfddd37-80d5-4704-8fa5-1f1eccd7995a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:38.221598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfddd37-80d5-4704-8fa5-1f1eccd7995a service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:38.222444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfddd37-80d5-4704-8fa5-1f1eccd7995a service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:38.222744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfddd37-80d5-4704-8fa5-1f1eccd7995a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:38.249614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfddd37-80d5-4704-8fa5-1f1eccd7995a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:38.252041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfddd37-80d5-4704-8fa5-1f1eccd7995a service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:38.283126 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2228/4388] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:21:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:21:38.284211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfddd37-80d5-4704-8fa5-1f1eccd7995a service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:38.290147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5bfddd37-80d5-4704-8fa5-1f1eccd7995a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:38.320825 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2161/4389] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:37 2022] PUT /identity/v3/projects/14f73d9f9df742988baa1e53192acb7f/users/c45754429aec40f096c1463d89f157b2/roles/c27ae8ee177b4b71b2ab962e88913533 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:38.325006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce53365-54ab-4e35-a086-e6518b4027e7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:38.462686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfddd37-80d5-4704-8fa5-1f1eccd7995a service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:38.476217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce53365-54ab-4e35-a086-e6518b4027e7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:38.482439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78720a0e-4efb-4f68-b1bd-b57ccb3544bd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:38.483843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78720a0e-4efb-4f68-b1bd-b57ccb3544bd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:38.484360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78720a0e-4efb-4f68-b1bd-b57ccb3544bd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:38.484883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78720a0e-4efb-4f68-b1bd-b57ccb3544bd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:38.488922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78720a0e-4efb-4f68-b1bd-b57ccb3544bd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c27ae8ee177b4b71b2ab962e88913533, implied_role_id=ed3ba6080bac49c990e47d1c1ee8741d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:38.490292 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-78720a0e-4efb-4f68-b1bd-b57ccb3544bd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:38.490292 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:21:38.490292 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:21:38.491594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78720a0e-4efb-4f68-b1bd-b57ccb3544bd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:38.547111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ab10a-c7f5-4e00-8f81-806601fe7493 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:38.548891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ab10a-c7f5-4e00-8f81-806601fe7493 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:38.549555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ab10a-c7f5-4e00-8f81-806601fe7493 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:38.550227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ab10a-c7f5-4e00-8f81-806601fe7493 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:38.655066 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2162/4390] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Jul 16 21:21:38 2022] PUT /identity/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d => generated 521 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:21:38.661064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78720a0e-4efb-4f68-b1bd-b57ccb3544bd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:38.699773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ab10a-c7f5-4e00-8f81-806601fe7493 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:38.705302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ab10a-c7f5-4e00-8f81-806601fe7493 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:38.752093 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2229/4391] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:21:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:21:38.833892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78720a0e-4efb-4f68-b1bd-b57ccb3544bd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:39.034175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21548a64-be43-4852-87be-d0bd45ecd971 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:39.034175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21548a64-be43-4852-87be-d0bd45ecd971 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:39.034175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21548a64-be43-4852-87be-d0bd45ecd971 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:39.035201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21548a64-be43-4852-87be-d0bd45ecd971 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:39.035201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21548a64-be43-4852-87be-d0bd45ecd971 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Adding query filter params (scope.project.id=14f73d9f9df742988baa1e53192acb7f, user.id=c45754429aec40f096c1463d89f157b2) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:21:39.035201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21548a64-be43-4852-87be-d0bd45ecd971 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:39.035201 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-21548a64-be43-4852-87be-d0bd45ecd971 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:39.035201 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:21:39.035201 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:21:39.035850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21548a64-be43-4852-87be-d0bd45ecd971 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:39.099488 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2163/4392] 10.222.0.16 () {58 vars in 1355 bytes} [Sat Jul 16 21:21:38 2022] GET /identity/v3/role_assignments?scope.project.id=14f73d9f9df742988baa1e53192acb7f&user.id=c45754429aec40f096c1463d89f157b2&effective => generated 1061 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:39.102366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ab10a-c7f5-4e00-8f81-806601fe7493 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:39.126442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ab10a-c7f5-4e00-8f81-806601fe7493 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:39.145507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcab8eb-bfb8-46ec-9bb1-43432cf7785d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:39.146872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcab8eb-bfb8-46ec-9bb1-43432cf7785d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:39.149482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcab8eb-bfb8-46ec-9bb1-43432cf7785d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:39.151287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcab8eb-bfb8-46ec-9bb1-43432cf7785d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:39.161284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcab8eb-bfb8-46ec-9bb1-43432cf7785d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c27ae8ee177b4b71b2ab962e88913533, implied_role_id=ed3ba6080bac49c990e47d1c1ee8741d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:39.163964 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-3fcab8eb-bfb8-46ec-9bb1-43432cf7785d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:39.163964 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:21:39.163964 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:21:39.169039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcab8eb-bfb8-46ec-9bb1-43432cf7785d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:39.323768 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2230/4393] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Jul 16 21:21:39 2022] DELETE /identity/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:39.327555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21548a64-be43-4852-87be-d0bd45ecd971 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:39.339842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21548a64-be43-4852-87be-d0bd45ecd971 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:39.440086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b808962-7bdd-4c9b-96ab-5c4a64ef5c70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:39.442108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b808962-7bdd-4c9b-96ab-5c4a64ef5c70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:39.442675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b808962-7bdd-4c9b-96ab-5c4a64ef5c70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:39.443216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b808962-7bdd-4c9b-96ab-5c4a64ef5c70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:39.444298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b808962-7bdd-4c9b-96ab-5c4a64ef5c70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Adding query filter params (scope.project.id=14f73d9f9df742988baa1e53192acb7f, user.id=c45754429aec40f096c1463d89f157b2) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:21:39.445106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b808962-7bdd-4c9b-96ab-5c4a64ef5c70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:39.448337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b808962-7bdd-4c9b-96ab-5c4a64ef5c70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:39.522880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcab8eb-bfb8-46ec-9bb1-43432cf7785d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:39.534148 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2164/4394] 10.222.0.16 () {58 vars in 1355 bytes} [Sat Jul 16 21:21:39 2022] GET /identity/v3/role_assignments?scope.project.id=14f73d9f9df742988baa1e53192acb7f&user.id=c45754429aec40f096c1463d89f157b2&effective => generated 577 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:39.538260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcab8eb-bfb8-46ec-9bb1-43432cf7785d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:39.545252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03928a5a-bd75-47c4-833a-dd951299fd56 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:39.548200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03928a5a-bd75-47c4-833a-dd951299fd56 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:39.548739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03928a5a-bd75-47c4-833a-dd951299fd56 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:39.549128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03928a5a-bd75-47c4-833a-dd951299fd56 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:39.551334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03928a5a-bd75-47c4-833a-dd951299fd56 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c27ae8ee177b4b71b2ab962e88913533, implied_role_id=ed3ba6080bac49c990e47d1c1ee8741d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:39.554029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03928a5a-bd75-47c4-833a-dd951299fd56 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:39.617635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:39.631693 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-03928a5a-bd75-47c4-833a-dd951299fd56 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] c27ae8ee177b4b71b2ab962e88913533 does not imply ed3ba6080bac49c990e47d1c1ee8741d.: keystone.exception.ImpliedRoleNotFound: c27ae8ee177b4b71b2ab962e88913533 does not imply ed3ba6080bac49c990e47d1c1ee8741d. Jul 16 21:21:39.631693 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:39.631693 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 16 21:21:39.631693 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = query.one() Jul 16 21:21:39.631693 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 16 21:21:39.631693 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._iter().one() Jul 16 21:21:39.631693 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 16 21:21:39.631693 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._only_one_row( Jul 16 21:21:39.631693 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 16 21:21:39.631693 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 16 21:21:39.631693 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 16 21:21:39.631693 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:39.631693 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:21:39.631693 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:39.631693 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:39.631693 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:21:39.632867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:21:39.632867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:21:39.632867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:21:39.632867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:21:39.632867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:21:39.632867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:21:39.632867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:21:39.632867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:21:39.632867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:21:39.632867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jul 16 21:21:39.632867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jul 16 21:21:39.632867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:21:39.632867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:21:39.632867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jul 16 21:21:39.632867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jul 16 21:21:39.632867 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jul 16 21:21:39.633883 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 16 21:21:39.633883 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 16 21:21:39.633883 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 16 21:21:39.633883 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: c27ae8ee177b4b71b2ab962e88913533 does not imply ed3ba6080bac49c990e47d1c1ee8741d. Jul 16 21:21:39.633883 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:39.643325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b808962-7bdd-4c9b-96ab-5c4a64ef5c70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:39.652501 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2231/4395] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Jul 16 21:21:39 2022] DELETE /identity/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d => generated 137 bytes in 131 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:21:39.661154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b808962-7bdd-4c9b-96ab-5c4a64ef5c70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:39.673670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe2915-5fa1-404f-98c1-5b7d5463840a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:39.675377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe2915-5fa1-404f-98c1-5b7d5463840a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:39.677106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe2915-5fa1-404f-98c1-5b7d5463840a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:39.677837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe2915-5fa1-404f-98c1-5b7d5463840a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/projects/14f73d9f9df742988baa1e53192acb7f/users/c45754429aec40f096c1463d89f157b2/roles/c27ae8ee177b4b71b2ab962e88913533` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:39.685051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe2915-5fa1-404f-98c1-5b7d5463840a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=14f73d9f9df742988baa1e53192acb7f, user_id=c45754429aec40f096c1463d89f157b2, role_id=c27ae8ee177b4b71b2ab962e88913533)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:39.686244 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-f4fe2915-5fa1-404f-98c1-5b7d5463840a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:39.686244 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:21:39.686244 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:21:39.694825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe2915-5fa1-404f-98c1-5b7d5463840a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:39.713316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f4fe2915-5fa1-404f-98c1-5b7d5463840a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invalidating the token cache because role c27ae8ee177b4b71b2ab962e88913533 was removed from user c45754429aec40f096c1463d89f157b2 on project 14f73d9f9df742988baa1e53192acb7f. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:39.714013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f4fe2915-5fa1-404f-98c1-5b7d5463840a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:39.718604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f4fe2915-5fa1-404f-98c1-5b7d5463840a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:39.844282 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2165/4396] 10.222.0.16 () {58 vars in 1466 bytes} [Sat Jul 16 21:21:39 2022] DELETE /identity/v3/projects/14f73d9f9df742988baa1e53192acb7f/users/c45754429aec40f096c1463d89f157b2/roles/c27ae8ee177b4b71b2ab962e88913533 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:39.853394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03928a5a-bd75-47c4-833a-dd951299fd56 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:39.856283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-03928a5a-bd75-47c4-833a-dd951299fd56 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:39.896500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03928a5a-bd75-47c4-833a-dd951299fd56 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:40.113170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711b2a6-f7f7-4875-93af-23f6e5783001 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:40.113170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711b2a6-f7f7-4875-93af-23f6e5783001 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:40.113170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711b2a6-f7f7-4875-93af-23f6e5783001 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:40.113558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711b2a6-f7f7-4875-93af-23f6e5783001 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:40.113558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711b2a6-f7f7-4875-93af-23f6e5783001 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:40.113558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711b2a6-f7f7-4875-93af-23f6e5783001 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:40.183670 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2232/4397] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:21:39 2022] POST /identity/v3/roles => generated 272 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:40.187570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe2915-5fa1-404f-98c1-5b7d5463840a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:40.210712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe2915-5fa1-404f-98c1-5b7d5463840a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:40.227349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee6086-c2f7-4721-9ff5-bee3c7a8e2a0 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:40.228364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee6086-c2f7-4721-9ff5-bee3c7a8e2a0 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:40.229188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee6086-c2f7-4721-9ff5-bee3c7a8e2a0 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:40.229639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee6086-c2f7-4721-9ff5-bee3c7a8e2a0 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:40.230577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee6086-c2f7-4721-9ff5-bee3c7a8e2a0 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Adding query filter params (domain_id=2e571cc5fa7d423b9fa0c96e61964ccc) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:21:40.231079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee6086-c2f7-4721-9ff5-bee3c7a8e2a0 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:40.233695 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-25ee6086-c2f7-4721-9ff5-bee3c7a8e2a0 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:40.233695 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:21:40.233695 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:21:40.237157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee6086-c2f7-4721-9ff5-bee3c7a8e2a0 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:40.257790 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2166/4398] 10.222.0.16 () {58 vars in 1206 bytes} [Sat Jul 16 21:21:40 2022] GET /identity/v3/roles?domain_id=2e571cc5fa7d423b9fa0c96e61964ccc => generated 409 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:40.263131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711b2a6-f7f7-4875-93af-23f6e5783001 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:40.278829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711b2a6-f7f7-4875-93af-23f6e5783001 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:40.288924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8e0c3-7079-4120-a3a2-b5a22d9a24f8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:40.300329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8e0c3-7079-4120-a3a2-b5a22d9a24f8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:40.300686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8e0c3-7079-4120-a3a2-b5a22d9a24f8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:40.300983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8e0c3-7079-4120-a3a2-b5a22d9a24f8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/53b5c95f02cc4508870720a0cb1806d3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:40.303807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8e0c3-7079-4120-a3a2-b5a22d9a24f8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=53b5c95f02cc4508870720a0cb1806d3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:40.306046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8e0c3-7079-4120-a3a2-b5a22d9a24f8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:40.386067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee6086-c2f7-4721-9ff5-bee3c7a8e2a0 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:40.386067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-25ee6086-c2f7-4721-9ff5-bee3c7a8e2a0 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:40.456495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:40.517308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a6f8e0c3-7079-4120-a3a2-b5a22d9a24f8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invalidating the token cache because role 53b5c95f02cc4508870720a0cb1806d3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:40.517600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a6f8e0c3-7079-4120-a3a2-b5a22d9a24f8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:40.519513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a6f8e0c3-7079-4120-a3a2-b5a22d9a24f8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:40.542570 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2233/4399] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:40 2022] DELETE /identity/v3/roles/53b5c95f02cc4508870720a0cb1806d3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:40.542570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8e0c3-7079-4120-a3a2-b5a22d9a24f8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:40.542570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a6f8e0c3-7079-4120-a3a2-b5a22d9a24f8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:40.544993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee6086-c2f7-4721-9ff5-bee3c7a8e2a0 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:40.715585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef172d24-796a-444c-a2f5-4331b9d7d36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:40.716459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef172d24-796a-444c-a2f5-4331b9d7d36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:40.716933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef172d24-796a-444c-a2f5-4331b9d7d36a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:40.722834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef172d24-796a-444c-a2f5-4331b9d7d36a admin admin] PATH_INFO: `/v3/projects/f5ee1ace83414fcf9dc0d684db53ec71` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:40.723878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef172d24-796a-444c-a2f5-4331b9d7d36a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5ee1ace83414fcf9dc0d684db53ec71)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:40.726006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef172d24-796a-444c-a2f5-4331b9d7d36a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:40.816133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8e0c3-7079-4120-a3a2-b5a22d9a24f8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:40.858909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e617a-db8b-4e5d-a233-25033040fa04 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:40.871112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e617a-db8b-4e5d-a233-25033040fa04 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:40.873234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e617a-db8b-4e5d-a233-25033040fa04 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:40.873925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e617a-db8b-4e5d-a233-25033040fa04 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:40.875052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e617a-db8b-4e5d-a233-25033040fa04 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Adding query filter params (domain_id=2e571cc5fa7d423b9fa0c96e61964ccc) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:21:40.875714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e617a-db8b-4e5d-a233-25033040fa04 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:40.879891 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-6e6e617a-db8b-4e5d-a233-25033040fa04 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:40.879891 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:21:40.879891 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:21:40.881592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e617a-db8b-4e5d-a233-25033040fa04 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:40.896606 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2234/4400] 10.222.0.16 () {58 vars in 1206 bytes} [Sat Jul 16 21:21:40 2022] GET /identity/v3/roles?domain_id=2e571cc5fa7d423b9fa0c96e61964ccc => generated 148 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:40.900039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e617a-db8b-4e5d-a233-25033040fa04 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:40.918736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e617a-db8b-4e5d-a233-25033040fa04 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:40.930843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb955f0-9a49-4490-b8a5-b7ca1c23812b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:40.930843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb955f0-9a49-4490-b8a5-b7ca1c23812b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:40.930843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb955f0-9a49-4490-b8a5-b7ca1c23812b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:40.931207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb955f0-9a49-4490-b8a5-b7ca1c23812b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/53b5c95f02cc4508870720a0cb1806d3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:40.950576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb955f0-9a49-4490-b8a5-b7ca1c23812b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 21:21:40.966974 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-fdb955f0-9a49-4490-b8a5-b7ca1c23812b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Could not find role: 53b5c95f02cc4508870720a0cb1806d3.: keystone.exception.RoleNotFound: Could not find role: 53b5c95f02cc4508870720a0cb1806d3. Jul 16 21:21:40.966974 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:40.966974 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:21:40.966974 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:21:40.966974 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:21:40.966974 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:21:40.966974 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:21:40.966974 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:21:40.966974 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:21:40.966974 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:21:40.966974 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:21:40.966974 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:21:40.966974 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Jul 16 21:21:40.966974 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Jul 16 21:21:40.968102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 21:21:40.968102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 21:21:40.968102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 21:21:40.968102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 21:21:40.968102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:21:40.968102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:21:40.968102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:21:40.968102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:21:40.968102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:21:40.968102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:21:40.968102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:21:40.968102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 21:21:40.968102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:21:40.968102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:21:40.968102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:21:40.968102 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:21:40.969299 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:21:40.969299 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:21:40.969299 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:21:40.969299 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:21:40.969299 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 16 21:21:40.969299 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 16 21:21:40.969299 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 16 21:21:40.969299 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 16 21:21:40.969299 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 16 21:21:40.969299 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 16 21:21:40.969299 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 53b5c95f02cc4508870720a0cb1806d3. Jul 16 21:21:40.969299 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:40.975901 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2235/4401] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:40 2022] DELETE /identity/v3/roles/53b5c95f02cc4508870720a0cb1806d3 => generated 110 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:21:40.977003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb955f0-9a49-4490-b8a5-b7ca1c23812b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:40.994636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb955f0-9a49-4490-b8a5-b7ca1c23812b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:41.057763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ef172d24-796a-444c-a2f5-4331b9d7d36a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5ee1ace83414fcf9dc0d684db53ec71', 'request_id': 'req-ef172d24-796a-444c-a2f5-4331b9d7d36a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:41.095387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ef172d24-796a-444c-a2f5-4331b9d7d36a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5ee1ace83414fcf9dc0d684db53ec71', 'request_id': 'req-ef172d24-796a-444c-a2f5-4331b9d7d36a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:41.125170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ef172d24-796a-444c-a2f5-4331b9d7d36a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5ee1ace83414fcf9dc0d684db53ec71', 'request_id': 'req-ef172d24-796a-444c-a2f5-4331b9d7d36a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:41.164898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ea4bd-f24f-4399-8470-42588202768c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:41.166176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ea4bd-f24f-4399-8470-42588202768c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:41.170574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ea4bd-f24f-4399-8470-42588202768c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:41.172146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ea4bd-f24f-4399-8470-42588202768c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/domains/2e571cc5fa7d423b9fa0c96e61964ccc/groups/023ab4f93ff2409ebe3654774b8b323c/roles/c8da004e2606443c8f05e1e17f60967d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:41.190058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ea4bd-f24f-4399-8470-42588202768c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2e571cc5fa7d423b9fa0c96e61964ccc, group_id=023ab4f93ff2409ebe3654774b8b323c, role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:41.198166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ea4bd-f24f-4399-8470-42588202768c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:41.249750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ef172d24-796a-444c-a2f5-4331b9d7d36a admin admin] The token cache is being invalidate because project f5ee1ace83414fcf9dc0d684db53ec71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:41.250048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ef172d24-796a-444c-a2f5-4331b9d7d36a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:41.251181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ef172d24-796a-444c-a2f5-4331b9d7d36a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:41.259716 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2167/4402] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:40 2022] DELETE /identity/v3/projects/f5ee1ace83414fcf9dc0d684db53ec71 => generated 0 bytes in 877 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:41.264301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef172d24-796a-444c-a2f5-4331b9d7d36a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:41.268853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ef172d24-796a-444c-a2f5-4331b9d7d36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:41.317625 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2236/4403] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:40 2022] PUT /identity/v3/domains/2e571cc5fa7d423b9fa0c96e61964ccc/groups/023ab4f93ff2409ebe3654774b8b323c/roles/c8da004e2606443c8f05e1e17f60967d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:41.320054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ea4bd-f24f-4399-8470-42588202768c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:41.325755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4e8ea4bd-f24f-4399-8470-42588202768c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:41.497244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef172d24-796a-444c-a2f5-4331b9d7d36a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:41.571728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ea4bd-f24f-4399-8470-42588202768c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:41.578504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfc2b0-4e72-44b9-9e3a-8092cf9d5a1a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:41.580654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfc2b0-4e72-44b9-9e3a-8092cf9d5a1a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:41.580946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfc2b0-4e72-44b9-9e3a-8092cf9d5a1a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:41.581226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfc2b0-4e72-44b9-9e3a-8092cf9d5a1a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/domains/2e571cc5fa7d423b9fa0c96e61964ccc/groups/023ab4f93ff2409ebe3654774b8b323c/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:41.583163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfc2b0-4e72-44b9-9e3a-8092cf9d5a1a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=2e571cc5fa7d423b9fa0c96e61964ccc, group_id=023ab4f93ff2409ebe3654774b8b323c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:41.584631 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-f9dfc2b0-4e72-44b9-9e3a-8092cf9d5a1a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:41.584631 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:21:41.584631 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:21:41.587571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfc2b0-4e72-44b9-9e3a-8092cf9d5a1a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:41.611149 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2237/4404] 10.222.0.16 () {58 vars in 1364 bytes} [Sat Jul 16 21:21:41 2022] GET /identity/v3/domains/2e571cc5fa7d423b9fa0c96e61964ccc/groups/023ab4f93ff2409ebe3654774b8b323c/roles => generated 410 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:41.612224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfc2b0-4e72-44b9-9e3a-8092cf9d5a1a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:41.629056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfc2b0-4e72-44b9-9e3a-8092cf9d5a1a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:41.635965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee81bf6-73b8-45ee-b0ba-c50346886782 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:41.637711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee81bf6-73b8-45ee-b0ba-c50346886782 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `HEAD` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:41.638559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee81bf6-73b8-45ee-b0ba-c50346886782 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:41.638952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee81bf6-73b8-45ee-b0ba-c50346886782 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/domains/2e571cc5fa7d423b9fa0c96e61964ccc/groups/023ab4f93ff2409ebe3654774b8b323c/roles/c8da004e2606443c8f05e1e17f60967d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:41.644295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee81bf6-73b8-45ee-b0ba-c50346886782 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=2e571cc5fa7d423b9fa0c96e61964ccc, group_id=023ab4f93ff2409ebe3654774b8b323c, role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:41.645587 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-5ee81bf6-73b8-45ee-b0ba-c50346886782 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:41.645587 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:21:41.645587 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:21:41.648517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee81bf6-73b8-45ee-b0ba-c50346886782 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:41.666023 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2238/4405] 10.222.0.16 () {58 vars in 1464 bytes} [Sat Jul 16 21:21:41 2022] HEAD /identity/v3/domains/2e571cc5fa7d423b9fa0c96e61964ccc/groups/023ab4f93ff2409ebe3654774b8b323c/roles/c8da004e2606443c8f05e1e17f60967d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:41.666185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ed6cd-3cba-4de0-b517-cba2a20b2a1a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:41.666489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ed6cd-3cba-4de0-b517-cba2a20b2a1a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:41.666775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ed6cd-3cba-4de0-b517-cba2a20b2a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:41.695138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-db2ed6cd-3cba-4de0-b517-cba2a20b2a1a None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:41.696480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-db2ed6cd-3cba-4de0-b517-cba2a20b2a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:41.707544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:41.717552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cca89-1cb0-4aa6-ac9a-fc57f4d8ee9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:41.718851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cca89-1cb0-4aa6-ac9a-fc57f4d8ee9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:41.719344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cca89-1cb0-4aa6-ac9a-fc57f4d8ee9b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:41.720422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cca89-1cb0-4aa6-ac9a-fc57f4d8ee9b admin admin] PATH_INFO: `/v3/users/29e32d5a19fb4da7a1d0947e19729446` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:41.722931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043cca89-1cb0-4aa6-ac9a-fc57f4d8ee9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=29e32d5a19fb4da7a1d0947e19729446)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:41.725027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043cca89-1cb0-4aa6-ac9a-fc57f4d8ee9b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:41.861136 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2239/4406] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:21:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:41.861715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ed6cd-3cba-4de0-b517-cba2a20b2a1a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:41.906444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ed6cd-3cba-4de0-b517-cba2a20b2a1a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:41.932166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16487ccd-ccff-488c-b14e-bfcdf1aa9344 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:41.932736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16487ccd-ccff-488c-b14e-bfcdf1aa9344 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:41.933227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16487ccd-ccff-488c-b14e-bfcdf1aa9344 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:41.933500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16487ccd-ccff-488c-b14e-bfcdf1aa9344 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/domains/2e571cc5fa7d423b9fa0c96e61964ccc/groups/023ab4f93ff2409ebe3654774b8b323c/roles/c8da004e2606443c8f05e1e17f60967d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:41.939764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16487ccd-ccff-488c-b14e-bfcdf1aa9344 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2e571cc5fa7d423b9fa0c96e61964ccc, group_id=023ab4f93ff2409ebe3654774b8b323c, role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:41.942412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16487ccd-ccff-488c-b14e-bfcdf1aa9344 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:41.957358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16487ccd-ccff-488c-b14e-bfcdf1aa9344 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invalidating the token cache because role c8da004e2606443c8f05e1e17f60967d was removed from group 023ab4f93ff2409ebe3654774b8b323c on domain 2e571cc5fa7d423b9fa0c96e61964ccc. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:41.957665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16487ccd-ccff-488c-b14e-bfcdf1aa9344 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:41.959753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16487ccd-ccff-488c-b14e-bfcdf1aa9344 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:42.008743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-043cca89-1cb0-4aa6-ac9a-fc57f4d8ee9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29e32d5a19fb4da7a1d0947e19729446'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:42.042003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-043cca89-1cb0-4aa6-ac9a-fc57f4d8ee9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29e32d5a19fb4da7a1d0947e19729446'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:42.091049 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2240/4407] 10.222.0.16 () {58 vars in 1466 bytes} [Sat Jul 16 21:21:41 2022] DELETE /identity/v3/domains/2e571cc5fa7d423b9fa0c96e61964ccc/groups/023ab4f93ff2409ebe3654774b8b323c/roles/c8da004e2606443c8f05e1e17f60967d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:42.092489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16487ccd-ccff-488c-b14e-bfcdf1aa9344 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:42.099886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-16487ccd-ccff-488c-b14e-bfcdf1aa9344 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:42.181583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-043cca89-1cb0-4aa6-ac9a-fc57f4d8ee9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29e32d5a19fb4da7a1d0947e19729446'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:42.212602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-043cca89-1cb0-4aa6-ac9a-fc57f4d8ee9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29e32d5a19fb4da7a1d0947e19729446'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:42.215793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-043cca89-1cb0-4aa6-ac9a-fc57f4d8ee9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29e32d5a19fb4da7a1d0947e19729446'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:42.239952 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2168/4408] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:41 2022] DELETE /identity/v3/users/29e32d5a19fb4da7a1d0947e19729446 => generated 0 bytes in 974 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:42.242945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cca89-1cb0-4aa6-ac9a-fc57f4d8ee9b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:42.245229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-043cca89-1cb0-4aa6-ac9a-fc57f4d8ee9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:42.292817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16487ccd-ccff-488c-b14e-bfcdf1aa9344 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:42.342526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cca89-1cb0-4aa6-ac9a-fc57f4d8ee9b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:42.349777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea75253-2c07-426f-9979-39355bbc4e1d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:42.351543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea75253-2c07-426f-9979-39355bbc4e1d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:42.357539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea75253-2c07-426f-9979-39355bbc4e1d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:42.357539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea75253-2c07-426f-9979-39355bbc4e1d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/projects/14f73d9f9df742988baa1e53192acb7f/groups/023ab4f93ff2409ebe3654774b8b323c/roles/c8da004e2606443c8f05e1e17f60967d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:42.357539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea75253-2c07-426f-9979-39355bbc4e1d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_grant(project_id=14f73d9f9df742988baa1e53192acb7f, group_id=023ab4f93ff2409ebe3654774b8b323c, role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:42.359366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea75253-2c07-426f-9979-39355bbc4e1d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:42.418355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e488d-4afe-40dd-96ce-76a71cdc033a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:42.419259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e488d-4afe-40dd-96ce-76a71cdc033a service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:42.419740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e488d-4afe-40dd-96ce-76a71cdc033a service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:42.420142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e488d-4afe-40dd-96ce-76a71cdc033a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:42.422189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c36e488d-4afe-40dd-96ce-76a71cdc033a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:42.475176 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2169/4409] 10.222.0.16 () {60 vars in 1485 bytes} [Sat Jul 16 21:21:42 2022] PUT /identity/v3/projects/14f73d9f9df742988baa1e53192acb7f/groups/023ab4f93ff2409ebe3654774b8b323c/roles/c8da004e2606443c8f05e1e17f60967d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:42.479263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea75253-2c07-426f-9979-39355bbc4e1d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:42.561455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e488d-4afe-40dd-96ce-76a71cdc033a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:42.563972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e488d-4afe-40dd-96ce-76a71cdc033a service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:42.592639 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2241/4410] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:21:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:21:42.611259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea75253-2c07-426f-9979-39355bbc4e1d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:42.625713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e5708-20d4-4d70-a4ef-d1d908c8a529 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:42.627725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e5708-20d4-4d70-a4ef-d1d908c8a529 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:42.628012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e5708-20d4-4d70-a4ef-d1d908c8a529 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:42.628427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e5708-20d4-4d70-a4ef-d1d908c8a529 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/projects/14f73d9f9df742988baa1e53192acb7f/groups/023ab4f93ff2409ebe3654774b8b323c/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:42.630662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e5708-20d4-4d70-a4ef-d1d908c8a529 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:list_grants(project_id=14f73d9f9df742988baa1e53192acb7f, group_id=023ab4f93ff2409ebe3654774b8b323c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:42.633496 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-083e5708-20d4-4d70-a4ef-d1d908c8a529 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:42.633496 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:21:42.633496 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:21:42.636179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e5708-20d4-4d70-a4ef-d1d908c8a529 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:42.666904 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2170/4411] 10.222.0.16 () {58 vars in 1367 bytes} [Sat Jul 16 21:21:42 2022] GET /identity/v3/projects/14f73d9f9df742988baa1e53192acb7f/groups/023ab4f93ff2409ebe3654774b8b323c/roles => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:42.667958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e488d-4afe-40dd-96ce-76a71cdc033a service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:42.687919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e488d-4afe-40dd-96ce-76a71cdc033a service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:42.737398 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730c84c-70e2-44a7-9dd7-13e96b9a2948 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:42.738970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730c84c-70e2-44a7-9dd7-13e96b9a2948 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:42.740877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730c84c-70e2-44a7-9dd7-13e96b9a2948 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:42.742806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730c84c-70e2-44a7-9dd7-13e96b9a2948 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/groups/023ab4f93ff2409ebe3654774b8b323c/users/c45754429aec40f096c1463d89f157b2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:42.748734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730c84c-70e2-44a7-9dd7-13e96b9a2948 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=023ab4f93ff2409ebe3654774b8b323c, user_id=c45754429aec40f096c1463d89f157b2)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:42.764328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730c84c-70e2-44a7-9dd7-13e96b9a2948 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:42.921875 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2242/4412] 10.222.0.16 () {60 vars in 1359 bytes} [Sat Jul 16 21:21:42 2022] PUT /identity/v3/groups/023ab4f93ff2409ebe3654774b8b323c/users/c45754429aec40f096c1463d89f157b2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:42.926333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f678fc-bcdc-4bef-8161-7a9b3ea33b38 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:42.926919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f678fc-bcdc-4bef-8161-7a9b3ea33b38 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:42.927377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f678fc-bcdc-4bef-8161-7a9b3ea33b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:43.111345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e3f678fc-bcdc-4bef-8161-7a9b3ea33b38 None None] MFA Rules not processed for user `c45754429aec40f096c1463d89f157b2`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:43.118029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e3f678fc-bcdc-4bef-8161-7a9b3ea33b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:43.417248 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2171/4413] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:43.421526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730c84c-70e2-44a7-9dd7-13e96b9a2948 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:43.692590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730c84c-70e2-44a7-9dd7-13e96b9a2948 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:43.703281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d33e4-64df-4341-adc8-a7e85f6f2e50 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:43.705308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d33e4-64df-4341-adc8-a7e85f6f2e50 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `HEAD` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:43.705987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d33e4-64df-4341-adc8-a7e85f6f2e50 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:43.706463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d33e4-64df-4341-adc8-a7e85f6f2e50 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/projects/14f73d9f9df742988baa1e53192acb7f/groups/023ab4f93ff2409ebe3654774b8b323c/roles/c8da004e2606443c8f05e1e17f60967d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:43.715418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d33e4-64df-4341-adc8-a7e85f6f2e50 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:check_grant(project_id=14f73d9f9df742988baa1e53192acb7f, group_id=023ab4f93ff2409ebe3654774b8b323c, role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:43.725563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d33e4-64df-4341-adc8-a7e85f6f2e50 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:43.739725 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2243/4414] 10.222.0.16 () {58 vars in 1467 bytes} [Sat Jul 16 21:21:43 2022] HEAD /identity/v3/projects/14f73d9f9df742988baa1e53192acb7f/groups/023ab4f93ff2409ebe3654774b8b323c/roles/c8da004e2606443c8f05e1e17f60967d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:43.744299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f678fc-bcdc-4bef-8161-7a9b3ea33b38 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:43.772929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f678fc-bcdc-4bef-8161-7a9b3ea33b38 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:43.788464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b205ea-4c48-4ae4-859a-e4aac1afd3b5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:43.794306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b205ea-4c48-4ae4-859a-e4aac1afd3b5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:43.794306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b205ea-4c48-4ae4-859a-e4aac1afd3b5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:43.794821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b205ea-4c48-4ae4-859a-e4aac1afd3b5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/projects/14f73d9f9df742988baa1e53192acb7f/groups/023ab4f93ff2409ebe3654774b8b323c/roles/c8da004e2606443c8f05e1e17f60967d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:43.807844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b205ea-4c48-4ae4-859a-e4aac1afd3b5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=14f73d9f9df742988baa1e53192acb7f, group_id=023ab4f93ff2409ebe3654774b8b323c, role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:43.816346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b205ea-4c48-4ae4-859a-e4aac1afd3b5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:43.841383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-41b205ea-4c48-4ae4-859a-e4aac1afd3b5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invalidating the token cache because role c8da004e2606443c8f05e1e17f60967d was removed from group 023ab4f93ff2409ebe3654774b8b323c on project 14f73d9f9df742988baa1e53192acb7f. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:43.842217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-41b205ea-4c48-4ae4-859a-e4aac1afd3b5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:43.845573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-41b205ea-4c48-4ae4-859a-e4aac1afd3b5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:43.847513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d33e4-64df-4341-adc8-a7e85f6f2e50 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:43.849609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-901d33e4-64df-4341-adc8-a7e85f6f2e50 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:43.968823 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2172/4415] 10.222.0.16 () {58 vars in 1469 bytes} [Sat Jul 16 21:21:43 2022] DELETE /identity/v3/projects/14f73d9f9df742988baa1e53192acb7f/groups/023ab4f93ff2409ebe3654774b8b323c/roles/c8da004e2606443c8f05e1e17f60967d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:43.975999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:43.976679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b205ea-4c48-4ae4-859a-e4aac1afd3b5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:43.976679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-41b205ea-4c48-4ae4-859a-e4aac1afd3b5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:44.054719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:44.063470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d33e4-64df-4341-adc8-a7e85f6f2e50 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:44.115527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b205ea-4c48-4ae4-859a-e4aac1afd3b5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:44.132210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67c35f-e31b-4b9c-8dfc-3f00fc2e05d5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:44.133364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67c35f-e31b-4b9c-8dfc-3f00fc2e05d5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:44.133654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67c35f-e31b-4b9c-8dfc-3f00fc2e05d5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:44.133985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67c35f-e31b-4b9c-8dfc-3f00fc2e05d5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/groups/023ab4f93ff2409ebe3654774b8b323c/users/c45754429aec40f096c1463d89f157b2` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:44.138787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67c35f-e31b-4b9c-8dfc-3f00fc2e05d5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=023ab4f93ff2409ebe3654774b8b323c, user_id=c45754429aec40f096c1463d89f157b2)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:44.143551 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-0d67c35f-e31b-4b9c-8dfc-3f00fc2e05d5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:44.143551 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:21:44.143551 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:21:44.147244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67c35f-e31b-4b9c-8dfc-3f00fc2e05d5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:44.244161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d8b98-8e41-4675-886b-527286c13045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:44.245590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d8b98-8e41-4675-886b-527286c13045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:44.246299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d8b98-8e41-4675-886b-527286c13045 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:44.246653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d8b98-8e41-4675-886b-527286c13045 admin admin] PATH_INFO: `/v3/projects/ac53481d9830400aae9c5f965341807e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:44.262910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d8b98-8e41-4675-886b-527286c13045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac53481d9830400aae9c5f965341807e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:44.265372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d8b98-8e41-4675-886b-527286c13045 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:44.268039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0d67c35f-e31b-4b9c-8dfc-3f00fc2e05d5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c45754429aec40f096c1463d89f157b2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:44.402582 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2173/4416] 10.222.0.16 () {58 vars in 1343 bytes} [Sat Jul 16 21:21:43 2022] DELETE /identity/v3/groups/023ab4f93ff2409ebe3654774b8b323c/users/c45754429aec40f096c1463d89f157b2 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:44.408834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67c35f-e31b-4b9c-8dfc-3f00fc2e05d5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:44.582472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67c35f-e31b-4b9c-8dfc-3f00fc2e05d5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:44.637479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3c1d8b98-8e41-4675-886b-527286c13045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac53481d9830400aae9c5f965341807e', 'request_id': 'req-3c1d8b98-8e41-4675-886b-527286c13045'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:44.657753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3c1d8b98-8e41-4675-886b-527286c13045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac53481d9830400aae9c5f965341807e', 'request_id': 'req-3c1d8b98-8e41-4675-886b-527286c13045'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:44.678413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3c1d8b98-8e41-4675-886b-527286c13045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac53481d9830400aae9c5f965341807e', 'request_id': 'req-3c1d8b98-8e41-4675-886b-527286c13045'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:44.796881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375e562-ce2a-4f1c-8da7-ba814af398ca tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:44.798471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375e562-ce2a-4f1c-8da7-ba814af398ca tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:44.798923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375e562-ce2a-4f1c-8da7-ba814af398ca tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:44.799236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375e562-ce2a-4f1c-8da7-ba814af398ca tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/system/groups/023ab4f93ff2409ebe3654774b8b323c/roles/c8da004e2606443c8f05e1e17f60967d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:44.802423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375e562-ce2a-4f1c-8da7-ba814af398ca tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=023ab4f93ff2409ebe3654774b8b323c, role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:44.806180 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-5375e562-ce2a-4f1c-8da7-ba814af398ca tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:44.806180 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:21:44.806180 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:21:44.809874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375e562-ce2a-4f1c-8da7-ba814af398ca tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:44.810890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3c1d8b98-8e41-4675-886b-527286c13045 admin admin] The token cache is being invalidate because project ac53481d9830400aae9c5f965341807e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:44.811605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3c1d8b98-8e41-4675-886b-527286c13045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:44.815646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3c1d8b98-8e41-4675-886b-527286c13045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:44.818592 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2244/4417] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:43 2022] DELETE /identity/v3/projects/ac53481d9830400aae9c5f965341807e => generated 0 bytes in 971 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:21:44.823408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38011e5-359c-463f-b96a-6f8fb028d7cd None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:44.823892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38011e5-359c-463f-b96a-6f8fb028d7cd None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:44.824347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38011e5-359c-463f-b96a-6f8fb028d7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:44.876314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d38011e5-359c-463f-b96a-6f8fb028d7cd None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:44.876314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d38011e5-359c-463f-b96a-6f8fb028d7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:44.933168 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2174/4418] 10.222.0.16 () {60 vars in 1380 bytes} [Sat Jul 16 21:21:44 2022] PUT /identity/v3/system/groups/023ab4f93ff2409ebe3654774b8b323c/roles/c8da004e2606443c8f05e1e17f60967d => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:44.936881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375e562-ce2a-4f1c-8da7-ba814af398ca tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:44.938726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5375e562-ce2a-4f1c-8da7-ba814af398ca tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:44.978233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375e562-ce2a-4f1c-8da7-ba814af398ca tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:44.995175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4912c-bec7-43f9-8a81-681a77786bae tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:44.996112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4912c-bec7-43f9-8a81-681a77786bae tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:44.996382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4912c-bec7-43f9-8a81-681a77786bae tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:44.996661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4912c-bec7-43f9-8a81-681a77786bae tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/system/groups/023ab4f93ff2409ebe3654774b8b323c/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:45.000268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4912c-bec7-43f9-8a81-681a77786bae tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=023ab4f93ff2409ebe3654774b8b323c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:45.001546 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-c8d4912c-bec7-43f9-8a81-681a77786bae tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:45.001546 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:21:45.001546 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:21:45.002455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4912c-bec7-43f9-8a81-681a77786bae tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:45.080231 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2175/4419] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Jul 16 21:21:44 2022] GET /identity/v3/system/groups/023ab4f93ff2409ebe3654774b8b323c/roles => generated 376 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:21:45.082053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4912c-bec7-43f9-8a81-681a77786bae tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:45.085566 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2245/4420] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:21:45.087207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cd42d-9ae6-432f-8aef-c579ca8697fa None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:45.088613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cd42d-9ae6-432f-8aef-c579ca8697fa None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:45.089111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cd42d-9ae6-432f-8aef-c579ca8697fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:45.149040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4912c-bec7-43f9-8a81-681a77786bae tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:45.177042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-471cd42d-9ae6-432f-8aef-c579ca8697fa None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:45.180325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc2d46-11f1-4144-aa1d-8b6f1a496b1f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:45.181224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc2d46-11f1-4144-aa1d-8b6f1a496b1f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `HEAD` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:45.181513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc2d46-11f1-4144-aa1d-8b6f1a496b1f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:45.181801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc2d46-11f1-4144-aa1d-8b6f1a496b1f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/system/groups/023ab4f93ff2409ebe3654774b8b323c/roles/c8da004e2606443c8f05e1e17f60967d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:45.186480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-471cd42d-9ae6-432f-8aef-c579ca8697fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:45.196494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc2d46-11f1-4144-aa1d-8b6f1a496b1f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=023ab4f93ff2409ebe3654774b8b323c, role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:45.196991 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-7bcc2d46-11f1-4144-aa1d-8b6f1a496b1f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:45.196991 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:21:45.196991 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:21:45.197904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc2d46-11f1-4144-aa1d-8b6f1a496b1f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:45.223984 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2246/4421] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:45.229997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cd42d-9ae6-432f-8aef-c579ca8697fa None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:45.230550 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2176/4422] 10.222.0.16 () {58 vars in 1362 bytes} [Sat Jul 16 21:21:45 2022] HEAD /identity/v3/system/groups/023ab4f93ff2409ebe3654774b8b323c/roles/c8da004e2606443c8f05e1e17f60967d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:45.236547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc2d46-11f1-4144-aa1d-8b6f1a496b1f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:45.265372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cd42d-9ae6-432f-8aef-c579ca8697fa None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:45.268287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc2d46-11f1-4144-aa1d-8b6f1a496b1f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:45.283403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c49707-d765-4185-8984-11456cea69ad tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:45.284265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c49707-d765-4185-8984-11456cea69ad tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:45.284554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c49707-d765-4185-8984-11456cea69ad tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:45.284845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c49707-d765-4185-8984-11456cea69ad tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/system/groups/023ab4f93ff2409ebe3654774b8b323c/roles/c8da004e2606443c8f05e1e17f60967d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:45.289932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c49707-d765-4185-8984-11456cea69ad tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=023ab4f93ff2409ebe3654774b8b323c, role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:45.290381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef86b4-2056-4e3a-b017-1502c310dd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:45.290983 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-68c49707-d765-4185-8984-11456cea69ad tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:45.290983 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:21:45.290983 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:21:45.294522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c49707-d765-4185-8984-11456cea69ad tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:45.295517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef86b4-2056-4e3a-b017-1502c310dd01 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:45.297258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef86b4-2056-4e3a-b017-1502c310dd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:45.297258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef86b4-2056-4e3a-b017-1502c310dd01 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:45.297258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef86b4-2056-4e3a-b017-1502c310dd01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:21:45.301822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef86b4-2056-4e3a-b017-1502c310dd01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:45.303730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef86b4-2056-4e3a-b017-1502c310dd01 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:45.346385 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2247/4423] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:45.347438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef86b4-2056-4e3a-b017-1502c310dd01 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:45.370847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef86b4-2056-4e3a-b017-1502c310dd01 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:45.375471 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2177/4424] 10.222.0.16 () {58 vars in 1364 bytes} [Sat Jul 16 21:21:45 2022] DELETE /identity/v3/system/groups/023ab4f93ff2409ebe3654774b8b323c/roles/c8da004e2606443c8f05e1e17f60967d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:45.386753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c49707-d765-4185-8984-11456cea69ad tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:45.387089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff07d8-b81b-4048-a28a-1548f5edbd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:45.388368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff07d8-b81b-4048-a28a-1548f5edbd06 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:45.388728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff07d8-b81b-4048-a28a-1548f5edbd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:45.389137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff07d8-b81b-4048-a28a-1548f5edbd06 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:45.389712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff07d8-b81b-4048-a28a-1548f5edbd06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:45.394014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff07d8-b81b-4048-a28a-1548f5edbd06 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:45.397380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c49707-d765-4185-8984-11456cea69ad tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:45.423198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8e90c-2b1d-4b24-a9a0-8eaa2e320085 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:45.427042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8e90c-2b1d-4b24-a9a0-8eaa2e320085 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:45.428764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8e90c-2b1d-4b24-a9a0-8eaa2e320085 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:45.430793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8e90c-2b1d-4b24-a9a0-8eaa2e320085 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/domains/2e571cc5fa7d423b9fa0c96e61964ccc/users/c45754429aec40f096c1463d89f157b2/roles/c8da004e2606443c8f05e1e17f60967d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:45.442874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8e90c-2b1d-4b24-a9a0-8eaa2e320085 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2e571cc5fa7d423b9fa0c96e61964ccc, user_id=c45754429aec40f096c1463d89f157b2, role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:45.468931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8e90c-2b1d-4b24-a9a0-8eaa2e320085 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:45.638733 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2248/4425] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:21:45 2022] POST /identity/v3/projects => generated 385 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:45.639728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff07d8-b81b-4048-a28a-1548f5edbd06 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:45.644084 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2178/4426] 10.222.0.16 () {60 vars in 1479 bytes} [Sat Jul 16 21:21:45 2022] PUT /identity/v3/domains/2e571cc5fa7d423b9fa0c96e61964ccc/users/c45754429aec40f096c1463d89f157b2/roles/c8da004e2606443c8f05e1e17f60967d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:45.652896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8e90c-2b1d-4b24-a9a0-8eaa2e320085 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:45.780507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff07d8-b81b-4048-a28a-1548f5edbd06 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:45.800660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b2cbc-e594-4973-953e-b09c94251ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:45.801412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b2cbc-e594-4973-953e-b09c94251ccb admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:45.801709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b2cbc-e594-4973-953e-b09c94251ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:45.802003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b2cbc-e594-4973-953e-b09c94251ccb admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:45.805203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b2cbc-e594-4973-953e-b09c94251ccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:45.813226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b2cbc-e594-4973-953e-b09c94251ccb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:45.821241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:45.873105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8e90c-2b1d-4b24-a9a0-8eaa2e320085 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:45.965813 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2249/4427] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:21:45 2022] POST /identity/v3/users => generated 293 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:45.971516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b2cbc-e594-4973-953e-b09c94251ccb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:45.995944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b2cbc-e594-4973-953e-b09c94251ccb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:46.021990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6115f-9153-41a0-a66a-d5b60d6d3100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:46.022713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6115f-9153-41a0-a66a-d5b60d6d3100 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:46.022972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6115f-9153-41a0-a66a-d5b60d6d3100 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:46.023345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6115f-9153-41a0-a66a-d5b60d6d3100 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:46.027801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6115f-9153-41a0-a66a-d5b60d6d3100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:46.034659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6115f-9153-41a0-a66a-d5b60d6d3100 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:46.064375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d5061-cad2-492a-af6b-37c428f9d973 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:46.066330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d5061-cad2-492a-af6b-37c428f9d973 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:46.067321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d5061-cad2-492a-af6b-37c428f9d973 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:46.071181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d5061-cad2-492a-af6b-37c428f9d973 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/domains/2e571cc5fa7d423b9fa0c96e61964ccc/users/c45754429aec40f096c1463d89f157b2/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:46.072014 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2250/4428] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:45 2022] GET /identity/v3/roles => generated 2322 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:46.072677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6115f-9153-41a0-a66a-d5b60d6d3100 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:46.073110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d5061-cad2-492a-af6b-37c428f9d973 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=2e571cc5fa7d423b9fa0c96e61964ccc, user_id=c45754429aec40f096c1463d89f157b2)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:46.081485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d5061-cad2-492a-af6b-37c428f9d973 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:46.109538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6115f-9153-41a0-a66a-d5b60d6d3100 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:46.117549 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2179/4429] 10.222.0.16 () {58 vars in 1361 bytes} [Sat Jul 16 21:21:45 2022] GET /identity/v3/domains/2e571cc5fa7d423b9fa0c96e61964ccc/users/c45754429aec40f096c1463d89f157b2/roles => generated 409 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:46.118555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d5061-cad2-492a-af6b-37c428f9d973 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:46.123789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ad975-b3d0-4249-a950-d05e88a0dc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:46.124433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ad975-b3d0-4249-a950-d05e88a0dc93 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:46.124720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ad975-b3d0-4249-a950-d05e88a0dc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:46.125077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ad975-b3d0-4249-a950-d05e88a0dc93 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:46.130251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ad975-b3d0-4249-a950-d05e88a0dc93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:46.133941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ad975-b3d0-4249-a950-d05e88a0dc93 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:46.145758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d5061-cad2-492a-af6b-37c428f9d973 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:46.160776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:46.168908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13648e9a-2fc6-483d-a811-1db15696819e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:46.171324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13648e9a-2fc6-483d-a811-1db15696819e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `HEAD` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:46.171648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13648e9a-2fc6-483d-a811-1db15696819e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:46.171937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13648e9a-2fc6-483d-a811-1db15696819e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/domains/2e571cc5fa7d423b9fa0c96e61964ccc/users/c45754429aec40f096c1463d89f157b2/roles/c8da004e2606443c8f05e1e17f60967d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:46.179406 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2251/4430] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:46 2022] GET /identity/v3/roles => generated 2322 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:46.181325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ad975-b3d0-4249-a950-d05e88a0dc93 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:46.182292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13648e9a-2fc6-483d-a811-1db15696819e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=2e571cc5fa7d423b9fa0c96e61964ccc, user_id=c45754429aec40f096c1463d89f157b2, role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:46.183473 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-13648e9a-2fc6-483d-a811-1db15696819e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:46.183473 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:21:46.183473 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:21:46.191149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13648e9a-2fc6-483d-a811-1db15696819e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:46.203433 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2180/4431] 10.222.0.16 () {58 vars in 1461 bytes} [Sat Jul 16 21:21:46 2022] HEAD /identity/v3/domains/2e571cc5fa7d423b9fa0c96e61964ccc/users/c45754429aec40f096c1463d89f157b2/roles/c8da004e2606443c8f05e1e17f60967d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:21:46.205332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ad975-b3d0-4249-a950-d05e88a0dc93 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:46.207916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13648e9a-2fc6-483d-a811-1db15696819e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:46.232122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486d4a8-45ad-4693-815b-c71eb75ae9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:46.233433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13648e9a-2fc6-483d-a811-1db15696819e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:46.234742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486d4a8-45ad-4693-815b-c71eb75ae9c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:46.238816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486d4a8-45ad-4693-815b-c71eb75ae9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:46.240635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2cb6e-fb8e-4bb4-8223-15391d26f791 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:46.241026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486d4a8-45ad-4693-815b-c71eb75ae9c7 admin admin] PATH_INFO: `/v3/projects/3179b826526f4fbdbbff66fbf50931ca/users/e062ffc134634356afc2a92605af963c/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:46.241540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2cb6e-fb8e-4bb4-8223-15391d26f791 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:46.242065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2cb6e-fb8e-4bb4-8223-15391d26f791 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:46.242194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2cb6e-fb8e-4bb4-8223-15391d26f791 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/domains/2e571cc5fa7d423b9fa0c96e61964ccc/users/c45754429aec40f096c1463d89f157b2/roles/c8da004e2606443c8f05e1e17f60967d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:46.245194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2cb6e-fb8e-4bb4-8223-15391d26f791 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2e571cc5fa7d423b9fa0c96e61964ccc, user_id=c45754429aec40f096c1463d89f157b2, role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:46.252086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2cb6e-fb8e-4bb4-8223-15391d26f791 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:46.273665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1aa2cb6e-fb8e-4bb4-8223-15391d26f791 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invalidating the token cache because role c8da004e2606443c8f05e1e17f60967d was removed from user c45754429aec40f096c1463d89f157b2 on domain 2e571cc5fa7d423b9fa0c96e61964ccc. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:46.273977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1aa2cb6e-fb8e-4bb4-8223-15391d26f791 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:46.274768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1aa2cb6e-fb8e-4bb4-8223-15391d26f791 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:46.289595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486d4a8-45ad-4693-815b-c71eb75ae9c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3179b826526f4fbdbbff66fbf50931ca, user_id=e062ffc134634356afc2a92605af963c, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:46.294597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486d4a8-45ad-4693-815b-c71eb75ae9c7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:46.413234 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2181/4432] 10.222.0.16 () {58 vars in 1463 bytes} [Sat Jul 16 21:21:46 2022] DELETE /identity/v3/domains/2e571cc5fa7d423b9fa0c96e61964ccc/users/c45754429aec40f096c1463d89f157b2/roles/c8da004e2606443c8f05e1e17f60967d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:21:46.418612 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2252/4433] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:46 2022] PUT /identity/v3/projects/3179b826526f4fbdbbff66fbf50931ca/users/e062ffc134634356afc2a92605af963c/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:46.432659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2cb6e-fb8e-4bb4-8223-15391d26f791 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:46.438302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546a813-7c04-41e8-a78a-6ad9820da8f4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:46.438597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546a813-7c04-41e8-a78a-6ad9820da8f4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:46.440739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546a813-7c04-41e8-a78a-6ad9820da8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:46.444033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1aa2cb6e-fb8e-4bb4-8223-15391d26f791 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:46.656065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1546a813-7c04-41e8-a78a-6ad9820da8f4 None None] MFA Rules not processed for user `e062ffc134634356afc2a92605af963c`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:46.658108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1546a813-7c04-41e8-a78a-6ad9820da8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:46.681335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2cb6e-fb8e-4bb4-8223-15391d26f791 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:46.702277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657f729-ae64-4358-9205-05368a67f9f5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:46.704295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657f729-ae64-4358-9205-05368a67f9f5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:46.706239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657f729-ae64-4358-9205-05368a67f9f5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:46.706824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657f729-ae64-4358-9205-05368a67f9f5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/projects/14f73d9f9df742988baa1e53192acb7f/users/c45754429aec40f096c1463d89f157b2/roles/c8da004e2606443c8f05e1e17f60967d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:46.718961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657f729-ae64-4358-9205-05368a67f9f5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_grant(project_id=14f73d9f9df742988baa1e53192acb7f, user_id=c45754429aec40f096c1463d89f157b2, role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:46.723215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657f729-ae64-4358-9205-05368a67f9f5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:46.874685 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2182/4434] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:46 2022] PUT /identity/v3/projects/14f73d9f9df742988baa1e53192acb7f/users/c45754429aec40f096c1463d89f157b2/roles/c8da004e2606443c8f05e1e17f60967d => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:46.875780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657f729-ae64-4358-9205-05368a67f9f5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:47.053971 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2253/4435] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 620 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:47.058424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546a813-7c04-41e8-a78a-6ad9820da8f4 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:47.059935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1546a813-7c04-41e8-a78a-6ad9820da8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:47.160474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657f729-ae64-4358-9205-05368a67f9f5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:47.174080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f8bd0-85cc-438f-a0fb-8a814cb6e1c8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:47.175317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f8bd0-85cc-438f-a0fb-8a814cb6e1c8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:47.175722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f8bd0-85cc-438f-a0fb-8a814cb6e1c8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:47.176183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f8bd0-85cc-438f-a0fb-8a814cb6e1c8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/projects/14f73d9f9df742988baa1e53192acb7f/users/c45754429aec40f096c1463d89f157b2/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:47.181723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f8bd0-85cc-438f-a0fb-8a814cb6e1c8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:list_grants(project_id=14f73d9f9df742988baa1e53192acb7f, user_id=c45754429aec40f096c1463d89f157b2)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:47.188431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f8bd0-85cc-438f-a0fb-8a814cb6e1c8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:47.224088 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2183/4436] 10.222.0.16 () {58 vars in 1364 bytes} [Sat Jul 16 21:21:46 2022] GET /identity/v3/projects/14f73d9f9df742988baa1e53192acb7f/users/c45754429aec40f096c1463d89f157b2/roles => generated 410 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:47.225705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f8bd0-85cc-438f-a0fb-8a814cb6e1c8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:47.272462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f8bd0-85cc-438f-a0fb-8a814cb6e1c8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:47.279291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546a813-7c04-41e8-a78a-6ad9820da8f4 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:47.294235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421a3df-005c-49dc-be91-eb9f122d86b3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:47.296309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421a3df-005c-49dc-be91-eb9f122d86b3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `HEAD` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:47.299832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421a3df-005c-49dc-be91-eb9f122d86b3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:47.300404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421a3df-005c-49dc-be91-eb9f122d86b3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/projects/14f73d9f9df742988baa1e53192acb7f/users/c45754429aec40f096c1463d89f157b2/roles/c8da004e2606443c8f05e1e17f60967d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:47.311324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421a3df-005c-49dc-be91-eb9f122d86b3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:check_grant(project_id=14f73d9f9df742988baa1e53192acb7f, user_id=c45754429aec40f096c1463d89f157b2, role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:47.321286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421a3df-005c-49dc-be91-eb9f122d86b3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:47.351054 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2184/4437] 10.222.0.16 () {58 vars in 1464 bytes} [Sat Jul 16 21:21:47 2022] HEAD /identity/v3/projects/14f73d9f9df742988baa1e53192acb7f/users/c45754429aec40f096c1463d89f157b2/roles/c8da004e2606443c8f05e1e17f60967d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:47.352462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421a3df-005c-49dc-be91-eb9f122d86b3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:47.393005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421a3df-005c-49dc-be91-eb9f122d86b3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:47.408583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36001d-8ffd-464c-8200-76649968ffab tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:47.409668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36001d-8ffd-464c-8200-76649968ffab tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:47.410074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36001d-8ffd-464c-8200-76649968ffab tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:47.410606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36001d-8ffd-464c-8200-76649968ffab tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/projects/14f73d9f9df742988baa1e53192acb7f/users/c45754429aec40f096c1463d89f157b2/roles/c8da004e2606443c8f05e1e17f60967d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:47.418360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36001d-8ffd-464c-8200-76649968ffab tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=14f73d9f9df742988baa1e53192acb7f, user_id=c45754429aec40f096c1463d89f157b2, role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:47.425010 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36001d-8ffd-464c-8200-76649968ffab tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:47.434453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd2d9a-bb51-4e1b-a4f2-a1414a55f7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:47.435278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd2d9a-bb51-4e1b-a4f2-a1414a55f7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:47.435563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd2d9a-bb51-4e1b-a4f2-a1414a55f7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:47.436072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd2d9a-bb51-4e1b-a4f2-a1414a55f7d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:47.436838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd2d9a-bb51-4e1b-a4f2-a1414a55f7d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:47.447997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cd36001d-8ffd-464c-8200-76649968ffab tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invalidating the token cache because role c8da004e2606443c8f05e1e17f60967d was removed from user c45754429aec40f096c1463d89f157b2 on project 14f73d9f9df742988baa1e53192acb7f. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:47.447997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cd36001d-8ffd-464c-8200-76649968ffab tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:47.448226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd2d9a-bb51-4e1b-a4f2-a1414a55f7d3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:47.448341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cd36001d-8ffd-464c-8200-76649968ffab tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:47.546537 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2185/4438] 10.222.0.16 () {58 vars in 1466 bytes} [Sat Jul 16 21:21:47 2022] DELETE /identity/v3/projects/14f73d9f9df742988baa1e53192acb7f/users/c45754429aec40f096c1463d89f157b2/roles/c8da004e2606443c8f05e1e17f60967d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:47.552958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36001d-8ffd-464c-8200-76649968ffab tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:47.557713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cd36001d-8ffd-464c-8200-76649968ffab tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:47.640088 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2254/4439] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:21:47 2022] POST /identity/v3/projects => generated 385 bytes in 582 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:47.643911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd2d9a-bb51-4e1b-a4f2-a1414a55f7d3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:47.646279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-91bd2d9a-bb51-4e1b-a4f2-a1414a55f7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:47.772470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:47.850412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36001d-8ffd-464c-8200-76649968ffab tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:47.971571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd2d9a-bb51-4e1b-a4f2-a1414a55f7d3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:47.977321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a4472-b7f7-4308-9e93-c09e475a1780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:47.978006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a4472-b7f7-4308-9e93-c09e475a1780 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:47.978321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a4472-b7f7-4308-9e93-c09e475a1780 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:47.978601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a4472-b7f7-4308-9e93-c09e475a1780 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:47.979470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a4472-b7f7-4308-9e93-c09e475a1780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:47.982724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a4472-b7f7-4308-9e93-c09e475a1780 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:48.033654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ebb0c-6bc3-4765-b637-cc4536c58cae tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:48.037032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ebb0c-6bc3-4765-b637-cc4536c58cae tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:48.037327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ebb0c-6bc3-4765-b637-cc4536c58cae tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:48.037675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ebb0c-6bc3-4765-b637-cc4536c58cae tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/system/users/c45754429aec40f096c1463d89f157b2/roles/c8da004e2606443c8f05e1e17f60967d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:48.043413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ebb0c-6bc3-4765-b637-cc4536c58cae tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c45754429aec40f096c1463d89f157b2, role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:48.044526 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-f40ebb0c-6bc3-4765-b637-cc4536c58cae tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:48.044526 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:21:48.044526 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:21:48.050880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ebb0c-6bc3-4765-b637-cc4536c58cae tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:48.092028 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2255/4440] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:21:47 2022] POST /identity/v3/users => generated 293 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:48.093442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd269f-9afb-45d7-b423-f7a6bf63f27b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:48.093786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd269f-9afb-45d7-b423-f7a6bf63f27b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:48.095430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd269f-9afb-45d7-b423-f7a6bf63f27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:48.182458 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2186/4441] 10.222.0.16 () {60 vars in 1377 bytes} [Sat Jul 16 21:21:47 2022] PUT /identity/v3/system/users/c45754429aec40f096c1463d89f157b2/roles/c8da004e2606443c8f05e1e17f60967d => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:48.183919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ebb0c-6bc3-4765-b637-cc4536c58cae tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:48.195591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1bfd269f-9afb-45d7-b423-f7a6bf63f27b None None] MFA Rules not processed for user `6f2e974ab5aa48dfb4b00f810dcedb63`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:48.197067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1bfd269f-9afb-45d7-b423-f7a6bf63f27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:48.204685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ebb0c-6bc3-4765-b637-cc4536c58cae tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:48.220722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26353d-38be-4077-966b-d6407fcb7606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:48.221941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26353d-38be-4077-966b-d6407fcb7606 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:48.223332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26353d-38be-4077-966b-d6407fcb7606 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:48.224422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26353d-38be-4077-966b-d6407fcb7606 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:48.229259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26353d-38be-4077-966b-d6407fcb7606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:48.234635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26353d-38be-4077-966b-d6407fcb7606 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:48.275359 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2187/4442] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:48 2022] GET /identity/v3/roles => generated 2322 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:48.277846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26353d-38be-4077-966b-d6407fcb7606 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:48.311749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26353d-38be-4077-966b-d6407fcb7606 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:48.326356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3793b3-09c8-403e-8a07-6a7ec23eed06 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:48.327429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3793b3-09c8-403e-8a07-6a7ec23eed06 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:48.329426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3793b3-09c8-403e-8a07-6a7ec23eed06 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:48.329859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3793b3-09c8-403e-8a07-6a7ec23eed06 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/system/users/c45754429aec40f096c1463d89f157b2/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:48.334777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3793b3-09c8-403e-8a07-6a7ec23eed06 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=c45754429aec40f096c1463d89f157b2)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:48.336154 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-9d3793b3-09c8-403e-8a07-6a7ec23eed06 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:48.336154 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:21:48.336154 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:21:48.338563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3793b3-09c8-403e-8a07-6a7ec23eed06 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:48.377255 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2188/4443] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Jul 16 21:21:48 2022] GET /identity/v3/system/users/c45754429aec40f096c1463d89f157b2/roles => generated 375 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:48.378449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3793b3-09c8-403e-8a07-6a7ec23eed06 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:48.406726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3793b3-09c8-403e-8a07-6a7ec23eed06 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:48.431261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b69a7c-0140-46f1-b0bc-2c8d30501149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:48.431261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b69a7c-0140-46f1-b0bc-2c8d30501149 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:48.431261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b69a7c-0140-46f1-b0bc-2c8d30501149 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:48.431261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b69a7c-0140-46f1-b0bc-2c8d30501149 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:48.431936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b69a7c-0140-46f1-b0bc-2c8d30501149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:48.431936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b69a7c-0140-46f1-b0bc-2c8d30501149 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:48.445185 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2256/4444] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:48.447767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd269f-9afb-45d7-b423-f7a6bf63f27b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:48.463535 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2189/4445] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:48 2022] GET /identity/v3/roles => generated 2322 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:48.467509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aac5dd-f2a3-463e-8023-641d0578b194 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:48.467877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aac5dd-f2a3-463e-8023-641d0578b194 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:48.468232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aac5dd-f2a3-463e-8023-641d0578b194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:48.505147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd269f-9afb-45d7-b423-f7a6bf63f27b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:48.514010 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-64aac5dd-f2a3-463e-8023-641d0578b194 None None] MFA Rules not processed for user `6f2e974ab5aa48dfb4b00f810dcedb63`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:48.520069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-64aac5dd-f2a3-463e-8023-641d0578b194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:48.541102 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2190/4446] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:48.542186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbad8ce-f848-430a-b027-95490305e782 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:48.543682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbad8ce-f848-430a-b027-95490305e782 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `HEAD` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:48.544160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbad8ce-f848-430a-b027-95490305e782 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:48.544338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aac5dd-f2a3-463e-8023-641d0578b194 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:48.544794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbad8ce-f848-430a-b027-95490305e782 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/system/users/c45754429aec40f096c1463d89f157b2/roles/c8da004e2606443c8f05e1e17f60967d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:48.550660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbad8ce-f848-430a-b027-95490305e782 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=c45754429aec40f096c1463d89f157b2, role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:48.552062 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-acbad8ce-f848-430a-b027-95490305e782 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:48.552062 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:21:48.552062 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:21:48.554329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbad8ce-f848-430a-b027-95490305e782 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:48.575345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aac5dd-f2a3-463e-8023-641d0578b194 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:48.581735 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2257/4447] 10.222.0.16 () {58 vars in 1359 bytes} [Sat Jul 16 21:21:48 2022] HEAD /identity/v3/system/users/c45754429aec40f096c1463d89f157b2/roles/c8da004e2606443c8f05e1e17f60967d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:48.588551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbad8ce-f848-430a-b027-95490305e782 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:48.589017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccca20-1f4c-41cb-b826-8289d81b31c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:48.592560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccca20-1f4c-41cb-b826-8289d81b31c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:48.593000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccca20-1f4c-41cb-b826-8289d81b31c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:48.597114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccca20-1f4c-41cb-b826-8289d81b31c0 admin admin] PATH_INFO: `/v3/projects/06aaa4c6d3394bff9d653079a97983b0/users/07fe756dfe054b43abcfdf12c5442b64/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:48.636108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ccca20-1f4c-41cb-b826-8289d81b31c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06aaa4c6d3394bff9d653079a97983b0, user_id=07fe756dfe054b43abcfdf12c5442b64, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:48.638809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbad8ce-f848-430a-b027-95490305e782 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:48.639537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ccca20-1f4c-41cb-b826-8289d81b31c0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:48.668433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814573ef-93d6-499a-a389-858791176f61 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:48.669304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814573ef-93d6-499a-a389-858791176f61 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:48.669789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814573ef-93d6-499a-a389-858791176f61 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:48.670218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814573ef-93d6-499a-a389-858791176f61 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/system/users/c45754429aec40f096c1463d89f157b2/roles/c8da004e2606443c8f05e1e17f60967d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:48.690120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814573ef-93d6-499a-a389-858791176f61 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=c45754429aec40f096c1463d89f157b2, role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:48.694352 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-814573ef-93d6-499a-a389-858791176f61 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:48.694352 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:21:48.694352 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:21:48.698528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814573ef-93d6-499a-a389-858791176f61 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:48.754411 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2191/4448] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:21:48 2022] PUT /identity/v3/projects/06aaa4c6d3394bff9d653079a97983b0/users/07fe756dfe054b43abcfdf12c5442b64/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:48.767884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15868b-435f-4558-9d28-afb67186419e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:48.768737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15868b-435f-4558-9d28-afb67186419e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:48.768929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15868b-435f-4558-9d28-afb67186419e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:48.805006 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2258/4449] 10.222.0.16 () {58 vars in 1361 bytes} [Sat Jul 16 21:21:48 2022] DELETE /identity/v3/system/users/c45754429aec40f096c1463d89f157b2/roles/c8da004e2606443c8f05e1e17f60967d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:48.811422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814573ef-93d6-499a-a389-858791176f61 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:48.837117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8c15868b-435f-4558-9d28-afb67186419e None None] MFA Rules not processed for user `07fe756dfe054b43abcfdf12c5442b64`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:48.838667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8c15868b-435f-4558-9d28-afb67186419e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:48.853895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814573ef-93d6-499a-a389-858791176f61 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:49.035528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:49.067046 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2192/4450] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:21:49.082466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15868b-435f-4558-9d28-afb67186419e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:49.085540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8c15868b-435f-4558-9d28-afb67186419e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:49.113404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:49.118501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c521f-f4f9-4d0c-a6d7-b499018fb1f3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:49.119283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c521f-f4f9-4d0c-a6d7-b499018fb1f3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:49.121868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c521f-f4f9-4d0c-a6d7-b499018fb1f3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:49.123496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c521f-f4f9-4d0c-a6d7-b499018fb1f3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:49.126329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c521f-f4f9-4d0c-a6d7-b499018fb1f3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:49.130613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c521f-f4f9-4d0c-a6d7-b499018fb1f3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:49.246930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15868b-435f-4558-9d28-afb67186419e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:49.259443 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2259/4451] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:21:48 2022] POST /identity/v3/roles => generated 270 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:49.261899 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793092b-83ad-4e21-af35-08c50c62210f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:49.262745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793092b-83ad-4e21-af35-08c50c62210f service glance] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:49.263243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793092b-83ad-4e21-af35-08c50c62210f service glance] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:49.263680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793092b-83ad-4e21-af35-08c50c62210f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:49.265939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a793092b-83ad-4e21-af35-08c50c62210f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:49.269002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c521f-f4f9-4d0c-a6d7-b499018fb1f3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:49.295431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c521f-f4f9-4d0c-a6d7-b499018fb1f3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:49.310623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25544a24-279e-4392-b99d-33df1adcad54 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:49.311349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25544a24-279e-4392-b99d-33df1adcad54 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:49.311641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25544a24-279e-4392-b99d-33df1adcad54 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:49.311925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25544a24-279e-4392-b99d-33df1adcad54 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:49.312687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25544a24-279e-4392-b99d-33df1adcad54 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:49.315048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25544a24-279e-4392-b99d-33df1adcad54 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:49.423194 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2260/4452] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:21:49 2022] POST /identity/v3/roles => generated 270 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:49.423919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25544a24-279e-4392-b99d-33df1adcad54 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:49.431977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-25544a24-279e-4392-b99d-33df1adcad54 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:49.441855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793092b-83ad-4e21-af35-08c50c62210f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:49.445037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793092b-83ad-4e21-af35-08c50c62210f service glance] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:49.485372 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2193/4453] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:21:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:21:49.487728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793092b-83ad-4e21-af35-08c50c62210f service glance] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:49.524487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793092b-83ad-4e21-af35-08c50c62210f service glance] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:49.536428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d97d8-5248-4bfd-bfab-d0aa45d6c036 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:49.541901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d97d8-5248-4bfd-bfab-d0aa45d6c036 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:49.543669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d97d8-5248-4bfd-bfab-d0aa45d6c036 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:49.546489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d97d8-5248-4bfd-bfab-d0aa45d6c036 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/5e8c8527f62b43acbaf645ee6fc029b1/implies/48c2802bf87f4d5cb3a5eba4923bdeb3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:49.551463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d97d8-5248-4bfd-bfab-d0aa45d6c036 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5e8c8527f62b43acbaf645ee6fc029b1, implied_role_id=48c2802bf87f4d5cb3a5eba4923bdeb3)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:49.553976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d97d8-5248-4bfd-bfab-d0aa45d6c036 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:49.624445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25544a24-279e-4392-b99d-33df1adcad54 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:49.632480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468466b-5af8-463e-b596-e4e9594374dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:49.635510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468466b-5af8-463e-b596-e4e9594374dd service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:49.635510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468466b-5af8-463e-b596-e4e9594374dd service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:49.635510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468466b-5af8-463e-b596-e4e9594374dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:49.722000 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2194/4454] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Jul 16 21:21:49 2022] PUT /identity/v3/roles/5e8c8527f62b43acbaf645ee6fc029b1/implies/48c2802bf87f4d5cb3a5eba4923bdeb3 => generated 531 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:49.726110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d97d8-5248-4bfd-bfab-d0aa45d6c036 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:49.838866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468466b-5af8-463e-b596-e4e9594374dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:49.849519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468466b-5af8-463e-b596-e4e9594374dd service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:49.903046 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2261/4455] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:21:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:21:49.972436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d97d8-5248-4bfd-bfab-d0aa45d6c036 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:50.000364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63e18f-4cfb-479c-a2a7-715586c5b2cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:50.004829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63e18f-4cfb-479c-a2a7-715586c5b2cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:50.006377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63e18f-4cfb-479c-a2a7-715586c5b2cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:50.008861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63e18f-4cfb-479c-a2a7-715586c5b2cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:50.010823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63e18f-4cfb-479c-a2a7-715586c5b2cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:50.019428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63e18f-4cfb-479c-a2a7-715586c5b2cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:50.179744 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2195/4456] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:21:49 2022] POST /identity/v3/domains => generated 274 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:50.181903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468466b-5af8-463e-b596-e4e9594374dd service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:50.220668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63e18f-4cfb-479c-a2a7-715586c5b2cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:50.223358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468466b-5af8-463e-b596-e4e9594374dd service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:50.396852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63e18f-4cfb-479c-a2a7-715586c5b2cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:50.401419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:50.414880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4515e-7743-4832-bac0-ad3aeec4526e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:50.415740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4515e-7743-4832-bac0-ad3aeec4526e service glance] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:50.416037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4515e-7743-4832-bac0-ad3aeec4526e service glance] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:50.416382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4515e-7743-4832-bac0-ad3aeec4526e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:50.467935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca00668-587e-433a-8d54-f4c8ea0cf313 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:50.477076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca00668-587e-433a-8d54-f4c8ea0cf313 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:50.479077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca00668-587e-433a-8d54-f4c8ea0cf313 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:50.481617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca00668-587e-433a-8d54-f4c8ea0cf313 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:50.486088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca00668-587e-433a-8d54-f4c8ea0cf313 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:50.495385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca00668-587e-433a-8d54-f4c8ea0cf313 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:50.532811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4515e-7743-4832-bac0-ad3aeec4526e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:50.536265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4515e-7743-4832-bac0-ad3aeec4526e service glance] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:50.561139 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2196/4457] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:21:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:21:50.609356 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2262/4458] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:21:50 2022] POST /identity/v3/roles => generated 269 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:50.610496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4515e-7743-4832-bac0-ad3aeec4526e service glance] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:50.642798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4515e-7743-4832-bac0-ad3aeec4526e service glance] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:50.674048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a0548-68ba-47d7-9f36-ca989b6cab20 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:50.676096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a0548-68ba-47d7-9f36-ca989b6cab20 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:50.678631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a0548-68ba-47d7-9f36-ca989b6cab20 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:50.678936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a0548-68ba-47d7-9f36-ca989b6cab20 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/5e8c8527f62b43acbaf645ee6fc029b1/implies/17f05916d8c548cf9c7bd6f4c5890249` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:50.685832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a0548-68ba-47d7-9f36-ca989b6cab20 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5e8c8527f62b43acbaf645ee6fc029b1, implied_role_id=17f05916d8c548cf9c7bd6f4c5890249)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:50.688502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a0548-68ba-47d7-9f36-ca989b6cab20 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:50.901290 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2197/4459] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Jul 16 21:21:50 2022] PUT /identity/v3/roles/5e8c8527f62b43acbaf645ee6fc029b1/implies/17f05916d8c548cf9c7bd6f4c5890249 => generated 530 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:50.905578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca00668-587e-433a-8d54-f4c8ea0cf313 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:50.925620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca00668-587e-433a-8d54-f4c8ea0cf313 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:51.053244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:51.101001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09109807-16a4-4532-a0e0-53267afe24b1 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:51.102794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09109807-16a4-4532-a0e0-53267afe24b1 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:51.103140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09109807-16a4-4532-a0e0-53267afe24b1 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:51.103397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09109807-16a4-4532-a0e0-53267afe24b1 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/5e8c8527f62b43acbaf645ee6fc029b1/implies/c8da004e2606443c8f05e1e17f60967d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:51.139134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09109807-16a4-4532-a0e0-53267afe24b1 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5e8c8527f62b43acbaf645ee6fc029b1, implied_role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:51.140425 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-09109807-16a4-4532-a0e0-53267afe24b1 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:51.140425 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:21:51.140425 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:21:51.156114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09109807-16a4-4532-a0e0-53267afe24b1 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:51.291598 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2263/4460] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Jul 16 21:21:50 2022] PUT /identity/v3/roles/5e8c8527f62b43acbaf645ee6fc029b1/implies/c8da004e2606443c8f05e1e17f60967d => generated 526 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:51.295868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a0548-68ba-47d7-9f36-ca989b6cab20 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:51.312591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a0548-68ba-47d7-9f36-ca989b6cab20 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:51.468947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26996ed4-6917-48e9-a56b-31a9b238a08c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:51.469947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26996ed4-6917-48e9-a56b-31a9b238a08c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:51.470347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26996ed4-6917-48e9-a56b-31a9b238a08c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:51.470692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26996ed4-6917-48e9-a56b-31a9b238a08c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c8da004e2606443c8f05e1e17f60967d/implies/5e8c8527f62b43acbaf645ee6fc029b1` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:51.473740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26996ed4-6917-48e9-a56b-31a9b238a08c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c8da004e2606443c8f05e1e17f60967d, implied_role_id=5e8c8527f62b43acbaf645ee6fc029b1)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:51.477785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26996ed4-6917-48e9-a56b-31a9b238a08c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:51.554909 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-26996ed4-6917-48e9-a56b-31a9b238a08c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] 5e8c8527f62b43acbaf645ee6fc029b1 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 5e8c8527f62b43acbaf645ee6fc029b1 cannot be an implied roles. Jul 16 21:21:51.554909 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:51.554909 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:21:51.554909 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:21:51.554909 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:21:51.554909 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:21:51.554909 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:21:51.554909 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:21:51.554909 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:21:51.554909 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:21:51.554909 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:21:51.554909 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:21:51.554909 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Jul 16 21:21:51.554909 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Jul 16 21:21:51.556207 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:21:51.556207 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:21:51.556207 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Jul 16 21:21:51.556207 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Jul 16 21:21:51.556207 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 5e8c8527f62b43acbaf645ee6fc029b1 cannot be an implied roles. Jul 16 21:21:51.556207 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:21:51.557865 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2198/4461] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Jul 16 21:21:51 2022] PUT /identity/v3/roles/c8da004e2606443c8f05e1e17f60967d/implies/5e8c8527f62b43acbaf645ee6fc029b1 => generated 116 bytes in 262 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:21:51.561023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09109807-16a4-4532-a0e0-53267afe24b1 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:51.585488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09109807-16a4-4532-a0e0-53267afe24b1 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:51.600038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995e456-b8fe-4d20-b12e-685ed9e7bdcd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:51.600038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995e456-b8fe-4d20-b12e-685ed9e7bdcd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:51.600379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995e456-b8fe-4d20-b12e-685ed9e7bdcd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:51.606362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995e456-b8fe-4d20-b12e-685ed9e7bdcd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/5e8c8527f62b43acbaf645ee6fc029b1/implies/c8da004e2606443c8f05e1e17f60967d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:51.612003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995e456-b8fe-4d20-b12e-685ed9e7bdcd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5e8c8527f62b43acbaf645ee6fc029b1, implied_role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:51.617364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995e456-b8fe-4d20-b12e-685ed9e7bdcd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:51.712324 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2264/4462] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Jul 16 21:21:51 2022] DELETE /identity/v3/roles/5e8c8527f62b43acbaf645ee6fc029b1/implies/c8da004e2606443c8f05e1e17f60967d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:51.716646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26996ed4-6917-48e9-a56b-31a9b238a08c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:51.734186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26996ed4-6917-48e9-a56b-31a9b238a08c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:51.900795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119c489-e30a-49bf-8fb6-54d90f0304ea tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:51.902303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119c489-e30a-49bf-8fb6-54d90f0304ea tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:51.902880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119c489-e30a-49bf-8fb6-54d90f0304ea tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:51.903555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119c489-e30a-49bf-8fb6-54d90f0304ea tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/5e8c8527f62b43acbaf645ee6fc029b1/implies/17f05916d8c548cf9c7bd6f4c5890249` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:51.908978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119c489-e30a-49bf-8fb6-54d90f0304ea tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5e8c8527f62b43acbaf645ee6fc029b1, implied_role_id=17f05916d8c548cf9c7bd6f4c5890249)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:51.910457 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-4119c489-e30a-49bf-8fb6-54d90f0304ea tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:51.910457 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:21:51.910457 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:21:51.912054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119c489-e30a-49bf-8fb6-54d90f0304ea tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:52.054424 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2199/4463] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Jul 16 21:21:51 2022] DELETE /identity/v3/roles/5e8c8527f62b43acbaf645ee6fc029b1/implies/17f05916d8c548cf9c7bd6f4c5890249 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:52.055661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995e456-b8fe-4d20-b12e-685ed9e7bdcd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:52.072645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995e456-b8fe-4d20-b12e-685ed9e7bdcd tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:52.091798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119c489-e30a-49bf-8fb6-54d90f0304ea tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:52.231272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed7755-d4a6-4e90-a1ab-a0a2ae3999cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:52.232151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed7755-d4a6-4e90-a1ab-a0a2ae3999cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:52.232441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed7755-d4a6-4e90-a1ab-a0a2ae3999cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:52.232722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed7755-d4a6-4e90-a1ab-a0a2ae3999cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/17f05916d8c548cf9c7bd6f4c5890249` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:52.238955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed7755-d4a6-4e90-a1ab-a0a2ae3999cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=17f05916d8c548cf9c7bd6f4c5890249)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:52.244696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed7755-d4a6-4e90-a1ab-a0a2ae3999cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:52.245870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119c489-e30a-49bf-8fb6-54d90f0304ea tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:52.253210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f5227-94ee-4652-ac73-34e866ae4c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:52.254721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f5227-94ee-4652-ac73-34e866ae4c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:52.255029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f5227-94ee-4652-ac73-34e866ae4c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:52.255466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f5227-94ee-4652-ac73-34e866ae4c0c admin admin] PATH_INFO: `/v3/users/e062ffc134634356afc2a92605af963c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:52.256828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f5227-94ee-4652-ac73-34e866ae4c0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e062ffc134634356afc2a92605af963c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:52.258812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f5227-94ee-4652-ac73-34e866ae4c0c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:52.429126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-46ed7755-d4a6-4e90-a1ab-a0a2ae3999cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invalidating the token cache because role 17f05916d8c548cf9c7bd6f4c5890249 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:52.429126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-46ed7755-d4a6-4e90-a1ab-a0a2ae3999cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:52.429126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-46ed7755-d4a6-4e90-a1ab-a0a2ae3999cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:52.430357 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2265/4464] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:52 2022] DELETE /identity/v3/roles/17f05916d8c548cf9c7bd6f4c5890249 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:52.435984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed7755-d4a6-4e90-a1ab-a0a2ae3999cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:52.439043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-46ed7755-d4a6-4e90-a1ab-a0a2ae3999cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:52.545268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cc0f5227-94ee-4652-ac73-34e866ae4c0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e062ffc134634356afc2a92605af963c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:52.569874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cc0f5227-94ee-4652-ac73-34e866ae4c0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e062ffc134634356afc2a92605af963c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:52.613597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed7755-d4a6-4e90-a1ab-a0a2ae3999cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:52.634048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd52e68-75da-48e8-b252-163e77c122f7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:52.635087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd52e68-75da-48e8-b252-163e77c122f7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:52.635599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd52e68-75da-48e8-b252-163e77c122f7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:52.636410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd52e68-75da-48e8-b252-163e77c122f7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/domains/91bdac0c55594f41877c7b3d65dc32f2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:52.655659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd52e68-75da-48e8-b252-163e77c122f7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=91bdac0c55594f41877c7b3d65dc32f2)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:52.658097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd52e68-75da-48e8-b252-163e77c122f7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:52.662931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cc0f5227-94ee-4652-ac73-34e866ae4c0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e062ffc134634356afc2a92605af963c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:52.674390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cc0f5227-94ee-4652-ac73-34e866ae4c0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e062ffc134634356afc2a92605af963c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:52.676029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cc0f5227-94ee-4652-ac73-34e866ae4c0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e062ffc134634356afc2a92605af963c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:52.698407 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2200/4465] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:52 2022] DELETE /identity/v3/users/e062ffc134634356afc2a92605af963c => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:52.705378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d840f-3fd5-4a00-83fc-c8d8327f8d6e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:52.705675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d840f-3fd5-4a00-83fc-c8d8327f8d6e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:52.707059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d840f-3fd5-4a00-83fc-c8d8327f8d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:52.734058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2dd52e68-75da-48e8-b252-163e77c122f7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '91bdac0c55594f41877c7b3d65dc32f2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:52.735690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2dd52e68-75da-48e8-b252-163e77c122f7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '91bdac0c55594f41877c7b3d65dc32f2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:52.742648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:52.756675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f44d840f-3fd5-4a00-83fc-c8d8327f8d6e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:52.757921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f44d840f-3fd5-4a00-83fc-c8d8327f8d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:52.873759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2dd52e68-75da-48e8-b252-163e77c122f7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '91bdac0c55594f41877c7b3d65dc32f2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:52.874996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2dd52e68-75da-48e8-b252-163e77c122f7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '91bdac0c55594f41877c7b3d65dc32f2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:52.880822 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2266/4466] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:21:52 2022] PATCH /identity/v3/domains/91bdac0c55594f41877c7b3d65dc32f2 => generated 275 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:52.883953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd52e68-75da-48e8-b252-163e77c122f7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:52.887507 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2201/4467] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:52.888497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d840f-3fd5-4a00-83fc-c8d8327f8d6e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:52.890044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f44d840f-3fd5-4a00-83fc-c8d8327f8d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:52.890313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2dd52e68-75da-48e8-b252-163e77c122f7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:52.994855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd52e68-75da-48e8-b252-163e77c122f7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:53.004601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f4586-0669-42c7-8b73-0e96c765421f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:53.005957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f4586-0669-42c7-8b73-0e96c765421f service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:53.016591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f4586-0669-42c7-8b73-0e96c765421f service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:53.016591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f4586-0669-42c7-8b73-0e96c765421f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:53.018156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0c7f4586-0669-42c7-8b73-0e96c765421f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:53.037751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d840f-3fd5-4a00-83fc-c8d8327f8d6e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:53.041565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f4586-0669-42c7-8b73-0e96c765421f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:53.043693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:53.051383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f4586-0669-42c7-8b73-0e96c765421f service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:53.051529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:53.051529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:53.051529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/domains/91bdac0c55594f41877c7b3d65dc32f2` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:53.063488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=91bdac0c55594f41877c7b3d65dc32f2)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:53.066528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:53.071709 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2267/4468] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:21:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:21:53.107073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:53.130669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '91bdac0c55594f41877c7b3d65dc32f2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:53.144691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '91bdac0c55594f41877c7b3d65dc32f2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:53.357974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91bdac0c55594f41877c7b3d65dc32f2', 'request_id': 'req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:53.370722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91bdac0c55594f41877c7b3d65dc32f2', 'request_id': 'req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:53.400496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91bdac0c55594f41877c7b3d65dc32f2', 'request_id': 'req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:53.504915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] The token cache is being invalidate because project 91bdac0c55594f41877c7b3d65dc32f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:53.505277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:53.506667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:53.541593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '91bdac0c55594f41877c7b3d65dc32f2', 'request_id': 'req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:53.547794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '91bdac0c55594f41877c7b3d65dc32f2', 'request_id': 'req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:53.548583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '91bdac0c55594f41877c7b3d65dc32f2', 'request_id': 'req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:53.572223 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2202/4469] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:21:52 2022] DELETE /identity/v3/domains/91bdac0c55594f41877c7b3d65dc32f2 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:21:53.577303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f4586-0669-42c7-8b73-0e96c765421f service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:53.579213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0c7f4586-0669-42c7-8b73-0e96c765421f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:53.628314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f4586-0669-42c7-8b73-0e96c765421f service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:53.838032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf93fc-894e-49ce-9fc6-ad4f2064bb3c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:53.840200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf93fc-894e-49ce-9fc6-ad4f2064bb3c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:53.844917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf93fc-894e-49ce-9fc6-ad4f2064bb3c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:53.846493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf93fc-894e-49ce-9fc6-ad4f2064bb3c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/5e8c8527f62b43acbaf645ee6fc029b1/implies/48c2802bf87f4d5cb3a5eba4923bdeb3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:53.855833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf93fc-894e-49ce-9fc6-ad4f2064bb3c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5e8c8527f62b43acbaf645ee6fc029b1, implied_role_id=48c2802bf87f4d5cb3a5eba4923bdeb3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:53.863968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf93fc-894e-49ce-9fc6-ad4f2064bb3c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:54.016673 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2268/4470] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Jul 16 21:21:53 2022] DELETE /identity/v3/roles/5e8c8527f62b43acbaf645ee6fc029b1/implies/48c2802bf87f4d5cb3a5eba4923bdeb3 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:54.020962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:54.022623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:54.065400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dfa90-ed46-4298-9f63-69fb6774c1ff tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:54.258137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4cd50-8b2e-46a0-9f28-cbbb9214be27 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:54.259295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4cd50-8b2e-46a0-9f28-cbbb9214be27 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:54.259798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4cd50-8b2e-46a0-9f28-cbbb9214be27 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:54.260095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4cd50-8b2e-46a0-9f28-cbbb9214be27 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/48c2802bf87f4d5cb3a5eba4923bdeb3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:54.264022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4cd50-8b2e-46a0-9f28-cbbb9214be27 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=48c2802bf87f4d5cb3a5eba4923bdeb3)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:54.265295 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-62d4cd50-8b2e-46a0-9f28-cbbb9214be27 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:54.265295 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:21:54.265295 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:21:54.266255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4cd50-8b2e-46a0-9f28-cbbb9214be27 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:54.458096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-62d4cd50-8b2e-46a0-9f28-cbbb9214be27 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invalidating the token cache because role 48c2802bf87f4d5cb3a5eba4923bdeb3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:54.458544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-62d4cd50-8b2e-46a0-9f28-cbbb9214be27 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:54.460347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-62d4cd50-8b2e-46a0-9f28-cbbb9214be27 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:54.482876 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2203/4471] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:54 2022] DELETE /identity/v3/roles/48c2802bf87f4d5cb3a5eba4923bdeb3 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:21:54.487716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf93fc-894e-49ce-9fc6-ad4f2064bb3c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:54.490937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-deaf93fc-894e-49ce-9fc6-ad4f2064bb3c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:54.549744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf93fc-894e-49ce-9fc6-ad4f2064bb3c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:54.566001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4cd50-8b2e-46a0-9f28-cbbb9214be27 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:54.568303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-62d4cd50-8b2e-46a0-9f28-cbbb9214be27 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:54.805773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bb08b-8d35-4f19-8756-b3cde99894cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:54.826145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bb08b-8d35-4f19-8756-b3cde99894cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:54.826145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bb08b-8d35-4f19-8756-b3cde99894cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:54.826145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bb08b-8d35-4f19-8756-b3cde99894cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/5e8c8527f62b43acbaf645ee6fc029b1` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:54.826145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bb08b-8d35-4f19-8756-b3cde99894cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=5e8c8527f62b43acbaf645ee6fc029b1)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:54.826145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bb08b-8d35-4f19-8756-b3cde99894cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:54.857029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4cd50-8b2e-46a0-9f28-cbbb9214be27 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:54.897312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802034e-9b8d-4fb1-bb80-dcf01cec4e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:54.899491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802034e-9b8d-4fb1-bb80-dcf01cec4e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:54.901201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802034e-9b8d-4fb1-bb80-dcf01cec4e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:54.902436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802034e-9b8d-4fb1-bb80-dcf01cec4e14 admin admin] PATH_INFO: `/v3/projects/3179b826526f4fbdbbff66fbf50931ca` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:54.905149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802034e-9b8d-4fb1-bb80-dcf01cec4e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3179b826526f4fbdbbff66fbf50931ca)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:54.911810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802034e-9b8d-4fb1-bb80-dcf01cec4e14 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:55.131387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c37bb08b-8d35-4f19-8756-b3cde99894cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invalidating the token cache because role 5e8c8527f62b43acbaf645ee6fc029b1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:55.131893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c37bb08b-8d35-4f19-8756-b3cde99894cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:55.132892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c37bb08b-8d35-4f19-8756-b3cde99894cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:55.140446 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2269/4472] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:54 2022] DELETE /identity/v3/roles/5e8c8527f62b43acbaf645ee6fc029b1 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:55.142660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bb08b-8d35-4f19-8756-b3cde99894cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:55.144170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c37bb08b-8d35-4f19-8756-b3cde99894cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:55.198026 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8802034e-9b8d-4fb1-bb80-dcf01cec4e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3179b826526f4fbdbbff66fbf50931ca', 'request_id': 'req-8802034e-9b8d-4fb1-bb80-dcf01cec4e14'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:55.205267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8802034e-9b8d-4fb1-bb80-dcf01cec4e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3179b826526f4fbdbbff66fbf50931ca', 'request_id': 'req-8802034e-9b8d-4fb1-bb80-dcf01cec4e14'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:55.214485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8802034e-9b8d-4fb1-bb80-dcf01cec4e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3179b826526f4fbdbbff66fbf50931ca', 'request_id': 'req-8802034e-9b8d-4fb1-bb80-dcf01cec4e14'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:55.289726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bb08b-8d35-4f19-8756-b3cde99894cc tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:55.374501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8802034e-9b8d-4fb1-bb80-dcf01cec4e14 admin admin] The token cache is being invalidate because project 3179b826526f4fbdbbff66fbf50931ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:55.375742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8802034e-9b8d-4fb1-bb80-dcf01cec4e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:55.376883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8802034e-9b8d-4fb1-bb80-dcf01cec4e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:55.379227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56408aeb-bf83-4e64-92a1-da429b9b292c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:55.379648 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2204/4473] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:54 2022] DELETE /identity/v3/projects/3179b826526f4fbdbbff66fbf50931ca => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:55.380495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56408aeb-bf83-4e64-92a1-da429b9b292c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:55.381165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56408aeb-bf83-4e64-92a1-da429b9b292c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:55.381526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56408aeb-bf83-4e64-92a1-da429b9b292c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:55.383894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56408aeb-bf83-4e64-92a1-da429b9b292c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c27ae8ee177b4b71b2ab962e88913533, implied_role_id=ed3ba6080bac49c990e47d1c1ee8741d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:55.385063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802034e-9b8d-4fb1-bb80-dcf01cec4e14 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:55.386794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56408aeb-bf83-4e64-92a1-da429b9b292c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:55.387069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8802034e-9b8d-4fb1-bb80-dcf01cec4e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:55.509032 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2270/4474] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Jul 16 21:21:55 2022] PUT /identity/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d => generated 521 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:55.522050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56408aeb-bf83-4e64-92a1-da429b9b292c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:55.527151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-56408aeb-bf83-4e64-92a1-da429b9b292c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:55.596868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802034e-9b8d-4fb1-bb80-dcf01cec4e14 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:55.625377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56408aeb-bf83-4e64-92a1-da429b9b292c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:55.634435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6e55f-816d-4fbf-806b-0876947a52de tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:55.634435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6e55f-816d-4fbf-806b-0876947a52de tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `HEAD` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:55.634435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6e55f-816d-4fbf-806b-0876947a52de tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:55.634770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6e55f-816d-4fbf-806b-0876947a52de tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:55.637200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6e55f-816d-4fbf-806b-0876947a52de tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=c27ae8ee177b4b71b2ab962e88913533, implied_role_id=ed3ba6080bac49c990e47d1c1ee8741d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:55.638264 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-37c6e55f-816d-4fbf-806b-0876947a52de tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:55.638264 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:21:55.638264 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:21:55.639212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6e55f-816d-4fbf-806b-0876947a52de tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:55.640173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6e55f-816d-4fbf-806b-0876947a52de tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=c27ae8ee177b4b71b2ab962e88913533, implied_role_id=ed3ba6080bac49c990e47d1c1ee8741d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:55.641281 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-37c6e55f-816d-4fbf-806b-0876947a52de tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:55.641281 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:21:55.641281 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:21:55.643607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6e55f-816d-4fbf-806b-0876947a52de tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:55.651894 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2271/4475] 10.222.0.16 () {58 vars in 1344 bytes} [Sat Jul 16 21:21:55 2022] HEAD /identity/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:55.652957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6e55f-816d-4fbf-806b-0876947a52de tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:55.666920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6e55f-816d-4fbf-806b-0876947a52de tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:55.673946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1940b-6d3d-4cd9-a67a-6849035be2f4 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:55.674928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1940b-6d3d-4cd9-a67a-6849035be2f4 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:55.675605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1940b-6d3d-4cd9-a67a-6849035be2f4 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:55.675605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1940b-6d3d-4cd9-a67a-6849035be2f4 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:55.678520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1940b-6d3d-4cd9-a67a-6849035be2f4 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=c27ae8ee177b4b71b2ab962e88913533, implied_role_id=ed3ba6080bac49c990e47d1c1ee8741d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:55.680373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1940b-6d3d-4cd9-a67a-6849035be2f4 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:55.688222 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2272/4476] 10.222.0.16 () {58 vars in 1343 bytes} [Sat Jul 16 21:21:55 2022] GET /identity/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d => generated 521 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:55.692466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1940b-6d3d-4cd9-a67a-6849035be2f4 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:55.705279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1940b-6d3d-4cd9-a67a-6849035be2f4 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:55.717533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28f5fa-280a-46d8-895a-b61b658fe313 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:55.726510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28f5fa-280a-46d8-895a-b61b658fe313 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:55.726510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28f5fa-280a-46d8-895a-b61b658fe313 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:55.726510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28f5fa-280a-46d8-895a-b61b658fe313 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:55.726510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28f5fa-280a-46d8-895a-b61b658fe313 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c27ae8ee177b4b71b2ab962e88913533, implied_role_id=ed3ba6080bac49c990e47d1c1ee8741d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:55.726912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28f5fa-280a-46d8-895a-b61b658fe313 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:55.728185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0f76a-e596-438e-9105-eeed5e2026c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:55.731747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0f76a-e596-438e-9105-eeed5e2026c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:55.732189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0f76a-e596-438e-9105-eeed5e2026c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:55.732739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0f76a-e596-438e-9105-eeed5e2026c3 admin admin] PATH_INFO: `/v3/users/07fe756dfe054b43abcfdf12c5442b64` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:55.736892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0f76a-e596-438e-9105-eeed5e2026c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07fe756dfe054b43abcfdf12c5442b64)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:55.740062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0f76a-e596-438e-9105-eeed5e2026c3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:55.750285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:55.811953 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2273/4477] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Jul 16 21:21:55 2022] DELETE /identity/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:55.820965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28f5fa-280a-46d8-895a-b61b658fe313 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:55.913445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28f5fa-280a-46d8-895a-b61b658fe313 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:55.929803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef4344-b091-4b58-8281-6aa012f1395b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:55.931555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef4344-b091-4b58-8281-6aa012f1395b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:55.931917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef4344-b091-4b58-8281-6aa012f1395b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:55.932301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef4344-b091-4b58-8281-6aa012f1395b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:55.935082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef4344-b091-4b58-8281-6aa012f1395b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=c27ae8ee177b4b71b2ab962e88913533, implied_role_id=ed3ba6080bac49c990e47d1c1ee8741d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:55.936639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef4344-b091-4b58-8281-6aa012f1395b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:55.956065 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-c8ef4344-b091-4b58-8281-6aa012f1395b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] c27ae8ee177b4b71b2ab962e88913533 does not imply ed3ba6080bac49c990e47d1c1ee8741d.: keystone.exception.ImpliedRoleNotFound: c27ae8ee177b4b71b2ab962e88913533 does not imply ed3ba6080bac49c990e47d1c1ee8741d. Jul 16 21:21:55.956065 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:55.956065 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 16 21:21:55.956065 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = query.one() Jul 16 21:21:55.956065 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 16 21:21:55.956065 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._iter().one() Jul 16 21:21:55.956065 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 16 21:21:55.956065 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._only_one_row( Jul 16 21:21:55.956065 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 16 21:21:55.956065 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 16 21:21:55.956065 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 16 21:21:55.956065 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:55.956065 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:21:55.956065 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:55.956065 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:55.956065 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:21:55.957294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:21:55.957294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:21:55.957294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:21:55.957294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:21:55.957294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:21:55.957294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:21:55.957294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:21:55.957294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:21:55.957294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:21:55.957294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Jul 16 21:21:55.957294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Jul 16 21:21:55.957294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Jul 16 21:21:55.957294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Jul 16 21:21:55.957294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Jul 16 21:21:55.957294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 16 21:21:55.957294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 16 21:21:55.958378 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 16 21:21:55.958378 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: c27ae8ee177b4b71b2ab962e88913533 does not imply ed3ba6080bac49c990e47d1c1ee8741d. Jul 16 21:21:55.958378 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:55.958378 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2274/4478] 10.222.0.16 () {58 vars in 1343 bytes} [Sat Jul 16 21:21:55 2022] GET /identity/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d => generated 137 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:21:55.962324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef4344-b091-4b58-8281-6aa012f1395b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:55.974483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef4344-b091-4b58-8281-6aa012f1395b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:55.979922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cb65f-6738-41fb-9e42-40d3c5800c2e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:55.980994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cb65f-6738-41fb-9e42-40d3c5800c2e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:55.980994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cb65f-6738-41fb-9e42-40d3c5800c2e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:55.981690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cb65f-6738-41fb-9e42-40d3c5800c2e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:55.983379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cb65f-6738-41fb-9e42-40d3c5800c2e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c27ae8ee177b4b71b2ab962e88913533, implied_role_id=ed3ba6080bac49c990e47d1c1ee8741d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:55.985683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cb65f-6738-41fb-9e42-40d3c5800c2e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:56.007385 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-772cb65f-6738-41fb-9e42-40d3c5800c2e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] c27ae8ee177b4b71b2ab962e88913533 does not imply ed3ba6080bac49c990e47d1c1ee8741d.: keystone.exception.ImpliedRoleNotFound: c27ae8ee177b4b71b2ab962e88913533 does not imply ed3ba6080bac49c990e47d1c1ee8741d. Jul 16 21:21:56.007385 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:56.007385 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 16 21:21:56.007385 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = query.one() Jul 16 21:21:56.007385 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 16 21:21:56.007385 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._iter().one() Jul 16 21:21:56.007385 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 16 21:21:56.007385 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._only_one_row( Jul 16 21:21:56.007385 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 16 21:21:56.007385 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 16 21:21:56.007385 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 16 21:21:56.007385 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:56.007385 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:21:56.007385 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:56.007385 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:21:56.007385 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:21:56.008458 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:21:56.008458 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:21:56.008458 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:21:56.008458 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:21:56.008458 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:21:56.008458 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:21:56.008458 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:21:56.008458 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:21:56.008458 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:21:56.008458 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jul 16 21:21:56.008458 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jul 16 21:21:56.008458 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:21:56.008458 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:21:56.008458 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jul 16 21:21:56.008458 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jul 16 21:21:56.008458 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jul 16 21:21:56.009484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 16 21:21:56.009484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 16 21:21:56.009484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 16 21:21:56.009484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: c27ae8ee177b4b71b2ab962e88913533 does not imply ed3ba6080bac49c990e47d1c1ee8741d. Jul 16 21:21:56.009484 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:21:56.014217 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2275/4479] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Jul 16 21:21:55 2022] DELETE /identity/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d => generated 137 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:21:56.015366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cb65f-6738-41fb-9e42-40d3c5800c2e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:56.032366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6ae0f76a-e596-438e-9105-eeed5e2026c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07fe756dfe054b43abcfdf12c5442b64'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:56.040209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cb65f-6738-41fb-9e42-40d3c5800c2e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:56.045922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6ae0f76a-e596-438e-9105-eeed5e2026c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07fe756dfe054b43abcfdf12c5442b64'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:56.052426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f5a92-4865-4e4c-ada7-e0f841492b4a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:56.053539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f5a92-4865-4e4c-ada7-e0f841492b4a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:56.054584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f5a92-4865-4e4c-ada7-e0f841492b4a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:56.054866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f5a92-4865-4e4c-ada7-e0f841492b4a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:56.056764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f5a92-4865-4e4c-ada7-e0f841492b4a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c27ae8ee177b4b71b2ab962e88913533, implied_role_id=ed3ba6080bac49c990e47d1c1ee8741d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:56.058561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f5a92-4865-4e4c-ada7-e0f841492b4a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:56.174690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6ae0f76a-e596-438e-9105-eeed5e2026c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07fe756dfe054b43abcfdf12c5442b64'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:56.204699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6ae0f76a-e596-438e-9105-eeed5e2026c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07fe756dfe054b43abcfdf12c5442b64'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:56.205792 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2276/4480] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Jul 16 21:21:56 2022] PUT /identity/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d => generated 521 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:56.207658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6ae0f76a-e596-438e-9105-eeed5e2026c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07fe756dfe054b43abcfdf12c5442b64'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:56.214027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f5a92-4865-4e4c-ada7-e0f841492b4a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:56.220994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f86f5a92-4865-4e4c-ada7-e0f841492b4a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:56.229359 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2205/4481] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:21:55 2022] DELETE /identity/v3/users/07fe756dfe054b43abcfdf12c5442b64 => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:56.295883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:56.434383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f5a92-4865-4e4c-ada7-e0f841492b4a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:56.597540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b224d2-9e9a-41c8-a239-df3230adda2e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:56.599361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b224d2-9e9a-41c8-a239-df3230adda2e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:56.599888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b224d2-9e9a-41c8-a239-df3230adda2e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:56.600616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b224d2-9e9a-41c8-a239-df3230adda2e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/58264627182b4a198fc25cc031282c49` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:56.636192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b224d2-9e9a-41c8-a239-df3230adda2e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c27ae8ee177b4b71b2ab962e88913533, implied_role_id=58264627182b4a198fc25cc031282c49)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:56.642970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b224d2-9e9a-41c8-a239-df3230adda2e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:56.783844 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2277/4482] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Jul 16 21:21:56 2022] PUT /identity/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/58264627182b4a198fc25cc031282c49 => generated 519 bytes in 570 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:56.787849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0f76a-e596-438e-9105-eeed5e2026c3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:56.809673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0f76a-e596-438e-9105-eeed5e2026c3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:57.009199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5bfb3-0b5a-41a4-8003-328ad93d4bf6 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:57.014051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5bfb3-0b5a-41a4-8003-328ad93d4bf6 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:57.014051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5bfb3-0b5a-41a4-8003-328ad93d4bf6 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:57.014051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5bfb3-0b5a-41a4-8003-328ad93d4bf6 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/58264627182b4a198fc25cc031282c49/implies/c8da004e2606443c8f05e1e17f60967d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:57.021989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5bfb3-0b5a-41a4-8003-328ad93d4bf6 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=58264627182b4a198fc25cc031282c49, implied_role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:57.023699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5bfb3-0b5a-41a4-8003-328ad93d4bf6 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:57.161733 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2206/4483] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Jul 16 21:21:56 2022] PUT /identity/v3/roles/58264627182b4a198fc25cc031282c49/implies/c8da004e2606443c8f05e1e17f60967d => generated 519 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:57.165995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b224d2-9e9a-41c8-a239-df3230adda2e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:57.187870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b224d2-9e9a-41c8-a239-df3230adda2e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:57.206539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5bfb3-0b5a-41a4-8003-328ad93d4bf6 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:57.210566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3db5bfb3-0b5a-41a4-8003-328ad93d4bf6 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:57.436052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1065570-2cf2-4a6d-9fdd-b3703d99ce66 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:57.437000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1065570-2cf2-4a6d-9fdd-b3703d99ce66 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:57.438064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1065570-2cf2-4a6d-9fdd-b3703d99ce66 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:57.438513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1065570-2cf2-4a6d-9fdd-b3703d99ce66 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:57.439358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1065570-2cf2-4a6d-9fdd-b3703d99ce66 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:57.440734 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-e1065570-2cf2-4a6d-9fdd-b3703d99ce66 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:57.440734 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:21:57.440734 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:21:57.459737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1065570-2cf2-4a6d-9fdd-b3703d99ce66 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:57.487117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5bfb3-0b5a-41a4-8003-328ad93d4bf6 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:57.506007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04922ab-4425-44f0-8acc-3362cbb23066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:57.508779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04922ab-4425-44f0-8acc-3362cbb23066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:57.509513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04922ab-4425-44f0-8acc-3362cbb23066 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:57.511673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04922ab-4425-44f0-8acc-3362cbb23066 admin admin] PATH_INFO: `/v3/projects/06aaa4c6d3394bff9d653079a97983b0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:57.515115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04922ab-4425-44f0-8acc-3362cbb23066 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06aaa4c6d3394bff9d653079a97983b0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:57.519341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04922ab-4425-44f0-8acc-3362cbb23066 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:57.532957 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2278/4484] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Jul 16 21:21:57 2022] GET /identity/v3/role_inferences => generated 1604 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:57.534153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1065570-2cf2-4a6d-9fdd-b3703d99ce66 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:57.581800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1065570-2cf2-4a6d-9fdd-b3703d99ce66 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:57.612350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972cd55-dd26-4ca7-9581-9e44a890131e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:57.613308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972cd55-dd26-4ca7-9581-9e44a890131e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:57.613595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972cd55-dd26-4ca7-9581-9e44a890131e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:57.613871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972cd55-dd26-4ca7-9581-9e44a890131e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/58264627182b4a198fc25cc031282c49/implies/c8da004e2606443c8f05e1e17f60967d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:57.615964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972cd55-dd26-4ca7-9581-9e44a890131e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=58264627182b4a198fc25cc031282c49, implied_role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:57.617798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972cd55-dd26-4ca7-9581-9e44a890131e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:58.201130 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2279/4485] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Jul 16 21:21:57 2022] DELETE /identity/v3/roles/58264627182b4a198fc25cc031282c49/implies/c8da004e2606443c8f05e1e17f60967d => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:58.211203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972cd55-dd26-4ca7-9581-9e44a890131e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:58.310000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a04922ab-4425-44f0-8acc-3362cbb23066 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06aaa4c6d3394bff9d653079a97983b0', 'request_id': 'req-a04922ab-4425-44f0-8acc-3362cbb23066'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:58.335898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a04922ab-4425-44f0-8acc-3362cbb23066 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06aaa4c6d3394bff9d653079a97983b0', 'request_id': 'req-a04922ab-4425-44f0-8acc-3362cbb23066'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:58.362071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a04922ab-4425-44f0-8acc-3362cbb23066 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06aaa4c6d3394bff9d653079a97983b0', 'request_id': 'req-a04922ab-4425-44f0-8acc-3362cbb23066'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:58.462548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972cd55-dd26-4ca7-9581-9e44a890131e tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:58.483385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a04922ab-4425-44f0-8acc-3362cbb23066 admin admin] The token cache is being invalidate because project 06aaa4c6d3394bff9d653079a97983b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:21:58.484856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a04922ab-4425-44f0-8acc-3362cbb23066 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:58.486027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a04922ab-4425-44f0-8acc-3362cbb23066 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:21:58.490381 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2207/4486] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:21:57 2022] DELETE /identity/v3/projects/06aaa4c6d3394bff9d653079a97983b0 => generated 0 bytes in 1284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:58.502958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc2d57-a666-4409-811d-1e81f7a4c7ab None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:58.503604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc2d57-a666-4409-811d-1e81f7a4c7ab None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:58.504167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc2d57-a666-4409-811d-1e81f7a4c7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:58.569154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-59fc2d57-a666-4409-811d-1e81f7a4c7ab None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:58.570586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-59fc2d57-a666-4409-811d-1e81f7a4c7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:58.690837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c8fe4-70ba-445d-82cb-a82f9500b22f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:58.692666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c8fe4-70ba-445d-82cb-a82f9500b22f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:58.692973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c8fe4-70ba-445d-82cb-a82f9500b22f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:58.695237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c8fe4-70ba-445d-82cb-a82f9500b22f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/58264627182b4a198fc25cc031282c49` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:58.701835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c8fe4-70ba-445d-82cb-a82f9500b22f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c27ae8ee177b4b71b2ab962e88913533, implied_role_id=58264627182b4a198fc25cc031282c49)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:58.711415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c8fe4-70ba-445d-82cb-a82f9500b22f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:58.759486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:21:58.830660 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2280/4487] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Jul 16 21:21:58 2022] DELETE /identity/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/58264627182b4a198fc25cc031282c49 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:21:58.841945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c8fe4-70ba-445d-82cb-a82f9500b22f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:58.841945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a71c8fe4-70ba-445d-82cb-a82f9500b22f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:58.855822 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2208/4488] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:21:58.862059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ce431-5539-4332-92c1-e6de5b9d66ac None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:58.862923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ce431-5539-4332-92c1-e6de5b9d66ac None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:58.863544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ce431-5539-4332-92c1-e6de5b9d66ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:58.912640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ae7ce431-5539-4332-92c1-e6de5b9d66ac None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:21:58.919291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ae7ce431-5539-4332-92c1-e6de5b9d66ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:21:59.104861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c8fe4-70ba-445d-82cb-a82f9500b22f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:59.116778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf9e83-b539-47ef-88fa-873b2814dbfa tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:59.119631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf9e83-b539-47ef-88fa-873b2814dbfa tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:59.119922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf9e83-b539-47ef-88fa-873b2814dbfa tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:59.120209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf9e83-b539-47ef-88fa-873b2814dbfa tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:59.123300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf9e83-b539-47ef-88fa-873b2814dbfa tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c27ae8ee177b4b71b2ab962e88913533, implied_role_id=ed3ba6080bac49c990e47d1c1ee8741d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:59.126761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf9e83-b539-47ef-88fa-873b2814dbfa tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:59.187812 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2209/4489] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:21:59.188872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ce431-5539-4332-92c1-e6de5b9d66ac None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:59.206698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ce431-5539-4332-92c1-e6de5b9d66ac None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:59.226852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562d8a1-c4ef-4973-be3a-d7b2a13417db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:59.228260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562d8a1-c4ef-4973-be3a-d7b2a13417db admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:59.228260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562d8a1-c4ef-4973-be3a-d7b2a13417db admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:59.228260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562d8a1-c4ef-4973-be3a-d7b2a13417db admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:59.228983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562d8a1-c4ef-4973-be3a-d7b2a13417db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:21:59.229294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562d8a1-c4ef-4973-be3a-d7b2a13417db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:59.235658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562d8a1-c4ef-4973-be3a-d7b2a13417db admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:59.239908 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2281/4490] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Jul 16 21:21:58 2022] DELETE /identity/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:21:59.240698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf9e83-b539-47ef-88fa-873b2814dbfa tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:59.258929 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2210/4491] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:21:59.260116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562d8a1-c4ef-4973-be3a-d7b2a13417db admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:59.285564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562d8a1-c4ef-4973-be3a-d7b2a13417db admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:59.414688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf9e83-b539-47ef-88fa-873b2814dbfa tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:59.423651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72fcb5-1a18-442c-ae39-668494d0de8a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:59.425467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72fcb5-1a18-442c-ae39-668494d0de8a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:59.425467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72fcb5-1a18-442c-ae39-668494d0de8a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:59.425467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72fcb5-1a18-442c-ae39-668494d0de8a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:59.425744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72fcb5-1a18-442c-ae39-668494d0de8a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:59.428531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72fcb5-1a18-442c-ae39-668494d0de8a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:59.450669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48510d07-179b-4152-9947-65cfceaf3b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:59.452530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48510d07-179b-4152-9947-65cfceaf3b0d admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:59.452960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48510d07-179b-4152-9947-65cfceaf3b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:59.453696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48510d07-179b-4152-9947-65cfceaf3b0d admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:59.455666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48510d07-179b-4152-9947-65cfceaf3b0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:59.460835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48510d07-179b-4152-9947-65cfceaf3b0d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:59.473156 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2282/4492] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:21:59 2022] GET /identity/v3/roles => generated 2322 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:21:59.478696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72fcb5-1a18-442c-ae39-668494d0de8a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:59.503482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72fcb5-1a18-442c-ae39-668494d0de8a tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:59.509078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3127dda-054a-461a-a27d-ca1570e212f1 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:59.509826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3127dda-054a-461a-a27d-ca1570e212f1 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:59.510117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3127dda-054a-461a-a27d-ca1570e212f1 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:59.510521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3127dda-054a-461a-a27d-ca1570e212f1 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:59.511745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3127dda-054a-461a-a27d-ca1570e212f1 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:59.517472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3127dda-054a-461a-a27d-ca1570e212f1 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:59.620705 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2283/4494] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:21:59 2022] POST /identity/v3/roles => generated 235 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:21:59.621713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3127dda-054a-461a-a27d-ca1570e212f1 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:59.623560 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2211/4493] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:21:59 2022] POST /identity/v3/projects => generated 409 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:21:59.625531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48510d07-179b-4152-9947-65cfceaf3b0d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:21:59.652935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3127dda-054a-461a-a27d-ca1570e212f1 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:59.779532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48510d07-179b-4152-9947-65cfceaf3b0d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:21:59.806832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a3eb3-af35-4aa9-b06a-f4b70c348c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:59.811863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a3eb3-af35-4aa9-b06a-f4b70c348c28 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:59.812171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a3eb3-af35-4aa9-b06a-f4b70c348c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:59.813312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a3eb3-af35-4aa9-b06a-f4b70c348c28 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:59.814223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a3eb3-af35-4aa9-b06a-f4b70c348c28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:59.818674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a3eb3-af35-4aa9-b06a-f4b70c348c28 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:21:59.830584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cecff-9e11-432e-ac0c-fb668bb2d552 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:21:59.832696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cecff-9e11-432e-ac0c-fb668bb2d552 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:21:59.833485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cecff-9e11-432e-ac0c-fb668bb2d552 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:21:59.833775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cecff-9e11-432e-ac0c-fb668bb2d552 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c54519b6214b484f9e321839d325bdbb` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:21:59.840957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8cecff-9e11-432e-ac0c-fb668bb2d552 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:update_role(role_id=c54519b6214b484f9e321839d325bdbb)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:21:59.846996 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-0c8cecff-9e11-432e-ac0c-fb668bb2d552 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:21:59.846996 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:21:59.846996 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:21:59.849157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8cecff-9e11-432e-ac0c-fb668bb2d552 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:00.042510 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2284/4495] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:21:59 2022] POST /identity/v3/users => generated 305 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:00.043881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a3eb3-af35-4aa9-b06a-f4b70c348c28 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:00.058160 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2212/4496] 10.222.0.16 () {60 vars in 1242 bytes} [Sat Jul 16 21:21:59 2022] PATCH /identity/v3/roles/c54519b6214b484f9e321839d325bdbb => generated 237 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:22:00.059789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cecff-9e11-432e-ac0c-fb668bb2d552 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:00.062448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a3eb3-af35-4aa9-b06a-f4b70c348c28 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:00.074967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cecff-9e11-432e-ac0c-fb668bb2d552 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:00.080177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacc6d9-805a-48ff-aa96-2308540285c5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:00.081052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacc6d9-805a-48ff-aa96-2308540285c5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:00.081342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacc6d9-805a-48ff-aa96-2308540285c5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:00.081779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacc6d9-805a-48ff-aa96-2308540285c5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c54519b6214b484f9e321839d325bdbb` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:00.092910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d6026-76da-4f0c-8fa0-39a3961498a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:00.094478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d6026-76da-4f0c-8fa0-39a3961498a6 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:00.094771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d6026-76da-4f0c-8fa0-39a3961498a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:00.095074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d6026-76da-4f0c-8fa0-39a3961498a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:00.097649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d6026-76da-4f0c-8fa0-39a3961498a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:00.098183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dacc6d9-805a-48ff-aa96-2308540285c5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:get_role(role_id=c54519b6214b484f9e321839d325bdbb)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:00.099891 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-8dacc6d9-805a-48ff-aa96-2308540285c5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:22:00.099891 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:22:00.099891 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:22:00.101173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dacc6d9-805a-48ff-aa96-2308540285c5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:00.112199 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2213/4497] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Jul 16 21:22:00 2022] GET /identity/v3/roles/c54519b6214b484f9e321839d325bdbb => generated 237 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:22:00.112199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacc6d9-805a-48ff-aa96-2308540285c5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:00.115297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d6026-76da-4f0c-8fa0-39a3961498a6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:00.126946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacc6d9-805a-48ff-aa96-2308540285c5 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:00.133672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119823b-4524-4a27-a972-874a8ef7dcb3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:00.134591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119823b-4524-4a27-a972-874a8ef7dcb3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:00.135070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119823b-4524-4a27-a972-874a8ef7dcb3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:00.135516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119823b-4524-4a27-a972-874a8ef7dcb3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:00.136405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119823b-4524-4a27-a972-874a8ef7dcb3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:00.138472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119823b-4524-4a27-a972-874a8ef7dcb3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:00.151607 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2285/4498] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:00 2022] GET /identity/v3/roles => generated 2550 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:00.155361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d6026-76da-4f0c-8fa0-39a3961498a6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:00.163396 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2214/4499] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:00 2022] GET /identity/v3/roles => generated 2550 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:00.163396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119823b-4524-4a27-a972-874a8ef7dcb3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:00.167762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d6026-76da-4f0c-8fa0-39a3961498a6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:00.175828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953c67a-a7ba-4194-87dc-07029c4df9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:00.177194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953c67a-a7ba-4194-87dc-07029c4df9ac admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:00.177736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953c67a-a7ba-4194-87dc-07029c4df9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:00.178387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953c67a-a7ba-4194-87dc-07029c4df9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:00.179572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953c67a-a7ba-4194-87dc-07029c4df9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:00.182274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953c67a-a7ba-4194-87dc-07029c4df9ac admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:00.198914 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2286/4500] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:00 2022] GET /identity/v3/roles => generated 2550 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:00.201666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119823b-4524-4a27-a972-874a8ef7dcb3 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:00.202720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953c67a-a7ba-4194-87dc-07029c4df9ac admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:00.217782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953c67a-a7ba-4194-87dc-07029c4df9ac admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:00.221454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c7826-4807-42de-9645-3ceb558d0bd2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:00.222332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c7826-4807-42de-9645-3ceb558d0bd2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:00.222621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c7826-4807-42de-9645-3ceb558d0bd2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:00.222900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c7826-4807-42de-9645-3ceb558d0bd2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c54519b6214b484f9e321839d325bdbb` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:00.227064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c7826-4807-42de-9645-3ceb558d0bd2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c54519b6214b484f9e321839d325bdbb)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:00.227064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c7826-4807-42de-9645-3ceb558d0bd2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:00.234988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506d737-f9d3-4d77-b1cb-08f24ffb2006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:00.234988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506d737-f9d3-4d77-b1cb-08f24ffb2006 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:00.234988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506d737-f9d3-4d77-b1cb-08f24ffb2006 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:00.234988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506d737-f9d3-4d77-b1cb-08f24ffb2006 admin admin] PATH_INFO: `/v3/projects/780eb756635a4647a00599ab1085853c/users/a4006a038b2e4a86965c6d01ad929c93/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:00.255566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506d737-f9d3-4d77-b1cb-08f24ffb2006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=780eb756635a4647a00599ab1085853c, user_id=a4006a038b2e4a86965c6d01ad929c93, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:00.262322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506d737-f9d3-4d77-b1cb-08f24ffb2006 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:00.394799 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2287/4501] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:00 2022] PUT /identity/v3/projects/780eb756635a4647a00599ab1085853c/users/a4006a038b2e4a86965c6d01ad929c93/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:00.397821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-937c7826-4807-42de-9645-3ceb558d0bd2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invalidating the token cache because role c54519b6214b484f9e321839d325bdbb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:00.398390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-937c7826-4807-42de-9645-3ceb558d0bd2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:00.399646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-937c7826-4807-42de-9645-3ceb558d0bd2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:00.402957 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2215/4502] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:22:00 2022] DELETE /identity/v3/roles/c54519b6214b484f9e321839d325bdbb => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:00.409559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506d737-f9d3-4d77-b1cb-08f24ffb2006 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:00.411956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1506d737-f9d3-4d77-b1cb-08f24ffb2006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:00.419825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072a033-ad5a-4a80-938a-86e90df7eded None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:00.419825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072a033-ad5a-4a80-938a-86e90df7eded None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:00.420082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072a033-ad5a-4a80-938a-86e90df7eded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:00.479569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1072a033-ad5a-4a80-938a-86e90df7eded None None] MFA Rules not processed for user `a4006a038b2e4a86965c6d01ad929c93`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:00.480789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1072a033-ad5a-4a80-938a-86e90df7eded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:00.605092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506d737-f9d3-4d77-b1cb-08f24ffb2006 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:00.636658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:00.679887 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2216/4503] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:00 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:00.684658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072a033-ad5a-4a80-938a-86e90df7eded None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:00.686653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1072a033-ad5a-4a80-938a-86e90df7eded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:00.711121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72eb38c-9609-4238-a3ab-57c2eeb9ff3b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:00.713573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72eb38c-9609-4238-a3ab-57c2eeb9ff3b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:00.713869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72eb38c-9609-4238-a3ab-57c2eeb9ff3b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:00.714154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72eb38c-9609-4238-a3ab-57c2eeb9ff3b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:00.716645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72eb38c-9609-4238-a3ab-57c2eeb9ff3b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c27ae8ee177b4b71b2ab962e88913533, implied_role_id=ed3ba6080bac49c990e47d1c1ee8741d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:00.722692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72eb38c-9609-4238-a3ab-57c2eeb9ff3b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:00.787114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072a033-ad5a-4a80-938a-86e90df7eded None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:00.813379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a43ec-befd-4e82-83f8-0e5bb90439ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:00.815745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a43ec-befd-4e82-83f8-0e5bb90439ed admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:00.816297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a43ec-befd-4e82-83f8-0e5bb90439ed admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:00.817027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a43ec-befd-4e82-83f8-0e5bb90439ed admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:00.818118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a43ec-befd-4e82-83f8-0e5bb90439ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:00.821553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a43ec-befd-4e82-83f8-0e5bb90439ed admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:00.876793 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2288/4504] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Jul 16 21:22:00 2022] PUT /identity/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d => generated 521 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:00.881644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72eb38c-9609-4238-a3ab-57c2eeb9ff3b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:00.982920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:00.998200 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2217/4505] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:22:00 2022] POST /identity/v3/projects => generated 409 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:00.999660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a43ec-befd-4e82-83f8-0e5bb90439ed admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:01.008491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72eb38c-9609-4238-a3ab-57c2eeb9ff3b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:01.160431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbacec1-6158-4ef2-8763-e95b0bf8c9f2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:01.160682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a43ec-befd-4e82-83f8-0e5bb90439ed admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:01.161378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbacec1-6158-4ef2-8763-e95b0bf8c9f2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:01.163502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbacec1-6158-4ef2-8763-e95b0bf8c9f2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:01.163799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbacec1-6158-4ef2-8763-e95b0bf8c9f2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/58264627182b4a198fc25cc031282c49` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:01.170807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbacec1-6158-4ef2-8763-e95b0bf8c9f2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c27ae8ee177b4b71b2ab962e88913533, implied_role_id=58264627182b4a198fc25cc031282c49)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:01.173701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbacec1-6158-4ef2-8763-e95b0bf8c9f2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:01.177010 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb238a1-ae29-48f1-a9e4-910d365904d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:01.179038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb238a1-ae29-48f1-a9e4-910d365904d5 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:01.179666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb238a1-ae29-48f1-a9e4-910d365904d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:01.180342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb238a1-ae29-48f1-a9e4-910d365904d5 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:01.181574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb238a1-ae29-48f1-a9e4-910d365904d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:01.184178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb238a1-ae29-48f1-a9e4-910d365904d5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:01.214103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:01.342331 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2289/4506] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Jul 16 21:22:00 2022] PUT /identity/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/58264627182b4a198fc25cc031282c49 => generated 519 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:01.352017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbacec1-6158-4ef2-8763-e95b0bf8c9f2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:01.396624 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2218/4507] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:22:00 2022] POST /identity/v3/users => generated 311 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:01.400371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb238a1-ae29-48f1-a9e4-910d365904d5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:01.431667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb238a1-ae29-48f1-a9e4-910d365904d5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:01.466275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbacec1-6158-4ef2-8763-e95b0bf8c9f2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:01.473858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d1234-1be4-48ad-bd26-5ca74270735d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:01.475476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d1234-1be4-48ad-bd26-5ca74270735d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:01.475614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d1234-1be4-48ad-bd26-5ca74270735d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:01.475811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d1234-1be4-48ad-bd26-5ca74270735d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/58264627182b4a198fc25cc031282c49/implies/c8da004e2606443c8f05e1e17f60967d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:01.478244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d1234-1be4-48ad-bd26-5ca74270735d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=58264627182b4a198fc25cc031282c49, implied_role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:01.480477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d1234-1be4-48ad-bd26-5ca74270735d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:01.561579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d22c8-bc95-4714-8e7f-146ea2a9a1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:01.568729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d22c8-bc95-4714-8e7f-146ea2a9a1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:01.568729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d22c8-bc95-4714-8e7f-146ea2a9a1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:01.568729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d22c8-bc95-4714-8e7f-146ea2a9a1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:01.568729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d22c8-bc95-4714-8e7f-146ea2a9a1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:01.568729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d22c8-bc95-4714-8e7f-146ea2a9a1a9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:01.590651 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2219/4508] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:01 2022] GET /identity/v3/roles => generated 2322 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:01.595571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d22c8-bc95-4714-8e7f-146ea2a9a1a9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:01.608799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d22c8-bc95-4714-8e7f-146ea2a9a1a9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:01.632118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6d562-89aa-40c4-a64d-66e1058cda0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:01.633262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6d562-89aa-40c4-a64d-66e1058cda0d admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:01.633870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6d562-89aa-40c4-a64d-66e1058cda0d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:01.634346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6d562-89aa-40c4-a64d-66e1058cda0d admin admin] PATH_INFO: `/v3/projects/f2b7791ebf2e45a69be8b35bcd19e7bb/users/8ce07615fe564ba1bc76e135278b3a22/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:01.653606 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2290/4509] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Jul 16 21:22:01 2022] PUT /identity/v3/roles/58264627182b4a198fc25cc031282c49/implies/c8da004e2606443c8f05e1e17f60967d => generated 519 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:01.654691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d1234-1be4-48ad-bd26-5ca74270735d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:01.657207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6d562-89aa-40c4-a64d-66e1058cda0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b7791ebf2e45a69be8b35bcd19e7bb, user_id=8ce07615fe564ba1bc76e135278b3a22, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:01.660783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6d562-89aa-40c4-a64d-66e1058cda0d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:01.748532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d1234-1be4-48ad-bd26-5ca74270735d tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:01.755419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931a366-26cc-4cc7-8152-921a34b62282 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:01.757014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931a366-26cc-4cc7-8152-921a34b62282 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:01.757254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931a366-26cc-4cc7-8152-921a34b62282 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:01.757443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931a366-26cc-4cc7-8152-921a34b62282 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/58264627182b4a198fc25cc031282c49/implies` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:01.759044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931a366-26cc-4cc7-8152-921a34b62282 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=58264627182b4a198fc25cc031282c49)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:01.760307 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-5931a366-26cc-4cc7-8152-921a34b62282 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:22:01.760307 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:22:01.760307 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:22:01.761199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931a366-26cc-4cc7-8152-921a34b62282 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:01.769342 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2291/4510] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Jul 16 21:22:01 2022] GET /identity/v3/roles/58264627182b4a198fc25cc031282c49/implies => generated 488 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:22:01.772727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931a366-26cc-4cc7-8152-921a34b62282 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:01.786187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931a366-26cc-4cc7-8152-921a34b62282 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:01.792691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14335945-d3cd-4957-8491-3b5797e8b2ba tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:01.793670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14335945-d3cd-4957-8491-3b5797e8b2ba tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:01.794144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14335945-d3cd-4957-8491-3b5797e8b2ba tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:01.794642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14335945-d3cd-4957-8491-3b5797e8b2ba tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:01.796406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14335945-d3cd-4957-8491-3b5797e8b2ba tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=c27ae8ee177b4b71b2ab962e88913533)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:01.798940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14335945-d3cd-4957-8491-3b5797e8b2ba tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:01.812466 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2292/4511] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Jul 16 21:22:01 2022] GET /identity/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies => generated 659 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:22:01.819437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14335945-d3cd-4957-8491-3b5797e8b2ba tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:01.832336 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2220/4512] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:01 2022] PUT /identity/v3/projects/f2b7791ebf2e45a69be8b35bcd19e7bb/users/8ce07615fe564ba1bc76e135278b3a22/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:22:01.835945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6d562-89aa-40c4-a64d-66e1058cda0d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:01.840741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14335945-d3cd-4957-8491-3b5797e8b2ba tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:01.954037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6d562-89aa-40c4-a64d-66e1058cda0d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:01.961813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f817ece-92d1-4017-88c6-3b2ad430ca30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:01.963954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f817ece-92d1-4017-88c6-3b2ad430ca30 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:01.964419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f817ece-92d1-4017-88c6-3b2ad430ca30 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:01.964944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f817ece-92d1-4017-88c6-3b2ad430ca30 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:01.966675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f817ece-92d1-4017-88c6-3b2ad430ca30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:01.985020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f817ece-92d1-4017-88c6-3b2ad430ca30 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:02.002963 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2221/4513] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:01 2022] GET /identity/v3/roles => generated 2322 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:02.013599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f817ece-92d1-4017-88c6-3b2ad430ca30 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:02.021539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f817ece-92d1-4017-88c6-3b2ad430ca30 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:02.024720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1384529-bb49-4256-abc5-e31a69901ee2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:02.025724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1384529-bb49-4256-abc5-e31a69901ee2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:02.026665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b666818-4c94-4b41-ba22-03c003aa6857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:02.027295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1384529-bb49-4256-abc5-e31a69901ee2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:02.027552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1384529-bb49-4256-abc5-e31a69901ee2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/58264627182b4a198fc25cc031282c49/implies/c8da004e2606443c8f05e1e17f60967d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:02.029336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1384529-bb49-4256-abc5-e31a69901ee2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=58264627182b4a198fc25cc031282c49, implied_role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:02.031603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1384529-bb49-4256-abc5-e31a69901ee2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:02.036409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b666818-4c94-4b41-ba22-03c003aa6857 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:02.036409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b666818-4c94-4b41-ba22-03c003aa6857 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:02.036409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b666818-4c94-4b41-ba22-03c003aa6857 admin admin] PATH_INFO: `/v3/projects/f2b7791ebf2e45a69be8b35bcd19e7bb/users/8ce07615fe564ba1bc76e135278b3a22/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:02.037039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b666818-4c94-4b41-ba22-03c003aa6857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b7791ebf2e45a69be8b35bcd19e7bb, user_id=8ce07615fe564ba1bc76e135278b3a22, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:02.039762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b666818-4c94-4b41-ba22-03c003aa6857 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:02.054776 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2222/4514] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:02 2022] PUT /identity/v3/projects/f2b7791ebf2e45a69be8b35bcd19e7bb/users/8ce07615fe564ba1bc76e135278b3a22/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:02.066161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500d1af-6c86-4565-aa82-05b7c942d4eb None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:02.066456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500d1af-6c86-4565-aa82-05b7c942d4eb None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:02.066737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500d1af-6c86-4565-aa82-05b7c942d4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:02.096961 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2293/4515] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Jul 16 21:22:01 2022] DELETE /identity/v3/roles/58264627182b4a198fc25cc031282c49/implies/c8da004e2606443c8f05e1e17f60967d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:02.101142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1384529-bb49-4256-abc5-e31a69901ee2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:02.103794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b500d1af-6c86-4565-aa82-05b7c942d4eb None None] MFA Rules not processed for user `8ce07615fe564ba1bc76e135278b3a22`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:02.106868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b500d1af-6c86-4565-aa82-05b7c942d4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:02.213539 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2223/4516] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:02 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:02.220471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500d1af-6c86-4565-aa82-05b7c942d4eb None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:02.222426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b500d1af-6c86-4565-aa82-05b7c942d4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:02.235475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1384529-bb49-4256-abc5-e31a69901ee2 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:02.249521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1833fe1-030d-4bb3-af1a-290d631e3add tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:02.250530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1833fe1-030d-4bb3-af1a-290d631e3add tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:02.250810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1833fe1-030d-4bb3-af1a-290d631e3add tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:02.251119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1833fe1-030d-4bb3-af1a-290d631e3add tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/58264627182b4a198fc25cc031282c49` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:02.253481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1833fe1-030d-4bb3-af1a-290d631e3add tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c27ae8ee177b4b71b2ab962e88913533, implied_role_id=58264627182b4a198fc25cc031282c49)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:02.255341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1833fe1-030d-4bb3-af1a-290d631e3add tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:02.345341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500d1af-6c86-4565-aa82-05b7c942d4eb None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:02.349530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f23ed8-c149-443b-8bf7-1b3729c6ee2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:02.351044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f23ed8-c149-443b-8bf7-1b3729c6ee2a service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:02.351044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f23ed8-c149-443b-8bf7-1b3729c6ee2a service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:02.351044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f23ed8-c149-443b-8bf7-1b3729c6ee2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:02.361914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f23ed8-c149-443b-8bf7-1b3729c6ee2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:02.365149 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2294/4517] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Jul 16 21:22:02 2022] DELETE /identity/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/58264627182b4a198fc25cc031282c49 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:22:02.366625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f23ed8-c149-443b-8bf7-1b3729c6ee2a service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:02.369717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1833fe1-030d-4bb3-af1a-290d631e3add tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:02.383626 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2224/4518] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:22:02 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:22:02.464883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1833fe1-030d-4bb3-af1a-290d631e3add tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:02.470836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7248ca2-726c-4ebb-8fa2-89b0fda3cf8c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:02.471923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7248ca2-726c-4ebb-8fa2-89b0fda3cf8c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:02.472630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7248ca2-726c-4ebb-8fa2-89b0fda3cf8c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:02.472630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7248ca2-726c-4ebb-8fa2-89b0fda3cf8c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:02.474219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7248ca2-726c-4ebb-8fa2-89b0fda3cf8c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c27ae8ee177b4b71b2ab962e88913533, implied_role_id=ed3ba6080bac49c990e47d1c1ee8741d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:02.475891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7248ca2-726c-4ebb-8fa2-89b0fda3cf8c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:02.507042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:02.564256 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2295/4519] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Jul 16 21:22:02 2022] DELETE /identity/v3/roles/c27ae8ee177b4b71b2ab962e88913533/implies/ed3ba6080bac49c990e47d1c1ee8741d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:22:02.571247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f23ed8-c149-443b-8bf7-1b3729c6ee2a service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:02.583872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f23ed8-c149-443b-8bf7-1b3729c6ee2a service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:02.654719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b117d77-1a6a-4dde-963a-433cdecd6c11 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:02.657605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b117d77-1a6a-4dde-963a-433cdecd6c11 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:02.658130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b117d77-1a6a-4dde-963a-433cdecd6c11 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:02.658623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b117d77-1a6a-4dde-963a-433cdecd6c11 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/domains/91bdac0c55594f41877c7b3d65dc32f2` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:02.668017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b117d77-1a6a-4dde-963a-433cdecd6c11 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 21:22:02.682464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-6b117d77-1a6a-4dde-963a-433cdecd6c11 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Could not find domain: 91bdac0c55594f41877c7b3d65dc32f2.: keystone.exception.DomainNotFound: Could not find domain: 91bdac0c55594f41877c7b3d65dc32f2. Jul 16 21:22:02.682464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:22:02.682464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 16 21:22:02.682464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 16 21:22:02.682464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 21:22:02.682464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 21:22:02.682464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 21:22:02.682464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 21:22:02.682464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 91bdac0c55594f41877c7b3d65dc32f2. Jul 16 21:22:02.682464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:22:02.682464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:22:02.682464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:22:02.682464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:22:02.682464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:22:02.682464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:22:02.682464 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:22:02.683650 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:22:02.683650 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:22:02.683650 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:22:02.683650 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:22:02.683650 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:22:02.683650 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:22:02.683650 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:22:02.683650 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 16 21:22:02.683650 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 16 21:22:02.683650 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 21:22:02.683650 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 21:22:02.683650 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 21:22:02.683650 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 21:22:02.683650 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:22:02.683650 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:22:02.683650 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:22:02.685698 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:22:02.685698 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:22:02.685698 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:22:02.685698 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:22:02.685698 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 21:22:02.685698 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:22:02.685698 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:22:02.685698 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:22:02.685698 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:22:02.685698 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:22:02.685698 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:22:02.685698 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:22:02.685698 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:22:02.685698 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 16 21:22:02.685698 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 21:22:02.685698 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 91bdac0c55594f41877c7b3d65dc32f2. Jul 16 21:22:02.685698 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:22:02.686790 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2225/4520] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:22:02 2022] PATCH /identity/v3/domains/91bdac0c55594f41877c7b3d65dc32f2 => generated 112 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:22:02.689642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7248ca2-726c-4ebb-8fa2-89b0fda3cf8c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:02.727753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7248ca2-726c-4ebb-8fa2-89b0fda3cf8c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:02.733930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff5b39-ad3a-45fc-ae7f-6fd7ca72f536 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:02.735480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff5b39-ad3a-45fc-ae7f-6fd7ca72f536 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:02.735773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff5b39-ad3a-45fc-ae7f-6fd7ca72f536 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:02.736047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff5b39-ad3a-45fc-ae7f-6fd7ca72f536 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/users/c45754429aec40f096c1463d89f157b2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:02.738255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff5b39-ad3a-45fc-ae7f-6fd7ca72f536 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c45754429aec40f096c1463d89f157b2)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:02.740737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff5b39-ad3a-45fc-ae7f-6fd7ca72f536 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:02.856729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-61ff5b39-ad3a-45fc-ae7f-6fd7ca72f536 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c45754429aec40f096c1463d89f157b2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:02.869720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-61ff5b39-ad3a-45fc-ae7f-6fd7ca72f536 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c45754429aec40f096c1463d89f157b2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:02.874245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:02.952296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-61ff5b39-ad3a-45fc-ae7f-6fd7ca72f536 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c45754429aec40f096c1463d89f157b2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:02.955430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-61ff5b39-ad3a-45fc-ae7f-6fd7ca72f536 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c45754429aec40f096c1463d89f157b2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:02.969529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-61ff5b39-ad3a-45fc-ae7f-6fd7ca72f536 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c45754429aec40f096c1463d89f157b2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:02.975729 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2296/4521] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:22:02 2022] DELETE /identity/v3/users/c45754429aec40f096c1463d89f157b2 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:02.980429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b117d77-1a6a-4dde-963a-433cdecd6c11 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:02.983924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6b117d77-1a6a-4dde-963a-433cdecd6c11 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:02.998962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b117d77-1a6a-4dde-963a-433cdecd6c11 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:03.085113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3c5ed-a3a9-4357-aab6-9de0530ab7bf tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:03.087958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3c5ed-a3a9-4357-aab6-9de0530ab7bf tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:03.088658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3c5ed-a3a9-4357-aab6-9de0530ab7bf tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:03.089643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3c5ed-a3a9-4357-aab6-9de0530ab7bf tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c8da004e2606443c8f05e1e17f60967d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:03.094680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3c5ed-a3a9-4357-aab6-9de0530ab7bf tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c8da004e2606443c8f05e1e17f60967d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:03.097590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3c5ed-a3a9-4357-aab6-9de0530ab7bf tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:03.231484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-feb3c5ed-a3a9-4357-aab6-9de0530ab7bf tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invalidating the token cache because role c8da004e2606443c8f05e1e17f60967d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:03.231791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-feb3c5ed-a3a9-4357-aab6-9de0530ab7bf tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:03.232453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-feb3c5ed-a3a9-4357-aab6-9de0530ab7bf tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:03.235705 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2226/4522] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:22:02 2022] DELETE /identity/v3/roles/c8da004e2606443c8f05e1e17f60967d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:03.240183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff5b39-ad3a-45fc-ae7f-6fd7ca72f536 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:03.257461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff5b39-ad3a-45fc-ae7f-6fd7ca72f536 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:03.331360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199421c-0811-4b6b-98ba-97b7577c01f7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:03.332334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199421c-0811-4b6b-98ba-97b7577c01f7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:03.333187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199421c-0811-4b6b-98ba-97b7577c01f7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:03.333187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199421c-0811-4b6b-98ba-97b7577c01f7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/groups/023ab4f93ff2409ebe3654774b8b323c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:03.334969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199421c-0811-4b6b-98ba-97b7577c01f7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_group(group_id=023ab4f93ff2409ebe3654774b8b323c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:03.337065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199421c-0811-4b6b-98ba-97b7577c01f7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:03.474307 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2297/4523] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Jul 16 21:22:03 2022] DELETE /identity/v3/groups/023ab4f93ff2409ebe3654774b8b323c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:22:03.478850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3c5ed-a3a9-4357-aab6-9de0530ab7bf tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:03.480474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-feb3c5ed-a3a9-4357-aab6-9de0530ab7bf tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:03.496685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3c5ed-a3a9-4357-aab6-9de0530ab7bf tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:03.561493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db239126-dc3f-4c21-9311-8e224288ea60 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:03.563767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db239126-dc3f-4c21-9311-8e224288ea60 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:03.564620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db239126-dc3f-4c21-9311-8e224288ea60 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:03.564914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db239126-dc3f-4c21-9311-8e224288ea60 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/projects/14f73d9f9df742988baa1e53192acb7f` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:03.566351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db239126-dc3f-4c21-9311-8e224288ea60 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_project(project_id=14f73d9f9df742988baa1e53192acb7f)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:03.569354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db239126-dc3f-4c21-9311-8e224288ea60 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:03.673158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:03.689314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-db239126-dc3f-4c21-9311-8e224288ea60 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14f73d9f9df742988baa1e53192acb7f', 'request_id': 'req-db239126-dc3f-4c21-9311-8e224288ea60'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:03.696472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-db239126-dc3f-4c21-9311-8e224288ea60 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14f73d9f9df742988baa1e53192acb7f', 'request_id': 'req-db239126-dc3f-4c21-9311-8e224288ea60'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:03.705285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-db239126-dc3f-4c21-9311-8e224288ea60 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14f73d9f9df742988baa1e53192acb7f', 'request_id': 'req-db239126-dc3f-4c21-9311-8e224288ea60'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:03.811169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-db239126-dc3f-4c21-9311-8e224288ea60 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] The token cache is being invalidate because project 14f73d9f9df742988baa1e53192acb7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:03.811769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-db239126-dc3f-4c21-9311-8e224288ea60 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:03.814235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-db239126-dc3f-4c21-9311-8e224288ea60 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:03.818293 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2227/4524] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:22:03 2022] DELETE /identity/v3/projects/14f73d9f9df742988baa1e53192acb7f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:03.822315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199421c-0811-4b6b-98ba-97b7577c01f7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:03.824948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6199421c-0811-4b6b-98ba-97b7577c01f7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:03.855052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199421c-0811-4b6b-98ba-97b7577c01f7 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:03.928154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729789af-0c42-4933-8626-becc05c6064b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:03.928154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729789af-0c42-4933-8626-becc05c6064b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:03.928154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729789af-0c42-4933-8626-becc05c6064b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:03.928474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729789af-0c42-4933-8626-becc05c6064b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/domains/2e571cc5fa7d423b9fa0c96e61964ccc` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:03.930688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729789af-0c42-4933-8626-becc05c6064b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2e571cc5fa7d423b9fa0c96e61964ccc)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:03.932485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729789af-0c42-4933-8626-becc05c6064b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:03.962455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-729789af-0c42-4933-8626-becc05c6064b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2e571cc5fa7d423b9fa0c96e61964ccc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:03.963557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-729789af-0c42-4933-8626-becc05c6064b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2e571cc5fa7d423b9fa0c96e61964ccc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:04.014576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:04.179360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-729789af-0c42-4933-8626-becc05c6064b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2e571cc5fa7d423b9fa0c96e61964ccc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:04.179588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-729789af-0c42-4933-8626-becc05c6064b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2e571cc5fa7d423b9fa0c96e61964ccc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:04.185008 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2298/4525] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:22:03 2022] PATCH /identity/v3/domains/2e571cc5fa7d423b9fa0c96e61964ccc => generated 278 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:22:04.186433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db239126-dc3f-4c21-9311-8e224288ea60 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:04.197391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db239126-dc3f-4c21-9311-8e224288ea60 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:04.285909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e4593-a654-4ad4-ba54-9a1d87142e70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:04.286850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e4593-a654-4ad4-ba54-9a1d87142e70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:04.287238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e4593-a654-4ad4-ba54-9a1d87142e70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:04.287523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e4593-a654-4ad4-ba54-9a1d87142e70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/domains/2e571cc5fa7d423b9fa0c96e61964ccc` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:04.300660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e4593-a654-4ad4-ba54-9a1d87142e70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2e571cc5fa7d423b9fa0c96e61964ccc)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:04.302851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e4593-a654-4ad4-ba54-9a1d87142e70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:04.361136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-517e4593-a654-4ad4-ba54-9a1d87142e70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2e571cc5fa7d423b9fa0c96e61964ccc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:04.372475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-517e4593-a654-4ad4-ba54-9a1d87142e70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2e571cc5fa7d423b9fa0c96e61964ccc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:04.541244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-517e4593-a654-4ad4-ba54-9a1d87142e70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e571cc5fa7d423b9fa0c96e61964ccc', 'request_id': 'req-517e4593-a654-4ad4-ba54-9a1d87142e70'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:04.546758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-517e4593-a654-4ad4-ba54-9a1d87142e70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e571cc5fa7d423b9fa0c96e61964ccc', 'request_id': 'req-517e4593-a654-4ad4-ba54-9a1d87142e70'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:04.553606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-517e4593-a654-4ad4-ba54-9a1d87142e70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e571cc5fa7d423b9fa0c96e61964ccc', 'request_id': 'req-517e4593-a654-4ad4-ba54-9a1d87142e70'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:04.662388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-517e4593-a654-4ad4-ba54-9a1d87142e70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] The token cache is being invalidate because project 2e571cc5fa7d423b9fa0c96e61964ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:04.663086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-517e4593-a654-4ad4-ba54-9a1d87142e70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:04.663875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-517e4593-a654-4ad4-ba54-9a1d87142e70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:04.672663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-517e4593-a654-4ad4-ba54-9a1d87142e70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2e571cc5fa7d423b9fa0c96e61964ccc', 'request_id': 'req-517e4593-a654-4ad4-ba54-9a1d87142e70'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:04.673365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-517e4593-a654-4ad4-ba54-9a1d87142e70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2e571cc5fa7d423b9fa0c96e61964ccc', 'request_id': 'req-517e4593-a654-4ad4-ba54-9a1d87142e70'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:04.674005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-517e4593-a654-4ad4-ba54-9a1d87142e70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2e571cc5fa7d423b9fa0c96e61964ccc', 'request_id': 'req-517e4593-a654-4ad4-ba54-9a1d87142e70'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:04.692479 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2228/4526] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:22:04 2022] DELETE /identity/v3/domains/2e571cc5fa7d423b9fa0c96e61964ccc => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:04.693162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729789af-0c42-4933-8626-becc05c6064b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:04.693162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-729789af-0c42-4933-8626-becc05c6064b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:04.709194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729789af-0c42-4933-8626-becc05c6064b tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:04.798862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766bf90-9713-4428-b101-bd82e3de838f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:04.799736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766bf90-9713-4428-b101-bd82e3de838f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:04.800029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766bf90-9713-4428-b101-bd82e3de838f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:04.800311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766bf90-9713-4428-b101-bd82e3de838f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/58264627182b4a198fc25cc031282c49` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:04.802773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766bf90-9713-4428-b101-bd82e3de838f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_role(role_id=58264627182b4a198fc25cc031282c49)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:04.804450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766bf90-9713-4428-b101-bd82e3de838f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:04.916582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f766bf90-9713-4428-b101-bd82e3de838f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invalidating the token cache because role 58264627182b4a198fc25cc031282c49 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:04.917286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f766bf90-9713-4428-b101-bd82e3de838f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:04.918195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f766bf90-9713-4428-b101-bd82e3de838f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:04.930424 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2299/4527] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:22:04 2022] DELETE /identity/v3/roles/58264627182b4a198fc25cc031282c49 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:22:04.934750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e4593-a654-4ad4-ba54-9a1d87142e70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:04.939263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-517e4593-a654-4ad4-ba54-9a1d87142e70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:04.958646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e4593-a654-4ad4-ba54-9a1d87142e70 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:05.025216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1fa47-2268-4025-855a-48482408dd6c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:05.026100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1fa47-2268-4025-855a-48482408dd6c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:05.026384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1fa47-2268-4025-855a-48482408dd6c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:05.026660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1fa47-2268-4025-855a-48482408dd6c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/ed3ba6080bac49c990e47d1c1ee8741d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:05.028160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1fa47-2268-4025-855a-48482408dd6c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ed3ba6080bac49c990e47d1c1ee8741d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:05.029760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1fa47-2268-4025-855a-48482408dd6c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:05.204062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dfe1fa47-2268-4025-855a-48482408dd6c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invalidating the token cache because role ed3ba6080bac49c990e47d1c1ee8741d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:05.204418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dfe1fa47-2268-4025-855a-48482408dd6c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:05.205045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dfe1fa47-2268-4025-855a-48482408dd6c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:05.210105 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2229/4528] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:22:04 2022] DELETE /identity/v3/roles/ed3ba6080bac49c990e47d1c1ee8741d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:05.211294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766bf90-9713-4428-b101-bd82e3de838f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:05.213989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f766bf90-9713-4428-b101-bd82e3de838f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:05.228283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766bf90-9713-4428-b101-bd82e3de838f tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:05.296105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc09495-4e7f-4e76-b87d-a0633b8629e8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a88791844842b8ba56a415f67f224e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c347b158466a46ea9886d5b2ba3b95c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:05.297577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc09495-4e7f-4e76-b87d-a0633b8629e8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:05.297863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc09495-4e7f-4e76-b87d-a0633b8629e8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:05.298138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc09495-4e7f-4e76-b87d-a0633b8629e8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] PATH_INFO: `/v3/roles/c27ae8ee177b4b71b2ab962e88913533` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:05.299726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc09495-4e7f-4e76-b87d-a0633b8629e8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c27ae8ee177b4b71b2ab962e88913533)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:05.301922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc09495-4e7f-4e76-b87d-a0633b8629e8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:05.413095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5bc09495-4e7f-4e76-b87d-a0633b8629e8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invalidating the token cache because role c27ae8ee177b4b71b2ab962e88913533 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:05.413459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5bc09495-4e7f-4e76-b87d-a0633b8629e8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:05.416191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5bc09495-4e7f-4e76-b87d-a0633b8629e8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:05.422789 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2300/4529] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:22:05 2022] DELETE /identity/v3/roles/c27ae8ee177b4b71b2ab962e88913533 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:05.430764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1fa47-2268-4025-855a-48482408dd6c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:05.434201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-dfe1fa47-2268-4025-855a-48482408dd6c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:05.541890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1fa47-2268-4025-855a-48482408dd6c tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:05.610461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b7225-8aa9-4b71-a4ab-8c0930ee1dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:05.611518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b7225-8aa9-4b71-a4ab-8c0930ee1dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:05.611927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b7225-8aa9-4b71-a4ab-8c0930ee1dec admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:05.612241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b7225-8aa9-4b71-a4ab-8c0930ee1dec admin admin] PATH_INFO: `/v3/users/3e11efd60bf0462487909aacb277454d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:05.613633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b7225-8aa9-4b71-a4ab-8c0930ee1dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e11efd60bf0462487909aacb277454d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:05.615750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b7225-8aa9-4b71-a4ab-8c0930ee1dec admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:05.701711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc09495-4e7f-4e76-b87d-a0633b8629e8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:05.703472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5bc09495-4e7f-4e76-b87d-a0633b8629e8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:05.725957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc09495-4e7f-4e76-b87d-a0633b8629e8 tempest-RolesV3TestJSON-391215221 tempest-RolesV3TestJSON-391215221-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:05.732983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea0730-1ecf-4a83-a9ec-5fcb6b0f13dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:05.734589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea0730-1ecf-4a83-a9ec-5fcb6b0f13dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:05.735140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea0730-1ecf-4a83-a9ec-5fcb6b0f13dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:05.735506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea0730-1ecf-4a83-a9ec-5fcb6b0f13dd admin admin] PATH_INFO: `/v3/users/a4006a038b2e4a86965c6d01ad929c93` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:05.736784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea0730-1ecf-4a83-a9ec-5fcb6b0f13dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4006a038b2e4a86965c6d01ad929c93)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:05.739901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea0730-1ecf-4a83-a9ec-5fcb6b0f13dd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:05.920251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-621b7225-8aa9-4b71-a4ab-8c0930ee1dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e11efd60bf0462487909aacb277454d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:05.935047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-621b7225-8aa9-4b71-a4ab-8c0930ee1dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e11efd60bf0462487909aacb277454d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:06.032873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-daea0730-1ecf-4a83-a9ec-5fcb6b0f13dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4006a038b2e4a86965c6d01ad929c93'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:06.040208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-daea0730-1ecf-4a83-a9ec-5fcb6b0f13dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4006a038b2e4a86965c6d01ad929c93'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:06.043225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-621b7225-8aa9-4b71-a4ab-8c0930ee1dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e11efd60bf0462487909aacb277454d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:06.056257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-621b7225-8aa9-4b71-a4ab-8c0930ee1dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e11efd60bf0462487909aacb277454d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:06.058158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-621b7225-8aa9-4b71-a4ab-8c0930ee1dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e11efd60bf0462487909aacb277454d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:06.074899 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2230/4530] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:22:05 2022] DELETE /identity/v3/users/3e11efd60bf0462487909aacb277454d => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:06.076952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c2912-ca6a-48fc-93c3-2f44aad4a57d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:06.078451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c2912-ca6a-48fc-93c3-2f44aad4a57d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:06.078966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c2912-ca6a-48fc-93c3-2f44aad4a57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:06.107452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c24c2912-ca6a-48fc-93c3-2f44aad4a57d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:06.110965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c24c2912-ca6a-48fc-93c3-2f44aad4a57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:06.136196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-daea0730-1ecf-4a83-a9ec-5fcb6b0f13dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4006a038b2e4a86965c6d01ad929c93'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:06.136831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-daea0730-1ecf-4a83-a9ec-5fcb6b0f13dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4006a038b2e4a86965c6d01ad929c93'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:06.155531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-daea0730-1ecf-4a83-a9ec-5fcb6b0f13dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4006a038b2e4a86965c6d01ad929c93'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:06.163451 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2301/4531] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:22:05 2022] DELETE /identity/v3/users/a4006a038b2e4a86965c6d01ad929c93 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:06.165286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:06.168395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87102f8d-c0e5-4c25-9188-8a5dcff96a70 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:06.168931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87102f8d-c0e5-4c25-9188-8a5dcff96a70 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:06.171664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87102f8d-c0e5-4c25-9188-8a5dcff96a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:06.195146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-87102f8d-c0e5-4c25-9188-8a5dcff96a70 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:06.196645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-87102f8d-c0e5-4c25-9188-8a5dcff96a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:06.206036 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2231/4532] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:06.217794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c2912-ca6a-48fc-93c3-2f44aad4a57d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:06.219902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c24c2912-ca6a-48fc-93c3-2f44aad4a57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:06.313200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c2912-ca6a-48fc-93c3-2f44aad4a57d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:06.344849 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2302/4533] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:06.356237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87102f8d-c0e5-4c25-9188-8a5dcff96a70 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:06.390729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963ddb1-313f-48db-8b71-ba8e0ba58b0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:06.392075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963ddb1-313f-48db-8b71-ba8e0ba58b0b service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:06.392366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963ddb1-313f-48db-8b71-ba8e0ba58b0b service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:06.393552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963ddb1-313f-48db-8b71-ba8e0ba58b0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:06.404478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963ddb1-313f-48db-8b71-ba8e0ba58b0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:06.407635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963ddb1-313f-48db-8b71-ba8e0ba58b0b service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:06.421715 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2232/4534] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:22:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:22:06.428991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87102f8d-c0e5-4c25-9188-8a5dcff96a70 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:06.434551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c85cb6-6c8f-4a62-8368-3dcdec7936c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:06.435685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c85cb6-6c8f-4a62-8368-3dcdec7936c4 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:06.435685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c85cb6-6c8f-4a62-8368-3dcdec7936c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:06.435846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c85cb6-6c8f-4a62-8368-3dcdec7936c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:06.448357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c85cb6-6c8f-4a62-8368-3dcdec7936c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:06.449900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c85cb6-6c8f-4a62-8368-3dcdec7936c4 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:06.463063 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2303/4535] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:22:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:22:06.716622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:07.119333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963ddb1-313f-48db-8b71-ba8e0ba58b0b service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:07.121780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6963ddb1-313f-48db-8b71-ba8e0ba58b0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:07.163880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963ddb1-313f-48db-8b71-ba8e0ba58b0b service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:07.169717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d881e4e-07f3-4cf9-9f33-5c02afc4847f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:07.170827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d881e4e-07f3-4cf9-9f33-5c02afc4847f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:07.171168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d881e4e-07f3-4cf9-9f33-5c02afc4847f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:07.172187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d881e4e-07f3-4cf9-9f33-5c02afc4847f admin admin] PATH_INFO: `/v3/projects/fa16ebcffab741799fcbd30176908619` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:07.173923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d881e4e-07f3-4cf9-9f33-5c02afc4847f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa16ebcffab741799fcbd30176908619)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:07.176437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d881e4e-07f3-4cf9-9f33-5c02afc4847f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:07.216330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c85cb6-6c8f-4a62-8368-3dcdec7936c4 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:07.217922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c7c85cb6-6c8f-4a62-8368-3dcdec7936c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:07.235447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c85cb6-6c8f-4a62-8368-3dcdec7936c4 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:07.240792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477057a-d573-468c-a637-9de052e6af89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:07.242160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477057a-d573-468c-a637-9de052e6af89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:07.242492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477057a-d573-468c-a637-9de052e6af89 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:07.242779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477057a-d573-468c-a637-9de052e6af89 admin admin] PATH_INFO: `/v3/projects/780eb756635a4647a00599ab1085853c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:07.244212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477057a-d573-468c-a637-9de052e6af89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=780eb756635a4647a00599ab1085853c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:07.250213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477057a-d573-468c-a637-9de052e6af89 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:07.324146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0d881e4e-07f3-4cf9-9f33-5c02afc4847f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa16ebcffab741799fcbd30176908619', 'request_id': 'req-0d881e4e-07f3-4cf9-9f33-5c02afc4847f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:07.337278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0d881e4e-07f3-4cf9-9f33-5c02afc4847f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa16ebcffab741799fcbd30176908619', 'request_id': 'req-0d881e4e-07f3-4cf9-9f33-5c02afc4847f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:07.345089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0d881e4e-07f3-4cf9-9f33-5c02afc4847f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa16ebcffab741799fcbd30176908619', 'request_id': 'req-0d881e4e-07f3-4cf9-9f33-5c02afc4847f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:07.413971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a477057a-d573-468c-a637-9de052e6af89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '780eb756635a4647a00599ab1085853c', 'request_id': 'req-a477057a-d573-468c-a637-9de052e6af89'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:07.422176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a477057a-d573-468c-a637-9de052e6af89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '780eb756635a4647a00599ab1085853c', 'request_id': 'req-a477057a-d573-468c-a637-9de052e6af89'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:07.430225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a477057a-d573-468c-a637-9de052e6af89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '780eb756635a4647a00599ab1085853c', 'request_id': 'req-a477057a-d573-468c-a637-9de052e6af89'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:07.433913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0d881e4e-07f3-4cf9-9f33-5c02afc4847f admin admin] The token cache is being invalidate because project fa16ebcffab741799fcbd30176908619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:07.433913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0d881e4e-07f3-4cf9-9f33-5c02afc4847f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:07.435897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0d881e4e-07f3-4cf9-9f33-5c02afc4847f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:07.437275 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2233/4536] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:22:07 2022] DELETE /identity/v3/projects/fa16ebcffab741799fcbd30176908619 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:07.441542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d881e4e-07f3-4cf9-9f33-5c02afc4847f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:07.444302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0d881e4e-07f3-4cf9-9f33-5c02afc4847f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:07.548106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d881e4e-07f3-4cf9-9f33-5c02afc4847f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:07.565152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a477057a-d573-468c-a637-9de052e6af89 admin admin] The token cache is being invalidate because project 780eb756635a4647a00599ab1085853c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:07.565557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a477057a-d573-468c-a637-9de052e6af89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:07.567798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a477057a-d573-468c-a637-9de052e6af89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:07.572401 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2304/4537] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:22:07 2022] DELETE /identity/v3/projects/780eb756635a4647a00599ab1085853c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:22:07.576439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477057a-d573-468c-a637-9de052e6af89 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:07.582608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a477057a-d573-468c-a637-9de052e6af89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:07.646159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce90b95-b30a-4d48-a4d8-e99d3db31bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:07.647673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce90b95-b30a-4d48-a4d8-e99d3db31bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:07.648224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce90b95-b30a-4d48-a4d8-e99d3db31bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:07.648651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce90b95-b30a-4d48-a4d8-e99d3db31bc7 admin admin] PATH_INFO: `/v3/users/48a88791844842b8ba56a415f67f224e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:07.650808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce90b95-b30a-4d48-a4d8-e99d3db31bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48a88791844842b8ba56a415f67f224e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:07.653931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce90b95-b30a-4d48-a4d8-e99d3db31bc7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:07.727517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477057a-d573-468c-a637-9de052e6af89 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:07.733173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84021639-8532-471b-b931-ff137717ace9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:07.734644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84021639-8532-471b-b931-ff137717ace9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:07.734933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84021639-8532-471b-b931-ff137717ace9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:07.735248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84021639-8532-471b-b931-ff137717ace9 admin admin] PATH_INFO: `/v3/users/8ce07615fe564ba1bc76e135278b3a22` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:07.736485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84021639-8532-471b-b931-ff137717ace9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ce07615fe564ba1bc76e135278b3a22)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:07.738816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84021639-8532-471b-b931-ff137717ace9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:07.967127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cce90b95-b30a-4d48-a4d8-e99d3db31bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48a88791844842b8ba56a415f67f224e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:07.986323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cce90b95-b30a-4d48-a4d8-e99d3db31bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48a88791844842b8ba56a415f67f224e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:08.120578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-84021639-8532-471b-b931-ff137717ace9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ce07615fe564ba1bc76e135278b3a22'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:08.129129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cce90b95-b30a-4d48-a4d8-e99d3db31bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48a88791844842b8ba56a415f67f224e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:08.133300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-84021639-8532-471b-b931-ff137717ace9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ce07615fe564ba1bc76e135278b3a22'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:08.139046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cce90b95-b30a-4d48-a4d8-e99d3db31bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48a88791844842b8ba56a415f67f224e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:08.139895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cce90b95-b30a-4d48-a4d8-e99d3db31bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48a88791844842b8ba56a415f67f224e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:08.146819 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2234/4538] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:22:07 2022] DELETE /identity/v3/users/48a88791844842b8ba56a415f67f224e => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:22:08.267419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-84021639-8532-471b-b931-ff137717ace9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ce07615fe564ba1bc76e135278b3a22'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:08.268333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-84021639-8532-471b-b931-ff137717ace9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ce07615fe564ba1bc76e135278b3a22'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:08.284785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-84021639-8532-471b-b931-ff137717ace9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ce07615fe564ba1bc76e135278b3a22'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:08.295333 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2305/4539] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:22:07 2022] DELETE /identity/v3/users/8ce07615fe564ba1bc76e135278b3a22 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:08.551289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:08.678456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce90b95-b30a-4d48-a4d8-e99d3db31bc7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:08.680106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cce90b95-b30a-4d48-a4d8-e99d3db31bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:08.702998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84021639-8532-471b-b931-ff137717ace9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:08.704858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-84021639-8532-471b-b931-ff137717ace9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:08.779851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce90b95-b30a-4d48-a4d8-e99d3db31bc7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:08.781534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84021639-8532-471b-b931-ff137717ace9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:08.785008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c037b-e3c2-4dc1-b6e0-68c72f7a3d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:08.786054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c037b-e3c2-4dc1-b6e0-68c72f7a3d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:08.786351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c037b-e3c2-4dc1-b6e0-68c72f7a3d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:08.786681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c037b-e3c2-4dc1-b6e0-68c72f7a3d4d admin admin] PATH_INFO: `/v3/projects/f2b7791ebf2e45a69be8b35bcd19e7bb` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:08.788301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5027641-fabd-4d18-90de-6abc8fc3a7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:08.788525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c037b-e3c2-4dc1-b6e0-68c72f7a3d4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2b7791ebf2e45a69be8b35bcd19e7bb)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:08.789400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5027641-fabd-4d18-90de-6abc8fc3a7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:08.789758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5027641-fabd-4d18-90de-6abc8fc3a7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:08.790106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5027641-fabd-4d18-90de-6abc8fc3a7aa admin admin] PATH_INFO: `/v3/projects/c347b158466a46ea9886d5b2ba3b95c8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:08.790509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c037b-e3c2-4dc1-b6e0-68c72f7a3d4d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:08.791598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5027641-fabd-4d18-90de-6abc8fc3a7aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c347b158466a46ea9886d5b2ba3b95c8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:08.799242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5027641-fabd-4d18-90de-6abc8fc3a7aa admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:08.993845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b5027641-fabd-4d18-90de-6abc8fc3a7aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c347b158466a46ea9886d5b2ba3b95c8', 'request_id': 'req-b5027641-fabd-4d18-90de-6abc8fc3a7aa'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:09.000452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aa0c037b-e3c2-4dc1-b6e0-68c72f7a3d4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2b7791ebf2e45a69be8b35bcd19e7bb', 'request_id': 'req-aa0c037b-e3c2-4dc1-b6e0-68c72f7a3d4d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:09.004406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b5027641-fabd-4d18-90de-6abc8fc3a7aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c347b158466a46ea9886d5b2ba3b95c8', 'request_id': 'req-b5027641-fabd-4d18-90de-6abc8fc3a7aa'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:09.010936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b5027641-fabd-4d18-90de-6abc8fc3a7aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c347b158466a46ea9886d5b2ba3b95c8', 'request_id': 'req-b5027641-fabd-4d18-90de-6abc8fc3a7aa'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:09.011297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aa0c037b-e3c2-4dc1-b6e0-68c72f7a3d4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2b7791ebf2e45a69be8b35bcd19e7bb', 'request_id': 'req-aa0c037b-e3c2-4dc1-b6e0-68c72f7a3d4d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:09.019787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aa0c037b-e3c2-4dc1-b6e0-68c72f7a3d4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2b7791ebf2e45a69be8b35bcd19e7bb', 'request_id': 'req-aa0c037b-e3c2-4dc1-b6e0-68c72f7a3d4d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:09.182230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b5027641-fabd-4d18-90de-6abc8fc3a7aa admin admin] The token cache is being invalidate because project c347b158466a46ea9886d5b2ba3b95c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:09.182936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b5027641-fabd-4d18-90de-6abc8fc3a7aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:09.183882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b5027641-fabd-4d18-90de-6abc8fc3a7aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:09.186248 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2306/4540] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:22:08 2022] DELETE /identity/v3/projects/c347b158466a46ea9886d5b2ba3b95c8 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:09.195480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18684368-a010-4999-a004-c6df6fbb6ab0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:09.195663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18684368-a010-4999-a004-c6df6fbb6ab0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:09.195947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18684368-a010-4999-a004-c6df6fbb6ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:09.227434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-18684368-a010-4999-a004-c6df6fbb6ab0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:09.228751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-18684368-a010-4999-a004-c6df6fbb6ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:09.281165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=11 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:09.285075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aa0c037b-e3c2-4dc1-b6e0-68c72f7a3d4d admin admin] The token cache is being invalidate because project f2b7791ebf2e45a69be8b35bcd19e7bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:09.285494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aa0c037b-e3c2-4dc1-b6e0-68c72f7a3d4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:09.285990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-aa0c037b-e3c2-4dc1-b6e0-68c72f7a3d4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:09.287854 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2235/4541] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:22:08 2022] DELETE /identity/v3/projects/f2b7791ebf2e45a69be8b35bcd19e7bb => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:09.293829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd82bc5-f6c3-4c04-8cd5-cdaf7d1c41bf None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:09.294259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd82bc5-f6c3-4c04-8cd5-cdaf7d1c41bf None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:09.294546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd82bc5-f6c3-4c04-8cd5-cdaf7d1c41bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:09.317014 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2307/4542] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:09.323687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1dd82bc5-f6c3-4c04-8cd5-cdaf7d1c41bf None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:09.324411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c37eaf-fa45-44d1-9122-d4ac5f24aafd None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:09.324866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c37eaf-fa45-44d1-9122-d4ac5f24aafd None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:09.325053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1dd82bc5-f6c3-4c04-8cd5-cdaf7d1c41bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:09.325487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c37eaf-fa45-44d1-9122-d4ac5f24aafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:09.334330 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2236/4543] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:09.342647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae34d6-647f-4067-bcaa-f2c5d324b448 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:09.343251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae34d6-647f-4067-bcaa-f2c5d324b448 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:09.343696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae34d6-647f-4067-bcaa-f2c5d324b448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:09.366706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-73ae34d6-647f-4067-bcaa-f2c5d324b448 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:09.368031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-74c37eaf-fa45-44d1-9122-d4ac5f24aafd None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:09.368286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-73ae34d6-647f-4067-bcaa-f2c5d324b448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:09.369880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-74c37eaf-fa45-44d1-9122-d4ac5f24aafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:09.378116 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2237/4544] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:22:09.378650 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2308/4545] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:22:09.382362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae34d6-647f-4067-bcaa-f2c5d324b448 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:09.383407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c37eaf-fa45-44d1-9122-d4ac5f24aafd None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:09.393377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae34d6-647f-4067-bcaa-f2c5d324b448 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:09.393902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c37eaf-fa45-44d1-9122-d4ac5f24aafd None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:09.398622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245d41d-13b3-45ed-b23a-d19fa5232782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:09.398779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16499f5a-ddb2-44b5-abfd-433f090564b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:09.399351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245d41d-13b3-45ed-b23a-d19fa5232782 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:09.399656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16499f5a-ddb2-44b5-abfd-433f090564b0 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:09.399903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245d41d-13b3-45ed-b23a-d19fa5232782 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:09.400055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16499f5a-ddb2-44b5-abfd-433f090564b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:09.400192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245d41d-13b3-45ed-b23a-d19fa5232782 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:09.400453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16499f5a-ddb2-44b5-abfd-433f090564b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:09.400928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245d41d-13b3-45ed-b23a-d19fa5232782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:22:09.401240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245d41d-13b3-45ed-b23a-d19fa5232782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:09.401356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16499f5a-ddb2-44b5-abfd-433f090564b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:22:09.401727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16499f5a-ddb2-44b5-abfd-433f090564b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:09.402970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245d41d-13b3-45ed-b23a-d19fa5232782 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:09.403493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16499f5a-ddb2-44b5-abfd-433f090564b0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:09.419085 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2238/4546] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:22:09.419286 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2309/4547] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:22:09.420529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245d41d-13b3-45ed-b23a-d19fa5232782 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:09.420677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16499f5a-ddb2-44b5-abfd-433f090564b0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:09.430965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245d41d-13b3-45ed-b23a-d19fa5232782 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:09.432692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16499f5a-ddb2-44b5-abfd-433f090564b0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:09.435796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225708df-e39c-445e-8ca1-eb1048be9998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:09.436449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225708df-e39c-445e-8ca1-eb1048be9998 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:09.436734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225708df-e39c-445e-8ca1-eb1048be9998 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:09.437090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225708df-e39c-445e-8ca1-eb1048be9998 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:09.437789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225708df-e39c-445e-8ca1-eb1048be9998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:09.438480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9420c-24e8-47bd-8f95-5a6c6d0e5f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:09.439168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9420c-24e8-47bd-8f95-5a6c6d0e5f8e admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:09.439454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9420c-24e8-47bd-8f95-5a6c6d0e5f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:09.439728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9420c-24e8-47bd-8f95-5a6c6d0e5f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:09.439886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225708df-e39c-445e-8ca1-eb1048be9998 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:09.440411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9420c-24e8-47bd-8f95-5a6c6d0e5f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:09.442377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9420c-24e8-47bd-8f95-5a6c6d0e5f8e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:09.566016 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2310/4548] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:22:09 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:22:09.569123 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2239/4549] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:22:09 2022] POST /identity/v3/projects => generated 369 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:09.569823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9420c-24e8-47bd-8f95-5a6c6d0e5f8e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:09.573106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225708df-e39c-445e-8ca1-eb1048be9998 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:09.651806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9420c-24e8-47bd-8f95-5a6c6d0e5f8e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:09.670345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225708df-e39c-445e-8ca1-eb1048be9998 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:09.675423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f0d3a-11ec-4685-9ed8-a4ba657b9a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:09.676432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f0d3a-11ec-4685-9ed8-a4ba657b9a11 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:09.676432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f0d3a-11ec-4685-9ed8-a4ba657b9a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:09.676740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f0d3a-11ec-4685-9ed8-a4ba657b9a11 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:09.677608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f0d3a-11ec-4685-9ed8-a4ba657b9a11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:09.679630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f0d3a-11ec-4685-9ed8-a4ba657b9a11 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:09.721077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7b4e6-9004-4511-a0dc-d94cb4cb91c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:09.721759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7b4e6-9004-4511-a0dc-d94cb4cb91c4 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:09.722042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7b4e6-9004-4511-a0dc-d94cb4cb91c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:09.722315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7b4e6-9004-4511-a0dc-d94cb4cb91c4 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:09.722998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7b4e6-9004-4511-a0dc-d94cb4cb91c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:09.725016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7b4e6-9004-4511-a0dc-d94cb4cb91c4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:09.800360 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2240/4550] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:22:09 2022] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:22:09.801871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f0d3a-11ec-4685-9ed8-a4ba657b9a11 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:09.828694 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2311/4551] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:22:09 2022] POST /identity/v3/users => generated 286 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:22:09.832699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7b4e6-9004-4511-a0dc-d94cb4cb91c4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:09.833378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f0d3a-11ec-4685-9ed8-a4ba657b9a11 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:09.848310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc109e-07b0-4ead-860d-cfdbe2f5d177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:09.849712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc109e-07b0-4ead-860d-cfdbe2f5d177 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:09.850357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc109e-07b0-4ead-860d-cfdbe2f5d177 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:09.850960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc109e-07b0-4ead-860d-cfdbe2f5d177 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:09.852941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc109e-07b0-4ead-860d-cfdbe2f5d177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:09.854793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc109e-07b0-4ead-860d-cfdbe2f5d177 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:09.867922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7b4e6-9004-4511-a0dc-d94cb4cb91c4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:09.879070 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2241/4552] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:09.880974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c34c9-5b0e-44af-9a86-797de6666a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:09.883452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c34c9-5b0e-44af-9a86-797de6666a7b admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:09.883452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c34c9-5b0e-44af-9a86-797de6666a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:09.883452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c34c9-5b0e-44af-9a86-797de6666a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:09.883785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc109e-07b0-4ead-860d-cfdbe2f5d177 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:09.883902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c34c9-5b0e-44af-9a86-797de6666a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:09.884745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c34c9-5b0e-44af-9a86-797de6666a7b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:09.904940 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2312/4553] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:22:09.905942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c34c9-5b0e-44af-9a86-797de6666a7b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:09.912981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc109e-07b0-4ead-860d-cfdbe2f5d177 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:09.916713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c34c9-5b0e-44af-9a86-797de6666a7b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:09.922742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63412230-2068-434d-aab9-c778b1b3058d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:09.924314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63412230-2068-434d-aab9-c778b1b3058d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:09.924740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63412230-2068-434d-aab9-c778b1b3058d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:09.925089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63412230-2068-434d-aab9-c778b1b3058d admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:09.925960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63412230-2068-434d-aab9-c778b1b3058d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:09.927686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce7f88-4c61-4737-bd11-2c2d69c8bc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:09.927935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63412230-2068-434d-aab9-c778b1b3058d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:09.930590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce7f88-4c61-4737-bd11-2c2d69c8bc64 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:09.930764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce7f88-4c61-4737-bd11-2c2d69c8bc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:09.930904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce7f88-4c61-4737-bd11-2c2d69c8bc64 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:09.931694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce7f88-4c61-4737-bd11-2c2d69c8bc64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:09.937540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce7f88-4c61-4737-bd11-2c2d69c8bc64 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:09.950533 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2313/4554] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:09.956874 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2242/4555] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:09.957074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63412230-2068-434d-aab9-c778b1b3058d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:09.959934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce7f88-4c61-4737-bd11-2c2d69c8bc64 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:09.970582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63412230-2068-434d-aab9-c778b1b3058d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:09.979087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5fde1-384f-4db0-9644-101b23fbf28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:09.980564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce7f88-4c61-4737-bd11-2c2d69c8bc64 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:09.980918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5fde1-384f-4db0-9644-101b23fbf28d admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:09.981353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5fde1-384f-4db0-9644-101b23fbf28d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:09.981872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5fde1-384f-4db0-9644-101b23fbf28d admin admin] PATH_INFO: `/v3/projects/1f726c2a62c34705b4c9be3a77d17491/users/2e923f5253fc4e16aad3aec502ea0aa5/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:09.987875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5698b2-1c5c-400d-aacf-cfa70029155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:09.988959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5698b2-1c5c-400d-aacf-cfa70029155f admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:09.989485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5698b2-1c5c-400d-aacf-cfa70029155f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:09.989834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5698b2-1c5c-400d-aacf-cfa70029155f admin admin] PATH_INFO: `/v3/projects/1579c645b7764bddb2250132d7af0b73/users/1f9f3744fb4a495893c236859d6f5286/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:10.006592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5fde1-384f-4db0-9644-101b23fbf28d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f726c2a62c34705b4c9be3a77d17491, user_id=2e923f5253fc4e16aad3aec502ea0aa5, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:10.011102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5fde1-384f-4db0-9644-101b23fbf28d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:10.011969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5698b2-1c5c-400d-aacf-cfa70029155f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1579c645b7764bddb2250132d7af0b73, user_id=1f9f3744fb4a495893c236859d6f5286, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:10.022656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5698b2-1c5c-400d-aacf-cfa70029155f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:10.131479 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2314/4556] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:09 2022] PUT /identity/v3/projects/1f726c2a62c34705b4c9be3a77d17491/users/2e923f5253fc4e16aad3aec502ea0aa5/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:10.150710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfa6a7-8ca6-45c6-9b3d-0d7d2aa0ac02 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:10.151804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfa6a7-8ca6-45c6-9b3d-0d7d2aa0ac02 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:10.152129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfa6a7-8ca6-45c6-9b3d-0d7d2aa0ac02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:10.164230 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2243/4557] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:09 2022] PUT /identity/v3/projects/1579c645b7764bddb2250132d7af0b73/users/1f9f3744fb4a495893c236859d6f5286/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:10.176887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc90be3-eb41-4b47-978f-c460c22ae1d2 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:10.177198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc90be3-eb41-4b47-978f-c460c22ae1d2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:10.177466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc90be3-eb41-4b47-978f-c460c22ae1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:10.213095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-10cfa6a7-8ca6-45c6-9b3d-0d7d2aa0ac02 None None] MFA Rules not processed for user `2e923f5253fc4e16aad3aec502ea0aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:10.214710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-10cfa6a7-8ca6-45c6-9b3d-0d7d2aa0ac02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:10.218593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ccc90be3-eb41-4b47-978f-c460c22ae1d2 None None] MFA Rules not processed for user `1f9f3744fb4a495893c236859d6f5286`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:10.219980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ccc90be3-eb41-4b47-978f-c460c22ae1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:10.300250 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2244/4558] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:22:10.305545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc90be3-eb41-4b47-978f-c460c22ae1d2 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:10.315578 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2315/4559] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:22:10.319893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfa6a7-8ca6-45c6-9b3d-0d7d2aa0ac02 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:10.431634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc90be3-eb41-4b47-978f-c460c22ae1d2 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:10.435276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfa6a7-8ca6-45c6-9b3d-0d7d2aa0ac02 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:10.438464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff801b4-3a74-47c7-8b12-aaf5ede61cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:10.439283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff801b4-3a74-47c7-8b12-aaf5ede61cce admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:10.439565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff801b4-3a74-47c7-8b12-aaf5ede61cce admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:10.439839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff801b4-3a74-47c7-8b12-aaf5ede61cce admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:10.441073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff801b4-3a74-47c7-8b12-aaf5ede61cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:10.443725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff801b4-3a74-47c7-8b12-aaf5ede61cce admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:10.443938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650acd34-2df7-4ea1-aa64-c831582ac233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:10.444622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650acd34-2df7-4ea1-aa64-c831582ac233 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:10.444907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650acd34-2df7-4ea1-aa64-c831582ac233 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:10.445185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650acd34-2df7-4ea1-aa64-c831582ac233 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:10.445879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650acd34-2df7-4ea1-aa64-c831582ac233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:10.453871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650acd34-2df7-4ea1-aa64-c831582ac233 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:10.558824 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2245/4560] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:22:10 2022] POST /identity/v3/projects => generated 367 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:22:10.563847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff801b4-3a74-47c7-8b12-aaf5ede61cce admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:10.586616 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2316/4561] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:22:10 2022] POST /identity/v3/projects => generated 373 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:22:10.590304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650acd34-2df7-4ea1-aa64-c831582ac233 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:10.663715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff801b4-3a74-47c7-8b12-aaf5ede61cce admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:10.715275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650acd34-2df7-4ea1-aa64-c831582ac233 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:10.721939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b3f63-0c08-4bf7-88a7-48b542e3ca05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:10.722807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b3f63-0c08-4bf7-88a7-48b542e3ca05 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:10.723378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b3f63-0c08-4bf7-88a7-48b542e3ca05 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:10.723666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b3f63-0c08-4bf7-88a7-48b542e3ca05 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:10.724370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b3f63-0c08-4bf7-88a7-48b542e3ca05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:10.726454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b3f63-0c08-4bf7-88a7-48b542e3ca05 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:10.760147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa01d7-de46-41f1-b27c-4f7d19b69928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:10.760821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa01d7-de46-41f1-b27c-4f7d19b69928 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:10.761106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa01d7-de46-41f1-b27c-4f7d19b69928 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:10.762103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa01d7-de46-41f1-b27c-4f7d19b69928 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:10.762534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa01d7-de46-41f1-b27c-4f7d19b69928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:10.764611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa01d7-de46-41f1-b27c-4f7d19b69928 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:10.913044 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2317/4562] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:22:10 2022] POST /identity/v3/users => generated 293 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:22:10.917403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b3f63-0c08-4bf7-88a7-48b542e3ca05 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:10.929089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b3f63-0c08-4bf7-88a7-48b542e3ca05 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:10.935671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b75a13-ddb1-4ef8-9b84-217184532e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:10.936551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b75a13-ddb1-4ef8-9b84-217184532e44 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:10.938162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b75a13-ddb1-4ef8-9b84-217184532e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:10.938902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b75a13-ddb1-4ef8-9b84-217184532e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:10.939873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b75a13-ddb1-4ef8-9b84-217184532e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:10.941554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b75a13-ddb1-4ef8-9b84-217184532e44 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:10.956358 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2318/4563] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:10.961678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b75a13-ddb1-4ef8-9b84-217184532e44 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:10.976676 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2246/4564] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:22:10 2022] POST /identity/v3/users => generated 290 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:10.980633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa01d7-de46-41f1-b27c-4f7d19b69928 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:10.981307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b75a13-ddb1-4ef8-9b84-217184532e44 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:10.986415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a172dfb-a8dc-40cc-9338-25c8f00c7708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:10.987955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a172dfb-a8dc-40cc-9338-25c8f00c7708 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:10.988245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a172dfb-a8dc-40cc-9338-25c8f00c7708 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:10.988525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a172dfb-a8dc-40cc-9338-25c8f00c7708 admin admin] PATH_INFO: `/v3/projects/dc3c6bbb2ffe4856ad86522182e4acbc/users/0b1526f31e4b471fb859a9d8f1dac811/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:10.991235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa01d7-de46-41f1-b27c-4f7d19b69928 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:10.996103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cee28b-2be6-427e-900e-004f6a6e3f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:10.997464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cee28b-2be6-427e-900e-004f6a6e3f7f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:10.997464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cee28b-2be6-427e-900e-004f6a6e3f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:10.997661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cee28b-2be6-427e-900e-004f6a6e3f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:11.000301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cee28b-2be6-427e-900e-004f6a6e3f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:11.000301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cee28b-2be6-427e-900e-004f6a6e3f7f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:11.011452 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2247/4565] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:11.012965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a172dfb-a8dc-40cc-9338-25c8f00c7708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc3c6bbb2ffe4856ad86522182e4acbc, user_id=0b1526f31e4b471fb859a9d8f1dac811, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:11.016623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cee28b-2be6-427e-900e-004f6a6e3f7f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:11.016852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a172dfb-a8dc-40cc-9338-25c8f00c7708 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:11.027597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cee28b-2be6-427e-900e-004f6a6e3f7f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:11.032999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacb9f5-9532-4470-85d0-49ded71129e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:11.034131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacb9f5-9532-4470-85d0-49ded71129e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:11.035153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacb9f5-9532-4470-85d0-49ded71129e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:11.035433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacb9f5-9532-4470-85d0-49ded71129e8 admin admin] PATH_INFO: `/v3/projects/f2cb5d05ea024210994c215280985f35/users/0bdda0cb51bb4e7d9a534878a5f6f296/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:11.052682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aacb9f5-9532-4470-85d0-49ded71129e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2cb5d05ea024210994c215280985f35, user_id=0bdda0cb51bb4e7d9a534878a5f6f296, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:11.055480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aacb9f5-9532-4470-85d0-49ded71129e8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:11.167056 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2319/4567] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:10 2022] PUT /identity/v3/projects/dc3c6bbb2ffe4856ad86522182e4acbc/users/0b1526f31e4b471fb859a9d8f1dac811/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:22:11.167334 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2248/4567] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:11 2022] PUT /identity/v3/projects/f2cb5d05ea024210994c215280985f35/users/0bdda0cb51bb4e7d9a534878a5f6f296/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:11.168426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a172dfb-a8dc-40cc-9338-25c8f00c7708 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:11.169823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacb9f5-9532-4470-85d0-49ded71129e8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:11.257416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacb9f5-9532-4470-85d0-49ded71129e8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:11.263134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a30d07-19b7-47d0-8a47-695e31e4d5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:11.263855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a30d07-19b7-47d0-8a47-695e31e4d5bd admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:11.264086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a30d07-19b7-47d0-8a47-695e31e4d5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:11.264364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a30d07-19b7-47d0-8a47-695e31e4d5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:11.265652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a30d07-19b7-47d0-8a47-695e31e4d5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:11.267490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a30d07-19b7-47d0-8a47-695e31e4d5bd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:11.271475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a172dfb-a8dc-40cc-9338-25c8f00c7708 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:11.282386 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2249/4568] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:11.283312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a30d07-19b7-47d0-8a47-695e31e4d5bd admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:11.286411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d8fab-b3a7-4823-a9f0-b6e99f828adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:11.287283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d8fab-b3a7-4823-a9f0-b6e99f828adf admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:11.287631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d8fab-b3a7-4823-a9f0-b6e99f828adf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:11.287975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d8fab-b3a7-4823-a9f0-b6e99f828adf admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:11.288777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d8fab-b3a7-4823-a9f0-b6e99f828adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:11.290457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d8fab-b3a7-4823-a9f0-b6e99f828adf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:11.293174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a30d07-19b7-47d0-8a47-695e31e4d5bd admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:11.298338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb99149-8580-41c8-ae43-9fe17b345313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:11.299268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb99149-8580-41c8-ae43-9fe17b345313 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:11.299551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb99149-8580-41c8-ae43-9fe17b345313 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:11.299844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb99149-8580-41c8-ae43-9fe17b345313 admin admin] PATH_INFO: `/v3/projects/dc3c6bbb2ffe4856ad86522182e4acbc/users/0b1526f31e4b471fb859a9d8f1dac811/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:11.301882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb99149-8580-41c8-ae43-9fe17b345313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc3c6bbb2ffe4856ad86522182e4acbc, user_id=0b1526f31e4b471fb859a9d8f1dac811, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:11.305344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb99149-8580-41c8-ae43-9fe17b345313 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:11.322502 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2320/4569] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:22:11.324124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d8fab-b3a7-4823-a9f0-b6e99f828adf admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:11.331638 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2250/4570] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:11 2022] PUT /identity/v3/projects/dc3c6bbb2ffe4856ad86522182e4acbc/users/0b1526f31e4b471fb859a9d8f1dac811/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:11.337708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d8fab-b3a7-4823-a9f0-b6e99f828adf admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:11.342072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e9702-1ca8-4d47-875c-54cb38462c9e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:11.342361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e9702-1ca8-4d47-875c-54cb38462c9e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:11.342641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e9702-1ca8-4d47-875c-54cb38462c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:11.370104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-785e9702-1ca8-4d47-875c-54cb38462c9e None None] MFA Rules not processed for user `0b1526f31e4b471fb859a9d8f1dac811`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:11.371415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-785e9702-1ca8-4d47-875c-54cb38462c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:11.398911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80801c7b-33e6-4393-be50-a8a66673fed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:11.399762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80801c7b-33e6-4393-be50-a8a66673fed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:11.400047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80801c7b-33e6-4393-be50-a8a66673fed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:11.400321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80801c7b-33e6-4393-be50-a8a66673fed3 admin admin] PATH_INFO: `/v3/projects/f2cb5d05ea024210994c215280985f35/users/0bdda0cb51bb4e7d9a534878a5f6f296/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:11.402434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80801c7b-33e6-4393-be50-a8a66673fed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2cb5d05ea024210994c215280985f35, user_id=0bdda0cb51bb4e7d9a534878a5f6f296, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:11.405132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80801c7b-33e6-4393-be50-a8a66673fed3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:11.415967 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2321/4571] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:11 2022] PUT /identity/v3/projects/f2cb5d05ea024210994c215280985f35/users/0bdda0cb51bb4e7d9a534878a5f6f296/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:22:11.428938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecffdc-69b5-45d6-b8ba-b9bec33f2720 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:11.429230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecffdc-69b5-45d6-b8ba-b9bec33f2720 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:11.429511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecffdc-69b5-45d6-b8ba-b9bec33f2720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:11.445764 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2251/4572] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:11.451516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e9702-1ca8-4d47-875c-54cb38462c9e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:11.459229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d3ecffdc-69b5-45d6-b8ba-b9bec33f2720 None None] MFA Rules not processed for user `0bdda0cb51bb4e7d9a534878a5f6f296`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:11.460439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d3ecffdc-69b5-45d6-b8ba-b9bec33f2720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:11.461601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e9702-1ca8-4d47-875c-54cb38462c9e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:11.502463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=95,keystone:UPDATE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:11.521382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6f1c0-757c-40ad-8706-1694c92968fe tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1526f31e4b471fb859a9d8f1dac811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc3c6bbb2ffe4856ad86522182e4acbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:11.522057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6f1c0-757c-40ad-8706-1694c92968fe tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:11.522347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6f1c0-757c-40ad-8706-1694c92968fe tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:11.522630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6f1c0-757c-40ad-8706-1694c92968fe tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:11.523465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6f1c0-757c-40ad-8706-1694c92968fe tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:22:11.523779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6f1c0-757c-40ad-8706-1694c92968fe tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:11.525529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6f1c0-757c-40ad-8706-1694c92968fe tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:11.535893 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2322/4573] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:11 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:11.540652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecffdc-69b5-45d6-b8ba-b9bec33f2720 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:11.547906 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2252/4574] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:22:11.548877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6f1c0-757c-40ad-8706-1694c92968fe tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:11.550710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecffdc-69b5-45d6-b8ba-b9bec33f2720 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:11.563395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6f1c0-757c-40ad-8706-1694c92968fe tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:11.569461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981486b6-b607-4934-aa86-22557512add1 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bdda0cb51bb4e7d9a534878a5f6f296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2cb5d05ea024210994c215280985f35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:11.569461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981486b6-b607-4934-aa86-22557512add1 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:11.569461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981486b6-b607-4934-aa86-22557512add1 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:11.570178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981486b6-b607-4934-aa86-22557512add1 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:11.570178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981486b6-b607-4934-aa86-22557512add1 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:11.570357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126d1f1-f6a4-41f4-bf60-06db0c0aab31 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1526f31e4b471fb859a9d8f1dac811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc3c6bbb2ffe4856ad86522182e4acbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:11.570464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981486b6-b607-4934-aa86-22557512add1 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:11.570565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126d1f1-f6a4-41f4-bf60-06db0c0aab31 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:11.570565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126d1f1-f6a4-41f4-bf60-06db0c0aab31 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:11.570873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126d1f1-f6a4-41f4-bf60-06db0c0aab31 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:11.571795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126d1f1-f6a4-41f4-bf60-06db0c0aab31 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:11.574481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126d1f1-f6a4-41f4-bf60-06db0c0aab31 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:11.621292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:11.702905 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2253/4575] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:22:11 2022] POST /identity/v3/projects => generated 349 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:11.708170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126d1f1-f6a4-41f4-bf60-06db0c0aab31 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:11.726214 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2323/4576] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:22:11 2022] POST /identity/v3/projects => generated 359 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:22:11.732284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981486b6-b607-4934-aa86-22557512add1 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:11.828347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126d1f1-f6a4-41f4-bf60-06db0c0aab31 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:11.903066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981486b6-b607-4934-aa86-22557512add1 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:11.903506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedaf79-6c85-42c1-b2e5-a80ec4fbb012 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1526f31e4b471fb859a9d8f1dac811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc3c6bbb2ffe4856ad86522182e4acbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:11.904424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedaf79-6c85-42c1-b2e5-a80ec4fbb012 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:11.904923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedaf79-6c85-42c1-b2e5-a80ec4fbb012 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:11.906251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedaf79-6c85-42c1-b2e5-a80ec4fbb012 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:11.907626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfedaf79-6c85-42c1-b2e5-a80ec4fbb012 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:22:11.908140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfedaf79-6c85-42c1-b2e5-a80ec4fbb012 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:11.911214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfedaf79-6c85-42c1-b2e5-a80ec4fbb012 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:11.925231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b556dd-6f38-4791-9fbb-e180dc3ce71a tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bdda0cb51bb4e7d9a534878a5f6f296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2cb5d05ea024210994c215280985f35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:11.927736 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2254/4577] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:22:11.930434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b556dd-6f38-4791-9fbb-e180dc3ce71a tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:11.930727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b556dd-6f38-4791-9fbb-e180dc3ce71a tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:11.931042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b556dd-6f38-4791-9fbb-e180dc3ce71a tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:11.934985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b556dd-6f38-4791-9fbb-e180dc3ce71a tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:11.937216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b556dd-6f38-4791-9fbb-e180dc3ce71a tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:11.940718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedaf79-6c85-42c1-b2e5-a80ec4fbb012 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:11.942877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bfedaf79-6c85-42c1-b2e5-a80ec4fbb012 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:12.031685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedaf79-6c85-42c1-b2e5-a80ec4fbb012 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:12.035953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf82107-6fb5-47a0-8a1d-2e4e7bba29e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:12.036607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf82107-6fb5-47a0-8a1d-2e4e7bba29e6 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:12.037003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf82107-6fb5-47a0-8a1d-2e4e7bba29e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:12.037288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf82107-6fb5-47a0-8a1d-2e4e7bba29e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:12.050283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf82107-6fb5-47a0-8a1d-2e4e7bba29e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:12.052680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf82107-6fb5-47a0-8a1d-2e4e7bba29e6 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:12.066908 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2255/4578] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:22:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:22:12.117185 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2324/4579] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:22:11 2022] POST /identity/v3/users => generated 369 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:12.121713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf82107-6fb5-47a0-8a1d-2e4e7bba29e6 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:12.136996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf82107-6fb5-47a0-8a1d-2e4e7bba29e6 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:12.143482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e0782-f791-4d32-a34e-43a8999a8e5d tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bdda0cb51bb4e7d9a534878a5f6f296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2cb5d05ea024210994c215280985f35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:12.145180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e0782-f791-4d32-a34e-43a8999a8e5d tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:12.145180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e0782-f791-4d32-a34e-43a8999a8e5d tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:12.145641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e0782-f791-4d32-a34e-43a8999a8e5d tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:12.146686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e0782-f791-4d32-a34e-43a8999a8e5d tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:22:12.147117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e0782-f791-4d32-a34e-43a8999a8e5d tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:12.150483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e0782-f791-4d32-a34e-43a8999a8e5d tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:12.191576 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2256/4580] 10.222.0.16 () {58 vars in 1156 bytes} [Sat Jul 16 21:22:12 2022] GET /identity/v3/users?domain_id=default => generated 8303 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:12.196765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b556dd-6f38-4791-9fbb-e180dc3ce71a tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:12.208866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b556dd-6f38-4791-9fbb-e180dc3ce71a tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:12.213870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12add422-2505-49a8-a995-d4686abb8f15 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bdda0cb51bb4e7d9a534878a5f6f296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2cb5d05ea024210994c215280985f35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:12.215559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12add422-2505-49a8-a995-d4686abb8f15 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:12.215559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12add422-2505-49a8-a995-d4686abb8f15 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:12.215559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12add422-2505-49a8-a995-d4686abb8f15 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] PATH_INFO: `/v3/users/bbc66c19b4554aba8a7da12e41db25bf` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:12.232084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12add422-2505-49a8-a995-d4686abb8f15 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] RBAC: Authorizing `identity:update_user(user_id=bbc66c19b4554aba8a7da12e41db25bf)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:12.233374 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-12add422-2505-49a8-a995-d4686abb8f15 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:22:12.233374 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:22:12.233374 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:22:12.235296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12add422-2505-49a8-a995-d4686abb8f15 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:12.377770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-12add422-2505-49a8-a995-d4686abb8f15 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bbc66c19b4554aba8a7da12e41db25bf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:12.527158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-12add422-2505-49a8-a995-d4686abb8f15 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Invalidating the token cache because user bbc66c19b4554aba8a7da12e41db25bf was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:12.527598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-12add422-2505-49a8-a995-d4686abb8f15 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:12.528389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-12add422-2505-49a8-a995-d4686abb8f15 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:12.531880 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2325/4581] 10.222.0.16 () {60 vars in 1243 bytes} [Sat Jul 16 21:22:12 2022] PATCH /identity/v3/users/bbc66c19b4554aba8a7da12e41db25bf => generated 482 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:22:12.535992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab64dcb-37bc-4e05-a150-6f58c74c0ea0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:12.536500 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab64dcb-37bc-4e05-a150-6f58c74c0ea0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:12.537131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab64dcb-37bc-4e05-a150-6f58c74c0ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:12.550964 ncdv-master-1 devstack@keystone.service[98195]: WARNING keystone.auth.plugins.core [None req-3ab64dcb-37bc-4e05-a150-6f58c74c0ea0 None None] User is disabled: bbc66c19b4554aba8a7da12e41db25bf: AssertionError: User is disabled: bbc66c19b4554aba8a7da12e41db25bf Jul 16 21:22:12.572142 ncdv-master-1 devstack@keystone.service[98195]: WARNING keystone.server.flask.application [None req-3ab64dcb-37bc-4e05-a150-6f58c74c0ea0 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 16 21:22:12.573942 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2257/4582] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:12 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 39 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 16 21:22:12.578251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12add422-2505-49a8-a995-d4686abb8f15 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:12.579936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-12add422-2505-49a8-a995-d4686abb8f15 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:12.593400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12add422-2505-49a8-a995-d4686abb8f15 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:12.609890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3185d-7fab-47d1-b401-4ffbfee101e4 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bdda0cb51bb4e7d9a534878a5f6f296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2cb5d05ea024210994c215280985f35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:12.611104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3185d-7fab-47d1-b401-4ffbfee101e4 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:12.611964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3185d-7fab-47d1-b401-4ffbfee101e4 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:12.611964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3185d-7fab-47d1-b401-4ffbfee101e4 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] PATH_INFO: `/v3/users/bbc66c19b4554aba8a7da12e41db25bf` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:12.632239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3185d-7fab-47d1-b401-4ffbfee101e4 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bbc66c19b4554aba8a7da12e41db25bf)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:12.635766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3185d-7fab-47d1-b401-4ffbfee101e4 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:12.770196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-63d3185d-7fab-47d1-b401-4ffbfee101e4 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc66c19b4554aba8a7da12e41db25bf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:12.777404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-63d3185d-7fab-47d1-b401-4ffbfee101e4 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc66c19b4554aba8a7da12e41db25bf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:12.881902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-63d3185d-7fab-47d1-b401-4ffbfee101e4 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc66c19b4554aba8a7da12e41db25bf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:12.882557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-63d3185d-7fab-47d1-b401-4ffbfee101e4 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc66c19b4554aba8a7da12e41db25bf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:12.896053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-63d3185d-7fab-47d1-b401-4ffbfee101e4 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc66c19b4554aba8a7da12e41db25bf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:12.906237 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2326/4583] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:22:12 2022] DELETE /identity/v3/users/bbc66c19b4554aba8a7da12e41db25bf => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:12.907358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab64dcb-37bc-4e05-a150-6f58c74c0ea0 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:12.909066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3ab64dcb-37bc-4e05-a150-6f58c74c0ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:12.980939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab64dcb-37bc-4e05-a150-6f58c74c0ea0 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:12.986578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a68dce-df19-463f-8478-b98333505f9d tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bdda0cb51bb4e7d9a534878a5f6f296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2cb5d05ea024210994c215280985f35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:12.987482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a68dce-df19-463f-8478-b98333505f9d tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:12.987774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a68dce-df19-463f-8478-b98333505f9d tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:12.988057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a68dce-df19-463f-8478-b98333505f9d tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] PATH_INFO: `/v3/projects/572d55444eab4cebbc8e1bef56de2237` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:12.989281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a68dce-df19-463f-8478-b98333505f9d tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] RBAC: Authorizing `identity:delete_project(project_id=572d55444eab4cebbc8e1bef56de2237)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:12.991248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a68dce-df19-463f-8478-b98333505f9d tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:13.118352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a9a68dce-df19-463f-8478-b98333505f9d tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '572d55444eab4cebbc8e1bef56de2237', 'request_id': 'req-a9a68dce-df19-463f-8478-b98333505f9d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:13.124926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a9a68dce-df19-463f-8478-b98333505f9d tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '572d55444eab4cebbc8e1bef56de2237', 'request_id': 'req-a9a68dce-df19-463f-8478-b98333505f9d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:13.131472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a9a68dce-df19-463f-8478-b98333505f9d tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '572d55444eab4cebbc8e1bef56de2237', 'request_id': 'req-a9a68dce-df19-463f-8478-b98333505f9d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:13.225960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a9a68dce-df19-463f-8478-b98333505f9d tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] The token cache is being invalidate because project 572d55444eab4cebbc8e1bef56de2237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:13.226192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a9a68dce-df19-463f-8478-b98333505f9d tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:13.226835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a9a68dce-df19-463f-8478-b98333505f9d tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:13.228745 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2258/4584] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:22:12 2022] DELETE /identity/v3/projects/572d55444eab4cebbc8e1bef56de2237 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:22:13.235199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3185d-7fab-47d1-b401-4ffbfee101e4 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:13.247266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3185d-7fab-47d1-b401-4ffbfee101e4 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:13.309760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc994e-1758-4949-b8e2-32217ecd6e71 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bdda0cb51bb4e7d9a534878a5f6f296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2cb5d05ea024210994c215280985f35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:13.311111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc994e-1758-4949-b8e2-32217ecd6e71 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:13.311111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc994e-1758-4949-b8e2-32217ecd6e71 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:13.311319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc994e-1758-4949-b8e2-32217ecd6e71 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:13.314996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc994e-1758-4949-b8e2-32217ecd6e71 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:13.314996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc994e-1758-4949-b8e2-32217ecd6e71 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:13.328166 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-edcc994e-1758-4949-b8e2-32217ecd6e71 tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Could not find domain: e142536e2ae44a40bbd3481ab42893c6.: keystone.exception.DomainNotFound: Could not find domain: e142536e2ae44a40bbd3481ab42893c6. Jul 16 21:22:13.328166 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:22:13.328166 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 16 21:22:13.328166 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 16 21:22:13.328166 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 21:22:13.328166 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 21:22:13.328166 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 21:22:13.328166 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 21:22:13.328166 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e142536e2ae44a40bbd3481ab42893c6. Jul 16 21:22:13.328166 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:22:13.328166 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:22:13.328166 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:22:13.328166 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:22:13.328166 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:22:13.328166 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:22:13.328166 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:22:13.329459 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:22:13.329459 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:22:13.329459 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:22:13.329459 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:22:13.329459 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:22:13.329459 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:22:13.329459 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:22:13.329459 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 16 21:22:13.329459 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 16 21:22:13.329459 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:22:13.329459 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:22:13.329459 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 21:22:13.329459 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 21:22:13.329459 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 21:22:13.329459 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 21:22:13.329459 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Jul 16 21:22:13.329459 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Jul 16 21:22:13.330692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:22:13.330692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:22:13.330692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:22:13.330692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:22:13.330692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:22:13.330692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:22:13.330692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:22:13.330692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 21:22:13.330692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:22:13.330692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:22:13.330692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:22:13.330692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:22:13.330692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:22:13.330692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:22:13.330692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:22:13.330692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:22:13.330692 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 16 21:22:13.331762 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 21:22:13.331762 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e142536e2ae44a40bbd3481ab42893c6. Jul 16 21:22:13.331762 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:22:13.331762 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2327/4585] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:22:13 2022] POST /identity/v3/users => generated 112 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:22:13.334621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a68dce-df19-463f-8478-b98333505f9d tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:13.338231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a9a68dce-df19-463f-8478-b98333505f9d tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:13.404676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a68dce-df19-463f-8478-b98333505f9d tempest-UsersNegativeTest-59310307 tempest-UsersNegativeTest-59310307-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:13.410534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f087b4-c699-4a35-9e0f-41262d3e6c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:13.411530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f087b4-c699-4a35-9e0f-41262d3e6c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:13.411876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f087b4-c699-4a35-9e0f-41262d3e6c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:13.412220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f087b4-c699-4a35-9e0f-41262d3e6c23 admin admin] PATH_INFO: `/v3/users/1f9f3744fb4a495893c236859d6f5286` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:13.413602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f087b4-c699-4a35-9e0f-41262d3e6c23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f9f3744fb4a495893c236859d6f5286)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:13.415708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f087b4-c699-4a35-9e0f-41262d3e6c23 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:13.606403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-56f087b4-c699-4a35-9e0f-41262d3e6c23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f9f3744fb4a495893c236859d6f5286'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:13.619536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-56f087b4-c699-4a35-9e0f-41262d3e6c23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f9f3744fb4a495893c236859d6f5286'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:13.721634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-56f087b4-c699-4a35-9e0f-41262d3e6c23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f9f3744fb4a495893c236859d6f5286'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:13.729774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-56f087b4-c699-4a35-9e0f-41262d3e6c23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f9f3744fb4a495893c236859d6f5286'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:13.730801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-56f087b4-c699-4a35-9e0f-41262d3e6c23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f9f3744fb4a495893c236859d6f5286'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:13.738240 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2259/4586] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:22:13 2022] DELETE /identity/v3/users/1f9f3744fb4a495893c236859d6f5286 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:13.743663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276517-acca-4c06-b9c4-1812c81187df None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:13.744288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276517-acca-4c06-b9c4-1812c81187df None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:13.751638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276517-acca-4c06-b9c4-1812c81187df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:13.764108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-40276517-acca-4c06-b9c4-1812c81187df None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:13.766277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-40276517-acca-4c06-b9c4-1812c81187df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:13.828285 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2328/4587] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:13.837860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f087b4-c699-4a35-9e0f-41262d3e6c23 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:13.839301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-56f087b4-c699-4a35-9e0f-41262d3e6c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:13.917972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f087b4-c699-4a35-9e0f-41262d3e6c23 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:13.923930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cef7d0-61f7-4dc4-9352-137820ce8aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:13.924275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cef7d0-61f7-4dc4-9352-137820ce8aaa service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:13.924753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cef7d0-61f7-4dc4-9352-137820ce8aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:13.925101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cef7d0-61f7-4dc4-9352-137820ce8aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:13.935957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cef7d0-61f7-4dc4-9352-137820ce8aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:13.938049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cef7d0-61f7-4dc4-9352-137820ce8aaa service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:13.962323 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2260/4588] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:22:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:22:14.324309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:14.587175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:14.930581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40276517-acca-4c06-b9c4-1812c81187df None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:14.933060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-40276517-acca-4c06-b9c4-1812c81187df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:14.947651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40276517-acca-4c06-b9c4-1812c81187df None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:14.961716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae50324-c91e-477a-9355-22d0cdf66847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:14.962619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae50324-c91e-477a-9355-22d0cdf66847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:14.962910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae50324-c91e-477a-9355-22d0cdf66847 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:14.963209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae50324-c91e-477a-9355-22d0cdf66847 admin admin] PATH_INFO: `/v3/projects/1579c645b7764bddb2250132d7af0b73` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:14.964485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae50324-c91e-477a-9355-22d0cdf66847 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1579c645b7764bddb2250132d7af0b73)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:14.966673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae50324-c91e-477a-9355-22d0cdf66847 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:15.139549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eae50324-c91e-477a-9355-22d0cdf66847 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1579c645b7764bddb2250132d7af0b73', 'request_id': 'req-eae50324-c91e-477a-9355-22d0cdf66847'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:15.147478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eae50324-c91e-477a-9355-22d0cdf66847 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1579c645b7764bddb2250132d7af0b73', 'request_id': 'req-eae50324-c91e-477a-9355-22d0cdf66847'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:15.153974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eae50324-c91e-477a-9355-22d0cdf66847 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1579c645b7764bddb2250132d7af0b73', 'request_id': 'req-eae50324-c91e-477a-9355-22d0cdf66847'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:15.229867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eae50324-c91e-477a-9355-22d0cdf66847 admin admin] The token cache is being invalidate because project 1579c645b7764bddb2250132d7af0b73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:15.229867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eae50324-c91e-477a-9355-22d0cdf66847 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:15.229867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eae50324-c91e-477a-9355-22d0cdf66847 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:15.230661 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2329/4589] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:22:14 2022] DELETE /identity/v3/projects/1579c645b7764bddb2250132d7af0b73 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:15.238950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cef7d0-61f7-4dc4-9352-137820ce8aaa service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:15.251199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cef7d0-61f7-4dc4-9352-137820ce8aaa service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:15.326505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3be8f-ec30-474e-9316-94732815b409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:15.328577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3be8f-ec30-474e-9316-94732815b409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:15.328967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3be8f-ec30-474e-9316-94732815b409 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:15.329344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3be8f-ec30-474e-9316-94732815b409 admin admin] PATH_INFO: `/v3/users/0bdda0cb51bb4e7d9a534878a5f6f296` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:15.331217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3be8f-ec30-474e-9316-94732815b409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bdda0cb51bb4e7d9a534878a5f6f296)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:15.333654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3be8f-ec30-474e-9316-94732815b409 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:15.582995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-eda3be8f-ec30-474e-9316-94732815b409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bdda0cb51bb4e7d9a534878a5f6f296'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:15.605319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-eda3be8f-ec30-474e-9316-94732815b409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bdda0cb51bb4e7d9a534878a5f6f296'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:15.666075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-eda3be8f-ec30-474e-9316-94732815b409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bdda0cb51bb4e7d9a534878a5f6f296'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:15.674488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-eda3be8f-ec30-474e-9316-94732815b409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bdda0cb51bb4e7d9a534878a5f6f296'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:15.675217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-eda3be8f-ec30-474e-9316-94732815b409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bdda0cb51bb4e7d9a534878a5f6f296'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:15.681529 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2261/4590] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:22:15 2022] DELETE /identity/v3/users/0bdda0cb51bb4e7d9a534878a5f6f296 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:15.934086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae50324-c91e-477a-9355-22d0cdf66847 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:15.937434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-eae50324-c91e-477a-9355-22d0cdf66847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:16.023599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae50324-c91e-477a-9355-22d0cdf66847 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:16.096472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a7944-8343-4cd7-a1e4-32e379000d86 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1526f31e4b471fb859a9d8f1dac811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc3c6bbb2ffe4856ad86522182e4acbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:16.097354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a7944-8343-4cd7-a1e4-32e379000d86 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:16.097637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a7944-8343-4cd7-a1e4-32e379000d86 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:16.097915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a7944-8343-4cd7-a1e4-32e379000d86 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] PATH_INFO: `/v3/projects/27a571d1625f45c0bd18ab9983b42c4b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:16.099406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a7944-8343-4cd7-a1e4-32e379000d86 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] RBAC: Authorizing `identity:delete_project(project_id=27a571d1625f45c0bd18ab9983b42c4b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:16.106461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a7944-8343-4cd7-a1e4-32e379000d86 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:16.258365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9a9a7944-8343-4cd7-a1e4-32e379000d86 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a571d1625f45c0bd18ab9983b42c4b', 'request_id': 'req-9a9a7944-8343-4cd7-a1e4-32e379000d86'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:16.264723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9a9a7944-8343-4cd7-a1e4-32e379000d86 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a571d1625f45c0bd18ab9983b42c4b', 'request_id': 'req-9a9a7944-8343-4cd7-a1e4-32e379000d86'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:16.271528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9a9a7944-8343-4cd7-a1e4-32e379000d86 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a571d1625f45c0bd18ab9983b42c4b', 'request_id': 'req-9a9a7944-8343-4cd7-a1e4-32e379000d86'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:16.296642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3be8f-ec30-474e-9316-94732815b409 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:16.298187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-eda3be8f-ec30-474e-9316-94732815b409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:16.364648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9a9a7944-8343-4cd7-a1e4-32e379000d86 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] The token cache is being invalidate because project 27a571d1625f45c0bd18ab9983b42c4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:16.366264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9a9a7944-8343-4cd7-a1e4-32e379000d86 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:16.366264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9a9a7944-8343-4cd7-a1e4-32e379000d86 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:16.367517 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2330/4591] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:22:15 2022] DELETE /identity/v3/projects/27a571d1625f45c0bd18ab9983b42c4b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:16.373178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a7944-8343-4cd7-a1e4-32e379000d86 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:16.375451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9a9a7944-8343-4cd7-a1e4-32e379000d86 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:16.394488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3be8f-ec30-474e-9316-94732815b409 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:16.450552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a7944-8343-4cd7-a1e4-32e379000d86 tempest-QuotasNegativeTest-2065505064 tempest-QuotasNegativeTest-2065505064-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:16.455578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96741c57-b003-44e7-bb91-5f34cadca71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:16.456473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96741c57-b003-44e7-bb91-5f34cadca71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:16.456761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96741c57-b003-44e7-bb91-5f34cadca71a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:16.457034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96741c57-b003-44e7-bb91-5f34cadca71a admin admin] PATH_INFO: `/v3/users/2e923f5253fc4e16aad3aec502ea0aa5` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:16.458234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96741c57-b003-44e7-bb91-5f34cadca71a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e923f5253fc4e16aad3aec502ea0aa5)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:16.459139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37647499-2a22-43a6-981b-25acedb8f5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:16.460005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37647499-2a22-43a6-981b-25acedb8f5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:16.460208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96741c57-b003-44e7-bb91-5f34cadca71a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:16.460309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37647499-2a22-43a6-981b-25acedb8f5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:16.460550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37647499-2a22-43a6-981b-25acedb8f5f9 admin admin] PATH_INFO: `/v3/projects/f2cb5d05ea024210994c215280985f35` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:16.461762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37647499-2a22-43a6-981b-25acedb8f5f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2cb5d05ea024210994c215280985f35)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:16.463761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37647499-2a22-43a6-981b-25acedb8f5f9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:16.788813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-96741c57-b003-44e7-bb91-5f34cadca71a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e923f5253fc4e16aad3aec502ea0aa5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:16.789563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-37647499-2a22-43a6-981b-25acedb8f5f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2cb5d05ea024210994c215280985f35', 'request_id': 'req-37647499-2a22-43a6-981b-25acedb8f5f9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:16.795309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-37647499-2a22-43a6-981b-25acedb8f5f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2cb5d05ea024210994c215280985f35', 'request_id': 'req-37647499-2a22-43a6-981b-25acedb8f5f9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:16.796930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-96741c57-b003-44e7-bb91-5f34cadca71a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e923f5253fc4e16aad3aec502ea0aa5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:16.802518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-37647499-2a22-43a6-981b-25acedb8f5f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2cb5d05ea024210994c215280985f35', 'request_id': 'req-37647499-2a22-43a6-981b-25acedb8f5f9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:16.905971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-96741c57-b003-44e7-bb91-5f34cadca71a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e923f5253fc4e16aad3aec502ea0aa5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:16.906626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-96741c57-b003-44e7-bb91-5f34cadca71a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e923f5253fc4e16aad3aec502ea0aa5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:16.919192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-96741c57-b003-44e7-bb91-5f34cadca71a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e923f5253fc4e16aad3aec502ea0aa5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:16.926320 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2331/4592] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:22:16 2022] DELETE /identity/v3/users/2e923f5253fc4e16aad3aec502ea0aa5 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:16.930738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b2351-87fa-4a4b-b90e-cd5328bdb369 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:16.931047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b2351-87fa-4a4b-b90e-cd5328bdb369 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:16.931484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b2351-87fa-4a4b-b90e-cd5328bdb369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:16.950764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c56b2351-87fa-4a4b-b90e-cd5328bdb369 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:16.952326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c56b2351-87fa-4a4b-b90e-cd5328bdb369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:17.025424 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2332/4593] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:22:17.028854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-37647499-2a22-43a6-981b-25acedb8f5f9 admin admin] The token cache is being invalidate because project f2cb5d05ea024210994c215280985f35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:17.029157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-37647499-2a22-43a6-981b-25acedb8f5f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:17.029908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-37647499-2a22-43a6-981b-25acedb8f5f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:17.031919 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2262/4594] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:22:16 2022] DELETE /identity/v3/projects/f2cb5d05ea024210994c215280985f35 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:17.037763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06eafda-da87-4694-8099-1513b07beebf None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:17.038547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06eafda-da87-4694-8099-1513b07beebf None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:17.038547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06eafda-da87-4694-8099-1513b07beebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:17.038784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37647499-2a22-43a6-981b-25acedb8f5f9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:17.040122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-37647499-2a22-43a6-981b-25acedb8f5f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:17.053339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:17.078227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e06eafda-da87-4694-8099-1513b07beebf None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:17.080010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e06eafda-da87-4694-8099-1513b07beebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:17.089247 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2333/4595] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:17.097744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4301ba-1882-4e67-a469-9fb7e0798b53 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:17.098216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4301ba-1882-4e67-a469-9fb7e0798b53 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:17.098643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4301ba-1882-4e67-a469-9fb7e0798b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:17.118228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6a4301ba-1882-4e67-a469-9fb7e0798b53 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:17.119472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6a4301ba-1882-4e67-a469-9fb7e0798b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:17.130286 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2334/4596] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:17.135845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4301ba-1882-4e67-a469-9fb7e0798b53 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:17.147040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4301ba-1882-4e67-a469-9fb7e0798b53 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:17.147247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37647499-2a22-43a6-981b-25acedb8f5f9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:17.152737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcb910-e34e-47dc-a72a-dd1327241636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:17.155707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcb910-e34e-47dc-a72a-dd1327241636 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:17.155707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcb910-e34e-47dc-a72a-dd1327241636 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:17.155707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcb910-e34e-47dc-a72a-dd1327241636 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:17.155707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adcb910-e34e-47dc-a72a-dd1327241636 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:22:17.156692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adcb910-e34e-47dc-a72a-dd1327241636 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:17.159722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adcb910-e34e-47dc-a72a-dd1327241636 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:17.179454 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2335/4597] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:22:17.184006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcb910-e34e-47dc-a72a-dd1327241636 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:17.194884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcb910-e34e-47dc-a72a-dd1327241636 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:17.199953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd8fef-8bb6-4718-8b16-6763cc3132aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:17.200615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd8fef-8bb6-4718-8b16-6763cc3132aa admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:17.200902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd8fef-8bb6-4718-8b16-6763cc3132aa admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:17.201185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd8fef-8bb6-4718-8b16-6763cc3132aa admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:17.202032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd8fef-8bb6-4718-8b16-6763cc3132aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:17.204634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd8fef-8bb6-4718-8b16-6763cc3132aa admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:17.208277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d948cf-21cb-4372-b1d7-f776bcad7605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:17.208992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d948cf-21cb-4372-b1d7-f776bcad7605 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:17.209992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d948cf-21cb-4372-b1d7-f776bcad7605 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:17.210575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d948cf-21cb-4372-b1d7-f776bcad7605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:17.213072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-74d948cf-21cb-4372-b1d7-f776bcad7605 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:17.235351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d948cf-21cb-4372-b1d7-f776bcad7605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:17.237080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d948cf-21cb-4372-b1d7-f776bcad7605 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:17.248941 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2263/4598] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:22:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:22:17.338282 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2336/4599] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:22:17 2022] POST /identity/v3/projects => generated 369 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:17.339941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d948cf-21cb-4372-b1d7-f776bcad7605 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:17.351364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d948cf-21cb-4372-b1d7-f776bcad7605 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:17.414112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ea244-4ebe-4b53-894d-bfc964e561c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:17.414790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ea244-4ebe-4b53-894d-bfc964e561c5 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:17.415118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ea244-4ebe-4b53-894d-bfc964e561c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:17.415378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ea244-4ebe-4b53-894d-bfc964e561c5 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:17.416064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ea244-4ebe-4b53-894d-bfc964e561c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:17.417975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ea244-4ebe-4b53-894d-bfc964e561c5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:17.430828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:17.529154 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2264/4600] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:22:17 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:17.533989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd8fef-8bb6-4718-8b16-6763cc3132aa admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:17.548137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd8fef-8bb6-4718-8b16-6763cc3132aa admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:17.554225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4381523-877c-4fe3-a2bd-d791d43ce983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:17.555369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4381523-877c-4fe3-a2bd-d791d43ce983 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:17.555369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4381523-877c-4fe3-a2bd-d791d43ce983 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:17.555625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4381523-877c-4fe3-a2bd-d791d43ce983 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:17.556566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4381523-877c-4fe3-a2bd-d791d43ce983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:17.557990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4381523-877c-4fe3-a2bd-d791d43ce983 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:17.569975 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2337/4601] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:22:17.574989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ea244-4ebe-4b53-894d-bfc964e561c5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:17.587416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ea244-4ebe-4b53-894d-bfc964e561c5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:17.594997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d512a8-55e1-4cea-8e8c-05317f42f372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:17.595562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d512a8-55e1-4cea-8e8c-05317f42f372 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:17.595970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d512a8-55e1-4cea-8e8c-05317f42f372 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:17.596377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d512a8-55e1-4cea-8e8c-05317f42f372 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:17.597662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d512a8-55e1-4cea-8e8c-05317f42f372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:17.599980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d512a8-55e1-4cea-8e8c-05317f42f372 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:17.615046 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2265/4602] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:17.617196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4381523-877c-4fe3-a2bd-d791d43ce983 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:17.619733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:17.630408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4381523-877c-4fe3-a2bd-d791d43ce983 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:17.635777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c23e6-4875-40c8-af6c-b37733f67197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:17.636667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c23e6-4875-40c8-af6c-b37733f67197 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:17.636953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c23e6-4875-40c8-af6c-b37733f67197 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:17.637232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c23e6-4875-40c8-af6c-b37733f67197 admin admin] PATH_INFO: `/v3/projects/c2a53516d4124b0cb0443d02647dd7cd/users/6e6c22bd04c440dfa8f473e58e429462/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:17.653581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c23e6-4875-40c8-af6c-b37733f67197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2a53516d4124b0cb0443d02647dd7cd, user_id=6e6c22bd04c440dfa8f473e58e429462, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:17.657252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c23e6-4875-40c8-af6c-b37733f67197 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:17.691804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d512a8-55e1-4cea-8e8c-05317f42f372 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:17.693902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-92d512a8-55e1-4cea-8e8c-05317f42f372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:17.708602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d512a8-55e1-4cea-8e8c-05317f42f372 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:17.714320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdc845-1916-420a-a3bb-bcaf1d0bb3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:17.715368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdc845-1916-420a-a3bb-bcaf1d0bb3ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:17.715720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdc845-1916-420a-a3bb-bcaf1d0bb3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:17.716002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdc845-1916-420a-a3bb-bcaf1d0bb3ac admin admin] PATH_INFO: `/v3/projects/1f726c2a62c34705b4c9be3a77d17491` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:17.718900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdc845-1916-420a-a3bb-bcaf1d0bb3ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f726c2a62c34705b4c9be3a77d17491)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:17.720213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdc845-1916-420a-a3bb-bcaf1d0bb3ac admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:17.735681 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2338/4603] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:17 2022] PUT /identity/v3/projects/c2a53516d4124b0cb0443d02647dd7cd/users/6e6c22bd04c440dfa8f473e58e429462/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:17.745975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1e202-2357-487e-bae9-4bfe57cefe3a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:17.746933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1e202-2357-487e-bae9-4bfe57cefe3a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:17.747338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1e202-2357-487e-bae9-4bfe57cefe3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:17.776128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-69c1e202-2357-487e-bae9-4bfe57cefe3a None None] MFA Rules not processed for user `6e6c22bd04c440dfa8f473e58e429462`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:17.777381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-69c1e202-2357-487e-bae9-4bfe57cefe3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:17.846373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cdbdc845-1916-420a-a3bb-bcaf1d0bb3ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f726c2a62c34705b4c9be3a77d17491', 'request_id': 'req-cdbdc845-1916-420a-a3bb-bcaf1d0bb3ac'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:17.849554 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2339/4604] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:17.852036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cdbdc845-1916-420a-a3bb-bcaf1d0bb3ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f726c2a62c34705b4c9be3a77d17491', 'request_id': 'req-cdbdc845-1916-420a-a3bb-bcaf1d0bb3ac'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:17.859326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1e202-2357-487e-bae9-4bfe57cefe3a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:17.860818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cdbdc845-1916-420a-a3bb-bcaf1d0bb3ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f726c2a62c34705b4c9be3a77d17491', 'request_id': 'req-cdbdc845-1916-420a-a3bb-bcaf1d0bb3ac'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:17.869118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1e202-2357-487e-bae9-4bfe57cefe3a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:17.922946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e365102-ff07-430c-ac37-677994204434 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6c22bd04c440dfa8f473e58e429462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a53516d4124b0cb0443d02647dd7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:17.923767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e365102-ff07-430c-ac37-677994204434 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:17.924050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e365102-ff07-430c-ac37-677994204434 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:17.924322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e365102-ff07-430c-ac37-677994204434 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] PATH_INFO: `/v3/users/6e6c22bd04c440dfa8f473e58e429462/application_credentials` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:17.925042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e365102-ff07-430c-ac37-677994204434 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: Authorizing `identity:create_application_credential(user_id=6e6c22bd04c440dfa8f473e58e429462)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:17.926243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e365102-ff07-430c-ac37-677994204434 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:17.985103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cdbdc845-1916-420a-a3bb-bcaf1d0bb3ac admin admin] The token cache is being invalidate because project 1f726c2a62c34705b4c9be3a77d17491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:17.985399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cdbdc845-1916-420a-a3bb-bcaf1d0bb3ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:17.989027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cdbdc845-1916-420a-a3bb-bcaf1d0bb3ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:17.991568 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2266/4605] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:22:17 2022] DELETE /identity/v3/projects/1f726c2a62c34705b4c9be3a77d17491 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:22:18.000229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdc845-1916-420a-a3bb-bcaf1d0bb3ac admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:18.001858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cdbdc845-1916-420a-a3bb-bcaf1d0bb3ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:18.089071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdc845-1916-420a-a3bb-bcaf1d0bb3ac admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:18.094810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab2776-1c0e-4dfd-ba59-b2555a6cb800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:18.095864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab2776-1c0e-4dfd-ba59-b2555a6cb800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:18.096245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab2776-1c0e-4dfd-ba59-b2555a6cb800 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:18.096623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab2776-1c0e-4dfd-ba59-b2555a6cb800 admin admin] PATH_INFO: `/v3/users/0b1526f31e4b471fb859a9d8f1dac811` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:18.098173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab2776-1c0e-4dfd-ba59-b2555a6cb800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b1526f31e4b471fb859a9d8f1dac811)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:18.100509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab2776-1c0e-4dfd-ba59-b2555a6cb800 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:18.157170 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2340/4606] 10.222.0.16 () {60 vars in 1314 bytes} [Sat Jul 16 21:22:17 2022] POST /identity/v3/users/6e6c22bd04c440dfa8f473e58e429462/application_credentials => generated 921 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:22:18.161590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e365102-ff07-430c-ac37-677994204434 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:18.163742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4e365102-ff07-430c-ac37-677994204434 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:18.178873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e365102-ff07-430c-ac37-677994204434 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:18.183915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a9d96-ec8d-4c36-bff6-4dff33cc6573 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6c22bd04c440dfa8f473e58e429462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a53516d4124b0cb0443d02647dd7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:18.185172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a9d96-ec8d-4c36-bff6-4dff33cc6573 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:18.185458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a9d96-ec8d-4c36-bff6-4dff33cc6573 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:18.186283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a9d96-ec8d-4c36-bff6-4dff33cc6573 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] PATH_INFO: `/v3/users/6e6c22bd04c440dfa8f473e58e429462/access_rules/3439e7dc42d545e9911470d917c2a9b4` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:18.187504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a9d96-ec8d-4c36-bff6-4dff33cc6573 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: Authorizing `identity:delete_access_rule(user_id=6e6c22bd04c440dfa8f473e58e429462, access_rule_id=3439e7dc42d545e9911470d917c2a9b4)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:18.189018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a9d96-ec8d-4c36-bff6-4dff33cc6573 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:18.242080 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-806a9d96-ec8d-4c36-bff6-4dff33cc6573 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jul 16 21:22:18.242080 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:22:18.242080 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Jul 16 21:22:18.242080 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application session.delete(ref) Jul 16 21:22:18.242080 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 16 21:22:18.242080 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application next(self.gen) Jul 16 21:22:18.242080 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 16 21:22:18.242080 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application yield resource Jul 16 21:22:18.242080 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 16 21:22:18.242080 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application next(self.gen) Jul 16 21:22:18.242080 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 16 21:22:18.242080 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self.session.rollback() Jul 16 21:22:18.242080 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 16 21:22:18.242080 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self.force_reraise() Jul 16 21:22:18.242080 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 16 21:22:18.242080 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise self.value Jul 16 21:22:18.247172 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 16 21:22:18.247172 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 16 21:22:18.247172 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 16 21:22:18.247172 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application session.commit() Jul 16 21:22:18.247172 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 16 21:22:18.247172 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 16 21:22:18.247172 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 16 21:22:18.247172 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._prepare_impl() Jul 16 21:22:18.247172 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 16 21:22:18.247172 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self.session.flush() Jul 16 21:22:18.247172 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 16 21:22:18.247172 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._flush(objects) Jul 16 21:22:18.247172 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 16 21:22:18.247172 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 16 21:22:18.247172 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 16 21:22:18.247172 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application compat.raise_( Jul 16 21:22:18.248498 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 16 21:22:18.248498 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception Jul 16 21:22:18.248498 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 16 21:22:18.248498 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application flush_context.execute() Jul 16 21:22:18.248498 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 16 21:22:18.248498 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rec.execute(self) Jul 16 21:22:18.248498 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Jul 16 21:22:18.248498 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Jul 16 21:22:18.248498 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Jul 16 21:22:18.248498 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._synchronize( Jul 16 21:22:18.248498 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Jul 16 21:22:18.248498 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Jul 16 21:22:18.248498 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Jul 16 21:22:18.248498 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise AssertionError( Jul 16 21:22:18.248498 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Jul 16 21:22:18.248498 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:22:18.249937 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:22:18.249937 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:22:18.249937 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:22:18.249937 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:22:18.249937 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:22:18.249937 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:22:18.249937 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:22:18.249937 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:22:18.249937 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:22:18.249937 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:22:18.249937 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:22:18.249937 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:22:18.249937 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:22:18.249937 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Jul 16 21:22:18.249937 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Jul 16 21:22:18.249937 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:22:18.249937 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:22:18.251263 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Jul 16 21:22:18.251263 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Jul 16 21:22:18.251263 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Jul 16 21:22:18.251263 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jul 16 21:22:18.251263 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jul 16 21:22:18.251263 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:22:18.251263 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2341/4607] 10.222.0.16 () {58 vars in 1361 bytes} [Sat Jul 16 21:22:18 2022] DELETE /identity/v3/users/6e6c22bd04c440dfa8f473e58e429462/access_rules/3439e7dc42d545e9911470d917c2a9b4 => generated 89 bytes in 86 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Jul 16 21:22:18.253186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a9d96-ec8d-4c36-bff6-4dff33cc6573 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:18.264370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a9d96-ec8d-4c36-bff6-4dff33cc6573 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:18.271362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc860b-c783-46cd-9b03-efac3d0dbe27 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6c22bd04c440dfa8f473e58e429462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a53516d4124b0cb0443d02647dd7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:18.275799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc860b-c783-46cd-9b03-efac3d0dbe27 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:18.275799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc860b-c783-46cd-9b03-efac3d0dbe27 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:18.275799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc860b-c783-46cd-9b03-efac3d0dbe27 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] PATH_INFO: `/v3/users/6e6c22bd04c440dfa8f473e58e429462/application_credentials/8996d9cdb16c4e919993d2e9585e281b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:18.294976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc860b-c783-46cd-9b03-efac3d0dbe27 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: Authorizing `identity:delete_application_credential(user_id=6e6c22bd04c440dfa8f473e58e429462, application_credential_id=8996d9cdb16c4e919993d2e9585e281b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:18.296629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc860b-c783-46cd-9b03-efac3d0dbe27 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:18.350606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d1ab2776-1c0e-4dfd-ba59-b2555a6cb800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b1526f31e4b471fb859a9d8f1dac811'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:18.364594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d1ab2776-1c0e-4dfd-ba59-b2555a6cb800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b1526f31e4b471fb859a9d8f1dac811'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:18.397917 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2342/4608] 10.222.0.16 () {58 vars in 1394 bytes} [Sat Jul 16 21:22:18 2022] DELETE /identity/v3/users/6e6c22bd04c440dfa8f473e58e429462/application_credentials/8996d9cdb16c4e919993d2e9585e281b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:22:18.401948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc860b-c783-46cd-9b03-efac3d0dbe27 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:18.415250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc860b-c783-46cd-9b03-efac3d0dbe27 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:18.423236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb1f87-1b98-4c63-9efe-2390cabd871a tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6c22bd04c440dfa8f473e58e429462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a53516d4124b0cb0443d02647dd7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:18.424881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb1f87-1b98-4c63-9efe-2390cabd871a tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:18.425223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb1f87-1b98-4c63-9efe-2390cabd871a tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:18.425508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb1f87-1b98-4c63-9efe-2390cabd871a tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] PATH_INFO: `/v3/users/6e6c22bd04c440dfa8f473e58e429462/access_rules` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:18.427181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb1f87-1b98-4c63-9efe-2390cabd871a tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: Authorizing `identity:list_access_rules(user_id=6e6c22bd04c440dfa8f473e58e429462)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:18.429115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb1f87-1b98-4c63-9efe-2390cabd871a tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:18.436507 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2343/4609] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Jul 16 21:22:18 2022] GET /identity/v3/users/6e6c22bd04c440dfa8f473e58e429462/access_rules => generated 369 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:22:18.441316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb1f87-1b98-4c63-9efe-2390cabd871a tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:18.457210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb1f87-1b98-4c63-9efe-2390cabd871a tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:18.463890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3768c88-1fb7-4cdb-9f29-f5eac0b6c0f8 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6c22bd04c440dfa8f473e58e429462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a53516d4124b0cb0443d02647dd7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:18.465390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3768c88-1fb7-4cdb-9f29-f5eac0b6c0f8 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:18.465857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3768c88-1fb7-4cdb-9f29-f5eac0b6c0f8 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:18.466432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3768c88-1fb7-4cdb-9f29-f5eac0b6c0f8 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] PATH_INFO: `/v3/users/6e6c22bd04c440dfa8f473e58e429462/access_rules/3439e7dc42d545e9911470d917c2a9b4` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:18.468013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3768c88-1fb7-4cdb-9f29-f5eac0b6c0f8 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: Authorizing `identity:delete_access_rule(user_id=6e6c22bd04c440dfa8f473e58e429462, access_rule_id=3439e7dc42d545e9911470d917c2a9b4)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:18.469930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3768c88-1fb7-4cdb-9f29-f5eac0b6c0f8 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:18.482927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d1ab2776-1c0e-4dfd-ba59-b2555a6cb800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b1526f31e4b471fb859a9d8f1dac811'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:18.491947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d1ab2776-1c0e-4dfd-ba59-b2555a6cb800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b1526f31e4b471fb859a9d8f1dac811'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:18.493095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d1ab2776-1c0e-4dfd-ba59-b2555a6cb800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b1526f31e4b471fb859a9d8f1dac811'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:18.500512 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2267/4610] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:22:17 2022] DELETE /identity/v3/users/0b1526f31e4b471fb859a9d8f1dac811 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:22:18.581263 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2344/4611] 10.222.0.16 () {58 vars in 1361 bytes} [Sat Jul 16 21:22:18 2022] DELETE /identity/v3/users/6e6c22bd04c440dfa8f473e58e429462/access_rules/3439e7dc42d545e9911470d917c2a9b4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:18.586213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab2776-1c0e-4dfd-ba59-b2555a6cb800 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:18.588092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d1ab2776-1c0e-4dfd-ba59-b2555a6cb800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:18.657792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab2776-1c0e-4dfd-ba59-b2555a6cb800 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:18.662226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7cd03-945e-4a72-b08e-9734bbdffcda tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6c22bd04c440dfa8f473e58e429462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a53516d4124b0cb0443d02647dd7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:18.663318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7cd03-945e-4a72-b08e-9734bbdffcda tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:18.663614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7cd03-945e-4a72-b08e-9734bbdffcda tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:18.663893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7cd03-945e-4a72-b08e-9734bbdffcda tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] PATH_INFO: `/v3/users/6e6c22bd04c440dfa8f473e58e429462/access_rules` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:18.665152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7cd03-945e-4a72-b08e-9734bbdffcda tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: Authorizing `identity:list_access_rules(user_id=6e6c22bd04c440dfa8f473e58e429462)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:18.666636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7cd03-945e-4a72-b08e-9734bbdffcda tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:18.677408 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2268/4612] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Jul 16 21:22:18 2022] GET /identity/v3/users/6e6c22bd04c440dfa8f473e58e429462/access_rules => generated 158 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:22:18.678818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3768c88-1fb7-4cdb-9f29-f5eac0b6c0f8 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:18.689361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3768c88-1fb7-4cdb-9f29-f5eac0b6c0f8 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:18.693911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fd54d-f711-4b93-9f66-4cac2da2b235 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6c22bd04c440dfa8f473e58e429462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a53516d4124b0cb0443d02647dd7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:18.694849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fd54d-f711-4b93-9f66-4cac2da2b235 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:18.697818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fd54d-f711-4b93-9f66-4cac2da2b235 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:18.697818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fd54d-f711-4b93-9f66-4cac2da2b235 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] PATH_INFO: `/v3/users/6e6c22bd04c440dfa8f473e58e429462/application_credentials` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:18.697818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fd54d-f711-4b93-9f66-4cac2da2b235 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: Authorizing `identity:create_application_credential(user_id=6e6c22bd04c440dfa8f473e58e429462)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:18.697818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fd54d-f711-4b93-9f66-4cac2da2b235 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:18.739948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:18.929798 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2345/4613] 10.222.0.16 () {60 vars in 1314 bytes} [Sat Jul 16 21:22:18 2022] POST /identity/v3/users/6e6c22bd04c440dfa8f473e58e429462/application_credentials => generated 921 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:18.933796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7cd03-945e-4a72-b08e-9734bbdffcda tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:18.948862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7cd03-945e-4a72-b08e-9734bbdffcda tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:18.950765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fd5e9-274c-4859-a7d4-41f03994a134 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6c22bd04c440dfa8f473e58e429462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a53516d4124b0cb0443d02647dd7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:18.951733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fd5e9-274c-4859-a7d4-41f03994a134 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:18.952970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fd5e9-274c-4859-a7d4-41f03994a134 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:18.953263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fd5e9-274c-4859-a7d4-41f03994a134 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] PATH_INFO: `/v3/users/6e6c22bd04c440dfa8f473e58e429462/access_rules` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:18.954670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fd5e9-274c-4859-a7d4-41f03994a134 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: Authorizing `identity:list_access_rules(user_id=6e6c22bd04c440dfa8f473e58e429462)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:18.956274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fd5e9-274c-4859-a7d4-41f03994a134 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:18.965765 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2269/4614] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Jul 16 21:22:18 2022] GET /identity/v3/users/6e6c22bd04c440dfa8f473e58e429462/access_rules => generated 369 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:22:18.967430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fd54d-f711-4b93-9f66-4cac2da2b235 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:18.977341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fd54d-f711-4b93-9f66-4cac2da2b235 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:18.981504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea1840-3f9c-4967-b22d-9728ce721168 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6c22bd04c440dfa8f473e58e429462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a53516d4124b0cb0443d02647dd7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:18.982419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea1840-3f9c-4967-b22d-9728ce721168 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:18.982655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea1840-3f9c-4967-b22d-9728ce721168 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:18.982997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea1840-3f9c-4967-b22d-9728ce721168 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] PATH_INFO: `/v3/users/6e6c22bd04c440dfa8f473e58e429462/application_credentials` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:18.984308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea1840-3f9c-4967-b22d-9728ce721168 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: Authorizing `identity:create_application_credential(user_id=6e6c22bd04c440dfa8f473e58e429462)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:18.985549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea1840-3f9c-4967-b22d-9728ce721168 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:19.169974 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2346/4615] 10.222.0.16 () {60 vars in 1314 bytes} [Sat Jul 16 21:22:18 2022] POST /identity/v3/users/6e6c22bd04c440dfa8f473e58e429462/application_credentials => generated 921 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:19.172634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fd5e9-274c-4859-a7d4-41f03994a134 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:19.174463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea1840-3f9c-4967-b22d-9728ce721168 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:19.174587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-be8fd5e9-274c-4859-a7d4-41f03994a134 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:19.184521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea1840-3f9c-4967-b22d-9728ce721168 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:19.191906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635d4cf-acb2-49fe-a5a3-e9befd6b669f tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6c22bd04c440dfa8f473e58e429462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a53516d4124b0cb0443d02647dd7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:19.191906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635d4cf-acb2-49fe-a5a3-e9befd6b669f tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:19.191906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635d4cf-acb2-49fe-a5a3-e9befd6b669f tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:19.192185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635d4cf-acb2-49fe-a5a3-e9befd6b669f tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] PATH_INFO: `/v3/users/6e6c22bd04c440dfa8f473e58e429462/access_rules/398dfa41099048229346e97e78114ed7` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:19.192428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635d4cf-acb2-49fe-a5a3-e9befd6b669f tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: Authorizing `identity:get_access_rule(user_id=6e6c22bd04c440dfa8f473e58e429462, access_rule_id=398dfa41099048229346e97e78114ed7)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:19.194082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635d4cf-acb2-49fe-a5a3-e9befd6b669f tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:19.200359 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2347/4616] 10.222.0.16 () {58 vars in 1358 bytes} [Sat Jul 16 21:22:19 2022] GET /identity/v3/users/6e6c22bd04c440dfa8f473e58e429462/access_rules/398dfa41099048229346e97e78114ed7 => generated 229 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:22:19.205819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635d4cf-acb2-49fe-a5a3-e9befd6b669f tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:19.207951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9635d4cf-acb2-49fe-a5a3-e9befd6b669f tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:19.316980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fd5e9-274c-4859-a7d4-41f03994a134 tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:19.321817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adad885-31b3-497d-bfcc-34c3bd0f873c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:19.322770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adad885-31b3-497d-bfcc-34c3bd0f873c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:19.323177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adad885-31b3-497d-bfcc-34c3bd0f873c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:19.323528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adad885-31b3-497d-bfcc-34c3bd0f873c admin admin] PATH_INFO: `/v3/projects/dc3c6bbb2ffe4856ad86522182e4acbc` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:19.324853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adad885-31b3-497d-bfcc-34c3bd0f873c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc3c6bbb2ffe4856ad86522182e4acbc)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:19.326824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adad885-31b3-497d-bfcc-34c3bd0f873c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:19.336135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635d4cf-acb2-49fe-a5a3-e9befd6b669f tempest-AccessRulesV3Test-506555760 tempest-AccessRulesV3Test-506555760-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:19.343338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aeb37b-43da-4753-9974-6b524991832f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:19.344646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aeb37b-43da-4753-9974-6b524991832f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:19.344967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aeb37b-43da-4753-9974-6b524991832f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:19.345250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aeb37b-43da-4753-9974-6b524991832f admin admin] PATH_INFO: `/v3/users/6e6c22bd04c440dfa8f473e58e429462` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:19.346538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aeb37b-43da-4753-9974-6b524991832f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e6c22bd04c440dfa8f473e58e429462)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:19.349134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aeb37b-43da-4753-9974-6b524991832f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:19.495845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8adad885-31b3-497d-bfcc-34c3bd0f873c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc3c6bbb2ffe4856ad86522182e4acbc', 'request_id': 'req-8adad885-31b3-497d-bfcc-34c3bd0f873c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:19.504192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8adad885-31b3-497d-bfcc-34c3bd0f873c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc3c6bbb2ffe4856ad86522182e4acbc', 'request_id': 'req-8adad885-31b3-497d-bfcc-34c3bd0f873c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:19.511412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8adad885-31b3-497d-bfcc-34c3bd0f873c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc3c6bbb2ffe4856ad86522182e4acbc', 'request_id': 'req-8adad885-31b3-497d-bfcc-34c3bd0f873c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:19.553731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c1aeb37b-43da-4753-9974-6b524991832f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e6c22bd04c440dfa8f473e58e429462'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:19.568032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c1aeb37b-43da-4753-9974-6b524991832f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e6c22bd04c440dfa8f473e58e429462'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:19.636673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8adad885-31b3-497d-bfcc-34c3bd0f873c admin admin] The token cache is being invalidate because project dc3c6bbb2ffe4856ad86522182e4acbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:19.636992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8adad885-31b3-497d-bfcc-34c3bd0f873c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:19.637639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8adad885-31b3-497d-bfcc-34c3bd0f873c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:19.639222 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2270/4617] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:22:19 2022] DELETE /identity/v3/projects/dc3c6bbb2ffe4856ad86522182e4acbc => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:19.644681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0df11-5d35-4795-aa1d-8eb818392154 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:19.644970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0df11-5d35-4795-aa1d-8eb818392154 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:19.645250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0df11-5d35-4795-aa1d-8eb818392154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:19.653634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:19.664610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-34e0df11-5d35-4795-aa1d-8eb818392154 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:19.665824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-34e0df11-5d35-4795-aa1d-8eb818392154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:19.722633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c1aeb37b-43da-4753-9974-6b524991832f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e6c22bd04c440dfa8f473e58e429462'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:19.723287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c1aeb37b-43da-4753-9974-6b524991832f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e6c22bd04c440dfa8f473e58e429462'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:19.726782 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2271/4618] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:22:19.734950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0444f7-84bd-4dad-a7b8-daf364a9cd0a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:19.735302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0444f7-84bd-4dad-a7b8-daf364a9cd0a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:19.735591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0444f7-84bd-4dad-a7b8-daf364a9cd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:19.755407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9a0444f7-84bd-4dad-a7b8-daf364a9cd0a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:19.756617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9a0444f7-84bd-4dad-a7b8-daf364a9cd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:19.764849 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2272/4619] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:22:19.769139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0444f7-84bd-4dad-a7b8-daf364a9cd0a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:19.778252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0444f7-84bd-4dad-a7b8-daf364a9cd0a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:19.783219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932387b-f7b9-4243-a773-79fb83a29c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:19.783922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932387b-f7b9-4243-a773-79fb83a29c50 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:19.784201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932387b-f7b9-4243-a773-79fb83a29c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:19.784477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932387b-f7b9-4243-a773-79fb83a29c50 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:19.785201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932387b-f7b9-4243-a773-79fb83a29c50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:22:19.785795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932387b-f7b9-4243-a773-79fb83a29c50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:19.787114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932387b-f7b9-4243-a773-79fb83a29c50 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:19.800404 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2273/4620] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:22:19.804255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932387b-f7b9-4243-a773-79fb83a29c50 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:19.821141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932387b-f7b9-4243-a773-79fb83a29c50 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:19.836360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab5c01-0bf0-4411-8531-0117c348e42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:19.837110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab5c01-0bf0-4411-8531-0117c348e42d admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:19.837396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab5c01-0bf0-4411-8531-0117c348e42d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:19.837671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab5c01-0bf0-4411-8531-0117c348e42d admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:19.838364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab5c01-0bf0-4411-8531-0117c348e42d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:19.840311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab5c01-0bf0-4411-8531-0117c348e42d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:19.899201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c1aeb37b-43da-4753-9974-6b524991832f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e6c22bd04c440dfa8f473e58e429462'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:19.906206 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2348/4621] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:22:19 2022] DELETE /identity/v3/users/6e6c22bd04c440dfa8f473e58e429462 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:19.910463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11973a49-4b6b-46ef-a7ce-0bbe282033c8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:19.910757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11973a49-4b6b-46ef-a7ce-0bbe282033c8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:19.911074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11973a49-4b6b-46ef-a7ce-0bbe282033c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:19.924162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:19.929772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-11973a49-4b6b-46ef-a7ce-0bbe282033c8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:19.930805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-11973a49-4b6b-46ef-a7ce-0bbe282033c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:19.938224 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2274/4622] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:22:19 2022] POST /identity/v3/projects => generated 399 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:22:19.939604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab5c01-0bf0-4411-8531-0117c348e42d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:20.003257 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2349/4623] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:22:20.020701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11973a49-4b6b-46ef-a7ce-0bbe282033c8 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:20.020701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-11973a49-4b6b-46ef-a7ce-0bbe282033c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:20.024967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab5c01-0bf0-4411-8531-0117c348e42d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:20.031913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed80b2-d30a-4779-a713-46b85c95b60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:20.032746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed80b2-d30a-4779-a713-46b85c95b60e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:20.033038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed80b2-d30a-4779-a713-46b85c95b60e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:20.033319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed80b2-d30a-4779-a713-46b85c95b60e admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:20.034051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed80b2-d30a-4779-a713-46b85c95b60e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:20.035981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed80b2-d30a-4779-a713-46b85c95b60e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:20.112181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11973a49-4b6b-46ef-a7ce-0bbe282033c8 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:20.135057 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2275/4624] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:22:19 2022] POST /identity/v3/users => generated 300 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:22:20.136426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8b17c-4c1f-4e53-80a9-83236017af43 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:20.136721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8b17c-4c1f-4e53-80a9-83236017af43 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:20.139517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8b17c-4c1f-4e53-80a9-83236017af43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:20.155674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4ac8b17c-4c1f-4e53-80a9-83236017af43 None None] MFA Rules not processed for user `6f2e974ab5aa48dfb4b00f810dcedb63`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:20.159684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4ac8b17c-4c1f-4e53-80a9-83236017af43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:20.164180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad3a39-a39e-44b4-9d0b-e276dddb9812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:20.164823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad3a39-a39e-44b4-9d0b-e276dddb9812 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:20.165105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad3a39-a39e-44b4-9d0b-e276dddb9812 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:20.165419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad3a39-a39e-44b4-9d0b-e276dddb9812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:20.175628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad3a39-a39e-44b4-9d0b-e276dddb9812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:20.177234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad3a39-a39e-44b4-9d0b-e276dddb9812 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:20.187232 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2350/4625] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:22:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:22:20.191977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad3a39-a39e-44b4-9d0b-e276dddb9812 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:20.201734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad3a39-a39e-44b4-9d0b-e276dddb9812 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:20.206728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71018f24-7e4c-4f6f-8117-839ba3f4b56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:20.207427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71018f24-7e4c-4f6f-8117-839ba3f4b56e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:20.207710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71018f24-7e4c-4f6f-8117-839ba3f4b56e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:20.207983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71018f24-7e4c-4f6f-8117-839ba3f4b56e admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:20.209027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71018f24-7e4c-4f6f-8117-839ba3f4b56e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:20.210656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71018f24-7e4c-4f6f-8117-839ba3f4b56e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:20.225284 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2276/4626] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:20.225491 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2351/4627] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:20.235921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8b17c-4c1f-4e53-80a9-83236017af43 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:20.251710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8b17c-4c1f-4e53-80a9-83236017af43 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:20.256341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143940f-6934-4140-bc8e-360fd28d66ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:20.257046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143940f-6934-4140-bc8e-360fd28d66ed admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:20.257336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143940f-6934-4140-bc8e-360fd28d66ed admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:20.257597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143940f-6934-4140-bc8e-360fd28d66ed admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:20.258403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143940f-6934-4140-bc8e-360fd28d66ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:20.260311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143940f-6934-4140-bc8e-360fd28d66ed admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:20.274197 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2277/4628] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:20.275857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71018f24-7e4c-4f6f-8117-839ba3f4b56e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:20.288930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71018f24-7e4c-4f6f-8117-839ba3f4b56e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:20.294458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8af595-4bec-4fe6-85a7-be804ad354b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:20.297722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8af595-4bec-4fe6-85a7-be804ad354b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:20.297722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8af595-4bec-4fe6-85a7-be804ad354b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:20.297722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8af595-4bec-4fe6-85a7-be804ad354b0 admin admin] PATH_INFO: `/v3/projects/8813dbf63ca8439c8ce487b4ecc02398/users/6d3c3e30e1a7431ab7cc33fa2b867eab/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:20.312607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8af595-4bec-4fe6-85a7-be804ad354b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8813dbf63ca8439c8ce487b4ecc02398, user_id=6d3c3e30e1a7431ab7cc33fa2b867eab, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:20.315420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8af595-4bec-4fe6-85a7-be804ad354b0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:20.472955 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2352/4629] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:20 2022] PUT /identity/v3/projects/8813dbf63ca8439c8ce487b4ecc02398/users/6d3c3e30e1a7431ab7cc33fa2b867eab/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:22:20.483228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c880e-9f22-46c8-a614-942fa8a77410 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:20.484031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c880e-9f22-46c8-a614-942fa8a77410 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:20.484317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c880e-9f22-46c8-a614-942fa8a77410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:20.513768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-747c880e-9f22-46c8-a614-942fa8a77410 None None] MFA Rules not processed for user `6d3c3e30e1a7431ab7cc33fa2b867eab`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:20.515647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-747c880e-9f22-46c8-a614-942fa8a77410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:20.608375 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2278/4630] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:20.613022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8af595-4bec-4fe6-85a7-be804ad354b0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:20.687441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8af595-4bec-4fe6-85a7-be804ad354b0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:20.692404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee1fbb-51c4-4b28-af6d-d29595b5f9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:20.693083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee1fbb-51c4-4b28-af6d-d29595b5f9c3 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:20.693390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee1fbb-51c4-4b28-af6d-d29595b5f9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:20.693667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee1fbb-51c4-4b28-af6d-d29595b5f9c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:20.694376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee1fbb-51c4-4b28-af6d-d29595b5f9c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:20.696392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee1fbb-51c4-4b28-af6d-d29595b5f9c3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:20.804913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c880e-9f22-46c8-a614-942fa8a77410 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:20.806395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-747c880e-9f22-46c8-a614-942fa8a77410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:20.834943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c880e-9f22-46c8-a614-942fa8a77410 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:20.845310 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2353/4631] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:22:20 2022] POST /identity/v3/projects => generated 399 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:20.846378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee1fbb-51c4-4b28-af6d-d29595b5f9c3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:20.849076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e97aa4-8e13-4b67-8e09-9594bc71d1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:20.849956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e97aa4-8e13-4b67-8e09-9594bc71d1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:20.850254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e97aa4-8e13-4b67-8e09-9594bc71d1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:20.850512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e97aa4-8e13-4b67-8e09-9594bc71d1bf admin admin] PATH_INFO: `/v3/projects/c2a53516d4124b0cb0443d02647dd7cd` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:20.851770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e97aa4-8e13-4b67-8e09-9594bc71d1bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2a53516d4124b0cb0443d02647dd7cd)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:20.853688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e97aa4-8e13-4b67-8e09-9594bc71d1bf admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:20.919160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee1fbb-51c4-4b28-af6d-d29595b5f9c3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:20.924382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ca6af-dd5a-4a1f-88b8-dd5fbd88e47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:20.925049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ca6af-dd5a-4a1f-88b8-dd5fbd88e47d admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:20.925327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ca6af-dd5a-4a1f-88b8-dd5fbd88e47d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:20.925597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ca6af-dd5a-4a1f-88b8-dd5fbd88e47d admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:20.926288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ca6af-dd5a-4a1f-88b8-dd5fbd88e47d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:20.928315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ca6af-dd5a-4a1f-88b8-dd5fbd88e47d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:21.051398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-23e97aa4-8e13-4b67-8e09-9594bc71d1bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2a53516d4124b0cb0443d02647dd7cd', 'request_id': 'req-23e97aa4-8e13-4b67-8e09-9594bc71d1bf'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:21.058997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-23e97aa4-8e13-4b67-8e09-9594bc71d1bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2a53516d4124b0cb0443d02647dd7cd', 'request_id': 'req-23e97aa4-8e13-4b67-8e09-9594bc71d1bf'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:21.062651 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2354/4632] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:22:20 2022] POST /identity/v3/users => generated 306 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:22:21.067142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ca6af-dd5a-4a1f-88b8-dd5fbd88e47d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:21.071033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-23e97aa4-8e13-4b67-8e09-9594bc71d1bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2a53516d4124b0cb0443d02647dd7cd', 'request_id': 'req-23e97aa4-8e13-4b67-8e09-9594bc71d1bf'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:21.111190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ca6af-dd5a-4a1f-88b8-dd5fbd88e47d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:21.172161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0265dee-51a6-4efb-a07c-a04544e5f45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:21.173215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0265dee-51a6-4efb-a07c-a04544e5f45a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:21.173494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0265dee-51a6-4efb-a07c-a04544e5f45a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:21.173766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0265dee-51a6-4efb-a07c-a04544e5f45a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:21.174487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0265dee-51a6-4efb-a07c-a04544e5f45a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:21.176120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0265dee-51a6-4efb-a07c-a04544e5f45a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:21.186102 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2355/4633] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:21.190586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0265dee-51a6-4efb-a07c-a04544e5f45a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:21.206244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0265dee-51a6-4efb-a07c-a04544e5f45a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:21.206736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fa498-586b-45cc-a9ca-14914043059f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:21.207664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fa498-586b-45cc-a9ca-14914043059f admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:21.207947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fa498-586b-45cc-a9ca-14914043059f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:21.208226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fa498-586b-45cc-a9ca-14914043059f admin admin] PATH_INFO: `/v3/projects/0ca3d0a497614f3bb0aab6764145e9df/users/c33816b723f74bac977a9f430c9c5a92/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:21.224509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fa498-586b-45cc-a9ca-14914043059f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca3d0a497614f3bb0aab6764145e9df, user_id=c33816b723f74bac977a9f430c9c5a92, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:21.225172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-23e97aa4-8e13-4b67-8e09-9594bc71d1bf admin admin] The token cache is being invalidate because project c2a53516d4124b0cb0443d02647dd7cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:21.225561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-23e97aa4-8e13-4b67-8e09-9594bc71d1bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:21.226704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-23e97aa4-8e13-4b67-8e09-9594bc71d1bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:21.227283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fa498-586b-45cc-a9ca-14914043059f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:21.232386 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2279/4634] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:22:20 2022] DELETE /identity/v3/projects/c2a53516d4124b0cb0443d02647dd7cd => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:21.235651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1147b23-c2eb-4fde-9465-05a82313b4c3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:21.236134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1147b23-c2eb-4fde-9465-05a82313b4c3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:21.247666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1147b23-c2eb-4fde-9465-05a82313b4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:21.256592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d1147b23-c2eb-4fde-9465-05a82313b4c3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:21.257884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d1147b23-c2eb-4fde-9465-05a82313b4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:21.273520 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2280/4635] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:21.283357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8256d5-62f9-4a29-ab86-57d9fb99486e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:21.283717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8256d5-62f9-4a29-ab86-57d9fb99486e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:21.284090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8256d5-62f9-4a29-ab86-57d9fb99486e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:21.309964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6d8256d5-62f9-4a29-ab86-57d9fb99486e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:21.311619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6d8256d5-62f9-4a29-ab86-57d9fb99486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:21.322739 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2281/4636] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:21.324363 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2356/4637] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:21 2022] PUT /identity/v3/projects/0ca3d0a497614f3bb0aab6764145e9df/users/c33816b723f74bac977a9f430c9c5a92/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:21.327903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8256d5-62f9-4a29-ab86-57d9fb99486e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:21.329749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fa498-586b-45cc-a9ca-14914043059f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:21.332424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b65fa498-586b-45cc-a9ca-14914043059f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:21.340266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8256d5-62f9-4a29-ab86-57d9fb99486e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:21.416048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88703f3-4c8b-4874-aa8c-beebd92c009d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:21.416874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88703f3-4c8b-4874-aa8c-beebd92c009d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:21.417233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88703f3-4c8b-4874-aa8c-beebd92c009d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:21.417659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88703f3-4c8b-4874-aa8c-beebd92c009d admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:21.419235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88703f3-4c8b-4874-aa8c-beebd92c009d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:22:21.422834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88703f3-4c8b-4874-aa8c-beebd92c009d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:21.422834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:21.426202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88703f3-4c8b-4874-aa8c-beebd92c009d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:21.444861 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2282/4638] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:22:21.456653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88703f3-4c8b-4874-aa8c-beebd92c009d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:21.469198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fa498-586b-45cc-a9ca-14914043059f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:21.469589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88703f3-4c8b-4874-aa8c-beebd92c009d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:21.476122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616ab2d-ad94-434c-a146-ae23327bb7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:21.476924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d32960-d98f-4ce5-b0a0-3d592039be59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:21.477038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616ab2d-ad94-434c-a146-ae23327bb7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:21.477122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d32960-d98f-4ce5-b0a0-3d592039be59 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:21.477200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616ab2d-ad94-434c-a146-ae23327bb7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:21.477287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d32960-d98f-4ce5-b0a0-3d592039be59 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:21.477374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616ab2d-ad94-434c-a146-ae23327bb7f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:21.477452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d32960-d98f-4ce5-b0a0-3d592039be59 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:21.477452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d32960-d98f-4ce5-b0a0-3d592039be59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:21.477606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616ab2d-ad94-434c-a146-ae23327bb7f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:21.479027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616ab2d-ad94-434c-a146-ae23327bb7f8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:21.479289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d32960-d98f-4ce5-b0a0-3d592039be59 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:21.490051 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2357/4639] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:21.494418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616ab2d-ad94-434c-a146-ae23327bb7f8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:21.505145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616ab2d-ad94-434c-a146-ae23327bb7f8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:21.509945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6797c-af28-4d20-87c9-75e5cf63de0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:21.510821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6797c-af28-4d20-87c9-75e5cf63de0a admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:21.511184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6797c-af28-4d20-87c9-75e5cf63de0a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:21.511471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6797c-af28-4d20-87c9-75e5cf63de0a admin admin] PATH_INFO: `/v3/projects/0ca3d0a497614f3bb0aab6764145e9df/users/c33816b723f74bac977a9f430c9c5a92/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:21.513475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6797c-af28-4d20-87c9-75e5cf63de0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca3d0a497614f3bb0aab6764145e9df, user_id=c33816b723f74bac977a9f430c9c5a92, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:21.516890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6797c-af28-4d20-87c9-75e5cf63de0a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:21.527617 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2358/4640] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:21 2022] PUT /identity/v3/projects/0ca3d0a497614f3bb0aab6764145e9df/users/c33816b723f74bac977a9f430c9c5a92/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:22:21.538794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24319b4-ce0a-4d2d-a2f1-2a94f0270d03 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:21.539113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24319b4-ce0a-4d2d-a2f1-2a94f0270d03 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:21.539395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24319b4-ce0a-4d2d-a2f1-2a94f0270d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:21.563603 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2283/4641] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:22:21 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:22:21.564583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d32960-d98f-4ce5-b0a0-3d592039be59 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:21.568262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c24319b4-ce0a-4d2d-a2f1-2a94f0270d03 None None] MFA Rules not processed for user `c33816b723f74bac977a9f430c9c5a92`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:21.569467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c24319b4-ce0a-4d2d-a2f1-2a94f0270d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:21.630489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d32960-d98f-4ce5-b0a0-3d592039be59 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:21.635334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7decfb-6bb4-4e7e-9f0f-9b6dd1fb1b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:21.636004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7decfb-6bb4-4e7e-9f0f-9b6dd1fb1b80 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:21.636286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7decfb-6bb4-4e7e-9f0f-9b6dd1fb1b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:21.636565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7decfb-6bb4-4e7e-9f0f-9b6dd1fb1b80 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:21.637244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7decfb-6bb4-4e7e-9f0f-9b6dd1fb1b80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:21.639339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7decfb-6bb4-4e7e-9f0f-9b6dd1fb1b80 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:21.639983 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2359/4642] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:21 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:22:21.651068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24319b4-ce0a-4d2d-a2f1-2a94f0270d03 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:21.652592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c24319b4-ce0a-4d2d-a2f1-2a94f0270d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:21.720865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24319b4-ce0a-4d2d-a2f1-2a94f0270d03 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:21.724612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cef9b0-89e5-4290-85c9-4b326d59a361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:21.725254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cef9b0-89e5-4290-85c9-4b326d59a361 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:21.725536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cef9b0-89e5-4290-85c9-4b326d59a361 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:21.725812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cef9b0-89e5-4290-85c9-4b326d59a361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:21.727683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-03cef9b0-89e5-4290-85c9-4b326d59a361 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:21.769188 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2284/4643] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:22:21 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:22:21.773213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7decfb-6bb4-4e7e-9f0f-9b6dd1fb1b80 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:21.783138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7decfb-6bb4-4e7e-9f0f-9b6dd1fb1b80 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:21.788097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91b296-4e32-487d-b66d-d70175553cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:21.788748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91b296-4e32-487d-b66d-d70175553cfe admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:21.789028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91b296-4e32-487d-b66d-d70175553cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:21.789301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91b296-4e32-487d-b66d-d70175553cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:21.790059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91b296-4e32-487d-b66d-d70175553cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:21.791812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91b296-4e32-487d-b66d-d70175553cfe admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:21.791981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cef9b0-89e5-4290-85c9-4b326d59a361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:21.795392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cef9b0-89e5-4290-85c9-4b326d59a361 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:21.802354 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2285/4644] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:21.803104 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2360/4645] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:22:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:22:21.806467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91b296-4e32-487d-b66d-d70175553cfe admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:21.818078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91b296-4e32-487d-b66d-d70175553cfe admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:21.824201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad0e68-e9ac-4ee5-9a0b-390d724d560b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:21.827713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad0e68-e9ac-4ee5-9a0b-390d724d560b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:21.827713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad0e68-e9ac-4ee5-9a0b-390d724d560b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:21.827713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad0e68-e9ac-4ee5-9a0b-390d724d560b admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:21.827713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad0e68-e9ac-4ee5-9a0b-390d724d560b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:21.828475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad0e68-e9ac-4ee5-9a0b-390d724d560b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:21.838629 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2286/4646] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:21.842998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cef9b0-89e5-4290-85c9-4b326d59a361 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:21.854268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cef9b0-89e5-4290-85c9-4b326d59a361 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:21.859379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c6181-4d0f-4d29-a591-5b66ec5b321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:21.860793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c6181-4d0f-4d29-a591-5b66ec5b321b admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:21.862089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c6181-4d0f-4d29-a591-5b66ec5b321b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:21.862454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c6181-4d0f-4d29-a591-5b66ec5b321b admin admin] PATH_INFO: `/v3/projects/68f4720b609e45d2a0178a383eafc2a4/users/a136272bd2664accbbc03bddbf5f5d10/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:21.879677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c6181-4d0f-4d29-a591-5b66ec5b321b admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f4720b609e45d2a0178a383eafc2a4, user_id=a136272bd2664accbbc03bddbf5f5d10, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:21.882432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c6181-4d0f-4d29-a591-5b66ec5b321b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:21.957248 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2361/4647] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:21 2022] PUT /identity/v3/projects/68f4720b609e45d2a0178a383eafc2a4/users/a136272bd2664accbbc03bddbf5f5d10/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:21.969294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26d3b3-fc15-4417-ab8a-37589f9a5543 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:21.969632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26d3b3-fc15-4417-ab8a-37589f9a5543 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:21.969917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26d3b3-fc15-4417-ab8a-37589f9a5543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:22.008032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3e26d3b3-fc15-4417-ab8a-37589f9a5543 None None] MFA Rules not processed for user `a136272bd2664accbbc03bddbf5f5d10`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:22.009288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3e26d3b3-fc15-4417-ab8a-37589f9a5543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:22.095310 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2287/4648] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:22.100256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c6181-4d0f-4d29-a591-5b66ec5b321b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:22.112262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c6181-4d0f-4d29-a591-5b66ec5b321b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:22.117099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d428b-7e24-4c6c-90a9-22c591c6dee6 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a136272bd2664accbbc03bddbf5f5d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f4720b609e45d2a0178a383eafc2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:22.118000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d428b-7e24-4c6c-90a9-22c591c6dee6 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:22.118349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d428b-7e24-4c6c-90a9-22c591c6dee6 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:22.118877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d428b-7e24-4c6c-90a9-22c591c6dee6 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] PATH_INFO: `/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:22.119690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d428b-7e24-4c6c-90a9-22c591c6dee6 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=a136272bd2664accbbc03bddbf5f5d10)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:22.121915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d428b-7e24-4c6c-90a9-22c591c6dee6 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:22.210043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:22.256246 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2362/4649] 10.222.0.16 () {60 vars in 1298 bytes} [Sat Jul 16 21:22:22 2022] POST /identity/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2 => generated 367 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:22.267234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26d3b3-fc15-4417-ab8a-37589f9a5543 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:22.291277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26d3b3-fc15-4417-ab8a-37589f9a5543 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:22.306323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701413f-f257-436a-b134-4e994f0843a8 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a136272bd2664accbbc03bddbf5f5d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f4720b609e45d2a0178a383eafc2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:22.307544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701413f-f257-436a-b134-4e994f0843a8 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:22.307837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701413f-f257-436a-b134-4e994f0843a8 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:22.308118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701413f-f257-436a-b134-4e994f0843a8 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] PATH_INFO: `/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2/563b5187d439419886879143228e565c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:22.310535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701413f-f257-436a-b134-4e994f0843a8 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=a136272bd2664accbbc03bddbf5f5d10, credential_id=563b5187d439419886879143228e565c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:22.312649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701413f-f257-436a-b134-4e994f0843a8 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:22.439481 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2288/4650] 10.222.0.16 () {58 vars in 1379 bytes} [Sat Jul 16 21:22:22 2022] DELETE /identity/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2/563b5187d439419886879143228e565c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:22:22.441593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d428b-7e24-4c6c-90a9-22c591c6dee6 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:22.453475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d428b-7e24-4c6c-90a9-22c591c6dee6 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:22.460319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e9166-03fa-4904-a3b7-d8a639ab031a tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a136272bd2664accbbc03bddbf5f5d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f4720b609e45d2a0178a383eafc2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:22.461279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e9166-03fa-4904-a3b7-d8a639ab031a tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:22.461676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e9166-03fa-4904-a3b7-d8a639ab031a tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:22.462114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e9166-03fa-4904-a3b7-d8a639ab031a tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] PATH_INFO: `/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:22.462907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e9166-03fa-4904-a3b7-d8a639ab031a tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=a136272bd2664accbbc03bddbf5f5d10)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:22.464757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e9166-03fa-4904-a3b7-d8a639ab031a tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:22.500970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:22.581940 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2363/4651] 10.222.0.16 () {60 vars in 1298 bytes} [Sat Jul 16 21:22:22 2022] POST /identity/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2 => generated 367 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:22:22.582064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701413f-f257-436a-b134-4e994f0843a8 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:22.590197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701413f-f257-436a-b134-4e994f0843a8 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:22.598562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec33cb2-306f-46bc-9934-68326d3dd687 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a136272bd2664accbbc03bddbf5f5d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f4720b609e45d2a0178a383eafc2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:22.599995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec33cb2-306f-46bc-9934-68326d3dd687 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:22.600381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec33cb2-306f-46bc-9934-68326d3dd687 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:22.600842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec33cb2-306f-46bc-9934-68326d3dd687 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] PATH_INFO: `/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2/67362c700ecd4661a2ef662d71a43bdb` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:22.603330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec33cb2-306f-46bc-9934-68326d3dd687 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=a136272bd2664accbbc03bddbf5f5d10, credential_id=67362c700ecd4661a2ef662d71a43bdb)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:22.605176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec33cb2-306f-46bc-9934-68326d3dd687 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:22.656978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e9166-03fa-4904-a3b7-d8a639ab031a tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:22.658911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2d1e9166-03fa-4904-a3b7-d8a639ab031a tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:22.716802 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2289/4652] 10.222.0.16 () {58 vars in 1379 bytes} [Sat Jul 16 21:22:22 2022] DELETE /identity/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2/67362c700ecd4661a2ef662d71a43bdb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:22.721440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec33cb2-306f-46bc-9934-68326d3dd687 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:22.731422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec33cb2-306f-46bc-9934-68326d3dd687 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:22.739763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf64f36-b85d-4454-be23-c9dce59fc69e tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a136272bd2664accbbc03bddbf5f5d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f4720b609e45d2a0178a383eafc2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:22.740654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf64f36-b85d-4454-be23-c9dce59fc69e tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:22.740945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf64f36-b85d-4454-be23-c9dce59fc69e tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:22.741275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf64f36-b85d-4454-be23-c9dce59fc69e tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] PATH_INFO: `/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2/67362c700ecd4661a2ef662d71a43bdb` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:22.754261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e9166-03fa-4904-a3b7-d8a639ab031a tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:22.759298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23baff51-c733-43c5-8ae5-af3d4974453e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:22.759943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23baff51-c733-43c5-8ae5-af3d4974453e service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:22.760222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23baff51-c733-43c5-8ae5-af3d4974453e service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:22.760498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23baff51-c733-43c5-8ae5-af3d4974453e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:22.769213 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-baf64f36-b85d-4454-be23-c9dce59fc69e tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Could not find credential: c50150684ceb1b4daed72ff018060621a06d1474a156bf7067f5903eea16ddb7.: keystone.exception.CredentialNotFound: Could not find credential: c50150684ceb1b4daed72ff018060621a06d1474a156bf7067f5903eea16ddb7. Jul 16 21:22:22.769213 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:22:22.769213 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:22:22.769213 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:22:22.769213 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:22:22.769213 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:22:22.769213 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:22:22.769213 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:22:22.769213 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:22:22.769213 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:22:22.769213 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:22:22.769213 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:22:22.769213 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Jul 16 21:22:22.769213 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 16 21:22:22.770192 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 16 21:22:22.770192 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 16 21:22:22.770192 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Jul 16 21:22:22.770192 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Jul 16 21:22:22.770192 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:22:22.770192 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:22:22.770192 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Jul 16 21:22:22.770192 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Jul 16 21:22:22.770192 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:22:22.770192 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:22:22.770192 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:22:22.770192 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:22:22.770192 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:22:22.770192 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 21:22:22.770192 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:22:22.770192 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:22:22.771368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:22:22.771368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:22:22.771368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:22:22.771368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:22:22.771368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:22:22.771368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:22:22.771368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Jul 16 21:22:22.771368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Jul 16 21:22:22.771368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Jul 16 21:22:22.771368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Jul 16 21:22:22.771368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Jul 16 21:22:22.771368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Jul 16 21:22:22.771368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: c50150684ceb1b4daed72ff018060621a06d1474a156bf7067f5903eea16ddb7. Jul 16 21:22:22.771368 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:22:22.771368 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2290/4653] 10.222.0.16 () {58 vars in 1376 bytes} [Sat Jul 16 21:22:22 2022] GET /identity/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2/67362c700ecd4661a2ef662d71a43bdb => generated 148 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 16 21:22:22.776453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf64f36-b85d-4454-be23-c9dce59fc69e tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:22.787533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf64f36-b85d-4454-be23-c9dce59fc69e tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:22.792022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2f6a9-110d-46bc-855f-b68a623fd0fa tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a136272bd2664accbbc03bddbf5f5d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f4720b609e45d2a0178a383eafc2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:22.792909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f6a9-110d-46bc-855f-b68a623fd0fa tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:22.793212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f6a9-110d-46bc-855f-b68a623fd0fa tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:22.793497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f6a9-110d-46bc-855f-b68a623fd0fa tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] PATH_INFO: `/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:22.794171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2f6a9-110d-46bc-855f-b68a623fd0fa tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=a136272bd2664accbbc03bddbf5f5d10)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:22.795862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2f6a9-110d-46bc-855f-b68a623fd0fa tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:22.842473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23baff51-c733-43c5-8ae5-af3d4974453e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:22.849722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23baff51-c733-43c5-8ae5-af3d4974453e service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:22.855860 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2364/4654] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:22:22 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:22:22.886695 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2291/4655] 10.222.0.16 () {60 vars in 1298 bytes} [Sat Jul 16 21:22:22 2022] POST /identity/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2 => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:22.896701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23baff51-c733-43c5-8ae5-af3d4974453e service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:22.912332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23baff51-c733-43c5-8ae5-af3d4974453e service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:22.919058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae4841-8939-4c9e-9968-79a0077bbbf5 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a136272bd2664accbbc03bddbf5f5d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f4720b609e45d2a0178a383eafc2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:22.920149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae4841-8939-4c9e-9968-79a0077bbbf5 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:22.920462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae4841-8939-4c9e-9968-79a0077bbbf5 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:22.920916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae4841-8939-4c9e-9968-79a0077bbbf5 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] PATH_INFO: `/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:22.923075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae4841-8939-4c9e-9968-79a0077bbbf5 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=a136272bd2664accbbc03bddbf5f5d10)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:22.923318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae4841-8939-4c9e-9968-79a0077bbbf5 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:23.047133 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2365/4656] 10.222.0.16 () {60 vars in 1298 bytes} [Sat Jul 16 21:22:22 2022] POST /identity/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2 => generated 367 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:23.050829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2f6a9-110d-46bc-855f-b68a623fd0fa tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:23.066637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2f6a9-110d-46bc-855f-b68a623fd0fa tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:23.072765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a463f3a-e492-4865-8a99-a67ae893b8ec tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a136272bd2664accbbc03bddbf5f5d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f4720b609e45d2a0178a383eafc2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:23.073755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a463f3a-e492-4865-8a99-a67ae893b8ec tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:23.074113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a463f3a-e492-4865-8a99-a67ae893b8ec tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:23.074486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a463f3a-e492-4865-8a99-a67ae893b8ec tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] PATH_INFO: `/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:23.075755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a463f3a-e492-4865-8a99-a67ae893b8ec tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=a136272bd2664accbbc03bddbf5f5d10)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:23.078036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a463f3a-e492-4865-8a99-a67ae893b8ec tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:23.083573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:23.097250 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2292/4657] 10.222.0.16 () {58 vars in 1277 bytes} [Sat Jul 16 21:22:23 2022] GET /identity/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2 => generated 865 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:22:23.099240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae4841-8939-4c9e-9968-79a0077bbbf5 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:23.113039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae4841-8939-4c9e-9968-79a0077bbbf5 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:23.118035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff836952-5ae6-4399-b4f9-ba37a2a4a713 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a136272bd2664accbbc03bddbf5f5d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f4720b609e45d2a0178a383eafc2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:23.119325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff836952-5ae6-4399-b4f9-ba37a2a4a713 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:23.119608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff836952-5ae6-4399-b4f9-ba37a2a4a713 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:23.119877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff836952-5ae6-4399-b4f9-ba37a2a4a713 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] PATH_INFO: `/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2/0cbaefe82c884cecbd5e93c34508d4cb` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:23.122673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff836952-5ae6-4399-b4f9-ba37a2a4a713 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=a136272bd2664accbbc03bddbf5f5d10, credential_id=0cbaefe82c884cecbd5e93c34508d4cb)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:23.124885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff836952-5ae6-4399-b4f9-ba37a2a4a713 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:23.256174 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2366/4658] 10.222.0.16 () {58 vars in 1379 bytes} [Sat Jul 16 21:22:23 2022] DELETE /identity/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2/0cbaefe82c884cecbd5e93c34508d4cb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:23.260650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a463f3a-e492-4865-8a99-a67ae893b8ec tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:23.271127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a463f3a-e492-4865-8a99-a67ae893b8ec tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:23.275798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c11ed0-d7b7-4166-a878-cc46847cbc09 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a136272bd2664accbbc03bddbf5f5d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f4720b609e45d2a0178a383eafc2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:23.280088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c11ed0-d7b7-4166-a878-cc46847cbc09 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:23.280088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c11ed0-d7b7-4166-a878-cc46847cbc09 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:23.280088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c11ed0-d7b7-4166-a878-cc46847cbc09 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] PATH_INFO: `/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2/2a5fc423792e4181b946b750dcfa2558` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:23.280088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c11ed0-d7b7-4166-a878-cc46847cbc09 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=a136272bd2664accbbc03bddbf5f5d10, credential_id=2a5fc423792e4181b946b750dcfa2558)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:23.280757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c11ed0-d7b7-4166-a878-cc46847cbc09 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:23.391138 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2293/4659] 10.222.0.16 () {58 vars in 1379 bytes} [Sat Jul 16 21:22:23 2022] DELETE /identity/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2/2a5fc423792e4181b946b750dcfa2558 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:22:23.396299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff836952-5ae6-4399-b4f9-ba37a2a4a713 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:23.406243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff836952-5ae6-4399-b4f9-ba37a2a4a713 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:23.410607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f84fe6-ad2f-4e8b-980b-e6a0b2f6c778 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a136272bd2664accbbc03bddbf5f5d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f4720b609e45d2a0178a383eafc2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:23.411492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f84fe6-ad2f-4e8b-980b-e6a0b2f6c778 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:23.411774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f84fe6-ad2f-4e8b-980b-e6a0b2f6c778 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:23.412043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f84fe6-ad2f-4e8b-980b-e6a0b2f6c778 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] PATH_INFO: `/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:23.412749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f84fe6-ad2f-4e8b-980b-e6a0b2f6c778 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=a136272bd2664accbbc03bddbf5f5d10)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:23.414265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f84fe6-ad2f-4e8b-980b-e6a0b2f6c778 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:23.529786 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2367/4660] 10.222.0.16 () {60 vars in 1298 bytes} [Sat Jul 16 21:22:23 2022] POST /identity/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2 => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:23.535142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c11ed0-d7b7-4166-a878-cc46847cbc09 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:23.550026 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c11ed0-d7b7-4166-a878-cc46847cbc09 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:23.556169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097d4d1-3537-4862-be8b-4afde718f30f tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a136272bd2664accbbc03bddbf5f5d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f4720b609e45d2a0178a383eafc2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:23.557610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097d4d1-3537-4862-be8b-4afde718f30f tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:23.557915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097d4d1-3537-4862-be8b-4afde718f30f tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:23.558207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097d4d1-3537-4862-be8b-4afde718f30f tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] PATH_INFO: `/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2/ed443b2e6bcb4abd9d420cc699b885a0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:23.560731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097d4d1-3537-4862-be8b-4afde718f30f tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=a136272bd2664accbbc03bddbf5f5d10, credential_id=ed443b2e6bcb4abd9d420cc699b885a0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:23.563036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097d4d1-3537-4862-be8b-4afde718f30f tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:23.571210 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2294/4661] 10.222.0.16 () {58 vars in 1376 bytes} [Sat Jul 16 21:22:23 2022] GET /identity/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2/ed443b2e6bcb4abd9d420cc699b885a0 => generated 367 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:22:23.574984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f84fe6-ad2f-4e8b-980b-e6a0b2f6c778 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:23.585318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f84fe6-ad2f-4e8b-980b-e6a0b2f6c778 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:23.589979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2effcac-b584-456e-84f3-91fbf656b2d6 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a136272bd2664accbbc03bddbf5f5d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f4720b609e45d2a0178a383eafc2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:23.590875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2effcac-b584-456e-84f3-91fbf656b2d6 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:23.592043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2effcac-b584-456e-84f3-91fbf656b2d6 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:23.592043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2effcac-b584-456e-84f3-91fbf656b2d6 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] PATH_INFO: `/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2/ed443b2e6bcb4abd9d420cc699b885a0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:23.593895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2effcac-b584-456e-84f3-91fbf656b2d6 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=a136272bd2664accbbc03bddbf5f5d10, credential_id=ed443b2e6bcb4abd9d420cc699b885a0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:23.595399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2effcac-b584-456e-84f3-91fbf656b2d6 tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:23.684707 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2368/4662] 10.222.0.16 () {58 vars in 1379 bytes} [Sat Jul 16 21:22:23 2022] DELETE /identity/v3/users/a136272bd2664accbbc03bddbf5f5d10/credentials/OS-EC2/ed443b2e6bcb4abd9d420cc699b885a0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:23.696542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097d4d1-3537-4862-be8b-4afde718f30f tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:23.789980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097d4d1-3537-4862-be8b-4afde718f30f tempest-EC2CredentialsTest-92553292 tempest-EC2CredentialsTest-92553292-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:23.794991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7627e7-df15-457b-8db4-eab0a9fa8754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:23.796768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7627e7-df15-457b-8db4-eab0a9fa8754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:23.797053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7627e7-df15-457b-8db4-eab0a9fa8754 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:23.797330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7627e7-df15-457b-8db4-eab0a9fa8754 admin admin] PATH_INFO: `/v3/users/a136272bd2664accbbc03bddbf5f5d10` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:23.798601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7627e7-df15-457b-8db4-eab0a9fa8754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a136272bd2664accbbc03bddbf5f5d10)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:23.800770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7627e7-df15-457b-8db4-eab0a9fa8754 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:24.027727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2a7627e7-df15-457b-8db4-eab0a9fa8754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a136272bd2664accbbc03bddbf5f5d10'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:24.040015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2a7627e7-df15-457b-8db4-eab0a9fa8754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a136272bd2664accbbc03bddbf5f5d10'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:24.140216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2a7627e7-df15-457b-8db4-eab0a9fa8754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a136272bd2664accbbc03bddbf5f5d10'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:24.148151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2a7627e7-df15-457b-8db4-eab0a9fa8754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a136272bd2664accbbc03bddbf5f5d10'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:24.148847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2a7627e7-df15-457b-8db4-eab0a9fa8754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a136272bd2664accbbc03bddbf5f5d10'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:24.158960 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2295/4663] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:22:23 2022] DELETE /identity/v3/users/a136272bd2664accbbc03bddbf5f5d10 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:24.161434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45cbb9-f08e-40d3-8f50-be42a9ed012c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:24.161798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45cbb9-f08e-40d3-8f50-be42a9ed012c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:24.162154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45cbb9-f08e-40d3-8f50-be42a9ed012c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:24.181973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7c45cbb9-f08e-40d3-8f50-be42a9ed012c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:24.184279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7c45cbb9-f08e-40d3-8f50-be42a9ed012c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:24.275545 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2369/4664] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:22:24.288831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7627e7-df15-457b-8db4-eab0a9fa8754 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:24.291149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2a7627e7-df15-457b-8db4-eab0a9fa8754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:24.334268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:24.363208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7627e7-df15-457b-8db4-eab0a9fa8754 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:24.367536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf1db1-2afc-4583-9a4b-d376f408d455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:24.368198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf1db1-2afc-4583-9a4b-d376f408d455 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:24.368496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf1db1-2afc-4583-9a4b-d376f408d455 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:24.368808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf1db1-2afc-4583-9a4b-d376f408d455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:24.381196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf1db1-2afc-4583-9a4b-d376f408d455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:24.383024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf1db1-2afc-4583-9a4b-d376f408d455 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:24.397223 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2296/4665] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:22:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:22:25.172627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45cbb9-f08e-40d3-8f50-be42a9ed012c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:25.174504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7c45cbb9-f08e-40d3-8f50-be42a9ed012c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:25.194779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45cbb9-f08e-40d3-8f50-be42a9ed012c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:25.204878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ee4a5-73ff-4502-9a88-166410d9680d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:25.205797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ee4a5-73ff-4502-9a88-166410d9680d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:25.206117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ee4a5-73ff-4502-9a88-166410d9680d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:25.206959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ee4a5-73ff-4502-9a88-166410d9680d admin admin] PATH_INFO: `/v3/projects/68f4720b609e45d2a0178a383eafc2a4` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:25.209116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ee4a5-73ff-4502-9a88-166410d9680d admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f4720b609e45d2a0178a383eafc2a4)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:25.213367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ee4a5-73ff-4502-9a88-166410d9680d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:25.325657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:25.394866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c14ee4a5-73ff-4502-9a88-166410d9680d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f4720b609e45d2a0178a383eafc2a4', 'request_id': 'req-c14ee4a5-73ff-4502-9a88-166410d9680d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:25.401701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c14ee4a5-73ff-4502-9a88-166410d9680d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f4720b609e45d2a0178a383eafc2a4', 'request_id': 'req-c14ee4a5-73ff-4502-9a88-166410d9680d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:25.408739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c14ee4a5-73ff-4502-9a88-166410d9680d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f4720b609e45d2a0178a383eafc2a4', 'request_id': 'req-c14ee4a5-73ff-4502-9a88-166410d9680d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:25.509926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c14ee4a5-73ff-4502-9a88-166410d9680d admin admin] The token cache is being invalidate because project 68f4720b609e45d2a0178a383eafc2a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:25.517324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c14ee4a5-73ff-4502-9a88-166410d9680d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:25.517324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c14ee4a5-73ff-4502-9a88-166410d9680d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:25.517324 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2370/4666] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:22:25 2022] DELETE /identity/v3/projects/68f4720b609e45d2a0178a383eafc2a4 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:25.519053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed63ebb-431f-4322-8b92-c086f11df318 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:25.519543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed63ebb-431f-4322-8b92-c086f11df318 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:25.519628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed63ebb-431f-4322-8b92-c086f11df318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:25.558952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3ed63ebb-431f-4322-8b92-c086f11df318 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:25.560275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3ed63ebb-431f-4322-8b92-c086f11df318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:25.627375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:25.635979 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2297/4667] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:25.645195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4df02-ba78-4832-9122-d83224d79336 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:25.645687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4df02-ba78-4832-9122-d83224d79336 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:25.645963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4df02-ba78-4832-9122-d83224d79336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:25.668781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a3e4df02-ba78-4832-9122-d83224d79336 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:25.670157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a3e4df02-ba78-4832-9122-d83224d79336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:25.680188 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2371/4668] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:25.684725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed63ebb-431f-4322-8b92-c086f11df318 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:25.695615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed63ebb-431f-4322-8b92-c086f11df318 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:25.700828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da71e72-23c6-4d79-9cd8-b05bdfe60298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:25.701501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da71e72-23c6-4d79-9cd8-b05bdfe60298 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:25.701859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da71e72-23c6-4d79-9cd8-b05bdfe60298 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:25.702140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da71e72-23c6-4d79-9cd8-b05bdfe60298 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:25.702870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da71e72-23c6-4d79-9cd8-b05bdfe60298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:22:25.703218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da71e72-23c6-4d79-9cd8-b05bdfe60298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:25.705072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da71e72-23c6-4d79-9cd8-b05bdfe60298 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:25.721457 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2298/4669] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:22:25.723227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4df02-ba78-4832-9122-d83224d79336 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:25.738801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4df02-ba78-4832-9122-d83224d79336 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:25.743487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0faee2-1e92-4c9b-8660-437dab4a4953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:25.744343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0faee2-1e92-4c9b-8660-437dab4a4953 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:25.744698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0faee2-1e92-4c9b-8660-437dab4a4953 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:25.745052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0faee2-1e92-4c9b-8660-437dab4a4953 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:25.746736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0faee2-1e92-4c9b-8660-437dab4a4953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:25.748848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0faee2-1e92-4c9b-8660-437dab4a4953 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:25.847827 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2372/4670] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:22:25 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:25.852151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da71e72-23c6-4d79-9cd8-b05bdfe60298 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:25.871261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da71e72-23c6-4d79-9cd8-b05bdfe60298 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:25.941562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c38c2-e25c-479e-a210-5287a872046a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:25.942868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c38c2-e25c-479e-a210-5287a872046a admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:25.943192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c38c2-e25c-479e-a210-5287a872046a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:25.943482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c38c2-e25c-479e-a210-5287a872046a admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:25.944177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c38c2-e25c-479e-a210-5287a872046a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:25.946743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c38c2-e25c-479e-a210-5287a872046a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:26.052315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0faee2-1e92-4c9b-8660-437dab4a4953 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:26.053311 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2299/4671] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:22:25 2022] POST /identity/v3/users => generated 288 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:22:26.067883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0faee2-1e92-4c9b-8660-437dab4a4953 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:26.073438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515779c0-73a3-4f58-9b76-e61e1432f16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:26.074538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515779c0-73a3-4f58-9b76-e61e1432f16b admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:26.074828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515779c0-73a3-4f58-9b76-e61e1432f16b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:26.075395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515779c0-73a3-4f58-9b76-e61e1432f16b admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:26.076434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515779c0-73a3-4f58-9b76-e61e1432f16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:26.078856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515779c0-73a3-4f58-9b76-e61e1432f16b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:26.091747 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2373/4672] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:22:26.097471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c38c2-e25c-479e-a210-5287a872046a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:26.111970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c38c2-e25c-479e-a210-5287a872046a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:26.118252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38fda6-e52a-4647-87ff-9fe370a08833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:26.118963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38fda6-e52a-4647-87ff-9fe370a08833 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:26.119293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38fda6-e52a-4647-87ff-9fe370a08833 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:26.119578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38fda6-e52a-4647-87ff-9fe370a08833 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:26.120313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38fda6-e52a-4647-87ff-9fe370a08833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:26.122201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38fda6-e52a-4647-87ff-9fe370a08833 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:26.138932 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2300/4673] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:26.141095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515779c0-73a3-4f58-9b76-e61e1432f16b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:26.151561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515779c0-73a3-4f58-9b76-e61e1432f16b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:26.156743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2771bb9-b4ff-4764-acd4-c28354bb03c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:26.157911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2771bb9-b4ff-4764-acd4-c28354bb03c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:26.158495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2771bb9-b4ff-4764-acd4-c28354bb03c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:26.158946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2771bb9-b4ff-4764-acd4-c28354bb03c6 admin admin] PATH_INFO: `/v3/projects/e446a13317d9461c8bce6ad9bd4c17ea/users/d85f03e60b2742a59b2709f769dc9c6f/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:26.189486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2771bb9-b4ff-4764-acd4-c28354bb03c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e446a13317d9461c8bce6ad9bd4c17ea, user_id=d85f03e60b2742a59b2709f769dc9c6f, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:26.193016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2771bb9-b4ff-4764-acd4-c28354bb03c6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:26.301531 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2374/4674] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:26 2022] PUT /identity/v3/projects/e446a13317d9461c8bce6ad9bd4c17ea/users/d85f03e60b2742a59b2709f769dc9c6f/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:26.314046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8aacf-3639-4554-823b-95c6e4ad7641 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:26.314428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8aacf-3639-4554-823b-95c6e4ad7641 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:26.314880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8aacf-3639-4554-823b-95c6e4ad7641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:26.356662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-74d8aacf-3639-4554-823b-95c6e4ad7641 None None] MFA Rules not processed for user `d85f03e60b2742a59b2709f769dc9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:26.358135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-74d8aacf-3639-4554-823b-95c6e4ad7641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:26.404608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:26.455364 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2301/4675] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:26.460894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2771bb9-b4ff-4764-acd4-c28354bb03c6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:26.475572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2771bb9-b4ff-4764-acd4-c28354bb03c6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:26.480550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b98c04-c5e2-4eb2-bc7f-43e6af4b9b26 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85f03e60b2742a59b2709f769dc9c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e446a13317d9461c8bce6ad9bd4c17ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:26.482119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b98c04-c5e2-4eb2-bc7f-43e6af4b9b26 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:26.482572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b98c04-c5e2-4eb2-bc7f-43e6af4b9b26 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:26.483798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b98c04-c5e2-4eb2-bc7f-43e6af4b9b26 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] PATH_INFO: `/v3/users/d85f03e60b2742a59b2709f769dc9c6f/password` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:26.648148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-00b98c04-c5e2-4eb2-bc7f-43e6af4b9b26 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd85f03e60b2742a59b2709f769dc9c6f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:26.785697 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2375/4676] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Jul 16 21:22:26 2022] POST /identity/v3/users/d85f03e60b2742a59b2709f769dc9c6f/password => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:27.522460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:27.790807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6cfb5-f898-432b-be9a-f59d905053d7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:27.791559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6cfb5-f898-432b-be9a-f59d905053d7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:27.792038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6cfb5-f898-432b-be9a-f59d905053d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:27.793380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:27.812701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-83c6cfb5-f898-432b-be9a-f59d905053d7 None None] MFA Rules not processed for user `d85f03e60b2742a59b2709f769dc9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:27.814137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-83c6cfb5-f898-432b-be9a-f59d905053d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:27.825780 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2302/4677] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:27 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 21:22:27.832467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd595f5-8b86-4294-852f-4ed1b702253d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:27.832960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd595f5-8b86-4294-852f-4ed1b702253d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:27.833311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd595f5-8b86-4294-852f-4ed1b702253d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:27.855759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-efd595f5-8b86-4294-852f-4ed1b702253d None None] MFA Rules not processed for user `d85f03e60b2742a59b2709f769dc9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:27.857200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-efd595f5-8b86-4294-852f-4ed1b702253d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:27.871806 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2376/4678] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:27.877934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6cfb5-f898-432b-be9a-f59d905053d7 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:27.906723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6cfb5-f898-432b-be9a-f59d905053d7 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:27.915294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440b706-2b7f-4e32-8f7f-31c50cffc682 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85f03e60b2742a59b2709f769dc9c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e446a13317d9461c8bce6ad9bd4c17ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:27.916188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440b706-2b7f-4e32-8f7f-31c50cffc682 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:27.916477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440b706-2b7f-4e32-8f7f-31c50cffc682 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:27.916755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440b706-2b7f-4e32-8f7f-31c50cffc682 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] PATH_INFO: `/v3/users/d85f03e60b2742a59b2709f769dc9c6f/password` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:27.985977 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-5440b706-2b7f-4e32-8f7f-31c50cffc682 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 16 21:22:27.985977 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:22:27.985977 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:22:27.985977 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:22:27.985977 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:22:27.985977 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:22:27.985977 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:22:27.985977 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:22:27.985977 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:22:27.985977 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:22:27.985977 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:22:27.985977 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:22:27.985977 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 16 21:22:27.987026 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 16 21:22:27.987026 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jul 16 21:22:27.987026 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jul 16 21:22:27.987026 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:22:27.987026 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:22:27.987026 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 21:22:27.987026 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 21:22:27.987026 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jul 16 21:22:27.987026 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jul 16 21:22:27.987026 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jul 16 21:22:27.987026 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jul 16 21:22:27.987026 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jul 16 21:22:27.987026 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jul 16 21:22:27.987026 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 16 21:22:27.987026 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:22:27.988962 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2303/4679] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Jul 16 21:22:27 2022] POST /identity/v3/users/d85f03e60b2742a59b2709f769dc9c6f/password => generated 188 bytes in 110 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 16 21:22:27.991681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd595f5-8b86-4294-852f-4ed1b702253d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:28.002142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd595f5-8b86-4294-852f-4ed1b702253d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:28.006423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829458c-371e-4542-afb5-3ed9fa032677 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85f03e60b2742a59b2709f769dc9c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e446a13317d9461c8bce6ad9bd4c17ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:28.007330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829458c-371e-4542-afb5-3ed9fa032677 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:28.007613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829458c-371e-4542-afb5-3ed9fa032677 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:28.007888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829458c-371e-4542-afb5-3ed9fa032677 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] PATH_INFO: `/v3/users/d85f03e60b2742a59b2709f769dc9c6f/password` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:28.053745 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-3829458c-371e-4542-afb5-3ed9fa032677 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 16 21:22:28.053745 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:22:28.053745 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:22:28.053745 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:22:28.053745 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:22:28.053745 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:22:28.053745 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:22:28.053745 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:22:28.053745 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:22:28.053745 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:22:28.053745 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:22:28.053745 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:22:28.053745 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 16 21:22:28.054774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 16 21:22:28.054774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jul 16 21:22:28.054774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jul 16 21:22:28.054774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:22:28.054774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:22:28.054774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 21:22:28.054774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 21:22:28.054774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jul 16 21:22:28.054774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jul 16 21:22:28.054774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jul 16 21:22:28.054774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jul 16 21:22:28.054774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jul 16 21:22:28.054774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jul 16 21:22:28.054774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 16 21:22:28.054774 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:22:28.059273 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2377/4680] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Jul 16 21:22:27 2022] POST /identity/v3/users/d85f03e60b2742a59b2709f769dc9c6f/password => generated 188 bytes in 64 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 16 21:22:28.059519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440b706-2b7f-4e32-8f7f-31c50cffc682 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:28.073057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440b706-2b7f-4e32-8f7f-31c50cffc682 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:28.080945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22660739-ade9-4736-8f99-1333d041e7c1 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85f03e60b2742a59b2709f769dc9c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e446a13317d9461c8bce6ad9bd4c17ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:28.082464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22660739-ade9-4736-8f99-1333d041e7c1 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:28.083067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22660739-ade9-4736-8f99-1333d041e7c1 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:28.083539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22660739-ade9-4736-8f99-1333d041e7c1 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] PATH_INFO: `/v3/users/d85f03e60b2742a59b2709f769dc9c6f/password` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:28.235283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-22660739-ade9-4736-8f99-1333d041e7c1 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd85f03e60b2742a59b2709f769dc9c6f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:28.369253 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2304/4681] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Jul 16 21:22:28 2022] POST /identity/v3/users/d85f03e60b2742a59b2709f769dc9c6f/password => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:29.242551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:29.375062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257be04f-29e6-4ae8-b52b-2bafdbb7eb28 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:29.375355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257be04f-29e6-4ae8-b52b-2bafdbb7eb28 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:29.375637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257be04f-29e6-4ae8-b52b-2bafdbb7eb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:29.405945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-257be04f-29e6-4ae8-b52b-2bafdbb7eb28 None None] MFA Rules not processed for user `d85f03e60b2742a59b2709f769dc9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:29.408411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-257be04f-29e6-4ae8-b52b-2bafdbb7eb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:29.429849 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2378/4682] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:29 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 21:22:29.435257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debb9fb-3a54-494f-a4be-6158f9e309f4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:29.435784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debb9fb-3a54-494f-a4be-6158f9e309f4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:29.436059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debb9fb-3a54-494f-a4be-6158f9e309f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:29.471887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2debb9fb-3a54-494f-a4be-6158f9e309f4 None None] MFA Rules not processed for user `d85f03e60b2742a59b2709f769dc9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:29.473142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2debb9fb-3a54-494f-a4be-6158f9e309f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:29.489916 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2305/4683] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:29.493804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257be04f-29e6-4ae8-b52b-2bafdbb7eb28 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:29.507783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257be04f-29e6-4ae8-b52b-2bafdbb7eb28 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:29.513190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac2bb1-14b0-41a9-aa22-c94b8ad0bd29 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85f03e60b2742a59b2709f769dc9c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e446a13317d9461c8bce6ad9bd4c17ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:29.514758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac2bb1-14b0-41a9-aa22-c94b8ad0bd29 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:29.515094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac2bb1-14b0-41a9-aa22-c94b8ad0bd29 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:29.515432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac2bb1-14b0-41a9-aa22-c94b8ad0bd29 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] PATH_INFO: `/v3/users/d85f03e60b2742a59b2709f769dc9c6f/password` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:29.646868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9aac2bb1-14b0-41a9-aa22-c94b8ad0bd29 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd85f03e60b2742a59b2709f769dc9c6f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:29.729153 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2379/4684] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Jul 16 21:22:29 2022] POST /identity/v3/users/d85f03e60b2742a59b2709f769dc9c6f/password => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:30.037599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:30.371614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:30.737301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928d940-7bcd-46d3-96b2-0e0aee352903 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:30.738337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928d940-7bcd-46d3-96b2-0e0aee352903 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:30.743972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928d940-7bcd-46d3-96b2-0e0aee352903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:30.766361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a928d940-7bcd-46d3-96b2-0e0aee352903 None None] MFA Rules not processed for user `d85f03e60b2742a59b2709f769dc9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:30.767715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a928d940-7bcd-46d3-96b2-0e0aee352903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:30.772696 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2306/4685] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:30 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 21:22:30.776191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131a546-82c4-4bf7-a9d1-6e92d236989e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:30.776658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131a546-82c4-4bf7-a9d1-6e92d236989e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:30.777027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131a546-82c4-4bf7-a9d1-6e92d236989e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:30.802981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2131a546-82c4-4bf7-a9d1-6e92d236989e None None] MFA Rules not processed for user `d85f03e60b2742a59b2709f769dc9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:30.804356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2131a546-82c4-4bf7-a9d1-6e92d236989e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:30.812941 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2380/4686] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:22:30.816771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928d940-7bcd-46d3-96b2-0e0aee352903 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:30.829152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928d940-7bcd-46d3-96b2-0e0aee352903 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:30.833856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774830e-200a-4e66-af92-d8bf63dfb50b tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85f03e60b2742a59b2709f769dc9c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e446a13317d9461c8bce6ad9bd4c17ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:30.835250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774830e-200a-4e66-af92-d8bf63dfb50b tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:30.835717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774830e-200a-4e66-af92-d8bf63dfb50b tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:30.836148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774830e-200a-4e66-af92-d8bf63dfb50b tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] PATH_INFO: `/v3/users/d85f03e60b2742a59b2709f769dc9c6f/password` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:30.979562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2774830e-200a-4e66-af92-d8bf63dfb50b tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd85f03e60b2742a59b2709f769dc9c6f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:31.078786 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2307/4687] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Jul 16 21:22:30 2022] POST /identity/v3/users/d85f03e60b2742a59b2709f769dc9c6f/password => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:31.267059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:31.450566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:32.084372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569379fb-02c8-4a1c-84b0-7d7e3fe0b03c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:32.084974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569379fb-02c8-4a1c-84b0-7d7e3fe0b03c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:32.084974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569379fb-02c8-4a1c-84b0-7d7e3fe0b03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:32.110483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-569379fb-02c8-4a1c-84b0-7d7e3fe0b03c None None] MFA Rules not processed for user `d85f03e60b2742a59b2709f769dc9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:32.111861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-569379fb-02c8-4a1c-84b0-7d7e3fe0b03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:32.119248 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2381/4688] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:32 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 21:22:32.125067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee188706-59fe-4a7e-839d-914b53e57d16 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:32.126011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee188706-59fe-4a7e-839d-914b53e57d16 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:32.127759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee188706-59fe-4a7e-839d-914b53e57d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:32.151163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ee188706-59fe-4a7e-839d-914b53e57d16 None None] MFA Rules not processed for user `d85f03e60b2742a59b2709f769dc9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:32.152522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ee188706-59fe-4a7e-839d-914b53e57d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:32.167143 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2308/4689] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:32.172516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569379fb-02c8-4a1c-84b0-7d7e3fe0b03c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:32.184851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569379fb-02c8-4a1c-84b0-7d7e3fe0b03c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:32.189231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c6fbf-cef8-46f4-85f6-3462d10cee7a tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85f03e60b2742a59b2709f769dc9c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e446a13317d9461c8bce6ad9bd4c17ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:32.190133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c6fbf-cef8-46f4-85f6-3462d10cee7a tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:32.190419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c6fbf-cef8-46f4-85f6-3462d10cee7a tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:32.190704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c6fbf-cef8-46f4-85f6-3462d10cee7a tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] PATH_INFO: `/v3/users/d85f03e60b2742a59b2709f769dc9c6f/password` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:32.320439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a53c6fbf-cef8-46f4-85f6-3462d10cee7a tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd85f03e60b2742a59b2709f769dc9c6f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:32.479342 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2382/4690] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Jul 16 21:22:32 2022] POST /identity/v3/users/d85f03e60b2742a59b2709f769dc9c6f/password => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:32.645568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:33.084644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:33.094003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee188706-59fe-4a7e-839d-914b53e57d16 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:33.095694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ee188706-59fe-4a7e-839d-914b53e57d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:33.193511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee188706-59fe-4a7e-839d-914b53e57d16 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:33.198195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac750f99-6f36-41d4-8990-8eaa1a0a5b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:33.199126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac750f99-6f36-41d4-8990-8eaa1a0a5b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:33.199409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac750f99-6f36-41d4-8990-8eaa1a0a5b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:33.199679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac750f99-6f36-41d4-8990-8eaa1a0a5b90 admin admin] PATH_INFO: `/v3/users/6d3c3e30e1a7431ab7cc33fa2b867eab` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:33.200964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac750f99-6f36-41d4-8990-8eaa1a0a5b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d3c3e30e1a7431ab7cc33fa2b867eab)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:33.204053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac750f99-6f36-41d4-8990-8eaa1a0a5b90 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:33.417194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ac750f99-6f36-41d4-8990-8eaa1a0a5b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d3c3e30e1a7431ab7cc33fa2b867eab'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:33.434143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ac750f99-6f36-41d4-8990-8eaa1a0a5b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d3c3e30e1a7431ab7cc33fa2b867eab'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:33.481140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f8458-4827-4e48-809a-b7c72e42bd99 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:33.486027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f8458-4827-4e48-809a-b7c72e42bd99 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:33.486027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f8458-4827-4e48-809a-b7c72e42bd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:33.500688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-789f8458-4827-4e48-809a-b7c72e42bd99 None None] MFA Rules not processed for user `d85f03e60b2742a59b2709f769dc9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:33.501913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-789f8458-4827-4e48-809a-b7c72e42bd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:33.505339 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2383/4691] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:33 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 21:22:33.533343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ac750f99-6f36-41d4-8990-8eaa1a0a5b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d3c3e30e1a7431ab7cc33fa2b867eab'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:33.541132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ac750f99-6f36-41d4-8990-8eaa1a0a5b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d3c3e30e1a7431ab7cc33fa2b867eab'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:33.541722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ac750f99-6f36-41d4-8990-8eaa1a0a5b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d3c3e30e1a7431ab7cc33fa2b867eab'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:33.548246 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2309/4692] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:22:33 2022] DELETE /identity/v3/users/6d3c3e30e1a7431ab7cc33fa2b867eab => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:33.552716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb7c74-5d1f-456e-8eb3-64a9642c7fac None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:33.553009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb7c74-5d1f-456e-8eb3-64a9642c7fac None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:33.553578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb7c74-5d1f-456e-8eb3-64a9642c7fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:33.577257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac750f99-6f36-41d4-8990-8eaa1a0a5b90 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:33.578830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ac750f99-6f36-41d4-8990-8eaa1a0a5b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:33.585021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c6eb7c74-5d1f-456e-8eb3-64a9642c7fac None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:33.586409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c6eb7c74-5d1f-456e-8eb3-64a9642c7fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:33.650902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac750f99-6f36-41d4-8990-8eaa1a0a5b90 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:33.657293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766f897-478e-4e4b-884e-b4b869d059e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:33.661293 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2384/4693] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:33.662122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766f897-478e-4e4b-884e-b4b869d059e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:33.662122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766f897-478e-4e4b-884e-b4b869d059e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:33.662122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766f897-478e-4e4b-884e-b4b869d059e1 admin admin] PATH_INFO: `/v3/users/fa4c2791e14d4f88883a0af422e4ff0c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:33.664039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb7c74-5d1f-456e-8eb3-64a9642c7fac None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:33.664206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766f897-478e-4e4b-884e-b4b869d059e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4c2791e14d4f88883a0af422e4ff0c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:33.665730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c6eb7c74-5d1f-456e-8eb3-64a9642c7fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:33.666186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766f897-478e-4e4b-884e-b4b869d059e1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:33.761878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb7c74-5d1f-456e-8eb3-64a9642c7fac None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:33.765826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d359ed1-0a6f-46d3-92ea-af99108bf416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:33.766481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d359ed1-0a6f-46d3-92ea-af99108bf416 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:33.767116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d359ed1-0a6f-46d3-92ea-af99108bf416 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:33.767116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d359ed1-0a6f-46d3-92ea-af99108bf416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:33.780169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d359ed1-0a6f-46d3-92ea-af99108bf416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:33.781727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d359ed1-0a6f-46d3-92ea-af99108bf416 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:33.792482 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2385/4694] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:22:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:22:33.888523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d766f897-478e-4e4b-884e-b4b869d059e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4c2791e14d4f88883a0af422e4ff0c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:33.942978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d766f897-478e-4e4b-884e-b4b869d059e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4c2791e14d4f88883a0af422e4ff0c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:33.980371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:34.036660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d766f897-478e-4e4b-884e-b4b869d059e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4c2791e14d4f88883a0af422e4ff0c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:34.046095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d766f897-478e-4e4b-884e-b4b869d059e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4c2791e14d4f88883a0af422e4ff0c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:34.046879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d766f897-478e-4e4b-884e-b4b869d059e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4c2791e14d4f88883a0af422e4ff0c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:34.053279 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2310/4695] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:22:33 2022] DELETE /identity/v3/users/fa4c2791e14d4f88883a0af422e4ff0c => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:22:34.126715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d359ed1-0a6f-46d3-92ea-af99108bf416 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:34.129748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3d359ed1-0a6f-46d3-92ea-af99108bf416 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:34.187331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d359ed1-0a6f-46d3-92ea-af99108bf416 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:34.276443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88996eb5-98b7-49a4-889e-75488e124031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:34.277445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88996eb5-98b7-49a4-889e-75488e124031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:34.277818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88996eb5-98b7-49a4-889e-75488e124031 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:34.278499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88996eb5-98b7-49a4-889e-75488e124031 admin admin] PATH_INFO: `/v3/projects/8813dbf63ca8439c8ce487b4ecc02398` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:34.280037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88996eb5-98b7-49a4-889e-75488e124031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8813dbf63ca8439c8ce487b4ecc02398)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:34.282716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88996eb5-98b7-49a4-889e-75488e124031 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:34.500616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-88996eb5-98b7-49a4-889e-75488e124031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8813dbf63ca8439c8ce487b4ecc02398', 'request_id': 'req-88996eb5-98b7-49a4-889e-75488e124031'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:34.507089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-88996eb5-98b7-49a4-889e-75488e124031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8813dbf63ca8439c8ce487b4ecc02398', 'request_id': 'req-88996eb5-98b7-49a4-889e-75488e124031'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:34.511038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f137928-2925-4c38-b812-48dbcdf4be8f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:34.514585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f137928-2925-4c38-b812-48dbcdf4be8f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:34.514585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f137928-2925-4c38-b812-48dbcdf4be8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:34.525393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-88996eb5-98b7-49a4-889e-75488e124031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8813dbf63ca8439c8ce487b4ecc02398', 'request_id': 'req-88996eb5-98b7-49a4-889e-75488e124031'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:34.534017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6f137928-2925-4c38-b812-48dbcdf4be8f None None] MFA Rules not processed for user `d85f03e60b2742a59b2709f769dc9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:34.535359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6f137928-2925-4c38-b812-48dbcdf4be8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:34.596543 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2311/4696] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:34.597430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f137928-2925-4c38-b812-48dbcdf4be8f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:34.602072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6f137928-2925-4c38-b812-48dbcdf4be8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:34.625482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-88996eb5-98b7-49a4-889e-75488e124031 admin admin] The token cache is being invalidate because project 8813dbf63ca8439c8ce487b4ecc02398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:34.626059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-88996eb5-98b7-49a4-889e-75488e124031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:34.626914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-88996eb5-98b7-49a4-889e-75488e124031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:34.629218 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2386/4697] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:22:34 2022] DELETE /identity/v3/projects/8813dbf63ca8439c8ce487b4ecc02398 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:34.630945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8357d46-8b98-4ec9-abda-e61298496449 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:34.631432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8357d46-8b98-4ec9-abda-e61298496449 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:34.634945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8357d46-8b98-4ec9-abda-e61298496449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:34.654970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a8357d46-8b98-4ec9-abda-e61298496449 None None] MFA Rules not processed for user `d85f03e60b2742a59b2709f769dc9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:34.656711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a8357d46-8b98-4ec9-abda-e61298496449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:34.662657 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2387/4698] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:34 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 21:22:34.663693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8357d46-8b98-4ec9-abda-e61298496449 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:34.666682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a8357d46-8b98-4ec9-abda-e61298496449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:34.681221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f137928-2925-4c38-b812-48dbcdf4be8f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:34.683853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8357d46-8b98-4ec9-abda-e61298496449 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:34.686924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff26be5-1376-46a3-bf3e-4d5902c26028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:34.687848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff26be5-1376-46a3-bf3e-4d5902c26028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:34.688222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff26be5-1376-46a3-bf3e-4d5902c26028 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:34.688693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff26be5-1376-46a3-bf3e-4d5902c26028 admin admin] PATH_INFO: `/v3/projects/c95a2d1e0a034c7ca4a2fcb9fd060d53` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:34.690266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff26be5-1376-46a3-bf3e-4d5902c26028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c95a2d1e0a034c7ca4a2fcb9fd060d53)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:34.691646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2b4f1-71a8-491f-b7ff-be65af06907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:34.692978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff26be5-1376-46a3-bf3e-4d5902c26028 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:34.693327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2b4f1-71a8-491f-b7ff-be65af06907f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:34.693765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2b4f1-71a8-491f-b7ff-be65af06907f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:34.694229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2b4f1-71a8-491f-b7ff-be65af06907f admin admin] PATH_INFO: `/v3/users/c33816b723f74bac977a9f430c9c5a92` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:34.696052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2b4f1-71a8-491f-b7ff-be65af06907f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c33816b723f74bac977a9f430c9c5a92)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:34.698470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2b4f1-71a8-491f-b7ff-be65af06907f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:34.834837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-eff26be5-1376-46a3-bf3e-4d5902c26028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c95a2d1e0a034c7ca4a2fcb9fd060d53', 'request_id': 'req-eff26be5-1376-46a3-bf3e-4d5902c26028'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:34.844187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-eff26be5-1376-46a3-bf3e-4d5902c26028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c95a2d1e0a034c7ca4a2fcb9fd060d53', 'request_id': 'req-eff26be5-1376-46a3-bf3e-4d5902c26028'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:34.851580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-eff26be5-1376-46a3-bf3e-4d5902c26028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c95a2d1e0a034c7ca4a2fcb9fd060d53', 'request_id': 'req-eff26be5-1376-46a3-bf3e-4d5902c26028'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:34.936465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-eff26be5-1376-46a3-bf3e-4d5902c26028 admin admin] The token cache is being invalidate because project c95a2d1e0a034c7ca4a2fcb9fd060d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:34.937057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-eff26be5-1376-46a3-bf3e-4d5902c26028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:34.937815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-eff26be5-1376-46a3-bf3e-4d5902c26028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:34.939555 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2312/4699] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:22:34 2022] DELETE /identity/v3/projects/c95a2d1e0a034c7ca4a2fcb9fd060d53 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:34.941791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e63fe-44c0-4625-9ea4-4d213695c3df None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:34.942144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e63fe-44c0-4625-9ea4-4d213695c3df None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:34.942488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e63fe-44c0-4625-9ea4-4d213695c3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:34.947519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-40d2b4f1-71a8-491f-b7ff-be65af06907f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c33816b723f74bac977a9f430c9c5a92'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:34.961469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-40d2b4f1-71a8-491f-b7ff-be65af06907f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c33816b723f74bac977a9f430c9c5a92'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:35.059595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-40d2b4f1-71a8-491f-b7ff-be65af06907f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c33816b723f74bac977a9f430c9c5a92'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:35.060278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-40d2b4f1-71a8-491f-b7ff-be65af06907f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c33816b723f74bac977a9f430c9c5a92'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:35.076217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-40d2b4f1-71a8-491f-b7ff-be65af06907f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c33816b723f74bac977a9f430c9c5a92'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:35.082710 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2388/4700] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:22:34 2022] DELETE /identity/v3/users/c33816b723f74bac977a9f430c9c5a92 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:35.084286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e94bc-07ce-4f03-a95f-e8832de6c4a1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:35.087317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e94bc-07ce-4f03-a95f-e8832de6c4a1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:35.087317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e94bc-07ce-4f03-a95f-e8832de6c4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:35.088133 ncdv-master-1 devstack@keystone.service[98195]: WARNING keystone.server.flask.application [None req-153e63fe-44c0-4625-9ea4-4d213695c3df None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 16 21:22:35.089506 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2313/4701] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:34 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 149 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 16 21:22:35.094709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca71ff-d917-4005-b81d-9da4bb91a574 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:35.095539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca71ff-d917-4005-b81d-9da4bb91a574 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:35.095539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca71ff-d917-4005-b81d-9da4bb91a574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:35.139086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:35.159429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ad3e94bc-07ce-4f03-a95f-e8832de6c4a1 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:35.160776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ad3e94bc-07ce-4f03-a95f-e8832de6c4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:35.228966 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2389/4702] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:35.230442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643dbfa-352f-4081-9d13-1ffcc1f6869c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:35.230734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643dbfa-352f-4081-9d13-1ffcc1f6869c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:35.231041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643dbfa-352f-4081-9d13-1ffcc1f6869c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:35.243168 ncdv-master-1 devstack@keystone.service[98195]: WARNING keystone.server.flask.application [None req-c9ca71ff-d917-4005-b81d-9da4bb91a574 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 16 21:22:35.244780 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2314/4703] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:35 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 151 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 16 21:22:35.251407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c643dbfa-352f-4081-9d13-1ffcc1f6869c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:35.252724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c643dbfa-352f-4081-9d13-1ffcc1f6869c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:35.255312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abb8ce-1255-40c3-bc0d-9813d0026995 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:35.255605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abb8ce-1255-40c3-bc0d-9813d0026995 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:35.255883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abb8ce-1255-40c3-bc0d-9813d0026995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:35.261323 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2390/4704] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:35.265919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643dbfa-352f-4081-9d13-1ffcc1f6869c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:35.276370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643dbfa-352f-4081-9d13-1ffcc1f6869c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:35.282044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b0d17-348f-42f1-9494-2140e44f80a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:35.282816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b0d17-348f-42f1-9494-2140e44f80a8 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:35.283253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b0d17-348f-42f1-9494-2140e44f80a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:35.283625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b0d17-348f-42f1-9494-2140e44f80a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:35.284442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b0d17-348f-42f1-9494-2140e44f80a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:22:35.284845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b0d17-348f-42f1-9494-2140e44f80a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:35.285999 ncdv-master-1 devstack@keystone.service[98195]: WARNING keystone.server.flask.application [None req-81abb8ce-1255-40c3-bc0d-9813d0026995 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 16 21:22:35.286767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b0d17-348f-42f1-9494-2140e44f80a8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:35.287823 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2315/4705] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:35 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 33 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 16 21:22:35.300385 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2391/4706] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:22:35.308825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abb8ce-1255-40c3-bc0d-9813d0026995 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:35.323154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abb8ce-1255-40c3-bc0d-9813d0026995 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:35.328775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a45553-3890-42a4-9a74-82aade3e651f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:35.328775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a45553-3890-42a4-9a74-82aade3e651f admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:35.329016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a45553-3890-42a4-9a74-82aade3e651f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:35.329270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a45553-3890-42a4-9a74-82aade3e651f admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:35.329973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a45553-3890-42a4-9a74-82aade3e651f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:35.331910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a45553-3890-42a4-9a74-82aade3e651f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:35.519214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b0d17-348f-42f1-9494-2140e44f80a8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:35.522189 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2316/4707] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:22:35 2022] POST /identity/v3/projects => generated 399 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:35.522593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6d4b0d17-348f-42f1-9494-2140e44f80a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:35.523934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a45553-3890-42a4-9a74-82aade3e651f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:35.536187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b0d17-348f-42f1-9494-2140e44f80a8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:35.609853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a45553-3890-42a4-9a74-82aade3e651f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:35.614222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e4466-e6f8-44ac-874a-2e9ba71c1937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:35.615191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e4466-e6f8-44ac-874a-2e9ba71c1937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:35.615310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac2fb1-7667-492e-a439-2dd2efc9dd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:35.615594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e4466-e6f8-44ac-874a-2e9ba71c1937 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:35.615873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e4466-e6f8-44ac-874a-2e9ba71c1937 admin admin] PATH_INFO: `/v3/projects/0ca3d0a497614f3bb0aab6764145e9df` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:35.616155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac2fb1-7667-492e-a439-2dd2efc9dd89 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:35.616569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac2fb1-7667-492e-a439-2dd2efc9dd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:35.616936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac2fb1-7667-492e-a439-2dd2efc9dd89 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:35.617120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e4466-e6f8-44ac-874a-2e9ba71c1937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca3d0a497614f3bb0aab6764145e9df)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:35.617746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac2fb1-7667-492e-a439-2dd2efc9dd89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:35.619167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e4466-e6f8-44ac-874a-2e9ba71c1937 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:35.619989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac2fb1-7667-492e-a439-2dd2efc9dd89 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:35.740598 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2317/4708] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:22:35 2022] POST /identity/v3/users => generated 300 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:35.744673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac2fb1-7667-492e-a439-2dd2efc9dd89 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:35.755156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac2fb1-7667-492e-a439-2dd2efc9dd89 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:35.759813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc1447-8c4b-4f36-8862-d19c0d2ab504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:35.760461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc1447-8c4b-4f36-8862-d19c0d2ab504 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:35.762072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc1447-8c4b-4f36-8862-d19c0d2ab504 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:35.762072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc1447-8c4b-4f36-8862-d19c0d2ab504 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:35.762072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc1447-8c4b-4f36-8862-d19c0d2ab504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:35.763326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc1447-8c4b-4f36-8862-d19c0d2ab504 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:35.774208 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2318/4709] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:35.778527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc1447-8c4b-4f36-8862-d19c0d2ab504 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:35.781690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-da1e4466-e6f8-44ac-874a-2e9ba71c1937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca3d0a497614f3bb0aab6764145e9df', 'request_id': 'req-da1e4466-e6f8-44ac-874a-2e9ba71c1937'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:35.788490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-da1e4466-e6f8-44ac-874a-2e9ba71c1937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca3d0a497614f3bb0aab6764145e9df', 'request_id': 'req-da1e4466-e6f8-44ac-874a-2e9ba71c1937'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:35.789842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc1447-8c4b-4f36-8862-d19c0d2ab504 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:35.794136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-da1e4466-e6f8-44ac-874a-2e9ba71c1937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca3d0a497614f3bb0aab6764145e9df', 'request_id': 'req-da1e4466-e6f8-44ac-874a-2e9ba71c1937'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:35.849496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7e675-1e2c-4b13-8116-64eacb08a312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:35.850169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7e675-1e2c-4b13-8116-64eacb08a312 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:35.850457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7e675-1e2c-4b13-8116-64eacb08a312 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:35.850734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7e675-1e2c-4b13-8116-64eacb08a312 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:35.852120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7e675-1e2c-4b13-8116-64eacb08a312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:35.853705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-da1e4466-e6f8-44ac-874a-2e9ba71c1937 admin admin] The token cache is being invalidate because project 0ca3d0a497614f3bb0aab6764145e9df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:35.853705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-da1e4466-e6f8-44ac-874a-2e9ba71c1937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:35.853910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7e675-1e2c-4b13-8116-64eacb08a312 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:35.854581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-da1e4466-e6f8-44ac-874a-2e9ba71c1937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:35.856384 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2392/4710] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:22:35 2022] DELETE /identity/v3/projects/0ca3d0a497614f3bb0aab6764145e9df => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:35.867781 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2319/4711] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:35.867936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196be00-470b-405e-a3ce-b92f3342beea None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:35.867936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196be00-470b-405e-a3ce-b92f3342beea None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:35.867936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196be00-470b-405e-a3ce-b92f3342beea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:35.871273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7e675-1e2c-4b13-8116-64eacb08a312 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:35.874139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c7b7e675-1e2c-4b13-8116-64eacb08a312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:35.887683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7e675-1e2c-4b13-8116-64eacb08a312 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:35.890177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7196be00-470b-405e-a3ce-b92f3342beea None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:35.891601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7196be00-470b-405e-a3ce-b92f3342beea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:35.892940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876f031-29d5-430c-b46a-f7c51d0f913f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:35.893862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876f031-29d5-430c-b46a-f7c51d0f913f admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:35.894147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876f031-29d5-430c-b46a-f7c51d0f913f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:35.894422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876f031-29d5-430c-b46a-f7c51d0f913f admin admin] PATH_INFO: `/v3/projects/7c0ebaf2e3714e42b3bda726e2133522/users/3ab7326ef48042fe961a7eed5c46db24/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:35.903991 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2393/4712] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:35.911105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876f031-29d5-430c-b46a-f7c51d0f913f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0ebaf2e3714e42b3bda726e2133522, user_id=3ab7326ef48042fe961a7eed5c46db24, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:35.913384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a0ce-006c-494a-90db-0c57f193059e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:35.917123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a0ce-006c-494a-90db-0c57f193059e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:35.917258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876f031-29d5-430c-b46a-f7c51d0f913f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:35.917366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a0ce-006c-494a-90db-0c57f193059e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:35.932678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-dad0a0ce-006c-494a-90db-0c57f193059e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:35.933894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dad0a0ce-006c-494a-90db-0c57f193059e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:35.942790 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2394/4713] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:22:35.946983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0a0ce-006c-494a-90db-0c57f193059e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:35.956453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0a0ce-006c-494a-90db-0c57f193059e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:35.961078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46035e-6000-467b-bb2d-1d71d79ebeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:35.961729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46035e-6000-467b-bb2d-1d71d79ebeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:35.963283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46035e-6000-467b-bb2d-1d71d79ebeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:35.963283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46035e-6000-467b-bb2d-1d71d79ebeb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:35.963283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46035e-6000-467b-bb2d-1d71d79ebeb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:22:35.963555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46035e-6000-467b-bb2d-1d71d79ebeb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:35.964928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46035e-6000-467b-bb2d-1d71d79ebeb6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:35.978955 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2395/4714] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:22:35.983345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46035e-6000-467b-bb2d-1d71d79ebeb6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:35.990277 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2320/4715] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:35 2022] PUT /identity/v3/projects/7c0ebaf2e3714e42b3bda726e2133522/users/3ab7326ef48042fe961a7eed5c46db24/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:35.995338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b447462-7a27-49b1-8f4a-75ca4579aae2 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:35.995633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b447462-7a27-49b1-8f4a-75ca4579aae2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:35.996206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b447462-7a27-49b1-8f4a-75ca4579aae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:35.996331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46035e-6000-467b-bb2d-1d71d79ebeb6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:36.014837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8b447462-7a27-49b1-8f4a-75ca4579aae2 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:36.016266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8b447462-7a27-49b1-8f4a-75ca4579aae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:36.058776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:36.066049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7784f49-73e5-474a-b2bb-2e2ac74e2bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:36.066700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7784f49-73e5-474a-b2bb-2e2ac74e2bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:36.066983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7784f49-73e5-474a-b2bb-2e2ac74e2bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:36.067291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7784f49-73e5-474a-b2bb-2e2ac74e2bc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:36.067975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7784f49-73e5-474a-b2bb-2e2ac74e2bc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:36.070068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7784f49-73e5-474a-b2bb-2e2ac74e2bc5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:36.078154 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2321/4716] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:22:36.089977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b447462-7a27-49b1-8f4a-75ca4579aae2 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:36.099207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8b447462-7a27-49b1-8f4a-75ca4579aae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:36.155359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b447462-7a27-49b1-8f4a-75ca4579aae2 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:36.159285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827d467-196b-4c78-95c0-72f868b5a1f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:36.159948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827d467-196b-4c78-95c0-72f868b5a1f6 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:36.160271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827d467-196b-4c78-95c0-72f868b5a1f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:36.160544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827d467-196b-4c78-95c0-72f868b5a1f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:36.171201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1827d467-196b-4c78-95c0-72f868b5a1f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:36.176283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1827d467-196b-4c78-95c0-72f868b5a1f6 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:36.181690 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2396/4717] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:22:35 2022] POST /identity/v3/projects => generated 369 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:22:36.186001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7784f49-73e5-474a-b2bb-2e2ac74e2bc5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:36.186472 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2322/4718] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:22:36.252890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7784f49-73e5-474a-b2bb-2e2ac74e2bc5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:36.258063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c65443-efae-475a-bb29-56e5ac63fc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:36.258888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c65443-efae-475a-bb29-56e5ac63fc7e admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:36.259000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c65443-efae-475a-bb29-56e5ac63fc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:36.259300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c65443-efae-475a-bb29-56e5ac63fc7e admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:36.263207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c65443-efae-475a-bb29-56e5ac63fc7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:36.265213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c65443-efae-475a-bb29-56e5ac63fc7e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:36.372524 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2397/4719] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:22:36 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:22:36.373888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827d467-196b-4c78-95c0-72f868b5a1f6 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:36.384535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827d467-196b-4c78-95c0-72f868b5a1f6 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:36.392034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c28f5-7a08-41e1-95ac-4a34b304fcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:36.392802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c28f5-7a08-41e1-95ac-4a34b304fcf1 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:36.393192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c28f5-7a08-41e1-95ac-4a34b304fcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:36.393567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c28f5-7a08-41e1-95ac-4a34b304fcf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:36.394588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c28f5-7a08-41e1-95ac-4a34b304fcf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:36.396530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c28f5-7a08-41e1-95ac-4a34b304fcf1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:36.415553 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2323/4720] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:36.416168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c65443-efae-475a-bb29-56e5ac63fc7e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:36.428154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c65443-efae-475a-bb29-56e5ac63fc7e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:36.442921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:36.443893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8408cc-7c5c-4345-9f4a-8ee6260593f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:36.444584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8408cc-7c5c-4345-9f4a-8ee6260593f3 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:36.445035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8408cc-7c5c-4345-9f4a-8ee6260593f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:36.445447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8408cc-7c5c-4345-9f4a-8ee6260593f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:36.446557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8408cc-7c5c-4345-9f4a-8ee6260593f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:36.447874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8408cc-7c5c-4345-9f4a-8ee6260593f3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:36.462159 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2398/4721] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:22:36.463408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c28f5-7a08-41e1-95ac-4a34b304fcf1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:36.474765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c28f5-7a08-41e1-95ac-4a34b304fcf1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:36.479392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bd384-4f11-48d5-8f20-2a6b59d6edb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:36.480286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bd384-4f11-48d5-8f20-2a6b59d6edb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:36.480573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bd384-4f11-48d5-8f20-2a6b59d6edb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:36.480849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bd384-4f11-48d5-8f20-2a6b59d6edb1 admin admin] PATH_INFO: `/v3/projects/444adbbe7b604478bcbfc26666e4cbed/users/59876ad10218461681980764d3f29539/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:36.502113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3bd384-4f11-48d5-8f20-2a6b59d6edb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=444adbbe7b604478bcbfc26666e4cbed, user_id=59876ad10218461681980764d3f29539, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:36.505018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3bd384-4f11-48d5-8f20-2a6b59d6edb1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:36.654435 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2324/4722] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:36 2022] PUT /identity/v3/projects/444adbbe7b604478bcbfc26666e4cbed/users/59876ad10218461681980764d3f29539/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:36.655836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98036cdd-7798-4972-9b41-b6456437e34b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:36.656354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98036cdd-7798-4972-9b41-b6456437e34b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:36.656465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98036cdd-7798-4972-9b41-b6456437e34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:36.689221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-98036cdd-7798-4972-9b41-b6456437e34b None None] MFA Rules not processed for user `59876ad10218461681980764d3f29539`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:36.691600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-98036cdd-7798-4972-9b41-b6456437e34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:36.762113 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2399/4723] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:36.767776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bd384-4f11-48d5-8f20-2a6b59d6edb1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:36.832583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bd384-4f11-48d5-8f20-2a6b59d6edb1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:36.837311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ac6f4-afc4-4428-a567-d01d4552f5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:36.837990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ac6f4-afc4-4428-a567-d01d4552f5f1 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:36.838261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ac6f4-afc4-4428-a567-d01d4552f5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:36.838539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ac6f4-afc4-4428-a567-d01d4552f5f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:36.839273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ac6f4-afc4-4428-a567-d01d4552f5f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:36.841187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ac6f4-afc4-4428-a567-d01d4552f5f1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:36.969719 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2325/4724] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:22:36 2022] POST /identity/v3/projects => generated 369 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:36.974003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98036cdd-7798-4972-9b41-b6456437e34b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:36.985638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98036cdd-7798-4972-9b41-b6456437e34b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:37.056988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc0eac-e2dc-49a1-abcc-21ef1c8d9366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:37.057688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc0eac-e2dc-49a1-abcc-21ef1c8d9366 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:37.057973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc0eac-e2dc-49a1-abcc-21ef1c8d9366 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:37.058250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc0eac-e2dc-49a1-abcc-21ef1c8d9366 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:37.058947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc0eac-e2dc-49a1-abcc-21ef1c8d9366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:37.060944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc0eac-e2dc-49a1-abcc-21ef1c8d9366 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:37.161762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ac6f4-afc4-4428-a567-d01d4552f5f1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:37.163528 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2400/4725] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:22:36 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:22:37.173019 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ac6f4-afc4-4428-a567-d01d4552f5f1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:37.178582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782a553-d56a-406e-864f-f4aeeedd2f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:37.179365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782a553-d56a-406e-864f-f4aeeedd2f9e admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:37.185271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782a553-d56a-406e-864f-f4aeeedd2f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:37.185271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782a553-d56a-406e-864f-f4aeeedd2f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:37.185271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782a553-d56a-406e-864f-f4aeeedd2f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:37.185271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782a553-d56a-406e-864f-f4aeeedd2f9e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:37.194479 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2326/4726] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:22:37.200643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc0eac-e2dc-49a1-abcc-21ef1c8d9366 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:37.211570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc0eac-e2dc-49a1-abcc-21ef1c8d9366 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:37.216534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149fab0-f183-47c0-862c-d3488e86fcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:37.217451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149fab0-f183-47c0-862c-d3488e86fcaf admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:37.217735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149fab0-f183-47c0-862c-d3488e86fcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:37.218015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149fab0-f183-47c0-862c-d3488e86fcaf admin admin] PATH_INFO: `/v3/projects/c982566016f54b54bce1d2bbd0a75049/users/352b3ba8594c420ea61c6f9756106bea/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:37.233416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149fab0-f183-47c0-862c-d3488e86fcaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c982566016f54b54bce1d2bbd0a75049, user_id=352b3ba8594c420ea61c6f9756106bea, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:37.236354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149fab0-f183-47c0-862c-d3488e86fcaf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:37.347551 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2401/4727] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:37 2022] PUT /identity/v3/projects/c982566016f54b54bce1d2bbd0a75049/users/352b3ba8594c420ea61c6f9756106bea/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:37.351650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782a553-d56a-406e-864f-f4aeeedd2f9e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:37.365831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782a553-d56a-406e-864f-f4aeeedd2f9e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:37.425505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75221f-9bf3-47f3-b7a6-fffbe195fcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:37.426092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75221f-9bf3-47f3-b7a6-fffbe195fcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:37.426374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75221f-9bf3-47f3-b7a6-fffbe195fcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:37.426653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75221f-9bf3-47f3-b7a6-fffbe195fcf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:37.427722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75221f-9bf3-47f3-b7a6-fffbe195fcf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:37.429096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75221f-9bf3-47f3-b7a6-fffbe195fcf3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:37.439712 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2327/4728] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:22:37.444052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149fab0-f183-47c0-862c-d3488e86fcaf admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:37.454930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149fab0-f183-47c0-862c-d3488e86fcaf admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:37.459804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9e39f-f4cc-400d-b464-032077e68ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:37.460702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9e39f-f4cc-400d-b464-032077e68ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:37.460980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9e39f-f4cc-400d-b464-032077e68ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:37.461250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9e39f-f4cc-400d-b464-032077e68ac5 admin admin] PATH_INFO: `/v3/projects/c982566016f54b54bce1d2bbd0a75049/users/352b3ba8594c420ea61c6f9756106bea/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:37.463454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9e39f-f4cc-400d-b464-032077e68ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c982566016f54b54bce1d2bbd0a75049, user_id=352b3ba8594c420ea61c6f9756106bea, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:37.466107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9e39f-f4cc-400d-b464-032077e68ac5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:37.477508 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2402/4729] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:37 2022] PUT /identity/v3/projects/c982566016f54b54bce1d2bbd0a75049/users/352b3ba8594c420ea61c6f9756106bea/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:37.488638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6146931-7b9b-44ce-af18-22b86e0474f7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:37.488930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6146931-7b9b-44ce-af18-22b86e0474f7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:37.489205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6146931-7b9b-44ce-af18-22b86e0474f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:37.519930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e6146931-7b9b-44ce-af18-22b86e0474f7 None None] MFA Rules not processed for user `352b3ba8594c420ea61c6f9756106bea`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:37.521216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e6146931-7b9b-44ce-af18-22b86e0474f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:37.594687 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2328/4730] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:37 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:37.605375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9e39f-f4cc-400d-b464-032077e68ac5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:37.607713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a4a9e39f-f4cc-400d-b464-032077e68ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:37.637341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:37.682742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9e39f-f4cc-400d-b464-032077e68ac5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:37.686388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36967a76-2874-4119-927a-ad550a2ab7fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:37.687061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36967a76-2874-4119-927a-ad550a2ab7fb service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:37.687348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36967a76-2874-4119-927a-ad550a2ab7fb service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:37.687624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36967a76-2874-4119-927a-ad550a2ab7fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:37.696894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36967a76-2874-4119-927a-ad550a2ab7fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:37.698337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36967a76-2874-4119-927a-ad550a2ab7fb service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:37.708768 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2403/4731] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:22:37 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:22:37.888773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:38.721035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:40.215064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:40.522642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:41.787268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:42.246253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:43.430679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:43.712308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:44.003412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2471b82-7005-446d-9fa5-0739fcd14a4d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:44.003704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2471b82-7005-446d-9fa5-0739fcd14a4d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:44.003990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2471b82-7005-446d-9fa5-0739fcd14a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:44.048346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b2471b82-7005-446d-9fa5-0739fcd14a4d None None] MFA Rules not processed for user `3ab7326ef48042fe961a7eed5c46db24`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:44.049572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b2471b82-7005-446d-9fa5-0739fcd14a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:44.136472 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2329/4732] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:44.146933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ec1f8-f67a-41a9-854b-d4e1db6eefb7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:44.147272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ec1f8-f67a-41a9-854b-d4e1db6eefb7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:44.148072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ec1f8-f67a-41a9-854b-d4e1db6eefb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:44.168189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1e5ec1f8-f67a-41a9-854b-d4e1db6eefb7 None None] MFA Rules not processed for user `3ab7326ef48042fe961a7eed5c46db24`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:44.169727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1e5ec1f8-f67a-41a9-854b-d4e1db6eefb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:44.182141 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2404/4733] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:44.195593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2471b82-7005-446d-9fa5-0739fcd14a4d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:44.198025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b2471b82-7005-446d-9fa5-0739fcd14a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:44.260109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:44.322543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2471b82-7005-446d-9fa5-0739fcd14a4d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:44.330705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1570e-f712-4556-a047-651eb5908765 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:44.332034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1570e-f712-4556-a047-651eb5908765 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:44.332481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1570e-f712-4556-a047-651eb5908765 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:44.333175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1570e-f712-4556-a047-651eb5908765 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:44.344263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1570e-f712-4556-a047-651eb5908765 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:44.346159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1570e-f712-4556-a047-651eb5908765 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:44.360318 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2330/4734] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:22:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:22:45.008553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:45.464319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:45.866269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:46.208308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:46.302005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18d2e5-182e-4d75-a4c5-5cd2d98cc234 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:46.302701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18d2e5-182e-4d75-a4c5-5cd2d98cc234 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:46.303085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18d2e5-182e-4d75-a4c5-5cd2d98cc234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:46.476918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ef18d2e5-182e-4d75-a4c5-5cd2d98cc234 None None] MFA Rules not processed for user `d85f03e60b2742a59b2709f769dc9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:46.479120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ef18d2e5-182e-4d75-a4c5-5cd2d98cc234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:46.489903 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2405/4735] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:46 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 21:22:46.491286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1570e-f712-4556-a047-651eb5908765 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:46.492781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-86b1570e-f712-4556-a047-651eb5908765 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:46.522237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:46.573530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1570e-f712-4556-a047-651eb5908765 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:46.579667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f20648-2dbe-4c0a-9cb2-e3948daf78a0 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85f03e60b2742a59b2709f769dc9c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e446a13317d9461c8bce6ad9bd4c17ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:46.580907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f20648-2dbe-4c0a-9cb2-e3948daf78a0 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:46.581586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f20648-2dbe-4c0a-9cb2-e3948daf78a0 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:46.581996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f20648-2dbe-4c0a-9cb2-e3948daf78a0 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] PATH_INFO: `/v3/users/d85f03e60b2742a59b2709f769dc9c6f/password` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:46.695405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-91f20648-2dbe-4c0a-9cb2-e3948daf78a0 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd85f03e60b2742a59b2709f769dc9c6f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:46.802773 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2331/4736] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Jul 16 21:22:46 2022] POST /identity/v3/users/d85f03e60b2742a59b2709f769dc9c6f/password => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:47.806002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1467c7-ad91-4806-9df9-c3c6a5145d8c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:47.811245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1467c7-ad91-4806-9df9-c3c6a5145d8c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:47.811245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1467c7-ad91-4806-9df9-c3c6a5145d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:47.836651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ff1467c7-ad91-4806-9df9-c3c6a5145d8c None None] MFA Rules not processed for user `d85f03e60b2742a59b2709f769dc9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:47.838657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ff1467c7-ad91-4806-9df9-c3c6a5145d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:47.882082 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2406/4737] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:47 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 21:22:47.883626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bdf5b-4b2f-47a3-8459-67f700b17c95 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:47.884064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bdf5b-4b2f-47a3-8459-67f700b17c95 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:47.884269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bdf5b-4b2f-47a3-8459-67f700b17c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:47.982156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-293bdf5b-4b2f-47a3-8459-67f700b17c95 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 16 21:22:47.982156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:22:47.982156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:22:47.982156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:22:47.982156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:22:47.982156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:22:47.982156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:22:47.982156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:22:47.982156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:22:47.982156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:22:47.982156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:22:47.982156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:22:47.982156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 16 21:22:47.982156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 16 21:22:47.982156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Jul 16 21:22:47.982156 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Jul 16 21:22:47.983350 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Jul 16 21:22:47.983350 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Jul 16 21:22:47.983350 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Jul 16 21:22:47.983350 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Jul 16 21:22:47.983350 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Jul 16 21:22:47.983350 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Jul 16 21:22:47.983350 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Jul 16 21:22:47.983350 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Jul 16 21:22:47.983350 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:22:47.983350 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:22:47.983350 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 16 21:22:47.983350 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 16 21:22:47.983350 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 16 21:22:47.983350 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 16 21:22:47.983350 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:22:47.983350 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:22:47.984746 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 16 21:22:47.984746 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 16 21:22:47.984746 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:22:47.984746 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:22:47.984746 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 16 21:22:47.984746 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 16 21:22:47.984746 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:22:47.984746 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:22:47.984746 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 16 21:22:47.984746 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 16 21:22:47.984746 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 16 21:22:47.984746 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:22:47.987931 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2332/4738] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:47 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 21:22:47.990251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9900ad-e092-4715-9e4a-e90cb4ce4987 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:47.990730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9900ad-e092-4715-9e4a-e90cb4ce4987 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:47.991206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9900ad-e092-4715-9e4a-e90cb4ce4987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:48.205800 ncdv-master-1 devstack@keystone.service[98196]: WARNING keystone.server.flask.application [None req-0f9900ad-e092-4715-9e4a-e90cb4ce4987 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 16 21:22:48.214854 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2407/4739] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:47 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 224 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 16 21:22:48.219563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee2224-fcfa-4ddd-b26d-f8f922b725ac None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:48.219989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee2224-fcfa-4ddd-b26d-f8f922b725ac None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:48.220574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee2224-fcfa-4ddd-b26d-f8f922b725ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:48.391804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e8ee2224-fcfa-4ddd-b26d-f8f922b725ac None None] MFA Rules not processed for user `d85f03e60b2742a59b2709f769dc9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:48.392988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e8ee2224-fcfa-4ddd-b26d-f8f922b725ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:48.413738 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2333/4740] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:48.418024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9900ad-e092-4715-9e4a-e90cb4ce4987 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:48.433286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9900ad-e092-4715-9e4a-e90cb4ce4987 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:48.439118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de008e-f720-4fb9-9778-01e3cf6aa6c7 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85f03e60b2742a59b2709f769dc9c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e446a13317d9461c8bce6ad9bd4c17ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:48.440096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de008e-f720-4fb9-9778-01e3cf6aa6c7 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:48.440818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de008e-f720-4fb9-9778-01e3cf6aa6c7 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:48.455242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de008e-f720-4fb9-9778-01e3cf6aa6c7 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] PATH_INFO: `/v3/users/d85f03e60b2742a59b2709f769dc9c6f/password` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:48.614089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-00de008e-f720-4fb9-9778-01e3cf6aa6c7 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd85f03e60b2742a59b2709f769dc9c6f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:48.638761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:48.694411 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2408/4741] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Jul 16 21:22:48 2022] POST /identity/v3/users/d85f03e60b2742a59b2709f769dc9c6f/password => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:48.889915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:49.700423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9cbeb-f726-41df-aa44-878e6af78478 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:49.701398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9cbeb-f726-41df-aa44-878e6af78478 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:49.702192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9cbeb-f726-41df-aa44-878e6af78478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:49.730980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de008e-f720-4fb9-9778-01e3cf6aa6c7 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:49.734980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-06e9cbeb-f726-41df-aa44-878e6af78478 None None] MFA Rules not processed for user `d85f03e60b2742a59b2709f769dc9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:49.743315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-06e9cbeb-f726-41df-aa44-878e6af78478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:49.747618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de008e-f720-4fb9-9778-01e3cf6aa6c7 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:49.748367 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2334/4742] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:49 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 21:22:49.753129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7fbf7-925f-434a-8172-d7b23049f307 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:49.753423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7fbf7-925f-434a-8172-d7b23049f307 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:49.753700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7fbf7-925f-434a-8172-d7b23049f307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:49.755356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a55cb-f93c-449d-aa6e-605b703668ef tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b3ba8594c420ea61c6f9756106bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c982566016f54b54bce1d2bbd0a75049', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:49.756246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a55cb-f93c-449d-aa6e-605b703668ef tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:49.756694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a55cb-f93c-449d-aa6e-605b703668ef tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:49.757132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a55cb-f93c-449d-aa6e-605b703668ef tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:49.758042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a55cb-f93c-449d-aa6e-605b703668ef tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:22:49.758513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a55cb-f93c-449d-aa6e-605b703668ef tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:49.760453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a55cb-f93c-449d-aa6e-605b703668ef tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:49.777260 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2409/4743] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:22:49.782243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a55cb-f93c-449d-aa6e-605b703668ef tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:49.802780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d5d7fbf7-925f-434a-8172-d7b23049f307 None None] MFA Rules not processed for user `d85f03e60b2742a59b2709f769dc9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:49.806435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a55cb-f93c-449d-aa6e-605b703668ef tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:49.808153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d5d7fbf7-925f-434a-8172-d7b23049f307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:49.819485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55764a2d-4459-45c5-a916-7a01ff330f71 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b3ba8594c420ea61c6f9756106bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c982566016f54b54bce1d2bbd0a75049', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:49.820421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55764a2d-4459-45c5-a916-7a01ff330f71 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:49.820853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55764a2d-4459-45c5-a916-7a01ff330f71 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:49.821319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55764a2d-4459-45c5-a916-7a01ff330f71 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:49.822483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55764a2d-4459-45c5-a916-7a01ff330f71 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:49.823933 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2335/4744] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:49.824672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7fbf7-925f-434a-8172-d7b23049f307 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:49.829755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55764a2d-4459-45c5-a916-7a01ff330f71 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:49.841114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7fbf7-925f-434a-8172-d7b23049f307 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:49.855268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351af243-3032-49a3-89c8-7e689e0b8358 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85f03e60b2742a59b2709f769dc9c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e446a13317d9461c8bce6ad9bd4c17ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:49.856287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af243-3032-49a3-89c8-7e689e0b8358 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:49.856414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af243-3032-49a3-89c8-7e689e0b8358 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:49.856614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af243-3032-49a3-89c8-7e689e0b8358 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] PATH_INFO: `/v3/users/d85f03e60b2742a59b2709f769dc9c6f/password` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:49.979467 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2410/4745] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:22:49 2022] POST /identity/v3/projects => generated 347 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:49.984462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55764a2d-4459-45c5-a916-7a01ff330f71 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:50.002941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-351af243-3032-49a3-89c8-7e689e0b8358 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd85f03e60b2742a59b2709f769dc9c6f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:50.057709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55764a2d-4459-45c5-a916-7a01ff330f71 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:50.063862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e9376-eed7-4d74-b876-c899fba3cdab tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b3ba8594c420ea61c6f9756106bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c982566016f54b54bce1d2bbd0a75049', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:50.064664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e9376-eed7-4d74-b876-c899fba3cdab tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:50.065082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e9376-eed7-4d74-b876-c899fba3cdab tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:50.065437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e9376-eed7-4d74-b876-c899fba3cdab tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:50.067040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e9376-eed7-4d74-b876-c899fba3cdab tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:22:50.067040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e9376-eed7-4d74-b876-c899fba3cdab tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:50.068951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e9376-eed7-4d74-b876-c899fba3cdab tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:50.084219 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2411/4746] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:22:50.136743 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2336/4747] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Jul 16 21:22:49 2022] POST /identity/v3/users/d85f03e60b2742a59b2709f769dc9c6f/password => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:50.932375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:51.067337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e9376-eed7-4d74-b876-c899fba3cdab tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:51.079469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e9376-eed7-4d74-b876-c899fba3cdab tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:51.085619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0680c94-e9b7-4030-93d2-7934c4b88405 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b3ba8594c420ea61c6f9756106bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c982566016f54b54bce1d2bbd0a75049', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:51.086489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0680c94-e9b7-4030-93d2-7934c4b88405 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:51.086773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0680c94-e9b7-4030-93d2-7934c4b88405 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:51.087071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0680c94-e9b7-4030-93d2-7934c4b88405 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] PATH_INFO: `/v3/projects/21fbdf7828624715ac43960a1467cdd5` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:51.088274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0680c94-e9b7-4030-93d2-7934c4b88405 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] RBAC: Authorizing `identity:delete_project(project_id=21fbdf7828624715ac43960a1467cdd5)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:51.090485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0680c94-e9b7-4030-93d2-7934c4b88405 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:51.142772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bce2e-b480-4599-adf8-a91e5d72fd08 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:51.144081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bce2e-b480-4599-adf8-a91e5d72fd08 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:51.144604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bce2e-b480-4599-adf8-a91e5d72fd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:51.144745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:51.164555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8d1bce2e-b480-4599-adf8-a91e5d72fd08 None None] MFA Rules not processed for user `d85f03e60b2742a59b2709f769dc9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:51.166411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8d1bce2e-b480-4599-adf8-a91e5d72fd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:51.173780 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2337/4748] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:51 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 16 21:22:51.175529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7200415-40e0-4d43-8847-1b5ddfd575b3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:51.178744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7200415-40e0-4d43-8847-1b5ddfd575b3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:51.178744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7200415-40e0-4d43-8847-1b5ddfd575b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:51.197416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a7200415-40e0-4d43-8847-1b5ddfd575b3 None None] MFA Rules not processed for user `d85f03e60b2742a59b2709f769dc9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:51.199060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a7200415-40e0-4d43-8847-1b5ddfd575b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:51.240783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d0680c94-e9b7-4030-93d2-7934c4b88405 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21fbdf7828624715ac43960a1467cdd5', 'request_id': 'req-d0680c94-e9b7-4030-93d2-7934c4b88405'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:51.258881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d0680c94-e9b7-4030-93d2-7934c4b88405 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21fbdf7828624715ac43960a1467cdd5', 'request_id': 'req-d0680c94-e9b7-4030-93d2-7934c4b88405'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:51.273119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d0680c94-e9b7-4030-93d2-7934c4b88405 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21fbdf7828624715ac43960a1467cdd5', 'request_id': 'req-d0680c94-e9b7-4030-93d2-7934c4b88405'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:51.285915 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2338/4749] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:51.287974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7200415-40e0-4d43-8847-1b5ddfd575b3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:51.299059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7200415-40e0-4d43-8847-1b5ddfd575b3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:51.345951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d0680c94-e9b7-4030-93d2-7934c4b88405 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] The token cache is being invalidate because project 21fbdf7828624715ac43960a1467cdd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:51.346707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d0680c94-e9b7-4030-93d2-7934c4b88405 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:51.347656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d0680c94-e9b7-4030-93d2-7934c4b88405 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:51.349752 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2412/4750] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:22:51 2022] DELETE /identity/v3/projects/21fbdf7828624715ac43960a1467cdd5 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:51.363666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0680c94-e9b7-4030-93d2-7934c4b88405 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:51.365283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d0680c94-e9b7-4030-93d2-7934c4b88405 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:51.372364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec94d8-c1da-4ed2-8b4a-df5e8e38a858 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85f03e60b2742a59b2709f769dc9c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e446a13317d9461c8bce6ad9bd4c17ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:51.373529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec94d8-c1da-4ed2-8b4a-df5e8e38a858 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:51.375188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec94d8-c1da-4ed2-8b4a-df5e8e38a858 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:51.375349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec94d8-c1da-4ed2-8b4a-df5e8e38a858 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] PATH_INFO: `/v3/users/d85f03e60b2742a59b2709f769dc9c6f/password` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:51.462971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0680c94-e9b7-4030-93d2-7934c4b88405 tempest-RoutersAdminTest-1724180092 tempest-RoutersAdminTest-1724180092-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:51.469070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0382cf-6e9f-4bd6-9845-57c12a7e45ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:51.470110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0382cf-6e9f-4bd6-9845-57c12a7e45ee service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:51.471247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0382cf-6e9f-4bd6-9845-57c12a7e45ee service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:51.472226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0382cf-6e9f-4bd6-9845-57c12a7e45ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:51.474224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ff0382cf-6e9f-4bd6-9845-57c12a7e45ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:51.545619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-91ec94d8-c1da-4ed2-8b4a-df5e8e38a858 tempest-IdentityV3UsersTest-1812787407 tempest-IdentityV3UsersTest-1812787407-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd85f03e60b2742a59b2709f769dc9c6f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:51.550287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0382cf-6e9f-4bd6-9845-57c12a7e45ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:51.550287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0382cf-6e9f-4bd6-9845-57c12a7e45ee service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:51.563216 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2413/4751] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:22:51 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:22:51.688686 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2339/4752] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Jul 16 21:22:51 2022] POST /identity/v3/users/d85f03e60b2742a59b2709f769dc9c6f/password => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:52.385714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:52.551461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:52.694256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1d254-9563-459a-9cb5-1db34076bbb6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:52.694869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1d254-9563-459a-9cb5-1db34076bbb6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:52.695406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1d254-9563-459a-9cb5-1db34076bbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:52.715228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-adc1d254-9563-459a-9cb5-1db34076bbb6 None None] MFA Rules not processed for user `d85f03e60b2742a59b2709f769dc9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:52.716450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-adc1d254-9563-459a-9cb5-1db34076bbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:52.720659 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2414/4753] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:52 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 21:22:53.066346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:53.465230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:53.726192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba4183-8558-49a8-b666-b855763aecfb None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:53.726865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba4183-8558-49a8-b666-b855763aecfb None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:53.726865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba4183-8558-49a8-b666-b855763aecfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:53.768945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3bba4183-8558-49a8-b666-b855763aecfb None None] MFA Rules not processed for user `d85f03e60b2742a59b2709f769dc9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:53.772530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3bba4183-8558-49a8-b666-b855763aecfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:53.792337 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2340/4754] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:53.798021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1d254-9563-459a-9cb5-1db34076bbb6 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:53.799862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-adc1d254-9563-459a-9cb5-1db34076bbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:53.930105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:53.932022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1d254-9563-459a-9cb5-1db34076bbb6 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:53.941647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a90fd9-df38-494d-ad7c-efc411063277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:53.943774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a90fd9-df38-494d-ad7c-efc411063277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:53.944289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a90fd9-df38-494d-ad7c-efc411063277 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:53.946383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a90fd9-df38-494d-ad7c-efc411063277 admin admin] PATH_INFO: `/v3/users/d85f03e60b2742a59b2709f769dc9c6f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:53.949778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a90fd9-df38-494d-ad7c-efc411063277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d85f03e60b2742a59b2709f769dc9c6f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:53.953587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a90fd9-df38-494d-ad7c-efc411063277 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:54.286213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-07a90fd9-df38-494d-ad7c-efc411063277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd85f03e60b2742a59b2709f769dc9c6f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:54.296831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:54.300089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-07a90fd9-df38-494d-ad7c-efc411063277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd85f03e60b2742a59b2709f769dc9c6f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:54.442390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-07a90fd9-df38-494d-ad7c-efc411063277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd85f03e60b2742a59b2709f769dc9c6f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:54.444164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-07a90fd9-df38-494d-ad7c-efc411063277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd85f03e60b2742a59b2709f769dc9c6f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:54.492751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-07a90fd9-df38-494d-ad7c-efc411063277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd85f03e60b2742a59b2709f769dc9c6f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:54.507401 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2415/4755] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:22:53 2022] DELETE /identity/v3/users/d85f03e60b2742a59b2709f769dc9c6f => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:54.511593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d5d19-d8b8-434a-88c7-c22c391b3e98 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:54.512221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d5d19-d8b8-434a-88c7-c22c391b3e98 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:54.512734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d5d19-d8b8-434a-88c7-c22c391b3e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:54.534386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-fb5d5d19-d8b8-434a-88c7-c22c391b3e98 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:54.536168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fb5d5d19-d8b8-434a-88c7-c22c391b3e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:54.618030 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2341/4756] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:54.642063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a90fd9-df38-494d-ad7c-efc411063277 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:54.643851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-07a90fd9-df38-494d-ad7c-efc411063277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:54.789133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a90fd9-df38-494d-ad7c-efc411063277 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:54.805239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b67e9f-aca2-4b9a-bd58-16d886e57f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:54.805930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b67e9f-aca2-4b9a-bd58-16d886e57f79 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:54.806790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b67e9f-aca2-4b9a-bd58-16d886e57f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:54.806790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b67e9f-aca2-4b9a-bd58-16d886e57f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:54.840407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b67e9f-aca2-4b9a-bd58-16d886e57f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:54.842583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b67e9f-aca2-4b9a-bd58-16d886e57f79 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:54.876791 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2416/4757] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:22:54.939111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:55.002963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f429f01-2124-476b-bcff-0e9ed367207a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:55.003829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f429f01-2124-476b-bcff-0e9ed367207a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:55.004291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f429f01-2124-476b-bcff-0e9ed367207a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:55.025180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0f429f01-2124-476b-bcff-0e9ed367207a None None] MFA Rules not processed for user `6f2e974ab5aa48dfb4b00f810dcedb63`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:55.026713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0f429f01-2124-476b-bcff-0e9ed367207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:55.099577 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2342/4758] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:55.493692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:56.025034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:56.175907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b67e9f-aca2-4b9a-bd58-16d886e57f79 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:56.177784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d9b67e9f-aca2-4b9a-bd58-16d886e57f79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:56.201295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b67e9f-aca2-4b9a-bd58-16d886e57f79 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:56.208246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5e33e-e88f-4368-9b82-b18b7da3feff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:56.209646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5e33e-e88f-4368-9b82-b18b7da3feff admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:56.210707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5e33e-e88f-4368-9b82-b18b7da3feff admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:56.213871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5e33e-e88f-4368-9b82-b18b7da3feff admin admin] PATH_INFO: `/v3/projects/e446a13317d9461c8bce6ad9bd4c17ea` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:56.217217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5e33e-e88f-4368-9b82-b18b7da3feff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e446a13317d9461c8bce6ad9bd4c17ea)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:56.220016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5e33e-e88f-4368-9b82-b18b7da3feff admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:56.366662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5da5e33e-e88f-4368-9b82-b18b7da3feff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e446a13317d9461c8bce6ad9bd4c17ea', 'request_id': 'req-5da5e33e-e88f-4368-9b82-b18b7da3feff'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:56.375444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5da5e33e-e88f-4368-9b82-b18b7da3feff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e446a13317d9461c8bce6ad9bd4c17ea', 'request_id': 'req-5da5e33e-e88f-4368-9b82-b18b7da3feff'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:56.385629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5da5e33e-e88f-4368-9b82-b18b7da3feff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e446a13317d9461c8bce6ad9bd4c17ea', 'request_id': 'req-5da5e33e-e88f-4368-9b82-b18b7da3feff'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:56.471220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:56.523970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5da5e33e-e88f-4368-9b82-b18b7da3feff admin admin] The token cache is being invalidate because project e446a13317d9461c8bce6ad9bd4c17ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:22:56.524263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5da5e33e-e88f-4368-9b82-b18b7da3feff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:56.525344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5da5e33e-e88f-4368-9b82-b18b7da3feff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:22:56.527593 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2417/4759] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:22:56 2022] DELETE /identity/v3/projects/e446a13317d9461c8bce6ad9bd4c17ea => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:56.534922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857098a4-bc2c-49fa-aebb-3a57ca2f4558 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:56.535238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857098a4-bc2c-49fa-aebb-3a57ca2f4558 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:56.535518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857098a4-bc2c-49fa-aebb-3a57ca2f4558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:56.557784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-857098a4-bc2c-49fa-aebb-3a57ca2f4558 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:56.559046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-857098a4-bc2c-49fa-aebb-3a57ca2f4558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:56.628172 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2343/4760] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:56.635821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced8e75-f52d-4798-9dda-87f0884c47a4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:56.636113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced8e75-f52d-4798-9dda-87f0884c47a4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:56.636418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced8e75-f52d-4798-9dda-87f0884c47a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:56.657656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-cced8e75-f52d-4798-9dda-87f0884c47a4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:56.659436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cced8e75-f52d-4798-9dda-87f0884c47a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:56.671669 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2418/4761] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:56.672875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857098a4-bc2c-49fa-aebb-3a57ca2f4558 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:56.687166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857098a4-bc2c-49fa-aebb-3a57ca2f4558 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:56.699682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb405a-9462-4359-a37a-d819b7f5689d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:56.700752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb405a-9462-4359-a37a-d819b7f5689d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:56.701038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb405a-9462-4359-a37a-d819b7f5689d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:56.701315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb405a-9462-4359-a37a-d819b7f5689d admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:56.702912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb405a-9462-4359-a37a-d819b7f5689d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:22:56.703447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb405a-9462-4359-a37a-d819b7f5689d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:56.705074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb405a-9462-4359-a37a-d819b7f5689d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:56.718333 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2344/4762] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:22:56.725092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced8e75-f52d-4798-9dda-87f0884c47a4 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:56.748094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced8e75-f52d-4798-9dda-87f0884c47a4 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:56.763959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde746a3-e332-494c-822e-0e8174fcaa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:56.765529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde746a3-e332-494c-822e-0e8174fcaa25 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:56.772791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde746a3-e332-494c-822e-0e8174fcaa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:56.772791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde746a3-e332-494c-822e-0e8174fcaa25 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:56.772791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde746a3-e332-494c-822e-0e8174fcaa25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:56.773772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde746a3-e332-494c-822e-0e8174fcaa25 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:56.919321 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2419/4763] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:22:56 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:56.922331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb405a-9462-4359-a37a-d819b7f5689d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:56.933589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb405a-9462-4359-a37a-d819b7f5689d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:57.004268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f49b9-7366-4d89-9439-8f1c6a0b934a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:57.004824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f49b9-7366-4d89-9439-8f1c6a0b934a admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:57.005306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f49b9-7366-4d89-9439-8f1c6a0b934a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:57.005568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f49b9-7366-4d89-9439-8f1c6a0b934a admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:57.006519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f49b9-7366-4d89-9439-8f1c6a0b934a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:57.008279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f49b9-7366-4d89-9439-8f1c6a0b934a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:57.151147 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2345/4764] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:22:56 2022] POST /identity/v3/users => generated 292 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:22:57.158196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde746a3-e332-494c-822e-0e8174fcaa25 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:57.175680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde746a3-e332-494c-822e-0e8174fcaa25 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:57.184540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c755e-dfcf-4da9-a249-1b63c6cf54de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:57.185472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c755e-dfcf-4da9-a249-1b63c6cf54de admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:57.185819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c755e-dfcf-4da9-a249-1b63c6cf54de admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:57.186955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c755e-dfcf-4da9-a249-1b63c6cf54de admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:57.188902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c755e-dfcf-4da9-a249-1b63c6cf54de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:57.190899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c755e-dfcf-4da9-a249-1b63c6cf54de admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:57.207913 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2420/4765] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:57.209211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f49b9-7366-4d89-9439-8f1c6a0b934a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:57.223627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f49b9-7366-4d89-9439-8f1c6a0b934a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:57.238649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad82832-b48e-4cb4-a462-4f9bf567241b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:57.240156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad82832-b48e-4cb4-a462-4f9bf567241b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:57.240156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad82832-b48e-4cb4-a462-4f9bf567241b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:57.240451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad82832-b48e-4cb4-a462-4f9bf567241b admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:57.241304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad82832-b48e-4cb4-a462-4f9bf567241b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:57.243849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad82832-b48e-4cb4-a462-4f9bf567241b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:57.265426 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2346/4766] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:57.266680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c755e-dfcf-4da9-a249-1b63c6cf54de admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:57.281732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c755e-dfcf-4da9-a249-1b63c6cf54de admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:57.289151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a66eef-4773-47e5-be7d-f08a28186430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:57.290417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a66eef-4773-47e5-be7d-f08a28186430 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:57.291852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a66eef-4773-47e5-be7d-f08a28186430 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:57.292573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a66eef-4773-47e5-be7d-f08a28186430 admin admin] PATH_INFO: `/v3/projects/b3a695a829b140e1a9397134e0290cc1/users/ed417bacc78b4d5db0e10cd719fd47e3/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:57.299485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:57.314113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a66eef-4773-47e5-be7d-f08a28186430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a695a829b140e1a9397134e0290cc1, user_id=ed417bacc78b4d5db0e10cd719fd47e3, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:57.317854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a66eef-4773-47e5-be7d-f08a28186430 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:57.443658 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2421/4767] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:57 2022] PUT /identity/v3/projects/b3a695a829b140e1a9397134e0290cc1/users/ed417bacc78b4d5db0e10cd719fd47e3/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:57.455310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf988c8-eaf8-41a7-95a2-52ee4e326be8 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:57.457686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf988c8-eaf8-41a7-95a2-52ee4e326be8 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:57.457686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf988c8-eaf8-41a7-95a2-52ee4e326be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:57.487549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3cf988c8-eaf8-41a7-95a2-52ee4e326be8 None None] MFA Rules not processed for user `ed417bacc78b4d5db0e10cd719fd47e3`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:57.489718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3cf988c8-eaf8-41a7-95a2-52ee4e326be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:57.594427 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2347/4768] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:57.598633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a66eef-4773-47e5-be7d-f08a28186430 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:57.699141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a66eef-4773-47e5-be7d-f08a28186430 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:57.707955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c5dd6-28fe-4403-93b4-91f688a659e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:57.708986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c5dd6-28fe-4403-93b4-91f688a659e9 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:57.709271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c5dd6-28fe-4403-93b4-91f688a659e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:57.709549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c5dd6-28fe-4403-93b4-91f688a659e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:57.710263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c5dd6-28fe-4403-93b4-91f688a659e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:57.712268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c5dd6-28fe-4403-93b4-91f688a659e9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:57.801985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:57.844233 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2422/4769] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:22:57 2022] POST /identity/v3/projects => generated 383 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:57.853542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf988c8-eaf8-41a7-95a2-52ee4e326be8 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:57.892351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf988c8-eaf8-41a7-95a2-52ee4e326be8 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:57.978990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4482e6d-4841-4af2-a420-0ca03ca9413d None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:57.978990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4482e6d-4841-4af2-a420-0ca03ca9413d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:57.978990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4482e6d-4841-4af2-a420-0ca03ca9413d None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:57.985634 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2423/4770] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:22:57 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 21:22:57.993837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c00c1a-aead-48fa-a4fb-f5eca8598849 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:57.993837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c00c1a-aead-48fa-a4fb-f5eca8598849 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:57.993837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c00c1a-aead-48fa-a4fb-f5eca8598849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:57.996248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca7e6f-dad8-4a4a-8701-5e96e918c30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:57.997014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca7e6f-dad8-4a4a-8701-5e96e918c30c admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:57.997373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca7e6f-dad8-4a4a-8701-5e96e918c30c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:57.997728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca7e6f-dad8-4a4a-8701-5e96e918c30c admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:57.998616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca7e6f-dad8-4a4a-8701-5e96e918c30c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:58.001459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca7e6f-dad8-4a4a-8701-5e96e918c30c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:58.034910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-89c00c1a-aead-48fa-a4fb-f5eca8598849 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:58.036698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-89c00c1a-aead-48fa-a4fb-f5eca8598849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:58.120872 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2424/4771] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:22:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:22:58.139123 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2348/4772] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:22:57 2022] POST /identity/v3/users => generated 292 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:22:58.141359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c00c1a-aead-48fa-a4fb-f5eca8598849 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:58.146475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca7e6f-dad8-4a4a-8701-5e96e918c30c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:58.149845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c1ca7e6f-dad8-4a4a-8701-5e96e918c30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:58.157340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c00c1a-aead-48fa-a4fb-f5eca8598849 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:58.162749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c35f9-6639-4c59-ada1-637317d539d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:58.163438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c35f9-6639-4c59-ada1-637317d539d2 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:58.163941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c35f9-6639-4c59-ada1-637317d539d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:58.164062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c35f9-6639-4c59-ada1-637317d539d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:58.164696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c35f9-6639-4c59-ada1-637317d539d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:58.166371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c35f9-6639-4c59-ada1-637317d539d2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:58.173761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca7e6f-dad8-4a4a-8701-5e96e918c30c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:58.178272 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2425/4773] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:58.180640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5920c9-aeb5-4f3b-a0bf-656ddbfe9278 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:58.181418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5920c9-aeb5-4f3b-a0bf-656ddbfe9278 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:58.181712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5920c9-aeb5-4f3b-a0bf-656ddbfe9278 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:58.181989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5920c9-aeb5-4f3b-a0bf-656ddbfe9278 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:58.182124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c35f9-6639-4c59-ada1-637317d539d2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:58.192553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5920c9-aeb5-4f3b-a0bf-656ddbfe9278 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:58.200980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5920c9-aeb5-4f3b-a0bf-656ddbfe9278 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:58.201171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c35f9-6639-4c59-ada1-637317d539d2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:58.204578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1843d-e3c8-4568-8fce-4ee8c0208f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:58.205584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1843d-e3c8-4568-8fce-4ee8c0208f1d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:58.206084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1843d-e3c8-4568-8fce-4ee8c0208f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:58.206617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1843d-e3c8-4568-8fce-4ee8c0208f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:58.207603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1843d-e3c8-4568-8fce-4ee8c0208f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:58.207738 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2349/4774] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:22:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:22:58.209748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1843d-e3c8-4568-8fce-4ee8c0208f1d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:58.223561 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2426/4775] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:58.230105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5920c9-aeb5-4f3b-a0bf-656ddbfe9278 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:58.246370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5920c9-aeb5-4f3b-a0bf-656ddbfe9278 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:58.251984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec6e07-5401-47a6-b788-be0826ef3dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:58.252886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec6e07-5401-47a6-b788-be0826ef3dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:58.253166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec6e07-5401-47a6-b788-be0826ef3dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:58.253438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec6e07-5401-47a6-b788-be0826ef3dbe admin admin] PATH_INFO: `/v3/projects/e695602b15db4b80adea6ff7af2dd3ac/users/ec0c0e321f464cdfa0e3d9f2136a99d3/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:58.271565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec6e07-5401-47a6-b788-be0826ef3dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e695602b15db4b80adea6ff7af2dd3ac, user_id=ec0c0e321f464cdfa0e3d9f2136a99d3, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:58.276050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec6e07-5401-47a6-b788-be0826ef3dbe admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:58.393542 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2350/4776] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:58 2022] PUT /identity/v3/projects/e695602b15db4b80adea6ff7af2dd3ac/users/ec0c0e321f464cdfa0e3d9f2136a99d3/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:58.405210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bd45b-2939-4b5c-8efa-d518327d948e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:58.406542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bd45b-2939-4b5c-8efa-d518327d948e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:58.406831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bd45b-2939-4b5c-8efa-d518327d948e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:58.441241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-cd1bd45b-2939-4b5c-8efa-d518327d948e None None] MFA Rules not processed for user `ec0c0e321f464cdfa0e3d9f2136a99d3`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:58.442556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cd1bd45b-2939-4b5c-8efa-d518327d948e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:58.524221 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2427/4777] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:58.528902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec6e07-5401-47a6-b788-be0826ef3dbe admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:58.533331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:58.598861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec6e07-5401-47a6-b788-be0826ef3dbe admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:58.604473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0331877-e135-4df8-8a69-e35445c300f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:58.605211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0331877-e135-4df8-8a69-e35445c300f7 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:58.605497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0331877-e135-4df8-8a69-e35445c300f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:58.605776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0331877-e135-4df8-8a69-e35445c300f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:58.606477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0331877-e135-4df8-8a69-e35445c300f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:58.609616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0331877-e135-4df8-8a69-e35445c300f7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:58.744826 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2351/4778] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:22:58 2022] POST /identity/v3/projects => generated 383 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:22:58.746154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1bd45b-2939-4b5c-8efa-d518327d948e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:58.758639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1bd45b-2939-4b5c-8efa-d518327d948e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:58.818845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4e271-8a3a-4d5a-9c5b-5df840104293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:58.819636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4e271-8a3a-4d5a-9c5b-5df840104293 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:58.819923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4e271-8a3a-4d5a-9c5b-5df840104293 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:58.821934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4e271-8a3a-4d5a-9c5b-5df840104293 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:58.821934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4e271-8a3a-4d5a-9c5b-5df840104293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:58.822992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4e271-8a3a-4d5a-9c5b-5df840104293 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:58.912331 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2428/4779] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:22:58 2022] POST /identity/v3/users => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:22:58.916335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0331877-e135-4df8-8a69-e35445c300f7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:58.955049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0331877-e135-4df8-8a69-e35445c300f7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:58.965807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1a4fb-2fac-4f49-bbdb-f756adbabf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:58.970774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1a4fb-2fac-4f49-bbdb-f756adbabf42 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:58.970774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1a4fb-2fac-4f49-bbdb-f756adbabf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:58.970774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1a4fb-2fac-4f49-bbdb-f756adbabf42 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:58.970774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1a4fb-2fac-4f49-bbdb-f756adbabf42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:58.971916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1a4fb-2fac-4f49-bbdb-f756adbabf42 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:58.993096 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2352/4780] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:22:58.993189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4e271-8a3a-4d5a-9c5b-5df840104293 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:59.011303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb80d3-dcc8-49f1-8b94-9583aa056dfb None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:59.011597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb80d3-dcc8-49f1-8b94-9583aa056dfb None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:59.011877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb80d3-dcc8-49f1-8b94-9583aa056dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:59.012226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4e271-8a3a-4d5a-9c5b-5df840104293 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:59.018017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c2fb7-d42b-42ae-98ae-cf0a5dd84e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:59.018912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c2fb7-d42b-42ae-98ae-cf0a5dd84e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:59.019338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c2fb7-d42b-42ae-98ae-cf0a5dd84e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:59.019525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c2fb7-d42b-42ae-98ae-cf0a5dd84e7f admin admin] PATH_INFO: `/v3/projects/ace5615ae179446691f1a8bb8e6c4341/users/11205317c070496499da3741e1659d51/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:59.038944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c2fb7-d42b-42ae-98ae-cf0a5dd84e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace5615ae179446691f1a8bb8e6c4341, user_id=11205317c070496499da3741e1659d51, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:59.041861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c2fb7-d42b-42ae-98ae-cf0a5dd84e7f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:59.044854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-eceb80d3-dcc8-49f1-8b94-9583aa056dfb None None] MFA Rules not processed for user `6f2e974ab5aa48dfb4b00f810dcedb63`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:59.047886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-eceb80d3-dcc8-49f1-8b94-9583aa056dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:59.118966 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2353/4781] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:22:59.131812 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2429/4782] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:58 2022] PUT /identity/v3/projects/ace5615ae179446691f1a8bb8e6c4341/users/11205317c070496499da3741e1659d51/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:22:59.135842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb80d3-dcc8-49f1-8b94-9583aa056dfb None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:59.148602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb80d3-dcc8-49f1-8b94-9583aa056dfb None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:59.167836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:22:59.214825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0febe-95ae-42a3-b4a2-4a42be0bd525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:59.215871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0febe-95ae-42a3-b4a2-4a42be0bd525 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:59.216160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0febe-95ae-42a3-b4a2-4a42be0bd525 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:59.216428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0febe-95ae-42a3-b4a2-4a42be0bd525 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:59.217991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0febe-95ae-42a3-b4a2-4a42be0bd525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:59.219791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0febe-95ae-42a3-b4a2-4a42be0bd525 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:59.230559 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2354/4783] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:22:59.235652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c2fb7-d42b-42ae-98ae-cf0a5dd84e7f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:59.251219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c2fb7-d42b-42ae-98ae-cf0a5dd84e7f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:59.256765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2265654-fe63-4bf6-a23d-d963f13c1b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:59.257823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2265654-fe63-4bf6-a23d-d963f13c1b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:59.258054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2265654-fe63-4bf6-a23d-d963f13c1b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:59.258328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2265654-fe63-4bf6-a23d-d963f13c1b96 admin admin] PATH_INFO: `/v3/projects/ace5615ae179446691f1a8bb8e6c4341/users/11205317c070496499da3741e1659d51/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:59.260456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2265654-fe63-4bf6-a23d-d963f13c1b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace5615ae179446691f1a8bb8e6c4341, user_id=11205317c070496499da3741e1659d51, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:59.263205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2265654-fe63-4bf6-a23d-d963f13c1b96 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:59.275202 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2430/4784] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:22:59 2022] PUT /identity/v3/projects/ace5615ae179446691f1a8bb8e6c4341/users/11205317c070496499da3741e1659d51/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:22:59.286675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67392a0-760c-4c1b-8c99-8b1ef7477d0f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:59.286971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67392a0-760c-4c1b-8c99-8b1ef7477d0f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:59.287320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67392a0-760c-4c1b-8c99-8b1ef7477d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:59.317095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b67392a0-760c-4c1b-8c99-8b1ef7477d0f None None] MFA Rules not processed for user `11205317c070496499da3741e1659d51`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:22:59.318343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b67392a0-760c-4c1b-8c99-8b1ef7477d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:59.418414 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2355/4785] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:22:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:22:59.432300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2265654-fe63-4bf6-a23d-d963f13c1b96 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:22:59.435144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a2265654-fe63-4bf6-a23d-d963f13c1b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:22:59.505669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2265654-fe63-4bf6-a23d-d963f13c1b96 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:22:59.509736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229dc044-6581-4e92-ba3c-7aebca39196a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:22:59.510338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dc044-6581-4e92-ba3c-7aebca39196a service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:22:59.510615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dc044-6581-4e92-ba3c-7aebca39196a service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:22:59.510890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dc044-6581-4e92-ba3c-7aebca39196a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:22:59.574133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229dc044-6581-4e92-ba3c-7aebca39196a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:22:59.575919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229dc044-6581-4e92-ba3c-7aebca39196a service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:22:59.588884 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2431/4786] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:22:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:23:00.001169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:01.111812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:01.229338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:02.887977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:03.270659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:05.226644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=1,keystone:SELECT=96,keystone:DELETE=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:05.756047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:07.778703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:08.439624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:10.630292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:11.527508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:13.496526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67392a0-760c-4c1b-8c99-8b1ef7477d0f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:13.501111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b67392a0-760c-4c1b-8c99-8b1ef7477d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:13.522390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67392a0-760c-4c1b-8c99-8b1ef7477d0f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:13.523968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a85ac-b7f8-4128-8a22-9cbd8f86f24b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:13.530450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a85ac-b7f8-4128-8a22-9cbd8f86f24b service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:13.531163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a85ac-b7f8-4128-8a22-9cbd8f86f24b service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:13.533018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a85ac-b7f8-4128-8a22-9cbd8f86f24b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:13.545254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0a0a85ac-b7f8-4128-8a22-9cbd8f86f24b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:13.642983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a85ac-b7f8-4128-8a22-9cbd8f86f24b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:13.644672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a85ac-b7f8-4128-8a22-9cbd8f86f24b service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:13.647391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=4,keystone:SELECT=95,keystone:DELETE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:13.662168 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2356/4787] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:23:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:23:14.252445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ad34d-c6ea-4e16-86dd-07add19bdb98 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:14.255568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ad34d-c6ea-4e16-86dd-07add19bdb98 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:14.255568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ad34d-c6ea-4e16-86dd-07add19bdb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:14.272802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c42ad34d-c6ea-4e16-86dd-07add19bdb98 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:23:14.275141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c42ad34d-c6ea-4e16-86dd-07add19bdb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:14.372431 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2432/4788] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:23:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:23:14.422209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a85ac-b7f8-4128-8a22-9cbd8f86f24b service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:14.423980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0a0a85ac-b7f8-4128-8a22-9cbd8f86f24b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:14.535477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a85ac-b7f8-4128-8a22-9cbd8f86f24b service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:14.544394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb088a7d-0974-47bb-9b67-3f609634a706 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:14.546139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb088a7d-0974-47bb-9b67-3f609634a706 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:14.546721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb088a7d-0974-47bb-9b67-3f609634a706 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:14.549726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb088a7d-0974-47bb-9b67-3f609634a706 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:14.563424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb088a7d-0974-47bb-9b67-3f609634a706 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:14.568713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb088a7d-0974-47bb-9b67-3f609634a706 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:14.581722 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2357/4789] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:23:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:23:15.275286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:15.283407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ad34d-c6ea-4e16-86dd-07add19bdb98 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:15.313074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ad34d-c6ea-4e16-86dd-07add19bdb98 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:15.318078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec1ea4-b31d-441c-8edc-6c2a148cae49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:15.318930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec1ea4-b31d-441c-8edc-6c2a148cae49 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:15.319501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec1ea4-b31d-441c-8edc-6c2a148cae49 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:15.320057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec1ea4-b31d-441c-8edc-6c2a148cae49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:15.337065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec1ea4-b31d-441c-8edc-6c2a148cae49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:15.338869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec1ea4-b31d-441c-8edc-6c2a148cae49 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:15.356010 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2433/4790] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:23:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:23:15.952211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb088a7d-0974-47bb-9b67-3f609634a706 service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:15.971929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb088a7d-0974-47bb-9b67-3f609634a706 service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:15.979174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab04aed-54f4-40c4-a36c-750cbac84ba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:15.979837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab04aed-54f4-40c4-a36c-750cbac84ba9 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:15.980292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab04aed-54f4-40c4-a36c-750cbac84ba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:15.980733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab04aed-54f4-40c4-a36c-750cbac84ba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:15.984479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-aab04aed-54f4-40c4-a36c-750cbac84ba9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:16.005122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab04aed-54f4-40c4-a36c-750cbac84ba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:16.012795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab04aed-54f4-40c4-a36c-750cbac84ba9 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:16.028466 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2358/4791] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:23:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:23:16.109589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:16.329862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec1ea4-b31d-441c-8edc-6c2a148cae49 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:16.331701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c0ec1ea4-b31d-441c-8edc-6c2a148cae49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:16.361567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec1ea4-b31d-441c-8edc-6c2a148cae49 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:16.374554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac31e3-4f30-4a33-86e9-4c2479c529bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:16.376738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac31e3-4f30-4a33-86e9-4c2479c529bd service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:16.378063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac31e3-4f30-4a33-86e9-4c2479c529bd service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:16.380374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac31e3-4f30-4a33-86e9-4c2479c529bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:16.384489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-14ac31e3-4f30-4a33-86e9-4c2479c529bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:16.552736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac31e3-4f30-4a33-86e9-4c2479c529bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:16.576969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac31e3-4f30-4a33-86e9-4c2479c529bd service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:16.583526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab04aed-54f4-40c4-a36c-750cbac84ba9 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:16.584966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-aab04aed-54f4-40c4-a36c-750cbac84ba9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:16.642281 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2434/4792] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:23:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:23:16.713418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab04aed-54f4-40c4-a36c-750cbac84ba9 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:16.725313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275c6a5-dcb2-44a9-928d-3a90a8489fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:16.726218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275c6a5-dcb2-44a9-928d-3a90a8489fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:16.726555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275c6a5-dcb2-44a9-928d-3a90a8489fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:16.726834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275c6a5-dcb2-44a9-928d-3a90a8489fcb admin admin] PATH_INFO: `/v3/users/aaf2292818b749f0ae43c66bca929be9` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:16.730355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275c6a5-dcb2-44a9-928d-3a90a8489fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaf2292818b749f0ae43c66bca929be9)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:16.735321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275c6a5-dcb2-44a9-928d-3a90a8489fcb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:17.024037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5275c6a5-dcb2-44a9-928d-3a90a8489fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaf2292818b749f0ae43c66bca929be9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:17.089797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5275c6a5-dcb2-44a9-928d-3a90a8489fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaf2292818b749f0ae43c66bca929be9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:17.201782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5275c6a5-dcb2-44a9-928d-3a90a8489fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaf2292818b749f0ae43c66bca929be9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:17.211736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5275c6a5-dcb2-44a9-928d-3a90a8489fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaf2292818b749f0ae43c66bca929be9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:17.212699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5275c6a5-dcb2-44a9-928d-3a90a8489fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaf2292818b749f0ae43c66bca929be9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:17.223037 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2359/4793] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:23:16 2022] DELETE /identity/v3/users/aaf2292818b749f0ae43c66bca929be9 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:23:17.469891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:17.556280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:18.214405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac31e3-4f30-4a33-86e9-4c2479c529bd service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:18.229858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac31e3-4f30-4a33-86e9-4c2479c529bd service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:18.298056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc796b08-696e-466a-a6c6-1d2509a92031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:18.298865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc796b08-696e-466a-a6c6-1d2509a92031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:18.299180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc796b08-696e-466a-a6c6-1d2509a92031 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:18.299458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc796b08-696e-466a-a6c6-1d2509a92031 admin admin] PATH_INFO: `/v3/projects/65644a8df5d84df3b35c894560e0a5c4` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:18.300664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc796b08-696e-466a-a6c6-1d2509a92031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65644a8df5d84df3b35c894560e0a5c4)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:18.302618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc796b08-696e-466a-a6c6-1d2509a92031 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:18.370420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:18.415312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bc796b08-696e-466a-a6c6-1d2509a92031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65644a8df5d84df3b35c894560e0a5c4', 'request_id': 'req-bc796b08-696e-466a-a6c6-1d2509a92031'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:18.431452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bc796b08-696e-466a-a6c6-1d2509a92031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65644a8df5d84df3b35c894560e0a5c4', 'request_id': 'req-bc796b08-696e-466a-a6c6-1d2509a92031'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:18.432080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bc796b08-696e-466a-a6c6-1d2509a92031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65644a8df5d84df3b35c894560e0a5c4', 'request_id': 'req-bc796b08-696e-466a-a6c6-1d2509a92031'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:18.585953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bc796b08-696e-466a-a6c6-1d2509a92031 admin admin] The token cache is being invalidate because project 65644a8df5d84df3b35c894560e0a5c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:23:18.586553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bc796b08-696e-466a-a6c6-1d2509a92031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:18.586972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bc796b08-696e-466a-a6c6-1d2509a92031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:18.588720 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2435/4794] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:23:18 2022] DELETE /identity/v3/projects/65644a8df5d84df3b35c894560e0a5c4 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:23:18.594213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accdabe-7af2-4d9b-a69c-ffe06054e703 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:18.594749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accdabe-7af2-4d9b-a69c-ffe06054e703 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:18.595215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accdabe-7af2-4d9b-a69c-ffe06054e703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:18.616866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1accdabe-7af2-4d9b-a69c-ffe06054e703 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:23:18.618232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1accdabe-7af2-4d9b-a69c-ffe06054e703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:18.703916 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2360/4795] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:23:18.711845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320668f2-3304-4294-9727-7164a2e1e2e7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:18.712133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320668f2-3304-4294-9727-7164a2e1e2e7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:18.712410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320668f2-3304-4294-9727-7164a2e1e2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:18.733450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-320668f2-3304-4294-9727-7164a2e1e2e7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:23:18.735440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-320668f2-3304-4294-9727-7164a2e1e2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:18.749688 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2436/4796] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:23:18.750818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accdabe-7af2-4d9b-a69c-ffe06054e703 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:18.761456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accdabe-7af2-4d9b-a69c-ffe06054e703 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:18.768187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf0dcd-2746-4fdd-b38f-18859b0f4206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:18.769605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf0dcd-2746-4fdd-b38f-18859b0f4206 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:18.770092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf0dcd-2746-4fdd-b38f-18859b0f4206 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:18.770821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf0dcd-2746-4fdd-b38f-18859b0f4206 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:18.774580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf0dcd-2746-4fdd-b38f-18859b0f4206 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:23:18.774580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf0dcd-2746-4fdd-b38f-18859b0f4206 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:18.774580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf0dcd-2746-4fdd-b38f-18859b0f4206 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:18.792523 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2361/4797] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:23:18.794106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320668f2-3304-4294-9727-7164a2e1e2e7 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:18.804443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320668f2-3304-4294-9727-7164a2e1e2e7 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:18.809855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e78f5-81d2-4f71-87e4-0c17c35a671b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:18.811277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e78f5-81d2-4f71-87e4-0c17c35a671b admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:18.811621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e78f5-81d2-4f71-87e4-0c17c35a671b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:18.812008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e78f5-81d2-4f71-87e4-0c17c35a671b admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:18.812771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e78f5-81d2-4f71-87e4-0c17c35a671b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:18.814774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e78f5-81d2-4f71-87e4-0c17c35a671b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:18.947601 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2437/4798] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:23:18 2022] POST /identity/v3/projects => generated 367 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:23:18.951708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf0dcd-2746-4fdd-b38f-18859b0f4206 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:18.963820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf0dcd-2746-4fdd-b38f-18859b0f4206 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:19.047841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf222d7-f8b5-4071-a88d-e8a5968ebc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:19.048785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf222d7-f8b5-4071-a88d-e8a5968ebc5a admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:19.049133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf222d7-f8b5-4071-a88d-e8a5968ebc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:19.049469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf222d7-f8b5-4071-a88d-e8a5968ebc5a admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:19.053008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf222d7-f8b5-4071-a88d-e8a5968ebc5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:19.054575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf222d7-f8b5-4071-a88d-e8a5968ebc5a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:19.176175 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2362/4799] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:23:18 2022] POST /identity/v3/users => generated 284 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:23:19.180415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e78f5-81d2-4f71-87e4-0c17c35a671b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:19.203697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e78f5-81d2-4f71-87e4-0c17c35a671b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:19.211966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a4af6-1504-4fd0-83f1-20a3b1343ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:19.213692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a4af6-1504-4fd0-83f1-20a3b1343ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:19.214223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a4af6-1504-4fd0-83f1-20a3b1343ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:19.214900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a4af6-1504-4fd0-83f1-20a3b1343ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:19.218479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a4af6-1504-4fd0-83f1-20a3b1343ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:19.220595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a4af6-1504-4fd0-83f1-20a3b1343ba1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:19.235762 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2438/4800] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:23:19.239711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf222d7-f8b5-4071-a88d-e8a5968ebc5a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:19.247525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:19.256413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf222d7-f8b5-4071-a88d-e8a5968ebc5a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:19.263401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e898624-416b-4751-a62d-b07576471db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:19.265229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e898624-416b-4751-a62d-b07576471db5 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:19.265807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e898624-416b-4751-a62d-b07576471db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:19.266642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e898624-416b-4751-a62d-b07576471db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:19.267899 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e898624-416b-4751-a62d-b07576471db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:19.275364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e898624-416b-4751-a62d-b07576471db5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:19.286924 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2363/4801] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:23:19.290697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a4af6-1504-4fd0-83f1-20a3b1343ba1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:19.311992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a4af6-1504-4fd0-83f1-20a3b1343ba1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:19.320344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb2863-c8e7-4946-9060-e11ef8a48d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:19.322103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb2863-c8e7-4946-9060-e11ef8a48d22 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:19.322906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb2863-c8e7-4946-9060-e11ef8a48d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:19.323464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb2863-c8e7-4946-9060-e11ef8a48d22 admin admin] PATH_INFO: `/v3/projects/1dad823e240149edb30e592380249a13/users/027dcc48e4fd4c36a5004096ad5e43f8/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:19.346130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb2863-c8e7-4946-9060-e11ef8a48d22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dad823e240149edb30e592380249a13, user_id=027dcc48e4fd4c36a5004096ad5e43f8, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:19.349581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb2863-c8e7-4946-9060-e11ef8a48d22 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:19.421928 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2439/4802] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:23:19 2022] PUT /identity/v3/projects/1dad823e240149edb30e592380249a13/users/027dcc48e4fd4c36a5004096ad5e43f8/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:23:19.424465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b9d75-6984-485e-a2d0-9f7d2d8260c7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:19.424959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b9d75-6984-485e-a2d0-9f7d2d8260c7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:19.425211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b9d75-6984-485e-a2d0-9f7d2d8260c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:19.459298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-975b9d75-6984-485e-a2d0-9f7d2d8260c7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:23:19.460896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-975b9d75-6984-485e-a2d0-9f7d2d8260c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:19.564776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:19.572242 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2364/4803] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:23:19.648669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb2863-c8e7-4946-9060-e11ef8a48d22 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:19.650921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4cdb2863-c8e7-4946-9060-e11ef8a48d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:19.731157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb2863-c8e7-4946-9060-e11ef8a48d22 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:19.736102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6123ee-cbc9-4171-a189-19272a04110c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:19.737769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6123ee-cbc9-4171-a189-19272a04110c service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:19.738332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6123ee-cbc9-4171-a189-19272a04110c service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:19.738713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6123ee-cbc9-4171-a189-19272a04110c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:19.760933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6123ee-cbc9-4171-a189-19272a04110c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:19.760933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6123ee-cbc9-4171-a189-19272a04110c service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:19.769172 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2440/4804] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:23:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:23:20.483937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:20.509803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:22.316633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:22.407778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:24.213887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:24.280033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:24.302789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b9d75-6984-485e-a2d0-9f7d2d8260c7 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:24.304473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-975b9d75-6984-485e-a2d0-9f7d2d8260c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:24.327530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b9d75-6984-485e-a2d0-9f7d2d8260c7 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:24.345549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735301b1-b052-4f36-b890-38882597453d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:24.346462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735301b1-b052-4f36-b890-38882597453d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:24.346743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735301b1-b052-4f36-b890-38882597453d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:24.347048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735301b1-b052-4f36-b890-38882597453d admin admin] PATH_INFO: `/v3/users/3ab7326ef48042fe961a7eed5c46db24` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:24.355049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735301b1-b052-4f36-b890-38882597453d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab7326ef48042fe961a7eed5c46db24)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:24.361021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735301b1-b052-4f36-b890-38882597453d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:24.665831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-735301b1-b052-4f36-b890-38882597453d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab7326ef48042fe961a7eed5c46db24'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:24.697840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-735301b1-b052-4f36-b890-38882597453d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab7326ef48042fe961a7eed5c46db24'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:24.795708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-735301b1-b052-4f36-b890-38882597453d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab7326ef48042fe961a7eed5c46db24'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:24.806072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-735301b1-b052-4f36-b890-38882597453d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab7326ef48042fe961a7eed5c46db24'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:24.807489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-735301b1-b052-4f36-b890-38882597453d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab7326ef48042fe961a7eed5c46db24'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:24.815783 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2365/4805] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:23:24 2022] DELETE /identity/v3/users/3ab7326ef48042fe961a7eed5c46db24 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:23:25.445370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6123ee-cbc9-4171-a189-19272a04110c service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:25.463640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6123ee-cbc9-4171-a189-19272a04110c service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:25.583925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a799c79-9d59-42d6-8020-e816c1615cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:25.586293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a799c79-9d59-42d6-8020-e816c1615cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:25.588832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a799c79-9d59-42d6-8020-e816c1615cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:25.589283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a799c79-9d59-42d6-8020-e816c1615cd8 admin admin] PATH_INFO: `/v3/projects/7c0ebaf2e3714e42b3bda726e2133522` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:25.592720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a799c79-9d59-42d6-8020-e816c1615cd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0ebaf2e3714e42b3bda726e2133522)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:25.612367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a799c79-9d59-42d6-8020-e816c1615cd8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:25.857396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8a799c79-9d59-42d6-8020-e816c1615cd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0ebaf2e3714e42b3bda726e2133522', 'request_id': 'req-8a799c79-9d59-42d6-8020-e816c1615cd8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:25.875450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8a799c79-9d59-42d6-8020-e816c1615cd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0ebaf2e3714e42b3bda726e2133522', 'request_id': 'req-8a799c79-9d59-42d6-8020-e816c1615cd8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:25.883745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8a799c79-9d59-42d6-8020-e816c1615cd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0ebaf2e3714e42b3bda726e2133522', 'request_id': 'req-8a799c79-9d59-42d6-8020-e816c1615cd8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:25.995151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8a799c79-9d59-42d6-8020-e816c1615cd8 admin admin] The token cache is being invalidate because project 7c0ebaf2e3714e42b3bda726e2133522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:23:25.995445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8a799c79-9d59-42d6-8020-e816c1615cd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:25.998209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8a799c79-9d59-42d6-8020-e816c1615cd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:26.001776 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2441/4806] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:23:25 2022] DELETE /identity/v3/projects/7c0ebaf2e3714e42b3bda726e2133522 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:23:26.007378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389489a-8b60-42b6-bfe2-de23cd7c5dee None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:26.007867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389489a-8b60-42b6-bfe2-de23cd7c5dee None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:26.008159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389489a-8b60-42b6-bfe2-de23cd7c5dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:26.041272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e389489a-8b60-42b6-bfe2-de23cd7c5dee None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:23:26.041645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e389489a-8b60-42b6-bfe2-de23cd7c5dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:26.136029 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2366/4807] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:23:26.144931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc197d6c-ce16-4a01-a1be-50b6cd390af0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:26.145266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc197d6c-ce16-4a01-a1be-50b6cd390af0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:26.145497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc197d6c-ce16-4a01-a1be-50b6cd390af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:26.167984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-dc197d6c-ce16-4a01-a1be-50b6cd390af0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:23:26.169887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dc197d6c-ce16-4a01-a1be-50b6cd390af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:26.183777 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2442/4808] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:23:26.188507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389489a-8b60-42b6-bfe2-de23cd7c5dee None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:26.199806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389489a-8b60-42b6-bfe2-de23cd7c5dee None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:26.206753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8088cbe-40f7-455e-88c5-8458c935fc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:26.207820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8088cbe-40f7-455e-88c5-8458c935fc9a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:26.208485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8088cbe-40f7-455e-88c5-8458c935fc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:26.208950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8088cbe-40f7-455e-88c5-8458c935fc9a admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:26.209894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8088cbe-40f7-455e-88c5-8458c935fc9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:23:26.210394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8088cbe-40f7-455e-88c5-8458c935fc9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:26.212271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8088cbe-40f7-455e-88c5-8458c935fc9a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:26.230654 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2367/4809] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:23:26.236096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc197d6c-ce16-4a01-a1be-50b6cd390af0 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:26.250871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc197d6c-ce16-4a01-a1be-50b6cd390af0 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:26.256872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722ea62-dc02-4dac-8ea9-8c997ee7969f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:26.258712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722ea62-dc02-4dac-8ea9-8c997ee7969f admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:26.258712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722ea62-dc02-4dac-8ea9-8c997ee7969f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:26.258712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722ea62-dc02-4dac-8ea9-8c997ee7969f admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:26.259142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722ea62-dc02-4dac-8ea9-8c997ee7969f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:26.261247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722ea62-dc02-4dac-8ea9-8c997ee7969f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:26.422254 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2443/4810] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:23:26 2022] POST /identity/v3/projects => generated 391 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:23:26.424968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8088cbe-40f7-455e-88c5-8458c935fc9a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:26.442106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8088cbe-40f7-455e-88c5-8458c935fc9a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:26.614200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c9145-29ba-40ee-8701-349a925088f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:26.617482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c9145-29ba-40ee-8701-349a925088f2 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:26.618197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c9145-29ba-40ee-8701-349a925088f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:26.618617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c9145-29ba-40ee-8701-349a925088f2 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:26.619208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c9145-29ba-40ee-8701-349a925088f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:26.621412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c9145-29ba-40ee-8701-349a925088f2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:26.757037 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2368/4811] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:23:26 2022] POST /identity/v3/users => generated 296 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:23:26.757901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722ea62-dc02-4dac-8ea9-8c997ee7969f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:26.780912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722ea62-dc02-4dac-8ea9-8c997ee7969f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:26.787475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1493c-3c87-4a59-92e0-63d3279b6690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:26.788596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1493c-3c87-4a59-92e0-63d3279b6690 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:26.789074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1493c-3c87-4a59-92e0-63d3279b6690 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:26.790044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1493c-3c87-4a59-92e0-63d3279b6690 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:26.790964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1493c-3c87-4a59-92e0-63d3279b6690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:26.793088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1493c-3c87-4a59-92e0-63d3279b6690 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:26.812150 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2444/4812] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:23:26.815531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c9145-29ba-40ee-8701-349a925088f2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:26.817476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-676c9145-29ba-40ee-8701-349a925088f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:26.831798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1493c-3c87-4a59-92e0-63d3279b6690 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:26.854816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:26.855723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1493c-3c87-4a59-92e0-63d3279b6690 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:26.885824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178279e-f92d-4f22-865b-be92ddab7136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:26.886888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178279e-f92d-4f22-865b-be92ddab7136 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:26.888713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178279e-f92d-4f22-865b-be92ddab7136 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:26.888713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178279e-f92d-4f22-865b-be92ddab7136 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:26.890442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178279e-f92d-4f22-865b-be92ddab7136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:26.894550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178279e-f92d-4f22-865b-be92ddab7136 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:26.897885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:26.928853 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2445/4813] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:23:26.931983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178279e-f92d-4f22-865b-be92ddab7136 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:26.954317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c9145-29ba-40ee-8701-349a925088f2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:26.956893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178279e-f92d-4f22-865b-be92ddab7136 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:26.958178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51da1f5-8bfc-4965-9425-725c1d7ea273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:26.965872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51da1f5-8bfc-4965-9425-725c1d7ea273 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:26.966927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51da1f5-8bfc-4965-9425-725c1d7ea273 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:26.997975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51da1f5-8bfc-4965-9425-725c1d7ea273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:26.998971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4b5e1-f3a9-4356-8de7-7be6653a2897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:26.999108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b51da1f5-8bfc-4965-9425-725c1d7ea273 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:26.999195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4b5e1-f3a9-4356-8de7-7be6653a2897 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:26.999195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4b5e1-f3a9-4356-8de7-7be6653a2897 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:26.999195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4b5e1-f3a9-4356-8de7-7be6653a2897 admin admin] PATH_INFO: `/v3/projects/da56fc78f06142aba80ca4c6e3d60475/users/bcc9aa2a091c490599f9a9c41163e2eb/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:26.999426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51da1f5-8bfc-4965-9425-725c1d7ea273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:26.999426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51da1f5-8bfc-4965-9425-725c1d7ea273 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:27.013698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4b5e1-f3a9-4356-8de7-7be6653a2897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da56fc78f06142aba80ca4c6e3d60475, user_id=bcc9aa2a091c490599f9a9c41163e2eb, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:27.014006 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2369/4814] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:23:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:23:27.016614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4b5e1-f3a9-4356-8de7-7be6653a2897 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:27.093657 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2446/4815] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:23:26 2022] PUT /identity/v3/projects/da56fc78f06142aba80ca4c6e3d60475/users/bcc9aa2a091c490599f9a9c41163e2eb/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:23:27.098889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cbedc-94f9-4b7b-a732-570d95d62b6b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:27.099693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cbedc-94f9-4b7b-a732-570d95d62b6b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:27.100284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cbedc-94f9-4b7b-a732-570d95d62b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:27.124740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6f5cbedc-94f9-4b7b-a732-570d95d62b6b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:23:27.126928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6f5cbedc-94f9-4b7b-a732-570d95d62b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:27.198117 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2370/4816] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:23:27.208367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4b5e1-f3a9-4356-8de7-7be6653a2897 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:27.210179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-43b4b5e1-f3a9-4356-8de7-7be6653a2897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:27.285801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4b5e1-f3a9-4356-8de7-7be6653a2897 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:27.289746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa044940-382f-4e78-8723-cde637ebe5b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:27.290471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa044940-382f-4e78-8723-cde637ebe5b3 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:27.290969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa044940-382f-4e78-8723-cde637ebe5b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:27.291487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa044940-382f-4e78-8723-cde637ebe5b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:27.304589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa044940-382f-4e78-8723-cde637ebe5b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:27.306165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa044940-382f-4e78-8723-cde637ebe5b3 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:27.319892 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2447/4817] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:23:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:23:28.349977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:28.644545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:29.395413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cbedc-94f9-4b7b-a732-570d95d62b6b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:29.422995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cbedc-94f9-4b7b-a732-570d95d62b6b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:29.435280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf78abc-243c-4494-bfe7-7b5f6bbb13a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:29.440432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf78abc-243c-4494-bfe7-7b5f6bbb13a5 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:29.441572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf78abc-243c-4494-bfe7-7b5f6bbb13a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:29.442221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf78abc-243c-4494-bfe7-7b5f6bbb13a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:29.445067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4cf78abc-243c-4494-bfe7-7b5f6bbb13a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:29.587319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf78abc-243c-4494-bfe7-7b5f6bbb13a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:29.589341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf78abc-243c-4494-bfe7-7b5f6bbb13a5 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:29.601767 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2371/4818] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:23:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:23:29.898361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:30.281427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:30.938010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864848d-4af5-4724-8078-c0b047dad8b3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:30.938577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864848d-4af5-4724-8078-c0b047dad8b3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:30.938577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864848d-4af5-4724-8078-c0b047dad8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:30.974868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b864848d-4af5-4724-8078-c0b047dad8b3 None None] MFA Rules not processed for user `027dcc48e4fd4c36a5004096ad5e43f8`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:23:30.978113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b864848d-4af5-4724-8078-c0b047dad8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:31.079142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1a9ec-145b-4e09-8b20-d71a0b352cdb None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:31.079711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1a9ec-145b-4e09-8b20-d71a0b352cdb None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:31.079898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1a9ec-145b-4e09-8b20-d71a0b352cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:31.098769 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2448/4819] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:23:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:23:31.100701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635eee6c-51cd-45a6-9874-9349c560e6db None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:31.100996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635eee6c-51cd-45a6-9874-9349c560e6db None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:31.101277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635eee6c-51cd-45a6-9874-9349c560e6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:31.104371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d6c1a9ec-145b-4e09-8b20-d71a0b352cdb None None] MFA Rules not processed for user `6f2e974ab5aa48dfb4b00f810dcedb63`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:23:31.105929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d6c1a9ec-145b-4e09-8b20-d71a0b352cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:31.139501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-635eee6c-51cd-45a6-9874-9349c560e6db None None] MFA Rules not processed for user `027dcc48e4fd4c36a5004096ad5e43f8`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:23:31.142907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-635eee6c-51cd-45a6-9874-9349c560e6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:31.167258 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2449/4820] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:23:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:23:31.172314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635eee6c-51cd-45a6-9874-9349c560e6db None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:31.175201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-635eee6c-51cd-45a6-9874-9349c560e6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:31.186562 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2372/4821] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:23:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:23:31.304325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635eee6c-51cd-45a6-9874-9349c560e6db None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:31.311709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf93580-5fd1-4ec4-a33e-7d9eda600f81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:31.312747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf93580-5fd1-4ec4-a33e-7d9eda600f81 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:31.313206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf93580-5fd1-4ec4-a33e-7d9eda600f81 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:31.313652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf93580-5fd1-4ec4-a33e-7d9eda600f81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:31.323242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf93580-5fd1-4ec4-a33e-7d9eda600f81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:31.324919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf93580-5fd1-4ec4-a33e-7d9eda600f81 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:31.337592 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2450/4822] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:23:31 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:23:31.675448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:32.412487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:32.560643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:33.830762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:33.846566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:34.720939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:34.986928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:35.057609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:36.989231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:37.141768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:38.886186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:38.909968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:40.304998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:40.412019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:41.817295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:41.846595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:42.490208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1a9ec-145b-4e09-8b20-d71a0b352cdb None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:42.492049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d6c1a9ec-145b-4e09-8b20-d71a0b352cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:42.511413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1a9ec-145b-4e09-8b20-d71a0b352cdb None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:42.516817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4ad61-1e6c-4b38-9ad2-3cfb58c32195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:42.518327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4ad61-1e6c-4b38-9ad2-3cfb58c32195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:42.518837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4ad61-1e6c-4b38-9ad2-3cfb58c32195 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:42.519354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4ad61-1e6c-4b38-9ad2-3cfb58c32195 admin admin] PATH_INFO: `/v3/users/1aa99be675e946fd995d71465b4cbec6` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:42.520826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4ad61-1e6c-4b38-9ad2-3cfb58c32195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa99be675e946fd995d71465b4cbec6)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:42.523136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4ad61-1e6c-4b38-9ad2-3cfb58c32195 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:42.713740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-66b4ad61-1e6c-4b38-9ad2-3cfb58c32195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa99be675e946fd995d71465b4cbec6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:42.729679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-66b4ad61-1e6c-4b38-9ad2-3cfb58c32195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa99be675e946fd995d71465b4cbec6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:42.835742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-66b4ad61-1e6c-4b38-9ad2-3cfb58c32195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa99be675e946fd995d71465b4cbec6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:42.849084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-66b4ad61-1e6c-4b38-9ad2-3cfb58c32195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa99be675e946fd995d71465b4cbec6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:42.850629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-66b4ad61-1e6c-4b38-9ad2-3cfb58c32195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa99be675e946fd995d71465b4cbec6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:42.901340 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2373/4823] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:23:42 2022] DELETE /identity/v3/users/1aa99be675e946fd995d71465b4cbec6 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:23:43.166523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:43.474623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:43.760536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:UPDATE=1,keystone:DELETE=9 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:44.308137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:44.729309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf93580-5fd1-4ec4-a33e-7d9eda600f81 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:44.752000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf93580-5fd1-4ec4-a33e-7d9eda600f81 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:44.886338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5420481-baec-44f4-8436-99d46e78b8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:44.889256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5420481-baec-44f4-8436-99d46e78b8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:44.889803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5420481-baec-44f4-8436-99d46e78b8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:44.890302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5420481-baec-44f4-8436-99d46e78b8bf admin admin] PATH_INFO: `/v3/projects/d82c2d92c67f469e863eb70bb7f9af84` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:44.893636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5420481-baec-44f4-8436-99d46e78b8bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d82c2d92c67f469e863eb70bb7f9af84)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:44.895933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5420481-baec-44f4-8436-99d46e78b8bf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:44.914311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:45.044023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f5420481-baec-44f4-8436-99d46e78b8bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd82c2d92c67f469e863eb70bb7f9af84', 'request_id': 'req-f5420481-baec-44f4-8436-99d46e78b8bf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:45.052027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f5420481-baec-44f4-8436-99d46e78b8bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd82c2d92c67f469e863eb70bb7f9af84', 'request_id': 'req-f5420481-baec-44f4-8436-99d46e78b8bf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:45.058800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f5420481-baec-44f4-8436-99d46e78b8bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd82c2d92c67f469e863eb70bb7f9af84', 'request_id': 'req-f5420481-baec-44f4-8436-99d46e78b8bf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:45.190126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f5420481-baec-44f4-8436-99d46e78b8bf admin admin] The token cache is being invalidate because project d82c2d92c67f469e863eb70bb7f9af84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:23:45.190455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f5420481-baec-44f4-8436-99d46e78b8bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:45.191182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f5420481-baec-44f4-8436-99d46e78b8bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:45.192748 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2451/4824] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:23:44 2022] DELETE /identity/v3/projects/d82c2d92c67f469e863eb70bb7f9af84 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:23:45.197964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d77bb-a18b-4819-8321-f65f6d55faf6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:45.198248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d77bb-a18b-4819-8321-f65f6d55faf6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:45.198543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d77bb-a18b-4819-8321-f65f6d55faf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:45.217821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-345d77bb-a18b-4819-8321-f65f6d55faf6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:23:45.219041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-345d77bb-a18b-4819-8321-f65f6d55faf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:45.287211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:45.294788 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2374/4825] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:23:45.303361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f2329-b015-4a71-be17-273ca2348369 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:45.303764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f2329-b015-4a71-be17-273ca2348369 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:45.304114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f2329-b015-4a71-be17-273ca2348369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:45.322882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d09f2329-b015-4a71-be17-273ca2348369 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:23:45.325634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d09f2329-b015-4a71-be17-273ca2348369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:45.335065 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2452/4826] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:23:45.339431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d77bb-a18b-4819-8321-f65f6d55faf6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:45.351653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d77bb-a18b-4819-8321-f65f6d55faf6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:45.357330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1c353-0f80-4b80-8537-b0fd70a9c038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:45.358012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1c353-0f80-4b80-8537-b0fd70a9c038 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:45.358936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1c353-0f80-4b80-8537-b0fd70a9c038 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:45.359291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1c353-0f80-4b80-8537-b0fd70a9c038 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:45.360220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1c353-0f80-4b80-8537-b0fd70a9c038 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:23:45.360531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1c353-0f80-4b80-8537-b0fd70a9c038 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:45.362159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1c353-0f80-4b80-8537-b0fd70a9c038 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:45.378027 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2375/4827] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:23:45.382759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f2329-b015-4a71-be17-273ca2348369 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:45.395291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f2329-b015-4a71-be17-273ca2348369 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:45.400605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a6982-a338-4372-94a3-ab7d85fb881e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:45.401275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a6982-a338-4372-94a3-ab7d85fb881e admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:45.401568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a6982-a338-4372-94a3-ab7d85fb881e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:45.401844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a6982-a338-4372-94a3-ab7d85fb881e admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:45.402731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a6982-a338-4372-94a3-ab7d85fb881e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:45.404793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a6982-a338-4372-94a3-ab7d85fb881e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:45.550995 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2453/4828] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:23:45 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:23:45.555218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1c353-0f80-4b80-8537-b0fd70a9c038 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:45.566011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1c353-0f80-4b80-8537-b0fd70a9c038 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:45.642219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcc222-edd2-4ad1-b35a-1014ef4fd021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:45.643071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcc222-edd2-4ad1-b35a-1014ef4fd021 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:45.643796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcc222-edd2-4ad1-b35a-1014ef4fd021 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:45.644770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcc222-edd2-4ad1-b35a-1014ef4fd021 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:45.645046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcc222-edd2-4ad1-b35a-1014ef4fd021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:45.647325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcc222-edd2-4ad1-b35a-1014ef4fd021 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:45.740222 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2376/4829] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:23:45 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:23:45.741477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a6982-a338-4372-94a3-ab7d85fb881e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:45.753715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a6982-a338-4372-94a3-ab7d85fb881e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:45.759037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58edeaf-a392-4872-9cfa-676f43ede07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:45.759905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58edeaf-a392-4872-9cfa-676f43ede07f admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:45.760201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58edeaf-a392-4872-9cfa-676f43ede07f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:45.761658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58edeaf-a392-4872-9cfa-676f43ede07f admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:45.762818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58edeaf-a392-4872-9cfa-676f43ede07f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:45.768554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58edeaf-a392-4872-9cfa-676f43ede07f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:45.781646 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2454/4830] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:23:45.800314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcc222-edd2-4ad1-b35a-1014ef4fd021 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:45.824088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcc222-edd2-4ad1-b35a-1014ef4fd021 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:45.854486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b9adc-44a2-499c-95fc-f269149c8176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:45.855321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b9adc-44a2-499c-95fc-f269149c8176 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:45.855601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b9adc-44a2-499c-95fc-f269149c8176 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:45.856054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b9adc-44a2-499c-95fc-f269149c8176 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:45.857264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b9adc-44a2-499c-95fc-f269149c8176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:45.859116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b9adc-44a2-499c-95fc-f269149c8176 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:45.877816 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2377/4831] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:23:45.878381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58edeaf-a392-4872-9cfa-676f43ede07f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:45.891797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58edeaf-a392-4872-9cfa-676f43ede07f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:45.901035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0beed1-9aea-45ad-898e-3c223c5a349c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:45.902218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0beed1-9aea-45ad-898e-3c223c5a349c admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:45.906669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0beed1-9aea-45ad-898e-3c223c5a349c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:45.906669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0beed1-9aea-45ad-898e-3c223c5a349c admin admin] PATH_INFO: `/v3/projects/cfc2e42a0df346f4adef152ba2e3fa71/users/a23fafbab18d41ee82b84bbdf94cf0fe/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:45.945700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0beed1-9aea-45ad-898e-3c223c5a349c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc2e42a0df346f4adef152ba2e3fa71, user_id=a23fafbab18d41ee82b84bbdf94cf0fe, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:45.948896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0beed1-9aea-45ad-898e-3c223c5a349c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:45.960022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:46.044873 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2455/4832] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:23:45 2022] PUT /identity/v3/projects/cfc2e42a0df346f4adef152ba2e3fa71/users/a23fafbab18d41ee82b84bbdf94cf0fe/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:23:46.050807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3a77e-3cc6-479e-89a7-1bd20be1d95f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:46.051265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3a77e-3cc6-479e-89a7-1bd20be1d95f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:46.051644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3a77e-3cc6-479e-89a7-1bd20be1d95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:46.080436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-90e3a77e-3cc6-479e-89a7-1bd20be1d95f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:23:46.083129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-90e3a77e-3cc6-479e-89a7-1bd20be1d95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:46.155650 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2378/4833] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:23:46.197904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0beed1-9aea-45ad-898e-3c223c5a349c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:46.200475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6c0beed1-9aea-45ad-898e-3c223c5a349c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:46.286615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0beed1-9aea-45ad-898e-3c223c5a349c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:46.291088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f8d33-a788-4cfb-9ebe-c380b1d4c170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:46.291668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f8d33-a788-4cfb-9ebe-c380b1d4c170 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:46.291947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f8d33-a788-4cfb-9ebe-c380b1d4c170 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:46.292959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f8d33-a788-4cfb-9ebe-c380b1d4c170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:46.306452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f8d33-a788-4cfb-9ebe-c380b1d4c170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:46.308031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f8d33-a788-4cfb-9ebe-c380b1d4c170 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:46.320904 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2456/4834] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:23:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:23:46.418110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3a77e-3cc6-479e-89a7-1bd20be1d95f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:46.421107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-90e3a77e-3cc6-479e-89a7-1bd20be1d95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:46.539487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3a77e-3cc6-479e-89a7-1bd20be1d95f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:46.551275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae18ef-864c-4aa4-8d6c-40bd745fcd20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:46.562078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae18ef-864c-4aa4-8d6c-40bd745fcd20 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:46.562686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae18ef-864c-4aa4-8d6c-40bd745fcd20 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:46.563692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae18ef-864c-4aa4-8d6c-40bd745fcd20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:46.565919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-abae18ef-864c-4aa4-8d6c-40bd745fcd20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:46.588898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae18ef-864c-4aa4-8d6c-40bd745fcd20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:46.591849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae18ef-864c-4aa4-8d6c-40bd745fcd20 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:46.636664 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2379/4835] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:23:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:23:47.533312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:47.640232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:48.035388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:48.651728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:49.097820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:49.313857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85512a39-856d-42eb-a713-b13cd21bfb10 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:49.314474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85512a39-856d-42eb-a713-b13cd21bfb10 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:49.315305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85512a39-856d-42eb-a713-b13cd21bfb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:49.384567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-85512a39-856d-42eb-a713-b13cd21bfb10 None None] MFA Rules not processed for user `bcc9aa2a091c490599f9a9c41163e2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:23:49.388948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-85512a39-856d-42eb-a713-b13cd21bfb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:49.547794 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2457/4836] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:23:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:23:49.559544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954987d-352c-4bac-996d-f72f0de294fd None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:49.559886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954987d-352c-4bac-996d-f72f0de294fd None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:49.560165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954987d-352c-4bac-996d-f72f0de294fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:49.604720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0954987d-352c-4bac-996d-f72f0de294fd None None] MFA Rules not processed for user `bcc9aa2a091c490599f9a9c41163e2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:23:49.609766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0954987d-352c-4bac-996d-f72f0de294fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:49.630931 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2380/4837] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:23:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:23:49.645737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:49.917721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:49.977241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=4,keystone:INSERT=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:50.139451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85512a39-856d-42eb-a713-b13cd21bfb10 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:50.141241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-85512a39-856d-42eb-a713-b13cd21bfb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:50.172469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85512a39-856d-42eb-a713-b13cd21bfb10 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:50.181631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c886db-e8c9-4e59-96f7-3860909f3f72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:50.183309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c886db-e8c9-4e59-96f7-3860909f3f72 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:50.188965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c886db-e8c9-4e59-96f7-3860909f3f72 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:50.188965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c886db-e8c9-4e59-96f7-3860909f3f72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:50.203294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c886db-e8c9-4e59-96f7-3860909f3f72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:50.205736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c886db-e8c9-4e59-96f7-3860909f3f72 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:50.229994 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2458/4838] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:23:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:23:51.007393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:51.099872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:51.547716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954987d-352c-4bac-996d-f72f0de294fd None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:51.550026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c886db-e8c9-4e59-96f7-3860909f3f72 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:51.551765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0954987d-352c-4bac-996d-f72f0de294fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:51.552882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-14c886db-e8c9-4e59-96f7-3860909f3f72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:51.587192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c886db-e8c9-4e59-96f7-3860909f3f72 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:51.596824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954987d-352c-4bac-996d-f72f0de294fd None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:51.599961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f289e-c116-4aea-82bc-c96c3ed173a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:51.600370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f289e-c116-4aea-82bc-c96c3ed173a2 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:51.600657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f289e-c116-4aea-82bc-c96c3ed173a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:51.600939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f289e-c116-4aea-82bc-c96c3ed173a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:51.607827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-848f289e-c116-4aea-82bc-c96c3ed173a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:51.612879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d2254-14d4-4bd5-81dd-a7957a95dcf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:51.619175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d2254-14d4-4bd5-81dd-a7957a95dcf5 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:51.621240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d2254-14d4-4bd5-81dd-a7957a95dcf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:51.621703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d2254-14d4-4bd5-81dd-a7957a95dcf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:51.646618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d2254-14d4-4bd5-81dd-a7957a95dcf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:51.648573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f289e-c116-4aea-82bc-c96c3ed173a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:51.649601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d2254-14d4-4bd5-81dd-a7957a95dcf5 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:51.654405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f289e-c116-4aea-82bc-c96c3ed173a2 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:51.674222 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2459/4839] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:23:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:23:51.684059 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2381/4840] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:23:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:23:52.516576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f289e-c116-4aea-82bc-c96c3ed173a2 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:52.518596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-848f289e-c116-4aea-82bc-c96c3ed173a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:52.565410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:52.665471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:52.705696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f289e-c116-4aea-82bc-c96c3ed173a2 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:52.735492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434e95e-cba5-4a98-985a-328aaf4ce40c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:52.736128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434e95e-cba5-4a98-985a-328aaf4ce40c service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:52.736672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434e95e-cba5-4a98-985a-328aaf4ce40c service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:52.737112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434e95e-cba5-4a98-985a-328aaf4ce40c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:52.740330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0434e95e-cba5-4a98-985a-328aaf4ce40c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:52.772105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434e95e-cba5-4a98-985a-328aaf4ce40c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:52.774066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434e95e-cba5-4a98-985a-328aaf4ce40c service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:52.805655 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2460/4841] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:23:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:23:52.825250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e62fae-e8ed-43e6-989e-0d476c2afe8e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:52.825570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e62fae-e8ed-43e6-989e-0d476c2afe8e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:52.825861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e62fae-e8ed-43e6-989e-0d476c2afe8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:52.878767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-59e62fae-e8ed-43e6-989e-0d476c2afe8e None None] MFA Rules not processed for user `bcc9aa2a091c490599f9a9c41163e2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:23:52.879584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-59e62fae-e8ed-43e6-989e-0d476c2afe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:52.906390 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2382/4842] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:23:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:23:53.783353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:54.217683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:54.475085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434e95e-cba5-4a98-985a-328aaf4ce40c service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:54.476737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0434e95e-cba5-4a98-985a-328aaf4ce40c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:54.503450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434e95e-cba5-4a98-985a-328aaf4ce40c service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:54.518094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0edaa-9e3c-48c5-8271-0190e6b6920e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:54.520004 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0edaa-9e3c-48c5-8271-0190e6b6920e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:54.520744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0edaa-9e3c-48c5-8271-0190e6b6920e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:54.521227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0edaa-9e3c-48c5-8271-0190e6b6920e admin admin] PATH_INFO: `/v3/users/59876ad10218461681980764d3f29539` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:54.523571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0edaa-9e3c-48c5-8271-0190e6b6920e admin admin] RBAC: Authorizing `identity:delete_user(user_id=59876ad10218461681980764d3f29539)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:54.527474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0edaa-9e3c-48c5-8271-0190e6b6920e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:54.653266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e62fae-e8ed-43e6-989e-0d476c2afe8e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:54.679654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e62fae-e8ed-43e6-989e-0d476c2afe8e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:54.700932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fba14-b374-4d5f-b67c-5be0407f20ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:54.702105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fba14-b374-4d5f-b67c-5be0407f20ea service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:54.702621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fba14-b374-4d5f-b67c-5be0407f20ea service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:54.703561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fba14-b374-4d5f-b67c-5be0407f20ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:54.707843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5e6fba14-b374-4d5f-b67c-5be0407f20ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:54.754328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fba14-b374-4d5f-b67c-5be0407f20ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:54.759414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fba14-b374-4d5f-b67c-5be0407f20ea service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:54.782005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-03a0edaa-9e3c-48c5-8271-0190e6b6920e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59876ad10218461681980764d3f29539'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:54.795621 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2383/4843] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:23:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:23:54.798762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-03a0edaa-9e3c-48c5-8271-0190e6b6920e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59876ad10218461681980764d3f29539'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:54.904800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-03a0edaa-9e3c-48c5-8271-0190e6b6920e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59876ad10218461681980764d3f29539'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:54.905686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-03a0edaa-9e3c-48c5-8271-0190e6b6920e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59876ad10218461681980764d3f29539'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:54.926787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-03a0edaa-9e3c-48c5-8271-0190e6b6920e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59876ad10218461681980764d3f29539'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:54.953602 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2461/4844] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:23:54 2022] DELETE /identity/v3/users/59876ad10218461681980764d3f29539 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:23:54.954823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4e057-9b8e-4ee0-a1ae-70187789ca5c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:54.955438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4e057-9b8e-4ee0-a1ae-70187789ca5c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:54.956386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4e057-9b8e-4ee0-a1ae-70187789ca5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:55.015261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6ac4e057-9b8e-4ee0-a1ae-70187789ca5c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:23:55.016593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6ac4e057-9b8e-4ee0-a1ae-70187789ca5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:55.153650 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2384/4845] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:23:55.189469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0edaa-9e3c-48c5-8271-0190e6b6920e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:55.190945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-03a0edaa-9e3c-48c5-8271-0190e6b6920e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:55.246932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:55.344370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0edaa-9e3c-48c5-8271-0190e6b6920e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:55.351800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ad8b6-6879-48da-889b-153030341a8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:55.352934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ad8b6-6879-48da-889b-153030341a8b service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:55.353436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ad8b6-6879-48da-889b-153030341a8b service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:55.354525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ad8b6-6879-48da-889b-153030341a8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:55.375880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ad8b6-6879-48da-889b-153030341a8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:55.389084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ad8b6-6879-48da-889b-153030341a8b service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:55.404446 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2462/4846] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:23:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:23:56.109285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:56.120700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4e057-9b8e-4ee0-a1ae-70187789ca5c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:56.123559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6ac4e057-9b8e-4ee0-a1ae-70187789ca5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:56.143638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4e057-9b8e-4ee0-a1ae-70187789ca5c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:56.159952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4afbe-79b6-4d0a-a1c5-19127ebf4e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:56.160971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4afbe-79b6-4d0a-a1c5-19127ebf4e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:56.161326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4afbe-79b6-4d0a-a1c5-19127ebf4e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:56.161735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4afbe-79b6-4d0a-a1c5-19127ebf4e13 admin admin] PATH_INFO: `/v3/projects/444adbbe7b604478bcbfc26666e4cbed` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:56.164338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4afbe-79b6-4d0a-a1c5-19127ebf4e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=444adbbe7b604478bcbfc26666e4cbed)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:56.174418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4afbe-79b6-4d0a-a1c5-19127ebf4e13 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:56.370359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b6a4afbe-79b6-4d0a-a1c5-19127ebf4e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '444adbbe7b604478bcbfc26666e4cbed', 'request_id': 'req-b6a4afbe-79b6-4d0a-a1c5-19127ebf4e13'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:56.379434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b6a4afbe-79b6-4d0a-a1c5-19127ebf4e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '444adbbe7b604478bcbfc26666e4cbed', 'request_id': 'req-b6a4afbe-79b6-4d0a-a1c5-19127ebf4e13'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:56.387503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b6a4afbe-79b6-4d0a-a1c5-19127ebf4e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '444adbbe7b604478bcbfc26666e4cbed', 'request_id': 'req-b6a4afbe-79b6-4d0a-a1c5-19127ebf4e13'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:56.491198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:56.549473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b6a4afbe-79b6-4d0a-a1c5-19127ebf4e13 admin admin] The token cache is being invalidate because project 444adbbe7b604478bcbfc26666e4cbed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:23:56.549767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b6a4afbe-79b6-4d0a-a1c5-19127ebf4e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:56.552870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b6a4afbe-79b6-4d0a-a1c5-19127ebf4e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:56.556220 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2385/4847] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:23:56 2022] DELETE /identity/v3/projects/444adbbe7b604478bcbfc26666e4cbed => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:23:56.567031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ad8b6-6879-48da-889b-153030341a8b service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:56.587538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ad8b6-6879-48da-889b-153030341a8b service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:56.756856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c396ec-c53d-46ac-bc19-04fa834815e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:56.757830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c396ec-c53d-46ac-bc19-04fa834815e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:56.758119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c396ec-c53d-46ac-bc19-04fa834815e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:56.758413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c396ec-c53d-46ac-bc19-04fa834815e9 admin admin] PATH_INFO: `/v3/users/352b3ba8594c420ea61c6f9756106bea` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:56.761940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c396ec-c53d-46ac-bc19-04fa834815e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=352b3ba8594c420ea61c6f9756106bea)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:56.764123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c396ec-c53d-46ac-bc19-04fa834815e9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:56.781867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4afbe-79b6-4d0a-a1c5-19127ebf4e13 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:56.783347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b6a4afbe-79b6-4d0a-a1c5-19127ebf4e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:56.812154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4afbe-79b6-4d0a-a1c5-19127ebf4e13 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:56.824713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2bba2-dafa-48e9-b2b8-739076731e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:56.827822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2bba2-dafa-48e9-b2b8-739076731e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:56.827822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2bba2-dafa-48e9-b2b8-739076731e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:56.827822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2bba2-dafa-48e9-b2b8-739076731e49 admin admin] PATH_INFO: `/v3/users/029f1334779e4bcdb3f4f2aed564a075` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:56.828909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2bba2-dafa-48e9-b2b8-739076731e49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=029f1334779e4bcdb3f4f2aed564a075)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:56.831203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2bba2-dafa-48e9-b2b8-739076731e49 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:57.103585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4ad2bba2-dafa-48e9-b2b8-739076731e49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '029f1334779e4bcdb3f4f2aed564a075'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:57.104434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e5c396ec-c53d-46ac-bc19-04fa834815e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352b3ba8594c420ea61c6f9756106bea'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:57.142216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e5c396ec-c53d-46ac-bc19-04fa834815e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352b3ba8594c420ea61c6f9756106bea'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:57.146319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4ad2bba2-dafa-48e9-b2b8-739076731e49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '029f1334779e4bcdb3f4f2aed564a075'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:57.211596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e5c396ec-c53d-46ac-bc19-04fa834815e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352b3ba8594c420ea61c6f9756106bea'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:57.212899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e5c396ec-c53d-46ac-bc19-04fa834815e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352b3ba8594c420ea61c6f9756106bea'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:57.230838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e5c396ec-c53d-46ac-bc19-04fa834815e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352b3ba8594c420ea61c6f9756106bea'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:57.240464 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2463/4848] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:23:56 2022] DELETE /identity/v3/users/352b3ba8594c420ea61c6f9756106bea => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:23:57.330640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4ad2bba2-dafa-48e9-b2b8-739076731e49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '029f1334779e4bcdb3f4f2aed564a075'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:57.340903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4ad2bba2-dafa-48e9-b2b8-739076731e49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '029f1334779e4bcdb3f4f2aed564a075'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:57.341989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4ad2bba2-dafa-48e9-b2b8-739076731e49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '029f1334779e4bcdb3f4f2aed564a075'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:57.354174 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2386/4849] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:23:56 2022] DELETE /identity/v3/users/029f1334779e4bcdb3f4f2aed564a075 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:23:58.017106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:58.160917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:58.438949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c396ec-c53d-46ac-bc19-04fa834815e9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:58.441373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e5c396ec-c53d-46ac-bc19-04fa834815e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:58.571193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2bba2-dafa-48e9-b2b8-739076731e49 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:58.574220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4ad2bba2-dafa-48e9-b2b8-739076731e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:58.588210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c396ec-c53d-46ac-bc19-04fa834815e9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:58.744274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc3d4c-7ce4-497f-a81c-ef0d9f9b8ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:58.748206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc3d4c-7ce4-497f-a81c-ef0d9f9b8ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:58.748531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc3d4c-7ce4-497f-a81c-ef0d9f9b8ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:58.748766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc3d4c-7ce4-497f-a81c-ef0d9f9b8ca7 admin admin] PATH_INFO: `/v3/projects/c982566016f54b54bce1d2bbd0a75049` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:58.761503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc3d4c-7ce4-497f-a81c-ef0d9f9b8ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c982566016f54b54bce1d2bbd0a75049)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:58.761503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc3d4c-7ce4-497f-a81c-ef0d9f9b8ca7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:58.761771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2bba2-dafa-48e9-b2b8-739076731e49 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:58.772297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23106312-e8bd-40a3-a8f6-ad197a3302f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:58.774845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23106312-e8bd-40a3-a8f6-ad197a3302f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:58.775470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23106312-e8bd-40a3-a8f6-ad197a3302f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:58.776022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23106312-e8bd-40a3-a8f6-ad197a3302f1 admin admin] PATH_INFO: `/v3/projects/3e1f6ffc3fb64dba8c4474641e796fb8` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:58.778168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23106312-e8bd-40a3-a8f6-ad197a3302f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e1f6ffc3fb64dba8c4474641e796fb8)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:58.783049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23106312-e8bd-40a3-a8f6-ad197a3302f1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:58.958668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-23106312-e8bd-40a3-a8f6-ad197a3302f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e1f6ffc3fb64dba8c4474641e796fb8', 'request_id': 'req-23106312-e8bd-40a3-a8f6-ad197a3302f1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:58.967148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-23106312-e8bd-40a3-a8f6-ad197a3302f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e1f6ffc3fb64dba8c4474641e796fb8', 'request_id': 'req-23106312-e8bd-40a3-a8f6-ad197a3302f1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:58.976382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-23106312-e8bd-40a3-a8f6-ad197a3302f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e1f6ffc3fb64dba8c4474641e796fb8', 'request_id': 'req-23106312-e8bd-40a3-a8f6-ad197a3302f1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:59.069117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4dbc3d4c-7ce4-497f-a81c-ef0d9f9b8ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c982566016f54b54bce1d2bbd0a75049', 'request_id': 'req-4dbc3d4c-7ce4-497f-a81c-ef0d9f9b8ca7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:59.082683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4dbc3d4c-7ce4-497f-a81c-ef0d9f9b8ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c982566016f54b54bce1d2bbd0a75049', 'request_id': 'req-4dbc3d4c-7ce4-497f-a81c-ef0d9f9b8ca7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:59.089236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4dbc3d4c-7ce4-497f-a81c-ef0d9f9b8ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c982566016f54b54bce1d2bbd0a75049', 'request_id': 'req-4dbc3d4c-7ce4-497f-a81c-ef0d9f9b8ca7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:59.118622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-23106312-e8bd-40a3-a8f6-ad197a3302f1 admin admin] The token cache is being invalidate because project 3e1f6ffc3fb64dba8c4474641e796fb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:23:59.119139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-23106312-e8bd-40a3-a8f6-ad197a3302f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:59.122201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-23106312-e8bd-40a3-a8f6-ad197a3302f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:59.134688 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2387/4850] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:23:58 2022] DELETE /identity/v3/projects/3e1f6ffc3fb64dba8c4474641e796fb8 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:23:59.136052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23106312-e8bd-40a3-a8f6-ad197a3302f1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:59.145772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-23106312-e8bd-40a3-a8f6-ad197a3302f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:59.229713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4dbc3d4c-7ce4-497f-a81c-ef0d9f9b8ca7 admin admin] The token cache is being invalidate because project c982566016f54b54bce1d2bbd0a75049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:23:59.232851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4dbc3d4c-7ce4-497f-a81c-ef0d9f9b8ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:59.234746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4dbc3d4c-7ce4-497f-a81c-ef0d9f9b8ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:59.242225 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2464/4851] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:23:58 2022] DELETE /identity/v3/projects/c982566016f54b54bce1d2bbd0a75049 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:23:59.243960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc3d4c-7ce4-497f-a81c-ef0d9f9b8ca7 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:59.248295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4dbc3d4c-7ce4-497f-a81c-ef0d9f9b8ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:59.284697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23106312-e8bd-40a3-a8f6-ad197a3302f1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:59.389538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc3d4c-7ce4-497f-a81c-ef0d9f9b8ca7 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:59.403813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a142a6-53b6-4929-a2b7-278958c6e9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:59.404315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28f32d-4b36-4a6d-b757-16338c123e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:59.405076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a142a6-53b6-4929-a2b7-278958c6e9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:59.405387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28f32d-4b36-4a6d-b757-16338c123e20 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:59.405828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28f32d-4b36-4a6d-b757-16338c123e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:59.406281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28f32d-4b36-4a6d-b757-16338c123e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:59.406511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a142a6-53b6-4929-a2b7-278958c6e9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:59.406627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a142a6-53b6-4929-a2b7-278958c6e9d7 admin admin] PATH_INFO: `/v3/users/ed417bacc78b4d5db0e10cd719fd47e3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:59.409243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-aa28f32d-4b36-4a6d-b757-16338c123e20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:59.410484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a142a6-53b6-4929-a2b7-278958c6e9d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed417bacc78b4d5db0e10cd719fd47e3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:59.422711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a142a6-53b6-4929-a2b7-278958c6e9d7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:59.429525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28f32d-4b36-4a6d-b757-16338c123e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:59.431283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28f32d-4b36-4a6d-b757-16338c123e20 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:59.446448 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2388/4852] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:23:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:23:59.447623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28f32d-4b36-4a6d-b757-16338c123e20 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:23:59.449438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-aa28f32d-4b36-4a6d-b757-16338c123e20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:59.471159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28f32d-4b36-4a6d-b757-16338c123e20 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:23:59.478565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386e8d7-f172-4d16-a8c9-9c8f147989f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:23:59.483075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386e8d7-f172-4d16-a8c9-9c8f147989f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:59.483075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386e8d7-f172-4d16-a8c9-9c8f147989f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:59.483075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386e8d7-f172-4d16-a8c9-9c8f147989f3 admin admin] PATH_INFO: `/v3/users/b7d013d2f9834ce0a8884e6f93a95d13` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:59.484169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386e8d7-f172-4d16-a8c9-9c8f147989f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d013d2f9834ce0a8884e6f93a95d13)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:23:59.487597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386e8d7-f172-4d16-a8c9-9c8f147989f3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:23:59.731354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-32a142a6-53b6-4929-a2b7-278958c6e9d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed417bacc78b4d5db0e10cd719fd47e3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:59.742366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-32a142a6-53b6-4929-a2b7-278958c6e9d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed417bacc78b4d5db0e10cd719fd47e3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:59.747946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c386e8d7-f172-4d16-a8c9-9c8f147989f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d013d2f9834ce0a8884e6f93a95d13'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:59.762156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c386e8d7-f172-4d16-a8c9-9c8f147989f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d013d2f9834ce0a8884e6f93a95d13'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:59.851369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-32a142a6-53b6-4929-a2b7-278958c6e9d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed417bacc78b4d5db0e10cd719fd47e3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:59.852348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-32a142a6-53b6-4929-a2b7-278958c6e9d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed417bacc78b4d5db0e10cd719fd47e3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:59.879503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-32a142a6-53b6-4929-a2b7-278958c6e9d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed417bacc78b4d5db0e10cd719fd47e3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:59.882255 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2465/4853] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:23:59 2022] DELETE /identity/v3/users/ed417bacc78b4d5db0e10cd719fd47e3 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:23:59.885110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70bb61-6f29-46c9-af16-d91d08808669 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:59.885110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70bb61-6f29-46c9-af16-d91d08808669 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:59.885110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70bb61-6f29-46c9-af16-d91d08808669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:23:59.904761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ec70bb61-6f29-46c9-af16-d91d08808669 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:23:59.905961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ec70bb61-6f29-46c9-af16-d91d08808669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:23:59.931781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:23:59.932507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c386e8d7-f172-4d16-a8c9-9c8f147989f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d013d2f9834ce0a8884e6f93a95d13'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:59.943779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c386e8d7-f172-4d16-a8c9-9c8f147989f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d013d2f9834ce0a8884e6f93a95d13'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:59.944802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c386e8d7-f172-4d16-a8c9-9c8f147989f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d013d2f9834ce0a8884e6f93a95d13'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:23:59.953972 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2389/4854] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:23:59 2022] DELETE /identity/v3/users/b7d013d2f9834ce0a8884e6f93a95d13 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:23:59.955620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d9f04-6590-4e74-9911-5c7ee089ce5b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:23:59.956197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d9f04-6590-4e74-9911-5c7ee089ce5b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:23:59.956681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d9f04-6590-4e74-9911-5c7ee089ce5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:00.019882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-dd6d9f04-6590-4e74-9911-5c7ee089ce5b None None] MFA Rules not processed for user `a23fafbab18d41ee82b84bbdf94cf0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:00.021081 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2466/4855] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:00.029726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-dd6d9f04-6590-4e74-9911-5c7ee089ce5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:00.048826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2b0e6-e9fe-4e81-b6ac-3f90dc3291bc None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:00.048826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2b0e6-e9fe-4e81-b6ac-3f90dc3291bc None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:00.056264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2b0e6-e9fe-4e81-b6ac-3f90dc3291bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:00.084077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=86,keystone:UPDATE=3,keystone:INSERT=6,keystone:DELETE=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:00.117325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-22c2b0e6-e9fe-4e81-b6ac-3f90dc3291bc None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:00.119705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-22c2b0e6-e9fe-4e81-b6ac-3f90dc3291bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:00.239538 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2390/4856] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:23:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:00.239538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74c2c2-c69e-4544-a6a2-0420981eaafc None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:00.239538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74c2c2-c69e-4544-a6a2-0420981eaafc None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:00.239538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74c2c2-c69e-4544-a6a2-0420981eaafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:00.289306 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2467/4857] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:00.289306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2b0e6-e9fe-4e81-b6ac-3f90dc3291bc None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:00.293276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-de74c2c2-c69e-4544-a6a2-0420981eaafc None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:00.294347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-22c2b0e6-e9fe-4e81-b6ac-3f90dc3291bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:00.298421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-de74c2c2-c69e-4544-a6a2-0420981eaafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:00.320597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2b0e6-e9fe-4e81-b6ac-3f90dc3291bc None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:00.322490 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2391/4858] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:00.323386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74c2c2-c69e-4544-a6a2-0420981eaafc None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:00.327956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-de74c2c2-c69e-4544-a6a2-0420981eaafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:00.329015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892923b5-814c-4230-90a5-bdb950559588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:00.330386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892923b5-814c-4230-90a5-bdb950559588 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:00.330776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892923b5-814c-4230-90a5-bdb950559588 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:00.331243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892923b5-814c-4230-90a5-bdb950559588 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:00.332356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892923b5-814c-4230-90a5-bdb950559588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:00.334948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892923b5-814c-4230-90a5-bdb950559588 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:00.399115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74c2c2-c69e-4544-a6a2-0420981eaafc None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:00.405459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05b371-ee54-4848-80a3-390b4f3b95f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:00.405459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05b371-ee54-4848-80a3-390b4f3b95f9 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:00.405459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05b371-ee54-4848-80a3-390b4f3b95f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:00.405459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05b371-ee54-4848-80a3-390b4f3b95f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:00.416948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05b371-ee54-4848-80a3-390b4f3b95f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:00.419345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05b371-ee54-4848-80a3-390b4f3b95f9 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:00.432160 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2392/4859] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:24:00.433042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05b371-ee54-4848-80a3-390b4f3b95f9 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:00.443388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05b371-ee54-4848-80a3-390b4f3b95f9 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:00.452360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8e3e4-50f0-47f3-9854-47f5d9a3af29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:00.453036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8e3e4-50f0-47f3-9854-47f5d9a3af29 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:00.453318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8e3e4-50f0-47f3-9854-47f5d9a3af29 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:00.453597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8e3e4-50f0-47f3-9854-47f5d9a3af29 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:00.458789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8e3e4-50f0-47f3-9854-47f5d9a3af29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:24:00.463123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8e3e4-50f0-47f3-9854-47f5d9a3af29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:00.463123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8e3e4-50f0-47f3-9854-47f5d9a3af29 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:00.476599 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2393/4860] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:24:00.481745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8e3e4-50f0-47f3-9854-47f5d9a3af29 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:00.492883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8e3e4-50f0-47f3-9854-47f5d9a3af29 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:00.502284 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2468/4861] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:24:00 2022] POST /identity/v3/projects => generated 379 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:00.514289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892923b5-814c-4230-90a5-bdb950559588 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:00.677691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f0895-38a8-4cc9-8032-4ab787ef2095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:00.678414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f0895-38a8-4cc9-8032-4ab787ef2095 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:00.678706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f0895-38a8-4cc9-8032-4ab787ef2095 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:00.681558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f0895-38a8-4cc9-8032-4ab787ef2095 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:00.683096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f0895-38a8-4cc9-8032-4ab787ef2095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:00.693448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f0895-38a8-4cc9-8032-4ab787ef2095 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:00.697854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892923b5-814c-4230-90a5-bdb950559588 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:00.719794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec14e1-820a-4532-a471-e10003a48fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:00.720750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec14e1-820a-4532-a471-e10003a48fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:00.722907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec14e1-820a-4532-a471-e10003a48fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:00.723480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec14e1-820a-4532-a471-e10003a48fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:00.724402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec14e1-820a-4532-a471-e10003a48fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:00.727860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec14e1-820a-4532-a471-e10003a48fd5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:00.873317 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2469/4862] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:24:00 2022] POST /identity/v3/users => generated 296 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:00.873317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec14e1-820a-4532-a471-e10003a48fd5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:00.873719 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2394/4863] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:24:00 2022] POST /identity/v3/projects => generated 393 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:24:00.876004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f0895-38a8-4cc9-8032-4ab787ef2095 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:00.876283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f8ec14e1-820a-4532-a471-e10003a48fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:00.905707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec14e1-820a-4532-a471-e10003a48fd5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:01.095498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f0895-38a8-4cc9-8032-4ab787ef2095 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:01.097913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27261fe-4486-4daa-becc-3382c19a5d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:01.098806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27261fe-4486-4daa-becc-3382c19a5d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:01.102454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27261fe-4486-4daa-becc-3382c19a5d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:01.104529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27261fe-4486-4daa-becc-3382c19a5d10 admin admin] PATH_INFO: `/v3/projects/76f5320a44c24b1086bffdd1e81833d1` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:01.108150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88580f5-351e-410c-93e3-a8180655bf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:01.110876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27261fe-4486-4daa-becc-3382c19a5d10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76f5320a44c24b1086bffdd1e81833d1)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:01.112959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27261fe-4486-4daa-becc-3382c19a5d10 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:01.114480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88580f5-351e-410c-93e3-a8180655bf7e admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:01.114955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88580f5-351e-410c-93e3-a8180655bf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:01.117019 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88580f5-351e-410c-93e3-a8180655bf7e admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:01.118929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88580f5-351e-410c-93e3-a8180655bf7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:01.124575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88580f5-351e-410c-93e3-a8180655bf7e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:01.155148 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2395/4864] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:24:01.157150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88580f5-351e-410c-93e3-a8180655bf7e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:01.181139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88580f5-351e-410c-93e3-a8180655bf7e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:01.189466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db16f1b-cac8-4cf9-bb1f-dd228f3fe492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:01.190788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db16f1b-cac8-4cf9-bb1f-dd228f3fe492 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:01.191269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db16f1b-cac8-4cf9-bb1f-dd228f3fe492 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:01.191674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db16f1b-cac8-4cf9-bb1f-dd228f3fe492 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:01.192772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db16f1b-cac8-4cf9-bb1f-dd228f3fe492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:01.198355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db16f1b-cac8-4cf9-bb1f-dd228f3fe492 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:01.286760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c27261fe-4486-4daa-becc-3382c19a5d10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f5320a44c24b1086bffdd1e81833d1', 'request_id': 'req-c27261fe-4486-4daa-becc-3382c19a5d10'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:01.295498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c27261fe-4486-4daa-becc-3382c19a5d10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f5320a44c24b1086bffdd1e81833d1', 'request_id': 'req-c27261fe-4486-4daa-becc-3382c19a5d10'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:01.303349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c27261fe-4486-4daa-becc-3382c19a5d10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f5320a44c24b1086bffdd1e81833d1', 'request_id': 'req-c27261fe-4486-4daa-becc-3382c19a5d10'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:01.337299 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2396/4865] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:24:01 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:01.338450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db16f1b-cac8-4cf9-bb1f-dd228f3fe492 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:01.345799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3db16f1b-cac8-4cf9-bb1f-dd228f3fe492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:01.365408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db16f1b-cac8-4cf9-bb1f-dd228f3fe492 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:01.405080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c27261fe-4486-4daa-becc-3382c19a5d10 admin admin] The token cache is being invalidate because project 76f5320a44c24b1086bffdd1e81833d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:24:01.405679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c27261fe-4486-4daa-becc-3382c19a5d10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:01.406537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c27261fe-4486-4daa-becc-3382c19a5d10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:01.411675 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2470/4866] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:24:00 2022] DELETE /identity/v3/projects/76f5320a44c24b1086bffdd1e81833d1 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:01.413828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27261fe-4486-4daa-becc-3382c19a5d10 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:01.416206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c27261fe-4486-4daa-becc-3382c19a5d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:01.478048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6e55d-b5c1-494e-a12f-cd8a12c5ca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:01.479387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6e55d-b5c1-494e-a12f-cd8a12c5ca64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:01.479674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6e55d-b5c1-494e-a12f-cd8a12c5ca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:01.480465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6e55d-b5c1-494e-a12f-cd8a12c5ca64 admin admin] PATH_INFO: `/v3/projects/b3a695a829b140e1a9397134e0290cc1` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:01.481803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6e55d-b5c1-494e-a12f-cd8a12c5ca64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3a695a829b140e1a9397134e0290cc1)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:01.484327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6e55d-b5c1-494e-a12f-cd8a12c5ca64 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:01.523354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27261fe-4486-4daa-becc-3382c19a5d10 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:01.532623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af01c9-efdb-440b-b629-b2816e0b5555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:01.534863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af01c9-efdb-440b-b629-b2816e0b5555 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:01.535349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af01c9-efdb-440b-b629-b2816e0b5555 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:01.535658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af01c9-efdb-440b-b629-b2816e0b5555 admin admin] PATH_INFO: `/v3/projects/5a4706830b164b0080150ff24c137ece/users/f01ecd9543134b1f8a3c089fdba63fb2/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:01.555966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af01c9-efdb-440b-b629-b2816e0b5555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4706830b164b0080150ff24c137ece, user_id=f01ecd9543134b1f8a3c089fdba63fb2, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:01.558939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af01c9-efdb-440b-b629-b2816e0b5555 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:02.139780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:02.161676 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2471/4867] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:24:01 2022] PUT /identity/v3/projects/5a4706830b164b0080150ff24c137ece/users/f01ecd9543134b1f8a3c089fdba63fb2/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:02.161676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af01c9-efdb-440b-b629-b2816e0b5555 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:02.164323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-68af01c9-efdb-440b-b629-b2816e0b5555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:02.187718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fce6e55d-b5c1-494e-a12f-cd8a12c5ca64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3a695a829b140e1a9397134e0290cc1', 'request_id': 'req-fce6e55d-b5c1-494e-a12f-cd8a12c5ca64'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:02.202743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fce6e55d-b5c1-494e-a12f-cd8a12c5ca64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3a695a829b140e1a9397134e0290cc1', 'request_id': 'req-fce6e55d-b5c1-494e-a12f-cd8a12c5ca64'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:02.218565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fce6e55d-b5c1-494e-a12f-cd8a12c5ca64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3a695a829b140e1a9397134e0290cc1', 'request_id': 'req-fce6e55d-b5c1-494e-a12f-cd8a12c5ca64'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:02.317982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fce6e55d-b5c1-494e-a12f-cd8a12c5ca64 admin admin] The token cache is being invalidate because project b3a695a829b140e1a9397134e0290cc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:24:02.318716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fce6e55d-b5c1-494e-a12f-cd8a12c5ca64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:02.319835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fce6e55d-b5c1-494e-a12f-cd8a12c5ca64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:02.322734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af01c9-efdb-440b-b629-b2816e0b5555 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:02.323418 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2397/4868] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:24:01 2022] DELETE /identity/v3/projects/b3a695a829b140e1a9397134e0290cc1 => generated 0 bytes in 985 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:02.326410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c73fd8-650f-41cf-aa59-401068669b2e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:02.327043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c73fd8-650f-41cf-aa59-401068669b2e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:02.327525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c73fd8-650f-41cf-aa59-401068669b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:02.359950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-30c73fd8-650f-41cf-aa59-401068669b2e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:02.360520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-30c73fd8-650f-41cf-aa59-401068669b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:02.470167 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2398/4869] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:02.471701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55780d85-b43c-4733-b77f-2d864c488c7d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:02.472002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55780d85-b43c-4733-b77f-2d864c488c7d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:02.472283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55780d85-b43c-4733-b77f-2d864c488c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:02.489386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedd08d-7172-4ad0-be38-3809fce0cab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:02.490092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedd08d-7172-4ad0-be38-3809fce0cab3 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:02.490376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedd08d-7172-4ad0-be38-3809fce0cab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:02.490652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedd08d-7172-4ad0-be38-3809fce0cab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:02.491432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aedd08d-7172-4ad0-be38-3809fce0cab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:02.493067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aedd08d-7172-4ad0-be38-3809fce0cab3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:02.506347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-55780d85-b43c-4733-b77f-2d864c488c7d None None] MFA Rules not processed for user `027dcc48e4fd4c36a5004096ad5e43f8`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:02.507907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-55780d85-b43c-4733-b77f-2d864c488c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:02.529767 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2472/4870] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:02.531263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedd08d-7172-4ad0-be38-3809fce0cab3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:02.537900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6aedd08d-7172-4ad0-be38-3809fce0cab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:02.569801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedd08d-7172-4ad0-be38-3809fce0cab3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:02.575996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29663ac6-760f-4cef-9cf1-c68ec39fda31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:02.576891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29663ac6-760f-4cef-9cf1-c68ec39fda31 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:02.577374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29663ac6-760f-4cef-9cf1-c68ec39fda31 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:02.577825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29663ac6-760f-4cef-9cf1-c68ec39fda31 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:02.578876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29663ac6-760f-4cef-9cf1-c68ec39fda31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:02.583766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29663ac6-760f-4cef-9cf1-c68ec39fda31 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:02.596542 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2473/4871] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:02.598126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29663ac6-760f-4cef-9cf1-c68ec39fda31 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:02.602517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-29663ac6-760f-4cef-9cf1-c68ec39fda31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:02.639404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29663ac6-760f-4cef-9cf1-c68ec39fda31 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:02.650201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c42af2-9713-4673-9130-ed381c884278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:02.651158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c42af2-9713-4673-9130-ed381c884278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:02.652360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c42af2-9713-4673-9130-ed381c884278 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:02.652850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c42af2-9713-4673-9130-ed381c884278 admin admin] PATH_INFO: `/v3/users/ec0c0e321f464cdfa0e3d9f2136a99d3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:02.655441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c42af2-9713-4673-9130-ed381c884278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec0c0e321f464cdfa0e3d9f2136a99d3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:02.657915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c42af2-9713-4673-9130-ed381c884278 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:02.745667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:02.747421 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2399/4872] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:02.749043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0990e3e-affb-4515-b679-21e480f5c662 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:02.749337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0990e3e-affb-4515-b679-21e480f5c662 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:02.749620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0990e3e-affb-4515-b679-21e480f5c662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:02.799971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a0990e3e-affb-4515-b679-21e480f5c662 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:02.801347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a0990e3e-affb-4515-b679-21e480f5c662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:02.826846 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2400/4873] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:02.827290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0990e3e-affb-4515-b679-21e480f5c662 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:02.831930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a0990e3e-affb-4515-b679-21e480f5c662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:02.865369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0990e3e-affb-4515-b679-21e480f5c662 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:02.878856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf31e4-bdec-4081-b10a-ddc467c55797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:02.883584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf31e4-bdec-4081-b10a-ddc467c55797 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:02.883584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf31e4-bdec-4081-b10a-ddc467c55797 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:02.883584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf31e4-bdec-4081-b10a-ddc467c55797 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:02.885228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf31e4-bdec-4081-b10a-ddc467c55797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:02.887215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf31e4-bdec-4081-b10a-ddc467c55797 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:02.903127 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2401/4874] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:02.905208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf31e4-bdec-4081-b10a-ddc467c55797 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:02.929713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf31e4-bdec-4081-b10a-ddc467c55797 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:02.944683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a318cd3-c3c6-4325-842e-ef443ffd2c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:02.946970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a318cd3-c3c6-4325-842e-ef443ffd2c99 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:02.948313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a318cd3-c3c6-4325-842e-ef443ffd2c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:02.948637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a318cd3-c3c6-4325-842e-ef443ffd2c99 admin admin] PATH_INFO: `/v3/projects/5a4706830b164b0080150ff24c137ece/users/f01ecd9543134b1f8a3c089fdba63fb2/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:02.954149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a318cd3-c3c6-4325-842e-ef443ffd2c99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4706830b164b0080150ff24c137ece, user_id=f01ecd9543134b1f8a3c089fdba63fb2, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:02.959930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a318cd3-c3c6-4325-842e-ef443ffd2c99 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:03.001882 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2402/4875] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:24:02 2022] PUT /identity/v3/projects/5a4706830b164b0080150ff24c137ece/users/f01ecd9543134b1f8a3c089fdba63fb2/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:03.002739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a318cd3-c3c6-4325-842e-ef443ffd2c99 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:03.039632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-86c42af2-9713-4673-9130-ed381c884278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec0c0e321f464cdfa0e3d9f2136a99d3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:03.059795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-86c42af2-9713-4673-9130-ed381c884278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec0c0e321f464cdfa0e3d9f2136a99d3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:03.110525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a318cd3-c3c6-4325-842e-ef443ffd2c99 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:03.117502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272b94e-f133-4ca4-b9d4-e4f3c1bf9767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:03.121451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272b94e-f133-4ca4-b9d4-e4f3c1bf9767 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:03.121647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272b94e-f133-4ca4-b9d4-e4f3c1bf9767 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:03.121907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272b94e-f133-4ca4-b9d4-e4f3c1bf9767 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:03.123169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272b94e-f133-4ca4-b9d4-e4f3c1bf9767 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:24:03.123910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272b94e-f133-4ca4-b9d4-e4f3c1bf9767 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:03.125615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272b94e-f133-4ca4-b9d4-e4f3c1bf9767 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:03.156412 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2403/4876] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:24:03.158755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272b94e-f133-4ca4-b9d4-e4f3c1bf9767 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:03.166800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-86c42af2-9713-4673-9130-ed381c884278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec0c0e321f464cdfa0e3d9f2136a99d3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:03.169956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-86c42af2-9713-4673-9130-ed381c884278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec0c0e321f464cdfa0e3d9f2136a99d3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:03.206775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-86c42af2-9713-4673-9130-ed381c884278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec0c0e321f464cdfa0e3d9f2136a99d3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:03.209171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272b94e-f133-4ca4-b9d4-e4f3c1bf9767 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:03.216177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ececedb-1d5a-46d0-9815-8ff4212a7b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:03.217452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ececedb-1d5a-46d0-9815-8ff4212a7b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:03.217909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ececedb-1d5a-46d0-9815-8ff4212a7b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:03.218447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ececedb-1d5a-46d0-9815-8ff4212a7b87 admin admin] PATH_INFO: `/v3/projects/738c7a543cf345018cd3e6e544aadc19/users/9b79af01c1ca41e38c99193165f4e2ac/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:03.219683 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2474/4877] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:24:02 2022] DELETE /identity/v3/users/ec0c0e321f464cdfa0e3d9f2136a99d3 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:03.221589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c42af2-9713-4673-9130-ed381c884278 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:03.222842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-86c42af2-9713-4673-9130-ed381c884278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:03.266554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ececedb-1d5a-46d0-9815-8ff4212a7b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=738c7a543cf345018cd3e6e544aadc19, user_id=9b79af01c1ca41e38c99193165f4e2ac, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:03.273460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ececedb-1d5a-46d0-9815-8ff4212a7b87 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:03.360099 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2404/4878] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:24:03 2022] PUT /identity/v3/projects/738c7a543cf345018cd3e6e544aadc19/users/9b79af01c1ca41e38c99193165f4e2ac/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:03.371205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96733535-49d6-4d92-9b81-4af7dbfce421 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:03.372461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96733535-49d6-4d92-9b81-4af7dbfce421 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:03.372745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96733535-49d6-4d92-9b81-4af7dbfce421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:03.428710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-96733535-49d6-4d92-9b81-4af7dbfce421 None None] MFA Rules not processed for user `9b79af01c1ca41e38c99193165f4e2ac`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:03.428710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-96733535-49d6-4d92-9b81-4af7dbfce421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:03.440744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c42af2-9713-4673-9130-ed381c884278 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:03.519605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:03.583442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab7e9f-629d-4be4-b149-3bdded369912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:03.584496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab7e9f-629d-4be4-b149-3bdded369912 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:03.586960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab7e9f-629d-4be4-b149-3bdded369912 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:03.587846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab7e9f-629d-4be4-b149-3bdded369912 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:03.590235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab7e9f-629d-4be4-b149-3bdded369912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:03.593292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab7e9f-629d-4be4-b149-3bdded369912 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:03.633239 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2405/4879] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:24:03.661454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96733535-49d6-4d92-9b81-4af7dbfce421 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:03.664045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-96733535-49d6-4d92-9b81-4af7dbfce421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:03.711108 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2475/4880] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:24:03 2022] POST /identity/v3/projects => generated 371 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:03.717571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab7e9f-629d-4be4-b149-3bdded369912 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:03.792189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96733535-49d6-4d92-9b81-4af7dbfce421 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:03.837583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab7e9f-629d-4be4-b149-3bdded369912 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:03.845786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a2e59-9668-4d8c-8729-ff523a9b3d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:03.847105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a2e59-9668-4d8c-8729-ff523a9b3d08 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:03.849075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a2e59-9668-4d8c-8729-ff523a9b3d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:03.849560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a2e59-9668-4d8c-8729-ff523a9b3d08 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:03.850490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a2e59-9668-4d8c-8729-ff523a9b3d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:03.852940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a2e59-9668-4d8c-8729-ff523a9b3d08 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:03.881711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d660b94-a6b5-4f92-ba26-4378cdfb4e75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:03.882616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d660b94-a6b5-4f92-ba26-4378cdfb4e75 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:03.882906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d660b94-a6b5-4f92-ba26-4378cdfb4e75 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:03.883214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d660b94-a6b5-4f92-ba26-4378cdfb4e75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:03.970257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d660b94-a6b5-4f92-ba26-4378cdfb4e75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:03.972032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d660b94-a6b5-4f92-ba26-4378cdfb4e75 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:03.984342 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2406/4881] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:24:04.018252 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2476/4882] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:24:03 2022] POST /identity/v3/users => generated 286 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:04.022256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d660b94-a6b5-4f92-ba26-4378cdfb4e75 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:04.036536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d660b94-a6b5-4f92-ba26-4378cdfb4e75 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:04.050524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f845477-1523-4b40-8b90-66fa0105e3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:04.051772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f845477-1523-4b40-8b90-66fa0105e3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:04.052045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f845477-1523-4b40-8b90-66fa0105e3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:04.052655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f845477-1523-4b40-8b90-66fa0105e3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:04.053740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f845477-1523-4b40-8b90-66fa0105e3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:04.055935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f845477-1523-4b40-8b90-66fa0105e3a3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:04.072427 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2407/4883] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:04.075135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a2e59-9668-4d8c-8729-ff523a9b3d08 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:04.086406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a2e59-9668-4d8c-8729-ff523a9b3d08 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:04.092485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf41f5-c23d-4db7-ba3a-0690ef2e5f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:04.093224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf41f5-c23d-4db7-ba3a-0690ef2e5f74 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:04.093529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf41f5-c23d-4db7-ba3a-0690ef2e5f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:04.093792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf41f5-c23d-4db7-ba3a-0690ef2e5f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:04.094528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf41f5-c23d-4db7-ba3a-0690ef2e5f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:04.096374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf41f5-c23d-4db7-ba3a-0690ef2e5f74 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:04.109219 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2477/4884] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:04.112919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f845477-1523-4b40-8b90-66fa0105e3a3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:04.126836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f845477-1523-4b40-8b90-66fa0105e3a3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:04.132802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e964f69-3d12-405a-a6a6-ab67d4fa34d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:04.139655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e964f69-3d12-405a-a6a6-ab67d4fa34d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:04.139655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e964f69-3d12-405a-a6a6-ab67d4fa34d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:04.139655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e964f69-3d12-405a-a6a6-ab67d4fa34d5 admin admin] PATH_INFO: `/v3/projects/b61b070aa69a40c29b7188b2670b71a0/users/34e7dd3c2a93488d8e83839a8737b108/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:04.163260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e964f69-3d12-405a-a6a6-ab67d4fa34d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b61b070aa69a40c29b7188b2670b71a0, user_id=34e7dd3c2a93488d8e83839a8737b108, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:04.166508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e964f69-3d12-405a-a6a6-ab67d4fa34d5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:04.261907 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2408/4885] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:24:04 2022] PUT /identity/v3/projects/b61b070aa69a40c29b7188b2670b71a0/users/34e7dd3c2a93488d8e83839a8737b108/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:24:04.271169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aec4f-9efa-44ba-8b1e-ed40c43b2b37 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:04.275479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aec4f-9efa-44ba-8b1e-ed40c43b2b37 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:04.275479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aec4f-9efa-44ba-8b1e-ed40c43b2b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:04.334291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-023aec4f-9efa-44ba-8b1e-ed40c43b2b37 None None] MFA Rules not processed for user `34e7dd3c2a93488d8e83839a8737b108`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:04.335846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-023aec4f-9efa-44ba-8b1e-ed40c43b2b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:04.469161 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2478/4886] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:04.502982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:04.856061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e964f69-3d12-405a-a6a6-ab67d4fa34d5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:04.858910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2e964f69-3d12-405a-a6a6-ab67d4fa34d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:05.015947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e964f69-3d12-405a-a6a6-ab67d4fa34d5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:05.038515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84847501-024d-4959-b50e-5c23591cf738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:05.040421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84847501-024d-4959-b50e-5c23591cf738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:05.040923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84847501-024d-4959-b50e-5c23591cf738 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:05.041310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84847501-024d-4959-b50e-5c23591cf738 admin admin] PATH_INFO: `/v3/projects/e695602b15db4b80adea6ff7af2dd3ac` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:05.043784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84847501-024d-4959-b50e-5c23591cf738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e695602b15db4b80adea6ff7af2dd3ac)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:05.047768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84847501-024d-4959-b50e-5c23591cf738 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:05.259263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-84847501-024d-4959-b50e-5c23591cf738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e695602b15db4b80adea6ff7af2dd3ac', 'request_id': 'req-84847501-024d-4959-b50e-5c23591cf738'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:05.266901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-84847501-024d-4959-b50e-5c23591cf738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e695602b15db4b80adea6ff7af2dd3ac', 'request_id': 'req-84847501-024d-4959-b50e-5c23591cf738'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:05.279480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-84847501-024d-4959-b50e-5c23591cf738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e695602b15db4b80adea6ff7af2dd3ac', 'request_id': 'req-84847501-024d-4959-b50e-5c23591cf738'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:05.326635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023aec4f-9efa-44ba-8b1e-ed40c43b2b37 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:05.332227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-023aec4f-9efa-44ba-8b1e-ed40c43b2b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:05.390584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-84847501-024d-4959-b50e-5c23591cf738 admin admin] The token cache is being invalidate because project e695602b15db4b80adea6ff7af2dd3ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:24:05.391362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-84847501-024d-4959-b50e-5c23591cf738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:05.393026 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-84847501-024d-4959-b50e-5c23591cf738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:05.396913 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2409/4887] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:24:04 2022] DELETE /identity/v3/projects/e695602b15db4b80adea6ff7af2dd3ac => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:05.400915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84847501-024d-4959-b50e-5c23591cf738 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:05.407823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-84847501-024d-4959-b50e-5c23591cf738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:05.484051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023aec4f-9efa-44ba-8b1e-ed40c43b2b37 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:05.619234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84847501-024d-4959-b50e-5c23591cf738 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:05.620960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de4e4b-3b0c-4a80-975b-32265ae7faa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:05.621956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de4e4b-3b0c-4a80-975b-32265ae7faa0 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:05.623702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de4e4b-3b0c-4a80-975b-32265ae7faa0 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:05.627458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de4e4b-3b0c-4a80-975b-32265ae7faa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:05.633174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1abf6-50ba-453c-bebc-8b716f3a73ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:05.633834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-49de4e4b-3b0c-4a80-975b-32265ae7faa0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:05.634523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1abf6-50ba-453c-bebc-8b716f3a73ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:05.634974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1abf6-50ba-453c-bebc-8b716f3a73ff admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:05.635509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1abf6-50ba-453c-bebc-8b716f3a73ff admin admin] PATH_INFO: `/v3/users/11205317c070496499da3741e1659d51` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:05.637330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1abf6-50ba-453c-bebc-8b716f3a73ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=11205317c070496499da3741e1659d51)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:05.639720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1abf6-50ba-453c-bebc-8b716f3a73ff admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:05.786215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de4e4b-3b0c-4a80-975b-32265ae7faa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:05.790793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de4e4b-3b0c-4a80-975b-32265ae7faa0 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:05.808248 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2479/4888] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:24:05.809720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687902b-dc97-494a-9b5d-490fe15d52df None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:05.810062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687902b-dc97-494a-9b5d-490fe15d52df None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:05.814634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687902b-dc97-494a-9b5d-490fe15d52df None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:05.814634 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2480/4889] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:24:05.830044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caefb54-1692-47a5-89ac-a667481084cf None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:05.830339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caefb54-1692-47a5-89ac-a667481084cf None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:05.830786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caefb54-1692-47a5-89ac-a667481084cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:05.890061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d4e1abf6-50ba-453c-bebc-8b716f3a73ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11205317c070496499da3741e1659d51'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:05.891891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5caefb54-1692-47a5-89ac-a667481084cf None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:05.895215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5caefb54-1692-47a5-89ac-a667481084cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:05.909051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d4e1abf6-50ba-453c-bebc-8b716f3a73ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11205317c070496499da3741e1659d51'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:06.021915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d4e1abf6-50ba-453c-bebc-8b716f3a73ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11205317c070496499da3741e1659d51'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:06.034985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d4e1abf6-50ba-453c-bebc-8b716f3a73ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11205317c070496499da3741e1659d51'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:06.036803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d4e1abf6-50ba-453c-bebc-8b716f3a73ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11205317c070496499da3741e1659d51'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:06.041530 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2481/4890] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:24:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:06.083240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caefb54-1692-47a5-89ac-a667481084cf None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:06.085316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5caefb54-1692-47a5-89ac-a667481084cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:06.093645 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2410/4891] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:24:05 2022] DELETE /identity/v3/users/11205317c070496499da3741e1659d51 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:06.121636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caefb54-1692-47a5-89ac-a667481084cf None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:06.248575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879aac4-e593-4f00-9417-52fad61ba12f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:06.250152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879aac4-e593-4f00-9417-52fad61ba12f service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:06.250522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879aac4-e593-4f00-9417-52fad61ba12f service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:06.251241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879aac4-e593-4f00-9417-52fad61ba12f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:06.254061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8879aac4-e593-4f00-9417-52fad61ba12f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:06.280429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879aac4-e593-4f00-9417-52fad61ba12f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:06.282061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879aac4-e593-4f00-9417-52fad61ba12f service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:06.302872 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2482/4892] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:24:06.516146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=84,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=12 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:07.114778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb27cc-95a5-463d-aa7f-5845ee067d4c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:07.115196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb27cc-95a5-463d-aa7f-5845ee067d4c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:07.115575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb27cc-95a5-463d-aa7f-5845ee067d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:07.156550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-11eb27cc-95a5-463d-aa7f-5845ee067d4c None None] MFA Rules not processed for user `027dcc48e4fd4c36a5004096ad5e43f8`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:07.157992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-11eb27cc-95a5-463d-aa7f-5845ee067d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:07.189849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:07.262930 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2411/4893] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:07.363753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879aac4-e593-4f00-9417-52fad61ba12f service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:07.365339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8879aac4-e593-4f00-9417-52fad61ba12f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:07.508146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879aac4-e593-4f00-9417-52fad61ba12f service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:07.524090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905496a9-b44a-49b3-90f2-64b0497e0785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:07.524984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905496a9-b44a-49b3-90f2-64b0497e0785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:07.525266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905496a9-b44a-49b3-90f2-64b0497e0785 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:07.525540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905496a9-b44a-49b3-90f2-64b0497e0785 admin admin] PATH_INFO: `/v3/projects/ace5615ae179446691f1a8bb8e6c4341` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:07.528346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905496a9-b44a-49b3-90f2-64b0497e0785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace5615ae179446691f1a8bb8e6c4341)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:07.530028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905496a9-b44a-49b3-90f2-64b0497e0785 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:07.743710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-905496a9-b44a-49b3-90f2-64b0497e0785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace5615ae179446691f1a8bb8e6c4341', 'request_id': 'req-905496a9-b44a-49b3-90f2-64b0497e0785'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:07.764869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-905496a9-b44a-49b3-90f2-64b0497e0785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace5615ae179446691f1a8bb8e6c4341', 'request_id': 'req-905496a9-b44a-49b3-90f2-64b0497e0785'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:07.791940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-905496a9-b44a-49b3-90f2-64b0497e0785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace5615ae179446691f1a8bb8e6c4341', 'request_id': 'req-905496a9-b44a-49b3-90f2-64b0497e0785'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:07.870754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-905496a9-b44a-49b3-90f2-64b0497e0785 admin admin] The token cache is being invalidate because project ace5615ae179446691f1a8bb8e6c4341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:24:07.870754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-905496a9-b44a-49b3-90f2-64b0497e0785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:07.870754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-905496a9-b44a-49b3-90f2-64b0497e0785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:07.873547 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2483/4894] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:24:07 2022] DELETE /identity/v3/projects/ace5615ae179446691f1a8bb8e6c4341 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:07.878645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76f2ca-5c29-4cac-964b-364b42d7d29f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:07.879524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76f2ca-5c29-4cac-964b-364b42d7d29f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:07.879981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76f2ca-5c29-4cac-964b-364b42d7d29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:07.927988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9c76f2ca-5c29-4cac-964b-364b42d7d29f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:07.932118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9c76f2ca-5c29-4cac-964b-364b42d7d29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:08.054862 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2412/4895] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:08.066697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b435d-16eb-4541-8ed7-fd2d4dac05d6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:08.067099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b435d-16eb-4541-8ed7-fd2d4dac05d6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:08.067373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b435d-16eb-4541-8ed7-fd2d4dac05d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:08.116466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-444b435d-16eb-4541-8ed7-fd2d4dac05d6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:08.117632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-444b435d-16eb-4541-8ed7-fd2d4dac05d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:08.141493 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2484/4896] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:08.147198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76f2ca-5c29-4cac-964b-364b42d7d29f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:08.195424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76f2ca-5c29-4cac-964b-364b42d7d29f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:08.202238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbea48b-e507-4685-a4b6-b78cdd0094f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:08.203276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbea48b-e507-4685-a4b6-b78cdd0094f4 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:08.203729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbea48b-e507-4685-a4b6-b78cdd0094f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:08.204183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbea48b-e507-4685-a4b6-b78cdd0094f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:08.205263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbea48b-e507-4685-a4b6-b78cdd0094f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:24:08.205984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbea48b-e507-4685-a4b6-b78cdd0094f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:08.208364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbea48b-e507-4685-a4b6-b78cdd0094f4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:08.226521 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2413/4897] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:24:08.232730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b435d-16eb-4541-8ed7-fd2d4dac05d6 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:08.282331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b435d-16eb-4541-8ed7-fd2d4dac05d6 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:08.295614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54218b8a-6fa5-46aa-831f-8448acea4d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:08.297990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54218b8a-6fa5-46aa-831f-8448acea4d94 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:08.298600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54218b8a-6fa5-46aa-831f-8448acea4d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:08.299153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54218b8a-6fa5-46aa-831f-8448acea4d94 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:08.300700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54218b8a-6fa5-46aa-831f-8448acea4d94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:08.304274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54218b8a-6fa5-46aa-831f-8448acea4d94 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:08.528750 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2485/4898] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:24:08 2022] POST /identity/v3/projects => generated 369 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:08.539341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbea48b-e507-4685-a4b6-b78cdd0094f4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:08.546589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54218b8a-6fa5-46aa-831f-8448acea4d94 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:08.551901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-54218b8a-6fa5-46aa-831f-8448acea4d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:08.564502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbea48b-e507-4685-a4b6-b78cdd0094f4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:08.751758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17dfe3f-5084-47ed-90de-7848a3e1ec3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:08.752451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dfe3f-5084-47ed-90de-7848a3e1ec3a admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:08.752974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dfe3f-5084-47ed-90de-7848a3e1ec3a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:08.753263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dfe3f-5084-47ed-90de-7848a3e1ec3a admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:08.753970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17dfe3f-5084-47ed-90de-7848a3e1ec3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:08.759750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17dfe3f-5084-47ed-90de-7848a3e1ec3a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:08.814889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54218b8a-6fa5-46aa-831f-8448acea4d94 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:08.836889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125987ea-d907-4ff8-a966-e47c692a11aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:08.837844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125987ea-d907-4ff8-a966-e47c692a11aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:08.839991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125987ea-d907-4ff8-a966-e47c692a11aa admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:08.840371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125987ea-d907-4ff8-a966-e47c692a11aa admin admin] PATH_INFO: `/v3/users/34e7dd3c2a93488d8e83839a8737b108` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:08.841743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125987ea-d907-4ff8-a966-e47c692a11aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e7dd3c2a93488d8e83839a8737b108)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:08.844487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125987ea-d907-4ff8-a966-e47c692a11aa admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:08.896017 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2414/4899] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:24:08 2022] POST /identity/v3/users => generated 285 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:08.896974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17dfe3f-5084-47ed-90de-7848a3e1ec3a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:08.930644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17dfe3f-5084-47ed-90de-7848a3e1ec3a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:08.943260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f0acb-b1c4-4801-8aaf-0e3471477b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:08.962967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f0acb-b1c4-4801-8aaf-0e3471477b0a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:08.962967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f0acb-b1c4-4801-8aaf-0e3471477b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:08.962967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f0acb-b1c4-4801-8aaf-0e3471477b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:08.962967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f0acb-b1c4-4801-8aaf-0e3471477b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:08.962967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f0acb-b1c4-4801-8aaf-0e3471477b0a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:08.987471 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2415/4900] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:08.991177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f0acb-b1c4-4801-8aaf-0e3471477b0a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:09.018436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f0acb-b1c4-4801-8aaf-0e3471477b0a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:09.034793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3908e82-6882-4eb6-bf1b-56728db62c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:09.035807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3908e82-6882-4eb6-bf1b-56728db62c93 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:09.036261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3908e82-6882-4eb6-bf1b-56728db62c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:09.036725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3908e82-6882-4eb6-bf1b-56728db62c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:09.037629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3908e82-6882-4eb6-bf1b-56728db62c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:09.039582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3908e82-6882-4eb6-bf1b-56728db62c93 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:09.065681 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2416/4901] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:09.072129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3908e82-6882-4eb6-bf1b-56728db62c93 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:09.100846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3908e82-6882-4eb6-bf1b-56728db62c93 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:09.108035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9eda10-e49e-4e62-bf38-90affeae7dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:09.109039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9eda10-e49e-4e62-bf38-90affeae7dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:09.109331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9eda10-e49e-4e62-bf38-90affeae7dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:09.109612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9eda10-e49e-4e62-bf38-90affeae7dc9 admin admin] PATH_INFO: `/v3/projects/ff06e31821fd40b688b6e2cc7596ce7c/users/594eb89ccb444cee8bed6c06ecddb637/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:09.137633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-125987ea-d907-4ff8-a966-e47c692a11aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e7dd3c2a93488d8e83839a8737b108'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:09.145745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9eda10-e49e-4e62-bf38-90affeae7dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff06e31821fd40b688b6e2cc7596ce7c, user_id=594eb89ccb444cee8bed6c06ecddb637, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:09.149069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9eda10-e49e-4e62-bf38-90affeae7dc9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:09.162851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-125987ea-d907-4ff8-a966-e47c692a11aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e7dd3c2a93488d8e83839a8737b108'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:09.245372 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2417/4902] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:24:09 2022] PUT /identity/v3/projects/ff06e31821fd40b688b6e2cc7596ce7c/users/594eb89ccb444cee8bed6c06ecddb637/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:09.255824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33840745-5b4c-4f58-817f-7feda7b027a2 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:09.256242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33840745-5b4c-4f58-817f-7feda7b027a2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:09.256624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33840745-5b4c-4f58-817f-7feda7b027a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:09.267714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-125987ea-d907-4ff8-a966-e47c692a11aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e7dd3c2a93488d8e83839a8737b108'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:09.269333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-125987ea-d907-4ff8-a966-e47c692a11aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e7dd3c2a93488d8e83839a8737b108'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:09.294346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-33840745-5b4c-4f58-817f-7feda7b027a2 None None] MFA Rules not processed for user `594eb89ccb444cee8bed6c06ecddb637`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:09.294927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-125987ea-d907-4ff8-a966-e47c692a11aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e7dd3c2a93488d8e83839a8737b108'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:09.297459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-33840745-5b4c-4f58-817f-7feda7b027a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:09.305146 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2486/4903] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:24:08 2022] DELETE /identity/v3/users/34e7dd3c2a93488d8e83839a8737b108 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:09.311895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39575f0-d5f3-4cf5-80f0-b7288c6c5d29 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:09.312324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39575f0-d5f3-4cf5-80f0-b7288c6c5d29 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:09.312758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39575f0-d5f3-4cf5-80f0-b7288c6c5d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:09.341508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e39575f0-d5f3-4cf5-80f0-b7288c6c5d29 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:09.346786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e39575f0-d5f3-4cf5-80f0-b7288c6c5d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:09.436610 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2418/4904] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:24:09.442585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33840745-5b4c-4f58-817f-7feda7b027a2 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:09.444218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-33840745-5b4c-4f58-817f-7feda7b027a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:09.518178 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2487/4905] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:09.545650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39575f0-d5f3-4cf5-80f0-b7288c6c5d29 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:09.547412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e39575f0-d5f3-4cf5-80f0-b7288c6c5d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:09.596810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33840745-5b4c-4f58-817f-7feda7b027a2 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:09.610118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a292e9-2054-4e2e-bb9b-69926cade485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:09.610804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a292e9-2054-4e2e-bb9b-69926cade485 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:09.611297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a292e9-2054-4e2e-bb9b-69926cade485 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:09.611915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a292e9-2054-4e2e-bb9b-69926cade485 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:09.612790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a292e9-2054-4e2e-bb9b-69926cade485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:09.617593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a292e9-2054-4e2e-bb9b-69926cade485 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:09.651044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39575f0-d5f3-4cf5-80f0-b7288c6c5d29 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:09.654370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:09.658484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2491eab-2636-4123-8ada-72ec9e14edd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:09.659545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2491eab-2636-4123-8ada-72ec9e14edd3 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:09.660014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2491eab-2636-4123-8ada-72ec9e14edd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:09.660748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2491eab-2636-4123-8ada-72ec9e14edd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:09.675802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2491eab-2636-4123-8ada-72ec9e14edd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:09.693150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2491eab-2636-4123-8ada-72ec9e14edd3 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:09.707823 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2488/4906] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:24:09.758056 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2419/4907] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:24:09 2022] POST /identity/v3/projects => generated 367 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:09.763324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2491eab-2636-4123-8ada-72ec9e14edd3 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:09.785458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2491eab-2636-4123-8ada-72ec9e14edd3 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:09.908805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ff33b-bfe6-4172-aff0-2e0c866d35f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:09.910584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ff33b-bfe6-4172-aff0-2e0c866d35f2 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:09.911316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ff33b-bfe6-4172-aff0-2e0c866d35f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:09.911814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ff33b-bfe6-4172-aff0-2e0c866d35f2 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:09.913391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ff33b-bfe6-4172-aff0-2e0c866d35f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:09.915964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ff33b-bfe6-4172-aff0-2e0c866d35f2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:09.951741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:10.013163 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2489/4908] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:24:09 2022] POST /identity/v3/users => generated 290 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:10.017403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a292e9-2054-4e2e-bb9b-69926cade485 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:10.045885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a292e9-2054-4e2e-bb9b-69926cade485 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:10.051755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99baf5-8525-469a-949a-a85ef3c5a359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:10.052722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99baf5-8525-469a-949a-a85ef3c5a359 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:10.053182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99baf5-8525-469a-949a-a85ef3c5a359 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:10.053639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99baf5-8525-469a-949a-a85ef3c5a359 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:10.054373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99baf5-8525-469a-949a-a85ef3c5a359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:10.056036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99baf5-8525-469a-949a-a85ef3c5a359 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:10.085747 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2420/4909] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:10.090340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ff33b-bfe6-4172-aff0-2e0c866d35f2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:10.103963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ff33b-bfe6-4172-aff0-2e0c866d35f2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:10.112061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e5d25-f70d-4b58-a2ee-b2b2b17c6820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:10.113035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e5d25-f70d-4b58-a2ee-b2b2b17c6820 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:10.113290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e5d25-f70d-4b58-a2ee-b2b2b17c6820 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:10.113573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e5d25-f70d-4b58-a2ee-b2b2b17c6820 admin admin] PATH_INFO: `/v3/projects/6e8b4f27846f4fb594cccf661747d160/users/2a2bd6fe7cf94604b7b1495047f63cdb/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:10.134014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e5d25-f70d-4b58-a2ee-b2b2b17c6820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e8b4f27846f4fb594cccf661747d160, user_id=2a2bd6fe7cf94604b7b1495047f63cdb, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:10.137989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e5d25-f70d-4b58-a2ee-b2b2b17c6820 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:10.225946 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2490/4910] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:24:10 2022] PUT /identity/v3/projects/6e8b4f27846f4fb594cccf661747d160/users/2a2bd6fe7cf94604b7b1495047f63cdb/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:10.228124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99baf5-8525-469a-949a-a85ef3c5a359 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:10.244668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99baf5-8525-469a-949a-a85ef3c5a359 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:10.396297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87861cff-b419-4e5f-a12e-1f8e35af6eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:10.397076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87861cff-b419-4e5f-a12e-1f8e35af6eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:10.397365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87861cff-b419-4e5f-a12e-1f8e35af6eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:10.397649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87861cff-b419-4e5f-a12e-1f8e35af6eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:10.399727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87861cff-b419-4e5f-a12e-1f8e35af6eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:10.402182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87861cff-b419-4e5f-a12e-1f8e35af6eb2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:10.416437 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2421/4911] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:10.420841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e5d25-f70d-4b58-a2ee-b2b2b17c6820 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:10.435496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e5d25-f70d-4b58-a2ee-b2b2b17c6820 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:10.441307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ced3fa-998b-48a0-8ff9-6a10981bf368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:10.442254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ced3fa-998b-48a0-8ff9-6a10981bf368 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:10.442546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ced3fa-998b-48a0-8ff9-6a10981bf368 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:10.442829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ced3fa-998b-48a0-8ff9-6a10981bf368 admin admin] PATH_INFO: `/v3/projects/6e8b4f27846f4fb594cccf661747d160/users/2a2bd6fe7cf94604b7b1495047f63cdb/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:10.445307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ced3fa-998b-48a0-8ff9-6a10981bf368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e8b4f27846f4fb594cccf661747d160, user_id=2a2bd6fe7cf94604b7b1495047f63cdb, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:10.448047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ced3fa-998b-48a0-8ff9-6a10981bf368 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:10.460791 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2491/4912] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:24:10 2022] PUT /identity/v3/projects/6e8b4f27846f4fb594cccf661747d160/users/2a2bd6fe7cf94604b7b1495047f63cdb/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:10.472012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc1755-7123-4f84-b90d-996091b6da31 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:10.472312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc1755-7123-4f84-b90d-996091b6da31 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:10.472596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc1755-7123-4f84-b90d-996091b6da31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:10.529365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8abc1755-7123-4f84-b90d-996091b6da31 None None] MFA Rules not processed for user `2a2bd6fe7cf94604b7b1495047f63cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:10.532938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8abc1755-7123-4f84-b90d-996091b6da31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:10.643524 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2422/4913] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:10 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:10.664088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ced3fa-998b-48a0-8ff9-6a10981bf368 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:10.666446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c4ced3fa-998b-48a0-8ff9-6a10981bf368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:10.770199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ced3fa-998b-48a0-8ff9-6a10981bf368 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:10.777145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e490b-94b9-49a3-9fd6-12f51270946e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:10.780139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e490b-94b9-49a3-9fd6-12f51270946e service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:10.780750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e490b-94b9-49a3-9fd6-12f51270946e service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:10.781509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e490b-94b9-49a3-9fd6-12f51270946e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:10.805798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e490b-94b9-49a3-9fd6-12f51270946e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:10.809578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e490b-94b9-49a3-9fd6-12f51270946e service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:10.827877 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2492/4914] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:10 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:24:10.920221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:UPDATE=3,keystone:DELETE=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:11.059700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc1755-7123-4f84-b90d-996091b6da31 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:11.061677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8abc1755-7123-4f84-b90d-996091b6da31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:11.191619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc1755-7123-4f84-b90d-996091b6da31 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:11.203897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60fade-0eb5-4f90-b1b4-9f6b4dc99e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:11.205717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60fade-0eb5-4f90-b1b4-9f6b4dc99e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:11.206199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60fade-0eb5-4f90-b1b4-9f6b4dc99e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:11.206647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60fade-0eb5-4f90-b1b4-9f6b4dc99e23 admin admin] PATH_INFO: `/v3/projects/b61b070aa69a40c29b7188b2670b71a0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:11.208161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60fade-0eb5-4f90-b1b4-9f6b4dc99e23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b61b070aa69a40c29b7188b2670b71a0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:11.212617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60fade-0eb5-4f90-b1b4-9f6b4dc99e23 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:11.407492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0a60fade-0eb5-4f90-b1b4-9f6b4dc99e23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b61b070aa69a40c29b7188b2670b71a0', 'request_id': 'req-0a60fade-0eb5-4f90-b1b4-9f6b4dc99e23'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:11.428287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0a60fade-0eb5-4f90-b1b4-9f6b4dc99e23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b61b070aa69a40c29b7188b2670b71a0', 'request_id': 'req-0a60fade-0eb5-4f90-b1b4-9f6b4dc99e23'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:11.450649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0a60fade-0eb5-4f90-b1b4-9f6b4dc99e23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b61b070aa69a40c29b7188b2670b71a0', 'request_id': 'req-0a60fade-0eb5-4f90-b1b4-9f6b4dc99e23'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:11.596316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0a60fade-0eb5-4f90-b1b4-9f6b4dc99e23 admin admin] The token cache is being invalidate because project b61b070aa69a40c29b7188b2670b71a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:24:11.598653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0a60fade-0eb5-4f90-b1b4-9f6b4dc99e23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:11.599661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0a60fade-0eb5-4f90-b1b4-9f6b4dc99e23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:11.608313 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2423/4915] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:24:11 2022] DELETE /identity/v3/projects/b61b070aa69a40c29b7188b2670b71a0 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:11.610009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edaacb-54ce-48a6-b5b3-3c2c5df60abe None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:11.610508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edaacb-54ce-48a6-b5b3-3c2c5df60abe None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:11.610656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edaacb-54ce-48a6-b5b3-3c2c5df60abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:11.641506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-29edaacb-54ce-48a6-b5b3-3c2c5df60abe None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:11.643390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-29edaacb-54ce-48a6-b5b3-3c2c5df60abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:11.752526 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2493/4916] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:11.752931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c8ec7-92ea-43b5-86f8-9438024d0ce9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:11.753242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c8ec7-92ea-43b5-86f8-9438024d0ce9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:11.753530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c8ec7-92ea-43b5-86f8-9438024d0ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:11.782987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-856c8ec7-92ea-43b5-86f8-9438024d0ce9 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:11.796222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-856c8ec7-92ea-43b5-86f8-9438024d0ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:11.817168 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2424/4917] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:24:11.825316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edaacb-54ce-48a6-b5b3-3c2c5df60abe None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:11.844940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edaacb-54ce-48a6-b5b3-3c2c5df60abe None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:11.851684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896b37f-fd3f-4e43-b617-521d591c0d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:11.853660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896b37f-fd3f-4e43-b617-521d591c0d03 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:11.854021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896b37f-fd3f-4e43-b617-521d591c0d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:11.855077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896b37f-fd3f-4e43-b617-521d591c0d03 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:11.856277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896b37f-fd3f-4e43-b617-521d591c0d03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:24:11.856664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896b37f-fd3f-4e43-b617-521d591c0d03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:11.858403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896b37f-fd3f-4e43-b617-521d591c0d03 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:11.879840 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2494/4918] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:24:11.880659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c8ec7-92ea-43b5-86f8-9438024d0ce9 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:11.906166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c8ec7-92ea-43b5-86f8-9438024d0ce9 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:11.918445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00331952-7baf-4a3a-b702-8db534b3a6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:11.919151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00331952-7baf-4a3a-b702-8db534b3a6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:11.919435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00331952-7baf-4a3a-b702-8db534b3a6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:11.919710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00331952-7baf-4a3a-b702-8db534b3a6b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:11.920403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00331952-7baf-4a3a-b702-8db534b3a6b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:11.922300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00331952-7baf-4a3a-b702-8db534b3a6b3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:12.070786 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2425/4919] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:24:11 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:12.074750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896b37f-fd3f-4e43-b617-521d591c0d03 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:12.088821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896b37f-fd3f-4e43-b617-521d591c0d03 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:12.191729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060ea19-9111-41b5-9f17-f9e69972ee3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:12.193872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060ea19-9111-41b5-9f17-f9e69972ee3f admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:12.194308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060ea19-9111-41b5-9f17-f9e69972ee3f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:12.194976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060ea19-9111-41b5-9f17-f9e69972ee3f admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:12.196718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060ea19-9111-41b5-9f17-f9e69972ee3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:12.199760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060ea19-9111-41b5-9f17-f9e69972ee3f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:12.290977 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2495/4920] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:24:12 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:12.297555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00331952-7baf-4a3a-b702-8db534b3a6b3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:12.319363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00331952-7baf-4a3a-b702-8db534b3a6b3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:12.325321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb428ac5-6cfd-4259-a970-bf7191d6cd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:12.326453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb428ac5-6cfd-4259-a970-bf7191d6cd02 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:12.327097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb428ac5-6cfd-4259-a970-bf7191d6cd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:12.327552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb428ac5-6cfd-4259-a970-bf7191d6cd02 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:12.328653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb428ac5-6cfd-4259-a970-bf7191d6cd02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:12.330817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb428ac5-6cfd-4259-a970-bf7191d6cd02 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:12.349238 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2426/4921] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:24:12.354336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060ea19-9111-41b5-9f17-f9e69972ee3f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:12.366518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060ea19-9111-41b5-9f17-f9e69972ee3f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:12.373346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5852d5-61ff-40d0-a475-b46b6084dd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:12.374299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5852d5-61ff-40d0-a475-b46b6084dd44 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:12.374734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5852d5-61ff-40d0-a475-b46b6084dd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:12.375174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5852d5-61ff-40d0-a475-b46b6084dd44 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:12.376001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5852d5-61ff-40d0-a475-b46b6084dd44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:12.377810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5852d5-61ff-40d0-a475-b46b6084dd44 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:12.390137 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2496/4922] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:12.394672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb428ac5-6cfd-4259-a970-bf7191d6cd02 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:12.406485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb428ac5-6cfd-4259-a970-bf7191d6cd02 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:12.412127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fc827-da2b-41e6-a3cd-0851618a30be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:12.413402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fc827-da2b-41e6-a3cd-0851618a30be admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:12.413750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fc827-da2b-41e6-a3cd-0851618a30be admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:12.414311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fc827-da2b-41e6-a3cd-0851618a30be admin admin] PATH_INFO: `/v3/projects/b5b3367821b84df7bafc93dea7905e37/users/ab1e26051847460f85bfedf8f9c0336b/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:12.432765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fc827-da2b-41e6-a3cd-0851618a30be admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5b3367821b84df7bafc93dea7905e37, user_id=ab1e26051847460f85bfedf8f9c0336b, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:12.436035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fc827-da2b-41e6-a3cd-0851618a30be admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:12.486764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=2,keystone:UPDATE=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:12.567346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62512ed4-13bd-4d05-b895-540a3447e6e7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:12.567706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62512ed4-13bd-4d05-b895-540a3447e6e7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:12.568055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62512ed4-13bd-4d05-b895-540a3447e6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:12.568187 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2427/4923] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:24:12 2022] PUT /identity/v3/projects/b5b3367821b84df7bafc93dea7905e37/users/ab1e26051847460f85bfedf8f9c0336b/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:12.597141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-62512ed4-13bd-4d05-b895-540a3447e6e7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:12.600108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-62512ed4-13bd-4d05-b895-540a3447e6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:12.685675 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2497/4924] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:12.694907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fc827-da2b-41e6-a3cd-0851618a30be admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:12.696721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4c9fc827-da2b-41e6-a3cd-0851618a30be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:12.829492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fc827-da2b-41e6-a3cd-0851618a30be admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:12.842269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370ad4a-a131-404c-ad31-505a5fd35df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:12.843200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370ad4a-a131-404c-ad31-505a5fd35df8 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:12.843647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370ad4a-a131-404c-ad31-505a5fd35df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:12.843988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370ad4a-a131-404c-ad31-505a5fd35df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:12.867326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370ad4a-a131-404c-ad31-505a5fd35df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:12.871913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370ad4a-a131-404c-ad31-505a5fd35df8 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:12.891073 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2428/4925] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:24:14.122320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:15.405539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:16.503307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:16.663348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcd01f-2d8f-4e4c-ab08-0f42515a440c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:16.664187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcd01f-2d8f-4e4c-ab08-0f42515a440c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:16.665390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcd01f-2d8f-4e4c-ab08-0f42515a440c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:16.673744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:16.729166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f3dcd01f-2d8f-4e4c-ab08-0f42515a440c None None] MFA Rules not processed for user `f01ecd9543134b1f8a3c089fdba63fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:16.731128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f3dcd01f-2d8f-4e4c-ab08-0f42515a440c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:16.757829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370ad4a-a131-404c-ad31-505a5fd35df8 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:16.760300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4370ad4a-a131-404c-ad31-505a5fd35df8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:16.788139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370ad4a-a131-404c-ad31-505a5fd35df8 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:16.794703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2be36-ea73-4880-9a3a-1fd0c34c14c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:16.797475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2be36-ea73-4880-9a3a-1fd0c34c14c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:16.797760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2be36-ea73-4880-9a3a-1fd0c34c14c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:16.798226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2be36-ea73-4880-9a3a-1fd0c34c14c7 admin admin] PATH_INFO: `/v3/users/594eb89ccb444cee8bed6c06ecddb637` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:16.800194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2be36-ea73-4880-9a3a-1fd0c34c14c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=594eb89ccb444cee8bed6c06ecddb637)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:16.806105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2be36-ea73-4880-9a3a-1fd0c34c14c7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:16.956895 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2498/4926] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:16.974012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcd01f-2d8f-4e4c-ab08-0f42515a440c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:16.980532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f3dcd01f-2d8f-4e4c-ab08-0f42515a440c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:17.062862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-00b2be36-ea73-4880-9a3a-1fd0c34c14c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '594eb89ccb444cee8bed6c06ecddb637'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:17.091914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-00b2be36-ea73-4880-9a3a-1fd0c34c14c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '594eb89ccb444cee8bed6c06ecddb637'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:17.114463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcd01f-2d8f-4e4c-ab08-0f42515a440c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:17.147800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8bf4d-9f48-4c44-81e9-97fe372672d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:17.149867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8bf4d-9f48-4c44-81e9-97fe372672d8 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:17.150171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8bf4d-9f48-4c44-81e9-97fe372672d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:17.150455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8bf4d-9f48-4c44-81e9-97fe372672d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:17.153990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c2a8bf4d-9f48-4c44-81e9-97fe372672d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:17.188507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-00b2be36-ea73-4880-9a3a-1fd0c34c14c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '594eb89ccb444cee8bed6c06ecddb637'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:17.199628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-00b2be36-ea73-4880-9a3a-1fd0c34c14c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '594eb89ccb444cee8bed6c06ecddb637'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:17.202855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-00b2be36-ea73-4880-9a3a-1fd0c34c14c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '594eb89ccb444cee8bed6c06ecddb637'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:17.220614 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2429/4927] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:24:16 2022] DELETE /identity/v3/users/594eb89ccb444cee8bed6c06ecddb637 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:17.224906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d76c7-e90d-4ff4-9aa1-9cceabb00e9e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:17.225305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d76c7-e90d-4ff4-9aa1-9cceabb00e9e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:17.225648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d76c7-e90d-4ff4-9aa1-9cceabb00e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:17.245603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8bf4d-9f48-4c44-81e9-97fe372672d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:17.248594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8bf4d-9f48-4c44-81e9-97fe372672d8 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:17.264371 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2499/4928] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:24:17.275559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-bb5d76c7-e90d-4ff4-9aa1-9cceabb00e9e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:17.281476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bb5d76c7-e90d-4ff4-9aa1-9cceabb00e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:17.443057 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2430/4929] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:17.509487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8bf4d-9f48-4c44-81e9-97fe372672d8 service cinder] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:17.511491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c2a8bf4d-9f48-4c44-81e9-97fe372672d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:17.546354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8bf4d-9f48-4c44-81e9-97fe372672d8 service cinder] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:17.734963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ef59a-df8e-4245-b7d5-7618523fb1c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:17.735963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ef59a-df8e-4245-b7d5-7618523fb1c2 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:17.738676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ef59a-df8e-4245-b7d5-7618523fb1c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:17.738676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ef59a-df8e-4245-b7d5-7618523fb1c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:17.752681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ef59a-df8e-4245-b7d5-7618523fb1c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:17.754469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ef59a-df8e-4245-b7d5-7618523fb1c2 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:17.768857 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2500/4930] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:24:18.147991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:18.479884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:18.816833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:20.754479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:21.107478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d76c7-e90d-4ff4-9aa1-9cceabb00e9e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:21.108935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bb5d76c7-e90d-4ff4-9aa1-9cceabb00e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:21.129728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d76c7-e90d-4ff4-9aa1-9cceabb00e9e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:21.136942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67b122-7470-49b5-825c-35cbf77e3752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:21.138448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67b122-7470-49b5-825c-35cbf77e3752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:21.138978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67b122-7470-49b5-825c-35cbf77e3752 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:21.139620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67b122-7470-49b5-825c-35cbf77e3752 admin admin] PATH_INFO: `/v3/projects/ff06e31821fd40b688b6e2cc7596ce7c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:21.141120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67b122-7470-49b5-825c-35cbf77e3752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff06e31821fd40b688b6e2cc7596ce7c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:21.143713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67b122-7470-49b5-825c-35cbf77e3752 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:21.316293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ab67b122-7470-49b5-825c-35cbf77e3752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff06e31821fd40b688b6e2cc7596ce7c', 'request_id': 'req-ab67b122-7470-49b5-825c-35cbf77e3752'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:21.324943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ab67b122-7470-49b5-825c-35cbf77e3752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff06e31821fd40b688b6e2cc7596ce7c', 'request_id': 'req-ab67b122-7470-49b5-825c-35cbf77e3752'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:21.333569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ab67b122-7470-49b5-825c-35cbf77e3752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff06e31821fd40b688b6e2cc7596ce7c', 'request_id': 'req-ab67b122-7470-49b5-825c-35cbf77e3752'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:21.433636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ab67b122-7470-49b5-825c-35cbf77e3752 admin admin] The token cache is being invalidate because project ff06e31821fd40b688b6e2cc7596ce7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:24:21.434327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ab67b122-7470-49b5-825c-35cbf77e3752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:21.437066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ab67b122-7470-49b5-825c-35cbf77e3752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:21.444665 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2431/4931] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:24:21 2022] DELETE /identity/v3/projects/ff06e31821fd40b688b6e2cc7596ce7c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:21.445387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ef59a-df8e-4245-b7d5-7618523fb1c2 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:21.459231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ef59a-df8e-4245-b7d5-7618523fb1c2 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:21.604782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a106bd-734e-44ff-883c-4c82be9c8448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:21.606649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a106bd-734e-44ff-883c-4c82be9c8448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:21.607164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a106bd-734e-44ff-883c-4c82be9c8448 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:21.607619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a106bd-734e-44ff-883c-4c82be9c8448 admin admin] PATH_INFO: `/v3/users/2a2bd6fe7cf94604b7b1495047f63cdb` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:21.609933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a106bd-734e-44ff-883c-4c82be9c8448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a2bd6fe7cf94604b7b1495047f63cdb)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:21.612159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a106bd-734e-44ff-883c-4c82be9c8448 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:21.669164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:21.841303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67b122-7470-49b5-825c-35cbf77e3752 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:21.842849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ab67b122-7470-49b5-825c-35cbf77e3752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:21.877292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67b122-7470-49b5-825c-35cbf77e3752 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:21.896320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-24a106bd-734e-44ff-883c-4c82be9c8448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a2bd6fe7cf94604b7b1495047f63cdb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:21.902703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-24a106bd-734e-44ff-883c-4c82be9c8448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a2bd6fe7cf94604b7b1495047f63cdb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:21.905174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa385592-d08c-4213-9f90-862fc9b9b182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:21.906093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa385592-d08c-4213-9f90-862fc9b9b182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:21.906386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa385592-d08c-4213-9f90-862fc9b9b182 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:21.906683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa385592-d08c-4213-9f90-862fc9b9b182 admin admin] PATH_INFO: `/v3/users/9b79af01c1ca41e38c99193165f4e2ac` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:21.909782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa385592-d08c-4213-9f90-862fc9b9b182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b79af01c1ca41e38c99193165f4e2ac)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:21.912153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa385592-d08c-4213-9f90-862fc9b9b182 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:21.970246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-24a106bd-734e-44ff-883c-4c82be9c8448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a2bd6fe7cf94604b7b1495047f63cdb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:21.971199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-24a106bd-734e-44ff-883c-4c82be9c8448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a2bd6fe7cf94604b7b1495047f63cdb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:21.998295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-24a106bd-734e-44ff-883c-4c82be9c8448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a2bd6fe7cf94604b7b1495047f63cdb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:22.007158 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2501/4932] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:24:21 2022] DELETE /identity/v3/users/2a2bd6fe7cf94604b7b1495047f63cdb => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:22.221178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fa385592-d08c-4213-9f90-862fc9b9b182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b79af01c1ca41e38c99193165f4e2ac'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:22.235522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fa385592-d08c-4213-9f90-862fc9b9b182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b79af01c1ca41e38c99193165f4e2ac'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:22.306414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b2051-1d75-41fa-844e-957cc882e30b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:22.307623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b2051-1d75-41fa-844e-957cc882e30b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:22.308135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b2051-1d75-41fa-844e-957cc882e30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:22.313520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fa385592-d08c-4213-9f90-862fc9b9b182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b79af01c1ca41e38c99193165f4e2ac'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:22.326854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fa385592-d08c-4213-9f90-862fc9b9b182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b79af01c1ca41e38c99193165f4e2ac'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:22.327843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fa385592-d08c-4213-9f90-862fc9b9b182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b79af01c1ca41e38c99193165f4e2ac'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:22.332483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-828b2051-1d75-41fa-844e-957cc882e30b None None] MFA Rules not processed for user `bba77f6ef42547f1aa8480e27868bd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:22.333705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-828b2051-1d75-41fa-844e-957cc882e30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:22.335105 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2432/4933] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:24:21 2022] DELETE /identity/v3/users/9b79af01c1ca41e38c99193165f4e2ac => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:22.339941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245f51d-7785-4850-8c98-2bdc18324e1d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:22.340239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245f51d-7785-4850-8c98-2bdc18324e1d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:22.340754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245f51d-7785-4850-8c98-2bdc18324e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:22.361576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5245f51d-7785-4850-8c98-2bdc18324e1d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:22.362967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5245f51d-7785-4850-8c98-2bdc18324e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:22.400894 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2502/4934] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:22.466910 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2433/4935] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:22.473641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b2051-1d75-41fa-844e-957cc882e30b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:22.475043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-828b2051-1d75-41fa-844e-957cc882e30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:22.484785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:22.546170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b2051-1d75-41fa-844e-957cc882e30b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:22.550044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5d1f9-0da3-4fef-b6d6-c71f5a000798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:22.550796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5d1f9-0da3-4fef-b6d6-c71f5a000798 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:22.551761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5d1f9-0da3-4fef-b6d6-c71f5a000798 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:22.552548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5d1f9-0da3-4fef-b6d6-c71f5a000798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:22.563552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5d1f9-0da3-4fef-b6d6-c71f5a000798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:22.565010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5d1f9-0da3-4fef-b6d6-c71f5a000798 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:22.575191 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2503/4936] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:24:22.765952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245f51d-7785-4850-8c98-2bdc18324e1d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:22.767488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5245f51d-7785-4850-8c98-2bdc18324e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:22.783406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245f51d-7785-4850-8c98-2bdc18324e1d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:22.789529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27ccc8-5d94-49de-a83e-c44857cf51a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:22.790995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27ccc8-5d94-49de-a83e-c44857cf51a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:22.790995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27ccc8-5d94-49de-a83e-c44857cf51a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:22.790995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27ccc8-5d94-49de-a83e-c44857cf51a3 admin admin] PATH_INFO: `/v3/projects/6e8b4f27846f4fb594cccf661747d160` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:22.792821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27ccc8-5d94-49de-a83e-c44857cf51a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e8b4f27846f4fb594cccf661747d160)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:22.794768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27ccc8-5d94-49de-a83e-c44857cf51a3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:22.892880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5d1f9-0da3-4fef-b6d6-c71f5a000798 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:22.894526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-88e5d1f9-0da3-4fef-b6d6-c71f5a000798 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:22.918921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5d1f9-0da3-4fef-b6d6-c71f5a000798 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:22.926456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119712b8-0bad-472f-9e39-e9d30d8f64b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:22.928010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119712b8-0bad-472f-9e39-e9d30d8f64b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:22.928633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119712b8-0bad-472f-9e39-e9d30d8f64b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:22.929129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119712b8-0bad-472f-9e39-e9d30d8f64b4 admin admin] PATH_INFO: `/v3/projects/738c7a543cf345018cd3e6e544aadc19` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:22.930575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119712b8-0bad-472f-9e39-e9d30d8f64b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=738c7a543cf345018cd3e6e544aadc19)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:22.934693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119712b8-0bad-472f-9e39-e9d30d8f64b4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:22.978533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cb27ccc8-5d94-49de-a83e-c44857cf51a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e8b4f27846f4fb594cccf661747d160', 'request_id': 'req-cb27ccc8-5d94-49de-a83e-c44857cf51a3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:22.987337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cb27ccc8-5d94-49de-a83e-c44857cf51a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e8b4f27846f4fb594cccf661747d160', 'request_id': 'req-cb27ccc8-5d94-49de-a83e-c44857cf51a3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:22.996948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cb27ccc8-5d94-49de-a83e-c44857cf51a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e8b4f27846f4fb594cccf661747d160', 'request_id': 'req-cb27ccc8-5d94-49de-a83e-c44857cf51a3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:23.110703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-119712b8-0bad-472f-9e39-e9d30d8f64b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '738c7a543cf345018cd3e6e544aadc19', 'request_id': 'req-119712b8-0bad-472f-9e39-e9d30d8f64b4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:23.119548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cb27ccc8-5d94-49de-a83e-c44857cf51a3 admin admin] The token cache is being invalidate because project 6e8b4f27846f4fb594cccf661747d160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:24:23.129021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cb27ccc8-5d94-49de-a83e-c44857cf51a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:23.129021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cb27ccc8-5d94-49de-a83e-c44857cf51a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:23.129021 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2434/4937] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:24:22 2022] DELETE /identity/v3/projects/6e8b4f27846f4fb594cccf661747d160 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:23.129594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-119712b8-0bad-472f-9e39-e9d30d8f64b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '738c7a543cf345018cd3e6e544aadc19', 'request_id': 'req-119712b8-0bad-472f-9e39-e9d30d8f64b4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:23.129985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c264a56-b5e1-44e9-81a2-d2d382f680d4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:23.130374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c264a56-b5e1-44e9-81a2-d2d382f680d4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:23.130753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c264a56-b5e1-44e9-81a2-d2d382f680d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:23.140273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-119712b8-0bad-472f-9e39-e9d30d8f64b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '738c7a543cf345018cd3e6e544aadc19', 'request_id': 'req-119712b8-0bad-472f-9e39-e9d30d8f64b4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:23.153499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6c264a56-b5e1-44e9-81a2-d2d382f680d4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:23.154765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6c264a56-b5e1-44e9-81a2-d2d382f680d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:23.231288 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2435/4938] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:23.240119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429a3be-4f6c-4799-8ec7-4435fd612759 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:23.240421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429a3be-4f6c-4799-8ec7-4435fd612759 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:23.240704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429a3be-4f6c-4799-8ec7-4435fd612759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:23.255948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-119712b8-0bad-472f-9e39-e9d30d8f64b4 admin admin] The token cache is being invalidate because project 738c7a543cf345018cd3e6e544aadc19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:24:23.256666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-119712b8-0bad-472f-9e39-e9d30d8f64b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:23.257561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-119712b8-0bad-472f-9e39-e9d30d8f64b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:23.259371 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2504/4939] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:24:22 2022] DELETE /identity/v3/projects/738c7a543cf345018cd3e6e544aadc19 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:23.265153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f9124-d909-4cdc-ae3d-6e8866f0a03b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:23.269355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f9124-d909-4cdc-ae3d-6e8866f0a03b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:23.269355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f9124-d909-4cdc-ae3d-6e8866f0a03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:23.275367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9429a3be-4f6c-4799-8ec7-4435fd612759 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:23.277887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9429a3be-4f6c-4799-8ec7-4435fd612759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:23.287272 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2436/4940] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:24:23.290841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d72f9124-d909-4cdc-ae3d-6e8866f0a03b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:23.292409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d72f9124-d909-4cdc-ae3d-6e8866f0a03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:23.295443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429a3be-4f6c-4799-8ec7-4435fd612759 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:23.309399 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2505/4941] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:23.311885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb1d50-f5f4-4c07-b26c-1919a8cebaf1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:23.312307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb1d50-f5f4-4c07-b26c-1919a8cebaf1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:23.312598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb1d50-f5f4-4c07-b26c-1919a8cebaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:23.317837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429a3be-4f6c-4799-8ec7-4435fd612759 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:23.325717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b18c9e-e67e-4b19-b2e1-1d9028f5132a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:23.327412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b18c9e-e67e-4b19-b2e1-1d9028f5132a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:23.327412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b18c9e-e67e-4b19-b2e1-1d9028f5132a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:23.327412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b18c9e-e67e-4b19-b2e1-1d9028f5132a admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:23.327747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b18c9e-e67e-4b19-b2e1-1d9028f5132a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:24:23.328244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b18c9e-e67e-4b19-b2e1-1d9028f5132a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:23.330015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b18c9e-e67e-4b19-b2e1-1d9028f5132a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:23.334026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6abb1d50-f5f4-4c07-b26c-1919a8cebaf1 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:23.335222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6abb1d50-f5f4-4c07-b26c-1919a8cebaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:23.344881 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2437/4942] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:24:23.347110 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2506/4943] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:23.349144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b18c9e-e67e-4b19-b2e1-1d9028f5132a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:23.353427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb1d50-f5f4-4c07-b26c-1919a8cebaf1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:23.363677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b18c9e-e67e-4b19-b2e1-1d9028f5132a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:23.364016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb1d50-f5f4-4c07-b26c-1919a8cebaf1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:23.371898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa936cb-15c3-4460-8191-2cd81ee5e01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:23.378690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e2390-aa5d-4bda-934d-027245e40e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:23.379891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa936cb-15c3-4460-8191-2cd81ee5e01d admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:23.380007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e2390-aa5d-4bda-934d-027245e40e36 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:23.380099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa936cb-15c3-4460-8191-2cd81ee5e01d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:23.380185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e2390-aa5d-4bda-934d-027245e40e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:23.380283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa936cb-15c3-4460-8191-2cd81ee5e01d admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:23.380369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e2390-aa5d-4bda-934d-027245e40e36 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:23.380452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa936cb-15c3-4460-8191-2cd81ee5e01d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:23.380535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e2390-aa5d-4bda-934d-027245e40e36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:24:23.380535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e2390-aa5d-4bda-934d-027245e40e36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:23.380705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa936cb-15c3-4460-8191-2cd81ee5e01d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:23.380798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e2390-aa5d-4bda-934d-027245e40e36 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:23.392195 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2507/4944] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:24:23.397155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e2390-aa5d-4bda-934d-027245e40e36 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:23.408411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e2390-aa5d-4bda-934d-027245e40e36 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:23.413681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780c762-11ea-47db-9d9d-d8c6b6c4ce92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:23.414333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780c762-11ea-47db-9d9d-d8c6b6c4ce92 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:23.414615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780c762-11ea-47db-9d9d-d8c6b6c4ce92 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:23.414919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780c762-11ea-47db-9d9d-d8c6b6c4ce92 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:23.415846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780c762-11ea-47db-9d9d-d8c6b6c4ce92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:23.418441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780c762-11ea-47db-9d9d-d8c6b6c4ce92 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:23.466988 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2438/4945] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:24:23 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:23.468127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa936cb-15c3-4460-8191-2cd81ee5e01d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:23.508557 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2508/4946] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:24:23 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:24:23.513273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780c762-11ea-47db-9d9d-d8c6b6c4ce92 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:23.515577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:23.542572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa936cb-15c3-4460-8191-2cd81ee5e01d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:23.594447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780c762-11ea-47db-9d9d-d8c6b6c4ce92 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:23.599473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee212db-5b7c-425a-b2ff-b2a59b016471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:23.600285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee212db-5b7c-425a-b2ff-b2a59b016471 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:23.600581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee212db-5b7c-425a-b2ff-b2a59b016471 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:23.600862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee212db-5b7c-425a-b2ff-b2a59b016471 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:23.601799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee212db-5b7c-425a-b2ff-b2a59b016471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:23.604586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee212db-5b7c-425a-b2ff-b2a59b016471 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:23.606654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243cdc3-be06-4c9d-80e2-6f78ffce0870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:23.607485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243cdc3-be06-4c9d-80e2-6f78ffce0870 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:23.607770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243cdc3-be06-4c9d-80e2-6f78ffce0870 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:23.608051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243cdc3-be06-4c9d-80e2-6f78ffce0870 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:23.609345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243cdc3-be06-4c9d-80e2-6f78ffce0870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:23.611917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243cdc3-be06-4c9d-80e2-6f78ffce0870 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:23.703893 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2509/4947] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:24:23 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:23.707991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee212db-5b7c-425a-b2ff-b2a59b016471 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:23.720288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee212db-5b7c-425a-b2ff-b2a59b016471 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:23.725492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c885a-1bad-465c-87c3-08bdaea7dc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:23.726189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c885a-1bad-465c-87c3-08bdaea7dc80 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:23.726475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c885a-1bad-465c-87c3-08bdaea7dc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:23.726753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c885a-1bad-465c-87c3-08bdaea7dc80 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:23.727749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c885a-1bad-465c-87c3-08bdaea7dc80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:23.729928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c885a-1bad-465c-87c3-08bdaea7dc80 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:23.742366 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2510/4948] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:23.747344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c885a-1bad-465c-87c3-08bdaea7dc80 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:23.750313 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2439/4949] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:24:23 2022] POST /identity/v3/users => generated 286 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:23.755214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243cdc3-be06-4c9d-80e2-6f78ffce0870 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:23.757423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c885a-1bad-465c-87c3-08bdaea7dc80 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:23.765893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47971b66-2659-458f-8f47-3464b35a7d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:23.766721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47971b66-2659-458f-8f47-3464b35a7d18 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:23.767143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47971b66-2659-458f-8f47-3464b35a7d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:23.767527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47971b66-2659-458f-8f47-3464b35a7d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:23.767654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243cdc3-be06-4c9d-80e2-6f78ffce0870 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:23.768445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47971b66-2659-458f-8f47-3464b35a7d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:23.770242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47971b66-2659-458f-8f47-3464b35a7d18 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:23.772566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8aa8c-4671-41b8-936e-a8ab13778c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:23.773492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8aa8c-4671-41b8-936e-a8ab13778c90 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:23.776930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8aa8c-4671-41b8-936e-a8ab13778c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:23.776930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8aa8c-4671-41b8-936e-a8ab13778c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:23.776930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8aa8c-4671-41b8-936e-a8ab13778c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:23.777682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8aa8c-4671-41b8-936e-a8ab13778c90 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:23.782744 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2511/4950] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:24:23.787209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47971b66-2659-458f-8f47-3464b35a7d18 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:23.794057 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2440/4951] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:23.798403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8aa8c-4671-41b8-936e-a8ab13778c90 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:23.799793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47971b66-2659-458f-8f47-3464b35a7d18 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:23.804761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8d0d9-8a15-422b-b27c-fcdc1122baa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:23.805945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8d0d9-8a15-422b-b27c-fcdc1122baa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:23.806324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8d0d9-8a15-422b-b27c-fcdc1122baa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:23.806715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8d0d9-8a15-422b-b27c-fcdc1122baa4 admin admin] PATH_INFO: `/v3/projects/020889a05ee6468fbfb029a25fc24aae/users/d54facfbb0e34d1dbbe093a9ea78e20e/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:23.810203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8aa8c-4671-41b8-936e-a8ab13778c90 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:23.825575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16415d-c50a-48c5-a4f2-e8a83594683c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:23.828502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16415d-c50a-48c5-a4f2-e8a83594683c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:23.828502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16415d-c50a-48c5-a4f2-e8a83594683c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:23.828502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16415d-c50a-48c5-a4f2-e8a83594683c admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:23.828502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16415d-c50a-48c5-a4f2-e8a83594683c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:23.829542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16415d-c50a-48c5-a4f2-e8a83594683c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:23.841215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8d0d9-8a15-422b-b27c-fcdc1122baa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=020889a05ee6468fbfb029a25fc24aae, user_id=d54facfbb0e34d1dbbe093a9ea78e20e, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:23.845274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8d0d9-8a15-422b-b27c-fcdc1122baa4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:23.859649 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2441/4952] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:24:23.860613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16415d-c50a-48c5-a4f2-e8a83594683c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:23.888108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16415d-c50a-48c5-a4f2-e8a83594683c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:23.896373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b4dc8-6e02-40ce-b7b7-f6a1bd4c9446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:23.897353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b4dc8-6e02-40ce-b7b7-f6a1bd4c9446 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:23.897698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b4dc8-6e02-40ce-b7b7-f6a1bd4c9446 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:23.898075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b4dc8-6e02-40ce-b7b7-f6a1bd4c9446 admin admin] PATH_INFO: `/v3/projects/a22fb8b1d448405d954ac2f7980e33c6/users/d3327010a84d4b1b9a0dc9fc75267b0c/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:23.925769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b4dc8-6e02-40ce-b7b7-f6a1bd4c9446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22fb8b1d448405d954ac2f7980e33c6, user_id=d3327010a84d4b1b9a0dc9fc75267b0c, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:23.928875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b4dc8-6e02-40ce-b7b7-f6a1bd4c9446 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:23.952940 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2512/4953] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:24:23 2022] PUT /identity/v3/projects/020889a05ee6468fbfb029a25fc24aae/users/d54facfbb0e34d1dbbe093a9ea78e20e/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:24:23.961269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df26337-62b6-4166-9ce6-0707aae51034 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:23.961604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df26337-62b6-4166-9ce6-0707aae51034 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:23.961831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df26337-62b6-4166-9ce6-0707aae51034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:24.006680 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2442/4954] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:24:23 2022] PUT /identity/v3/projects/a22fb8b1d448405d954ac2f7980e33c6/users/d3327010a84d4b1b9a0dc9fc75267b0c/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:24.012175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1df26337-62b6-4166-9ce6-0707aae51034 None None] MFA Rules not processed for user `d54facfbb0e34d1dbbe093a9ea78e20e`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:24.018945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554c86a-b376-489a-80ca-44afbd5c1bb7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:24.019304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554c86a-b376-489a-80ca-44afbd5c1bb7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:24.019577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554c86a-b376-489a-80ca-44afbd5c1bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:24.023130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1df26337-62b6-4166-9ce6-0707aae51034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:24.062167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b554c86a-b376-489a-80ca-44afbd5c1bb7 None None] MFA Rules not processed for user `d3327010a84d4b1b9a0dc9fc75267b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:24.063444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b554c86a-b376-489a-80ca-44afbd5c1bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:24.205463 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2513/4955] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:24:24.207256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df26337-62b6-4166-9ce6-0707aae51034 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:24.209041 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2443/4956] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:24.224306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554c86a-b376-489a-80ca-44afbd5c1bb7 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:24.228476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b554c86a-b376-489a-80ca-44afbd5c1bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:24.326057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df26337-62b6-4166-9ce6-0707aae51034 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:24.332862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7803f2-07e1-4230-9a6c-304fea8df4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:24.334381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7803f2-07e1-4230-9a6c-304fea8df4db admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:24.334852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7803f2-07e1-4230-9a6c-304fea8df4db admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:24.335172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7803f2-07e1-4230-9a6c-304fea8df4db admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:24.336495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7803f2-07e1-4230-9a6c-304fea8df4db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:24.339668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7803f2-07e1-4230-9a6c-304fea8df4db admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:24.353645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554c86a-b376-489a-80ca-44afbd5c1bb7 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:24.359937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f791f-5043-468e-8dd8-34f9b063d84c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:24.360692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f791f-5043-468e-8dd8-34f9b063d84c service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:24.361050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f791f-5043-468e-8dd8-34f9b063d84c service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:24.361398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f791f-5043-468e-8dd8-34f9b063d84c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:24.372000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f791f-5043-468e-8dd8-34f9b063d84c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:24.373572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f791f-5043-468e-8dd8-34f9b063d84c service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:24.386707 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2444/4957] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:24:24.451047 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2514/4958] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:24:24 2022] POST /identity/v3/projects => generated 387 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:24.463134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f791f-5043-468e-8dd8-34f9b063d84c service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:24.477206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f791f-5043-468e-8dd8-34f9b063d84c service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:24.560979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45704826-5be6-4a3d-9fff-83415a3f7da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:24.561667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45704826-5be6-4a3d-9fff-83415a3f7da8 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:24.561955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45704826-5be6-4a3d-9fff-83415a3f7da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:24.562237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45704826-5be6-4a3d-9fff-83415a3f7da8 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:24.562931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45704826-5be6-4a3d-9fff-83415a3f7da8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:24.565511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45704826-5be6-4a3d-9fff-83415a3f7da8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:24.667261 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2445/4959] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:24:24 2022] POST /identity/v3/users => generated 300 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:24.669212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7803f2-07e1-4230-9a6c-304fea8df4db admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:24.685844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7803f2-07e1-4230-9a6c-304fea8df4db admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:24.694663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d8a5e-e671-4f67-ad39-eb9aead0c7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:24.695701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d8a5e-e671-4f67-ad39-eb9aead0c7fb admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:24.696146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d8a5e-e671-4f67-ad39-eb9aead0c7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:24.696574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d8a5e-e671-4f67-ad39-eb9aead0c7fb admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:24.698153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d8a5e-e671-4f67-ad39-eb9aead0c7fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:24.699939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d8a5e-e671-4f67-ad39-eb9aead0c7fb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:24.714114 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2515/4960] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:24.718524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45704826-5be6-4a3d-9fff-83415a3f7da8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:24.739493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45704826-5be6-4a3d-9fff-83415a3f7da8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:24.756854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03c2c3-7771-4c08-b251-7cf9e9ba6739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:24.756854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03c2c3-7771-4c08-b251-7cf9e9ba6739 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:24.756854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03c2c3-7771-4c08-b251-7cf9e9ba6739 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:24.756854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03c2c3-7771-4c08-b251-7cf9e9ba6739 admin admin] PATH_INFO: `/v3/projects/38a2ec99a2474f0ba3a3df85d2571b3c/users/c91977d5445e42e49053fe239da209cc/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:24.818595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03c2c3-7771-4c08-b251-7cf9e9ba6739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a2ec99a2474f0ba3a3df85d2571b3c, user_id=c91977d5445e42e49053fe239da209cc, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:24.821484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03c2c3-7771-4c08-b251-7cf9e9ba6739 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:24.960894 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2446/4961] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:24:24 2022] PUT /identity/v3/projects/38a2ec99a2474f0ba3a3df85d2571b3c/users/c91977d5445e42e49053fe239da209cc/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:24.972096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d8a5e-e671-4f67-ad39-eb9aead0c7fb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:24.988745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d8a5e-e671-4f67-ad39-eb9aead0c7fb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:25.058605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:25.112430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145428c-613b-4aa1-88cc-7fded18481b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:25.112430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145428c-613b-4aa1-88cc-7fded18481b3 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:25.112430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145428c-613b-4aa1-88cc-7fded18481b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:25.112430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145428c-613b-4aa1-88cc-7fded18481b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:25.112881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145428c-613b-4aa1-88cc-7fded18481b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:25.112881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145428c-613b-4aa1-88cc-7fded18481b3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:25.134285 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2516/4962] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:25.138720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03c2c3-7771-4c08-b251-7cf9e9ba6739 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:25.153748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03c2c3-7771-4c08-b251-7cf9e9ba6739 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:25.159431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f3858-a7b6-409f-95a6-70b3efac5371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:25.161408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f3858-a7b6-409f-95a6-70b3efac5371 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:25.161835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f3858-a7b6-409f-95a6-70b3efac5371 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:25.162211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f3858-a7b6-409f-95a6-70b3efac5371 admin admin] PATH_INFO: `/v3/projects/38a2ec99a2474f0ba3a3df85d2571b3c/users/c91977d5445e42e49053fe239da209cc/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:25.165711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:25.174557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f3858-a7b6-409f-95a6-70b3efac5371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a2ec99a2474f0ba3a3df85d2571b3c, user_id=c91977d5445e42e49053fe239da209cc, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:25.178378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f3858-a7b6-409f-95a6-70b3efac5371 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:25.200086 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2447/4963] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:24:25 2022] PUT /identity/v3/projects/38a2ec99a2474f0ba3a3df85d2571b3c/users/c91977d5445e42e49053fe239da209cc/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:25.207873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab7f00-22ba-4b4c-8f22-c20bb0a13544 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:25.207873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab7f00-22ba-4b4c-8f22-c20bb0a13544 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:25.207873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab7f00-22ba-4b4c-8f22-c20bb0a13544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:25.282441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8cab7f00-22ba-4b4c-8f22-c20bb0a13544 None None] MFA Rules not processed for user `c91977d5445e42e49053fe239da209cc`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:25.283698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8cab7f00-22ba-4b4c-8f22-c20bb0a13544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:25.361144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f3858-a7b6-409f-95a6-70b3efac5371 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:25.407115 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2517/4964] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:25.426885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab7f00-22ba-4b4c-8f22-c20bb0a13544 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:25.430512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8cab7f00-22ba-4b4c-8f22-c20bb0a13544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:25.465399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f3858-a7b6-409f-95a6-70b3efac5371 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:25.471580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67347d7-ef93-4446-8cf2-78ca22ec1834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:25.472770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67347d7-ef93-4446-8cf2-78ca22ec1834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:25.477213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67347d7-ef93-4446-8cf2-78ca22ec1834 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:25.477213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67347d7-ef93-4446-8cf2-78ca22ec1834 admin admin] PATH_INFO: `/v3/users/d3327010a84d4b1b9a0dc9fc75267b0c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:25.477213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67347d7-ef93-4446-8cf2-78ca22ec1834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3327010a84d4b1b9a0dc9fc75267b0c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:25.477999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67347d7-ef93-4446-8cf2-78ca22ec1834 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:25.551406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab7f00-22ba-4b4c-8f22-c20bb0a13544 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:25.565125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25aa358-f43d-48ee-acc0-a11f74dda9c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:25.565887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aa358-f43d-48ee-acc0-a11f74dda9c5 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:25.566242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aa358-f43d-48ee-acc0-a11f74dda9c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:25.566767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aa358-f43d-48ee-acc0-a11f74dda9c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:25.577000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25aa358-f43d-48ee-acc0-a11f74dda9c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:25.578452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25aa358-f43d-48ee-acc0-a11f74dda9c5 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:25.599911 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2518/4965] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:24:25.775541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d67347d7-ef93-4446-8cf2-78ca22ec1834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3327010a84d4b1b9a0dc9fc75267b0c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:25.797633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d67347d7-ef93-4446-8cf2-78ca22ec1834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3327010a84d4b1b9a0dc9fc75267b0c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:25.817296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25aa358-f43d-48ee-acc0-a11f74dda9c5 service cinder] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:25.835524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25aa358-f43d-48ee-acc0-a11f74dda9c5 service cinder] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:25.841500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45042a-83e5-4467-bcde-d773f44172a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:25.843350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45042a-83e5-4467-bcde-d773f44172a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:25.843880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45042a-83e5-4467-bcde-d773f44172a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:25.844377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45042a-83e5-4467-bcde-d773f44172a1 admin admin] PATH_INFO: `/v3/users/d54facfbb0e34d1dbbe093a9ea78e20e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:25.845878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45042a-83e5-4467-bcde-d773f44172a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d54facfbb0e34d1dbbe093a9ea78e20e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:25.848749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45042a-83e5-4467-bcde-d773f44172a1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:25.880945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d67347d7-ef93-4446-8cf2-78ca22ec1834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3327010a84d4b1b9a0dc9fc75267b0c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:25.898922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d67347d7-ef93-4446-8cf2-78ca22ec1834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3327010a84d4b1b9a0dc9fc75267b0c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:25.901917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d67347d7-ef93-4446-8cf2-78ca22ec1834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3327010a84d4b1b9a0dc9fc75267b0c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:25.920420 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2448/4966] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:24:25 2022] DELETE /identity/v3/users/d3327010a84d4b1b9a0dc9fc75267b0c => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:25.925948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92224b9-063f-4cc7-b93c-84662be8aedf None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:25.926507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92224b9-063f-4cc7-b93c-84662be8aedf None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:25.927090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92224b9-063f-4cc7-b93c-84662be8aedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:25.981389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f92224b9-063f-4cc7-b93c-84662be8aedf None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:25.982776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f92224b9-063f-4cc7-b93c-84662be8aedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:26.106388 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2449/4967] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:26.138771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92224b9-063f-4cc7-b93c-84662be8aedf None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:26.140696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f92224b9-063f-4cc7-b93c-84662be8aedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:26.210948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92224b9-063f-4cc7-b93c-84662be8aedf None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:26.217662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f9edc-ea36-4095-97e7-c3881a2d5a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:26.218412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f9edc-ea36-4095-97e7-c3881a2d5a11 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:26.220189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f9edc-ea36-4095-97e7-c3881a2d5a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:26.220479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f9edc-ea36-4095-97e7-c3881a2d5a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:26.231131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3b45042a-83e5-4467-bcde-d773f44172a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd54facfbb0e34d1dbbe093a9ea78e20e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:26.246263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f9edc-ea36-4095-97e7-c3881a2d5a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:26.249842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f9edc-ea36-4095-97e7-c3881a2d5a11 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:26.252580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3b45042a-83e5-4467-bcde-d773f44172a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd54facfbb0e34d1dbbe093a9ea78e20e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:26.274439 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2450/4968] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:24:26.419752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3b45042a-83e5-4467-bcde-d773f44172a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd54facfbb0e34d1dbbe093a9ea78e20e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:26.422536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3b45042a-83e5-4467-bcde-d773f44172a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd54facfbb0e34d1dbbe093a9ea78e20e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:26.452103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3b45042a-83e5-4467-bcde-d773f44172a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd54facfbb0e34d1dbbe093a9ea78e20e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:26.461700 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2519/4969] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:24:25 2022] DELETE /identity/v3/users/d54facfbb0e34d1dbbe093a9ea78e20e => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:24:26.466613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424c096-0239-4b94-9754-73397abdae19 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:26.467699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424c096-0239-4b94-9754-73397abdae19 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:26.468192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424c096-0239-4b94-9754-73397abdae19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:26.493362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c424c096-0239-4b94-9754-73397abdae19 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:26.495430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c424c096-0239-4b94-9754-73397abdae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:26.526466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:26.579418 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2451/4970] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:24:26.605168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45042a-83e5-4467-bcde-d773f44172a1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:26.606978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3b45042a-83e5-4467-bcde-d773f44172a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:26.743779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45042a-83e5-4467-bcde-d773f44172a1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:26.749391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa6ed8-b8fa-4fec-ada4-3a0140be556a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:26.751056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa6ed8-b8fa-4fec-ada4-3a0140be556a service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:26.752898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa6ed8-b8fa-4fec-ada4-3a0140be556a service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:26.753282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa6ed8-b8fa-4fec-ada4-3a0140be556a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:26.768355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa6ed8-b8fa-4fec-ada4-3a0140be556a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:26.770591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa6ed8-b8fa-4fec-ada4-3a0140be556a service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:26.804700 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2520/4971] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:24:26.982200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424c096-0239-4b94-9754-73397abdae19 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:26.984037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c424c096-0239-4b94-9754-73397abdae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:27.015277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424c096-0239-4b94-9754-73397abdae19 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:27.023703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bfdd8-c058-4657-b0f9-a5568bc4ae97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:27.024922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bfdd8-c058-4657-b0f9-a5568bc4ae97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:27.025452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bfdd8-c058-4657-b0f9-a5568bc4ae97 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:27.026520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bfdd8-c058-4657-b0f9-a5568bc4ae97 admin admin] PATH_INFO: `/v3/projects/a22fb8b1d448405d954ac2f7980e33c6` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:27.028362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bfdd8-c058-4657-b0f9-a5568bc4ae97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22fb8b1d448405d954ac2f7980e33c6)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:27.030877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bfdd8-c058-4657-b0f9-a5568bc4ae97 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:27.180915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-702bfdd8-c058-4657-b0f9-a5568bc4ae97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22fb8b1d448405d954ac2f7980e33c6', 'request_id': 'req-702bfdd8-c058-4657-b0f9-a5568bc4ae97'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:27.228391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-702bfdd8-c058-4657-b0f9-a5568bc4ae97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22fb8b1d448405d954ac2f7980e33c6', 'request_id': 'req-702bfdd8-c058-4657-b0f9-a5568bc4ae97'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:27.238336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-702bfdd8-c058-4657-b0f9-a5568bc4ae97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22fb8b1d448405d954ac2f7980e33c6', 'request_id': 'req-702bfdd8-c058-4657-b0f9-a5568bc4ae97'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:27.341584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:27.383505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-702bfdd8-c058-4657-b0f9-a5568bc4ae97 admin admin] The token cache is being invalidate because project a22fb8b1d448405d954ac2f7980e33c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:24:27.384003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-702bfdd8-c058-4657-b0f9-a5568bc4ae97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:27.387374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-702bfdd8-c058-4657-b0f9-a5568bc4ae97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:27.392349 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2452/4972] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:24:26 2022] DELETE /identity/v3/projects/a22fb8b1d448405d954ac2f7980e33c6 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:27.397540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75388155-ae23-40ff-a349-be2014a6ee42 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:27.397870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75388155-ae23-40ff-a349-be2014a6ee42 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:27.398157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75388155-ae23-40ff-a349-be2014a6ee42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:27.427651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-75388155-ae23-40ff-a349-be2014a6ee42 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:27.429123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-75388155-ae23-40ff-a349-be2014a6ee42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:27.530729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66744c1-d658-442d-a681-9c745b7d8a58 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:27.532249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66744c1-d658-442d-a681-9c745b7d8a58 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:27.532873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66744c1-d658-442d-a681-9c745b7d8a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:27.535490 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2521/4973] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:27.554369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e66744c1-d658-442d-a681-9c745b7d8a58 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:27.555951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e66744c1-d658-442d-a681-9c745b7d8a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:27.574559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75388155-ae23-40ff-a349-be2014a6ee42 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:27.575263 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2453/4974] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:27.591611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75388155-ae23-40ff-a349-be2014a6ee42 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:27.599373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13d395-8589-480d-b8af-efbb54007399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:27.600458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13d395-8589-480d-b8af-efbb54007399 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:27.601096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13d395-8589-480d-b8af-efbb54007399 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:27.601576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13d395-8589-480d-b8af-efbb54007399 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:27.602772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13d395-8589-480d-b8af-efbb54007399 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:24:27.603425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13d395-8589-480d-b8af-efbb54007399 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:27.607669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13d395-8589-480d-b8af-efbb54007399 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:27.625606 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2522/4975] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:24:27.629594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66744c1-d658-442d-a681-9c745b7d8a58 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:27.640801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66744c1-d658-442d-a681-9c745b7d8a58 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:27.646319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfecdb4-9580-45bf-abe1-337a77dd043f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:27.647131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfecdb4-9580-45bf-abe1-337a77dd043f admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:27.647422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfecdb4-9580-45bf-abe1-337a77dd043f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:27.647701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfecdb4-9580-45bf-abe1-337a77dd043f admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:27.648421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfecdb4-9580-45bf-abe1-337a77dd043f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:27.651689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfecdb4-9580-45bf-abe1-337a77dd043f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:27.752047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:27.765140 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2454/4976] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:24:27 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:27.769498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13d395-8589-480d-b8af-efbb54007399 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:27.787102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13d395-8589-480d-b8af-efbb54007399 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:27.908269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77b0e0-88f0-44f9-8942-7ba77f353a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:27.909191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77b0e0-88f0-44f9-8942-7ba77f353a67 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:27.909476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77b0e0-88f0-44f9-8942-7ba77f353a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:27.909757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77b0e0-88f0-44f9-8942-7ba77f353a67 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:27.910500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77b0e0-88f0-44f9-8942-7ba77f353a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:27.912740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77b0e0-88f0-44f9-8942-7ba77f353a67 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:27.934467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfecdb4-9580-45bf-abe1-337a77dd043f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:27.936856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4dfecdb4-9580-45bf-abe1-337a77dd043f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:27.959112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfecdb4-9580-45bf-abe1-337a77dd043f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:27.977097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd95127-3410-4db4-a113-4ef661be0a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:27.977744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd95127-3410-4db4-a113-4ef661be0a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:27.978041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd95127-3410-4db4-a113-4ef661be0a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:27.978419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd95127-3410-4db4-a113-4ef661be0a30 admin admin] PATH_INFO: `/v3/projects/020889a05ee6468fbfb029a25fc24aae` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:27.980083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd95127-3410-4db4-a113-4ef661be0a30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=020889a05ee6468fbfb029a25fc24aae)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:27.983134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd95127-3410-4db4-a113-4ef661be0a30 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:28.075702 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2523/4977] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:24:27 2022] POST /identity/v3/users => generated 291 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:24:28.079915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77b0e0-88f0-44f9-8942-7ba77f353a67 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:28.096313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77b0e0-88f0-44f9-8942-7ba77f353a67 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:28.103463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0b2c2-b681-46f1-b6ef-197056f9cdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:28.104439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0b2c2-b681-46f1-b6ef-197056f9cdd7 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:28.104921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0b2c2-b681-46f1-b6ef-197056f9cdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:28.105267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0b2c2-b681-46f1-b6ef-197056f9cdd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:28.106083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0b2c2-b681-46f1-b6ef-197056f9cdd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:28.107936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0b2c2-b681-46f1-b6ef-197056f9cdd7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:28.128092 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2524/4978] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:28.132359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0b2c2-b681-46f1-b6ef-197056f9cdd7 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:28.148491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0b2c2-b681-46f1-b6ef-197056f9cdd7 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:28.173209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6bd95127-3410-4db4-a113-4ef661be0a30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '020889a05ee6468fbfb029a25fc24aae', 'request_id': 'req-6bd95127-3410-4db4-a113-4ef661be0a30'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:28.180613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6bd95127-3410-4db4-a113-4ef661be0a30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '020889a05ee6468fbfb029a25fc24aae', 'request_id': 'req-6bd95127-3410-4db4-a113-4ef661be0a30'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:28.207776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6bd95127-3410-4db4-a113-4ef661be0a30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '020889a05ee6468fbfb029a25fc24aae', 'request_id': 'req-6bd95127-3410-4db4-a113-4ef661be0a30'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:28.283216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec6f5e-85c3-472a-b6a1-cc40ea9b9224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:28.286499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec6f5e-85c3-472a-b6a1-cc40ea9b9224 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:28.287405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec6f5e-85c3-472a-b6a1-cc40ea9b9224 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:28.288099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec6f5e-85c3-472a-b6a1-cc40ea9b9224 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:28.288982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec6f5e-85c3-472a-b6a1-cc40ea9b9224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:28.293262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec6f5e-85c3-472a-b6a1-cc40ea9b9224 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:28.302604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6bd95127-3410-4db4-a113-4ef661be0a30 admin admin] The token cache is being invalidate because project 020889a05ee6468fbfb029a25fc24aae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:24:28.303195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6bd95127-3410-4db4-a113-4ef661be0a30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:28.304718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6bd95127-3410-4db4-a113-4ef661be0a30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:28.308699 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2455/4979] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:24:27 2022] DELETE /identity/v3/projects/020889a05ee6468fbfb029a25fc24aae => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:28.316988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd95127-3410-4db4-a113-4ef661be0a30 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:28.320825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6bd95127-3410-4db4-a113-4ef661be0a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:28.331104 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2525/4980] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:28.332113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec6f5e-85c3-472a-b6a1-cc40ea9b9224 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:28.337016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-74ec6f5e-85c3-472a-b6a1-cc40ea9b9224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:28.370731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd95127-3410-4db4-a113-4ef661be0a30 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:28.371748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec6f5e-85c3-472a-b6a1-cc40ea9b9224 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:28.389605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2c26c-97a8-482b-830b-175e44f8b56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:28.390852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2c26c-97a8-482b-830b-175e44f8b56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:28.390852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2c26c-97a8-482b-830b-175e44f8b56e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:28.391108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2c26c-97a8-482b-830b-175e44f8b56e admin admin] PATH_INFO: `/v3/users/c91977d5445e42e49053fe239da209cc` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:28.394669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2c26c-97a8-482b-830b-175e44f8b56e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c91977d5445e42e49053fe239da209cc)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:28.396146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578588c6-cdef-46d7-a244-8aab9b9c2ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:28.397070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578588c6-cdef-46d7-a244-8aab9b9c2ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:28.397369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578588c6-cdef-46d7-a244-8aab9b9c2ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:28.399638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578588c6-cdef-46d7-a244-8aab9b9c2ab8 admin admin] PATH_INFO: `/v3/projects/00ac4228f14749fb8f3fe8da4fdb4a85/users/9f2a6e0cc1014d5e8c274be360c8d472/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:28.404743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2c26c-97a8-482b-830b-175e44f8b56e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:28.456248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578588c6-cdef-46d7-a244-8aab9b9c2ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00ac4228f14749fb8f3fe8da4fdb4a85, user_id=9f2a6e0cc1014d5e8c274be360c8d472, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:28.465731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578588c6-cdef-46d7-a244-8aab9b9c2ab8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:28.489454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:28.570931 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2526/4981] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:24:28 2022] PUT /identity/v3/projects/00ac4228f14749fb8f3fe8da4fdb4a85/users/9f2a6e0cc1014d5e8c274be360c8d472/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:28.582483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8041a-948e-4585-9598-f242a925a9db None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:28.582776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8041a-948e-4585-9598-f242a925a9db None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:28.583144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8041a-948e-4585-9598-f242a925a9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:28.645394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-09c8041a-948e-4585-9598-f242a925a9db None None] MFA Rules not processed for user `9f2a6e0cc1014d5e8c274be360c8d472`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:28.646645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-09c8041a-948e-4585-9598-f242a925a9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:28.710833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-62d2c26c-97a8-482b-830b-175e44f8b56e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c91977d5445e42e49053fe239da209cc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:28.731160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-62d2c26c-97a8-482b-830b-175e44f8b56e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c91977d5445e42e49053fe239da209cc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:28.788175 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2527/4982] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:24:28.811703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-62d2c26c-97a8-482b-830b-175e44f8b56e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c91977d5445e42e49053fe239da209cc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:28.826688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8041a-948e-4585-9598-f242a925a9db None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:28.828267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-09c8041a-948e-4585-9598-f242a925a9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:28.829385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-62d2c26c-97a8-482b-830b-175e44f8b56e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c91977d5445e42e49053fe239da209cc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:28.834001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-62d2c26c-97a8-482b-830b-175e44f8b56e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c91977d5445e42e49053fe239da209cc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:28.863145 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2456/4983] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:24:28 2022] DELETE /identity/v3/users/c91977d5445e42e49053fe239da209cc => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:28.867058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a10ce-6a81-4f72-805d-ce4a8cc0cc0f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:28.867058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a10ce-6a81-4f72-805d-ce4a8cc0cc0f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:28.867058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a10ce-6a81-4f72-805d-ce4a8cc0cc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:28.929951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a44a10ce-6a81-4f72-805d-ce4a8cc0cc0f None None] MFA Rules not processed for user `ab1e26051847460f85bfedf8f9c0336b`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:28.931592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a44a10ce-6a81-4f72-805d-ce4a8cc0cc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:29.048880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8041a-948e-4585-9598-f242a925a9db None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:29.132087 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2457/4984] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:29.175178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d542a61-f6d5-4ca5-9b11-24fb9b93b6c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:29.175915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d542a61-f6d5-4ca5-9b11-24fb9b93b6c5 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:29.176252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d542a61-f6d5-4ca5-9b11-24fb9b93b6c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:29.176528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d542a61-f6d5-4ca5-9b11-24fb9b93b6c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:29.180299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8d542a61-f6d5-4ca5-9b11-24fb9b93b6c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:29.239495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:29.271451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d542a61-f6d5-4ca5-9b11-24fb9b93b6c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:29.274225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d542a61-f6d5-4ca5-9b11-24fb9b93b6c5 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:29.290072 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2528/4985] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:24:29.463229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a10ce-6a81-4f72-805d-ce4a8cc0cc0f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:29.465490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a44a10ce-6a81-4f72-805d-ce4a8cc0cc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:29.587265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a10ce-6a81-4f72-805d-ce4a8cc0cc0f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:29.595773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49158a87-5d53-4591-bff3-13372ad537ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:29.598106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49158a87-5d53-4591-bff3-13372ad537ae service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:29.598398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49158a87-5d53-4591-bff3-13372ad537ae service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:29.598725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49158a87-5d53-4591-bff3-13372ad537ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:29.610255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49158a87-5d53-4591-bff3-13372ad537ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:29.611916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49158a87-5d53-4591-bff3-13372ad537ae service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:29.623042 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2458/4986] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:24:30.042872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d542a61-f6d5-4ca5-9b11-24fb9b93b6c5 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:30.045838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8d542a61-f6d5-4ca5-9b11-24fb9b93b6c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:30.184811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d542a61-f6d5-4ca5-9b11-24fb9b93b6c5 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:30.190084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df18075-01d0-4d6a-bb01-74fd20332e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:30.191098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df18075-01d0-4d6a-bb01-74fd20332e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:30.191384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df18075-01d0-4d6a-bb01-74fd20332e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:30.191663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df18075-01d0-4d6a-bb01-74fd20332e4d admin admin] PATH_INFO: `/v3/projects/38a2ec99a2474f0ba3a3df85d2571b3c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:30.192953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df18075-01d0-4d6a-bb01-74fd20332e4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=38a2ec99a2474f0ba3a3df85d2571b3c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:30.194914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df18075-01d0-4d6a-bb01-74fd20332e4d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:30.410879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:30.465727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1df18075-01d0-4d6a-bb01-74fd20332e4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38a2ec99a2474f0ba3a3df85d2571b3c', 'request_id': 'req-1df18075-01d0-4d6a-bb01-74fd20332e4d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:30.481271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1df18075-01d0-4d6a-bb01-74fd20332e4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38a2ec99a2474f0ba3a3df85d2571b3c', 'request_id': 'req-1df18075-01d0-4d6a-bb01-74fd20332e4d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:30.497620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1df18075-01d0-4d6a-bb01-74fd20332e4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38a2ec99a2474f0ba3a3df85d2571b3c', 'request_id': 'req-1df18075-01d0-4d6a-bb01-74fd20332e4d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:30.611942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1df18075-01d0-4d6a-bb01-74fd20332e4d admin admin] The token cache is being invalidate because project 38a2ec99a2474f0ba3a3df85d2571b3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:24:30.612385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1df18075-01d0-4d6a-bb01-74fd20332e4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:30.613079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1df18075-01d0-4d6a-bb01-74fd20332e4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:30.616760 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2529/4987] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:24:30 2022] DELETE /identity/v3/projects/38a2ec99a2474f0ba3a3df85d2571b3c => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:30.622388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a161928-4ddf-439d-969f-957dbd2d7c50 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:30.622982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a161928-4ddf-439d-969f-957dbd2d7c50 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:30.623451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a161928-4ddf-439d-969f-957dbd2d7c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:30.646438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5a161928-4ddf-439d-969f-957dbd2d7c50 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:30.648113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5a161928-4ddf-439d-969f-957dbd2d7c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:30.753306 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2459/4988] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:30.756757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425d0e8-0f0d-415e-9c12-8b009d713a05 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:30.757283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425d0e8-0f0d-415e-9c12-8b009d713a05 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:30.757731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425d0e8-0f0d-415e-9c12-8b009d713a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:30.781322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e425d0e8-0f0d-415e-9c12-8b009d713a05 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:30.782572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e425d0e8-0f0d-415e-9c12-8b009d713a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:30.798774 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2530/4989] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:30.805632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a161928-4ddf-439d-969f-957dbd2d7c50 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:30.831516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:30.842070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a161928-4ddf-439d-969f-957dbd2d7c50 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:30.859141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e5ed5-a30a-4710-8894-4fb313fef080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:30.863687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e5ed5-a30a-4710-8894-4fb313fef080 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:30.865917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e5ed5-a30a-4710-8894-4fb313fef080 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:30.870238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e5ed5-a30a-4710-8894-4fb313fef080 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:30.873217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e5ed5-a30a-4710-8894-4fb313fef080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:24:30.877463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e5ed5-a30a-4710-8894-4fb313fef080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:30.881065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e5ed5-a30a-4710-8894-4fb313fef080 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:30.923733 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2460/4990] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:24:30.928571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425d0e8-0f0d-415e-9c12-8b009d713a05 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:30.942737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425d0e8-0f0d-415e-9c12-8b009d713a05 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:30.958822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe8af9-8adb-4d8f-aff9-ffccab235a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:30.959624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe8af9-8adb-4d8f-aff9-ffccab235a5e admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:30.959906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe8af9-8adb-4d8f-aff9-ffccab235a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:30.960181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe8af9-8adb-4d8f-aff9-ffccab235a5e admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:30.960883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe8af9-8adb-4d8f-aff9-ffccab235a5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:30.962917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe8af9-8adb-4d8f-aff9-ffccab235a5e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:31.110366 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2531/4991] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:24:30 2022] POST /identity/v3/projects => generated 387 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:31.114528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e5ed5-a30a-4710-8894-4fb313fef080 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:31.131044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e5ed5-a30a-4710-8894-4fb313fef080 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:31.217897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401be798-9464-4b82-899c-13d43e940559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:31.218880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401be798-9464-4b82-899c-13d43e940559 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:31.219294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401be798-9464-4b82-899c-13d43e940559 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:31.220377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401be798-9464-4b82-899c-13d43e940559 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:31.221387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401be798-9464-4b82-899c-13d43e940559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:31.224151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401be798-9464-4b82-899c-13d43e940559 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:31.318102 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2461/4992] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:24:31 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:31.319766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe8af9-8adb-4d8f-aff9-ffccab235a5e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:31.335280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe8af9-8adb-4d8f-aff9-ffccab235a5e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:31.357931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f00497-ffbf-4a24-a06b-33c76d559183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:31.358688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f00497-ffbf-4a24-a06b-33c76d559183 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:31.359363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f00497-ffbf-4a24-a06b-33c76d559183 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:31.359526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f00497-ffbf-4a24-a06b-33c76d559183 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:31.360690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f00497-ffbf-4a24-a06b-33c76d559183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:31.362845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f00497-ffbf-4a24-a06b-33c76d559183 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:31.393322 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2532/4993] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:31.393724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401be798-9464-4b82-899c-13d43e940559 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:31.416393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401be798-9464-4b82-899c-13d43e940559 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:31.431594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10561d-257c-4777-aae0-6a51668db647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:31.432746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10561d-257c-4777-aae0-6a51668db647 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:31.433393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10561d-257c-4777-aae0-6a51668db647 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:31.434074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10561d-257c-4777-aae0-6a51668db647 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:31.434978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10561d-257c-4777-aae0-6a51668db647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:31.436801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10561d-257c-4777-aae0-6a51668db647 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:31.462047 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2462/4994] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:31.468403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f00497-ffbf-4a24-a06b-33c76d559183 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:31.482893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f00497-ffbf-4a24-a06b-33c76d559183 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:31.488335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0c27a-e2db-4a72-8142-b2ca870b5c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:31.503215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0c27a-e2db-4a72-8142-b2ca870b5c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:31.503215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0c27a-e2db-4a72-8142-b2ca870b5c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:31.503215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0c27a-e2db-4a72-8142-b2ca870b5c55 admin admin] PATH_INFO: `/v3/projects/8271874b0ee44efeb22f8fb088206844/users/dcb0bf2c8241485797e5a71ecd9aac4e/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:31.512543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0c27a-e2db-4a72-8142-b2ca870b5c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8271874b0ee44efeb22f8fb088206844, user_id=dcb0bf2c8241485797e5a71ecd9aac4e, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:31.517165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0c27a-e2db-4a72-8142-b2ca870b5c55 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:31.711633 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2533/4995] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:24:31 2022] PUT /identity/v3/projects/8271874b0ee44efeb22f8fb088206844/users/dcb0bf2c8241485797e5a71ecd9aac4e/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:31.722790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8cfa4-b1f0-4b86-bc9c-59a3a0ba7acc None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:31.723338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8cfa4-b1f0-4b86-bc9c-59a3a0ba7acc None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:31.723776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8cfa4-b1f0-4b86-bc9c-59a3a0ba7acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:31.764066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-94b8cfa4-b1f0-4b86-bc9c-59a3a0ba7acc None None] MFA Rules not processed for user `dcb0bf2c8241485797e5a71ecd9aac4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:31.765296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-94b8cfa4-b1f0-4b86-bc9c-59a3a0ba7acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:31.863356 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2463/4996] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:31.867103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0c27a-e2db-4a72-8142-b2ca870b5c55 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:31.907600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:31.959416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:31.990194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0c27a-e2db-4a72-8142-b2ca870b5c55 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:32.004379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32753b-88d1-4b6e-999c-9b4a3063be31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:32.005067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32753b-88d1-4b6e-999c-9b4a3063be31 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:32.005351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32753b-88d1-4b6e-999c-9b4a3063be31 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:32.005630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32753b-88d1-4b6e-999c-9b4a3063be31 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:32.006342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32753b-88d1-4b6e-999c-9b4a3063be31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:32.008321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32753b-88d1-4b6e-999c-9b4a3063be31 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:32.119958 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2534/4997] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:24:31 2022] POST /identity/v3/projects => generated 385 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:24:32.121796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8cfa4-b1f0-4b86-bc9c-59a3a0ba7acc None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:32.150966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8cfa4-b1f0-4b86-bc9c-59a3a0ba7acc None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:32.268880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b342963-04f8-45f3-9b43-cb2ce9aacffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:32.271547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b342963-04f8-45f3-9b43-cb2ce9aacffc admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:32.272119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b342963-04f8-45f3-9b43-cb2ce9aacffc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:32.272843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b342963-04f8-45f3-9b43-cb2ce9aacffc admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:32.275503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b342963-04f8-45f3-9b43-cb2ce9aacffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:32.279316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b342963-04f8-45f3-9b43-cb2ce9aacffc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:32.408148 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2464/4998] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:24:32 2022] POST /identity/v3/users => generated 299 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:32.412273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32753b-88d1-4b6e-999c-9b4a3063be31 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:32.425934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32753b-88d1-4b6e-999c-9b4a3063be31 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:32.441399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e620c8d-8247-4880-9f23-e0573fede9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:32.444546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e620c8d-8247-4880-9f23-e0573fede9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:32.444994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e620c8d-8247-4880-9f23-e0573fede9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:32.446719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e620c8d-8247-4880-9f23-e0573fede9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:32.447816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e620c8d-8247-4880-9f23-e0573fede9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:32.450789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e620c8d-8247-4880-9f23-e0573fede9d4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:32.482890 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2535/4999] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:32.487316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b342963-04f8-45f3-9b43-cb2ce9aacffc admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:32.507421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b342963-04f8-45f3-9b43-cb2ce9aacffc admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:32.514876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211490b-3bb5-417b-9099-d770a92a3ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:32.515884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211490b-3bb5-417b-9099-d770a92a3ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:32.516227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211490b-3bb5-417b-9099-d770a92a3ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:32.516559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211490b-3bb5-417b-9099-d770a92a3ca3 admin admin] PATH_INFO: `/v3/projects/51343d7ddb3245ee932625c49aee8630/users/27ffba4e72ba4bf4aff8892e4dddbf0b/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:32.554839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211490b-3bb5-417b-9099-d770a92a3ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51343d7ddb3245ee932625c49aee8630, user_id=27ffba4e72ba4bf4aff8892e4dddbf0b, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:32.557700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211490b-3bb5-417b-9099-d770a92a3ca3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:32.804671 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2465/5000] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:24:32 2022] PUT /identity/v3/projects/51343d7ddb3245ee932625c49aee8630/users/27ffba4e72ba4bf4aff8892e4dddbf0b/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:32.810898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e620c8d-8247-4880-9f23-e0573fede9d4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:32.843755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e620c8d-8247-4880-9f23-e0573fede9d4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:32.952241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39550b1b-21c5-4d67-952e-b3e40f59c440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:32.957309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39550b1b-21c5-4d67-952e-b3e40f59c440 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:32.957309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39550b1b-21c5-4d67-952e-b3e40f59c440 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:32.957309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39550b1b-21c5-4d67-952e-b3e40f59c440 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:32.957309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39550b1b-21c5-4d67-952e-b3e40f59c440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:32.959147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39550b1b-21c5-4d67-952e-b3e40f59c440 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:32.979880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211490b-3bb5-417b-9099-d770a92a3ca3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:32.993921 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2536/5001] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:32.997891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211490b-3bb5-417b-9099-d770a92a3ca3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:33.014048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0675ec-2cda-4712-98cd-87d9bac23828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:33.014964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0675ec-2cda-4712-98cd-87d9bac23828 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:33.015276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0675ec-2cda-4712-98cd-87d9bac23828 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:33.015555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0675ec-2cda-4712-98cd-87d9bac23828 admin admin] PATH_INFO: `/v3/projects/51343d7ddb3245ee932625c49aee8630/users/27ffba4e72ba4bf4aff8892e4dddbf0b/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:33.019115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0675ec-2cda-4712-98cd-87d9bac23828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51343d7ddb3245ee932625c49aee8630, user_id=27ffba4e72ba4bf4aff8892e4dddbf0b, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:33.022020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0675ec-2cda-4712-98cd-87d9bac23828 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:33.064016 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2466/5002] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:24:32 2022] PUT /identity/v3/projects/51343d7ddb3245ee932625c49aee8630/users/27ffba4e72ba4bf4aff8892e4dddbf0b/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:24:33.076710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037a4cf-0b69-48a1-9849-b4beeecc9969 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:33.077059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037a4cf-0b69-48a1-9849-b4beeecc9969 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:33.077395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037a4cf-0b69-48a1-9849-b4beeecc9969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:33.174273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f037a4cf-0b69-48a1-9849-b4beeecc9969 None None] MFA Rules not processed for user `27ffba4e72ba4bf4aff8892e4dddbf0b`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:33.175560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f037a4cf-0b69-48a1-9849-b4beeecc9969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:33.327141 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2537/5003] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:33.333638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0675ec-2cda-4712-98cd-87d9bac23828 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:33.335551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3c0675ec-2cda-4712-98cd-87d9bac23828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:33.540885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0675ec-2cda-4712-98cd-87d9bac23828 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:33.556643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9753a-75d9-4a2f-8d1e-404185097ed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:33.556643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9753a-75d9-4a2f-8d1e-404185097ed6 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:33.556643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9753a-75d9-4a2f-8d1e-404185097ed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:33.556643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9753a-75d9-4a2f-8d1e-404185097ed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:33.566126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9753a-75d9-4a2f-8d1e-404185097ed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:33.568225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9753a-75d9-4a2f-8d1e-404185097ed6 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:33.596837 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2467/5004] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:24:33.651424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:33.689578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037a4cf-0b69-48a1-9849-b4beeecc9969 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:33.810566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:33.872061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037a4cf-0b69-48a1-9849-b4beeecc9969 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:33.896831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41232c-e9e4-49be-85ba-fb9802c74abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:33.898281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41232c-e9e4-49be-85ba-fb9802c74abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:33.898571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41232c-e9e4-49be-85ba-fb9802c74abc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:33.900059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41232c-e9e4-49be-85ba-fb9802c74abc admin admin] PATH_INFO: `/v3/users/dcb0bf2c8241485797e5a71ecd9aac4e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:33.903842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41232c-e9e4-49be-85ba-fb9802c74abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcb0bf2c8241485797e5a71ecd9aac4e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:33.910168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41232c-e9e4-49be-85ba-fb9802c74abc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:34.208976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4d41232c-e9e4-49be-85ba-fb9802c74abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcb0bf2c8241485797e5a71ecd9aac4e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:34.219104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4d41232c-e9e4-49be-85ba-fb9802c74abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcb0bf2c8241485797e5a71ecd9aac4e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:34.341870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:34.376320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4d41232c-e9e4-49be-85ba-fb9802c74abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcb0bf2c8241485797e5a71ecd9aac4e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:34.377358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4d41232c-e9e4-49be-85ba-fb9802c74abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcb0bf2c8241485797e5a71ecd9aac4e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:34.403032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4d41232c-e9e4-49be-85ba-fb9802c74abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcb0bf2c8241485797e5a71ecd9aac4e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:34.414996 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2538/5005] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:24:33 2022] DELETE /identity/v3/users/dcb0bf2c8241485797e5a71ecd9aac4e => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:34.420385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace86457-3f0f-4a19-924d-3d5374d06720 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:34.420681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace86457-3f0f-4a19-924d-3d5374d06720 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:34.420959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace86457-3f0f-4a19-924d-3d5374d06720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:34.443825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ace86457-3f0f-4a19-924d-3d5374d06720 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:34.449763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ace86457-3f0f-4a19-924d-3d5374d06720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:34.558924 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2468/5006] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:34.576240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41232c-e9e4-49be-85ba-fb9802c74abc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:34.577804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4d41232c-e9e4-49be-85ba-fb9802c74abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:34.668100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41232c-e9e4-49be-85ba-fb9802c74abc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:34.686786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21aaea-b019-41e3-ba23-f42c9440a6b1 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:34.687162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21aaea-b019-41e3-ba23-f42c9440a6b1 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:34.688086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21aaea-b019-41e3-ba23-f42c9440a6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:34.693456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b1bab-59e8-4dcb-a46c-5213ff67c9c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:34.696060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b1bab-59e8-4dcb-a46c-5213ff67c9c3 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:34.696703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b1bab-59e8-4dcb-a46c-5213ff67c9c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:34.698624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b1bab-59e8-4dcb-a46c-5213ff67c9c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:34.726217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8a21aaea-b019-41e3-ba23-f42c9440a6b1 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:34.729470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8a21aaea-b019-41e3-ba23-f42c9440a6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:34.733147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b1bab-59e8-4dcb-a46c-5213ff67c9c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:34.736814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b1bab-59e8-4dcb-a46c-5213ff67c9c3 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:34.765803 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2539/5007] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:24:34.858594 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2469/5008] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:24:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:24:35.010790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b1bab-59e8-4dcb-a46c-5213ff67c9c3 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:35.010790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-916b1bab-59e8-4dcb-a46c-5213ff67c9c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:35.116783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b1bab-59e8-4dcb-a46c-5213ff67c9c3 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:35.123942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c3c34-9d82-4972-b6fc-a39b8af34d93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:35.124674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c3c34-9d82-4972-b6fc-a39b8af34d93 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:35.125024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c3c34-9d82-4972-b6fc-a39b8af34d93 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:35.125391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c3c34-9d82-4972-b6fc-a39b8af34d93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:35.134172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c3c34-9d82-4972-b6fc-a39b8af34d93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:35.136758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c3c34-9d82-4972-b6fc-a39b8af34d93 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:35.145712 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2540/5009] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:24:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:24:35.293920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b875724-9e11-482f-8b6e-d839caceed9d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:35.294818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b875724-9e11-482f-8b6e-d839caceed9d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:35.295927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b875724-9e11-482f-8b6e-d839caceed9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:35.343948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8b875724-9e11-482f-8b6e-d839caceed9d None None] MFA Rules not processed for user `027dcc48e4fd4c36a5004096ad5e43f8`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:35.346828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8b875724-9e11-482f-8b6e-d839caceed9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:35.473369 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2470/5010] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:35.798973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:36.564542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:36.946710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c3c34-9d82-4972-b6fc-a39b8af34d93 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:36.950376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0b3c3c34-9d82-4972-b6fc-a39b8af34d93 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:36.976232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c3c34-9d82-4972-b6fc-a39b8af34d93 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:36.993430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd6287-62d5-440d-a290-9d31829718da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:36.997815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd6287-62d5-440d-a290-9d31829718da admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:36.997815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd6287-62d5-440d-a290-9d31829718da admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:36.997815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd6287-62d5-440d-a290-9d31829718da admin admin] PATH_INFO: `/v3/projects/8271874b0ee44efeb22f8fb088206844` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:36.999341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd6287-62d5-440d-a290-9d31829718da admin admin] RBAC: Authorizing `identity:delete_project(project_id=8271874b0ee44efeb22f8fb088206844)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:37.001497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd6287-62d5-440d-a290-9d31829718da admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:37.213770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bdfd6287-62d5-440d-a290-9d31829718da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8271874b0ee44efeb22f8fb088206844', 'request_id': 'req-bdfd6287-62d5-440d-a290-9d31829718da'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:37.232457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bdfd6287-62d5-440d-a290-9d31829718da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8271874b0ee44efeb22f8fb088206844', 'request_id': 'req-bdfd6287-62d5-440d-a290-9d31829718da'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:37.243369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bdfd6287-62d5-440d-a290-9d31829718da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8271874b0ee44efeb22f8fb088206844', 'request_id': 'req-bdfd6287-62d5-440d-a290-9d31829718da'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:37.354050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bdfd6287-62d5-440d-a290-9d31829718da admin admin] The token cache is being invalidate because project 8271874b0ee44efeb22f8fb088206844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:24:37.355425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bdfd6287-62d5-440d-a290-9d31829718da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:37.358162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bdfd6287-62d5-440d-a290-9d31829718da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:37.358539 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2541/5011] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:24:36 2022] DELETE /identity/v3/projects/8271874b0ee44efeb22f8fb088206844 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:24:37.362835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b875724-9e11-482f-8b6e-d839caceed9d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:37.381523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b875724-9e11-482f-8b6e-d839caceed9d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:37.552755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc769358-4af3-4eb9-b848-294e19eae204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:37.555839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc769358-4af3-4eb9-b848-294e19eae204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:37.558328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc769358-4af3-4eb9-b848-294e19eae204 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:37.558824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc769358-4af3-4eb9-b848-294e19eae204 admin admin] PATH_INFO: `/v3/users/27ffba4e72ba4bf4aff8892e4dddbf0b` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:37.573027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc769358-4af3-4eb9-b848-294e19eae204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ffba4e72ba4bf4aff8892e4dddbf0b)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:37.579497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc769358-4af3-4eb9-b848-294e19eae204 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:37.874151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc769358-4af3-4eb9-b848-294e19eae204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ffba4e72ba4bf4aff8892e4dddbf0b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:37.906979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc769358-4af3-4eb9-b848-294e19eae204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ffba4e72ba4bf4aff8892e4dddbf0b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:38.056190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc769358-4af3-4eb9-b848-294e19eae204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ffba4e72ba4bf4aff8892e4dddbf0b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:38.090605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc769358-4af3-4eb9-b848-294e19eae204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ffba4e72ba4bf4aff8892e4dddbf0b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:38.092594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc769358-4af3-4eb9-b848-294e19eae204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ffba4e72ba4bf4aff8892e4dddbf0b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:38.112110 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2471/5012] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:24:37 2022] DELETE /identity/v3/users/27ffba4e72ba4bf4aff8892e4dddbf0b => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:38.261730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:38.347992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:39.612639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd6287-62d5-440d-a290-9d31829718da admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:39.615215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bdfd6287-62d5-440d-a290-9d31829718da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:39.652780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd6287-62d5-440d-a290-9d31829718da admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:39.945030 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12377110-a78b-49e4-ad52-1a91c56632a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:39.945948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12377110-a78b-49e4-ad52-1a91c56632a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:39.946227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12377110-a78b-49e4-ad52-1a91c56632a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:39.946501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12377110-a78b-49e4-ad52-1a91c56632a8 admin admin] PATH_INFO: `/v3/projects/51343d7ddb3245ee932625c49aee8630` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:39.958355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12377110-a78b-49e4-ad52-1a91c56632a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51343d7ddb3245ee932625c49aee8630)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:39.968850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12377110-a78b-49e4-ad52-1a91c56632a8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:40.236159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:40.303981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-12377110-a78b-49e4-ad52-1a91c56632a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51343d7ddb3245ee932625c49aee8630', 'request_id': 'req-12377110-a78b-49e4-ad52-1a91c56632a8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:40.313167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-12377110-a78b-49e4-ad52-1a91c56632a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51343d7ddb3245ee932625c49aee8630', 'request_id': 'req-12377110-a78b-49e4-ad52-1a91c56632a8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:40.329707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-12377110-a78b-49e4-ad52-1a91c56632a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51343d7ddb3245ee932625c49aee8630', 'request_id': 'req-12377110-a78b-49e4-ad52-1a91c56632a8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:40.472205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-12377110-a78b-49e4-ad52-1a91c56632a8 admin admin] The token cache is being invalidate because project 51343d7ddb3245ee932625c49aee8630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:24:40.472205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-12377110-a78b-49e4-ad52-1a91c56632a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:40.472205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-12377110-a78b-49e4-ad52-1a91c56632a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:40.472205 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2542/5013] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:24:39 2022] DELETE /identity/v3/projects/51343d7ddb3245ee932625c49aee8630 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:40.475536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b4ada-9069-4f50-8f77-2df464bebd89 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:40.476370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b4ada-9069-4f50-8f77-2df464bebd89 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:40.476852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b4ada-9069-4f50-8f77-2df464bebd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:40.542621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9f2b4ada-9069-4f50-8f77-2df464bebd89 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:40.548237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9f2b4ada-9069-4f50-8f77-2df464bebd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:40.747098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806173f-d5af-447d-b848-e1dc3f5a3a7a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:40.753371 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2472/5014] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:40.753716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806173f-d5af-447d-b848-e1dc3f5a3a7a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:40.753716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806173f-d5af-447d-b848-e1dc3f5a3a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:40.798639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4806173f-d5af-447d-b848-e1dc3f5a3a7a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:40.800255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4806173f-d5af-447d-b848-e1dc3f5a3a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:40.847648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b4ada-9069-4f50-8f77-2df464bebd89 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:40.860119 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2543/5015] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:24:40.862195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b4ada-9069-4f50-8f77-2df464bebd89 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:40.869219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c6cc5-317b-4331-bd0e-ca28823be7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:40.871225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c6cc5-317b-4331-bd0e-ca28823be7cf admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:40.871660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c6cc5-317b-4331-bd0e-ca28823be7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:40.872046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c6cc5-317b-4331-bd0e-ca28823be7cf admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:40.873308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c6cc5-317b-4331-bd0e-ca28823be7cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:24:40.873725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c6cc5-317b-4331-bd0e-ca28823be7cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:40.905956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c6cc5-317b-4331-bd0e-ca28823be7cf admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:40.941849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806173f-d5af-447d-b848-e1dc3f5a3a7a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:40.942603 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2473/5016] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:24:40.959667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806173f-d5af-447d-b848-e1dc3f5a3a7a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:40.966083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f359c3b-24d4-440b-adc3-89b5d2fb39a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:40.967117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f359c3b-24d4-440b-adc3-89b5d2fb39a6 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:40.967933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f359c3b-24d4-440b-adc3-89b5d2fb39a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:40.968579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f359c3b-24d4-440b-adc3-89b5d2fb39a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:40.969562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f359c3b-24d4-440b-adc3-89b5d2fb39a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:40.971910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f359c3b-24d4-440b-adc3-89b5d2fb39a6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:40.993663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:41.068567 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2544/5017] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:24:40 2022] POST /identity/v3/projects => generated 391 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:24:41.069870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c6cc5-317b-4331-bd0e-ca28823be7cf admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:41.084551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c6cc5-317b-4331-bd0e-ca28823be7cf admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:41.192475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c9f63-1d05-4322-9032-8b4ffd104b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:41.193264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c9f63-1d05-4322-9032-8b4ffd104b09 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:41.197231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c9f63-1d05-4322-9032-8b4ffd104b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:41.197231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c9f63-1d05-4322-9032-8b4ffd104b09 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:41.197231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c9f63-1d05-4322-9032-8b4ffd104b09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:41.198786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c9f63-1d05-4322-9032-8b4ffd104b09 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:41.329422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f359c3b-24d4-440b-adc3-89b5d2fb39a6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:41.330437 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2474/5018] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:24:41 2022] POST /identity/v3/users => generated 296 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:41.348622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f359c3b-24d4-440b-adc3-89b5d2fb39a6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:41.370215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c759cb1-c975-4a5c-a04d-40527882bad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:41.371518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c759cb1-c975-4a5c-a04d-40527882bad1 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:41.371518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c759cb1-c975-4a5c-a04d-40527882bad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:41.371518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c759cb1-c975-4a5c-a04d-40527882bad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:41.372231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c759cb1-c975-4a5c-a04d-40527882bad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:41.373928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c759cb1-c975-4a5c-a04d-40527882bad1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:41.400354 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2545/5019] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:24:41.401970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c9f63-1d05-4322-9032-8b4ffd104b09 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:41.420372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c9f63-1d05-4322-9032-8b4ffd104b09 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:41.430297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35167cf1-4546-45de-b95e-74e5e99c1580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:41.432753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35167cf1-4546-45de-b95e-74e5e99c1580 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:41.435267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35167cf1-4546-45de-b95e-74e5e99c1580 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:41.435578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35167cf1-4546-45de-b95e-74e5e99c1580 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:41.436959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35167cf1-4546-45de-b95e-74e5e99c1580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:41.442602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35167cf1-4546-45de-b95e-74e5e99c1580 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:41.480414 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2475/5020] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:41.483887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c759cb1-c975-4a5c-a04d-40527882bad1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:41.506869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c759cb1-c975-4a5c-a04d-40527882bad1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:41.523124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9613c2c-d7f3-454a-a11e-cf46694d544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:41.524046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9613c2c-d7f3-454a-a11e-cf46694d544b admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:41.525368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9613c2c-d7f3-454a-a11e-cf46694d544b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:41.525709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9613c2c-d7f3-454a-a11e-cf46694d544b admin admin] PATH_INFO: `/v3/projects/dcafa6d06a74473f91cbc3322e711f84/users/e1fe9c36813b4eaabc25578f20a62b44/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:41.562263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9613c2c-d7f3-454a-a11e-cf46694d544b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcafa6d06a74473f91cbc3322e711f84, user_id=e1fe9c36813b4eaabc25578f20a62b44, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:41.565132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9613c2c-d7f3-454a-a11e-cf46694d544b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:41.672139 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2546/5021] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:24:41 2022] PUT /identity/v3/projects/dcafa6d06a74473f91cbc3322e711f84/users/e1fe9c36813b4eaabc25578f20a62b44/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:41.673641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c806b87-301f-4550-9bf6-a500b09e9247 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:41.673934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c806b87-301f-4550-9bf6-a500b09e9247 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:41.674214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c806b87-301f-4550-9bf6-a500b09e9247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:41.745826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4c806b87-301f-4550-9bf6-a500b09e9247 None None] MFA Rules not processed for user `e1fe9c36813b4eaabc25578f20a62b44`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:41.748129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4c806b87-301f-4550-9bf6-a500b09e9247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:42.002651 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2476/5022] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:24:42.015316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9613c2c-d7f3-454a-a11e-cf46694d544b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:42.147898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9613c2c-d7f3-454a-a11e-cf46694d544b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:42.151228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d109f-f353-4854-92a0-6cec7c5bee72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:42.152187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d109f-f353-4854-92a0-6cec7c5bee72 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:42.153191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d109f-f353-4854-92a0-6cec7c5bee72 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:42.153640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d109f-f353-4854-92a0-6cec7c5bee72 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:42.154515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d109f-f353-4854-92a0-6cec7c5bee72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:42.157475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d109f-f353-4854-92a0-6cec7c5bee72 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:42.308644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c806b87-301f-4550-9bf6-a500b09e9247 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:42.309587 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2547/5023] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:24:42 2022] POST /identity/v3/projects => generated 389 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:42.341523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c806b87-301f-4550-9bf6-a500b09e9247 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:42.427324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:42.552901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa683a-6e0f-4a0e-8fd7-4aaadaa8a1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:42.554291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa683a-6e0f-4a0e-8fd7-4aaadaa8a1d0 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:42.554739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa683a-6e0f-4a0e-8fd7-4aaadaa8a1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:42.555222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa683a-6e0f-4a0e-8fd7-4aaadaa8a1d0 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:42.558625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa683a-6e0f-4a0e-8fd7-4aaadaa8a1d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:42.561131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa683a-6e0f-4a0e-8fd7-4aaadaa8a1d0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:42.726162 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2477/5024] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:24:42 2022] POST /identity/v3/users => generated 301 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:24:42.731506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d109f-f353-4854-92a0-6cec7c5bee72 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:42.777741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d109f-f353-4854-92a0-6cec7c5bee72 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:42.784788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12250a72-7415-4872-aa0c-c0d48d0f559a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:42.787438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12250a72-7415-4872-aa0c-c0d48d0f559a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:42.787861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12250a72-7415-4872-aa0c-c0d48d0f559a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:42.788580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12250a72-7415-4872-aa0c-c0d48d0f559a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:42.790171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12250a72-7415-4872-aa0c-c0d48d0f559a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:42.797277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12250a72-7415-4872-aa0c-c0d48d0f559a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:42.840755 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2548/5025] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:42.840996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa683a-6e0f-4a0e-8fd7-4aaadaa8a1d0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:42.850991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:42.883513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa683a-6e0f-4a0e-8fd7-4aaadaa8a1d0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:42.913201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30b932-c352-401a-8548-505c3613578c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:42.914372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30b932-c352-401a-8548-505c3613578c admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:42.914824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30b932-c352-401a-8548-505c3613578c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:42.915602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30b932-c352-401a-8548-505c3613578c admin admin] PATH_INFO: `/v3/projects/605323b2ed364c6ca981190953e5cdb2/users/7645290d5ecb4b96bda6c927201a0a7b/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:42.966321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30b932-c352-401a-8548-505c3613578c admin admin] RBAC: Authorizing `identity:create_grant(project_id=605323b2ed364c6ca981190953e5cdb2, user_id=7645290d5ecb4b96bda6c927201a0a7b, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:42.969821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30b932-c352-401a-8548-505c3613578c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:43.279378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12250a72-7415-4872-aa0c-c0d48d0f559a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:43.279378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-12250a72-7415-4872-aa0c-c0d48d0f559a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:43.300121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12250a72-7415-4872-aa0c-c0d48d0f559a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:43.309029 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2478/5026] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:24:42 2022] PUT /identity/v3/projects/605323b2ed364c6ca981190953e5cdb2/users/7645290d5ecb4b96bda6c927201a0a7b/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:43.312898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30b932-c352-401a-8548-505c3613578c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:43.507195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0d088-bb76-4e00-ae4c-b548003ebc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:43.508110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0d088-bb76-4e00-ae4c-b548003ebc07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:43.508404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0d088-bb76-4e00-ae4c-b548003ebc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:43.508973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0d088-bb76-4e00-ae4c-b548003ebc07 admin admin] PATH_INFO: `/v3/users/ab1e26051847460f85bfedf8f9c0336b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:43.511723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0d088-bb76-4e00-ae4c-b548003ebc07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1e26051847460f85bfedf8f9c0336b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:43.514033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0d088-bb76-4e00-ae4c-b548003ebc07 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:43.521551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30b932-c352-401a-8548-505c3613578c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:43.544122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb9d2e-a455-4516-b304-bb4a06f32651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:43.545396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb9d2e-a455-4516-b304-bb4a06f32651 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:43.554674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb9d2e-a455-4516-b304-bb4a06f32651 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:43.554674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb9d2e-a455-4516-b304-bb4a06f32651 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:43.554674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb9d2e-a455-4516-b304-bb4a06f32651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:43.554674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb9d2e-a455-4516-b304-bb4a06f32651 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:43.587083 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2479/5027] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:24:43.609112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb9d2e-a455-4516-b304-bb4a06f32651 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:43.668767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb9d2e-a455-4516-b304-bb4a06f32651 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:43.674955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de80d17-617c-4c7b-be6c-10aec22a99b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:43.676174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de80d17-617c-4c7b-be6c-10aec22a99b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:43.682626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de80d17-617c-4c7b-be6c-10aec22a99b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:43.682626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de80d17-617c-4c7b-be6c-10aec22a99b3 admin admin] PATH_INFO: `/v3/projects/605323b2ed364c6ca981190953e5cdb2/users/7645290d5ecb4b96bda6c927201a0a7b/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:43.684367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de80d17-617c-4c7b-be6c-10aec22a99b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=605323b2ed364c6ca981190953e5cdb2, user_id=7645290d5ecb4b96bda6c927201a0a7b, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:43.690164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de80d17-617c-4c7b-be6c-10aec22a99b3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:43.707904 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2480/5028] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:24:43 2022] PUT /identity/v3/projects/605323b2ed364c6ca981190953e5cdb2/users/7645290d5ecb4b96bda6c927201a0a7b/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:43.729272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a8373-b167-4a3c-9194-de8966c8a651 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:43.729850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a8373-b167-4a3c-9194-de8966c8a651 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:43.731610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a8373-b167-4a3c-9194-de8966c8a651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:43.774407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6e0d088-bb76-4e00-ae4c-b548003ebc07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1e26051847460f85bfedf8f9c0336b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:43.787425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4b8a8373-b167-4a3c-9194-de8966c8a651 None None] MFA Rules not processed for user `7645290d5ecb4b96bda6c927201a0a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:43.789055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4b8a8373-b167-4a3c-9194-de8966c8a651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:43.807505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6e0d088-bb76-4e00-ae4c-b548003ebc07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1e26051847460f85bfedf8f9c0336b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:43.923880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6e0d088-bb76-4e00-ae4c-b548003ebc07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1e26051847460f85bfedf8f9c0336b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:43.924376 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2481/5029] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:43.925468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6e0d088-bb76-4e00-ae4c-b548003ebc07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1e26051847460f85bfedf8f9c0336b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:43.941548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a8373-b167-4a3c-9194-de8966c8a651 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:43.947365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4b8a8373-b167-4a3c-9194-de8966c8a651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:43.956420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6e0d088-bb76-4e00-ae4c-b548003ebc07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1e26051847460f85bfedf8f9c0336b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:43.980874 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2549/5030] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:24:43 2022] DELETE /identity/v3/users/ab1e26051847460f85bfedf8f9c0336b => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:24:44.123673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a8373-b167-4a3c-9194-de8966c8a651 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:44.232866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:44.264100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c846cde-dbbf-47f2-826b-4786ba0b2bbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:44.265836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c846cde-dbbf-47f2-826b-4786ba0b2bbc service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:44.266961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c846cde-dbbf-47f2-826b-4786ba0b2bbc service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:44.271705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c846cde-dbbf-47f2-826b-4786ba0b2bbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:44.277533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0c846cde-dbbf-47f2-826b-4786ba0b2bbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:44.422102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c846cde-dbbf-47f2-826b-4786ba0b2bbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:44.423923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c846cde-dbbf-47f2-826b-4786ba0b2bbc service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:44.443486 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2482/5031] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:24:44.521084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:44.595457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0d088-bb76-4e00-ae4c-b548003ebc07 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:44.599329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c6e0d088-bb76-4e00-ae4c-b548003ebc07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:44.624229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0d088-bb76-4e00-ae4c-b548003ebc07 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:44.640735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4270b33-c569-4ae7-92ec-202925e7b2d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:44.641361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4270b33-c569-4ae7-92ec-202925e7b2d1 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:44.641646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4270b33-c569-4ae7-92ec-202925e7b2d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:44.641920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4270b33-c569-4ae7-92ec-202925e7b2d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:44.646540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d4270b33-c569-4ae7-92ec-202925e7b2d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:44.834350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4270b33-c569-4ae7-92ec-202925e7b2d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:44.843448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4270b33-c569-4ae7-92ec-202925e7b2d1 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:44.865992 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2550/5032] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:24:44.899580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c846cde-dbbf-47f2-826b-4786ba0b2bbc service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:44.901856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0c846cde-dbbf-47f2-826b-4786ba0b2bbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:45.100470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c846cde-dbbf-47f2-826b-4786ba0b2bbc service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:45.115134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cbd83c-6017-4017-a069-360b0913e72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:45.116024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbd83c-6017-4017-a069-360b0913e72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:45.118941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbd83c-6017-4017-a069-360b0913e72d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:45.120076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbd83c-6017-4017-a069-360b0913e72d admin admin] PATH_INFO: `/v3/projects/b5b3367821b84df7bafc93dea7905e37` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:45.122656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cbd83c-6017-4017-a069-360b0913e72d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5b3367821b84df7bafc93dea7905e37)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:45.125982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cbd83c-6017-4017-a069-360b0913e72d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:45.325440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:45.454649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-44cbd83c-6017-4017-a069-360b0913e72d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5b3367821b84df7bafc93dea7905e37', 'request_id': 'req-44cbd83c-6017-4017-a069-360b0913e72d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:45.470848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-44cbd83c-6017-4017-a069-360b0913e72d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5b3367821b84df7bafc93dea7905e37', 'request_id': 'req-44cbd83c-6017-4017-a069-360b0913e72d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:45.480252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-44cbd83c-6017-4017-a069-360b0913e72d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5b3367821b84df7bafc93dea7905e37', 'request_id': 'req-44cbd83c-6017-4017-a069-360b0913e72d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:45.612406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-44cbd83c-6017-4017-a069-360b0913e72d admin admin] The token cache is being invalidate because project b5b3367821b84df7bafc93dea7905e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:24:45.612406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-44cbd83c-6017-4017-a069-360b0913e72d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:45.612406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-44cbd83c-6017-4017-a069-360b0913e72d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:45.612406 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2483/5033] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:24:44 2022] DELETE /identity/v3/projects/b5b3367821b84df7bafc93dea7905e37 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:45.614336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c522473-c7a6-4702-bd8b-b7ae51199af2 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:45.614801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c522473-c7a6-4702-bd8b-b7ae51199af2 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:45.614906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c522473-c7a6-4702-bd8b-b7ae51199af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:45.661493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:45.667695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9c522473-c7a6-4702-bd8b-b7ae51199af2 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:45.669310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9c522473-c7a6-4702-bd8b-b7ae51199af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:45.775903 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2551/5034] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:24:45.783681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52da730-9f03-48fa-b10f-a45a37147f4a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:45.784232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52da730-9f03-48fa-b10f-a45a37147f4a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:45.784698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52da730-9f03-48fa-b10f-a45a37147f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:45.828368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d52da730-9f03-48fa-b10f-a45a37147f4a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:45.829747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d52da730-9f03-48fa-b10f-a45a37147f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:45.855694 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2484/5035] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:45.855949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c522473-c7a6-4702-bd8b-b7ae51199af2 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:45.881610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c522473-c7a6-4702-bd8b-b7ae51199af2 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:45.893700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b6f44-a81f-4961-8d9f-51575c3424c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:45.919783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b6f44-a81f-4961-8d9f-51575c3424c5 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:45.921738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b6f44-a81f-4961-8d9f-51575c3424c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:45.922289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b6f44-a81f-4961-8d9f-51575c3424c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:45.931721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b6f44-a81f-4961-8d9f-51575c3424c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:24:45.938615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b6f44-a81f-4961-8d9f-51575c3424c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:45.945021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b6f44-a81f-4961-8d9f-51575c3424c5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:45.976153 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2552/5036] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:24:45.980735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52da730-9f03-48fa-b10f-a45a37147f4a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:45.994321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52da730-9f03-48fa-b10f-a45a37147f4a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:46.008683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c20037-015d-4590-b5d7-e1ac4b3b2546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:46.010240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:46.010559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c20037-015d-4590-b5d7-e1ac4b3b2546 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:46.011109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c20037-015d-4590-b5d7-e1ac4b3b2546 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:46.015321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c20037-015d-4590-b5d7-e1ac4b3b2546 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:46.017424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c20037-015d-4590-b5d7-e1ac4b3b2546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:46.022578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c20037-015d-4590-b5d7-e1ac4b3b2546 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:46.167940 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2485/5037] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:24:45 2022] POST /identity/v3/projects => generated 381 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:46.177297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b6f44-a81f-4961-8d9f-51575c3424c5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:46.210786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b6f44-a81f-4961-8d9f-51575c3424c5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:46.382511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e58d55-c9d6-4aa3-a0a9-ec2dd2641e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:46.383281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e58d55-c9d6-4aa3-a0a9-ec2dd2641e1f admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:46.383759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e58d55-c9d6-4aa3-a0a9-ec2dd2641e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:46.384077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e58d55-c9d6-4aa3-a0a9-ec2dd2641e1f admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:46.385342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e58d55-c9d6-4aa3-a0a9-ec2dd2641e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:46.386751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e58d55-c9d6-4aa3-a0a9-ec2dd2641e1f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:46.486046 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2553/5038] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:24:46 2022] POST /identity/v3/users => generated 291 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:24:46.490959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c20037-015d-4590-b5d7-e1ac4b3b2546 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:46.505464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c20037-015d-4590-b5d7-e1ac4b3b2546 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:46.521998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4541a6-35b6-491e-95bc-aec2a14c6098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:46.525970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4541a6-35b6-491e-95bc-aec2a14c6098 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:46.526334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4541a6-35b6-491e-95bc-aec2a14c6098 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:46.526560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4541a6-35b6-491e-95bc-aec2a14c6098 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:46.527941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4541a6-35b6-491e-95bc-aec2a14c6098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:46.528967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4541a6-35b6-491e-95bc-aec2a14c6098 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:46.574707 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2486/5039] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:46.576062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e58d55-c9d6-4aa3-a0a9-ec2dd2641e1f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:46.597992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e58d55-c9d6-4aa3-a0a9-ec2dd2641e1f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:46.612815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f3abb-de93-474b-b8be-8e2b75d58bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:46.613481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f3abb-de93-474b-b8be-8e2b75d58bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:46.613668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f3abb-de93-474b-b8be-8e2b75d58bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:46.614491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f3abb-de93-474b-b8be-8e2b75d58bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:46.615078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f3abb-de93-474b-b8be-8e2b75d58bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:46.616328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f3abb-de93-474b-b8be-8e2b75d58bd9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:46.640009 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2554/5040] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:24:46.642013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4541a6-35b6-491e-95bc-aec2a14c6098 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:46.655400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4541a6-35b6-491e-95bc-aec2a14c6098 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:46.661211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a59317-b453-4acf-a46d-39bb42976a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:46.662519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a59317-b453-4acf-a46d-39bb42976a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:46.662519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a59317-b453-4acf-a46d-39bb42976a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:46.663954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a59317-b453-4acf-a46d-39bb42976a63 admin admin] PATH_INFO: `/v3/projects/336b3ef8a8744bf3b86854b32000bda6/users/3b0b46c0c1f74adaaaf65d46db7b2618/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:46.717354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a59317-b453-4acf-a46d-39bb42976a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=336b3ef8a8744bf3b86854b32000bda6, user_id=3b0b46c0c1f74adaaaf65d46db7b2618, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:46.724202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a59317-b453-4acf-a46d-39bb42976a63 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:46.833639 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2487/5041] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:24:46 2022] PUT /identity/v3/projects/336b3ef8a8744bf3b86854b32000bda6/users/3b0b46c0c1f74adaaaf65d46db7b2618/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:46.845598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd622d9-15b1-407d-baed-034d962f19a7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:46.846000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd622d9-15b1-407d-baed-034d962f19a7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:46.847269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd622d9-15b1-407d-baed-034d962f19a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:46.907805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8bd622d9-15b1-407d-baed-034d962f19a7 None None] MFA Rules not processed for user `3b0b46c0c1f74adaaaf65d46db7b2618`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:46.909273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8bd622d9-15b1-407d-baed-034d962f19a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:47.031844 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2555/5042] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:47.042277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c3c9a-4ea1-433a-b0df-4edd09f2ea16 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:47.045648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c3c9a-4ea1-433a-b0df-4edd09f2ea16 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:47.045648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c3c9a-4ea1-433a-b0df-4edd09f2ea16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:47.076768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c60c3c9a-4ea1-433a-b0df-4edd09f2ea16 None None] MFA Rules not processed for user `3b0b46c0c1f74adaaaf65d46db7b2618`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:47.078542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c60c3c9a-4ea1-433a-b0df-4edd09f2ea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:47.099681 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2488/5043] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:47.136451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:47.422432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:47.722928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd622d9-15b1-407d-baed-034d962f19a7 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:47.724516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8bd622d9-15b1-407d-baed-034d962f19a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:47.892234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd622d9-15b1-407d-baed-034d962f19a7 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:47.899681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29986a82-1d2c-405b-9a21-d0f79d696949 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:47.900864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29986a82-1d2c-405b-9a21-d0f79d696949 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:47.901360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29986a82-1d2c-405b-9a21-d0f79d696949 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:47.901842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29986a82-1d2c-405b-9a21-d0f79d696949 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:47.911666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29986a82-1d2c-405b-9a21-d0f79d696949 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:47.913637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29986a82-1d2c-405b-9a21-d0f79d696949 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:47.927000 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2556/5044] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:24:48.330199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:48.359239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:49.545342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:50.768070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:51.290905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1810c-85fe-4684-9008-b563cbd3538d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:51.291325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1810c-85fe-4684-9008-b563cbd3538d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:51.291489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1810c-85fe-4684-9008-b563cbd3538d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:51.319215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-dcc1810c-85fe-4684-9008-b563cbd3538d None None] MFA Rules not processed for user `a23fafbab18d41ee82b84bbdf94cf0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:51.320814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-dcc1810c-85fe-4684-9008-b563cbd3538d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:51.408576 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2489/5045] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:51.414513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc33a13-e8a4-4b98-b8f3-86de951d1e16 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:51.415065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc33a13-e8a4-4b98-b8f3-86de951d1e16 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:51.417920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc33a13-e8a4-4b98-b8f3-86de951d1e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:51.440767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ffc33a13-e8a4-4b98-b8f3-86de951d1e16 None None] MFA Rules not processed for user `a23fafbab18d41ee82b84bbdf94cf0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:51.442910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ffc33a13-e8a4-4b98-b8f3-86de951d1e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:51.466086 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2557/5046] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:51.724785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:52.136021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:52.599202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:53.233029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:53.268436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:53.672383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:54.457657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:54.933169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1810c-85fe-4684-9008-b563cbd3538d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:54.935351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-dcc1810c-85fe-4684-9008-b563cbd3538d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:55.042827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1810c-85fe-4684-9008-b563cbd3538d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:55.051872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b95d62-1189-4c57-9790-4abf7d02d792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:55.055822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b95d62-1189-4c57-9790-4abf7d02d792 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:55.057560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b95d62-1189-4c57-9790-4abf7d02d792 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:55.058067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b95d62-1189-4c57-9790-4abf7d02d792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:55.072426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-04b95d62-1189-4c57-9790-4abf7d02d792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:55.085404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:55.100021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b95d62-1189-4c57-9790-4abf7d02d792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:55.104036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b95d62-1189-4c57-9790-4abf7d02d792 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:55.126001 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2490/5047] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:24:55.210104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:56.752930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:57.157932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:57.416773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc33a13-e8a4-4b98-b8f3-86de951d1e16 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:57.418397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ffc33a13-e8a4-4b98-b8f3-86de951d1e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:57.562858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc33a13-e8a4-4b98-b8f3-86de951d1e16 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:57.567595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184e9a7-de7b-43ab-92d9-9a7221d7b3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:57.568553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184e9a7-de7b-43ab-92d9-9a7221d7b3e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:57.569079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184e9a7-de7b-43ab-92d9-9a7221d7b3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:57.569557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184e9a7-de7b-43ab-92d9-9a7221d7b3e7 admin admin] PATH_INFO: `/v3/users/e1fe9c36813b4eaabc25578f20a62b44` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:57.573665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184e9a7-de7b-43ab-92d9-9a7221d7b3e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1fe9c36813b4eaabc25578f20a62b44)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:57.575972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184e9a7-de7b-43ab-92d9-9a7221d7b3e7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:57.945439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b184e9a7-de7b-43ab-92d9-9a7221d7b3e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1fe9c36813b4eaabc25578f20a62b44'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:57.974730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b184e9a7-de7b-43ab-92d9-9a7221d7b3e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1fe9c36813b4eaabc25578f20a62b44'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:58.083475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b184e9a7-de7b-43ab-92d9-9a7221d7b3e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1fe9c36813b4eaabc25578f20a62b44'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:58.084749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b184e9a7-de7b-43ab-92d9-9a7221d7b3e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1fe9c36813b4eaabc25578f20a62b44'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:58.106074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b184e9a7-de7b-43ab-92d9-9a7221d7b3e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1fe9c36813b4eaabc25578f20a62b44'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:58.116091 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2558/5048] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:24:57 2022] DELETE /identity/v3/users/e1fe9c36813b4eaabc25578f20a62b44 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:58.122645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b111051-dbc5-49f8-89d8-faeb3cc87d8b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:58.123222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b111051-dbc5-49f8-89d8-faeb3cc87d8b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:58.124929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b111051-dbc5-49f8-89d8-faeb3cc87d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:58.155486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5b111051-dbc5-49f8-89d8-faeb3cc87d8b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:24:58.156787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5b111051-dbc5-49f8-89d8-faeb3cc87d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:58.234159 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2491/5049] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:24:58.251149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184e9a7-de7b-43ab-92d9-9a7221d7b3e7 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:58.253279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b184e9a7-de7b-43ab-92d9-9a7221d7b3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:58.338112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184e9a7-de7b-43ab-92d9-9a7221d7b3e7 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:58.344493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805f8ce-e9c0-4b6a-a9cb-46a0f6b85e47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:58.345635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805f8ce-e9c0-4b6a-a9cb-46a0f6b85e47 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:58.348974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805f8ce-e9c0-4b6a-a9cb-46a0f6b85e47 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:58.349521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805f8ce-e9c0-4b6a-a9cb-46a0f6b85e47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:58.362515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805f8ce-e9c0-4b6a-a9cb-46a0f6b85e47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:58.364860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805f8ce-e9c0-4b6a-a9cb-46a0f6b85e47 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:58.386940 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2559/5050] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:24:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:24:58.701078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:59.259235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:24:59.488333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b111051-dbc5-49f8-89d8-faeb3cc87d8b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:59.492098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5b111051-dbc5-49f8-89d8-faeb3cc87d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:24:59.566288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b111051-dbc5-49f8-89d8-faeb3cc87d8b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:24:59.577812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fd91d-dfa2-4d00-a2f9-a02d7eea4048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:24:59.578711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fd91d-dfa2-4d00-a2f9-a02d7eea4048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:24:59.579114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fd91d-dfa2-4d00-a2f9-a02d7eea4048 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:24:59.579370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fd91d-dfa2-4d00-a2f9-a02d7eea4048 admin admin] PATH_INFO: `/v3/projects/dcafa6d06a74473f91cbc3322e711f84` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:24:59.584522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fd91d-dfa2-4d00-a2f9-a02d7eea4048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcafa6d06a74473f91cbc3322e711f84)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:24:59.587135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fd91d-dfa2-4d00-a2f9-a02d7eea4048 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:24:59.756227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-319fd91d-dfa2-4d00-a2f9-a02d7eea4048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcafa6d06a74473f91cbc3322e711f84', 'request_id': 'req-319fd91d-dfa2-4d00-a2f9-a02d7eea4048'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:59.786199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-319fd91d-dfa2-4d00-a2f9-a02d7eea4048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcafa6d06a74473f91cbc3322e711f84', 'request_id': 'req-319fd91d-dfa2-4d00-a2f9-a02d7eea4048'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:59.796114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-319fd91d-dfa2-4d00-a2f9-a02d7eea4048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcafa6d06a74473f91cbc3322e711f84', 'request_id': 'req-319fd91d-dfa2-4d00-a2f9-a02d7eea4048'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:59.876930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-319fd91d-dfa2-4d00-a2f9-a02d7eea4048 admin admin] The token cache is being invalidate because project dcafa6d06a74473f91cbc3322e711f84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:24:59.877564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-319fd91d-dfa2-4d00-a2f9-a02d7eea4048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:59.884461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-319fd91d-dfa2-4d00-a2f9-a02d7eea4048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:24:59.891435 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2492/5051] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:24:59 2022] DELETE /identity/v3/projects/dcafa6d06a74473f91cbc3322e711f84 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:24:59.895257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805f8ce-e9c0-4b6a-a9cb-46a0f6b85e47 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:24:59.908935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805f8ce-e9c0-4b6a-a9cb-46a0f6b85e47 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:00.062858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92725c-1472-435a-840d-f4919e49b1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:00.063950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92725c-1472-435a-840d-f4919e49b1c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:00.064242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92725c-1472-435a-840d-f4919e49b1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:00.065145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92725c-1472-435a-840d-f4919e49b1c1 admin admin] PATH_INFO: `/v3/users/7645290d5ecb4b96bda6c927201a0a7b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:00.067234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92725c-1472-435a-840d-f4919e49b1c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7645290d5ecb4b96bda6c927201a0a7b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:00.069420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92725c-1472-435a-840d-f4919e49b1c1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:00.380852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-af92725c-1472-435a-840d-f4919e49b1c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7645290d5ecb4b96bda6c927201a0a7b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:00.409026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-af92725c-1472-435a-840d-f4919e49b1c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7645290d5ecb4b96bda6c927201a0a7b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:00.501617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fd91d-dfa2-4d00-a2f9-a02d7eea4048 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:00.503284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-319fd91d-dfa2-4d00-a2f9-a02d7eea4048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:00.541826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-af92725c-1472-435a-840d-f4919e49b1c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7645290d5ecb4b96bda6c927201a0a7b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:00.542984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-af92725c-1472-435a-840d-f4919e49b1c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7645290d5ecb4b96bda6c927201a0a7b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:00.560327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-af92725c-1472-435a-840d-f4919e49b1c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7645290d5ecb4b96bda6c927201a0a7b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:00.584112 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2560/5052] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:24:59 2022] DELETE /identity/v3/users/7645290d5ecb4b96bda6c927201a0a7b => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:25:00.669238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fd91d-dfa2-4d00-a2f9-a02d7eea4048 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:00.698224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:00.817694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbbd7a-1c27-4c6a-a5c7-c1e9a85133da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:00.817694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbbd7a-1c27-4c6a-a5c7-c1e9a85133da service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:00.828106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbbd7a-1c27-4c6a-a5c7-c1e9a85133da service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:00.829175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbbd7a-1c27-4c6a-a5c7-c1e9a85133da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:00.841773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e6fbbd7a-1c27-4c6a-a5c7-c1e9a85133da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:01.051965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbbd7a-1c27-4c6a-a5c7-c1e9a85133da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:01.053583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbbd7a-1c27-4c6a-a5c7-c1e9a85133da service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:01.077891 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2493/5053] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:25:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:25:01.510882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:02.089520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:02.469501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92725c-1472-435a-840d-f4919e49b1c1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:02.471516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-af92725c-1472-435a-840d-f4919e49b1c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:02.559794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92725c-1472-435a-840d-f4919e49b1c1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:02.564517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b58b4b-85b3-4162-ae69-50d7762c9ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:02.565383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b58b4b-85b3-4162-ae69-50d7762c9ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:02.565666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b58b4b-85b3-4162-ae69-50d7762c9ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:02.565941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b58b4b-85b3-4162-ae69-50d7762c9ab2 admin admin] PATH_INFO: `/v3/projects/605323b2ed364c6ca981190953e5cdb2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:02.567333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b58b4b-85b3-4162-ae69-50d7762c9ab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=605323b2ed364c6ca981190953e5cdb2)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:02.569258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b58b4b-85b3-4162-ae69-50d7762c9ab2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:02.718084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-08b58b4b-85b3-4162-ae69-50d7762c9ab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '605323b2ed364c6ca981190953e5cdb2', 'request_id': 'req-08b58b4b-85b3-4162-ae69-50d7762c9ab2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:02.725185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-08b58b4b-85b3-4162-ae69-50d7762c9ab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '605323b2ed364c6ca981190953e5cdb2', 'request_id': 'req-08b58b4b-85b3-4162-ae69-50d7762c9ab2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:02.733100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-08b58b4b-85b3-4162-ae69-50d7762c9ab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '605323b2ed364c6ca981190953e5cdb2', 'request_id': 'req-08b58b4b-85b3-4162-ae69-50d7762c9ab2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:02.819800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-08b58b4b-85b3-4162-ae69-50d7762c9ab2 admin admin] The token cache is being invalidate because project 605323b2ed364c6ca981190953e5cdb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:25:02.820094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-08b58b4b-85b3-4162-ae69-50d7762c9ab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:02.820840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-08b58b4b-85b3-4162-ae69-50d7762c9ab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:02.823238 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2561/5054] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:25:02 2022] DELETE /identity/v3/projects/605323b2ed364c6ca981190953e5cdb2 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:02.828590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93cda2-60ea-4ed8-b2f8-ee421272b21f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:02.828886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93cda2-60ea-4ed8-b2f8-ee421272b21f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:02.829165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93cda2-60ea-4ed8-b2f8-ee421272b21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:02.848879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-fa93cda2-60ea-4ed8-b2f8-ee421272b21f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:02.850089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fa93cda2-60ea-4ed8-b2f8-ee421272b21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:02.929871 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2494/5055] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:02.938597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b74215-53b1-42e5-b3bf-c3cc0435bd92 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:02.938892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b74215-53b1-42e5-b3bf-c3cc0435bd92 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:02.939207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b74215-53b1-42e5-b3bf-c3cc0435bd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:02.959916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-44b74215-53b1-42e5-b3bf-c3cc0435bd92 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:02.960933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-44b74215-53b1-42e5-b3bf-c3cc0435bd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:02.971882 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2562/5056] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:02.980251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93cda2-60ea-4ed8-b2f8-ee421272b21f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:02.992762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93cda2-60ea-4ed8-b2f8-ee421272b21f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:02.998821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971d60a-5e55-484b-a6d7-bb50cc24e5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:02.999755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971d60a-5e55-484b-a6d7-bb50cc24e5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:03.000117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971d60a-5e55-484b-a6d7-bb50cc24e5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:03.000848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971d60a-5e55-484b-a6d7-bb50cc24e5b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:03.002015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971d60a-5e55-484b-a6d7-bb50cc24e5b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:25:03.002714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971d60a-5e55-484b-a6d7-bb50cc24e5b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:03.004507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971d60a-5e55-484b-a6d7-bb50cc24e5b2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:03.018267 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2495/5057] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:25:03.022831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b74215-53b1-42e5-b3bf-c3cc0435bd92 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:03.033093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b74215-53b1-42e5-b3bf-c3cc0435bd92 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:03.038240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573867bb-183d-43cf-a6a0-6b0cdbc1da8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:03.038911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573867bb-183d-43cf-a6a0-6b0cdbc1da8c admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:03.039240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573867bb-183d-43cf-a6a0-6b0cdbc1da8c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:03.039565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573867bb-183d-43cf-a6a0-6b0cdbc1da8c admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:03.040447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573867bb-183d-43cf-a6a0-6b0cdbc1da8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:03.042372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573867bb-183d-43cf-a6a0-6b0cdbc1da8c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:03.159253 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2563/5058] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:25:03 2022] POST /identity/v3/projects => generated 407 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:25:03.163585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971d60a-5e55-484b-a6d7-bb50cc24e5b2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:03.184050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971d60a-5e55-484b-a6d7-bb50cc24e5b2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:03.263485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f853f65-1a71-40af-9712-2e0f93dd545f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:03.264317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f853f65-1a71-40af-9712-2e0f93dd545f admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:03.264578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f853f65-1a71-40af-9712-2e0f93dd545f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:03.264851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f853f65-1a71-40af-9712-2e0f93dd545f admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:03.265574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f853f65-1a71-40af-9712-2e0f93dd545f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:03.267811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f853f65-1a71-40af-9712-2e0f93dd545f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:03.388739 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2496/5059] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:25:03 2022] POST /identity/v3/users => generated 304 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:25:03.393047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573867bb-183d-43cf-a6a0-6b0cdbc1da8c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:03.404987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573867bb-183d-43cf-a6a0-6b0cdbc1da8c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:03.410676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34756e4-f994-41e1-92ea-c649245c70ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:03.411384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34756e4-f994-41e1-92ea-c649245c70ef admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:03.411665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34756e4-f994-41e1-92ea-c649245c70ef admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:03.411980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34756e4-f994-41e1-92ea-c649245c70ef admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:03.413303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34756e4-f994-41e1-92ea-c649245c70ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:03.415030 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34756e4-f994-41e1-92ea-c649245c70ef admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:03.432951 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2564/5060] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:25:03.433955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f853f65-1a71-40af-9712-2e0f93dd545f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:03.454487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f853f65-1a71-40af-9712-2e0f93dd545f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:03.460457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34325a5e-9878-47eb-827f-b7dad17632ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:03.461526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34325a5e-9878-47eb-827f-b7dad17632ad admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:03.462193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34325a5e-9878-47eb-827f-b7dad17632ad admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:03.462680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34325a5e-9878-47eb-827f-b7dad17632ad admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:03.463655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34325a5e-9878-47eb-827f-b7dad17632ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:03.466390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34325a5e-9878-47eb-827f-b7dad17632ad admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:03.480644 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2497/5061] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:25:03.484965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34756e4-f994-41e1-92ea-c649245c70ef admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:03.497792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34756e4-f994-41e1-92ea-c649245c70ef admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:03.509366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d064e09-9801-437d-b57e-8f6c76640c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:03.510414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d064e09-9801-437d-b57e-8f6c76640c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:03.510699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d064e09-9801-437d-b57e-8f6c76640c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:03.511229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d064e09-9801-437d-b57e-8f6c76640c90 admin admin] PATH_INFO: `/v3/projects/db405b7acaa14a18b71529d9d0710c1e/users/0aef6cf4bba04285808fb348ecfefd27/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:03.529282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d064e09-9801-437d-b57e-8f6c76640c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db405b7acaa14a18b71529d9d0710c1e, user_id=0aef6cf4bba04285808fb348ecfefd27, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:03.532216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d064e09-9801-437d-b57e-8f6c76640c90 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:03.618111 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2565/5062] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:25:03 2022] PUT /identity/v3/projects/db405b7acaa14a18b71529d9d0710c1e/users/0aef6cf4bba04285808fb348ecfefd27/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:03.628316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a2432-d098-4f79-80d8-aa36b95387d6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:03.631593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a2432-d098-4f79-80d8-aa36b95387d6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:03.631593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a2432-d098-4f79-80d8-aa36b95387d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:03.656834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-aa8a2432-d098-4f79-80d8-aa36b95387d6 None None] MFA Rules not processed for user `0aef6cf4bba04285808fb348ecfefd27`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:03.658059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-aa8a2432-d098-4f79-80d8-aa36b95387d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:03.728962 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2498/5063] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:25:03.734945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d064e09-9801-437d-b57e-8f6c76640c90 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:03.809404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d064e09-9801-437d-b57e-8f6c76640c90 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:03.814701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b82c4-6b61-4c03-9374-fd630f50ca0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:03.815406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b82c4-6b61-4c03-9374-fd630f50ca0c admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:03.815692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b82c4-6b61-4c03-9374-fd630f50ca0c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:03.815969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b82c4-6b61-4c03-9374-fd630f50ca0c admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:03.816683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b82c4-6b61-4c03-9374-fd630f50ca0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:03.818617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b82c4-6b61-4c03-9374-fd630f50ca0c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:04.064519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a2432-d098-4f79-80d8-aa36b95387d6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:04.065913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-aa8a2432-d098-4f79-80d8-aa36b95387d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:04.083595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a2432-d098-4f79-80d8-aa36b95387d6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:04.088508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae121a6-d7a3-4a2f-aee1-45c3e133c3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:04.094901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae121a6-d7a3-4a2f-aee1-45c3e133c3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:04.094901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae121a6-d7a3-4a2f-aee1-45c3e133c3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:04.094901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae121a6-d7a3-4a2f-aee1-45c3e133c3b0 admin admin] PATH_INFO: `/v3/users/9f2a6e0cc1014d5e8c274be360c8d472` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:04.094901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae121a6-d7a3-4a2f-aee1-45c3e133c3b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f2a6e0cc1014d5e8c274be360c8d472)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:04.094901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae121a6-d7a3-4a2f-aee1-45c3e133c3b0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:04.123092 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2566/5064] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:25:03 2022] POST /identity/v3/projects => generated 407 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:25:04.124162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b82c4-6b61-4c03-9374-fd630f50ca0c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:04.185558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b82c4-6b61-4c03-9374-fd630f50ca0c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:04.190361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c12927-8e26-4d76-823a-6aeb83f896dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:04.191146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c12927-8e26-4d76-823a-6aeb83f896dd admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:04.191499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c12927-8e26-4d76-823a-6aeb83f896dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:04.191845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c12927-8e26-4d76-823a-6aeb83f896dd admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:04.192724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c12927-8e26-4d76-823a-6aeb83f896dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:04.194734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c12927-8e26-4d76-823a-6aeb83f896dd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:04.272347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bae121a6-d7a3-4a2f-aee1-45c3e133c3b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f2a6e0cc1014d5e8c274be360c8d472'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:04.294931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bae121a6-d7a3-4a2f-aee1-45c3e133c3b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f2a6e0cc1014d5e8c274be360c8d472'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:04.318540 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2567/5065] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:25:04 2022] POST /identity/v3/users => generated 310 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:25:04.323289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c12927-8e26-4d76-823a-6aeb83f896dd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:04.335286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c12927-8e26-4d76-823a-6aeb83f896dd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:04.341044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f8e5a-17d2-455e-8f96-1f2779931031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:04.342499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f8e5a-17d2-455e-8f96-1f2779931031 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:04.343242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f8e5a-17d2-455e-8f96-1f2779931031 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:04.343242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f8e5a-17d2-455e-8f96-1f2779931031 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:04.344161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f8e5a-17d2-455e-8f96-1f2779931031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:04.345832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f8e5a-17d2-455e-8f96-1f2779931031 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:04.361221 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2568/5066] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:25:04.362216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f8e5a-17d2-455e-8f96-1f2779931031 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:04.374666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f8e5a-17d2-455e-8f96-1f2779931031 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:04.380281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47e8c7-ad69-4fe9-b4b5-eaa7559081ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:04.380493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47e8c7-ad69-4fe9-b4b5-eaa7559081ec admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:04.380752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47e8c7-ad69-4fe9-b4b5-eaa7559081ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:04.381029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47e8c7-ad69-4fe9-b4b5-eaa7559081ec admin admin] PATH_INFO: `/v3/projects/82bd8d82a7664e2a82dd011fa82732a7/users/6f79428048d2483e9d2479ae1efd8c03/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:04.396518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47e8c7-ad69-4fe9-b4b5-eaa7559081ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=82bd8d82a7664e2a82dd011fa82732a7, user_id=6f79428048d2483e9d2479ae1efd8c03, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:04.415534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47e8c7-ad69-4fe9-b4b5-eaa7559081ec admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:04.541432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bae121a6-d7a3-4a2f-aee1-45c3e133c3b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f2a6e0cc1014d5e8c274be360c8d472'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:04.550801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bae121a6-d7a3-4a2f-aee1-45c3e133c3b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f2a6e0cc1014d5e8c274be360c8d472'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:04.551561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bae121a6-d7a3-4a2f-aee1-45c3e133c3b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f2a6e0cc1014d5e8c274be360c8d472'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:04.558260 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2499/5067] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:25:04 2022] DELETE /identity/v3/users/9f2a6e0cc1014d5e8c274be360c8d472 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:25:04.562506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6f96c-a113-44d6-827c-a5d4f28eacd5 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:04.573649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6f96c-a113-44d6-827c-a5d4f28eacd5 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:04.573649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6f96c-a113-44d6-827c-a5d4f28eacd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:04.580729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-70a6f96c-a113-44d6-827c-a5d4f28eacd5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:04.581994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-70a6f96c-a113-44d6-827c-a5d4f28eacd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:04.606089 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2569/5068] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:25:04 2022] PUT /identity/v3/projects/82bd8d82a7664e2a82dd011fa82732a7/users/6f79428048d2483e9d2479ae1efd8c03/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:04.610000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47e8c7-ad69-4fe9-b4b5-eaa7559081ec admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:04.612087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8d47e8c7-ad69-4fe9-b4b5-eaa7559081ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:04.665603 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2500/5069] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:25:04.685925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6f96c-a113-44d6-827c-a5d4f28eacd5 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:04.687240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-70a6f96c-a113-44d6-827c-a5d4f28eacd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:04.694395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47e8c7-ad69-4fe9-b4b5-eaa7559081ec admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:04.704370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bebbd8-4567-412d-991c-86793ff12a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:04.705086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bebbd8-4567-412d-991c-86793ff12a50 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:04.705370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bebbd8-4567-412d-991c-86793ff12a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:04.705646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bebbd8-4567-412d-991c-86793ff12a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:04.706576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bebbd8-4567-412d-991c-86793ff12a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:04.708222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bebbd8-4567-412d-991c-86793ff12a50 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:04.740438 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2570/5070] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:25:04.745455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bebbd8-4567-412d-991c-86793ff12a50 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:04.756085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bebbd8-4567-412d-991c-86793ff12a50 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:04.761337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6f96c-a113-44d6-827c-a5d4f28eacd5 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:04.761899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472db67-78ca-4fd5-bb3f-a1b032bc0ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:04.762985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472db67-78ca-4fd5-bb3f-a1b032bc0ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:04.763482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472db67-78ca-4fd5-bb3f-a1b032bc0ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:04.763950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472db67-78ca-4fd5-bb3f-a1b032bc0ea0 admin admin] PATH_INFO: `/v3/projects/82bd8d82a7664e2a82dd011fa82732a7/users/6f79428048d2483e9d2479ae1efd8c03/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:04.766230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472db67-78ca-4fd5-bb3f-a1b032bc0ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82bd8d82a7664e2a82dd011fa82732a7, user_id=6f79428048d2483e9d2479ae1efd8c03, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:04.769612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472db67-78ca-4fd5-bb3f-a1b032bc0ea0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:04.791644 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2571/5071] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:25:04 2022] PUT /identity/v3/projects/82bd8d82a7664e2a82dd011fa82732a7/users/6f79428048d2483e9d2479ae1efd8c03/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:04.793259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4513d0e-81a0-4cc5-b606-fdfce46d8c56 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:04.793490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4513d0e-81a0-4cc5-b606-fdfce46d8c56 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:04.793771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4513d0e-81a0-4cc5-b606-fdfce46d8c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:04.813920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335c615-bd35-4345-88e1-67b2443af5a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:04.818823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335c615-bd35-4345-88e1-67b2443af5a6 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:04.818823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335c615-bd35-4345-88e1-67b2443af5a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:04.818823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335c615-bd35-4345-88e1-67b2443af5a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:04.824548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d4513d0e-81a0-4cc5-b606-fdfce46d8c56 None None] MFA Rules not processed for user `6f79428048d2483e9d2479ae1efd8c03`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:04.825778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d4513d0e-81a0-4cc5-b606-fdfce46d8c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:04.826565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335c615-bd35-4345-88e1-67b2443af5a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:04.828110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335c615-bd35-4345-88e1-67b2443af5a6 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:04.838526 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2501/5072] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:25:04.845286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:04.937931 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2572/5073] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:04 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:04.948844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335c615-bd35-4345-88e1-67b2443af5a6 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:04.950160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7335c615-bd35-4345-88e1-67b2443af5a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:05.028075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335c615-bd35-4345-88e1-67b2443af5a6 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:05.093687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2faa4df-d080-4ef9-9abd-60bde9c7e114 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:05.094480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2faa4df-d080-4ef9-9abd-60bde9c7e114 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:05.094832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2faa4df-d080-4ef9-9abd-60bde9c7e114 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:05.095239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2faa4df-d080-4ef9-9abd-60bde9c7e114 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:05.106206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2faa4df-d080-4ef9-9abd-60bde9c7e114 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:05.107846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2faa4df-d080-4ef9-9abd-60bde9c7e114 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:05.119335 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2502/5074] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:25:04 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:25:05.193774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:05.276797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4513d0e-81a0-4cc5-b606-fdfce46d8c56 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:05.279444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d4513d0e-81a0-4cc5-b606-fdfce46d8c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:05.361061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4513d0e-81a0-4cc5-b606-fdfce46d8c56 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:05.365835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5130f2-aba7-4c67-a78e-9249be0fe7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:05.366708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5130f2-aba7-4c67-a78e-9249be0fe7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:05.366986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5130f2-aba7-4c67-a78e-9249be0fe7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:05.367288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5130f2-aba7-4c67-a78e-9249be0fe7f7 admin admin] PATH_INFO: `/v3/projects/00ac4228f14749fb8f3fe8da4fdb4a85` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:05.369343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5130f2-aba7-4c67-a78e-9249be0fe7f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00ac4228f14749fb8f3fe8da4fdb4a85)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:05.371322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5130f2-aba7-4c67-a78e-9249be0fe7f7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:05.565424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ec5130f2-aba7-4c67-a78e-9249be0fe7f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00ac4228f14749fb8f3fe8da4fdb4a85', 'request_id': 'req-ec5130f2-aba7-4c67-a78e-9249be0fe7f7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:05.585765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ec5130f2-aba7-4c67-a78e-9249be0fe7f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00ac4228f14749fb8f3fe8da4fdb4a85', 'request_id': 'req-ec5130f2-aba7-4c67-a78e-9249be0fe7f7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:05.593201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ec5130f2-aba7-4c67-a78e-9249be0fe7f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00ac4228f14749fb8f3fe8da4fdb4a85', 'request_id': 'req-ec5130f2-aba7-4c67-a78e-9249be0fe7f7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:05.598317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2faa4df-d080-4ef9-9abd-60bde9c7e114 service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:05.599910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c2faa4df-d080-4ef9-9abd-60bde9c7e114 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:05.622379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2faa4df-d080-4ef9-9abd-60bde9c7e114 service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:05.693753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0daf1a-4d79-48f3-9a32-aaf95028827a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:05.694576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0daf1a-4d79-48f3-9a32-aaf95028827a service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:05.694956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0daf1a-4d79-48f3-9a32-aaf95028827a service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:05.700976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0daf1a-4d79-48f3-9a32-aaf95028827a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:05.700976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bc0daf1a-4d79-48f3-9a32-aaf95028827a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:05.701236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ec5130f2-aba7-4c67-a78e-9249be0fe7f7 admin admin] The token cache is being invalidate because project 00ac4228f14749fb8f3fe8da4fdb4a85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:25:05.701236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ec5130f2-aba7-4c67-a78e-9249be0fe7f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:05.703244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ec5130f2-aba7-4c67-a78e-9249be0fe7f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:05.708536 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2573/5075] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:25:05 2022] DELETE /identity/v3/projects/00ac4228f14749fb8f3fe8da4fdb4a85 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:05.716128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdd12c-7692-493b-9e21-e52712f07827 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:05.716945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdd12c-7692-493b-9e21-e52712f07827 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:05.717465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdd12c-7692-493b-9e21-e52712f07827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:05.775040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d7bdd12c-7692-493b-9e21-e52712f07827 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:05.776890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d7bdd12c-7692-493b-9e21-e52712f07827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:05.802608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0daf1a-4d79-48f3-9a32-aaf95028827a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:05.805921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0daf1a-4d79-48f3-9a32-aaf95028827a service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:05.822338 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2503/5076] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:25:05 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:25:05.923696 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2574/5077] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:05.932197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63679fb-9858-48bb-bdd8-5c8f047d2216 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:05.932425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63679fb-9858-48bb-bdd8-5c8f047d2216 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:05.932706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63679fb-9858-48bb-bdd8-5c8f047d2216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:05.960106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d63679fb-9858-48bb-bdd8-5c8f047d2216 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:05.962037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d63679fb-9858-48bb-bdd8-5c8f047d2216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:05.994191 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2504/5078] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:05.994877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdd12c-7692-493b-9e21-e52712f07827 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:06.008337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdd12c-7692-493b-9e21-e52712f07827 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:06.014397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dac087-ce93-4bde-a1d1-e2da61e6cda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:06.015338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dac087-ce93-4bde-a1d1-e2da61e6cda9 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:06.015631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dac087-ce93-4bde-a1d1-e2da61e6cda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:06.016036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dac087-ce93-4bde-a1d1-e2da61e6cda9 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:06.016782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dac087-ce93-4bde-a1d1-e2da61e6cda9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:25:06.017104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dac087-ce93-4bde-a1d1-e2da61e6cda9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:06.018887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dac087-ce93-4bde-a1d1-e2da61e6cda9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:06.033000 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2575/5079] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:25:06.037759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63679fb-9858-48bb-bdd8-5c8f047d2216 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:06.048315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63679fb-9858-48bb-bdd8-5c8f047d2216 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:06.053274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e12f6-e204-4ed3-9836-c8984e4e81f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:06.053993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e12f6-e204-4ed3-9836-c8984e4e81f6 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:06.054313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e12f6-e204-4ed3-9836-c8984e4e81f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:06.054592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e12f6-e204-4ed3-9836-c8984e4e81f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:06.055984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e12f6-e204-4ed3-9836-c8984e4e81f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:06.058454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e12f6-e204-4ed3-9836-c8984e4e81f6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:06.150330 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2505/5080] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:25:06 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:25:06.154985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dac087-ce93-4bde-a1d1-e2da61e6cda9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:06.173262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dac087-ce93-4bde-a1d1-e2da61e6cda9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:06.322008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364ea5f-10d4-4f57-905b-6eb5e70400db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:06.322739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364ea5f-10d4-4f57-905b-6eb5e70400db admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:06.323045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364ea5f-10d4-4f57-905b-6eb5e70400db admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:06.323388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364ea5f-10d4-4f57-905b-6eb5e70400db admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:06.324056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364ea5f-10d4-4f57-905b-6eb5e70400db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:06.326015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364ea5f-10d4-4f57-905b-6eb5e70400db admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:06.525124 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2576/5081] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:25:06 2022] POST /identity/v3/users => generated 290 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:25:06.529425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e12f6-e204-4ed3-9836-c8984e4e81f6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:06.544099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e12f6-e204-4ed3-9836-c8984e4e81f6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:06.559469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8aeda-8d86-45be-b617-33ef9fd445b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:06.560405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8aeda-8d86-45be-b617-33ef9fd445b0 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:06.560859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8aeda-8d86-45be-b617-33ef9fd445b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:06.561321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8aeda-8d86-45be-b617-33ef9fd445b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:06.563027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8aeda-8d86-45be-b617-33ef9fd445b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:06.565944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8aeda-8d86-45be-b617-33ef9fd445b0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:06.592501 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2506/5082] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:25:06.599346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364ea5f-10d4-4f57-905b-6eb5e70400db admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:06.612309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364ea5f-10d4-4f57-905b-6eb5e70400db admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:06.632476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781783af-d983-456e-9e76-91ffc5d6617d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:06.635546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781783af-d983-456e-9e76-91ffc5d6617d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:06.636112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781783af-d983-456e-9e76-91ffc5d6617d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:06.636950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781783af-d983-456e-9e76-91ffc5d6617d admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:06.639051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781783af-d983-456e-9e76-91ffc5d6617d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:06.648079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781783af-d983-456e-9e76-91ffc5d6617d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:06.696639 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2577/5083] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:25:06.701456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8aeda-8d86-45be-b617-33ef9fd445b0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:06.723699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8aeda-8d86-45be-b617-33ef9fd445b0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:06.731875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fa670-e60b-4dcf-b6cb-1fb5e49a2b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:06.733841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fa670-e60b-4dcf-b6cb-1fb5e49a2b8e admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:06.734597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fa670-e60b-4dcf-b6cb-1fb5e49a2b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:06.735615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fa670-e60b-4dcf-b6cb-1fb5e49a2b8e admin admin] PATH_INFO: `/v3/projects/9761cbc2eb3942e18fc79afbf73cd46f/users/602cb3d0d5bd419697f51c81343604de/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:06.755698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fa670-e60b-4dcf-b6cb-1fb5e49a2b8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9761cbc2eb3942e18fc79afbf73cd46f, user_id=602cb3d0d5bd419697f51c81343604de, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:06.760115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fa670-e60b-4dcf-b6cb-1fb5e49a2b8e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:06.850988 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2507/5084] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:25:06 2022] PUT /identity/v3/projects/9761cbc2eb3942e18fc79afbf73cd46f/users/602cb3d0d5bd419697f51c81343604de/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:06.862180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca606d0-1954-43d3-8e9e-97ab4faa3803 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:06.863148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca606d0-1954-43d3-8e9e-97ab4faa3803 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:06.863616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca606d0-1954-43d3-8e9e-97ab4faa3803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:06.929074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-fca606d0-1954-43d3-8e9e-97ab4faa3803 None None] MFA Rules not processed for user `602cb3d0d5bd419697f51c81343604de`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:06.930684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fca606d0-1954-43d3-8e9e-97ab4faa3803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:06.935259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:07.063824 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2578/5085] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:07.069239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fa670-e60b-4dcf-b6cb-1fb5e49a2b8e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:07.122079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:07.180781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fa670-e60b-4dcf-b6cb-1fb5e49a2b8e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:07.187035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed801c5-f74f-49a4-b84d-4dcab4dbe05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:07.191259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed801c5-f74f-49a4-b84d-4dcab4dbe05f admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:07.191619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed801c5-f74f-49a4-b84d-4dcab4dbe05f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:07.191874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed801c5-f74f-49a4-b84d-4dcab4dbe05f admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:07.192730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed801c5-f74f-49a4-b84d-4dcab4dbe05f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:07.194751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed801c5-f74f-49a4-b84d-4dcab4dbe05f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:07.331269 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2508/5086] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:25:07 2022] POST /identity/v3/projects => generated 381 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:25:07.331908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca606d0-1954-43d3-8e9e-97ab4faa3803 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:07.361732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca606d0-1954-43d3-8e9e-97ab4faa3803 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:07.494462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f63e9-ab59-483e-bae2-cdae471d38ba None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:07.494462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f63e9-ab59-483e-bae2-cdae471d38ba None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:07.495664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f63e9-ab59-483e-bae2-cdae471d38ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:07.504704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f87b69-aed4-4ff8-87fd-44875563bb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:07.505846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f87b69-aed4-4ff8-87fd-44875563bb53 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:07.505846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f87b69-aed4-4ff8-87fd-44875563bb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:07.506058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f87b69-aed4-4ff8-87fd-44875563bb53 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:07.506901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f87b69-aed4-4ff8-87fd-44875563bb53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:07.510661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f87b69-aed4-4ff8-87fd-44875563bb53 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:07.524605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-471f63e9-ab59-483e-bae2-cdae471d38ba None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:07.526356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-471f63e9-ab59-483e-bae2-cdae471d38ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:07.609240 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2509/5087] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:25:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:25:07.626545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f63e9-ab59-483e-bae2-cdae471d38ba None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:07.628325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-471f63e9-ab59-483e-bae2-cdae471d38ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:07.659532 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2579/5088] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:25:07 2022] POST /identity/v3/users => generated 297 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:25:07.661451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f87b69-aed4-4ff8-87fd-44875563bb53 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:07.701760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f87b69-aed4-4ff8-87fd-44875563bb53 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:07.715871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef0b8b-ac3d-414a-9492-1a2969954e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:07.716991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef0b8b-ac3d-414a-9492-1a2969954e85 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:07.717446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef0b8b-ac3d-414a-9492-1a2969954e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:07.717899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef0b8b-ac3d-414a-9492-1a2969954e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:07.718817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef0b8b-ac3d-414a-9492-1a2969954e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:07.723790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef0b8b-ac3d-414a-9492-1a2969954e85 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:07.766137 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2580/5089] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:25:07.770613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef0b8b-ac3d-414a-9492-1a2969954e85 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:07.794780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef0b8b-ac3d-414a-9492-1a2969954e85 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:07.811273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a1673-2cc7-4c63-8651-ecb14c19334c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:07.812027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f63e9-ab59-483e-bae2-cdae471d38ba None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:07.812564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a1673-2cc7-4c63-8651-ecb14c19334c admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:07.812564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a1673-2cc7-4c63-8651-ecb14c19334c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:07.812924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a1673-2cc7-4c63-8651-ecb14c19334c admin admin] PATH_INFO: `/v3/projects/1c03b4743be543e0b1fa9d8d066e04a4/users/f244b685fd8f4e519006789fc2a2f76e/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:07.840602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e40ff-77f6-4305-b843-493294b69669 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:07.844524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e40ff-77f6-4305-b843-493294b69669 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:07.845511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e40ff-77f6-4305-b843-493294b69669 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:07.846349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a1673-2cc7-4c63-8651-ecb14c19334c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c03b4743be543e0b1fa9d8d066e04a4, user_id=f244b685fd8f4e519006789fc2a2f76e, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:07.846518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e40ff-77f6-4305-b843-493294b69669 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:07.849661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a1673-2cc7-4c63-8651-ecb14c19334c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:07.873618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e40ff-77f6-4305-b843-493294b69669 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:07.877993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e40ff-77f6-4305-b843-493294b69669 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:07.915055 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2510/5090] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:25:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:25:07.994639 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2581/5091] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:25:07 2022] PUT /identity/v3/projects/1c03b4743be543e0b1fa9d8d066e04a4/users/f244b685fd8f4e519006789fc2a2f76e/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:07.998810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e40ff-77f6-4305-b843-493294b69669 service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:08.025034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e40ff-77f6-4305-b843-493294b69669 service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:08.141100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb35787-a318-4d68-a7ca-796b994abb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:08.141100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb35787-a318-4d68-a7ca-796b994abb78 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:08.141100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb35787-a318-4d68-a7ca-796b994abb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:08.141100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb35787-a318-4d68-a7ca-796b994abb78 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:08.141550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb35787-a318-4d68-a7ca-796b994abb78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:08.141550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb35787-a318-4d68-a7ca-796b994abb78 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:08.152439 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2511/5092] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:25:08.156726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a1673-2cc7-4c63-8651-ecb14c19334c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:08.168576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a1673-2cc7-4c63-8651-ecb14c19334c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:08.181069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d403d-9d56-47ea-9943-ba49f7791446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:08.181069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d403d-9d56-47ea-9943-ba49f7791446 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:08.181069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d403d-9d56-47ea-9943-ba49f7791446 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:08.181069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d403d-9d56-47ea-9943-ba49f7791446 admin admin] PATH_INFO: `/v3/projects/1c03b4743be543e0b1fa9d8d066e04a4/users/f244b685fd8f4e519006789fc2a2f76e/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:08.181565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d403d-9d56-47ea-9943-ba49f7791446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c03b4743be543e0b1fa9d8d066e04a4, user_id=f244b685fd8f4e519006789fc2a2f76e, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:08.186233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d403d-9d56-47ea-9943-ba49f7791446 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:08.231803 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2582/5093] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:25:08 2022] PUT /identity/v3/projects/1c03b4743be543e0b1fa9d8d066e04a4/users/f244b685fd8f4e519006789fc2a2f76e/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:08.244804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938f718-0565-46e1-96e5-f4b52d2819a6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:08.246004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938f718-0565-46e1-96e5-f4b52d2819a6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:08.246377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938f718-0565-46e1-96e5-f4b52d2819a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:08.297106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5938f718-0565-46e1-96e5-f4b52d2819a6 None None] MFA Rules not processed for user `f244b685fd8f4e519006789fc2a2f76e`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:08.299170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5938f718-0565-46e1-96e5-f4b52d2819a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:08.417484 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2512/5094] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:08.430766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d403d-9d56-47ea-9943-ba49f7791446 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:08.432921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-725d403d-9d56-47ea-9943-ba49f7791446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:08.570936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d403d-9d56-47ea-9943-ba49f7791446 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:08.575267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4b471-17cd-46a8-9d7d-10df63a10f27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:08.576115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4b471-17cd-46a8-9d7d-10df63a10f27 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:08.576428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4b471-17cd-46a8-9d7d-10df63a10f27 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:08.576772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4b471-17cd-46a8-9d7d-10df63a10f27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:08.592285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4b471-17cd-46a8-9d7d-10df63a10f27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:08.593743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4b471-17cd-46a8-9d7d-10df63a10f27 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:08.606173 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2583/5095] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:25:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:25:08.921873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938f718-0565-46e1-96e5-f4b52d2819a6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:08.939177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938f718-0565-46e1-96e5-f4b52d2819a6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:08.949996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debef248-4466-42a5-b31c-bbf00d3ccb96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:08.958150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debef248-4466-42a5-b31c-bbf00d3ccb96 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:08.958150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debef248-4466-42a5-b31c-bbf00d3ccb96 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:08.958150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debef248-4466-42a5-b31c-bbf00d3ccb96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:09.082467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debef248-4466-42a5-b31c-bbf00d3ccb96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:09.092854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debef248-4466-42a5-b31c-bbf00d3ccb96 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:09.124798 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2513/5096] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:25:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:25:09.163197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:09.780383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:11.550909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927439be-c565-4f32-9159-c195e7939e8a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:11.553517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927439be-c565-4f32-9159-c195e7939e8a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:11.554029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927439be-c565-4f32-9159-c195e7939e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:11.596111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-927439be-c565-4f32-9159-c195e7939e8a None None] MFA Rules not processed for user `6f2e974ab5aa48dfb4b00f810dcedb63`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:11.597770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-927439be-c565-4f32-9159-c195e7939e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:11.656989 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2584/5097] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:11.699598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfdbec-7f2b-4653-aca4-4a75cd65f124 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:11.700118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfdbec-7f2b-4653-aca4-4a75cd65f124 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:11.700214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfdbec-7f2b-4653-aca4-4a75cd65f124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:11.720574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7fbfdbec-7f2b-4653-aca4-4a75cd65f124 None None] MFA Rules not processed for user `027dcc48e4fd4c36a5004096ad5e43f8`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:11.722469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7fbfdbec-7f2b-4653-aca4-4a75cd65f124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:11.793653 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2514/5098] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:12.153112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:12.871737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:14.930718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:15.256595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe28ad-8c2e-4d0e-b3e5-0959591066f0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:15.256887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe28ad-8c2e-4d0e-b3e5-0959591066f0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:15.257167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe28ad-8c2e-4d0e-b3e5-0959591066f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:15.276062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-61fe28ad-8c2e-4d0e-b3e5-0959591066f0 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:15.277383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-61fe28ad-8c2e-4d0e-b3e5-0959591066f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:15.356367 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2585/5099] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:25:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:25:15.369944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfdbec-7f2b-4653-aca4-4a75cd65f124 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:15.457126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:15.516958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfdbec-7f2b-4653-aca4-4a75cd65f124 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:15.522680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d8d53-99a7-4021-b237-b78462aeac74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:15.523914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d8d53-99a7-4021-b237-b78462aeac74 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:15.524206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d8d53-99a7-4021-b237-b78462aeac74 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:15.524489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d8d53-99a7-4021-b237-b78462aeac74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:15.541073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d8d53-99a7-4021-b237-b78462aeac74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:15.544504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d8d53-99a7-4021-b237-b78462aeac74 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:15.559367 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2515/5100] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:25:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:25:17.163615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:17.205894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe28ad-8c2e-4d0e-b3e5-0959591066f0 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:17.207401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-61fe28ad-8c2e-4d0e-b3e5-0959591066f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:17.331028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe28ad-8c2e-4d0e-b3e5-0959591066f0 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:17.333062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:17.340115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95fe2a-c6df-42e6-ad99-d95c1a2a4eb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:17.341524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95fe2a-c6df-42e6-ad99-d95c1a2a4eb5 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:17.342034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95fe2a-c6df-42e6-ad99-d95c1a2a4eb5 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:17.343685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95fe2a-c6df-42e6-ad99-d95c1a2a4eb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:17.347313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cd95fe2a-c6df-42e6-ad99-d95c1a2a4eb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:17.364889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95fe2a-c6df-42e6-ad99-d95c1a2a4eb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:17.367922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95fe2a-c6df-42e6-ad99-d95c1a2a4eb5 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:17.401296 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2586/5101] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:25:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:25:18.426917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:18.699856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:19.530060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:20.687464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:21.494836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:21.932816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:22.283113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:23.125612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:23.219609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:23.803591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:23.895714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:25.591550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:25.808671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:27.037180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:27.220587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:28.215832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d8d53-99a7-4021-b237-b78462aeac74 service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:28.217339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7b5d8d53-99a7-4021-b237-b78462aeac74 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:28.433660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d8d53-99a7-4021-b237-b78462aeac74 service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:28.456441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b4c83-81df-42ad-910f-0fdd01e43d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:28.457367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b4c83-81df-42ad-910f-0fdd01e43d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:28.457656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b4c83-81df-42ad-910f-0fdd01e43d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:28.464190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b4c83-81df-42ad-910f-0fdd01e43d1d admin admin] PATH_INFO: `/v3/users/0aef6cf4bba04285808fb348ecfefd27` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:28.474902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b4c83-81df-42ad-910f-0fdd01e43d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aef6cf4bba04285808fb348ecfefd27)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:28.477835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b4c83-81df-42ad-910f-0fdd01e43d1d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:28.897084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:29.034926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0d6b4c83-81df-42ad-910f-0fdd01e43d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aef6cf4bba04285808fb348ecfefd27'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:29.056612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0d6b4c83-81df-42ad-910f-0fdd01e43d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aef6cf4bba04285808fb348ecfefd27'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:29.127433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0d6b4c83-81df-42ad-910f-0fdd01e43d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aef6cf4bba04285808fb348ecfefd27'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:29.138725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0d6b4c83-81df-42ad-910f-0fdd01e43d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aef6cf4bba04285808fb348ecfefd27'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:29.139595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0d6b4c83-81df-42ad-910f-0fdd01e43d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aef6cf4bba04285808fb348ecfefd27'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:29.154332 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2516/5102] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:25:28 2022] DELETE /identity/v3/users/0aef6cf4bba04285808fb348ecfefd27 => generated 0 bytes in 936 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:29.156150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba145eb4-df55-4498-af24-2249a861dbd3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:29.162725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba145eb4-df55-4498-af24-2249a861dbd3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:29.162725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba145eb4-df55-4498-af24-2249a861dbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:29.186724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ba145eb4-df55-4498-af24-2249a861dbd3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:29.187997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ba145eb4-df55-4498-af24-2249a861dbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:29.357443 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2587/5103] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:29.369851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b4c83-81df-42ad-910f-0fdd01e43d1d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:29.373381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0d6b4c83-81df-42ad-910f-0fdd01e43d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:29.466008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b4c83-81df-42ad-910f-0fdd01e43d1d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:29.474776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecee79f-2010-46fb-9bac-a7feac7fa10f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:29.474776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecee79f-2010-46fb-9bac-a7feac7fa10f service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:29.474776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecee79f-2010-46fb-9bac-a7feac7fa10f service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:29.474776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecee79f-2010-46fb-9bac-a7feac7fa10f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:29.485118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecee79f-2010-46fb-9bac-a7feac7fa10f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:29.487084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecee79f-2010-46fb-9bac-a7feac7fa10f service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:29.513602 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2517/5104] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:25:30.089445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba145eb4-df55-4498-af24-2249a861dbd3 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:30.091526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ba145eb4-df55-4498-af24-2249a861dbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:30.135241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba145eb4-df55-4498-af24-2249a861dbd3 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:30.148188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c456b80-60e7-4f7f-9cd7-8d433758122c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:30.152111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c456b80-60e7-4f7f-9cd7-8d433758122c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:30.152330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c456b80-60e7-4f7f-9cd7-8d433758122c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:30.152681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c456b80-60e7-4f7f-9cd7-8d433758122c admin admin] PATH_INFO: `/v3/projects/db405b7acaa14a18b71529d9d0710c1e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:30.154399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c456b80-60e7-4f7f-9cd7-8d433758122c admin admin] RBAC: Authorizing `identity:delete_project(project_id=db405b7acaa14a18b71529d9d0710c1e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:30.157018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c456b80-60e7-4f7f-9cd7-8d433758122c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:30.311409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7c456b80-60e7-4f7f-9cd7-8d433758122c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db405b7acaa14a18b71529d9d0710c1e', 'request_id': 'req-7c456b80-60e7-4f7f-9cd7-8d433758122c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:30.321209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7c456b80-60e7-4f7f-9cd7-8d433758122c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db405b7acaa14a18b71529d9d0710c1e', 'request_id': 'req-7c456b80-60e7-4f7f-9cd7-8d433758122c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:30.328150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7c456b80-60e7-4f7f-9cd7-8d433758122c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db405b7acaa14a18b71529d9d0710c1e', 'request_id': 'req-7c456b80-60e7-4f7f-9cd7-8d433758122c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:30.453959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7c456b80-60e7-4f7f-9cd7-8d433758122c admin admin] The token cache is being invalidate because project db405b7acaa14a18b71529d9d0710c1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:25:30.454638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7c456b80-60e7-4f7f-9cd7-8d433758122c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:30.455753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7c456b80-60e7-4f7f-9cd7-8d433758122c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:30.462715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecee79f-2010-46fb-9bac-a7feac7fa10f service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:30.463668 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2588/5105] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:25:30 2022] DELETE /identity/v3/projects/db405b7acaa14a18b71529d9d0710c1e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:30.473442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecee79f-2010-46fb-9bac-a7feac7fa10f service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:30.567521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae288b17-8df4-42a6-9ce4-d6fa530d17c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:30.573361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae288b17-8df4-42a6-9ce4-d6fa530d17c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:30.576512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae288b17-8df4-42a6-9ce4-d6fa530d17c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:30.576512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae288b17-8df4-42a6-9ce4-d6fa530d17c3 admin admin] PATH_INFO: `/v3/users/6f79428048d2483e9d2479ae1efd8c03` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:30.576512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae288b17-8df4-42a6-9ce4-d6fa530d17c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f79428048d2483e9d2479ae1efd8c03)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:30.589160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae288b17-8df4-42a6-9ce4-d6fa530d17c3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:30.825265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ae288b17-8df4-42a6-9ce4-d6fa530d17c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f79428048d2483e9d2479ae1efd8c03'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:30.847154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ae288b17-8df4-42a6-9ce4-d6fa530d17c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f79428048d2483e9d2479ae1efd8c03'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:30.928193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ae288b17-8df4-42a6-9ce4-d6fa530d17c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f79428048d2483e9d2479ae1efd8c03'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:30.950855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ae288b17-8df4-42a6-9ce4-d6fa530d17c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f79428048d2483e9d2479ae1efd8c03'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:30.952025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ae288b17-8df4-42a6-9ce4-d6fa530d17c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f79428048d2483e9d2479ae1efd8c03'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:30.975522 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2518/5106] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:25:30 2022] DELETE /identity/v3/users/6f79428048d2483e9d2479ae1efd8c03 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:25:31.254401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:31.674660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c456b80-60e7-4f7f-9cd7-8d433758122c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:31.677156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7c456b80-60e7-4f7f-9cd7-8d433758122c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:31.699801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c456b80-60e7-4f7f-9cd7-8d433758122c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:31.767981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:31.787447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cf811-8e31-48b2-9245-56b244a2e5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:31.789224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cf811-8e31-48b2-9245-56b244a2e5b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:31.789562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cf811-8e31-48b2-9245-56b244a2e5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:31.789907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cf811-8e31-48b2-9245-56b244a2e5b8 admin admin] PATH_INFO: `/v3/projects/82bd8d82a7664e2a82dd011fa82732a7` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:31.791194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cf811-8e31-48b2-9245-56b244a2e5b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82bd8d82a7664e2a82dd011fa82732a7)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:31.793169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cf811-8e31-48b2-9245-56b244a2e5b8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:31.981519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-131cf811-8e31-48b2-9245-56b244a2e5b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82bd8d82a7664e2a82dd011fa82732a7', 'request_id': 'req-131cf811-8e31-48b2-9245-56b244a2e5b8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:31.989305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-131cf811-8e31-48b2-9245-56b244a2e5b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82bd8d82a7664e2a82dd011fa82732a7', 'request_id': 'req-131cf811-8e31-48b2-9245-56b244a2e5b8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:31.995974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-131cf811-8e31-48b2-9245-56b244a2e5b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82bd8d82a7664e2a82dd011fa82732a7', 'request_id': 'req-131cf811-8e31-48b2-9245-56b244a2e5b8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:32.082492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-131cf811-8e31-48b2-9245-56b244a2e5b8 admin admin] The token cache is being invalidate because project 82bd8d82a7664e2a82dd011fa82732a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:25:32.082896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-131cf811-8e31-48b2-9245-56b244a2e5b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:32.083967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-131cf811-8e31-48b2-9245-56b244a2e5b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:32.086351 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2589/5107] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:25:31 2022] DELETE /identity/v3/projects/82bd8d82a7664e2a82dd011fa82732a7 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:32.091374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cec11-3744-48ad-bf6d-fd31a82eae40 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:32.091872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cec11-3744-48ad-bf6d-fd31a82eae40 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:32.091975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cec11-3744-48ad-bf6d-fd31a82eae40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:32.112113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-166cec11-3744-48ad-bf6d-fd31a82eae40 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:32.121616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-166cec11-3744-48ad-bf6d-fd31a82eae40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:32.180465 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2519/5108] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:32.188517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd8885-e857-4d0f-b7c1-d3845d082911 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:32.188809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd8885-e857-4d0f-b7c1-d3845d082911 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:32.191158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd8885-e857-4d0f-b7c1-d3845d082911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:32.203157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:32.215475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c7cd8885-e857-4d0f-b7c1-d3845d082911 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:32.216730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c7cd8885-e857-4d0f-b7c1-d3845d082911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:32.225381 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2590/5109] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:32.230349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cec11-3744-48ad-bf6d-fd31a82eae40 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:32.243276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cec11-3744-48ad-bf6d-fd31a82eae40 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:32.249902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f325d-bb9a-4ee9-be1e-917677814f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:32.253924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f325d-bb9a-4ee9-be1e-917677814f3f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:32.253924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f325d-bb9a-4ee9-be1e-917677814f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:32.253924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f325d-bb9a-4ee9-be1e-917677814f3f admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:32.253924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f325d-bb9a-4ee9-be1e-917677814f3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:25:32.253924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f325d-bb9a-4ee9-be1e-917677814f3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:32.253924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f325d-bb9a-4ee9-be1e-917677814f3f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:32.276041 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2520/5110] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:25:32.277334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd8885-e857-4d0f-b7c1-d3845d082911 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:32.289152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd8885-e857-4d0f-b7c1-d3845d082911 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:32.294965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd559e77-c950-4d38-b6b3-9fafd5d8af72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:32.295680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd559e77-c950-4d38-b6b3-9fafd5d8af72 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:32.295961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd559e77-c950-4d38-b6b3-9fafd5d8af72 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:32.296266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd559e77-c950-4d38-b6b3-9fafd5d8af72 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:32.296958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd559e77-c950-4d38-b6b3-9fafd5d8af72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:32.298934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd559e77-c950-4d38-b6b3-9fafd5d8af72 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:32.456361 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2591/5111] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:25:32 2022] POST /identity/v3/projects => generated 365 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:25:32.457784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f325d-bb9a-4ee9-be1e-917677814f3f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:32.469416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f325d-bb9a-4ee9-be1e-917677814f3f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:32.552357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b520ab-cd09-4bcb-a78e-31c3e1025327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:32.553359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b520ab-cd09-4bcb-a78e-31c3e1025327 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:32.553746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b520ab-cd09-4bcb-a78e-31c3e1025327 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:32.554235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b520ab-cd09-4bcb-a78e-31c3e1025327 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:32.555071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b520ab-cd09-4bcb-a78e-31c3e1025327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:32.557168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b520ab-cd09-4bcb-a78e-31c3e1025327 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:32.639115 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2521/5112] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:25:32 2022] POST /identity/v3/users => generated 283 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:25:32.645027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd559e77-c950-4d38-b6b3-9fafd5d8af72 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:32.660941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd559e77-c950-4d38-b6b3-9fafd5d8af72 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:32.666666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1acf8-6353-4301-8ccc-d1e63c1bb7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:32.667369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1acf8-6353-4301-8ccc-d1e63c1bb7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:32.667681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1acf8-6353-4301-8ccc-d1e63c1bb7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:32.667958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1acf8-6353-4301-8ccc-d1e63c1bb7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:32.668717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1acf8-6353-4301-8ccc-d1e63c1bb7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:32.670393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1acf8-6353-4301-8ccc-d1e63c1bb7a9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:32.681071 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2592/5113] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:25:32.688221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b520ab-cd09-4bcb-a78e-31c3e1025327 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:32.698475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b520ab-cd09-4bcb-a78e-31c3e1025327 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:32.703827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37104e9d-62aa-4549-8c99-d83e276ec2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:32.704497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37104e9d-62aa-4549-8c99-d83e276ec2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:32.704780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37104e9d-62aa-4549-8c99-d83e276ec2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:32.705056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37104e9d-62aa-4549-8c99-d83e276ec2f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:32.705778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37104e9d-62aa-4549-8c99-d83e276ec2f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:32.707996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37104e9d-62aa-4549-8c99-d83e276ec2f1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:32.721847 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2522/5114] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:25:32.726797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1acf8-6353-4301-8ccc-d1e63c1bb7a9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:32.737883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1acf8-6353-4301-8ccc-d1e63c1bb7a9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:32.744091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d7978-91ee-4911-94ca-5c3e54bb97e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:32.745028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d7978-91ee-4911-94ca-5c3e54bb97e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:32.745301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d7978-91ee-4911-94ca-5c3e54bb97e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:32.745507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d7978-91ee-4911-94ca-5c3e54bb97e5 admin admin] PATH_INFO: `/v3/projects/157b9e8c2932496db38da85b71c4024c/users/c7e2a9b5d9964c7bb25c7bdbbb71acaa/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:32.753602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cc5ea-0842-4a03-9eb9-908b1b9b41a2 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:32.753914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cc5ea-0842-4a03-9eb9-908b1b9b41a2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:32.754158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cc5ea-0842-4a03-9eb9-908b1b9b41a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:32.768066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d7978-91ee-4911-94ca-5c3e54bb97e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=157b9e8c2932496db38da85b71c4024c, user_id=c7e2a9b5d9964c7bb25c7bdbbb71acaa, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:32.771223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d7978-91ee-4911-94ca-5c3e54bb97e5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:32.776274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-cb1cc5ea-0842-4a03-9eb9-908b1b9b41a2 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:32.779092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cb1cc5ea-0842-4a03-9eb9-908b1b9b41a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:32.851466 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2523/5115] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:25:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:25:32.862676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cc5ea-0842-4a03-9eb9-908b1b9b41a2 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:32.864384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cb1cc5ea-0842-4a03-9eb9-908b1b9b41a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:32.880613 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2593/5116] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:25:32 2022] PUT /identity/v3/projects/157b9e8c2932496db38da85b71c4024c/users/c7e2a9b5d9964c7bb25c7bdbbb71acaa/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:32.893028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af956e57-4155-433e-a770-059320a9a9b5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:32.893319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af956e57-4155-433e-a770-059320a9a9b5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:32.893597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af956e57-4155-433e-a770-059320a9a9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:32.934243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-af956e57-4155-433e-a770-059320a9a9b5 None None] MFA Rules not processed for user `c7e2a9b5d9964c7bb25c7bdbbb71acaa`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:32.935595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-af956e57-4155-433e-a770-059320a9a9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:32.973058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cc5ea-0842-4a03-9eb9-908b1b9b41a2 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:33.034271 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2594/5117] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:25:33.039365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af956e57-4155-433e-a770-059320a9a9b5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:33.079713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1134bd-4626-423f-9ed3-38fe0c623222 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:33.081166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1134bd-4626-423f-9ed3-38fe0c623222 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:33.081517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1134bd-4626-423f-9ed3-38fe0c623222 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:33.081880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1134bd-4626-423f-9ed3-38fe0c623222 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:33.128531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af956e57-4155-433e-a770-059320a9a9b5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:33.135646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beac4ac-af89-48ac-a19e-8049fbc35d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:33.136971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beac4ac-af89-48ac-a19e-8049fbc35d74 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:33.137270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beac4ac-af89-48ac-a19e-8049fbc35d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:33.137568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beac4ac-af89-48ac-a19e-8049fbc35d74 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:33.138272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beac4ac-af89-48ac-a19e-8049fbc35d74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:33.140247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beac4ac-af89-48ac-a19e-8049fbc35d74 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:33.163854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1134bd-4626-423f-9ed3-38fe0c623222 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:33.166436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1134bd-4626-423f-9ed3-38fe0c623222 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:33.187151 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2524/5118] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:25:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:25:33.239103 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2595/5119] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:25:33 2022] POST /identity/v3/projects => generated 367 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:25:33.244067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1134bd-4626-423f-9ed3-38fe0c623222 service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:33.256093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1134bd-4626-423f-9ed3-38fe0c623222 service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:33.327791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c71f4-7c27-4bed-8197-44a1684d5392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:33.328586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c71f4-7c27-4bed-8197-44a1684d5392 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:33.329074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c71f4-7c27-4bed-8197-44a1684d5392 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:33.329560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c71f4-7c27-4bed-8197-44a1684d5392 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:33.330470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c71f4-7c27-4bed-8197-44a1684d5392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:33.332910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c71f4-7c27-4bed-8197-44a1684d5392 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:33.430667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceda7c-2843-4b01-937e-0aa878c95fcb None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:33.430961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceda7c-2843-4b01-937e-0aa878c95fcb None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:33.431280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceda7c-2843-4b01-937e-0aa878c95fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:33.461732 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2525/5120] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:25:33 2022] POST /identity/v3/users => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:25:33.462220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c71f4-7c27-4bed-8197-44a1684d5392 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:33.469502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-16ceda7c-2843-4b01-937e-0aa878c95fcb None None] MFA Rules not processed for user `027dcc48e4fd4c36a5004096ad5e43f8`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:33.470746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-16ceda7c-2843-4b01-937e-0aa878c95fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:33.482057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c71f4-7c27-4bed-8197-44a1684d5392 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:33.493075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d367dae-5c39-4eda-b354-0b3f7ecac09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:33.497079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d367dae-5c39-4eda-b354-0b3f7ecac09f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:33.497079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d367dae-5c39-4eda-b354-0b3f7ecac09f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:33.497079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d367dae-5c39-4eda-b354-0b3f7ecac09f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:33.497414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d367dae-5c39-4eda-b354-0b3f7ecac09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:33.499755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d367dae-5c39-4eda-b354-0b3f7ecac09f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:33.517258 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2526/5121] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:25:33.523812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d367dae-5c39-4eda-b354-0b3f7ecac09f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:33.534604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d367dae-5c39-4eda-b354-0b3f7ecac09f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:33.540959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88c91e-5743-4ebd-b976-48a5cf93bc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:33.541854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88c91e-5743-4ebd-b976-48a5cf93bc23 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:33.542141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88c91e-5743-4ebd-b976-48a5cf93bc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:33.542419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88c91e-5743-4ebd-b976-48a5cf93bc23 admin admin] PATH_INFO: `/v3/projects/f66c93bce570418caef2ef672dbe114c/users/af93a82ac633412db85de7d037b9b3df/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:33.558300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88c91e-5743-4ebd-b976-48a5cf93bc23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f66c93bce570418caef2ef672dbe114c, user_id=af93a82ac633412db85de7d037b9b3df, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:33.561023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88c91e-5743-4ebd-b976-48a5cf93bc23 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:33.562056 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2596/5122] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:25:33.671180 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2527/5123] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:25:33 2022] PUT /identity/v3/projects/f66c93bce570418caef2ef672dbe114c/users/af93a82ac633412db85de7d037b9b3df/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:25:33.675889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ceda7c-2843-4b01-937e-0aa878c95fcb None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:33.703158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ceda7c-2843-4b01-937e-0aa878c95fcb None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:33.759107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99505cb7-1dbd-4c12-a830-6233600b7a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:33.759803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99505cb7-1dbd-4c12-a830-6233600b7a2e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:33.760205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99505cb7-1dbd-4c12-a830-6233600b7a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:33.760536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99505cb7-1dbd-4c12-a830-6233600b7a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:33.761291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99505cb7-1dbd-4c12-a830-6233600b7a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:33.763210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99505cb7-1dbd-4c12-a830-6233600b7a2e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:33.775117 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2597/5124] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:25:33.779738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88c91e-5743-4ebd-b976-48a5cf93bc23 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:33.800392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88c91e-5743-4ebd-b976-48a5cf93bc23 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:33.807074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3192f-e63f-41a1-916c-45a10af51f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:33.814015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3192f-e63f-41a1-916c-45a10af51f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:33.814015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3192f-e63f-41a1-916c-45a10af51f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:33.814015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3192f-e63f-41a1-916c-45a10af51f5a admin admin] PATH_INFO: `/v3/projects/f66c93bce570418caef2ef672dbe114c/users/af93a82ac633412db85de7d037b9b3df/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:33.814015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3192f-e63f-41a1-916c-45a10af51f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f66c93bce570418caef2ef672dbe114c, user_id=af93a82ac633412db85de7d037b9b3df, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:33.814903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3192f-e63f-41a1-916c-45a10af51f5a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:33.815764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99505cb7-1dbd-4c12-a830-6233600b7a2e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:33.817759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-99505cb7-1dbd-4c12-a830-6233600b7a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:33.837465 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2528/5125] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:25:33 2022] PUT /identity/v3/projects/f66c93bce570418caef2ef672dbe114c/users/af93a82ac633412db85de7d037b9b3df/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:33.839000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99505cb7-1dbd-4c12-a830-6233600b7a2e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:33.848797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84629cd-837d-4f39-b908-7a86a533fc5c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:33.849126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84629cd-837d-4f39-b908-7a86a533fc5c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:33.849355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84629cd-837d-4f39-b908-7a86a533fc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:33.894414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f84629cd-837d-4f39-b908-7a86a533fc5c None None] MFA Rules not processed for user `af93a82ac633412db85de7d037b9b3df`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:33.896459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f84629cd-837d-4f39-b908-7a86a533fc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:33.916303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ce004-086f-4954-a7a6-e8d0f7c2e4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:33.917260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ce004-086f-4954-a7a6-e8d0f7c2e4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:33.917546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ce004-086f-4954-a7a6-e8d0f7c2e4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:33.918285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ce004-086f-4954-a7a6-e8d0f7c2e4bd admin admin] PATH_INFO: `/v3/users/602cb3d0d5bd419697f51c81343604de` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:33.919210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ce004-086f-4954-a7a6-e8d0f7c2e4bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=602cb3d0d5bd419697f51c81343604de)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:33.921303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ce004-086f-4954-a7a6-e8d0f7c2e4bd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:33.982701 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2529/5126] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:33 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:25:33.990970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84629cd-837d-4f39-b908-7a86a533fc5c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:33.993391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f84629cd-837d-4f39-b908-7a86a533fc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:34.062041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84629cd-837d-4f39-b908-7a86a533fc5c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:34.065857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6f925-f6a1-41c5-83ef-3c383a6a90c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:34.066539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6f925-f6a1-41c5-83ef-3c383a6a90c8 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:34.067092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6f925-f6a1-41c5-83ef-3c383a6a90c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:34.067372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6f925-f6a1-41c5-83ef-3c383a6a90c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:34.078635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6f925-f6a1-41c5-83ef-3c383a6a90c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:34.080320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6f925-f6a1-41c5-83ef-3c383a6a90c8 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:34.099163 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2530/5127] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:25:33 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:25:34.179208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b71ce004-086f-4954-a7a6-e8d0f7c2e4bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '602cb3d0d5bd419697f51c81343604de'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:34.188158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b71ce004-086f-4954-a7a6-e8d0f7c2e4bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '602cb3d0d5bd419697f51c81343604de'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:34.283577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b71ce004-086f-4954-a7a6-e8d0f7c2e4bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '602cb3d0d5bd419697f51c81343604de'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:34.284391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b71ce004-086f-4954-a7a6-e8d0f7c2e4bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '602cb3d0d5bd419697f51c81343604de'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:34.300343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b71ce004-086f-4954-a7a6-e8d0f7c2e4bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '602cb3d0d5bd419697f51c81343604de'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:34.314473 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2598/5128] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:25:33 2022] DELETE /identity/v3/users/602cb3d0d5bd419697f51c81343604de => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:34.318924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a00ac9-52d2-4368-aaa5-401df8db2077 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:34.320724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a00ac9-52d2-4368-aaa5-401df8db2077 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:34.321326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a00ac9-52d2-4368-aaa5-401df8db2077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:34.342792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ce004-086f-4954-a7a6-e8d0f7c2e4bd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:34.346751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b71ce004-086f-4954-a7a6-e8d0f7c2e4bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:34.384816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-40a00ac9-52d2-4368-aaa5-401df8db2077 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:34.386279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-40a00ac9-52d2-4368-aaa5-401df8db2077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:34.433880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ce004-086f-4954-a7a6-e8d0f7c2e4bd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:34.438680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d622a8f-df2d-475d-bd04-f937386f8c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:34.443769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d622a8f-df2d-475d-bd04-f937386f8c31 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:34.443769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d622a8f-df2d-475d-bd04-f937386f8c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:34.443769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d622a8f-df2d-475d-bd04-f937386f8c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:34.443769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4d622a8f-df2d-475d-bd04-f937386f8c31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:34.466841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:34.500857 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2531/5129] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:34.515781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a00ac9-52d2-4368-aaa5-401df8db2077 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:34.517953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-40a00ac9-52d2-4368-aaa5-401df8db2077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:34.535268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d622a8f-df2d-475d-bd04-f937386f8c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:34.537811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d622a8f-df2d-475d-bd04-f937386f8c31 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:34.550575 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2599/5130] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:25:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:25:34.605325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a00ac9-52d2-4368-aaa5-401df8db2077 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:34.609930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66939dd8-6959-4b3a-865e-84f21fe80523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:34.611053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66939dd8-6959-4b3a-865e-84f21fe80523 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:34.611658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66939dd8-6959-4b3a-865e-84f21fe80523 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:34.612101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66939dd8-6959-4b3a-865e-84f21fe80523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:34.624354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66939dd8-6959-4b3a-865e-84f21fe80523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:34.626037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66939dd8-6959-4b3a-865e-84f21fe80523 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:34.637958 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2532/5131] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:25:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:25:35.065278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:35.454940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d622a8f-df2d-475d-bd04-f937386f8c31 service cinder] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:35.458219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4d622a8f-df2d-475d-bd04-f937386f8c31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:35.503252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d622a8f-df2d-475d-bd04-f937386f8c31 service cinder] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:35.518958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04556e-96da-466a-b062-2206432d6097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:35.520448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04556e-96da-466a-b062-2206432d6097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:35.520731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04556e-96da-466a-b062-2206432d6097 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:35.521199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04556e-96da-466a-b062-2206432d6097 admin admin] PATH_INFO: `/v3/projects/9761cbc2eb3942e18fc79afbf73cd46f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:35.523674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04556e-96da-466a-b062-2206432d6097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9761cbc2eb3942e18fc79afbf73cd46f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:35.540980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04556e-96da-466a-b062-2206432d6097 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:35.642724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:35.750671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9c04556e-96da-466a-b062-2206432d6097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9761cbc2eb3942e18fc79afbf73cd46f', 'request_id': 'req-9c04556e-96da-466a-b062-2206432d6097'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:35.770612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9c04556e-96da-466a-b062-2206432d6097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9761cbc2eb3942e18fc79afbf73cd46f', 'request_id': 'req-9c04556e-96da-466a-b062-2206432d6097'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:35.770612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9c04556e-96da-466a-b062-2206432d6097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9761cbc2eb3942e18fc79afbf73cd46f', 'request_id': 'req-9c04556e-96da-466a-b062-2206432d6097'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:35.903496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9c04556e-96da-466a-b062-2206432d6097 admin admin] The token cache is being invalidate because project 9761cbc2eb3942e18fc79afbf73cd46f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:25:35.904013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9c04556e-96da-466a-b062-2206432d6097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:35.905253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9c04556e-96da-466a-b062-2206432d6097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:35.913598 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2600/5132] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:25:35 2022] DELETE /identity/v3/projects/9761cbc2eb3942e18fc79afbf73cd46f => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:35.913718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66939dd8-6959-4b3a-865e-84f21fe80523 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:35.924556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66939dd8-6959-4b3a-865e-84f21fe80523 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:36.060286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9e7a2-8167-4608-b38e-474ea0aaea6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:36.060286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9e7a2-8167-4608-b38e-474ea0aaea6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:36.060286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9e7a2-8167-4608-b38e-474ea0aaea6c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:36.060608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9e7a2-8167-4608-b38e-474ea0aaea6c admin admin] PATH_INFO: `/v3/users/f244b685fd8f4e519006789fc2a2f76e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:36.062422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9e7a2-8167-4608-b38e-474ea0aaea6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f244b685fd8f4e519006789fc2a2f76e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:36.064813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9e7a2-8167-4608-b38e-474ea0aaea6c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:36.307752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bbd9e7a2-8167-4608-b38e-474ea0aaea6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f244b685fd8f4e519006789fc2a2f76e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:36.334692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bbd9e7a2-8167-4608-b38e-474ea0aaea6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f244b685fd8f4e519006789fc2a2f76e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:36.408433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bbd9e7a2-8167-4608-b38e-474ea0aaea6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f244b685fd8f4e519006789fc2a2f76e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:36.419140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bbd9e7a2-8167-4608-b38e-474ea0aaea6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f244b685fd8f4e519006789fc2a2f76e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:36.419994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bbd9e7a2-8167-4608-b38e-474ea0aaea6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f244b685fd8f4e519006789fc2a2f76e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:36.428520 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2533/5133] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:25:35 2022] DELETE /identity/v3/users/f244b685fd8f4e519006789fc2a2f76e => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:37.205036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04556e-96da-466a-b062-2206432d6097 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:37.206545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9c04556e-96da-466a-b062-2206432d6097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:37.236749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04556e-96da-466a-b062-2206432d6097 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:37.325717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42441063-8e77-4b29-8c8c-ce7849f74fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:37.326974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42441063-8e77-4b29-8c8c-ce7849f74fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:37.327459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42441063-8e77-4b29-8c8c-ce7849f74fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:37.327973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42441063-8e77-4b29-8c8c-ce7849f74fbd admin admin] PATH_INFO: `/v3/projects/1c03b4743be543e0b1fa9d8d066e04a4` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:37.329255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42441063-8e77-4b29-8c8c-ce7849f74fbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c03b4743be543e0b1fa9d8d066e04a4)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:37.331313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42441063-8e77-4b29-8c8c-ce7849f74fbd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:37.495622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-42441063-8e77-4b29-8c8c-ce7849f74fbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c03b4743be543e0b1fa9d8d066e04a4', 'request_id': 'req-42441063-8e77-4b29-8c8c-ce7849f74fbd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:37.502098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-42441063-8e77-4b29-8c8c-ce7849f74fbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c03b4743be543e0b1fa9d8d066e04a4', 'request_id': 'req-42441063-8e77-4b29-8c8c-ce7849f74fbd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:37.522029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-42441063-8e77-4b29-8c8c-ce7849f74fbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c03b4743be543e0b1fa9d8d066e04a4', 'request_id': 'req-42441063-8e77-4b29-8c8c-ce7849f74fbd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:37.522194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bcef8-b292-4c15-8b80-65820f54fa89 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:37.522194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bcef8-b292-4c15-8b80-65820f54fa89 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:37.522194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bcef8-b292-4c15-8b80-65820f54fa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:37.544176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ae6bcef8-b292-4c15-8b80-65820f54fa89 None None] MFA Rules not processed for user `bcc9aa2a091c490599f9a9c41163e2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:37.545397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ae6bcef8-b292-4c15-8b80-65820f54fa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:37.568154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:37.574556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-42441063-8e77-4b29-8c8c-ce7849f74fbd admin admin] The token cache is being invalidate because project 1c03b4743be543e0b1fa9d8d066e04a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:25:37.575101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-42441063-8e77-4b29-8c8c-ce7849f74fbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:37.581410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-42441063-8e77-4b29-8c8c-ce7849f74fbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:37.581410 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2601/5134] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:25:37 2022] DELETE /identity/v3/projects/1c03b4743be543e0b1fa9d8d066e04a4 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:37.583437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6a960-7459-4a0c-a115-2261e5cb7f3a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:37.583799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6a960-7459-4a0c-a115-2261e5cb7f3a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:37.584365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6a960-7459-4a0c-a115-2261e5cb7f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:37.605627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ace6a960-7459-4a0c-a115-2261e5cb7f3a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:37.607127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ace6a960-7459-4a0c-a115-2261e5cb7f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:37.611904 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2534/5135] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:25:37.677654 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2602/5136] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:37.685813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb47beb-bebd-4459-a907-03dd4c8b6f1d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:37.686321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb47beb-bebd-4459-a907-03dd4c8b6f1d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:37.686698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb47beb-bebd-4459-a907-03dd4c8b6f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:37.722336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5bb47beb-bebd-4459-a907-03dd4c8b6f1d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:37.722336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5bb47beb-bebd-4459-a907-03dd4c8b6f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:37.736376 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2535/5137] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:37.740909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6a960-7459-4a0c-a115-2261e5cb7f3a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:37.753149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6a960-7459-4a0c-a115-2261e5cb7f3a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:37.759772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d8489-ee61-41cc-aa59-c2ea09630040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:37.760800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d8489-ee61-41cc-aa59-c2ea09630040 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:37.761151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d8489-ee61-41cc-aa59-c2ea09630040 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:37.761498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d8489-ee61-41cc-aa59-c2ea09630040 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:37.762373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d8489-ee61-41cc-aa59-c2ea09630040 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:25:37.763056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d8489-ee61-41cc-aa59-c2ea09630040 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:37.764838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d8489-ee61-41cc-aa59-c2ea09630040 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:37.783048 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2603/5138] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:25:37.787066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb47beb-bebd-4459-a907-03dd4c8b6f1d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:37.796958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb47beb-bebd-4459-a907-03dd4c8b6f1d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:37.801670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a30f3-4e33-408f-b09b-2db119d27bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:37.802323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a30f3-4e33-408f-b09b-2db119d27bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:37.802606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a30f3-4e33-408f-b09b-2db119d27bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:37.802881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a30f3-4e33-408f-b09b-2db119d27bb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:37.803667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a30f3-4e33-408f-b09b-2db119d27bb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:37.805672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a30f3-4e33-408f-b09b-2db119d27bb8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:37.895045 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2536/5139] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:25:37 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:25:37.898529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d8489-ee61-41cc-aa59-c2ea09630040 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:37.905819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:37.914414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d8489-ee61-41cc-aa59-c2ea09630040 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:37.997961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e139d1-a645-4363-83a1-01626ec5cd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:37.998985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e139d1-a645-4363-83a1-01626ec5cd93 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:37.999373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e139d1-a645-4363-83a1-01626ec5cd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:37.999724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e139d1-a645-4363-83a1-01626ec5cd93 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:38.001145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e139d1-a645-4363-83a1-01626ec5cd93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:38.003420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e139d1-a645-4363-83a1-01626ec5cd93 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:38.090148 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2604/5140] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:25:37 2022] POST /identity/v3/users => generated 283 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:25:38.094046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a30f3-4e33-408f-b09b-2db119d27bb8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:38.108108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a30f3-4e33-408f-b09b-2db119d27bb8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:38.113780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee1433-0cc8-47a3-ae00-0cb110c301b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:38.119348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee1433-0cc8-47a3-ae00-0cb110c301b7 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:38.119348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee1433-0cc8-47a3-ae00-0cb110c301b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:38.119348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee1433-0cc8-47a3-ae00-0cb110c301b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:38.119348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee1433-0cc8-47a3-ae00-0cb110c301b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:38.119348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee1433-0cc8-47a3-ae00-0cb110c301b7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:38.133842 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2537/5141] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:25:38.141647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e139d1-a645-4363-83a1-01626ec5cd93 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:38.164990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e139d1-a645-4363-83a1-01626ec5cd93 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:38.176422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81d928-1cef-401f-af23-6c533bc45d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:38.177118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81d928-1cef-401f-af23-6c533bc45d61 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:38.180208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81d928-1cef-401f-af23-6c533bc45d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:38.180208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81d928-1cef-401f-af23-6c533bc45d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:38.180208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81d928-1cef-401f-af23-6c533bc45d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:38.181884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81d928-1cef-401f-af23-6c533bc45d61 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:38.199059 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2605/5142] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:25:38.200732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee1433-0cc8-47a3-ae00-0cb110c301b7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:38.213676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee1433-0cc8-47a3-ae00-0cb110c301b7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:38.218885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9424fce-5f2a-40a4-adc2-3ef0d3602799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:38.220060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9424fce-5f2a-40a4-adc2-3ef0d3602799 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:38.220373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9424fce-5f2a-40a4-adc2-3ef0d3602799 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:38.220659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9424fce-5f2a-40a4-adc2-3ef0d3602799 admin admin] PATH_INFO: `/v3/projects/fccc2261607a49258e1729d4c5012ef7/users/63230a6cc1b84276a4a5ff869af83ec3/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:38.237277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9424fce-5f2a-40a4-adc2-3ef0d3602799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fccc2261607a49258e1729d4c5012ef7, user_id=63230a6cc1b84276a4a5ff869af83ec3, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:38.240077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9424fce-5f2a-40a4-adc2-3ef0d3602799 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:38.343914 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2538/5143] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:25:38 2022] PUT /identity/v3/projects/fccc2261607a49258e1729d4c5012ef7/users/63230a6cc1b84276a4a5ff869af83ec3/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:38.354074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a1c74-7161-4e98-8602-4fb33f13870d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:38.355480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a1c74-7161-4e98-8602-4fb33f13870d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:38.355776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a1c74-7161-4e98-8602-4fb33f13870d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:38.393820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b92a1c74-7161-4e98-8602-4fb33f13870d None None] MFA Rules not processed for user `63230a6cc1b84276a4a5ff869af83ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:38.395238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b92a1c74-7161-4e98-8602-4fb33f13870d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:38.550448 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2606/5144] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:38.550770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9424fce-5f2a-40a4-adc2-3ef0d3602799 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:38.636372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9424fce-5f2a-40a4-adc2-3ef0d3602799 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:38.641821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce804e-0020-4a0f-b6ea-5a21f533e9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:38.642526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce804e-0020-4a0f-b6ea-5a21f533e9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:38.642837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce804e-0020-4a0f-b6ea-5a21f533e9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:38.643148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce804e-0020-4a0f-b6ea-5a21f533e9e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:38.643851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce804e-0020-4a0f-b6ea-5a21f533e9e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:38.645785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce804e-0020-4a0f-b6ea-5a21f533e9e9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:38.793864 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2539/5145] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:25:38 2022] POST /identity/v3/projects => generated 365 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:25:38.799594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a1c74-7161-4e98-8602-4fb33f13870d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:38.831210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a1c74-7161-4e98-8602-4fb33f13870d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:38.876122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:38.925281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c68179-afd4-4545-bfe7-024031487304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:38.926122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c68179-afd4-4545-bfe7-024031487304 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:38.926419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c68179-afd4-4545-bfe7-024031487304 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:38.926681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c68179-afd4-4545-bfe7-024031487304 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:38.927462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c68179-afd4-4545-bfe7-024031487304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:38.929733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c68179-afd4-4545-bfe7-024031487304 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:39.018717 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2607/5146] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:25:38 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:25:39.022374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce804e-0020-4a0f-b6ea-5a21f533e9e9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:39.051547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce804e-0020-4a0f-b6ea-5a21f533e9e9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:39.067494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f7092-9234-4153-9193-8fad01fc3129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:39.068643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f7092-9234-4153-9193-8fad01fc3129 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:39.068643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f7092-9234-4153-9193-8fad01fc3129 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:39.068860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f7092-9234-4153-9193-8fad01fc3129 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:39.069966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f7092-9234-4153-9193-8fad01fc3129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:39.071608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f7092-9234-4153-9193-8fad01fc3129 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:39.115933 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2540/5147] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:25:39.116857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c68179-afd4-4545-bfe7-024031487304 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:39.130349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c68179-afd4-4545-bfe7-024031487304 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:39.139880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99bea9-8c62-4bf6-8a00-5f0de875b4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:39.140832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99bea9-8c62-4bf6-8a00-5f0de875b4c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:39.141186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99bea9-8c62-4bf6-8a00-5f0de875b4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:39.141480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99bea9-8c62-4bf6-8a00-5f0de875b4c4 admin admin] PATH_INFO: `/v3/projects/ef8375923ce244ce87e5ef4afb446ead/users/dcda371bddd345b4b2bb9653f7c1688c/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:39.158055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99bea9-8c62-4bf6-8a00-5f0de875b4c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef8375923ce244ce87e5ef4afb446ead, user_id=dcda371bddd345b4b2bb9653f7c1688c, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:39.160829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99bea9-8c62-4bf6-8a00-5f0de875b4c4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:39.208668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:39.296645 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2608/5148] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:25:39 2022] PUT /identity/v3/projects/ef8375923ce244ce87e5ef4afb446ead/users/dcda371bddd345b4b2bb9653f7c1688c/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:25:39.300435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f7092-9234-4153-9193-8fad01fc3129 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:39.315904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f7092-9234-4153-9193-8fad01fc3129 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:39.393548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac21af3-8a9c-4dca-908d-ba8455f5c907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:39.394918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac21af3-8a9c-4dca-908d-ba8455f5c907 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:39.395712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac21af3-8a9c-4dca-908d-ba8455f5c907 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:39.396312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac21af3-8a9c-4dca-908d-ba8455f5c907 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:39.398236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac21af3-8a9c-4dca-908d-ba8455f5c907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:39.400828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac21af3-8a9c-4dca-908d-ba8455f5c907 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:39.411975 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2541/5149] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:25:39.422401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99bea9-8c62-4bf6-8a00-5f0de875b4c4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:39.450454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99bea9-8c62-4bf6-8a00-5f0de875b4c4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:39.458180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea6f9c-ef27-4586-8bad-58381d140b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:39.460816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea6f9c-ef27-4586-8bad-58381d140b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:39.461287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea6f9c-ef27-4586-8bad-58381d140b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:39.461892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea6f9c-ef27-4586-8bad-58381d140b31 admin admin] PATH_INFO: `/v3/projects/ef8375923ce244ce87e5ef4afb446ead/users/dcda371bddd345b4b2bb9653f7c1688c/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:39.465888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea6f9c-ef27-4586-8bad-58381d140b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef8375923ce244ce87e5ef4afb446ead, user_id=dcda371bddd345b4b2bb9653f7c1688c, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:39.469335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea6f9c-ef27-4586-8bad-58381d140b31 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:39.482306 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2609/5150] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:25:39 2022] PUT /identity/v3/projects/ef8375923ce244ce87e5ef4afb446ead/users/dcda371bddd345b4b2bb9653f7c1688c/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:39.503332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b68f55-4db7-4194-b7cb-d79fa968a409 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:39.503332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b68f55-4db7-4194-b7cb-d79fa968a409 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:39.505189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b68f55-4db7-4194-b7cb-d79fa968a409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:39.545786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-86b68f55-4db7-4194-b7cb-d79fa968a409 None None] MFA Rules not processed for user `dcda371bddd345b4b2bb9653f7c1688c`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:39.547768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-86b68f55-4db7-4194-b7cb-d79fa968a409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:39.664282 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2542/5151] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:39 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:39.713939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea6f9c-ef27-4586-8bad-58381d140b31 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:39.716056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-abea6f9c-ef27-4586-8bad-58381d140b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:39.797496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea6f9c-ef27-4586-8bad-58381d140b31 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:39.801657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efad6ae-ee46-4653-a6a5-da68dc3fe2ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:39.802354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efad6ae-ee46-4653-a6a5-da68dc3fe2ab service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:39.802615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efad6ae-ee46-4653-a6a5-da68dc3fe2ab service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:39.802888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efad6ae-ee46-4653-a6a5-da68dc3fe2ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:39.812781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efad6ae-ee46-4653-a6a5-da68dc3fe2ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:39.815039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efad6ae-ee46-4653-a6a5-da68dc3fe2ab service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:39.836630 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2610/5152] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:25:39 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:25:40.286262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b68f55-4db7-4194-b7cb-d79fa968a409 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:40.298764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b68f55-4db7-4194-b7cb-d79fa968a409 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:40.302476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e254376-1b95-4174-aeab-da8f5b8e34d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:40.303248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e254376-1b95-4174-aeab-da8f5b8e34d0 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:40.309507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e254376-1b95-4174-aeab-da8f5b8e34d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:40.309507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e254376-1b95-4174-aeab-da8f5b8e34d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:40.386808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b2de9-170a-40ab-9467-055ed5f2da08 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:40.387597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b2de9-170a-40ab-9467-055ed5f2da08 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:40.387754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b2de9-170a-40ab-9467-055ed5f2da08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:40.390480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e254376-1b95-4174-aeab-da8f5b8e34d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:40.392662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e254376-1b95-4174-aeab-da8f5b8e34d0 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:40.406937 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2543/5153] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:25:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:25:40.421523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-077b2de9-170a-40ab-9467-055ed5f2da08 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:40.423246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-077b2de9-170a-40ab-9467-055ed5f2da08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:40.550982 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2611/5154] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:25:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:40.571139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e254376-1b95-4174-aeab-da8f5b8e34d0 service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:40.572773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7e254376-1b95-4174-aeab-da8f5b8e34d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:40.699161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e254376-1b95-4174-aeab-da8f5b8e34d0 service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:40.709169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa2345-904d-4460-aadd-c86dfc0fc231 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:40.710040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa2345-904d-4460-aadd-c86dfc0fc231 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:40.710444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa2345-904d-4460-aadd-c86dfc0fc231 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:40.710850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa2345-904d-4460-aadd-c86dfc0fc231 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:40.732405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa2345-904d-4460-aadd-c86dfc0fc231 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:40.738162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa2345-904d-4460-aadd-c86dfc0fc231 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:40.772748 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2544/5155] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:25:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:25:41.397298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:41.737359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:42.482079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:43.570810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:44.068429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b2de9-170a-40ab-9467-055ed5f2da08 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:44.093543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:44.175755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b2de9-170a-40ab-9467-055ed5f2da08 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:44.192102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc13462-2a71-4fb2-bd5d-3d6d2a6bcf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:44.193295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc13462-2a71-4fb2-bd5d-3d6d2a6bcf16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:44.193927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc13462-2a71-4fb2-bd5d-3d6d2a6bcf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:44.194289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc13462-2a71-4fb2-bd5d-3d6d2a6bcf16 admin admin] PATH_INFO: `/v3/users/63230a6cc1b84276a4a5ff869af83ec3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:44.201163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc13462-2a71-4fb2-bd5d-3d6d2a6bcf16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63230a6cc1b84276a4a5ff869af83ec3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:44.205700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc13462-2a71-4fb2-bd5d-3d6d2a6bcf16 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:44.486736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2bc13462-2a71-4fb2-bd5d-3d6d2a6bcf16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63230a6cc1b84276a4a5ff869af83ec3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:44.496321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2bc13462-2a71-4fb2-bd5d-3d6d2a6bcf16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63230a6cc1b84276a4a5ff869af83ec3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:44.545282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2bc13462-2a71-4fb2-bd5d-3d6d2a6bcf16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63230a6cc1b84276a4a5ff869af83ec3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:44.546455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2bc13462-2a71-4fb2-bd5d-3d6d2a6bcf16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63230a6cc1b84276a4a5ff869af83ec3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:44.585845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2bc13462-2a71-4fb2-bd5d-3d6d2a6bcf16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63230a6cc1b84276a4a5ff869af83ec3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:44.597894 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2612/5156] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:25:44 2022] DELETE /identity/v3/users/63230a6cc1b84276a4a5ff869af83ec3 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:44.603538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30510365-3b03-4dda-a5c6-f43353acf232 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:44.603997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30510365-3b03-4dda-a5c6-f43353acf232 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:44.604343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30510365-3b03-4dda-a5c6-f43353acf232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:44.641974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-30510365-3b03-4dda-a5c6-f43353acf232 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:44.643582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-30510365-3b03-4dda-a5c6-f43353acf232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:44.814486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:44.843248 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2545/5157] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:44.853980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc13462-2a71-4fb2-bd5d-3d6d2a6bcf16 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:44.855487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2bc13462-2a71-4fb2-bd5d-3d6d2a6bcf16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:44.987825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc13462-2a71-4fb2-bd5d-3d6d2a6bcf16 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:44.996934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2f2ae-8cc1-4abc-ae3d-89da7fef80a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:44.998082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2f2ae-8cc1-4abc-ae3d-89da7fef80a0 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:44.998637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2f2ae-8cc1-4abc-ae3d-89da7fef80a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:44.999276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2f2ae-8cc1-4abc-ae3d-89da7fef80a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:45.043644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2f2ae-8cc1-4abc-ae3d-89da7fef80a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:45.047546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2f2ae-8cc1-4abc-ae3d-89da7fef80a0 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:45.066406 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2613/5158] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:25:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:25:45.319856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:46.498733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30510365-3b03-4dda-a5c6-f43353acf232 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:46.500200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-30510365-3b03-4dda-a5c6-f43353acf232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:46.533359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30510365-3b03-4dda-a5c6-f43353acf232 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:46.548694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d06a9-a9db-4d12-ada0-364373fdf5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:46.552603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d06a9-a9db-4d12-ada0-364373fdf5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:46.555725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d06a9-a9db-4d12-ada0-364373fdf5af admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:46.556018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d06a9-a9db-4d12-ada0-364373fdf5af admin admin] PATH_INFO: `/v3/projects/fccc2261607a49258e1729d4c5012ef7` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:46.559629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d06a9-a9db-4d12-ada0-364373fdf5af admin admin] RBAC: Authorizing `identity:delete_project(project_id=fccc2261607a49258e1729d4c5012ef7)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:46.570629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d06a9-a9db-4d12-ada0-364373fdf5af admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:46.745943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-294d06a9-a9db-4d12-ada0-364373fdf5af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fccc2261607a49258e1729d4c5012ef7', 'request_id': 'req-294d06a9-a9db-4d12-ada0-364373fdf5af'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:46.753276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-294d06a9-a9db-4d12-ada0-364373fdf5af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fccc2261607a49258e1729d4c5012ef7', 'request_id': 'req-294d06a9-a9db-4d12-ada0-364373fdf5af'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:46.765728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-294d06a9-a9db-4d12-ada0-364373fdf5af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fccc2261607a49258e1729d4c5012ef7', 'request_id': 'req-294d06a9-a9db-4d12-ada0-364373fdf5af'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:46.870438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-294d06a9-a9db-4d12-ada0-364373fdf5af admin admin] The token cache is being invalidate because project fccc2261607a49258e1729d4c5012ef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:25:46.874452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-294d06a9-a9db-4d12-ada0-364373fdf5af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:46.874452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-294d06a9-a9db-4d12-ada0-364373fdf5af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:46.876697 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2546/5159] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:25:46 2022] DELETE /identity/v3/projects/fccc2261607a49258e1729d4c5012ef7 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:46.880543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2f2ae-8cc1-4abc-ae3d-89da7fef80a0 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:46.893507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2f2ae-8cc1-4abc-ae3d-89da7fef80a0 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:46.932891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:46.996521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37958f6-4b16-4e98-8619-03c0322ed6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:46.997520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37958f6-4b16-4e98-8619-03c0322ed6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:46.997807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37958f6-4b16-4e98-8619-03c0322ed6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:46.998087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37958f6-4b16-4e98-8619-03c0322ed6fc admin admin] PATH_INFO: `/v3/users/dcda371bddd345b4b2bb9653f7c1688c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:47.000449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37958f6-4b16-4e98-8619-03c0322ed6fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcda371bddd345b4b2bb9653f7c1688c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:47.005037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37958f6-4b16-4e98-8619-03c0322ed6fc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:47.273582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a37958f6-4b16-4e98-8619-03c0322ed6fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcda371bddd345b4b2bb9653f7c1688c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:47.289244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a37958f6-4b16-4e98-8619-03c0322ed6fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcda371bddd345b4b2bb9653f7c1688c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:47.362242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a37958f6-4b16-4e98-8619-03c0322ed6fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcda371bddd345b4b2bb9653f7c1688c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:47.362874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a37958f6-4b16-4e98-8619-03c0322ed6fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcda371bddd345b4b2bb9653f7c1688c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:47.389743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a37958f6-4b16-4e98-8619-03c0322ed6fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcda371bddd345b4b2bb9653f7c1688c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:47.397661 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2614/5160] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:25:46 2022] DELETE /identity/v3/users/dcda371bddd345b4b2bb9653f7c1688c => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:47.750721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:48.507731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d06a9-a9db-4d12-ada0-364373fdf5af admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:48.509362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-294d06a9-a9db-4d12-ada0-364373fdf5af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:48.543326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d06a9-a9db-4d12-ada0-364373fdf5af admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:48.654762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b1f9f-5591-4abf-acde-0a254591eefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:48.655982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b1f9f-5591-4abf-acde-0a254591eefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:48.656512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b1f9f-5591-4abf-acde-0a254591eefa admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:48.656949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b1f9f-5591-4abf-acde-0a254591eefa admin admin] PATH_INFO: `/v3/projects/ef8375923ce244ce87e5ef4afb446ead` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:48.658501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b1f9f-5591-4abf-acde-0a254591eefa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef8375923ce244ce87e5ef4afb446ead)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:48.660668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b1f9f-5591-4abf-acde-0a254591eefa admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:48.930281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-105b1f9f-5591-4abf-acde-0a254591eefa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef8375923ce244ce87e5ef4afb446ead', 'request_id': 'req-105b1f9f-5591-4abf-acde-0a254591eefa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:48.949681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-105b1f9f-5591-4abf-acde-0a254591eefa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef8375923ce244ce87e5ef4afb446ead', 'request_id': 'req-105b1f9f-5591-4abf-acde-0a254591eefa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:48.960916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-105b1f9f-5591-4abf-acde-0a254591eefa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef8375923ce244ce87e5ef4afb446ead', 'request_id': 'req-105b1f9f-5591-4abf-acde-0a254591eefa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:49.019694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:49.064990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-105b1f9f-5591-4abf-acde-0a254591eefa admin admin] The token cache is being invalidate because project ef8375923ce244ce87e5ef4afb446ead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:25:49.065285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-105b1f9f-5591-4abf-acde-0a254591eefa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:49.066922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-105b1f9f-5591-4abf-acde-0a254591eefa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:49.069753 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2547/5161] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:25:48 2022] DELETE /identity/v3/projects/ef8375923ce244ce87e5ef4afb446ead => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:49.075792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2166fb-9a15-4c13-9358-8ec70cfce499 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:49.076335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2166fb-9a15-4c13-9358-8ec70cfce499 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:49.076335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2166fb-9a15-4c13-9358-8ec70cfce499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:49.160621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2b2166fb-9a15-4c13-9358-8ec70cfce499 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:49.161818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2b2166fb-9a15-4c13-9358-8ec70cfce499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:49.262227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218fc87-9267-4f44-b419-9cd0699e96da None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:49.262430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218fc87-9267-4f44-b419-9cd0699e96da None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:49.262740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218fc87-9267-4f44-b419-9cd0699e96da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:49.267132 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2615/5162] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:49.303933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4218fc87-9267-4f44-b419-9cd0699e96da None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:49.307666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4218fc87-9267-4f44-b419-9cd0699e96da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:49.333101 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2548/5163] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:49.337573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2166fb-9a15-4c13-9358-8ec70cfce499 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:49.354211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2166fb-9a15-4c13-9358-8ec70cfce499 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:49.360624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4248967-699e-4449-8c09-9e7f131ddcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:49.362111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4248967-699e-4449-8c09-9e7f131ddcd6 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:49.362633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4248967-699e-4449-8c09-9e7f131ddcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:49.363231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4248967-699e-4449-8c09-9e7f131ddcd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:49.364241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4248967-699e-4449-8c09-9e7f131ddcd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:25:49.365082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4248967-699e-4449-8c09-9e7f131ddcd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:49.370122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4248967-699e-4449-8c09-9e7f131ddcd6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:49.394129 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2616/5164] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:25:49.398512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218fc87-9267-4f44-b419-9cd0699e96da None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:49.411767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218fc87-9267-4f44-b419-9cd0699e96da None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:49.421493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ba0d6-e248-4000-8b07-7a1027c0b931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:49.424159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ba0d6-e248-4000-8b07-7a1027c0b931 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:49.424700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ba0d6-e248-4000-8b07-7a1027c0b931 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:49.431606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ba0d6-e248-4000-8b07-7a1027c0b931 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:49.431606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ba0d6-e248-4000-8b07-7a1027c0b931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:49.431606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ba0d6-e248-4000-8b07-7a1027c0b931 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:49.574832 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2549/5165] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:25:49 2022] POST /identity/v3/projects => generated 399 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:25:49.579292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4248967-699e-4449-8c09-9e7f131ddcd6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:49.632596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4248967-699e-4449-8c09-9e7f131ddcd6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:49.733862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ba0d6-e248-4000-8b07-7a1027c0b931 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:49.735675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-136ba0d6-e248-4000-8b07-7a1027c0b931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:49.791340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:49.851817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ffc73-f97e-433d-b482-b32c698213bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:49.853746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ffc73-f97e-433d-b482-b32c698213bc admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:49.854341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ffc73-f97e-433d-b482-b32c698213bc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:49.856461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ffc73-f97e-433d-b482-b32c698213bc admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:49.857441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ffc73-f97e-433d-b482-b32c698213bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:49.861202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ffc73-f97e-433d-b482-b32c698213bc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:49.923223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ba0d6-e248-4000-8b07-7a1027c0b931 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:49.941421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08b69d-d404-4548-aeb8-17c70fa09785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:49.942335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08b69d-d404-4548-aeb8-17c70fa09785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:49.942619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08b69d-d404-4548-aeb8-17c70fa09785 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:49.950254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08b69d-d404-4548-aeb8-17c70fa09785 admin admin] PATH_INFO: `/v3/users/c7e2a9b5d9964c7bb25c7bdbbb71acaa` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:49.964497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08b69d-d404-4548-aeb8-17c70fa09785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e2a9b5d9964c7bb25c7bdbbb71acaa)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:49.982343 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2617/5166] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:25:49 2022] POST /identity/v3/users => generated 300 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:25:49.982568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08b69d-d404-4548-aeb8-17c70fa09785 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:49.989063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ffc73-f97e-433d-b482-b32c698213bc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:50.009511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ffc73-f97e-433d-b482-b32c698213bc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:50.016401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf65ca-4d63-4a27-983b-523d01773c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:50.017947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf65ca-4d63-4a27-983b-523d01773c1c admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:50.018361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf65ca-4d63-4a27-983b-523d01773c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:50.018887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf65ca-4d63-4a27-983b-523d01773c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:50.019763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf65ca-4d63-4a27-983b-523d01773c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:50.023129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf65ca-4d63-4a27-983b-523d01773c1c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:50.043188 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2618/5167] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:25:50.045613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf65ca-4d63-4a27-983b-523d01773c1c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:50.059534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf65ca-4d63-4a27-983b-523d01773c1c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:50.068566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420e29f-29f9-4cc7-83ef-8bf704499400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:50.069888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420e29f-29f9-4cc7-83ef-8bf704499400 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:50.070187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420e29f-29f9-4cc7-83ef-8bf704499400 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:50.071578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420e29f-29f9-4cc7-83ef-8bf704499400 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:50.072518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420e29f-29f9-4cc7-83ef-8bf704499400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:50.076709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420e29f-29f9-4cc7-83ef-8bf704499400 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:50.110878 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2619/5168] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:25:50.112539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420e29f-29f9-4cc7-83ef-8bf704499400 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:50.126847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420e29f-29f9-4cc7-83ef-8bf704499400 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:50.134355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454fb99-0d40-4b05-86ad-3e10d914c9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:50.135577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454fb99-0d40-4b05-86ad-3e10d914c9c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:50.136009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454fb99-0d40-4b05-86ad-3e10d914c9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:50.136411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454fb99-0d40-4b05-86ad-3e10d914c9c2 admin admin] PATH_INFO: `/v3/projects/bbcf15429e7f4b638f3b61e1c8f9244b/users/2e1a1216c7544596b090ce9644e35290/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:50.161434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454fb99-0d40-4b05-86ad-3e10d914c9c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbcf15429e7f4b638f3b61e1c8f9244b, user_id=2e1a1216c7544596b090ce9644e35290, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:50.162633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:50.166648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454fb99-0d40-4b05-86ad-3e10d914c9c2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:50.270955 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2620/5169] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:25:50 2022] PUT /identity/v3/projects/bbcf15429e7f4b638f3b61e1c8f9244b/users/2e1a1216c7544596b090ce9644e35290/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:25:50.272933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024bb49-194e-4cab-a262-af93f83f44e6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:50.273223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024bb49-194e-4cab-a262-af93f83f44e6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:50.276901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024bb49-194e-4cab-a262-af93f83f44e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:50.285659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1a08b69d-d404-4548-aeb8-17c70fa09785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e2a9b5d9964c7bb25c7bdbbb71acaa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:50.307753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1a08b69d-d404-4548-aeb8-17c70fa09785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e2a9b5d9964c7bb25c7bdbbb71acaa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:50.316037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f024bb49-194e-4cab-a262-af93f83f44e6 None None] MFA Rules not processed for user `2e1a1216c7544596b090ce9644e35290`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:50.317311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f024bb49-194e-4cab-a262-af93f83f44e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:50.435825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1a08b69d-d404-4548-aeb8-17c70fa09785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e2a9b5d9964c7bb25c7bdbbb71acaa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:50.445619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1a08b69d-d404-4548-aeb8-17c70fa09785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e2a9b5d9964c7bb25c7bdbbb71acaa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:50.446402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1a08b69d-d404-4548-aeb8-17c70fa09785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e2a9b5d9964c7bb25c7bdbbb71acaa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:50.451905 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2621/5170] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:50.459859 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2550/5171] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:25:49 2022] DELETE /identity/v3/users/c7e2a9b5d9964c7bb25c7bdbbb71acaa => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:50.461615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024bb49-194e-4cab-a262-af93f83f44e6 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:50.464610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee211ab-00a6-40f4-8555-d62c6f731e82 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:50.464913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee211ab-00a6-40f4-8555-d62c6f731e82 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:50.465196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee211ab-00a6-40f4-8555-d62c6f731e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:50.509653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-aee211ab-00a6-40f4-8555-d62c6f731e82 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:50.510896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-aee211ab-00a6-40f4-8555-d62c6f731e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:50.558549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024bb49-194e-4cab-a262-af93f83f44e6 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:50.597645 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2551/5172] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:50.609755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee211ab-00a6-40f4-8555-d62c6f731e82 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:50.611845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-aee211ab-00a6-40f4-8555-d62c6f731e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:50.635543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5931aba-00e1-4692-b9c8-c8aafc510da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:50.639300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5931aba-00e1-4692-b9c8-c8aafc510da3 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:50.639300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5931aba-00e1-4692-b9c8-c8aafc510da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:50.639300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5931aba-00e1-4692-b9c8-c8aafc510da3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:50.639300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5931aba-00e1-4692-b9c8-c8aafc510da3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:50.641156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5931aba-00e1-4692-b9c8-c8aafc510da3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:50.685704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee211ab-00a6-40f4-8555-d62c6f731e82 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:50.689959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796a124-8331-45b8-a446-598cd105a80b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:50.690630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796a124-8331-45b8-a446-598cd105a80b service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:50.691138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796a124-8331-45b8-a446-598cd105a80b service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:50.691587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796a124-8331-45b8-a446-598cd105a80b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:50.702637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796a124-8331-45b8-a446-598cd105a80b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:50.705218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796a124-8331-45b8-a446-598cd105a80b service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:50.725179 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2552/5173] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:25:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:25:50.759426 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2622/5174] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:25:50 2022] POST /identity/v3/projects => generated 399 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:25:50.760358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796a124-8331-45b8-a446-598cd105a80b service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:50.763274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e796a124-8331-45b8-a446-598cd105a80b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:50.782643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796a124-8331-45b8-a446-598cd105a80b service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:50.892453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6e9b0-03d1-4791-abd3-2cd307a5eadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:50.897727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6e9b0-03d1-4791-abd3-2cd307a5eadf admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:50.897727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6e9b0-03d1-4791-abd3-2cd307a5eadf admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:50.897727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6e9b0-03d1-4791-abd3-2cd307a5eadf admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:50.897727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6e9b0-03d1-4791-abd3-2cd307a5eadf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:50.897727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6e9b0-03d1-4791-abd3-2cd307a5eadf admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:51.035202 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2553/5175] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:25:50 2022] POST /identity/v3/users => generated 306 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:25:51.035923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5931aba-00e1-4692-b9c8-c8aafc510da3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:51.040105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5931aba-00e1-4692-b9c8-c8aafc510da3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:51.045334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030d7fa-192e-47de-a2c2-90d1425c5a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:51.046362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030d7fa-192e-47de-a2c2-90d1425c5a1a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:51.046684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030d7fa-192e-47de-a2c2-90d1425c5a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:51.046953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030d7fa-192e-47de-a2c2-90d1425c5a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:51.049831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030d7fa-192e-47de-a2c2-90d1425c5a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:51.049831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030d7fa-192e-47de-a2c2-90d1425c5a1a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:51.063381 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2623/5176] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:25:51.067795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6e9b0-03d1-4791-abd3-2cd307a5eadf admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:51.088945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6e9b0-03d1-4791-abd3-2cd307a5eadf admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:51.093780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d15125-9add-463f-9df1-e905c410b09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:51.094674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d15125-9add-463f-9df1-e905c410b09a admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:51.094987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d15125-9add-463f-9df1-e905c410b09a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:51.095301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d15125-9add-463f-9df1-e905c410b09a admin admin] PATH_INFO: `/v3/projects/119a1ab47c114440b2a8b749c006a135/users/ac74b5e888b644bdba7825d42d5ac20c/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:51.117565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d15125-9add-463f-9df1-e905c410b09a admin admin] RBAC: Authorizing `identity:create_grant(project_id=119a1ab47c114440b2a8b749c006a135, user_id=ac74b5e888b644bdba7825d42d5ac20c, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:51.120706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d15125-9add-463f-9df1-e905c410b09a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:51.436887 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2554/5177] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:25:51 2022] PUT /identity/v3/projects/119a1ab47c114440b2a8b749c006a135/users/ac74b5e888b644bdba7825d42d5ac20c/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:25:51.440689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030d7fa-192e-47de-a2c2-90d1425c5a1a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:51.451673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030d7fa-192e-47de-a2c2-90d1425c5a1a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:51.500481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d15125-9add-463f-9df1-e905c410b09a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:51.502238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-08d15125-9add-463f-9df1-e905c410b09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:51.570952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3c710-ef31-41a4-b00a-cf6073d51741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:51.571803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3c710-ef31-41a4-b00a-cf6073d51741 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:51.571917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3c710-ef31-41a4-b00a-cf6073d51741 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:51.572191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3c710-ef31-41a4-b00a-cf6073d51741 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:51.572918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3c710-ef31-41a4-b00a-cf6073d51741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:51.574540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3c710-ef31-41a4-b00a-cf6073d51741 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:51.598382 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2624/5178] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:25:51.606481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3c710-ef31-41a4-b00a-cf6073d51741 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:51.630337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d15125-9add-463f-9df1-e905c410b09a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:51.635614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3c710-ef31-41a4-b00a-cf6073d51741 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:51.637858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248b9ac-f21c-4884-b8e3-9b14f02a1941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:51.638375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248b9ac-f21c-4884-b8e3-9b14f02a1941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:51.638825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248b9ac-f21c-4884-b8e3-9b14f02a1941 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:51.639310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248b9ac-f21c-4884-b8e3-9b14f02a1941 admin admin] PATH_INFO: `/v3/projects/157b9e8c2932496db38da85b71c4024c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:51.640881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248b9ac-f21c-4884-b8e3-9b14f02a1941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=157b9e8c2932496db38da85b71c4024c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:51.643157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248b9ac-f21c-4884-b8e3-9b14f02a1941 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:51.655220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b308a-5816-452a-9bcc-32b542b36d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:51.656445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b308a-5816-452a-9bcc-32b542b36d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:51.657081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b308a-5816-452a-9bcc-32b542b36d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:51.657891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b308a-5816-452a-9bcc-32b542b36d8c admin admin] PATH_INFO: `/v3/projects/119a1ab47c114440b2a8b749c006a135/users/ac74b5e888b644bdba7825d42d5ac20c/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:51.667646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b308a-5816-452a-9bcc-32b542b36d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=119a1ab47c114440b2a8b749c006a135, user_id=ac74b5e888b644bdba7825d42d5ac20c, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:51.671067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b308a-5816-452a-9bcc-32b542b36d8c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:51.697611 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2625/5179] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:25:51 2022] PUT /identity/v3/projects/119a1ab47c114440b2a8b749c006a135/users/ac74b5e888b644bdba7825d42d5ac20c/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:51.706614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5ee81-ce11-4df4-8b5e-c03924a7db61 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:51.707261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5ee81-ce11-4df4-8b5e-c03924a7db61 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:51.707674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5ee81-ce11-4df4-8b5e-c03924a7db61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:51.748894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-93b5ee81-ce11-4df4-8b5e-c03924a7db61 None None] MFA Rules not processed for user `ac74b5e888b644bdba7825d42d5ac20c`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:51.750556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-93b5ee81-ce11-4df4-8b5e-c03924a7db61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:51.805147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f248b9ac-f21c-4884-b8e3-9b14f02a1941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '157b9e8c2932496db38da85b71c4024c', 'request_id': 'req-f248b9ac-f21c-4884-b8e3-9b14f02a1941'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:51.812462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f248b9ac-f21c-4884-b8e3-9b14f02a1941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '157b9e8c2932496db38da85b71c4024c', 'request_id': 'req-f248b9ac-f21c-4884-b8e3-9b14f02a1941'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:51.826836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f248b9ac-f21c-4884-b8e3-9b14f02a1941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '157b9e8c2932496db38da85b71c4024c', 'request_id': 'req-f248b9ac-f21c-4884-b8e3-9b14f02a1941'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:51.886415 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2626/5180] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:51 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:51.887645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5ee81-ce11-4df4-8b5e-c03924a7db61 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:51.890717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-93b5ee81-ce11-4df4-8b5e-c03924a7db61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:51.931972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f248b9ac-f21c-4884-b8e3-9b14f02a1941 admin admin] The token cache is being invalidate because project 157b9e8c2932496db38da85b71c4024c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:25:51.932351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f248b9ac-f21c-4884-b8e3-9b14f02a1941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:51.933960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f248b9ac-f21c-4884-b8e3-9b14f02a1941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:51.939101 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2555/5181] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:25:51 2022] DELETE /identity/v3/projects/157b9e8c2932496db38da85b71c4024c => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:25:51.940234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248b9ac-f21c-4884-b8e3-9b14f02a1941 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:51.942082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f248b9ac-f21c-4884-b8e3-9b14f02a1941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:52.018526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5ee81-ce11-4df4-8b5e-c03924a7db61 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:52.107725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248b9ac-f21c-4884-b8e3-9b14f02a1941 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:52.115719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3e114-7414-4417-a7cb-ab1aa381368e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:52.116763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3e114-7414-4417-a7cb-ab1aa381368e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:52.118244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1de5fa-5dbe-4c42-b7a4-8187aae120f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:52.118921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1de5fa-5dbe-4c42-b7a4-8187aae120f6 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:52.119236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1de5fa-5dbe-4c42-b7a4-8187aae120f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:52.119516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1de5fa-5dbe-4c42-b7a4-8187aae120f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:52.121670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-de1de5fa-5dbe-4c42-b7a4-8187aae120f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:52.121820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3e114-7414-4417-a7cb-ab1aa381368e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:52.122069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3e114-7414-4417-a7cb-ab1aa381368e admin admin] PATH_INFO: `/v3/users/af93a82ac633412db85de7d037b9b3df` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:52.123457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3e114-7414-4417-a7cb-ab1aa381368e admin admin] RBAC: Authorizing `identity:delete_user(user_id=af93a82ac633412db85de7d037b9b3df)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:52.125394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3e114-7414-4417-a7cb-ab1aa381368e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:52.171128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:52.238888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1de5fa-5dbe-4c42-b7a4-8187aae120f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:52.242544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1de5fa-5dbe-4c42-b7a4-8187aae120f6 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:52.267876 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2627/5182] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:25:51 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:25:52.343314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-22a3e114-7414-4417-a7cb-ab1aa381368e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af93a82ac633412db85de7d037b9b3df'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:52.356763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-22a3e114-7414-4417-a7cb-ab1aa381368e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af93a82ac633412db85de7d037b9b3df'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:52.527187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-22a3e114-7414-4417-a7cb-ab1aa381368e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af93a82ac633412db85de7d037b9b3df'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:52.536064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-22a3e114-7414-4417-a7cb-ab1aa381368e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af93a82ac633412db85de7d037b9b3df'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:52.536868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-22a3e114-7414-4417-a7cb-ab1aa381368e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af93a82ac633412db85de7d037b9b3df'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:52.545281 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2556/5183] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:25:51 2022] DELETE /identity/v3/users/af93a82ac633412db85de7d037b9b3df => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:52.573487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1de5fa-5dbe-4c42-b7a4-8187aae120f6 service cinder] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:52.575458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-de1de5fa-5dbe-4c42-b7a4-8187aae120f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:52.590429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1de5fa-5dbe-4c42-b7a4-8187aae120f6 service cinder] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:52.665982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b1153-6b3e-4dca-95de-7a5a8eea6e2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:52.668351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b1153-6b3e-4dca-95de-7a5a8eea6e2c service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:52.668351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b1153-6b3e-4dca-95de-7a5a8eea6e2c service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:52.668351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b1153-6b3e-4dca-95de-7a5a8eea6e2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:52.669913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d16b1153-6b3e-4dca-95de-7a5a8eea6e2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:52.759301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b1153-6b3e-4dca-95de-7a5a8eea6e2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:52.763604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b1153-6b3e-4dca-95de-7a5a8eea6e2c service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:52.776948 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2628/5184] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:25:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:25:53.058896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:53.252383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3e114-7414-4417-a7cb-ab1aa381368e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:53.254147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-22a3e114-7414-4417-a7cb-ab1aa381368e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:53.338626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b1153-6b3e-4dca-95de-7a5a8eea6e2c service cinder] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:53.345368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d16b1153-6b3e-4dca-95de-7a5a8eea6e2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:53.462984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3e114-7414-4417-a7cb-ab1aa381368e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:53.483068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9f8e6-a3cd-4ebb-9691-d7fb30be6257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:53.484212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9f8e6-a3cd-4ebb-9691-d7fb30be6257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:53.484685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9f8e6-a3cd-4ebb-9691-d7fb30be6257 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:53.485151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9f8e6-a3cd-4ebb-9691-d7fb30be6257 admin admin] PATH_INFO: `/v3/projects/f66c93bce570418caef2ef672dbe114c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:53.486747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9f8e6-a3cd-4ebb-9691-d7fb30be6257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f66c93bce570418caef2ef672dbe114c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:53.492826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9f8e6-a3cd-4ebb-9691-d7fb30be6257 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:53.548121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b1153-6b3e-4dca-95de-7a5a8eea6e2c service cinder] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:53.560360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de683f4b-b2f1-441d-8ac9-1a5d47292f08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:53.561975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de683f4b-b2f1-441d-8ac9-1a5d47292f08 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:53.561975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de683f4b-b2f1-441d-8ac9-1a5d47292f08 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:53.561975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de683f4b-b2f1-441d-8ac9-1a5d47292f08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:53.565306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-de683f4b-b2f1-441d-8ac9-1a5d47292f08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:53.612161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de683f4b-b2f1-441d-8ac9-1a5d47292f08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:53.614258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de683f4b-b2f1-441d-8ac9-1a5d47292f08 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:53.632861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-41a9f8e6-a3cd-4ebb-9691-d7fb30be6257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f66c93bce570418caef2ef672dbe114c', 'request_id': 'req-41a9f8e6-a3cd-4ebb-9691-d7fb30be6257'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:53.647366 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2629/5185] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:25:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:25:53.669386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-41a9f8e6-a3cd-4ebb-9691-d7fb30be6257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f66c93bce570418caef2ef672dbe114c', 'request_id': 'req-41a9f8e6-a3cd-4ebb-9691-d7fb30be6257'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:53.680714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-41a9f8e6-a3cd-4ebb-9691-d7fb30be6257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f66c93bce570418caef2ef672dbe114c', 'request_id': 'req-41a9f8e6-a3cd-4ebb-9691-d7fb30be6257'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:53.774707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:53.822270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-41a9f8e6-a3cd-4ebb-9691-d7fb30be6257 admin admin] The token cache is being invalidate because project f66c93bce570418caef2ef672dbe114c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:25:53.822728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-41a9f8e6-a3cd-4ebb-9691-d7fb30be6257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:53.824088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-41a9f8e6-a3cd-4ebb-9691-d7fb30be6257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:53.826887 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2557/5186] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:25:53 2022] DELETE /identity/v3/projects/f66c93bce570418caef2ef672dbe114c => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:25:53.832889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa2ffb-144b-4fc8-a544-527b495551a3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:53.833182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa2ffb-144b-4fc8-a544-527b495551a3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:53.834358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa2ffb-144b-4fc8-a544-527b495551a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:53.885425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c9fa2ffb-144b-4fc8-a544-527b495551a3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:53.886908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c9fa2ffb-144b-4fc8-a544-527b495551a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:53.995458 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2630/5187] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:53.996613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3e159-046d-4482-84bc-e543db830585 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:53.996912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3e159-046d-4482-84bc-e543db830585 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:53.997199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3e159-046d-4482-84bc-e543db830585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:54.083689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-35b3e159-046d-4482-84bc-e543db830585 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:54.086928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-35b3e159-046d-4482-84bc-e543db830585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:54.113316 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2558/5188] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:54.117277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa2ffb-144b-4fc8-a544-527b495551a3 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:54.133015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa2ffb-144b-4fc8-a544-527b495551a3 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:54.138463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120836d6-cb70-4d62-a351-712dabec3947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:54.139190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120836d6-cb70-4d62-a351-712dabec3947 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:54.139480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120836d6-cb70-4d62-a351-712dabec3947 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:54.139754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120836d6-cb70-4d62-a351-712dabec3947 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:54.140771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120836d6-cb70-4d62-a351-712dabec3947 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:25:54.141396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120836d6-cb70-4d62-a351-712dabec3947 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:54.143115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120836d6-cb70-4d62-a351-712dabec3947 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:54.172014 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2631/5189] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:25:54.175847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3e159-046d-4482-84bc-e543db830585 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:54.196858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3e159-046d-4482-84bc-e543db830585 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:54.227438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90df626-2c82-415d-94ac-454f924340cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:54.228292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90df626-2c82-415d-94ac-454f924340cb admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:54.229139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90df626-2c82-415d-94ac-454f924340cb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:54.231042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90df626-2c82-415d-94ac-454f924340cb admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:54.231877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90df626-2c82-415d-94ac-454f924340cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:54.236126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90df626-2c82-415d-94ac-454f924340cb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:54.381408 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2559/5190] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:25:54 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:25:54.386279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120836d6-cb70-4d62-a351-712dabec3947 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:54.400882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120836d6-cb70-4d62-a351-712dabec3947 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:54.530560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc69423-d3b0-4ad6-bd31-cf8ddf1663e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:54.531300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc69423-d3b0-4ad6-bd31-cf8ddf1663e2 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:54.531586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc69423-d3b0-4ad6-bd31-cf8ddf1663e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:54.531871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc69423-d3b0-4ad6-bd31-cf8ddf1663e2 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:54.532630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc69423-d3b0-4ad6-bd31-cf8ddf1663e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:54.534747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc69423-d3b0-4ad6-bd31-cf8ddf1663e2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:54.679370 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2632/5191] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:25:54 2022] POST /identity/v3/users => generated 293 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:25:54.689938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:54.695086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90df626-2c82-415d-94ac-454f924340cb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:54.705972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90df626-2c82-415d-94ac-454f924340cb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:54.717125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99525b0e-8b53-4eb2-9c7f-59d0e5e78213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:54.719167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99525b0e-8b53-4eb2-9c7f-59d0e5e78213 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:54.720252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99525b0e-8b53-4eb2-9c7f-59d0e5e78213 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:54.720777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99525b0e-8b53-4eb2-9c7f-59d0e5e78213 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:54.722429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99525b0e-8b53-4eb2-9c7f-59d0e5e78213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:54.725239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99525b0e-8b53-4eb2-9c7f-59d0e5e78213 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:54.755572 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2560/5192] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:25:54.758019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:54.759774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc69423-d3b0-4ad6-bd31-cf8ddf1663e2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:54.775748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc69423-d3b0-4ad6-bd31-cf8ddf1663e2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:54.790412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc96729-7fac-4616-bc85-efc01117f226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:54.791259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc96729-7fac-4616-bc85-efc01117f226 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:54.791776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc96729-7fac-4616-bc85-efc01117f226 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:54.792322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc96729-7fac-4616-bc85-efc01117f226 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:54.793251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc96729-7fac-4616-bc85-efc01117f226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:54.797180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc96729-7fac-4616-bc85-efc01117f226 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:54.820668 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2633/5193] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:25:54.821680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99525b0e-8b53-4eb2-9c7f-59d0e5e78213 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:54.836466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99525b0e-8b53-4eb2-9c7f-59d0e5e78213 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:54.841870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecb647-7dfa-4d8c-85dd-9064081cb34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:54.843030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecb647-7dfa-4d8c-85dd-9064081cb34d admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:54.843515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecb647-7dfa-4d8c-85dd-9064081cb34d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:54.844086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecb647-7dfa-4d8c-85dd-9064081cb34d admin admin] PATH_INFO: `/v3/projects/6a474b59057843bb9fb2b2fdf97b3a74/users/558d62904e9e4d67ac4cd7a27736f108/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:54.861101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecb647-7dfa-4d8c-85dd-9064081cb34d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a474b59057843bb9fb2b2fdf97b3a74, user_id=558d62904e9e4d67ac4cd7a27736f108, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:54.866389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecb647-7dfa-4d8c-85dd-9064081cb34d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:54.974543 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2561/5194] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:25:54 2022] PUT /identity/v3/projects/6a474b59057843bb9fb2b2fdf97b3a74/users/558d62904e9e4d67ac4cd7a27736f108/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:25:54.992746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7ddd0-bf17-4193-bc1d-87b0decb2d44 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:54.995285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7ddd0-bf17-4193-bc1d-87b0decb2d44 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:54.995700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7ddd0-bf17-4193-bc1d-87b0decb2d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:55.044089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-16d7ddd0-bf17-4193-bc1d-87b0decb2d44 None None] MFA Rules not processed for user `558d62904e9e4d67ac4cd7a27736f108`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:55.045763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-16d7ddd0-bf17-4193-bc1d-87b0decb2d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:55.081232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:55.191127 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2634/5195] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:55.196889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecb647-7dfa-4d8c-85dd-9064081cb34d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:55.294102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecb647-7dfa-4d8c-85dd-9064081cb34d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:55.307556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c88a04-d61b-473f-89fc-4fce5eb90096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:55.308688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c88a04-d61b-473f-89fc-4fce5eb90096 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:55.309130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c88a04-d61b-473f-89fc-4fce5eb90096 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:55.309661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c88a04-d61b-473f-89fc-4fce5eb90096 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:55.310511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c88a04-d61b-473f-89fc-4fce5eb90096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:55.312862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c88a04-d61b-473f-89fc-4fce5eb90096 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:55.459616 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2562/5196] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:25:55 2022] POST /identity/v3/projects => generated 387 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:25:55.464637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7ddd0-bf17-4193-bc1d-87b0decb2d44 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:55.508203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7ddd0-bf17-4193-bc1d-87b0decb2d44 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:55.622520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864fcba-7722-4208-9f3a-970ceea7bbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:55.623345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864fcba-7722-4208-9f3a-970ceea7bbff admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:55.623697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864fcba-7722-4208-9f3a-970ceea7bbff admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:55.624121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864fcba-7722-4208-9f3a-970ceea7bbff admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:55.624889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864fcba-7722-4208-9f3a-970ceea7bbff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:55.626984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864fcba-7722-4208-9f3a-970ceea7bbff admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:55.732431 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2635/5197] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:25:55 2022] POST /identity/v3/users => generated 300 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:25:55.736025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c88a04-d61b-473f-89fc-4fce5eb90096 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:55.758584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c88a04-d61b-473f-89fc-4fce5eb90096 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:55.769888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0243bb2-913f-4989-85a6-228ac9704483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:55.770983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0243bb2-913f-4989-85a6-228ac9704483 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:55.772223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0243bb2-913f-4989-85a6-228ac9704483 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:55.773013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0243bb2-913f-4989-85a6-228ac9704483 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:55.774044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0243bb2-913f-4989-85a6-228ac9704483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:55.777847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0243bb2-913f-4989-85a6-228ac9704483 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:55.799117 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2563/5198] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:25:55.803912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864fcba-7722-4208-9f3a-970ceea7bbff admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:55.834541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864fcba-7722-4208-9f3a-970ceea7bbff admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:55.866385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452b002-16cf-4ebb-954a-97f4a548bfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:55.866385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452b002-16cf-4ebb-954a-97f4a548bfd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:55.866385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452b002-16cf-4ebb-954a-97f4a548bfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:55.866385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452b002-16cf-4ebb-954a-97f4a548bfd3 admin admin] PATH_INFO: `/v3/projects/14f5450ce23a4d0fac89bdc19e4d9e00/users/0c5b8cb6922d429fa261038473b1893f/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:55.888095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:55.904373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452b002-16cf-4ebb-954a-97f4a548bfd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f5450ce23a4d0fac89bdc19e4d9e00, user_id=0c5b8cb6922d429fa261038473b1893f, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:55.908168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452b002-16cf-4ebb-954a-97f4a548bfd3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:56.299783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:56.306919 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2636/5199] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:25:55 2022] PUT /identity/v3/projects/14f5450ce23a4d0fac89bdc19e4d9e00/users/0c5b8cb6922d429fa261038473b1893f/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:56.311224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0243bb2-913f-4989-85a6-228ac9704483 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:56.322939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0243bb2-913f-4989-85a6-228ac9704483 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:56.482028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f83c6a-69a2-4920-acd7-c361dea5a9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:56.482028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f83c6a-69a2-4920-acd7-c361dea5a9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:56.482028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f83c6a-69a2-4920-acd7-c361dea5a9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:56.482028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f83c6a-69a2-4920-acd7-c361dea5a9d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:56.483062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f83c6a-69a2-4920-acd7-c361dea5a9d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:56.489363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f83c6a-69a2-4920-acd7-c361dea5a9d3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:56.532505 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2564/5200] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:25:56.533729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452b002-16cf-4ebb-954a-97f4a548bfd3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:56.554234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452b002-16cf-4ebb-954a-97f4a548bfd3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:56.571961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894d058-64e1-4ec2-ab3d-39874d582a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:56.575178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894d058-64e1-4ec2-ab3d-39874d582a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:56.575178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894d058-64e1-4ec2-ab3d-39874d582a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:56.575178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894d058-64e1-4ec2-ab3d-39874d582a7b admin admin] PATH_INFO: `/v3/projects/14f5450ce23a4d0fac89bdc19e4d9e00/users/0c5b8cb6922d429fa261038473b1893f/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:56.582480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894d058-64e1-4ec2-ab3d-39874d582a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f5450ce23a4d0fac89bdc19e4d9e00, user_id=0c5b8cb6922d429fa261038473b1893f, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:56.594625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894d058-64e1-4ec2-ab3d-39874d582a7b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:56.635155 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2637/5201] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:25:56 2022] PUT /identity/v3/projects/14f5450ce23a4d0fac89bdc19e4d9e00/users/0c5b8cb6922d429fa261038473b1893f/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:56.645914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098c8f7-1e90-481c-b208-c3729a2c8bfa None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:56.647060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098c8f7-1e90-481c-b208-c3729a2c8bfa None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:56.647574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098c8f7-1e90-481c-b208-c3729a2c8bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:56.704482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9098c8f7-1e90-481c-b208-c3729a2c8bfa None None] MFA Rules not processed for user `0c5b8cb6922d429fa261038473b1893f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:56.705924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9098c8f7-1e90-481c-b208-c3729a2c8bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:56.871126 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2565/5202] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:56.883450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894d058-64e1-4ec2-ab3d-39874d582a7b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:56.886891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7894d058-64e1-4ec2-ab3d-39874d582a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:57.068770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894d058-64e1-4ec2-ab3d-39874d582a7b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:57.072519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbaf0a4-9504-454e-b795-73e70ff6b866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:57.073183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbaf0a4-9504-454e-b795-73e70ff6b866 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:57.073467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbaf0a4-9504-454e-b795-73e70ff6b866 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:57.073766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbaf0a4-9504-454e-b795-73e70ff6b866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:57.087819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbaf0a4-9504-454e-b795-73e70ff6b866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:57.089299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbaf0a4-9504-454e-b795-73e70ff6b866 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:57.101786 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2638/5203] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:25:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:25:57.957738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:25:58.748783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098c8f7-1e90-481c-b208-c3729a2c8bfa None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:58.903277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098c8f7-1e90-481c-b208-c3729a2c8bfa None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:58.908363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496611c-ced6-4e5b-ac45-4d3c5562f896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:58.909263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496611c-ced6-4e5b-ac45-4d3c5562f896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:58.914435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496611c-ced6-4e5b-ac45-4d3c5562f896 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:58.914435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496611c-ced6-4e5b-ac45-4d3c5562f896 admin admin] PATH_INFO: `/v3/users/558d62904e9e4d67ac4cd7a27736f108` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:58.914435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496611c-ced6-4e5b-ac45-4d3c5562f896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=558d62904e9e4d67ac4cd7a27736f108)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:58.914435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496611c-ced6-4e5b-ac45-4d3c5562f896 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:59.218018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f496611c-ced6-4e5b-ac45-4d3c5562f896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '558d62904e9e4d67ac4cd7a27736f108'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:59.232601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f496611c-ced6-4e5b-ac45-4d3c5562f896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '558d62904e9e4d67ac4cd7a27736f108'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:59.294092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f496611c-ced6-4e5b-ac45-4d3c5562f896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '558d62904e9e4d67ac4cd7a27736f108'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:59.303363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f496611c-ced6-4e5b-ac45-4d3c5562f896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '558d62904e9e4d67ac4cd7a27736f108'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:59.304532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f496611c-ced6-4e5b-ac45-4d3c5562f896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '558d62904e9e4d67ac4cd7a27736f108'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:25:59.312857 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2566/5204] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:25:58 2022] DELETE /identity/v3/users/558d62904e9e4d67ac4cd7a27736f108 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:25:59.319240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345c356-9bb9-4ff8-ae6b-3e621953b44a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:59.323822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345c356-9bb9-4ff8-ae6b-3e621953b44a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:59.323822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345c356-9bb9-4ff8-ae6b-3e621953b44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:59.342776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7345c356-9bb9-4ff8-ae6b-3e621953b44a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:59.344474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7345c356-9bb9-4ff8-ae6b-3e621953b44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:59.431365 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2639/5205] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:59.439275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496611c-ced6-4e5b-ac45-4d3c5562f896 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:59.440984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f496611c-ced6-4e5b-ac45-4d3c5562f896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:59.534531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496611c-ced6-4e5b-ac45-4d3c5562f896 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:59.540154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ee28d-9065-4267-aad3-52d3ffd469de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:59.545171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee28d-9065-4267-aad3-52d3ffd469de service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:59.545171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee28d-9065-4267-aad3-52d3ffd469de service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:59.545171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee28d-9065-4267-aad3-52d3ffd469de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:59.566862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ee28d-9065-4267-aad3-52d3ffd469de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:59.569770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ee28d-9065-4267-aad3-52d3ffd469de service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:59.595297 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2567/5206] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:25:59.611177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50cada-73f5-41fe-bc26-04b21d6b3566 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:59.611720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50cada-73f5-41fe-bc26-04b21d6b3566 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:59.612231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50cada-73f5-41fe-bc26-04b21d6b3566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:59.633619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2b50cada-73f5-41fe-bc26-04b21d6b3566 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:25:59.635897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2b50cada-73f5-41fe-bc26-04b21d6b3566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:59.719490 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2640/5207] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:25:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:25:59.740650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ee28d-9065-4267-aad3-52d3ffd469de service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:25:59.740650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-756ee28d-9065-4267-aad3-52d3ffd469de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:25:59.880796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ee28d-9065-4267-aad3-52d3ffd469de service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:25:59.887968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdab8e-1bab-4aef-8dec-b88647e46793 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:25:59.889686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdab8e-1bab-4aef-8dec-b88647e46793 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:25:59.890864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdab8e-1bab-4aef-8dec-b88647e46793 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:25:59.891376 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdab8e-1bab-4aef-8dec-b88647e46793 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:25:59.904241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdab8e-1bab-4aef-8dec-b88647e46793 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:25:59.904461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdab8e-1bab-4aef-8dec-b88647e46793 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:25:59.915644 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2568/5208] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:25:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:26:00.145977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50cada-73f5-41fe-bc26-04b21d6b3566 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:00.148380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2b50cada-73f5-41fe-bc26-04b21d6b3566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:00.163237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50cada-73f5-41fe-bc26-04b21d6b3566 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:00.179864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983ea0d-5501-4be4-8447-6b59994ebe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:00.180772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983ea0d-5501-4be4-8447-6b59994ebe17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:00.181053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983ea0d-5501-4be4-8447-6b59994ebe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:00.181355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983ea0d-5501-4be4-8447-6b59994ebe17 admin admin] PATH_INFO: `/v3/projects/6a474b59057843bb9fb2b2fdf97b3a74` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:00.182639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983ea0d-5501-4be4-8447-6b59994ebe17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a474b59057843bb9fb2b2fdf97b3a74)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:00.184804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983ea0d-5501-4be4-8447-6b59994ebe17 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:00.244579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdab8e-1bab-4aef-8dec-b88647e46793 service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:00.246054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ddbdab8e-1bab-4aef-8dec-b88647e46793 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:00.326100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdab8e-1bab-4aef-8dec-b88647e46793 service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:00.331602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fef87-0f86-4c35-b05c-cedb9d1138ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:00.332249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fef87-0f86-4c35-b05c-cedb9d1138ec service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:00.332528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fef87-0f86-4c35-b05c-cedb9d1138ec service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:00.332841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fef87-0f86-4c35-b05c-cedb9d1138ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:00.334772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ff8fef87-0f86-4c35-b05c-cedb9d1138ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:00.342002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:00.356776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4983ea0d-5501-4be4-8447-6b59994ebe17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a474b59057843bb9fb2b2fdf97b3a74', 'request_id': 'req-4983ea0d-5501-4be4-8447-6b59994ebe17'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:00.363267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4983ea0d-5501-4be4-8447-6b59994ebe17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a474b59057843bb9fb2b2fdf97b3a74', 'request_id': 'req-4983ea0d-5501-4be4-8447-6b59994ebe17'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:00.370363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:00.375237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4983ea0d-5501-4be4-8447-6b59994ebe17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a474b59057843bb9fb2b2fdf97b3a74', 'request_id': 'req-4983ea0d-5501-4be4-8447-6b59994ebe17'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:00.400334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fef87-0f86-4c35-b05c-cedb9d1138ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:00.401949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fef87-0f86-4c35-b05c-cedb9d1138ec service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:00.412262 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2569/5209] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:26:00.481708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4983ea0d-5501-4be4-8447-6b59994ebe17 admin admin] The token cache is being invalidate because project 6a474b59057843bb9fb2b2fdf97b3a74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:00.482263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4983ea0d-5501-4be4-8447-6b59994ebe17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:00.483362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4983ea0d-5501-4be4-8447-6b59994ebe17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:00.485422 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2641/5210] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:00 2022] DELETE /identity/v3/projects/6a474b59057843bb9fb2b2fdf97b3a74 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:00.489286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fef87-0f86-4c35-b05c-cedb9d1138ec service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:00.502456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fef87-0f86-4c35-b05c-cedb9d1138ec service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:00.561118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81767a90-0428-4c9a-a7ef-1619eac9d312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:00.561997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81767a90-0428-4c9a-a7ef-1619eac9d312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:00.562279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81767a90-0428-4c9a-a7ef-1619eac9d312 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:00.562555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81767a90-0428-4c9a-a7ef-1619eac9d312 admin admin] PATH_INFO: `/v3/users/0c5b8cb6922d429fa261038473b1893f` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:00.563879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81767a90-0428-4c9a-a7ef-1619eac9d312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5b8cb6922d429fa261038473b1893f)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:00.565865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81767a90-0428-4c9a-a7ef-1619eac9d312 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:00.833736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-81767a90-0428-4c9a-a7ef-1619eac9d312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5b8cb6922d429fa261038473b1893f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:00.846265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-81767a90-0428-4c9a-a7ef-1619eac9d312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5b8cb6922d429fa261038473b1893f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:00.978282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-81767a90-0428-4c9a-a7ef-1619eac9d312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5b8cb6922d429fa261038473b1893f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:00.986086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-81767a90-0428-4c9a-a7ef-1619eac9d312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5b8cb6922d429fa261038473b1893f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:00.986766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-81767a90-0428-4c9a-a7ef-1619eac9d312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5b8cb6922d429fa261038473b1893f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:00.993770 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2570/5211] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:26:00 2022] DELETE /identity/v3/users/0c5b8cb6922d429fa261038473b1893f => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:01.600259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983ea0d-5501-4be4-8447-6b59994ebe17 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:01.603853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4983ea0d-5501-4be4-8447-6b59994ebe17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:01.621601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983ea0d-5501-4be4-8447-6b59994ebe17 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:01.688397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913f730-f5cd-4eb2-8215-fc1dcaf8d8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:01.689288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913f730-f5cd-4eb2-8215-fc1dcaf8d8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:01.689567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913f730-f5cd-4eb2-8215-fc1dcaf8d8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:01.689840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913f730-f5cd-4eb2-8215-fc1dcaf8d8f1 admin admin] PATH_INFO: `/v3/projects/14f5450ce23a4d0fac89bdc19e4d9e00` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:01.691629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913f730-f5cd-4eb2-8215-fc1dcaf8d8f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14f5450ce23a4d0fac89bdc19e4d9e00)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:01.693965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913f730-f5cd-4eb2-8215-fc1dcaf8d8f1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:01.796333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3913f730-f5cd-4eb2-8215-fc1dcaf8d8f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14f5450ce23a4d0fac89bdc19e4d9e00', 'request_id': 'req-3913f730-f5cd-4eb2-8215-fc1dcaf8d8f1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:01.802898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3913f730-f5cd-4eb2-8215-fc1dcaf8d8f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14f5450ce23a4d0fac89bdc19e4d9e00', 'request_id': 'req-3913f730-f5cd-4eb2-8215-fc1dcaf8d8f1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:01.810369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3913f730-f5cd-4eb2-8215-fc1dcaf8d8f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14f5450ce23a4d0fac89bdc19e4d9e00', 'request_id': 'req-3913f730-f5cd-4eb2-8215-fc1dcaf8d8f1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:01.869847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:01.874110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3913f730-f5cd-4eb2-8215-fc1dcaf8d8f1 admin admin] The token cache is being invalidate because project 14f5450ce23a4d0fac89bdc19e4d9e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:01.874669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3913f730-f5cd-4eb2-8215-fc1dcaf8d8f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:01.875589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3913f730-f5cd-4eb2-8215-fc1dcaf8d8f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:01.877695 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2642/5212] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:01 2022] DELETE /identity/v3/projects/14f5450ce23a4d0fac89bdc19e4d9e00 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:01.882926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c60ac-94a7-40b9-910c-295f04347e6a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:01.883466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c60ac-94a7-40b9-910c-295f04347e6a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:01.883879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c60ac-94a7-40b9-910c-295f04347e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:01.903488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-de2c60ac-94a7-40b9-910c-295f04347e6a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:01.904700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-de2c60ac-94a7-40b9-910c-295f04347e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:01.970827 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2571/5213] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:26:01.979664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988435c7-7254-4f39-8466-3154dea08241 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:01.979957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988435c7-7254-4f39-8466-3154dea08241 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:01.980242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988435c7-7254-4f39-8466-3154dea08241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:01.999478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-988435c7-7254-4f39-8466-3154dea08241 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:02.001012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-988435c7-7254-4f39-8466-3154dea08241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:02.009427 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2643/5214] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:02.013784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c60ac-94a7-40b9-910c-295f04347e6a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:02.026136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c60ac-94a7-40b9-910c-295f04347e6a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:02.031072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9fbc8-c304-421e-8854-cf62e2ca3526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:02.031744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9fbc8-c304-421e-8854-cf62e2ca3526 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:02.032027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9fbc8-c304-421e-8854-cf62e2ca3526 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:02.032302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9fbc8-c304-421e-8854-cf62e2ca3526 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:02.033035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9fbc8-c304-421e-8854-cf62e2ca3526 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:26:02.033366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9fbc8-c304-421e-8854-cf62e2ca3526 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:02.035051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9fbc8-c304-421e-8854-cf62e2ca3526 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:02.048014 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2572/5215] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:26:02.057298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988435c7-7254-4f39-8466-3154dea08241 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:02.062856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988435c7-7254-4f39-8466-3154dea08241 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:02.067472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69a4a0-9754-4077-bdf0-801953d223ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:02.068735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69a4a0-9754-4077-bdf0-801953d223ee admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:02.069144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69a4a0-9754-4077-bdf0-801953d223ee admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:02.069440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69a4a0-9754-4077-bdf0-801953d223ee admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:02.070129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69a4a0-9754-4077-bdf0-801953d223ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:02.072141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69a4a0-9754-4077-bdf0-801953d223ee admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:02.179299 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2644/5216] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:02 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:02.183404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9fbc8-c304-421e-8854-cf62e2ca3526 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:02.194078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9fbc8-c304-421e-8854-cf62e2ca3526 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:02.265775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274f473-446f-4045-9272-8d549f7d63b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:02.266622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274f473-446f-4045-9272-8d549f7d63b8 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:02.266969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274f473-446f-4045-9272-8d549f7d63b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:02.267463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274f473-446f-4045-9272-8d549f7d63b8 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:02.268319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274f473-446f-4045-9272-8d549f7d63b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:02.270600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274f473-446f-4045-9272-8d549f7d63b8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:02.322428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69a4a0-9754-4077-bdf0-801953d223ee admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:02.324874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9e69a4a0-9754-4077-bdf0-801953d223ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:02.380500 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2573/5217] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:26:02 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:02.383514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274f473-446f-4045-9272-8d549f7d63b8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:02.393035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:02.420404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274f473-446f-4045-9272-8d549f7d63b8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:02.426293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd9fd9-0bec-4767-ba30-640d51f54091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:02.435032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd9fd9-0bec-4767-ba30-640d51f54091 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:02.435032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd9fd9-0bec-4767-ba30-640d51f54091 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:02.435032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd9fd9-0bec-4767-ba30-640d51f54091 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:02.435032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd9fd9-0bec-4767-ba30-640d51f54091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:02.435032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd9fd9-0bec-4767-ba30-640d51f54091 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:02.437040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69a4a0-9754-4077-bdf0-801953d223ee admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:02.453011 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2574/5218] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:02.455058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd9fd9-0bec-4767-ba30-640d51f54091 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:02.468031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd9fd9-0bec-4767-ba30-640d51f54091 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:02.473008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2688dc-2d9c-4ff3-9a3d-747de6356c95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:02.473217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac41877-44b5-432d-b6cd-d9a00a51d441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:02.473857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2688dc-2d9c-4ff3-9a3d-747de6356c95 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:02.474553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac41877-44b5-432d-b6cd-d9a00a51d441 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:02.474702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2688dc-2d9c-4ff3-9a3d-747de6356c95 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:02.475125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac41877-44b5-432d-b6cd-d9a00a51d441 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:02.475267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2688dc-2d9c-4ff3-9a3d-747de6356c95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:02.475412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac41877-44b5-432d-b6cd-d9a00a51d441 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:02.476372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac41877-44b5-432d-b6cd-d9a00a51d441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:02.478504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac41877-44b5-432d-b6cd-d9a00a51d441 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:02.483034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bf2688dc-2d9c-4ff3-9a3d-747de6356c95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:02.495407 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2575/5219] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:26:02.499139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac41877-44b5-432d-b6cd-d9a00a51d441 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:02.512532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac41877-44b5-432d-b6cd-d9a00a51d441 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:02.514781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2688dc-2d9c-4ff3-9a3d-747de6356c95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:02.519466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ba3ab-c698-4d8a-878e-883f4c30e631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:02.520012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2688dc-2d9c-4ff3-9a3d-747de6356c95 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:02.524368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ba3ab-c698-4d8a-878e-883f4c30e631 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:02.524368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ba3ab-c698-4d8a-878e-883f4c30e631 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:02.524368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ba3ab-c698-4d8a-878e-883f4c30e631 admin admin] PATH_INFO: `/v3/projects/9e352d74c8674c3789b1b5ea8c25a2b7/users/a1c3c91a8eed4871a9c74ba0485d08ec/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:02.542203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ba3ab-c698-4d8a-878e-883f4c30e631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e352d74c8674c3789b1b5ea8c25a2b7, user_id=a1c3c91a8eed4871a9c74ba0485d08ec, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:02.545994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ba3ab-c698-4d8a-878e-883f4c30e631 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:02.555286 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2645/5220] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:26:02.716998 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2576/5221] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:26:02 2022] PUT /identity/v3/projects/9e352d74c8674c3789b1b5ea8c25a2b7/users/a1c3c91a8eed4871a9c74ba0485d08ec/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:02.729388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cf600-4cc1-4551-bf6c-7ef66e37ac93 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:02.729998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cf600-4cc1-4551-bf6c-7ef66e37ac93 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:02.729998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cf600-4cc1-4551-bf6c-7ef66e37ac93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:02.813826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-778cf600-4cc1-4551-bf6c-7ef66e37ac93 None None] MFA Rules not processed for user `a1c3c91a8eed4871a9c74ba0485d08ec`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:02.815915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-778cf600-4cc1-4551-bf6c-7ef66e37ac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:03.250311 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2646/5222] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:03.251585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ba3ab-c698-4d8a-878e-883f4c30e631 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:03.251585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ba3ab-c698-4d8a-878e-883f4c30e631 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:03.251585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb006e3-591f-4b25-aa19-aa94ec23b565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:03.251585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb006e3-591f-4b25-aa19-aa94ec23b565 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:03.252605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb006e3-591f-4b25-aa19-aa94ec23b565 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:03.252605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb006e3-591f-4b25-aa19-aa94ec23b565 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:03.252605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb006e3-591f-4b25-aa19-aa94ec23b565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:03.252605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb006e3-591f-4b25-aa19-aa94ec23b565 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:03.329734 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2577/5223] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:03 2022] POST /identity/v3/projects => generated 373 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:26:03.334616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cf600-4cc1-4551-bf6c-7ef66e37ac93 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:03.353059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cf600-4cc1-4551-bf6c-7ef66e37ac93 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:03.423148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50b55d-b798-46d1-a557-af34f2c9a396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:03.423840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50b55d-b798-46d1-a557-af34f2c9a396 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:03.424204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50b55d-b798-46d1-a557-af34f2c9a396 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:03.424463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50b55d-b798-46d1-a557-af34f2c9a396 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:03.425304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50b55d-b798-46d1-a557-af34f2c9a396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:03.427639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50b55d-b798-46d1-a557-af34f2c9a396 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:03.513643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb006e3-591f-4b25-aa19-aa94ec23b565 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:03.515646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-edb006e3-591f-4b25-aa19-aa94ec23b565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:03.544954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb006e3-591f-4b25-aa19-aa94ec23b565 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:03.550128 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2647/5224] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:26:03 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:03.553847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50b55d-b798-46d1-a557-af34f2c9a396 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:03.554411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212aa5aa-b688-46e1-ae13-0e2226ecab3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:03.555656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aa5aa-b688-46e1-ae13-0e2226ecab3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:03.556044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aa5aa-b688-46e1-ae13-0e2226ecab3d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:03.556595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aa5aa-b688-46e1-ae13-0e2226ecab3d admin admin] PATH_INFO: `/v3/users/2e1a1216c7544596b090ce9644e35290` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:03.558197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aa5aa-b688-46e1-ae13-0e2226ecab3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e1a1216c7544596b090ce9644e35290)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:03.561541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aa5aa-b688-46e1-ae13-0e2226ecab3d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:03.566734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50b55d-b798-46d1-a557-af34f2c9a396 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:03.580416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adbb41-2495-419a-a650-e10268aa3f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:03.581221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adbb41-2495-419a-a650-e10268aa3f8d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:03.584306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adbb41-2495-419a-a650-e10268aa3f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:03.584306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adbb41-2495-419a-a650-e10268aa3f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:03.584306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adbb41-2495-419a-a650-e10268aa3f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:03.585328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adbb41-2495-419a-a650-e10268aa3f8d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:03.599104 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2648/5225] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:26:03.616947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adbb41-2495-419a-a650-e10268aa3f8d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:03.642146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adbb41-2495-419a-a650-e10268aa3f8d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:03.647591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17a482-dc82-4716-bd33-017bdf1beaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:03.648881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17a482-dc82-4716-bd33-017bdf1beaaa admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:03.649274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17a482-dc82-4716-bd33-017bdf1beaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:03.649609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17a482-dc82-4716-bd33-017bdf1beaaa admin admin] PATH_INFO: `/v3/projects/c67f6e8e3cec4bf8804e5e7fe0a886d7/users/33efafd262e84948acb81891cfeccf5f/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:03.678642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17a482-dc82-4716-bd33-017bdf1beaaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67f6e8e3cec4bf8804e5e7fe0a886d7, user_id=33efafd262e84948acb81891cfeccf5f, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:03.683143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17a482-dc82-4716-bd33-017bdf1beaaa admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:03.791256 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2649/5226] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:26:03 2022] PUT /identity/v3/projects/c67f6e8e3cec4bf8804e5e7fe0a886d7/users/33efafd262e84948acb81891cfeccf5f/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:03.795287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17a482-dc82-4716-bd33-017bdf1beaaa admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:03.818750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-212aa5aa-b688-46e1-ae13-0e2226ecab3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e1a1216c7544596b090ce9644e35290'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:03.864257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-212aa5aa-b688-46e1-ae13-0e2226ecab3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e1a1216c7544596b090ce9644e35290'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:03.917512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17a482-dc82-4716-bd33-017bdf1beaaa admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:03.922873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98a198-7d0c-4015-9606-9679a6fe0c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:03.924018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98a198-7d0c-4015-9606-9679a6fe0c0e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:03.924302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98a198-7d0c-4015-9606-9679a6fe0c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:03.924577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98a198-7d0c-4015-9606-9679a6fe0c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:03.925298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98a198-7d0c-4015-9606-9679a6fe0c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:03.926961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98a198-7d0c-4015-9606-9679a6fe0c0e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:03.942254 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2650/5227] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:03.944028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98a198-7d0c-4015-9606-9679a6fe0c0e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:03.955711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98a198-7d0c-4015-9606-9679a6fe0c0e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:03.961236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64fb3a-0008-47a7-b156-8ff8b075f670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:03.962222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64fb3a-0008-47a7-b156-8ff8b075f670 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:03.962574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64fb3a-0008-47a7-b156-8ff8b075f670 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:03.962860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64fb3a-0008-47a7-b156-8ff8b075f670 admin admin] PATH_INFO: `/v3/projects/c67f6e8e3cec4bf8804e5e7fe0a886d7/users/33efafd262e84948acb81891cfeccf5f/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:03.965569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64fb3a-0008-47a7-b156-8ff8b075f670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67f6e8e3cec4bf8804e5e7fe0a886d7, user_id=33efafd262e84948acb81891cfeccf5f, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:03.969054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64fb3a-0008-47a7-b156-8ff8b075f670 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:03.978962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-212aa5aa-b688-46e1-ae13-0e2226ecab3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e1a1216c7544596b090ce9644e35290'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:03.987041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-212aa5aa-b688-46e1-ae13-0e2226ecab3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e1a1216c7544596b090ce9644e35290'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:03.988553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-212aa5aa-b688-46e1-ae13-0e2226ecab3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e1a1216c7544596b090ce9644e35290'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:03.990844 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2651/5228] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:26:03 2022] PUT /identity/v3/projects/c67f6e8e3cec4bf8804e5e7fe0a886d7/users/33efafd262e84948acb81891cfeccf5f/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:04.001268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43571aad-015e-4e7c-a277-64d653c2b910 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:04.001566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43571aad-015e-4e7c-a277-64d653c2b910 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:04.001855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43571aad-015e-4e7c-a277-64d653c2b910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:04.020675 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2578/5229] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:26:03 2022] DELETE /identity/v3/users/2e1a1216c7544596b090ce9644e35290 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:04.021740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150d0ea-61e2-4678-97ff-26b74aa92932 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:04.022341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150d0ea-61e2-4678-97ff-26b74aa92932 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:04.022685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150d0ea-61e2-4678-97ff-26b74aa92932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:04.043960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-43571aad-015e-4e7c-a277-64d653c2b910 None None] MFA Rules not processed for user `33efafd262e84948acb81891cfeccf5f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:04.045278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-43571aad-015e-4e7c-a277-64d653c2b910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:04.055415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c150d0ea-61e2-4678-97ff-26b74aa92932 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:04.058055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c150d0ea-61e2-4678-97ff-26b74aa92932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:04.087634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:04.148799 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2652/5230] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:26:04.157288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43571aad-015e-4e7c-a277-64d653c2b910 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:04.158696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-43571aad-015e-4e7c-a277-64d653c2b910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:04.164633 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2579/5231] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:26:04.175658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150d0ea-61e2-4678-97ff-26b74aa92932 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:04.180646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c150d0ea-61e2-4678-97ff-26b74aa92932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:04.226105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43571aad-015e-4e7c-a277-64d653c2b910 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:04.231333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04946ef6-d46b-499e-9389-205b15a7ed67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:04.231999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04946ef6-d46b-499e-9389-205b15a7ed67 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:04.232281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04946ef6-d46b-499e-9389-205b15a7ed67 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:04.232558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04946ef6-d46b-499e-9389-205b15a7ed67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:04.234847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-04946ef6-d46b-499e-9389-205b15a7ed67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:04.297548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150d0ea-61e2-4678-97ff-26b74aa92932 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:04.301797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095b1f7-a441-407b-a982-175c6f6eacf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:04.302897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095b1f7-a441-407b-a982-175c6f6eacf9 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:04.303235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095b1f7-a441-407b-a982-175c6f6eacf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:04.303541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095b1f7-a441-407b-a982-175c6f6eacf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:04.314953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095b1f7-a441-407b-a982-175c6f6eacf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:04.316587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095b1f7-a441-407b-a982-175c6f6eacf9 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:04.324862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04946ef6-d46b-499e-9389-205b15a7ed67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:04.328693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04946ef6-d46b-499e-9389-205b15a7ed67 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:04.329736 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2580/5232] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:26:04.352363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:04.355288 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2653/5233] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:26:04.840104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095b1f7-a441-407b-a982-175c6f6eacf9 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:04.841613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1095b1f7-a441-407b-a982-175c6f6eacf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:04.871239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095b1f7-a441-407b-a982-175c6f6eacf9 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:04.882366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75dd80-fd77-48e4-b716-d41b31a5d3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:04.883520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75dd80-fd77-48e4-b716-d41b31a5d3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:04.884405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75dd80-fd77-48e4-b716-d41b31a5d3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:04.884702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75dd80-fd77-48e4-b716-d41b31a5d3f7 admin admin] PATH_INFO: `/v3/projects/bbcf15429e7f4b638f3b61e1c8f9244b` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:04.886109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75dd80-fd77-48e4-b716-d41b31a5d3f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbcf15429e7f4b638f3b61e1c8f9244b)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:04.888142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75dd80-fd77-48e4-b716-d41b31a5d3f7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:05.027572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8c75dd80-fd77-48e4-b716-d41b31a5d3f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbcf15429e7f4b638f3b61e1c8f9244b', 'request_id': 'req-8c75dd80-fd77-48e4-b716-d41b31a5d3f7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:05.037677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8c75dd80-fd77-48e4-b716-d41b31a5d3f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbcf15429e7f4b638f3b61e1c8f9244b', 'request_id': 'req-8c75dd80-fd77-48e4-b716-d41b31a5d3f7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:05.045135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8c75dd80-fd77-48e4-b716-d41b31a5d3f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbcf15429e7f4b638f3b61e1c8f9244b', 'request_id': 'req-8c75dd80-fd77-48e4-b716-d41b31a5d3f7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:05.158367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8c75dd80-fd77-48e4-b716-d41b31a5d3f7 admin admin] The token cache is being invalidate because project bbcf15429e7f4b638f3b61e1c8f9244b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:05.159438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8c75dd80-fd77-48e4-b716-d41b31a5d3f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:05.160149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8c75dd80-fd77-48e4-b716-d41b31a5d3f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:05.166713 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2581/5234] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:04 2022] DELETE /identity/v3/projects/bbcf15429e7f4b638f3b61e1c8f9244b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:05.170629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04946ef6-d46b-499e-9389-205b15a7ed67 service cinder] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:05.186969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04946ef6-d46b-499e-9389-205b15a7ed67 service cinder] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:05.275161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795a5b6-92c0-4189-a637-0058b6889c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:05.276184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795a5b6-92c0-4189-a637-0058b6889c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:05.276543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795a5b6-92c0-4189-a637-0058b6889c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:05.276945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795a5b6-92c0-4189-a637-0058b6889c97 admin admin] PATH_INFO: `/v3/users/ac74b5e888b644bdba7825d42d5ac20c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:05.278632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795a5b6-92c0-4189-a637-0058b6889c97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac74b5e888b644bdba7825d42d5ac20c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:05.280626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795a5b6-92c0-4189-a637-0058b6889c97 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:05.514869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1795a5b6-92c0-4189-a637-0058b6889c97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac74b5e888b644bdba7825d42d5ac20c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:05.523746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1795a5b6-92c0-4189-a637-0058b6889c97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac74b5e888b644bdba7825d42d5ac20c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:05.602022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1795a5b6-92c0-4189-a637-0058b6889c97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac74b5e888b644bdba7825d42d5ac20c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:05.603163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1795a5b6-92c0-4189-a637-0058b6889c97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac74b5e888b644bdba7825d42d5ac20c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:05.622447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1795a5b6-92c0-4189-a637-0058b6889c97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac74b5e888b644bdba7825d42d5ac20c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:05.640582 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2654/5235] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:26:05 2022] DELETE /identity/v3/users/ac74b5e888b644bdba7825d42d5ac20c => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:05.683757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:06.031129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:06.318103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75dd80-fd77-48e4-b716-d41b31a5d3f7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:06.319508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8c75dd80-fd77-48e4-b716-d41b31a5d3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:06.334470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75dd80-fd77-48e4-b716-d41b31a5d3f7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:06.422605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdce25-1746-4c2b-90c4-c29412de3da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:06.424460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdce25-1746-4c2b-90c4-c29412de3da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:06.424888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdce25-1746-4c2b-90c4-c29412de3da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:06.425303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdce25-1746-4c2b-90c4-c29412de3da9 admin admin] PATH_INFO: `/v3/projects/119a1ab47c114440b2a8b749c006a135` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:06.426914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdce25-1746-4c2b-90c4-c29412de3da9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=119a1ab47c114440b2a8b749c006a135)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:06.432893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdce25-1746-4c2b-90c4-c29412de3da9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:06.553280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7bcdce25-1746-4c2b-90c4-c29412de3da9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '119a1ab47c114440b2a8b749c006a135', 'request_id': 'req-7bcdce25-1746-4c2b-90c4-c29412de3da9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:06.558800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7bcdce25-1746-4c2b-90c4-c29412de3da9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '119a1ab47c114440b2a8b749c006a135', 'request_id': 'req-7bcdce25-1746-4c2b-90c4-c29412de3da9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:06.565581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7bcdce25-1746-4c2b-90c4-c29412de3da9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '119a1ab47c114440b2a8b749c006a135', 'request_id': 'req-7bcdce25-1746-4c2b-90c4-c29412de3da9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:06.761599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7bcdce25-1746-4c2b-90c4-c29412de3da9 admin admin] The token cache is being invalidate because project 119a1ab47c114440b2a8b749c006a135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:06.761957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7bcdce25-1746-4c2b-90c4-c29412de3da9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:06.762614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7bcdce25-1746-4c2b-90c4-c29412de3da9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:06.764552 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2582/5236] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:06 2022] DELETE /identity/v3/projects/119a1ab47c114440b2a8b749c006a135 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:06.769814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912495c7-a3e2-4d70-966d-f1137a8f2b56 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:06.770291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912495c7-a3e2-4d70-966d-f1137a8f2b56 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:06.770462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912495c7-a3e2-4d70-966d-f1137a8f2b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:06.801524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-912495c7-a3e2-4d70-966d-f1137a8f2b56 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:06.801524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-912495c7-a3e2-4d70-966d-f1137a8f2b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:06.870245 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2655/5237] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:26:06.878148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eae87f-0f3a-4921-be15-44b8b588104d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:06.878546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eae87f-0f3a-4921-be15-44b8b588104d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:06.878904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eae87f-0f3a-4921-be15-44b8b588104d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:06.903514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d0eae87f-0f3a-4921-be15-44b8b588104d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:06.904983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d0eae87f-0f3a-4921-be15-44b8b588104d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:06.914094 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2583/5238] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:06.918662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912495c7-a3e2-4d70-966d-f1137a8f2b56 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:06.929128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912495c7-a3e2-4d70-966d-f1137a8f2b56 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:06.934079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d865c-4c2d-4532-a99c-50813b22162f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:06.934728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d865c-4c2d-4532-a99c-50813b22162f admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:06.935035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d865c-4c2d-4532-a99c-50813b22162f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:06.935320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d865c-4c2d-4532-a99c-50813b22162f admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:06.936049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d865c-4c2d-4532-a99c-50813b22162f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:26:06.936356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d865c-4c2d-4532-a99c-50813b22162f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:06.938006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d865c-4c2d-4532-a99c-50813b22162f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:06.950768 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2656/5239] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:26:06.955293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eae87f-0f3a-4921-be15-44b8b588104d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:06.966015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eae87f-0f3a-4921-be15-44b8b588104d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:06.970923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3709b-eaa3-44b8-a158-0d39a0a2906e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:06.971684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3709b-eaa3-44b8-a158-0d39a0a2906e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:06.972017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3709b-eaa3-44b8-a158-0d39a0a2906e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:06.972243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3709b-eaa3-44b8-a158-0d39a0a2906e admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:06.976828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3709b-eaa3-44b8-a158-0d39a0a2906e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:06.976931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:06.977016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3709b-eaa3-44b8-a158-0d39a0a2906e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:07.063227 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2584/5240] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:06 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:07.069148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d865c-4c2d-4532-a99c-50813b22162f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:07.081582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d865c-4c2d-4532-a99c-50813b22162f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:07.157875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8703c-611d-4439-b13d-4df566c15d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:07.159162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8703c-611d-4439-b13d-4df566c15d8e admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:07.159614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8703c-611d-4439-b13d-4df566c15d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:07.160053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8703c-611d-4439-b13d-4df566c15d8e admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:07.160898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8703c-611d-4439-b13d-4df566c15d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:07.163554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8703c-611d-4439-b13d-4df566c15d8e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:07.260773 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2657/5241] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:26:07 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:07.266260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3709b-eaa3-44b8-a158-0d39a0a2906e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:07.276641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3709b-eaa3-44b8-a158-0d39a0a2906e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:07.281889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793305a-eb76-4b32-94ed-dee6d655ca02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:07.282582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793305a-eb76-4b32-94ed-dee6d655ca02 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:07.283061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793305a-eb76-4b32-94ed-dee6d655ca02 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:07.283349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793305a-eb76-4b32-94ed-dee6d655ca02 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:07.284142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793305a-eb76-4b32-94ed-dee6d655ca02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:07.286100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793305a-eb76-4b32-94ed-dee6d655ca02 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:07.297301 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2585/5242] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:07.301542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8703c-611d-4439-b13d-4df566c15d8e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:07.312807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8703c-611d-4439-b13d-4df566c15d8e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:07.319426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b43145-e4f0-4bb7-b78c-b76d607140cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:07.320301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b43145-e4f0-4bb7-b78c-b76d607140cc admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:07.320696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b43145-e4f0-4bb7-b78c-b76d607140cc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:07.321362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b43145-e4f0-4bb7-b78c-b76d607140cc admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:07.322052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b43145-e4f0-4bb7-b78c-b76d607140cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:07.323764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b43145-e4f0-4bb7-b78c-b76d607140cc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:07.338988 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2658/5243] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:26:07.339947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793305a-eb76-4b32-94ed-dee6d655ca02 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:07.351697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793305a-eb76-4b32-94ed-dee6d655ca02 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:07.366002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4372d7-f4b3-43ca-9f06-664d32f0d010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:07.367181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4372d7-f4b3-43ca-9f06-664d32f0d010 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:07.367651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4372d7-f4b3-43ca-9f06-664d32f0d010 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:07.368092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4372d7-f4b3-43ca-9f06-664d32f0d010 admin admin] PATH_INFO: `/v3/projects/6912df7db283434e96ed3ed6e0eac567/users/fa5edfa78c194c9b99843be4536cfe79/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:07.382599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:07.389115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4372d7-f4b3-43ca-9f06-664d32f0d010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6912df7db283434e96ed3ed6e0eac567, user_id=fa5edfa78c194c9b99843be4536cfe79, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:07.391896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4372d7-f4b3-43ca-9f06-664d32f0d010 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:07.494365 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2586/5244] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:26:07 2022] PUT /identity/v3/projects/6912df7db283434e96ed3ed6e0eac567/users/fa5edfa78c194c9b99843be4536cfe79/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:07.504426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55af31-1425-414d-8931-00d4f19c89bd None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:07.504742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55af31-1425-414d-8931-00d4f19c89bd None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:07.505077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55af31-1425-414d-8931-00d4f19c89bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:07.539717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2e55af31-1425-414d-8931-00d4f19c89bd None None] MFA Rules not processed for user `fa5edfa78c194c9b99843be4536cfe79`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:07.540957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2e55af31-1425-414d-8931-00d4f19c89bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:07.618894 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2659/5245] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:26:07.620298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4372d7-f4b3-43ca-9f06-664d32f0d010 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:07.774708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4372d7-f4b3-43ca-9f06-664d32f0d010 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:07.779793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47646138-a18a-4907-a0aa-85bb1c616124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:07.780620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47646138-a18a-4907-a0aa-85bb1c616124 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:07.780904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47646138-a18a-4907-a0aa-85bb1c616124 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:07.785050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47646138-a18a-4907-a0aa-85bb1c616124 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:07.785050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47646138-a18a-4907-a0aa-85bb1c616124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:07.785050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47646138-a18a-4907-a0aa-85bb1c616124 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:07.822027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55af31-1425-414d-8931-00d4f19c89bd None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:07.823497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2e55af31-1425-414d-8931-00d4f19c89bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:07.850041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55af31-1425-414d-8931-00d4f19c89bd None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:07.856274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dba80c-c723-452b-88cb-d0b14f8dcb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:07.857364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dba80c-c723-452b-88cb-d0b14f8dcb5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:07.857915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dba80c-c723-452b-88cb-d0b14f8dcb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:07.858265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dba80c-c723-452b-88cb-d0b14f8dcb5d admin admin] PATH_INFO: `/v3/users/3b0b46c0c1f74adaaaf65d46db7b2618` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:07.873228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dba80c-c723-452b-88cb-d0b14f8dcb5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b0b46c0c1f74adaaaf65d46db7b2618)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:07.876333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dba80c-c723-452b-88cb-d0b14f8dcb5d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:07.887142 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2587/5246] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:07 2022] POST /identity/v3/projects => generated 383 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:07.889466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47646138-a18a-4907-a0aa-85bb1c616124 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:07.971614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47646138-a18a-4907-a0aa-85bb1c616124 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:07.984118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dd91b-2e9c-4224-8c54-fdc2a61c323e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:07.984862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dd91b-2e9c-4224-8c54-fdc2a61c323e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:07.985151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dd91b-2e9c-4224-8c54-fdc2a61c323e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:07.985508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dd91b-2e9c-4224-8c54-fdc2a61c323e admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:07.986212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dd91b-2e9c-4224-8c54-fdc2a61c323e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:07.988567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dd91b-2e9c-4224-8c54-fdc2a61c323e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:08.055949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16dba80c-c723-452b-88cb-d0b14f8dcb5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b0b46c0c1f74adaaaf65d46db7b2618'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:08.077469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16dba80c-c723-452b-88cb-d0b14f8dcb5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b0b46c0c1f74adaaaf65d46db7b2618'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:08.189273 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2588/5247] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:26:07 2022] POST /identity/v3/users => generated 298 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:26:08.190399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dd91b-2e9c-4224-8c54-fdc2a61c323e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:08.201804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dd91b-2e9c-4224-8c54-fdc2a61c323e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:08.207366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a391f4-6b77-4133-aeb9-1d7c7122d18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:08.208991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a391f4-6b77-4133-aeb9-1d7c7122d18e admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:08.209330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a391f4-6b77-4133-aeb9-1d7c7122d18e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:08.209688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a391f4-6b77-4133-aeb9-1d7c7122d18e admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:08.210598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a391f4-6b77-4133-aeb9-1d7c7122d18e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:08.214005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a391f4-6b77-4133-aeb9-1d7c7122d18e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:08.219377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16dba80c-c723-452b-88cb-d0b14f8dcb5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b0b46c0c1f74adaaaf65d46db7b2618'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:08.221389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16dba80c-c723-452b-88cb-d0b14f8dcb5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b0b46c0c1f74adaaaf65d46db7b2618'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:08.250909 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2589/5248] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:26:08.252107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a391f4-6b77-4133-aeb9-1d7c7122d18e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:08.253335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16dba80c-c723-452b-88cb-d0b14f8dcb5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b0b46c0c1f74adaaaf65d46db7b2618'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:08.268530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b0a391f4-6b77-4133-aeb9-1d7c7122d18e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:08.276043 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2660/5249] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:26:07 2022] DELETE /identity/v3/users/3b0b46c0c1f74adaaaf65d46db7b2618 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:08.281526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7bbf9-c372-42bc-84e1-a187431a4d36 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:08.282147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7bbf9-c372-42bc-84e1-a187431a4d36 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:08.282885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7bbf9-c372-42bc-84e1-a187431a4d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:08.288310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a391f4-6b77-4133-aeb9-1d7c7122d18e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:08.344057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f1f7bbf9-c372-42bc-84e1-a187431a4d36 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:08.347127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f1f7bbf9-c372-42bc-84e1-a187431a4d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:08.412284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acdf14-37dd-4a0f-a4c3-e6a302c75be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:08.413211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acdf14-37dd-4a0f-a4c3-e6a302c75be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:08.413496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acdf14-37dd-4a0f-a4c3-e6a302c75be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:08.413865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acdf14-37dd-4a0f-a4c3-e6a302c75be1 admin admin] PATH_INFO: `/v3/projects/8f92a7b5cfef4da8a45bc153ad033484/users/0f204d383bf54d5f854549daad491cdc/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:08.456396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10acdf14-37dd-4a0f-a4c3-e6a302c75be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f92a7b5cfef4da8a45bc153ad033484, user_id=0f204d383bf54d5f854549daad491cdc, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:08.459299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10acdf14-37dd-4a0f-a4c3-e6a302c75be1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:08.507056 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2661/5250] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:08.519472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7bbf9-c372-42bc-84e1-a187431a4d36 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:08.523296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f1f7bbf9-c372-42bc-84e1-a187431a4d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:08.618545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7bbf9-c372-42bc-84e1-a187431a4d36 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:08.626639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4050a-c9be-4b7f-93d8-9658bc19d157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:08.627971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4050a-c9be-4b7f-93d8-9658bc19d157 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:08.628584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4050a-c9be-4b7f-93d8-9658bc19d157 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:08.629004 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4050a-c9be-4b7f-93d8-9658bc19d157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:08.656024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4050a-c9be-4b7f-93d8-9658bc19d157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:08.657539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4050a-c9be-4b7f-93d8-9658bc19d157 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:08.663575 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2590/5251] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:26:08 2022] PUT /identity/v3/projects/8f92a7b5cfef4da8a45bc153ad033484/users/0f204d383bf54d5f854549daad491cdc/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:08.664876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acdf14-37dd-4a0f-a4c3-e6a302c75be1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:08.686190 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2662/5252] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:26:08.815188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acdf14-37dd-4a0f-a4c3-e6a302c75be1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:08.824162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa70a46-9b84-48c3-a9c5-0e96378a0adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:08.825012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa70a46-9b84-48c3-a9c5-0e96378a0adf admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:08.825431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa70a46-9b84-48c3-a9c5-0e96378a0adf admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:08.825961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa70a46-9b84-48c3-a9c5-0e96378a0adf admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:08.836986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa70a46-9b84-48c3-a9c5-0e96378a0adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:08.836986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa70a46-9b84-48c3-a9c5-0e96378a0adf admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:08.843566 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2591/5253] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:08.848079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4050a-c9be-4b7f-93d8-9658bc19d157 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:08.863822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4050a-c9be-4b7f-93d8-9658bc19d157 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:08.883861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd090a05-c1ac-4385-9bb3-f0dab6c5b03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:08.884589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd090a05-c1ac-4385-9bb3-f0dab6c5b03b admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:08.885088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd090a05-c1ac-4385-9bb3-f0dab6c5b03b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:08.885462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd090a05-c1ac-4385-9bb3-f0dab6c5b03b admin admin] PATH_INFO: `/v3/projects/8f92a7b5cfef4da8a45bc153ad033484/users/0f204d383bf54d5f854549daad491cdc/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:08.891318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd090a05-c1ac-4385-9bb3-f0dab6c5b03b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f92a7b5cfef4da8a45bc153ad033484, user_id=0f204d383bf54d5f854549daad491cdc, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:08.891318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd090a05-c1ac-4385-9bb3-f0dab6c5b03b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:08.917908 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2663/5254] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:26:08 2022] PUT /identity/v3/projects/8f92a7b5cfef4da8a45bc153ad033484/users/0f204d383bf54d5f854549daad491cdc/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:26:08.928427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d2300-0958-4591-a189-9f724e739b38 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:08.928734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d2300-0958-4591-a189-9f724e739b38 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:08.929019 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d2300-0958-4591-a189-9f724e739b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:08.968464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ba4d2300-0958-4591-a189-9f724e739b38 None None] MFA Rules not processed for user `0f204d383bf54d5f854549daad491cdc`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:08.969996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ba4d2300-0958-4591-a189-9f724e739b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:09.068163 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2592/5255] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:09.084958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd090a05-c1ac-4385-9bb3-f0dab6c5b03b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:09.091486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cd090a05-c1ac-4385-9bb3-f0dab6c5b03b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:09.098998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d2300-0958-4591-a189-9f724e739b38 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:09.105449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ba4d2300-0958-4591-a189-9f724e739b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:09.179102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:09.247156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d2300-0958-4591-a189-9f724e739b38 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:09.253157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41767b4b-e5ed-41d0-9506-130c19f013a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:09.255571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41767b4b-e5ed-41d0-9506-130c19f013a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:09.255858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41767b4b-e5ed-41d0-9506-130c19f013a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:09.256137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41767b4b-e5ed-41d0-9506-130c19f013a1 admin admin] PATH_INFO: `/v3/projects/336b3ef8a8744bf3b86854b32000bda6` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:09.258328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41767b4b-e5ed-41d0-9506-130c19f013a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=336b3ef8a8744bf3b86854b32000bda6)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:09.260336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41767b4b-e5ed-41d0-9506-130c19f013a1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:09.268646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd090a05-c1ac-4385-9bb3-f0dab6c5b03b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:09.275380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd084245-c1bc-45a5-9ac3-578075910514 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:09.276623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd084245-c1bc-45a5-9ac3-578075910514 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:09.277481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd084245-c1bc-45a5-9ac3-578075910514 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:09.278105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd084245-c1bc-45a5-9ac3-578075910514 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:09.299453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd084245-c1bc-45a5-9ac3-578075910514 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:09.301169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd084245-c1bc-45a5-9ac3-578075910514 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:09.329504 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2664/5256] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:26:09.367665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:09.395335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-41767b4b-e5ed-41d0-9506-130c19f013a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '336b3ef8a8744bf3b86854b32000bda6', 'request_id': 'req-41767b4b-e5ed-41d0-9506-130c19f013a1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:09.407717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-41767b4b-e5ed-41d0-9506-130c19f013a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '336b3ef8a8744bf3b86854b32000bda6', 'request_id': 'req-41767b4b-e5ed-41d0-9506-130c19f013a1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:09.418233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-41767b4b-e5ed-41d0-9506-130c19f013a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '336b3ef8a8744bf3b86854b32000bda6', 'request_id': 'req-41767b4b-e5ed-41d0-9506-130c19f013a1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:09.531973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-41767b4b-e5ed-41d0-9506-130c19f013a1 admin admin] The token cache is being invalidate because project 336b3ef8a8744bf3b86854b32000bda6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:09.533128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-41767b4b-e5ed-41d0-9506-130c19f013a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:09.534172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-41767b4b-e5ed-41d0-9506-130c19f013a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:09.537386 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2593/5257] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:09 2022] DELETE /identity/v3/projects/336b3ef8a8744bf3b86854b32000bda6 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:09.543942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12e441-35aa-45b2-95b3-8c5c726df600 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:09.544230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12e441-35aa-45b2-95b3-8c5c726df600 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:09.544989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12e441-35aa-45b2-95b3-8c5c726df600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:09.551759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41767b4b-e5ed-41d0-9506-130c19f013a1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:09.560273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-41767b4b-e5ed-41d0-9506-130c19f013a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:09.580046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ca12e441-35aa-45b2-95b3-8c5c726df600 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:09.582325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ca12e441-35aa-45b2-95b3-8c5c726df600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:09.670093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41767b4b-e5ed-41d0-9506-130c19f013a1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:09.675737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef57bf-1096-453c-8946-d195c171ecdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:09.676431 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2665/5258] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:09.679864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef57bf-1096-453c-8946-d195c171ecdf service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:09.680158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef57bf-1096-453c-8946-d195c171ecdf service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:09.685755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef57bf-1096-453c-8946-d195c171ecdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:09.685755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7aef57bf-1096-453c-8946-d195c171ecdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:09.686311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275195-70ee-4647-8864-95b31eef39a7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:09.686887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275195-70ee-4647-8864-95b31eef39a7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:09.687361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275195-70ee-4647-8864-95b31eef39a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:09.716700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-28275195-70ee-4647-8864-95b31eef39a7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:09.718079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-28275195-70ee-4647-8864-95b31eef39a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:09.731125 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2666/5259] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:26:09.735287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28275195-70ee-4647-8864-95b31eef39a7 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:09.748299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28275195-70ee-4647-8864-95b31eef39a7 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:09.753935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d73da-48fb-4cbb-a5a9-0631fd0940ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:09.755683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d73da-48fb-4cbb-a5a9-0631fd0940ce admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:09.756016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d73da-48fb-4cbb-a5a9-0631fd0940ce admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:09.756296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d73da-48fb-4cbb-a5a9-0631fd0940ce admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:09.757110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d73da-48fb-4cbb-a5a9-0631fd0940ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:26:09.757424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d73da-48fb-4cbb-a5a9-0631fd0940ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:09.759167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d73da-48fb-4cbb-a5a9-0631fd0940ce admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:09.768975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef57bf-1096-453c-8946-d195c171ecdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:09.772136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef57bf-1096-453c-8946-d195c171ecdf service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:09.776823 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2667/5260] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:26:09.782407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d73da-48fb-4cbb-a5a9-0631fd0940ce admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:09.785902 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2594/5261] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:26:09.804060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d73da-48fb-4cbb-a5a9-0631fd0940ce admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:09.816055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ed1fd-17f5-4d87-8e0d-6068956982ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:09.816774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ed1fd-17f5-4d87-8e0d-6068956982ca admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:09.817064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ed1fd-17f5-4d87-8e0d-6068956982ca admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:09.817347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ed1fd-17f5-4d87-8e0d-6068956982ca admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:09.821693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ed1fd-17f5-4d87-8e0d-6068956982ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:09.821693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ed1fd-17f5-4d87-8e0d-6068956982ca admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:09.991685 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2668/5262] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:09 2022] POST /identity/v3/projects => generated 397 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:26:09.996419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef57bf-1096-453c-8946-d195c171ecdf service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:10.020138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef57bf-1096-453c-8946-d195c171ecdf service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:10.112522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e49df3-83c6-4e3c-9673-a73a6caf403e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:10.113456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e49df3-83c6-4e3c-9673-a73a6caf403e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:10.114066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e49df3-83c6-4e3c-9673-a73a6caf403e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:10.115444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e49df3-83c6-4e3c-9673-a73a6caf403e admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:10.116661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e49df3-83c6-4e3c-9673-a73a6caf403e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:10.119563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e49df3-83c6-4e3c-9673-a73a6caf403e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:10.231339 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2595/5263] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:26:09 2022] POST /identity/v3/users => generated 299 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:10.236611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ed1fd-17f5-4d87-8e0d-6068956982ca admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:10.248095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ed1fd-17f5-4d87-8e0d-6068956982ca admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:10.253193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865f549-e2e9-481c-84ec-639bd4d3334a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:10.253499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865f549-e2e9-481c-84ec-639bd4d3334a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:10.253777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865f549-e2e9-481c-84ec-639bd4d3334a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:10.254052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865f549-e2e9-481c-84ec-639bd4d3334a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:10.254770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865f549-e2e9-481c-84ec-639bd4d3334a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:10.257188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865f549-e2e9-481c-84ec-639bd4d3334a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:10.268178 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2669/5264] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:10.271855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e49df3-83c6-4e3c-9673-a73a6caf403e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:10.283804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e49df3-83c6-4e3c-9673-a73a6caf403e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:10.289873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37071f-f3fc-4fb3-8e1d-609304a275ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:10.290545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37071f-f3fc-4fb3-8e1d-609304a275ad admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:10.290857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37071f-f3fc-4fb3-8e1d-609304a275ad admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:10.291359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37071f-f3fc-4fb3-8e1d-609304a275ad admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:10.292095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37071f-f3fc-4fb3-8e1d-609304a275ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:10.293830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37071f-f3fc-4fb3-8e1d-609304a275ad admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:10.306975 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2596/5265] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:26:10.311538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865f549-e2e9-481c-84ec-639bd4d3334a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:10.322563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865f549-e2e9-481c-84ec-639bd4d3334a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:10.327421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3368d-7057-4b30-b85f-fb9aa731d635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:10.328304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3368d-7057-4b30-b85f-fb9aa731d635 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:10.328584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3368d-7057-4b30-b85f-fb9aa731d635 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:10.328859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3368d-7057-4b30-b85f-fb9aa731d635 admin admin] PATH_INFO: `/v3/projects/8f2736abb6094c1f83a7aa3efc772506/users/1963f7b0ee0244b2b4f5fc1d8b34f858/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:10.345093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3368d-7057-4b30-b85f-fb9aa731d635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f2736abb6094c1f83a7aa3efc772506, user_id=1963f7b0ee0244b2b4f5fc1d8b34f858, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:10.347891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3368d-7057-4b30-b85f-fb9aa731d635 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:10.424298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37071f-f3fc-4fb3-8e1d-609304a275ad admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:10.425712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cc37071f-f3fc-4fb3-8e1d-609304a275ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:10.440686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37071f-f3fc-4fb3-8e1d-609304a275ad admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:10.446368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466eb416-60d6-4a3b-a261-f3be888d8ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:10.447287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466eb416-60d6-4a3b-a261-f3be888d8ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:10.447569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466eb416-60d6-4a3b-a261-f3be888d8ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:10.447844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466eb416-60d6-4a3b-a261-f3be888d8ccf admin admin] PATH_INFO: `/v3/users/fa5edfa78c194c9b99843be4536cfe79` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:10.449461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466eb416-60d6-4a3b-a261-f3be888d8ccf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa5edfa78c194c9b99843be4536cfe79)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:10.456646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466eb416-60d6-4a3b-a261-f3be888d8ccf admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:10.459748 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2670/5266] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:26:10 2022] PUT /identity/v3/projects/8f2736abb6094c1f83a7aa3efc772506/users/1963f7b0ee0244b2b4f5fc1d8b34f858/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:10.465526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4a7f6-0a99-41ff-94c9-543f4dd117e8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:10.465526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4a7f6-0a99-41ff-94c9-543f4dd117e8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:10.465526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4a7f6-0a99-41ff-94c9-543f4dd117e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:10.484167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6ab4a7f6-0a99-41ff-94c9-543f4dd117e8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:10.485531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6ab4a7f6-0a99-41ff-94c9-543f4dd117e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:10.547372 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2671/5267] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:26:10.557330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4a7f6-0a99-41ff-94c9-543f4dd117e8 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:10.558690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6ab4a7f6-0a99-41ff-94c9-543f4dd117e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:10.619391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4a7f6-0a99-41ff-94c9-543f4dd117e8 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:10.623138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b00656-dab7-463c-abe8-4f8eab070aa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:10.623786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b00656-dab7-463c-abe8-4f8eab070aa2 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:10.624065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b00656-dab7-463c-abe8-4f8eab070aa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:10.624526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b00656-dab7-463c-abe8-4f8eab070aa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:10.635751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b00656-dab7-463c-abe8-4f8eab070aa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:10.637235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b00656-dab7-463c-abe8-4f8eab070aa2 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:10.648879 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2672/5268] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:26:10.650670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-466eb416-60d6-4a3b-a261-f3be888d8ccf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa5edfa78c194c9b99843be4536cfe79'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:10.671641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-466eb416-60d6-4a3b-a261-f3be888d8ccf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa5edfa78c194c9b99843be4536cfe79'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:10.750438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-466eb416-60d6-4a3b-a261-f3be888d8ccf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa5edfa78c194c9b99843be4536cfe79'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:10.759592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-466eb416-60d6-4a3b-a261-f3be888d8ccf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa5edfa78c194c9b99843be4536cfe79'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:10.760458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-466eb416-60d6-4a3b-a261-f3be888d8ccf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa5edfa78c194c9b99843be4536cfe79'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:10.767586 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2597/5269] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:26:10 2022] DELETE /identity/v3/users/fa5edfa78c194c9b99843be4536cfe79 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:26:10.772658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd69f08-a002-44f9-9c94-c669f4ea2b00 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:10.773176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd69f08-a002-44f9-9c94-c669f4ea2b00 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:10.773450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd69f08-a002-44f9-9c94-c669f4ea2b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:10.792986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1fd69f08-a002-44f9-9c94-c669f4ea2b00 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:10.794288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1fd69f08-a002-44f9-9c94-c669f4ea2b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:10.875196 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2673/5270] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:26:10.886427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466eb416-60d6-4a3b-a261-f3be888d8ccf admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:10.888666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-466eb416-60d6-4a3b-a261-f3be888d8ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:10.962981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466eb416-60d6-4a3b-a261-f3be888d8ccf admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:10.966596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1944f-40fc-46df-86c2-57b27d731e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:10.967276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1944f-40fc-46df-86c2-57b27d731e4a service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:10.967543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1944f-40fc-46df-86c2-57b27d731e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:10.967818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1944f-40fc-46df-86c2-57b27d731e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:10.978363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1944f-40fc-46df-86c2-57b27d731e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:10.979907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1944f-40fc-46df-86c2-57b27d731e4a service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:10.993210 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2598/5271] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:26:11.012691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:11.386563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:11.534121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd69f08-a002-44f9-9c94-c669f4ea2b00 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:11.535678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1fd69f08-a002-44f9-9c94-c669f4ea2b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:11.555459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd69f08-a002-44f9-9c94-c669f4ea2b00 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:11.560631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a6cf8-fcab-4c72-bd1f-1c5f284eeca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:11.564116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a6cf8-fcab-4c72-bd1f-1c5f284eeca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:11.564116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a6cf8-fcab-4c72-bd1f-1c5f284eeca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:11.564116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a6cf8-fcab-4c72-bd1f-1c5f284eeca2 admin admin] PATH_INFO: `/v3/projects/6912df7db283434e96ed3ed6e0eac567` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:11.564116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a6cf8-fcab-4c72-bd1f-1c5f284eeca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6912df7db283434e96ed3ed6e0eac567)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:11.565674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a6cf8-fcab-4c72-bd1f-1c5f284eeca2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:11.803931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e94a6cf8-fcab-4c72-bd1f-1c5f284eeca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6912df7db283434e96ed3ed6e0eac567', 'request_id': 'req-e94a6cf8-fcab-4c72-bd1f-1c5f284eeca2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:11.811103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e94a6cf8-fcab-4c72-bd1f-1c5f284eeca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6912df7db283434e96ed3ed6e0eac567', 'request_id': 'req-e94a6cf8-fcab-4c72-bd1f-1c5f284eeca2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:11.817087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e94a6cf8-fcab-4c72-bd1f-1c5f284eeca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6912df7db283434e96ed3ed6e0eac567', 'request_id': 'req-e94a6cf8-fcab-4c72-bd1f-1c5f284eeca2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:11.919849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e94a6cf8-fcab-4c72-bd1f-1c5f284eeca2 admin admin] The token cache is being invalidate because project 6912df7db283434e96ed3ed6e0eac567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:11.920137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e94a6cf8-fcab-4c72-bd1f-1c5f284eeca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:11.920757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e94a6cf8-fcab-4c72-bd1f-1c5f284eeca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:11.922326 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2674/5272] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:11 2022] DELETE /identity/v3/projects/6912df7db283434e96ed3ed6e0eac567 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:11.926492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1944f-40fc-46df-86c2-57b27d731e4a service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:11.939580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1944f-40fc-46df-86c2-57b27d731e4a service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:12.022993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d07f4-2fd5-4712-9ad1-504908d992f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:12.023908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d07f4-2fd5-4712-9ad1-504908d992f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:12.024192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d07f4-2fd5-4712-9ad1-504908d992f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:12.024469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d07f4-2fd5-4712-9ad1-504908d992f1 admin admin] PATH_INFO: `/v3/users/0f204d383bf54d5f854549daad491cdc` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:12.025676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d07f4-2fd5-4712-9ad1-504908d992f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f204d383bf54d5f854549daad491cdc)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:12.027728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d07f4-2fd5-4712-9ad1-504908d992f1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:12.238726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-277d07f4-2fd5-4712-9ad1-504908d992f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f204d383bf54d5f854549daad491cdc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:12.251735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-277d07f4-2fd5-4712-9ad1-504908d992f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f204d383bf54d5f854549daad491cdc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:12.321358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-277d07f4-2fd5-4712-9ad1-504908d992f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f204d383bf54d5f854549daad491cdc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:12.330659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-277d07f4-2fd5-4712-9ad1-504908d992f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f204d383bf54d5f854549daad491cdc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:12.331488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-277d07f4-2fd5-4712-9ad1-504908d992f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f204d383bf54d5f854549daad491cdc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:12.338450 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2599/5273] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:26:11 2022] DELETE /identity/v3/users/0f204d383bf54d5f854549daad491cdc => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:12.888194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:13.061622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a6cf8-fcab-4c72-bd1f-1c5f284eeca2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:13.084317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e94a6cf8-fcab-4c72-bd1f-1c5f284eeca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:13.117525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a6cf8-fcab-4c72-bd1f-1c5f284eeca2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:13.205340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829a56e-e3c3-4c8b-b67b-d9d82fe8819b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:13.206426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829a56e-e3c3-4c8b-b67b-d9d82fe8819b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:13.206710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829a56e-e3c3-4c8b-b67b-d9d82fe8819b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:13.206983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829a56e-e3c3-4c8b-b67b-d9d82fe8819b admin admin] PATH_INFO: `/v3/projects/8f92a7b5cfef4da8a45bc153ad033484` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:13.208409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829a56e-e3c3-4c8b-b67b-d9d82fe8819b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f92a7b5cfef4da8a45bc153ad033484)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:13.210419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829a56e-e3c3-4c8b-b67b-d9d82fe8819b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:13.298659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:13.364218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0829a56e-e3c3-4c8b-b67b-d9d82fe8819b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f92a7b5cfef4da8a45bc153ad033484', 'request_id': 'req-0829a56e-e3c3-4c8b-b67b-d9d82fe8819b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:13.374422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0829a56e-e3c3-4c8b-b67b-d9d82fe8819b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f92a7b5cfef4da8a45bc153ad033484', 'request_id': 'req-0829a56e-e3c3-4c8b-b67b-d9d82fe8819b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:13.381553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0829a56e-e3c3-4c8b-b67b-d9d82fe8819b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f92a7b5cfef4da8a45bc153ad033484', 'request_id': 'req-0829a56e-e3c3-4c8b-b67b-d9d82fe8819b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:13.458837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0829a56e-e3c3-4c8b-b67b-d9d82fe8819b admin admin] The token cache is being invalidate because project 8f92a7b5cfef4da8a45bc153ad033484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:13.459177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0829a56e-e3c3-4c8b-b67b-d9d82fe8819b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:13.459833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0829a56e-e3c3-4c8b-b67b-d9d82fe8819b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:13.461628 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2675/5274] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:13 2022] DELETE /identity/v3/projects/8f92a7b5cfef4da8a45bc153ad033484 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:13.466434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe98251-8b80-4130-a2b6-07131e872eb0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:13.466721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe98251-8b80-4130-a2b6-07131e872eb0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:13.467001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe98251-8b80-4130-a2b6-07131e872eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:13.492645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-bfe98251-8b80-4130-a2b6-07131e872eb0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:13.494071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bfe98251-8b80-4130-a2b6-07131e872eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:13.559345 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2600/5275] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:26:13.568876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff3f77-a18b-47fd-99a5-541e70381c0c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:13.569168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff3f77-a18b-47fd-99a5-541e70381c0c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:13.569763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff3f77-a18b-47fd-99a5-541e70381c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:13.592141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-27ff3f77-a18b-47fd-99a5-541e70381c0c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:13.593384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-27ff3f77-a18b-47fd-99a5-541e70381c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:13.603165 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2676/5276] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:26:13.607741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe98251-8b80-4130-a2b6-07131e872eb0 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:13.621586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe98251-8b80-4130-a2b6-07131e872eb0 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:13.626642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7c9bb-79fe-4b32-a35b-69c73bf7f6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:13.627451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7c9bb-79fe-4b32-a35b-69c73bf7f6ef admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:13.627813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7c9bb-79fe-4b32-a35b-69c73bf7f6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:13.628098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7c9bb-79fe-4b32-a35b-69c73bf7f6ef admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:13.628886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7c9bb-79fe-4b32-a35b-69c73bf7f6ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:26:13.629272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7c9bb-79fe-4b32-a35b-69c73bf7f6ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:13.631236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7c9bb-79fe-4b32-a35b-69c73bf7f6ef admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:13.651238 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2601/5277] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:26:13.652269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff3f77-a18b-47fd-99a5-541e70381c0c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:13.663653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff3f77-a18b-47fd-99a5-541e70381c0c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:13.671155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9da26e-7697-4461-a10d-b2ecf7cf10a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:13.671875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9da26e-7697-4461-a10d-b2ecf7cf10a3 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:13.672194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9da26e-7697-4461-a10d-b2ecf7cf10a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:13.672585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9da26e-7697-4461-a10d-b2ecf7cf10a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:13.678090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9da26e-7697-4461-a10d-b2ecf7cf10a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:13.678090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9da26e-7697-4461-a10d-b2ecf7cf10a3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:13.827480 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2677/5278] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:13 2022] POST /identity/v3/projects => generated 359 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:13.828436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7c9bb-79fe-4b32-a35b-69c73bf7f6ef admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:13.845335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7c9bb-79fe-4b32-a35b-69c73bf7f6ef admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:13.926077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5848606-7dff-4c69-b179-a48541f3de2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:13.927610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5848606-7dff-4c69-b179-a48541f3de2a admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:13.928043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5848606-7dff-4c69-b179-a48541f3de2a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:13.928465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5848606-7dff-4c69-b179-a48541f3de2a admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:13.929350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5848606-7dff-4c69-b179-a48541f3de2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:13.931499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5848606-7dff-4c69-b179-a48541f3de2a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:14.035945 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2602/5279] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:26:13 2022] POST /identity/v3/users => generated 280 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:14.041133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9da26e-7697-4461-a10d-b2ecf7cf10a3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:14.041497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:14.077807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9da26e-7697-4461-a10d-b2ecf7cf10a3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:14.095328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9974703-0af6-4bf6-941f-caf865f90a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:14.096087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9974703-0af6-4bf6-941f-caf865f90a56 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:14.097441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9974703-0af6-4bf6-941f-caf865f90a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:14.097785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9974703-0af6-4bf6-941f-caf865f90a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:14.099897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9974703-0af6-4bf6-941f-caf865f90a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:14.103402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9974703-0af6-4bf6-941f-caf865f90a56 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:14.127063 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2678/5280] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:14.129268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5848606-7dff-4c69-b179-a48541f3de2a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:14.147062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5848606-7dff-4c69-b179-a48541f3de2a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:14.158742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fc153-c03f-4194-a0f1-42f46ea5c1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:14.160037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fc153-c03f-4194-a0f1-42f46ea5c1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:14.161461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fc153-c03f-4194-a0f1-42f46ea5c1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:14.161893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fc153-c03f-4194-a0f1-42f46ea5c1f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:14.163115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fc153-c03f-4194-a0f1-42f46ea5c1f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:14.164994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fc153-c03f-4194-a0f1-42f46ea5c1f2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:14.189984 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2603/5281] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:14.195883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9974703-0af6-4bf6-941f-caf865f90a56 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:14.210905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9974703-0af6-4bf6-941f-caf865f90a56 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:14.220984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711711e-4bc7-4898-8459-93babde79261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:14.221935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711711e-4bc7-4898-8459-93babde79261 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:14.222453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711711e-4bc7-4898-8459-93babde79261 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:14.222623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711711e-4bc7-4898-8459-93babde79261 admin admin] PATH_INFO: `/v3/projects/e85e6f4f89714e81bd798d32526e1121/users/25cc00ebce57414fbde5c57ab3d5452c/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:14.246658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711711e-4bc7-4898-8459-93babde79261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85e6f4f89714e81bd798d32526e1121, user_id=25cc00ebce57414fbde5c57ab3d5452c, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:14.249890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711711e-4bc7-4898-8459-93babde79261 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:14.361059 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2679/5282] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:26:14 2022] PUT /identity/v3/projects/e85e6f4f89714e81bd798d32526e1121/users/25cc00ebce57414fbde5c57ab3d5452c/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:14.378414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4ae2b-b89b-4ffa-90a2-ee8458963f1e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:14.378414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4ae2b-b89b-4ffa-90a2-ee8458963f1e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:14.378414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4ae2b-b89b-4ffa-90a2-ee8458963f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:14.417677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f4e4ae2b-b89b-4ffa-90a2-ee8458963f1e None None] MFA Rules not processed for user `25cc00ebce57414fbde5c57ab3d5452c`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:14.420423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f4e4ae2b-b89b-4ffa-90a2-ee8458963f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:14.447425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:14.588593 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2604/5283] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:14 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:14.632878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711711e-4bc7-4898-8459-93babde79261 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:14.635336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4711711e-4bc7-4898-8459-93babde79261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:14.720894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711711e-4bc7-4898-8459-93babde79261 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:14.725438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51865e58-10e1-43be-bf8f-ecaa2bd49af5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:14.726094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51865e58-10e1-43be-bf8f-ecaa2bd49af5 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:14.726374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51865e58-10e1-43be-bf8f-ecaa2bd49af5 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:14.726665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51865e58-10e1-43be-bf8f-ecaa2bd49af5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:14.737878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51865e58-10e1-43be-bf8f-ecaa2bd49af5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:14.739663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51865e58-10e1-43be-bf8f-ecaa2bd49af5 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:14.756696 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2680/5284] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:14 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:26:14.784363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4ae2b-b89b-4ffa-90a2-ee8458963f1e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:14.934912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4ae2b-b89b-4ffa-90a2-ee8458963f1e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:14.943563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb189df9-561c-4571-918c-cd24e383c92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:14.949328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb189df9-561c-4571-918c-cd24e383c92d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:14.949766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb189df9-561c-4571-918c-cd24e383c92d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:14.950167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb189df9-561c-4571-918c-cd24e383c92d admin admin] PATH_INFO: `/v3/users/25cc00ebce57414fbde5c57ab3d5452c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:14.953768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb189df9-561c-4571-918c-cd24e383c92d admin admin] RBAC: Authorizing `identity:delete_user(user_id=25cc00ebce57414fbde5c57ab3d5452c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:14.958779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb189df9-561c-4571-918c-cd24e383c92d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:15.194044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51865e58-10e1-43be-bf8f-ecaa2bd49af5 service cinder] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:15.195946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-51865e58-10e1-43be-bf8f-ecaa2bd49af5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:15.212079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-eb189df9-561c-4571-918c-cd24e383c92d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25cc00ebce57414fbde5c57ab3d5452c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:15.227484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51865e58-10e1-43be-bf8f-ecaa2bd49af5 service cinder] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:15.232881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-eb189df9-561c-4571-918c-cd24e383c92d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25cc00ebce57414fbde5c57ab3d5452c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:15.237586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38cd00-449c-4524-8eeb-e9a592418f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:15.237743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38cd00-449c-4524-8eeb-e9a592418f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:15.238011 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38cd00-449c-4524-8eeb-e9a592418f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:15.238289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38cd00-449c-4524-8eeb-e9a592418f5f admin admin] PATH_INFO: `/v3/users/a1c3c91a8eed4871a9c74ba0485d08ec` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:15.241495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38cd00-449c-4524-8eeb-e9a592418f5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c3c91a8eed4871a9c74ba0485d08ec)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:15.243794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38cd00-449c-4524-8eeb-e9a592418f5f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:15.344385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-eb189df9-561c-4571-918c-cd24e383c92d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25cc00ebce57414fbde5c57ab3d5452c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:15.360362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-eb189df9-561c-4571-918c-cd24e383c92d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25cc00ebce57414fbde5c57ab3d5452c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:15.362138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-eb189df9-561c-4571-918c-cd24e383c92d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25cc00ebce57414fbde5c57ab3d5452c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:15.374679 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2605/5285] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:26:14 2022] DELETE /identity/v3/users/25cc00ebce57414fbde5c57ab3d5452c => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:15.379500 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3928cd-33df-42ec-b3c8-9108267722e0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:15.384017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3928cd-33df-42ec-b3c8-9108267722e0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:15.384329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3928cd-33df-42ec-b3c8-9108267722e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:15.419664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-fe3928cd-33df-42ec-b3c8-9108267722e0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:15.419664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fe3928cd-33df-42ec-b3c8-9108267722e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:15.499581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-db38cd00-449c-4524-8eeb-e9a592418f5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c3c91a8eed4871a9c74ba0485d08ec'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:15.509311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-db38cd00-449c-4524-8eeb-e9a592418f5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c3c91a8eed4871a9c74ba0485d08ec'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:15.510184 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2606/5286] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:15.520280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3928cd-33df-42ec-b3c8-9108267722e0 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:15.522498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fe3928cd-33df-42ec-b3c8-9108267722e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:15.592765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3928cd-33df-42ec-b3c8-9108267722e0 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:15.596773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d6f86-a8a5-473e-b3bf-8c7c6f4b0f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:15.597432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d6f86-a8a5-473e-b3bf-8c7c6f4b0f49 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:15.597722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d6f86-a8a5-473e-b3bf-8c7c6f4b0f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:15.598108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d6f86-a8a5-473e-b3bf-8c7c6f4b0f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:15.612029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d6f86-a8a5-473e-b3bf-8c7c6f4b0f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:15.612936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d6f86-a8a5-473e-b3bf-8c7c6f4b0f49 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:15.626166 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2607/5287] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:26:15.687438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-db38cd00-449c-4524-8eeb-e9a592418f5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c3c91a8eed4871a9c74ba0485d08ec'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:15.688348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-db38cd00-449c-4524-8eeb-e9a592418f5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c3c91a8eed4871a9c74ba0485d08ec'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:15.705428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-db38cd00-449c-4524-8eeb-e9a592418f5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c3c91a8eed4871a9c74ba0485d08ec'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:15.713428 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2681/5288] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:26:15 2022] DELETE /identity/v3/users/a1c3c91a8eed4871a9c74ba0485d08ec => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:15.718468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c991f4c-fcd4-4124-b651-81a306d50b8a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:15.718886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c991f4c-fcd4-4124-b651-81a306d50b8a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:15.719312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c991f4c-fcd4-4124-b651-81a306d50b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:15.741624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8c991f4c-fcd4-4124-b651-81a306d50b8a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:15.743106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8c991f4c-fcd4-4124-b651-81a306d50b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:15.812206 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2608/5289] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:15.823982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38cd00-449c-4524-8eeb-e9a592418f5f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:15.825568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-db38cd00-449c-4524-8eeb-e9a592418f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:15.907669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38cd00-449c-4524-8eeb-e9a592418f5f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:15.912757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90b6e1-752e-4b22-bc77-a4451b254894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:15.913597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90b6e1-752e-4b22-bc77-a4451b254894 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:15.913922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90b6e1-752e-4b22-bc77-a4451b254894 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:15.914199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90b6e1-752e-4b22-bc77-a4451b254894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:15.926589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90b6e1-752e-4b22-bc77-a4451b254894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:15.928171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90b6e1-752e-4b22-bc77-a4451b254894 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:15.939621 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2682/5290] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:26:16.096854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:16.304561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c991f4c-fcd4-4124-b651-81a306d50b8a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:16.306284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8c991f4c-fcd4-4124-b651-81a306d50b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:16.329546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c991f4c-fcd4-4124-b651-81a306d50b8a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:16.338447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c05ab-7991-4c99-8319-bd5fd424da29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:16.339941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c05ab-7991-4c99-8319-bd5fd424da29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:16.340368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c05ab-7991-4c99-8319-bd5fd424da29 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:16.340790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c05ab-7991-4c99-8319-bd5fd424da29 admin admin] PATH_INFO: `/v3/projects/e85e6f4f89714e81bd798d32526e1121` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:16.342714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c05ab-7991-4c99-8319-bd5fd424da29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85e6f4f89714e81bd798d32526e1121)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:16.346087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c05ab-7991-4c99-8319-bd5fd424da29 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:16.534910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-878c05ab-7991-4c99-8319-bd5fd424da29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85e6f4f89714e81bd798d32526e1121', 'request_id': 'req-878c05ab-7991-4c99-8319-bd5fd424da29'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:16.557230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-878c05ab-7991-4c99-8319-bd5fd424da29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85e6f4f89714e81bd798d32526e1121', 'request_id': 'req-878c05ab-7991-4c99-8319-bd5fd424da29'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:16.577832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-878c05ab-7991-4c99-8319-bd5fd424da29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85e6f4f89714e81bd798d32526e1121', 'request_id': 'req-878c05ab-7991-4c99-8319-bd5fd424da29'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:16.587652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:16.603504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d1fdc-f45b-4dc2-9c83-d75f9943056d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:16.604672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d1fdc-f45b-4dc2-9c83-d75f9943056d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:16.605129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d1fdc-f45b-4dc2-9c83-d75f9943056d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:16.630868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ae6d1fdc-f45b-4dc2-9c83-d75f9943056d None None] MFA Rules not processed for user `6f2e974ab5aa48dfb4b00f810dcedb63`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:16.632119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ae6d1fdc-f45b-4dc2-9c83-d75f9943056d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:16.643218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-878c05ab-7991-4c99-8319-bd5fd424da29 admin admin] The token cache is being invalidate because project e85e6f4f89714e81bd798d32526e1121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:16.643534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-878c05ab-7991-4c99-8319-bd5fd424da29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:16.644460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-878c05ab-7991-4c99-8319-bd5fd424da29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:16.647376 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2609/5291] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:16 2022] DELETE /identity/v3/projects/e85e6f4f89714e81bd798d32526e1121 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:16.654754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f07dcf-639a-4e87-a219-c8f1c31300b2 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:16.655442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f07dcf-639a-4e87-a219-c8f1c31300b2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:16.655797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f07dcf-639a-4e87-a219-c8f1c31300b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:16.680127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-15f07dcf-639a-4e87-a219-c8f1c31300b2 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:16.681751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-15f07dcf-639a-4e87-a219-c8f1c31300b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:16.768218 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2683/5292] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:16.769507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d1fdc-f45b-4dc2-9c83-d75f9943056d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:16.772374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ae6d1fdc-f45b-4dc2-9c83-d75f9943056d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:16.852034 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2610/5293] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:16.854161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5e96b-2e78-4fac-b706-8eab8e1ca42a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:16.854604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5e96b-2e78-4fac-b706-8eab8e1ca42a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:16.854943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5e96b-2e78-4fac-b706-8eab8e1ca42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:16.882171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5fd5e96b-2e78-4fac-b706-8eab8e1ca42a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:16.883972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5fd5e96b-2e78-4fac-b706-8eab8e1ca42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:16.894624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d1fdc-f45b-4dc2-9c83-d75f9943056d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:16.894961 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2611/5294] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:16.899917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5e96b-2e78-4fac-b706-8eab8e1ca42a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:16.901598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1f7a6-e82f-41a7-b7ee-ce123f3213b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:16.902574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1f7a6-e82f-41a7-b7ee-ce123f3213b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:16.902956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1f7a6-e82f-41a7-b7ee-ce123f3213b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:16.903443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1f7a6-e82f-41a7-b7ee-ce123f3213b4 admin admin] PATH_INFO: `/v3/projects/9e352d74c8674c3789b1b5ea8c25a2b7` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:16.905784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1f7a6-e82f-41a7-b7ee-ce123f3213b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e352d74c8674c3789b1b5ea8c25a2b7)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:16.908280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1f7a6-e82f-41a7-b7ee-ce123f3213b4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:16.913824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5e96b-2e78-4fac-b706-8eab8e1ca42a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:16.918911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371e336-64cd-4682-9366-1cc578e25259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:16.925709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371e336-64cd-4682-9366-1cc578e25259 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:16.925709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371e336-64cd-4682-9366-1cc578e25259 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:16.925709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371e336-64cd-4682-9366-1cc578e25259 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:16.925709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371e336-64cd-4682-9366-1cc578e25259 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:26:16.925709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371e336-64cd-4682-9366-1cc578e25259 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:16.925709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371e336-64cd-4682-9366-1cc578e25259 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:16.941271 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2612/5295] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:26:16.945875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371e336-64cd-4682-9366-1cc578e25259 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:16.961136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371e336-64cd-4682-9366-1cc578e25259 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:16.969047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d70cf-b3a6-4313-b96b-b23c6d77400a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:16.970282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d70cf-b3a6-4313-b96b-b23c6d77400a admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:16.975883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d70cf-b3a6-4313-b96b-b23c6d77400a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:16.975883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d70cf-b3a6-4313-b96b-b23c6d77400a admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:16.975883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d70cf-b3a6-4313-b96b-b23c6d77400a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:16.975883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d70cf-b3a6-4313-b96b-b23c6d77400a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:17.038486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5cb1f7a6-e82f-41a7-b7ee-ce123f3213b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e352d74c8674c3789b1b5ea8c25a2b7', 'request_id': 'req-5cb1f7a6-e82f-41a7-b7ee-ce123f3213b4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:17.046310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5cb1f7a6-e82f-41a7-b7ee-ce123f3213b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e352d74c8674c3789b1b5ea8c25a2b7', 'request_id': 'req-5cb1f7a6-e82f-41a7-b7ee-ce123f3213b4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:17.054063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5cb1f7a6-e82f-41a7-b7ee-ce123f3213b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e352d74c8674c3789b1b5ea8c25a2b7', 'request_id': 'req-5cb1f7a6-e82f-41a7-b7ee-ce123f3213b4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:17.120643 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2613/5296] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:16 2022] POST /identity/v3/projects => generated 367 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:17.124465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d70cf-b3a6-4313-b96b-b23c6d77400a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:17.168691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5cb1f7a6-e82f-41a7-b7ee-ce123f3213b4 admin admin] The token cache is being invalidate because project 9e352d74c8674c3789b1b5ea8c25a2b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:17.169208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5cb1f7a6-e82f-41a7-b7ee-ce123f3213b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:17.170055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5cb1f7a6-e82f-41a7-b7ee-ce123f3213b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:17.177942 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2684/5297] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:16 2022] DELETE /identity/v3/projects/9e352d74c8674c3789b1b5ea8c25a2b7 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:17.182109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1f7a6-e82f-41a7-b7ee-ce123f3213b4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:17.183698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5cb1f7a6-e82f-41a7-b7ee-ce123f3213b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:17.195438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d70cf-b3a6-4313-b96b-b23c6d77400a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:17.200606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89e488-fa5a-4fa8-b3c7-3f436b7ec83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:17.201479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89e488-fa5a-4fa8-b3c7-3f436b7ec83e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:17.201938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89e488-fa5a-4fa8-b3c7-3f436b7ec83e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:17.202399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89e488-fa5a-4fa8-b3c7-3f436b7ec83e admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:17.203296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89e488-fa5a-4fa8-b3c7-3f436b7ec83e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:17.205418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89e488-fa5a-4fa8-b3c7-3f436b7ec83e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:17.257478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1f7a6-e82f-41a7-b7ee-ce123f3213b4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:17.263212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37d856-b337-4016-b0d3-11c801a28d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:17.264103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37d856-b337-4016-b0d3-11c801a28d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:17.264391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37d856-b337-4016-b0d3-11c801a28d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:17.264670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37d856-b337-4016-b0d3-11c801a28d2f admin admin] PATH_INFO: `/v3/users/33efafd262e84948acb81891cfeccf5f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:17.265914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37d856-b337-4016-b0d3-11c801a28d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=33efafd262e84948acb81891cfeccf5f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:17.268080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37d856-b337-4016-b0d3-11c801a28d2f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:17.312186 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2614/5298] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:26:17 2022] POST /identity/v3/users => generated 284 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:26:17.313337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89e488-fa5a-4fa8-b3c7-3f436b7ec83e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:17.315199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8f89e488-fa5a-4fa8-b3c7-3f436b7ec83e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:17.389180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89e488-fa5a-4fa8-b3c7-3f436b7ec83e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:17.393149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ae6da-33c0-45e0-b8e7-7eba12366c06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:17.393825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ae6da-33c0-45e0-b8e7-7eba12366c06 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:17.394134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ae6da-33c0-45e0-b8e7-7eba12366c06 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:17.394414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ae6da-33c0-45e0-b8e7-7eba12366c06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:17.396425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d09ae6da-33c0-45e0-b8e7-7eba12366c06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:17.418856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ae6da-33c0-45e0-b8e7-7eba12366c06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:17.419418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ae6da-33c0-45e0-b8e7-7eba12366c06 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:17.432907 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2615/5299] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:26:17.433785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ae6da-33c0-45e0-b8e7-7eba12366c06 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:17.435253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d09ae6da-33c0-45e0-b8e7-7eba12366c06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:17.449849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ae6da-33c0-45e0-b8e7-7eba12366c06 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:17.456981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa83ea-a4c0-4a22-915a-ab70ea270312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:17.458118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa83ea-a4c0-4a22-915a-ab70ea270312 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:17.458406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa83ea-a4c0-4a22-915a-ab70ea270312 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:17.458685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa83ea-a4c0-4a22-915a-ab70ea270312 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:17.459888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa83ea-a4c0-4a22-915a-ab70ea270312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:17.461704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa83ea-a4c0-4a22-915a-ab70ea270312 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:17.494652 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2616/5300] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:17.494652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a1ffe-46e3-4988-8ba1-1cd083808ab2 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:17.494652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a1ffe-46e3-4988-8ba1-1cd083808ab2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:17.494652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a1ffe-46e3-4988-8ba1-1cd083808ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:17.495407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bf37d856-b337-4016-b0d3-11c801a28d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33efafd262e84948acb81891cfeccf5f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:17.507299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bf37d856-b337-4016-b0d3-11c801a28d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33efafd262e84948acb81891cfeccf5f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:17.516512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2e7a1ffe-46e3-4988-8ba1-1cd083808ab2 None None] MFA Rules not processed for user `027dcc48e4fd4c36a5004096ad5e43f8`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:17.517753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2e7a1ffe-46e3-4988-8ba1-1cd083808ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:17.589981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bf37d856-b337-4016-b0d3-11c801a28d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33efafd262e84948acb81891cfeccf5f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:17.591432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bf37d856-b337-4016-b0d3-11c801a28d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33efafd262e84948acb81891cfeccf5f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:17.594013 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2617/5301] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:17.595138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a1ffe-46e3-4988-8ba1-1cd083808ab2 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:17.612045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bf37d856-b337-4016-b0d3-11c801a28d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33efafd262e84948acb81891cfeccf5f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:17.619925 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2685/5302] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:26:17 2022] DELETE /identity/v3/users/33efafd262e84948acb81891cfeccf5f => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:17.621964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a1ffe-46e3-4988-8ba1-1cd083808ab2 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:17.711401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:17.716160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864132c2-abb7-4cc7-86bb-1db5e6eeaa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:17.717977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864132c2-abb7-4cc7-86bb-1db5e6eeaa46 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:17.719078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864132c2-abb7-4cc7-86bb-1db5e6eeaa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:17.719462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864132c2-abb7-4cc7-86bb-1db5e6eeaa46 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:17.720592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864132c2-abb7-4cc7-86bb-1db5e6eeaa46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:17.722286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864132c2-abb7-4cc7-86bb-1db5e6eeaa46 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:17.742245 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2618/5303] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:17.743562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37d856-b337-4016-b0d3-11c801a28d2f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:17.745169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bf37d856-b337-4016-b0d3-11c801a28d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:17.761518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37d856-b337-4016-b0d3-11c801a28d2f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:17.769096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed45623-7e16-4af6-99c4-9d42feed78e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:17.771338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed45623-7e16-4af6-99c4-9d42feed78e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:17.771864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed45623-7e16-4af6-99c4-9d42feed78e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:17.772394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed45623-7e16-4af6-99c4-9d42feed78e4 admin admin] PATH_INFO: `/v3/projects/ca905b8fd9304f979ed3420ac3b415fe/users/42e2cd7bf8a04c1a93ab0772d56b2c6b/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:17.800390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed45623-7e16-4af6-99c4-9d42feed78e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca905b8fd9304f979ed3420ac3b415fe, user_id=42e2cd7bf8a04c1a93ab0772d56b2c6b, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:17.804673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed45623-7e16-4af6-99c4-9d42feed78e4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:17.900381 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2686/5304] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:26:17 2022] PUT /identity/v3/projects/ca905b8fd9304f979ed3420ac3b415fe/users/42e2cd7bf8a04c1a93ab0772d56b2c6b/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:17.911379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983b1a5-11e2-4394-8c90-5fc981499c4c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:17.911727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983b1a5-11e2-4394-8c90-5fc981499c4c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:17.913573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983b1a5-11e2-4394-8c90-5fc981499c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:17.945846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:17.984786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9983b1a5-11e2-4394-8c90-5fc981499c4c None None] MFA Rules not processed for user `42e2cd7bf8a04c1a93ab0772d56b2c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:17.986038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9983b1a5-11e2-4394-8c90-5fc981499c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:18.167474 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2619/5305] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:18.188204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed45623-7e16-4af6-99c4-9d42feed78e4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:18.189238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983b1a5-11e2-4394-8c90-5fc981499c4c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:18.190344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6ed45623-7e16-4af6-99c4-9d42feed78e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:18.190669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9983b1a5-11e2-4394-8c90-5fc981499c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:18.297484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983b1a5-11e2-4394-8c90-5fc981499c4c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:18.307764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c0ec6-506f-4c69-aa98-4b96806df0ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:18.308556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c0ec6-506f-4c69-aa98-4b96806df0ad service glance] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:18.308781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c0ec6-506f-4c69-aa98-4b96806df0ad service glance] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:18.309004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c0ec6-506f-4c69-aa98-4b96806df0ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:18.330908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c0ec6-506f-4c69-aa98-4b96806df0ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:18.333674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c0ec6-506f-4c69-aa98-4b96806df0ad service glance] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:18.356045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed45623-7e16-4af6-99c4-9d42feed78e4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:18.358457 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2620/5306] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:26:18.362491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8634fc0-7603-40ad-b5cd-2fd301b9b8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:18.363785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8634fc0-7603-40ad-b5cd-2fd301b9b8b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:18.364903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8634fc0-7603-40ad-b5cd-2fd301b9b8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:18.365182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8634fc0-7603-40ad-b5cd-2fd301b9b8b8 admin admin] PATH_INFO: `/v3/projects/c67f6e8e3cec4bf8804e5e7fe0a886d7` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:18.366529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8634fc0-7603-40ad-b5cd-2fd301b9b8b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c67f6e8e3cec4bf8804e5e7fe0a886d7)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:18.368999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8634fc0-7603-40ad-b5cd-2fd301b9b8b8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:18.546387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b8634fc0-7603-40ad-b5cd-2fd301b9b8b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c67f6e8e3cec4bf8804e5e7fe0a886d7', 'request_id': 'req-b8634fc0-7603-40ad-b5cd-2fd301b9b8b8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:18.558811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b8634fc0-7603-40ad-b5cd-2fd301b9b8b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c67f6e8e3cec4bf8804e5e7fe0a886d7', 'request_id': 'req-b8634fc0-7603-40ad-b5cd-2fd301b9b8b8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:18.574664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b8634fc0-7603-40ad-b5cd-2fd301b9b8b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c67f6e8e3cec4bf8804e5e7fe0a886d7', 'request_id': 'req-b8634fc0-7603-40ad-b5cd-2fd301b9b8b8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:18.681624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b8634fc0-7603-40ad-b5cd-2fd301b9b8b8 admin admin] The token cache is being invalidate because project c67f6e8e3cec4bf8804e5e7fe0a886d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:18.682699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b8634fc0-7603-40ad-b5cd-2fd301b9b8b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:18.683837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b8634fc0-7603-40ad-b5cd-2fd301b9b8b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:18.686565 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2687/5307] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:18 2022] DELETE /identity/v3/projects/c67f6e8e3cec4bf8804e5e7fe0a886d7 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:18.696657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d827f-291a-4a5c-8689-7e65e58ffdd1 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:18.697198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d827f-291a-4a5c-8689-7e65e58ffdd1 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:18.697770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d827f-291a-4a5c-8689-7e65e58ffdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:18.743103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c31d827f-291a-4a5c-8689-7e65e58ffdd1 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:18.744581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c31d827f-291a-4a5c-8689-7e65e58ffdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:18.858522 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2621/5308] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:18.872678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669d216-25f9-41a7-8b27-bf2d49e32100 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:18.873033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669d216-25f9-41a7-8b27-bf2d49e32100 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:18.873338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669d216-25f9-41a7-8b27-bf2d49e32100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:18.908525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e669d216-25f9-41a7-8b27-bf2d49e32100 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:18.912639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e669d216-25f9-41a7-8b27-bf2d49e32100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:18.945153 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2688/5309] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:18.949265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d827f-291a-4a5c-8689-7e65e58ffdd1 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:18.961897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d827f-291a-4a5c-8689-7e65e58ffdd1 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:18.968144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19719653-734e-43a8-82ca-6a47db04d93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:18.968866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19719653-734e-43a8-82ca-6a47db04d93d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:18.969155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19719653-734e-43a8-82ca-6a47db04d93d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:18.969435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19719653-734e-43a8-82ca-6a47db04d93d admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:18.970166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19719653-734e-43a8-82ca-6a47db04d93d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:26:18.970766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19719653-734e-43a8-82ca-6a47db04d93d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:18.972603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19719653-734e-43a8-82ca-6a47db04d93d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:18.986666 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2622/5310] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:26:18.996411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669d216-25f9-41a7-8b27-bf2d49e32100 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:19.007921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669d216-25f9-41a7-8b27-bf2d49e32100 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:19.014115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a2009-645e-43ab-b9bb-964ac0e55e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:19.015144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a2009-645e-43ab-b9bb-964ac0e55e70 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:19.015594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a2009-645e-43ab-b9bb-964ac0e55e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:19.016103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a2009-645e-43ab-b9bb-964ac0e55e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:19.017322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a2009-645e-43ab-b9bb-964ac0e55e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:19.019212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a2009-645e-43ab-b9bb-964ac0e55e70 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:19.186888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19719653-734e-43a8-82ca-6a47db04d93d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:19.197566 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2689/5311] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:18 2022] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:19.206384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19719653-734e-43a8-82ca-6a47db04d93d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:19.243210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:19.322131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea714ba-d09b-4001-ba88-0e4791d44f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:19.322841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea714ba-d09b-4001-ba88-0e4791d44f8c admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:19.323164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea714ba-d09b-4001-ba88-0e4791d44f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:19.323438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea714ba-d09b-4001-ba88-0e4791d44f8c admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:19.324154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea714ba-d09b-4001-ba88-0e4791d44f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:19.326572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea714ba-d09b-4001-ba88-0e4791d44f8c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:19.466238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a2009-645e-43ab-b9bb-964ac0e55e70 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:19.472597 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2623/5312] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:26:19 2022] POST /identity/v3/users => generated 287 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:19.486194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a2009-645e-43ab-b9bb-964ac0e55e70 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:19.499496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0350012-7252-4b7f-acf5-0e02cb6e0965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:19.500710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0350012-7252-4b7f-acf5-0e02cb6e0965 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:19.501146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0350012-7252-4b7f-acf5-0e02cb6e0965 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:19.501737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0350012-7252-4b7f-acf5-0e02cb6e0965 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:19.502792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0350012-7252-4b7f-acf5-0e02cb6e0965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:19.505246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0350012-7252-4b7f-acf5-0e02cb6e0965 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:19.530648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea714ba-d09b-4001-ba88-0e4791d44f8c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:19.553315 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2690/5313] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:26:19.556126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea714ba-d09b-4001-ba88-0e4791d44f8c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:19.563660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad0adc-16e2-46b9-b51f-1616f460e04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:19.564376 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad0adc-16e2-46b9-b51f-1616f460e04f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:19.564665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad0adc-16e2-46b9-b51f-1616f460e04f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:19.564981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad0adc-16e2-46b9-b51f-1616f460e04f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:19.565847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad0adc-16e2-46b9-b51f-1616f460e04f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:19.567728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad0adc-16e2-46b9-b51f-1616f460e04f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:19.605134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0350012-7252-4b7f-acf5-0e02cb6e0965 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:19.613483 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2624/5314] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:19.624642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0350012-7252-4b7f-acf5-0e02cb6e0965 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:19.635390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a2052-e45b-4ed5-9db3-069b013b6b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:19.636677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a2052-e45b-4ed5-9db3-069b013b6b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:19.637255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a2052-e45b-4ed5-9db3-069b013b6b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:19.637888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a2052-e45b-4ed5-9db3-069b013b6b15 admin admin] PATH_INFO: `/v3/projects/7d5a798ee507429bb70566356229535d/users/bb1f6532421745a4b0de70356748a647/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:19.675328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a2052-e45b-4ed5-9db3-069b013b6b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5a798ee507429bb70566356229535d, user_id=bb1f6532421745a4b0de70356748a647, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:19.679254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a2052-e45b-4ed5-9db3-069b013b6b15 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:19.778269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:19.814720 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2691/5315] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:26:19 2022] PUT /identity/v3/projects/7d5a798ee507429bb70566356229535d/users/bb1f6532421745a4b0de70356748a647/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:19.829023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139c4ca-d3ab-478d-926a-b3c426a6ea9b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:19.829309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139c4ca-d3ab-478d-926a-b3c426a6ea9b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:19.829589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139c4ca-d3ab-478d-926a-b3c426a6ea9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:19.872962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3139c4ca-d3ab-478d-926a-b3c426a6ea9b None None] MFA Rules not processed for user `bb1f6532421745a4b0de70356748a647`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:19.874893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3139c4ca-d3ab-478d-926a-b3c426a6ea9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:19.978905 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2625/5316] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:19.991770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a2052-e45b-4ed5-9db3-069b013b6b15 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:19.993501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ec4a2052-e45b-4ed5-9db3-069b013b6b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:20.055820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a2052-e45b-4ed5-9db3-069b013b6b15 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:20.059881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc43b2-beb7-48c5-89ef-415ddd771315 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:20.060541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc43b2-beb7-48c5-89ef-415ddd771315 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:20.060829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc43b2-beb7-48c5-89ef-415ddd771315 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:20.061107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc43b2-beb7-48c5-89ef-415ddd771315 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:20.078987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc43b2-beb7-48c5-89ef-415ddd771315 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:20.078987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc43b2-beb7-48c5-89ef-415ddd771315 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:20.085835 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2692/5317] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:26:20.100750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec93e17-7bc7-4ea1-8d1c-4142aca02787 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:20.102450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec93e17-7bc7-4ea1-8d1c-4142aca02787 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:20.103449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec93e17-7bc7-4ea1-8d1c-4142aca02787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:20.138216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4ec93e17-7bc7-4ea1-8d1c-4142aca02787 None None] MFA Rules not processed for user `1963f7b0ee0244b2b4f5fc1d8b34f858`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:20.140906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4ec93e17-7bc7-4ea1-8d1c-4142aca02787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:20.244886 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2626/5318] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:26:20.255324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61833091-4530-4ce2-b5b9-84ecd90c03b0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:20.255828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61833091-4530-4ce2-b5b9-84ecd90c03b0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:20.256112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61833091-4530-4ce2-b5b9-84ecd90c03b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:20.278879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-61833091-4530-4ce2-b5b9-84ecd90c03b0 None None] MFA Rules not processed for user `1963f7b0ee0244b2b4f5fc1d8b34f858`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:20.280509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-61833091-4530-4ce2-b5b9-84ecd90c03b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:20.289013 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2693/5319] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:20.300792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec93e17-7bc7-4ea1-8d1c-4142aca02787 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:20.303506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4ec93e17-7bc7-4ea1-8d1c-4142aca02787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:20.416775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec93e17-7bc7-4ea1-8d1c-4142aca02787 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:20.425918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb8dbc-6612-498b-9811-0e0041db3571 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:20.427489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb8dbc-6612-498b-9811-0e0041db3571 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:20.431656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb8dbc-6612-498b-9811-0e0041db3571 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:20.431656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb8dbc-6612-498b-9811-0e0041db3571 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:20.439090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb8dbc-6612-498b-9811-0e0041db3571 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:20.441343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb8dbc-6612-498b-9811-0e0041db3571 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:20.465615 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2627/5320] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:26:20.698438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:20.832203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61833091-4530-4ce2-b5b9-84ecd90c03b0 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:20.840657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-61833091-4530-4ce2-b5b9-84ecd90c03b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:20.939817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61833091-4530-4ce2-b5b9-84ecd90c03b0 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:20.944245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83268bc3-4f16-4ab6-93ce-aae5947bd0e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:20.944962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83268bc3-4f16-4ab6-93ce-aae5947bd0e3 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:20.945403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83268bc3-4f16-4ab6-93ce-aae5947bd0e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:20.945824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83268bc3-4f16-4ab6-93ce-aae5947bd0e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:20.947821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-83268bc3-4f16-4ab6-93ce-aae5947bd0e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:21.037971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83268bc3-4f16-4ab6-93ce-aae5947bd0e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:21.039829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83268bc3-4f16-4ab6-93ce-aae5947bd0e3 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:21.054572 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2694/5321] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:26:22.396071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:23.756531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:25.438224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531af43-b384-4f74-931c-3b0fb83937cb None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:25.438810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531af43-b384-4f74-931c-3b0fb83937cb None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:25.438810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531af43-b384-4f74-931c-3b0fb83937cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:25.476420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9531af43-b384-4f74-931c-3b0fb83937cb None None] MFA Rules not processed for user `bb1f6532421745a4b0de70356748a647`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:25.478159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9531af43-b384-4f74-931c-3b0fb83937cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:25.502195 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2628/5322] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:26.389779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:27.140837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:27.284265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:28.236273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83268bc3-4f16-4ab6-93ce-aae5947bd0e3 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:28.237785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-83268bc3-4f16-4ab6-93ce-aae5947bd0e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:28.255704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:28.326838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83268bc3-4f16-4ab6-93ce-aae5947bd0e3 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:28.343752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876b202-4e5f-4fe7-86a6-a1bc93215e98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:28.344430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876b202-4e5f-4fe7-86a6-a1bc93215e98 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:28.344715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876b202-4e5f-4fe7-86a6-a1bc93215e98 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:28.344996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876b202-4e5f-4fe7-86a6-a1bc93215e98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:28.346857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1876b202-4e5f-4fe7-86a6-a1bc93215e98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:28.363361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876b202-4e5f-4fe7-86a6-a1bc93215e98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:28.365770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876b202-4e5f-4fe7-86a6-a1bc93215e98 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:28.380663 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2695/5323] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:26:28.648088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531af43-b384-4f74-931c-3b0fb83937cb None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:28.650406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9531af43-b384-4f74-931c-3b0fb83937cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:28.672765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531af43-b384-4f74-931c-3b0fb83937cb None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:28.693942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162d9f0-b2e7-4f04-8c0b-ccd88a625b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:28.695332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162d9f0-b2e7-4f04-8c0b-ccd88a625b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:28.695928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162d9f0-b2e7-4f04-8c0b-ccd88a625b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:28.696406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162d9f0-b2e7-4f04-8c0b-ccd88a625b5b admin admin] PATH_INFO: `/v3/users/bba77f6ef42547f1aa8480e27868bd4a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:28.697849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162d9f0-b2e7-4f04-8c0b-ccd88a625b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bba77f6ef42547f1aa8480e27868bd4a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:28.701208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162d9f0-b2e7-4f04-8c0b-ccd88a625b5b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:28.942264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2162d9f0-b2e7-4f04-8c0b-ccd88a625b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bba77f6ef42547f1aa8480e27868bd4a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:28.973751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2162d9f0-b2e7-4f04-8c0b-ccd88a625b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bba77f6ef42547f1aa8480e27868bd4a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:29.080518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2162d9f0-b2e7-4f04-8c0b-ccd88a625b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bba77f6ef42547f1aa8480e27868bd4a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:29.088717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2162d9f0-b2e7-4f04-8c0b-ccd88a625b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bba77f6ef42547f1aa8480e27868bd4a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:29.089634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2162d9f0-b2e7-4f04-8c0b-ccd88a625b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bba77f6ef42547f1aa8480e27868bd4a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:29.096575 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2629/5324] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:26:28 2022] DELETE /identity/v3/users/bba77f6ef42547f1aa8480e27868bd4a => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:29.612951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876b202-4e5f-4fe7-86a6-a1bc93215e98 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:29.642601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876b202-4e5f-4fe7-86a6-a1bc93215e98 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:29.751248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55ed7c-b0f5-4b67-853f-f58a242a3428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:29.752307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55ed7c-b0f5-4b67-853f-f58a242a3428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:29.752652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55ed7c-b0f5-4b67-853f-f58a242a3428 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:29.753201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55ed7c-b0f5-4b67-853f-f58a242a3428 admin admin] PATH_INFO: `/v3/projects/22ca92a86e6c40d59071e58ce4085568` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:29.755582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55ed7c-b0f5-4b67-853f-f58a242a3428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ca92a86e6c40d59071e58ce4085568)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:29.757665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55ed7c-b0f5-4b67-853f-f58a242a3428 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:29.877370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7e55ed7c-b0f5-4b67-853f-f58a242a3428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ca92a86e6c40d59071e58ce4085568', 'request_id': 'req-7e55ed7c-b0f5-4b67-853f-f58a242a3428'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:29.891403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7e55ed7c-b0f5-4b67-853f-f58a242a3428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ca92a86e6c40d59071e58ce4085568', 'request_id': 'req-7e55ed7c-b0f5-4b67-853f-f58a242a3428'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:29.898516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7e55ed7c-b0f5-4b67-853f-f58a242a3428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ca92a86e6c40d59071e58ce4085568', 'request_id': 'req-7e55ed7c-b0f5-4b67-853f-f58a242a3428'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:29.983652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7e55ed7c-b0f5-4b67-853f-f58a242a3428 admin admin] The token cache is being invalidate because project 22ca92a86e6c40d59071e58ce4085568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:29.984093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7e55ed7c-b0f5-4b67-853f-f58a242a3428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:29.984740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7e55ed7c-b0f5-4b67-853f-f58a242a3428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:29.986551 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2696/5325] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:29 2022] DELETE /identity/v3/projects/22ca92a86e6c40d59071e58ce4085568 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:29.993278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7204d-0a77-4835-84ba-5a4b0887070a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:29.993840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7204d-0a77-4835-84ba-5a4b0887070a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:29.993840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7204d-0a77-4835-84ba-5a4b0887070a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:30.013283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4bc7204d-0a77-4835-84ba-5a4b0887070a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:30.014491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4bc7204d-0a77-4835-84ba-5a4b0887070a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:30.071771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:30.110282 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2630/5326] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:30.188032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd990f5-d1b6-44fc-bd7b-205cc208446d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:30.188318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd990f5-d1b6-44fc-bd7b-205cc208446d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:30.188662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd990f5-d1b6-44fc-bd7b-205cc208446d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:30.208245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0dd990f5-d1b6-44fc-bd7b-205cc208446d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:30.209453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0dd990f5-d1b6-44fc-bd7b-205cc208446d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:30.218685 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2697/5327] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:30.224069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7204d-0a77-4835-84ba-5a4b0887070a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:30.234102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7204d-0a77-4835-84ba-5a4b0887070a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:30.241974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6926231-c087-43ff-92bc-776096434e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:30.242697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6926231-c087-43ff-92bc-776096434e4e admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:30.242998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6926231-c087-43ff-92bc-776096434e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:30.243303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6926231-c087-43ff-92bc-776096434e4e admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:30.245213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6926231-c087-43ff-92bc-776096434e4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:26:30.245213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6926231-c087-43ff-92bc-776096434e4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:30.246139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6926231-c087-43ff-92bc-776096434e4e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:30.258268 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2631/5328] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:26:30.262878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd990f5-d1b6-44fc-bd7b-205cc208446d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:30.273074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd990f5-d1b6-44fc-bd7b-205cc208446d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:30.277873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06efb5-dd81-4d89-b6ee-32ab9b9adc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:30.278525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06efb5-dd81-4d89-b6ee-32ab9b9adc0d admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:30.278810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06efb5-dd81-4d89-b6ee-32ab9b9adc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:30.279126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06efb5-dd81-4d89-b6ee-32ab9b9adc0d admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:30.279817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06efb5-dd81-4d89-b6ee-32ab9b9adc0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:30.281730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06efb5-dd81-4d89-b6ee-32ab9b9adc0d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:30.374559 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2698/5329] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:30 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:30.379491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6926231-c087-43ff-92bc-776096434e4e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:30.390431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6926231-c087-43ff-92bc-776096434e4e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:30.454227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abf43d-5a6a-4390-a45c-0dd91f03f259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:30.454721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abf43d-5a6a-4390-a45c-0dd91f03f259 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:30.455043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abf43d-5a6a-4390-a45c-0dd91f03f259 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:30.455322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abf43d-5a6a-4390-a45c-0dd91f03f259 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:30.456013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abf43d-5a6a-4390-a45c-0dd91f03f259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:30.458450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abf43d-5a6a-4390-a45c-0dd91f03f259 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:30.547187 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2632/5330] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:26:30 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:30.548393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06efb5-dd81-4d89-b6ee-32ab9b9adc0d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:30.554885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:30.562174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06efb5-dd81-4d89-b6ee-32ab9b9adc0d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:30.568538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2438c-5e60-4e4a-890a-1b833d04e2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:30.569229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2438c-5e60-4e4a-890a-1b833d04e2ef admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:30.569524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2438c-5e60-4e4a-890a-1b833d04e2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:30.569807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2438c-5e60-4e4a-890a-1b833d04e2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:30.579064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2438c-5e60-4e4a-890a-1b833d04e2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:30.583163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2438c-5e60-4e4a-890a-1b833d04e2ef admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:30.606850 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2699/5331] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:30.610506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abf43d-5a6a-4390-a45c-0dd91f03f259 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:30.624505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abf43d-5a6a-4390-a45c-0dd91f03f259 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:30.632840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9690178-d55c-43b1-8145-f6efea431161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:30.633887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9690178-d55c-43b1-8145-f6efea431161 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:30.634352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9690178-d55c-43b1-8145-f6efea431161 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:30.634944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9690178-d55c-43b1-8145-f6efea431161 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:30.636112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9690178-d55c-43b1-8145-f6efea431161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:30.637947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9690178-d55c-43b1-8145-f6efea431161 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:30.654247 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2633/5332] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:30.655663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2438c-5e60-4e4a-890a-1b833d04e2ef admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:30.667110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2438c-5e60-4e4a-890a-1b833d04e2ef admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:30.672244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd71b36-38b8-45b3-a24f-d1a12b5dd4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:30.673973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd71b36-38b8-45b3-a24f-d1a12b5dd4cf admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:30.681022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd71b36-38b8-45b3-a24f-d1a12b5dd4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:30.681022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd71b36-38b8-45b3-a24f-d1a12b5dd4cf admin admin] PATH_INFO: `/v3/projects/856b5fd8e4544b028f50cfdcaa39181a/users/4bca4052ad6940e78c6b9a04748d1ff4/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:30.694504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd71b36-38b8-45b3-a24f-d1a12b5dd4cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=856b5fd8e4544b028f50cfdcaa39181a, user_id=4bca4052ad6940e78c6b9a04748d1ff4, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:30.698771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd71b36-38b8-45b3-a24f-d1a12b5dd4cf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:30.824685 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2700/5333] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:26:30 2022] PUT /identity/v3/projects/856b5fd8e4544b028f50cfdcaa39181a/users/4bca4052ad6940e78c6b9a04748d1ff4/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:30.835246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b7c16-5e2f-4437-9346-03410e90140c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:30.835542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b7c16-5e2f-4437-9346-03410e90140c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:30.835826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b7c16-5e2f-4437-9346-03410e90140c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:30.879664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-083b7c16-5e2f-4437-9346-03410e90140c None None] MFA Rules not processed for user `4bca4052ad6940e78c6b9a04748d1ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:30.881595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-083b7c16-5e2f-4437-9346-03410e90140c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:30.977601 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2634/5334] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:30.990612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd71b36-38b8-45b3-a24f-d1a12b5dd4cf admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:31.003666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0cd71b36-38b8-45b3-a24f-d1a12b5dd4cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:31.122599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd71b36-38b8-45b3-a24f-d1a12b5dd4cf admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:31.131074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9867d7-7bcc-4a4e-9316-25c41d0a082f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:31.132238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9867d7-7bcc-4a4e-9316-25c41d0a082f service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:31.132238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9867d7-7bcc-4a4e-9316-25c41d0a082f service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:31.132427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9867d7-7bcc-4a4e-9316-25c41d0a082f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:31.143841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9867d7-7bcc-4a4e-9316-25c41d0a082f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:31.146634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9867d7-7bcc-4a4e-9316-25c41d0a082f service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:31.160059 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2701/5335] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:26:31.432883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b7c16-5e2f-4437-9346-03410e90140c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:31.504929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:31.514625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b7c16-5e2f-4437-9346-03410e90140c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:31.519637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be03ccf-9b32-40e1-b0e0-1050caf41968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:31.521107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be03ccf-9b32-40e1-b0e0-1050caf41968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:31.521406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be03ccf-9b32-40e1-b0e0-1050caf41968 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:31.521676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be03ccf-9b32-40e1-b0e0-1050caf41968 admin admin] PATH_INFO: `/v3/users/4bca4052ad6940e78c6b9a04748d1ff4` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:31.522889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be03ccf-9b32-40e1-b0e0-1050caf41968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bca4052ad6940e78c6b9a04748d1ff4)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:31.525266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be03ccf-9b32-40e1-b0e0-1050caf41968 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:31.750528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0be03ccf-9b32-40e1-b0e0-1050caf41968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bca4052ad6940e78c6b9a04748d1ff4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:31.771758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0be03ccf-9b32-40e1-b0e0-1050caf41968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bca4052ad6940e78c6b9a04748d1ff4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:31.909410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0be03ccf-9b32-40e1-b0e0-1050caf41968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bca4052ad6940e78c6b9a04748d1ff4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:31.931152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0be03ccf-9b32-40e1-b0e0-1050caf41968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bca4052ad6940e78c6b9a04748d1ff4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:31.933378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0be03ccf-9b32-40e1-b0e0-1050caf41968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bca4052ad6940e78c6b9a04748d1ff4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:31.949637 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2635/5336] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:26:31 2022] DELETE /identity/v3/users/4bca4052ad6940e78c6b9a04748d1ff4 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:31.955168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aaa29c-1c84-4451-bcff-93f47695a94b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:31.956766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aaa29c-1c84-4451-bcff-93f47695a94b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:31.958040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aaa29c-1c84-4451-bcff-93f47695a94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:31.992866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-95aaa29c-1c84-4451-bcff-93f47695a94b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:31.994236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-95aaa29c-1c84-4451-bcff-93f47695a94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:32.065022 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2702/5337] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:32.075137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be03ccf-9b32-40e1-b0e0-1050caf41968 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:32.076673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0be03ccf-9b32-40e1-b0e0-1050caf41968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:32.139885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be03ccf-9b32-40e1-b0e0-1050caf41968 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:32.143664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7088eb0-ffe8-4144-8e2d-1fbf5f79016d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:32.145289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7088eb0-ffe8-4144-8e2d-1fbf5f79016d service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:32.145576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7088eb0-ffe8-4144-8e2d-1fbf5f79016d service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:32.145852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7088eb0-ffe8-4144-8e2d-1fbf5f79016d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:32.157567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7088eb0-ffe8-4144-8e2d-1fbf5f79016d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:32.159091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7088eb0-ffe8-4144-8e2d-1fbf5f79016d service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:32.170373 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2636/5338] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:26:32.597309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aaa29c-1c84-4451-bcff-93f47695a94b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:32.598828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-95aaa29c-1c84-4451-bcff-93f47695a94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:32.617637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aaa29c-1c84-4451-bcff-93f47695a94b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:32.635021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03496f28-86e1-4175-9aa3-e85ffa37505c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:32.635947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03496f28-86e1-4175-9aa3-e85ffa37505c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:32.638255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03496f28-86e1-4175-9aa3-e85ffa37505c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:32.638255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03496f28-86e1-4175-9aa3-e85ffa37505c admin admin] PATH_INFO: `/v3/projects/856b5fd8e4544b028f50cfdcaa39181a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:32.638255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03496f28-86e1-4175-9aa3-e85ffa37505c admin admin] RBAC: Authorizing `identity:delete_project(project_id=856b5fd8e4544b028f50cfdcaa39181a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:32.639709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03496f28-86e1-4175-9aa3-e85ffa37505c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:32.752084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:32.780035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-03496f28-86e1-4175-9aa3-e85ffa37505c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '856b5fd8e4544b028f50cfdcaa39181a', 'request_id': 'req-03496f28-86e1-4175-9aa3-e85ffa37505c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:32.809878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-03496f28-86e1-4175-9aa3-e85ffa37505c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '856b5fd8e4544b028f50cfdcaa39181a', 'request_id': 'req-03496f28-86e1-4175-9aa3-e85ffa37505c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:32.821743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-03496f28-86e1-4175-9aa3-e85ffa37505c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '856b5fd8e4544b028f50cfdcaa39181a', 'request_id': 'req-03496f28-86e1-4175-9aa3-e85ffa37505c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:33.056702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-03496f28-86e1-4175-9aa3-e85ffa37505c admin admin] The token cache is being invalidate because project 856b5fd8e4544b028f50cfdcaa39181a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:33.057306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-03496f28-86e1-4175-9aa3-e85ffa37505c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:33.058548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-03496f28-86e1-4175-9aa3-e85ffa37505c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:33.060428 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2703/5339] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:32 2022] DELETE /identity/v3/projects/856b5fd8e4544b028f50cfdcaa39181a => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:33.067143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8360b-c349-433c-a313-1042e1042ec6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:33.068055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8360b-c349-433c-a313-1042e1042ec6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:33.068254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8360b-c349-433c-a313-1042e1042ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:33.091696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7bb8360b-c349-433c-a313-1042e1042ec6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:33.093139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7bb8360b-c349-433c-a313-1042e1042ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:33.160895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:33.179108 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2637/5340] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:33.187672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2f79b-486e-415c-be6a-41724d1718ed None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:33.187871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2f79b-486e-415c-be6a-41724d1718ed None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:33.188159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2f79b-486e-415c-be6a-41724d1718ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:33.209417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9ea2f79b-486e-415c-be6a-41724d1718ed None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:33.214555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9ea2f79b-486e-415c-be6a-41724d1718ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:33.224504 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2704/5341] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:33.225860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8360b-c349-433c-a313-1042e1042ec6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:33.237626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8360b-c349-433c-a313-1042e1042ec6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:33.243324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64ca1b-384a-4748-b79a-3ced7eaa399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:33.244081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64ca1b-384a-4748-b79a-3ced7eaa399c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:33.244364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64ca1b-384a-4748-b79a-3ced7eaa399c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:33.244736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64ca1b-384a-4748-b79a-3ced7eaa399c admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:33.245514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64ca1b-384a-4748-b79a-3ced7eaa399c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:26:33.245823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64ca1b-384a-4748-b79a-3ced7eaa399c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:33.247550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64ca1b-384a-4748-b79a-3ced7eaa399c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:33.264314 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2638/5342] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:26:33.265732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2f79b-486e-415c-be6a-41724d1718ed None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:33.276276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2f79b-486e-415c-be6a-41724d1718ed None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:33.281280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce2ff5-4edd-4013-9ae5-25f11c03c9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:33.281995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce2ff5-4edd-4013-9ae5-25f11c03c9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:33.286546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce2ff5-4edd-4013-9ae5-25f11c03c9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:33.286546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce2ff5-4edd-4013-9ae5-25f11c03c9b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:33.286546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce2ff5-4edd-4013-9ae5-25f11c03c9b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:33.286546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce2ff5-4edd-4013-9ae5-25f11c03c9b2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:33.503307 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2705/5343] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:33 2022] POST /identity/v3/projects => generated 373 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:33.503400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64ca1b-384a-4748-b79a-3ced7eaa399c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:33.516652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64ca1b-384a-4748-b79a-3ced7eaa399c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:33.582293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dace693-f60c-4966-954b-c1eeba4f7db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:33.583311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dace693-f60c-4966-954b-c1eeba4f7db3 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:33.583626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dace693-f60c-4966-954b-c1eeba4f7db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:33.583880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dace693-f60c-4966-954b-c1eeba4f7db3 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:33.584867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dace693-f60c-4966-954b-c1eeba4f7db3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:33.586883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dace693-f60c-4966-954b-c1eeba4f7db3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:33.659103 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2639/5344] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:26:33 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:26:33.666642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce2ff5-4edd-4013-9ae5-25f11c03c9b2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:33.681833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce2ff5-4edd-4013-9ae5-25f11c03c9b2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:33.704891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2768f9-6487-40da-bf27-20aea8112756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:33.705974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2768f9-6487-40da-bf27-20aea8112756 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:33.706448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2768f9-6487-40da-bf27-20aea8112756 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:33.706931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2768f9-6487-40da-bf27-20aea8112756 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:33.708556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2768f9-6487-40da-bf27-20aea8112756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:33.713380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2768f9-6487-40da-bf27-20aea8112756 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:33.725367 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2706/5345] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:33.729667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dace693-f60c-4966-954b-c1eeba4f7db3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:33.742521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dace693-f60c-4966-954b-c1eeba4f7db3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:33.751058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b3276-66b2-4ea2-a621-50afde0ecb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:33.759160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b3276-66b2-4ea2-a621-50afde0ecb9d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:33.759160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b3276-66b2-4ea2-a621-50afde0ecb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:33.759160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b3276-66b2-4ea2-a621-50afde0ecb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:33.759160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b3276-66b2-4ea2-a621-50afde0ecb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:33.759160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b3276-66b2-4ea2-a621-50afde0ecb9d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:33.775748 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2640/5346] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:33.779780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2768f9-6487-40da-bf27-20aea8112756 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:33.791298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2768f9-6487-40da-bf27-20aea8112756 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:33.796366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbbfa1-9262-4ccb-8515-715cbc4ce9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:33.797377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbbfa1-9262-4ccb-8515-715cbc4ce9af admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:33.797662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbbfa1-9262-4ccb-8515-715cbc4ce9af admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:33.797938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbbfa1-9262-4ccb-8515-715cbc4ce9af admin admin] PATH_INFO: `/v3/projects/8c3fe15317854afe9dd09626423d236f/users/9952a5670df2478e87a96ab0d8fbe11c/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:33.815650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbbfa1-9262-4ccb-8515-715cbc4ce9af admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3fe15317854afe9dd09626423d236f, user_id=9952a5670df2478e87a96ab0d8fbe11c, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:33.819442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbbfa1-9262-4ccb-8515-715cbc4ce9af admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:33.903095 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2707/5347] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:26:33 2022] PUT /identity/v3/projects/8c3fe15317854afe9dd09626423d236f/users/9952a5670df2478e87a96ab0d8fbe11c/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:33.913520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c054b79-e6b3-4449-a748-d3b8c6e7e642 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:33.913933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c054b79-e6b3-4449-a748-d3b8c6e7e642 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:33.914227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c054b79-e6b3-4449-a748-d3b8c6e7e642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:33.949056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5c054b79-e6b3-4449-a748-d3b8c6e7e642 None None] MFA Rules not processed for user `9952a5670df2478e87a96ab0d8fbe11c`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:33.950350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5c054b79-e6b3-4449-a748-d3b8c6e7e642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:34.076230 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2641/5348] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:34.082300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbbfa1-9262-4ccb-8515-715cbc4ce9af admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:34.174663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbbfa1-9262-4ccb-8515-715cbc4ce9af admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:34.181321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd208b2-434b-4ced-a316-181b0d24dde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:34.182040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd208b2-434b-4ced-a316-181b0d24dde8 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:34.182331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd208b2-434b-4ced-a316-181b0d24dde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:34.182606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd208b2-434b-4ced-a316-181b0d24dde8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:34.183991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd208b2-434b-4ced-a316-181b0d24dde8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:34.185963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd208b2-434b-4ced-a316-181b0d24dde8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:34.339938 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2708/5349] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:34 2022] POST /identity/v3/projects => generated 373 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:34.344156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c054b79-e6b3-4449-a748-d3b8c6e7e642 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:34.356501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c054b79-e6b3-4449-a748-d3b8c6e7e642 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:34.415417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f171c28-7e73-414a-9489-0017e4181a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:34.416204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f171c28-7e73-414a-9489-0017e4181a0b admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:34.416633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f171c28-7e73-414a-9489-0017e4181a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:34.416921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f171c28-7e73-414a-9489-0017e4181a0b admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:34.417628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f171c28-7e73-414a-9489-0017e4181a0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:34.419583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f171c28-7e73-414a-9489-0017e4181a0b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:34.517322 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2642/5350] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:26:34 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:26:34.522383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd208b2-434b-4ced-a316-181b0d24dde8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:34.533213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd208b2-434b-4ced-a316-181b0d24dde8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:34.538982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6e093-c367-45e5-99fa-3e67b079917d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:34.539713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6e093-c367-45e5-99fa-3e67b079917d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:34.539999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6e093-c367-45e5-99fa-3e67b079917d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:34.540279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6e093-c367-45e5-99fa-3e67b079917d admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:34.541000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6e093-c367-45e5-99fa-3e67b079917d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:34.543423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6e093-c367-45e5-99fa-3e67b079917d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:34.570252 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2709/5351] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:34.574021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f171c28-7e73-414a-9489-0017e4181a0b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:34.593327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f171c28-7e73-414a-9489-0017e4181a0b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:34.599062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e7a7a-ebab-437b-92d8-21a4b57584f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:34.599939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e7a7a-ebab-437b-92d8-21a4b57584f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:34.600224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e7a7a-ebab-437b-92d8-21a4b57584f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:34.600527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e7a7a-ebab-437b-92d8-21a4b57584f0 admin admin] PATH_INFO: `/v3/projects/63910efb635c47c9beb88f8a5e4a2ccb/users/f5d6183cb70d41ae89189d68bcb3921c/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:34.618116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e7a7a-ebab-437b-92d8-21a4b57584f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63910efb635c47c9beb88f8a5e4a2ccb, user_id=f5d6183cb70d41ae89189d68bcb3921c, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:34.621605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e7a7a-ebab-437b-92d8-21a4b57584f0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:34.699065 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2643/5352] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:26:34 2022] PUT /identity/v3/projects/63910efb635c47c9beb88f8a5e4a2ccb/users/f5d6183cb70d41ae89189d68bcb3921c/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:34.703804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6e093-c367-45e5-99fa-3e67b079917d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:34.718003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6e093-c367-45e5-99fa-3e67b079917d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:34.779844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:34.904557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e77b83-589f-4a4b-8b25-cf39c2445f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:34.906044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e77b83-589f-4a4b-8b25-cf39c2445f14 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:34.907690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e77b83-589f-4a4b-8b25-cf39c2445f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:34.910688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e77b83-589f-4a4b-8b25-cf39c2445f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:34.911859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e77b83-589f-4a4b-8b25-cf39c2445f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:34.919135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e77b83-589f-4a4b-8b25-cf39c2445f14 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:34.928457 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2710/5353] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:34.932846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e7a7a-ebab-437b-92d8-21a4b57584f0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:34.956134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e7a7a-ebab-437b-92d8-21a4b57584f0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:34.967988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb880c-5428-4071-a21e-163d6e4b55ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:34.968917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb880c-5428-4071-a21e-163d6e4b55ba admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:34.969239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb880c-5428-4071-a21e-163d6e4b55ba admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:34.969522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb880c-5428-4071-a21e-163d6e4b55ba admin admin] PATH_INFO: `/v3/projects/63910efb635c47c9beb88f8a5e4a2ccb/users/f5d6183cb70d41ae89189d68bcb3921c/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:34.971954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb880c-5428-4071-a21e-163d6e4b55ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=63910efb635c47c9beb88f8a5e4a2ccb, user_id=f5d6183cb70d41ae89189d68bcb3921c, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:34.975126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb880c-5428-4071-a21e-163d6e4b55ba admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:34.988771 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2644/5354] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:26:34 2022] PUT /identity/v3/projects/63910efb635c47c9beb88f8a5e4a2ccb/users/f5d6183cb70d41ae89189d68bcb3921c/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:35.002104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79902d-2906-4881-9c23-a766ab8c9fce None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:35.003485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79902d-2906-4881-9c23-a766ab8c9fce None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:35.004546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79902d-2906-4881-9c23-a766ab8c9fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:35.051305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2c79902d-2906-4881-9c23-a766ab8c9fce None None] MFA Rules not processed for user `f5d6183cb70d41ae89189d68bcb3921c`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:35.052993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2c79902d-2906-4881-9c23-a766ab8c9fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:35.160729 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2711/5355] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:35.164958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb880c-5428-4071-a21e-163d6e4b55ba admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:35.181364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb880c-5428-4071-a21e-163d6e4b55ba admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:35.191292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458a9e4-247b-4e76-ae09-82413902c7cc tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d6183cb70d41ae89189d68bcb3921c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63910efb635c47c9beb88f8a5e4a2ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:35.192239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458a9e4-247b-4e76-ae09-82413902c7cc tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:35.192551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458a9e4-247b-4e76-ae09-82413902c7cc tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:35.192807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458a9e4-247b-4e76-ae09-82413902c7cc tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:35.195985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458a9e4-247b-4e76-ae09-82413902c7cc tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:35.207316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458a9e4-247b-4e76-ae09-82413902c7cc tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:35.282426 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2645/5356] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:35 2022] POST /identity/v3/services => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:35.286874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79902d-2906-4881-9c23-a766ab8c9fce None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:35.302870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79902d-2906-4881-9c23-a766ab8c9fce None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:35.318375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26323e40-d093-434a-bd04-1f9238eac382 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d6183cb70d41ae89189d68bcb3921c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63910efb635c47c9beb88f8a5e4a2ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:35.319043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26323e40-d093-434a-bd04-1f9238eac382 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:35.319344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26323e40-d093-434a-bd04-1f9238eac382 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:35.320816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26323e40-d093-434a-bd04-1f9238eac382 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:35.320816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26323e40-d093-434a-bd04-1f9238eac382 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:35.321371 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-26323e40-d093-434a-bd04-1f9238eac382 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:26:35.321371 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:26:35.321371 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:26:35.322264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26323e40-d093-434a-bd04-1f9238eac382 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:35.360869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:35.416515 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2712/5357] 10.222.0.16 () {60 vars in 1212 bytes} [Sat Jul 16 21:26:35 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:26:35.420078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458a9e4-247b-4e76-ae09-82413902c7cc tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:35.431255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458a9e4-247b-4e76-ae09-82413902c7cc tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:35.436796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb1e71-e56f-4f1e-a4ad-443f7818b392 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d6183cb70d41ae89189d68bcb3921c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63910efb635c47c9beb88f8a5e4a2ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:35.439120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb1e71-e56f-4f1e-a4ad-443f7818b392 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:35.439120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb1e71-e56f-4f1e-a4ad-443f7818b392 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:35.439120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb1e71-e56f-4f1e-a4ad-443f7818b392 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:35.439120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb1e71-e56f-4f1e-a4ad-443f7818b392 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:35.440621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb1e71-e56f-4f1e-a4ad-443f7818b392 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:35.522164 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2646/5358] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:35 2022] POST /identity/v3/services => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:35.523359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26323e40-d093-434a-bd04-1f9238eac382 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:35.539096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26323e40-d093-434a-bd04-1f9238eac382 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:35.560491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b378924-530c-4816-a51f-46e937883771 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d6183cb70d41ae89189d68bcb3921c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63910efb635c47c9beb88f8a5e4a2ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:35.564003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b378924-530c-4816-a51f-46e937883771 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:35.564003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b378924-530c-4816-a51f-46e937883771 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:35.564003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b378924-530c-4816-a51f-46e937883771 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:35.564003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b378924-530c-4816-a51f-46e937883771 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:35.564281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b378924-530c-4816-a51f-46e937883771 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:35.658102 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2713/5359] 10.222.0.16 () {60 vars in 1212 bytes} [Sat Jul 16 21:26:35 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:26:35.663143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb1e71-e56f-4f1e-a4ad-443f7818b392 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:35.673712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb1e71-e56f-4f1e-a4ad-443f7818b392 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:35.679162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea7bb0-5bb7-427e-81c1-f441c9a15fab tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d6183cb70d41ae89189d68bcb3921c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63910efb635c47c9beb88f8a5e4a2ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:35.683943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea7bb0-5bb7-427e-81c1-f441c9a15fab tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:35.683943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea7bb0-5bb7-427e-81c1-f441c9a15fab tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:35.683943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea7bb0-5bb7-427e-81c1-f441c9a15fab tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:35.683943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea7bb0-5bb7-427e-81c1-f441c9a15fab tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:35.684260 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-acea7bb0-5bb7-427e-81c1-f441c9a15fab tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:26:35.684260 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:26:35.684260 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:26:35.684260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea7bb0-5bb7-427e-81c1-f441c9a15fab tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:35.689657 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2647/5360] 10.222.0.16 () {58 vars in 1190 bytes} [Sat Jul 16 21:26:35 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 765 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:26:35.693968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b378924-530c-4816-a51f-46e937883771 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:35.704203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b378924-530c-4816-a51f-46e937883771 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:35.709052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2be59-054c-4087-a494-c62d552a99f1 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d6183cb70d41ae89189d68bcb3921c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63910efb635c47c9beb88f8a5e4a2ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:35.709878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2be59-054c-4087-a494-c62d552a99f1 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:35.710159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2be59-054c-4087-a494-c62d552a99f1 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:35.710492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2be59-054c-4087-a494-c62d552a99f1 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/1dfe015b1dd946d28c6b043b07fd4220` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:35.711200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2be59-054c-4087-a494-c62d552a99f1 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=1dfe015b1dd946d28c6b043b07fd4220)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:35.712207 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-b1b2be59-054c-4087-a494-c62d552a99f1 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:26:35.712207 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:26:35.712207 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:26:35.713524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2be59-054c-4087-a494-c62d552a99f1 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:35.719639 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2714/5361] 10.222.0.16 () {58 vars in 1289 bytes} [Sat Jul 16 21:26:35 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/1dfe015b1dd946d28c6b043b07fd4220 => generated 333 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:26:35.724139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea7bb0-5bb7-427e-81c1-f441c9a15fab tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:35.734485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea7bb0-5bb7-427e-81c1-f441c9a15fab tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:35.739973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ca90a-e186-4074-8564-69b8ec4cbc01 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d6183cb70d41ae89189d68bcb3921c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63910efb635c47c9beb88f8a5e4a2ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:35.740801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ca90a-e186-4074-8564-69b8ec4cbc01 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] REQUEST_METHOD: `HEAD` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:35.741084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ca90a-e186-4074-8564-69b8ec4cbc01 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:35.741369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ca90a-e186-4074-8564-69b8ec4cbc01 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/1dfe015b1dd946d28c6b043b07fd4220` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:35.742024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ca90a-e186-4074-8564-69b8ec4cbc01 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=1dfe015b1dd946d28c6b043b07fd4220)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:35.743041 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-e25ca90a-e186-4074-8564-69b8ec4cbc01 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:26:35.743041 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:26:35.743041 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:26:35.743920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ca90a-e186-4074-8564-69b8ec4cbc01 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:35.749623 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2648/5362] 10.222.0.16 () {58 vars in 1290 bytes} [Sat Jul 16 21:26:35 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/1dfe015b1dd946d28c6b043b07fd4220 => generated 0 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 16 21:26:35.758908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2be59-054c-4087-a494-c62d552a99f1 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:35.768822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2be59-054c-4087-a494-c62d552a99f1 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:35.774502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839dfde8-93a1-4434-ac56-a1a92f0ce4e4 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d6183cb70d41ae89189d68bcb3921c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63910efb635c47c9beb88f8a5e4a2ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:35.775380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839dfde8-93a1-4434-ac56-a1a92f0ce4e4 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:35.775665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839dfde8-93a1-4434-ac56-a1a92f0ce4e4 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:35.779481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839dfde8-93a1-4434-ac56-a1a92f0ce4e4 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/1dfe015b1dd946d28c6b043b07fd4220` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:35.779481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839dfde8-93a1-4434-ac56-a1a92f0ce4e4 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=1dfe015b1dd946d28c6b043b07fd4220)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:35.779481 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-839dfde8-93a1-4434-ac56-a1a92f0ce4e4 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:26:35.779481 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:26:35.779481 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:26:35.779481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839dfde8-93a1-4434-ac56-a1a92f0ce4e4 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:35.834947 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2715/5363] 10.222.0.16 () {58 vars in 1292 bytes} [Sat Jul 16 21:26:35 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/1dfe015b1dd946d28c6b043b07fd4220 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:26:35.839136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ca90a-e186-4074-8564-69b8ec4cbc01 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:35.849874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ca90a-e186-4074-8564-69b8ec4cbc01 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:35.855211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290203e-4351-4674-98ca-2ecd39a538bf tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d6183cb70d41ae89189d68bcb3921c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63910efb635c47c9beb88f8a5e4a2ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:35.855836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290203e-4351-4674-98ca-2ecd39a538bf tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:35.856122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290203e-4351-4674-98ca-2ecd39a538bf tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:35.856398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290203e-4351-4674-98ca-2ecd39a538bf tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:35.857088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290203e-4351-4674-98ca-2ecd39a538bf tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:35.858681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290203e-4351-4674-98ca-2ecd39a538bf tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:35.864258 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2649/5364] 10.222.0.16 () {58 vars in 1190 bytes} [Sat Jul 16 21:26:35 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 451 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:26:35.868682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839dfde8-93a1-4434-ac56-a1a92f0ce4e4 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:35.879140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839dfde8-93a1-4434-ac56-a1a92f0ce4e4 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:35.883857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6929d-b74a-4c1e-a16f-c75e66f49a96 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d6183cb70d41ae89189d68bcb3921c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63910efb635c47c9beb88f8a5e4a2ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:35.884734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6929d-b74a-4c1e-a16f-c75e66f49a96 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:35.885002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6929d-b74a-4c1e-a16f-c75e66f49a96 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:35.885283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6929d-b74a-4c1e-a16f-c75e66f49a96 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/1dfe015b1dd946d28c6b043b07fd4220` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:35.885937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6929d-b74a-4c1e-a16f-c75e66f49a96 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=1dfe015b1dd946d28c6b043b07fd4220)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:35.887569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6929d-b74a-4c1e-a16f-c75e66f49a96 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:35.906236 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-53f6929d-b74a-4c1e-a16f-c75e66f49a96 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Could not find Endpoint Group: 1dfe015b1dd946d28c6b043b07fd4220.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 1dfe015b1dd946d28c6b043b07fd4220. Jul 16 21:26:35.906236 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:26:35.906236 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:26:35.906236 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:26:35.906236 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:26:35.906236 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:26:35.906236 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:26:35.906236 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:26:35.906236 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:26:35.906236 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:26:35.906236 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:26:35.906236 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:26:35.906236 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Jul 16 21:26:35.906236 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Jul 16 21:26:35.907183 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Jul 16 21:26:35.907183 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Jul 16 21:26:35.907183 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Jul 16 21:26:35.907183 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Jul 16 21:26:35.907183 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 1dfe015b1dd946d28c6b043b07fd4220. Jul 16 21:26:35.907183 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:26:35.907687 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2716/5365] 10.222.0.16 () {58 vars in 1292 bytes} [Sat Jul 16 21:26:35 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/1dfe015b1dd946d28c6b043b07fd4220 => generated 120 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:26:35.912406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290203e-4351-4674-98ca-2ecd39a538bf tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:35.923167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290203e-4351-4674-98ca-2ecd39a538bf tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:35.929628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb65b60-b73b-461a-a9d2-805c4fe285be tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d6183cb70d41ae89189d68bcb3921c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63910efb635c47c9beb88f8a5e4a2ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:35.930485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb65b60-b73b-461a-a9d2-805c4fe285be tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:35.930770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb65b60-b73b-461a-a9d2-805c4fe285be tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:35.931074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb65b60-b73b-461a-a9d2-805c4fe285be tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] PATH_INFO: `/v3/services/d709f9c6d08c46ffad8672ef37397d4f` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:35.931723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb65b60-b73b-461a-a9d2-805c4fe285be tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d709f9c6d08c46ffad8672ef37397d4f)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:35.933377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb65b60-b73b-461a-a9d2-805c4fe285be tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:36.023038 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2650/5366] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:35 2022] DELETE /identity/v3/services/d709f9c6d08c46ffad8672ef37397d4f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:36.028130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6929d-b74a-4c1e-a16f-c75e66f49a96 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:36.039717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6929d-b74a-4c1e-a16f-c75e66f49a96 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:36.057583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e640ebe-cf98-4d6e-b370-872f0ffb60fc tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d6183cb70d41ae89189d68bcb3921c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63910efb635c47c9beb88f8a5e4a2ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:36.059678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e640ebe-cf98-4d6e-b370-872f0ffb60fc tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:36.059678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e640ebe-cf98-4d6e-b370-872f0ffb60fc tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:36.059678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e640ebe-cf98-4d6e-b370-872f0ffb60fc tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:36.060016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e640ebe-cf98-4d6e-b370-872f0ffb60fc tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:36.061617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e640ebe-cf98-4d6e-b370-872f0ffb60fc tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:36.158394 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2717/5367] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:36 2022] POST /identity/v3/services => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:36.163354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb65b60-b73b-461a-a9d2-805c4fe285be tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:36.174832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb65b60-b73b-461a-a9d2-805c4fe285be tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:36.191746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53972639-088e-422f-a4c6-d51001d98e61 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d6183cb70d41ae89189d68bcb3921c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63910efb635c47c9beb88f8a5e4a2ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:36.192400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53972639-088e-422f-a4c6-d51001d98e61 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:36.192691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53972639-088e-422f-a4c6-d51001d98e61 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:36.193094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53972639-088e-422f-a4c6-d51001d98e61 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:36.193832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53972639-088e-422f-a4c6-d51001d98e61 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:36.194860 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-53972639-088e-422f-a4c6-d51001d98e61 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:26:36.194860 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:26:36.194860 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:26:36.195788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53972639-088e-422f-a4c6-d51001d98e61 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:36.280938 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2651/5368] 10.222.0.16 () {60 vars in 1212 bytes} [Sat Jul 16 21:26:36 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:36.285886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e640ebe-cf98-4d6e-b370-872f0ffb60fc tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:36.296934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e640ebe-cf98-4d6e-b370-872f0ffb60fc tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:36.302149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadd8a3-a166-4539-b9f6-89db6c26df86 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d6183cb70d41ae89189d68bcb3921c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63910efb635c47c9beb88f8a5e4a2ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:36.302827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadd8a3-a166-4539-b9f6-89db6c26df86 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:36.303145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadd8a3-a166-4539-b9f6-89db6c26df86 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:36.303426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadd8a3-a166-4539-b9f6-89db6c26df86 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:36.304183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadd8a3-a166-4539-b9f6-89db6c26df86 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:36.305773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadd8a3-a166-4539-b9f6-89db6c26df86 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:36.533719 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2718/5369] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:36 2022] POST /identity/v3/services => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:36.537898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53972639-088e-422f-a4c6-d51001d98e61 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:36.548556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53972639-088e-422f-a4c6-d51001d98e61 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:36.592039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc795e2-3447-4d5c-8fdc-9e5d1a625574 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d6183cb70d41ae89189d68bcb3921c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63910efb635c47c9beb88f8a5e4a2ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:36.592039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc795e2-3447-4d5c-8fdc-9e5d1a625574 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:36.592039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc795e2-3447-4d5c-8fdc-9e5d1a625574 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:36.592464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc795e2-3447-4d5c-8fdc-9e5d1a625574 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/499a79e0afaf44abbcc691779fdbcc3c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:36.592464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc795e2-3447-4d5c-8fdc-9e5d1a625574 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=499a79e0afaf44abbcc691779fdbcc3c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:36.592464 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-3fc795e2-3447-4d5c-8fdc-9e5d1a625574 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:26:36.592464 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:26:36.592464 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:26:36.592464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc795e2-3447-4d5c-8fdc-9e5d1a625574 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:36.741790 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2652/5370] 10.222.0.16 () {60 vars in 1312 bytes} [Sat Jul 16 21:26:36 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/499a79e0afaf44abbcc691779fdbcc3c => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:26:36.749123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadd8a3-a166-4539-b9f6-89db6c26df86 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:36.755774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadd8a3-a166-4539-b9f6-89db6c26df86 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:36.760570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a85b0-0894-4c3c-ba87-2dcd6a197965 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d6183cb70d41ae89189d68bcb3921c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63910efb635c47c9beb88f8a5e4a2ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:36.761416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a85b0-0894-4c3c-ba87-2dcd6a197965 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:36.761702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a85b0-0894-4c3c-ba87-2dcd6a197965 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:36.761978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a85b0-0894-4c3c-ba87-2dcd6a197965 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] PATH_INFO: `/v3/services/1847821bf9964576a7d73b782647a036` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:36.762627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a85b0-0894-4c3c-ba87-2dcd6a197965 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1847821bf9964576a7d73b782647a036)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:36.764677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a85b0-0894-4c3c-ba87-2dcd6a197965 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:36.915620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:36.923452 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2719/5371] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:36 2022] DELETE /identity/v3/services/1847821bf9964576a7d73b782647a036 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:36.927763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc795e2-3447-4d5c-8fdc-9e5d1a625574 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:36.939137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc795e2-3447-4d5c-8fdc-9e5d1a625574 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:36.958883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9fb14-9233-4810-a8e1-42841f045ed2 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d6183cb70d41ae89189d68bcb3921c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63910efb635c47c9beb88f8a5e4a2ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:36.958883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9fb14-9233-4810-a8e1-42841f045ed2 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:36.958883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9fb14-9233-4810-a8e1-42841f045ed2 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:36.970104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9fb14-9233-4810-a8e1-42841f045ed2 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/499a79e0afaf44abbcc691779fdbcc3c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:36.970104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9fb14-9233-4810-a8e1-42841f045ed2 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=499a79e0afaf44abbcc691779fdbcc3c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:36.970104 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-d8c9fb14-9233-4810-a8e1-42841f045ed2 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:26:36.970104 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:26:36.970104 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:26:36.970104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9fb14-9233-4810-a8e1-42841f045ed2 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:37.069119 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2653/5372] 10.222.0.16 () {58 vars in 1292 bytes} [Sat Jul 16 21:26:36 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/499a79e0afaf44abbcc691779fdbcc3c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:37.073344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a85b0-0894-4c3c-ba87-2dcd6a197965 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:37.084812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a85b0-0894-4c3c-ba87-2dcd6a197965 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:37.089443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7378a-4bf3-48f3-90c7-f50ee713a822 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d6183cb70d41ae89189d68bcb3921c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63910efb635c47c9beb88f8a5e4a2ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:37.090282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7378a-4bf3-48f3-90c7-f50ee713a822 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:37.090565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7378a-4bf3-48f3-90c7-f50ee713a822 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:37.090840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7378a-4bf3-48f3-90c7-f50ee713a822 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] PATH_INFO: `/v3/services/88a6b334b1dc458b8fe3b6f81db1d0fc` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:37.091528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7378a-4bf3-48f3-90c7-f50ee713a822 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorizing `identity:delete_service(service_id=88a6b334b1dc458b8fe3b6f81db1d0fc)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:37.093129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7378a-4bf3-48f3-90c7-f50ee713a822 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:37.207685 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2720/5373] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:37 2022] DELETE /identity/v3/services/88a6b334b1dc458b8fe3b6f81db1d0fc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:37.213876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9fb14-9233-4810-a8e1-42841f045ed2 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:37.226664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9fb14-9233-4810-a8e1-42841f045ed2 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:37.244875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03945408-cf26-4978-b40b-e71851437701 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d6183cb70d41ae89189d68bcb3921c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63910efb635c47c9beb88f8a5e4a2ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:37.245942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03945408-cf26-4978-b40b-e71851437701 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:37.246221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03945408-cf26-4978-b40b-e71851437701 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:37.246493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03945408-cf26-4978-b40b-e71851437701 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/c60cfe43ba064d57b382e6a48cb038fa` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:37.247229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03945408-cf26-4978-b40b-e71851437701 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=c60cfe43ba064d57b382e6a48cb038fa)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:37.248914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03945408-cf26-4978-b40b-e71851437701 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:37.320832 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2654/5374] 10.222.0.16 () {58 vars in 1292 bytes} [Sat Jul 16 21:26:37 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/c60cfe43ba064d57b382e6a48cb038fa => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:37.324803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7378a-4bf3-48f3-90c7-f50ee713a822 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:37.341005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7378a-4bf3-48f3-90c7-f50ee713a822 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:37.345731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1ffe8-d42d-4209-bd61-1c6925c0b8a2 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d6183cb70d41ae89189d68bcb3921c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63910efb635c47c9beb88f8a5e4a2ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:37.346621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1ffe8-d42d-4209-bd61-1c6925c0b8a2 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:37.346909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1ffe8-d42d-4209-bd61-1c6925c0b8a2 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:37.347218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1ffe8-d42d-4209-bd61-1c6925c0b8a2 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] PATH_INFO: `/v3/services/ff31daee893a4efea84470286f02b561` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:37.348058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1ffe8-d42d-4209-bd61-1c6925c0b8a2 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ff31daee893a4efea84470286f02b561)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:37.349715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1ffe8-d42d-4209-bd61-1c6925c0b8a2 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:37.432045 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2721/5375] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:37 2022] DELETE /identity/v3/services/ff31daee893a4efea84470286f02b561 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:26:37.436831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03945408-cf26-4978-b40b-e71851437701 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:37.441652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=85,keystone:INSERT=8,keystone:DELETE=6,keystone:UPDATE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:37.529415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03945408-cf26-4978-b40b-e71851437701 tempest-EndPointGroupsTest-1711791696 tempest-EndPointGroupsTest-1711791696-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:37.541097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d63e5-ffea-4bee-ba4b-d2f3a3e09e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:37.542287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d63e5-ffea-4bee-ba4b-d2f3a3e09e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:37.542570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d63e5-ffea-4bee-ba4b-d2f3a3e09e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:37.542895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d63e5-ffea-4bee-ba4b-d2f3a3e09e65 admin admin] PATH_INFO: `/v3/users/9952a5670df2478e87a96ab0d8fbe11c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:37.544184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d63e5-ffea-4bee-ba4b-d2f3a3e09e65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9952a5670df2478e87a96ab0d8fbe11c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:37.546136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d63e5-ffea-4bee-ba4b-d2f3a3e09e65 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:37.784123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-352d63e5-ffea-4bee-ba4b-d2f3a3e09e65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9952a5670df2478e87a96ab0d8fbe11c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:37.797794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-352d63e5-ffea-4bee-ba4b-d2f3a3e09e65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9952a5670df2478e87a96ab0d8fbe11c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:37.879162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-352d63e5-ffea-4bee-ba4b-d2f3a3e09e65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9952a5670df2478e87a96ab0d8fbe11c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:37.881189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-352d63e5-ffea-4bee-ba4b-d2f3a3e09e65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9952a5670df2478e87a96ab0d8fbe11c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:37.881889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-352d63e5-ffea-4bee-ba4b-d2f3a3e09e65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9952a5670df2478e87a96ab0d8fbe11c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:37.887993 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2655/5376] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:26:37 2022] DELETE /identity/v3/users/9952a5670df2478e87a96ab0d8fbe11c => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:37.892595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b222e-0267-4407-8f96-13272f235a30 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:37.892898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b222e-0267-4407-8f96-13272f235a30 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:37.893161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b222e-0267-4407-8f96-13272f235a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:37.911755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-522b222e-0267-4407-8f96-13272f235a30 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:37.913070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-522b222e-0267-4407-8f96-13272f235a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:37.973995 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2722/5377] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:37.989810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d63e5-ffea-4bee-ba4b-d2f3a3e09e65 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:37.991251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-352d63e5-ffea-4bee-ba4b-d2f3a3e09e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:38.063191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d63e5-ffea-4bee-ba4b-d2f3a3e09e65 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:38.070688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e58338-f7c3-49f9-b9db-0f27f34c016a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:38.071670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e58338-f7c3-49f9-b9db-0f27f34c016a service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:38.075159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e58338-f7c3-49f9-b9db-0f27f34c016a service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:38.075159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e58338-f7c3-49f9-b9db-0f27f34c016a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:38.083356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e58338-f7c3-49f9-b9db-0f27f34c016a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:38.085331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e58338-f7c3-49f9-b9db-0f27f34c016a service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:38.096095 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2656/5378] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:26:38.655115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b222e-0267-4407-8f96-13272f235a30 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:38.657719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-522b222e-0267-4407-8f96-13272f235a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:38.680314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b222e-0267-4407-8f96-13272f235a30 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:38.685283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da1db9-52fd-44a6-8ae6-07ef4d439807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:38.686407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da1db9-52fd-44a6-8ae6-07ef4d439807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:38.686763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da1db9-52fd-44a6-8ae6-07ef4d439807 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:38.687186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da1db9-52fd-44a6-8ae6-07ef4d439807 admin admin] PATH_INFO: `/v3/projects/8c3fe15317854afe9dd09626423d236f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:38.688594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da1db9-52fd-44a6-8ae6-07ef4d439807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c3fe15317854afe9dd09626423d236f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:38.691217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da1db9-52fd-44a6-8ae6-07ef4d439807 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:38.811121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-17da1db9-52fd-44a6-8ae6-07ef4d439807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c3fe15317854afe9dd09626423d236f', 'request_id': 'req-17da1db9-52fd-44a6-8ae6-07ef4d439807'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:38.818591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-17da1db9-52fd-44a6-8ae6-07ef4d439807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c3fe15317854afe9dd09626423d236f', 'request_id': 'req-17da1db9-52fd-44a6-8ae6-07ef4d439807'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:38.826162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-17da1db9-52fd-44a6-8ae6-07ef4d439807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c3fe15317854afe9dd09626423d236f', 'request_id': 'req-17da1db9-52fd-44a6-8ae6-07ef4d439807'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:38.932728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-17da1db9-52fd-44a6-8ae6-07ef4d439807 admin admin] The token cache is being invalidate because project 8c3fe15317854afe9dd09626423d236f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:38.933273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-17da1db9-52fd-44a6-8ae6-07ef4d439807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:38.934468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-17da1db9-52fd-44a6-8ae6-07ef4d439807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:38.940015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e58338-f7c3-49f9-b9db-0f27f34c016a service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:38.941075 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2723/5379] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:38 2022] DELETE /identity/v3/projects/8c3fe15317854afe9dd09626423d236f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:38.950555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e58338-f7c3-49f9-b9db-0f27f34c016a service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:39.016873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea189f-edd6-475b-9f8f-8aa1a3d8aa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:39.018089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea189f-edd6-475b-9f8f-8aa1a3d8aa23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:39.018438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea189f-edd6-475b-9f8f-8aa1a3d8aa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:39.018721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea189f-edd6-475b-9f8f-8aa1a3d8aa23 admin admin] PATH_INFO: `/v3/users/f5d6183cb70d41ae89189d68bcb3921c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:39.020790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea189f-edd6-475b-9f8f-8aa1a3d8aa23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d6183cb70d41ae89189d68bcb3921c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:39.022890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea189f-edd6-475b-9f8f-8aa1a3d8aa23 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:39.219877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-95ea189f-edd6-475b-9f8f-8aa1a3d8aa23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d6183cb70d41ae89189d68bcb3921c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:39.233658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-95ea189f-edd6-475b-9f8f-8aa1a3d8aa23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d6183cb70d41ae89189d68bcb3921c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:39.325945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-95ea189f-edd6-475b-9f8f-8aa1a3d8aa23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d6183cb70d41ae89189d68bcb3921c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:39.334267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-95ea189f-edd6-475b-9f8f-8aa1a3d8aa23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d6183cb70d41ae89189d68bcb3921c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:39.334935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-95ea189f-edd6-475b-9f8f-8aa1a3d8aa23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d6183cb70d41ae89189d68bcb3921c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:39.340840 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2657/5380] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:26:38 2022] DELETE /identity/v3/users/f5d6183cb70d41ae89189d68bcb3921c => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:39.792382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da1db9-52fd-44a6-8ae6-07ef4d439807 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:39.793630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-17da1db9-52fd-44a6-8ae6-07ef4d439807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:39.809218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da1db9-52fd-44a6-8ae6-07ef4d439807 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:39.837163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:39.897977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f255b-771e-45ae-8601-904c81875233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:39.898933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f255b-771e-45ae-8601-904c81875233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:39.899319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f255b-771e-45ae-8601-904c81875233 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:39.899705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f255b-771e-45ae-8601-904c81875233 admin admin] PATH_INFO: `/v3/projects/63910efb635c47c9beb88f8a5e4a2ccb` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:39.901055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f255b-771e-45ae-8601-904c81875233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63910efb635c47c9beb88f8a5e4a2ccb)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:39.903727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f255b-771e-45ae-8601-904c81875233 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:40.018685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-439f255b-771e-45ae-8601-904c81875233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63910efb635c47c9beb88f8a5e4a2ccb', 'request_id': 'req-439f255b-771e-45ae-8601-904c81875233'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:40.027325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-439f255b-771e-45ae-8601-904c81875233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63910efb635c47c9beb88f8a5e4a2ccb', 'request_id': 'req-439f255b-771e-45ae-8601-904c81875233'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:40.038115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-439f255b-771e-45ae-8601-904c81875233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63910efb635c47c9beb88f8a5e4a2ccb', 'request_id': 'req-439f255b-771e-45ae-8601-904c81875233'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:40.109860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-439f255b-771e-45ae-8601-904c81875233 admin admin] The token cache is being invalidate because project 63910efb635c47c9beb88f8a5e4a2ccb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:40.110412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-439f255b-771e-45ae-8601-904c81875233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:40.111281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-439f255b-771e-45ae-8601-904c81875233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:40.113042 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2724/5381] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:39 2022] DELETE /identity/v3/projects/63910efb635c47c9beb88f8a5e4a2ccb => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:40.118931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a3009-7e80-4ba1-a875-28aecf07dd53 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:40.119455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a3009-7e80-4ba1-a875-28aecf07dd53 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:40.119551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a3009-7e80-4ba1-a875-28aecf07dd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:40.139057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f06a3009-7e80-4ba1-a875-28aecf07dd53 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:40.140541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f06a3009-7e80-4ba1-a875-28aecf07dd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:40.168873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:40.214611 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2658/5382] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:40.224508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac9f8a-d022-433f-ab42-7f2b447d483c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:40.224887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac9f8a-d022-433f-ab42-7f2b447d483c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:40.225275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac9f8a-d022-433f-ab42-7f2b447d483c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:40.246433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-bfac9f8a-d022-433f-ab42-7f2b447d483c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:40.247704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bfac9f8a-d022-433f-ab42-7f2b447d483c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:40.259149 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2725/5383] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:40.263545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a3009-7e80-4ba1-a875-28aecf07dd53 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:40.274481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a3009-7e80-4ba1-a875-28aecf07dd53 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:40.280122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202dee52-4d81-40e9-b194-934b38311cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:40.280952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202dee52-4d81-40e9-b194-934b38311cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:40.281501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202dee52-4d81-40e9-b194-934b38311cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:40.281864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202dee52-4d81-40e9-b194-934b38311cd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:40.282633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202dee52-4d81-40e9-b194-934b38311cd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:26:40.283056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202dee52-4d81-40e9-b194-934b38311cd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:40.289057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202dee52-4d81-40e9-b194-934b38311cd1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:40.304246 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2659/5384] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:26:40.306072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac9f8a-d022-433f-ab42-7f2b447d483c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:40.317529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac9f8a-d022-433f-ab42-7f2b447d483c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:40.323334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c391a1-f0f2-426c-be99-06a13755f944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:40.324214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c391a1-f0f2-426c-be99-06a13755f944 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:40.324498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c391a1-f0f2-426c-be99-06a13755f944 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:40.324818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c391a1-f0f2-426c-be99-06a13755f944 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:40.325448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c391a1-f0f2-426c-be99-06a13755f944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:40.327524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c391a1-f0f2-426c-be99-06a13755f944 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:40.411384 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2726/5385] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:40 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:26:40.415227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202dee52-4d81-40e9-b194-934b38311cd1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:40.427129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202dee52-4d81-40e9-b194-934b38311cd1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:40.536039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342063ea-c6a6-4226-a13a-bb8030ba2e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:40.536927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342063ea-c6a6-4226-a13a-bb8030ba2e84 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:40.537440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342063ea-c6a6-4226-a13a-bb8030ba2e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:40.538013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342063ea-c6a6-4226-a13a-bb8030ba2e84 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:40.541661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342063ea-c6a6-4226-a13a-bb8030ba2e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:40.544146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342063ea-c6a6-4226-a13a-bb8030ba2e84 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:40.641016 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2660/5386] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:26:40 2022] POST /identity/v3/users => generated 284 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:26:40.645207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c391a1-f0f2-426c-be99-06a13755f944 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:40.655693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c391a1-f0f2-426c-be99-06a13755f944 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:40.660211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547f17c-e7ad-4e25-9bb1-f75837b76f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:40.660988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547f17c-e7ad-4e25-9bb1-f75837b76f58 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:40.661371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547f17c-e7ad-4e25-9bb1-f75837b76f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:40.661653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547f17c-e7ad-4e25-9bb1-f75837b76f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:40.662407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547f17c-e7ad-4e25-9bb1-f75837b76f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:40.664066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547f17c-e7ad-4e25-9bb1-f75837b76f58 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:40.674767 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2727/5387] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:40.679440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342063ea-c6a6-4226-a13a-bb8030ba2e84 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:40.689647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342063ea-c6a6-4226-a13a-bb8030ba2e84 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:40.694943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fed6ee-fc8e-4f9b-8fee-a9dd5a74a58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:40.695620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fed6ee-fc8e-4f9b-8fee-a9dd5a74a58e admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:40.695902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fed6ee-fc8e-4f9b-8fee-a9dd5a74a58e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:40.696182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fed6ee-fc8e-4f9b-8fee-a9dd5a74a58e admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:40.696904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fed6ee-fc8e-4f9b-8fee-a9dd5a74a58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:40.698489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fed6ee-fc8e-4f9b-8fee-a9dd5a74a58e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:40.708503 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2661/5388] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:40.712810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547f17c-e7ad-4e25-9bb1-f75837b76f58 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:40.722946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547f17c-e7ad-4e25-9bb1-f75837b76f58 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:40.727915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eabf38a-8926-4bbc-b631-ca4a991ec4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:40.729843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabf38a-8926-4bbc-b631-ca4a991ec4b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:40.729843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabf38a-8926-4bbc-b631-ca4a991ec4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:40.729843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabf38a-8926-4bbc-b631-ca4a991ec4b0 admin admin] PATH_INFO: `/v3/projects/54fbe893b86d448ebb9e9f285bdc25b5/users/c83f60ca52004c48afaa00d08dc28bde/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:40.745057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eabf38a-8926-4bbc-b631-ca4a991ec4b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54fbe893b86d448ebb9e9f285bdc25b5, user_id=c83f60ca52004c48afaa00d08dc28bde, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:40.747883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eabf38a-8926-4bbc-b631-ca4a991ec4b0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:40.838212 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2728/5389] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:26:40 2022] PUT /identity/v3/projects/54fbe893b86d448ebb9e9f285bdc25b5/users/c83f60ca52004c48afaa00d08dc28bde/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:40.849149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e86041-0509-4db8-8484-ab18a1049938 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:40.849575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e86041-0509-4db8-8484-ab18a1049938 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:40.849854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e86041-0509-4db8-8484-ab18a1049938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:40.886965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-67e86041-0509-4db8-8484-ab18a1049938 None None] MFA Rules not processed for user `c83f60ca52004c48afaa00d08dc28bde`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:40.888211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-67e86041-0509-4db8-8484-ab18a1049938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:40.966095 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2662/5390] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:26:40.968854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eabf38a-8926-4bbc-b631-ca4a991ec4b0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:41.051833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eabf38a-8926-4bbc-b631-ca4a991ec4b0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:41.057328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482531b1-a198-4173-80e1-7fae1a58c4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:41.058327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482531b1-a198-4173-80e1-7fae1a58c4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:41.058785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482531b1-a198-4173-80e1-7fae1a58c4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:41.060119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482531b1-a198-4173-80e1-7fae1a58c4a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:41.061365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482531b1-a198-4173-80e1-7fae1a58c4a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:41.063673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482531b1-a198-4173-80e1-7fae1a58c4a0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:41.206699 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2729/5391] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:40 2022] POST /identity/v3/projects => generated 365 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:26:41.209361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e86041-0509-4db8-8484-ab18a1049938 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:41.220653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e86041-0509-4db8-8484-ab18a1049938 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:41.277562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804aece-1502-41e0-a6c4-bda659ff8e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:41.278249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804aece-1502-41e0-a6c4-bda659ff8e01 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:41.278531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804aece-1502-41e0-a6c4-bda659ff8e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:41.278814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804aece-1502-41e0-a6c4-bda659ff8e01 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:41.279553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804aece-1502-41e0-a6c4-bda659ff8e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:41.284608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804aece-1502-41e0-a6c4-bda659ff8e01 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:41.431998 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2663/5392] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:26:41 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:26:41.436727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482531b1-a198-4173-80e1-7fae1a58c4a0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:41.445287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482531b1-a198-4173-80e1-7fae1a58c4a0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:41.450018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c83c5-756d-4a4f-b41d-b397a9f03798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:41.450678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c83c5-756d-4a4f-b41d-b397a9f03798 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:41.450959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c83c5-756d-4a4f-b41d-b397a9f03798 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:41.451268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c83c5-756d-4a4f-b41d-b397a9f03798 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:41.451985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c83c5-756d-4a4f-b41d-b397a9f03798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:41.453639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c83c5-756d-4a4f-b41d-b397a9f03798 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:41.469775 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2730/5393] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:41.471085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804aece-1502-41e0-a6c4-bda659ff8e01 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:41.483261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804aece-1502-41e0-a6c4-bda659ff8e01 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:41.488940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504ab83-f4c7-41b4-a076-3889e9a05f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:41.490335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504ab83-f4c7-41b4-a076-3889e9a05f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:41.490537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504ab83-f4c7-41b4-a076-3889e9a05f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:41.490817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504ab83-f4c7-41b4-a076-3889e9a05f1d admin admin] PATH_INFO: `/v3/projects/c062216ef42e4d7ba6fb28b44f0604d2/users/bcdbee75143a481faf7f9131f037fd39/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:41.507114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504ab83-f4c7-41b4-a076-3889e9a05f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c062216ef42e4d7ba6fb28b44f0604d2, user_id=bcdbee75143a481faf7f9131f037fd39, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:41.509732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504ab83-f4c7-41b4-a076-3889e9a05f1d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:41.637035 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2664/5394] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:26:41 2022] PUT /identity/v3/projects/c062216ef42e4d7ba6fb28b44f0604d2/users/bcdbee75143a481faf7f9131f037fd39/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:41.642123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c83c5-756d-4a4f-b41d-b397a9f03798 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:41.653924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c83c5-756d-4a4f-b41d-b397a9f03798 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:41.716808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34993d1d-4047-4b86-97a0-4e67e709bb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:41.717470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34993d1d-4047-4b86-97a0-4e67e709bb92 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:41.717747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34993d1d-4047-4b86-97a0-4e67e709bb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:41.718018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34993d1d-4047-4b86-97a0-4e67e709bb92 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:41.718769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34993d1d-4047-4b86-97a0-4e67e709bb92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:41.720433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34993d1d-4047-4b86-97a0-4e67e709bb92 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:41.731303 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2731/5395] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:41.735745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504ab83-f4c7-41b4-a076-3889e9a05f1d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:41.746650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504ab83-f4c7-41b4-a076-3889e9a05f1d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:41.751856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849adc8-b829-4105-98c7-59ab1b4e60ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:41.753215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849adc8-b829-4105-98c7-59ab1b4e60ec admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:41.753215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849adc8-b829-4105-98c7-59ab1b4e60ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:41.753383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849adc8-b829-4105-98c7-59ab1b4e60ec admin admin] PATH_INFO: `/v3/projects/c062216ef42e4d7ba6fb28b44f0604d2/users/bcdbee75143a481faf7f9131f037fd39/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:41.756043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849adc8-b829-4105-98c7-59ab1b4e60ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=c062216ef42e4d7ba6fb28b44f0604d2, user_id=bcdbee75143a481faf7f9131f037fd39, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:41.758733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849adc8-b829-4105-98c7-59ab1b4e60ec admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:41.769275 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2665/5396] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:26:41 2022] PUT /identity/v3/projects/c062216ef42e4d7ba6fb28b44f0604d2/users/bcdbee75143a481faf7f9131f037fd39/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:41.780488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a7037-2a37-409e-abfd-3f14aae13608 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:41.780865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a7037-2a37-409e-abfd-3f14aae13608 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:41.781158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a7037-2a37-409e-abfd-3f14aae13608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:41.812914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e12a7037-2a37-409e-abfd-3f14aae13608 None None] MFA Rules not processed for user `bcdbee75143a481faf7f9131f037fd39`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:41.814170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e12a7037-2a37-409e-abfd-3f14aae13608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:41.899336 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2732/5397] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:26:41.901735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849adc8-b829-4105-98c7-59ab1b4e60ec admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:41.915690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849adc8-b829-4105-98c7-59ab1b4e60ec admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:41.921082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938ca1d-adc4-4747-8575-2f6267725a82 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:41.921730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938ca1d-adc4-4747-8575-2f6267725a82 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:41.922022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938ca1d-adc4-4747-8575-2f6267725a82 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:41.922303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938ca1d-adc4-4747-8575-2f6267725a82 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:41.922998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938ca1d-adc4-4747-8575-2f6267725a82 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:41.925078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938ca1d-adc4-4747-8575-2f6267725a82 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:42.047982 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2666/5398] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:41 2022] POST /identity/v3/projects => generated 359 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:42.053001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a7037-2a37-409e-abfd-3f14aae13608 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:42.065101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a7037-2a37-409e-abfd-3f14aae13608 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:42.126337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47502ccf-11e6-4a46-a8cd-c8a8a1cd2e9a tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:42.126947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47502ccf-11e6-4a46-a8cd-c8a8a1cd2e9a tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:42.127287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47502ccf-11e6-4a46-a8cd-c8a8a1cd2e9a tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:42.127572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47502ccf-11e6-4a46-a8cd-c8a8a1cd2e9a tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:42.128289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47502ccf-11e6-4a46-a8cd-c8a8a1cd2e9a tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:42.131137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47502ccf-11e6-4a46-a8cd-c8a8a1cd2e9a tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:42.254224 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2733/5399] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:26:42 2022] POST /identity/v3/users => generated 373 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:26:42.256188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938ca1d-adc4-4747-8575-2f6267725a82 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:42.272923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938ca1d-adc4-4747-8575-2f6267725a82 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:42.278577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c9c66-8743-4172-aaaf-a1e918d8ac6b tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:42.279516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c9c66-8743-4172-aaaf-a1e918d8ac6b tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:42.279810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c9c66-8743-4172-aaaf-a1e918d8ac6b tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:42.280398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c9c66-8743-4172-aaaf-a1e918d8ac6b tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/users/0adbea859abf4c5780f485e105ac485a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:42.300579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c9c66-8743-4172-aaaf-a1e918d8ac6b tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:get_user(user_id=0adbea859abf4c5780f485e105ac485a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:42.307707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c9c66-8743-4172-aaaf-a1e918d8ac6b tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:42.307707 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2667/5400] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Jul 16 21:26:42 2022] GET /identity/v3/users/0adbea859abf4c5780f485e105ac485a => generated 373 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:26:42.310609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47502ccf-11e6-4a46-a8cd-c8a8a1cd2e9a tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:42.322362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47502ccf-11e6-4a46-a8cd-c8a8a1cd2e9a tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:42.327745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:42.331419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd81ce9-4d5f-45cf-aa29-071ca5b3fe73 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:42.334847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd81ce9-4d5f-45cf-aa29-071ca5b3fe73 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:42.334847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd81ce9-4d5f-45cf-aa29-071ca5b3fe73 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:42.334847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd81ce9-4d5f-45cf-aa29-071ca5b3fe73 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/users/0adbea859abf4c5780f485e105ac485a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:42.336407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd81ce9-4d5f-45cf-aa29-071ca5b3fe73 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0adbea859abf4c5780f485e105ac485a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:42.339241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd81ce9-4d5f-45cf-aa29-071ca5b3fe73 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:42.431553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4cd81ce9-4d5f-45cf-aa29-071ca5b3fe73 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0adbea859abf4c5780f485e105ac485a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:42.439871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4cd81ce9-4d5f-45cf-aa29-071ca5b3fe73 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0adbea859abf4c5780f485e105ac485a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:42.503732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4cd81ce9-4d5f-45cf-aa29-071ca5b3fe73 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0adbea859abf4c5780f485e105ac485a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:42.505921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4cd81ce9-4d5f-45cf-aa29-071ca5b3fe73 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0adbea859abf4c5780f485e105ac485a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:42.528578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:42.546964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4cd81ce9-4d5f-45cf-aa29-071ca5b3fe73 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0adbea859abf4c5780f485e105ac485a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:42.564700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c9c66-8743-4172-aaaf-a1e918d8ac6b tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:42.564907 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2734/5401] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:26:42 2022] DELETE /identity/v3/users/0adbea859abf4c5780f485e105ac485a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:42.566626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a49c9c66-8743-4172-aaaf-a1e918d8ac6b tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:42.624042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c9c66-8743-4172-aaaf-a1e918d8ac6b tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:42.808460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce547d6-19e2-4b8e-8ccc-b7d1d3ab0c54 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:42.809358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce547d6-19e2-4b8e-8ccc-b7d1d3ab0c54 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:42.809646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce547d6-19e2-4b8e-8ccc-b7d1d3ab0c54 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:42.809998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce547d6-19e2-4b8e-8ccc-b7d1d3ab0c54 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/projects/b092ae7439fb4673a77e1cef1f53792a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:42.811788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce547d6-19e2-4b8e-8ccc-b7d1d3ab0c54 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b092ae7439fb4673a77e1cef1f53792a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:42.814931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce547d6-19e2-4b8e-8ccc-b7d1d3ab0c54 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:42.976017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0ce547d6-19e2-4b8e-8ccc-b7d1d3ab0c54 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b092ae7439fb4673a77e1cef1f53792a', 'request_id': 'req-0ce547d6-19e2-4b8e-8ccc-b7d1d3ab0c54'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:42.981004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0ce547d6-19e2-4b8e-8ccc-b7d1d3ab0c54 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b092ae7439fb4673a77e1cef1f53792a', 'request_id': 'req-0ce547d6-19e2-4b8e-8ccc-b7d1d3ab0c54'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:42.989596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0ce547d6-19e2-4b8e-8ccc-b7d1d3ab0c54 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b092ae7439fb4673a77e1cef1f53792a', 'request_id': 'req-0ce547d6-19e2-4b8e-8ccc-b7d1d3ab0c54'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:43.060114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0ce547d6-19e2-4b8e-8ccc-b7d1d3ab0c54 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] The token cache is being invalidate because project b092ae7439fb4673a77e1cef1f53792a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:43.060636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0ce547d6-19e2-4b8e-8ccc-b7d1d3ab0c54 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:43.061620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0ce547d6-19e2-4b8e-8ccc-b7d1d3ab0c54 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:43.063578 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2668/5402] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:42 2022] DELETE /identity/v3/projects/b092ae7439fb4673a77e1cef1f53792a => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:43.069370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd81ce9-4d5f-45cf-aa29-071ca5b3fe73 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:43.087470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd81ce9-4d5f-45cf-aa29-071ca5b3fe73 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:43.182772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98588089-6335-4c06-bba4-09bef8c38b1d tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:43.183695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98588089-6335-4c06-bba4-09bef8c38b1d tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:43.184085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98588089-6335-4c06-bba4-09bef8c38b1d tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:43.184471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98588089-6335-4c06-bba4-09bef8c38b1d tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:43.185300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98588089-6335-4c06-bba4-09bef8c38b1d tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:43.187593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98588089-6335-4c06-bba4-09bef8c38b1d tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:43.318398 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2735/5403] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:43 2022] POST /identity/v3/projects => generated 359 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:26:43.320765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce547d6-19e2-4b8e-8ccc-b7d1d3ab0c54 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:43.322481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0ce547d6-19e2-4b8e-8ccc-b7d1d3ab0c54 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:43.362684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce547d6-19e2-4b8e-8ccc-b7d1d3ab0c54 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:43.499161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669a683-c50a-4d74-b264-12714834e3ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:43.500388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669a683-c50a-4d74-b264-12714834e3ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:43.500848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669a683-c50a-4d74-b264-12714834e3ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:43.502549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669a683-c50a-4d74-b264-12714834e3ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:43.503732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669a683-c50a-4d74-b264-12714834e3ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:43.508089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669a683-c50a-4d74-b264-12714834e3ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:43.608886 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2669/5404] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:26:43 2022] POST /identity/v3/users => generated 414 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:43.612543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98588089-6335-4c06-bba4-09bef8c38b1d tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:43.643519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98588089-6335-4c06-bba4-09bef8c38b1d tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:43.665995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4b839-0bd0-46bf-99de-c5b0ae76c022 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:43.674273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4b839-0bd0-46bf-99de-c5b0ae76c022 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:43.674637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:43.675465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4b839-0bd0-46bf-99de-c5b0ae76c022 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:43.677037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4b839-0bd0-46bf-99de-c5b0ae76c022 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:43.678035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4b839-0bd0-46bf-99de-c5b0ae76c022 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:43.684146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4b839-0bd0-46bf-99de-c5b0ae76c022 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:43.858255 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2736/5405] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:26:43 2022] POST /identity/v3/roles => generated 240 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:26:43.867753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669a683-c50a-4d74-b264-12714834e3ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:43.885022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669a683-c50a-4d74-b264-12714834e3ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:43.898877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427dc0e-92ac-4a1e-acd2-4f7426d7bec6 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:43.899803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427dc0e-92ac-4a1e-acd2-4f7426d7bec6 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:43.900094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427dc0e-92ac-4a1e-acd2-4f7426d7bec6 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:43.900530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427dc0e-92ac-4a1e-acd2-4f7426d7bec6 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/users/e8333d7b41454d3680f9416b72cdcd1c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:43.934910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427dc0e-92ac-4a1e-acd2-4f7426d7bec6 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:get_user(user_id=e8333d7b41454d3680f9416b72cdcd1c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:43.937359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427dc0e-92ac-4a1e-acd2-4f7426d7bec6 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:43.940574 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2670/5406] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Jul 16 21:26:43 2022] GET /identity/v3/users/e8333d7b41454d3680f9416b72cdcd1c => generated 414 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:26:43.945566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4b839-0bd0-46bf-99de-c5b0ae76c022 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:43.962247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4b839-0bd0-46bf-99de-c5b0ae76c022 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:43.969323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16399cfd-4878-4579-961a-679b8ef75fe2 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:43.970203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16399cfd-4878-4579-961a-679b8ef75fe2 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:43.970490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16399cfd-4878-4579-961a-679b8ef75fe2 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:43.970991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16399cfd-4878-4579-961a-679b8ef75fe2 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/roles/0c1e79ae73b640d68efecec07bf85da4` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:43.975925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16399cfd-4878-4579-961a-679b8ef75fe2 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:get_role(role_id=0c1e79ae73b640d68efecec07bf85da4)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:43.976886 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-16399cfd-4878-4579-961a-679b8ef75fe2 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:26:43.976886 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:26:43.976886 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:26:43.979923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16399cfd-4878-4579-961a-679b8ef75fe2 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:43.998418 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2737/5407] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Jul 16 21:26:43 2022] GET /identity/v3/roles/0c1e79ae73b640d68efecec07bf85da4 => generated 240 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:26:43.998531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427dc0e-92ac-4a1e-acd2-4f7426d7bec6 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:44.012565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427dc0e-92ac-4a1e-acd2-4f7426d7bec6 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:44.029894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc3dee-5295-4f65-a747-037f85ecabda tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:44.030577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3dee-5295-4f65-a747-037f85ecabda tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:44.030864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3dee-5295-4f65-a747-037f85ecabda tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:44.031168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3dee-5295-4f65-a747-037f85ecabda tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:44.031860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc3dee-5295-4f65-a747-037f85ecabda tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:44.033851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc3dee-5295-4f65-a747-037f85ecabda tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:44.148895 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2671/5408] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:43 2022] POST /identity/v3/projects => generated 359 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:44.152840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16399cfd-4878-4579-961a-679b8ef75fe2 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:44.164919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16399cfd-4878-4579-961a-679b8ef75fe2 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:44.230906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287885d-b88b-4458-8949-a9d08a44dc84 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:44.231730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287885d-b88b-4458-8949-a9d08a44dc84 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:44.232017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287885d-b88b-4458-8949-a9d08a44dc84 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:44.232302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287885d-b88b-4458-8949-a9d08a44dc84 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/projects/24ed26459e4947b495f138c6e0c303e8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:44.233487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287885d-b88b-4458-8949-a9d08a44dc84 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:get_project(project_id=24ed26459e4947b495f138c6e0c303e8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:44.235593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287885d-b88b-4458-8949-a9d08a44dc84 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:44.237299 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2738/5409] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:26:44 2022] GET /identity/v3/projects/24ed26459e4947b495f138c6e0c303e8 => generated 359 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:26:44.242047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc3dee-5295-4f65-a747-037f85ecabda tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:44.253230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc3dee-5295-4f65-a747-037f85ecabda tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:44.259182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31779d2a-1a6c-4de9-9226-ec3d3595f5b9 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:44.259182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31779d2a-1a6c-4de9-9226-ec3d3595f5b9 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:44.259182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31779d2a-1a6c-4de9-9226-ec3d3595f5b9 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:44.259618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31779d2a-1a6c-4de9-9226-ec3d3595f5b9 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/projects/24ed26459e4947b495f138c6e0c303e8/users/e8333d7b41454d3680f9416b72cdcd1c/roles/0c1e79ae73b640d68efecec07bf85da4` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:44.261775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31779d2a-1a6c-4de9-9226-ec3d3595f5b9 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:create_grant(project_id=24ed26459e4947b495f138c6e0c303e8, user_id=e8333d7b41454d3680f9416b72cdcd1c, role_id=0c1e79ae73b640d68efecec07bf85da4)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:44.264741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31779d2a-1a6c-4de9-9226-ec3d3595f5b9 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:44.331552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:44.406158 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2672/5410] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:26:44 2022] PUT /identity/v3/projects/24ed26459e4947b495f138c6e0c303e8/users/e8333d7b41454d3680f9416b72cdcd1c/roles/0c1e79ae73b640d68efecec07bf85da4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:44.411769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287885d-b88b-4458-8949-a9d08a44dc84 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:44.421943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287885d-b88b-4458-8949-a9d08a44dc84 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:44.481083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069d788-2365-4c0f-8708-3667831e9af7 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:44.481669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069d788-2365-4c0f-8708-3667831e9af7 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:44.481958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069d788-2365-4c0f-8708-3667831e9af7 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:44.482245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069d788-2365-4c0f-8708-3667831e9af7 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:44.482935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069d788-2365-4c0f-8708-3667831e9af7 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:44.484867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069d788-2365-4c0f-8708-3667831e9af7 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:44.592261 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2739/5411] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:44 2022] POST /identity/v3/projects => generated 360 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:26:44.593891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31779d2a-1a6c-4de9-9226-ec3d3595f5b9 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:44.609286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31779d2a-1a6c-4de9-9226-ec3d3595f5b9 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:44.669819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841e8eb-a89b-41bc-b2a3-2adc95513ddc tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:44.670689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841e8eb-a89b-41bc-b2a3-2adc95513ddc tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:44.670971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841e8eb-a89b-41bc-b2a3-2adc95513ddc tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:44.671288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841e8eb-a89b-41bc-b2a3-2adc95513ddc tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/projects/2cc375a529cc47239baf3de4e1fbf73e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:44.672564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841e8eb-a89b-41bc-b2a3-2adc95513ddc tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:get_project(project_id=2cc375a529cc47239baf3de4e1fbf73e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:44.674599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841e8eb-a89b-41bc-b2a3-2adc95513ddc tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:44.676406 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2673/5412] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:26:44 2022] GET /identity/v3/projects/2cc375a529cc47239baf3de4e1fbf73e => generated 360 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:26:44.680991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069d788-2365-4c0f-8708-3667831e9af7 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:44.692423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069d788-2365-4c0f-8708-3667831e9af7 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:44.697559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5fbf0-cf47-4c0b-bd7a-8a7f0744c44c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:44.698542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5fbf0-cf47-4c0b-bd7a-8a7f0744c44c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:44.698812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5fbf0-cf47-4c0b-bd7a-8a7f0744c44c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:44.699127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5fbf0-cf47-4c0b-bd7a-8a7f0744c44c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/projects/2cc375a529cc47239baf3de4e1fbf73e/users/e8333d7b41454d3680f9416b72cdcd1c/roles/0c1e79ae73b640d68efecec07bf85da4` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:44.701562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5fbf0-cf47-4c0b-bd7a-8a7f0744c44c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2cc375a529cc47239baf3de4e1fbf73e, user_id=e8333d7b41454d3680f9416b72cdcd1c, role_id=0c1e79ae73b640d68efecec07bf85da4)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:44.704471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5fbf0-cf47-4c0b-bd7a-8a7f0744c44c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:44.814539 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2740/5413] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:26:44 2022] PUT /identity/v3/projects/2cc375a529cc47239baf3de4e1fbf73e/users/e8333d7b41454d3680f9416b72cdcd1c/roles/0c1e79ae73b640d68efecec07bf85da4 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:44.822725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841e8eb-a89b-41bc-b2a3-2adc95513ddc tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:44.836253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841e8eb-a89b-41bc-b2a3-2adc95513ddc tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:44.919501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ce3df-5f94-4633-9555-7b86bd65a796 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:44.920377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ce3df-5f94-4633-9555-7b86bd65a796 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:44.920662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ce3df-5f94-4633-9555-7b86bd65a796 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:44.920938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ce3df-5f94-4633-9555-7b86bd65a796 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/users/e8333d7b41454d3680f9416b72cdcd1c/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:44.922461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ce3df-5f94-4633-9555-7b86bd65a796 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=e8333d7b41454d3680f9416b72cdcd1c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:44.924754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ce3df-5f94-4633-9555-7b86bd65a796 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:44.973541 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2674/5414] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Jul 16 21:26:44 2022] GET /identity/v3/users/e8333d7b41454d3680f9416b72cdcd1c/projects => generated 843 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:26:44.977736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5fbf0-cf47-4c0b-bd7a-8a7f0744c44c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:44.989946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5fbf0-cf47-4c0b-bd7a-8a7f0744c44c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:44.994855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a79b0-1623-4c5a-85ed-4df041d1b5ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:44.995755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a79b0-1623-4c5a-85ed-4df041d1b5ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:44.996046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a79b0-1623-4c5a-85ed-4df041d1b5ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:44.996320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a79b0-1623-4c5a-85ed-4df041d1b5ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/projects/2cc375a529cc47239baf3de4e1fbf73e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:44.997526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a79b0-1623-4c5a-85ed-4df041d1b5ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2cc375a529cc47239baf3de4e1fbf73e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:44.999478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a79b0-1623-4c5a-85ed-4df041d1b5ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:45.076492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425afc7b-056e-4e37-b6fa-60a9dfade356 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:45.076492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425afc7b-056e-4e37-b6fa-60a9dfade356 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:45.076492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425afc7b-056e-4e37-b6fa-60a9dfade356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:45.100489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-425afc7b-056e-4e37-b6fa-60a9dfade356 None None] MFA Rules not processed for user `027dcc48e4fd4c36a5004096ad5e43f8`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:45.105236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-425afc7b-056e-4e37-b6fa-60a9dfade356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:45.177420 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2675/5415] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:45.228374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1c0a79b0-1623-4c5a-85ed-4df041d1b5ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cc375a529cc47239baf3de4e1fbf73e', 'request_id': 'req-1c0a79b0-1623-4c5a-85ed-4df041d1b5ba'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:45.235466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1c0a79b0-1623-4c5a-85ed-4df041d1b5ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cc375a529cc47239baf3de4e1fbf73e', 'request_id': 'req-1c0a79b0-1623-4c5a-85ed-4df041d1b5ba'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:45.248262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1c0a79b0-1623-4c5a-85ed-4df041d1b5ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cc375a529cc47239baf3de4e1fbf73e', 'request_id': 'req-1c0a79b0-1623-4c5a-85ed-4df041d1b5ba'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:45.360716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1c0a79b0-1623-4c5a-85ed-4df041d1b5ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] The token cache is being invalidate because project 2cc375a529cc47239baf3de4e1fbf73e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:45.361151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1c0a79b0-1623-4c5a-85ed-4df041d1b5ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:45.362053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1c0a79b0-1623-4c5a-85ed-4df041d1b5ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:45.365447 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2741/5416] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:44 2022] DELETE /identity/v3/projects/2cc375a529cc47239baf3de4e1fbf73e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:45.369523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425afc7b-056e-4e37-b6fa-60a9dfade356 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:45.395812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425afc7b-056e-4e37-b6fa-60a9dfade356 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:45.465895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:45.525342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da2680-3a75-49ab-95dd-ae5697054aec tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:45.526508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da2680-3a75-49ab-95dd-ae5697054aec tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:45.527592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da2680-3a75-49ab-95dd-ae5697054aec tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:45.528080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da2680-3a75-49ab-95dd-ae5697054aec tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/projects/24ed26459e4947b495f138c6e0c303e8` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:45.529771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da2680-3a75-49ab-95dd-ae5697054aec tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:delete_project(project_id=24ed26459e4947b495f138c6e0c303e8)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:45.531877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da2680-3a75-49ab-95dd-ae5697054aec tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:45.778734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-37da2680-3a75-49ab-95dd-ae5697054aec tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24ed26459e4947b495f138c6e0c303e8', 'request_id': 'req-37da2680-3a75-49ab-95dd-ae5697054aec'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:45.787887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-37da2680-3a75-49ab-95dd-ae5697054aec tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24ed26459e4947b495f138c6e0c303e8', 'request_id': 'req-37da2680-3a75-49ab-95dd-ae5697054aec'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:45.799113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-37da2680-3a75-49ab-95dd-ae5697054aec tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24ed26459e4947b495f138c6e0c303e8', 'request_id': 'req-37da2680-3a75-49ab-95dd-ae5697054aec'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:45.877808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-37da2680-3a75-49ab-95dd-ae5697054aec tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] The token cache is being invalidate because project 24ed26459e4947b495f138c6e0c303e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:45.881624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-37da2680-3a75-49ab-95dd-ae5697054aec tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:45.882510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-37da2680-3a75-49ab-95dd-ae5697054aec tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:45.884198 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2676/5417] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:45 2022] DELETE /identity/v3/projects/24ed26459e4947b495f138c6e0c303e8 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:45.888557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a79b0-1623-4c5a-85ed-4df041d1b5ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:45.890361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1c0a79b0-1623-4c5a-85ed-4df041d1b5ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:45.913553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a79b0-1623-4c5a-85ed-4df041d1b5ba tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:45.988529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f803f8a-f324-4754-83a7-d6518cb6336c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:45.989589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f803f8a-f324-4754-83a7-d6518cb6336c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:45.990078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f803f8a-f324-4754-83a7-d6518cb6336c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:45.990499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f803f8a-f324-4754-83a7-d6518cb6336c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/roles/0c1e79ae73b640d68efecec07bf85da4` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:45.992881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f803f8a-f324-4754-83a7-d6518cb6336c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0c1e79ae73b640d68efecec07bf85da4)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:45.995414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f803f8a-f324-4754-83a7-d6518cb6336c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:46.063414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:46.197312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5f803f8a-f324-4754-83a7-d6518cb6336c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invalidating the token cache because role 0c1e79ae73b640d68efecec07bf85da4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:46.199780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5f803f8a-f324-4754-83a7-d6518cb6336c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:46.200524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5f803f8a-f324-4754-83a7-d6518cb6336c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:46.202375 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2742/5418] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:26:45 2022] DELETE /identity/v3/roles/0c1e79ae73b640d68efecec07bf85da4 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:46.206525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da2680-3a75-49ab-95dd-ae5697054aec tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:46.208549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-37da2680-3a75-49ab-95dd-ae5697054aec tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:46.226527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da2680-3a75-49ab-95dd-ae5697054aec tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:46.307409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e262c7-d6ba-4a8f-a81c-ab0817c58107 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:46.308814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e262c7-d6ba-4a8f-a81c-ab0817c58107 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:46.308814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e262c7-d6ba-4a8f-a81c-ab0817c58107 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:46.309116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e262c7-d6ba-4a8f-a81c-ab0817c58107 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/users/e8333d7b41454d3680f9416b72cdcd1c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:46.310519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e262c7-d6ba-4a8f-a81c-ab0817c58107 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e8333d7b41454d3680f9416b72cdcd1c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:46.313170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e262c7-d6ba-4a8f-a81c-ab0817c58107 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:46.432063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-39e262c7-d6ba-4a8f-a81c-ab0817c58107 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8333d7b41454d3680f9416b72cdcd1c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:46.445402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-39e262c7-d6ba-4a8f-a81c-ab0817c58107 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8333d7b41454d3680f9416b72cdcd1c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:46.534496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-39e262c7-d6ba-4a8f-a81c-ab0817c58107 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8333d7b41454d3680f9416b72cdcd1c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:46.543853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-39e262c7-d6ba-4a8f-a81c-ab0817c58107 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8333d7b41454d3680f9416b72cdcd1c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:46.544613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-39e262c7-d6ba-4a8f-a81c-ab0817c58107 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8333d7b41454d3680f9416b72cdcd1c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:46.552874 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2677/5419] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:26:46 2022] DELETE /identity/v3/users/e8333d7b41454d3680f9416b72cdcd1c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:26:46.556628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f803f8a-f324-4754-83a7-d6518cb6336c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:46.559037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5f803f8a-f324-4754-83a7-d6518cb6336c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:46.576108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f803f8a-f324-4754-83a7-d6518cb6336c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:46.660569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6878d-6782-46c5-bcd2-f55c19e6bf7e tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:46.661453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6878d-6782-46c5-bcd2-f55c19e6bf7e tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:46.661769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6878d-6782-46c5-bcd2-f55c19e6bf7e tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:46.662048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6878d-6782-46c5-bcd2-f55c19e6bf7e tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/projects/bbefb78910b248098dfb85ecbedefc89` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:46.664812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6878d-6782-46c5-bcd2-f55c19e6bf7e tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bbefb78910b248098dfb85ecbedefc89)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:46.666751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6878d-6782-46c5-bcd2-f55c19e6bf7e tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:46.798108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9fb6878d-6782-46c5-bcd2-f55c19e6bf7e tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbefb78910b248098dfb85ecbedefc89', 'request_id': 'req-9fb6878d-6782-46c5-bcd2-f55c19e6bf7e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:46.809824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9fb6878d-6782-46c5-bcd2-f55c19e6bf7e tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbefb78910b248098dfb85ecbedefc89', 'request_id': 'req-9fb6878d-6782-46c5-bcd2-f55c19e6bf7e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:46.815595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9fb6878d-6782-46c5-bcd2-f55c19e6bf7e tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbefb78910b248098dfb85ecbedefc89', 'request_id': 'req-9fb6878d-6782-46c5-bcd2-f55c19e6bf7e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:46.886459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9fb6878d-6782-46c5-bcd2-f55c19e6bf7e tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] The token cache is being invalidate because project bbefb78910b248098dfb85ecbedefc89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:46.886996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9fb6878d-6782-46c5-bcd2-f55c19e6bf7e tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:46.887666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9fb6878d-6782-46c5-bcd2-f55c19e6bf7e tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:46.889341 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2743/5420] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:46 2022] DELETE /identity/v3/projects/bbefb78910b248098dfb85ecbedefc89 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:46.894632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e262c7-d6ba-4a8f-a81c-ab0817c58107 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:46.896384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-39e262c7-d6ba-4a8f-a81c-ab0817c58107 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:46.909241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e262c7-d6ba-4a8f-a81c-ab0817c58107 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:46.970483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e53c2b-1e06-47cd-8a38-8ae4b71d5bc4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:46.971626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e53c2b-1e06-47cd-8a38-8ae4b71d5bc4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:46.971931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e53c2b-1e06-47cd-8a38-8ae4b71d5bc4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:46.972213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e53c2b-1e06-47cd-8a38-8ae4b71d5bc4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/users/c83f60ca52004c48afaa00d08dc28bde` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:46.974594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e53c2b-1e06-47cd-8a38-8ae4b71d5bc4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:update_user(user_id=c83f60ca52004c48afaa00d08dc28bde)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:46.975898 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-29e53c2b-1e06-47cd-8a38-8ae4b71d5bc4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:26:46.975898 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:26:46.975898 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:26:46.977693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e53c2b-1e06-47cd-8a38-8ae4b71d5bc4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:47.093023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-29e53c2b-1e06-47cd-8a38-8ae4b71d5bc4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c83f60ca52004c48afaa00d08dc28bde'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:47.200359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-29e53c2b-1e06-47cd-8a38-8ae4b71d5bc4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invalidating the token cache because user c83f60ca52004c48afaa00d08dc28bde was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:47.204672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-29e53c2b-1e06-47cd-8a38-8ae4b71d5bc4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:47.204672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-29e53c2b-1e06-47cd-8a38-8ae4b71d5bc4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:47.205169 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2678/5421] 10.222.0.16 () {60 vars in 1242 bytes} [Sat Jul 16 21:26:46 2022] PATCH /identity/v3/users/c83f60ca52004c48afaa00d08dc28bde => generated 297 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:26:47.210245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2bc66-ff51-4bfd-88d9-8dd0266f72e1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:47.210561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2bc66-ff51-4bfd-88d9-8dd0266f72e1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:47.211357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2bc66-ff51-4bfd-88d9-8dd0266f72e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:47.243466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-35c2bc66-ff51-4bfd-88d9-8dd0266f72e1 None None] MFA Rules not processed for user `c83f60ca52004c48afaa00d08dc28bde`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:47.245590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-35c2bc66-ff51-4bfd-88d9-8dd0266f72e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:47.250288 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2744/5422] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:47 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 21:26:47.254623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e53c2b-1e06-47cd-8a38-8ae4b71d5bc4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:47.256244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-29e53c2b-1e06-47cd-8a38-8ae4b71d5bc4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:47.269266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e53c2b-1e06-47cd-8a38-8ae4b71d5bc4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:47.276343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc5914-6c7b-402a-9334-8e9dc353b3d4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:47.277228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc5914-6c7b-402a-9334-8e9dc353b3d4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:47.277669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc5914-6c7b-402a-9334-8e9dc353b3d4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:47.278658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc5914-6c7b-402a-9334-8e9dc353b3d4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/users/c83f60ca52004c48afaa00d08dc28bde` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:47.280015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc5914-6c7b-402a-9334-8e9dc353b3d4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:update_user(user_id=c83f60ca52004c48afaa00d08dc28bde)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:47.281944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc5914-6c7b-402a-9334-8e9dc353b3d4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:47.436450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-13bc5914-6c7b-402a-9334-8e9dc353b3d4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c83f60ca52004c48afaa00d08dc28bde'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:47.542853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-13bc5914-6c7b-402a-9334-8e9dc353b3d4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invalidating the token cache because user c83f60ca52004c48afaa00d08dc28bde was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:47.543192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-13bc5914-6c7b-402a-9334-8e9dc353b3d4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:47.543871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-13bc5914-6c7b-402a-9334-8e9dc353b3d4 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:47.543973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:47.547132 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2679/5423] 10.222.0.16 () {60 vars in 1242 bytes} [Sat Jul 16 21:26:47 2022] PATCH /identity/v3/users/c83f60ca52004c48afaa00d08dc28bde => generated 297 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:26:47.554052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2bc66-ff51-4bfd-88d9-8dd0266f72e1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:47.573386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2bc66-ff51-4bfd-88d9-8dd0266f72e1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:47.575430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bd432-0e4b-4fe1-a08a-3f1f73cae1c7 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:47.576625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bd432-0e4b-4fe1-a08a-3f1f73cae1c7 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:47.577059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bd432-0e4b-4fe1-a08a-3f1f73cae1c7 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:47.577484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bd432-0e4b-4fe1-a08a-3f1f73cae1c7 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/users/c83f60ca52004c48afaa00d08dc28bde` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:47.600019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bd432-0e4b-4fe1-a08a-3f1f73cae1c7 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:update_user(user_id=c83f60ca52004c48afaa00d08dc28bde)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:47.602289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bd432-0e4b-4fe1-a08a-3f1f73cae1c7 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:47.735606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-630bd432-0e4b-4fe1-a08a-3f1f73cae1c7 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c83f60ca52004c48afaa00d08dc28bde'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:47.879801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-630bd432-0e4b-4fe1-a08a-3f1f73cae1c7 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invalidating the token cache because user c83f60ca52004c48afaa00d08dc28bde was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:47.880100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-630bd432-0e4b-4fe1-a08a-3f1f73cae1c7 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:47.880718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-630bd432-0e4b-4fe1-a08a-3f1f73cae1c7 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:47.882630 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2745/5424] 10.222.0.16 () {60 vars in 1242 bytes} [Sat Jul 16 21:26:47 2022] PATCH /identity/v3/users/c83f60ca52004c48afaa00d08dc28bde => generated 297 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:26:47.887217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b672931-075a-47c6-8e1f-f3b622218c04 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:47.887505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b672931-075a-47c6-8e1f-f3b622218c04 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:47.887779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b672931-075a-47c6-8e1f-f3b622218c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:47.919442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1b672931-075a-47c6-8e1f-f3b622218c04 None None] MFA Rules not processed for user `c83f60ca52004c48afaa00d08dc28bde`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:47.920646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1b672931-075a-47c6-8e1f-f3b622218c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:47.924011 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2680/5425] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:47 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 21:26:47.928990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bd432-0e4b-4fe1-a08a-3f1f73cae1c7 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:47.930679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-630bd432-0e4b-4fe1-a08a-3f1f73cae1c7 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:47.944726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bd432-0e4b-4fe1-a08a-3f1f73cae1c7 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:47.950074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e15cb-ec03-4e43-a064-74235462694c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:47.951126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e15cb-ec03-4e43-a064-74235462694c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:47.951485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e15cb-ec03-4e43-a064-74235462694c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:47.951840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e15cb-ec03-4e43-a064-74235462694c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/users/c83f60ca52004c48afaa00d08dc28bde` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:47.958842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e15cb-ec03-4e43-a064-74235462694c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:update_user(user_id=c83f60ca52004c48afaa00d08dc28bde)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:47.962270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e15cb-ec03-4e43-a064-74235462694c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:48.065178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:48.076770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9c6e15cb-ec03-4e43-a064-74235462694c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c83f60ca52004c48afaa00d08dc28bde'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:48.148994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9c6e15cb-ec03-4e43-a064-74235462694c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invalidating the token cache because user c83f60ca52004c48afaa00d08dc28bde was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:48.149291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9c6e15cb-ec03-4e43-a064-74235462694c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:48.149969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9c6e15cb-ec03-4e43-a064-74235462694c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:48.152154 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2746/5426] 10.222.0.16 () {60 vars in 1242 bytes} [Sat Jul 16 21:26:47 2022] PATCH /identity/v3/users/c83f60ca52004c48afaa00d08dc28bde => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:26:48.162599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b672931-075a-47c6-8e1f-f3b622218c04 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:48.176557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b672931-075a-47c6-8e1f-f3b622218c04 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:48.182368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab462db-72db-493f-a4a5-8470513a7434 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:48.183250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab462db-72db-493f-a4a5-8470513a7434 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:48.183782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab462db-72db-493f-a4a5-8470513a7434 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:48.184134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab462db-72db-493f-a4a5-8470513a7434 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:48.184900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab462db-72db-493f-a4a5-8470513a7434 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:48.186855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab462db-72db-493f-a4a5-8470513a7434 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:48.292015 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2681/5427] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:26:48 2022] POST /identity/v3/users => generated 265 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:48.296932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e15cb-ec03-4e43-a064-74235462694c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:48.298802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9c6e15cb-ec03-4e43-a064-74235462694c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:48.315125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e15cb-ec03-4e43-a064-74235462694c tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:48.331633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6692de-063b-4f81-9be2-557db7cf46ec tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:48.332775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6692de-063b-4f81-9be2-557db7cf46ec tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:48.333985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6692de-063b-4f81-9be2-557db7cf46ec tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:48.334423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6692de-063b-4f81-9be2-557db7cf46ec tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/users/7eb891041a2a43738011a41ad252da36/password` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:48.583604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4f6692de-063b-4f81-9be2-557db7cf46ec tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7eb891041a2a43738011a41ad252da36'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:48.674710 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2747/5428] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Jul 16 21:26:48 2022] POST /identity/v3/users/7eb891041a2a43738011a41ad252da36/password => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:49.503790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:49.659473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab462db-72db-493f-a4a5-8470513a7434 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:49.665706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0ab462db-72db-493f-a4a5-8470513a7434 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:49.682214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd403c-a00b-4190-a947-8a65f50c9a31 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:49.682692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd403c-a00b-4190-a947-8a65f50c9a31 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:49.682804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd403c-a00b-4190-a947-8a65f50c9a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:49.687649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:49.745136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-bbbd403c-a00b-4190-a947-8a65f50c9a31 None None] MFA Rules not processed for user `7eb891041a2a43738011a41ad252da36`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:49.748591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bbbd403c-a00b-4190-a947-8a65f50c9a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:49.759850 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2748/5429] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:49 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 16 21:26:49.769987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd403c-a00b-4190-a947-8a65f50c9a31 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:49.792791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd403c-a00b-4190-a947-8a65f50c9a31 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:49.806103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84656f1-d3c2-42ae-b8d6-f866f12ea603 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:49.807687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84656f1-d3c2-42ae-b8d6-f866f12ea603 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:49.808167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84656f1-d3c2-42ae-b8d6-f866f12ea603 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:49.808596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84656f1-d3c2-42ae-b8d6-f866f12ea603 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:49.829036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84656f1-d3c2-42ae-b8d6-f866f12ea603 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:49.836941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84656f1-d3c2-42ae-b8d6-f866f12ea603 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:49.855622 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2749/5430] 10.222.0.16 () {56 vars in 1262 bytes} [Sat Jul 16 21:26:49 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 21:26:49.859856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84656f1-d3c2-42ae-b8d6-f866f12ea603 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:49.885906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84656f1-d3c2-42ae-b8d6-f866f12ea603 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:49.896979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab462db-72db-493f-a4a5-8470513a7434 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:49.900824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57931bc5-a940-4004-a2c0-1e95562c5fd8 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:49.902317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57931bc5-a940-4004-a2c0-1e95562c5fd8 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:49.903295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57931bc5-a940-4004-a2c0-1e95562c5fd8 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:49.904139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57931bc5-a940-4004-a2c0-1e95562c5fd8 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/users/7eb891041a2a43738011a41ad252da36` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:49.906695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7f727-6b8f-49cc-8f4c-b65e1a6a65af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:49.907759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7f727-6b8f-49cc-8f4c-b65e1a6a65af service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:49.908062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7f727-6b8f-49cc-8f4c-b65e1a6a65af service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:49.908862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57931bc5-a940-4004-a2c0-1e95562c5fd8 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7eb891041a2a43738011a41ad252da36)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:49.911240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7f727-6b8f-49cc-8f4c-b65e1a6a65af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:49.911970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57931bc5-a940-4004-a2c0-1e95562c5fd8 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:49.915859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b2c7f727-6b8f-49cc-8f4c-b65e1a6a65af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:50.004478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7f727-6b8f-49cc-8f4c-b65e1a6a65af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:50.006125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7f727-6b8f-49cc-8f4c-b65e1a6a65af service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:50.029424 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2682/5431] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:26:50.095499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-57931bc5-a940-4004-a2c0-1e95562c5fd8 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eb891041a2a43738011a41ad252da36'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:50.133337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-57931bc5-a940-4004-a2c0-1e95562c5fd8 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eb891041a2a43738011a41ad252da36'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:50.246250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-57931bc5-a940-4004-a2c0-1e95562c5fd8 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eb891041a2a43738011a41ad252da36'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:50.246917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-57931bc5-a940-4004-a2c0-1e95562c5fd8 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eb891041a2a43738011a41ad252da36'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:50.278343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-57931bc5-a940-4004-a2c0-1e95562c5fd8 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eb891041a2a43738011a41ad252da36'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:50.291481 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2750/5432] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:26:49 2022] DELETE /identity/v3/users/7eb891041a2a43738011a41ad252da36 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:26:50.292768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7f727-6b8f-49cc-8f4c-b65e1a6a65af service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:50.310152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7f727-6b8f-49cc-8f4c-b65e1a6a65af service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:50.457699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bc0e7-74dc-4f6d-97c6-42eb9d1e4e18 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:50.458801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bc0e7-74dc-4f6d-97c6-42eb9d1e4e18 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:50.459322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bc0e7-74dc-4f6d-97c6-42eb9d1e4e18 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:50.459849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bc0e7-74dc-4f6d-97c6-42eb9d1e4e18 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:50.460880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487bc0e7-74dc-4f6d-97c6-42eb9d1e4e18 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:50.466250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487bc0e7-74dc-4f6d-97c6-42eb9d1e4e18 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:50.607113 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2683/5433] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:26:50 2022] POST /identity/v3/users => generated 367 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:26:50.616572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57931bc5-a940-4004-a2c0-1e95562c5fd8 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:50.618033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-57931bc5-a940-4004-a2c0-1e95562c5fd8 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:50.634465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57931bc5-a940-4004-a2c0-1e95562c5fd8 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:50.639181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00054740-4b52-402e-84f8-6e596416f15d tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:50.639944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00054740-4b52-402e-84f8-6e596416f15d tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:50.640307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00054740-4b52-402e-84f8-6e596416f15d tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:50.640666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00054740-4b52-402e-84f8-6e596416f15d tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:50.641429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00054740-4b52-402e-84f8-6e596416f15d tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:50.643663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00054740-4b52-402e-84f8-6e596416f15d tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:50.750268 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2751/5434] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:50 2022] POST /identity/v3/projects => generated 359 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:50.756161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bc0e7-74dc-4f6d-97c6-42eb9d1e4e18 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:50.768198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bc0e7-74dc-4f6d-97c6-42eb9d1e4e18 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:50.815099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00054740-4b52-402e-84f8-6e596416f15d tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:50.818276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-00054740-4b52-402e-84f8-6e596416f15d tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:50.888233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973957af-962c-455c-817d-4b170f5e5345 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:50.889408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973957af-962c-455c-817d-4b170f5e5345 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:50.890242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973957af-962c-455c-817d-4b170f5e5345 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:50.890854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973957af-962c-455c-817d-4b170f5e5345 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/users/ef4a0dd031a344e99c0937b21c144b38` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:50.911955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973957af-962c-455c-817d-4b170f5e5345 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:update_user(user_id=ef4a0dd031a344e99c0937b21c144b38)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:50.914854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973957af-962c-455c-817d-4b170f5e5345 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:50.985865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00054740-4b52-402e-84f8-6e596416f15d tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:50.993874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a348005-aa7d-421b-b700-95af877b4749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:50.996002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a348005-aa7d-421b-b700-95af877b4749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:50.996002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a348005-aa7d-421b-b700-95af877b4749 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:50.996002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a348005-aa7d-421b-b700-95af877b4749 admin admin] PATH_INFO: `/v3/users/1963f7b0ee0244b2b4f5fc1d8b34f858` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:50.997385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a348005-aa7d-421b-b700-95af877b4749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1963f7b0ee0244b2b4f5fc1d8b34f858)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:51.002126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a348005-aa7d-421b-b700-95af877b4749 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:51.046125 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2684/5435] 10.222.0.16 () {60 vars in 1243 bytes} [Sat Jul 16 21:26:50 2022] PATCH /identity/v3/users/ef4a0dd031a344e99c0937b21c144b38 => generated 524 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:26:51.047811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973957af-962c-455c-817d-4b170f5e5345 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:51.067315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973957af-962c-455c-817d-4b170f5e5345 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:51.075297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3799115-d0c6-45a5-9687-988c2b48c4eb tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:51.076399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3799115-d0c6-45a5-9687-988c2b48c4eb tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:51.076700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3799115-d0c6-45a5-9687-988c2b48c4eb tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:51.076983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3799115-d0c6-45a5-9687-988c2b48c4eb tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/users/ef4a0dd031a344e99c0937b21c144b38` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:51.092878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3799115-d0c6-45a5-9687-988c2b48c4eb tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:get_user(user_id=ef4a0dd031a344e99c0937b21c144b38)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:51.095443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3799115-d0c6-45a5-9687-988c2b48c4eb tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:51.097336 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2685/5436] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Jul 16 21:26:51 2022] GET /identity/v3/users/ef4a0dd031a344e99c0937b21c144b38 => generated 390 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:26:51.101871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3799115-d0c6-45a5-9687-988c2b48c4eb tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:51.114038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3799115-d0c6-45a5-9687-988c2b48c4eb tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:51.120919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8f536-ff48-45ac-a7b1-8e130a2ff956 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:51.121881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8f536-ff48-45ac-a7b1-8e130a2ff956 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:51.122264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8f536-ff48-45ac-a7b1-8e130a2ff956 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:51.122536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8f536-ff48-45ac-a7b1-8e130a2ff956 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/projects/876d75ebcabe42b187a7d00457f02fd2` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:51.124073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8f536-ff48-45ac-a7b1-8e130a2ff956 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:delete_project(project_id=876d75ebcabe42b187a7d00457f02fd2)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:51.126023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8f536-ff48-45ac-a7b1-8e130a2ff956 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:51.252014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:51.265909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9a348005-aa7d-421b-b700-95af877b4749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1963f7b0ee0244b2b4f5fc1d8b34f858'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:51.267787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-12c8f536-ff48-45ac-a7b1-8e130a2ff956 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '876d75ebcabe42b187a7d00457f02fd2', 'request_id': 'req-12c8f536-ff48-45ac-a7b1-8e130a2ff956'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:51.272822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9a348005-aa7d-421b-b700-95af877b4749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1963f7b0ee0244b2b4f5fc1d8b34f858'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:51.274128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-12c8f536-ff48-45ac-a7b1-8e130a2ff956 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '876d75ebcabe42b187a7d00457f02fd2', 'request_id': 'req-12c8f536-ff48-45ac-a7b1-8e130a2ff956'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:51.280833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-12c8f536-ff48-45ac-a7b1-8e130a2ff956 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '876d75ebcabe42b187a7d00457f02fd2', 'request_id': 'req-12c8f536-ff48-45ac-a7b1-8e130a2ff956'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:51.372129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9a348005-aa7d-421b-b700-95af877b4749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1963f7b0ee0244b2b4f5fc1d8b34f858'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:51.372879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9a348005-aa7d-421b-b700-95af877b4749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1963f7b0ee0244b2b4f5fc1d8b34f858'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:51.375327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=79,keystone:UPDATE=3,keystone:INSERT=6,keystone:DELETE=12 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:51.388972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9a348005-aa7d-421b-b700-95af877b4749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1963f7b0ee0244b2b4f5fc1d8b34f858'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:51.396278 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2752/5437] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:26:50 2022] DELETE /identity/v3/users/1963f7b0ee0244b2b4f5fc1d8b34f858 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:26:51.468926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-12c8f536-ff48-45ac-a7b1-8e130a2ff956 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] The token cache is being invalidate because project 876d75ebcabe42b187a7d00457f02fd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:51.468926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-12c8f536-ff48-45ac-a7b1-8e130a2ff956 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:51.470516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-12c8f536-ff48-45ac-a7b1-8e130a2ff956 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:51.474959 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2686/5438] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:51 2022] DELETE /identity/v3/projects/876d75ebcabe42b187a7d00457f02fd2 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:26:51.481267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a348005-aa7d-421b-b700-95af877b4749 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:51.483690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9a348005-aa7d-421b-b700-95af877b4749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:51.578902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a348005-aa7d-421b-b700-95af877b4749 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:51.585830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705e78b-974f-4ace-90ba-fafb6a58f473 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdbee75143a481faf7f9131f037fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c062216ef42e4d7ba6fb28b44f0604d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:51.586741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705e78b-974f-4ace-90ba-fafb6a58f473 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:51.587046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705e78b-974f-4ace-90ba-fafb6a58f473 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:51.587335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705e78b-974f-4ace-90ba-fafb6a58f473 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] PATH_INFO: `/v3/users/ef4a0dd031a344e99c0937b21c144b38` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:51.588613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705e78b-974f-4ace-90ba-fafb6a58f473 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ef4a0dd031a344e99c0937b21c144b38)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:51.590691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705e78b-974f-4ace-90ba-fafb6a58f473 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:51.788178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f705e78b-974f-4ace-90ba-fafb6a58f473 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef4a0dd031a344e99c0937b21c144b38'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:51.804328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f705e78b-974f-4ace-90ba-fafb6a58f473 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef4a0dd031a344e99c0937b21c144b38'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:51.881693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f705e78b-974f-4ace-90ba-fafb6a58f473 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef4a0dd031a344e99c0937b21c144b38'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:51.884042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f705e78b-974f-4ace-90ba-fafb6a58f473 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef4a0dd031a344e99c0937b21c144b38'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:51.899134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f705e78b-974f-4ace-90ba-fafb6a58f473 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef4a0dd031a344e99c0937b21c144b38'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:51.906995 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2753/5439] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:26:51 2022] DELETE /identity/v3/users/ef4a0dd031a344e99c0937b21c144b38 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:51.912847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8f536-ff48-45ac-a7b1-8e130a2ff956 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:51.914512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-12c8f536-ff48-45ac-a7b1-8e130a2ff956 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:52.032215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8f536-ff48-45ac-a7b1-8e130a2ff956 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:52.100430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9efb95-f332-42cd-bfa8-034fefab374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:52.101315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9efb95-f332-42cd-bfa8-034fefab374a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:52.101589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9efb95-f332-42cd-bfa8-034fefab374a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:52.101861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9efb95-f332-42cd-bfa8-034fefab374a admin admin] PATH_INFO: `/v3/users/c83f60ca52004c48afaa00d08dc28bde` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:52.126102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9efb95-f332-42cd-bfa8-034fefab374a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c83f60ca52004c48afaa00d08dc28bde)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:52.130573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9efb95-f332-42cd-bfa8-034fefab374a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:52.154510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705e78b-974f-4ace-90ba-fafb6a58f473 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:52.156828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f705e78b-974f-4ace-90ba-fafb6a58f473 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:52.179481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705e78b-974f-4ace-90ba-fafb6a58f473 tempest-UsersV3TestJSON-706030694 tempest-UsersV3TestJSON-706030694-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:52.186094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e37506-59a9-4f09-95d4-23932eea7eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:52.187304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e37506-59a9-4f09-95d4-23932eea7eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:52.187790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e37506-59a9-4f09-95d4-23932eea7eec admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:52.188267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e37506-59a9-4f09-95d4-23932eea7eec admin admin] PATH_INFO: `/v3/projects/8f2736abb6094c1f83a7aa3efc772506` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:52.189873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e37506-59a9-4f09-95d4-23932eea7eec admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f2736abb6094c1f83a7aa3efc772506)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:52.193306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e37506-59a9-4f09-95d4-23932eea7eec admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:52.404928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-db9efb95-f332-42cd-bfa8-034fefab374a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c83f60ca52004c48afaa00d08dc28bde'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:52.406598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-62e37506-59a9-4f09-95d4-23932eea7eec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f2736abb6094c1f83a7aa3efc772506', 'request_id': 'req-62e37506-59a9-4f09-95d4-23932eea7eec'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:52.414018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-62e37506-59a9-4f09-95d4-23932eea7eec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f2736abb6094c1f83a7aa3efc772506', 'request_id': 'req-62e37506-59a9-4f09-95d4-23932eea7eec'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:52.418533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-db9efb95-f332-42cd-bfa8-034fefab374a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c83f60ca52004c48afaa00d08dc28bde'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:52.420896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-62e37506-59a9-4f09-95d4-23932eea7eec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f2736abb6094c1f83a7aa3efc772506', 'request_id': 'req-62e37506-59a9-4f09-95d4-23932eea7eec'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:52.514364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-db9efb95-f332-42cd-bfa8-034fefab374a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c83f60ca52004c48afaa00d08dc28bde'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:52.523629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-db9efb95-f332-42cd-bfa8-034fefab374a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c83f60ca52004c48afaa00d08dc28bde'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:52.524522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-db9efb95-f332-42cd-bfa8-034fefab374a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c83f60ca52004c48afaa00d08dc28bde'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:52.531678 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2687/5440] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:26:51 2022] DELETE /identity/v3/users/c83f60ca52004c48afaa00d08dc28bde => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:52.536269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54959ca-19cb-4364-b61b-65622bab11d6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:52.536561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54959ca-19cb-4364-b61b-65622bab11d6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:52.536842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54959ca-19cb-4364-b61b-65622bab11d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:52.554977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f54959ca-19cb-4364-b61b-65622bab11d6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:52.556245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f54959ca-19cb-4364-b61b-65622bab11d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:52.596220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-62e37506-59a9-4f09-95d4-23932eea7eec admin admin] The token cache is being invalidate because project 8f2736abb6094c1f83a7aa3efc772506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:52.596608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-62e37506-59a9-4f09-95d4-23932eea7eec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:52.597373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-62e37506-59a9-4f09-95d4-23932eea7eec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:52.599525 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2754/5441] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:52 2022] DELETE /identity/v3/projects/8f2736abb6094c1f83a7aa3efc772506 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:26:52.604810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe2935-38a0-4732-891d-ab4cf31f4f25 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:52.605098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe2935-38a0-4732-891d-ab4cf31f4f25 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:52.605372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe2935-38a0-4732-891d-ab4cf31f4f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:52.627515 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2688/5442] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:26:52.632091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8fbe2935-38a0-4732-891d-ab4cf31f4f25 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:52.634018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8fbe2935-38a0-4732-891d-ab4cf31f4f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:52.637107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54959ca-19cb-4364-b61b-65622bab11d6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:52.640984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f54959ca-19cb-4364-b61b-65622bab11d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:52.642718 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2755/5443] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:52.654278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ce563-f99c-4199-8c57-b4af8966a10b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:52.654524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ce563-f99c-4199-8c57-b4af8966a10b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:52.654865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ce563-f99c-4199-8c57-b4af8966a10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:52.676215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c48ce563-f99c-4199-8c57-b4af8966a10b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:52.677677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c48ce563-f99c-4199-8c57-b4af8966a10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:52.687207 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2756/5444] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:52.692052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ce563-f99c-4199-8c57-b4af8966a10b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:52.702250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ce563-f99c-4199-8c57-b4af8966a10b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:52.708422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b460087-3e25-4b8c-ae81-b08790f696d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:52.711809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b460087-3e25-4b8c-ae81-b08790f696d5 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:52.711809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b460087-3e25-4b8c-ae81-b08790f696d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:52.711809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b460087-3e25-4b8c-ae81-b08790f696d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:52.711809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b460087-3e25-4b8c-ae81-b08790f696d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:26:52.711809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b460087-3e25-4b8c-ae81-b08790f696d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:52.712431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b460087-3e25-4b8c-ae81-b08790f696d5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:52.720466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54959ca-19cb-4364-b61b-65622bab11d6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:52.728245 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2757/5445] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:26:52.729009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420a15f-2c31-4861-9f7c-89a09f08f264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:52.729846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420a15f-2c31-4861-9f7c-89a09f08f264 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:52.730096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420a15f-2c31-4861-9f7c-89a09f08f264 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:52.730468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420a15f-2c31-4861-9f7c-89a09f08f264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:52.737026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b460087-3e25-4b8c-ae81-b08790f696d5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:52.746541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420a15f-2c31-4861-9f7c-89a09f08f264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:52.748168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420a15f-2c31-4861-9f7c-89a09f08f264 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:52.748990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b460087-3e25-4b8c-ae81-b08790f696d5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:52.753979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63ae79-4c0c-4232-8ee1-5156144389a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:52.754648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63ae79-4c0c-4232-8ee1-5156144389a1 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:52.754975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63ae79-4c0c-4232-8ee1-5156144389a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:52.755292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63ae79-4c0c-4232-8ee1-5156144389a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:52.756821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63ae79-4c0c-4232-8ee1-5156144389a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:52.758776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63ae79-4c0c-4232-8ee1-5156144389a1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:52.759470 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2689/5446] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:26:52.859398 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2758/5447] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:52 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:52.863774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420a15f-2c31-4861-9f7c-89a09f08f264 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:52.873991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420a15f-2c31-4861-9f7c-89a09f08f264 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:52.910225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:52.936235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991b254-9a8e-41b9-825e-69033bbc9515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:52.936903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991b254-9a8e-41b9-825e-69033bbc9515 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:52.937178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991b254-9a8e-41b9-825e-69033bbc9515 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:52.937454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991b254-9a8e-41b9-825e-69033bbc9515 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:52.938700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991b254-9a8e-41b9-825e-69033bbc9515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:52.940157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991b254-9a8e-41b9-825e-69033bbc9515 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:52.972708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:DELETE=13 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:53.037639 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2690/5448] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:26:52 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:53.040219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63ae79-4c0c-4232-8ee1-5156144389a1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:53.052447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63ae79-4c0c-4232-8ee1-5156144389a1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:53.057831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3667b5f-e34d-4cc6-ba9d-c68309726bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:53.058508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3667b5f-e34d-4cc6-ba9d-c68309726bbc admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:53.058791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3667b5f-e34d-4cc6-ba9d-c68309726bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:53.059105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3667b5f-e34d-4cc6-ba9d-c68309726bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:53.060061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3667b5f-e34d-4cc6-ba9d-c68309726bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:53.062310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3667b5f-e34d-4cc6-ba9d-c68309726bbc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:53.081996 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2759/5449] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:53.086728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991b254-9a8e-41b9-825e-69033bbc9515 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:53.097460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991b254-9a8e-41b9-825e-69033bbc9515 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:53.102829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9105f-4ae5-4532-addc-1c8c43868512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:53.103660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9105f-4ae5-4532-addc-1c8c43868512 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:53.104048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9105f-4ae5-4532-addc-1c8c43868512 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:53.108656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9105f-4ae5-4532-addc-1c8c43868512 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:53.109613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9105f-4ae5-4532-addc-1c8c43868512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:53.111490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9105f-4ae5-4532-addc-1c8c43868512 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:53.123088 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2691/5450] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:53.127214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3667b5f-e34d-4cc6-ba9d-c68309726bbc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:53.140532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3667b5f-e34d-4cc6-ba9d-c68309726bbc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:53.146420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8c7a5-d0d6-4eec-a0cc-778d2c3fced0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:53.147779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8c7a5-d0d6-4eec-a0cc-778d2c3fced0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:53.148389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8c7a5-d0d6-4eec-a0cc-778d2c3fced0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:53.148918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8c7a5-d0d6-4eec-a0cc-778d2c3fced0 admin admin] PATH_INFO: `/v3/projects/3b214f5044c7445592e177835a5d18fc/users/029c76a0ba614b5880128c4309902c67/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:53.177382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8c7a5-d0d6-4eec-a0cc-778d2c3fced0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b214f5044c7445592e177835a5d18fc, user_id=029c76a0ba614b5880128c4309902c67, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:53.180104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8c7a5-d0d6-4eec-a0cc-778d2c3fced0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:53.271191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9105f-4ae5-4532-addc-1c8c43868512 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:53.275755 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2760/5451] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:26:53 2022] PUT /identity/v3/projects/3b214f5044c7445592e177835a5d18fc/users/029c76a0ba614b5880128c4309902c67/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:53.275879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-95a9105f-4ae5-4532-addc-1c8c43868512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:53.278155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838113b3-6372-4141-8087-4bb0ff2b5efd None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:53.278282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838113b3-6372-4141-8087-4bb0ff2b5efd None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:53.278542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838113b3-6372-4141-8087-4bb0ff2b5efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:53.294785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9105f-4ae5-4532-addc-1c8c43868512 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:53.314351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-838113b3-6372-4141-8087-4bb0ff2b5efd None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:53.315825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-838113b3-6372-4141-8087-4bb0ff2b5efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:53.366445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ed176-26a5-45fe-b8aa-1911e2d5ce2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:53.367671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ed176-26a5-45fe-b8aa-1911e2d5ce2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:53.368024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ed176-26a5-45fe-b8aa-1911e2d5ce2b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:53.368370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ed176-26a5-45fe-b8aa-1911e2d5ce2b admin admin] PATH_INFO: `/v3/projects/54fbe893b86d448ebb9e9f285bdc25b5` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:53.369684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ed176-26a5-45fe-b8aa-1911e2d5ce2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=54fbe893b86d448ebb9e9f285bdc25b5)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:53.371726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ed176-26a5-45fe-b8aa-1911e2d5ce2b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:53.384844 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2761/5452] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:53.395179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838113b3-6372-4141-8087-4bb0ff2b5efd None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:53.454938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838113b3-6372-4141-8087-4bb0ff2b5efd None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:53.459373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b64458-72ae-4fcd-8423-be8ce8fca36f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:53.460161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b64458-72ae-4fcd-8423-be8ce8fca36f service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:53.460450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b64458-72ae-4fcd-8423-be8ce8fca36f service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:53.460749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b64458-72ae-4fcd-8423-be8ce8fca36f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:53.470573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b64458-72ae-4fcd-8423-be8ce8fca36f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:53.473321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b64458-72ae-4fcd-8423-be8ce8fca36f service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:53.484160 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2762/5453] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:26:53.514012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-029ed176-26a5-45fe-b8aa-1911e2d5ce2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54fbe893b86d448ebb9e9f285bdc25b5', 'request_id': 'req-029ed176-26a5-45fe-b8aa-1911e2d5ce2b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:53.520646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-029ed176-26a5-45fe-b8aa-1911e2d5ce2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54fbe893b86d448ebb9e9f285bdc25b5', 'request_id': 'req-029ed176-26a5-45fe-b8aa-1911e2d5ce2b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:53.527095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-029ed176-26a5-45fe-b8aa-1911e2d5ce2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54fbe893b86d448ebb9e9f285bdc25b5', 'request_id': 'req-029ed176-26a5-45fe-b8aa-1911e2d5ce2b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:53.607987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-029ed176-26a5-45fe-b8aa-1911e2d5ce2b admin admin] The token cache is being invalidate because project 54fbe893b86d448ebb9e9f285bdc25b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:53.608414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-029ed176-26a5-45fe-b8aa-1911e2d5ce2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:53.609441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-029ed176-26a5-45fe-b8aa-1911e2d5ce2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:53.612243 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2692/5454] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:53 2022] DELETE /identity/v3/projects/54fbe893b86d448ebb9e9f285bdc25b5 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:53.617119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b64458-72ae-4fcd-8423-be8ce8fca36f service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:53.629208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b64458-72ae-4fcd-8423-be8ce8fca36f service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:53.706499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15514353-a557-4cbb-9ca0-4f7724d91efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:53.707979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15514353-a557-4cbb-9ca0-4f7724d91efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:53.708280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15514353-a557-4cbb-9ca0-4f7724d91efe admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:53.708554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15514353-a557-4cbb-9ca0-4f7724d91efe admin admin] PATH_INFO: `/v3/users/bcdbee75143a481faf7f9131f037fd39` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:53.709761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15514353-a557-4cbb-9ca0-4f7724d91efe admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcdbee75143a481faf7f9131f037fd39)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:53.711789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15514353-a557-4cbb-9ca0-4f7724d91efe admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:53.720663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:53.915116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-15514353-a557-4cbb-9ca0-4f7724d91efe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcdbee75143a481faf7f9131f037fd39'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:53.922547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-15514353-a557-4cbb-9ca0-4f7724d91efe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcdbee75143a481faf7f9131f037fd39'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:54.005895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-15514353-a557-4cbb-9ca0-4f7724d91efe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcdbee75143a481faf7f9131f037fd39'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:54.006875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-15514353-a557-4cbb-9ca0-4f7724d91efe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcdbee75143a481faf7f9131f037fd39'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:54.017388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:UPDATE=2,keystone:DELETE=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:54.025316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-15514353-a557-4cbb-9ca0-4f7724d91efe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcdbee75143a481faf7f9131f037fd39'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:54.032725 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2763/5455] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:26:53 2022] DELETE /identity/v3/users/bcdbee75143a481faf7f9131f037fd39 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:54.760427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ed176-26a5-45fe-b8aa-1911e2d5ce2b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:54.762310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-029ed176-26a5-45fe-b8aa-1911e2d5ce2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:54.780768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ed176-26a5-45fe-b8aa-1911e2d5ce2b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:54.835038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:54.938303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3144b14-0c99-41e5-8458-0afb2e69b2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:54.939226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3144b14-0c99-41e5-8458-0afb2e69b2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:54.939521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3144b14-0c99-41e5-8458-0afb2e69b2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:54.939889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3144b14-0c99-41e5-8458-0afb2e69b2b9 admin admin] PATH_INFO: `/v3/projects/c062216ef42e4d7ba6fb28b44f0604d2` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:54.941244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3144b14-0c99-41e5-8458-0afb2e69b2b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c062216ef42e4d7ba6fb28b44f0604d2)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:54.943436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3144b14-0c99-41e5-8458-0afb2e69b2b9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:55.081365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d3144b14-0c99-41e5-8458-0afb2e69b2b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c062216ef42e4d7ba6fb28b44f0604d2', 'request_id': 'req-d3144b14-0c99-41e5-8458-0afb2e69b2b9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:55.087666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d3144b14-0c99-41e5-8458-0afb2e69b2b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c062216ef42e4d7ba6fb28b44f0604d2', 'request_id': 'req-d3144b14-0c99-41e5-8458-0afb2e69b2b9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:55.094321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d3144b14-0c99-41e5-8458-0afb2e69b2b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c062216ef42e4d7ba6fb28b44f0604d2', 'request_id': 'req-d3144b14-0c99-41e5-8458-0afb2e69b2b9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:55.245569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d3144b14-0c99-41e5-8458-0afb2e69b2b9 admin admin] The token cache is being invalidate because project c062216ef42e4d7ba6fb28b44f0604d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:55.245856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d3144b14-0c99-41e5-8458-0afb2e69b2b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:55.246518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d3144b14-0c99-41e5-8458-0afb2e69b2b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:55.248126 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2693/5456] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:54 2022] DELETE /identity/v3/projects/c062216ef42e4d7ba6fb28b44f0604d2 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:55.255719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175d498-24f4-4de4-83c5-61b298124e23 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:55.256203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175d498-24f4-4de4-83c5-61b298124e23 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:55.257617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175d498-24f4-4de4-83c5-61b298124e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:55.284113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9175d498-24f4-4de4-83c5-61b298124e23 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:55.284113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9175d498-24f4-4de4-83c5-61b298124e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:55.292382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2337b0a-7466-4d22-a0b6-d9b8a94860ef None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:55.292762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2337b0a-7466-4d22-a0b6-d9b8a94860ef None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:55.293144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2337b0a-7466-4d22-a0b6-d9b8a94860ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:55.343928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f2337b0a-7466-4d22-a0b6-d9b8a94860ef None None] MFA Rules not processed for user `029c76a0ba614b5880128c4309902c67`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:55.345144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f2337b0a-7466-4d22-a0b6-d9b8a94860ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:55.349872 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2764/5457] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:55.358075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64708f5-e0b9-4554-bfda-067176970611 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:55.358650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64708f5-e0b9-4554-bfda-067176970611 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:55.358882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64708f5-e0b9-4554-bfda-067176970611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:55.383756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c64708f5-e0b9-4554-bfda-067176970611 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:55.385163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c64708f5-e0b9-4554-bfda-067176970611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:55.398605 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2765/5458] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:26:55.400665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64708f5-e0b9-4554-bfda-067176970611 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:55.424574 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2694/5459] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:26:55.430688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64708f5-e0b9-4554-bfda-067176970611 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:55.442276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755b604-4bc6-4f93-b7ee-4c4d71849206 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:55.443236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755b604-4bc6-4f93-b7ee-4c4d71849206 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:55.443236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755b604-4bc6-4f93-b7ee-4c4d71849206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:55.457611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81226759-9d76-49ec-953d-2dbf98f72fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:55.459514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81226759-9d76-49ec-953d-2dbf98f72fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:55.461084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81226759-9d76-49ec-953d-2dbf98f72fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:55.462812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81226759-9d76-49ec-953d-2dbf98f72fa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:55.463773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81226759-9d76-49ec-953d-2dbf98f72fa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:26:55.465019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81226759-9d76-49ec-953d-2dbf98f72fa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:55.468515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81226759-9d76-49ec-953d-2dbf98f72fa6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:55.473707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2755b604-4bc6-4f93-b7ee-4c4d71849206 None None] MFA Rules not processed for user `029c76a0ba614b5880128c4309902c67`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:55.474965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2755b604-4bc6-4f93-b7ee-4c4d71849206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:55.487502 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2695/5460] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:55.498807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef53f04-47ac-48f0-a826-a61567de1cb1 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:55.499235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef53f04-47ac-48f0-a826-a61567de1cb1 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:55.500312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef53f04-47ac-48f0-a826-a61567de1cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:55.512208 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2766/5461] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:26:55.517574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81226759-9d76-49ec-953d-2dbf98f72fa6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:55.532716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81226759-9d76-49ec-953d-2dbf98f72fa6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:55.538224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32946c2-e402-4cd9-ae7e-f70f93d3fdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:55.538851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32946c2-e402-4cd9-ae7e-f70f93d3fdb5 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:55.539418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32946c2-e402-4cd9-ae7e-f70f93d3fdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:55.539994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32946c2-e402-4cd9-ae7e-f70f93d3fdb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:55.540396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32946c2-e402-4cd9-ae7e-f70f93d3fdb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:55.542366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32946c2-e402-4cd9-ae7e-f70f93d3fdb5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:55.553724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9ef53f04-47ac-48f0-a826-a61567de1cb1 None None] MFA Rules not processed for user `029c76a0ba614b5880128c4309902c67`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:55.555294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9ef53f04-47ac-48f0-a826-a61567de1cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:55.574171 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2696/5462] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:55.599895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef53f04-47ac-48f0-a826-a61567de1cb1 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:55.601341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9ef53f04-47ac-48f0-a826-a61567de1cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:55.645982 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2767/5463] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:55 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:55.650111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32946c2-e402-4cd9-ae7e-f70f93d3fdb5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:55.805047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32946c2-e402-4cd9-ae7e-f70f93d3fdb5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:55.811044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af833f8-e513-400d-a555-1455d683d697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:55.811899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af833f8-e513-400d-a555-1455d683d697 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:55.812522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af833f8-e513-400d-a555-1455d683d697 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:55.812646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af833f8-e513-400d-a555-1455d683d697 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:55.813474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af833f8-e513-400d-a555-1455d683d697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:55.818459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af833f8-e513-400d-a555-1455d683d697 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:55.828274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:55.831308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef53f04-47ac-48f0-a826-a61567de1cb1 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:55.895340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:55.906744 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2768/5464] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:26:55 2022] POST /identity/v3/users => generated 290 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:26:55.912022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af833f8-e513-400d-a555-1455d683d697 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:55.931833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af833f8-e513-400d-a555-1455d683d697 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:55.972085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2556a-d298-4a7d-8ba4-38aa145959fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:55.973245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2556a-d298-4a7d-8ba4-38aa145959fd admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:55.973600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2556a-d298-4a7d-8ba4-38aa145959fd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:55.973952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2556a-d298-4a7d-8ba4-38aa145959fd admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:55.974978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2556a-d298-4a7d-8ba4-38aa145959fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:55.980255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2556a-d298-4a7d-8ba4-38aa145959fd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:55.996760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395a0c5-6d30-4b64-b3a7-9710969064c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:56.004331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395a0c5-6d30-4b64-b3a7-9710969064c6 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:56.004331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395a0c5-6d30-4b64-b3a7-9710969064c6 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:56.004331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395a0c5-6d30-4b64-b3a7-9710969064c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:56.005236 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2769/5465] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:26:56.014854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2556a-d298-4a7d-8ba4-38aa145959fd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:56.042800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2556a-d298-4a7d-8ba4-38aa145959fd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:56.053250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42461cd7-1470-4858-abf7-804af56e59d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:56.055995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42461cd7-1470-4858-abf7-804af56e59d5 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:56.056492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42461cd7-1470-4858-abf7-804af56e59d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:56.056950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42461cd7-1470-4858-abf7-804af56e59d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:56.057869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42461cd7-1470-4858-abf7-804af56e59d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:56.060118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42461cd7-1470-4858-abf7-804af56e59d5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:56.074307 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2770/5466] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:26:56.078300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42461cd7-1470-4858-abf7-804af56e59d5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:56.096552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42461cd7-1470-4858-abf7-804af56e59d5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:56.107866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9f7ae-dbae-4a6e-9b84-da9d11e0a963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:56.108903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9f7ae-dbae-4a6e-9b84-da9d11e0a963 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:56.111084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9f7ae-dbae-4a6e-9b84-da9d11e0a963 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:56.112587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9f7ae-dbae-4a6e-9b84-da9d11e0a963 admin admin] PATH_INFO: `/v3/projects/fccf4fbc1b404ebab6e36dd87be16c60/users/32234b2922514f96bff52c2998f7694f/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:56.128394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395a0c5-6d30-4b64-b3a7-9710969064c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:56.130518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395a0c5-6d30-4b64-b3a7-9710969064c6 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:56.145276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9f7ae-dbae-4a6e-9b84-da9d11e0a963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fccf4fbc1b404ebab6e36dd87be16c60, user_id=32234b2922514f96bff52c2998f7694f, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:56.153030 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9f7ae-dbae-4a6e-9b84-da9d11e0a963 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:56.163977 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2697/5467] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:26:56.251051 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2771/5468] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:26:56 2022] PUT /identity/v3/projects/fccf4fbc1b404ebab6e36dd87be16c60/users/32234b2922514f96bff52c2998f7694f/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:56.259508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b0d29-e006-416d-b381-af9bc877c8c4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:56.259801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b0d29-e006-416d-b381-af9bc877c8c4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:56.260080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b0d29-e006-416d-b381-af9bc877c8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:56.299541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0a9b0d29-e006-416d-b381-af9bc877c8c4 None None] MFA Rules not processed for user `32234b2922514f96bff52c2998f7694f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:56.301536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0a9b0d29-e006-416d-b381-af9bc877c8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:56.302165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9f7ae-dbae-4a6e-9b84-da9d11e0a963 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:56.304229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0de9f7ae-dbae-4a6e-9b84-da9d11e0a963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:56.404903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9f7ae-dbae-4a6e-9b84-da9d11e0a963 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:56.423316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341995f-d671-43f2-98f0-b22a02cd95a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:56.424219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341995f-d671-43f2-98f0-b22a02cd95a4 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:56.424506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341995f-d671-43f2-98f0-b22a02cd95a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:56.424789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341995f-d671-43f2-98f0-b22a02cd95a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:56.427525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9341995f-d671-43f2-98f0-b22a02cd95a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:56.433645 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2698/5469] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:56.439749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b0d29-e006-416d-b381-af9bc877c8c4 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:56.454433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b0d29-e006-416d-b381-af9bc877c8c4 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:56.458883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce58f19-ecc5-4ae6-8847-42bbf51420b3 tempest-DefaultDomainTestJSON-2000687032 tempest-DefaultDomainTestJSON-2000687032-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32234b2922514f96bff52c2998f7694f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccf4fbc1b404ebab6e36dd87be16c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:56.460581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce58f19-ecc5-4ae6-8847-42bbf51420b3 tempest-DefaultDomainTestJSON-2000687032 tempest-DefaultDomainTestJSON-2000687032-project] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:56.461366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce58f19-ecc5-4ae6-8847-42bbf51420b3 tempest-DefaultDomainTestJSON-2000687032 tempest-DefaultDomainTestJSON-2000687032-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:56.461642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce58f19-ecc5-4ae6-8847-42bbf51420b3 tempest-DefaultDomainTestJSON-2000687032 tempest-DefaultDomainTestJSON-2000687032-project] PATH_INFO: `/v3/domains/default` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:56.463030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce58f19-ecc5-4ae6-8847-42bbf51420b3 tempest-DefaultDomainTestJSON-2000687032 tempest-DefaultDomainTestJSON-2000687032-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:56.466522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce58f19-ecc5-4ae6-8847-42bbf51420b3 tempest-DefaultDomainTestJSON-2000687032 tempest-DefaultDomainTestJSON-2000687032-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:56.470823 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2699/5470] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Jul 16 21:26:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:26:56.474606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce58f19-ecc5-4ae6-8847-42bbf51420b3 tempest-DefaultDomainTestJSON-2000687032 tempest-DefaultDomainTestJSON-2000687032-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:56.526124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341995f-d671-43f2-98f0-b22a02cd95a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:56.528892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341995f-d671-43f2-98f0-b22a02cd95a4 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:56.566673 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2772/5471] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:26:56.599942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce58f19-ecc5-4ae6-8847-42bbf51420b3 tempest-DefaultDomainTestJSON-2000687032 tempest-DefaultDomainTestJSON-2000687032-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:56.605957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e16469-04bb-4b6f-8430-4e1503b7041d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:56.606848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e16469-04bb-4b6f-8430-4e1503b7041d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:56.607188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e16469-04bb-4b6f-8430-4e1503b7041d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:56.608850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e16469-04bb-4b6f-8430-4e1503b7041d admin admin] PATH_INFO: `/v3/users/32234b2922514f96bff52c2998f7694f` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:56.615368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e16469-04bb-4b6f-8430-4e1503b7041d admin admin] RBAC: Authorizing `identity:delete_user(user_id=32234b2922514f96bff52c2998f7694f)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:56.619205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e16469-04bb-4b6f-8430-4e1503b7041d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:56.845070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b6e16469-04bb-4b6f-8430-4e1503b7041d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32234b2922514f96bff52c2998f7694f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:56.880133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b6e16469-04bb-4b6f-8430-4e1503b7041d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32234b2922514f96bff52c2998f7694f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:56.966052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b6e16469-04bb-4b6f-8430-4e1503b7041d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32234b2922514f96bff52c2998f7694f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:56.975769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b6e16469-04bb-4b6f-8430-4e1503b7041d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32234b2922514f96bff52c2998f7694f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:56.976855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b6e16469-04bb-4b6f-8430-4e1503b7041d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32234b2922514f96bff52c2998f7694f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:57.001904 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2700/5472] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:26:56 2022] DELETE /identity/v3/users/32234b2922514f96bff52c2998f7694f => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:57.004296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcacb3-b260-46ea-a04b-ab6eb79bf54a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:57.004823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcacb3-b260-46ea-a04b-ab6eb79bf54a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:57.005250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcacb3-b260-46ea-a04b-ab6eb79bf54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:57.033645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c4fcacb3-b260-46ea-a04b-ab6eb79bf54a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:57.035560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c4fcacb3-b260-46ea-a04b-ab6eb79bf54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:57.084028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090aea93-abde-4b96-b964-e40d35df503d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:57.085115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090aea93-abde-4b96-b964-e40d35df503d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:57.085115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090aea93-abde-4b96-b964-e40d35df503d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:57.104022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-090aea93-abde-4b96-b964-e40d35df503d None None] MFA Rules not processed for user `029c76a0ba614b5880128c4309902c67`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:57.105348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-090aea93-abde-4b96-b964-e40d35df503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:57.198369 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2773/5473] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:57.220936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcacb3-b260-46ea-a04b-ab6eb79bf54a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:57.220936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c4fcacb3-b260-46ea-a04b-ab6eb79bf54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:57.264084 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2701/5474] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:57.343287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:57.378227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:57.384812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcacb3-b260-46ea-a04b-ab6eb79bf54a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:57.398342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818be82f-9dc5-43e4-8b0e-1919b0b378ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:57.400745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818be82f-9dc5-43e4-8b0e-1919b0b378ef service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:57.401189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818be82f-9dc5-43e4-8b0e-1919b0b378ef service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:57.402357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818be82f-9dc5-43e4-8b0e-1919b0b378ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:57.426540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818be82f-9dc5-43e4-8b0e-1919b0b378ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:57.430534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818be82f-9dc5-43e4-8b0e-1919b0b378ef service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:57.459981 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2774/5475] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:26:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:26:58.196651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:26:58.694181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526d75f-4a88-4d8f-be6d-2a84c834d009 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:58.694880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526d75f-4a88-4d8f-be6d-2a84c834d009 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:58.694880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526d75f-4a88-4d8f-be6d-2a84c834d009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:58.715471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3526d75f-4a88-4d8f-be6d-2a84c834d009 None None] MFA Rules not processed for user `029c76a0ba614b5880128c4309902c67`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:58.717112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3526d75f-4a88-4d8f-be6d-2a84c834d009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:58.724243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818be82f-9dc5-43e4-8b0e-1919b0b378ef service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:58.725995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-818be82f-9dc5-43e4-8b0e-1919b0b378ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:58.773229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818be82f-9dc5-43e4-8b0e-1919b0b378ef service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:58.776032 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2702/5476] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:58.786843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33649ec-05cb-4d69-ac60-3dfb6fc42ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:58.788137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33649ec-05cb-4d69-ac60-3dfb6fc42ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:58.788423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33649ec-05cb-4d69-ac60-3dfb6fc42ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:58.790705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33649ec-05cb-4d69-ac60-3dfb6fc42ef8 admin admin] PATH_INFO: `/v3/projects/fccf4fbc1b404ebab6e36dd87be16c60` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:58.790705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33649ec-05cb-4d69-ac60-3dfb6fc42ef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fccf4fbc1b404ebab6e36dd87be16c60)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:58.792306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33649ec-05cb-4d69-ac60-3dfb6fc42ef8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:58.926994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f33649ec-05cb-4d69-ac60-3dfb6fc42ef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fccf4fbc1b404ebab6e36dd87be16c60', 'request_id': 'req-f33649ec-05cb-4d69-ac60-3dfb6fc42ef8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:58.933608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f33649ec-05cb-4d69-ac60-3dfb6fc42ef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fccf4fbc1b404ebab6e36dd87be16c60', 'request_id': 'req-f33649ec-05cb-4d69-ac60-3dfb6fc42ef8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:58.950135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f33649ec-05cb-4d69-ac60-3dfb6fc42ef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fccf4fbc1b404ebab6e36dd87be16c60', 'request_id': 'req-f33649ec-05cb-4d69-ac60-3dfb6fc42ef8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:59.053356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f33649ec-05cb-4d69-ac60-3dfb6fc42ef8 admin admin] The token cache is being invalidate because project fccf4fbc1b404ebab6e36dd87be16c60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:26:59.053645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f33649ec-05cb-4d69-ac60-3dfb6fc42ef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:59.056131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f33649ec-05cb-4d69-ac60-3dfb6fc42ef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:26:59.062908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c115854-fa69-46cc-a6c4-0297e6928187 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:59.063441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c115854-fa69-46cc-a6c4-0297e6928187 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:59.063868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c115854-fa69-46cc-a6c4-0297e6928187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:59.065708 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2775/5477] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:26:58 2022] DELETE /identity/v3/projects/fccf4fbc1b404ebab6e36dd87be16c60 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:26:59.103507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1c115854-fa69-46cc-a6c4-0297e6928187 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:59.105685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1c115854-fa69-46cc-a6c4-0297e6928187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:59.564546 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2703/5478] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:59.573739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06894650-0aa4-4685-8143-22e82b25566d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:59.574203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06894650-0aa4-4685-8143-22e82b25566d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:59.574659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06894650-0aa4-4685-8143-22e82b25566d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:59.616825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-06894650-0aa4-4685-8143-22e82b25566d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:26:59.619639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-06894650-0aa4-4685-8143-22e82b25566d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:26:59.641448 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2776/5479] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:26:59.642257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c115854-fa69-46cc-a6c4-0297e6928187 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:59.655779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c115854-fa69-46cc-a6c4-0297e6928187 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:59.661962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02281f52-03a4-4d04-9faa-d67bf56ab4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:59.663178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02281f52-03a4-4d04-9faa-d67bf56ab4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:59.663715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02281f52-03a4-4d04-9faa-d67bf56ab4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:59.664160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02281f52-03a4-4d04-9faa-d67bf56ab4b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:59.665774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02281f52-03a4-4d04-9faa-d67bf56ab4b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:26:59.667493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02281f52-03a4-4d04-9faa-d67bf56ab4b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:59.671628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02281f52-03a4-4d04-9faa-d67bf56ab4b4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:59.695560 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2704/5480] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:26:59.696956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06894650-0aa4-4685-8143-22e82b25566d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:59.710726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06894650-0aa4-4685-8143-22e82b25566d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:26:59.722143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bc0e7-860c-4801-84b4-bbb3cb261e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:26:59.723482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bc0e7-860c-4801-84b4-bbb3cb261e0e admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:26:59.723783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bc0e7-860c-4801-84b4-bbb3cb261e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:26:59.724123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bc0e7-860c-4801-84b4-bbb3cb261e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:26:59.729974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bc0e7-860c-4801-84b4-bbb3cb261e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:26:59.761955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bc0e7-860c-4801-84b4-bbb3cb261e0e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:26:59.909781 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2777/5481] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:26:59 2022] POST /identity/v3/projects => generated 379 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:26:59.910841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02281f52-03a4-4d04-9faa-d67bf56ab4b4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:26:59.930431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02281f52-03a4-4d04-9faa-d67bf56ab4b4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:00.002462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f11a5f-de33-428a-967b-62a955ba0e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:00.004769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f11a5f-de33-428a-967b-62a955ba0e01 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:00.005257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f11a5f-de33-428a-967b-62a955ba0e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:00.005963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f11a5f-de33-428a-967b-62a955ba0e01 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:00.006852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f11a5f-de33-428a-967b-62a955ba0e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:00.009235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f11a5f-de33-428a-967b-62a955ba0e01 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:00.046058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:00.089350 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2705/5482] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:26:59 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:27:00.093052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bc0e7-860c-4801-84b4-bbb3cb261e0e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:00.123444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bc0e7-860c-4801-84b4-bbb3cb261e0e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:00.134204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874080bb-b030-4096-9ad4-0ba536c47781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:00.134894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874080bb-b030-4096-9ad4-0ba536c47781 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:00.135271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874080bb-b030-4096-9ad4-0ba536c47781 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:00.135699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874080bb-b030-4096-9ad4-0ba536c47781 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:00.136605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874080bb-b030-4096-9ad4-0ba536c47781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:00.138406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874080bb-b030-4096-9ad4-0ba536c47781 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:00.151851 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2778/5483] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:27:00.155923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f11a5f-de33-428a-967b-62a955ba0e01 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:00.183503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f11a5f-de33-428a-967b-62a955ba0e01 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:00.205858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27374b93-01a0-469f-9cd3-84fc27bde250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:00.209590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27374b93-01a0-469f-9cd3-84fc27bde250 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:00.210437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27374b93-01a0-469f-9cd3-84fc27bde250 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:00.224234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27374b93-01a0-469f-9cd3-84fc27bde250 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:00.226971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27374b93-01a0-469f-9cd3-84fc27bde250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:00.227587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27374b93-01a0-469f-9cd3-84fc27bde250 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:00.250026 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2706/5484] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:27:00.253343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874080bb-b030-4096-9ad4-0ba536c47781 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:00.267538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874080bb-b030-4096-9ad4-0ba536c47781 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:00.285278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b03cdc-ec1f-4203-a8e2-2fe71f909f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:00.289420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b03cdc-ec1f-4203-a8e2-2fe71f909f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:00.297048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b03cdc-ec1f-4203-a8e2-2fe71f909f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:00.297048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b03cdc-ec1f-4203-a8e2-2fe71f909f9b admin admin] PATH_INFO: `/v3/projects/a2eff74d6336466cba6bedebcc17e7db/users/49e73f91919545bb8321142062d595fb/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:00.304568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:00.344600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b03cdc-ec1f-4203-a8e2-2fe71f909f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2eff74d6336466cba6bedebcc17e7db, user_id=49e73f91919545bb8321142062d595fb, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:00.348450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b03cdc-ec1f-4203-a8e2-2fe71f909f9b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:00.433886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc3309-8858-4137-9754-7f8a2c2c1bd7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:00.434365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc3309-8858-4137-9754-7f8a2c2c1bd7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:00.436438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc3309-8858-4137-9754-7f8a2c2c1bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:00.437192 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2779/5485] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:27:00 2022] PUT /identity/v3/projects/a2eff74d6336466cba6bedebcc17e7db/users/49e73f91919545bb8321142062d595fb/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:27:00.513401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9efc3309-8858-4137-9754-7f8a2c2c1bd7 None None] MFA Rules not processed for user `49e73f91919545bb8321142062d595fb`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:00.521186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9efc3309-8858-4137-9754-7f8a2c2c1bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:00.709386 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2707/5486] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:00.715241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b03cdc-ec1f-4203-a8e2-2fe71f909f9b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:00.799486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b03cdc-ec1f-4203-a8e2-2fe71f909f9b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:00.805056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0ee81-3ea7-42cb-83b8-34ebadc7d1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:00.805926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0ee81-3ea7-42cb-83b8-34ebadc7d1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:00.806350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0ee81-3ea7-42cb-83b8-34ebadc7d1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:00.806700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0ee81-3ea7-42cb-83b8-34ebadc7d1d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:00.807557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0ee81-3ea7-42cb-83b8-34ebadc7d1d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:00.809760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0ee81-3ea7-42cb-83b8-34ebadc7d1d8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:00.980899 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2780/5487] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:27:00 2022] POST /identity/v3/projects => generated 379 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:27:00.985092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc3309-8858-4137-9754-7f8a2c2c1bd7 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:01.004124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc3309-8858-4137-9754-7f8a2c2c1bd7 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:01.131297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac797d-86dc-4b99-a6da-19b27ed2f58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:01.133139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac797d-86dc-4b99-a6da-19b27ed2f58a admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:01.133741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac797d-86dc-4b99-a6da-19b27ed2f58a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:01.134750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac797d-86dc-4b99-a6da-19b27ed2f58a admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:01.135810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac797d-86dc-4b99-a6da-19b27ed2f58a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:01.139291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac797d-86dc-4b99-a6da-19b27ed2f58a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:01.307216 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2708/5488] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:27:00 2022] POST /identity/v3/users => generated 290 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:27:01.310714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0ee81-3ea7-42cb-83b8-34ebadc7d1d8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:01.331462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0ee81-3ea7-42cb-83b8-34ebadc7d1d8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:01.341270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca541a-9c28-48f8-b82b-6b7ead652c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:01.342476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca541a-9c28-48f8-b82b-6b7ead652c33 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:01.342920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca541a-9c28-48f8-b82b-6b7ead652c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:01.344142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca541a-9c28-48f8-b82b-6b7ead652c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:01.349222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca541a-9c28-48f8-b82b-6b7ead652c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:01.349222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca541a-9c28-48f8-b82b-6b7ead652c33 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:01.361590 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2781/5489] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:27:01.366584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac797d-86dc-4b99-a6da-19b27ed2f58a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:01.379493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac797d-86dc-4b99-a6da-19b27ed2f58a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:01.386000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe82d5-f764-4e04-9abd-c1a6b6f4accb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:01.386849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe82d5-f764-4e04-9abd-c1a6b6f4accb admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:01.388711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe82d5-f764-4e04-9abd-c1a6b6f4accb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:01.389182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe82d5-f764-4e04-9abd-c1a6b6f4accb admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:01.389934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe82d5-f764-4e04-9abd-c1a6b6f4accb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:01.402362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe82d5-f764-4e04-9abd-c1a6b6f4accb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:01.405372 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2709/5490] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:27:01.409218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca541a-9c28-48f8-b82b-6b7ead652c33 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:01.421217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca541a-9c28-48f8-b82b-6b7ead652c33 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:01.427768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fe601-5224-45a1-a239-1e056502eaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:01.428888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fe601-5224-45a1-a239-1e056502eaa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:01.429349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fe601-5224-45a1-a239-1e056502eaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:01.429810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fe601-5224-45a1-a239-1e056502eaa5 admin admin] PATH_INFO: `/v3/projects/6d89b8be4809404ab877f8667843ba00/users/398d310446104f5894032193edecf055/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:01.455109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fe601-5224-45a1-a239-1e056502eaa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d89b8be4809404ab877f8667843ba00, user_id=398d310446104f5894032193edecf055, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:01.458996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fe601-5224-45a1-a239-1e056502eaa5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:01.651277 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2782/5491] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:27:01 2022] PUT /identity/v3/projects/6d89b8be4809404ab877f8667843ba00/users/398d310446104f5894032193edecf055/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:01.661273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c80fa-7858-404e-bd9e-5fc2f53ad3e3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:01.661573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c80fa-7858-404e-bd9e-5fc2f53ad3e3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:01.661850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c80fa-7858-404e-bd9e-5fc2f53ad3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:01.753303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b99c80fa-7858-404e-bd9e-5fc2f53ad3e3 None None] MFA Rules not processed for user `398d310446104f5894032193edecf055`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:01.758104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b99c80fa-7858-404e-bd9e-5fc2f53ad3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:01.926515 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2710/5492] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:01.931550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fe601-5224-45a1-a239-1e056502eaa5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:02.019720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fe601-5224-45a1-a239-1e056502eaa5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:02.029394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee898d-ab81-4c72-a784-8703b9b264ea tempest-IdentityV3ProjectsTest-954845830 tempest-IdentityV3ProjectsTest-954845830-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49e73f91919545bb8321142062d595fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2eff74d6336466cba6bedebcc17e7db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:02.030601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee898d-ab81-4c72-a784-8703b9b264ea tempest-IdentityV3ProjectsTest-954845830 tempest-IdentityV3ProjectsTest-954845830-project] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:02.031098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee898d-ab81-4c72-a784-8703b9b264ea tempest-IdentityV3ProjectsTest-954845830 tempest-IdentityV3ProjectsTest-954845830-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:02.031818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee898d-ab81-4c72-a784-8703b9b264ea tempest-IdentityV3ProjectsTest-954845830 tempest-IdentityV3ProjectsTest-954845830-project] PATH_INFO: `/v3/users/49e73f91919545bb8321142062d595fb/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:02.037057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee898d-ab81-4c72-a784-8703b9b264ea tempest-IdentityV3ProjectsTest-954845830 tempest-IdentityV3ProjectsTest-954845830-project] RBAC: Authorizing `identity:list_user_projects(user_id=49e73f91919545bb8321142062d595fb)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:02.040474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee898d-ab81-4c72-a784-8703b9b264ea tempest-IdentityV3ProjectsTest-954845830 tempest-IdentityV3ProjectsTest-954845830-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:02.123203 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2783/5493] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Jul 16 21:27:01 2022] GET /identity/v3/users/49e73f91919545bb8321142062d595fb/projects => generated 515 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:27:02.127760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3272b-c48c-4d3f-9e5f-7c23cac5e847 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:02.131081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3272b-c48c-4d3f-9e5f-7c23cac5e847 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:02.131584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3272b-c48c-4d3f-9e5f-7c23cac5e847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:02.182333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-41c3272b-c48c-4d3f-9e5f-7c23cac5e847 None None] MFA Rules not processed for user `49e73f91919545bb8321142062d595fb`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:02.184300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-41c3272b-c48c-4d3f-9e5f-7c23cac5e847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:02.189143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:02.231100 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2711/5494] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:02.236001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6946e-5e8e-4b77-9e27-8168bfc16549 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:02.236484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6946e-5e8e-4b77-9e27-8168bfc16549 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:02.236911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6946e-5e8e-4b77-9e27-8168bfc16549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:02.284175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7da6946e-5e8e-4b77-9e27-8168bfc16549 None None] MFA Rules not processed for user `49e73f91919545bb8321142062d595fb`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:02.284175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7da6946e-5e8e-4b77-9e27-8168bfc16549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:02.351795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.models.token_model [None req-7da6946e-5e8e-4b77-9e27-8168bfc16549 None None] User 49e73f91919545bb8321142062d595fb has no access to project 6d89b8be4809404ab877f8667843ba00 {{(pid=98196) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Jul 16 21:27:02.357300 ncdv-master-1 devstack@keystone.service[98196]: WARNING keystone.server.flask.application [None req-7da6946e-5e8e-4b77-9e27-8168bfc16549 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 16 21:27:02.364655 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2784/5495] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:02 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 125 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 16 21:27:02.368681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3272b-c48c-4d3f-9e5f-7c23cac5e847 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:02.441399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3272b-c48c-4d3f-9e5f-7c23cac5e847 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:02.447236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073cece-d2d7-4e81-abaf-b9867613b500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:02.448136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073cece-d2d7-4e81-abaf-b9867613b500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:02.448420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073cece-d2d7-4e81-abaf-b9867613b500 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:02.448694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073cece-d2d7-4e81-abaf-b9867613b500 admin admin] PATH_INFO: `/v3/users/49e73f91919545bb8321142062d595fb` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:02.450138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073cece-d2d7-4e81-abaf-b9867613b500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49e73f91919545bb8321142062d595fb)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:02.452129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073cece-d2d7-4e81-abaf-b9867613b500 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:02.674973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:02.688603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5073cece-d2d7-4e81-abaf-b9867613b500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49e73f91919545bb8321142062d595fb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:02.706279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5073cece-d2d7-4e81-abaf-b9867613b500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49e73f91919545bb8321142062d595fb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:02.795793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5073cece-d2d7-4e81-abaf-b9867613b500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49e73f91919545bb8321142062d595fb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:02.806140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5073cece-d2d7-4e81-abaf-b9867613b500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49e73f91919545bb8321142062d595fb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:02.812009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5073cece-d2d7-4e81-abaf-b9867613b500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49e73f91919545bb8321142062d595fb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:02.826567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8c699-dac8-4278-a9ff-93c1c238e02f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:02.827225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8c699-dac8-4278-a9ff-93c1c238e02f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:02.832483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8c699-dac8-4278-a9ff-93c1c238e02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:02.849811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f5b8c699-dac8-4278-a9ff-93c1c238e02f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:02.851202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f5b8c699-dac8-4278-a9ff-93c1c238e02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:02.855582 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2712/5496] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:27:02 2022] DELETE /identity/v3/users/49e73f91919545bb8321142062d595fb => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:02.938281 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2785/5497] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:02.949193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073cece-d2d7-4e81-abaf-b9867613b500 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:02.951177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5073cece-d2d7-4e81-abaf-b9867613b500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:03.060155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073cece-d2d7-4e81-abaf-b9867613b500 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:03.066851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda8718-bd84-4f50-a3ee-71bc55817053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:03.067750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda8718-bd84-4f50-a3ee-71bc55817053 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:03.069523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda8718-bd84-4f50-a3ee-71bc55817053 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:03.069523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda8718-bd84-4f50-a3ee-71bc55817053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:03.097640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a333b-1eb0-42ec-848b-b1c7277fea3f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:03.097998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a333b-1eb0-42ec-848b-b1c7277fea3f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:03.098201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a333b-1eb0-42ec-848b-b1c7277fea3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:03.111401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda8718-bd84-4f50-a3ee-71bc55817053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:03.115516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda8718-bd84-4f50-a3ee-71bc55817053 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:03.132377 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2713/5498] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:27:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:27:03.140732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f05a333b-1eb0-42ec-848b-b1c7277fea3f None None] MFA Rules not processed for user `bcc9aa2a091c490599f9a9c41163e2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:03.142123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f05a333b-1eb0-42ec-848b-b1c7277fea3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:03.252150 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2786/5499] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:27:03.475741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda8718-bd84-4f50-a3ee-71bc55817053 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:03.477422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2fda8718-bd84-4f50-a3ee-71bc55817053 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:03.604627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda8718-bd84-4f50-a3ee-71bc55817053 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:03.610275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23239954-395b-43e3-bddf-967f59ff3c45 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:03.610822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23239954-395b-43e3-bddf-967f59ff3c45 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:03.611144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23239954-395b-43e3-bddf-967f59ff3c45 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:03.611412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23239954-395b-43e3-bddf-967f59ff3c45 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:03.613855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-23239954-395b-43e3-bddf-967f59ff3c45 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:03.634698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23239954-395b-43e3-bddf-967f59ff3c45 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:03.636378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23239954-395b-43e3-bddf-967f59ff3c45 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:03.656646 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2714/5500] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:27:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:27:03.739744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a333b-1eb0-42ec-848b-b1c7277fea3f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:03.742462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f05a333b-1eb0-42ec-848b-b1c7277fea3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:03.759362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a333b-1eb0-42ec-848b-b1c7277fea3f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:03.774631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246c356-1f9f-4c3f-a053-0be5331a0c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:03.775632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246c356-1f9f-4c3f-a053-0be5331a0c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:03.776020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246c356-1f9f-4c3f-a053-0be5331a0c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:03.776401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246c356-1f9f-4c3f-a053-0be5331a0c84 admin admin] PATH_INFO: `/v3/users/6f2e974ab5aa48dfb4b00f810dcedb63` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:03.779481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246c356-1f9f-4c3f-a053-0be5331a0c84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f2e974ab5aa48dfb4b00f810dcedb63)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:03.779875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246c356-1f9f-4c3f-a053-0be5331a0c84 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:04.008135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:04.070194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e246c356-1f9f-4c3f-a053-0be5331a0c84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f2e974ab5aa48dfb4b00f810dcedb63'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:04.084067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e246c356-1f9f-4c3f-a053-0be5331a0c84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f2e974ab5aa48dfb4b00f810dcedb63'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:04.136718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e246c356-1f9f-4c3f-a053-0be5331a0c84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f2e974ab5aa48dfb4b00f810dcedb63'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:04.137419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e246c356-1f9f-4c3f-a053-0be5331a0c84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f2e974ab5aa48dfb4b00f810dcedb63'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:04.153332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e246c356-1f9f-4c3f-a053-0be5331a0c84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f2e974ab5aa48dfb4b00f810dcedb63'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:04.167401 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2787/5501] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:27:03 2022] DELETE /identity/v3/users/6f2e974ab5aa48dfb4b00f810dcedb63 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:04.309770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:04.381759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23239954-395b-43e3-bddf-967f59ff3c45 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:04.383311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-23239954-395b-43e3-bddf-967f59ff3c45 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:04.462435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23239954-395b-43e3-bddf-967f59ff3c45 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:04.557486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ea533-5232-42b9-8d80-060950638105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:04.558498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ea533-5232-42b9-8d80-060950638105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:04.558839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ea533-5232-42b9-8d80-060950638105 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:04.559215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ea533-5232-42b9-8d80-060950638105 admin admin] PATH_INFO: `/v3/projects/a2eff74d6336466cba6bedebcc17e7db` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:04.560500 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ea533-5232-42b9-8d80-060950638105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2eff74d6336466cba6bedebcc17e7db)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:04.562559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ea533-5232-42b9-8d80-060950638105 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:04.731804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1b5ea533-5232-42b9-8d80-060950638105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2eff74d6336466cba6bedebcc17e7db', 'request_id': 'req-1b5ea533-5232-42b9-8d80-060950638105'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:04.738005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1b5ea533-5232-42b9-8d80-060950638105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2eff74d6336466cba6bedebcc17e7db', 'request_id': 'req-1b5ea533-5232-42b9-8d80-060950638105'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:04.745369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1b5ea533-5232-42b9-8d80-060950638105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2eff74d6336466cba6bedebcc17e7db', 'request_id': 'req-1b5ea533-5232-42b9-8d80-060950638105'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:04.818356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1b5ea533-5232-42b9-8d80-060950638105 admin admin] The token cache is being invalidate because project a2eff74d6336466cba6bedebcc17e7db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:27:04.819280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1b5ea533-5232-42b9-8d80-060950638105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:04.822712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1b5ea533-5232-42b9-8d80-060950638105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:04.825631 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2715/5502] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:27:04 2022] DELETE /identity/v3/projects/a2eff74d6336466cba6bedebcc17e7db => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:04.829630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246c356-1f9f-4c3f-a053-0be5331a0c84 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:04.831097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e246c356-1f9f-4c3f-a053-0be5331a0c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:04.858483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246c356-1f9f-4c3f-a053-0be5331a0c84 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:04.929244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ea533-5232-42b9-8d80-060950638105 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:04.930971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1b5ea533-5232-42b9-8d80-060950638105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:04.972230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1380be1-1c87-42e4-9ef8-9a1449ff8efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:04.973406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1380be1-1c87-42e4-9ef8-9a1449ff8efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:04.977301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1380be1-1c87-42e4-9ef8-9a1449ff8efe admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:04.981239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1380be1-1c87-42e4-9ef8-9a1449ff8efe admin admin] PATH_INFO: `/v3/users/398d310446104f5894032193edecf055` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:04.987819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1380be1-1c87-42e4-9ef8-9a1449ff8efe admin admin] RBAC: Authorizing `identity:delete_user(user_id=398d310446104f5894032193edecf055)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:04.987819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1380be1-1c87-42e4-9ef8-9a1449ff8efe admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:05.078903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ea533-5232-42b9-8d80-060950638105 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:05.090037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc4be8-d3c5-4607-a6e7-665b1910b7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:05.094700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc4be8-d3c5-4607-a6e7-665b1910b7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:05.094700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc4be8-d3c5-4607-a6e7-665b1910b7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:05.094700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc4be8-d3c5-4607-a6e7-665b1910b7d3 admin admin] PATH_INFO: `/v3/projects/d31be8475a6a49d6bfe8132dd050c6c0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:05.094700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc4be8-d3c5-4607-a6e7-665b1910b7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d31be8475a6a49d6bfe8132dd050c6c0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:05.098670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc4be8-d3c5-4607-a6e7-665b1910b7d3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:05.243659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f1380be1-1c87-42e4-9ef8-9a1449ff8efe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '398d310446104f5894032193edecf055'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:05.255204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cbfc4be8-d3c5-4607-a6e7-665b1910b7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd31be8475a6a49d6bfe8132dd050c6c0', 'request_id': 'req-cbfc4be8-d3c5-4607-a6e7-665b1910b7d3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:05.256239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f1380be1-1c87-42e4-9ef8-9a1449ff8efe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '398d310446104f5894032193edecf055'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:05.276610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cbfc4be8-d3c5-4607-a6e7-665b1910b7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd31be8475a6a49d6bfe8132dd050c6c0', 'request_id': 'req-cbfc4be8-d3c5-4607-a6e7-665b1910b7d3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:05.287052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cbfc4be8-d3c5-4607-a6e7-665b1910b7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd31be8475a6a49d6bfe8132dd050c6c0', 'request_id': 'req-cbfc4be8-d3c5-4607-a6e7-665b1910b7d3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:05.332005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f1380be1-1c87-42e4-9ef8-9a1449ff8efe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '398d310446104f5894032193edecf055'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:05.334152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f1380be1-1c87-42e4-9ef8-9a1449ff8efe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '398d310446104f5894032193edecf055'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:05.355725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f1380be1-1c87-42e4-9ef8-9a1449ff8efe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '398d310446104f5894032193edecf055'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:05.368951 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2788/5503] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:27:04 2022] DELETE /identity/v3/users/398d310446104f5894032193edecf055 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:05.425578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cbfc4be8-d3c5-4607-a6e7-665b1910b7d3 admin admin] The token cache is being invalidate because project d31be8475a6a49d6bfe8132dd050c6c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:27:05.426384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cbfc4be8-d3c5-4607-a6e7-665b1910b7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:05.427158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cbfc4be8-d3c5-4607-a6e7-665b1910b7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:05.429195 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2716/5504] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:27:04 2022] DELETE /identity/v3/projects/d31be8475a6a49d6bfe8132dd050c6c0 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:05.434523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7c2b7-6f97-4929-b5d8-5bd4aa7782ad None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:05.435143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7c2b7-6f97-4929-b5d8-5bd4aa7782ad None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:05.435250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7c2b7-6f97-4929-b5d8-5bd4aa7782ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:05.462037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c9f7c2b7-6f97-4929-b5d8-5bd4aa7782ad None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:05.463836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c9f7c2b7-6f97-4929-b5d8-5bd4aa7782ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:05.522777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:05.545844 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2789/5505] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:05.554404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bce748-1958-4307-91dd-87f72e103455 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:05.554818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bce748-1958-4307-91dd-87f72e103455 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:05.555340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bce748-1958-4307-91dd-87f72e103455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:05.575420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-21bce748-1958-4307-91dd-87f72e103455 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:05.576794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-21bce748-1958-4307-91dd-87f72e103455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:05.587768 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2717/5506] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:27:05.592040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7c2b7-6f97-4929-b5d8-5bd4aa7782ad None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:05.602670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7c2b7-6f97-4929-b5d8-5bd4aa7782ad None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:05.611656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b8190-dbae-4233-82ba-73b9fffb4ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:05.612799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b8190-dbae-4233-82ba-73b9fffb4ccf admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:05.613088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b8190-dbae-4233-82ba-73b9fffb4ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:05.613537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b8190-dbae-4233-82ba-73b9fffb4ccf admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:05.615353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b8190-dbae-4233-82ba-73b9fffb4ccf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:27:05.615670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b8190-dbae-4233-82ba-73b9fffb4ccf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:05.617334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b8190-dbae-4233-82ba-73b9fffb4ccf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:05.634301 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2790/5507] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:27:05.639782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bce748-1958-4307-91dd-87f72e103455 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:05.651268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bce748-1958-4307-91dd-87f72e103455 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:05.662311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44418c55-c5b5-4044-a5e4-1a7c385851ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:05.663190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44418c55-c5b5-4044-a5e4-1a7c385851ad admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:05.663715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44418c55-c5b5-4044-a5e4-1a7c385851ad admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:05.664089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44418c55-c5b5-4044-a5e4-1a7c385851ad admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:05.665208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44418c55-c5b5-4044-a5e4-1a7c385851ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:05.667545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44418c55-c5b5-4044-a5e4-1a7c385851ad admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:05.709764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:05.788415 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2718/5508] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:27:05 2022] POST /identity/v3/projects => generated 391 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:27:05.792483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b8190-dbae-4233-82ba-73b9fffb4ccf admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:05.804105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b8190-dbae-4233-82ba-73b9fffb4ccf admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:05.912581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17864ed-3003-4c5f-a480-b01fc7a65224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:05.913279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17864ed-3003-4c5f-a480-b01fc7a65224 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:05.913859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17864ed-3003-4c5f-a480-b01fc7a65224 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:05.913859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17864ed-3003-4c5f-a480-b01fc7a65224 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:05.914578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17864ed-3003-4c5f-a480-b01fc7a65224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:05.916560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17864ed-3003-4c5f-a480-b01fc7a65224 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:06.032425 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2791/5509] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:27:05 2022] POST /identity/v3/users => generated 296 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:27:06.036714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44418c55-c5b5-4044-a5e4-1a7c385851ad admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:06.048712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44418c55-c5b5-4044-a5e4-1a7c385851ad admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:06.054507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d43678-0f7a-434a-ba02-287e8bb25a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:06.055117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d43678-0f7a-434a-ba02-287e8bb25a31 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:06.055474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d43678-0f7a-434a-ba02-287e8bb25a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:06.055895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d43678-0f7a-434a-ba02-287e8bb25a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:06.056736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d43678-0f7a-434a-ba02-287e8bb25a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:06.058422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d43678-0f7a-434a-ba02-287e8bb25a31 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:06.074542 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2719/5510] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:27:06.075044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17864ed-3003-4c5f-a480-b01fc7a65224 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:06.089010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17864ed-3003-4c5f-a480-b01fc7a65224 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:06.096002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c12dc-74bf-4e07-bd30-387133d8efb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:06.097111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c12dc-74bf-4e07-bd30-387133d8efb3 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:06.097597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c12dc-74bf-4e07-bd30-387133d8efb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:06.098479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c12dc-74bf-4e07-bd30-387133d8efb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:06.099483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c12dc-74bf-4e07-bd30-387133d8efb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:06.101354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c12dc-74bf-4e07-bd30-387133d8efb3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:06.116392 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2792/5511] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:27:06.120771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d43678-0f7a-434a-ba02-287e8bb25a31 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:06.133730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d43678-0f7a-434a-ba02-287e8bb25a31 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:06.138531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134782b-7731-43ac-b4ad-5c04d56d1e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:06.139700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134782b-7731-43ac-b4ad-5c04d56d1e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:06.140048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134782b-7731-43ac-b4ad-5c04d56d1e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:06.140393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134782b-7731-43ac-b4ad-5c04d56d1e4e admin admin] PATH_INFO: `/v3/projects/aef73d309b204eeebfc2ce69b4e4a41b/users/45315c12d53349ae8cd245cb138b8dcd/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:06.161134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134782b-7731-43ac-b4ad-5c04d56d1e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef73d309b204eeebfc2ce69b4e4a41b, user_id=45315c12d53349ae8cd245cb138b8dcd, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:06.164292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134782b-7731-43ac-b4ad-5c04d56d1e4e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:06.236969 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2720/5512] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:27:06 2022] PUT /identity/v3/projects/aef73d309b204eeebfc2ce69b4e4a41b/users/45315c12d53349ae8cd245cb138b8dcd/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:06.243230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3360885-12b1-4e53-bfaf-f369f76fdb13 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:06.243721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3360885-12b1-4e53-bfaf-f369f76fdb13 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:06.255247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3360885-12b1-4e53-bfaf-f369f76fdb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:06.279408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d3360885-12b1-4e53-bfaf-f369f76fdb13 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:06.281178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d3360885-12b1-4e53-bfaf-f369f76fdb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:06.298349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134782b-7731-43ac-b4ad-5c04d56d1e4e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:06.301048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5134782b-7731-43ac-b4ad-5c04d56d1e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:06.381065 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2793/5513] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:06.391426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3360885-12b1-4e53-bfaf-f369f76fdb13 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:06.394617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d3360885-12b1-4e53-bfaf-f369f76fdb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:06.430140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134782b-7731-43ac-b4ad-5c04d56d1e4e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:06.435407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fca235-1485-435c-992c-b6182c3e5d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:06.436663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fca235-1485-435c-992c-b6182c3e5d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:06.437116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fca235-1485-435c-992c-b6182c3e5d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:06.438348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fca235-1485-435c-992c-b6182c3e5d3d admin admin] PATH_INFO: `/v3/projects/6d89b8be4809404ab877f8667843ba00` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:06.439850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fca235-1485-435c-992c-b6182c3e5d3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d89b8be4809404ab877f8667843ba00)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:06.442444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fca235-1485-435c-992c-b6182c3e5d3d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:06.489168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3360885-12b1-4e53-bfaf-f369f76fdb13 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:06.493132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b59238-8f5b-49b7-97a2-05b27165b385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:06.494516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b59238-8f5b-49b7-97a2-05b27165b385 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:06.494924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b59238-8f5b-49b7-97a2-05b27165b385 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:06.495440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b59238-8f5b-49b7-97a2-05b27165b385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:06.507198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b59238-8f5b-49b7-97a2-05b27165b385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:06.508852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b59238-8f5b-49b7-97a2-05b27165b385 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:06.521681 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2794/5514] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:27:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:27:06.593980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-60fca235-1485-435c-992c-b6182c3e5d3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d89b8be4809404ab877f8667843ba00', 'request_id': 'req-60fca235-1485-435c-992c-b6182c3e5d3d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:06.600307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-60fca235-1485-435c-992c-b6182c3e5d3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d89b8be4809404ab877f8667843ba00', 'request_id': 'req-60fca235-1485-435c-992c-b6182c3e5d3d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:06.606415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-60fca235-1485-435c-992c-b6182c3e5d3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d89b8be4809404ab877f8667843ba00', 'request_id': 'req-60fca235-1485-435c-992c-b6182c3e5d3d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:06.744824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-60fca235-1485-435c-992c-b6182c3e5d3d admin admin] The token cache is being invalidate because project 6d89b8be4809404ab877f8667843ba00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:27:06.744997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-60fca235-1485-435c-992c-b6182c3e5d3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:06.745848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-60fca235-1485-435c-992c-b6182c3e5d3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:06.754122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0df302-84e8-4198-a94b-c8658a7593fb None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:06.754727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0df302-84e8-4198-a94b-c8658a7593fb None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:06.755177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0df302-84e8-4198-a94b-c8658a7593fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:06.756790 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2721/5515] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:27:06 2022] DELETE /identity/v3/projects/6d89b8be4809404ab877f8667843ba00 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:27:06.818681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7e0df302-84e8-4198-a94b-c8658a7593fb None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:06.821413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7e0df302-84e8-4198-a94b-c8658a7593fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:06.835251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:06.964753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a54f46-29c7-45a5-9b23-f2f6d72010cc None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:06.965889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a54f46-29c7-45a5-9b23-f2f6d72010cc None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:06.965889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a54f46-29c7-45a5-9b23-f2f6d72010cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:06.966048 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2795/5516] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:07.008202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-92a54f46-29c7-45a5-9b23-f2f6d72010cc None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:07.011990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-92a54f46-29c7-45a5-9b23-f2f6d72010cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:07.023265 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2722/5517] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:27:07.035621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0df302-84e8-4198-a94b-c8658a7593fb None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:07.047254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0df302-84e8-4198-a94b-c8658a7593fb None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:07.092595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a51cdd-df45-4843-bc1f-b9f59985ea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:07.093487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a51cdd-df45-4843-bc1f-b9f59985ea3e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:07.093801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a51cdd-df45-4843-bc1f-b9f59985ea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:07.094085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a51cdd-df45-4843-bc1f-b9f59985ea3e admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:07.098545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a51cdd-df45-4843-bc1f-b9f59985ea3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:27:07.099110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a51cdd-df45-4843-bc1f-b9f59985ea3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:07.105292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a51cdd-df45-4843-bc1f-b9f59985ea3e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:07.115878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:07.138694 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2796/5518] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:27:07.143056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a54f46-29c7-45a5-9b23-f2f6d72010cc None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:07.156336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a54f46-29c7-45a5-9b23-f2f6d72010cc None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:07.168311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430f959-0acc-4191-9a4c-edbd5c1012ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:07.169363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430f959-0acc-4191-9a4c-edbd5c1012ff admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:07.169908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430f959-0acc-4191-9a4c-edbd5c1012ff admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:07.170645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430f959-0acc-4191-9a4c-edbd5c1012ff admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:07.172973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430f959-0acc-4191-9a4c-edbd5c1012ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:07.177060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430f959-0acc-4191-9a4c-edbd5c1012ff admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:07.281442 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2723/5519] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:27:07 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:27:07.287196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a51cdd-df45-4843-bc1f-b9f59985ea3e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:07.304641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a51cdd-df45-4843-bc1f-b9f59985ea3e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:07.410258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe81b3c-a967-4701-a8c5-ce67c58b8c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:07.421681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe81b3c-a967-4701-a8c5-ce67c58b8c1c admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:07.423648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe81b3c-a967-4701-a8c5-ce67c58b8c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:07.424345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe81b3c-a967-4701-a8c5-ce67c58b8c1c admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:07.426933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe81b3c-a967-4701-a8c5-ce67c58b8c1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:07.430742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe81b3c-a967-4701-a8c5-ce67c58b8c1c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:07.678711 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2797/5520] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:27:07 2022] POST /identity/v3/users => generated 300 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:27:07.679985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430f959-0acc-4191-9a4c-edbd5c1012ff admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:07.692932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430f959-0acc-4191-9a4c-edbd5c1012ff admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:07.698928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288cc45-2c08-4da2-870f-08d34c3af6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:07.699852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288cc45-2c08-4da2-870f-08d34c3af6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:07.700295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288cc45-2c08-4da2-870f-08d34c3af6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:07.701174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288cc45-2c08-4da2-870f-08d34c3af6f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:07.702415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288cc45-2c08-4da2-870f-08d34c3af6f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:07.716948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288cc45-2c08-4da2-870f-08d34c3af6f1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:07.735049 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2724/5521] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:27:07.739686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe81b3c-a967-4701-a8c5-ce67c58b8c1c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:07.752261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe81b3c-a967-4701-a8c5-ce67c58b8c1c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:07.758324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e23786-49ad-4f1c-85ae-9aca49a6fe84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:07.759254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e23786-49ad-4f1c-85ae-9aca49a6fe84 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:07.759542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e23786-49ad-4f1c-85ae-9aca49a6fe84 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:07.762095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e23786-49ad-4f1c-85ae-9aca49a6fe84 admin admin] PATH_INFO: `/v3/projects/03157d2f17c94855989c0760bb0c8550/users/ab5e0f342d6441f3b2acc643d6a0e37e/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:07.800689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e23786-49ad-4f1c-85ae-9aca49a6fe84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03157d2f17c94855989c0760bb0c8550, user_id=ab5e0f342d6441f3b2acc643d6a0e37e, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:07.803086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e23786-49ad-4f1c-85ae-9aca49a6fe84 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:07.908802 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2798/5522] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:27:07 2022] PUT /identity/v3/projects/03157d2f17c94855989c0760bb0c8550/users/ab5e0f342d6441f3b2acc643d6a0e37e/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:27:07.911777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288cc45-2c08-4da2-870f-08d34c3af6f1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:07.927052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288cc45-2c08-4da2-870f-08d34c3af6f1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:08.024771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6fc4e-dc55-47ec-8ad2-9d0c4dd6c12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:08.027463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6fc4e-dc55-47ec-8ad2-9d0c4dd6c12d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:08.028688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6fc4e-dc55-47ec-8ad2-9d0c4dd6c12d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:08.029274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6fc4e-dc55-47ec-8ad2-9d0c4dd6c12d admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:08.030349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6fc4e-dc55-47ec-8ad2-9d0c4dd6c12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:08.032118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6fc4e-dc55-47ec-8ad2-9d0c4dd6c12d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:08.044492 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2725/5523] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:27:08.049617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e23786-49ad-4f1c-85ae-9aca49a6fe84 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:08.061820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e23786-49ad-4f1c-85ae-9aca49a6fe84 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:08.072160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759be3db-0acd-46b6-b7ef-9b60180e4b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:08.073392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759be3db-0acd-46b6-b7ef-9b60180e4b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:08.073774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759be3db-0acd-46b6-b7ef-9b60180e4b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:08.074162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759be3db-0acd-46b6-b7ef-9b60180e4b49 admin admin] PATH_INFO: `/v3/projects/03157d2f17c94855989c0760bb0c8550/users/ab5e0f342d6441f3b2acc643d6a0e37e/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:08.076668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759be3db-0acd-46b6-b7ef-9b60180e4b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03157d2f17c94855989c0760bb0c8550, user_id=ab5e0f342d6441f3b2acc643d6a0e37e, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:08.081692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759be3db-0acd-46b6-b7ef-9b60180e4b49 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:08.095313 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2799/5524] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:27:08 2022] PUT /identity/v3/projects/03157d2f17c94855989c0760bb0c8550/users/ab5e0f342d6441f3b2acc643d6a0e37e/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:08.106170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f6215-a7b4-489d-9733-0069c1565af9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:08.106518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f6215-a7b4-489d-9733-0069c1565af9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:08.106811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f6215-a7b4-489d-9733-0069c1565af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:08.161192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-951f6215-a7b4-489d-9733-0069c1565af9 None None] MFA Rules not processed for user `ab5e0f342d6441f3b2acc643d6a0e37e`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:08.162426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-951f6215-a7b4-489d-9733-0069c1565af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:08.308169 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2726/5525] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:08.311228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759be3db-0acd-46b6-b7ef-9b60180e4b49 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:08.524025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:08.676287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:08.715369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759be3db-0acd-46b6-b7ef-9b60180e4b49 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:08.720875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a297c-e49f-47b8-a391-85362bbbe4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:08.722408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a297c-e49f-47b8-a391-85362bbbe4ff admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:08.723156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a297c-e49f-47b8-a391-85362bbbe4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:08.723961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a297c-e49f-47b8-a391-85362bbbe4ff admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:08.724986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a297c-e49f-47b8-a391-85362bbbe4ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:08.727312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a297c-e49f-47b8-a391-85362bbbe4ff admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:08.971592 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2800/5526] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:27:08 2022] POST /identity/v3/projects => generated 385 bytes in 658 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:27:08.973583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f6215-a7b4-489d-9733-0069c1565af9 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:08.989438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f6215-a7b4-489d-9733-0069c1565af9 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:09.070183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c6099-6872-4081-b669-a117fd22d362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:09.070866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c6099-6872-4081-b669-a117fd22d362 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:09.071217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c6099-6872-4081-b669-a117fd22d362 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:09.071529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c6099-6872-4081-b669-a117fd22d362 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:09.072299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c6099-6872-4081-b669-a117fd22d362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:09.075389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c6099-6872-4081-b669-a117fd22d362 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:09.178265 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2727/5527] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:27:08 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:27:09.185434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a297c-e49f-47b8-a391-85362bbbe4ff admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:09.199967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a297c-e49f-47b8-a391-85362bbbe4ff admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:09.204569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9751a5-6658-4f5a-aaa3-5a80f4a0ea26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:09.205741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9751a5-6658-4f5a-aaa3-5a80f4a0ea26 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:09.206310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9751a5-6658-4f5a-aaa3-5a80f4a0ea26 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:09.207076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9751a5-6658-4f5a-aaa3-5a80f4a0ea26 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:09.208888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9751a5-6658-4f5a-aaa3-5a80f4a0ea26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:09.213587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9751a5-6658-4f5a-aaa3-5a80f4a0ea26 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:09.226814 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2801/5528] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:27:09.231391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c6099-6872-4081-b669-a117fd22d362 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:09.243964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c6099-6872-4081-b669-a117fd22d362 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:09.249152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7732a6-bda9-41ed-83d0-47b2ea24c9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:09.249864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7732a6-bda9-41ed-83d0-47b2ea24c9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:09.250143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7732a6-bda9-41ed-83d0-47b2ea24c9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:09.250418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7732a6-bda9-41ed-83d0-47b2ea24c9e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:09.251177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7732a6-bda9-41ed-83d0-47b2ea24c9e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:09.252772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7732a6-bda9-41ed-83d0-47b2ea24c9e2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:09.269523 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2728/5529] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:27:09.271125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9751a5-6658-4f5a-aaa3-5a80f4a0ea26 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:09.281293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9751a5-6658-4f5a-aaa3-5a80f4a0ea26 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:09.286418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ea93d-749b-4ba0-9099-221701af39c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:09.287603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ea93d-749b-4ba0-9099-221701af39c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:09.288044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ea93d-749b-4ba0-9099-221701af39c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:09.288480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ea93d-749b-4ba0-9099-221701af39c1 admin admin] PATH_INFO: `/v3/projects/959435ff9c6c4663b46b342d39be38dc/users/962bd24994e947bb9115fab47deb68f1/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:09.306442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ea93d-749b-4ba0-9099-221701af39c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=959435ff9c6c4663b46b342d39be38dc, user_id=962bd24994e947bb9115fab47deb68f1, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:09.310207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ea93d-749b-4ba0-9099-221701af39c1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:09.383626 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2802/5530] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:27:09 2022] PUT /identity/v3/projects/959435ff9c6c4663b46b342d39be38dc/users/962bd24994e947bb9115fab47deb68f1/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:09.395191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68cf8a-17f5-4a69-b8d2-5a06027e8f7a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:09.395554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68cf8a-17f5-4a69-b8d2-5a06027e8f7a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:09.396072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68cf8a-17f5-4a69-b8d2-5a06027e8f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:09.436608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8c68cf8a-17f5-4a69-b8d2-5a06027e8f7a None None] MFA Rules not processed for user `962bd24994e947bb9115fab47deb68f1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:09.438436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8c68cf8a-17f5-4a69-b8d2-5a06027e8f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:09.507348 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2729/5531] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:09.521421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ea93d-749b-4ba0-9099-221701af39c1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:09.523472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1b9ea93d-749b-4ba0-9099-221701af39c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:09.623302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:09.639069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ea93d-749b-4ba0-9099-221701af39c1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:09.645693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6dfd3f-b439-48e9-9373-9a80f2133f3b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:09.646358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dfd3f-b439-48e9-9373-9a80f2133f3b service glance] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:09.646649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dfd3f-b439-48e9-9373-9a80f2133f3b service glance] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:09.646925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dfd3f-b439-48e9-9373-9a80f2133f3b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:09.716094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6dfd3f-b439-48e9-9373-9a80f2133f3b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:09.717560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6dfd3f-b439-48e9-9373-9a80f2133f3b service glance] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:09.728354 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2803/5532] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:27:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:27:10.551485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68cf8a-17f5-4a69-b8d2-5a06027e8f7a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:10.687931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68cf8a-17f5-4a69-b8d2-5a06027e8f7a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:10.705002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd6633-e9a4-4e64-8c5e-1dbf1349c3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:10.705002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd6633-e9a4-4e64-8c5e-1dbf1349c3e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:10.707515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd6633-e9a4-4e64-8c5e-1dbf1349c3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:10.709555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd6633-e9a4-4e64-8c5e-1dbf1349c3e7 admin admin] PATH_INFO: `/v3/users/ab5e0f342d6441f3b2acc643d6a0e37e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:10.711556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd6633-e9a4-4e64-8c5e-1dbf1349c3e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab5e0f342d6441f3b2acc643d6a0e37e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:10.715516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd6633-e9a4-4e64-8c5e-1dbf1349c3e7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:10.988924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e6fd6633-e9a4-4e64-8c5e-1dbf1349c3e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab5e0f342d6441f3b2acc643d6a0e37e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:11.010186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e6fd6633-e9a4-4e64-8c5e-1dbf1349c3e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab5e0f342d6441f3b2acc643d6a0e37e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:11.074039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e6fd6633-e9a4-4e64-8c5e-1dbf1349c3e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab5e0f342d6441f3b2acc643d6a0e37e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:11.086172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e6fd6633-e9a4-4e64-8c5e-1dbf1349c3e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab5e0f342d6441f3b2acc643d6a0e37e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:11.087264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e6fd6633-e9a4-4e64-8c5e-1dbf1349c3e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab5e0f342d6441f3b2acc643d6a0e37e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:11.104915 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2730/5533] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:27:10 2022] DELETE /identity/v3/users/ab5e0f342d6441f3b2acc643d6a0e37e => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:11.106481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fb634-93d2-4e2b-9984-71083ef6f42e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:11.107327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fb634-93d2-4e2b-9984-71083ef6f42e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:11.107771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fb634-93d2-4e2b-9984-71083ef6f42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:11.140177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d87fb634-93d2-4e2b-9984-71083ef6f42e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:11.141603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d87fb634-93d2-4e2b-9984-71083ef6f42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:11.205608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:11.292513 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2804/5534] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:11.304027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd6633-e9a4-4e64-8c5e-1dbf1349c3e7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:11.309827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e6fd6633-e9a4-4e64-8c5e-1dbf1349c3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:11.389404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd6633-e9a4-4e64-8c5e-1dbf1349c3e7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:11.393142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6d491-a62b-4105-9263-71539caa4d5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:11.394522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6d491-a62b-4105-9263-71539caa4d5f service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:11.395027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6d491-a62b-4105-9263-71539caa4d5f service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:11.395339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6d491-a62b-4105-9263-71539caa4d5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:11.410648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6d491-a62b-4105-9263-71539caa4d5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:11.410648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6d491-a62b-4105-9263-71539caa4d5f service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:11.419890 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2731/5535] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:27:12.059673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fb634-93d2-4e2b-9984-71083ef6f42e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:12.061209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d87fb634-93d2-4e2b-9984-71083ef6f42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:12.088192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fb634-93d2-4e2b-9984-71083ef6f42e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:12.093589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565b792-ee9f-431f-b0e4-3af850d06171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:12.095132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565b792-ee9f-431f-b0e4-3af850d06171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:12.095520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565b792-ee9f-431f-b0e4-3af850d06171 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:12.096331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565b792-ee9f-431f-b0e4-3af850d06171 admin admin] PATH_INFO: `/v3/projects/03157d2f17c94855989c0760bb0c8550` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:12.097317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565b792-ee9f-431f-b0e4-3af850d06171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03157d2f17c94855989c0760bb0c8550)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:12.099549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565b792-ee9f-431f-b0e4-3af850d06171 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:12.261506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6565b792-ee9f-431f-b0e4-3af850d06171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03157d2f17c94855989c0760bb0c8550', 'request_id': 'req-6565b792-ee9f-431f-b0e4-3af850d06171'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:12.279065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6565b792-ee9f-431f-b0e4-3af850d06171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03157d2f17c94855989c0760bb0c8550', 'request_id': 'req-6565b792-ee9f-431f-b0e4-3af850d06171'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:12.285737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6565b792-ee9f-431f-b0e4-3af850d06171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03157d2f17c94855989c0760bb0c8550', 'request_id': 'req-6565b792-ee9f-431f-b0e4-3af850d06171'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:12.391573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6565b792-ee9f-431f-b0e4-3af850d06171 admin admin] The token cache is being invalidate because project 03157d2f17c94855989c0760bb0c8550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:27:12.392165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6565b792-ee9f-431f-b0e4-3af850d06171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:12.392856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6565b792-ee9f-431f-b0e4-3af850d06171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:12.394567 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2805/5536] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:27:12 2022] DELETE /identity/v3/projects/03157d2f17c94855989c0760bb0c8550 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:12.400492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6d491-a62b-4105-9263-71539caa4d5f service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:12.421899 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6d491-a62b-4105-9263-71539caa4d5f service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:12.514694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f645318-bf75-432a-8f32-511906aa8622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:12.516533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f645318-bf75-432a-8f32-511906aa8622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:12.516995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f645318-bf75-432a-8f32-511906aa8622 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:12.517449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f645318-bf75-432a-8f32-511906aa8622 admin admin] PATH_INFO: `/v3/users/962bd24994e947bb9115fab47deb68f1` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:12.519277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f645318-bf75-432a-8f32-511906aa8622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=962bd24994e947bb9115fab47deb68f1)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:12.522159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f645318-bf75-432a-8f32-511906aa8622 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:12.799319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5f645318-bf75-432a-8f32-511906aa8622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '962bd24994e947bb9115fab47deb68f1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:12.829181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:12.838994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5f645318-bf75-432a-8f32-511906aa8622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '962bd24994e947bb9115fab47deb68f1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:12.931944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5f645318-bf75-432a-8f32-511906aa8622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '962bd24994e947bb9115fab47deb68f1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:12.945223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5f645318-bf75-432a-8f32-511906aa8622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '962bd24994e947bb9115fab47deb68f1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:12.945985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5f645318-bf75-432a-8f32-511906aa8622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '962bd24994e947bb9115fab47deb68f1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:12.959966 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2732/5537] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:27:12 2022] DELETE /identity/v3/users/962bd24994e947bb9115fab47deb68f1 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:13.551561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565b792-ee9f-431f-b0e4-3af850d06171 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:13.554475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6565b792-ee9f-431f-b0e4-3af850d06171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:13.570903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565b792-ee9f-431f-b0e4-3af850d06171 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:13.651654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677ac0b-f673-4497-bbcc-fc2c7316347b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:13.652546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677ac0b-f673-4497-bbcc-fc2c7316347b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:13.653004 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677ac0b-f673-4497-bbcc-fc2c7316347b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:13.653283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677ac0b-f673-4497-bbcc-fc2c7316347b admin admin] PATH_INFO: `/v3/projects/959435ff9c6c4663b46b342d39be38dc` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:13.654776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677ac0b-f673-4497-bbcc-fc2c7316347b admin admin] RBAC: Authorizing `identity:delete_project(project_id=959435ff9c6c4663b46b342d39be38dc)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:13.656798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677ac0b-f673-4497-bbcc-fc2c7316347b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:13.795077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8677ac0b-f673-4497-bbcc-fc2c7316347b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '959435ff9c6c4663b46b342d39be38dc', 'request_id': 'req-8677ac0b-f673-4497-bbcc-fc2c7316347b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:13.798156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:13.803828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8677ac0b-f673-4497-bbcc-fc2c7316347b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '959435ff9c6c4663b46b342d39be38dc', 'request_id': 'req-8677ac0b-f673-4497-bbcc-fc2c7316347b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:13.810878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8677ac0b-f673-4497-bbcc-fc2c7316347b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '959435ff9c6c4663b46b342d39be38dc', 'request_id': 'req-8677ac0b-f673-4497-bbcc-fc2c7316347b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:13.902175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8677ac0b-f673-4497-bbcc-fc2c7316347b admin admin] The token cache is being invalidate because project 959435ff9c6c4663b46b342d39be38dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:27:13.903639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8677ac0b-f673-4497-bbcc-fc2c7316347b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:13.903639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8677ac0b-f673-4497-bbcc-fc2c7316347b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:13.906093 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2806/5538] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:27:13 2022] DELETE /identity/v3/projects/959435ff9c6c4663b46b342d39be38dc => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:13.911262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9d371-a23c-4646-8a30-596d2e0d8638 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:13.911768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9d371-a23c-4646-8a30-596d2e0d8638 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:13.911845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9d371-a23c-4646-8a30-596d2e0d8638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:13.932368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b0a9d371-a23c-4646-8a30-596d2e0d8638 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:13.933930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b0a9d371-a23c-4646-8a30-596d2e0d8638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:14.004662 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2733/5539] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:14.016710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c2f82-0be4-42d2-b865-e9336d72e675 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:14.016998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c2f82-0be4-42d2-b865-e9336d72e675 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:14.017273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c2f82-0be4-42d2-b865-e9336d72e675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:14.039375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ec1c2f82-0be4-42d2-b865-e9336d72e675 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:14.040600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ec1c2f82-0be4-42d2-b865-e9336d72e675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:14.048679 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2807/5540] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:14.053370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9d371-a23c-4646-8a30-596d2e0d8638 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:14.063947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9d371-a23c-4646-8a30-596d2e0d8638 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:14.069407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730350a9-47a7-44ad-8568-4d1d0868606d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:14.070079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730350a9-47a7-44ad-8568-4d1d0868606d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:14.070359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730350a9-47a7-44ad-8568-4d1d0868606d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:14.070635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730350a9-47a7-44ad-8568-4d1d0868606d admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:14.071495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730350a9-47a7-44ad-8568-4d1d0868606d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:27:14.071784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730350a9-47a7-44ad-8568-4d1d0868606d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:14.073389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730350a9-47a7-44ad-8568-4d1d0868606d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:14.091403 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2734/5541] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:27:14.095903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c2f82-0be4-42d2-b865-e9336d72e675 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:14.112443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c2f82-0be4-42d2-b865-e9336d72e675 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:14.113334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927ad00-1746-4878-8d3a-459f4fbee9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:14.114118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927ad00-1746-4878-8d3a-459f4fbee9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:14.114427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927ad00-1746-4878-8d3a-459f4fbee9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:14.114698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927ad00-1746-4878-8d3a-459f4fbee9e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:14.115464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927ad00-1746-4878-8d3a-459f4fbee9e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:14.120170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927ad00-1746-4878-8d3a-459f4fbee9e6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:14.216132 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2808/5542] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:27:14 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:27:14.217453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730350a9-47a7-44ad-8568-4d1d0868606d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:14.229781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730350a9-47a7-44ad-8568-4d1d0868606d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:14.295607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457a58a-3fb3-4a0e-af90-2067d2eceb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:14.296367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457a58a-3fb3-4a0e-af90-2067d2eceb16 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:14.296655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457a58a-3fb3-4a0e-af90-2067d2eceb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:14.296930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457a58a-3fb3-4a0e-af90-2067d2eceb16 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:14.297620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457a58a-3fb3-4a0e-af90-2067d2eceb16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:14.300478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457a58a-3fb3-4a0e-af90-2067d2eceb16 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:14.421102 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2735/5543] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:27:14 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:27:14.424110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927ad00-1746-4878-8d3a-459f4fbee9e6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:14.437414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927ad00-1746-4878-8d3a-459f4fbee9e6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:14.445281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44a2f3-cf87-4d36-999e-4825dd50b3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:14.446012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44a2f3-cf87-4d36-999e-4825dd50b3ac admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:14.446648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44a2f3-cf87-4d36-999e-4825dd50b3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:14.446648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44a2f3-cf87-4d36-999e-4825dd50b3ac admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:14.447668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44a2f3-cf87-4d36-999e-4825dd50b3ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:14.449657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44a2f3-cf87-4d36-999e-4825dd50b3ac admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:14.475218 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2809/5544] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:27:14.476755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457a58a-3fb3-4a0e-af90-2067d2eceb16 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:14.489358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457a58a-3fb3-4a0e-af90-2067d2eceb16 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:14.495078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bdfef-b891-4efc-896f-1f0c88bc1b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:14.495821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bdfef-b891-4efc-896f-1f0c88bc1b2f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:14.502843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bdfef-b891-4efc-896f-1f0c88bc1b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:14.502843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bdfef-b891-4efc-896f-1f0c88bc1b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:14.502843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bdfef-b891-4efc-896f-1f0c88bc1b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:14.502843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bdfef-b891-4efc-896f-1f0c88bc1b2f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:14.514985 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2736/5545] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:27:14.516579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44a2f3-cf87-4d36-999e-4825dd50b3ac admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:14.530081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44a2f3-cf87-4d36-999e-4825dd50b3ac admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:14.534863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0f055-0595-4cf6-84cd-327ad77abddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:14.535840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0f055-0595-4cf6-84cd-327ad77abddd admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:14.536117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0f055-0595-4cf6-84cd-327ad77abddd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:14.536386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0f055-0595-4cf6-84cd-327ad77abddd admin admin] PATH_INFO: `/v3/projects/6c4c39da89c148d2bab7e1572d9c1437/users/2d7a17e09ca64d2f93d0adcc6e42e4c6/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:14.555715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0f055-0595-4cf6-84cd-327ad77abddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4c39da89c148d2bab7e1572d9c1437, user_id=2d7a17e09ca64d2f93d0adcc6e42e4c6, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:14.559316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0f055-0595-4cf6-84cd-327ad77abddd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:14.631590 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2810/5546] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:27:14 2022] PUT /identity/v3/projects/6c4c39da89c148d2bab7e1572d9c1437/users/2d7a17e09ca64d2f93d0adcc6e42e4c6/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:14.642188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716b3ad-667e-4218-ad47-ed5cd78eb817 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:14.642485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716b3ad-667e-4218-ad47-ed5cd78eb817 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:14.642769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716b3ad-667e-4218-ad47-ed5cd78eb817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:14.671149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f716b3ad-667e-4218-ad47-ed5cd78eb817 None None] MFA Rules not processed for user `2d7a17e09ca64d2f93d0adcc6e42e4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:14.672503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f716b3ad-667e-4218-ad47-ed5cd78eb817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:14.744586 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2737/5547] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:14.757262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0f055-0595-4cf6-84cd-327ad77abddd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:14.759040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c8c0f055-0595-4cf6-84cd-327ad77abddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:14.828500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0f055-0595-4cf6-84cd-327ad77abddd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:14.833840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bd73a-b9dc-443c-bc15-cf1a87ca1f1f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:14.835104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bd73a-b9dc-443c-bc15-cf1a87ca1f1f service glance] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:14.835580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bd73a-b9dc-443c-bc15-cf1a87ca1f1f service glance] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:14.836034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bd73a-b9dc-443c-bc15-cf1a87ca1f1f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:14.846672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bd73a-b9dc-443c-bc15-cf1a87ca1f1f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:14.848820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bd73a-b9dc-443c-bc15-cf1a87ca1f1f service glance] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:14.861897 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2811/5548] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:27:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:27:14.976784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:15.263335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b00af-4a08-45e0-bf5f-9b7f4d17a229 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:15.263335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b00af-4a08-45e0-bf5f-9b7f4d17a229 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:15.263335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b00af-4a08-45e0-bf5f-9b7f4d17a229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:15.281442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-426b00af-4a08-45e0-bf5f-9b7f4d17a229 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:15.282933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-426b00af-4a08-45e0-bf5f-9b7f4d17a229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:15.359285 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2738/5549] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:27:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:27:15.514333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bd73a-b9dc-443c-bc15-cf1a87ca1f1f service glance] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:15.516247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e15bd73a-b9dc-443c-bc15-cf1a87ca1f1f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:15.624268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bd73a-b9dc-443c-bc15-cf1a87ca1f1f service glance] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:15.631642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca194095-e6f4-4eb4-8407-3110cac14d39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:15.632637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca194095-e6f4-4eb4-8407-3110cac14d39 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:15.632993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca194095-e6f4-4eb4-8407-3110cac14d39 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:15.633827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca194095-e6f4-4eb4-8407-3110cac14d39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:15.643031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca194095-e6f4-4eb4-8407-3110cac14d39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:15.644827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca194095-e6f4-4eb4-8407-3110cac14d39 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:15.653372 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2812/5550] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:27:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:27:15.822473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:16.471625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab0c1d-4a96-489f-9231-bfed1cba8fac None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:16.472454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab0c1d-4a96-489f-9231-bfed1cba8fac None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:16.472454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab0c1d-4a96-489f-9231-bfed1cba8fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:16.496959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-daab0c1d-4a96-489f-9231-bfed1cba8fac None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:16.498258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-daab0c1d-4a96-489f-9231-bfed1cba8fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:16.506929 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2739/5551] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:27:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:16.519979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca194095-e6f4-4eb4-8407-3110cac14d39 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:16.534522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca194095-e6f4-4eb4-8407-3110cac14d39 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:16.570975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d28db-2610-442f-8dba-714d862fbc6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:16.572871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d28db-2610-442f-8dba-714d862fbc6d service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:16.572871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d28db-2610-442f-8dba-714d862fbc6d service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:16.573745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d28db-2610-442f-8dba-714d862fbc6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:16.594282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:16.605687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d28db-2610-442f-8dba-714d862fbc6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:16.607451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d28db-2610-442f-8dba-714d862fbc6d service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:16.620524 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2813/5552] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:27:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:27:17.442210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0d5da-1029-417d-ae62-e923bbf8fc53 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:17.442561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0d5da-1029-417d-ae62-e923bbf8fc53 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:17.442843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0d5da-1029-417d-ae62-e923bbf8fc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:17.463495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-50b0d5da-1029-417d-ae62-e923bbf8fc53 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:17.464973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-50b0d5da-1029-417d-ae62-e923bbf8fc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:17.479540 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2740/5553] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:27:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:17.491826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d28db-2610-442f-8dba-714d862fbc6d service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:17.506313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d28db-2610-442f-8dba-714d862fbc6d service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:17.512424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0a2e6-7537-4229-b3a8-c60a8f1ff768 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:17.513073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0a2e6-7537-4229-b3a8-c60a8f1ff768 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:17.513350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0a2e6-7537-4229-b3a8-c60a8f1ff768 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:17.513619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0a2e6-7537-4229-b3a8-c60a8f1ff768 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:17.523608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0a2e6-7537-4229-b3a8-c60a8f1ff768 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:17.525568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0a2e6-7537-4229-b3a8-c60a8f1ff768 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:17.534553 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2814/5554] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:27:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:27:17.829958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5adc9-ee88-4c95-8ad7-a8028905c623 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:17.830251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5adc9-ee88-4c95-8ad7-a8028905c623 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:17.830534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5adc9-ee88-4c95-8ad7-a8028905c623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:17.866125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-bef5adc9-ee88-4c95-8ad7-a8028905c623 None None] MFA Rules not processed for user `45315c12d53349ae8cd245cb138b8dcd`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:17.867499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bef5adc9-ee88-4c95-8ad7-a8028905c623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:17.936573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:17.974613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff57b6-cde2-47ff-8871-f9fe4725fb28 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:17.974903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff57b6-cde2-47ff-8871-f9fe4725fb28 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:17.977738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff57b6-cde2-47ff-8871-f9fe4725fb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:17.980684 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2741/5555] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:17.991899 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e06736-8430-4815-afc5-6dd13e7bf25a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:17.992190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e06736-8430-4815-afc5-6dd13e7bf25a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:17.992474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e06736-8430-4815-afc5-6dd13e7bf25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:17.995052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a7ff57b6-cde2-47ff-8871-f9fe4725fb28 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:17.995052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a7ff57b6-cde2-47ff-8871-f9fe4725fb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:18.002248 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2815/5556] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:27:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:18.010614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c1e06736-8430-4815-afc5-6dd13e7bf25a None None] MFA Rules not processed for user `45315c12d53349ae8cd245cb138b8dcd`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:18.015997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c1e06736-8430-4815-afc5-6dd13e7bf25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:18.016450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff57b6-cde2-47ff-8871-f9fe4725fb28 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:18.019897 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2742/5557] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:27:18.032202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e06736-8430-4815-afc5-6dd13e7bf25a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:18.032499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff57b6-cde2-47ff-8871-f9fe4725fb28 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:18.034475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c1e06736-8430-4815-afc5-6dd13e7bf25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:18.040125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daea87d-78cf-445a-9c1e-935cc54cd1a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:18.040998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daea87d-78cf-445a-9c1e-935cc54cd1a7 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:18.041432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daea87d-78cf-445a-9c1e-935cc54cd1a7 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:18.041705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daea87d-78cf-445a-9c1e-935cc54cd1a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:18.051272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daea87d-78cf-445a-9c1e-935cc54cd1a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:18.052857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daea87d-78cf-445a-9c1e-935cc54cd1a7 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:18.061403 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2816/5558] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:27:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:27:18.125627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e06736-8430-4815-afc5-6dd13e7bf25a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:18.132610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e742cee-4df3-466d-a249-03de77231862 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:18.133299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e742cee-4df3-466d-a249-03de77231862 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:18.133581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e742cee-4df3-466d-a249-03de77231862 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:18.133857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e742cee-4df3-466d-a249-03de77231862 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:18.142175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e742cee-4df3-466d-a249-03de77231862 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:18.144400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e742cee-4df3-466d-a249-03de77231862 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:18.154312 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2743/5559] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:27:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:27:18.861284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d3c17-fed5-452b-a567-1ffd577049f8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:18.861829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d3c17-fed5-452b-a567-1ffd577049f8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:18.862362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d3c17-fed5-452b-a567-1ffd577049f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:18.885404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-713d3c17-fed5-452b-a567-1ffd577049f8 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:18.887311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-713d3c17-fed5-452b-a567-1ffd577049f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:18.903434 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2817/5560] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:27:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:18.912817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e742cee-4df3-466d-a249-03de77231862 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:18.941493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e742cee-4df3-466d-a249-03de77231862 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:18.962854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f737e-3012-40c3-8f5b-e1c567343fba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:18.963658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f737e-3012-40c3-8f5b-e1c567343fba service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:18.963942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f737e-3012-40c3-8f5b-e1c567343fba service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:18.964363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f737e-3012-40c3-8f5b-e1c567343fba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:18.976695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f737e-3012-40c3-8f5b-e1c567343fba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:18.978619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f737e-3012-40c3-8f5b-e1c567343fba service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:19.000742 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2744/5561] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:27:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:27:19.205215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:19.767862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65837189-66ec-4d0b-979a-cb5a6cdffcb3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:19.768204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65837189-66ec-4d0b-979a-cb5a6cdffcb3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:19.768482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65837189-66ec-4d0b-979a-cb5a6cdffcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:19.793498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-65837189-66ec-4d0b-979a-cb5a6cdffcb3 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:19.795107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-65837189-66ec-4d0b-979a-cb5a6cdffcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:19.809123 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2818/5562] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:27:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:19.835089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f737e-3012-40c3-8f5b-e1c567343fba service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:19.854196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f737e-3012-40c3-8f5b-e1c567343fba service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:19.860579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0053ab8-05fb-4d02-967b-1cb0574c2bee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:19.861453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0053ab8-05fb-4d02-967b-1cb0574c2bee service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:19.862729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0053ab8-05fb-4d02-967b-1cb0574c2bee service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:19.863189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0053ab8-05fb-4d02-967b-1cb0574c2bee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:19.896888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0053ab8-05fb-4d02-967b-1cb0574c2bee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:19.898543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0053ab8-05fb-4d02-967b-1cb0574c2bee service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:19.932078 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2745/5563] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:27:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:27:20.674064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65837189-66ec-4d0b-979a-cb5a6cdffcb3 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:20.743457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65837189-66ec-4d0b-979a-cb5a6cdffcb3 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:20.748170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b5131-a80c-45b1-a0a1-42067f8f270e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:20.749045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b5131-a80c-45b1-a0a1-42067f8f270e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:20.749352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b5131-a80c-45b1-a0a1-42067f8f270e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:20.749621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b5131-a80c-45b1-a0a1-42067f8f270e admin admin] PATH_INFO: `/v3/users/2d7a17e09ca64d2f93d0adcc6e42e4c6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:20.750828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b5131-a80c-45b1-a0a1-42067f8f270e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d7a17e09ca64d2f93d0adcc6e42e4c6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:20.752849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b5131-a80c-45b1-a0a1-42067f8f270e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:20.943327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-934b5131-a80c-45b1-a0a1-42067f8f270e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d7a17e09ca64d2f93d0adcc6e42e4c6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:20.955267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-934b5131-a80c-45b1-a0a1-42067f8f270e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d7a17e09ca64d2f93d0adcc6e42e4c6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:21.051291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-934b5131-a80c-45b1-a0a1-42067f8f270e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d7a17e09ca64d2f93d0adcc6e42e4c6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:21.053958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-934b5131-a80c-45b1-a0a1-42067f8f270e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d7a17e09ca64d2f93d0adcc6e42e4c6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:21.100182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-934b5131-a80c-45b1-a0a1-42067f8f270e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d7a17e09ca64d2f93d0adcc6e42e4c6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:21.115225 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2819/5564] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:27:20 2022] DELETE /identity/v3/users/2d7a17e09ca64d2f93d0adcc6e42e4c6 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:21.120833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b33f3-90aa-4ef1-8e3d-06da62312c7a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:21.122241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b33f3-90aa-4ef1-8e3d-06da62312c7a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:21.122897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b33f3-90aa-4ef1-8e3d-06da62312c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:21.157601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3b4b33f3-90aa-4ef1-8e3d-06da62312c7a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:21.162898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3b4b33f3-90aa-4ef1-8e3d-06da62312c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:21.211717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:21.255953 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2746/5565] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:21.266406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b5131-a80c-45b1-a0a1-42067f8f270e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:21.269300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-934b5131-a80c-45b1-a0a1-42067f8f270e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:21.305787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:21.363201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b5131-a80c-45b1-a0a1-42067f8f270e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:21.367550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d87aa-8b07-42f1-9c6b-9a9af669b7a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:21.368215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d87aa-8b07-42f1-9c6b-9a9af669b7a7 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:21.368514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d87aa-8b07-42f1-9c6b-9a9af669b7a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:21.369031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d87aa-8b07-42f1-9c6b-9a9af669b7a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:21.382704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d87aa-8b07-42f1-9c6b-9a9af669b7a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:21.384336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d87aa-8b07-42f1-9c6b-9a9af669b7a7 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:21.401723 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2820/5566] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:27:22.036490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b33f3-90aa-4ef1-8e3d-06da62312c7a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:22.038892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3b4b33f3-90aa-4ef1-8e3d-06da62312c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:22.057166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b33f3-90aa-4ef1-8e3d-06da62312c7a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:22.062220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2e766-e95c-46b6-b153-d2b80a52bb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:22.063257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2e766-e95c-46b6-b153-d2b80a52bb4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:22.064941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2e766-e95c-46b6-b153-d2b80a52bb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:22.064941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2e766-e95c-46b6-b153-d2b80a52bb4e admin admin] PATH_INFO: `/v3/projects/6c4c39da89c148d2bab7e1572d9c1437` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:22.066397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2e766-e95c-46b6-b153-d2b80a52bb4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c4c39da89c148d2bab7e1572d9c1437)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:22.068414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2e766-e95c-46b6-b153-d2b80a52bb4e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:22.217524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-deb2e766-e95c-46b6-b153-d2b80a52bb4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c4c39da89c148d2bab7e1572d9c1437', 'request_id': 'req-deb2e766-e95c-46b6-b153-d2b80a52bb4e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:22.224195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-deb2e766-e95c-46b6-b153-d2b80a52bb4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c4c39da89c148d2bab7e1572d9c1437', 'request_id': 'req-deb2e766-e95c-46b6-b153-d2b80a52bb4e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:22.231816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-deb2e766-e95c-46b6-b153-d2b80a52bb4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c4c39da89c148d2bab7e1572d9c1437', 'request_id': 'req-deb2e766-e95c-46b6-b153-d2b80a52bb4e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:22.390444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-deb2e766-e95c-46b6-b153-d2b80a52bb4e admin admin] The token cache is being invalidate because project 6c4c39da89c148d2bab7e1572d9c1437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:27:22.391094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-deb2e766-e95c-46b6-b153-d2b80a52bb4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:22.391990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-deb2e766-e95c-46b6-b153-d2b80a52bb4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:22.398542 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2747/5567] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:27:22 2022] DELETE /identity/v3/projects/6c4c39da89c148d2bab7e1572d9c1437 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:22.400035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12965735-f72c-49fd-ac45-83e973f98314 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:22.404937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12965735-f72c-49fd-ac45-83e973f98314 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:22.404937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12965735-f72c-49fd-ac45-83e973f98314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:22.437900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-12965735-f72c-49fd-ac45-83e973f98314 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:22.439112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-12965735-f72c-49fd-ac45-83e973f98314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:22.512517 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2821/5568] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:22.521448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18103726-05c5-4165-ba2a-c82fc6d60d48 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:22.522115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18103726-05c5-4165-ba2a-c82fc6d60d48 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:22.522419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18103726-05c5-4165-ba2a-c82fc6d60d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:22.543445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-18103726-05c5-4165-ba2a-c82fc6d60d48 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:22.544720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-18103726-05c5-4165-ba2a-c82fc6d60d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:22.557125 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2748/5569] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:22.559537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12965735-f72c-49fd-ac45-83e973f98314 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:22.572848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12965735-f72c-49fd-ac45-83e973f98314 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:22.579199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43dc8af-ca54-4e82-a2f5-6691561f7436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:22.580084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dc8af-ca54-4e82-a2f5-6691561f7436 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:22.581577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dc8af-ca54-4e82-a2f5-6691561f7436 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:22.582744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dc8af-ca54-4e82-a2f5-6691561f7436 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:22.586818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43dc8af-ca54-4e82-a2f5-6691561f7436 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:27:22.587855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43dc8af-ca54-4e82-a2f5-6691561f7436 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:22.591299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43dc8af-ca54-4e82-a2f5-6691561f7436 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:22.622686 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2822/5570] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:27:22.626830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18103726-05c5-4165-ba2a-c82fc6d60d48 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:22.646239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18103726-05c5-4165-ba2a-c82fc6d60d48 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:22.655725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb9995-e025-4993-9f97-2275e3d68cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:22.668066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb9995-e025-4993-9f97-2275e3d68cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:22.668438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb9995-e025-4993-9f97-2275e3d68cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:22.668845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb9995-e025-4993-9f97-2275e3d68cf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:22.669643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb9995-e025-4993-9f97-2275e3d68cf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:22.671933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb9995-e025-4993-9f97-2275e3d68cf8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:22.795558 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2749/5571] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:27:22 2022] POST /identity/v3/projects => generated 359 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:27:22.800817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43dc8af-ca54-4e82-a2f5-6691561f7436 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:22.811266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43dc8af-ca54-4e82-a2f5-6691561f7436 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:22.925064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b17f0-c846-4bfd-bf1a-d3a1662d8062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:22.925064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b17f0-c846-4bfd-bf1a-d3a1662d8062 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:22.925064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b17f0-c846-4bfd-bf1a-d3a1662d8062 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:22.925064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b17f0-c846-4bfd-bf1a-d3a1662d8062 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:22.925441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b17f0-c846-4bfd-bf1a-d3a1662d8062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:22.925647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b17f0-c846-4bfd-bf1a-d3a1662d8062 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:23.107807 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2823/5572] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:27:22 2022] POST /identity/v3/users => generated 280 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:27:23.116041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb9995-e025-4993-9f97-2275e3d68cf8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:23.128333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb9995-e025-4993-9f97-2275e3d68cf8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:23.135112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef7194-bc05-468a-b30a-9b289a8011b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:23.135880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef7194-bc05-468a-b30a-9b289a8011b8 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:23.136844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef7194-bc05-468a-b30a-9b289a8011b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:23.137137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef7194-bc05-468a-b30a-9b289a8011b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:23.137895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef7194-bc05-468a-b30a-9b289a8011b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:23.139604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef7194-bc05-468a-b30a-9b289a8011b8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:23.159790 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2750/5573] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:27:23.162083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b17f0-c846-4bfd-bf1a-d3a1662d8062 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:23.176191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b17f0-c846-4bfd-bf1a-d3a1662d8062 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:23.181842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99b759-2bfd-41ba-b439-22740472c21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:23.182534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99b759-2bfd-41ba-b439-22740472c21e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:23.182818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99b759-2bfd-41ba-b439-22740472c21e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:23.183171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99b759-2bfd-41ba-b439-22740472c21e admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:23.183906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99b759-2bfd-41ba-b439-22740472c21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:23.185714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99b759-2bfd-41ba-b439-22740472c21e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:23.202578 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2824/5574] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:27:23.204954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef7194-bc05-468a-b30a-9b289a8011b8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:23.216595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef7194-bc05-468a-b30a-9b289a8011b8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:23.223801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617904f-a385-4861-a2b1-b8dc518521ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:23.225421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617904f-a385-4861-a2b1-b8dc518521ec admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:23.225707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617904f-a385-4861-a2b1-b8dc518521ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:23.225985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617904f-a385-4861-a2b1-b8dc518521ec admin admin] PATH_INFO: `/v3/projects/7f910643f3b34685bef27ab040ce8bdf/users/ffc1db40f10146ee923ed2b7d8dfa7cb/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:23.245603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617904f-a385-4861-a2b1-b8dc518521ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f910643f3b34685bef27ab040ce8bdf, user_id=ffc1db40f10146ee923ed2b7d8dfa7cb, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:23.248554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617904f-a385-4861-a2b1-b8dc518521ec admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:23.376818 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2751/5575] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:27:23 2022] PUT /identity/v3/projects/7f910643f3b34685bef27ab040ce8bdf/users/ffc1db40f10146ee923ed2b7d8dfa7cb/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:23.390637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcd753-f2b5-4883-93f5-e530affd4d72 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:23.391369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcd753-f2b5-4883-93f5-e530affd4d72 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:23.391874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcd753-f2b5-4883-93f5-e530affd4d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:23.422258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5bfcd753-f2b5-4883-93f5-e530affd4d72 None None] MFA Rules not processed for user `ffc1db40f10146ee923ed2b7d8dfa7cb`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:23.424425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5bfcd753-f2b5-4883-93f5-e530affd4d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:23.457110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:23.557467 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2825/5576] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:23 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:23.571977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617904f-a385-4861-a2b1-b8dc518521ec admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:23.639193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:23.657677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617904f-a385-4861-a2b1-b8dc518521ec admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:23.665004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84243fe-c819-410e-87b0-48af235e0dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:23.666382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84243fe-c819-410e-87b0-48af235e0dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:23.666928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84243fe-c819-410e-87b0-48af235e0dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:23.667242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84243fe-c819-410e-87b0-48af235e0dc5 admin admin] PATH_INFO: `/v3/users/ffc1db40f10146ee923ed2b7d8dfa7cb` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:23.670827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84243fe-c819-410e-87b0-48af235e0dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc1db40f10146ee923ed2b7d8dfa7cb)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:23.672813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84243fe-c819-410e-87b0-48af235e0dc5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:24.005274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c84243fe-c819-410e-87b0-48af235e0dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc1db40f10146ee923ed2b7d8dfa7cb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:24.034447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c84243fe-c819-410e-87b0-48af235e0dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc1db40f10146ee923ed2b7d8dfa7cb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:24.096497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c84243fe-c819-410e-87b0-48af235e0dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc1db40f10146ee923ed2b7d8dfa7cb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:24.106474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c84243fe-c819-410e-87b0-48af235e0dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc1db40f10146ee923ed2b7d8dfa7cb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:24.109362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c84243fe-c819-410e-87b0-48af235e0dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc1db40f10146ee923ed2b7d8dfa7cb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:24.125228 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2752/5577] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:27:23 2022] DELETE /identity/v3/users/ffc1db40f10146ee923ed2b7d8dfa7cb => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:24.130312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e6172-7a05-4bed-8dbf-711f4408a660 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:24.137216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e6172-7a05-4bed-8dbf-711f4408a660 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:24.137216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e6172-7a05-4bed-8dbf-711f4408a660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:24.149921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e46e6172-7a05-4bed-8dbf-711f4408a660 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:24.151257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e46e6172-7a05-4bed-8dbf-711f4408a660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:24.226045 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2826/5578] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:24.243324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84243fe-c819-410e-87b0-48af235e0dc5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:24.245478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c84243fe-c819-410e-87b0-48af235e0dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:24.321611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84243fe-c819-410e-87b0-48af235e0dc5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:24.325244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc731836-6d5f-4459-b2b0-9bd3c1e35174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:24.325902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc731836-6d5f-4459-b2b0-9bd3c1e35174 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:24.326188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc731836-6d5f-4459-b2b0-9bd3c1e35174 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:24.326467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc731836-6d5f-4459-b2b0-9bd3c1e35174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:24.336160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc731836-6d5f-4459-b2b0-9bd3c1e35174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:24.337585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc731836-6d5f-4459-b2b0-9bd3c1e35174 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:24.350049 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2753/5579] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:27:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:27:25.052438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e6172-7a05-4bed-8dbf-711f4408a660 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:25.054059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e46e6172-7a05-4bed-8dbf-711f4408a660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:25.080110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e6172-7a05-4bed-8dbf-711f4408a660 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:25.097519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957b10f-c5b6-4a20-91c7-e7ec56a1cb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:25.098499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957b10f-c5b6-4a20-91c7-e7ec56a1cb8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:25.100373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957b10f-c5b6-4a20-91c7-e7ec56a1cb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:25.100373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957b10f-c5b6-4a20-91c7-e7ec56a1cb8b admin admin] PATH_INFO: `/v3/projects/7f910643f3b34685bef27ab040ce8bdf` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:25.101240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957b10f-c5b6-4a20-91c7-e7ec56a1cb8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f910643f3b34685bef27ab040ce8bdf)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:25.103217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957b10f-c5b6-4a20-91c7-e7ec56a1cb8b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:25.231858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6957b10f-c5b6-4a20-91c7-e7ec56a1cb8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f910643f3b34685bef27ab040ce8bdf', 'request_id': 'req-6957b10f-c5b6-4a20-91c7-e7ec56a1cb8b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:25.239526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6957b10f-c5b6-4a20-91c7-e7ec56a1cb8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f910643f3b34685bef27ab040ce8bdf', 'request_id': 'req-6957b10f-c5b6-4a20-91c7-e7ec56a1cb8b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:25.245726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6957b10f-c5b6-4a20-91c7-e7ec56a1cb8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f910643f3b34685bef27ab040ce8bdf', 'request_id': 'req-6957b10f-c5b6-4a20-91c7-e7ec56a1cb8b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:25.365965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6957b10f-c5b6-4a20-91c7-e7ec56a1cb8b admin admin] The token cache is being invalidate because project 7f910643f3b34685bef27ab040ce8bdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:27:25.366264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6957b10f-c5b6-4a20-91c7-e7ec56a1cb8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:25.366985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6957b10f-c5b6-4a20-91c7-e7ec56a1cb8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:25.368824 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2827/5580] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:27:25 2022] DELETE /identity/v3/projects/7f910643f3b34685bef27ab040ce8bdf => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:25.373956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f2eb5-8cc7-4c99-87a4-74a705148efc None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:25.374464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f2eb5-8cc7-4c99-87a4-74a705148efc None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:25.374581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f2eb5-8cc7-4c99-87a4-74a705148efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:25.394487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-030f2eb5-8cc7-4c99-87a4-74a705148efc None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:25.395783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-030f2eb5-8cc7-4c99-87a4-74a705148efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:25.486133 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2754/5581] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:25.489066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f0fbf-e106-444d-b016-9cf72fde3d43 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:25.489355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f0fbf-e106-444d-b016-9cf72fde3d43 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:25.489689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f0fbf-e106-444d-b016-9cf72fde3d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:25.512129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-396f0fbf-e106-444d-b016-9cf72fde3d43 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:25.513516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-396f0fbf-e106-444d-b016-9cf72fde3d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:25.522887 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2828/5582] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:25.527089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f2eb5-8cc7-4c99-87a4-74a705148efc None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:25.538880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f2eb5-8cc7-4c99-87a4-74a705148efc None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:25.545919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a584af-2141-4a84-9a9c-659d7098db25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:25.546597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a584af-2141-4a84-9a9c-659d7098db25 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:25.546885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a584af-2141-4a84-9a9c-659d7098db25 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:25.547250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a584af-2141-4a84-9a9c-659d7098db25 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:25.547996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a584af-2141-4a84-9a9c-659d7098db25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:27:25.548309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a584af-2141-4a84-9a9c-659d7098db25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:25.549972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a584af-2141-4a84-9a9c-659d7098db25 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:25.552918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:25.564513 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2755/5583] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:27:25.569490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f0fbf-e106-444d-b016-9cf72fde3d43 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:25.579458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f0fbf-e106-444d-b016-9cf72fde3d43 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:25.585060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba24b4-a590-421b-ae62-fdfdfca9b8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:25.589830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba24b4-a590-421b-ae62-fdfdfca9b8bd admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:25.589830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba24b4-a590-421b-ae62-fdfdfca9b8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:25.589830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba24b4-a590-421b-ae62-fdfdfca9b8bd admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:25.589830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba24b4-a590-421b-ae62-fdfdfca9b8bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:25.589830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba24b4-a590-421b-ae62-fdfdfca9b8bd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:25.686575 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2829/5584] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:27:25 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:27:25.691198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a584af-2141-4a84-9a9c-659d7098db25 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:25.701525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a584af-2141-4a84-9a9c-659d7098db25 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:25.761111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36069f-b4a8-48cc-8535-fe28a61f16d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:25.761734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36069f-b4a8-48cc-8535-fe28a61f16d1 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:25.762016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36069f-b4a8-48cc-8535-fe28a61f16d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:25.762335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36069f-b4a8-48cc-8535-fe28a61f16d1 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:25.763027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36069f-b4a8-48cc-8535-fe28a61f16d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:25.764948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36069f-b4a8-48cc-8535-fe28a61f16d1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:25.867972 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2756/5585] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:27:25 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:27:25.872115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba24b4-a590-421b-ae62-fdfdfca9b8bd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:25.883916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba24b4-a590-421b-ae62-fdfdfca9b8bd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:25.889066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c19d2-30fd-4b36-8379-42e2cc43331a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:25.889729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c19d2-30fd-4b36-8379-42e2cc43331a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:25.890016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c19d2-30fd-4b36-8379-42e2cc43331a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:25.893623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c19d2-30fd-4b36-8379-42e2cc43331a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:25.893623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c19d2-30fd-4b36-8379-42e2cc43331a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:25.893623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c19d2-30fd-4b36-8379-42e2cc43331a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:25.904211 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2830/5586] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:27:25.908226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36069f-b4a8-48cc-8535-fe28a61f16d1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:25.918804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36069f-b4a8-48cc-8535-fe28a61f16d1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:25.923503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942b50d-2558-4e4c-be77-f3913d8df00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:25.924303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942b50d-2558-4e4c-be77-f3913d8df00d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:25.924598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942b50d-2558-4e4c-be77-f3913d8df00d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:25.924866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942b50d-2558-4e4c-be77-f3913d8df00d admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:25.925579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942b50d-2558-4e4c-be77-f3913d8df00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:25.927181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942b50d-2558-4e4c-be77-f3913d8df00d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:25.937362 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2757/5587] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:27:25.942236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c19d2-30fd-4b36-8379-42e2cc43331a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:25.947764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:25.953115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c19d2-30fd-4b36-8379-42e2cc43331a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:25.959135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef271b9f-fdb4-490f-a472-8491a5fc5327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:25.959943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef271b9f-fdb4-490f-a472-8491a5fc5327 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:25.960226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef271b9f-fdb4-490f-a472-8491a5fc5327 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:25.960505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef271b9f-fdb4-490f-a472-8491a5fc5327 admin admin] PATH_INFO: `/v3/projects/5a4542af4a214e95911d5090c6e7be2e/users/c229c4b26a5247ddafc848126dad8617/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:25.977215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef271b9f-fdb4-490f-a472-8491a5fc5327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4542af4a214e95911d5090c6e7be2e, user_id=c229c4b26a5247ddafc848126dad8617, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:25.979949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef271b9f-fdb4-490f-a472-8491a5fc5327 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:26.077101 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2831/5588] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:27:25 2022] PUT /identity/v3/projects/5a4542af4a214e95911d5090c6e7be2e/users/c229c4b26a5247ddafc848126dad8617/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:26.088254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90242f4a-7626-4b18-9d5c-6a0d0709503d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:26.088570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90242f4a-7626-4b18-9d5c-6a0d0709503d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:26.089079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90242f4a-7626-4b18-9d5c-6a0d0709503d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:26.119143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-90242f4a-7626-4b18-9d5c-6a0d0709503d None None] MFA Rules not processed for user `c229c4b26a5247ddafc848126dad8617`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:26.122695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-90242f4a-7626-4b18-9d5c-6a0d0709503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:26.187160 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2758/5589] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:26.198272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef271b9f-fdb4-490f-a472-8491a5fc5327 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:26.199983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ef271b9f-fdb4-490f-a472-8491a5fc5327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:26.259776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef271b9f-fdb4-490f-a472-8491a5fc5327 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:26.263652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd198aa-bcaa-4de3-91e6-3783d5c1c9dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:26.264297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd198aa-bcaa-4de3-91e6-3783d5c1c9dc service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:26.264581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd198aa-bcaa-4de3-91e6-3783d5c1c9dc service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:26.264861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd198aa-bcaa-4de3-91e6-3783d5c1c9dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:26.273634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd198aa-bcaa-4de3-91e6-3783d5c1c9dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:26.275086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd198aa-bcaa-4de3-91e6-3783d5c1c9dc service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:26.284010 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2832/5590] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:27:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:27:31.427418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90242f4a-7626-4b18-9d5c-6a0d0709503d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:31.429655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-90242f4a-7626-4b18-9d5c-6a0d0709503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:31.504137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90242f4a-7626-4b18-9d5c-6a0d0709503d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:31.509947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb3acf-78f1-45e8-8627-77f0659e0b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:31.510855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb3acf-78f1-45e8-8627-77f0659e0b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:31.511194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb3acf-78f1-45e8-8627-77f0659e0b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:31.511470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb3acf-78f1-45e8-8627-77f0659e0b69 admin admin] PATH_INFO: `/v3/users/42e2cd7bf8a04c1a93ab0772d56b2c6b` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:31.512914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb3acf-78f1-45e8-8627-77f0659e0b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42e2cd7bf8a04c1a93ab0772d56b2c6b)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:31.515064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb3acf-78f1-45e8-8627-77f0659e0b69 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:31.521963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:31.772727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8abb3acf-78f1-45e8-8627-77f0659e0b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42e2cd7bf8a04c1a93ab0772d56b2c6b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:31.785090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8abb3acf-78f1-45e8-8627-77f0659e0b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42e2cd7bf8a04c1a93ab0772d56b2c6b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:31.873387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8abb3acf-78f1-45e8-8627-77f0659e0b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42e2cd7bf8a04c1a93ab0772d56b2c6b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:31.884636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8abb3acf-78f1-45e8-8627-77f0659e0b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42e2cd7bf8a04c1a93ab0772d56b2c6b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:31.885446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8abb3acf-78f1-45e8-8627-77f0659e0b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42e2cd7bf8a04c1a93ab0772d56b2c6b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:31.898352 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2759/5591] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:27:31 2022] DELETE /identity/v3/users/42e2cd7bf8a04c1a93ab0772d56b2c6b => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:31.900138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111e59d-ac0b-46e2-b1b3-19645667e8a1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:31.905541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111e59d-ac0b-46e2-b1b3-19645667e8a1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:31.905541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111e59d-ac0b-46e2-b1b3-19645667e8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:31.920759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3111e59d-ac0b-46e2-b1b3-19645667e8a1 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:31.922041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3111e59d-ac0b-46e2-b1b3-19645667e8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:32.003055 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2833/5592] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:32.011902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb3acf-78f1-45e8-8627-77f0659e0b69 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:32.013355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8abb3acf-78f1-45e8-8627-77f0659e0b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:32.090411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb3acf-78f1-45e8-8627-77f0659e0b69 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:32.094698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341d449-953f-4d4a-a9bd-02cdb0bd1bd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:32.096963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341d449-953f-4d4a-a9bd-02cdb0bd1bd5 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:32.097258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341d449-953f-4d4a-a9bd-02cdb0bd1bd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:32.098047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341d449-953f-4d4a-a9bd-02cdb0bd1bd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:32.110416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341d449-953f-4d4a-a9bd-02cdb0bd1bd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:32.112486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341d449-953f-4d4a-a9bd-02cdb0bd1bd5 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:32.124847 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2760/5593] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:27:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:27:32.728351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111e59d-ac0b-46e2-b1b3-19645667e8a1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:32.728351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3111e59d-ac0b-46e2-b1b3-19645667e8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:32.741719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111e59d-ac0b-46e2-b1b3-19645667e8a1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:32.753618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899678cf-93bd-4ffb-9e7a-d495cd6f1161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:32.754499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899678cf-93bd-4ffb-9e7a-d495cd6f1161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:32.754803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899678cf-93bd-4ffb-9e7a-d495cd6f1161 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:32.755126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899678cf-93bd-4ffb-9e7a-d495cd6f1161 admin admin] PATH_INFO: `/v3/projects/ca905b8fd9304f979ed3420ac3b415fe` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:32.759920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899678cf-93bd-4ffb-9e7a-d495cd6f1161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca905b8fd9304f979ed3420ac3b415fe)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:32.759920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899678cf-93bd-4ffb-9e7a-d495cd6f1161 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:32.945552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-899678cf-93bd-4ffb-9e7a-d495cd6f1161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca905b8fd9304f979ed3420ac3b415fe', 'request_id': 'req-899678cf-93bd-4ffb-9e7a-d495cd6f1161'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:32.956596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-899678cf-93bd-4ffb-9e7a-d495cd6f1161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca905b8fd9304f979ed3420ac3b415fe', 'request_id': 'req-899678cf-93bd-4ffb-9e7a-d495cd6f1161'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:32.963804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-899678cf-93bd-4ffb-9e7a-d495cd6f1161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca905b8fd9304f979ed3420ac3b415fe', 'request_id': 'req-899678cf-93bd-4ffb-9e7a-d495cd6f1161'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:33.124409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-899678cf-93bd-4ffb-9e7a-d495cd6f1161 admin admin] The token cache is being invalidate because project ca905b8fd9304f979ed3420ac3b415fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:27:33.124943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-899678cf-93bd-4ffb-9e7a-d495cd6f1161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:33.125636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-899678cf-93bd-4ffb-9e7a-d495cd6f1161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:33.131393 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2834/5594] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:27:32 2022] DELETE /identity/v3/projects/ca905b8fd9304f979ed3420ac3b415fe => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:33.132891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a630d-7e9a-4675-92b7-713d3aed7c0d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:33.133369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a630d-7e9a-4675-92b7-713d3aed7c0d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:33.133462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a630d-7e9a-4675-92b7-713d3aed7c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:33.155577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9d9a630d-7e9a-4675-92b7-713d3aed7c0d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:33.155577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9d9a630d-7e9a-4675-92b7-713d3aed7c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:33.247998 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2761/5595] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:27:33.250903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef236f6-b76f-440f-96ac-c48408842393 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:33.251297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef236f6-b76f-440f-96ac-c48408842393 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:33.251684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef236f6-b76f-440f-96ac-c48408842393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:33.260604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:33.278883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8ef236f6-b76f-440f-96ac-c48408842393 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:33.281443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8ef236f6-b76f-440f-96ac-c48408842393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:33.293985 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2835/5596] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:33.297963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a630d-7e9a-4675-92b7-713d3aed7c0d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:33.309652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a630d-7e9a-4675-92b7-713d3aed7c0d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:33.315300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae1c7a-1e9c-4821-a7ed-d3ac90fb8959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:33.315974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae1c7a-1e9c-4821-a7ed-d3ac90fb8959 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:33.316266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae1c7a-1e9c-4821-a7ed-d3ac90fb8959 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:33.316664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae1c7a-1e9c-4821-a7ed-d3ac90fb8959 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:33.317406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae1c7a-1e9c-4821-a7ed-d3ac90fb8959 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:27:33.317944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae1c7a-1e9c-4821-a7ed-d3ac90fb8959 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:33.319422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae1c7a-1e9c-4821-a7ed-d3ac90fb8959 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:33.333311 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2762/5597] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:27:33.340016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef236f6-b76f-440f-96ac-c48408842393 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:33.352808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef236f6-b76f-440f-96ac-c48408842393 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:33.358238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e302d-27ab-46db-bea0-4db42454ed93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:33.358970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e302d-27ab-46db-bea0-4db42454ed93 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:33.359283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e302d-27ab-46db-bea0-4db42454ed93 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:33.359566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e302d-27ab-46db-bea0-4db42454ed93 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:33.361937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e302d-27ab-46db-bea0-4db42454ed93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:33.363489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e302d-27ab-46db-bea0-4db42454ed93 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:33.479481 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2836/5598] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:27:33 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:27:33.480746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae1c7a-1e9c-4821-a7ed-d3ac90fb8959 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:33.492112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae1c7a-1e9c-4821-a7ed-d3ac90fb8959 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:33.503485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:33.566056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36846fa1-a4e9-42cf-9ad1-0d21f0807e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:33.566859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36846fa1-a4e9-42cf-9ad1-0d21f0807e42 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:33.567252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36846fa1-a4e9-42cf-9ad1-0d21f0807e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:33.567628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36846fa1-a4e9-42cf-9ad1-0d21f0807e42 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:33.568473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36846fa1-a4e9-42cf-9ad1-0d21f0807e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:33.570858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36846fa1-a4e9-42cf-9ad1-0d21f0807e42 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:33.667289 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2763/5599] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:27:33 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:27:33.668289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e302d-27ab-46db-bea0-4db42454ed93 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:33.683384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e302d-27ab-46db-bea0-4db42454ed93 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:33.690026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5da361-4bef-48ce-aa3b-4bb22aa6f3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:33.690714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5da361-4bef-48ce-aa3b-4bb22aa6f3ec admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:33.690998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5da361-4bef-48ce-aa3b-4bb22aa6f3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:33.695863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5da361-4bef-48ce-aa3b-4bb22aa6f3ec admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:33.696825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5da361-4bef-48ce-aa3b-4bb22aa6f3ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:33.698483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5da361-4bef-48ce-aa3b-4bb22aa6f3ec admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:33.714517 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2837/5600] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:27:33.716055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36846fa1-a4e9-42cf-9ad1-0d21f0807e42 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:33.728463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36846fa1-a4e9-42cf-9ad1-0d21f0807e42 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:33.733649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47713f4a-f225-4740-856e-4604253603af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:33.734785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47713f4a-f225-4740-856e-4604253603af admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:33.735113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47713f4a-f225-4740-856e-4604253603af admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:33.735621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47713f4a-f225-4740-856e-4604253603af admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:33.743676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47713f4a-f225-4740-856e-4604253603af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:33.743676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47713f4a-f225-4740-856e-4604253603af admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:33.751073 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2764/5601] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:27:33.754104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5da361-4bef-48ce-aa3b-4bb22aa6f3ec admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:33.770104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5da361-4bef-48ce-aa3b-4bb22aa6f3ec admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:33.776455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b6fe9-7e86-4b3c-b4ba-53aedb98331d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:33.777634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b6fe9-7e86-4b3c-b4ba-53aedb98331d admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:33.778011 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b6fe9-7e86-4b3c-b4ba-53aedb98331d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:33.778354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b6fe9-7e86-4b3c-b4ba-53aedb98331d admin admin] PATH_INFO: `/v3/projects/5bfd328e0f1446369531a23d15387cd6/users/6771589864f442cbbfc8abf018abbd09/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:33.795458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b6fe9-7e86-4b3c-b4ba-53aedb98331d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bfd328e0f1446369531a23d15387cd6, user_id=6771589864f442cbbfc8abf018abbd09, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:33.798609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b6fe9-7e86-4b3c-b4ba-53aedb98331d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:33.899127 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2838/5602] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:27:33 2022] PUT /identity/v3/projects/5bfd328e0f1446369531a23d15387cd6/users/6771589864f442cbbfc8abf018abbd09/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:33.911910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd78c0-7437-4320-a94b-bd1f6539fef9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:33.912307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd78c0-7437-4320-a94b-bd1f6539fef9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:33.912602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd78c0-7437-4320-a94b-bd1f6539fef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:33.946205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e6dd78c0-7437-4320-a94b-bd1f6539fef9 None None] MFA Rules not processed for user `6771589864f442cbbfc8abf018abbd09`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:33.947619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e6dd78c0-7437-4320-a94b-bd1f6539fef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:34.039078 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2765/5603] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:34.051085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b6fe9-7e86-4b3c-b4ba-53aedb98331d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:34.052950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-964b6fe9-7e86-4b3c-b4ba-53aedb98331d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:34.118666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b6fe9-7e86-4b3c-b4ba-53aedb98331d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:34.122376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642df80f-6861-4d7a-b333-6b0f7c9ce306 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:34.124088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642df80f-6861-4d7a-b333-6b0f7c9ce306 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:34.124259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642df80f-6861-4d7a-b333-6b0f7c9ce306 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:34.125037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642df80f-6861-4d7a-b333-6b0f7c9ce306 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:34.134788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642df80f-6861-4d7a-b333-6b0f7c9ce306 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:34.136340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642df80f-6861-4d7a-b333-6b0f7c9ce306 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:34.147821 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2839/5604] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:27:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:27:37.165864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46386e-bb7e-4c1e-a8a1-be9d6a5b7eec None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:37.166340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46386e-bb7e-4c1e-a8a1-be9d6a5b7eec None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:37.166573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46386e-bb7e-4c1e-a8a1-be9d6a5b7eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:37.188169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-db46386e-bb7e-4c1e-a8a1-be9d6a5b7eec None None] MFA Rules not processed for user `6771589864f442cbbfc8abf018abbd09`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:37.189685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-db46386e-bb7e-4c1e-a8a1-be9d6a5b7eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:37.197500 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2766/5605] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:45.650667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=51,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:47.181330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:48.834722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642df80f-6861-4d7a-b333-6b0f7c9ce306 service cinder] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:48.836221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-642df80f-6861-4d7a-b333-6b0f7c9ce306 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:48.969864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642df80f-6861-4d7a-b333-6b0f7c9ce306 service cinder] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:48.979044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1deba96-0629-4aaf-a2c3-5ee0122ceee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:48.980669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1deba96-0629-4aaf-a2c3-5ee0122ceee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:48.981052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1deba96-0629-4aaf-a2c3-5ee0122ceee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:48.983302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1deba96-0629-4aaf-a2c3-5ee0122ceee6 admin admin] PATH_INFO: `/v3/users/45315c12d53349ae8cd245cb138b8dcd` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:48.987989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1deba96-0629-4aaf-a2c3-5ee0122ceee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45315c12d53349ae8cd245cb138b8dcd)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:48.990746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1deba96-0629-4aaf-a2c3-5ee0122ceee6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:49.321142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c1deba96-0629-4aaf-a2c3-5ee0122ceee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45315c12d53349ae8cd245cb138b8dcd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:49.329214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c1deba96-0629-4aaf-a2c3-5ee0122ceee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45315c12d53349ae8cd245cb138b8dcd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:49.431766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c1deba96-0629-4aaf-a2c3-5ee0122ceee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45315c12d53349ae8cd245cb138b8dcd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:49.432723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c1deba96-0629-4aaf-a2c3-5ee0122ceee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45315c12d53349ae8cd245cb138b8dcd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:49.456103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c1deba96-0629-4aaf-a2c3-5ee0122ceee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45315c12d53349ae8cd245cb138b8dcd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:49.475732 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2840/5606] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:27:48 2022] DELETE /identity/v3/users/45315c12d53349ae8cd245cb138b8dcd => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:50.170640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46386e-bb7e-4c1e-a8a1-be9d6a5b7eec None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:50.198566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46386e-bb7e-4c1e-a8a1-be9d6a5b7eec None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:50.388718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b97f3-38ff-4f29-8362-f771aedac095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:50.391311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b97f3-38ff-4f29-8362-f771aedac095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:50.392290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b97f3-38ff-4f29-8362-f771aedac095 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:50.396119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b97f3-38ff-4f29-8362-f771aedac095 admin admin] PATH_INFO: `/v3/projects/aef73d309b204eeebfc2ce69b4e4a41b` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:50.398214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b97f3-38ff-4f29-8362-f771aedac095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aef73d309b204eeebfc2ce69b4e4a41b)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:50.403459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b97f3-38ff-4f29-8362-f771aedac095 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:50.563389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-885b97f3-38ff-4f29-8362-f771aedac095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aef73d309b204eeebfc2ce69b4e4a41b', 'request_id': 'req-885b97f3-38ff-4f29-8362-f771aedac095'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:50.577604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-885b97f3-38ff-4f29-8362-f771aedac095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aef73d309b204eeebfc2ce69b4e4a41b', 'request_id': 'req-885b97f3-38ff-4f29-8362-f771aedac095'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:50.586600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-885b97f3-38ff-4f29-8362-f771aedac095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aef73d309b204eeebfc2ce69b4e4a41b', 'request_id': 'req-885b97f3-38ff-4f29-8362-f771aedac095'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:50.692822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-885b97f3-38ff-4f29-8362-f771aedac095 admin admin] The token cache is being invalidate because project aef73d309b204eeebfc2ce69b4e4a41b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:27:50.693382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-885b97f3-38ff-4f29-8362-f771aedac095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:50.694836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-885b97f3-38ff-4f29-8362-f771aedac095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:50.698182 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2767/5607] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:27:50 2022] DELETE /identity/v3/projects/aef73d309b204eeebfc2ce69b4e4a41b => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:50.703137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e9787-92f0-4732-b170-9a353d77168e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:50.703137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e9787-92f0-4732-b170-9a353d77168e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:50.703571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e9787-92f0-4732-b170-9a353d77168e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:50.728588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2c1e9787-92f0-4732-b170-9a353d77168e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:50.730074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2c1e9787-92f0-4732-b170-9a353d77168e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:50.800897 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2841/5608] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:50.809400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a22a3-8cd1-4cf7-97f9-5895f8170a4f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:50.809785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a22a3-8cd1-4cf7-97f9-5895f8170a4f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:50.810159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a22a3-8cd1-4cf7-97f9-5895f8170a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:50.843527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-267a22a3-8cd1-4cf7-97f9-5895f8170a4f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:50.845005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-267a22a3-8cd1-4cf7-97f9-5895f8170a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:50.874131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e9787-92f0-4732-b170-9a353d77168e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:50.876376 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2768/5609] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:50.880942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e9787-92f0-4732-b170-9a353d77168e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:50.886560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945ff94-50bf-42dd-a39f-ce6db04f4849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:50.887450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945ff94-50bf-42dd-a39f-ce6db04f4849 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:50.887986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945ff94-50bf-42dd-a39f-ce6db04f4849 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:50.888373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945ff94-50bf-42dd-a39f-ce6db04f4849 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:50.889220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945ff94-50bf-42dd-a39f-ce6db04f4849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:27:50.889636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945ff94-50bf-42dd-a39f-ce6db04f4849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:50.892570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945ff94-50bf-42dd-a39f-ce6db04f4849 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:50.918239 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2842/5610] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:27:50.919466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a22a3-8cd1-4cf7-97f9-5895f8170a4f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:50.929353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a22a3-8cd1-4cf7-97f9-5895f8170a4f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:50.943919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d89c6-edc3-4c9f-b511-84a4c1efbd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:50.944623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d89c6-edc3-4c9f-b511-84a4c1efbd81 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:50.944910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d89c6-edc3-4c9f-b511-84a4c1efbd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:50.945188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d89c6-edc3-4c9f-b511-84a4c1efbd81 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:50.946969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d89c6-edc3-4c9f-b511-84a4c1efbd81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:50.951214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d89c6-edc3-4c9f-b511-84a4c1efbd81 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:51.091153 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2769/5611] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:27:50 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:27:51.097530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945ff94-50bf-42dd-a39f-ce6db04f4849 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:51.130463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945ff94-50bf-42dd-a39f-ce6db04f4849 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:51.130463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:51.261644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89b9b2-53c2-420a-a70f-6e263b39e751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:51.262573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89b9b2-53c2-420a-a70f-6e263b39e751 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:51.263119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89b9b2-53c2-420a-a70f-6e263b39e751 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:51.263745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89b9b2-53c2-420a-a70f-6e263b39e751 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:51.264652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89b9b2-53c2-420a-a70f-6e263b39e751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:51.267872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89b9b2-53c2-420a-a70f-6e263b39e751 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:51.528972 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2843/5612] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:27:51 2022] POST /identity/v3/users => generated 293 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:27:51.533825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d89c6-edc3-4c9f-b511-84a4c1efbd81 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:51.546142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d89c6-edc3-4c9f-b511-84a4c1efbd81 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:51.552809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab5f1e-c15b-407a-b141-72d923c9f7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:51.553820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab5f1e-c15b-407a-b141-72d923c9f7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:51.554278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab5f1e-c15b-407a-b141-72d923c9f7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:51.555952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab5f1e-c15b-407a-b141-72d923c9f7d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:51.555952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab5f1e-c15b-407a-b141-72d923c9f7d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:51.557721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab5f1e-c15b-407a-b141-72d923c9f7d9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:51.575725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89b9b2-53c2-420a-a70f-6e263b39e751 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:51.579141 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2770/5613] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:27:51.589506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89b9b2-53c2-420a-a70f-6e263b39e751 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:51.596117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9abb85-1b54-40f2-9784-552c80f089d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:51.597144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9abb85-1b54-40f2-9784-552c80f089d4 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:51.601310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9abb85-1b54-40f2-9784-552c80f089d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:51.601310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9abb85-1b54-40f2-9784-552c80f089d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:51.601310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9abb85-1b54-40f2-9784-552c80f089d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:51.601310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9abb85-1b54-40f2-9784-552c80f089d4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:51.621625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab5f1e-c15b-407a-b141-72d923c9f7d9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:51.631820 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2844/5614] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:27:51.633811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab5f1e-c15b-407a-b141-72d923c9f7d9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:51.646605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300f78f-1d48-4ca2-887e-1ff8b234ce39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:51.648013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300f78f-1d48-4ca2-887e-1ff8b234ce39 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:51.648616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300f78f-1d48-4ca2-887e-1ff8b234ce39 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:51.649105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300f78f-1d48-4ca2-887e-1ff8b234ce39 admin admin] PATH_INFO: `/v3/projects/de44e171326242169fbabc063cbba853/users/6da4e4feaeb644979b5504d24c3de65e/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:51.682415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300f78f-1d48-4ca2-887e-1ff8b234ce39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de44e171326242169fbabc063cbba853, user_id=6da4e4feaeb644979b5504d24c3de65e, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:51.691381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300f78f-1d48-4ca2-887e-1ff8b234ce39 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:51.787955 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2771/5615] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:27:51 2022] PUT /identity/v3/projects/de44e171326242169fbabc063cbba853/users/6da4e4feaeb644979b5504d24c3de65e/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:51.793220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b985e00-e840-4dd1-802f-c3d31b3ae6f9 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:51.793753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b985e00-e840-4dd1-802f-c3d31b3ae6f9 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:51.794118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b985e00-e840-4dd1-802f-c3d31b3ae6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:51.825937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2b985e00-e840-4dd1-802f-c3d31b3ae6f9 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:51.827580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2b985e00-e840-4dd1-802f-c3d31b3ae6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:51.917153 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2845/5616] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:51.928795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300f78f-1d48-4ca2-887e-1ff8b234ce39 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:51.930548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f300f78f-1d48-4ca2-887e-1ff8b234ce39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:51.967544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:52.000103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300f78f-1d48-4ca2-887e-1ff8b234ce39 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:52.005153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9b14b-4be2-478f-bf47-6c2bd86ad90d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:52.006020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9b14b-4be2-478f-bf47-6c2bd86ad90d service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:52.006351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9b14b-4be2-478f-bf47-6c2bd86ad90d service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:52.007248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9b14b-4be2-478f-bf47-6c2bd86ad90d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:52.018930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9b14b-4be2-478f-bf47-6c2bd86ad90d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:52.020436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9b14b-4be2-478f-bf47-6c2bd86ad90d service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:52.031362 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2772/5617] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:27:52.889971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c07e8-66b1-4e99-a007-0ad6e3904eed None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:52.891296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c07e8-66b1-4e99-a007-0ad6e3904eed None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:52.893146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c07e8-66b1-4e99-a007-0ad6e3904eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:52.953008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2f1c07e8-66b1-4e99-a007-0ad6e3904eed None None] MFA Rules not processed for user `6da4e4feaeb644979b5504d24c3de65e`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:52.955422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2f1c07e8-66b1-4e99-a007-0ad6e3904eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:53.101873 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2846/5618] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:53.119856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dcae5-e535-4403-bdb5-60f61b8b1eff None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:53.119856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dcae5-e535-4403-bdb5-60f61b8b1eff None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:53.119856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dcae5-e535-4403-bdb5-60f61b8b1eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:53.168824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7e4dcae5-e535-4403-bdb5-60f61b8b1eff None None] MFA Rules not processed for user `6da4e4feaeb644979b5504d24c3de65e`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:53.171813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7e4dcae5-e535-4403-bdb5-60f61b8b1eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:53.195674 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2773/5619] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:53.456519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c07e8-66b1-4e99-a007-0ad6e3904eed None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:53.460594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2f1c07e8-66b1-4e99-a007-0ad6e3904eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:53.484697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:53.555292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c07e8-66b1-4e99-a007-0ad6e3904eed None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:53.562339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec861b-5a20-46b7-ace0-0dde619b2e56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:53.564131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec861b-5a20-46b7-ace0-0dde619b2e56 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:53.564663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec861b-5a20-46b7-ace0-0dde619b2e56 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:53.565116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec861b-5a20-46b7-ace0-0dde619b2e56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:53.576746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec861b-5a20-46b7-ace0-0dde619b2e56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:53.578877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec861b-5a20-46b7-ace0-0dde619b2e56 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:53.597304 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2847/5620] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:27:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:27:55.517931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dcae5-e535-4403-bdb5-60f61b8b1eff None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:55.539148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dcae5-e535-4403-bdb5-60f61b8b1eff None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:55.550354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229bb0c-d650-40e2-960c-fc858e73bc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:55.551310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229bb0c-d650-40e2-960c-fc858e73bc49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:55.551593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229bb0c-d650-40e2-960c-fc858e73bc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:55.551866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229bb0c-d650-40e2-960c-fc858e73bc49 admin admin] PATH_INFO: `/v3/users/6da4e4feaeb644979b5504d24c3de65e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:55.554287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229bb0c-d650-40e2-960c-fc858e73bc49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da4e4feaeb644979b5504d24c3de65e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:55.556269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229bb0c-d650-40e2-960c-fc858e73bc49 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:55.867993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a229bb0c-d650-40e2-960c-fc858e73bc49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da4e4feaeb644979b5504d24c3de65e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:55.891382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a229bb0c-d650-40e2-960c-fc858e73bc49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da4e4feaeb644979b5504d24c3de65e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:56.020817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a229bb0c-d650-40e2-960c-fc858e73bc49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da4e4feaeb644979b5504d24c3de65e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:56.029704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a229bb0c-d650-40e2-960c-fc858e73bc49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da4e4feaeb644979b5504d24c3de65e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:56.030699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a229bb0c-d650-40e2-960c-fc858e73bc49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da4e4feaeb644979b5504d24c3de65e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:56.040086 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2774/5621] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:27:55 2022] DELETE /identity/v3/users/6da4e4feaeb644979b5504d24c3de65e => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:56.601981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec861b-5a20-46b7-ace0-0dde619b2e56 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:56.621853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec861b-5a20-46b7-ace0-0dde619b2e56 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:56.702872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15af10-a4dd-4fd0-9143-902e300506c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:56.702872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15af10-a4dd-4fd0-9143-902e300506c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:56.702872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15af10-a4dd-4fd0-9143-902e300506c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:56.702872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15af10-a4dd-4fd0-9143-902e300506c8 admin admin] PATH_INFO: `/v3/projects/de44e171326242169fbabc063cbba853` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:56.704418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15af10-a4dd-4fd0-9143-902e300506c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de44e171326242169fbabc063cbba853)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:56.705891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15af10-a4dd-4fd0-9143-902e300506c8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:56.855830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-db15af10-a4dd-4fd0-9143-902e300506c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de44e171326242169fbabc063cbba853', 'request_id': 'req-db15af10-a4dd-4fd0-9143-902e300506c8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:56.911211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-db15af10-a4dd-4fd0-9143-902e300506c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de44e171326242169fbabc063cbba853', 'request_id': 'req-db15af10-a4dd-4fd0-9143-902e300506c8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:56.930651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-db15af10-a4dd-4fd0-9143-902e300506c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de44e171326242169fbabc063cbba853', 'request_id': 'req-db15af10-a4dd-4fd0-9143-902e300506c8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:57.067393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-db15af10-a4dd-4fd0-9143-902e300506c8 admin admin] The token cache is being invalidate because project de44e171326242169fbabc063cbba853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:27:57.067687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-db15af10-a4dd-4fd0-9143-902e300506c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:57.068617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-db15af10-a4dd-4fd0-9143-902e300506c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:57.070488 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2848/5622] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:27:56 2022] DELETE /identity/v3/projects/de44e171326242169fbabc063cbba853 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:57.075691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6116ac2-49da-4e47-a8a6-c362cf0a6f5c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:57.076196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6116ac2-49da-4e47-a8a6-c362cf0a6f5c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:57.076301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6116ac2-49da-4e47-a8a6-c362cf0a6f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:57.120457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a6116ac2-49da-4e47-a8a6-c362cf0a6f5c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:57.121720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a6116ac2-49da-4e47-a8a6-c362cf0a6f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:57.278870 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2775/5623] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:57.287061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37702c8b-48c0-47ba-b5df-cae6ed001664 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:57.287758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37702c8b-48c0-47ba-b5df-cae6ed001664 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:57.288239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37702c8b-48c0-47ba-b5df-cae6ed001664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:57.326716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-37702c8b-48c0-47ba-b5df-cae6ed001664 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:57.331098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-37702c8b-48c0-47ba-b5df-cae6ed001664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:57.368972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6116ac2-49da-4e47-a8a6-c362cf0a6f5c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:57.390432 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2849/5624] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:57.402643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6116ac2-49da-4e47-a8a6-c362cf0a6f5c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:57.409948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c40dac-f360-432a-8d22-e212fed5f10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:57.410882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c40dac-f360-432a-8d22-e212fed5f10f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:57.411364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c40dac-f360-432a-8d22-e212fed5f10f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:57.411788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c40dac-f360-432a-8d22-e212fed5f10f admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:57.413256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c40dac-f360-432a-8d22-e212fed5f10f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:27:57.413824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c40dac-f360-432a-8d22-e212fed5f10f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:57.415661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c40dac-f360-432a-8d22-e212fed5f10f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:57.438551 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2776/5625] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:27:57.440273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37702c8b-48c0-47ba-b5df-cae6ed001664 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:57.453151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37702c8b-48c0-47ba-b5df-cae6ed001664 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:57.466950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7c950-9a5a-4432-996a-6cfb979b5c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:57.467825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7c950-9a5a-4432-996a-6cfb979b5c32 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:57.468050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7c950-9a5a-4432-996a-6cfb979b5c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:57.468319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7c950-9a5a-4432-996a-6cfb979b5c32 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:57.469019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7c950-9a5a-4432-996a-6cfb979b5c32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:57.474510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7c950-9a5a-4432-996a-6cfb979b5c32 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:57.693887 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2850/5626] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:27:57 2022] POST /identity/v3/projects => generated 361 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:27:57.694618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c40dac-f360-432a-8d22-e212fed5f10f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:57.713686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c40dac-f360-432a-8d22-e212fed5f10f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:57.768277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:57.835477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817c6bc-18b5-4852-9a58-a6410ab38606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:57.836323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817c6bc-18b5-4852-9a58-a6410ab38606 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:57.836680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817c6bc-18b5-4852-9a58-a6410ab38606 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:57.837108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817c6bc-18b5-4852-9a58-a6410ab38606 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:57.838058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817c6bc-18b5-4852-9a58-a6410ab38606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:57.840461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817c6bc-18b5-4852-9a58-a6410ab38606 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:57.951709 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2777/5627] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:27:57 2022] POST /identity/v3/users => generated 281 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:27:57.955925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7c950-9a5a-4432-996a-6cfb979b5c32 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:57.963277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:27:57.974297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7c950-9a5a-4432-996a-6cfb979b5c32 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:57.976814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e37d5-c9ce-434e-bfaa-7763742f206e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:57.977740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e37d5-c9ce-434e-bfaa-7763742f206e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:57.978167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e37d5-c9ce-434e-bfaa-7763742f206e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:57.978649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e37d5-c9ce-434e-bfaa-7763742f206e admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:57.979798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e37d5-c9ce-434e-bfaa-7763742f206e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:57.982322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e37d5-c9ce-434e-bfaa-7763742f206e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:58.024392 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2851/5628] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:27:58.028772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817c6bc-18b5-4852-9a58-a6410ab38606 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:58.043759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817c6bc-18b5-4852-9a58-a6410ab38606 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:58.051693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2a8a3-39c7-4d4b-9b7a-52664960071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:58.052856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2a8a3-39c7-4d4b-9b7a-52664960071d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:58.053153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2a8a3-39c7-4d4b-9b7a-52664960071d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:58.053719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2a8a3-39c7-4d4b-9b7a-52664960071d admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:58.054329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2a8a3-39c7-4d4b-9b7a-52664960071d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:58.062135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2a8a3-39c7-4d4b-9b7a-52664960071d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:58.074916 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2778/5629] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:27:58.076342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e37d5-c9ce-434e-bfaa-7763742f206e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:58.089345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e37d5-c9ce-434e-bfaa-7763742f206e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:58.117347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7831a-ab05-49f7-8dbc-46b07c3ca4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:58.122096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7831a-ab05-49f7-8dbc-46b07c3ca4fd admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:58.123612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7831a-ab05-49f7-8dbc-46b07c3ca4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:58.123612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7831a-ab05-49f7-8dbc-46b07c3ca4fd admin admin] PATH_INFO: `/v3/projects/fe6003bb1fc847948e6e6596838b16c0/users/1aae35a61ad44ac3839c0739e8afeb02/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:58.157852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7831a-ab05-49f7-8dbc-46b07c3ca4fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6003bb1fc847948e6e6596838b16c0, user_id=1aae35a61ad44ac3839c0739e8afeb02, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:58.163686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7831a-ab05-49f7-8dbc-46b07c3ca4fd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:58.260925 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2852/5630] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:27:58 2022] PUT /identity/v3/projects/fe6003bb1fc847948e6e6596838b16c0/users/1aae35a61ad44ac3839c0739e8afeb02/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:58.262684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b7c0f-6624-4f5d-a5c4-801d55216396 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:58.263183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b7c0f-6624-4f5d-a5c4-801d55216396 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:58.263320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b7c0f-6624-4f5d-a5c4-801d55216396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:58.315317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-641b7c0f-6624-4f5d-a5c4-801d55216396 None None] MFA Rules not processed for user `1aae35a61ad44ac3839c0739e8afeb02`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:58.316613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-641b7c0f-6624-4f5d-a5c4-801d55216396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:58.404083 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2779/5631] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:58.454511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7831a-ab05-49f7-8dbc-46b07c3ca4fd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:58.613970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7831a-ab05-49f7-8dbc-46b07c3ca4fd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:58.619413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a4e9f-3cb5-4b84-8fb0-b8b32666f512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:58.620377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a4e9f-3cb5-4b84-8fb0-b8b32666f512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:58.621387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a4e9f-3cb5-4b84-8fb0-b8b32666f512 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:58.621926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a4e9f-3cb5-4b84-8fb0-b8b32666f512 admin admin] PATH_INFO: `/v3/users/1aae35a61ad44ac3839c0739e8afeb02` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:58.624056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a4e9f-3cb5-4b84-8fb0-b8b32666f512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aae35a61ad44ac3839c0739e8afeb02)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:58.628642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a4e9f-3cb5-4b84-8fb0-b8b32666f512 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:58.859132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b22a4e9f-3cb5-4b84-8fb0-b8b32666f512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aae35a61ad44ac3839c0739e8afeb02'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:58.876924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b22a4e9f-3cb5-4b84-8fb0-b8b32666f512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aae35a61ad44ac3839c0739e8afeb02'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:58.990491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b22a4e9f-3cb5-4b84-8fb0-b8b32666f512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aae35a61ad44ac3839c0739e8afeb02'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:58.990491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b22a4e9f-3cb5-4b84-8fb0-b8b32666f512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aae35a61ad44ac3839c0739e8afeb02'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:59.067168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b22a4e9f-3cb5-4b84-8fb0-b8b32666f512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aae35a61ad44ac3839c0739e8afeb02'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:27:59.097925 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2853/5632] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:27:58 2022] DELETE /identity/v3/users/1aae35a61ad44ac3839c0739e8afeb02 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:27:59.105203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ac25b-8d1e-4bc7-b553-2bd78471dd09 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:59.105203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ac25b-8d1e-4bc7-b553-2bd78471dd09 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:59.105203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ac25b-8d1e-4bc7-b553-2bd78471dd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:59.140173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d13ac25b-8d1e-4bc7-b553-2bd78471dd09 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:27:59.145066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d13ac25b-8d1e-4bc7-b553-2bd78471dd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:59.351663 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2780/5633] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:27:59.359217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a4e9f-3cb5-4b84-8fb0-b8b32666f512 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:27:59.361877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b22a4e9f-3cb5-4b84-8fb0-b8b32666f512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:27:59.507839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a4e9f-3cb5-4b84-8fb0-b8b32666f512 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:27:59.512178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905549c-55cf-4b73-b139-7372759fad52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:27:59.512854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905549c-55cf-4b73-b139-7372759fad52 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:27:59.513139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905549c-55cf-4b73-b139-7372759fad52 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:27:59.513418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905549c-55cf-4b73-b139-7372759fad52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:27:59.538526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905549c-55cf-4b73-b139-7372759fad52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:27:59.546338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905549c-55cf-4b73-b139-7372759fad52 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:27:59.562658 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2854/5634] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:27:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:27:59.685252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:01.002874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ac25b-8d1e-4bc7-b553-2bd78471dd09 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:01.004405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d13ac25b-8d1e-4bc7-b553-2bd78471dd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:01.018204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ac25b-8d1e-4bc7-b553-2bd78471dd09 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:01.023502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bb863-061c-474f-a053-53f8b98b56fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:01.024589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bb863-061c-474f-a053-53f8b98b56fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:01.025027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bb863-061c-474f-a053-53f8b98b56fa admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:01.025457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bb863-061c-474f-a053-53f8b98b56fa admin admin] PATH_INFO: `/v3/projects/fe6003bb1fc847948e6e6596838b16c0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:01.027100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bb863-061c-474f-a053-53f8b98b56fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe6003bb1fc847948e6e6596838b16c0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:01.029177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bb863-061c-474f-a053-53f8b98b56fa admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:01.129593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:01.156936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-315bb863-061c-474f-a053-53f8b98b56fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe6003bb1fc847948e6e6596838b16c0', 'request_id': 'req-315bb863-061c-474f-a053-53f8b98b56fa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:01.167783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-315bb863-061c-474f-a053-53f8b98b56fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe6003bb1fc847948e6e6596838b16c0', 'request_id': 'req-315bb863-061c-474f-a053-53f8b98b56fa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:01.191398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-315bb863-061c-474f-a053-53f8b98b56fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe6003bb1fc847948e6e6596838b16c0', 'request_id': 'req-315bb863-061c-474f-a053-53f8b98b56fa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:01.308305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-315bb863-061c-474f-a053-53f8b98b56fa admin admin] The token cache is being invalidate because project fe6003bb1fc847948e6e6596838b16c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:28:01.308610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-315bb863-061c-474f-a053-53f8b98b56fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:01.312278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-315bb863-061c-474f-a053-53f8b98b56fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:01.312278 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2781/5635] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:28:01 2022] DELETE /identity/v3/projects/fe6003bb1fc847948e6e6596838b16c0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:28:01.317543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824ed71-58bf-4c1e-a601-dda7017130d3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:01.318550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824ed71-58bf-4c1e-a601-dda7017130d3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:01.318980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824ed71-58bf-4c1e-a601-dda7017130d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:01.354006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e824ed71-58bf-4c1e-a601-dda7017130d3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:01.361848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e824ed71-58bf-4c1e-a601-dda7017130d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:01.458624 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2855/5636] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:01.460336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ac79d-ff47-4cb7-8d15-32f36ab1bbe8 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:01.460624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ac79d-ff47-4cb7-8d15-32f36ab1bbe8 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:01.461168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ac79d-ff47-4cb7-8d15-32f36ab1bbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:01.497317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c30ac79d-ff47-4cb7-8d15-32f36ab1bbe8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:01.498861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c30ac79d-ff47-4cb7-8d15-32f36ab1bbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:01.509838 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2782/5637] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:01.516903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824ed71-58bf-4c1e-a601-dda7017130d3 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:01.525115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824ed71-58bf-4c1e-a601-dda7017130d3 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:01.530381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca6fe3-4b12-46fc-ad4b-89e9ee1b5eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:01.531265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca6fe3-4b12-46fc-ad4b-89e9ee1b5eab admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:01.531778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca6fe3-4b12-46fc-ad4b-89e9ee1b5eab admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:01.532228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca6fe3-4b12-46fc-ad4b-89e9ee1b5eab admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:01.533393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca6fe3-4b12-46fc-ad4b-89e9ee1b5eab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:28:01.534009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca6fe3-4b12-46fc-ad4b-89e9ee1b5eab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:01.535825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca6fe3-4b12-46fc-ad4b-89e9ee1b5eab admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:01.551309 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2856/5638] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:28:01.555498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ac79d-ff47-4cb7-8d15-32f36ab1bbe8 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:01.570452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ac79d-ff47-4cb7-8d15-32f36ab1bbe8 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:01.575565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546b3de-671e-452d-85db-5a7fe6856e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:01.576240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546b3de-671e-452d-85db-5a7fe6856e3e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:01.577057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546b3de-671e-452d-85db-5a7fe6856e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:01.577517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546b3de-671e-452d-85db-5a7fe6856e3e admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:01.579032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546b3de-671e-452d-85db-5a7fe6856e3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:01.581808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546b3de-671e-452d-85db-5a7fe6856e3e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:01.675787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca6fe3-4b12-46fc-ad4b-89e9ee1b5eab admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:01.680101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c3ca6fe3-4b12-46fc-ad4b-89e9ee1b5eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:01.718138 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2783/5639] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:28:01 2022] POST /identity/v3/projects => generated 389 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:28:01.723370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546b3de-671e-452d-85db-5a7fe6856e3e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:01.745974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca6fe3-4b12-46fc-ad4b-89e9ee1b5eab admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:01.849996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620098a-2da3-49c6-8b4b-08a7960bc5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:01.850888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620098a-2da3-49c6-8b4b-08a7960bc5cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:01.852838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620098a-2da3-49c6-8b4b-08a7960bc5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:01.853280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620098a-2da3-49c6-8b4b-08a7960bc5cd admin admin] PATH_INFO: `/v3/users/027dcc48e4fd4c36a5004096ad5e43f8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:01.858071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620098a-2da3-49c6-8b4b-08a7960bc5cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=027dcc48e4fd4c36a5004096ad5e43f8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:01.863688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620098a-2da3-49c6-8b4b-08a7960bc5cd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:01.870738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546b3de-671e-452d-85db-5a7fe6856e3e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:01.876580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88f9be-c9a5-4ca7-aeb8-d72e24040ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:01.877786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88f9be-c9a5-4ca7-aeb8-d72e24040ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:01.878286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88f9be-c9a5-4ca7-aeb8-d72e24040ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:01.878781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88f9be-c9a5-4ca7-aeb8-d72e24040ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:01.880077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88f9be-c9a5-4ca7-aeb8-d72e24040ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:01.882713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88f9be-c9a5-4ca7-aeb8-d72e24040ee0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:01.998285 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2784/5640] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:28:01 2022] POST /identity/v3/users => generated 295 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:28:02.003387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88f9be-c9a5-4ca7-aeb8-d72e24040ee0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:02.021032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88f9be-c9a5-4ca7-aeb8-d72e24040ee0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:02.026858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84368062-8b45-4acb-81e4-8dfae1faf176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:02.028114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84368062-8b45-4acb-81e4-8dfae1faf176 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:02.028924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84368062-8b45-4acb-81e4-8dfae1faf176 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:02.029491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84368062-8b45-4acb-81e4-8dfae1faf176 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:02.030613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84368062-8b45-4acb-81e4-8dfae1faf176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:02.032856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84368062-8b45-4acb-81e4-8dfae1faf176 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:02.047241 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2785/5641] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:28:02.051972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84368062-8b45-4acb-81e4-8dfae1faf176 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:02.064577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84368062-8b45-4acb-81e4-8dfae1faf176 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:02.072733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689eed64-05e6-480b-8513-d0706d0a84f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:02.074222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689eed64-05e6-480b-8513-d0706d0a84f7 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:02.074900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689eed64-05e6-480b-8513-d0706d0a84f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:02.075565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689eed64-05e6-480b-8513-d0706d0a84f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:02.076492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689eed64-05e6-480b-8513-d0706d0a84f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:02.078312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689eed64-05e6-480b-8513-d0706d0a84f7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:02.130842 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2786/5642] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:28:02.135502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689eed64-05e6-480b-8513-d0706d0a84f7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:02.152918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689eed64-05e6-480b-8513-d0706d0a84f7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:02.159777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c519b28-074f-43b0-bcd8-13a183f0f814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:02.161442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c519b28-074f-43b0-bcd8-13a183f0f814 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:02.163122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c519b28-074f-43b0-bcd8-13a183f0f814 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:02.164124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c519b28-074f-43b0-bcd8-13a183f0f814 admin admin] PATH_INFO: `/v3/projects/e451ee7bfd2d4ab58d30c33fef334b55/users/ca2c9e7e6d61414cbf2c7e17753bc0df/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:02.179111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1620098a-2da3-49c6-8b4b-08a7960bc5cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '027dcc48e4fd4c36a5004096ad5e43f8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:02.194685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c519b28-074f-43b0-bcd8-13a183f0f814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e451ee7bfd2d4ab58d30c33fef334b55, user_id=ca2c9e7e6d61414cbf2c7e17753bc0df, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:02.195482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1620098a-2da3-49c6-8b4b-08a7960bc5cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '027dcc48e4fd4c36a5004096ad5e43f8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:02.201700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c519b28-074f-43b0-bcd8-13a183f0f814 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:02.290048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1620098a-2da3-49c6-8b4b-08a7960bc5cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '027dcc48e4fd4c36a5004096ad5e43f8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:02.290761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1620098a-2da3-49c6-8b4b-08a7960bc5cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '027dcc48e4fd4c36a5004096ad5e43f8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:02.305369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:02.307084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1620098a-2da3-49c6-8b4b-08a7960bc5cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '027dcc48e4fd4c36a5004096ad5e43f8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:02.314910 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2857/5643] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:28:01 2022] DELETE /identity/v3/users/027dcc48e4fd4c36a5004096ad5e43f8 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:28:02.325792 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2787/5644] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:28:02 2022] PUT /identity/v3/projects/e451ee7bfd2d4ab58d30c33fef334b55/users/ca2c9e7e6d61414cbf2c7e17753bc0df/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:28:02.333917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c20819-0555-4736-a144-ea3acf25bada None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:02.334469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c20819-0555-4736-a144-ea3acf25bada None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:02.334469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c20819-0555-4736-a144-ea3acf25bada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:02.360016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-80c20819-0555-4736-a144-ea3acf25bada None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:02.361656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-80c20819-0555-4736-a144-ea3acf25bada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:02.527064 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2858/5645] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:02.549519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c519b28-074f-43b0-bcd8-13a183f0f814 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:02.555352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1c519b28-074f-43b0-bcd8-13a183f0f814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:02.643093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c519b28-074f-43b0-bcd8-13a183f0f814 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:02.649068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a6a02-97ca-4ad9-a392-06d6de4bd76c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:02.649999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a6a02-97ca-4ad9-a392-06d6de4bd76c service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:02.650473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a6a02-97ca-4ad9-a392-06d6de4bd76c service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:02.650917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a6a02-97ca-4ad9-a392-06d6de4bd76c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:02.671029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a6a02-97ca-4ad9-a392-06d6de4bd76c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:02.672939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a6a02-97ca-4ad9-a392-06d6de4bd76c service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:02.684881 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2788/5646] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:28:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:28:02.949424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c20819-0555-4736-a144-ea3acf25bada None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:02.949424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-80c20819-0555-4736-a144-ea3acf25bada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:02.965169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c20819-0555-4736-a144-ea3acf25bada None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:02.980695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2d7b3-651e-4962-b3c9-c346ac282a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:02.982000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2d7b3-651e-4962-b3c9-c346ac282a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:02.982443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2d7b3-651e-4962-b3c9-c346ac282a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:02.982875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2d7b3-651e-4962-b3c9-c346ac282a08 admin admin] PATH_INFO: `/v3/projects/1dad823e240149edb30e592380249a13` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:02.988178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2d7b3-651e-4962-b3c9-c346ac282a08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dad823e240149edb30e592380249a13)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:02.990491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2d7b3-651e-4962-b3c9-c346ac282a08 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:03.153559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-77c2d7b3-651e-4962-b3c9-c346ac282a08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dad823e240149edb30e592380249a13', 'request_id': 'req-77c2d7b3-651e-4962-b3c9-c346ac282a08'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:03.168864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-77c2d7b3-651e-4962-b3c9-c346ac282a08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dad823e240149edb30e592380249a13', 'request_id': 'req-77c2d7b3-651e-4962-b3c9-c346ac282a08'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:03.185230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-77c2d7b3-651e-4962-b3c9-c346ac282a08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dad823e240149edb30e592380249a13', 'request_id': 'req-77c2d7b3-651e-4962-b3c9-c346ac282a08'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:03.216177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=6,keystone:SELECT=88,keystone:INSERT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:03.276266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-77c2d7b3-651e-4962-b3c9-c346ac282a08 admin admin] The token cache is being invalidate because project 1dad823e240149edb30e592380249a13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:28:03.276777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-77c2d7b3-651e-4962-b3c9-c346ac282a08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:03.277663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-77c2d7b3-651e-4962-b3c9-c346ac282a08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:03.279660 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2859/5647] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:28:02 2022] DELETE /identity/v3/projects/1dad823e240149edb30e592380249a13 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:28:03.284681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9854fd5-a31f-406c-bd50-0ea2f7c34b53 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:03.284969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9854fd5-a31f-406c-bd50-0ea2f7c34b53 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:03.285247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9854fd5-a31f-406c-bd50-0ea2f7c34b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:03.306351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e9854fd5-a31f-406c-bd50-0ea2f7c34b53 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:03.307642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e9854fd5-a31f-406c-bd50-0ea2f7c34b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:03.395598 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2789/5648] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:03.406213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff583c68-4581-4d4b-a62d-1f76c6cd6fbf None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:03.406794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff583c68-4581-4d4b-a62d-1f76c6cd6fbf None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:03.407032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff583c68-4581-4d4b-a62d-1f76c6cd6fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:03.433719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ff583c68-4581-4d4b-a62d-1f76c6cd6fbf None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:03.435173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ff583c68-4581-4d4b-a62d-1f76c6cd6fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:03.477816 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2860/5649] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:03.482772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9854fd5-a31f-406c-bd50-0ea2f7c34b53 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:03.497397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9854fd5-a31f-406c-bd50-0ea2f7c34b53 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:03.511455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04da022-4b07-494e-a20f-0c0079fdb437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:03.512141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04da022-4b07-494e-a20f-0c0079fdb437 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:03.512425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04da022-4b07-494e-a20f-0c0079fdb437 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:03.512893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04da022-4b07-494e-a20f-0c0079fdb437 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:03.513492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04da022-4b07-494e-a20f-0c0079fdb437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:28:03.513798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04da022-4b07-494e-a20f-0c0079fdb437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:03.515513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04da022-4b07-494e-a20f-0c0079fdb437 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:03.530154 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2790/5650] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:28:03.535226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff583c68-4581-4d4b-a62d-1f76c6cd6fbf None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:03.549108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff583c68-4581-4d4b-a62d-1f76c6cd6fbf None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:03.560191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d678ed7-9ee5-481f-97fc-783a168e2230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:03.561287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d678ed7-9ee5-481f-97fc-783a168e2230 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:03.562299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d678ed7-9ee5-481f-97fc-783a168e2230 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:03.562693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d678ed7-9ee5-481f-97fc-783a168e2230 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:03.564705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d678ed7-9ee5-481f-97fc-783a168e2230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:03.570761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d678ed7-9ee5-481f-97fc-783a168e2230 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:03.762712 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2861/5651] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:28:03 2022] POST /identity/v3/projects => generated 373 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:28:03.772202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04da022-4b07-494e-a20f-0c0079fdb437 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:03.788698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04da022-4b07-494e-a20f-0c0079fdb437 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:03.960927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cb0db-2346-414c-babf-c2e8814aac07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:03.963595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cb0db-2346-414c-babf-c2e8814aac07 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:03.963595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cb0db-2346-414c-babf-c2e8814aac07 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:03.963595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cb0db-2346-414c-babf-c2e8814aac07 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:03.963595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857cb0db-2346-414c-babf-c2e8814aac07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:03.965879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857cb0db-2346-414c-babf-c2e8814aac07 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:04.120885 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2791/5652] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:28:03 2022] POST /identity/v3/users => generated 287 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:28:04.125891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d678ed7-9ee5-481f-97fc-783a168e2230 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:04.146080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d678ed7-9ee5-481f-97fc-783a168e2230 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:04.163076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265c037-7739-4ee8-8f36-ed6f5e75ee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:04.163915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265c037-7739-4ee8-8f36-ed6f5e75ee08 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:04.164307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265c037-7739-4ee8-8f36-ed6f5e75ee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:04.164688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265c037-7739-4ee8-8f36-ed6f5e75ee08 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:04.165531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265c037-7739-4ee8-8f36-ed6f5e75ee08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:04.167762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265c037-7739-4ee8-8f36-ed6f5e75ee08 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:04.194764 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2862/5653] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:28:04.197790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cb0db-2346-414c-babf-c2e8814aac07 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:04.212437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cb0db-2346-414c-babf-c2e8814aac07 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:04.218116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb7a6d-854a-40f9-81d2-87d4261ef372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:04.218837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb7a6d-854a-40f9-81d2-87d4261ef372 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:04.219617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb7a6d-854a-40f9-81d2-87d4261ef372 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:04.220101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb7a6d-854a-40f9-81d2-87d4261ef372 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:04.221001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb7a6d-854a-40f9-81d2-87d4261ef372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:04.223196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb7a6d-854a-40f9-81d2-87d4261ef372 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:04.235797 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2792/5654] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:28:04.242246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265c037-7739-4ee8-8f36-ed6f5e75ee08 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:04.252661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265c037-7739-4ee8-8f36-ed6f5e75ee08 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:04.257902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3894a-d0b9-423f-80ce-1981616393fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:04.259580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3894a-d0b9-423f-80ce-1981616393fc admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:04.260058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3894a-d0b9-423f-80ce-1981616393fc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:04.260507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3894a-d0b9-423f-80ce-1981616393fc admin admin] PATH_INFO: `/v3/projects/349811967f4b4d1a9ab6772602a205a6/users/0f14ac04b7a44f17b946c5c8619554ad/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:04.288678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3894a-d0b9-423f-80ce-1981616393fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=349811967f4b4d1a9ab6772602a205a6, user_id=0f14ac04b7a44f17b946c5c8619554ad, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:04.296691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3894a-d0b9-423f-80ce-1981616393fc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:04.414916 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2863/5655] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:28:04 2022] PUT /identity/v3/projects/349811967f4b4d1a9ab6772602a205a6/users/0f14ac04b7a44f17b946c5c8619554ad/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:28:04.416443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072bd38-a07d-43c8-85f9-590b5545918f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:04.416907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072bd38-a07d-43c8-85f9-590b5545918f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:04.417347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072bd38-a07d-43c8-85f9-590b5545918f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:04.467785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8072bd38-a07d-43c8-85f9-590b5545918f None None] MFA Rules not processed for user `0f14ac04b7a44f17b946c5c8619554ad`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:04.475790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8072bd38-a07d-43c8-85f9-590b5545918f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:04.570195 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2793/5656] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:28:04.581972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c72128-af33-4cbb-a8b8-153ebacacdba None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:04.582267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c72128-af33-4cbb-a8b8-153ebacacdba None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:04.582553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c72128-af33-4cbb-a8b8-153ebacacdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:04.668152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-83c72128-af33-4cbb-a8b8-153ebacacdba None None] MFA Rules not processed for user `0f14ac04b7a44f17b946c5c8619554ad`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:04.672323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-83c72128-af33-4cbb-a8b8-153ebacacdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:04.697565 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2864/5657] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:04.721922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072bd38-a07d-43c8-85f9-590b5545918f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:04.722442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8072bd38-a07d-43c8-85f9-590b5545918f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:04.869269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072bd38-a07d-43c8-85f9-590b5545918f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:04.899675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31f1a0-a1e0-4c46-a77e-cfd3d48b2350 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:04.900467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31f1a0-a1e0-4c46-a77e-cfd3d48b2350 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:04.901198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31f1a0-a1e0-4c46-a77e-cfd3d48b2350 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:04.901575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31f1a0-a1e0-4c46-a77e-cfd3d48b2350 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:04.924712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31f1a0-a1e0-4c46-a77e-cfd3d48b2350 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:04.927053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31f1a0-a1e0-4c46-a77e-cfd3d48b2350 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:04.943228 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2794/5658] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:28:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:28:06.497977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:06.695838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3f8a7-56a1-496f-bd96-70279849e283 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:06.698591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3f8a7-56a1-496f-bd96-70279849e283 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:06.698591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3f8a7-56a1-496f-bd96-70279849e283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:06.737407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5be3f8a7-56a1-496f-bd96-70279849e283 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:06.739109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5be3f8a7-56a1-496f-bd96-70279849e283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:06.757327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:06.930346 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2865/5659] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:28:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:06.948591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31f1a0-a1e0-4c46-a77e-cfd3d48b2350 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:06.950056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6f31f1a0-a1e0-4c46-a77e-cfd3d48b2350 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:07.144061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31f1a0-a1e0-4c46-a77e-cfd3d48b2350 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:07.158975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ac2a8-77a3-462a-962b-b8e0928e8021 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:07.159674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ac2a8-77a3-462a-962b-b8e0928e8021 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:07.159956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ac2a8-77a3-462a-962b-b8e0928e8021 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:07.160233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ac2a8-77a3-462a-962b-b8e0928e8021 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:07.178913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ac2a8-77a3-462a-962b-b8e0928e8021 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:07.180577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ac2a8-77a3-462a-962b-b8e0928e8021 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:07.202494 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2795/5660] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:28:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:28:08.822987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1516fe-4705-4c4c-87e6-ef4e6374c769 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:08.823529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1516fe-4705-4c4c-87e6-ef4e6374c769 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:08.823658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1516fe-4705-4c4c-87e6-ef4e6374c769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:08.846017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-dd1516fe-4705-4c4c-87e6-ef4e6374c769 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:08.847800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dd1516fe-4705-4c4c-87e6-ef4e6374c769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:08.865768 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2866/5661] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:28:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:08.878584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ac2a8-77a3-462a-962b-b8e0928e8021 service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:08.921531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ac2a8-77a3-462a-962b-b8e0928e8021 service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:08.951454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66995610-f935-4eb6-920d-e2fbfc2e8f27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:08.954331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66995610-f935-4eb6-920d-e2fbfc2e8f27 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:08.954820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66995610-f935-4eb6-920d-e2fbfc2e8f27 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:08.956054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66995610-f935-4eb6-920d-e2fbfc2e8f27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:08.979315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66995610-f935-4eb6-920d-e2fbfc2e8f27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:08.987300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66995610-f935-4eb6-920d-e2fbfc2e8f27 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:09.021453 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2796/5662] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:28:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:28:09.955482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df621f9f-5751-44f7-93f6-0539f1b65149 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:09.957280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df621f9f-5751-44f7-93f6-0539f1b65149 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:09.957280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df621f9f-5751-44f7-93f6-0539f1b65149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:09.997498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-df621f9f-5751-44f7-93f6-0539f1b65149 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:09.997992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-df621f9f-5751-44f7-93f6-0539f1b65149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:10.043855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66995610-f935-4eb6-920d-e2fbfc2e8f27 service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:10.051514 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2867/5663] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:28:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:10.064503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66995610-f935-4eb6-920d-e2fbfc2e8f27 service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:10.075470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cc3e8-e40f-4fcc-be40-573b741f0ee1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:10.076660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cc3e8-e40f-4fcc-be40-573b741f0ee1 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:10.077186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cc3e8-e40f-4fcc-be40-573b741f0ee1 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:10.077680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cc3e8-e40f-4fcc-be40-573b741f0ee1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:10.090238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cc3e8-e40f-4fcc-be40-573b741f0ee1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:10.092236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cc3e8-e40f-4fcc-be40-573b741f0ee1 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:10.104996 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2797/5664] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:28:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:28:11.046310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5e092-2d33-49d2-ae52-8a292460ad90 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:11.046791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5e092-2d33-49d2-ae52-8a292460ad90 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:11.051951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5e092-2d33-49d2-ae52-8a292460ad90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:11.066426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-04d5e092-2d33-49d2-ae52-8a292460ad90 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:11.068246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-04d5e092-2d33-49d2-ae52-8a292460ad90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:11.085058 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2868/5665] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:28:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:11.100675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cc3e8-e40f-4fcc-be40-573b741f0ee1 service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:11.116620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cc3e8-e40f-4fcc-be40-573b741f0ee1 service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:11.123108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd598bd6-0bc9-4dac-9373-bd169609ffa2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:11.124148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd598bd6-0bc9-4dac-9373-bd169609ffa2 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:11.124728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd598bd6-0bc9-4dac-9373-bd169609ffa2 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:11.138519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd598bd6-0bc9-4dac-9373-bd169609ffa2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:11.151782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd598bd6-0bc9-4dac-9373-bd169609ffa2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:11.154256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd598bd6-0bc9-4dac-9373-bd169609ffa2 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:11.190938 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2798/5666] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:28:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:28:13.857700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5e092-2d33-49d2-ae52-8a292460ad90 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:13.862947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-04d5e092-2d33-49d2-ae52-8a292460ad90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:14.095385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5e092-2d33-49d2-ae52-8a292460ad90 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:14.118720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2220ea-1adc-4505-8ae7-7bd2dbc69508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:14.120893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2220ea-1adc-4505-8ae7-7bd2dbc69508 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:14.126543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2220ea-1adc-4505-8ae7-7bd2dbc69508 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:14.128892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2220ea-1adc-4505-8ae7-7bd2dbc69508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:14.144461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4a2220ea-1adc-4505-8ae7-7bd2dbc69508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:14.192006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2220ea-1adc-4505-8ae7-7bd2dbc69508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:14.193642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2220ea-1adc-4505-8ae7-7bd2dbc69508 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:14.232963 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2869/5667] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:28:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:28:14.452294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac28f82-5b6f-4c90-aedc-409d39cf695a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:14.453454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac28f82-5b6f-4c90-aedc-409d39cf695a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:14.453860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac28f82-5b6f-4c90-aedc-409d39cf695a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:14.463771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:14.519537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-cac28f82-5b6f-4c90-aedc-409d39cf695a None None] MFA Rules not processed for user `ca2c9e7e6d61414cbf2c7e17753bc0df`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:14.521067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cac28f82-5b6f-4c90-aedc-409d39cf695a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:14.658021 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2799/5668] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:14.883907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2220ea-1adc-4505-8ae7-7bd2dbc69508 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:14.897524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2220ea-1adc-4505-8ae7-7bd2dbc69508 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:14.910728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2184203-f030-401b-8e06-fc50e9e51f0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:14.911711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2184203-f030-401b-8e06-fc50e9e51f0e service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:14.912147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2184203-f030-401b-8e06-fc50e9e51f0e service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:14.920731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2184203-f030-401b-8e06-fc50e9e51f0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:14.928557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f2184203-f030-401b-8e06-fc50e9e51f0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:14.947743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac28f82-5b6f-4c90-aedc-409d39cf695a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:14.949187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cac28f82-5b6f-4c90-aedc-409d39cf695a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:14.975567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2184203-f030-401b-8e06-fc50e9e51f0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:14.977029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2184203-f030-401b-8e06-fc50e9e51f0e service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:14.981957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac28f82-5b6f-4c90-aedc-409d39cf695a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:14.991044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d83b50-6e46-476d-b3f5-8e9fef31e772 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:14.992315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d83b50-6e46-476d-b3f5-8e9fef31e772 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:14.992646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d83b50-6e46-476d-b3f5-8e9fef31e772 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:14.992986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d83b50-6e46-476d-b3f5-8e9fef31e772 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:14.995508 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2870/5669] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:28:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:28:15.009500 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d83b50-6e46-476d-b3f5-8e9fef31e772 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:15.012997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d83b50-6e46-476d-b3f5-8e9fef31e772 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:15.024602 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2800/5670] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:28:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:28:19.829733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d6863-2f3a-4bdc-8860-0a2820de27e2 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:19.830615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d6863-2f3a-4bdc-8860-0a2820de27e2 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:19.831083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d6863-2f3a-4bdc-8860-0a2820de27e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:19.858958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-564d6863-2f3a-4bdc-8860-0a2820de27e2 None None] MFA Rules not processed for user `ca2c9e7e6d61414cbf2c7e17753bc0df`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:19.862083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-564d6863-2f3a-4bdc-8860-0a2820de27e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:19.876213 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2871/5671] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:21.045303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d83b50-6e46-476d-b3f5-8e9fef31e772 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:21.048755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-09d83b50-6e46-476d-b3f5-8e9fef31e772 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:21.207160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d83b50-6e46-476d-b3f5-8e9fef31e772 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:21.215651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f0ac3-8dcb-459e-be02-b696bc342d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:21.217219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f0ac3-8dcb-459e-be02-b696bc342d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:21.217612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f0ac3-8dcb-459e-be02-b696bc342d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:21.218883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f0ac3-8dcb-459e-be02-b696bc342d79 admin admin] PATH_INFO: `/v3/users/029c76a0ba614b5880128c4309902c67` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:21.220260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f0ac3-8dcb-459e-be02-b696bc342d79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=029c76a0ba614b5880128c4309902c67)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:21.222293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f0ac3-8dcb-459e-be02-b696bc342d79 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:21.514184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ce4f0ac3-8dcb-459e-be02-b696bc342d79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '029c76a0ba614b5880128c4309902c67'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:21.532606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ce4f0ac3-8dcb-459e-be02-b696bc342d79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '029c76a0ba614b5880128c4309902c67'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:21.598858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ce4f0ac3-8dcb-459e-be02-b696bc342d79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '029c76a0ba614b5880128c4309902c67'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:21.609671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ce4f0ac3-8dcb-459e-be02-b696bc342d79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '029c76a0ba614b5880128c4309902c67'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:21.611811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ce4f0ac3-8dcb-459e-be02-b696bc342d79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '029c76a0ba614b5880128c4309902c67'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:21.613678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:21.628697 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2801/5672] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:28:21 2022] DELETE /identity/v3/users/029c76a0ba614b5880128c4309902c67 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:28:22.047822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d6863-2f3a-4bdc-8860-0a2820de27e2 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:22.064131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d6863-2f3a-4bdc-8860-0a2820de27e2 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:22.182040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b6295-835c-4668-a23d-4b294ae9bbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:22.182911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b6295-835c-4668-a23d-4b294ae9bbef admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:22.183231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b6295-835c-4668-a23d-4b294ae9bbef admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:22.183511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b6295-835c-4668-a23d-4b294ae9bbef admin admin] PATH_INFO: `/v3/projects/3b214f5044c7445592e177835a5d18fc` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:22.190500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b6295-835c-4668-a23d-4b294ae9bbef admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b214f5044c7445592e177835a5d18fc)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:22.192412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b6295-835c-4668-a23d-4b294ae9bbef admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:22.224646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:22.343626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-493b6295-835c-4668-a23d-4b294ae9bbef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b214f5044c7445592e177835a5d18fc', 'request_id': 'req-493b6295-835c-4668-a23d-4b294ae9bbef'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:22.352024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-493b6295-835c-4668-a23d-4b294ae9bbef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b214f5044c7445592e177835a5d18fc', 'request_id': 'req-493b6295-835c-4668-a23d-4b294ae9bbef'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:22.360443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-493b6295-835c-4668-a23d-4b294ae9bbef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b214f5044c7445592e177835a5d18fc', 'request_id': 'req-493b6295-835c-4668-a23d-4b294ae9bbef'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:22.501794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-493b6295-835c-4668-a23d-4b294ae9bbef admin admin] The token cache is being invalidate because project 3b214f5044c7445592e177835a5d18fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:28:22.502010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-493b6295-835c-4668-a23d-4b294ae9bbef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:22.502720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-493b6295-835c-4668-a23d-4b294ae9bbef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:22.504332 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2872/5673] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:28:22 2022] DELETE /identity/v3/projects/3b214f5044c7445592e177835a5d18fc => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:28:22.509461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd9994-0f5b-4759-8f95-5585c7222044 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:22.509992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd9994-0f5b-4759-8f95-5585c7222044 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:22.510087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd9994-0f5b-4759-8f95-5585c7222044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:22.528174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a5dd9994-0f5b-4759-8f95-5585c7222044 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:22.529411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a5dd9994-0f5b-4759-8f95-5585c7222044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:22.598620 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2802/5674] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:22.606524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b78c2-f88a-4749-ad72-3da2a5d093fd None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:22.607107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b78c2-f88a-4749-ad72-3da2a5d093fd None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:22.607897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b78c2-f88a-4749-ad72-3da2a5d093fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:22.635392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-eb3b78c2-f88a-4749-ad72-3da2a5d093fd None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:22.636780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-eb3b78c2-f88a-4749-ad72-3da2a5d093fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:22.646041 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2873/5675] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:22.650860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd9994-0f5b-4759-8f95-5585c7222044 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:22.662792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd9994-0f5b-4759-8f95-5585c7222044 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:22.669187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e690ac-2de3-4f6d-b9ca-bd392cb562bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:22.669859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e690ac-2de3-4f6d-b9ca-bd392cb562bc admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:22.670265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e690ac-2de3-4f6d-b9ca-bd392cb562bc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:22.670550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e690ac-2de3-4f6d-b9ca-bd392cb562bc admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:22.671437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e690ac-2de3-4f6d-b9ca-bd392cb562bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:28:22.671926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e690ac-2de3-4f6d-b9ca-bd392cb562bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:22.673801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e690ac-2de3-4f6d-b9ca-bd392cb562bc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:22.687497 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2803/5676] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:28:22.706559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b78c2-f88a-4749-ad72-3da2a5d093fd None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:22.718108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b78c2-f88a-4749-ad72-3da2a5d093fd None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:22.724429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7255a8-bfb3-4043-86c3-e6716ca25b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:22.725179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7255a8-bfb3-4043-86c3-e6716ca25b58 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:22.725523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7255a8-bfb3-4043-86c3-e6716ca25b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:22.725800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7255a8-bfb3-4043-86c3-e6716ca25b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:22.727345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7255a8-bfb3-4043-86c3-e6716ca25b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:22.729633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7255a8-bfb3-4043-86c3-e6716ca25b58 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:22.854299 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2874/5677] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:28:22 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:28:22.858532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e690ac-2de3-4f6d-b9ca-bd392cb562bc admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:22.873878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e690ac-2de3-4f6d-b9ca-bd392cb562bc admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:22.980347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6243b-c6f8-47e3-9e2c-e81cbb981403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:22.981031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6243b-c6f8-47e3-9e2c-e81cbb981403 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:22.981314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6243b-c6f8-47e3-9e2c-e81cbb981403 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:22.981592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6243b-c6f8-47e3-9e2c-e81cbb981403 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:22.982301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6243b-c6f8-47e3-9e2c-e81cbb981403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:22.986739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6243b-c6f8-47e3-9e2c-e81cbb981403 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:23.099034 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2804/5678] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:28:22 2022] POST /identity/v3/users => generated 292 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:28:23.102754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7255a8-bfb3-4043-86c3-e6716ca25b58 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:23.116235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7255a8-bfb3-4043-86c3-e6716ca25b58 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:23.121279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c6e9a-c32c-42a1-adea-97cf6018302b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:23.122187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c6e9a-c32c-42a1-adea-97cf6018302b admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:23.122473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c6e9a-c32c-42a1-adea-97cf6018302b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:23.130346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c6e9a-c32c-42a1-adea-97cf6018302b admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:23.132573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c6e9a-c32c-42a1-adea-97cf6018302b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:23.134384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c6e9a-c32c-42a1-adea-97cf6018302b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:23.149353 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2875/5679] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:28:23.159128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6243b-c6f8-47e3-9e2c-e81cbb981403 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:23.169863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6243b-c6f8-47e3-9e2c-e81cbb981403 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:23.178535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8010c43-7b19-4d03-82fb-bd0f5deec346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:23.179376 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8010c43-7b19-4d03-82fb-bd0f5deec346 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:23.179752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8010c43-7b19-4d03-82fb-bd0f5deec346 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:23.180090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8010c43-7b19-4d03-82fb-bd0f5deec346 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:23.180956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8010c43-7b19-4d03-82fb-bd0f5deec346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:23.182624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8010c43-7b19-4d03-82fb-bd0f5deec346 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:23.195113 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2805/5680] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:28:23.200346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c6e9a-c32c-42a1-adea-97cf6018302b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:23.216751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c6e9a-c32c-42a1-adea-97cf6018302b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:23.224144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda29024-47a0-4956-aaab-ebfc918ae9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:23.225360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda29024-47a0-4956-aaab-ebfc918ae9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:23.225639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda29024-47a0-4956-aaab-ebfc918ae9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:23.225966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda29024-47a0-4956-aaab-ebfc918ae9e8 admin admin] PATH_INFO: `/v3/projects/125617442dae45f58c179b625bcc799d/users/a27b3e9973c846c68f25f7981c995b73/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:23.245043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda29024-47a0-4956-aaab-ebfc918ae9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=125617442dae45f58c179b625bcc799d, user_id=a27b3e9973c846c68f25f7981c995b73, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:23.248483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda29024-47a0-4956-aaab-ebfc918ae9e8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:23.346827 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2876/5681] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:28:23 2022] PUT /identity/v3/projects/125617442dae45f58c179b625bcc799d/users/a27b3e9973c846c68f25f7981c995b73/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:28:23.351935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2282a08-8822-4a25-a83b-46612da28ec5 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:23.352244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2282a08-8822-4a25-a83b-46612da28ec5 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:23.352547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2282a08-8822-4a25-a83b-46612da28ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:23.379462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f2282a08-8822-4a25-a83b-46612da28ec5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:23.381002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f2282a08-8822-4a25-a83b-46612da28ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:23.451196 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2806/5682] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:23.461086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda29024-47a0-4956-aaab-ebfc918ae9e8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:23.462850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dda29024-47a0-4956-aaab-ebfc918ae9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:23.545235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda29024-47a0-4956-aaab-ebfc918ae9e8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:23.552647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a9b58-c3ca-40dd-8a5e-4bdd58289da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:23.552647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a9b58-c3ca-40dd-8a5e-4bdd58289da9 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:23.552899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a9b58-c3ca-40dd-8a5e-4bdd58289da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:23.553110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a9b58-c3ca-40dd-8a5e-4bdd58289da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:23.586956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a9b58-c3ca-40dd-8a5e-4bdd58289da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:23.598118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a9b58-c3ca-40dd-8a5e-4bdd58289da9 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:23.620871 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2877/5683] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:28:28.219660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2282a08-8822-4a25-a83b-46612da28ec5 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:28.222667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f2282a08-8822-4a25-a83b-46612da28ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:28.243825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:28.262217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2282a08-8822-4a25-a83b-46612da28ec5 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:28.285736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3c64f-5541-49d0-b17b-979e0c7d0c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:28.286640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3c64f-5541-49d0-b17b-979e0c7d0c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:28.286926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3c64f-5541-49d0-b17b-979e0c7d0c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:28.287236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3c64f-5541-49d0-b17b-979e0c7d0c25 admin admin] PATH_INFO: `/v3/users/6771589864f442cbbfc8abf018abbd09` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:28.291068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3c64f-5541-49d0-b17b-979e0c7d0c25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6771589864f442cbbfc8abf018abbd09)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:28.295466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3c64f-5541-49d0-b17b-979e0c7d0c25 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:28.571077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-46e3c64f-5541-49d0-b17b-979e0c7d0c25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6771589864f442cbbfc8abf018abbd09'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:28.587644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-46e3c64f-5541-49d0-b17b-979e0c7d0c25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6771589864f442cbbfc8abf018abbd09'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:28.690763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-46e3c64f-5541-49d0-b17b-979e0c7d0c25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6771589864f442cbbfc8abf018abbd09'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:28.701481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-46e3c64f-5541-49d0-b17b-979e0c7d0c25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6771589864f442cbbfc8abf018abbd09'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:28.704026 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-46e3c64f-5541-49d0-b17b-979e0c7d0c25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6771589864f442cbbfc8abf018abbd09'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:28.718843 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2807/5684] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:28:28 2022] DELETE /identity/v3/users/6771589864f442cbbfc8abf018abbd09 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:28:28.724551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ead04-7f32-4011-a853-997e439d16ed None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:28.727056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ead04-7f32-4011-a853-997e439d16ed None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:28.727391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ead04-7f32-4011-a853-997e439d16ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:28.763587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9f1ead04-7f32-4011-a853-997e439d16ed None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:28.765894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9f1ead04-7f32-4011-a853-997e439d16ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:28.855494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:28.894656 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2878/5685] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:28.935888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3c64f-5541-49d0-b17b-979e0c7d0c25 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:28.942345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-46e3c64f-5541-49d0-b17b-979e0c7d0c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:29.103229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3c64f-5541-49d0-b17b-979e0c7d0c25 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:29.103229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb547b4e-362b-477c-9d18-14e0a7a36fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:29.103987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb547b4e-362b-477c-9d18-14e0a7a36fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:29.105925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb547b4e-362b-477c-9d18-14e0a7a36fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:29.106330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb547b4e-362b-477c-9d18-14e0a7a36fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:29.128185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb547b4e-362b-477c-9d18-14e0a7a36fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:29.131127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb547b4e-362b-477c-9d18-14e0a7a36fa5 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:29.144000 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2808/5686] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:28:30.273289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ead04-7f32-4011-a853-997e439d16ed None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:30.279903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9f1ead04-7f32-4011-a853-997e439d16ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:30.304181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ead04-7f32-4011-a853-997e439d16ed None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:30.318493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34341916-bc0c-42d6-842d-eb785b143f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:30.325874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34341916-bc0c-42d6-842d-eb785b143f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:30.326665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34341916-bc0c-42d6-842d-eb785b143f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:30.337905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34341916-bc0c-42d6-842d-eb785b143f22 admin admin] PATH_INFO: `/v3/projects/5bfd328e0f1446369531a23d15387cd6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:30.339704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34341916-bc0c-42d6-842d-eb785b143f22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bfd328e0f1446369531a23d15387cd6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:30.341827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34341916-bc0c-42d6-842d-eb785b143f22 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:30.525313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-34341916-bc0c-42d6-842d-eb785b143f22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bfd328e0f1446369531a23d15387cd6', 'request_id': 'req-34341916-bc0c-42d6-842d-eb785b143f22'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:30.536300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-34341916-bc0c-42d6-842d-eb785b143f22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bfd328e0f1446369531a23d15387cd6', 'request_id': 'req-34341916-bc0c-42d6-842d-eb785b143f22'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:30.545260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-34341916-bc0c-42d6-842d-eb785b143f22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bfd328e0f1446369531a23d15387cd6', 'request_id': 'req-34341916-bc0c-42d6-842d-eb785b143f22'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:30.764056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-34341916-bc0c-42d6-842d-eb785b143f22 admin admin] The token cache is being invalidate because project 5bfd328e0f1446369531a23d15387cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:28:30.764556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-34341916-bc0c-42d6-842d-eb785b143f22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:30.767835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-34341916-bc0c-42d6-842d-eb785b143f22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:30.775457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625aeee-2d7f-4de3-ba5f-04bab0094e68 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:30.775937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625aeee-2d7f-4de3-ba5f-04bab0094e68 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:30.775937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625aeee-2d7f-4de3-ba5f-04bab0094e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:30.777111 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2879/5687] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:28:30 2022] DELETE /identity/v3/projects/5bfd328e0f1446369531a23d15387cd6 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:28:30.840111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5625aeee-2d7f-4de3-ba5f-04bab0094e68 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:30.845204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5625aeee-2d7f-4de3-ba5f-04bab0094e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:31.028266 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2809/5688] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:31.037147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd21fa9-84f6-405b-a61e-c6b9eb4f87ff None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:31.037638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd21fa9-84f6-405b-a61e-c6b9eb4f87ff None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:31.038065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd21fa9-84f6-405b-a61e-c6b9eb4f87ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:31.116517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ccd21fa9-84f6-405b-a61e-c6b9eb4f87ff None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:31.117809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ccd21fa9-84f6-405b-a61e-c6b9eb4f87ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:31.131648 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2880/5689] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:31.142056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625aeee-2d7f-4de3-ba5f-04bab0094e68 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:31.155940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625aeee-2d7f-4de3-ba5f-04bab0094e68 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:31.163038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465cf44-65fd-43be-a6b7-13386f01c033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:31.164448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465cf44-65fd-43be-a6b7-13386f01c033 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:31.164742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465cf44-65fd-43be-a6b7-13386f01c033 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:31.165021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465cf44-65fd-43be-a6b7-13386f01c033 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:31.166123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465cf44-65fd-43be-a6b7-13386f01c033 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:28:31.166438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465cf44-65fd-43be-a6b7-13386f01c033 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:31.169203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465cf44-65fd-43be-a6b7-13386f01c033 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:31.189743 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2810/5690] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:28:31.195268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd21fa9-84f6-405b-a61e-c6b9eb4f87ff None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:31.205878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd21fa9-84f6-405b-a61e-c6b9eb4f87ff None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:31.211769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a13a6-7704-4561-9816-df04992fc392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:31.212702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a13a6-7704-4561-9816-df04992fc392 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:31.220114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a13a6-7704-4561-9816-df04992fc392 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:31.220651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a13a6-7704-4561-9816-df04992fc392 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:31.221430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a13a6-7704-4561-9816-df04992fc392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:31.225057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a13a6-7704-4561-9816-df04992fc392 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:31.393457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465cf44-65fd-43be-a6b7-13386f01c033 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:31.418063 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2881/5691] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:28:31 2022] POST /identity/v3/projects => generated 373 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:28:31.430335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465cf44-65fd-43be-a6b7-13386f01c033 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:31.437883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:31.573569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a9cfe-1bdb-49e1-809d-9b442bc58e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:31.574586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a9cfe-1bdb-49e1-809d-9b442bc58e63 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:31.576588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a9cfe-1bdb-49e1-809d-9b442bc58e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:31.577183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a9cfe-1bdb-49e1-809d-9b442bc58e63 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:31.578369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a9cfe-1bdb-49e1-809d-9b442bc58e63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:31.580710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a9cfe-1bdb-49e1-809d-9b442bc58e63 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:31.759098 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2811/5692] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:28:31 2022] POST /identity/v3/users => generated 287 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:28:31.760340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a13a6-7704-4561-9816-df04992fc392 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:31.776727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a13a6-7704-4561-9816-df04992fc392 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:31.793480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae141b91-3be2-462e-a080-3934d970df41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:31.794171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae141b91-3be2-462e-a080-3934d970df41 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:31.794635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae141b91-3be2-462e-a080-3934d970df41 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:31.794917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae141b91-3be2-462e-a080-3934d970df41 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:31.798385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae141b91-3be2-462e-a080-3934d970df41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:31.800086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae141b91-3be2-462e-a080-3934d970df41 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:31.824710 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2882/5693] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:28:31.828361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a9cfe-1bdb-49e1-809d-9b442bc58e63 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:31.852372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a9cfe-1bdb-49e1-809d-9b442bc58e63 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:31.871110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93237b-8d27-47cf-9f33-60285acb9790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:31.872808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93237b-8d27-47cf-9f33-60285acb9790 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:31.873116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93237b-8d27-47cf-9f33-60285acb9790 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:31.873374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93237b-8d27-47cf-9f33-60285acb9790 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:31.874713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93237b-8d27-47cf-9f33-60285acb9790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:31.876743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93237b-8d27-47cf-9f33-60285acb9790 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:31.903536 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2812/5694] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:28:31.907807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae141b91-3be2-462e-a080-3934d970df41 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:31.922457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae141b91-3be2-462e-a080-3934d970df41 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:31.937637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97835ea8-090f-4494-83bd-b26fa8c10686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:31.938513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97835ea8-090f-4494-83bd-b26fa8c10686 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:31.938794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97835ea8-090f-4494-83bd-b26fa8c10686 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:31.939112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97835ea8-090f-4494-83bd-b26fa8c10686 admin admin] PATH_INFO: `/v3/projects/bed7c94624484c7cb8abeb3bfc8757b9/users/4ddfae3448704591b662de83b97a1876/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:31.970942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97835ea8-090f-4494-83bd-b26fa8c10686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bed7c94624484c7cb8abeb3bfc8757b9, user_id=4ddfae3448704591b662de83b97a1876, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:31.976719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97835ea8-090f-4494-83bd-b26fa8c10686 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:32.095581 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2883/5695] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:28:31 2022] PUT /identity/v3/projects/bed7c94624484c7cb8abeb3bfc8757b9/users/4ddfae3448704591b662de83b97a1876/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:28:32.106015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb80ad-6ef3-4c1b-8e43-12bed58c963c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:32.106341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb80ad-6ef3-4c1b-8e43-12bed58c963c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:32.106631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb80ad-6ef3-4c1b-8e43-12bed58c963c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:32.165005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-fefb80ad-6ef3-4c1b-8e43-12bed58c963c None None] MFA Rules not processed for user `4ddfae3448704591b662de83b97a1876`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:32.166640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fefb80ad-6ef3-4c1b-8e43-12bed58c963c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:32.342911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97835ea8-090f-4494-83bd-b26fa8c10686 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:32.343868 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2813/5696] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:32.521589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97835ea8-090f-4494-83bd-b26fa8c10686 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:32.525217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89154964-2b38-490f-8d39-77c89229e75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:32.528153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89154964-2b38-490f-8d39-77c89229e75f admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:32.528659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89154964-2b38-490f-8d39-77c89229e75f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:32.529199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89154964-2b38-490f-8d39-77c89229e75f admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:32.531957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89154964-2b38-490f-8d39-77c89229e75f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:32.534627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89154964-2b38-490f-8d39-77c89229e75f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:32.553325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:32.660122 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2884/5697] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:28:32 2022] POST /identity/v3/projects => generated 375 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:28:32.665470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb80ad-6ef3-4c1b-8e43-12bed58c963c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:32.684631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb80ad-6ef3-4c1b-8e43-12bed58c963c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:32.875899 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c58ead-7384-474c-b3fe-34c500868b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:32.879238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c58ead-7384-474c-b3fe-34c500868b89 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:32.879238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c58ead-7384-474c-b3fe-34c500868b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:32.879238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c58ead-7384-474c-b3fe-34c500868b89 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:32.879238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c58ead-7384-474c-b3fe-34c500868b89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:32.884760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c58ead-7384-474c-b3fe-34c500868b89 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:33.014877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89154964-2b38-490f-8d39-77c89229e75f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:33.025416 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2814/5698] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:28:32 2022] POST /identity/v3/users => generated 294 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:28:33.032921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89154964-2b38-490f-8d39-77c89229e75f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:33.042248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521cb3c-b17f-4e47-874c-fbc96cd4477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:33.043102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521cb3c-b17f-4e47-874c-fbc96cd4477e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:33.043470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521cb3c-b17f-4e47-874c-fbc96cd4477e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:33.044670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521cb3c-b17f-4e47-874c-fbc96cd4477e admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:33.046772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521cb3c-b17f-4e47-874c-fbc96cd4477e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:33.049397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521cb3c-b17f-4e47-874c-fbc96cd4477e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:33.084202 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2885/5699] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:28:33.089033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c58ead-7384-474c-b3fe-34c500868b89 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:33.104091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c58ead-7384-474c-b3fe-34c500868b89 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:33.115649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8480072-5033-468b-a200-c935f0e91b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:33.116966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8480072-5033-468b-a200-c935f0e91b7a admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:33.116966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8480072-5033-468b-a200-c935f0e91b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:33.117170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8480072-5033-468b-a200-c935f0e91b7a admin admin] PATH_INFO: `/v3/projects/db44b6fa072a42b688c7ca77cc51856b/users/e91db1cb21c14af69597f34b4ea1e41e/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:33.157629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8480072-5033-468b-a200-c935f0e91b7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=db44b6fa072a42b688c7ca77cc51856b, user_id=e91db1cb21c14af69597f34b4ea1e41e, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:33.164227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8480072-5033-468b-a200-c935f0e91b7a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:33.277341 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2815/5700] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:28:33 2022] PUT /identity/v3/projects/db44b6fa072a42b688c7ca77cc51856b/users/e91db1cb21c14af69597f34b4ea1e41e/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:28:33.283714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521cb3c-b17f-4e47-874c-fbc96cd4477e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:33.303683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521cb3c-b17f-4e47-874c-fbc96cd4477e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:33.476257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d7919-8e58-4af2-a370-05afb5f18588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:33.481831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d7919-8e58-4af2-a370-05afb5f18588 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:33.481831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d7919-8e58-4af2-a370-05afb5f18588 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:33.481831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d7919-8e58-4af2-a370-05afb5f18588 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:33.481831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d7919-8e58-4af2-a370-05afb5f18588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:33.481831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d7919-8e58-4af2-a370-05afb5f18588 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:33.496043 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2886/5701] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:28:33.500267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8480072-5033-468b-a200-c935f0e91b7a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:33.516849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8480072-5033-468b-a200-c935f0e91b7a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:33.523851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df4772-97fe-4603-b10e-d5db7588e69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:33.525047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df4772-97fe-4603-b10e-d5db7588e69c admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:33.525338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df4772-97fe-4603-b10e-d5db7588e69c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:33.525622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df4772-97fe-4603-b10e-d5db7588e69c admin admin] PATH_INFO: `/v3/projects/db44b6fa072a42b688c7ca77cc51856b/users/e91db1cb21c14af69597f34b4ea1e41e/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:33.543757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df4772-97fe-4603-b10e-d5db7588e69c admin admin] RBAC: Authorizing `identity:create_grant(project_id=db44b6fa072a42b688c7ca77cc51856b, user_id=e91db1cb21c14af69597f34b4ea1e41e, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:33.547138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df4772-97fe-4603-b10e-d5db7588e69c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:33.590819 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2816/5702] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:28:33 2022] PUT /identity/v3/projects/db44b6fa072a42b688c7ca77cc51856b/users/e91db1cb21c14af69597f34b4ea1e41e/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:28:33.592315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7440d-32c9-4aa3-be91-ef08a885b607 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:33.593737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7440d-32c9-4aa3-be91-ef08a885b607 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:33.594819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7440d-32c9-4aa3-be91-ef08a885b607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:33.684305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-18d7440d-32c9-4aa3-be91-ef08a885b607 None None] MFA Rules not processed for user `e91db1cb21c14af69597f34b4ea1e41e`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:33.687432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-18d7440d-32c9-4aa3-be91-ef08a885b607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:33.896042 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2887/5703] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:33.911392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df4772-97fe-4603-b10e-d5db7588e69c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:33.915928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d0df4772-97fe-4603-b10e-d5db7588e69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:34.000365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887757c4-e39e-426d-81db-30ef588ecc55 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:34.000781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887757c4-e39e-426d-81db-30ef588ecc55 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:34.001166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887757c4-e39e-426d-81db-30ef588ecc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:34.038796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df4772-97fe-4603-b10e-d5db7588e69c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:34.042857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35340bdf-3e0e-4b34-b549-a5841e3edc6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:34.043573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35340bdf-3e0e-4b34-b549-a5841e3edc6b service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:34.043859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35340bdf-3e0e-4b34-b549-a5841e3edc6b service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:34.044286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35340bdf-3e0e-4b34-b549-a5841e3edc6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:34.066971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-887757c4-e39e-426d-81db-30ef588ecc55 None None] MFA Rules not processed for user `a27b3e9973c846c68f25f7981c995b73`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:34.068856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-887757c4-e39e-426d-81db-30ef588ecc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:34.157656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:34.193622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35340bdf-3e0e-4b34-b549-a5841e3edc6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:34.198033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35340bdf-3e0e-4b34-b549-a5841e3edc6b service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:34.200504 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2888/5704] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:34.274741 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2817/5705] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:28:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:28:34.299404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37977682-4709-4916-830b-93c236462e18 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:34.299781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37977682-4709-4916-830b-93c236462e18 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:34.300070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37977682-4709-4916-830b-93c236462e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:34.326273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-37977682-4709-4916-830b-93c236462e18 None None] MFA Rules not processed for user `a27b3e9973c846c68f25f7981c995b73`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:34.335773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-37977682-4709-4916-830b-93c236462e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:34.348173 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2889/5706] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:34.542746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35340bdf-3e0e-4b34-b549-a5841e3edc6b service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:34.548821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-35340bdf-3e0e-4b34-b549-a5841e3edc6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:34.665216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35340bdf-3e0e-4b34-b549-a5841e3edc6b service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:34.673463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb4651-3e62-491b-82a4-b6e9fc36e3c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:34.674233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb4651-3e62-491b-82a4-b6e9fc36e3c9 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:34.674578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb4651-3e62-491b-82a4-b6e9fc36e3c9 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:34.674923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb4651-3e62-491b-82a4-b6e9fc36e3c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:34.683728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb4651-3e62-491b-82a4-b6e9fc36e3c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:34.685429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb4651-3e62-491b-82a4-b6e9fc36e3c9 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:34.704118 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2818/5707] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:28:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:28:35.318396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:39.088200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37977682-4709-4916-830b-93c236462e18 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:39.102140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37977682-4709-4916-830b-93c236462e18 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:39.105989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc9220-71e0-4d28-9986-d9b1df22b9c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:39.109712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc9220-71e0-4d28-9986-d9b1df22b9c1 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:39.109712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc9220-71e0-4d28-9986-d9b1df22b9c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:39.109712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc9220-71e0-4d28-9986-d9b1df22b9c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:39.119375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc9220-71e0-4d28-9986-d9b1df22b9c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:39.120675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc9220-71e0-4d28-9986-d9b1df22b9c1 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:39.133677 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2890/5708] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:28:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:28:41.273965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb4651-3e62-491b-82a4-b6e9fc36e3c9 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:41.301813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb4651-3e62-491b-82a4-b6e9fc36e3c9 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:41.318482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4b72e-1d33-48f5-b261-c305aa7b157f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:41.319850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4b72e-1d33-48f5-b261-c305aa7b157f service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:41.321186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4b72e-1d33-48f5-b261-c305aa7b157f service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:41.321472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4b72e-1d33-48f5-b261-c305aa7b157f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:41.328083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c4a4b72e-1d33-48f5-b261-c305aa7b157f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:41.342012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:41.466711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4b72e-1d33-48f5-b261-c305aa7b157f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:41.469451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4b72e-1d33-48f5-b261-c305aa7b157f service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:41.497355 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2819/5709] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:28:49.127821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=13 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:52.159903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc9220-71e0-4d28-9986-d9b1df22b9c1 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:52.162239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-26cc9220-71e0-4d28-9986-d9b1df22b9c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:52.200520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc9220-71e0-4d28-9986-d9b1df22b9c1 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:52.207048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4b6ea-d4f9-4151-9a72-8f7792a64a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:52.208208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4b6ea-d4f9-4151-9a72-8f7792a64a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:52.216617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4b6ea-d4f9-4151-9a72-8f7792a64a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:52.218131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4b6ea-d4f9-4151-9a72-8f7792a64a03 admin admin] PATH_INFO: `/v3/users/bcc9aa2a091c490599f9a9c41163e2eb` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:52.220345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4b6ea-d4f9-4151-9a72-8f7792a64a03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc9aa2a091c490599f9a9c41163e2eb)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:52.222970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4b72e-1d33-48f5-b261-c305aa7b157f service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:52.225150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c4a4b72e-1d33-48f5-b261-c305aa7b157f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:52.236762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4b6ea-d4f9-4151-9a72-8f7792a64a03 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:52.247070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4b72e-1d33-48f5-b261-c305aa7b157f service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:52.259078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1242d-241f-4175-8331-f30a5bbfbed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:52.261492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1242d-241f-4175-8331-f30a5bbfbed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:52.261800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1242d-241f-4175-8331-f30a5bbfbed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:52.262154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1242d-241f-4175-8331-f30a5bbfbed3 admin admin] PATH_INFO: `/v3/users/0f14ac04b7a44f17b946c5c8619554ad` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:52.264323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1242d-241f-4175-8331-f30a5bbfbed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f14ac04b7a44f17b946c5c8619554ad)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:52.267146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1242d-241f-4175-8331-f30a5bbfbed3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:52.543630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8de4b6ea-d4f9-4151-9a72-8f7792a64a03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc9aa2a091c490599f9a9c41163e2eb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:52.596801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8de4b6ea-d4f9-4151-9a72-8f7792a64a03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc9aa2a091c490599f9a9c41163e2eb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:52.600273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ccc1242d-241f-4175-8331-f30a5bbfbed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f14ac04b7a44f17b946c5c8619554ad'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:52.646962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ccc1242d-241f-4175-8331-f30a5bbfbed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f14ac04b7a44f17b946c5c8619554ad'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:52.742121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8de4b6ea-d4f9-4151-9a72-8f7792a64a03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc9aa2a091c490599f9a9c41163e2eb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:52.742786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8de4b6ea-d4f9-4151-9a72-8f7792a64a03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc9aa2a091c490599f9a9c41163e2eb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:52.771435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8de4b6ea-d4f9-4151-9a72-8f7792a64a03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc9aa2a091c490599f9a9c41163e2eb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:52.786380 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2891/5710] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:28:52 2022] DELETE /identity/v3/users/bcc9aa2a091c490599f9a9c41163e2eb => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:28:52.787822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4b6ea-d4f9-4151-9a72-8f7792a64a03 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:52.789486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8de4b6ea-d4f9-4151-9a72-8f7792a64a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:52.841397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ccc1242d-241f-4175-8331-f30a5bbfbed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f14ac04b7a44f17b946c5c8619554ad'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:52.852425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ccc1242d-241f-4175-8331-f30a5bbfbed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f14ac04b7a44f17b946c5c8619554ad'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:52.853866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ccc1242d-241f-4175-8331-f30a5bbfbed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f14ac04b7a44f17b946c5c8619554ad'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:52.884496 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2820/5711] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:28:52 2022] DELETE /identity/v3/users/0f14ac04b7a44f17b946c5c8619554ad => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:28:52.889986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc3363-9e9d-4bd2-b30b-286319460225 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:52.890265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc3363-9e9d-4bd2-b30b-286319460225 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:52.890540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc3363-9e9d-4bd2-b30b-286319460225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:52.935243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1abc3363-9e9d-4bd2-b30b-286319460225 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:52.937118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1abc3363-9e9d-4bd2-b30b-286319460225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:52.946408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4b6ea-d4f9-4151-9a72-8f7792a64a03 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:53.069322 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2821/5712] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:53.101732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc3363-9e9d-4bd2-b30b-286319460225 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:53.108146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1abc3363-9e9d-4bd2-b30b-286319460225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:53.130251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda7f25-f79a-490e-9945-6c767d320679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:53.132125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda7f25-f79a-490e-9945-6c767d320679 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:53.134534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda7f25-f79a-490e-9945-6c767d320679 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:53.135993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda7f25-f79a-490e-9945-6c767d320679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:53.142165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-afda7f25-f79a-490e-9945-6c767d320679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:53.152505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:53.182724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda7f25-f79a-490e-9945-6c767d320679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:53.186665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda7f25-f79a-490e-9945-6c767d320679 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:53.238502 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2892/5713] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:28:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:28:53.277668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc3363-9e9d-4bd2-b30b-286319460225 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:53.291352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d1ccf-a403-40a9-9b35-73a1fe8d0f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:53.292278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d1ccf-a403-40a9-9b35-73a1fe8d0f34 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:53.292797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d1ccf-a403-40a9-9b35-73a1fe8d0f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:53.293414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d1ccf-a403-40a9-9b35-73a1fe8d0f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:53.313106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d1ccf-a403-40a9-9b35-73a1fe8d0f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:53.314910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d1ccf-a403-40a9-9b35-73a1fe8d0f34 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:53.341199 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2822/5714] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:28:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:28:53.354394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda7f25-f79a-490e-9945-6c767d320679 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:53.356320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-afda7f25-f79a-490e-9945-6c767d320679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:53.402438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda7f25-f79a-490e-9945-6c767d320679 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:53.417131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed37b8d-f576-4d87-81da-c9bf4671fd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:53.418407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed37b8d-f576-4d87-81da-c9bf4671fd54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:53.418935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed37b8d-f576-4d87-81da-c9bf4671fd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:53.424796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed37b8d-f576-4d87-81da-c9bf4671fd54 admin admin] PATH_INFO: `/v3/projects/da56fc78f06142aba80ca4c6e3d60475` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:53.424796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed37b8d-f576-4d87-81da-c9bf4671fd54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da56fc78f06142aba80ca4c6e3d60475)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:53.424796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed37b8d-f576-4d87-81da-c9bf4671fd54 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:53.582469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:53.610386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7ed37b8d-f576-4d87-81da-c9bf4671fd54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da56fc78f06142aba80ca4c6e3d60475', 'request_id': 'req-7ed37b8d-f576-4d87-81da-c9bf4671fd54'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:53.620031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7ed37b8d-f576-4d87-81da-c9bf4671fd54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da56fc78f06142aba80ca4c6e3d60475', 'request_id': 'req-7ed37b8d-f576-4d87-81da-c9bf4671fd54'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:53.628991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7ed37b8d-f576-4d87-81da-c9bf4671fd54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da56fc78f06142aba80ca4c6e3d60475', 'request_id': 'req-7ed37b8d-f576-4d87-81da-c9bf4671fd54'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:53.781275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7ed37b8d-f576-4d87-81da-c9bf4671fd54 admin admin] The token cache is being invalidate because project da56fc78f06142aba80ca4c6e3d60475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:28:53.781569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7ed37b8d-f576-4d87-81da-c9bf4671fd54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:53.783337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7ed37b8d-f576-4d87-81da-c9bf4671fd54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:53.784949 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2893/5715] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:28:53 2022] DELETE /identity/v3/projects/da56fc78f06142aba80ca4c6e3d60475 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:28:53.790292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48090762-1f2c-48bf-bba7-22182d844b2a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:53.790902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48090762-1f2c-48bf-bba7-22182d844b2a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:53.791211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48090762-1f2c-48bf-bba7-22182d844b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:53.819251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-48090762-1f2c-48bf-bba7-22182d844b2a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:53.821032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-48090762-1f2c-48bf-bba7-22182d844b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:53.938080 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2823/5716] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:53.947081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14124a-7623-4c83-8db6-301fd5e2334f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:53.947431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14124a-7623-4c83-8db6-301fd5e2334f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:53.947715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14124a-7623-4c83-8db6-301fd5e2334f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:53.981169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4b14124a-7623-4c83-8db6-301fd5e2334f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:53.987293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4b14124a-7623-4c83-8db6-301fd5e2334f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:53.996551 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2894/5717] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:54.001695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48090762-1f2c-48bf-bba7-22182d844b2a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:54.014540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48090762-1f2c-48bf-bba7-22182d844b2a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:54.021696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a232ab-f7d0-4311-9e12-f6c8e14f4288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:54.022787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a232ab-f7d0-4311-9e12-f6c8e14f4288 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:54.023087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a232ab-f7d0-4311-9e12-f6c8e14f4288 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:54.023466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a232ab-f7d0-4311-9e12-f6c8e14f4288 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:54.025512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a232ab-f7d0-4311-9e12-f6c8e14f4288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:28:54.025896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a232ab-f7d0-4311-9e12-f6c8e14f4288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:54.028090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a232ab-f7d0-4311-9e12-f6c8e14f4288 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:54.053678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14124a-7623-4c83-8db6-301fd5e2334f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:54.077608 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2824/5718] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:28:54.081325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14124a-7623-4c83-8db6-301fd5e2334f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:54.088058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9137ef-3c27-4d9a-b32d-0607d4eb200b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:54.088941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9137ef-3c27-4d9a-b32d-0607d4eb200b admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:54.089377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9137ef-3c27-4d9a-b32d-0607d4eb200b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:54.089827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9137ef-3c27-4d9a-b32d-0607d4eb200b admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:54.090745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9137ef-3c27-4d9a-b32d-0607d4eb200b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:54.093825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9137ef-3c27-4d9a-b32d-0607d4eb200b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:54.148907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a232ab-f7d0-4311-9e12-f6c8e14f4288 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:54.151339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-88a232ab-f7d0-4311-9e12-f6c8e14f4288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:54.175293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a232ab-f7d0-4311-9e12-f6c8e14f4288 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:54.181059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8c50c-d74c-4ea7-9afb-956ab3102e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:54.182292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8c50c-d74c-4ea7-9afb-956ab3102e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:54.182432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8c50c-d74c-4ea7-9afb-956ab3102e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:54.182610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8c50c-d74c-4ea7-9afb-956ab3102e88 admin admin] PATH_INFO: `/v3/projects/349811967f4b4d1a9ab6772602a205a6` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:54.184097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8c50c-d74c-4ea7-9afb-956ab3102e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=349811967f4b4d1a9ab6772602a205a6)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:54.187365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8c50c-d74c-4ea7-9afb-956ab3102e88 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:54.234159 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2895/5719] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:28:54 2022] POST /identity/v3/projects => generated 371 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:28:54.237118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9137ef-3c27-4d9a-b32d-0607d4eb200b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:54.319020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9137ef-3c27-4d9a-b32d-0607d4eb200b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:54.323950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea18d1f-1b07-4dd0-b8a3-e55ad3242a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:54.324620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea18d1f-1b07-4dd0-b8a3-e55ad3242a79 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:54.324906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea18d1f-1b07-4dd0-b8a3-e55ad3242a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:54.325179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea18d1f-1b07-4dd0-b8a3-e55ad3242a79 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:54.326386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea18d1f-1b07-4dd0-b8a3-e55ad3242a79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:54.328977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea18d1f-1b07-4dd0-b8a3-e55ad3242a79 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:54.404078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-11f8c50c-d74c-4ea7-9afb-956ab3102e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '349811967f4b4d1a9ab6772602a205a6', 'request_id': 'req-11f8c50c-d74c-4ea7-9afb-956ab3102e88'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:54.412338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-11f8c50c-d74c-4ea7-9afb-956ab3102e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '349811967f4b4d1a9ab6772602a205a6', 'request_id': 'req-11f8c50c-d74c-4ea7-9afb-956ab3102e88'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:54.419836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-11f8c50c-d74c-4ea7-9afb-956ab3102e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '349811967f4b4d1a9ab6772602a205a6', 'request_id': 'req-11f8c50c-d74c-4ea7-9afb-956ab3102e88'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:54.453927 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2896/5720] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:28:54 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:28:54.457147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea18d1f-1b07-4dd0-b8a3-e55ad3242a79 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:54.471776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea18d1f-1b07-4dd0-b8a3-e55ad3242a79 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:54.518166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-11f8c50c-d74c-4ea7-9afb-956ab3102e88 admin admin] The token cache is being invalidate because project 349811967f4b4d1a9ab6772602a205a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:28:54.518458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-11f8c50c-d74c-4ea7-9afb-956ab3102e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:54.519395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-11f8c50c-d74c-4ea7-9afb-956ab3102e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:54.523382 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2825/5721] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:28:54 2022] DELETE /identity/v3/projects/349811967f4b4d1a9ab6772602a205a6 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:28:54.528501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4cb91-cc0e-4cee-8276-be036a407ff8 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:54.529566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4cb91-cc0e-4cee-8276-be036a407ff8 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:54.531594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4cb91-cc0e-4cee-8276-be036a407ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:54.545834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b875036-3d5f-44d1-93e9-1d4652c28fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:54.546577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b875036-3d5f-44d1-93e9-1d4652c28fad admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:54.546867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b875036-3d5f-44d1-93e9-1d4652c28fad admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:54.547633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b875036-3d5f-44d1-93e9-1d4652c28fad admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:54.548397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b875036-3d5f-44d1-93e9-1d4652c28fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:54.551882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b875036-3d5f-44d1-93e9-1d4652c28fad admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:54.568001 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2897/5722] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:28:54.571265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-59b4cb91-cc0e-4cee-8276-be036a407ff8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:54.571265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-59b4cb91-cc0e-4cee-8276-be036a407ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:54.572783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b875036-3d5f-44d1-93e9-1d4652c28fad admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:54.575180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4b875036-3d5f-44d1-93e9-1d4652c28fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:54.582094 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2826/5723] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:54.596293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b875036-3d5f-44d1-93e9-1d4652c28fad admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:54.599501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410f1c5-3627-4d1c-9f72-86250d55bc7f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:54.600600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410f1c5-3627-4d1c-9f72-86250d55bc7f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:54.601744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410f1c5-3627-4d1c-9f72-86250d55bc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:54.602102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2a498-dd32-47dd-943e-85c9114b86f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:54.603472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2a498-dd32-47dd-943e-85c9114b86f2 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:54.603763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2a498-dd32-47dd-943e-85c9114b86f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:54.604629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2a498-dd32-47dd-943e-85c9114b86f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:54.604949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2a498-dd32-47dd-943e-85c9114b86f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:54.606944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2a498-dd32-47dd-943e-85c9114b86f2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:54.628643 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2898/5724] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:28:54.630468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2a498-dd32-47dd-943e-85c9114b86f2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:54.645607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b410f1c5-3627-4d1c-9f72-86250d55bc7f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:54.647748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b410f1c5-3627-4d1c-9f72-86250d55bc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:54.652090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2a498-dd32-47dd-943e-85c9114b86f2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:54.665631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff8551-b384-4638-af45-5f458b2d4ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:54.666544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff8551-b384-4638-af45-5f458b2d4ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:54.666849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff8551-b384-4638-af45-5f458b2d4ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:54.667152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff8551-b384-4638-af45-5f458b2d4ed1 admin admin] PATH_INFO: `/v3/projects/3c6f089da37e4ff09784a2b42513ff36/users/af0cd3652c8d42bcb8af08852ff4f203/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:54.673276 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2827/5725] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:54.677596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410f1c5-3627-4d1c-9f72-86250d55bc7f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:54.694638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410f1c5-3627-4d1c-9f72-86250d55bc7f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:54.703288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff8551-b384-4638-af45-5f458b2d4ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c6f089da37e4ff09784a2b42513ff36, user_id=af0cd3652c8d42bcb8af08852ff4f203, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:54.712598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff8551-b384-4638-af45-5f458b2d4ed1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:54.715861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63942829-7aac-4f2b-ac19-a37192c88a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:54.716759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63942829-7aac-4f2b-ac19-a37192c88a2d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:54.717823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63942829-7aac-4f2b-ac19-a37192c88a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:54.719792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63942829-7aac-4f2b-ac19-a37192c88a2d admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:54.721084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63942829-7aac-4f2b-ac19-a37192c88a2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:28:54.722488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63942829-7aac-4f2b-ac19-a37192c88a2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:54.724779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63942829-7aac-4f2b-ac19-a37192c88a2d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:54.740342 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2828/5726] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:28:54.746143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63942829-7aac-4f2b-ac19-a37192c88a2d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:54.760582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63942829-7aac-4f2b-ac19-a37192c88a2d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:54.766388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97bc62-768c-4c17-9950-e5df0334ac00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:54.767168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97bc62-768c-4c17-9950-e5df0334ac00 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:54.767453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97bc62-768c-4c17-9950-e5df0334ac00 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:54.768238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97bc62-768c-4c17-9950-e5df0334ac00 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:54.769314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97bc62-768c-4c17-9950-e5df0334ac00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:54.771921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97bc62-768c-4c17-9950-e5df0334ac00 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:54.808355 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2899/5727] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:28:54 2022] PUT /identity/v3/projects/3c6f089da37e4ff09784a2b42513ff36/users/af0cd3652c8d42bcb8af08852ff4f203/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:28:54.821004 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a790d-299e-4a3d-b2eb-36e89af555a6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:54.821532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a790d-299e-4a3d-b2eb-36e89af555a6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:54.821989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a790d-299e-4a3d-b2eb-36e89af555a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:54.904299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c73a790d-299e-4a3d-b2eb-36e89af555a6 None None] MFA Rules not processed for user `af0cd3652c8d42bcb8af08852ff4f203`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:54.908062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c73a790d-299e-4a3d-b2eb-36e89af555a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:54.980886 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2829/5728] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:28:54 2022] POST /identity/v3/projects => generated 363 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:28:54.985521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97bc62-768c-4c17-9950-e5df0334ac00 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:55.066407 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2900/5729] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:28:55.076766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de6400-85e6-40a7-99e0-9544e7e1e58d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:55.080478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de6400-85e6-40a7-99e0-9544e7e1e58d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:55.080478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de6400-85e6-40a7-99e0-9544e7e1e58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:55.094613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97bc62-768c-4c17-9950-e5df0334ac00 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:55.100177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96da083-b66f-4d5e-af62-cd0f9728eeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:55.100857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96da083-b66f-4d5e-af62-cd0f9728eeac admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:55.101143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96da083-b66f-4d5e-af62-cd0f9728eeac admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:55.101425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96da083-b66f-4d5e-af62-cd0f9728eeac admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:55.102198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96da083-b66f-4d5e-af62-cd0f9728eeac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:55.102785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e7de6400-85e6-40a7-99e0-9544e7e1e58d None None] MFA Rules not processed for user `af0cd3652c8d42bcb8af08852ff4f203`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:55.104041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e7de6400-85e6-40a7-99e0-9544e7e1e58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:55.104156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96da083-b66f-4d5e-af62-cd0f9728eeac admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:55.173660 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2901/5730] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:28:55.182096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de6400-85e6-40a7-99e0-9544e7e1e58d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:55.188825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e7de6400-85e6-40a7-99e0-9544e7e1e58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:55.229640 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2830/5731] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:28:54 2022] POST /identity/v3/users => generated 282 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:28:55.242578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96da083-b66f-4d5e-af62-cd0f9728eeac admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:55.265319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96da083-b66f-4d5e-af62-cd0f9728eeac admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:55.271807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffdb38-10f1-425b-b9f3-0f909034b881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:55.272671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffdb38-10f1-425b-b9f3-0f909034b881 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:55.273122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffdb38-10f1-425b-b9f3-0f909034b881 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:55.273595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffdb38-10f1-425b-b9f3-0f909034b881 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:55.274490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffdb38-10f1-425b-b9f3-0f909034b881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:55.276513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffdb38-10f1-425b-b9f3-0f909034b881 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:55.288964 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2831/5732] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:28:55.293725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffdb38-10f1-425b-b9f3-0f909034b881 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:55.293893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de6400-85e6-40a7-99e0-9544e7e1e58d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:55.301013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048252d-07df-44e8-891f-2055cd9ada15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:55.301815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048252d-07df-44e8-891f-2055cd9ada15 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:55.303049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048252d-07df-44e8-891f-2055cd9ada15 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:55.303049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048252d-07df-44e8-891f-2055cd9ada15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:55.309961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffdb38-10f1-425b-b9f3-0f909034b881 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:55.315393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048252d-07df-44e8-891f-2055cd9ada15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:55.316495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048252d-07df-44e8-891f-2055cd9ada15 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:55.318866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3beb665-ff34-42da-b3e5-c939cd53d1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:55.319627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3beb665-ff34-42da-b3e5-c939cd53d1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:55.319916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3beb665-ff34-42da-b3e5-c939cd53d1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:55.320212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3beb665-ff34-42da-b3e5-c939cd53d1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:55.321598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3beb665-ff34-42da-b3e5-c939cd53d1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:55.323673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3beb665-ff34-42da-b3e5-c939cd53d1c9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:55.328165 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2902/5733] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:28:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:28:55.338775 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2832/5734] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:28:55.344977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048252d-07df-44e8-891f-2055cd9ada15 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:55.359240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048252d-07df-44e8-891f-2055cd9ada15 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:55.371434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8331e1-9b7f-472e-ad5b-33bfbfec8d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:55.371434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8331e1-9b7f-472e-ad5b-33bfbfec8d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:55.371434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8331e1-9b7f-472e-ad5b-33bfbfec8d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:55.371434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8331e1-9b7f-472e-ad5b-33bfbfec8d03 admin admin] PATH_INFO: `/v3/projects/fa907c34d1a345aebfae7765cc3187fb/users/da974d4cc6f34be4b11fb970f0bc0214/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:55.377555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d1ba0-3006-4f23-b5f9-e12bd30136f0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:55.377857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d1ba0-3006-4f23-b5f9-e12bd30136f0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:55.378707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d1ba0-3006-4f23-b5f9-e12bd30136f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:55.395843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8331e1-9b7f-472e-ad5b-33bfbfec8d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa907c34d1a345aebfae7765cc3187fb, user_id=da974d4cc6f34be4b11fb970f0bc0214, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:55.399002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8331e1-9b7f-472e-ad5b-33bfbfec8d03 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:55.399770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-743d1ba0-3006-4f23-b5f9-e12bd30136f0 None None] MFA Rules not processed for user `4ddfae3448704591b662de83b97a1876`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:55.401192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-743d1ba0-3006-4f23-b5f9-e12bd30136f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:55.451445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:55.465944 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2833/5735] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:55.512320 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2903/5736] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:28:55 2022] PUT /identity/v3/projects/fa907c34d1a345aebfae7765cc3187fb/users/da974d4cc6f34be4b11fb970f0bc0214/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:28:55.518777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fc647-6aa8-43e3-8342-192be6f1b33b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:55.519312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fc647-6aa8-43e3-8342-192be6f1b33b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:55.519763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fc647-6aa8-43e3-8342-192be6f1b33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:55.561171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-183fc647-6aa8-43e3-8342-192be6f1b33b None None] MFA Rules not processed for user `da974d4cc6f34be4b11fb970f0bc0214`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:55.562600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-183fc647-6aa8-43e3-8342-192be6f1b33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:55.645526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8331e1-9b7f-472e-ad5b-33bfbfec8d03 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:55.650227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3e8331e1-9b7f-472e-ad5b-33bfbfec8d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:55.687587 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2834/5737] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:55.755414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:55.758563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fc647-6aa8-43e3-8342-192be6f1b33b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:55.798027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8331e1-9b7f-472e-ad5b-33bfbfec8d03 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:55.804515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8340d22-4b39-4f7b-9f1d-f6c73eec6775 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:55.805317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8340d22-4b39-4f7b-9f1d-f6c73eec6775 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:55.805866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8340d22-4b39-4f7b-9f1d-f6c73eec6775 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:55.806462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8340d22-4b39-4f7b-9f1d-f6c73eec6775 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:55.808708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b8340d22-4b39-4f7b-9f1d-f6c73eec6775 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:55.853913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8340d22-4b39-4f7b-9f1d-f6c73eec6775 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:55.860149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8340d22-4b39-4f7b-9f1d-f6c73eec6775 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:55.886820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fc647-6aa8-43e3-8342-192be6f1b33b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:55.894326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3708d21-6c58-4f5a-935b-2d9cb721cd06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:55.896453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3708d21-6c58-4f5a-935b-2d9cb721cd06 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:55.896572 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2904/5738] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:28:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:28:55.896680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3708d21-6c58-4f5a-935b-2d9cb721cd06 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:55.896680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3708d21-6c58-4f5a-935b-2d9cb721cd06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:55.910985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3708d21-6c58-4f5a-935b-2d9cb721cd06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:55.912998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3708d21-6c58-4f5a-935b-2d9cb721cd06 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:55.934430 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2835/5739] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:28:55 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:28:55.984143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8340d22-4b39-4f7b-9f1d-f6c73eec6775 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:56.094928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8340d22-4b39-4f7b-9f1d-f6c73eec6775 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:56.101946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfd7a1-0066-49c4-89a2-dab25aea8fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:56.103295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfd7a1-0066-49c4-89a2-dab25aea8fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:56.103712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfd7a1-0066-49c4-89a2-dab25aea8fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:56.106933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfd7a1-0066-49c4-89a2-dab25aea8fb8 admin admin] PATH_INFO: `/v3/users/da974d4cc6f34be4b11fb970f0bc0214` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:56.110755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfd7a1-0066-49c4-89a2-dab25aea8fb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da974d4cc6f34be4b11fb970f0bc0214)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:56.122591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfd7a1-0066-49c4-89a2-dab25aea8fb8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:56.298378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eecfd7a1-0066-49c4-89a2-dab25aea8fb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da974d4cc6f34be4b11fb970f0bc0214'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:56.322813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eecfd7a1-0066-49c4-89a2-dab25aea8fb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da974d4cc6f34be4b11fb970f0bc0214'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:56.479239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eecfd7a1-0066-49c4-89a2-dab25aea8fb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da974d4cc6f34be4b11fb970f0bc0214'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:56.479239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eecfd7a1-0066-49c4-89a2-dab25aea8fb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da974d4cc6f34be4b11fb970f0bc0214'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:56.500809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eecfd7a1-0066-49c4-89a2-dab25aea8fb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da974d4cc6f34be4b11fb970f0bc0214'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:56.514289 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2905/5740] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:28:55 2022] DELETE /identity/v3/users/da974d4cc6f34be4b11fb970f0bc0214 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:28:56.518950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9669b9c-a001-4991-86d5-786363d9cdaa None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:56.519458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9669b9c-a001-4991-86d5-786363d9cdaa None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:56.519549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9669b9c-a001-4991-86d5-786363d9cdaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:56.556291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e9669b9c-a001-4991-86d5-786363d9cdaa None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:56.558479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e9669b9c-a001-4991-86d5-786363d9cdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:56.675839 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2836/5741] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:56.686479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfd7a1-0066-49c4-89a2-dab25aea8fb8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:56.688387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-eecfd7a1-0066-49c4-89a2-dab25aea8fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:56.794673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfd7a1-0066-49c4-89a2-dab25aea8fb8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:56.804252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45603ce9-c068-4f4d-84ff-ac0d4d2aaaab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:56.805327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45603ce9-c068-4f4d-84ff-ac0d4d2aaaab service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:56.805327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45603ce9-c068-4f4d-84ff-ac0d4d2aaaab service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:56.805507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45603ce9-c068-4f4d-84ff-ac0d4d2aaaab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:56.816880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45603ce9-c068-4f4d-84ff-ac0d4d2aaaab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:56.818356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45603ce9-c068-4f4d-84ff-ac0d4d2aaaab service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:56.838443 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2906/5742] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:28:57.459830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:57.587682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9669b9c-a001-4991-86d5-786363d9cdaa None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:57.589911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e9669b9c-a001-4991-86d5-786363d9cdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:57.623924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9669b9c-a001-4991-86d5-786363d9cdaa None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:57.631170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac57458-0add-4956-b865-2a19a3c11661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:57.632244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac57458-0add-4956-b865-2a19a3c11661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:57.632688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac57458-0add-4956-b865-2a19a3c11661 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:57.632967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac57458-0add-4956-b865-2a19a3c11661 admin admin] PATH_INFO: `/v3/projects/fa907c34d1a345aebfae7765cc3187fb` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:57.635880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac57458-0add-4956-b865-2a19a3c11661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa907c34d1a345aebfae7765cc3187fb)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:57.644692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac57458-0add-4956-b865-2a19a3c11661 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:57.836589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0ac57458-0add-4956-b865-2a19a3c11661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa907c34d1a345aebfae7765cc3187fb', 'request_id': 'req-0ac57458-0add-4956-b865-2a19a3c11661'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:57.843505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0ac57458-0add-4956-b865-2a19a3c11661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa907c34d1a345aebfae7765cc3187fb', 'request_id': 'req-0ac57458-0add-4956-b865-2a19a3c11661'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:57.850363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0ac57458-0add-4956-b865-2a19a3c11661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa907c34d1a345aebfae7765cc3187fb', 'request_id': 'req-0ac57458-0add-4956-b865-2a19a3c11661'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:57.952809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0ac57458-0add-4956-b865-2a19a3c11661 admin admin] The token cache is being invalidate because project fa907c34d1a345aebfae7765cc3187fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:28:57.956521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0ac57458-0add-4956-b865-2a19a3c11661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:57.956521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0ac57458-0add-4956-b865-2a19a3c11661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:28:57.960307 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2837/5743] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:28:57 2022] DELETE /identity/v3/projects/fa907c34d1a345aebfae7765cc3187fb => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:28:57.962967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e463964-5304-430c-a782-083315128582 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:57.963529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e463964-5304-430c-a782-083315128582 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:57.963801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e463964-5304-430c-a782-083315128582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:57.988635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5e463964-5304-430c-a782-083315128582 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:57.989900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5e463964-5304-430c-a782-083315128582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:58.064227 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2907/5744] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:58.072515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ad6a2-6376-4f4a-9396-3934404c20cf None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:58.072515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ad6a2-6376-4f4a-9396-3934404c20cf None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:58.072896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ad6a2-6376-4f4a-9396-3934404c20cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:58.096291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1e7ad6a2-6376-4f4a-9396-3934404c20cf None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:58.097532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1e7ad6a2-6376-4f4a-9396-3934404c20cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:58.116459 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2838/5745] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:58.120554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e463964-5304-430c-a782-083315128582 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:58.132097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e463964-5304-430c-a782-083315128582 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:58.139318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016bc0b-06b2-4bb1-aa00-d441cdef76b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:58.140280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016bc0b-06b2-4bb1-aa00-d441cdef76b2 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:58.140578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016bc0b-06b2-4bb1-aa00-d441cdef76b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:58.140854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016bc0b-06b2-4bb1-aa00-d441cdef76b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:58.141575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016bc0b-06b2-4bb1-aa00-d441cdef76b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:28:58.142056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016bc0b-06b2-4bb1-aa00-d441cdef76b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:58.145928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016bc0b-06b2-4bb1-aa00-d441cdef76b2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:58.158484 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2908/5746] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:28:58.162804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ad6a2-6376-4f4a-9396-3934404c20cf None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:58.174219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:58.178207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ad6a2-6376-4f4a-9396-3934404c20cf None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:58.180818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9498b54-74c0-4f55-b1c5-28afd55dbbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:58.181580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9498b54-74c0-4f55-b1c5-28afd55dbbe0 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:58.181943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9498b54-74c0-4f55-b1c5-28afd55dbbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:58.182316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9498b54-74c0-4f55-b1c5-28afd55dbbe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:58.183119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9498b54-74c0-4f55-b1c5-28afd55dbbe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:58.186076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9498b54-74c0-4f55-b1c5-28afd55dbbe0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:58.348537 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2839/5747] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:28:58 2022] POST /identity/v3/projects => generated 367 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:28:58.351944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016bc0b-06b2-4bb1-aa00-d441cdef76b2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:58.363696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016bc0b-06b2-4bb1-aa00-d441cdef76b2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:58.429256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f21def-5171-4bbc-9ded-64a9a359cdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:58.429945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f21def-5171-4bbc-9ded-64a9a359cdbc admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:58.430227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f21def-5171-4bbc-9ded-64a9a359cdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:58.430517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f21def-5171-4bbc-9ded-64a9a359cdbc admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:58.433910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f21def-5171-4bbc-9ded-64a9a359cdbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:58.436105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f21def-5171-4bbc-9ded-64a9a359cdbc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:58.601694 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2909/5748] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:28:58 2022] POST /identity/v3/users => generated 284 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:28:58.605809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9498b54-74c0-4f55-b1c5-28afd55dbbe0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:58.636264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9498b54-74c0-4f55-b1c5-28afd55dbbe0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:58.649558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dc5e0-d955-4b06-b59c-58ea559ee07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:58.650537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dc5e0-d955-4b06-b59c-58ea559ee07c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:58.650976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dc5e0-d955-4b06-b59c-58ea559ee07c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:58.653031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dc5e0-d955-4b06-b59c-58ea559ee07c admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:58.654140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25dc5e0-d955-4b06-b59c-58ea559ee07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:58.660059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25dc5e0-d955-4b06-b59c-58ea559ee07c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:58.679215 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2840/5749] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:28:58.683334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f21def-5171-4bbc-9ded-64a9a359cdbc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:58.695808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f21def-5171-4bbc-9ded-64a9a359cdbc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:58.704354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb3c5d-8b18-44f1-8a80-301bd4772bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:58.705190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb3c5d-8b18-44f1-8a80-301bd4772bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:58.705646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb3c5d-8b18-44f1-8a80-301bd4772bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:58.706161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb3c5d-8b18-44f1-8a80-301bd4772bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:58.707467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb3c5d-8b18-44f1-8a80-301bd4772bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:58.709548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb3c5d-8b18-44f1-8a80-301bd4772bf4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:58.726386 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2910/5750] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:28:58.731312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dc5e0-d955-4b06-b59c-58ea559ee07c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:58.746916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dc5e0-d955-4b06-b59c-58ea559ee07c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:58.752743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7cf4d-39f5-4c7f-8027-9177ed5f37db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:58.753991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7cf4d-39f5-4c7f-8027-9177ed5f37db admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:58.754219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7cf4d-39f5-4c7f-8027-9177ed5f37db admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:58.754533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7cf4d-39f5-4c7f-8027-9177ed5f37db admin admin] PATH_INFO: `/v3/projects/9d2ef778592b4a7b8a721d0814f8f751/users/3b7f1205079b41428d9122e5c2d123dd/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:58.774217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7cf4d-39f5-4c7f-8027-9177ed5f37db admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d2ef778592b4a7b8a721d0814f8f751, user_id=3b7f1205079b41428d9122e5c2d123dd, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:58.776963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7cf4d-39f5-4c7f-8027-9177ed5f37db admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:58.977608 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2841/5751] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:28:58 2022] PUT /identity/v3/projects/9d2ef778592b4a7b8a721d0814f8f751/users/3b7f1205079b41428d9122e5c2d123dd/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:28:58.980523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c44d7-0a00-4ac5-aa56-aa014179852f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:58.981025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c44d7-0a00-4ac5-aa56-aa014179852f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:58.981122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c44d7-0a00-4ac5-aa56-aa014179852f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:59.048314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-788c44d7-0a00-4ac5-aa56-aa014179852f None None] MFA Rules not processed for user `3b7f1205079b41428d9122e5c2d123dd`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:28:59.049696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-788c44d7-0a00-4ac5-aa56-aa014179852f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:59.191240 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2911/5752] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:28:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:28:59.192762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7cf4d-39f5-4c7f-8027-9177ed5f37db admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:59.194687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-48a7cf4d-39f5-4c7f-8027-9177ed5f37db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:59.274088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7cf4d-39f5-4c7f-8027-9177ed5f37db admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:59.280419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d38957-b761-424c-8379-8e83a8894585 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:59.281472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d38957-b761-424c-8379-8e83a8894585 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:59.282034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d38957-b761-424c-8379-8e83a8894585 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:59.282421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d38957-b761-424c-8379-8e83a8894585 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:59.299565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d38957-b761-424c-8379-8e83a8894585 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:59.302898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d38957-b761-424c-8379-8e83a8894585 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:59.317088 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2842/5753] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:28:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:28:59.488367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c44d7-0a00-4ac5-aa56-aa014179852f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:28:59.491258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-788c44d7-0a00-4ac5-aa56-aa014179852f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:59.624662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:28:59.689361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c44d7-0a00-4ac5-aa56-aa014179852f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:28:59.695644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0721c-1d26-42cc-b918-85c33a01510a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:28:59.697116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0721c-1d26-42cc-b918-85c33a01510a service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:28:59.697266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0721c-1d26-42cc-b918-85c33a01510a service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:28:59.698408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0721c-1d26-42cc-b918-85c33a01510a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:28:59.702465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bae0721c-1d26-42cc-b918-85c33a01510a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:28:59.721869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0721c-1d26-42cc-b918-85c33a01510a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:28:59.724179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0721c-1d26-42cc-b918-85c33a01510a service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:28:59.773790 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2912/5754] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:28:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:29:00.208627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:01.214648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d38957-b761-424c-8379-8e83a8894585 service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:01.216248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-64d38957-b761-424c-8379-8e83a8894585 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:01.279095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d38957-b761-424c-8379-8e83a8894585 service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:01.282890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea1ca0-873b-4d98-a4c5-8255d3ba526d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:01.283565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea1ca0-873b-4d98-a4c5-8255d3ba526d service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:01.283850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea1ca0-873b-4d98-a4c5-8255d3ba526d service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:01.284126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea1ca0-873b-4d98-a4c5-8255d3ba526d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:01.285874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-75ea1ca0-873b-4d98-a4c5-8255d3ba526d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:01.297597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea1ca0-873b-4d98-a4c5-8255d3ba526d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:01.299074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea1ca0-873b-4d98-a4c5-8255d3ba526d service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:01.308856 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2843/5755] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:29:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:29:02.876604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:09.892199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0721c-1d26-42cc-b918-85c33a01510a service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:09.895752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bae0721c-1d26-42cc-b918-85c33a01510a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:10.016295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0721c-1d26-42cc-b918-85c33a01510a service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:10.022139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36048fe0-e269-4483-887e-e385c218cadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:10.028275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36048fe0-e269-4483-887e-e385c218cadc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:10.028275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36048fe0-e269-4483-887e-e385c218cadc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:10.028275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36048fe0-e269-4483-887e-e385c218cadc admin admin] PATH_INFO: `/v3/users/a27b3e9973c846c68f25f7981c995b73` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:10.028275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36048fe0-e269-4483-887e-e385c218cadc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a27b3e9973c846c68f25f7981c995b73)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:10.028275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36048fe0-e269-4483-887e-e385c218cadc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:10.034560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:10.267827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-36048fe0-e269-4483-887e-e385c218cadc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a27b3e9973c846c68f25f7981c995b73'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:10.276373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-36048fe0-e269-4483-887e-e385c218cadc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a27b3e9973c846c68f25f7981c995b73'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:10.376777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-36048fe0-e269-4483-887e-e385c218cadc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a27b3e9973c846c68f25f7981c995b73'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:10.376777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-36048fe0-e269-4483-887e-e385c218cadc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a27b3e9973c846c68f25f7981c995b73'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:10.389552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-36048fe0-e269-4483-887e-e385c218cadc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a27b3e9973c846c68f25f7981c995b73'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:10.395746 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2913/5756] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:29:09 2022] DELETE /identity/v3/users/a27b3e9973c846c68f25f7981c995b73 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:29:10.855049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea1ca0-873b-4d98-a4c5-8255d3ba526d service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:10.867284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea1ca0-873b-4d98-a4c5-8255d3ba526d service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:10.910698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:10.963332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d2f7f-d7c4-4c8d-ab7b-932e6b400097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:10.964487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d2f7f-d7c4-4c8d-ab7b-932e6b400097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:10.964943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d2f7f-d7c4-4c8d-ab7b-932e6b400097 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:10.966000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d2f7f-d7c4-4c8d-ab7b-932e6b400097 admin admin] PATH_INFO: `/v3/projects/125617442dae45f58c179b625bcc799d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:10.973259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d2f7f-d7c4-4c8d-ab7b-932e6b400097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=125617442dae45f58c179b625bcc799d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:10.975633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d2f7f-d7c4-4c8d-ab7b-932e6b400097 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:11.167985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-766d2f7f-d7c4-4c8d-ab7b-932e6b400097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '125617442dae45f58c179b625bcc799d', 'request_id': 'req-766d2f7f-d7c4-4c8d-ab7b-932e6b400097'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:11.175881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-766d2f7f-d7c4-4c8d-ab7b-932e6b400097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '125617442dae45f58c179b625bcc799d', 'request_id': 'req-766d2f7f-d7c4-4c8d-ab7b-932e6b400097'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:11.183274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-766d2f7f-d7c4-4c8d-ab7b-932e6b400097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '125617442dae45f58c179b625bcc799d', 'request_id': 'req-766d2f7f-d7c4-4c8d-ab7b-932e6b400097'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:11.285300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-766d2f7f-d7c4-4c8d-ab7b-932e6b400097 admin admin] The token cache is being invalidate because project 125617442dae45f58c179b625bcc799d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:29:11.285988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-766d2f7f-d7c4-4c8d-ab7b-932e6b400097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:11.287101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-766d2f7f-d7c4-4c8d-ab7b-932e6b400097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:11.289230 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2844/5757] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:29:10 2022] DELETE /identity/v3/projects/125617442dae45f58c179b625bcc799d => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:29:11.295269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccde2d-2035-48f0-aef2-5d99bf4c259e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:11.296139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccde2d-2035-48f0-aef2-5d99bf4c259e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:11.296783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccde2d-2035-48f0-aef2-5d99bf4c259e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:11.321746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c2ccde2d-2035-48f0-aef2-5d99bf4c259e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:29:11.323294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c2ccde2d-2035-48f0-aef2-5d99bf4c259e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:11.411204 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2914/5758] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:29:11.413542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f5d25-0e5b-4bba-94fc-228acbbdbc89 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:11.413872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f5d25-0e5b-4bba-94fc-228acbbdbc89 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:11.414213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f5d25-0e5b-4bba-94fc-228acbbdbc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:11.435002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4f9f5d25-0e5b-4bba-94fc-228acbbdbc89 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:29:11.436929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4f9f5d25-0e5b-4bba-94fc-228acbbdbc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:11.446484 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2845/5759] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:29:11.451703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccde2d-2035-48f0-aef2-5d99bf4c259e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:11.462068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccde2d-2035-48f0-aef2-5d99bf4c259e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:11.473794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559de24-052a-4ce4-8509-e0a11fde0b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:11.474529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559de24-052a-4ce4-8509-e0a11fde0b44 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:11.474866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559de24-052a-4ce4-8509-e0a11fde0b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:11.475179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559de24-052a-4ce4-8509-e0a11fde0b44 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:11.475929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559de24-052a-4ce4-8509-e0a11fde0b44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:29:11.476241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559de24-052a-4ce4-8509-e0a11fde0b44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:11.478046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559de24-052a-4ce4-8509-e0a11fde0b44 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:11.492535 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2915/5760] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:29:11.497134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f5d25-0e5b-4bba-94fc-228acbbdbc89 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:11.507504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f5d25-0e5b-4bba-94fc-228acbbdbc89 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:11.518531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db71c5d-13d6-4010-ac32-d60d71fcf106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:11.519482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db71c5d-13d6-4010-ac32-d60d71fcf106 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:11.519765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db71c5d-13d6-4010-ac32-d60d71fcf106 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:11.520278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db71c5d-13d6-4010-ac32-d60d71fcf106 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:11.521428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db71c5d-13d6-4010-ac32-d60d71fcf106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:11.524420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db71c5d-13d6-4010-ac32-d60d71fcf106 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:11.649609 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2846/5761] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:29:11 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:29:11.654067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559de24-052a-4ce4-8509-e0a11fde0b44 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:11.667995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559de24-052a-4ce4-8509-e0a11fde0b44 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:11.763946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31d8f1-4e96-4454-b9ea-53bcd981820d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:11.764709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31d8f1-4e96-4454-b9ea-53bcd981820d admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:11.765114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31d8f1-4e96-4454-b9ea-53bcd981820d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:11.766059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31d8f1-4e96-4454-b9ea-53bcd981820d admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:11.766786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31d8f1-4e96-4454-b9ea-53bcd981820d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:11.768874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31d8f1-4e96-4454-b9ea-53bcd981820d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:11.912917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:11.920311 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2916/5762] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:29:11 2022] POST /identity/v3/users => generated 291 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:29:11.924466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db71c5d-13d6-4010-ac32-d60d71fcf106 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:11.944486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db71c5d-13d6-4010-ac32-d60d71fcf106 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:11.952354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377133f-e81c-4054-b32d-f544ea23fd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:11.953577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377133f-e81c-4054-b32d-f544ea23fd14 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:11.954153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377133f-e81c-4054-b32d-f544ea23fd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:11.954525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377133f-e81c-4054-b32d-f544ea23fd14 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:11.955715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377133f-e81c-4054-b32d-f544ea23fd14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:11.958402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377133f-e81c-4054-b32d-f544ea23fd14 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:11.971662 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2847/5763] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:29:11.975996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31d8f1-4e96-4454-b9ea-53bcd981820d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:11.992693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31d8f1-4e96-4454-b9ea-53bcd981820d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:11.998621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edb6ac-5631-401a-8ba9-0c0402a94cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:11.999506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edb6ac-5631-401a-8ba9-0c0402a94cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:11.999809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edb6ac-5631-401a-8ba9-0c0402a94cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:12.000139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edb6ac-5631-401a-8ba9-0c0402a94cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:12.016362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edb6ac-5631-401a-8ba9-0c0402a94cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:12.016362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edb6ac-5631-401a-8ba9-0c0402a94cd4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:12.031068 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2917/5764] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:29:12.034352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377133f-e81c-4054-b32d-f544ea23fd14 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:12.054652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377133f-e81c-4054-b32d-f544ea23fd14 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:12.069178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba933b17-61e9-4a45-a2dd-830f730d2243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:12.070099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba933b17-61e9-4a45-a2dd-830f730d2243 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:12.070443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba933b17-61e9-4a45-a2dd-830f730d2243 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:12.070755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba933b17-61e9-4a45-a2dd-830f730d2243 admin admin] PATH_INFO: `/v3/projects/295deae6a1574b69985deb317a9a4973/users/c88d6c32d91e4aedb4e5d1c2f6358df3/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:12.095202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba933b17-61e9-4a45-a2dd-830f730d2243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=295deae6a1574b69985deb317a9a4973, user_id=c88d6c32d91e4aedb4e5d1c2f6358df3, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:12.098719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba933b17-61e9-4a45-a2dd-830f730d2243 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:12.198079 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2848/5765] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:29:12 2022] PUT /identity/v3/projects/295deae6a1574b69985deb317a9a4973/users/c88d6c32d91e4aedb4e5d1c2f6358df3/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:29:12.203591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b078e-970b-4cd9-a03a-8752d5bed2fe None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:12.204200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b078e-970b-4cd9-a03a-8752d5bed2fe None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:12.204484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b078e-970b-4cd9-a03a-8752d5bed2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:12.234028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-000b078e-970b-4cd9-a03a-8752d5bed2fe None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:29:12.235666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-000b078e-970b-4cd9-a03a-8752d5bed2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:12.346171 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2918/5766] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:29:12.382627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba933b17-61e9-4a45-a2dd-830f730d2243 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:12.384958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ba933b17-61e9-4a45-a2dd-830f730d2243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:12.481859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba933b17-61e9-4a45-a2dd-830f730d2243 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:12.493000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f15f0-9305-4186-8d59-3c6e9ebfd956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:12.493984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f15f0-9305-4186-8d59-3c6e9ebfd956 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:12.494281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f15f0-9305-4186-8d59-3c6e9ebfd956 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:12.494822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f15f0-9305-4186-8d59-3c6e9ebfd956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:12.517778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f15f0-9305-4186-8d59-3c6e9ebfd956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:12.519198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f15f0-9305-4186-8d59-3c6e9ebfd956 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:12.548922 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2849/5767] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:29:12.756931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:14.441737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b078e-970b-4cd9-a03a-8752d5bed2fe None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:14.444380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-000b078e-970b-4cd9-a03a-8752d5bed2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:14.558742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b078e-970b-4cd9-a03a-8752d5bed2fe None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:14.569167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5b7d9-cfd4-422d-b649-566ad00f98c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:14.572672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5b7d9-cfd4-422d-b649-566ad00f98c5 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:14.572672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5b7d9-cfd4-422d-b649-566ad00f98c5 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:14.572672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5b7d9-cfd4-422d-b649-566ad00f98c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:14.573919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a0f5b7d9-cfd4-422d-b649-566ad00f98c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:14.591888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5b7d9-cfd4-422d-b649-566ad00f98c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:14.593554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5b7d9-cfd4-422d-b649-566ad00f98c5 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:14.623960 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2919/5768] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:29:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:29:21.706225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9525c-094e-4234-b5f7-971c57585a1f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:21.706739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9525c-094e-4234-b5f7-971c57585a1f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:21.706845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9525c-094e-4234-b5f7-971c57585a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:21.743971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-21d9525c-094e-4234-b5f7-971c57585a1f None None] MFA Rules not processed for user `c88d6c32d91e4aedb4e5d1c2f6358df3`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:29:21.745442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-21d9525c-094e-4234-b5f7-971c57585a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:21.844693 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2850/5769] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:29:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:29:21.854787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5b7d9-cfd4-422d-b649-566ad00f98c5 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:21.858679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a0f5b7d9-cfd4-422d-b649-566ad00f98c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:21.880482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5b7d9-cfd4-422d-b649-566ad00f98c5 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:21.898385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730d768-9852-4b00-b8b4-bf8345511edc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:21.899333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730d768-9852-4b00-b8b4-bf8345511edc service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:21.899983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730d768-9852-4b00-b8b4-bf8345511edc service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:21.900618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730d768-9852-4b00-b8b4-bf8345511edc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:21.912522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730d768-9852-4b00-b8b4-bf8345511edc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:21.914541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730d768-9852-4b00-b8b4-bf8345511edc service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:21.931262 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2920/5770] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:29:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:29:29.141898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9525c-094e-4234-b5f7-971c57585a1f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:29.156630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9525c-094e-4234-b5f7-971c57585a1f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:29.163584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af9a3b-2bef-4d69-ac45-3f02cdc75ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:29.164684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af9a3b-2bef-4d69-ac45-3f02cdc75ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:29.165424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af9a3b-2bef-4d69-ac45-3f02cdc75ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:29.165709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af9a3b-2bef-4d69-ac45-3f02cdc75ba5 admin admin] PATH_INFO: `/v3/users/c88d6c32d91e4aedb4e5d1c2f6358df3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:29.167250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af9a3b-2bef-4d69-ac45-3f02cdc75ba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c88d6c32d91e4aedb4e5d1c2f6358df3)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:29.171077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af9a3b-2bef-4d69-ac45-3f02cdc75ba5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:29.479515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-87af9a3b-2bef-4d69-ac45-3f02cdc75ba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c88d6c32d91e4aedb4e5d1c2f6358df3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:29.493052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-87af9a3b-2bef-4d69-ac45-3f02cdc75ba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c88d6c32d91e4aedb4e5d1c2f6358df3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:29.555463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-87af9a3b-2bef-4d69-ac45-3f02cdc75ba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c88d6c32d91e4aedb4e5d1c2f6358df3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:29.564039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-87af9a3b-2bef-4d69-ac45-3f02cdc75ba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c88d6c32d91e4aedb4e5d1c2f6358df3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:29.564871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-87af9a3b-2bef-4d69-ac45-3f02cdc75ba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c88d6c32d91e4aedb4e5d1c2f6358df3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:29.572174 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2851/5771] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:29:29 2022] DELETE /identity/v3/users/c88d6c32d91e4aedb4e5d1c2f6358df3 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:29:29.924133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730d768-9852-4b00-b8b4-bf8345511edc service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:29.939733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730d768-9852-4b00-b8b4-bf8345511edc service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:30.015851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0916f5-bdc8-4ec0-abeb-435fa8608777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:30.016754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0916f5-bdc8-4ec0-abeb-435fa8608777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:30.017059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0916f5-bdc8-4ec0-abeb-435fa8608777 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:30.017317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0916f5-bdc8-4ec0-abeb-435fa8608777 admin admin] PATH_INFO: `/v3/projects/295deae6a1574b69985deb317a9a4973` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:30.018585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0916f5-bdc8-4ec0-abeb-435fa8608777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=295deae6a1574b69985deb317a9a4973)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:30.020551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0916f5-bdc8-4ec0-abeb-435fa8608777 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:30.024796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:30.148160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ee0916f5-bdc8-4ec0-abeb-435fa8608777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '295deae6a1574b69985deb317a9a4973', 'request_id': 'req-ee0916f5-bdc8-4ec0-abeb-435fa8608777'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:30.156058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ee0916f5-bdc8-4ec0-abeb-435fa8608777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '295deae6a1574b69985deb317a9a4973', 'request_id': 'req-ee0916f5-bdc8-4ec0-abeb-435fa8608777'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:30.162417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ee0916f5-bdc8-4ec0-abeb-435fa8608777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '295deae6a1574b69985deb317a9a4973', 'request_id': 'req-ee0916f5-bdc8-4ec0-abeb-435fa8608777'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:30.240033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ee0916f5-bdc8-4ec0-abeb-435fa8608777 admin admin] The token cache is being invalidate because project 295deae6a1574b69985deb317a9a4973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:29:30.240633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ee0916f5-bdc8-4ec0-abeb-435fa8608777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:30.241526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ee0916f5-bdc8-4ec0-abeb-435fa8608777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:30.243686 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2921/5772] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:29:29 2022] DELETE /identity/v3/projects/295deae6a1574b69985deb317a9a4973 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:29:30.251539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c419b-db12-4fa5-9e21-c577943a0b48 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:30.253747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c419b-db12-4fa5-9e21-c577943a0b48 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:30.254301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c419b-db12-4fa5-9e21-c577943a0b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:30.278692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0a1c419b-db12-4fa5-9e21-c577943a0b48 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:29:30.281644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0a1c419b-db12-4fa5-9e21-c577943a0b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:30.364669 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2852/5773] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:29:30.373624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5aac9-764c-4c89-b793-244c4bb4b89e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:30.374005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5aac9-764c-4c89-b793-244c4bb4b89e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:30.374690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5aac9-764c-4c89-b793-244c4bb4b89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:30.394961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8aa5aac9-764c-4c89-b793-244c4bb4b89e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:29:30.396646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8aa5aac9-764c-4c89-b793-244c4bb4b89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:30.405431 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2922/5774] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:29:30.410001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c419b-db12-4fa5-9e21-c577943a0b48 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:30.415694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:30.421498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c419b-db12-4fa5-9e21-c577943a0b48 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:30.426390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7dace-2ed2-44e5-aba2-740823d04033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:30.427148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7dace-2ed2-44e5-aba2-740823d04033 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:30.427464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7dace-2ed2-44e5-aba2-740823d04033 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:30.427742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7dace-2ed2-44e5-aba2-740823d04033 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:30.428552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7dace-2ed2-44e5-aba2-740823d04033 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:29:30.428858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7dace-2ed2-44e5-aba2-740823d04033 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:30.430458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7dace-2ed2-44e5-aba2-740823d04033 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:30.442559 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2853/5775] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:29:30.447140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5aac9-764c-4c89-b793-244c4bb4b89e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:30.457335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5aac9-764c-4c89-b793-244c4bb4b89e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:30.462067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4859d9a-20e5-4bb6-9a98-7b1d5ff09ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:30.462715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4859d9a-20e5-4bb6-9a98-7b1d5ff09ffc admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:30.463000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4859d9a-20e5-4bb6-9a98-7b1d5ff09ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:30.463351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4859d9a-20e5-4bb6-9a98-7b1d5ff09ffc admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:30.464119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4859d9a-20e5-4bb6-9a98-7b1d5ff09ffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:30.466303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4859d9a-20e5-4bb6-9a98-7b1d5ff09ffc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:30.596090 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2923/5776] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:29:30 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:29:30.597337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7dace-2ed2-44e5-aba2-740823d04033 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:30.612554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7dace-2ed2-44e5-aba2-740823d04033 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:30.676860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9fd6e-6294-4936-96cf-6b274e79f0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:30.677688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9fd6e-6294-4936-96cf-6b274e79f0f3 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:30.678376 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9fd6e-6294-4936-96cf-6b274e79f0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:30.678533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9fd6e-6294-4936-96cf-6b274e79f0f3 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:30.679380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9fd6e-6294-4936-96cf-6b274e79f0f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:30.681923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9fd6e-6294-4936-96cf-6b274e79f0f3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:30.780727 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2854/5777] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:29:30 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:29:30.788448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4859d9a-20e5-4bb6-9a98-7b1d5ff09ffc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:30.803672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4859d9a-20e5-4bb6-9a98-7b1d5ff09ffc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:30.810045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8185143-b948-4c35-9c5a-b8e2d8c92f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:30.810835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8185143-b948-4c35-9c5a-b8e2d8c92f0e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:30.811207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8185143-b948-4c35-9c5a-b8e2d8c92f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:30.811488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8185143-b948-4c35-9c5a-b8e2d8c92f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:30.812372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8185143-b948-4c35-9c5a-b8e2d8c92f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:30.814109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8185143-b948-4c35-9c5a-b8e2d8c92f0e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:30.831060 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2924/5778] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:29:30.834580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9fd6e-6294-4936-96cf-6b274e79f0f3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:30.846703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9fd6e-6294-4936-96cf-6b274e79f0f3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:30.852292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38da5e5-6159-44d7-b2dd-bbf91868a322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:30.852974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38da5e5-6159-44d7-b2dd-bbf91868a322 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:30.856502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38da5e5-6159-44d7-b2dd-bbf91868a322 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:30.856502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38da5e5-6159-44d7-b2dd-bbf91868a322 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:30.856502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38da5e5-6159-44d7-b2dd-bbf91868a322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:30.856502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38da5e5-6159-44d7-b2dd-bbf91868a322 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:30.873315 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2855/5779] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:29:30.874629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8185143-b948-4c35-9c5a-b8e2d8c92f0e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:30.885448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8185143-b948-4c35-9c5a-b8e2d8c92f0e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:30.908273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f00e1-677b-4db2-a12d-24f2732b264b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:30.908273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f00e1-677b-4db2-a12d-24f2732b264b admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:30.908273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f00e1-677b-4db2-a12d-24f2732b264b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:30.908273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f00e1-677b-4db2-a12d-24f2732b264b admin admin] PATH_INFO: `/v3/projects/207ec2d1883c4a1ba89696e6e77cf3aa/users/da77ec3d0f04496d8c8df4025bba76d1/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:30.935375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f00e1-677b-4db2-a12d-24f2732b264b admin admin] RBAC: Authorizing `identity:create_grant(project_id=207ec2d1883c4a1ba89696e6e77cf3aa, user_id=da77ec3d0f04496d8c8df4025bba76d1, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:30.938367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f00e1-677b-4db2-a12d-24f2732b264b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:31.090462 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2925/5780] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:29:30 2022] PUT /identity/v3/projects/207ec2d1883c4a1ba89696e6e77cf3aa/users/da77ec3d0f04496d8c8df4025bba76d1/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:29:31.093502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be66757-0b3c-4b41-b67e-1473815d5237 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:31.094159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be66757-0b3c-4b41-b67e-1473815d5237 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:31.094597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be66757-0b3c-4b41-b67e-1473815d5237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:31.121769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0be66757-0b3c-4b41-b67e-1473815d5237 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:29:31.123243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0be66757-0b3c-4b41-b67e-1473815d5237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:31.229277 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2856/5781] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:29:31.241835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f00e1-677b-4db2-a12d-24f2732b264b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:31.244467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-763f00e1-677b-4db2-a12d-24f2732b264b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:31.355132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f00e1-677b-4db2-a12d-24f2732b264b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:31.360445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df363e8a-03ba-4711-842c-85f912b82921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:31.361948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df363e8a-03ba-4711-842c-85f912b82921 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:31.362409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df363e8a-03ba-4711-842c-85f912b82921 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:31.362858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df363e8a-03ba-4711-842c-85f912b82921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:31.388470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df363e8a-03ba-4711-842c-85f912b82921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:31.390001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df363e8a-03ba-4711-842c-85f912b82921 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:31.405601 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2926/5782] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:29:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:29:34.836175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158459ba-f2f2-4f7e-af0a-79c9176a61c6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:34.836175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158459ba-f2f2-4f7e-af0a-79c9176a61c6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:34.836175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158459ba-f2f2-4f7e-af0a-79c9176a61c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:34.898770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-158459ba-f2f2-4f7e-af0a-79c9176a61c6 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:29:34.901139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-158459ba-f2f2-4f7e-af0a-79c9176a61c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:34.968189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:34.988010 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2857/5783] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:29:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:29:35.191180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df363e8a-03ba-4711-842c-85f912b82921 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:35.193407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-df363e8a-03ba-4711-842c-85f912b82921 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:35.272852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:35.338954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df363e8a-03ba-4711-842c-85f912b82921 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:35.345002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9b0bd-bab5-4569-8848-86a376e00e34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:35.345657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9b0bd-bab5-4569-8848-86a376e00e34 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:35.345918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9b0bd-bab5-4569-8848-86a376e00e34 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:35.346191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9b0bd-bab5-4569-8848-86a376e00e34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:35.357345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9b0bd-bab5-4569-8848-86a376e00e34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:35.365232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9b0bd-bab5-4569-8848-86a376e00e34 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:35.392439 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2927/5784] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:29:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:29:41.329984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69234c-edac-4b87-b416-95371ab2bc50 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:41.330984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69234c-edac-4b87-b416-95371ab2bc50 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:41.331445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69234c-edac-4b87-b416-95371ab2bc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:41.436375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0c69234c-edac-4b87-b416-95371ab2bc50 None None] MFA Rules not processed for user `da77ec3d0f04496d8c8df4025bba76d1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:29:41.438649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0c69234c-edac-4b87-b416-95371ab2bc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:41.590973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9b0bd-bab5-4569-8848-86a376e00e34 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:41.598747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c6e9b0bd-bab5-4569-8848-86a376e00e34 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:41.631491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9b0bd-bab5-4569-8848-86a376e00e34 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:41.654006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab50ebe-ae60-4661-ba53-fa6ad724bf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:41.655219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab50ebe-ae60-4661-ba53-fa6ad724bf1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:41.657537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab50ebe-ae60-4661-ba53-fa6ad724bf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:41.660116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab50ebe-ae60-4661-ba53-fa6ad724bf1e admin admin] PATH_INFO: `/v3/users/af0cd3652c8d42bcb8af08852ff4f203` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:41.663350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab50ebe-ae60-4661-ba53-fa6ad724bf1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=af0cd3652c8d42bcb8af08852ff4f203)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:41.683550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab50ebe-ae60-4661-ba53-fa6ad724bf1e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:41.683706 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2858/5785] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:29:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:29:41.683706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69234c-edac-4b87-b416-95371ab2bc50 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:41.692180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0c69234c-edac-4b87-b416-95371ab2bc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:41.858518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69234c-edac-4b87-b416-95371ab2bc50 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:41.875041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b0b3c-3ca5-4481-bea7-9370d8ad5bcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:41.875755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b0b3c-3ca5-4481-bea7-9370d8ad5bcf service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:41.876203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b0b3c-3ca5-4481-bea7-9370d8ad5bcf service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:41.876419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b0b3c-3ca5-4481-bea7-9370d8ad5bcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:41.878987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ac4b0b3c-3ca5-4481-bea7-9370d8ad5bcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:41.986155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fab50ebe-ae60-4661-ba53-fa6ad724bf1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af0cd3652c8d42bcb8af08852ff4f203'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:42.001693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fab50ebe-ae60-4661-ba53-fa6ad724bf1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af0cd3652c8d42bcb8af08852ff4f203'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:42.018336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b0b3c-3ca5-4481-bea7-9370d8ad5bcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:42.022521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b0b3c-3ca5-4481-bea7-9370d8ad5bcf service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:42.061359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fab50ebe-ae60-4661-ba53-fa6ad724bf1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af0cd3652c8d42bcb8af08852ff4f203'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:42.062099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fab50ebe-ae60-4661-ba53-fa6ad724bf1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af0cd3652c8d42bcb8af08852ff4f203'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:42.067676 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2859/5786] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:29:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:29:42.068989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41266796-204b-47d0-a730-735f2613b903 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:42.069287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41266796-204b-47d0-a730-735f2613b903 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:42.069570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41266796-204b-47d0-a730-735f2613b903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:42.090045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fab50ebe-ae60-4661-ba53-fa6ad724bf1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af0cd3652c8d42bcb8af08852ff4f203'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:42.106278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:42.123648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-41266796-204b-47d0-a730-735f2613b903 None None] MFA Rules not processed for user `da77ec3d0f04496d8c8df4025bba76d1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:29:42.124903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-41266796-204b-47d0-a730-735f2613b903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:42.125035 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2928/5787] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:29:41 2022] DELETE /identity/v3/users/af0cd3652c8d42bcb8af08852ff4f203 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:29:42.134720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c9fdb-0866-4b16-9b64-e9b0221d3d7b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:42.134720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c9fdb-0866-4b16-9b64-e9b0221d3d7b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:42.134720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c9fdb-0866-4b16-9b64-e9b0221d3d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:42.207512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-601c9fdb-0866-4b16-9b64-e9b0221d3d7b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:29:42.211617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-601c9fdb-0866-4b16-9b64-e9b0221d3d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:42.287335 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2860/5788] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:29:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:29:42.298966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41266796-204b-47d0-a730-735f2613b903 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:42.303953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-41266796-204b-47d0-a730-735f2613b903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:42.393855 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2929/5789] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:29:42.404592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c9fdb-0866-4b16-9b64-e9b0221d3d7b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:42.406342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-601c9fdb-0866-4b16-9b64-e9b0221d3d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:42.467901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:42.544275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c9fdb-0866-4b16-9b64-e9b0221d3d7b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:42.556223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d3d0b-9ee5-44aa-9130-7d72d75cd7ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:42.557153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d3d0b-9ee5-44aa-9130-7d72d75cd7ed service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:42.557662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d3d0b-9ee5-44aa-9130-7d72d75cd7ed service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:42.558609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d3d0b-9ee5-44aa-9130-7d72d75cd7ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:42.568468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41266796-204b-47d0-a730-735f2613b903 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:42.580006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d3d0b-9ee5-44aa-9130-7d72d75cd7ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:42.582437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d3d0b-9ee5-44aa-9130-7d72d75cd7ed service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:42.591633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769d101-d23c-4e30-b40f-3485cc7eeb9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:42.592304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769d101-d23c-4e30-b40f-3485cc7eeb9c service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:42.592862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769d101-d23c-4e30-b40f-3485cc7eeb9c service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:42.593290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769d101-d23c-4e30-b40f-3485cc7eeb9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:42.608518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a769d101-d23c-4e30-b40f-3485cc7eeb9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:42.628286 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2930/5790] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:29:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:29:42.659102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769d101-d23c-4e30-b40f-3485cc7eeb9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:42.661589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769d101-d23c-4e30-b40f-3485cc7eeb9c service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:42.692446 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2861/5791] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:29:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:29:43.770430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d3d0b-9ee5-44aa-9130-7d72d75cd7ed service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:43.778677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-812d3d0b-9ee5-44aa-9130-7d72d75cd7ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:43.826472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d3d0b-9ee5-44aa-9130-7d72d75cd7ed service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:43.838981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079cba5-5fec-4f72-a31f-32a511c65150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:43.841683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079cba5-5fec-4f72-a31f-32a511c65150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:43.842190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079cba5-5fec-4f72-a31f-32a511c65150 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:43.842718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079cba5-5fec-4f72-a31f-32a511c65150 admin admin] PATH_INFO: `/v3/projects/3c6f089da37e4ff09784a2b42513ff36` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:43.846406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079cba5-5fec-4f72-a31f-32a511c65150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c6f089da37e4ff09784a2b42513ff36)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:43.849634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079cba5-5fec-4f72-a31f-32a511c65150 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:44.062738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3079cba5-5fec-4f72-a31f-32a511c65150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c6f089da37e4ff09784a2b42513ff36', 'request_id': 'req-3079cba5-5fec-4f72-a31f-32a511c65150'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:44.080129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3079cba5-5fec-4f72-a31f-32a511c65150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c6f089da37e4ff09784a2b42513ff36', 'request_id': 'req-3079cba5-5fec-4f72-a31f-32a511c65150'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:44.097193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3079cba5-5fec-4f72-a31f-32a511c65150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c6f089da37e4ff09784a2b42513ff36', 'request_id': 'req-3079cba5-5fec-4f72-a31f-32a511c65150'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:44.297032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3079cba5-5fec-4f72-a31f-32a511c65150 admin admin] The token cache is being invalidate because project 3c6f089da37e4ff09784a2b42513ff36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:29:44.297452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3079cba5-5fec-4f72-a31f-32a511c65150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:44.298269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3079cba5-5fec-4f72-a31f-32a511c65150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:44.302343 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2931/5792] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:29:43 2022] DELETE /identity/v3/projects/3c6f089da37e4ff09784a2b42513ff36 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:29:44.309083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63086f69-aa9b-434c-ab89-548f9ae52b15 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:44.313250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63086f69-aa9b-434c-ab89-548f9ae52b15 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:44.313250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63086f69-aa9b-434c-ab89-548f9ae52b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:44.376016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-63086f69-aa9b-434c-ab89-548f9ae52b15 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:29:44.377605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-63086f69-aa9b-434c-ab89-548f9ae52b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:44.580088 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2862/5793] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:29:44.590193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f324ddc-3887-47a0-8607-6260e2bf4190 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:44.590915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f324ddc-3887-47a0-8607-6260e2bf4190 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:44.590915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f324ddc-3887-47a0-8607-6260e2bf4190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:44.650446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6f324ddc-3887-47a0-8607-6260e2bf4190 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:29:44.653263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6f324ddc-3887-47a0-8607-6260e2bf4190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:44.679392 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2932/5794] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:29:44.681541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63086f69-aa9b-434c-ab89-548f9ae52b15 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:44.701407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63086f69-aa9b-434c-ab89-548f9ae52b15 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:44.716701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9960f-ab43-4a5a-8e57-aaad72066f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:44.719732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9960f-ab43-4a5a-8e57-aaad72066f8e admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:44.720098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9960f-ab43-4a5a-8e57-aaad72066f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:44.720590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9960f-ab43-4a5a-8e57-aaad72066f8e admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:44.721373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9960f-ab43-4a5a-8e57-aaad72066f8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:29:44.721694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9960f-ab43-4a5a-8e57-aaad72066f8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:44.723445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9960f-ab43-4a5a-8e57-aaad72066f8e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:44.755901 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2863/5795] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:29:44.757202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f324ddc-3887-47a0-8607-6260e2bf4190 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:44.777223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f324ddc-3887-47a0-8607-6260e2bf4190 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:44.784002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2f7a3-9fd7-41c0-a05e-6158d296c546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:44.785116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2f7a3-9fd7-41c0-a05e-6158d296c546 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:44.785559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2f7a3-9fd7-41c0-a05e-6158d296c546 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:44.786051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2f7a3-9fd7-41c0-a05e-6158d296c546 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:44.788069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2f7a3-9fd7-41c0-a05e-6158d296c546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:44.790405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2f7a3-9fd7-41c0-a05e-6158d296c546 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:44.941052 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2933/5796] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:29:44 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:29:44.946221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9960f-ab43-4a5a-8e57-aaad72066f8e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:44.977004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9960f-ab43-4a5a-8e57-aaad72066f8e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:45.020084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:45.129893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70949fb-f463-408c-b572-afb468377961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:45.132556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70949fb-f463-408c-b572-afb468377961 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:45.134487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70949fb-f463-408c-b572-afb468377961 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:45.134487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70949fb-f463-408c-b572-afb468377961 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:45.136616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70949fb-f463-408c-b572-afb468377961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:45.139099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70949fb-f463-408c-b572-afb468377961 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:45.259480 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2864/5797] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:29:44 2022] POST /identity/v3/users => generated 293 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:29:45.263863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2f7a3-9fd7-41c0-a05e-6158d296c546 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:45.280808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2f7a3-9fd7-41c0-a05e-6158d296c546 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:45.290873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff6df0-811a-445b-83b2-52894e067de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:45.292013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff6df0-811a-445b-83b2-52894e067de5 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:45.292013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff6df0-811a-445b-83b2-52894e067de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:45.292013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff6df0-811a-445b-83b2-52894e067de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:45.292910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff6df0-811a-445b-83b2-52894e067de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:45.294544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff6df0-811a-445b-83b2-52894e067de5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:45.311090 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2934/5798] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:29:45.314954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70949fb-f463-408c-b572-afb468377961 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:45.331996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70949fb-f463-408c-b572-afb468377961 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:45.342890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98141f-3bae-4022-89a7-25afe0529f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:45.345783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98141f-3bae-4022-89a7-25afe0529f5f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:45.346080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98141f-3bae-4022-89a7-25afe0529f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:45.346355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98141f-3bae-4022-89a7-25afe0529f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:45.347742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98141f-3bae-4022-89a7-25afe0529f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:45.350093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98141f-3bae-4022-89a7-25afe0529f5f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:45.369266 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2865/5799] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:29:45.374494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff6df0-811a-445b-83b2-52894e067de5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:45.391409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff6df0-811a-445b-83b2-52894e067de5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:45.403713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463d692-daea-4996-bee2-465de6f4681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:45.404856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463d692-daea-4996-bee2-465de6f4681a admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:45.407334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463d692-daea-4996-bee2-465de6f4681a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:45.407745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463d692-daea-4996-bee2-465de6f4681a admin admin] PATH_INFO: `/v3/projects/1b43d8433a044bd1aec29c4be23f6ac0/users/df066ff4bdcf42b58e2bacc3e8955bbb/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:45.450961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463d692-daea-4996-bee2-465de6f4681a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b43d8433a044bd1aec29c4be23f6ac0, user_id=df066ff4bdcf42b58e2bacc3e8955bbb, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:45.456189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463d692-daea-4996-bee2-465de6f4681a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:45.582715 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2935/5800] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:29:45 2022] PUT /identity/v3/projects/1b43d8433a044bd1aec29c4be23f6ac0/users/df066ff4bdcf42b58e2bacc3e8955bbb/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:29:45.588611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b722238-d71a-4a3e-9187-5a2e6d796735 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:45.589714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b722238-d71a-4a3e-9187-5a2e6d796735 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:45.590310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b722238-d71a-4a3e-9187-5a2e6d796735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:45.639690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7b722238-d71a-4a3e-9187-5a2e6d796735 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:29:45.644257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7b722238-d71a-4a3e-9187-5a2e6d796735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:45.824076 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2866/5801] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:29:45.834480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463d692-daea-4996-bee2-465de6f4681a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:45.837516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8463d692-daea-4996-bee2-465de6f4681a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:45.907436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:45.933260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463d692-daea-4996-bee2-465de6f4681a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:45.938156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7cd6b-b57a-456b-bf48-ddff44c55335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:45.939771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7cd6b-b57a-456b-bf48-ddff44c55335 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:45.940132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7cd6b-b57a-456b-bf48-ddff44c55335 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:45.940498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7cd6b-b57a-456b-bf48-ddff44c55335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:45.955118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7cd6b-b57a-456b-bf48-ddff44c55335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:45.959295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7cd6b-b57a-456b-bf48-ddff44c55335 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:45.993477 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2936/5802] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:29:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:29:53.692538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b722238-d71a-4a3e-9187-5a2e6d796735 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:53.694128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7b722238-d71a-4a3e-9187-5a2e6d796735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:53.716288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b722238-d71a-4a3e-9187-5a2e6d796735 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:53.730723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38027558-95d3-4527-a1a4-424f4a7927af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:53.732415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38027558-95d3-4527-a1a4-424f4a7927af admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:53.732902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38027558-95d3-4527-a1a4-424f4a7927af admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:53.733364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38027558-95d3-4527-a1a4-424f4a7927af admin admin] PATH_INFO: `/v3/users/3b7f1205079b41428d9122e5c2d123dd` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:53.734896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38027558-95d3-4527-a1a4-424f4a7927af admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b7f1205079b41428d9122e5c2d123dd)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:53.737441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38027558-95d3-4527-a1a4-424f4a7927af admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:54.010904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-38027558-95d3-4527-a1a4-424f4a7927af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7f1205079b41428d9122e5c2d123dd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:54.043945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-38027558-95d3-4527-a1a4-424f4a7927af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7f1205079b41428d9122e5c2d123dd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:54.149475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-38027558-95d3-4527-a1a4-424f4a7927af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7f1205079b41428d9122e5c2d123dd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:54.174671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-38027558-95d3-4527-a1a4-424f4a7927af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7f1205079b41428d9122e5c2d123dd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:54.176751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-38027558-95d3-4527-a1a4-424f4a7927af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7f1205079b41428d9122e5c2d123dd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:54.188745 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2867/5803] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:29:53 2022] DELETE /identity/v3/users/3b7f1205079b41428d9122e5c2d123dd => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:29:54.193252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff53ba-36bf-4dc0-add5-a31c0194ce3c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:54.193820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff53ba-36bf-4dc0-add5-a31c0194ce3c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:54.193820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff53ba-36bf-4dc0-add5-a31c0194ce3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:54.228484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-86ff53ba-36bf-4dc0-add5-a31c0194ce3c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:29:54.244216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-86ff53ba-36bf-4dc0-add5-a31c0194ce3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:54.373552 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2937/5804] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:29:54.389485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38027558-95d3-4527-a1a4-424f4a7927af admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:54.390959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-38027558-95d3-4527-a1a4-424f4a7927af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:54.427929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:54.527795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38027558-95d3-4527-a1a4-424f4a7927af admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:54.538006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d149dd-f8a9-453b-a48f-55d4a9d8615d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:54.540409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d149dd-f8a9-453b-a48f-55d4a9d8615d service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:54.540409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d149dd-f8a9-453b-a48f-55d4a9d8615d service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:54.540409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d149dd-f8a9-453b-a48f-55d4a9d8615d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:54.562766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d149dd-f8a9-453b-a48f-55d4a9d8615d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:54.565087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d149dd-f8a9-453b-a48f-55d4a9d8615d service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:54.595876 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2868/5805] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:29:56.928877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff53ba-36bf-4dc0-add5-a31c0194ce3c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:56.930686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-86ff53ba-36bf-4dc0-add5-a31c0194ce3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:56.967106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff53ba-36bf-4dc0-add5-a31c0194ce3c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:56.976137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf1ac6-369c-42af-a481-7cf5944b274d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:56.977495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf1ac6-369c-42af-a481-7cf5944b274d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:56.977968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf1ac6-369c-42af-a481-7cf5944b274d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:56.978564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf1ac6-369c-42af-a481-7cf5944b274d admin admin] PATH_INFO: `/v3/projects/9d2ef778592b4a7b8a721d0814f8f751` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:56.981567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf1ac6-369c-42af-a481-7cf5944b274d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d2ef778592b4a7b8a721d0814f8f751)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:56.984535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf1ac6-369c-42af-a481-7cf5944b274d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:57.149346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eaaf1ac6-369c-42af-a481-7cf5944b274d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d2ef778592b4a7b8a721d0814f8f751', 'request_id': 'req-eaaf1ac6-369c-42af-a481-7cf5944b274d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:57.174871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eaaf1ac6-369c-42af-a481-7cf5944b274d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d2ef778592b4a7b8a721d0814f8f751', 'request_id': 'req-eaaf1ac6-369c-42af-a481-7cf5944b274d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:57.183678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eaaf1ac6-369c-42af-a481-7cf5944b274d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d2ef778592b4a7b8a721d0814f8f751', 'request_id': 'req-eaaf1ac6-369c-42af-a481-7cf5944b274d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:57.280193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eaaf1ac6-369c-42af-a481-7cf5944b274d admin admin] The token cache is being invalidate because project 9d2ef778592b4a7b8a721d0814f8f751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:29:57.280792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eaaf1ac6-369c-42af-a481-7cf5944b274d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:57.281823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eaaf1ac6-369c-42af-a481-7cf5944b274d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:29:57.285855 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2938/5806] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:29:56 2022] DELETE /identity/v3/projects/9d2ef778592b4a7b8a721d0814f8f751 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:29:57.292672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab52e74-ae9d-47f4-8789-13b17c65fad0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:57.293674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab52e74-ae9d-47f4-8789-13b17c65fad0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:57.296899 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab52e74-ae9d-47f4-8789-13b17c65fad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:57.327580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8ab52e74-ae9d-47f4-8789-13b17c65fad0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:29:57.329145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8ab52e74-ae9d-47f4-8789-13b17c65fad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:57.455147 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2869/5807] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:29:57.462918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7885b-c312-4590-b3b5-6d651dc20c79 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:57.464001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7885b-c312-4590-b3b5-6d651dc20c79 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:57.464496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7885b-c312-4590-b3b5-6d651dc20c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:57.549108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-05e7885b-c312-4590-b3b5-6d651dc20c79 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:29:57.550749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-05e7885b-c312-4590-b3b5-6d651dc20c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:57.564902 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2939/5808] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:29:57.569603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab52e74-ae9d-47f4-8789-13b17c65fad0 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:57.585453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab52e74-ae9d-47f4-8789-13b17c65fad0 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:57.593983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fae67-3f61-4e3e-b471-57a94cd64c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:57.593983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fae67-3f61-4e3e-b471-57a94cd64c6a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:57.593983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fae67-3f61-4e3e-b471-57a94cd64c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:57.593983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fae67-3f61-4e3e-b471-57a94cd64c6a admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:57.594435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fae67-3f61-4e3e-b471-57a94cd64c6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:29:57.594759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fae67-3f61-4e3e-b471-57a94cd64c6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:57.596475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fae67-3f61-4e3e-b471-57a94cd64c6a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:57.620429 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2870/5809] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:29:57.621817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7885b-c312-4590-b3b5-6d651dc20c79 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:57.632659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7885b-c312-4590-b3b5-6d651dc20c79 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:57.649647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b43f05-e9d1-4674-ba8e-80b5c5a4d429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:57.650268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b43f05-e9d1-4674-ba8e-80b5c5a4d429 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:57.650606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b43f05-e9d1-4674-ba8e-80b5c5a4d429 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:57.650910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b43f05-e9d1-4674-ba8e-80b5c5a4d429 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:57.652231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b43f05-e9d1-4674-ba8e-80b5c5a4d429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:57.654760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b43f05-e9d1-4674-ba8e-80b5c5a4d429 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:57.790406 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2940/5810] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:29:57 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:29:57.795972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fae67-3f61-4e3e-b471-57a94cd64c6a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:57.817664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fae67-3f61-4e3e-b471-57a94cd64c6a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:58.019420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b4588-90e8-4bea-b8ef-5e76cefc04f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:58.025341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b4588-90e8-4bea-b8ef-5e76cefc04f0 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:58.025912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b4588-90e8-4bea-b8ef-5e76cefc04f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:58.027801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b4588-90e8-4bea-b8ef-5e76cefc04f0 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:58.034540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b4588-90e8-4bea-b8ef-5e76cefc04f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:58.041383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b4588-90e8-4bea-b8ef-5e76cefc04f0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:58.172195 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2871/5811] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:29:57 2022] POST /identity/v3/users => generated 288 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:29:58.184864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b43f05-e9d1-4674-ba8e-80b5c5a4d429 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:58.209670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b43f05-e9d1-4674-ba8e-80b5c5a4d429 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:58.238437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c77e74-281c-4aff-a385-db226f032c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:58.244050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c77e74-281c-4aff-a385-db226f032c68 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:58.244050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c77e74-281c-4aff-a385-db226f032c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:58.244050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c77e74-281c-4aff-a385-db226f032c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:58.244366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c77e74-281c-4aff-a385-db226f032c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:58.249801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c77e74-281c-4aff-a385-db226f032c68 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:58.283778 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2941/5812] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:29:58.287488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b4588-90e8-4bea-b8ef-5e76cefc04f0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:58.307588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b4588-90e8-4bea-b8ef-5e76cefc04f0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:58.315039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e2733-d4bf-4d1b-9cc2-1fa72ca5ad89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:58.315973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e2733-d4bf-4d1b-9cc2-1fa72ca5ad89 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:58.316438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e2733-d4bf-4d1b-9cc2-1fa72ca5ad89 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:58.316871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e2733-d4bf-4d1b-9cc2-1fa72ca5ad89 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:58.317777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e2733-d4bf-4d1b-9cc2-1fa72ca5ad89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:58.354956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e2733-d4bf-4d1b-9cc2-1fa72ca5ad89 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:58.387728 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2872/5813] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:29:58.389405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c77e74-281c-4aff-a385-db226f032c68 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:58.402947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c77e74-281c-4aff-a385-db226f032c68 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:58.411965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7efd62-c50c-4328-8e22-c71ab79584d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:58.411965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7efd62-c50c-4328-8e22-c71ab79584d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:58.413699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7efd62-c50c-4328-8e22-c71ab79584d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:58.414151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7efd62-c50c-4328-8e22-c71ab79584d1 admin admin] PATH_INFO: `/v3/projects/5f0aa3e3ee654c2abe38034e5a754b4a/users/ec496bf826ef44e1af28769a26913981/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:58.459917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7efd62-c50c-4328-8e22-c71ab79584d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0aa3e3ee654c2abe38034e5a754b4a, user_id=ec496bf826ef44e1af28769a26913981, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:58.481119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7efd62-c50c-4328-8e22-c71ab79584d1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:58.605084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375303a-20fc-41a7-8a6c-36ab86c1c709 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:58.605375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375303a-20fc-41a7-8a6c-36ab86c1c709 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:58.605678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375303a-20fc-41a7-8a6c-36ab86c1c709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:58.641239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3375303a-20fc-41a7-8a6c-36ab86c1c709 None None] MFA Rules not processed for user `df066ff4bdcf42b58e2bacc3e8955bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:29:58.642688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3375303a-20fc-41a7-8a6c-36ab86c1c709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:58.658662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:58.682118 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2942/5814] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:29:58 2022] PUT /identity/v3/projects/5f0aa3e3ee654c2abe38034e5a754b4a/users/ec496bf826ef44e1af28769a26913981/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:29:58.693422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6793945-1152-432e-bdfb-b4d4a6354cae None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:58.693870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6793945-1152-432e-bdfb-b4d4a6354cae None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:58.694220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6793945-1152-432e-bdfb-b4d4a6354cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:58.739587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:29:58.770488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e6793945-1152-432e-bdfb-b4d4a6354cae None None] MFA Rules not processed for user `ec496bf826ef44e1af28769a26913981`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:29:58.773543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e6793945-1152-432e-bdfb-b4d4a6354cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:29:58.801790 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2873/5815] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:29:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:29:58.953968 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2943/5816] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:29:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:29:58.961517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375303a-20fc-41a7-8a6c-36ab86c1c709 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:58.974031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375303a-20fc-41a7-8a6c-36ab86c1c709 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:59.049733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cd4ec-3c4a-415b-a0dd-ea7349dbe7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:59.050541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cd4ec-3c4a-415b-a0dd-ea7349dbe7a0 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:59.053988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cd4ec-3c4a-415b-a0dd-ea7349dbe7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:59.053988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cd4ec-3c4a-415b-a0dd-ea7349dbe7a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:59.053988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cd4ec-3c4a-415b-a0dd-ea7349dbe7a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:59.055510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cd4ec-3c4a-415b-a0dd-ea7349dbe7a0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:59.164522 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2874/5817] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:29:58 2022] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:29:59.169819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6793945-1152-432e-bdfb-b4d4a6354cae None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:59.194996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6793945-1152-432e-bdfb-b4d4a6354cae None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:59.283596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d3563-98c9-481f-b4f3-1c4f20ed9f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:59.284958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d3563-98c9-481f-b4f3-1c4f20ed9f21 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:59.285527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d3563-98c9-481f-b4f3-1c4f20ed9f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:59.286083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d3563-98c9-481f-b4f3-1c4f20ed9f21 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:59.287090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d3563-98c9-481f-b4f3-1c4f20ed9f21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:59.289563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d3563-98c9-481f-b4f3-1c4f20ed9f21 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:59.452853 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2944/5818] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:29:59 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:29:59.457442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cd4ec-3c4a-415b-a0dd-ea7349dbe7a0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:59.475466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cd4ec-3c4a-415b-a0dd-ea7349dbe7a0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:59.487504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200621e-4a92-4afc-8903-b376d267fb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:59.488200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200621e-4a92-4afc-8903-b376d267fb41 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:59.488486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200621e-4a92-4afc-8903-b376d267fb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:59.488767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200621e-4a92-4afc-8903-b376d267fb41 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:59.489688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200621e-4a92-4afc-8903-b376d267fb41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:59.491461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200621e-4a92-4afc-8903-b376d267fb41 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:59.516596 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2875/5819] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:29:59.521015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d3563-98c9-481f-b4f3-1c4f20ed9f21 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:59.536470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d3563-98c9-481f-b4f3-1c4f20ed9f21 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:59.542884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771b6d2-16fe-44fd-a740-e12a72ae4498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:59.545100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771b6d2-16fe-44fd-a740-e12a72ae4498 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:59.552392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771b6d2-16fe-44fd-a740-e12a72ae4498 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:59.552392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771b6d2-16fe-44fd-a740-e12a72ae4498 admin admin] PATH_INFO: `/v3/projects/2e102762876d40f69696af041843668e/users/ae873c1fdf3841b0968afdf31bf3f90e/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:59.572288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771b6d2-16fe-44fd-a740-e12a72ae4498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e102762876d40f69696af041843668e, user_id=ae873c1fdf3841b0968afdf31bf3f90e, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:59.576468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771b6d2-16fe-44fd-a740-e12a72ae4498 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:59.702513 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2945/5820] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:29:59 2022] PUT /identity/v3/projects/2e102762876d40f69696af041843668e/users/ae873c1fdf3841b0968afdf31bf3f90e/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:29:59.710187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200621e-4a92-4afc-8903-b376d267fb41 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:59.750731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200621e-4a92-4afc-8903-b376d267fb41 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:29:59.927495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8d6fa-edd3-4ec5-9bd2-b18c70d8cb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:29:59.929377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8d6fa-edd3-4ec5-9bd2-b18c70d8cb86 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:29:59.929881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8d6fa-edd3-4ec5-9bd2-b18c70d8cb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:29:59.930792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8d6fa-edd3-4ec5-9bd2-b18c70d8cb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:29:59.931944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8d6fa-edd3-4ec5-9bd2-b18c70d8cb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:29:59.934779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8d6fa-edd3-4ec5-9bd2-b18c70d8cb86 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:29:59.951733 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2876/5821] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:29:59.955399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771b6d2-16fe-44fd-a740-e12a72ae4498 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:29:59.996654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771b6d2-16fe-44fd-a740-e12a72ae4498 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:00.006289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ba383-6f4e-49b7-b02b-e0be2bad3324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:00.007908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ba383-6f4e-49b7-b02b-e0be2bad3324 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:00.008449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ba383-6f4e-49b7-b02b-e0be2bad3324 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:00.009320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ba383-6f4e-49b7-b02b-e0be2bad3324 admin admin] PATH_INFO: `/v3/projects/2e102762876d40f69696af041843668e/users/ae873c1fdf3841b0968afdf31bf3f90e/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:00.012235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ba383-6f4e-49b7-b02b-e0be2bad3324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e102762876d40f69696af041843668e, user_id=ae873c1fdf3841b0968afdf31bf3f90e, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:00.015835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ba383-6f4e-49b7-b02b-e0be2bad3324 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:00.038739 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2946/5822] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:29:59 2022] PUT /identity/v3/projects/2e102762876d40f69696af041843668e/users/ae873c1fdf3841b0968afdf31bf3f90e/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:00.052235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2c686-408c-4508-9b9c-811e4da0453f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:00.053366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2c686-408c-4508-9b9c-811e4da0453f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:00.053366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2c686-408c-4508-9b9c-811e4da0453f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:00.148655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-33c2c686-408c-4508-9b9c-811e4da0453f None None] MFA Rules not processed for user `ae873c1fdf3841b0968afdf31bf3f90e`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:00.152276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-33c2c686-408c-4508-9b9c-811e4da0453f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:00.176572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:00.252547 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2877/5823] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:00.257715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ba383-6f4e-49b7-b02b-e0be2bad3324 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:00.277736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ba383-6f4e-49b7-b02b-e0be2bad3324 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:00.290932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8871b0f-8885-4bf0-9b92-667ad93df913 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae873c1fdf3841b0968afdf31bf3f90e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e102762876d40f69696af041843668e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:00.293274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8871b0f-8885-4bf0-9b92-667ad93df913 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:00.295460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8871b0f-8885-4bf0-9b92-667ad93df913 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:00.295959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8871b0f-8885-4bf0-9b92-667ad93df913 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:00.297836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8871b0f-8885-4bf0-9b92-667ad93df913 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:00.304094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8871b0f-8885-4bf0-9b92-667ad93df913 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:00.543073 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2947/5824] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:00 2022] POST /identity/v3/projects => generated 350 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:00.547225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2c686-408c-4508-9b9c-811e4da0453f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:00.565056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2c686-408c-4508-9b9c-811e4da0453f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:00.694562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffc8da-bec8-4800-88b1-81b06796e1f1 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae873c1fdf3841b0968afdf31bf3f90e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e102762876d40f69696af041843668e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:00.695236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffc8da-bec8-4800-88b1-81b06796e1f1 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:00.695524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffc8da-bec8-4800-88b1-81b06796e1f1 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:00.695808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffc8da-bec8-4800-88b1-81b06796e1f1 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:00.696557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffc8da-bec8-4800-88b1-81b06796e1f1 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:00.699057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffc8da-bec8-4800-88b1-81b06796e1f1 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:00.887824 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2878/5825] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:00 2022] POST /identity/v3/projects => generated 351 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:00.892886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8871b0f-8885-4bf0-9b92-667ad93df913 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:00.910971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8871b0f-8885-4bf0-9b92-667ad93df913 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:00.967219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:01.046557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8423d-8ff0-46a9-837e-ab3b6014bc4a tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae873c1fdf3841b0968afdf31bf3f90e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e102762876d40f69696af041843668e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:01.050694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8423d-8ff0-46a9-837e-ab3b6014bc4a tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:01.050694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8423d-8ff0-46a9-837e-ab3b6014bc4a tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:01.050694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8423d-8ff0-46a9-837e-ab3b6014bc4a tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] PATH_INFO: `/v3/users/ec496bf826ef44e1af28769a26913981` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:01.050694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8423d-8ff0-46a9-837e-ab3b6014bc4a tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorizing `identity:get_user(user_id=ec496bf826ef44e1af28769a26913981)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:01.056130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8423d-8ff0-46a9-837e-ab3b6014bc4a tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:01.059133 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2948/5826] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Jul 16 21:30:00 2022] GET /identity/v3/users/ec496bf826ef44e1af28769a26913981 => generated 288 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:01.064357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffc8da-bec8-4800-88b1-81b06796e1f1 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:01.080733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffc8da-bec8-4800-88b1-81b06796e1f1 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:01.095109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc4bb5-c20a-40c1-b06f-c524388a62df tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae873c1fdf3841b0968afdf31bf3f90e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e102762876d40f69696af041843668e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:01.096831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc4bb5-c20a-40c1-b06f-c524388a62df tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:01.097132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc4bb5-c20a-40c1-b06f-c524388a62df tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:01.097562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc4bb5-c20a-40c1-b06f-c524388a62df tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] PATH_INFO: `/v3/credentials` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:01.098193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc4bb5-c20a-40c1-b06f-c524388a62df tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:01.101442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc4bb5-c20a-40c1-b06f-c524388a62df tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:01.231477 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2879/5827] 10.222.0.16 () {60 vars in 1161 bytes} [Sat Jul 16 21:30:01 2022] POST /identity/v3/credentials => generated 430 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:01.234944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8423d-8ff0-46a9-837e-ab3b6014bc4a tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:01.250368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8423d-8ff0-46a9-837e-ab3b6014bc4a tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:01.260515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18814dc7-ebda-426c-8187-e01f3c3b9b77 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae873c1fdf3841b0968afdf31bf3f90e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e102762876d40f69696af041843668e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:01.261540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18814dc7-ebda-426c-8187-e01f3c3b9b77 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:01.261856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18814dc7-ebda-426c-8187-e01f3c3b9b77 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:01.262106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18814dc7-ebda-426c-8187-e01f3c3b9b77 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] PATH_INFO: `/v3/credentials/45dfb1c8b2734f44fc96a86549bb1473456298faca4bf284c013f5820fb5b2c2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:01.269104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18814dc7-ebda-426c-8187-e01f3c3b9b77 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=45dfb1c8b2734f44fc96a86549bb1473456298faca4bf284c013f5820fb5b2c2)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:01.272365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18814dc7-ebda-426c-8187-e01f3c3b9b77 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:01.274565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18814dc7-ebda-426c-8187-e01f3c3b9b77 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=45dfb1c8b2734f44fc96a86549bb1473456298faca4bf284c013f5820fb5b2c2)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:01.277348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18814dc7-ebda-426c-8187-e01f3c3b9b77 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:01.369061 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2949/5828] 10.222.0.16 () {60 vars in 1357 bytes} [Sat Jul 16 21:30:01 2022] PATCH /identity/v3/credentials/45dfb1c8b2734f44fc96a86549bb1473456298faca4bf284c013f5820fb5b2c2 => generated 437 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:01.373412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc4bb5-c20a-40c1-b06f-c524388a62df tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:01.385717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc4bb5-c20a-40c1-b06f-c524388a62df tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:01.393354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d9957-c4ff-48ad-86f6-92ba35ec88a4 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae873c1fdf3841b0968afdf31bf3f90e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e102762876d40f69696af041843668e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:01.394694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d9957-c4ff-48ad-86f6-92ba35ec88a4 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:01.395171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d9957-c4ff-48ad-86f6-92ba35ec88a4 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:01.395625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d9957-c4ff-48ad-86f6-92ba35ec88a4 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] PATH_INFO: `/v3/credentials/45dfb1c8b2734f44fc96a86549bb1473456298faca4bf284c013f5820fb5b2c2` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:01.397970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d9957-c4ff-48ad-86f6-92ba35ec88a4 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=45dfb1c8b2734f44fc96a86549bb1473456298faca4bf284c013f5820fb5b2c2)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:01.400363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d9957-c4ff-48ad-86f6-92ba35ec88a4 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:01.403636 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2880/5829] 10.222.0.16 () {58 vars in 1334 bytes} [Sat Jul 16 21:30:01 2022] GET /identity/v3/credentials/45dfb1c8b2734f44fc96a86549bb1473456298faca4bf284c013f5820fb5b2c2 => generated 437 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:01.408822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18814dc7-ebda-426c-8187-e01f3c3b9b77 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:01.422979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18814dc7-ebda-426c-8187-e01f3c3b9b77 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:01.438199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7ddf1-b45b-4f79-ae46-43d4727559bd tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae873c1fdf3841b0968afdf31bf3f90e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e102762876d40f69696af041843668e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:01.438199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7ddf1-b45b-4f79-ae46-43d4727559bd tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:01.438199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7ddf1-b45b-4f79-ae46-43d4727559bd tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:01.438456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7ddf1-b45b-4f79-ae46-43d4727559bd tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] PATH_INFO: `/v3/credentials/45dfb1c8b2734f44fc96a86549bb1473456298faca4bf284c013f5820fb5b2c2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:01.441174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7ddf1-b45b-4f79-ae46-43d4727559bd tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=45dfb1c8b2734f44fc96a86549bb1473456298faca4bf284c013f5820fb5b2c2)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:01.445678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7ddf1-b45b-4f79-ae46-43d4727559bd tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:01.618697 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2950/5830] 10.222.0.16 () {58 vars in 1337 bytes} [Sat Jul 16 21:30:01 2022] DELETE /identity/v3/credentials/45dfb1c8b2734f44fc96a86549bb1473456298faca4bf284c013f5820fb5b2c2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:01.632065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d9957-c4ff-48ad-86f6-92ba35ec88a4 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:01.649797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d9957-c4ff-48ad-86f6-92ba35ec88a4 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:01.672636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22c4de-1486-44ef-8bcd-498ce2ea0110 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae873c1fdf3841b0968afdf31bf3f90e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e102762876d40f69696af041843668e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:01.673333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22c4de-1486-44ef-8bcd-498ce2ea0110 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:01.673627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22c4de-1486-44ef-8bcd-498ce2ea0110 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:01.673914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22c4de-1486-44ef-8bcd-498ce2ea0110 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] PATH_INFO: `/v3/credentials` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:01.674691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22c4de-1486-44ef-8bcd-498ce2ea0110 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:01.679729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22c4de-1486-44ef-8bcd-498ce2ea0110 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:01.768914 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2881/5831] 10.222.0.16 () {60 vars in 1161 bytes} [Sat Jul 16 21:30:01 2022] POST /identity/v3/credentials => generated 429 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:01.770809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7ddf1-b45b-4f79-ae46-43d4727559bd tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:01.796945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7ddf1-b45b-4f79-ae46-43d4727559bd tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:01.812097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1c9f2-e7fc-4f4a-a49a-9b962df9b2f6 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae873c1fdf3841b0968afdf31bf3f90e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e102762876d40f69696af041843668e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:01.812781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1c9f2-e7fc-4f4a-a49a-9b962df9b2f6 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:01.813070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1c9f2-e7fc-4f4a-a49a-9b962df9b2f6 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:01.813352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1c9f2-e7fc-4f4a-a49a-9b962df9b2f6 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] PATH_INFO: `/v3/credentials` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:01.814296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1c9f2-e7fc-4f4a-a49a-9b962df9b2f6 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:01.826615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1c9f2-e7fc-4f4a-a49a-9b962df9b2f6 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:02.018732 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2951/5832] 10.222.0.16 () {60 vars in 1161 bytes} [Sat Jul 16 21:30:01 2022] POST /identity/v3/credentials => generated 431 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:02.020046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22c4de-1486-44ef-8bcd-498ce2ea0110 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:02.045158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22c4de-1486-44ef-8bcd-498ce2ea0110 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:02.070143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d657f4a-33d6-42bb-a15f-4c1a3d6f4e28 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae873c1fdf3841b0968afdf31bf3f90e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e102762876d40f69696af041843668e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:02.071568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d657f4a-33d6-42bb-a15f-4c1a3d6f4e28 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:02.071568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d657f4a-33d6-42bb-a15f-4c1a3d6f4e28 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:02.071568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d657f4a-33d6-42bb-a15f-4c1a3d6f4e28 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] PATH_INFO: `/v3/credentials` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:02.085181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d657f4a-33d6-42bb-a15f-4c1a3d6f4e28 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:02.086813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d657f4a-33d6-42bb-a15f-4c1a3d6f4e28 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:02.114324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d657f4a-33d6-42bb-a15f-4c1a3d6f4e28 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:02.117246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d657f4a-33d6-42bb-a15f-4c1a3d6f4e28 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:02.122879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d657f4a-33d6-42bb-a15f-4c1a3d6f4e28 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:02.128791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d657f4a-33d6-42bb-a15f-4c1a3d6f4e28 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:02.138009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1c9f2-e7fc-4f4a-a49a-9b962df9b2f6 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:02.163924 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2882/5833] 10.222.0.16 () {58 vars in 1139 bytes} [Sat Jul 16 21:30:02 2022] GET /identity/v3/credentials => generated 945 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:02.167533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1c9f2-e7fc-4f4a-a49a-9b962df9b2f6 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:02.194326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2658e-1881-49b0-b032-c99f093d387a tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae873c1fdf3841b0968afdf31bf3f90e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e102762876d40f69696af041843668e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:02.195405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2658e-1881-49b0-b032-c99f093d387a tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:02.195677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2658e-1881-49b0-b032-c99f093d387a tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:02.199199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2658e-1881-49b0-b032-c99f093d387a tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] PATH_INFO: `/v3/credentials/456f3386fa39910b023146fa84670fb623b61ee910bafd5e14f35da599a3c848` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:02.210126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2658e-1881-49b0-b032-c99f093d387a tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=456f3386fa39910b023146fa84670fb623b61ee910bafd5e14f35da599a3c848)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:02.211761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2658e-1881-49b0-b032-c99f093d387a tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:02.392679 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2952/5834] 10.222.0.16 () {58 vars in 1337 bytes} [Sat Jul 16 21:30:02 2022] DELETE /identity/v3/credentials/456f3386fa39910b023146fa84670fb623b61ee910bafd5e14f35da599a3c848 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:02.395509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d657f4a-33d6-42bb-a15f-4c1a3d6f4e28 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:02.429400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d657f4a-33d6-42bb-a15f-4c1a3d6f4e28 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:02.458679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9790c-40c5-4b09-ae20-9f83c6de746c tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae873c1fdf3841b0968afdf31bf3f90e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e102762876d40f69696af041843668e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:02.459601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9790c-40c5-4b09-ae20-9f83c6de746c tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:02.459876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9790c-40c5-4b09-ae20-9f83c6de746c tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:02.460149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9790c-40c5-4b09-ae20-9f83c6de746c tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] PATH_INFO: `/v3/credentials/f92997f6e8b85df041b87914bfa36a75fa8a58827ed624e36612e0838e3ed02d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:02.468241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9790c-40c5-4b09-ae20-9f83c6de746c tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=f92997f6e8b85df041b87914bfa36a75fa8a58827ed624e36612e0838e3ed02d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:02.474994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9790c-40c5-4b09-ae20-9f83c6de746c tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:02.589013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2658e-1881-49b0-b032-c99f093d387a tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:02.596798 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2883/5835] 10.222.0.16 () {58 vars in 1337 bytes} [Sat Jul 16 21:30:02 2022] DELETE /identity/v3/credentials/f92997f6e8b85df041b87914bfa36a75fa8a58827ed624e36612e0838e3ed02d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:02.606224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2658e-1881-49b0-b032-c99f093d387a tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:02.616759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1f413-367c-46ef-a31f-4c970c9e4e92 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae873c1fdf3841b0968afdf31bf3f90e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e102762876d40f69696af041843668e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:02.619177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1f413-367c-46ef-a31f-4c970c9e4e92 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:02.620605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1f413-367c-46ef-a31f-4c970c9e4e92 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:02.621134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1f413-367c-46ef-a31f-4c970c9e4e92 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] PATH_INFO: `/v3/projects/14b91b61dd0d482b84a112c56321911a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:02.622706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1f413-367c-46ef-a31f-4c970c9e4e92 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorizing `identity:delete_project(project_id=14b91b61dd0d482b84a112c56321911a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:02.625901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1f413-367c-46ef-a31f-4c970c9e4e92 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:02.835072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-66f1f413-367c-46ef-a31f-4c970c9e4e92 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14b91b61dd0d482b84a112c56321911a', 'request_id': 'req-66f1f413-367c-46ef-a31f-4c970c9e4e92'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:02.850817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-66f1f413-367c-46ef-a31f-4c970c9e4e92 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14b91b61dd0d482b84a112c56321911a', 'request_id': 'req-66f1f413-367c-46ef-a31f-4c970c9e4e92'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:02.866992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-66f1f413-367c-46ef-a31f-4c970c9e4e92 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14b91b61dd0d482b84a112c56321911a', 'request_id': 'req-66f1f413-367c-46ef-a31f-4c970c9e4e92'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:02.999450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-66f1f413-367c-46ef-a31f-4c970c9e4e92 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] The token cache is being invalidate because project 14b91b61dd0d482b84a112c56321911a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:03.000800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-66f1f413-367c-46ef-a31f-4c970c9e4e92 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:03.001523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-66f1f413-367c-46ef-a31f-4c970c9e4e92 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:03.009101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9790c-40c5-4b09-ae20-9f83c6de746c tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:03.011805 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2953/5836] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:02 2022] DELETE /identity/v3/projects/14b91b61dd0d482b84a112c56321911a => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:03.013066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-24c9790c-40c5-4b09-ae20-9f83c6de746c tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:03.031857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9790c-40c5-4b09-ae20-9f83c6de746c tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:03.184437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:03.240937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7068f90-b72c-4241-9dcb-4678097ea001 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae873c1fdf3841b0968afdf31bf3f90e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e102762876d40f69696af041843668e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:03.240937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7068f90-b72c-4241-9dcb-4678097ea001 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:03.240937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7068f90-b72c-4241-9dcb-4678097ea001 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:03.245299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7068f90-b72c-4241-9dcb-4678097ea001 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] PATH_INFO: `/v3/projects/687365abae6447ed8f324a0f9bbd21a0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:03.246044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7068f90-b72c-4241-9dcb-4678097ea001 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorizing `identity:delete_project(project_id=687365abae6447ed8f324a0f9bbd21a0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:03.249142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7068f90-b72c-4241-9dcb-4678097ea001 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:03.487675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e7068f90-b72c-4241-9dcb-4678097ea001 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '687365abae6447ed8f324a0f9bbd21a0', 'request_id': 'req-e7068f90-b72c-4241-9dcb-4678097ea001'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:03.503749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e7068f90-b72c-4241-9dcb-4678097ea001 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '687365abae6447ed8f324a0f9bbd21a0', 'request_id': 'req-e7068f90-b72c-4241-9dcb-4678097ea001'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:03.526531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e7068f90-b72c-4241-9dcb-4678097ea001 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '687365abae6447ed8f324a0f9bbd21a0', 'request_id': 'req-e7068f90-b72c-4241-9dcb-4678097ea001'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:03.639891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e7068f90-b72c-4241-9dcb-4678097ea001 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] The token cache is being invalidate because project 687365abae6447ed8f324a0f9bbd21a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:03.640262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e7068f90-b72c-4241-9dcb-4678097ea001 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:03.641546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e7068f90-b72c-4241-9dcb-4678097ea001 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:03.649059 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2884/5837] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:03 2022] DELETE /identity/v3/projects/687365abae6447ed8f324a0f9bbd21a0 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:03.657628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1f413-367c-46ef-a31f-4c970c9e4e92 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:03.659443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-66f1f413-367c-46ef-a31f-4c970c9e4e92 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:03.828847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=9,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:03.836565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1f413-367c-46ef-a31f-4c970c9e4e92 tempest-CredentialsTestJSON-499902747 tempest-CredentialsTestJSON-499902747-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:03.968504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6411c1-1e89-4c7e-89d5-0dee87b98d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:03.968919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6411c1-1e89-4c7e-89d5-0dee87b98d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:03.969293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6411c1-1e89-4c7e-89d5-0dee87b98d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:03.969642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6411c1-1e89-4c7e-89d5-0dee87b98d73 admin admin] PATH_INFO: `/v3/users/ec496bf826ef44e1af28769a26913981` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:03.971316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6411c1-1e89-4c7e-89d5-0dee87b98d73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec496bf826ef44e1af28769a26913981)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:03.973447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6411c1-1e89-4c7e-89d5-0dee87b98d73 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:04.339682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-df6411c1-1e89-4c7e-89d5-0dee87b98d73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec496bf826ef44e1af28769a26913981'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:04.351847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-df6411c1-1e89-4c7e-89d5-0dee87b98d73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec496bf826ef44e1af28769a26913981'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:04.463861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-df6411c1-1e89-4c7e-89d5-0dee87b98d73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec496bf826ef44e1af28769a26913981'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:04.466017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-df6411c1-1e89-4c7e-89d5-0dee87b98d73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec496bf826ef44e1af28769a26913981'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:04.485568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-df6411c1-1e89-4c7e-89d5-0dee87b98d73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec496bf826ef44e1af28769a26913981'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:04.500143 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2954/5838] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:03 2022] DELETE /identity/v3/users/ec496bf826ef44e1af28769a26913981 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:04.505531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0a408-4a96-4616-acef-af9541d47a0e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:04.506433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0a408-4a96-4616-acef-af9541d47a0e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:04.506957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0a408-4a96-4616-acef-af9541d47a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:04.563211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-dda0a408-4a96-4616-acef-af9541d47a0e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:04.563211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-dda0a408-4a96-4616-acef-af9541d47a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:04.673422 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2885/5839] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:04.686524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6411c1-1e89-4c7e-89d5-0dee87b98d73 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:04.688510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-df6411c1-1e89-4c7e-89d5-0dee87b98d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:04.852783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6411c1-1e89-4c7e-89d5-0dee87b98d73 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:04.894000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd9c4b-c02d-4e34-8d35-6033cbc7c8a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:04.894891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd9c4b-c02d-4e34-8d35-6033cbc7c8a6 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:04.895273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd9c4b-c02d-4e34-8d35-6033cbc7c8a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:04.895544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd9c4b-c02d-4e34-8d35-6033cbc7c8a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:04.927404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd9c4b-c02d-4e34-8d35-6033cbc7c8a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:04.927555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd9c4b-c02d-4e34-8d35-6033cbc7c8a6 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:04.965936 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2955/5840] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:30:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:30:05.760599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0a408-4a96-4616-acef-af9541d47a0e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:05.760599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-dda0a408-4a96-4616-acef-af9541d47a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:05.893856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0a408-4a96-4616-acef-af9541d47a0e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:05.900246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52089d-bb19-4fb1-afa0-650fc5df9c66 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:05.901844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52089d-bb19-4fb1-afa0-650fc5df9c66 service glance] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:05.902362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52089d-bb19-4fb1-afa0-650fc5df9c66 service glance] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:05.902735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52089d-bb19-4fb1-afa0-650fc5df9c66 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:05.906765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2a52089d-bb19-4fb1-afa0-650fc5df9c66 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:05.970148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:06.090517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52089d-bb19-4fb1-afa0-650fc5df9c66 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:06.092044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52089d-bb19-4fb1-afa0-650fc5df9c66 service glance] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:06.115441 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2886/5841] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:30:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:30:06.167549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd9c4b-c02d-4e34-8d35-6033cbc7c8a6 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:06.175901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5edd9c4b-c02d-4e34-8d35-6033cbc7c8a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:06.204481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd9c4b-c02d-4e34-8d35-6033cbc7c8a6 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:06.217279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c667f6-3876-45e7-aa13-66fb3ba3c1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:06.218144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c667f6-3876-45e7-aa13-66fb3ba3c1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:06.218585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c667f6-3876-45e7-aa13-66fb3ba3c1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:06.218864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c667f6-3876-45e7-aa13-66fb3ba3c1b8 admin admin] PATH_INFO: `/v3/users/df066ff4bdcf42b58e2bacc3e8955bbb` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:06.220834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c667f6-3876-45e7-aa13-66fb3ba3c1b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df066ff4bdcf42b58e2bacc3e8955bbb)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:06.223177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c667f6-3876-45e7-aa13-66fb3ba3c1b8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:06.438353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52089d-bb19-4fb1-afa0-650fc5df9c66 service glance] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:06.439803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2a52089d-bb19-4fb1-afa0-650fc5df9c66 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:06.460715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52089d-bb19-4fb1-afa0-650fc5df9c66 service glance] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:06.466994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e68941-609b-40ca-991d-a599dcde793b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:06.468150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e68941-609b-40ca-991d-a599dcde793b service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:06.468985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e68941-609b-40ca-991d-a599dcde793b service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:06.469463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e68941-609b-40ca-991d-a599dcde793b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:06.472250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-65e68941-609b-40ca-991d-a599dcde793b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:06.488199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16c667f6-3876-45e7-aa13-66fb3ba3c1b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df066ff4bdcf42b58e2bacc3e8955bbb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:06.495805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e68941-609b-40ca-991d-a599dcde793b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:06.504416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e68941-609b-40ca-991d-a599dcde793b service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:06.517933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16c667f6-3876-45e7-aa13-66fb3ba3c1b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df066ff4bdcf42b58e2bacc3e8955bbb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:06.521759 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2887/5842] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:30:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:30:06.522749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e68941-609b-40ca-991d-a599dcde793b service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:06.525145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-65e68941-609b-40ca-991d-a599dcde793b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:06.560157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e68941-609b-40ca-991d-a599dcde793b service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:06.566277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6bcf3-ac27-4e6c-be57-937c7cd0685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:06.567292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6bcf3-ac27-4e6c-be57-937c7cd0685d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:06.567781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6bcf3-ac27-4e6c-be57-937c7cd0685d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:06.568193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6bcf3-ac27-4e6c-be57-937c7cd0685d admin admin] PATH_INFO: `/v3/projects/5f0aa3e3ee654c2abe38034e5a754b4a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:06.570042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6bcf3-ac27-4e6c-be57-937c7cd0685d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f0aa3e3ee654c2abe38034e5a754b4a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:06.576029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6bcf3-ac27-4e6c-be57-937c7cd0685d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:06.638377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16c667f6-3876-45e7-aa13-66fb3ba3c1b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df066ff4bdcf42b58e2bacc3e8955bbb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:06.639125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16c667f6-3876-45e7-aa13-66fb3ba3c1b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df066ff4bdcf42b58e2bacc3e8955bbb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:06.655543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16c667f6-3876-45e7-aa13-66fb3ba3c1b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df066ff4bdcf42b58e2bacc3e8955bbb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:06.665560 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2956/5843] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:06 2022] DELETE /identity/v3/users/df066ff4bdcf42b58e2bacc3e8955bbb => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:06.787295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4ea6bcf3-ac27-4e6c-be57-937c7cd0685d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f0aa3e3ee654c2abe38034e5a754b4a', 'request_id': 'req-4ea6bcf3-ac27-4e6c-be57-937c7cd0685d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:06.796712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c667f6-3876-45e7-aa13-66fb3ba3c1b8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:06.798409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-16c667f6-3876-45e7-aa13-66fb3ba3c1b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:06.802354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4ea6bcf3-ac27-4e6c-be57-937c7cd0685d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f0aa3e3ee654c2abe38034e5a754b4a', 'request_id': 'req-4ea6bcf3-ac27-4e6c-be57-937c7cd0685d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:06.848102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4ea6bcf3-ac27-4e6c-be57-937c7cd0685d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f0aa3e3ee654c2abe38034e5a754b4a', 'request_id': 'req-4ea6bcf3-ac27-4e6c-be57-937c7cd0685d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:06.910994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c667f6-3876-45e7-aa13-66fb3ba3c1b8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:06.972525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb505c3-7a7e-4410-8cf4-1031ad3d34b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:06.973253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb505c3-7a7e-4410-8cf4-1031ad3d34b8 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:06.973637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb505c3-7a7e-4410-8cf4-1031ad3d34b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:06.974146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb505c3-7a7e-4410-8cf4-1031ad3d34b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:06.976338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-aeb505c3-7a7e-4410-8cf4-1031ad3d34b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:06.988806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4ea6bcf3-ac27-4e6c-be57-937c7cd0685d admin admin] The token cache is being invalidate because project 5f0aa3e3ee654c2abe38034e5a754b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:06.989585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4ea6bcf3-ac27-4e6c-be57-937c7cd0685d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:06.991412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4ea6bcf3-ac27-4e6c-be57-937c7cd0685d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:06.994419 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2888/5844] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:06 2022] DELETE /identity/v3/projects/5f0aa3e3ee654c2abe38034e5a754b4a => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:06.999816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6bcf3-ac27-4e6c-be57-937c7cd0685d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:07.002344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4ea6bcf3-ac27-4e6c-be57-937c7cd0685d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:07.130150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb505c3-7a7e-4410-8cf4-1031ad3d34b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:07.130370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6bcf3-ac27-4e6c-be57-937c7cd0685d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:07.131995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb505c3-7a7e-4410-8cf4-1031ad3d34b8 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:07.137321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6337e0-b4f5-404e-b907-d94fb633d236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:07.138623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6337e0-b4f5-404e-b907-d94fb633d236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:07.139120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6337e0-b4f5-404e-b907-d94fb633d236 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:07.139544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6337e0-b4f5-404e-b907-d94fb633d236 admin admin] PATH_INFO: `/v3/users/ae873c1fdf3841b0968afdf31bf3f90e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:07.143385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6337e0-b4f5-404e-b907-d94fb633d236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae873c1fdf3841b0968afdf31bf3f90e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:07.146075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6337e0-b4f5-404e-b907-d94fb633d236 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:07.154357 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2957/5845] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:30:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:30:07.157987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb505c3-7a7e-4410-8cf4-1031ad3d34b8 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:07.159810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-aeb505c3-7a7e-4410-8cf4-1031ad3d34b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:07.194547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb505c3-7a7e-4410-8cf4-1031ad3d34b8 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:07.200347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c1354-c8b2-443b-a83b-c6f11b32d1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:07.204791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c1354-c8b2-443b-a83b-c6f11b32d1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:07.204791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c1354-c8b2-443b-a83b-c6f11b32d1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:07.204791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c1354-c8b2-443b-a83b-c6f11b32d1d0 admin admin] PATH_INFO: `/v3/projects/1b43d8433a044bd1aec29c4be23f6ac0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:07.204791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c1354-c8b2-443b-a83b-c6f11b32d1d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b43d8433a044bd1aec29c4be23f6ac0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:07.205501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c1354-c8b2-443b-a83b-c6f11b32d1d0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:07.452747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:07.499662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ae6337e0-b4f5-404e-b907-d94fb633d236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae873c1fdf3841b0968afdf31bf3f90e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:07.501845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ae0c1354-c8b2-443b-a83b-c6f11b32d1d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b43d8433a044bd1aec29c4be23f6ac0', 'request_id': 'req-ae0c1354-c8b2-443b-a83b-c6f11b32d1d0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:07.508525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ae0c1354-c8b2-443b-a83b-c6f11b32d1d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b43d8433a044bd1aec29c4be23f6ac0', 'request_id': 'req-ae0c1354-c8b2-443b-a83b-c6f11b32d1d0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:07.516439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ae0c1354-c8b2-443b-a83b-c6f11b32d1d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b43d8433a044bd1aec29c4be23f6ac0', 'request_id': 'req-ae0c1354-c8b2-443b-a83b-c6f11b32d1d0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:07.520004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ae6337e0-b4f5-404e-b907-d94fb633d236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae873c1fdf3841b0968afdf31bf3f90e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:07.696080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ae0c1354-c8b2-443b-a83b-c6f11b32d1d0 admin admin] The token cache is being invalidate because project 1b43d8433a044bd1aec29c4be23f6ac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:07.711982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ae0c1354-c8b2-443b-a83b-c6f11b32d1d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:07.711982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ae0c1354-c8b2-443b-a83b-c6f11b32d1d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:07.711982 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2958/5846] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:07 2022] DELETE /identity/v3/projects/1b43d8433a044bd1aec29c4be23f6ac0 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:07.717999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f58992-6a57-477c-9080-41ca91ae6329 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:07.718319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f58992-6a57-477c-9080-41ca91ae6329 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:07.718628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f58992-6a57-477c-9080-41ca91ae6329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:07.750711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-23f58992-6a57-477c-9080-41ca91ae6329 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:07.756327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-23f58992-6a57-477c-9080-41ca91ae6329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:07.831197 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2959/5847] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:07.840834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87032938-e789-4409-8e91-2d2b283fe4dc None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:07.841122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87032938-e789-4409-8e91-2d2b283fe4dc None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:07.841398 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87032938-e789-4409-8e91-2d2b283fe4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:07.867514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-87032938-e789-4409-8e91-2d2b283fe4dc None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:07.868734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-87032938-e789-4409-8e91-2d2b283fe4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:07.880202 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2960/5848] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:07.882262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87032938-e789-4409-8e91-2d2b283fe4dc None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:07.892808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87032938-e789-4409-8e91-2d2b283fe4dc None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:07.897464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca021f4-8f00-44b4-8997-e0a5903b9753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:07.898115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca021f4-8f00-44b4-8997-e0a5903b9753 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:07.898396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca021f4-8f00-44b4-8997-e0a5903b9753 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:07.898702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca021f4-8f00-44b4-8997-e0a5903b9753 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:07.899464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca021f4-8f00-44b4-8997-e0a5903b9753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:30:07.899774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca021f4-8f00-44b4-8997-e0a5903b9753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:07.901407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca021f4-8f00-44b4-8997-e0a5903b9753 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:07.913450 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2961/5849] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:30:07.919342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca021f4-8f00-44b4-8997-e0a5903b9753 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:07.932309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca021f4-8f00-44b4-8997-e0a5903b9753 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:07.937315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8784c5-b51c-488e-8368-f8f76e9604c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:07.938239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8784c5-b51c-488e-8368-f8f76e9604c9 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:07.938523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8784c5-b51c-488e-8368-f8f76e9604c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:07.938804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8784c5-b51c-488e-8368-f8f76e9604c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:07.939549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8784c5-b51c-488e-8368-f8f76e9604c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:07.941481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8784c5-b51c-488e-8368-f8f76e9604c9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:07.971499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ae6337e0-b4f5-404e-b907-d94fb633d236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae873c1fdf3841b0968afdf31bf3f90e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:07.985322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ae6337e0-b4f5-404e-b907-d94fb633d236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae873c1fdf3841b0968afdf31bf3f90e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:07.986552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ae6337e0-b4f5-404e-b907-d94fb633d236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae873c1fdf3841b0968afdf31bf3f90e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:07.998164 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2889/5850] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:06 2022] DELETE /identity/v3/users/ae873c1fdf3841b0968afdf31bf3f90e => generated 0 bytes in 1000 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:08.038264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6337e0-b4f5-404e-b907-d94fb633d236 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:08.039091 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2962/5851] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:07 2022] POST /identity/v3/projects => generated 403 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:30:08.040594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ae6337e0-b4f5-404e-b907-d94fb633d236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:08.153702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6337e0-b4f5-404e-b907-d94fb633d236 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:08.247465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c433c62-6dc8-4cc6-b0e4-17d996a523a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:08.248426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c433c62-6dc8-4cc6-b0e4-17d996a523a6 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:08.248790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c433c62-6dc8-4cc6-b0e4-17d996a523a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:08.249138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c433c62-6dc8-4cc6-b0e4-17d996a523a6 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:08.249910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c433c62-6dc8-4cc6-b0e4-17d996a523a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:08.252639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c433c62-6dc8-4cc6-b0e4-17d996a523a6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:08.390764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8784c5-b51c-488e-8368-f8f76e9604c9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:08.393425 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2890/5852] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:08 2022] POST /identity/v3/users => generated 302 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:08.406496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8784c5-b51c-488e-8368-f8f76e9604c9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:08.419163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fcb67-247b-48c4-bc47-9564af80a554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:08.419163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fcb67-247b-48c4-bc47-9564af80a554 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:08.419407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fcb67-247b-48c4-bc47-9564af80a554 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:08.419767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fcb67-247b-48c4-bc47-9564af80a554 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:08.421542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fcb67-247b-48c4-bc47-9564af80a554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:08.425914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fcb67-247b-48c4-bc47-9564af80a554 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:08.449381 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2963/5853] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:08.465601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c433c62-6dc8-4cc6-b0e4-17d996a523a6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:08.470205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c433c62-6dc8-4cc6-b0e4-17d996a523a6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:08.475710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ef0db-ffa6-4ef7-9f26-36d7a0fd4011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:08.476357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ef0db-ffa6-4ef7-9f26-36d7a0fd4011 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:08.476777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ef0db-ffa6-4ef7-9f26-36d7a0fd4011 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:08.477132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ef0db-ffa6-4ef7-9f26-36d7a0fd4011 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:08.478174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ef0db-ffa6-4ef7-9f26-36d7a0fd4011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:08.480576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ef0db-ffa6-4ef7-9f26-36d7a0fd4011 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:08.495850 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2891/5854] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:08.500359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fcb67-247b-48c4-bc47-9564af80a554 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:08.512580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fcb67-247b-48c4-bc47-9564af80a554 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:08.518271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d3f4f-df42-406a-a8ad-c056bff1e53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:08.519478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d3f4f-df42-406a-a8ad-c056bff1e53c admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:08.522915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d3f4f-df42-406a-a8ad-c056bff1e53c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:08.522915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d3f4f-df42-406a-a8ad-c056bff1e53c admin admin] PATH_INFO: `/v3/projects/af6a8488a21947fbbe7ab4b11ca9549f/users/d22d6190b9c946fb9e7aa024af388531/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:08.544524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d3f4f-df42-406a-a8ad-c056bff1e53c admin admin] RBAC: Authorizing `identity:create_grant(project_id=af6a8488a21947fbbe7ab4b11ca9549f, user_id=d22d6190b9c946fb9e7aa024af388531, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:08.547427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d3f4f-df42-406a-a8ad-c056bff1e53c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:08.618737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:08.627124 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2964/5855] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:08 2022] PUT /identity/v3/projects/af6a8488a21947fbbe7ab4b11ca9549f/users/d22d6190b9c946fb9e7aa024af388531/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:08.640735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1a5d5-b5dc-4f16-8531-e3c6cfbeaaee None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:08.653481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1a5d5-b5dc-4f16-8531-e3c6cfbeaaee None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:08.653481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1a5d5-b5dc-4f16-8531-e3c6cfbeaaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:08.711304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ccf1a5d5-b5dc-4f16-8531-e3c6cfbeaaee None None] MFA Rules not processed for user `d22d6190b9c946fb9e7aa024af388531`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:08.712793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ccf1a5d5-b5dc-4f16-8531-e3c6cfbeaaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:08.816300 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2892/5856] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:08.836534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d3f4f-df42-406a-a8ad-c056bff1e53c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:08.957724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d3f4f-df42-406a-a8ad-c056bff1e53c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:08.965382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e60e08-3fee-4ede-9657-9c45125177ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:08.966545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e60e08-3fee-4ede-9657-9c45125177ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:08.966828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e60e08-3fee-4ede-9657-9c45125177ce admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:08.967232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e60e08-3fee-4ede-9657-9c45125177ce admin admin] PATH_INFO: `/v3/users/d22d6190b9c946fb9e7aa024af388531` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:08.968470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e60e08-3fee-4ede-9657-9c45125177ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d22d6190b9c946fb9e7aa024af388531)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:08.970705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e60e08-3fee-4ede-9657-9c45125177ce admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:09.007224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1a5d5-b5dc-4f16-8531-e3c6cfbeaaee None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:09.008971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ccf1a5d5-b5dc-4f16-8531-e3c6cfbeaaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:09.026884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1a5d5-b5dc-4f16-8531-e3c6cfbeaaee None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:09.033777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f283f2-e728-4860-b114-75375f38d050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:09.035118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f283f2-e728-4860-b114-75375f38d050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:09.035904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f283f2-e728-4860-b114-75375f38d050 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:09.036405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f283f2-e728-4860-b114-75375f38d050 admin admin] PATH_INFO: `/v3/projects/2e102762876d40f69696af041843668e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:09.038176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f283f2-e728-4860-b114-75375f38d050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e102762876d40f69696af041843668e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:09.043747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f283f2-e728-4860-b114-75375f38d050 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:09.276077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f7f283f2-e728-4860-b114-75375f38d050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e102762876d40f69696af041843668e', 'request_id': 'req-f7f283f2-e728-4860-b114-75375f38d050'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:09.279728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f3e60e08-3fee-4ede-9657-9c45125177ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd22d6190b9c946fb9e7aa024af388531'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:09.295170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f7f283f2-e728-4860-b114-75375f38d050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e102762876d40f69696af041843668e', 'request_id': 'req-f7f283f2-e728-4860-b114-75375f38d050'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:09.304545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f3e60e08-3fee-4ede-9657-9c45125177ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd22d6190b9c946fb9e7aa024af388531'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:09.312211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f7f283f2-e728-4860-b114-75375f38d050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e102762876d40f69696af041843668e', 'request_id': 'req-f7f283f2-e728-4860-b114-75375f38d050'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:09.395088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f3e60e08-3fee-4ede-9657-9c45125177ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd22d6190b9c946fb9e7aa024af388531'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:09.395843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f3e60e08-3fee-4ede-9657-9c45125177ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd22d6190b9c946fb9e7aa024af388531'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:09.410604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f3e60e08-3fee-4ede-9657-9c45125177ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd22d6190b9c946fb9e7aa024af388531'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:09.419620 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2965/5857] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:08 2022] DELETE /identity/v3/users/d22d6190b9c946fb9e7aa024af388531 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:09.421541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed7a7e-9550-47a2-963c-be4ba15bfdd1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:09.422043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed7a7e-9550-47a2-963c-be4ba15bfdd1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:09.422554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed7a7e-9550-47a2-963c-be4ba15bfdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:09.441762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-15ed7a7e-9550-47a2-963c-be4ba15bfdd1 None None] MFA Rules not processed for user `4ddfae3448704591b662de83b97a1876`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:09.443152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-15ed7a7e-9550-47a2-963c-be4ba15bfdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:09.504505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f7f283f2-e728-4860-b114-75375f38d050 admin admin] The token cache is being invalidate because project 2e102762876d40f69696af041843668e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:09.505673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f7f283f2-e728-4860-b114-75375f38d050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:09.507957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f7f283f2-e728-4860-b114-75375f38d050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:09.514740 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2893/5858] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:09 2022] DELETE /identity/v3/projects/2e102762876d40f69696af041843668e => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:09.516608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443b4a4-68e9-45a1-8ca3-33db217b0779 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:09.517852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443b4a4-68e9-45a1-8ca3-33db217b0779 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:09.518909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443b4a4-68e9-45a1-8ca3-33db217b0779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:09.560119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2443b4a4-68e9-45a1-8ca3-33db217b0779 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:09.564217 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2966/5859] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:09.565189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2443b4a4-68e9-45a1-8ca3-33db217b0779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:09.565961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b04eb-3186-4ac5-8f1a-5fb8136033b2 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:09.566265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b04eb-3186-4ac5-8f1a-5fb8136033b2 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:09.566610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b04eb-3186-4ac5-8f1a-5fb8136033b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:09.591794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:09.603309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6e9b04eb-3186-4ac5-8f1a-5fb8136033b2 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:09.605636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6e9b04eb-3186-4ac5-8f1a-5fb8136033b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:09.656355 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2894/5860] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:09.669936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443b4a4-68e9-45a1-8ca3-33db217b0779 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:09.675790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2443b4a4-68e9-45a1-8ca3-33db217b0779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:09.732931 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2967/5861] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:09.739093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf6370-231d-4db3-8f1f-84045ca95c62 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:09.739427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf6370-231d-4db3-8f1f-84045ca95c62 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:09.739731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf6370-231d-4db3-8f1f-84045ca95c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:09.752492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443b4a4-68e9-45a1-8ca3-33db217b0779 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:09.757447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8e06c-9268-44c3-9b90-d1346119d2a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:09.758348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8e06c-9268-44c3-9b90-d1346119d2a3 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:09.758830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8e06c-9268-44c3-9b90-d1346119d2a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:09.759223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8e06c-9268-44c3-9b90-d1346119d2a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:09.763429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-eadf6370-231d-4db3-8f1f-84045ca95c62 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:09.764658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-eadf6370-231d-4db3-8f1f-84045ca95c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:09.776478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8e06c-9268-44c3-9b90-d1346119d2a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:09.778176 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2968/5862] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:09.778318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8e06c-9268-44c3-9b90-d1346119d2a3 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:09.785268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf6370-231d-4db3-8f1f-84045ca95c62 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:09.792934 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2895/5863] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:30:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:30:09.812072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf6370-231d-4db3-8f1f-84045ca95c62 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:09.818994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf5ec5-3a9a-4b2c-8d31-8b79a8c7a8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:09.818994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf5ec5-3a9a-4b2c-8d31-8b79a8c7a8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:09.818994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf5ec5-3a9a-4b2c-8d31-8b79a8c7a8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:09.818994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf5ec5-3a9a-4b2c-8d31-8b79a8c7a8f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:09.820218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf5ec5-3a9a-4b2c-8d31-8b79a8c7a8f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:30:09.820730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf5ec5-3a9a-4b2c-8d31-8b79a8c7a8f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:09.822980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf5ec5-3a9a-4b2c-8d31-8b79a8c7a8f9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:09.843339 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2969/5864] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:09.844727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8e06c-9268-44c3-9b90-d1346119d2a3 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:09.865289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8e06c-9268-44c3-9b90-d1346119d2a3 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:09.875182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c82a4-f27c-4ee2-a93a-23bb604ae131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:09.875182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c82a4-f27c-4ee2-a93a-23bb604ae131 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:09.877099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c82a4-f27c-4ee2-a93a-23bb604ae131 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:09.877564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c82a4-f27c-4ee2-a93a-23bb604ae131 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:09.878797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c82a4-f27c-4ee2-a93a-23bb604ae131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:09.885638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c82a4-f27c-4ee2-a93a-23bb604ae131 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:09.982304 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2896/5865] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:09 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:09.986740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf5ec5-3a9a-4b2c-8d31-8b79a8c7a8f9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:10.004570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf5ec5-3a9a-4b2c-8d31-8b79a8c7a8f9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:10.100976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de8584-8461-4f17-b1f6-5f5328dd8fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:10.101924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de8584-8461-4f17-b1f6-5f5328dd8fbb admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:10.102279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de8584-8461-4f17-b1f6-5f5328dd8fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:10.102623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de8584-8461-4f17-b1f6-5f5328dd8fbb admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:10.103493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de8584-8461-4f17-b1f6-5f5328dd8fbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:10.105915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de8584-8461-4f17-b1f6-5f5328dd8fbb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:10.262216 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2970/5866] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:09 2022] POST /identity/v3/users => generated 288 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:10.265411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c82a4-f27c-4ee2-a93a-23bb604ae131 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:10.281544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c82a4-f27c-4ee2-a93a-23bb604ae131 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:10.290728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952488a8-c8ee-49c0-958f-806c029dccc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:10.294556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952488a8-c8ee-49c0-958f-806c029dccc9 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:10.294556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952488a8-c8ee-49c0-958f-806c029dccc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:10.294556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952488a8-c8ee-49c0-958f-806c029dccc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:10.294556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952488a8-c8ee-49c0-958f-806c029dccc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:10.296217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952488a8-c8ee-49c0-958f-806c029dccc9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:10.312109 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2897/5867] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:10.316785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de8584-8461-4f17-b1f6-5f5328dd8fbb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:10.329513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de8584-8461-4f17-b1f6-5f5328dd8fbb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:10.343237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5a35e-2c67-4866-9639-d6e543eea1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:10.344276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5a35e-2c67-4866-9639-d6e543eea1bc admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:10.344707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5a35e-2c67-4866-9639-d6e543eea1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:10.345141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5a35e-2c67-4866-9639-d6e543eea1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:10.347290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5a35e-2c67-4866-9639-d6e543eea1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:10.351262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5a35e-2c67-4866-9639-d6e543eea1bc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:10.370226 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2971/5868] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:10.371759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952488a8-c8ee-49c0-958f-806c029dccc9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:10.385608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952488a8-c8ee-49c0-958f-806c029dccc9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:10.390575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a339992-0c8a-43b8-84cc-d5d0c74336e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:10.391495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a339992-0c8a-43b8-84cc-d5d0c74336e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:10.391776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a339992-0c8a-43b8-84cc-d5d0c74336e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:10.392063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a339992-0c8a-43b8-84cc-d5d0c74336e5 admin admin] PATH_INFO: `/v3/projects/6db8c1bc7736409799d6c96274e941f6/users/205e72444bcb458da4ad0feeff3f9229/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:10.407482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a339992-0c8a-43b8-84cc-d5d0c74336e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db8c1bc7736409799d6c96274e941f6, user_id=205e72444bcb458da4ad0feeff3f9229, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:10.412432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a339992-0c8a-43b8-84cc-d5d0c74336e5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:10.467806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5a35e-2c67-4866-9639-d6e543eea1bc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:10.469987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-21f5a35e-2c67-4866-9639-d6e543eea1bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:10.485062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5a35e-2c67-4866-9639-d6e543eea1bc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:10.490564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718e30e-7097-4b3c-8f5b-705cca922449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:10.491623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718e30e-7097-4b3c-8f5b-705cca922449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:10.492153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718e30e-7097-4b3c-8f5b-705cca922449 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:10.492657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718e30e-7097-4b3c-8f5b-705cca922449 admin admin] PATH_INFO: `/v3/projects/af6a8488a21947fbbe7ab4b11ca9549f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:10.494759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718e30e-7097-4b3c-8f5b-705cca922449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af6a8488a21947fbbe7ab4b11ca9549f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:10.497069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718e30e-7097-4b3c-8f5b-705cca922449 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:10.509507 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2898/5869] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:10 2022] PUT /identity/v3/projects/6db8c1bc7736409799d6c96274e941f6/users/205e72444bcb458da4ad0feeff3f9229/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:10.522725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13a721-cce6-4922-bc60-1808df892357 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:10.523384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13a721-cce6-4922-bc60-1808df892357 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:10.523866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13a721-cce6-4922-bc60-1808df892357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:10.565691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-fc13a721-cce6-4922-bc60-1808df892357 None None] MFA Rules not processed for user `205e72444bcb458da4ad0feeff3f9229`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:10.566972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fc13a721-cce6-4922-bc60-1808df892357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:10.652938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:10.689230 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2899/5870] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:10.693941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13a721-cce6-4922-bc60-1808df892357 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:10.696476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9718e30e-7097-4b3c-8f5b-705cca922449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af6a8488a21947fbbe7ab4b11ca9549f', 'request_id': 'req-9718e30e-7097-4b3c-8f5b-705cca922449'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:10.709936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9718e30e-7097-4b3c-8f5b-705cca922449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af6a8488a21947fbbe7ab4b11ca9549f', 'request_id': 'req-9718e30e-7097-4b3c-8f5b-705cca922449'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:10.716275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9718e30e-7097-4b3c-8f5b-705cca922449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af6a8488a21947fbbe7ab4b11ca9549f', 'request_id': 'req-9718e30e-7097-4b3c-8f5b-705cca922449'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:10.782514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13a721-cce6-4922-bc60-1808df892357 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:10.816245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9718e30e-7097-4b3c-8f5b-705cca922449 admin admin] The token cache is being invalidate because project af6a8488a21947fbbe7ab4b11ca9549f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:10.816534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9718e30e-7097-4b3c-8f5b-705cca922449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:10.817358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9718e30e-7097-4b3c-8f5b-705cca922449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:10.826247 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2972/5871] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:10 2022] DELETE /identity/v3/projects/af6a8488a21947fbbe7ab4b11ca9549f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:10.827400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930a8a4-04f5-48aa-beb3-4d3975cdc73d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:10.827728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930a8a4-04f5-48aa-beb3-4d3975cdc73d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:10.828006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930a8a4-04f5-48aa-beb3-4d3975cdc73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:10.851117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0930a8a4-04f5-48aa-beb3-4d3975cdc73d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:10.852871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0930a8a4-04f5-48aa-beb3-4d3975cdc73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:10.868127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7d31a-9bf0-4a2f-b5c4-e1701b51e334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:10.868127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7d31a-9bf0-4a2f-b5c4-e1701b51e334 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:10.868127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7d31a-9bf0-4a2f-b5c4-e1701b51e334 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:10.868461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7d31a-9bf0-4a2f-b5c4-e1701b51e334 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:10.869757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7d31a-9bf0-4a2f-b5c4-e1701b51e334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:10.871535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7d31a-9bf0-4a2f-b5c4-e1701b51e334 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:10.988117 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2973/5872] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:30:10.990705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08057a0-08b5-42ff-93ce-6563b84778fe None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:10.991002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08057a0-08b5-42ff-93ce-6563b84778fe None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:10.991306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08057a0-08b5-42ff-93ce-6563b84778fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:11.020780 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2900/5873] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:10 2022] POST /identity/v3/projects => generated 377 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:11.022197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7d31a-9bf0-4a2f-b5c4-e1701b51e334 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:11.025102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-66b7d31a-9bf0-4a2f-b5c4-e1701b51e334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:11.032177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d08057a0-08b5-42ff-93ce-6563b84778fe None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:11.033739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d08057a0-08b5-42ff-93ce-6563b84778fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:11.132047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7d31a-9bf0-4a2f-b5c4-e1701b51e334 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:11.150986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7bd00-9a4a-49a7-beb2-3c0ae9a3d8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:11.154128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7bd00-9a4a-49a7-beb2-3c0ae9a3d8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:11.154841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7bd00-9a4a-49a7-beb2-3c0ae9a3d8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:11.155898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7bd00-9a4a-49a7-beb2-3c0ae9a3d8f4 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:11.158156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7bd00-9a4a-49a7-beb2-3c0ae9a3d8f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:11.162639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7bd00-9a4a-49a7-beb2-3c0ae9a3d8f4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:11.199873 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2974/5874] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:30:11.205032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08057a0-08b5-42ff-93ce-6563b84778fe None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:11.222834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08057a0-08b5-42ff-93ce-6563b84778fe None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:11.236826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc382f-8ab8-4077-a5a6-446f0a52be5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:11.239299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc382f-8ab8-4077-a5a6-446f0a52be5e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:11.239299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc382f-8ab8-4077-a5a6-446f0a52be5e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:11.239299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc382f-8ab8-4077-a5a6-446f0a52be5e admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:11.239299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc382f-8ab8-4077-a5a6-446f0a52be5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:30:11.240953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc382f-8ab8-4077-a5a6-446f0a52be5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:11.243169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc382f-8ab8-4077-a5a6-446f0a52be5e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:11.265901 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2901/5875] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:11 2022] POST /identity/v3/users => generated 295 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:30:11.276856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7bd00-9a4a-49a7-beb2-3c0ae9a3d8f4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:11.309538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7bd00-9a4a-49a7-beb2-3c0ae9a3d8f4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:11.319736 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2975/5876] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:11.321055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc382f-8ab8-4077-a5a6-446f0a52be5e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:11.331571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355b6d2-d400-4683-b6fa-647ce49c5563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:11.332235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355b6d2-d400-4683-b6fa-647ce49c5563 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:11.332520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355b6d2-d400-4683-b6fa-647ce49c5563 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:11.332798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355b6d2-d400-4683-b6fa-647ce49c5563 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:11.333530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355b6d2-d400-4683-b6fa-647ce49c5563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:11.335189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355b6d2-d400-4683-b6fa-647ce49c5563 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:11.345764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc382f-8ab8-4077-a5a6-446f0a52be5e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:11.361780 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2902/5877] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:30:11.362715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355b6d2-d400-4683-b6fa-647ce49c5563 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:11.373207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa516558-b3b1-4a40-be34-767efaeff0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:11.373890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa516558-b3b1-4a40-be34-767efaeff0eb admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:11.375124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa516558-b3b1-4a40-be34-767efaeff0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:11.376043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa516558-b3b1-4a40-be34-767efaeff0eb admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:11.376787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa516558-b3b1-4a40-be34-767efaeff0eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:11.378729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa516558-b3b1-4a40-be34-767efaeff0eb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:11.383531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355b6d2-d400-4683-b6fa-647ce49c5563 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:11.411863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a4252-429c-4a20-badf-8ff0c1699392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:11.413193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a4252-429c-4a20-badf-8ff0c1699392 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:11.413688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a4252-429c-4a20-badf-8ff0c1699392 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:11.415784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a4252-429c-4a20-badf-8ff0c1699392 admin admin] PATH_INFO: `/v3/projects/eb4abbe4896f404c88158d6ec9a29e6d/users/1ec13b08b29e4f1f97dc1780b66adff4/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:11.474283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a4252-429c-4a20-badf-8ff0c1699392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4abbe4896f404c88158d6ec9a29e6d, user_id=1ec13b08b29e4f1f97dc1780b66adff4, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:11.475518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a4252-429c-4a20-badf-8ff0c1699392 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:11.607300 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2903/5878] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:11 2022] PUT /identity/v3/projects/eb4abbe4896f404c88158d6ec9a29e6d/users/1ec13b08b29e4f1f97dc1780b66adff4/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:11.610694 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2976/5879] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:11 2022] POST /identity/v3/projects => generated 387 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:11.612062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa516558-b3b1-4a40-be34-767efaeff0eb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:11.617984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a4252-429c-4a20-badf-8ff0c1699392 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:11.746969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a4252-429c-4a20-badf-8ff0c1699392 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:11.770896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa516558-b3b1-4a40-be34-767efaeff0eb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:11.787366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26480d1-b9bf-40af-a6dc-bd268720a86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:11.788058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26480d1-b9bf-40af-a6dc-bd268720a86d admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:11.788422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26480d1-b9bf-40af-a6dc-bd268720a86d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:11.788890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26480d1-b9bf-40af-a6dc-bd268720a86d admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:11.789756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26480d1-b9bf-40af-a6dc-bd268720a86d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:11.792814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26480d1-b9bf-40af-a6dc-bd268720a86d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:11.880243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c837729-bcb2-4b3e-a929-5d4028c475e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:11.881034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c837729-bcb2-4b3e-a929-5d4028c475e7 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:11.881408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c837729-bcb2-4b3e-a929-5d4028c475e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:11.881745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c837729-bcb2-4b3e-a929-5d4028c475e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:11.882547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c837729-bcb2-4b3e-a929-5d4028c475e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:11.884251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c837729-bcb2-4b3e-a929-5d4028c475e7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:11.894754 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2977/5880] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:11 2022] POST /identity/v3/users => generated 294 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:11.896402 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2904/5881] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:11.900449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26480d1-b9bf-40af-a6dc-bd268720a86d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:11.900948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c837729-bcb2-4b3e-a929-5d4028c475e7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:11.912058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c837729-bcb2-4b3e-a929-5d4028c475e7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:11.920702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26480d1-b9bf-40af-a6dc-bd268720a86d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:11.925140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ed118-1189-4c13-b4ae-14de6ff084d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:11.926007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ed118-1189-4c13-b4ae-14de6ff084d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:11.926401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ed118-1189-4c13-b4ae-14de6ff084d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:11.927940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ed118-1189-4c13-b4ae-14de6ff084d1 admin admin] PATH_INFO: `/v3/projects/eb4abbe4896f404c88158d6ec9a29e6d/users/1ec13b08b29e4f1f97dc1780b66adff4/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:11.934590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3f4a1-fafc-4665-b49e-b32bc6687944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:11.935530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3f4a1-fafc-4665-b49e-b32bc6687944 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:11.935968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3f4a1-fafc-4665-b49e-b32bc6687944 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:11.936414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3f4a1-fafc-4665-b49e-b32bc6687944 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:11.937369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3f4a1-fafc-4665-b49e-b32bc6687944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:11.938474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ed118-1189-4c13-b4ae-14de6ff084d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4abbe4896f404c88158d6ec9a29e6d, user_id=1ec13b08b29e4f1f97dc1780b66adff4, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:11.940050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3f4a1-fafc-4665-b49e-b32bc6687944 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:11.941683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ed118-1189-4c13-b4ae-14de6ff084d1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:11.954135 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2905/5882] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:11 2022] PUT /identity/v3/projects/eb4abbe4896f404c88158d6ec9a29e6d/users/1ec13b08b29e4f1f97dc1780b66adff4/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:11.967697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e970b7-0c07-4106-ab9e-e92cc002135d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:11.968337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e970b7-0c07-4106-ab9e-e92cc002135d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:11.968875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e970b7-0c07-4106-ab9e-e92cc002135d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:11.971855 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2978/5883] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:11.982238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3f4a1-fafc-4665-b49e-b32bc6687944 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:12.010586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:12.011068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3f4a1-fafc-4665-b49e-b32bc6687944 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:12.027133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e2e970b7-0c07-4106-ab9e-e92cc002135d None None] MFA Rules not processed for user `1ec13b08b29e4f1f97dc1780b66adff4`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:12.029646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e2e970b7-0c07-4106-ab9e-e92cc002135d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:12.162931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc0c22-e20a-429d-b3c4-3f9ff89b1eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:12.163656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc0c22-e20a-429d-b3c4-3f9ff89b1eaf admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:12.163939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc0c22-e20a-429d-b3c4-3f9ff89b1eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:12.164354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc0c22-e20a-429d-b3c4-3f9ff89b1eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:12.164944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc0c22-e20a-429d-b3c4-3f9ff89b1eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:12.167100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc0c22-e20a-429d-b3c4-3f9ff89b1eaf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:12.180581 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2979/5884] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:30:12.187349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc0c22-e20a-429d-b3c4-3f9ff89b1eaf admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:12.192922 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2906/5885] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:30:12.199507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e970b7-0c07-4106-ab9e-e92cc002135d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:12.217111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc0c22-e20a-429d-b3c4-3f9ff89b1eaf admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:12.225217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e970b7-0c07-4106-ab9e-e92cc002135d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:12.229316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63994d-330f-4abf-9775-0930ebaf02a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:12.230218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63994d-330f-4abf-9775-0930ebaf02a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:12.230653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63994d-330f-4abf-9775-0930ebaf02a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:12.230988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63994d-330f-4abf-9775-0930ebaf02a8 admin admin] PATH_INFO: `/v3/projects/20b46ea6d4a444699616a81b28614377/users/977932c56c774eafa86bfd396456353b/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:12.250884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfe1b4-5edb-4c19-a8a4-e9219d47a326 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ec13b08b29e4f1f97dc1780b66adff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4abbe4896f404c88158d6ec9a29e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:12.250884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfe1b4-5edb-4c19-a8a4-e9219d47a326 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:12.250884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfe1b4-5edb-4c19-a8a4-e9219d47a326 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:12.251407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfe1b4-5edb-4c19-a8a4-e9219d47a326 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:12.251407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfe1b4-5edb-4c19-a8a4-e9219d47a326 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:12.251407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfe1b4-5edb-4c19-a8a4-e9219d47a326 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:12.268829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63994d-330f-4abf-9775-0930ebaf02a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b46ea6d4a444699616a81b28614377, user_id=977932c56c774eafa86bfd396456353b, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:12.279561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63994d-330f-4abf-9775-0930ebaf02a8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:12.386424 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2980/5886] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:12 2022] PUT /identity/v3/projects/20b46ea6d4a444699616a81b28614377/users/977932c56c774eafa86bfd396456353b/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:12.396963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8753cee-ed73-44fc-8214-0e4cf29a0c79 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:12.397291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8753cee-ed73-44fc-8214-0e4cf29a0c79 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:12.397522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8753cee-ed73-44fc-8214-0e4cf29a0c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:12.399482 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2907/5887] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:30:12 2022] POST /identity/v3/domains => generated 245 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:12.413969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfe1b4-5edb-4c19-a8a4-e9219d47a326 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:12.454818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c8753cee-ed73-44fc-8214-0e4cf29a0c79 None None] MFA Rules not processed for user `977932c56c774eafa86bfd396456353b`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:12.463688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c8753cee-ed73-44fc-8214-0e4cf29a0c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:12.570266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfe1b4-5edb-4c19-a8a4-e9219d47a326 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:12.577624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48b4a8-958a-4a9a-b15d-d5aa8d5bf505 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ec13b08b29e4f1f97dc1780b66adff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4abbe4896f404c88158d6ec9a29e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:12.580241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48b4a8-958a-4a9a-b15d-d5aa8d5bf505 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:12.580787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48b4a8-958a-4a9a-b15d-d5aa8d5bf505 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:12.581297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48b4a8-958a-4a9a-b15d-d5aa8d5bf505 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:12.582272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48b4a8-958a-4a9a-b15d-d5aa8d5bf505 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:12.584932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48b4a8-958a-4a9a-b15d-d5aa8d5bf505 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:12.663073 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2981/5888] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:12.667647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8753cee-ed73-44fc-8214-0e4cf29a0c79 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:12.779523 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2908/5889] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:12 2022] POST /identity/v3/projects => generated 409 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:12.785291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48b4a8-958a-4a9a-b15d-d5aa8d5bf505 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:12.814650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8753cee-ed73-44fc-8214-0e4cf29a0c79 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:12.915985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:13.027294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937624b9-d6b9-4664-a656-e5807eafecb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:13.027873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937624b9-d6b9-4664-a656-e5807eafecb5 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:13.028159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937624b9-d6b9-4664-a656-e5807eafecb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:13.028438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937624b9-d6b9-4664-a656-e5807eafecb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:13.029141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937624b9-d6b9-4664-a656-e5807eafecb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:13.044401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937624b9-d6b9-4664-a656-e5807eafecb5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:13.044621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48b4a8-958a-4a9a-b15d-d5aa8d5bf505 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:13.066032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36613c-129f-405d-9f28-e3f54cc12714 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ec13b08b29e4f1f97dc1780b66adff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4abbe4896f404c88158d6ec9a29e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:13.067642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36613c-129f-405d-9f28-e3f54cc12714 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:13.068199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36613c-129f-405d-9f28-e3f54cc12714 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:13.068916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36613c-129f-405d-9f28-e3f54cc12714 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:13.073658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36613c-129f-405d-9f28-e3f54cc12714 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:13.076646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36613c-129f-405d-9f28-e3f54cc12714 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:13.189876 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2982/5890] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:12 2022] POST /identity/v3/projects => generated 389 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:13.193550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937624b9-d6b9-4664-a656-e5807eafecb5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:13.218500 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2909/5891] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:12 2022] POST /identity/v3/users => generated 348 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:13.222944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36613c-129f-405d-9f28-e3f54cc12714 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:13.246763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36613c-129f-405d-9f28-e3f54cc12714 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:13.313725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937624b9-d6b9-4664-a656-e5807eafecb5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:13.320174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e35f50-b8f2-472c-8e6f-a2a509f7c0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:13.320858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e35f50-b8f2-472c-8e6f-a2a509f7c0ce admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:13.321140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e35f50-b8f2-472c-8e6f-a2a509f7c0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:13.321418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e35f50-b8f2-472c-8e6f-a2a509f7c0ce admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:13.323064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e35f50-b8f2-472c-8e6f-a2a509f7c0ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:13.325622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e35f50-b8f2-472c-8e6f-a2a509f7c0ce admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:13.357794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734ea4c-9ecf-4665-b911-59db61253f8e tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ec13b08b29e4f1f97dc1780b66adff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4abbe4896f404c88158d6ec9a29e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:13.359084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734ea4c-9ecf-4665-b911-59db61253f8e tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:13.359554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734ea4c-9ecf-4665-b911-59db61253f8e tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:13.360780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734ea4c-9ecf-4665-b911-59db61253f8e tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:13.364437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734ea4c-9ecf-4665-b911-59db61253f8e tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:13.364437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734ea4c-9ecf-4665-b911-59db61253f8e tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:13.380523 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2910/5892] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:13.388110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734ea4c-9ecf-4665-b911-59db61253f8e tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:13.401685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734ea4c-9ecf-4665-b911-59db61253f8e tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:13.408504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243877a-fb56-4b2a-b0f9-b4a78538dcf1 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ec13b08b29e4f1f97dc1780b66adff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4abbe4896f404c88158d6ec9a29e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:13.410577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243877a-fb56-4b2a-b0f9-b4a78538dcf1 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:13.411216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243877a-fb56-4b2a-b0f9-b4a78538dcf1 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:13.411504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243877a-fb56-4b2a-b0f9-b4a78538dcf1 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] PATH_INFO: `/v3/projects/cf2efe8d749447b4a7fda74472a9b75d/users/f3d5fcdfff90441e96b71766f5259592/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:13.428775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243877a-fb56-4b2a-b0f9-b4a78538dcf1 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cf2efe8d749447b4a7fda74472a9b75d, user_id=f3d5fcdfff90441e96b71766f5259592, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:13.432904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243877a-fb56-4b2a-b0f9-b4a78538dcf1 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:13.526895 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2983/5893] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:13 2022] POST /identity/v3/users => generated 301 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:30:13.530795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e35f50-b8f2-472c-8e6f-a2a509f7c0ce admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:13.550338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e35f50-b8f2-472c-8e6f-a2a509f7c0ce admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:13.560590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d34f75-c986-409e-b6b1-e9046c828363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:13.561273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d34f75-c986-409e-b6b1-e9046c828363 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:13.561558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d34f75-c986-409e-b6b1-e9046c828363 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:13.562210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d34f75-c986-409e-b6b1-e9046c828363 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:13.563136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d34f75-c986-409e-b6b1-e9046c828363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:13.565391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d34f75-c986-409e-b6b1-e9046c828363 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:13.574810 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2911/5894] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:13 2022] PUT /identity/v3/projects/cf2efe8d749447b4a7fda74472a9b75d/users/f3d5fcdfff90441e96b71766f5259592/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:13.586954 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2984/5895] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:13.587124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a053af-f48b-4ce9-b4f4-ebd187d625f7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:13.587124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a053af-f48b-4ce9-b4f4-ebd187d625f7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:13.587124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a053af-f48b-4ce9-b4f4-ebd187d625f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:13.588646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d34f75-c986-409e-b6b1-e9046c828363 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:13.599988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d34f75-c986-409e-b6b1-e9046c828363 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:13.671769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2992a2e-2db6-40f9-8dcd-89e613ae1214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:13.672671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2992a2e-2db6-40f9-8dcd-89e613ae1214 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:13.672955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2992a2e-2db6-40f9-8dcd-89e613ae1214 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:13.673233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2992a2e-2db6-40f9-8dcd-89e613ae1214 admin admin] PATH_INFO: `/v3/projects/c216081b32484c0d966c70bc7d0185ab/users/cd6c50ff88fa4ceca8a8284e5bdfb936/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:13.692186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2992a2e-2db6-40f9-8dcd-89e613ae1214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c216081b32484c0d966c70bc7d0185ab, user_id=cd6c50ff88fa4ceca8a8284e5bdfb936, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:13.695341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2992a2e-2db6-40f9-8dcd-89e613ae1214 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:13.721868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c1a053af-f48b-4ce9-b4f4-ebd187d625f7 None None] MFA Rules not processed for user `f3d5fcdfff90441e96b71766f5259592`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:13.723192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c1a053af-f48b-4ce9-b4f4-ebd187d625f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:13.743738 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2912/5896] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:13 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:13.753585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e47b62-b725-4f7f-9659-4f01d25843f1 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:13.753990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e47b62-b725-4f7f-9659-4f01d25843f1 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:13.754938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e47b62-b725-4f7f-9659-4f01d25843f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:13.792357 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2985/5897] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:13 2022] PUT /identity/v3/projects/c216081b32484c0d966c70bc7d0185ab/users/cd6c50ff88fa4ceca8a8284e5bdfb936/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:13.798626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2992a2e-2db6-40f9-8dcd-89e613ae1214 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:13.811574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:13.920538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2992a2e-2db6-40f9-8dcd-89e613ae1214 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:13.927144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d18a71-1e84-4c1e-87a0-a2b393221199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:13.928366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d18a71-1e84-4c1e-87a0-a2b393221199 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:13.928827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d18a71-1e84-4c1e-87a0-a2b393221199 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:13.929261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d18a71-1e84-4c1e-87a0-a2b393221199 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:13.931023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d18a71-1e84-4c1e-87a0-a2b393221199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:13.933796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d18a71-1e84-4c1e-87a0-a2b393221199 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:13.953776 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2986/5898] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:13.958934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d18a71-1e84-4c1e-87a0-a2b393221199 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:13.973072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d18a71-1e84-4c1e-87a0-a2b393221199 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:13.983523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6659e-d558-4eb4-a687-dd5c5ef9d39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:13.984431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6659e-d558-4eb4-a687-dd5c5ef9d39b admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:13.984714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6659e-d558-4eb4-a687-dd5c5ef9d39b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:13.984990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6659e-d558-4eb4-a687-dd5c5ef9d39b admin admin] PATH_INFO: `/v3/projects/c216081b32484c0d966c70bc7d0185ab/users/cd6c50ff88fa4ceca8a8284e5bdfb936/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:13.987226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6659e-d558-4eb4-a687-dd5c5ef9d39b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c216081b32484c0d966c70bc7d0185ab, user_id=cd6c50ff88fa4ceca8a8284e5bdfb936, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:13.990137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6659e-d558-4eb4-a687-dd5c5ef9d39b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:14.017009 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2987/5899] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:13 2022] PUT /identity/v3/projects/c216081b32484c0d966c70bc7d0185ab/users/cd6c50ff88fa4ceca8a8284e5bdfb936/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:14.018637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e3342-39c8-486f-b04b-f9fc839af0c6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:14.020720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e3342-39c8-486f-b04b-f9fc839af0c6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:14.022073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e3342-39c8-486f-b04b-f9fc839af0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:14.026317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-75e47b62-b725-4f7f-9659-4f01d25843f1 None None] MFA Rules not processed for user `f3d5fcdfff90441e96b71766f5259592`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:14.029079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-75e47b62-b725-4f7f-9659-4f01d25843f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:14.037185 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2913/5900] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:13 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:30:14.042484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e47b62-b725-4f7f-9659-4f01d25843f1 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:14.069665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e47b62-b725-4f7f-9659-4f01d25843f1 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:14.083748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-dd5e3342-39c8-486f-b04b-f9fc839af0c6 None None] MFA Rules not processed for user `cd6c50ff88fa4ceca8a8284e5bdfb936`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:14.085827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dd5e3342-39c8-486f-b04b-f9fc839af0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:14.186118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77684a2-57dc-4be6-a790-a138b0620a03 tempest-test_project-1890985817 tempest-user-1363423642] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3d5fcdfff90441e96b71766f5259592', 'user_domain_id': '27144116d7504a358d834425787da2e9', 'system_scope': None, 'project_id': 'cf2efe8d749447b4a7fda74472a9b75d', 'project_domain_id': '27144116d7504a358d834425787da2e9', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:14.186776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77684a2-57dc-4be6-a790-a138b0620a03 tempest-test_project-1890985817 tempest-user-1363423642] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:14.187084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77684a2-57dc-4be6-a790-a138b0620a03 tempest-test_project-1890985817 tempest-user-1363423642] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:14.187370 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2988/5901] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:14.191269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77684a2-57dc-4be6-a790-a138b0620a03 tempest-test_project-1890985817 tempest-user-1363423642] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:14.192464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e3342-39c8-486f-b04b-f9fc839af0c6 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:14.201701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77684a2-57dc-4be6-a790-a138b0620a03 tempest-test_project-1890985817 tempest-user-1363423642] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:14.203733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77684a2-57dc-4be6-a790-a138b0620a03 tempest-test_project-1890985817 tempest-user-1363423642] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:14.225978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e3342-39c8-486f-b04b-f9fc839af0c6 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:14.226890 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2914/5902] 10.222.0.16 () {56 vars in 1283 bytes} [Sat Jul 16 21:30:14 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:30:14.231987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77684a2-57dc-4be6-a790-a138b0620a03 tempest-test_project-1890985817 tempest-user-1363423642] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:14.234681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671155f4-1c06-4695-8bc4-c920b588820b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd6c50ff88fa4ceca8a8284e5bdfb936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c216081b32484c0d966c70bc7d0185ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:14.235825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671155f4-1c06-4695-8bc4-c920b588820b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:14.236360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671155f4-1c06-4695-8bc4-c920b588820b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:14.236873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671155f4-1c06-4695-8bc4-c920b588820b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] PATH_INFO: `/v3/projects/20b46ea6d4a444699616a81b28614377` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:14.238314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671155f4-1c06-4695-8bc4-c920b588820b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorizing `identity:get_project(project_id=20b46ea6d4a444699616a81b28614377)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:14.241240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671155f4-1c06-4695-8bc4-c920b588820b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:14.243950 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2989/5903] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:30:14 2022] GET /identity/v3/projects/20b46ea6d4a444699616a81b28614377 => generated 387 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:14.250111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671155f4-1c06-4695-8bc4-c920b588820b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:14.285264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671155f4-1c06-4695-8bc4-c920b588820b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:14.290936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf323223-84b5-4f1e-a013-d0a7c96da499 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd6c50ff88fa4ceca8a8284e5bdfb936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c216081b32484c0d966c70bc7d0185ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:14.292143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf323223-84b5-4f1e-a013-d0a7c96da499 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:14.292693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf323223-84b5-4f1e-a013-d0a7c96da499 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:14.293208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf323223-84b5-4f1e-a013-d0a7c96da499 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:14.294085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf323223-84b5-4f1e-a013-d0a7c96da499 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:14.297390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf323223-84b5-4f1e-a013-d0a7c96da499 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:14.321269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77684a2-57dc-4be6-a790-a138b0620a03 tempest-test_project-1890985817 tempest-user-1363423642] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:14.332129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881f82b-922c-46b8-999a-5cc7302a67ae tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ec13b08b29e4f1f97dc1780b66adff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4abbe4896f404c88158d6ec9a29e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:14.332129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881f82b-922c-46b8-999a-5cc7302a67ae tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:14.332129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881f82b-922c-46b8-999a-5cc7302a67ae tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:14.332409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881f82b-922c-46b8-999a-5cc7302a67ae tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] PATH_INFO: `/v3/users/f3d5fcdfff90441e96b71766f5259592` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:14.333607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881f82b-922c-46b8-999a-5cc7302a67ae tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f3d5fcdfff90441e96b71766f5259592)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:14.335969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881f82b-922c-46b8-999a-5cc7302a67ae tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:14.426817 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2990/5904] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Jul 16 21:30:14 2022] POST /identity/v3/projects => generated 338 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:14.427993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf323223-84b5-4f1e-a013-d0a7c96da499 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:14.569120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf323223-84b5-4f1e-a013-d0a7c96da499 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:14.583806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4eb7fb-01fa-4600-b6f2-e4fd7494fe52 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd6c50ff88fa4ceca8a8284e5bdfb936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c216081b32484c0d966c70bc7d0185ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:14.584579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4eb7fb-01fa-4600-b6f2-e4fd7494fe52 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:14.584963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4eb7fb-01fa-4600-b6f2-e4fd7494fe52 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:14.585405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4eb7fb-01fa-4600-b6f2-e4fd7494fe52 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:14.589545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4eb7fb-01fa-4600-b6f2-e4fd7494fe52 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:14.591631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4eb7fb-01fa-4600-b6f2-e4fd7494fe52 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:14.622030 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2991/5905] 10.222.0.16 () {58 vars in 1130 bytes} [Sat Jul 16 21:30:14 2022] GET /identity/v3/projects => generated 7676 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:14.632310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4eb7fb-01fa-4600-b6f2-e4fd7494fe52 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:14.666580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8881f82b-922c-46b8-999a-5cc7302a67ae tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3d5fcdfff90441e96b71766f5259592'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:14.670578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4eb7fb-01fa-4600-b6f2-e4fd7494fe52 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:14.685023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da59990-dde5-4cc3-be42-c2fe2805e380 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd6c50ff88fa4ceca8a8284e5bdfb936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c216081b32484c0d966c70bc7d0185ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:14.686183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da59990-dde5-4cc3-be42-c2fe2805e380 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:14.686422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da59990-dde5-4cc3-be42-c2fe2805e380 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:14.686750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da59990-dde5-4cc3-be42-c2fe2805e380 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] PATH_INFO: `/v3/projects/20b46ea6d4a444699616a81b28614377` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:14.688756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da59990-dde5-4cc3-be42-c2fe2805e380 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorizing `identity:get_project(project_id=20b46ea6d4a444699616a81b28614377)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:14.697810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da59990-dde5-4cc3-be42-c2fe2805e380 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:14.697810 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2992/5906] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:30:14 2022] GET /identity/v3/projects/20b46ea6d4a444699616a81b28614377 => generated 387 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:14.701283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8881f82b-922c-46b8-999a-5cc7302a67ae tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3d5fcdfff90441e96b71766f5259592'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:14.701452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da59990-dde5-4cc3-be42-c2fe2805e380 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:14.713961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da59990-dde5-4cc3-be42-c2fe2805e380 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:14.719584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca822718-f6a5-4664-8702-b43a098072ca tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd6c50ff88fa4ceca8a8284e5bdfb936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c216081b32484c0d966c70bc7d0185ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:14.719977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:14.720519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca822718-f6a5-4664-8702-b43a098072ca tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:14.720744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca822718-f6a5-4664-8702-b43a098072ca tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:14.720992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca822718-f6a5-4664-8702-b43a098072ca tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] PATH_INFO: `/v3/projects/37ce0408c96f43c49da39d9f08ff1c3e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:14.722448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca822718-f6a5-4664-8702-b43a098072ca tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorizing `identity:get_project(project_id=37ce0408c96f43c49da39d9f08ff1c3e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:14.724599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca822718-f6a5-4664-8702-b43a098072ca tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:14.726700 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2993/5907] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:30:14 2022] GET /identity/v3/projects/37ce0408c96f43c49da39d9f08ff1c3e => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:30:14.732803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca822718-f6a5-4664-8702-b43a098072ca tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:14.743213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca822718-f6a5-4664-8702-b43a098072ca tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:14.749718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf6776-ed37-4a4e-abad-c9dba8816dc2 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd6c50ff88fa4ceca8a8284e5bdfb936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c216081b32484c0d966c70bc7d0185ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:14.750370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf6776-ed37-4a4e-abad-c9dba8816dc2 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:14.750649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf6776-ed37-4a4e-abad-c9dba8816dc2 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:14.750925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf6776-ed37-4a4e-abad-c9dba8816dc2 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:14.751680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf6776-ed37-4a4e-abad-c9dba8816dc2 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:14.754901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf6776-ed37-4a4e-abad-c9dba8816dc2 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:14.778336 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2994/5908] 10.222.0.16 () {58 vars in 1130 bytes} [Sat Jul 16 21:30:14 2022] GET /identity/v3/projects => generated 7676 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:30:14.783384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf6776-ed37-4a4e-abad-c9dba8816dc2 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:14.794424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf6776-ed37-4a4e-abad-c9dba8816dc2 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:14.799658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86d6c4-9f7b-4573-b71d-cc3465e12a37 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd6c50ff88fa4ceca8a8284e5bdfb936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c216081b32484c0d966c70bc7d0185ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:14.800315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86d6c4-9f7b-4573-b71d-cc3465e12a37 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:14.800603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86d6c4-9f7b-4573-b71d-cc3465e12a37 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:14.800889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86d6c4-9f7b-4573-b71d-cc3465e12a37 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:14.801649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86d6c4-9f7b-4573-b71d-cc3465e12a37 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:30:14.801962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86d6c4-9f7b-4573-b71d-cc3465e12a37 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:14.803929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86d6c4-9f7b-4573-b71d-cc3465e12a37 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:14.812817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8881f82b-922c-46b8-999a-5cc7302a67ae tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3d5fcdfff90441e96b71766f5259592'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:14.824920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8881f82b-922c-46b8-999a-5cc7302a67ae tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3d5fcdfff90441e96b71766f5259592'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:14.826189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8881f82b-922c-46b8-999a-5cc7302a67ae tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3d5fcdfff90441e96b71766f5259592'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:14.830711 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2995/5909] 10.222.0.16 () {58 vars in 1165 bytes} [Sat Jul 16 21:30:14 2022] GET /identity/v3/projects?domain_id=default => generated 6948 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:14.833765 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2915/5910] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:14 2022] DELETE /identity/v3/users/f3d5fcdfff90441e96b71766f5259592 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:14.839187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86d6c4-9f7b-4573-b71d-cc3465e12a37 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:14.839187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6e86d6c4-9f7b-4573-b71d-cc3465e12a37 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:14.841945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881f82b-922c-46b8-999a-5cc7302a67ae tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:14.843449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8881f82b-922c-46b8-999a-5cc7302a67ae tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:14.852230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86d6c4-9f7b-4573-b71d-cc3465e12a37 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:14.949459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b23525-237b-4835-b7cf-db275269169b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd6c50ff88fa4ceca8a8284e5bdfb936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c216081b32484c0d966c70bc7d0185ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:14.955424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b23525-237b-4835-b7cf-db275269169b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:14.955832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b23525-237b-4835-b7cf-db275269169b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:14.956225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b23525-237b-4835-b7cf-db275269169b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:14.957562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b23525-237b-4835-b7cf-db275269169b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:14.959813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b23525-237b-4835-b7cf-db275269169b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:14.983521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881f82b-922c-46b8-999a-5cc7302a67ae tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:14.989866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f9104-2f1b-42d0-addb-96d3a17e76d8 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ec13b08b29e4f1f97dc1780b66adff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4abbe4896f404c88158d6ec9a29e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:14.990969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f9104-2f1b-42d0-addb-96d3a17e76d8 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:14.991473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f9104-2f1b-42d0-addb-96d3a17e76d8 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:14.991916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f9104-2f1b-42d0-addb-96d3a17e76d8 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] PATH_INFO: `/v3/projects/cf2efe8d749447b4a7fda74472a9b75d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:14.993340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f9104-2f1b-42d0-addb-96d3a17e76d8 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cf2efe8d749447b4a7fda74472a9b75d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:14.997109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f9104-2f1b-42d0-addb-96d3a17e76d8 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:14.999030 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2996/5911] 10.222.0.16 () {58 vars in 1130 bytes} [Sat Jul 16 21:30:14 2022] GET /identity/v3/projects => generated 7676 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:30:15.003855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b23525-237b-4835-b7cf-db275269169b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:15.023977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b23525-237b-4835-b7cf-db275269169b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:15.037539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f69818-cc82-4466-9bbe-b0e03e1c5974 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd6c50ff88fa4ceca8a8284e5bdfb936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c216081b32484c0d966c70bc7d0185ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:15.045742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f69818-cc82-4466-9bbe-b0e03e1c5974 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:15.046143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f69818-cc82-4466-9bbe-b0e03e1c5974 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:15.046679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f69818-cc82-4466-9bbe-b0e03e1c5974 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:15.048275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f69818-cc82-4466-9bbe-b0e03e1c5974 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:30:15.048760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f69818-cc82-4466-9bbe-b0e03e1c5974 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:15.052790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f69818-cc82-4466-9bbe-b0e03e1c5974 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:15.077629 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2997/5912] 10.222.0.16 () {58 vars in 1165 bytes} [Sat Jul 16 21:30:15 2022] GET /identity/v3/projects?domain_id=default => generated 6948 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:30:15.085728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f69818-cc82-4466-9bbe-b0e03e1c5974 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:15.101713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f69818-cc82-4466-9bbe-b0e03e1c5974 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:15.108738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d24fd9-8c2e-46df-ab37-8bc4d082ca5b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd6c50ff88fa4ceca8a8284e5bdfb936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c216081b32484c0d966c70bc7d0185ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:15.109673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d24fd9-8c2e-46df-ab37-8bc4d082ca5b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:15.111638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d24fd9-8c2e-46df-ab37-8bc4d082ca5b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:15.111638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d24fd9-8c2e-46df-ab37-8bc4d082ca5b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:15.111638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d24fd9-8c2e-46df-ab37-8bc4d082ca5b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:15.114556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d24fd9-8c2e-46df-ab37-8bc4d082ca5b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:15.153328 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2998/5913] 10.222.0.16 () {58 vars in 1130 bytes} [Sat Jul 16 21:30:15 2022] GET /identity/v3/projects => generated 7676 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:15.179097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d24fd9-8c2e-46df-ab37-8bc4d082ca5b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:15.180143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3a5f9104-2f1b-42d0-addb-96d3a17e76d8 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2efe8d749447b4a7fda74472a9b75d', 'request_id': 'req-3a5f9104-2f1b-42d0-addb-96d3a17e76d8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:15.203055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3a5f9104-2f1b-42d0-addb-96d3a17e76d8 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2efe8d749447b4a7fda74472a9b75d', 'request_id': 'req-3a5f9104-2f1b-42d0-addb-96d3a17e76d8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:15.208129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d24fd9-8c2e-46df-ab37-8bc4d082ca5b tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:15.208303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3a5f9104-2f1b-42d0-addb-96d3a17e76d8 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2efe8d749447b4a7fda74472a9b75d', 'request_id': 'req-3a5f9104-2f1b-42d0-addb-96d3a17e76d8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:15.284914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f55cf-469d-4d50-ba87-0328101f8b67 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd6c50ff88fa4ceca8a8284e5bdfb936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c216081b32484c0d966c70bc7d0185ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:15.285889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f55cf-469d-4d50-ba87-0328101f8b67 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:15.286375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f55cf-469d-4d50-ba87-0328101f8b67 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:15.286844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f55cf-469d-4d50-ba87-0328101f8b67 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:15.287840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f55cf-469d-4d50-ba87-0328101f8b67 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-399076662) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:30:15.288402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f55cf-469d-4d50-ba87-0328101f8b67 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:15.291518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f55cf-469d-4d50-ba87-0328101f8b67 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:15.308967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3a5f9104-2f1b-42d0-addb-96d3a17e76d8 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] The token cache is being invalidate because project cf2efe8d749447b4a7fda74472a9b75d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:15.309294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3a5f9104-2f1b-42d0-addb-96d3a17e76d8 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:15.309954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3a5f9104-2f1b-42d0-addb-96d3a17e76d8 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:15.314323 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2916/5914] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:14 2022] DELETE /identity/v3/projects/cf2efe8d749447b4a7fda74472a9b75d => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:15.319355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f9104-2f1b-42d0-addb-96d3a17e76d8 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:15.322070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3a5f9104-2f1b-42d0-addb-96d3a17e76d8 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:15.332286 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 2999/5915] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:30:15 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-399076662 => generated 534 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:15.334967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f55cf-469d-4d50-ba87-0328101f8b67 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:15.338245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-356f55cf-469d-4d50-ba87-0328101f8b67 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:15.357983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f55cf-469d-4d50-ba87-0328101f8b67 tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:15.364610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c17e3a-fb1d-464a-99b2-5b0e2e7ea96c tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd6c50ff88fa4ceca8a8284e5bdfb936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c216081b32484c0d966c70bc7d0185ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:15.365835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c17e3a-fb1d-464a-99b2-5b0e2e7ea96c tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:15.367753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c17e3a-fb1d-464a-99b2-5b0e2e7ea96c tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:15.368253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c17e3a-fb1d-464a-99b2-5b0e2e7ea96c tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] PATH_INFO: `/v3/projects/37ce0408c96f43c49da39d9f08ff1c3e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:15.371233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c17e3a-fb1d-464a-99b2-5b0e2e7ea96c tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorizing `identity:delete_project(project_id=37ce0408c96f43c49da39d9f08ff1c3e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:15.375406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c17e3a-fb1d-464a-99b2-5b0e2e7ea96c tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:15.431783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:15.439568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f9104-2f1b-42d0-addb-96d3a17e76d8 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:15.444689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433e2ab-5d2f-4b69-840f-99750d3b7859 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ec13b08b29e4f1f97dc1780b66adff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4abbe4896f404c88158d6ec9a29e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:15.445531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433e2ab-5d2f-4b69-840f-99750d3b7859 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:15.445816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433e2ab-5d2f-4b69-840f-99750d3b7859 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:15.446264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433e2ab-5d2f-4b69-840f-99750d3b7859 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] PATH_INFO: `/v3/domains/27144116d7504a358d834425787da2e9` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:15.448551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433e2ab-5d2f-4b69-840f-99750d3b7859 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=27144116d7504a358d834425787da2e9)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:15.449645 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-5433e2ab-5d2f-4b69-840f-99750d3b7859 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:30:15.449645 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:30:15.449645 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:30:15.451053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433e2ab-5d2f-4b69-840f-99750d3b7859 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:15.474594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5433e2ab-5d2f-4b69-840f-99750d3b7859 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '27144116d7504a358d834425787da2e9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:15.475593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5433e2ab-5d2f-4b69-840f-99750d3b7859 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '27144116d7504a358d834425787da2e9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:15.538067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55c17e3a-fb1d-464a-99b2-5b0e2e7ea96c tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ce0408c96f43c49da39d9f08ff1c3e', 'request_id': 'req-55c17e3a-fb1d-464a-99b2-5b0e2e7ea96c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:15.547495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55c17e3a-fb1d-464a-99b2-5b0e2e7ea96c tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ce0408c96f43c49da39d9f08ff1c3e', 'request_id': 'req-55c17e3a-fb1d-464a-99b2-5b0e2e7ea96c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:15.554299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55c17e3a-fb1d-464a-99b2-5b0e2e7ea96c tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ce0408c96f43c49da39d9f08ff1c3e', 'request_id': 'req-55c17e3a-fb1d-464a-99b2-5b0e2e7ea96c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:15.601214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5433e2ab-5d2f-4b69-840f-99750d3b7859 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '27144116d7504a358d834425787da2e9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:15.602661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5433e2ab-5d2f-4b69-840f-99750d3b7859 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '27144116d7504a358d834425787da2e9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:15.606934 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2917/5916] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:30:15 2022] PATCH /identity/v3/domains/27144116d7504a358d834425787da2e9 => generated 246 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:15.611122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433e2ab-5d2f-4b69-840f-99750d3b7859 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:15.614904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5433e2ab-5d2f-4b69-840f-99750d3b7859 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:15.671048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55c17e3a-fb1d-464a-99b2-5b0e2e7ea96c tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] The token cache is being invalidate because project 37ce0408c96f43c49da39d9f08ff1c3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:15.671473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55c17e3a-fb1d-464a-99b2-5b0e2e7ea96c tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:15.672432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55c17e3a-fb1d-464a-99b2-5b0e2e7ea96c tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:15.674330 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3000/5917] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:15 2022] DELETE /identity/v3/projects/37ce0408c96f43c49da39d9f08ff1c3e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:15.678620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c17e3a-fb1d-464a-99b2-5b0e2e7ea96c tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:15.684266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-55c17e3a-fb1d-464a-99b2-5b0e2e7ea96c tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:15.738654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433e2ab-5d2f-4b69-840f-99750d3b7859 tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:15.787728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c17e3a-fb1d-464a-99b2-5b0e2e7ea96c tempest-ListProjectsStaticTestJSON-1884777887 tempest-ListProjectsStaticTestJSON-1884777887-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:15.795140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6439c16-44a6-48cd-b447-5817580aadba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:15.796531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6439c16-44a6-48cd-b447-5817580aadba admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:15.796880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6439c16-44a6-48cd-b447-5817580aadba admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:15.797163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6439c16-44a6-48cd-b447-5817580aadba admin admin] PATH_INFO: `/v3/users/977932c56c774eafa86bfd396456353b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:15.798474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6439c16-44a6-48cd-b447-5817580aadba admin admin] RBAC: Authorizing `identity:delete_user(user_id=977932c56c774eafa86bfd396456353b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:15.800464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6439c16-44a6-48cd-b447-5817580aadba admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:15.819813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ec13b08b29e4f1f97dc1780b66adff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4abbe4896f404c88158d6ec9a29e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:15.820706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:15.820995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:15.821276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] PATH_INFO: `/v3/domains/27144116d7504a358d834425787da2e9` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:15.836670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=27144116d7504a358d834425787da2e9)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:15.839139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:15.859272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:15.865208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '27144116d7504a358d834425787da2e9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:15.875808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '27144116d7504a358d834425787da2e9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.006525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27144116d7504a358d834425787da2e9', 'request_id': 'req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.013986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6439c16-44a6-48cd-b447-5817580aadba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '977932c56c774eafa86bfd396456353b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.014241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27144116d7504a358d834425787da2e9', 'request_id': 'req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.019022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6439c16-44a6-48cd-b447-5817580aadba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '977932c56c774eafa86bfd396456353b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.023386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27144116d7504a358d834425787da2e9', 'request_id': 'req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.085246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6439c16-44a6-48cd-b447-5817580aadba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '977932c56c774eafa86bfd396456353b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.085897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6439c16-44a6-48cd-b447-5817580aadba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '977932c56c774eafa86bfd396456353b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.101320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6439c16-44a6-48cd-b447-5817580aadba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '977932c56c774eafa86bfd396456353b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.108037 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3001/5918] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:15 2022] DELETE /identity/v3/users/977932c56c774eafa86bfd396456353b => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:16.108820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6439c16-44a6-48cd-b447-5817580aadba admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:16.110126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c6439c16-44a6-48cd-b447-5817580aadba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:16.142101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] The token cache is being invalidate because project 27144116d7504a358d834425787da2e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:16.142469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.143453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.154928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '27144116d7504a358d834425787da2e9', 'request_id': 'req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.155960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '27144116d7504a358d834425787da2e9', 'request_id': 'req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.159204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a tempest-TestDefaultProjectId-1636027217 tempest-TestDefaultProjectId-1636027217-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '27144116d7504a358d834425787da2e9', 'request_id': 'req-02f6c755-0ff3-42cd-a68b-f3ee2040d23a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.171861 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2918/5919] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:30:15 2022] DELETE /identity/v3/domains/27144116d7504a358d834425787da2e9 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:16.173370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea515e67-5e07-47a6-b582-6a5e3ddcb6ea None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:16.173747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea515e67-5e07-47a6-b582-6a5e3ddcb6ea None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:16.175047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea515e67-5e07-47a6-b582-6a5e3ddcb6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:16.195904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ea515e67-5e07-47a6-b582-6a5e3ddcb6ea None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:16.197356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ea515e67-5e07-47a6-b582-6a5e3ddcb6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:16.232608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6439c16-44a6-48cd-b447-5817580aadba admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:16.239233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c787c9-2a25-46d4-8070-c35d36daee03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:16.240937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c787c9-2a25-46d4-8070-c35d36daee03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:16.241269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c787c9-2a25-46d4-8070-c35d36daee03 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:16.241547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c787c9-2a25-46d4-8070-c35d36daee03 admin admin] PATH_INFO: `/v3/users/c229c4b26a5247ddafc848126dad8617` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:16.242841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c787c9-2a25-46d4-8070-c35d36daee03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c229c4b26a5247ddafc848126dad8617)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:16.245671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c787c9-2a25-46d4-8070-c35d36daee03 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:16.314948 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2919/5920] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:16.317285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea515e67-5e07-47a6-b582-6a5e3ddcb6ea None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:16.320305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ea515e67-5e07-47a6-b582-6a5e3ddcb6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:16.345662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea515e67-5e07-47a6-b582-6a5e3ddcb6ea None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:16.355563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4336776-8d3b-4051-9de3-1d201ac94a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:16.359267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4336776-8d3b-4051-9de3-1d201ac94a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:16.359267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4336776-8d3b-4051-9de3-1d201ac94a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:16.359267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4336776-8d3b-4051-9de3-1d201ac94a31 admin admin] PATH_INFO: `/v3/users/205e72444bcb458da4ad0feeff3f9229` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:16.359267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4336776-8d3b-4051-9de3-1d201ac94a31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=205e72444bcb458da4ad0feeff3f9229)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:16.361066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4336776-8d3b-4051-9de3-1d201ac94a31 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:16.504852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-96c787c9-2a25-46d4-8070-c35d36daee03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c229c4b26a5247ddafc848126dad8617'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.513258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-96c787c9-2a25-46d4-8070-c35d36daee03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c229c4b26a5247ddafc848126dad8617'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.629031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a4336776-8d3b-4051-9de3-1d201ac94a31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '205e72444bcb458da4ad0feeff3f9229'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.642155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a4336776-8d3b-4051-9de3-1d201ac94a31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '205e72444bcb458da4ad0feeff3f9229'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.657695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-96c787c9-2a25-46d4-8070-c35d36daee03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c229c4b26a5247ddafc848126dad8617'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.658387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-96c787c9-2a25-46d4-8070-c35d36daee03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c229c4b26a5247ddafc848126dad8617'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.672864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-96c787c9-2a25-46d4-8070-c35d36daee03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c229c4b26a5247ddafc848126dad8617'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.679343 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3002/5921] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:16 2022] DELETE /identity/v3/users/c229c4b26a5247ddafc848126dad8617 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:16.679979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c787c9-2a25-46d4-8070-c35d36daee03 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:16.681850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-96c787c9-2a25-46d4-8070-c35d36daee03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:16.747055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c787c9-2a25-46d4-8070-c35d36daee03 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:16.750775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8b771-61ef-4eb6-b73e-daa7037851f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:16.751460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8b771-61ef-4eb6-b73e-daa7037851f8 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:16.751744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8b771-61ef-4eb6-b73e-daa7037851f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:16.752018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8b771-61ef-4eb6-b73e-daa7037851f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:16.753829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d9a8b771-61ef-4eb6-b73e-daa7037851f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:16.800994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a4336776-8d3b-4051-9de3-1d201ac94a31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '205e72444bcb458da4ad0feeff3f9229'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.816417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a4336776-8d3b-4051-9de3-1d201ac94a31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '205e72444bcb458da4ad0feeff3f9229'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.817166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a4336776-8d3b-4051-9de3-1d201ac94a31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '205e72444bcb458da4ad0feeff3f9229'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:16.824900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:16.830142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8b771-61ef-4eb6-b73e-daa7037851f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:16.830726 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2920/5922] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:16 2022] DELETE /identity/v3/users/205e72444bcb458da4ad0feeff3f9229 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:16.831787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8b771-61ef-4eb6-b73e-daa7037851f8 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:16.832096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e8d1c-6e4d-402c-8fbc-38f306ee3b58 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:16.832415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e8d1c-6e4d-402c-8fbc-38f306ee3b58 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:16.832705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e8d1c-6e4d-402c-8fbc-38f306ee3b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:16.845539 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3003/5923] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:30:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:30:16.849793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04affaf3-189e-4556-8dde-cb909908c7b5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:16.849793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04affaf3-189e-4556-8dde-cb909908c7b5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:16.849793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04affaf3-189e-4556-8dde-cb909908c7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:16.870174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4e8e8d1c-6e4d-402c-8fbc-38f306ee3b58 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:16.871522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4e8e8d1c-6e4d-402c-8fbc-38f306ee3b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:16.882163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-04affaf3-189e-4556-8dde-cb909908c7b5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:16.883414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-04affaf3-189e-4556-8dde-cb909908c7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:16.938780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:16.940617 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2921/5924] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:30:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:16.942052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c385906-d1e8-4f1f-a486-6aae8158a93d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:16.942350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c385906-d1e8-4f1f-a486-6aae8158a93d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:16.942636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c385906-d1e8-4f1f-a486-6aae8158a93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:16.970358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2c385906-d1e8-4f1f-a486-6aae8158a93d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:16.971864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2c385906-d1e8-4f1f-a486-6aae8158a93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:16.991306 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3004/5925] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:16.991306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04affaf3-189e-4556-8dde-cb909908c7b5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:16.991306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-04affaf3-189e-4556-8dde-cb909908c7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:17.102250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04affaf3-189e-4556-8dde-cb909908c7b5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:17.115668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38529074-37ec-4634-bbe6-b70b3628c7c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:17.116415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38529074-37ec-4634-bbe6-b70b3628c7c5 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:17.116709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38529074-37ec-4634-bbe6-b70b3628c7c5 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:17.116991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38529074-37ec-4634-bbe6-b70b3628c7c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:17.124083 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2922/5926] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:17.124083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c385906-d1e8-4f1f-a486-6aae8158a93d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:17.124083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2c385906-d1e8-4f1f-a486-6aae8158a93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:17.127780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38529074-37ec-4634-bbe6-b70b3628c7c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:17.130285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38529074-37ec-4634-bbe6-b70b3628c7c5 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:17.142889 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3005/5927] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:30:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:30:17.149715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38529074-37ec-4634-bbe6-b70b3628c7c5 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:17.156444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-38529074-37ec-4634-bbe6-b70b3628c7c5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:17.221698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c385906-d1e8-4f1f-a486-6aae8158a93d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:17.226705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ddbcb-b6c5-4d51-beb6-fcfcf9edd880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:17.227595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ddbcb-b6c5-4d51-beb6-fcfcf9edd880 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:17.227929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ddbcb-b6c5-4d51-beb6-fcfcf9edd880 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:17.228351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ddbcb-b6c5-4d51-beb6-fcfcf9edd880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:17.240738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ddbcb-b6c5-4d51-beb6-fcfcf9edd880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:17.242280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ddbcb-b6c5-4d51-beb6-fcfcf9edd880 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:17.255832 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2923/5928] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:30:17.265207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38529074-37ec-4634-bbe6-b70b3628c7c5 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:17.270094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed200b-c212-4b13-b93b-ea3e9e3afa91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:17.271040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed200b-c212-4b13-b93b-ea3e9e3afa91 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:17.271498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed200b-c212-4b13-b93b-ea3e9e3afa91 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:17.272355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed200b-c212-4b13-b93b-ea3e9e3afa91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:17.288314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed200b-c212-4b13-b93b-ea3e9e3afa91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:17.290381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed200b-c212-4b13-b93b-ea3e9e3afa91 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:17.304403 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3006/5929] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:30:17.575773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ddbcb-b6c5-4d51-beb6-fcfcf9edd880 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:17.579587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-574ddbcb-b6c5-4d51-beb6-fcfcf9edd880 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:17.607328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ddbcb-b6c5-4d51-beb6-fcfcf9edd880 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:17.614977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576c463-835e-4e52-a873-74435131452a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:17.616191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576c463-835e-4e52-a873-74435131452a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:17.616843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576c463-835e-4e52-a873-74435131452a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:17.617583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576c463-835e-4e52-a873-74435131452a admin admin] PATH_INFO: `/v3/projects/20b46ea6d4a444699616a81b28614377` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:17.621387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576c463-835e-4e52-a873-74435131452a admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b46ea6d4a444699616a81b28614377)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:17.624763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576c463-835e-4e52-a873-74435131452a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:17.671593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:17.846714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:17.855519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5576c463-835e-4e52-a873-74435131452a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b46ea6d4a444699616a81b28614377', 'request_id': 'req-5576c463-835e-4e52-a873-74435131452a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:17.888217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5576c463-835e-4e52-a873-74435131452a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b46ea6d4a444699616a81b28614377', 'request_id': 'req-5576c463-835e-4e52-a873-74435131452a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:17.907179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5576c463-835e-4e52-a873-74435131452a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b46ea6d4a444699616a81b28614377', 'request_id': 'req-5576c463-835e-4e52-a873-74435131452a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:17.912508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed200b-c212-4b13-b93b-ea3e9e3afa91 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:17.914130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e8ed200b-c212-4b13-b93b-ea3e9e3afa91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:17.972879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed200b-c212-4b13-b93b-ea3e9e3afa91 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:17.998024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5576c463-835e-4e52-a873-74435131452a admin admin] The token cache is being invalidate because project 20b46ea6d4a444699616a81b28614377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:17.998310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5576c463-835e-4e52-a873-74435131452a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:17.999204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5576c463-835e-4e52-a873-74435131452a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:18.005129 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2924/5930] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:17 2022] DELETE /identity/v3/projects/20b46ea6d4a444699616a81b28614377 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:18.012800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576c463-835e-4e52-a873-74435131452a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:18.012800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5576c463-835e-4e52-a873-74435131452a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:18.082948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664d65f-aa44-4a10-aec2-be29863b78b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:18.083909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664d65f-aa44-4a10-aec2-be29863b78b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:18.087571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664d65f-aa44-4a10-aec2-be29863b78b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:18.087571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664d65f-aa44-4a10-aec2-be29863b78b9 admin admin] PATH_INFO: `/v3/projects/5a4542af4a214e95911d5090c6e7be2e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:18.087571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664d65f-aa44-4a10-aec2-be29863b78b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4542af4a214e95911d5090c6e7be2e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:18.088360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664d65f-aa44-4a10-aec2-be29863b78b9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:18.183861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576c463-835e-4e52-a873-74435131452a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:18.190351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a7e3c-60ab-42a0-baec-7f96cd096487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:18.191347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a7e3c-60ab-42a0-baec-7f96cd096487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:18.191631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a7e3c-60ab-42a0-baec-7f96cd096487 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:18.191906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a7e3c-60ab-42a0-baec-7f96cd096487 admin admin] PATH_INFO: `/v3/users/cd6c50ff88fa4ceca8a8284e5bdfb936` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:18.193185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a7e3c-60ab-42a0-baec-7f96cd096487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd6c50ff88fa4ceca8a8284e5bdfb936)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:18.195155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a7e3c-60ab-42a0-baec-7f96cd096487 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:18.255612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7664d65f-aa44-4a10-aec2-be29863b78b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4542af4a214e95911d5090c6e7be2e', 'request_id': 'req-7664d65f-aa44-4a10-aec2-be29863b78b9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:18.277954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7664d65f-aa44-4a10-aec2-be29863b78b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4542af4a214e95911d5090c6e7be2e', 'request_id': 'req-7664d65f-aa44-4a10-aec2-be29863b78b9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:18.294086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7664d65f-aa44-4a10-aec2-be29863b78b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4542af4a214e95911d5090c6e7be2e', 'request_id': 'req-7664d65f-aa44-4a10-aec2-be29863b78b9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:18.421257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7664d65f-aa44-4a10-aec2-be29863b78b9 admin admin] The token cache is being invalidate because project 5a4542af4a214e95911d5090c6e7be2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:18.424387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7664d65f-aa44-4a10-aec2-be29863b78b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:18.426859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7664d65f-aa44-4a10-aec2-be29863b78b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:18.430959 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3007/5931] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:17 2022] DELETE /identity/v3/projects/5a4542af4a214e95911d5090c6e7be2e => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:18.435898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664d65f-aa44-4a10-aec2-be29863b78b9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:18.438893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7664d65f-aa44-4a10-aec2-be29863b78b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:18.474126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-137a7e3c-60ab-42a0-baec-7f96cd096487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd6c50ff88fa4ceca8a8284e5bdfb936'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:18.502630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-137a7e3c-60ab-42a0-baec-7f96cd096487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd6c50ff88fa4ceca8a8284e5bdfb936'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:18.600656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-137a7e3c-60ab-42a0-baec-7f96cd096487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd6c50ff88fa4ceca8a8284e5bdfb936'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:18.613843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-137a7e3c-60ab-42a0-baec-7f96cd096487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd6c50ff88fa4ceca8a8284e5bdfb936'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:18.620117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-137a7e3c-60ab-42a0-baec-7f96cd096487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd6c50ff88fa4ceca8a8284e5bdfb936'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:18.626425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664d65f-aa44-4a10-aec2-be29863b78b9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:18.627691 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2925/5932] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:18 2022] DELETE /identity/v3/users/cd6c50ff88fa4ceca8a8284e5bdfb936 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:18.632043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c77b3-38eb-4126-9c52-f1d6eb0aac95 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:18.632339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c77b3-38eb-4126-9c52-f1d6eb0aac95 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:18.632630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c77b3-38eb-4126-9c52-f1d6eb0aac95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:18.653178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e73c77b3-38eb-4126-9c52-f1d6eb0aac95 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:18.654651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e73c77b3-38eb-4126-9c52-f1d6eb0aac95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:18.738442 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2926/5933] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:18.748439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a291908-890a-487d-bf8a-9ac856ea023f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:18.749362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a291908-890a-487d-bf8a-9ac856ea023f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:18.749885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a291908-890a-487d-bf8a-9ac856ea023f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:18.788607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2035fe3-9ec5-40d6-a8d8-c9b281583371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:18.789814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2035fe3-9ec5-40d6-a8d8-c9b281583371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:18.791811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2035fe3-9ec5-40d6-a8d8-c9b281583371 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:18.793004 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2035fe3-9ec5-40d6-a8d8-c9b281583371 admin admin] PATH_INFO: `/v3/projects/6db8c1bc7736409799d6c96274e941f6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:18.794091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2035fe3-9ec5-40d6-a8d8-c9b281583371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6db8c1bc7736409799d6c96274e941f6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:18.796493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5a291908-890a-487d-bf8a-9ac856ea023f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:18.797908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5a291908-890a-487d-bf8a-9ac856ea023f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:18.799112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2035fe3-9ec5-40d6-a8d8-c9b281583371 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:18.808392 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2927/5934] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:30:18.812265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a291908-890a-487d-bf8a-9ac856ea023f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:18.848440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a291908-890a-487d-bf8a-9ac856ea023f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:18.871579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05e864-3cd6-488e-9597-f24bb9478fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:18.872728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05e864-3cd6-488e-9597-f24bb9478fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:18.873660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05e864-3cd6-488e-9597-f24bb9478fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:18.874031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05e864-3cd6-488e-9597-f24bb9478fe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:18.874903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05e864-3cd6-488e-9597-f24bb9478fe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:30:18.875313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05e864-3cd6-488e-9597-f24bb9478fe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:18.879197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05e864-3cd6-488e-9597-f24bb9478fe0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:18.941184 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2928/5935] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:30:18.944771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05e864-3cd6-488e-9597-f24bb9478fe0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:18.990790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05e864-3cd6-488e-9597-f24bb9478fe0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:18.998534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21c76a-8abc-42b3-8908-be2c9a596f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:18.999171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21c76a-8abc-42b3-8908-be2c9a596f2f admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:18.999470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21c76a-8abc-42b3-8908-be2c9a596f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:18.999797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21c76a-8abc-42b3-8908-be2c9a596f2f admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:19.002156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21c76a-8abc-42b3-8908-be2c9a596f2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:19.004733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21c76a-8abc-42b3-8908-be2c9a596f2f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:19.032493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b2035fe3-9ec5-40d6-a8d8-c9b281583371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6db8c1bc7736409799d6c96274e941f6', 'request_id': 'req-b2035fe3-9ec5-40d6-a8d8-c9b281583371'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:19.049637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b2035fe3-9ec5-40d6-a8d8-c9b281583371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6db8c1bc7736409799d6c96274e941f6', 'request_id': 'req-b2035fe3-9ec5-40d6-a8d8-c9b281583371'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:19.059950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b2035fe3-9ec5-40d6-a8d8-c9b281583371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6db8c1bc7736409799d6c96274e941f6', 'request_id': 'req-b2035fe3-9ec5-40d6-a8d8-c9b281583371'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:19.096175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:19.152046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b2035fe3-9ec5-40d6-a8d8-c9b281583371 admin admin] The token cache is being invalidate because project 6db8c1bc7736409799d6c96274e941f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:19.152555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b2035fe3-9ec5-40d6-a8d8-c9b281583371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:19.155921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b2035fe3-9ec5-40d6-a8d8-c9b281583371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:19.162852 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3008/5936] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:18 2022] DELETE /identity/v3/projects/6db8c1bc7736409799d6c96274e941f6 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:19.169067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2035fe3-9ec5-40d6-a8d8-c9b281583371 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:19.173205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b2035fe3-9ec5-40d6-a8d8-c9b281583371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:19.176400 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2929/5937] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:18 2022] POST /identity/v3/projects => generated 371 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:19.180555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21c76a-8abc-42b3-8908-be2c9a596f2f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:19.184910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fd21c76a-8abc-42b3-8908-be2c9a596f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:19.292803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:19.347445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21c76a-8abc-42b3-8908-be2c9a596f2f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:19.352763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb3dfb-a53b-4f1b-8075-19bc16a8dd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:19.354038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb3dfb-a53b-4f1b-8075-19bc16a8dd63 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:19.354345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb3dfb-a53b-4f1b-8075-19bc16a8dd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:19.354576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb3dfb-a53b-4f1b-8075-19bc16a8dd63 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:19.355848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb3dfb-a53b-4f1b-8075-19bc16a8dd63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:19.358049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb3dfb-a53b-4f1b-8075-19bc16a8dd63 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:19.378347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2035fe3-9ec5-40d6-a8d8-c9b281583371 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:19.384119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1704a2-3621-4daf-90bc-80bc8567c687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:19.385879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1704a2-3621-4daf-90bc-80bc8567c687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:19.386157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1704a2-3621-4daf-90bc-80bc8567c687 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:19.386434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1704a2-3621-4daf-90bc-80bc8567c687 admin admin] PATH_INFO: `/v3/users/1ec13b08b29e4f1f97dc1780b66adff4` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:19.387824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1704a2-3621-4daf-90bc-80bc8567c687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ec13b08b29e4f1f97dc1780b66adff4)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:19.405655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1704a2-3621-4daf-90bc-80bc8567c687 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:19.504976 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2930/5938] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:19 2022] POST /identity/v3/users => generated 286 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:19.505843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb3dfb-a53b-4f1b-8075-19bc16a8dd63 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:19.508798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-59fb3dfb-a53b-4f1b-8075-19bc16a8dd63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:19.532728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb3dfb-a53b-4f1b-8075-19bc16a8dd63 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:19.538339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d849026-f9f6-4bab-8185-bddb975492f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:19.539524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849026-f9f6-4bab-8185-bddb975492f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:19.539856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849026-f9f6-4bab-8185-bddb975492f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:19.540115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849026-f9f6-4bab-8185-bddb975492f0 admin admin] PATH_INFO: `/v3/projects/c216081b32484c0d966c70bc7d0185ab` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:19.541932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d849026-f9f6-4bab-8185-bddb975492f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c216081b32484c0d966c70bc7d0185ab)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:19.544341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d849026-f9f6-4bab-8185-bddb975492f0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:19.680634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0f1704a2-3621-4daf-90bc-80bc8567c687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ec13b08b29e4f1f97dc1780b66adff4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:19.696774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3d849026-f9f6-4bab-8185-bddb975492f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c216081b32484c0d966c70bc7d0185ab', 'request_id': 'req-3d849026-f9f6-4bab-8185-bddb975492f0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:19.702002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0f1704a2-3621-4daf-90bc-80bc8567c687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ec13b08b29e4f1f97dc1780b66adff4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:19.710782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3d849026-f9f6-4bab-8185-bddb975492f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c216081b32484c0d966c70bc7d0185ab', 'request_id': 'req-3d849026-f9f6-4bab-8185-bddb975492f0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:19.733401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3d849026-f9f6-4bab-8185-bddb975492f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c216081b32484c0d966c70bc7d0185ab', 'request_id': 'req-3d849026-f9f6-4bab-8185-bddb975492f0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:19.765846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0f1704a2-3621-4daf-90bc-80bc8567c687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ec13b08b29e4f1f97dc1780b66adff4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:19.766513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0f1704a2-3621-4daf-90bc-80bc8567c687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ec13b08b29e4f1f97dc1780b66adff4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:19.780813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0f1704a2-3621-4daf-90bc-80bc8567c687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ec13b08b29e4f1f97dc1780b66adff4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:19.788052 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3009/5939] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:19 2022] DELETE /identity/v3/users/1ec13b08b29e4f1f97dc1780b66adff4 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:19.788763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1704a2-3621-4daf-90bc-80bc8567c687 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:19.793744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:19.796530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0f1704a2-3621-4daf-90bc-80bc8567c687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:19.844458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3d849026-f9f6-4bab-8185-bddb975492f0 admin admin] The token cache is being invalidate because project c216081b32484c0d966c70bc7d0185ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:19.844733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3d849026-f9f6-4bab-8185-bddb975492f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:19.845465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3d849026-f9f6-4bab-8185-bddb975492f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:19.847534 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2931/5940] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:19 2022] DELETE /identity/v3/projects/c216081b32484c0d966c70bc7d0185ab => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:19.855296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b37dc-f244-4628-8d04-77ebe839c257 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:19.855589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b37dc-f244-4628-8d04-77ebe839c257 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:19.855869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b37dc-f244-4628-8d04-77ebe839c257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:19.895386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-763b37dc-f244-4628-8d04-77ebe839c257 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:19.896649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-763b37dc-f244-4628-8d04-77ebe839c257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:19.933128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1704a2-3621-4daf-90bc-80bc8567c687 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:19.950535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75195a5c-1c08-40c9-9d55-383b831a581d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:19.951535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75195a5c-1c08-40c9-9d55-383b831a581d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:19.955981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75195a5c-1c08-40c9-9d55-383b831a581d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:19.955981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75195a5c-1c08-40c9-9d55-383b831a581d admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:19.955981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75195a5c-1c08-40c9-9d55-383b831a581d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:19.955981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75195a5c-1c08-40c9-9d55-383b831a581d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:19.986429 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3010/5941] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:19.990462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75195a5c-1c08-40c9-9d55-383b831a581d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:19.992412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-75195a5c-1c08-40c9-9d55-383b831a581d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:20.020668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75195a5c-1c08-40c9-9d55-383b831a581d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:20.030563 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2932/5942] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:20.038974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76414f3-ff07-477d-9a68-515db55f516a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:20.039305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76414f3-ff07-477d-9a68-515db55f516a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:20.039569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76414f3-ff07-477d-9a68-515db55f516a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:20.041249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5f206-ed38-4726-aea9-bcc84bff0eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:20.041931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5f206-ed38-4726-aea9-bcc84bff0eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:20.042246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5f206-ed38-4726-aea9-bcc84bff0eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:20.042729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5f206-ed38-4726-aea9-bcc84bff0eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:20.043891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5f206-ed38-4726-aea9-bcc84bff0eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:20.045724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5f206-ed38-4726-aea9-bcc84bff0eb4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:20.063078 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3011/5943] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:20.067401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5f206-ed38-4726-aea9-bcc84bff0eb4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:20.076078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b76414f3-ff07-477d-9a68-515db55f516a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:20.077956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b76414f3-ff07-477d-9a68-515db55f516a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:20.080891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5f206-ed38-4726-aea9-bcc84bff0eb4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:20.088629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dc0fd-59ea-49ea-bca3-6972a45d130b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:20.089782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dc0fd-59ea-49ea-bca3-6972a45d130b admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:20.090240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dc0fd-59ea-49ea-bca3-6972a45d130b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:20.090686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dc0fd-59ea-49ea-bca3-6972a45d130b admin admin] PATH_INFO: `/v3/projects/7658815dc50d42f49ed6d9aac9a6c98b/users/1c2f611a34d442b882c1ba152e7ed628/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:20.095269 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2933/5944] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:30:20.100004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76414f3-ff07-477d-9a68-515db55f516a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:20.113741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dc0fd-59ea-49ea-bca3-6972a45d130b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7658815dc50d42f49ed6d9aac9a6c98b, user_id=1c2f611a34d442b882c1ba152e7ed628, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:20.117202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76414f3-ff07-477d-9a68-515db55f516a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:20.118287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dc0fd-59ea-49ea-bca3-6972a45d130b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:20.122543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a78fa7-e067-4842-adcd-2682eeb69bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:20.123278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a78fa7-e067-4842-adcd-2682eeb69bae admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:20.123561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a78fa7-e067-4842-adcd-2682eeb69bae admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:20.123838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a78fa7-e067-4842-adcd-2682eeb69bae admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:20.124577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a78fa7-e067-4842-adcd-2682eeb69bae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:30:20.124897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a78fa7-e067-4842-adcd-2682eeb69bae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:20.126567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a78fa7-e067-4842-adcd-2682eeb69bae admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:20.178263 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2934/5945] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:30:20.184531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a78fa7-e067-4842-adcd-2682eeb69bae admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:20.199894 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3012/5946] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:20 2022] PUT /identity/v3/projects/7658815dc50d42f49ed6d9aac9a6c98b/users/1c2f611a34d442b882c1ba152e7ed628/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:20.210253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a78fa7-e067-4842-adcd-2682eeb69bae admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:20.212066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8ac23-be8a-4776-9fdb-cd27c441205b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:20.213311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8ac23-be8a-4776-9fdb-cd27c441205b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:20.213865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8ac23-be8a-4776-9fdb-cd27c441205b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:20.285108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-65d8ac23-be8a-4776-9fdb-cd27c441205b None None] MFA Rules not processed for user `1c2f611a34d442b882c1ba152e7ed628`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:20.288499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-65d8ac23-be8a-4776-9fdb-cd27c441205b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:20.345617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93206375-f473-4f6f-a973-3534d39423c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:20.346609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93206375-f473-4f6f-a973-3534d39423c2 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:20.346987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93206375-f473-4f6f-a973-3534d39423c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:20.347409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93206375-f473-4f6f-a973-3534d39423c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:20.348180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93206375-f473-4f6f-a973-3534d39423c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:20.350776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93206375-f473-4f6f-a973-3534d39423c2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:20.399313 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3013/5947] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:20.411326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8ac23-be8a-4776-9fdb-cd27c441205b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:20.413002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-65d8ac23-be8a-4776-9fdb-cd27c441205b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:20.488394 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2935/5948] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:20 2022] POST /identity/v3/projects => generated 367 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:20.499189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93206375-f473-4f6f-a973-3534d39423c2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:20.526721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8ac23-be8a-4776-9fdb-cd27c441205b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:20.590615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93206375-f473-4f6f-a973-3534d39423c2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:20.598953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f4c20-7835-4f37-9b5c-b08a6a136d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:20.600156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f4c20-7835-4f37-9b5c-b08a6a136d49 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:20.600987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f4c20-7835-4f37-9b5c-b08a6a136d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:20.601506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f4c20-7835-4f37-9b5c-b08a6a136d49 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:20.602489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f4c20-7835-4f37-9b5c-b08a6a136d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:20.605826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f4c20-7835-4f37-9b5c-b08a6a136d49 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:20.663832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63832aa-1dee-4891-8cc3-6946643d8296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:20.664502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63832aa-1dee-4891-8cc3-6946643d8296 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:20.664787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63832aa-1dee-4891-8cc3-6946643d8296 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:20.665064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63832aa-1dee-4891-8cc3-6946643d8296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:20.717550 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2936/5949] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:20 2022] POST /identity/v3/users => generated 284 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:20.729240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f4c20-7835-4f37-9b5c-b08a6a136d49 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:20.746286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:20.750252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f4c20-7835-4f37-9b5c-b08a6a136d49 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:20.758401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1301c13-9de2-4095-a5fb-1a27de451fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:20.759198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1301c13-9de2-4095-a5fb-1a27de451fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:20.759661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1301c13-9de2-4095-a5fb-1a27de451fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:20.759956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1301c13-9de2-4095-a5fb-1a27de451fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:20.760940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1301c13-9de2-4095-a5fb-1a27de451fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:20.763541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1301c13-9de2-4095-a5fb-1a27de451fc3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:20.798810 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2937/5950] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:20.800479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1301c13-9de2-4095-a5fb-1a27de451fc3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:20.810294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c1301c13-9de2-4095-a5fb-1a27de451fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:20.835316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63832aa-1dee-4891-8cc3-6946643d8296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:20.838205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63832aa-1dee-4891-8cc3-6946643d8296 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:20.849303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1301c13-9de2-4095-a5fb-1a27de451fc3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:20.856983 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3014/5951] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:30:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:30:20.859588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63832aa-1dee-4891-8cc3-6946643d8296 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:20.859723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1004d-2ab4-409b-9016-52b6bfe86f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:20.870450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1004d-2ab4-409b-9016-52b6bfe86f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:20.870915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1004d-2ab4-409b-9016-52b6bfe86f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:20.871397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1004d-2ab4-409b-9016-52b6bfe86f35 admin admin] PATH_INFO: `/v3/projects/eb4abbe4896f404c88158d6ec9a29e6d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:20.872431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63832aa-1dee-4891-8cc3-6946643d8296 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:20.873163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1004d-2ab4-409b-9016-52b6bfe86f35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb4abbe4896f404c88158d6ec9a29e6d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:20.875373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1004d-2ab4-409b-9016-52b6bfe86f35 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:20.880558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0920c84-4ee7-4098-af78-541043d40b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:20.882189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0920c84-4ee7-4098-af78-541043d40b77 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:20.882806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0920c84-4ee7-4098-af78-541043d40b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:20.883546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0920c84-4ee7-4098-af78-541043d40b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:20.885018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0920c84-4ee7-4098-af78-541043d40b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:20.887839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0920c84-4ee7-4098-af78-541043d40b77 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:20.902895 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3015/5952] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:20.908009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0920c84-4ee7-4098-af78-541043d40b77 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:20.920827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0920c84-4ee7-4098-af78-541043d40b77 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:20.927227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654eb8ce-0eac-4fe4-82f7-58fe4e44c7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:20.928230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654eb8ce-0eac-4fe4-82f7-58fe4e44c7af admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:20.933916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654eb8ce-0eac-4fe4-82f7-58fe4e44c7af admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:20.933916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654eb8ce-0eac-4fe4-82f7-58fe4e44c7af admin admin] PATH_INFO: `/v3/projects/97fbc1672a9a46679a00c3db9b70126e/users/ea29b237d20848ba8ac08614ebd7c47c/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:20.946406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654eb8ce-0eac-4fe4-82f7-58fe4e44c7af admin admin] RBAC: Authorizing `identity:create_grant(project_id=97fbc1672a9a46679a00c3db9b70126e, user_id=ea29b237d20848ba8ac08614ebd7c47c, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:20.950093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654eb8ce-0eac-4fe4-82f7-58fe4e44c7af admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:21.084936 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3016/5953] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:20 2022] PUT /identity/v3/projects/97fbc1672a9a46679a00c3db9b70126e/users/ea29b237d20848ba8ac08614ebd7c47c/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:21.110917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb582c82-7c48-4bb4-819e-6b573cd55584 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:21.110917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb582c82-7c48-4bb4-819e-6b573cd55584 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:21.110917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb582c82-7c48-4bb4-819e-6b573cd55584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:21.111233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0d1004d-2ab4-409b-9016-52b6bfe86f35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb4abbe4896f404c88158d6ec9a29e6d', 'request_id': 'req-b0d1004d-2ab4-409b-9016-52b6bfe86f35'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:21.114007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0d1004d-2ab4-409b-9016-52b6bfe86f35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb4abbe4896f404c88158d6ec9a29e6d', 'request_id': 'req-b0d1004d-2ab4-409b-9016-52b6bfe86f35'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:21.133226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0d1004d-2ab4-409b-9016-52b6bfe86f35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb4abbe4896f404c88158d6ec9a29e6d', 'request_id': 'req-b0d1004d-2ab4-409b-9016-52b6bfe86f35'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:21.153445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-bb582c82-7c48-4bb4-819e-6b573cd55584 None None] MFA Rules not processed for user `ea29b237d20848ba8ac08614ebd7c47c`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:21.154706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bb582c82-7c48-4bb4-819e-6b573cd55584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:21.234902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0d1004d-2ab4-409b-9016-52b6bfe86f35 admin admin] The token cache is being invalidate because project eb4abbe4896f404c88158d6ec9a29e6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:21.235316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0d1004d-2ab4-409b-9016-52b6bfe86f35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:21.235952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0d1004d-2ab4-409b-9016-52b6bfe86f35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:21.238007 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2938/5954] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:20 2022] DELETE /identity/v3/projects/eb4abbe4896f404c88158d6ec9a29e6d => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:21.245076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582c898-9c0c-45ce-aac1-8555a9837f1d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:21.245076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582c898-9c0c-45ce-aac1-8555a9837f1d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:21.245076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582c898-9c0c-45ce-aac1-8555a9837f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:21.261815 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3017/5955] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:21.269478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb582c82-7c48-4bb4-819e-6b573cd55584 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:21.276971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6582c898-9c0c-45ce-aac1-8555a9837f1d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:21.278349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6582c898-9c0c-45ce-aac1-8555a9837f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:21.354338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb582c82-7c48-4bb4-819e-6b573cd55584 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:21.365341 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2939/5956] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:21.365528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206076a-2375-471d-84ac-2c80c946dd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:21.365528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206076a-2375-471d-84ac-2c80c946dd82 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:21.365528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206076a-2375-471d-84ac-2c80c946dd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:21.365528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206076a-2375-471d-84ac-2c80c946dd82 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:21.365866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206076a-2375-471d-84ac-2c80c946dd82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:21.365866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206076a-2375-471d-84ac-2c80c946dd82 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:21.369242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2a3b8-618e-433c-bc22-7323922ea379 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:21.369645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2a3b8-618e-433c-bc22-7323922ea379 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:21.370366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2a3b8-618e-433c-bc22-7323922ea379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:21.391497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c3d2a3b8-618e-433c-bc22-7323922ea379 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:21.393707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c3d2a3b8-618e-433c-bc22-7323922ea379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:21.405365 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2940/5957] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:21.406540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2a3b8-618e-433c-bc22-7323922ea379 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:21.416723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2a3b8-618e-433c-bc22-7323922ea379 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:21.421643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5debbc5-de6c-4909-a43c-897562aab0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:21.422301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5debbc5-de6c-4909-a43c-897562aab0f9 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:21.422589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5debbc5-de6c-4909-a43c-897562aab0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:21.422874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5debbc5-de6c-4909-a43c-897562aab0f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:21.423645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5debbc5-de6c-4909-a43c-897562aab0f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:30:21.423958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5debbc5-de6c-4909-a43c-897562aab0f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:21.425562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5debbc5-de6c-4909-a43c-897562aab0f9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:21.437663 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3018/5958] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:21 2022] POST /identity/v3/projects => generated 367 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:21.443378 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2941/5959] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:30:21.443561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206076a-2375-471d-84ac-2c80c946dd82 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:21.444418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5debbc5-de6c-4909-a43c-897562aab0f9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:21.445915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9206076a-2375-471d-84ac-2c80c946dd82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:21.456196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5debbc5-de6c-4909-a43c-897562aab0f9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:21.518657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206076a-2375-471d-84ac-2c80c946dd82 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:21.518984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43160705-054f-4915-80ac-fb8a04bba989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:21.522165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43160705-054f-4915-80ac-fb8a04bba989 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:21.522165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43160705-054f-4915-80ac-fb8a04bba989 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:21.522165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43160705-054f-4915-80ac-fb8a04bba989 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:21.522165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43160705-054f-4915-80ac-fb8a04bba989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:21.522986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43160705-054f-4915-80ac-fb8a04bba989 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:21.523530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5fce2-ad0a-40c9-872e-65e2597ecbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:21.524190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5fce2-ad0a-40c9-872e-65e2597ecbae admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:21.524490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5fce2-ad0a-40c9-872e-65e2597ecbae admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:21.525289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5fce2-ad0a-40c9-872e-65e2597ecbae admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:21.526307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5fce2-ad0a-40c9-872e-65e2597ecbae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:21.528321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5fce2-ad0a-40c9-872e-65e2597ecbae admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:21.631758 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2942/5960] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:21 2022] POST /identity/v3/projects => generated 365 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:30:21.633464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43160705-054f-4915-80ac-fb8a04bba989 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:21.675465 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3019/5961] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:21 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:30:21.679640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5fce2-ad0a-40c9-872e-65e2597ecbae admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:21.690661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5fce2-ad0a-40c9-872e-65e2597ecbae admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:21.704482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43160705-054f-4915-80ac-fb8a04bba989 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:21.709596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842eda2-20d8-46e5-99cd-8e4d034f82fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:21.710306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842eda2-20d8-46e5-99cd-8e4d034f82fe admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:21.711786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842eda2-20d8-46e5-99cd-8e4d034f82fe admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:21.711786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842eda2-20d8-46e5-99cd-8e4d034f82fe admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:21.711786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842eda2-20d8-46e5-99cd-8e4d034f82fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:21.714399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842eda2-20d8-46e5-99cd-8e4d034f82fe admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:21.754698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af58a10-8273-43f5-a058-c28d0e442c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:21.760643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af58a10-8273-43f5-a058-c28d0e442c5b admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:21.760643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af58a10-8273-43f5-a058-c28d0e442c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:21.760643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af58a10-8273-43f5-a058-c28d0e442c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:21.760643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af58a10-8273-43f5-a058-c28d0e442c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:21.760643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af58a10-8273-43f5-a058-c28d0e442c5b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:21.772421 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3020/5962] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:30:21.773415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af58a10-8273-43f5-a058-c28d0e442c5b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:21.784630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af58a10-8273-43f5-a058-c28d0e442c5b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:21.793185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474d367-2980-4cc1-b712-a571232adc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:21.794119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474d367-2980-4cc1-b712-a571232adc8a admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:21.794446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474d367-2980-4cc1-b712-a571232adc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:21.794735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474d367-2980-4cc1-b712-a571232adc8a admin admin] PATH_INFO: `/v3/projects/9f521940ddf1495b94a52a06c299b198/users/cb9bb40fb67a46c88ee60439fe4ac5a4/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:21.807023 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2943/5963] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:21 2022] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:30:21.807486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842eda2-20d8-46e5-99cd-8e4d034f82fe admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:21.816076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474d367-2980-4cc1-b712-a571232adc8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f521940ddf1495b94a52a06c299b198, user_id=cb9bb40fb67a46c88ee60439fe4ac5a4, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:21.818961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842eda2-20d8-46e5-99cd-8e4d034f82fe admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:21.819560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474d367-2980-4cc1-b712-a571232adc8a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:21.825147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dee8df-e2b0-45cd-878f-ce0f32f5f529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:21.825828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dee8df-e2b0-45cd-878f-ce0f32f5f529 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:21.826115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dee8df-e2b0-45cd-878f-ce0f32f5f529 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:21.826395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dee8df-e2b0-45cd-878f-ce0f32f5f529 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:21.827507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dee8df-e2b0-45cd-878f-ce0f32f5f529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:21.829479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dee8df-e2b0-45cd-878f-ce0f32f5f529 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:21.847349 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2944/5964] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:21.848258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dee8df-e2b0-45cd-878f-ce0f32f5f529 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:21.856673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:21.869712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dee8df-e2b0-45cd-878f-ce0f32f5f529 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:21.875267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa172b8-4584-47d8-9b6f-4add3db009b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:21.875949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa172b8-4584-47d8-9b6f-4add3db009b9 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:21.876234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa172b8-4584-47d8-9b6f-4add3db009b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:21.876540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa172b8-4584-47d8-9b6f-4add3db009b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:21.877397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa172b8-4584-47d8-9b6f-4add3db009b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:21.879098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa172b8-4584-47d8-9b6f-4add3db009b9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:21.894812 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3021/5965] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:21 2022] PUT /identity/v3/projects/9f521940ddf1495b94a52a06c299b198/users/cb9bb40fb67a46c88ee60439fe4ac5a4/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:21.895211 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2945/5966] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:21.896284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474d367-2980-4cc1-b712-a571232adc8a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:21.899715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa172b8-4584-47d8-9b6f-4add3db009b9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:21.913397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa172b8-4584-47d8-9b6f-4add3db009b9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:21.966960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474d367-2980-4cc1-b712-a571232adc8a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:21.972023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd9476-bc34-4c1c-aa7a-90c6b586b13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:21.972696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd9476-bc34-4c1c-aa7a-90c6b586b13a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:21.972986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd9476-bc34-4c1c-aa7a-90c6b586b13a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:21.973551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd9476-bc34-4c1c-aa7a-90c6b586b13a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:21.974084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd9476-bc34-4c1c-aa7a-90c6b586b13a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:21.975743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd9476-bc34-4c1c-aa7a-90c6b586b13a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:21.984617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2365233-8412-4582-a64c-d46c5ae5b2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:21.985506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2365233-8412-4582-a64c-d46c5ae5b2e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:21.985796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2365233-8412-4582-a64c-d46c5ae5b2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:21.986077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2365233-8412-4582-a64c-d46c5ae5b2e8 admin admin] PATH_INFO: `/v3/projects/3d24ac7ace994150bd98ad729d469043/users/6521264b77dc485d83b1b77843a4cd03/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:21.989323 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3022/5967] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:21.990686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd9476-bc34-4c1c-aa7a-90c6b586b13a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:22.001208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd9476-bc34-4c1c-aa7a-90c6b586b13a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:22.003350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2365233-8412-4582-a64c-d46c5ae5b2e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d24ac7ace994150bd98ad729d469043, user_id=6521264b77dc485d83b1b77843a4cd03, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:22.005991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2365233-8412-4582-a64c-d46c5ae5b2e8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:22.006137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196dc5c0-ed95-4db2-b68c-468ba9fbddb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:22.006948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dc5c0-ed95-4db2-b68c-468ba9fbddb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:22.007282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dc5c0-ed95-4db2-b68c-468ba9fbddb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:22.007563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dc5c0-ed95-4db2-b68c-468ba9fbddb0 admin admin] PATH_INFO: `/v3/projects/9f521940ddf1495b94a52a06c299b198/users/cb9bb40fb67a46c88ee60439fe4ac5a4/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:22.010088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196dc5c0-ed95-4db2-b68c-468ba9fbddb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f521940ddf1495b94a52a06c299b198, user_id=cb9bb40fb67a46c88ee60439fe4ac5a4, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:22.012906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196dc5c0-ed95-4db2-b68c-468ba9fbddb0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:22.023705 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3023/5968] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:21 2022] PUT /identity/v3/projects/9f521940ddf1495b94a52a06c299b198/users/cb9bb40fb67a46c88ee60439fe4ac5a4/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:22.036167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002fee0-fb55-4565-9f17-8f66cbf11653 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:22.036458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002fee0-fb55-4565-9f17-8f66cbf11653 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:22.036743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002fee0-fb55-4565-9f17-8f66cbf11653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:22.063092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:22.065811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4002fee0-fb55-4565-9f17-8f66cbf11653 None None] MFA Rules not processed for user `cb9bb40fb67a46c88ee60439fe4ac5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:22.067127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4002fee0-fb55-4565-9f17-8f66cbf11653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:22.141174 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2946/5969] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:21 2022] PUT /identity/v3/projects/3d24ac7ace994150bd98ad729d469043/users/6521264b77dc485d83b1b77843a4cd03/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:22.153343 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3024/5970] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:22 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:22.153991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a86631-e367-44c5-9666-3db63993e390 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:22.154501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a86631-e367-44c5-9666-3db63993e390 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:22.155133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a86631-e367-44c5-9666-3db63993e390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:22.157725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002fee0-fb55-4565-9f17-8f66cbf11653 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:22.174993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002fee0-fb55-4565-9f17-8f66cbf11653 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:22.241994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-34a86631-e367-44c5-9666-3db63993e390 None None] MFA Rules not processed for user `6521264b77dc485d83b1b77843a4cd03`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:22.242622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff7334-8b71-477e-b74a-7d4ed9205f92 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9bb40fb67a46c88ee60439fe4ac5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f521940ddf1495b94a52a06c299b198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:22.243339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff7334-8b71-477e-b74a-7d4ed9205f92 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:22.244353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff7334-8b71-477e-b74a-7d4ed9205f92 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:22.244643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff7334-8b71-477e-b74a-7d4ed9205f92 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:22.245392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff7334-8b71-477e-b74a-7d4ed9205f92 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:22.247081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff7334-8b71-477e-b74a-7d4ed9205f92 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:22.247868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-34a86631-e367-44c5-9666-3db63993e390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:22.360149 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3025/5971] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:30:22 2022] POST /identity/v3/domains => generated 275 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:22.362959 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2947/5972] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:22.375545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff7334-8b71-477e-b74a-7d4ed9205f92 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:22.377630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a86631-e367-44c5-9666-3db63993e390 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:22.504550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff7334-8b71-477e-b74a-7d4ed9205f92 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:22.522901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3979a-6215-40aa-bbc7-afa5aece4bd1 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9bb40fb67a46c88ee60439fe4ac5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f521940ddf1495b94a52a06c299b198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:22.523786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3979a-6215-40aa-bbc7-afa5aece4bd1 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:22.524343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3979a-6215-40aa-bbc7-afa5aece4bd1 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:22.524969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3979a-6215-40aa-bbc7-afa5aece4bd1 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:22.536257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3979a-6215-40aa-bbc7-afa5aece4bd1 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:22.538274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3979a-6215-40aa-bbc7-afa5aece4bd1 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:22.568496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a86631-e367-44c5-9666-3db63993e390 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:22.636077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:22.678989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12b105-9335-4242-a2ea-b621dfb14922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:22.679697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12b105-9335-4242-a2ea-b621dfb14922 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:22.679981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12b105-9335-4242-a2ea-b621dfb14922 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:22.680257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12b105-9335-4242-a2ea-b621dfb14922 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:22.682270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12b105-9335-4242-a2ea-b621dfb14922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:22.684773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12b105-9335-4242-a2ea-b621dfb14922 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:22.690004 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3026/5973] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:22 2022] POST /identity/v3/users => generated 347 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:22.694589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3979a-6215-40aa-bbc7-afa5aece4bd1 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:22.708806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3979a-6215-40aa-bbc7-afa5aece4bd1 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:22.715000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98215e2f-e70f-4f65-9ca8-3bd8a4fe342c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9bb40fb67a46c88ee60439fe4ac5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f521940ddf1495b94a52a06c299b198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:22.715914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98215e2f-e70f-4f65-9ca8-3bd8a4fe342c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:22.716291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98215e2f-e70f-4f65-9ca8-3bd8a4fe342c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:22.716698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98215e2f-e70f-4f65-9ca8-3bd8a4fe342c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:22.717617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98215e2f-e70f-4f65-9ca8-3bd8a4fe342c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:22.720086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98215e2f-e70f-4f65-9ca8-3bd8a4fe342c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:22.808581 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2948/5974] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:22 2022] POST /identity/v3/projects => generated 365 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:22.812627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12b105-9335-4242-a2ea-b621dfb14922 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:22.835050 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3027/5975] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:22 2022] POST /identity/v3/users => generated 322 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:22.836161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98215e2f-e70f-4f65-9ca8-3bd8a4fe342c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:22.861913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98215e2f-e70f-4f65-9ca8-3bd8a4fe342c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:22.950307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12b105-9335-4242-a2ea-b621dfb14922 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:22.976853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:22.981935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655450e-a063-4093-8811-bf0f78ae9a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:22.983595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655450e-a063-4093-8811-bf0f78ae9a5e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:22.983947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655450e-a063-4093-8811-bf0f78ae9a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:22.984744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655450e-a063-4093-8811-bf0f78ae9a5e admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:22.985644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655450e-a063-4093-8811-bf0f78ae9a5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:22.988596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655450e-a063-4093-8811-bf0f78ae9a5e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:23.006420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514921cb-571f-4b68-b366-4825553c089d tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9bb40fb67a46c88ee60439fe4ac5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f521940ddf1495b94a52a06c299b198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:23.007665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514921cb-571f-4b68-b366-4825553c089d tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:23.008064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514921cb-571f-4b68-b366-4825553c089d tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:23.008480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514921cb-571f-4b68-b366-4825553c089d tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] PATH_INFO: `/v3/users/fc8fdcd3c6f34bf2a656f506721b66f7` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:23.026455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514921cb-571f-4b68-b366-4825553c089d tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorizing `identity:get_user(user_id=fc8fdcd3c6f34bf2a656f506721b66f7)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:23.029383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514921cb-571f-4b68-b366-4825553c089d tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:23.030836 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3028/5976] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Jul 16 21:30:22 2022] GET /identity/v3/users/fc8fdcd3c6f34bf2a656f506721b66f7 => generated 347 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:23.036165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514921cb-571f-4b68-b366-4825553c089d tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:23.051422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514921cb-571f-4b68-b366-4825553c089d tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:23.060204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36572d85-231f-4305-8baa-2284214a1b95 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9bb40fb67a46c88ee60439fe4ac5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f521940ddf1495b94a52a06c299b198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:23.061204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36572d85-231f-4305-8baa-2284214a1b95 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:23.061540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36572d85-231f-4305-8baa-2284214a1b95 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:23.061917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36572d85-231f-4305-8baa-2284214a1b95 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:23.062735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36572d85-231f-4305-8baa-2284214a1b95 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Adding query filter params (domain_id=1e91b5faaa664766a81eb3f5d4ea0e03) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:30:23.063534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36572d85-231f-4305-8baa-2284214a1b95 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:23.066563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36572d85-231f-4305-8baa-2284214a1b95 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:23.084625 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3029/5977] 10.222.0.16 () {58 vars in 1206 bytes} [Sat Jul 16 21:30:23 2022] GET /identity/v3/users?domain_id=1e91b5faaa664766a81eb3f5d4ea0e03 => generated 484 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:23.091531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36572d85-231f-4305-8baa-2284214a1b95 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:23.097509 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2949/5978] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:22 2022] POST /identity/v3/users => generated 289 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:23.105249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655450e-a063-4093-8811-bf0f78ae9a5e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:23.109621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36572d85-231f-4305-8baa-2284214a1b95 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:23.124915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655450e-a063-4093-8811-bf0f78ae9a5e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:23.131932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d23419-5308-41ad-9d38-43b691bd0672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:23.133280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d23419-5308-41ad-9d38-43b691bd0672 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:23.133737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d23419-5308-41ad-9d38-43b691bd0672 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:23.134534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d23419-5308-41ad-9d38-43b691bd0672 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:23.135298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6019f-0c29-42fa-8450-f785bcf45bc0 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9bb40fb67a46c88ee60439fe4ac5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f521940ddf1495b94a52a06c299b198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:23.136088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6019f-0c29-42fa-8450-f785bcf45bc0 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:23.136453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6019f-0c29-42fa-8450-f785bcf45bc0 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:23.137223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d23419-5308-41ad-9d38-43b691bd0672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:23.137348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6019f-0c29-42fa-8450-f785bcf45bc0 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:23.138111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6019f-0c29-42fa-8450-f785bcf45bc0 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:23.140259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6019f-0c29-42fa-8450-f785bcf45bc0 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:23.140483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d23419-5308-41ad-9d38-43b691bd0672 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:23.157121 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2950/5979] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:23.162232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d23419-5308-41ad-9d38-43b691bd0672 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:23.187352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d23419-5308-41ad-9d38-43b691bd0672 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:23.189298 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3030/5980] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:23 2022] GET /identity/v3/users => generated 9129 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:23.200780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eba6a1-930e-4d6e-a960-b36441cc3376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:23.202361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eba6a1-930e-4d6e-a960-b36441cc3376 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:23.202965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eba6a1-930e-4d6e-a960-b36441cc3376 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:23.203557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eba6a1-930e-4d6e-a960-b36441cc3376 admin admin] PATH_INFO: `/v3/projects/1208a05e41534557b03726f21e7f2438/users/f64ffb5111f74b0e8f0daee0dbe6a870/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:23.205040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6019f-0c29-42fa-8450-f785bcf45bc0 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:23.224600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6019f-0c29-42fa-8450-f785bcf45bc0 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:23.230851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0188c-37c7-4106-8929-3ec8081834b4 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9bb40fb67a46c88ee60439fe4ac5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f521940ddf1495b94a52a06c299b198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:23.231820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0188c-37c7-4106-8929-3ec8081834b4 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:23.232110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0188c-37c7-4106-8929-3ec8081834b4 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:23.232392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0188c-37c7-4106-8929-3ec8081834b4 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:23.233225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0188c-37c7-4106-8929-3ec8081834b4 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1300350305) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:30:23.233533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0188c-37c7-4106-8929-3ec8081834b4 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:23.235541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0188c-37c7-4106-8929-3ec8081834b4 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:23.237759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eba6a1-930e-4d6e-a960-b36441cc3376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1208a05e41534557b03726f21e7f2438, user_id=f64ffb5111f74b0e8f0daee0dbe6a870, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:23.241895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eba6a1-930e-4d6e-a960-b36441cc3376 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:23.278846 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3031/5981] 10.222.0.16 () {58 vars in 1188 bytes} [Sat Jul 16 21:30:23 2022] GET /identity/v3/users?name=tempest-test_user-1300350305 => generated 475 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:23.309342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0188c-37c7-4106-8929-3ec8081834b4 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:23.326207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0188c-37c7-4106-8929-3ec8081834b4 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:23.334380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95dd8b-bfe2-418c-910e-0241d47607eb tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9bb40fb67a46c88ee60439fe4ac5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f521940ddf1495b94a52a06c299b198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:23.338328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95dd8b-bfe2-418c-910e-0241d47607eb tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:23.338328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95dd8b-bfe2-418c-910e-0241d47607eb tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:23.338880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95dd8b-bfe2-418c-910e-0241d47607eb tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:23.341290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95dd8b-bfe2-418c-910e-0241d47607eb tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:30:23.341875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95dd8b-bfe2-418c-910e-0241d47607eb tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:23.346441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95dd8b-bfe2-418c-910e-0241d47607eb tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:23.398677 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3032/5982] 10.222.0.16 () {58 vars in 1148 bytes} [Sat Jul 16 21:30:23 2022] GET /identity/v3/users?enabled=False => generated 430 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:30:23.400863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95dd8b-bfe2-418c-910e-0241d47607eb tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:23.412404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95dd8b-bfe2-418c-910e-0241d47607eb tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:23.422684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b8a3a-4fcd-432f-bf42-cf95a2290249 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9bb40fb67a46c88ee60439fe4ac5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f521940ddf1495b94a52a06c299b198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:23.428085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b8a3a-4fcd-432f-bf42-cf95a2290249 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:23.428085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b8a3a-4fcd-432f-bf42-cf95a2290249 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:23.428085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b8a3a-4fcd-432f-bf42-cf95a2290249 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] PATH_INFO: `/v3/users/dcc8ad5b417b48bba4cabaf26b5798ad` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:23.429659 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2951/5983] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:23 2022] PUT /identity/v3/projects/1208a05e41534557b03726f21e7f2438/users/f64ffb5111f74b0e8f0daee0dbe6a870/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:23.433260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eba6a1-930e-4d6e-a960-b36441cc3376 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:23.449528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b8a3a-4fcd-432f-bf42-cf95a2290249 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorizing `identity:delete_user(user_id=dcc8ad5b417b48bba4cabaf26b5798ad)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:23.449528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b8a3a-4fcd-432f-bf42-cf95a2290249 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:23.576494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eba6a1-930e-4d6e-a960-b36441cc3376 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:23.584162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12091bc3-f84a-430d-8b69-d0d8ad46b55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:23.584909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12091bc3-f84a-430d-8b69-d0d8ad46b55c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:23.585200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12091bc3-f84a-430d-8b69-d0d8ad46b55c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:23.585556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12091bc3-f84a-430d-8b69-d0d8ad46b55c admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:23.586292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12091bc3-f84a-430d-8b69-d0d8ad46b55c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:23.589453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12091bc3-f84a-430d-8b69-d0d8ad46b55c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:23.618134 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2952/5984] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:23.624865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12091bc3-f84a-430d-8b69-d0d8ad46b55c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:23.648925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12091bc3-f84a-430d-8b69-d0d8ad46b55c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:23.656490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04d690-a0db-4265-9083-2076f39630e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:23.657739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04d690-a0db-4265-9083-2076f39630e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:23.658214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04d690-a0db-4265-9083-2076f39630e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:23.658610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04d690-a0db-4265-9083-2076f39630e5 admin admin] PATH_INFO: `/v3/projects/1208a05e41534557b03726f21e7f2438/users/f64ffb5111f74b0e8f0daee0dbe6a870/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:23.679228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04d690-a0db-4265-9083-2076f39630e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1208a05e41534557b03726f21e7f2438, user_id=f64ffb5111f74b0e8f0daee0dbe6a870, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:23.685667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04d690-a0db-4265-9083-2076f39630e5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:23.703931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fa2b8a3a-4fcd-432f-bf42-cf95a2290249 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcc8ad5b417b48bba4cabaf26b5798ad'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:23.718580 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2953/5985] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:23 2022] PUT /identity/v3/projects/1208a05e41534557b03726f21e7f2438/users/f64ffb5111f74b0e8f0daee0dbe6a870/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:23.721123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52982b-70b1-4e49-ac02-4c0f74e46eef None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:23.721503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52982b-70b1-4e49-ac02-4c0f74e46eef None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:23.722046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52982b-70b1-4e49-ac02-4c0f74e46eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:23.727001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fa2b8a3a-4fcd-432f-bf42-cf95a2290249 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcc8ad5b417b48bba4cabaf26b5798ad'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:23.831163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7f52982b-70b1-4e49-ac02-4c0f74e46eef None None] MFA Rules not processed for user `f64ffb5111f74b0e8f0daee0dbe6a870`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:23.831163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7f52982b-70b1-4e49-ac02-4c0f74e46eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:23.880730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fa2b8a3a-4fcd-432f-bf42-cf95a2290249 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcc8ad5b417b48bba4cabaf26b5798ad'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:23.882721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fa2b8a3a-4fcd-432f-bf42-cf95a2290249 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcc8ad5b417b48bba4cabaf26b5798ad'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:23.908666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fa2b8a3a-4fcd-432f-bf42-cf95a2290249 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcc8ad5b417b48bba4cabaf26b5798ad'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:23.922779 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3033/5986] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:23 2022] DELETE /identity/v3/users/dcc8ad5b417b48bba4cabaf26b5798ad => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:23.925431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b8a3a-4fcd-432f-bf42-cf95a2290249 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:23.932770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fa2b8a3a-4fcd-432f-bf42-cf95a2290249 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:24.020391 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2954/5987] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:23 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:24.033034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52982b-70b1-4e49-ac02-4c0f74e46eef None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:24.051773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52982b-70b1-4e49-ac02-4c0f74e46eef None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:24.084348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b8a3a-4fcd-432f-bf42-cf95a2290249 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:24.094394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad58f8-dbc5-4efe-81b1-36383dec5026 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9bb40fb67a46c88ee60439fe4ac5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f521940ddf1495b94a52a06c299b198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:24.100182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad58f8-dbc5-4efe-81b1-36383dec5026 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:24.100182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad58f8-dbc5-4efe-81b1-36383dec5026 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:24.100182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad58f8-dbc5-4efe-81b1-36383dec5026 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] PATH_INFO: `/v3/users/fc8fdcd3c6f34bf2a656f506721b66f7` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:24.100182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad58f8-dbc5-4efe-81b1-36383dec5026 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fc8fdcd3c6f34bf2a656f506721b66f7)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:24.100182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad58f8-dbc5-4efe-81b1-36383dec5026 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:24.170622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1903c-0662-4157-9e54-f54ff576a62f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64ffb5111f74b0e8f0daee0dbe6a870', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1208a05e41534557b03726f21e7f2438', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:24.171470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1903c-0662-4157-9e54-f54ff576a62f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:24.171784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1903c-0662-4157-9e54-f54ff576a62f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:24.172571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1903c-0662-4157-9e54-f54ff576a62f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] PATH_INFO: `/v3/regions` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:24.173443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1903c-0662-4157-9e54-f54ff576a62f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:24.174513 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-48d1903c-0662-4157-9e54-f54ff576a62f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:30:24.174513 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:30:24.174513 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:30:24.176338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1903c-0662-4157-9e54-f54ff576a62f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:24.298291 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2955/5988] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:30:24 2022] POST /identity/v3/regions => generated 223 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:30:24.302315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1903c-0662-4157-9e54-f54ff576a62f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:24.342949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ebad58f8-dbc5-4efe-81b1-36383dec5026 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc8fdcd3c6f34bf2a656f506721b66f7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:24.352796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1903c-0662-4157-9e54-f54ff576a62f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:24.363325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ebad58f8-dbc5-4efe-81b1-36383dec5026 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc8fdcd3c6f34bf2a656f506721b66f7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:24.387054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2c1f5-37a0-45f9-9ecf-493ab9e7738f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64ffb5111f74b0e8f0daee0dbe6a870', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1208a05e41534557b03726f21e7f2438', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:24.388211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2c1f5-37a0-45f9-9ecf-493ab9e7738f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:24.388682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2c1f5-37a0-45f9-9ecf-493ab9e7738f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:24.389132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2c1f5-37a0-45f9-9ecf-493ab9e7738f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] PATH_INFO: `/v3/regions` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:24.390029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2c1f5-37a0-45f9-9ecf-493ab9e7738f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:24.391859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2c1f5-37a0-45f9-9ecf-493ab9e7738f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:24.668913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ebad58f8-dbc5-4efe-81b1-36383dec5026 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc8fdcd3c6f34bf2a656f506721b66f7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:24.669571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ebad58f8-dbc5-4efe-81b1-36383dec5026 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc8fdcd3c6f34bf2a656f506721b66f7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:24.678117 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2956/5989] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:30:24 2022] POST /identity/v3/regions => generated 224 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:24.682659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2c1f5-37a0-45f9-9ecf-493ab9e7738f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:24.685680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6dc2c1f5-37a0-45f9-9ecf-493ab9e7738f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:24.702545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ebad58f8-dbc5-4efe-81b1-36383dec5026 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc8fdcd3c6f34bf2a656f506721b66f7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:24.715366 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3034/5990] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:23 2022] DELETE /identity/v3/users/fc8fdcd3c6f34bf2a656f506721b66f7 => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:24.725963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad58f8-dbc5-4efe-81b1-36383dec5026 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:24.725963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ebad58f8-dbc5-4efe-81b1-36383dec5026 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:24.744426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2c1f5-37a0-45f9-9ecf-493ab9e7738f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:24.835502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:24.854963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad58f8-dbc5-4efe-81b1-36383dec5026 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:24.876611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368ddc7-6fce-470a-9692-72ee5dfea5ce tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64ffb5111f74b0e8f0daee0dbe6a870', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1208a05e41534557b03726f21e7f2438', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:24.877466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368ddc7-6fce-470a-9692-72ee5dfea5ce tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:24.877822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368ddc7-6fce-470a-9692-72ee5dfea5ce tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:24.878035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368ddc7-6fce-470a-9692-72ee5dfea5ce tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] PATH_INFO: `/v3/regions/e6dab232-a076-4bda-8451-cd02730b49f5` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:24.878769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368ddc7-6fce-470a-9692-72ee5dfea5ce tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorizing `identity:create_region(region_id=e6dab232-a076-4bda-8451-cd02730b49f5)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:24.880596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368ddc7-6fce-470a-9692-72ee5dfea5ce tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:24.881280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7a0bb-21db-4d85-a6a0-af7328ab3590 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9bb40fb67a46c88ee60439fe4ac5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f521940ddf1495b94a52a06c299b198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:24.882208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7a0bb-21db-4d85-a6a0-af7328ab3590 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:24.882652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7a0bb-21db-4d85-a6a0-af7328ab3590 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:24.882835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7a0bb-21db-4d85-a6a0-af7328ab3590 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] PATH_INFO: `/v3/domains/1e91b5faaa664766a81eb3f5d4ea0e03` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:24.885523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7a0bb-21db-4d85-a6a0-af7328ab3590 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1e91b5faaa664766a81eb3f5d4ea0e03)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:24.887331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7a0bb-21db-4d85-a6a0-af7328ab3590 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:24.912009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0ac7a0bb-21db-4d85-a6a0-af7328ab3590 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1e91b5faaa664766a81eb3f5d4ea0e03'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:24.912768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0ac7a0bb-21db-4d85-a6a0-af7328ab3590 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1e91b5faaa664766a81eb3f5d4ea0e03'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:24.983109 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2957/5991] 10.222.0.16 () {60 vars in 1258 bytes} [Sat Jul 16 21:30:24 2022] PUT /identity/v3/regions/e6dab232-a076-4bda-8451-cd02730b49f5 => generated 232 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:24.984560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368ddc7-6fce-470a-9692-72ee5dfea5ce tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:24.987448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7368ddc7-6fce-470a-9692-72ee5dfea5ce tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:25.055744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0ac7a0bb-21db-4d85-a6a0-af7328ab3590 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1e91b5faaa664766a81eb3f5d4ea0e03'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:25.059480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0ac7a0bb-21db-4d85-a6a0-af7328ab3590 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1e91b5faaa664766a81eb3f5d4ea0e03'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:25.071123 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3035/5992] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:30:24 2022] PATCH /identity/v3/domains/1e91b5faaa664766a81eb3f5d4ea0e03 => generated 276 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:25.071729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368ddc7-6fce-470a-9692-72ee5dfea5ce tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:25.074949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7a0bb-21db-4d85-a6a0-af7328ab3590 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:25.080829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0ac7a0bb-21db-4d85-a6a0-af7328ab3590 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:25.273564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6931bc-bc70-4e4a-af8a-a78621670708 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64ffb5111f74b0e8f0daee0dbe6a870', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1208a05e41534557b03726f21e7f2438', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:25.274396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7a0bb-21db-4d85-a6a0-af7328ab3590 tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:25.276747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6931bc-bc70-4e4a-af8a-a78621670708 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:25.277149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6931bc-bc70-4e4a-af8a-a78621670708 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:25.284139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6931bc-bc70-4e4a-af8a-a78621670708 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] PATH_INFO: `/v3/regions/e6dab232-a076-4bda-8451-cd02730b49f5` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:25.285563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6931bc-bc70-4e4a-af8a-a78621670708 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorizing `identity:delete_region(region_id=e6dab232-a076-4bda-8451-cd02730b49f5)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:25.288661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6931bc-bc70-4e4a-af8a-a78621670708 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:25.320282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9bb40fb67a46c88ee60439fe4ac5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f521940ddf1495b94a52a06c299b198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:25.322696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:25.323066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:25.323362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] PATH_INFO: `/v3/domains/1e91b5faaa664766a81eb3f5d4ea0e03` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:25.337507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1e91b5faaa664766a81eb3f5d4ea0e03)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:25.339233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:25.380576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1e91b5faaa664766a81eb3f5d4ea0e03'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:25.397970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1e91b5faaa664766a81eb3f5d4ea0e03'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:25.850227 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2958/5993] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Jul 16 21:30:24 2022] DELETE /identity/v3/regions/e6dab232-a076-4bda-8451-cd02730b49f5 => generated 0 bytes in 866 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:25.856859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6931bc-bc70-4e4a-af8a-a78621670708 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:25.868022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ed6931bc-bc70-4e4a-af8a-a78621670708 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:25.895876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e91b5faaa664766a81eb3f5d4ea0e03', 'request_id': 'req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:25.901062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6931bc-bc70-4e4a-af8a-a78621670708 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:25.906352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e91b5faaa664766a81eb3f5d4ea0e03', 'request_id': 'req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:25.914461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e91b5faaa664766a81eb3f5d4ea0e03', 'request_id': 'req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:26.012464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] The token cache is being invalidate because project 1e91b5faaa664766a81eb3f5d4ea0e03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:26.012824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:26.018770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:26.029511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:26.047918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1e91b5faaa664766a81eb3f5d4ea0e03', 'request_id': 'req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:26.052274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1e91b5faaa664766a81eb3f5d4ea0e03', 'request_id': 'req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:26.052274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1e91b5faaa664766a81eb3f5d4ea0e03', 'request_id': 'req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:26.058075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8abe0e-e665-4ddf-affc-de7152f8e64c tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64ffb5111f74b0e8f0daee0dbe6a870', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1208a05e41534557b03726f21e7f2438', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:26.060782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8abe0e-e665-4ddf-affc-de7152f8e64c tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:26.061562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8abe0e-e665-4ddf-affc-de7152f8e64c tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:26.061928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8abe0e-e665-4ddf-affc-de7152f8e64c tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] PATH_INFO: `/v3/regions` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:26.062191 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3036/5994] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:30:25 2022] DELETE /identity/v3/domains/1e91b5faaa664766a81eb3f5d4ea0e03 => generated 0 bytes in 984 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:26.063859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8abe0e-e665-4ddf-affc-de7152f8e64c tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:26.074588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:26.074922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8abe0e-e665-4ddf-affc-de7152f8e64c tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:26.075051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:26.182481 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2959/5995] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Jul 16 21:30:25 2022] POST /identity/v3/regions => generated 252 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:26.183698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8abe0e-e665-4ddf-affc-de7152f8e64c tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:26.188348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7d8abe0e-e665-4ddf-affc-de7152f8e64c tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:26.254825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8abe0e-e665-4ddf-affc-de7152f8e64c tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:26.280434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b442dd-95d4-4898-8001-8e8ddb9319d5 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64ffb5111f74b0e8f0daee0dbe6a870', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1208a05e41534557b03726f21e7f2438', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:26.282341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b442dd-95d4-4898-8001-8e8ddb9319d5 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:26.282790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b442dd-95d4-4898-8001-8e8ddb9319d5 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:26.283306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b442dd-95d4-4898-8001-8e8ddb9319d5 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] PATH_INFO: `/v3/regions/fb081355fe04437d89272b717a4ba66e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:26.285286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b442dd-95d4-4898-8001-8e8ddb9319d5 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorizing `identity:update_region(region_id=fb081355fe04437d89272b717a4ba66e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:26.287245 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-e4b442dd-95d4-4898-8001-8e8ddb9319d5 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:30:26.287245 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:30:26.287245 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:30:26.288534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b442dd-95d4-4898-8001-8e8ddb9319d5 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:26.314985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2dd1c4-5168-48fa-95c3-9b8d151ce53c tempest-UsersV3TestJSON-1145879445 tempest-UsersV3TestJSON-1145879445-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:26.348817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e0c87-d2de-41dc-a8c4-3c68c6b0a201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:26.350071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e0c87-d2de-41dc-a8c4-3c68c6b0a201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:26.350556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e0c87-d2de-41dc-a8c4-3c68c6b0a201 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:26.351098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e0c87-d2de-41dc-a8c4-3c68c6b0a201 admin admin] PATH_INFO: `/v3/users/ea29b237d20848ba8ac08614ebd7c47c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:26.352903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e0c87-d2de-41dc-a8c4-3c68c6b0a201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea29b237d20848ba8ac08614ebd7c47c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:26.355219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e0c87-d2de-41dc-a8c4-3c68c6b0a201 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:26.418076 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2960/5996] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Jul 16 21:30:26 2022] PATCH /identity/v3/regions/fb081355fe04437d89272b717a4ba66e => generated 253 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:30:26.423072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b442dd-95d4-4898-8001-8e8ddb9319d5 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:26.453539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b442dd-95d4-4898-8001-8e8ddb9319d5 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:26.459719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14364705-73f2-4d4f-84a9-c6f3b89b0b05 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64ffb5111f74b0e8f0daee0dbe6a870', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1208a05e41534557b03726f21e7f2438', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:26.461249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14364705-73f2-4d4f-84a9-c6f3b89b0b05 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:26.461540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14364705-73f2-4d4f-84a9-c6f3b89b0b05 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:26.461818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14364705-73f2-4d4f-84a9-c6f3b89b0b05 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] PATH_INFO: `/v3/regions/fb081355fe04437d89272b717a4ba66e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:26.463962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14364705-73f2-4d4f-84a9-c6f3b89b0b05 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorizing `identity:get_region(region_id=fb081355fe04437d89272b717a4ba66e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:26.465712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14364705-73f2-4d4f-84a9-c6f3b89b0b05 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:26.477066 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2961/5997] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Jul 16 21:30:26 2022] GET /identity/v3/regions/fb081355fe04437d89272b717a4ba66e => generated 253 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:30:26.480280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14364705-73f2-4d4f-84a9-c6f3b89b0b05 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:26.504240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14364705-73f2-4d4f-84a9-c6f3b89b0b05 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:26.513159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fce56-adf6-49ef-8255-48fb4457f3ca tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64ffb5111f74b0e8f0daee0dbe6a870', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1208a05e41534557b03726f21e7f2438', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:26.526213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fce56-adf6-49ef-8255-48fb4457f3ca tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:26.526529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fce56-adf6-49ef-8255-48fb4457f3ca tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:26.526800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fce56-adf6-49ef-8255-48fb4457f3ca tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] PATH_INFO: `/v3/regions/fb081355fe04437d89272b717a4ba66e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:26.529729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fce56-adf6-49ef-8255-48fb4457f3ca tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorizing `identity:delete_region(region_id=fb081355fe04437d89272b717a4ba66e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:26.534973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fce56-adf6-49ef-8255-48fb4457f3ca tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:26.624138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fb7e0c87-d2de-41dc-a8c4-3c68c6b0a201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea29b237d20848ba8ac08614ebd7c47c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:26.646143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fb7e0c87-d2de-41dc-a8c4-3c68c6b0a201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea29b237d20848ba8ac08614ebd7c47c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:26.664442 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2962/5998] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:30:26 2022] DELETE /identity/v3/regions/fb081355fe04437d89272b717a4ba66e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:26.670319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fce56-adf6-49ef-8255-48fb4457f3ca tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:26.701311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fce56-adf6-49ef-8255-48fb4457f3ca tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:26.706562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40088764-5090-486e-954b-d837163f2ebc tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64ffb5111f74b0e8f0daee0dbe6a870', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1208a05e41534557b03726f21e7f2438', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:26.709075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fb7e0c87-d2de-41dc-a8c4-3c68c6b0a201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea29b237d20848ba8ac08614ebd7c47c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:26.709860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fb7e0c87-d2de-41dc-a8c4-3c68c6b0a201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea29b237d20848ba8ac08614ebd7c47c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:26.714673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40088764-5090-486e-954b-d837163f2ebc tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:26.716817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40088764-5090-486e-954b-d837163f2ebc tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:26.717910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40088764-5090-486e-954b-d837163f2ebc tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] PATH_INFO: `/v3/regions` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:26.718737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40088764-5090-486e-954b-d837163f2ebc tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:26.721953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40088764-5090-486e-954b-d837163f2ebc tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:26.731704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fb7e0c87-d2de-41dc-a8c4-3c68c6b0a201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea29b237d20848ba8ac08614ebd7c47c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:26.740908 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2963/5999] 10.222.0.16 () {58 vars in 1127 bytes} [Sat Jul 16 21:30:26 2022] GET /identity/v3/regions => generated 669 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:26.741684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40088764-5090-486e-954b-d837163f2ebc tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:26.746540 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3037/6000] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:26 2022] DELETE /identity/v3/users/ea29b237d20848ba8ac08614ebd7c47c => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:26.746729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-40088764-5090-486e-954b-d837163f2ebc tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:26.748763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b443df-4c82-4b09-b672-5552a4c4ad5a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:26.749287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b443df-4c82-4b09-b672-5552a4c4ad5a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:26.749572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b443df-4c82-4b09-b672-5552a4c4ad5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:26.766764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40088764-5090-486e-954b-d837163f2ebc tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:26.812705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-03b443df-4c82-4b09-b672-5552a4c4ad5a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:26.813975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-03b443df-4c82-4b09-b672-5552a4c4ad5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:26.894430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c3ba1-c745-4286-8423-a9af76a76147 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64ffb5111f74b0e8f0daee0dbe6a870', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1208a05e41534557b03726f21e7f2438', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:26.896090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c3ba1-c745-4286-8423-a9af76a76147 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:26.896399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c3ba1-c745-4286-8423-a9af76a76147 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:26.896638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c3ba1-c745-4286-8423-a9af76a76147 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] PATH_INFO: `/v3/regions/fb081355fe04437d89272b717a4ba66e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:26.897351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c3ba1-c745-4286-8423-a9af76a76147 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorizing `identity:delete_region(region_id=fb081355fe04437d89272b717a4ba66e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:26.901810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c3ba1-c745-4286-8423-a9af76a76147 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:26.937174 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-117c3ba1-c745-4286-8423-a9af76a76147 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Could not find region: fb081355fe04437d89272b717a4ba66e.: keystone.exception.RegionNotFound: Could not find region: fb081355fe04437d89272b717a4ba66e. Jul 16 21:30:26.937174 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:30:26.937174 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Jul 16 21:30:26.937174 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Jul 16 21:30:26.937174 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Jul 16 21:30:26.937174 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Jul 16 21:30:26.937174 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Jul 16 21:30:26.937174 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jul 16 21:30:26.937174 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: fb081355fe04437d89272b717a4ba66e. Jul 16 21:30:26.937174 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:30:26.937174 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:30:26.937174 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:30:26.937174 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:30:26.937174 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:30:26.937174 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:30:26.937174 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:30:26.938398 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:30:26.938398 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:30:26.938398 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:30:26.938398 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:30:26.938398 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:30:26.938398 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:30:26.938398 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:30:26.938398 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Jul 16 21:30:26.938398 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Jul 16 21:30:26.938398 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:30:26.938398 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:30:26.938398 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Jul 16 21:30:26.938398 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jul 16 21:30:26.938398 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: fb081355fe04437d89272b717a4ba66e. Jul 16 21:30:26.938398 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:30:26.943329 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2964/6001] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:30:26 2022] DELETE /identity/v3/regions/fb081355fe04437d89272b717a4ba66e => generated 112 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:30:26.944277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c3ba1-c745-4286-8423-a9af76a76147 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:26.995002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c3ba1-c745-4286-8423-a9af76a76147 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:27.000422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51e01e-c79a-44da-b56a-9af3c74c102f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64ffb5111f74b0e8f0daee0dbe6a870', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1208a05e41534557b03726f21e7f2438', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:27.001503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51e01e-c79a-44da-b56a-9af3c74c102f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:27.001942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51e01e-c79a-44da-b56a-9af3c74c102f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:27.002374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51e01e-c79a-44da-b56a-9af3c74c102f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] PATH_INFO: `/v3/regions` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:27.006505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51e01e-c79a-44da-b56a-9af3c74c102f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:27.007844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51e01e-c79a-44da-b56a-9af3c74c102f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:27.027772 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2965/6002] 10.222.0.16 () {58 vars in 1127 bytes} [Sat Jul 16 21:30:26 2022] GET /identity/v3/regions => generated 669 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:27.028967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51e01e-c79a-44da-b56a-9af3c74c102f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:27.054051 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3038/6003] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:27.064272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51e01e-c79a-44da-b56a-9af3c74c102f tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:27.068588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b443df-4c82-4b09-b672-5552a4c4ad5a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:27.068588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-03b443df-4c82-4b09-b672-5552a4c4ad5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:27.070101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2250cb-3468-4c7b-ae97-0580ad0d0837 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64ffb5111f74b0e8f0daee0dbe6a870', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1208a05e41534557b03726f21e7f2438', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:27.071153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2250cb-3468-4c7b-ae97-0580ad0d0837 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:27.072159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2250cb-3468-4c7b-ae97-0580ad0d0837 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:27.072754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2250cb-3468-4c7b-ae97-0580ad0d0837 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] PATH_INFO: `/v3/regions` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:27.073626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2250cb-3468-4c7b-ae97-0580ad0d0837 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:27.075960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2250cb-3468-4c7b-ae97-0580ad0d0837 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:27.153230 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2966/6004] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Jul 16 21:30:27 2022] POST /identity/v3/regions => generated 254 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:27.159465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2250cb-3468-4c7b-ae97-0580ad0d0837 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:27.202089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b443df-4c82-4b09-b672-5552a4c4ad5a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:27.218492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d2970-4492-43ec-8f31-ad6b93c2109f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:27.219161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d2970-4492-43ec-8f31-ad6b93c2109f service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:27.219562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d2970-4492-43ec-8f31-ad6b93c2109f service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:27.219849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d2970-4492-43ec-8f31-ad6b93c2109f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:27.229711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2250cb-3468-4c7b-ae97-0580ad0d0837 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:27.233717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d2970-4492-43ec-8f31-ad6b93c2109f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:27.235321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d2970-4492-43ec-8f31-ad6b93c2109f service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:27.237081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9018f-8a4e-4ccc-a460-d82ef2db3a07 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64ffb5111f74b0e8f0daee0dbe6a870', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1208a05e41534557b03726f21e7f2438', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:27.238746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9018f-8a4e-4ccc-a460-d82ef2db3a07 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:27.239239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9018f-8a4e-4ccc-a460-d82ef2db3a07 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:27.239686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9018f-8a4e-4ccc-a460-d82ef2db3a07 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] PATH_INFO: `/v3/regions` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:27.242324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9018f-8a4e-4ccc-a460-d82ef2db3a07 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Adding query filter params (parent_region_id=418156d252874ad48352c7eba802ca4c) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:30:27.242976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9018f-8a4e-4ccc-a460-d82ef2db3a07 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:27.256149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9018f-8a4e-4ccc-a460-d82ef2db3a07 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:27.262363 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3039/6005] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:30:27.274211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d2970-4492-43ec-8f31-ad6b93c2109f service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:27.276763 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2967/6006] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Jul 16 21:30:27 2022] GET /identity/v3/regions?parent_region_id=418156d252874ad48352c7eba802ca4c => generated 400 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:30:27.288496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d2970-4492-43ec-8f31-ad6b93c2109f service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:27.294140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5100334-d69a-4281-8425-a183b610d571 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64ffb5111f74b0e8f0daee0dbe6a870', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1208a05e41534557b03726f21e7f2438', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:27.295143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5100334-d69a-4281-8425-a183b610d571 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:27.295496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5100334-d69a-4281-8425-a183b610d571 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:27.295989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5100334-d69a-4281-8425-a183b610d571 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] PATH_INFO: `/v3/regions/7348f2ae992742b6baa17f774520f036` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:27.296868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5100334-d69a-4281-8425-a183b610d571 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorizing `identity:delete_region(region_id=7348f2ae992742b6baa17f774520f036)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:27.298867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5100334-d69a-4281-8425-a183b610d571 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:27.414005 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3040/6007] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:30:27 2022] DELETE /identity/v3/regions/7348f2ae992742b6baa17f774520f036 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:27.419900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9018f-8a4e-4ccc-a460-d82ef2db3a07 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:27.435300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9018f-8a4e-4ccc-a460-d82ef2db3a07 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:27.469468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7bfb6-1429-4472-8e55-be9740064f2c tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64ffb5111f74b0e8f0daee0dbe6a870', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1208a05e41534557b03726f21e7f2438', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:27.470839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7bfb6-1429-4472-8e55-be9740064f2c tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:27.470839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7bfb6-1429-4472-8e55-be9740064f2c tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:27.471081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7bfb6-1429-4472-8e55-be9740064f2c tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] PATH_INFO: `/v3/regions/484791af01ec4ac5922decc08bb4f5be` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:27.471656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7bfb6-1429-4472-8e55-be9740064f2c tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorizing `identity:delete_region(region_id=484791af01ec4ac5922decc08bb4f5be)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:27.473359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7bfb6-1429-4472-8e55-be9740064f2c tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:27.481277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:27.616430 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2968/6008] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:30:27 2022] DELETE /identity/v3/regions/484791af01ec4ac5922decc08bb4f5be => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:27.619456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5100334-d69a-4281-8425-a183b610d571 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:27.642792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5100334-d69a-4281-8425-a183b610d571 tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:27.692685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632700a-d8e9-4924-9688-1c6de74b5a2d tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64ffb5111f74b0e8f0daee0dbe6a870', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1208a05e41534557b03726f21e7f2438', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:27.693932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632700a-d8e9-4924-9688-1c6de74b5a2d tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:27.694216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632700a-d8e9-4924-9688-1c6de74b5a2d tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:27.694653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632700a-d8e9-4924-9688-1c6de74b5a2d tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] PATH_INFO: `/v3/regions/418156d252874ad48352c7eba802ca4c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:27.695613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632700a-d8e9-4924-9688-1c6de74b5a2d tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorizing `identity:delete_region(region_id=418156d252874ad48352c7eba802ca4c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:27.700978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632700a-d8e9-4924-9688-1c6de74b5a2d tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:27.830322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:27.843082 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3041/6009] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:30:27 2022] DELETE /identity/v3/regions/418156d252874ad48352c7eba802ca4c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:27.847652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7bfb6-1429-4472-8e55-be9740064f2c tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:27.852775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5ea7bfb6-1429-4472-8e55-be9740064f2c tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:27.931215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7bfb6-1429-4472-8e55-be9740064f2c tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:27.977652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:27.989073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7a42e-77ff-405f-a68f-e1309f0ea81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:27.990317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7a42e-77ff-405f-a68f-e1309f0ea81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:27.990804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7a42e-77ff-405f-a68f-e1309f0ea81d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:27.991291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7a42e-77ff-405f-a68f-e1309f0ea81d admin admin] PATH_INFO: `/v3/users/6521264b77dc485d83b1b77843a4cd03` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:27.996801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7a42e-77ff-405f-a68f-e1309f0ea81d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6521264b77dc485d83b1b77843a4cd03)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:28.000941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7a42e-77ff-405f-a68f-e1309f0ea81d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:28.151595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632700a-d8e9-4924-9688-1c6de74b5a2d tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:28.157427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7632700a-d8e9-4924-9688-1c6de74b5a2d tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:28.201817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632700a-d8e9-4924-9688-1c6de74b5a2d tempest-RegionsTestJSON-995424568 tempest-RegionsTestJSON-995424568-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:28.217380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620d1bb-7caa-4dd6-a3c3-e6eec656a6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:28.218293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620d1bb-7caa-4dd6-a3c3-e6eec656a6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:28.222219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620d1bb-7caa-4dd6-a3c3-e6eec656a6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:28.222219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620d1bb-7caa-4dd6-a3c3-e6eec656a6f7 admin admin] PATH_INFO: `/v3/projects/97fbc1672a9a46679a00c3db9b70126e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:28.222219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620d1bb-7caa-4dd6-a3c3-e6eec656a6f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97fbc1672a9a46679a00c3db9b70126e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:28.222219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620d1bb-7caa-4dd6-a3c3-e6eec656a6f7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:28.289016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-07d7a42e-77ff-405f-a68f-e1309f0ea81d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6521264b77dc485d83b1b77843a4cd03'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:28.322415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-07d7a42e-77ff-405f-a68f-e1309f0ea81d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6521264b77dc485d83b1b77843a4cd03'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:28.439165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-07d7a42e-77ff-405f-a68f-e1309f0ea81d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6521264b77dc485d83b1b77843a4cd03'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:28.455883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-07d7a42e-77ff-405f-a68f-e1309f0ea81d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6521264b77dc485d83b1b77843a4cd03'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:28.457296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-07d7a42e-77ff-405f-a68f-e1309f0ea81d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6521264b77dc485d83b1b77843a4cd03'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:28.474649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6620d1bb-7caa-4dd6-a3c3-e6eec656a6f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97fbc1672a9a46679a00c3db9b70126e', 'request_id': 'req-6620d1bb-7caa-4dd6-a3c3-e6eec656a6f7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:28.476076 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2969/6010] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:27 2022] DELETE /identity/v3/users/6521264b77dc485d83b1b77843a4cd03 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:28.481471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427324c5-c42f-489e-b419-40c15c265743 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:28.483392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427324c5-c42f-489e-b419-40c15c265743 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:28.483963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427324c5-c42f-489e-b419-40c15c265743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:28.487902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6620d1bb-7caa-4dd6-a3c3-e6eec656a6f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97fbc1672a9a46679a00c3db9b70126e', 'request_id': 'req-6620d1bb-7caa-4dd6-a3c3-e6eec656a6f7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:28.503473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6620d1bb-7caa-4dd6-a3c3-e6eec656a6f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97fbc1672a9a46679a00c3db9b70126e', 'request_id': 'req-6620d1bb-7caa-4dd6-a3c3-e6eec656a6f7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:28.513264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-427324c5-c42f-489e-b419-40c15c265743 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:28.514853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-427324c5-c42f-489e-b419-40c15c265743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:28.621630 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2970/6011] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:28.632206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427324c5-c42f-489e-b419-40c15c265743 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:28.637739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-427324c5-c42f-489e-b419-40c15c265743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:28.666827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6620d1bb-7caa-4dd6-a3c3-e6eec656a6f7 admin admin] The token cache is being invalidate because project 97fbc1672a9a46679a00c3db9b70126e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:28.667443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6620d1bb-7caa-4dd6-a3c3-e6eec656a6f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:28.674300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6620d1bb-7caa-4dd6-a3c3-e6eec656a6f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:28.676636 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3042/6012] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:28 2022] DELETE /identity/v3/projects/97fbc1672a9a46679a00c3db9b70126e => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:28.680408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620d1bb-7caa-4dd6-a3c3-e6eec656a6f7 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:28.682533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6620d1bb-7caa-4dd6-a3c3-e6eec656a6f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:28.781556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427324c5-c42f-489e-b419-40c15c265743 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:28.786922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123aaef-2dde-44c0-a048-27570595bcd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:28.787801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123aaef-2dde-44c0-a048-27570595bcd0 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:28.788087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123aaef-2dde-44c0-a048-27570595bcd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:28.788370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123aaef-2dde-44c0-a048-27570595bcd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:28.790489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7123aaef-2dde-44c0-a048-27570595bcd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:28.798185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620d1bb-7caa-4dd6-a3c3-e6eec656a6f7 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:28.805004 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c2a6d-f126-4d8a-a663-721098d99b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:28.806133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123aaef-2dde-44c0-a048-27570595bcd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:28.806280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c2a6d-f126-4d8a-a663-721098d99b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:28.806578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c2a6d-f126-4d8a-a663-721098d99b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:28.806856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c2a6d-f126-4d8a-a663-721098d99b1e admin admin] PATH_INFO: `/v3/users/cb9bb40fb67a46c88ee60439fe4ac5a4` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:28.808109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c2a6d-f126-4d8a-a663-721098d99b1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb9bb40fb67a46c88ee60439fe4ac5a4)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:28.808242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123aaef-2dde-44c0-a048-27570595bcd0 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:28.810309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c2a6d-f126-4d8a-a663-721098d99b1e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:28.823325 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2971/6013] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:30:29.230299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e88c2a6d-f126-4d8a-a663-721098d99b1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb9bb40fb67a46c88ee60439fe4ac5a4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:29.249464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e88c2a6d-f126-4d8a-a663-721098d99b1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb9bb40fb67a46c88ee60439fe4ac5a4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:29.400867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e88c2a6d-f126-4d8a-a663-721098d99b1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb9bb40fb67a46c88ee60439fe4ac5a4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:29.401564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e88c2a6d-f126-4d8a-a663-721098d99b1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb9bb40fb67a46c88ee60439fe4ac5a4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:29.437934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e88c2a6d-f126-4d8a-a663-721098d99b1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb9bb40fb67a46c88ee60439fe4ac5a4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:29.451829 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3043/6014] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:28 2022] DELETE /identity/v3/users/cb9bb40fb67a46c88ee60439fe4ac5a4 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:29.597666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123aaef-2dde-44c0-a048-27570595bcd0 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:29.599927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7123aaef-2dde-44c0-a048-27570595bcd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:29.626468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123aaef-2dde-44c0-a048-27570595bcd0 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:29.756441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249fd853-3e66-4281-86de-21766c8e37ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:29.756441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fd853-3e66-4281-86de-21766c8e37ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:29.756441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fd853-3e66-4281-86de-21766c8e37ca admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:29.756441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fd853-3e66-4281-86de-21766c8e37ca admin admin] PATH_INFO: `/v3/projects/3d24ac7ace994150bd98ad729d469043` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:29.757763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249fd853-3e66-4281-86de-21766c8e37ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d24ac7ace994150bd98ad729d469043)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:29.760069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249fd853-3e66-4281-86de-21766c8e37ca admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:29.920883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-249fd853-3e66-4281-86de-21766c8e37ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d24ac7ace994150bd98ad729d469043', 'request_id': 'req-249fd853-3e66-4281-86de-21766c8e37ca'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:29.926826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-249fd853-3e66-4281-86de-21766c8e37ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d24ac7ace994150bd98ad729d469043', 'request_id': 'req-249fd853-3e66-4281-86de-21766c8e37ca'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:29.934851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-249fd853-3e66-4281-86de-21766c8e37ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d24ac7ace994150bd98ad729d469043', 'request_id': 'req-249fd853-3e66-4281-86de-21766c8e37ca'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:30.072551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-249fd853-3e66-4281-86de-21766c8e37ca admin admin] The token cache is being invalidate because project 3d24ac7ace994150bd98ad729d469043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:30.072959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-249fd853-3e66-4281-86de-21766c8e37ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:30.073714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-249fd853-3e66-4281-86de-21766c8e37ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:30.075807 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2972/6015] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:29 2022] DELETE /identity/v3/projects/3d24ac7ace994150bd98ad729d469043 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:30.080256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c2a6d-f126-4d8a-a663-721098d99b1e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:30.081786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e88c2a6d-f126-4d8a-a663-721098d99b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:30.095897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c2a6d-f126-4d8a-a663-721098d99b1e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:30.158007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd06cb-3db8-4960-9d2b-763aec07d4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:30.158890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd06cb-3db8-4960-9d2b-763aec07d4f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:30.159358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd06cb-3db8-4960-9d2b-763aec07d4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:30.159639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd06cb-3db8-4960-9d2b-763aec07d4f0 admin admin] PATH_INFO: `/v3/users/f64ffb5111f74b0e8f0daee0dbe6a870` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:30.160902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd06cb-3db8-4960-9d2b-763aec07d4f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f64ffb5111f74b0e8f0daee0dbe6a870)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:30.162863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd06cb-3db8-4960-9d2b-763aec07d4f0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:30.246590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:30.284246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:30.443961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b2dd06cb-3db8-4960-9d2b-763aec07d4f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f64ffb5111f74b0e8f0daee0dbe6a870'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:30.450903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b2dd06cb-3db8-4960-9d2b-763aec07d4f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f64ffb5111f74b0e8f0daee0dbe6a870'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:30.517820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b2dd06cb-3db8-4960-9d2b-763aec07d4f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f64ffb5111f74b0e8f0daee0dbe6a870'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:30.518541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b2dd06cb-3db8-4960-9d2b-763aec07d4f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f64ffb5111f74b0e8f0daee0dbe6a870'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:30.526243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249fd853-3e66-4281-86de-21766c8e37ca admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:30.527784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-249fd853-3e66-4281-86de-21766c8e37ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:30.549905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249fd853-3e66-4281-86de-21766c8e37ca admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:30.550011 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b2dd06cb-3db8-4960-9d2b-763aec07d4f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f64ffb5111f74b0e8f0daee0dbe6a870'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:30.550095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c6f07-78a3-4668-b7be-d44e335d80c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:30.550095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c6f07-78a3-4668-b7be-d44e335d80c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:30.550352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c6f07-78a3-4668-b7be-d44e335d80c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:30.550594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c6f07-78a3-4668-b7be-d44e335d80c6 admin admin] PATH_INFO: `/v3/projects/9f521940ddf1495b94a52a06c299b198` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:30.552026 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c6f07-78a3-4668-b7be-d44e335d80c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f521940ddf1495b94a52a06c299b198)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:30.554237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c6f07-78a3-4668-b7be-d44e335d80c6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:30.570886 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3044/6016] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:30 2022] DELETE /identity/v3/users/f64ffb5111f74b0e8f0daee0dbe6a870 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:30.690803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3a5c6f07-78a3-4668-b7be-d44e335d80c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f521940ddf1495b94a52a06c299b198', 'request_id': 'req-3a5c6f07-78a3-4668-b7be-d44e335d80c6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:30.697168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3a5c6f07-78a3-4668-b7be-d44e335d80c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f521940ddf1495b94a52a06c299b198', 'request_id': 'req-3a5c6f07-78a3-4668-b7be-d44e335d80c6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:30.704241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3a5c6f07-78a3-4668-b7be-d44e335d80c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f521940ddf1495b94a52a06c299b198', 'request_id': 'req-3a5c6f07-78a3-4668-b7be-d44e335d80c6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:30.777060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3a5c6f07-78a3-4668-b7be-d44e335d80c6 admin admin] The token cache is being invalidate because project 9f521940ddf1495b94a52a06c299b198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:30.777060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3a5c6f07-78a3-4668-b7be-d44e335d80c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:30.777877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3a5c6f07-78a3-4668-b7be-d44e335d80c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:30.779853 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2973/6017] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:30 2022] DELETE /identity/v3/projects/9f521940ddf1495b94a52a06c299b198 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:30.784832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8301dc-7eb4-4842-8658-8a7f0cb65b68 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:30.785123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8301dc-7eb4-4842-8658-8a7f0cb65b68 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:30.785399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8301dc-7eb4-4842-8658-8a7f0cb65b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:30.804748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6b8301dc-7eb4-4842-8658-8a7f0cb65b68 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:30.806123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6b8301dc-7eb4-4842-8658-8a7f0cb65b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:30.891082 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3045/6018] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:30.899363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad7b3b-79a4-4cc6-aeec-b2141a2bea9d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:30.900147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad7b3b-79a4-4cc6-aeec-b2141a2bea9d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:30.900723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad7b3b-79a4-4cc6-aeec-b2141a2bea9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:30.921975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-cdad7b3b-79a4-4cc6-aeec-b2141a2bea9d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:30.923538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cdad7b3b-79a4-4cc6-aeec-b2141a2bea9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:30.954037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8301dc-7eb4-4842-8658-8a7f0cb65b68 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:30.954240 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2974/6019] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:30.973355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8301dc-7eb4-4842-8658-8a7f0cb65b68 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:30.985957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d6f45-906a-406c-85b3-ed1ac5b5fead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:30.987216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d6f45-906a-406c-85b3-ed1ac5b5fead admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:30.987786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d6f45-906a-406c-85b3-ed1ac5b5fead admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:30.988358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d6f45-906a-406c-85b3-ed1ac5b5fead admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:30.989131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d6f45-906a-406c-85b3-ed1ac5b5fead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:30:30.989539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d6f45-906a-406c-85b3-ed1ac5b5fead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:30.991285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d6f45-906a-406c-85b3-ed1ac5b5fead admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:31.017393 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3046/6020] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:31.021234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad7b3b-79a4-4cc6-aeec-b2141a2bea9d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:31.032645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad7b3b-79a4-4cc6-aeec-b2141a2bea9d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:31.038648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9828d9-c185-410a-86f8-33d72cf6674b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:31.039537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9828d9-c185-410a-86f8-33d72cf6674b admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:31.040758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9828d9-c185-410a-86f8-33d72cf6674b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:31.041495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9828d9-c185-410a-86f8-33d72cf6674b admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:31.042370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9828d9-c185-410a-86f8-33d72cf6674b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:31.046250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9828d9-c185-410a-86f8-33d72cf6674b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:31.175136 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2975/6021] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:31 2022] POST /identity/v3/projects => generated 387 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:31.179252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d6f45-906a-406c-85b3-ed1ac5b5fead admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:31.189997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d6f45-906a-406c-85b3-ed1ac5b5fead admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:31.311970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389631c1-3735-4750-9a1e-8705ad1b7dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:31.312858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389631c1-3735-4750-9a1e-8705ad1b7dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:31.313471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389631c1-3735-4750-9a1e-8705ad1b7dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:31.313825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389631c1-3735-4750-9a1e-8705ad1b7dd2 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:31.314585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389631c1-3735-4750-9a1e-8705ad1b7dd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:31.316755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389631c1-3735-4750-9a1e-8705ad1b7dd2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:31.404893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9828d9-c185-410a-86f8-33d72cf6674b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:31.404893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5f9828d9-c185-410a-86f8-33d72cf6674b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:31.414874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9828d9-c185-410a-86f8-33d72cf6674b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:31.420838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02991950-5c12-4317-9466-e10cdffe0130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:31.421700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02991950-5c12-4317-9466-e10cdffe0130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:31.421990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02991950-5c12-4317-9466-e10cdffe0130 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:31.422261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02991950-5c12-4317-9466-e10cdffe0130 admin admin] PATH_INFO: `/v3/projects/1208a05e41534557b03726f21e7f2438` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:31.423563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02991950-5c12-4317-9466-e10cdffe0130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1208a05e41534557b03726f21e7f2438)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:31.425779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02991950-5c12-4317-9466-e10cdffe0130 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:31.450014 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3047/6022] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:31 2022] POST /identity/v3/users => generated 294 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:30:31.451430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389631c1-3735-4750-9a1e-8705ad1b7dd2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:31.464441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389631c1-3735-4750-9a1e-8705ad1b7dd2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:31.470123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e77a06-6137-4944-98fd-f51340969bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:31.470679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e77a06-6137-4944-98fd-f51340969bbc admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:31.470958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e77a06-6137-4944-98fd-f51340969bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:31.471274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e77a06-6137-4944-98fd-f51340969bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:31.471993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e77a06-6137-4944-98fd-f51340969bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:31.473646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e77a06-6137-4944-98fd-f51340969bbc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:31.485093 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3048/6023] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:31.489643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e77a06-6137-4944-98fd-f51340969bbc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:31.501394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e77a06-6137-4944-98fd-f51340969bbc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:31.509360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cc03b-fcec-45da-8e11-bba1287c931c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:31.510531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cc03b-fcec-45da-8e11-bba1287c931c admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:31.511098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cc03b-fcec-45da-8e11-bba1287c931c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:31.511563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cc03b-fcec-45da-8e11-bba1287c931c admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:31.512675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cc03b-fcec-45da-8e11-bba1287c931c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:31.515325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cc03b-fcec-45da-8e11-bba1287c931c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:31.530135 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3049/6024] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:31.534300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cc03b-fcec-45da-8e11-bba1287c931c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:31.552588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cc03b-fcec-45da-8e11-bba1287c931c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:31.560579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d930c3-2720-46e0-99ac-eb23f45aa8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:31.561744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d930c3-2720-46e0-99ac-eb23f45aa8e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:31.562377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d930c3-2720-46e0-99ac-eb23f45aa8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:31.562975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d930c3-2720-46e0-99ac-eb23f45aa8e8 admin admin] PATH_INFO: `/v3/projects/a6045ecf289e4853806a2c8994c5407f/users/16421490487f47da9a054e45d17794d0/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:31.601830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d930c3-2720-46e0-99ac-eb23f45aa8e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6045ecf289e4853806a2c8994c5407f, user_id=16421490487f47da9a054e45d17794d0, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:31.604992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d930c3-2720-46e0-99ac-eb23f45aa8e8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:31.634227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-02991950-5c12-4317-9466-e10cdffe0130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1208a05e41534557b03726f21e7f2438', 'request_id': 'req-02991950-5c12-4317-9466-e10cdffe0130'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:31.642298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-02991950-5c12-4317-9466-e10cdffe0130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1208a05e41534557b03726f21e7f2438', 'request_id': 'req-02991950-5c12-4317-9466-e10cdffe0130'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:31.651546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-02991950-5c12-4317-9466-e10cdffe0130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1208a05e41534557b03726f21e7f2438', 'request_id': 'req-02991950-5c12-4317-9466-e10cdffe0130'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:31.709135 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3050/6025] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:31 2022] PUT /identity/v3/projects/a6045ecf289e4853806a2c8994c5407f/users/16421490487f47da9a054e45d17794d0/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:31.721370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69af445-838e-4f0c-a202-041fd6990f25 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:31.722130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69af445-838e-4f0c-a202-041fd6990f25 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:31.722130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69af445-838e-4f0c-a202-041fd6990f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:31.756981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e69af445-838e-4f0c-a202-041fd6990f25 None None] MFA Rules not processed for user `16421490487f47da9a054e45d17794d0`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:31.759274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e69af445-838e-4f0c-a202-041fd6990f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:31.829182 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3051/6026] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:30:31.829685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-02991950-5c12-4317-9466-e10cdffe0130 admin admin] The token cache is being invalidate because project 1208a05e41534557b03726f21e7f2438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:31.830129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-02991950-5c12-4317-9466-e10cdffe0130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:31.830866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-02991950-5c12-4317-9466-e10cdffe0130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:31.832574 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2976/6027] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:31 2022] DELETE /identity/v3/projects/1208a05e41534557b03726f21e7f2438 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:31.836099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69af445-838e-4f0c-a202-041fd6990f25 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:31.838096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07e5c4-bf16-4b48-9c16-c8ac7e540dec None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:31.838305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07e5c4-bf16-4b48-9c16-c8ac7e540dec None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:31.838513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07e5c4-bf16-4b48-9c16-c8ac7e540dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:31.857564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4b07e5c4-bf16-4b48-9c16-c8ac7e540dec None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:31.858843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4b07e5c4-bf16-4b48-9c16-c8ac7e540dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:31.951514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69af445-838e-4f0c-a202-041fd6990f25 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:31.952854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07150c-5e60-41e9-b446-9251ecd198d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:31.953756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07150c-5e60-41e9-b446-9251ecd198d9 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:31.954248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07150c-5e60-41e9-b446-9251ecd198d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:31.954732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07150c-5e60-41e9-b446-9251ecd198d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:31.955664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07150c-5e60-41e9-b446-9251ecd198d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:31.958110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07150c-5e60-41e9-b446-9251ecd198d9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:31.969002 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2977/6028] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:30:31.978630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f170023-c483-40ec-b436-a1ebdaf1be95 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:31.985384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f170023-c483-40ec-b436-a1ebdaf1be95 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:31.985940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f170023-c483-40ec-b436-a1ebdaf1be95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:32.018625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8f170023-c483-40ec-b436-a1ebdaf1be95 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:32.019928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8f170023-c483-40ec-b436-a1ebdaf1be95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:32.039328 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2978/6029] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:30:32.048265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f170023-c483-40ec-b436-a1ebdaf1be95 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:32.059649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f170023-c483-40ec-b436-a1ebdaf1be95 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:32.064403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae12ee6-c0cf-41dc-ad66-dc2f19c7768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:32.065055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae12ee6-c0cf-41dc-ad66-dc2f19c7768a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:32.065685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae12ee6-c0cf-41dc-ad66-dc2f19c7768a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:32.065963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae12ee6-c0cf-41dc-ad66-dc2f19c7768a admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:32.067071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae12ee6-c0cf-41dc-ad66-dc2f19c7768a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:30:32.067386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae12ee6-c0cf-41dc-ad66-dc2f19c7768a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:32.072270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae12ee6-c0cf-41dc-ad66-dc2f19c7768a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:32.082107 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2979/6030] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:32.086408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae12ee6-c0cf-41dc-ad66-dc2f19c7768a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:32.097043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae12ee6-c0cf-41dc-ad66-dc2f19c7768a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:32.101934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce944a-871e-4dcf-8802-1f5eb1c6ffbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:32.102628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce944a-871e-4dcf-8802-1f5eb1c6ffbd admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:32.102922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce944a-871e-4dcf-8802-1f5eb1c6ffbd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:32.103238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce944a-871e-4dcf-8802-1f5eb1c6ffbd admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:32.103936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce944a-871e-4dcf-8802-1f5eb1c6ffbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:32.105118 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3052/6031] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:31 2022] POST /identity/v3/projects => generated 381 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:32.106126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce944a-871e-4dcf-8802-1f5eb1c6ffbd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:32.109181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07150c-5e60-41e9-b446-9251ecd198d9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:32.110990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8f07150c-5e60-41e9-b446-9251ecd198d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:32.208579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07150c-5e60-41e9-b446-9251ecd198d9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:32.218481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926a664-4775-4314-992c-9a3422a2aef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:32.219317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926a664-4775-4314-992c-9a3422a2aef1 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:32.219624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926a664-4775-4314-992c-9a3422a2aef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:32.219899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926a664-4775-4314-992c-9a3422a2aef1 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:32.221371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926a664-4775-4314-992c-9a3422a2aef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:32.223939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926a664-4775-4314-992c-9a3422a2aef1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:32.259465 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2980/6032] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:32 2022] POST /identity/v3/projects => generated 367 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:30:32.263804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce944a-871e-4dcf-8802-1f5eb1c6ffbd admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:32.321023 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3053/6033] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:32 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:30:32.325351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926a664-4775-4314-992c-9a3422a2aef1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:32.340463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926a664-4775-4314-992c-9a3422a2aef1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:32.377569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce944a-871e-4dcf-8802-1f5eb1c6ffbd admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:32.384270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50a82d-acef-4267-a49f-5612a0495f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:32.384959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50a82d-acef-4267-a49f-5612a0495f09 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:32.385248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50a82d-acef-4267-a49f-5612a0495f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:32.385528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50a82d-acef-4267-a49f-5612a0495f09 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:32.386251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50a82d-acef-4267-a49f-5612a0495f09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:32.388647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50a82d-acef-4267-a49f-5612a0495f09 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:32.423405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:32.425181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ffda7-7785-4657-b15f-baacc647bd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:32.425181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ffda7-7785-4657-b15f-baacc647bd85 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:32.425181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ffda7-7785-4657-b15f-baacc647bd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:32.425656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ffda7-7785-4657-b15f-baacc647bd85 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:32.426201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ffda7-7785-4657-b15f-baacc647bd85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:32.427861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ffda7-7785-4657-b15f-baacc647bd85 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:32.440155 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3054/6034] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:32.445493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ffda7-7785-4657-b15f-baacc647bd85 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:32.458116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ffda7-7785-4657-b15f-baacc647bd85 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:32.464078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0a8f1-b595-44c6-8cf0-c0addf4f313b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:32.464974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0a8f1-b595-44c6-8cf0-c0addf4f313b admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:32.465260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0a8f1-b595-44c6-8cf0-c0addf4f313b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:32.465536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0a8f1-b595-44c6-8cf0-c0addf4f313b admin admin] PATH_INFO: `/v3/projects/63dadc6386244ecbac04e8a5bcab6328/users/12bc76d2029e4e62b7cad725c35376d9/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:32.485536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0a8f1-b595-44c6-8cf0-c0addf4f313b admin admin] RBAC: Authorizing `identity:create_grant(project_id=63dadc6386244ecbac04e8a5bcab6328, user_id=12bc76d2029e4e62b7cad725c35376d9, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:32.489214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0a8f1-b595-44c6-8cf0-c0addf4f313b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:32.498561 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2981/6035] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:32 2022] POST /identity/v3/users => generated 284 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:30:32.503920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50a82d-acef-4267-a49f-5612a0495f09 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:32.514086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:32.528210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50a82d-acef-4267-a49f-5612a0495f09 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:32.536428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff2f5f-b0d1-4924-a4c2-e7820f629fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:32.537120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff2f5f-b0d1-4924-a4c2-e7820f629fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:32.543172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff2f5f-b0d1-4924-a4c2-e7820f629fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:32.543172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff2f5f-b0d1-4924-a4c2-e7820f629fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:32.543172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff2f5f-b0d1-4924-a4c2-e7820f629fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:32.543172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff2f5f-b0d1-4924-a4c2-e7820f629fc2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:32.551953 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2982/6036] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:32.556057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff2f5f-b0d1-4924-a4c2-e7820f629fc2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:32.569247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff2f5f-b0d1-4924-a4c2-e7820f629fc2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:32.575055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95864db7-1ef3-470a-a1e2-8f4fc2512697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:32.575778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95864db7-1ef3-470a-a1e2-8f4fc2512697 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:32.579229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95864db7-1ef3-470a-a1e2-8f4fc2512697 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:32.579567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95864db7-1ef3-470a-a1e2-8f4fc2512697 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:32.580845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95864db7-1ef3-470a-a1e2-8f4fc2512697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:32.582625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95864db7-1ef3-470a-a1e2-8f4fc2512697 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:32.595145 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3055/6037] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:32 2022] PUT /identity/v3/projects/63dadc6386244ecbac04e8a5bcab6328/users/12bc76d2029e4e62b7cad725c35376d9/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:32.596866 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2983/6038] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:32.599164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0a8f1-b595-44c6-8cf0-c0addf4f313b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:32.601181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95864db7-1ef3-470a-a1e2-8f4fc2512697 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:32.618843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95864db7-1ef3-470a-a1e2-8f4fc2512697 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:32.696739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7d4cb-4144-46b3-a43b-04bb0794c72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:32.698648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7d4cb-4144-46b3-a43b-04bb0794c72c admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:32.699062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7d4cb-4144-46b3-a43b-04bb0794c72c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:32.699453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7d4cb-4144-46b3-a43b-04bb0794c72c admin admin] PATH_INFO: `/v3/projects/aff985fee96c4501b7671d45c3ffac39/users/ff8d9f5f70074fb2ad870d0453d8ca26/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:32.702570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0a8f1-b595-44c6-8cf0-c0addf4f313b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:32.709594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8070f0b-3d01-4936-a27c-d7721b79a98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:32.711050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8070f0b-3d01-4936-a27c-d7721b79a98b admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:32.718147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8070f0b-3d01-4936-a27c-d7721b79a98b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:32.718147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8070f0b-3d01-4936-a27c-d7721b79a98b admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:32.718147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8070f0b-3d01-4936-a27c-d7721b79a98b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:32.718147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8070f0b-3d01-4936-a27c-d7721b79a98b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:32.720889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7d4cb-4144-46b3-a43b-04bb0794c72c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff985fee96c4501b7671d45c3ffac39, user_id=ff8d9f5f70074fb2ad870d0453d8ca26, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:32.725150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7d4cb-4144-46b3-a43b-04bb0794c72c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:32.728615 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3056/6039] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:32.732734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8070f0b-3d01-4936-a27c-d7721b79a98b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:32.749821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8070f0b-3d01-4936-a27c-d7721b79a98b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:32.762201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2786d-bdba-4e03-8934-7736f592d8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:32.765023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2786d-bdba-4e03-8934-7736f592d8d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:32.765023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2786d-bdba-4e03-8934-7736f592d8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:32.765023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2786d-bdba-4e03-8934-7736f592d8d4 admin admin] PATH_INFO: `/v3/projects/63dadc6386244ecbac04e8a5bcab6328/users/12bc76d2029e4e62b7cad725c35376d9/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:32.766290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2786d-bdba-4e03-8934-7736f592d8d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63dadc6386244ecbac04e8a5bcab6328, user_id=12bc76d2029e4e62b7cad725c35376d9, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:32.769104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2786d-bdba-4e03-8934-7736f592d8d4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:32.787320 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3057/6040] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:32 2022] PUT /identity/v3/projects/63dadc6386244ecbac04e8a5bcab6328/users/12bc76d2029e4e62b7cad725c35376d9/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:32.799026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d331ac-17b1-478b-abdc-f9ddaf82d4e5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:32.799319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d331ac-17b1-478b-abdc-f9ddaf82d4e5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:32.799598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d331ac-17b1-478b-abdc-f9ddaf82d4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:32.849024 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2984/6041] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:32 2022] PUT /identity/v3/projects/aff985fee96c4501b7671d45c3ffac39/users/ff8d9f5f70074fb2ad870d0453d8ca26/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:32.860314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7c6de-3fd5-4a22-9385-4f812e4ec2f3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:32.860644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7c6de-3fd5-4a22-9385-4f812e4ec2f3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:32.861105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7c6de-3fd5-4a22-9385-4f812e4ec2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:32.890370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-94d331ac-17b1-478b-abdc-f9ddaf82d4e5 None None] MFA Rules not processed for user `12bc76d2029e4e62b7cad725c35376d9`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:32.891662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-94d331ac-17b1-478b-abdc-f9ddaf82d4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:32.913941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-79b7c6de-3fd5-4a22-9385-4f812e4ec2f3 None None] MFA Rules not processed for user `ff8d9f5f70074fb2ad870d0453d8ca26`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:32.915968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-79b7c6de-3fd5-4a22-9385-4f812e4ec2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:33.014141 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2985/6042] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:30:33.020159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7c6de-3fd5-4a22-9385-4f812e4ec2f3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:33.026534 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3058/6043] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:33.027719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d331ac-17b1-478b-abdc-f9ddaf82d4e5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:33.043196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d331ac-17b1-478b-abdc-f9ddaf82d4e5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:33.060294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1f833-84be-4155-af9c-e9841082fe7a tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12bc76d2029e4e62b7cad725c35376d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63dadc6386244ecbac04e8a5bcab6328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:33.061320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1f833-84be-4155-af9c-e9841082fe7a tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:33.061636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1f833-84be-4155-af9c-e9841082fe7a tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:33.061922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1f833-84be-4155-af9c-e9841082fe7a tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:33.062621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1f833-84be-4155-af9c-e9841082fe7a tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:33.064708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1f833-84be-4155-af9c-e9841082fe7a tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:33.141527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7c6de-3fd5-4a22-9385-4f812e4ec2f3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:33.147159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b3679-7a9b-4941-b88a-f20fe404702a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:33.147837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b3679-7a9b-4941-b88a-f20fe404702a admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:33.148119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b3679-7a9b-4941-b88a-f20fe404702a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:33.148392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b3679-7a9b-4941-b88a-f20fe404702a admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:33.149108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b3679-7a9b-4941-b88a-f20fe404702a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:33.151064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b3679-7a9b-4941-b88a-f20fe404702a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:33.198092 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3059/6044] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:33 2022] POST /identity/v3/projects => generated 359 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:33.202413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1f833-84be-4155-af9c-e9841082fe7a tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:33.285611 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2986/6045] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:33 2022] POST /identity/v3/projects => generated 369 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:33.286520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b3679-7a9b-4941-b88a-f20fe404702a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:33.303769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1f833-84be-4155-af9c-e9841082fe7a tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:33.359995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b3679-7a9b-4941-b88a-f20fe404702a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:33.365473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd229f-9786-483a-aff3-58656264557e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:33.366489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd229f-9786-483a-aff3-58656264557e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:33.366926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd229f-9786-483a-aff3-58656264557e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:33.367494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd229f-9786-483a-aff3-58656264557e admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:33.370064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd229f-9786-483a-aff3-58656264557e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:33.372616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd229f-9786-483a-aff3-58656264557e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:33.391572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c83453-2471-4639-9497-a154d7dfaa14 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12bc76d2029e4e62b7cad725c35376d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63dadc6386244ecbac04e8a5bcab6328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:33.392799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c83453-2471-4639-9497-a154d7dfaa14 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:33.393074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c83453-2471-4639-9497-a154d7dfaa14 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:33.393352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c83453-2471-4639-9497-a154d7dfaa14 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] PATH_INFO: `/v3/projects/9dc45b8dd07441bd9a4e9e6c43dab557/tags/tempest-tag-759257927` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:33.394806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c83453-2471-4639-9497-a154d7dfaa14 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=9dc45b8dd07441bd9a4e9e6c43dab557, value=tempest-tag-759257927)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:33.397215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c83453-2471-4639-9497-a154d7dfaa14 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:33.520438 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2987/6046] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:33 2022] POST /identity/v3/users => generated 291 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:33.521982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd229f-9786-483a-aff3-58656264557e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:33.535927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd229f-9786-483a-aff3-58656264557e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:33.542442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b31890-7e7f-4584-a904-60921768a781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:33.543391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b31890-7e7f-4584-a904-60921768a781 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:33.543628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b31890-7e7f-4584-a904-60921768a781 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:33.543979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b31890-7e7f-4584-a904-60921768a781 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:33.544716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b31890-7e7f-4584-a904-60921768a781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:33.546533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b31890-7e7f-4584-a904-60921768a781 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:33.559610 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2988/6047] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:33.563977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b31890-7e7f-4584-a904-60921768a781 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:33.577826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b31890-7e7f-4584-a904-60921768a781 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:33.583800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb9dbc-f731-4ad9-af69-9eedfaf14132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:33.584708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb9dbc-f731-4ad9-af69-9eedfaf14132 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:33.584990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb9dbc-f731-4ad9-af69-9eedfaf14132 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:33.585262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb9dbc-f731-4ad9-af69-9eedfaf14132 admin admin] PATH_INFO: `/v3/projects/69cd4349d9cf46c3ad23e42f907ac72a/users/862d611068f94b42b4dd8829ed5f212a/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:33.604465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb9dbc-f731-4ad9-af69-9eedfaf14132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69cd4349d9cf46c3ad23e42f907ac72a, user_id=862d611068f94b42b4dd8829ed5f212a, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:33.606351 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-27c83453-2471-4639-9497-a154d7dfaa14 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-759257927. To ensure interoperability, identifiers should be a valid uuid. Jul 16 21:30:33.606351 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 16 21:30:33.606351 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:30:33.607834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb9dbc-f731-4ad9-af69-9eedfaf14132 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:33.616839 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3060/6048] 10.222.0.16 () {60 vars in 1329 bytes} [Sat Jul 16 21:30:33 2022] PUT /identity/v3/projects/9dc45b8dd07441bd9a4e9e6c43dab557/tags/tempest-tag-759257927 => generated 0 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 290 bytes (2 switches on core 0) Jul 16 21:30:33.621356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c83453-2471-4639-9497-a154d7dfaa14 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:33.635438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c83453-2471-4639-9497-a154d7dfaa14 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:33.640868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f66238-b49e-49bb-bf23-cae2d4ad3238 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12bc76d2029e4e62b7cad725c35376d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63dadc6386244ecbac04e8a5bcab6328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:33.641773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f66238-b49e-49bb-bf23-cae2d4ad3238 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:33.642061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f66238-b49e-49bb-bf23-cae2d4ad3238 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:33.642342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f66238-b49e-49bb-bf23-cae2d4ad3238 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] PATH_INFO: `/v3/projects/9dc45b8dd07441bd9a4e9e6c43dab557/tags/tempest-tag-759257927` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:33.663914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f66238-b49e-49bb-bf23-cae2d4ad3238 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=9dc45b8dd07441bd9a4e9e6c43dab557, value=tempest-tag-759257927)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:33.672056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f66238-b49e-49bb-bf23-cae2d4ad3238 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:33.687714 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3061/6049] 10.222.0.16 () {58 vars in 1310 bytes} [Sat Jul 16 21:30:33 2022] GET /identity/v3/projects/9dc45b8dd07441bd9a4e9e6c43dab557/tags/tempest-tag-759257927 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:33.692039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f66238-b49e-49bb-bf23-cae2d4ad3238 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:33.706407 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2989/6050] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:33 2022] PUT /identity/v3/projects/69cd4349d9cf46c3ad23e42f907ac72a/users/862d611068f94b42b4dd8829ed5f212a/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:33.706905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f66238-b49e-49bb-bf23-cae2d4ad3238 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:33.711202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb9dbc-f731-4ad9-af69-9eedfaf14132 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:33.817092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb9dbc-f731-4ad9-af69-9eedfaf14132 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:33.817092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c8c7a-069d-4830-be85-8a9d8a765e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:33.817092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c8c7a-069d-4830-be85-8a9d8a765e4c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:33.817092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c8c7a-069d-4830-be85-8a9d8a765e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:33.817678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c8c7a-069d-4830-be85-8a9d8a765e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:33.818366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c8c7a-069d-4830-be85-8a9d8a765e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:33.820271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c8c7a-069d-4830-be85-8a9d8a765e4c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:33.824969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1eaaae-e6a9-4da7-ac52-b4a24c21d89c tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12bc76d2029e4e62b7cad725c35376d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63dadc6386244ecbac04e8a5bcab6328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:33.829636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1eaaae-e6a9-4da7-ac52-b4a24c21d89c tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:33.830000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1eaaae-e6a9-4da7-ac52-b4a24c21d89c tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:33.830282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1eaaae-e6a9-4da7-ac52-b4a24c21d89c tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] PATH_INFO: `/v3/projects/9dc45b8dd07441bd9a4e9e6c43dab557/tags` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:33.833008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1eaaae-e6a9-4da7-ac52-b4a24c21d89c tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=9dc45b8dd07441bd9a4e9e6c43dab557)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:33.835941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1eaaae-e6a9-4da7-ac52-b4a24c21d89c tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:33.839096 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2990/6051] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:30:33.843042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c8c7a-069d-4830-be85-8a9d8a765e4c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:33.865927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c8c7a-069d-4830-be85-8a9d8a765e4c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:33.898473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fabc6-c5af-4210-b062-9c9592384791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:33.898473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fabc6-c5af-4210-b062-9c9592384791 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:33.900290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fabc6-c5af-4210-b062-9c9592384791 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:33.900290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fabc6-c5af-4210-b062-9c9592384791 admin admin] PATH_INFO: `/v3/projects/69cd4349d9cf46c3ad23e42f907ac72a/users/862d611068f94b42b4dd8829ed5f212a/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:33.904893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2fabc6-c5af-4210-b062-9c9592384791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69cd4349d9cf46c3ad23e42f907ac72a, user_id=862d611068f94b42b4dd8829ed5f212a, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:33.913526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2fabc6-c5af-4210-b062-9c9592384791 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:33.953777 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2991/6052] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:33 2022] PUT /identity/v3/projects/69cd4349d9cf46c3ad23e42f907ac72a/users/862d611068f94b42b4dd8829ed5f212a/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:33.955662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7a129-7f5e-45a3-b96a-f3e19af18b93 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:33.956065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7a129-7f5e-45a3-b96a-f3e19af18b93 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:33.956466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7a129-7f5e-45a3-b96a-f3e19af18b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:34.005069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7dd7a129-7f5e-45a3-b96a-f3e19af18b93 None None] MFA Rules not processed for user `862d611068f94b42b4dd8829ed5f212a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:34.006506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7dd7a129-7f5e-45a3-b96a-f3e19af18b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:34.083719 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3062/6053] 10.222.0.16 () {60 vars in 1264 bytes} [Sat Jul 16 21:30:33 2022] PUT /identity/v3/projects/9dc45b8dd07441bd9a4e9e6c43dab557/tags => generated 140 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:30:34.084777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1eaaae-e6a9-4da7-ac52-b4a24c21d89c tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:34.115600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1eaaae-e6a9-4da7-ac52-b4a24c21d89c tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:34.174955 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2992/6054] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:33 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:34.178342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7a129-7f5e-45a3-b96a-f3e19af18b93 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:34.248119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f618f-d64e-48d0-af72-c4bb84c00836 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12bc76d2029e4e62b7cad725c35376d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63dadc6386244ecbac04e8a5bcab6328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:34.248988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f618f-d64e-48d0-af72-c4bb84c00836 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:34.254559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f618f-d64e-48d0-af72-c4bb84c00836 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:34.254559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f618f-d64e-48d0-af72-c4bb84c00836 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] PATH_INFO: `/v3/projects/9dc45b8dd07441bd9a4e9e6c43dab557/tags` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:34.280525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f618f-d64e-48d0-af72-c4bb84c00836 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=9dc45b8dd07441bd9a4e9e6c43dab557)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:34.285645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f618f-d64e-48d0-af72-c4bb84c00836 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:34.306567 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3063/6055] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Jul 16 21:30:34 2022] GET /identity/v3/projects/9dc45b8dd07441bd9a4e9e6c43dab557/tags => generated 140 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:34.311626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f618f-d64e-48d0-af72-c4bb84c00836 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:34.327550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f618f-d64e-48d0-af72-c4bb84c00836 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:34.335252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7a129-7f5e-45a3-b96a-f3e19af18b93 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:34.335971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791448e7-739e-4bd5-9b57-6fae0377f673 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12bc76d2029e4e62b7cad725c35376d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63dadc6386244ecbac04e8a5bcab6328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:34.339448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791448e7-739e-4bd5-9b57-6fae0377f673 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:34.340018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791448e7-739e-4bd5-9b57-6fae0377f673 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:34.341427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601111b1-51f0-4619-881d-eb6484e934e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:34.347174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601111b1-51f0-4619-881d-eb6484e934e7 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:34.347174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601111b1-51f0-4619-881d-eb6484e934e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:34.347174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601111b1-51f0-4619-881d-eb6484e934e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:34.347174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601111b1-51f0-4619-881d-eb6484e934e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:34.347671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791448e7-739e-4bd5-9b57-6fae0377f673 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] PATH_INFO: `/v3/projects/9dc45b8dd07441bd9a4e9e6c43dab557/tags/tempest-tag-816555796` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:34.350750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601111b1-51f0-4619-881d-eb6484e934e7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:34.353192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791448e7-739e-4bd5-9b57-6fae0377f673 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=9dc45b8dd07441bd9a4e9e6c43dab557, value=tempest-tag-816555796)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:34.355854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791448e7-739e-4bd5-9b57-6fae0377f673 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:34.454042 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2993/6056] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:34 2022] POST /identity/v3/projects => generated 367 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:34.458218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601111b1-51f0-4619-881d-eb6484e934e7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:34.488516 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-791448e7-739e-4bd5-9b57-6fae0377f673 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-816555796. To ensure interoperability, identifiers should be a valid uuid. Jul 16 21:30:34.488516 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 16 21:30:34.488516 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:30:34.505303 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3064/6057] 10.222.0.16 () {58 vars in 1313 bytes} [Sat Jul 16 21:30:34 2022] DELETE /identity/v3/projects/9dc45b8dd07441bd9a4e9e6c43dab557/tags/tempest-tag-816555796 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:34.509856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:34.510403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791448e7-739e-4bd5-9b57-6fae0377f673 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:34.544438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791448e7-739e-4bd5-9b57-6fae0377f673 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:34.568207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:34.570882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601111b1-51f0-4619-881d-eb6484e934e7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:34.577043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e265e-982e-4b4b-8269-23fec6f4a674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:34.577938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e265e-982e-4b4b-8269-23fec6f4a674 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:34.578434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e265e-982e-4b4b-8269-23fec6f4a674 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:34.579139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e265e-982e-4b4b-8269-23fec6f4a674 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:34.580041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e265e-982e-4b4b-8269-23fec6f4a674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:34.585159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e265e-982e-4b4b-8269-23fec6f4a674 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:34.659466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1248e5-c029-4248-97d8-2d1fdbcb7464 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12bc76d2029e4e62b7cad725c35376d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63dadc6386244ecbac04e8a5bcab6328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:34.660371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1248e5-c029-4248-97d8-2d1fdbcb7464 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:34.660660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1248e5-c029-4248-97d8-2d1fdbcb7464 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:34.660940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1248e5-c029-4248-97d8-2d1fdbcb7464 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] PATH_INFO: `/v3/projects/9dc45b8dd07441bd9a4e9e6c43dab557/tags/tempest-tag-816555796` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:34.674906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1248e5-c029-4248-97d8-2d1fdbcb7464 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=9dc45b8dd07441bd9a4e9e6c43dab557, value=tempest-tag-816555796)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:34.677042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1248e5-c029-4248-97d8-2d1fdbcb7464 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:34.691151 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2994/6058] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:34 2022] POST /identity/v3/users => generated 284 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:34.692143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e265e-982e-4b4b-8269-23fec6f4a674 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:34.704196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-1b1248e5-c029-4248-97d8-2d1fdbcb7464 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Could not find project tag: tempest-tag-816555796.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-816555796. Jul 16 21:30:34.704196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:30:34.704196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:30:34.704196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:30:34.704196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:30:34.704196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:30:34.704196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:30:34.704196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:30:34.704196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:30:34.704196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:30:34.704196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:30:34.704196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:30:34.704196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Jul 16 21:30:34.704196 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Jul 16 21:30:34.705576 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:30:34.705576 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:30:34.705576 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Jul 16 21:30:34.705576 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Jul 16 21:30:34.705576 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-816555796. Jul 16 21:30:34.705576 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:30:34.707780 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3065/6059] 10.222.0.16 () {58 vars in 1310 bytes} [Sat Jul 16 21:30:34 2022] GET /identity/v3/projects/9dc45b8dd07441bd9a4e9e6c43dab557/tags/tempest-tag-816555796 => generated 106 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:30:34.714108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1248e5-c029-4248-97d8-2d1fdbcb7464 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:34.721660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e265e-982e-4b4b-8269-23fec6f4a674 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:34.732680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda8040-86d8-4d52-8b96-6233d487387f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:34.739096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda8040-86d8-4d52-8b96-6233d487387f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:34.739096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda8040-86d8-4d52-8b96-6233d487387f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:34.739096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda8040-86d8-4d52-8b96-6233d487387f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:34.739555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1248e5-c029-4248-97d8-2d1fdbcb7464 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:34.739667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda8040-86d8-4d52-8b96-6233d487387f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:34.741101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda8040-86d8-4d52-8b96-6233d487387f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:34.749977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ce029-3676-4dbb-9d35-1c6197fd610c tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12bc76d2029e4e62b7cad725c35376d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63dadc6386244ecbac04e8a5bcab6328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:34.750963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ce029-3676-4dbb-9d35-1c6197fd610c tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:34.751369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ce029-3676-4dbb-9d35-1c6197fd610c tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:34.751750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ce029-3676-4dbb-9d35-1c6197fd610c tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] PATH_INFO: `/v3/projects/9dc45b8dd07441bd9a4e9e6c43dab557/tags` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:34.754892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ce029-3676-4dbb-9d35-1c6197fd610c tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=9dc45b8dd07441bd9a4e9e6c43dab557)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:34.758311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ce029-3676-4dbb-9d35-1c6197fd610c tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:34.763794 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2995/6060] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:34.767954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda8040-86d8-4d52-8b96-6233d487387f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:34.779449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda8040-86d8-4d52-8b96-6233d487387f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:34.787228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10618029-5dbb-46ff-b32c-3716bf9f0644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:34.788754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10618029-5dbb-46ff-b32c-3716bf9f0644 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:34.790967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10618029-5dbb-46ff-b32c-3716bf9f0644 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:34.790967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10618029-5dbb-46ff-b32c-3716bf9f0644 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:34.790967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10618029-5dbb-46ff-b32c-3716bf9f0644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:34.793037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10618029-5dbb-46ff-b32c-3716bf9f0644 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:34.811291 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2996/6061] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:34.814010 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10618029-5dbb-46ff-b32c-3716bf9f0644 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:34.824725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10618029-5dbb-46ff-b32c-3716bf9f0644 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:34.830201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8e946-831d-48f2-b564-ab49968344ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:34.831242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8e946-831d-48f2-b564-ab49968344ba admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:34.831526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8e946-831d-48f2-b564-ab49968344ba admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:34.831947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8e946-831d-48f2-b564-ab49968344ba admin admin] PATH_INFO: `/v3/projects/2b9b3ad58ab24d55bc9a3e95f20d9813/users/136fc4f978ef4d4890f4fa15469d678b/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:34.854647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8e946-831d-48f2-b564-ab49968344ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9b3ad58ab24d55bc9a3e95f20d9813, user_id=136fc4f978ef4d4890f4fa15469d678b, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:34.860944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8e946-831d-48f2-b564-ab49968344ba admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:34.909605 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3066/6062] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Jul 16 21:30:34 2022] DELETE /identity/v3/projects/9dc45b8dd07441bd9a4e9e6c43dab557/tags => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:34.913896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ce029-3676-4dbb-9d35-1c6197fd610c tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:34.925409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ce029-3676-4dbb-9d35-1c6197fd610c tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:34.932765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb3312-80eb-4e3a-b708-12fbd837dda2 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12bc76d2029e4e62b7cad725c35376d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63dadc6386244ecbac04e8a5bcab6328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:34.933679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb3312-80eb-4e3a-b708-12fbd837dda2 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:34.933971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb3312-80eb-4e3a-b708-12fbd837dda2 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:34.934247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb3312-80eb-4e3a-b708-12fbd837dda2 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] PATH_INFO: `/v3/projects/9dc45b8dd07441bd9a4e9e6c43dab557/tags` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:34.949667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb3312-80eb-4e3a-b708-12fbd837dda2 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=9dc45b8dd07441bd9a4e9e6c43dab557)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:34.952838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb3312-80eb-4e3a-b708-12fbd837dda2 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:34.966431 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3067/6063] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Jul 16 21:30:34 2022] GET /identity/v3/projects/9dc45b8dd07441bd9a4e9e6c43dab557/tags => generated 66 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 16 21:30:34.967125 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2997/6064] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:34 2022] PUT /identity/v3/projects/2b9b3ad58ab24d55bc9a3e95f20d9813/users/136fc4f978ef4d4890f4fa15469d678b/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:34.979976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb3312-80eb-4e3a-b708-12fbd837dda2 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:35.001573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb3312-80eb-4e3a-b708-12fbd837dda2 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:35.065760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf1b04-8d55-45da-928d-819a5bce080b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:35.066456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf1b04-8d55-45da-928d-819a5bce080b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:35.066749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf1b04-8d55-45da-928d-819a5bce080b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:35.078324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64242b00-aa62-4298-b540-8a0b0b95c411 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12bc76d2029e4e62b7cad725c35376d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63dadc6386244ecbac04e8a5bcab6328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:35.081861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64242b00-aa62-4298-b540-8a0b0b95c411 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:35.085632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64242b00-aa62-4298-b540-8a0b0b95c411 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:35.085632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64242b00-aa62-4298-b540-8a0b0b95c411 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] PATH_INFO: `/v3/projects/9dc45b8dd07441bd9a4e9e6c43dab557` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:35.087925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64242b00-aa62-4298-b540-8a0b0b95c411 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9dc45b8dd07441bd9a4e9e6c43dab557)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:35.090067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64242b00-aa62-4298-b540-8a0b0b95c411 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:35.116830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-67cf1b04-8d55-45da-928d-819a5bce080b None None] MFA Rules not processed for user `136fc4f978ef4d4890f4fa15469d678b`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:35.118579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-67cf1b04-8d55-45da-928d-819a5bce080b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:35.195058 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2998/6065] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:30:35.199175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf1b04-8d55-45da-928d-819a5bce080b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:35.219741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-64242b00-aa62-4298-b540-8a0b0b95c411 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dc45b8dd07441bd9a4e9e6c43dab557', 'request_id': 'req-64242b00-aa62-4298-b540-8a0b0b95c411'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:35.237134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-64242b00-aa62-4298-b540-8a0b0b95c411 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dc45b8dd07441bd9a4e9e6c43dab557', 'request_id': 'req-64242b00-aa62-4298-b540-8a0b0b95c411'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:35.273309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-64242b00-aa62-4298-b540-8a0b0b95c411 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dc45b8dd07441bd9a4e9e6c43dab557', 'request_id': 'req-64242b00-aa62-4298-b540-8a0b0b95c411'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:35.359228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf1b04-8d55-45da-928d-819a5bce080b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:35.363719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-64242b00-aa62-4298-b540-8a0b0b95c411 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] The token cache is being invalidate because project 9dc45b8dd07441bd9a4e9e6c43dab557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:35.364606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-64242b00-aa62-4298-b540-8a0b0b95c411 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:35.365562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-64242b00-aa62-4298-b540-8a0b0b95c411 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:35.367819 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3068/6066] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:34 2022] DELETE /identity/v3/projects/9dc45b8dd07441bd9a4e9e6c43dab557 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:35.373858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64242b00-aa62-4298-b540-8a0b0b95c411 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:35.379356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-64242b00-aa62-4298-b540-8a0b0b95c411 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:35.449214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874970e0-889e-4d50-a49e-a42abbe41b1f tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:35.450284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874970e0-889e-4d50-a49e-a42abbe41b1f tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:35.450665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874970e0-889e-4d50-a49e-a42abbe41b1f tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:35.451076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874970e0-889e-4d50-a49e-a42abbe41b1f tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:35.452798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874970e0-889e-4d50-a49e-a42abbe41b1f tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:35.456144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874970e0-889e-4d50-a49e-a42abbe41b1f tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:35.478689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64242b00-aa62-4298-b540-8a0b0b95c411 tempest-IdentityV3ProjectTagsTest-7101404 tempest-IdentityV3ProjectTagsTest-7101404-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:35.486201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09ee0f-9017-4e58-89c2-5f37f053ed01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:35.487410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09ee0f-9017-4e58-89c2-5f37f053ed01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:35.487807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09ee0f-9017-4e58-89c2-5f37f053ed01 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:35.489039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09ee0f-9017-4e58-89c2-5f37f053ed01 admin admin] PATH_INFO: `/v3/users/16421490487f47da9a054e45d17794d0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:35.500667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09ee0f-9017-4e58-89c2-5f37f053ed01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16421490487f47da9a054e45d17794d0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:35.500667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09ee0f-9017-4e58-89c2-5f37f053ed01 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:35.607137 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 2999/6067] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:30:35 2022] POST /identity/v3/domains => generated 276 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:30:35.610186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874970e0-889e-4d50-a49e-a42abbe41b1f tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:35.612990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-874970e0-889e-4d50-a49e-a42abbe41b1f tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:35.697670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874970e0-889e-4d50-a49e-a42abbe41b1f tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:35.702865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c51b7-ffff-42b4-acc7-77379003912d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:35.703602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c51b7-ffff-42b4-acc7-77379003912d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:35.703883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c51b7-ffff-42b4-acc7-77379003912d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:35.704156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c51b7-ffff-42b4-acc7-77379003912d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:35.704886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c51b7-ffff-42b4-acc7-77379003912d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:35.706487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c51b7-ffff-42b4-acc7-77379003912d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:35.710969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:35.844801 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3000/6068] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:30:35 2022] POST /identity/v3/roles => generated 238 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:30:35.846379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c51b7-ffff-42b4-acc7-77379003912d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:35.854946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f09ee0f-9017-4e58-89c2-5f37f053ed01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16421490487f47da9a054e45d17794d0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:35.859725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c51b7-ffff-42b4-acc7-77379003912d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:35.864887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd94c1-4729-49dc-89e3-696ef307c8f6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:35.865833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd94c1-4729-49dc-89e3-696ef307c8f6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:35.866365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd94c1-4729-49dc-89e3-696ef307c8f6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:35.868242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd94c1-4729-49dc-89e3-696ef307c8f6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains/d5597425d2e246189aee0edfa95627a6/users/136fc4f978ef4d4890f4fa15469d678b/roles/c0d7df8111f245f5858fd0d694956e91` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:35.873762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f09ee0f-9017-4e58-89c2-5f37f053ed01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16421490487f47da9a054e45d17794d0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:35.884122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd94c1-4729-49dc-89e3-696ef307c8f6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=d5597425d2e246189aee0edfa95627a6, user_id=136fc4f978ef4d4890f4fa15469d678b, role_id=c0d7df8111f245f5858fd0d694956e91)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:35.890524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd94c1-4729-49dc-89e3-696ef307c8f6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:35.942398 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f09ee0f-9017-4e58-89c2-5f37f053ed01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16421490487f47da9a054e45d17794d0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:35.943168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f09ee0f-9017-4e58-89c2-5f37f053ed01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16421490487f47da9a054e45d17794d0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:35.956784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f09ee0f-9017-4e58-89c2-5f37f053ed01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16421490487f47da9a054e45d17794d0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:35.967862 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3069/6069] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:35 2022] DELETE /identity/v3/users/16421490487f47da9a054e45d17794d0 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:35.969540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14bbb2-9e61-4777-a6ca-d5d5fcccd1b4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:35.969909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14bbb2-9e61-4777-a6ca-d5d5fcccd1b4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:35.970265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14bbb2-9e61-4777-a6ca-d5d5fcccd1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:35.983546 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3001/6070] 10.222.0.16 () {60 vars in 1479 bytes} [Sat Jul 16 21:30:35 2022] PUT /identity/v3/domains/d5597425d2e246189aee0edfa95627a6/users/136fc4f978ef4d4890f4fa15469d678b/roles/c0d7df8111f245f5858fd0d694956e91 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:35.987800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd94c1-4729-49dc-89e3-696ef307c8f6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:35.989202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-67cd94c1-4729-49dc-89e3-696ef307c8f6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:36.031034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4b14bbb2-9e61-4777-a6ca-d5d5fcccd1b4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:36.038560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4b14bbb2-9e61-4777-a6ca-d5d5fcccd1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:36.103841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd94c1-4729-49dc-89e3-696ef307c8f6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:36.112817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61458a67-9dd1-46ba-8679-91b0b5e29476 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:36.114173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61458a67-9dd1-46ba-8679-91b0b5e29476 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:36.114475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61458a67-9dd1-46ba-8679-91b0b5e29476 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:36.114958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61458a67-9dd1-46ba-8679-91b0b5e29476 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:36.118418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:36.122730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61458a67-9dd1-46ba-8679-91b0b5e29476 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:36.124223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61458a67-9dd1-46ba-8679-91b0b5e29476 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:36.148740 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3070/6071] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:36.163228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14bbb2-9e61-4777-a6ca-d5d5fcccd1b4 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:36.167300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4b14bbb2-9e61-4777-a6ca-d5d5fcccd1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:36.222624 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3002/6072] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:30:35 2022] POST /identity/v3/domains => generated 277 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:36.227097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61458a67-9dd1-46ba-8679-91b0b5e29476 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:36.265116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14bbb2-9e61-4777-a6ca-d5d5fcccd1b4 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:36.318514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61458a67-9dd1-46ba-8679-91b0b5e29476 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:36.327113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cc6b4-0ddd-4013-a9dd-d472ad3fd786 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:36.328014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cc6b4-0ddd-4013-a9dd-d472ad3fd786 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:36.328559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cc6b4-0ddd-4013-a9dd-d472ad3fd786 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:36.329004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cc6b4-0ddd-4013-a9dd-d472ad3fd786 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:36.329954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4cc6b4-0ddd-4013-a9dd-d472ad3fd786 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:36.332419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4cc6b4-0ddd-4013-a9dd-d472ad3fd786 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:36.357835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89974df3-719a-4de6-af18-0c862a3ea0c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:36.358807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89974df3-719a-4de6-af18-0c862a3ea0c2 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:36.359293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89974df3-719a-4de6-af18-0c862a3ea0c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:36.359749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89974df3-719a-4de6-af18-0c862a3ea0c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:36.439408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89974df3-719a-4de6-af18-0c862a3ea0c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:36.441143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89974df3-719a-4de6-af18-0c862a3ea0c2 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:36.451629 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3003/6073] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:30:36 2022] POST /identity/v3/roles => generated 239 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:36.455775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cc6b4-0ddd-4013-a9dd-d472ad3fd786 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:36.456637 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3071/6074] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:30:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:30:36.468286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cc6b4-0ddd-4013-a9dd-d472ad3fd786 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:36.474135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f3011-38a5-4048-aea8-503a900c3076 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:36.475115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f3011-38a5-4048-aea8-503a900c3076 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:36.475487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f3011-38a5-4048-aea8-503a900c3076 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:36.480217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f3011-38a5-4048-aea8-503a900c3076 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/groups` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:36.480217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f3011-38a5-4048-aea8-503a900c3076 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:36.480217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f3011-38a5-4048-aea8-503a900c3076 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:36.596427 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3004/6075] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jul 16 21:30:36 2022] POST /identity/v3/groups => generated 327 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:30:36.600803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89974df3-719a-4de6-af18-0c862a3ea0c2 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:36.621351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89974df3-719a-4de6-af18-0c862a3ea0c2 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:36.627936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4e045-e60f-4bd2-99c9-3cb1994b13b7 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:36.629957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4e045-e60f-4bd2-99c9-3cb1994b13b7 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:36.630253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4e045-e60f-4bd2-99c9-3cb1994b13b7 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:36.630674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4e045-e60f-4bd2-99c9-3cb1994b13b7 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/groups/38f485ed86f844ef82dd09c2311b41e0/users/136fc4f978ef4d4890f4fa15469d678b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:36.640887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4e045-e60f-4bd2-99c9-3cb1994b13b7 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=38f485ed86f844ef82dd09c2311b41e0, user_id=136fc4f978ef4d4890f4fa15469d678b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:36.643132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4e045-e60f-4bd2-99c9-3cb1994b13b7 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:36.752549 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3072/6076] 10.222.0.16 () {60 vars in 1359 bytes} [Sat Jul 16 21:30:36 2022] PUT /identity/v3/groups/38f485ed86f844ef82dd09c2311b41e0/users/136fc4f978ef4d4890f4fa15469d678b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:36.756677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f3011-38a5-4048-aea8-503a900c3076 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:36.774520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f3011-38a5-4048-aea8-503a900c3076 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:36.901201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d660304-e944-4dfd-8eb7-0733cb8a9818 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:36.902394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d660304-e944-4dfd-8eb7-0733cb8a9818 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:36.902518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d660304-e944-4dfd-8eb7-0733cb8a9818 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:36.902783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d660304-e944-4dfd-8eb7-0733cb8a9818 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains/a2724557a017425b92a4caac86ada08e/groups/38f485ed86f844ef82dd09c2311b41e0/roles/c241db24c09c42b0b5eaaca129b7095e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:36.905889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d660304-e944-4dfd-8eb7-0733cb8a9818 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a2724557a017425b92a4caac86ada08e, group_id=38f485ed86f844ef82dd09c2311b41e0, role_id=c241db24c09c42b0b5eaaca129b7095e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:36.908710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d660304-e944-4dfd-8eb7-0733cb8a9818 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:36.954310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:37.000955 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3005/6077] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:36 2022] PUT /identity/v3/domains/a2724557a017425b92a4caac86ada08e/groups/38f485ed86f844ef82dd09c2311b41e0/roles/c241db24c09c42b0b5eaaca129b7095e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:37.002256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4e045-e60f-4bd2-99c9-3cb1994b13b7 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:37.031565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4e045-e60f-4bd2-99c9-3cb1994b13b7 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:37.160385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727d6ee-67ab-4ee1-8670-8c8d8a784d26 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:37.161215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727d6ee-67ab-4ee1-8670-8c8d8a784d26 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:37.162060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727d6ee-67ab-4ee1-8670-8c8d8a784d26 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:37.162453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727d6ee-67ab-4ee1-8670-8c8d8a784d26 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:37.163681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727d6ee-67ab-4ee1-8670-8c8d8a784d26 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:37.166104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727d6ee-67ab-4ee1-8670-8c8d8a784d26 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:37.171946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb2296-cc41-4690-81ea-7479e6a87612 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:37.172301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb2296-cc41-4690-81ea-7479e6a87612 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:37.172587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb2296-cc41-4690-81ea-7479e6a87612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:37.195358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ddeb2296-cc41-4690-81ea-7479e6a87612 None None] MFA Rules not processed for user `da77ec3d0f04496d8c8df4025bba76d1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:37.196741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ddeb2296-cc41-4690-81ea-7479e6a87612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:37.286934 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3073/6078] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:30:37 2022] POST /identity/v3/domains => generated 277 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:37.289235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727d6ee-67ab-4ee1-8670-8c8d8a784d26 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:37.332791 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3006/6079] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:30:37.383123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727d6ee-67ab-4ee1-8670-8c8d8a784d26 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:37.407213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd147f1-5f7f-412e-a36a-daf582316915 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:37.408009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd147f1-5f7f-412e-a36a-daf582316915 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:37.408592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd147f1-5f7f-412e-a36a-daf582316915 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:37.408971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd147f1-5f7f-412e-a36a-daf582316915 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:37.409916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd147f1-5f7f-412e-a36a-daf582316915 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:37.412041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd147f1-5f7f-412e-a36a-daf582316915 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:37.442805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb2296-cc41-4690-81ea-7479e6a87612 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:37.444357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ddeb2296-cc41-4690-81ea-7479e6a87612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:37.534760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb2296-cc41-4690-81ea-7479e6a87612 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:37.568104 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3074/6080] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:30:37 2022] POST /identity/v3/roles => generated 239 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:37.572400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd147f1-5f7f-412e-a36a-daf582316915 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:37.587220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd147f1-5f7f-412e-a36a-daf582316915 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:37.593778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8294b-776d-4c03-927e-4c1f41e7376d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:37.595613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8294b-776d-4c03-927e-4c1f41e7376d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:37.596031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8294b-776d-4c03-927e-4c1f41e7376d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:37.596382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8294b-776d-4c03-927e-4c1f41e7376d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains/d73835de813e488d8cf4f2da68df307f/users/136fc4f978ef4d4890f4fa15469d678b/roles/df522615270b44e4b7662ba6ddc694ec` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:37.618960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8294b-776d-4c03-927e-4c1f41e7376d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=d73835de813e488d8cf4f2da68df307f, user_id=136fc4f978ef4d4890f4fa15469d678b, role_id=df522615270b44e4b7662ba6ddc694ec)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:37.622055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8294b-776d-4c03-927e-4c1f41e7376d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:37.646864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141f449-ca98-4da4-87ff-c5f85828252f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:37.647864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141f449-ca98-4da4-87ff-c5f85828252f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:37.648175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141f449-ca98-4da4-87ff-c5f85828252f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:37.648449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141f449-ca98-4da4-87ff-c5f85828252f admin admin] PATH_INFO: `/v3/projects/a6045ecf289e4853806a2c8994c5407f` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:37.653682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141f449-ca98-4da4-87ff-c5f85828252f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6045ecf289e4853806a2c8994c5407f)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:37.655840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141f449-ca98-4da4-87ff-c5f85828252f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:37.738096 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3075/6081] 10.222.0.16 () {60 vars in 1479 bytes} [Sat Jul 16 21:30:37 2022] PUT /identity/v3/domains/d73835de813e488d8cf4f2da68df307f/users/136fc4f978ef4d4890f4fa15469d678b/roles/df522615270b44e4b7662ba6ddc694ec => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:37.743717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8294b-776d-4c03-927e-4c1f41e7376d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:37.800195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:37.827390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2141f449-ca98-4da4-87ff-c5f85828252f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6045ecf289e4853806a2c8994c5407f', 'request_id': 'req-2141f449-ca98-4da4-87ff-c5f85828252f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:37.834599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2141f449-ca98-4da4-87ff-c5f85828252f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6045ecf289e4853806a2c8994c5407f', 'request_id': 'req-2141f449-ca98-4da4-87ff-c5f85828252f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:37.839347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8294b-776d-4c03-927e-4c1f41e7376d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:37.842855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2141f449-ca98-4da4-87ff-c5f85828252f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6045ecf289e4853806a2c8994c5407f', 'request_id': 'req-2141f449-ca98-4da4-87ff-c5f85828252f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:37.917711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4601eb-bd67-403b-a015-6f059af87e6d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:37.918853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4601eb-bd67-403b-a015-6f059af87e6d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:37.919185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4601eb-bd67-403b-a015-6f059af87e6d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:37.919515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4601eb-bd67-403b-a015-6f059af87e6d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:37.920277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4601eb-bd67-403b-a015-6f059af87e6d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:37.922456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4601eb-bd67-403b-a015-6f059af87e6d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:37.944144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2141f449-ca98-4da4-87ff-c5f85828252f admin admin] The token cache is being invalidate because project a6045ecf289e4853806a2c8994c5407f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:37.944505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2141f449-ca98-4da4-87ff-c5f85828252f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:37.947662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2141f449-ca98-4da4-87ff-c5f85828252f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:37.949498 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3007/6082] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:37 2022] DELETE /identity/v3/projects/a6045ecf289e4853806a2c8994c5407f => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:37.950303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141f449-ca98-4da4-87ff-c5f85828252f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:37.951903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2141f449-ca98-4da4-87ff-c5f85828252f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:38.011746 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3076/6083] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:30:37 2022] POST /identity/v3/domains => generated 275 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:38.012720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4601eb-bd67-403b-a015-6f059af87e6d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:38.014456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-df4601eb-bd67-403b-a015-6f059af87e6d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:38.033096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141f449-ca98-4da4-87ff-c5f85828252f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:38.109204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9582d1d-abee-4142-b05d-6776cf608d15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:38.109920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9582d1d-abee-4142-b05d-6776cf608d15 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:38.110203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9582d1d-abee-4142-b05d-6776cf608d15 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:38.116075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9582d1d-abee-4142-b05d-6776cf608d15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:38.128356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a9582d1d-abee-4142-b05d-6776cf608d15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:38.130251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4601eb-bd67-403b-a015-6f059af87e6d tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:38.138145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9582d1d-abee-4142-b05d-6776cf608d15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:38.139631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9582d1d-abee-4142-b05d-6776cf608d15 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:38.140510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ecb25-1bfd-4dfa-82f5-f50f79a9cd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:38.142368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ecb25-1bfd-4dfa-82f5-f50f79a9cd3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:38.142717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ecb25-1bfd-4dfa-82f5-f50f79a9cd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:38.143110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ecb25-1bfd-4dfa-82f5-f50f79a9cd3e admin admin] PATH_INFO: `/v3/users/12bc76d2029e4e62b7cad725c35376d9` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:38.144644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ecb25-1bfd-4dfa-82f5-f50f79a9cd3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=12bc76d2029e4e62b7cad725c35376d9)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:38.148268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ecb25-1bfd-4dfa-82f5-f50f79a9cd3e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:38.160932 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3008/6084] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:30:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:30:38.160932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9582d1d-abee-4142-b05d-6776cf608d15 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:38.161945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a9582d1d-abee-4142-b05d-6776cf608d15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:38.275372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9582d1d-abee-4142-b05d-6776cf608d15 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:38.284938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4365c09-639a-4588-8bea-c4e0e6bb9163 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:38.286109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4365c09-639a-4588-8bea-c4e0e6bb9163 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:38.286838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4365c09-639a-4588-8bea-c4e0e6bb9163 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:38.287338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4365c09-639a-4588-8bea-c4e0e6bb9163 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:38.288473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4365c09-639a-4588-8bea-c4e0e6bb9163 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:38.291650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4365c09-639a-4588-8bea-c4e0e6bb9163 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:38.433937 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3009/6085] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:30:38 2022] POST /identity/v3/roles => generated 240 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:38.435260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4365c09-639a-4588-8bea-c4e0e6bb9163 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:38.442193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6b3ecb25-1bfd-4dfa-82f5-f50f79a9cd3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12bc76d2029e4e62b7cad725c35376d9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:38.452468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6b3ecb25-1bfd-4dfa-82f5-f50f79a9cd3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12bc76d2029e4e62b7cad725c35376d9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:38.457311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4365c09-639a-4588-8bea-c4e0e6bb9163 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:38.473227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220829ae-5e81-4920-9f4d-c16b7e6d0850 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:38.474492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220829ae-5e81-4920-9f4d-c16b7e6d0850 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:38.474492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220829ae-5e81-4920-9f4d-c16b7e6d0850 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:38.474722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220829ae-5e81-4920-9f4d-c16b7e6d0850 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/groups` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:38.475356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220829ae-5e81-4920-9f4d-c16b7e6d0850 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:38.484124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220829ae-5e81-4920-9f4d-c16b7e6d0850 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:38.554904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6b3ecb25-1bfd-4dfa-82f5-f50f79a9cd3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12bc76d2029e4e62b7cad725c35376d9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:38.556422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6b3ecb25-1bfd-4dfa-82f5-f50f79a9cd3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12bc76d2029e4e62b7cad725c35376d9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:38.576982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6b3ecb25-1bfd-4dfa-82f5-f50f79a9cd3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12bc76d2029e4e62b7cad725c35376d9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:38.590908 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3077/6086] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:38 2022] DELETE /identity/v3/users/12bc76d2029e4e62b7cad725c35376d9 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:38.695339 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3010/6087] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jul 16 21:30:38 2022] POST /identity/v3/groups => generated 325 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:38.699847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ecb25-1bfd-4dfa-82f5-f50f79a9cd3e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:38.701679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6b3ecb25-1bfd-4dfa-82f5-f50f79a9cd3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:38.716534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:38.908116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ecb25-1bfd-4dfa-82f5-f50f79a9cd3e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:38.913001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c1f5e-6242-4293-af1d-8e6e46e22587 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:38.914041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c1f5e-6242-4293-af1d-8e6e46e22587 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:38.914322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c1f5e-6242-4293-af1d-8e6e46e22587 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:38.915363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c1f5e-6242-4293-af1d-8e6e46e22587 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/groups/4de3f41305d444eba650d8eddd87ad67/users/136fc4f978ef4d4890f4fa15469d678b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:38.921891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c1f5e-6242-4293-af1d-8e6e46e22587 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=4de3f41305d444eba650d8eddd87ad67, user_id=136fc4f978ef4d4890f4fa15469d678b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:38.924045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c1f5e-6242-4293-af1d-8e6e46e22587 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:39.081113 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3078/6088] 10.222.0.16 () {60 vars in 1359 bytes} [Sat Jul 16 21:30:38 2022] PUT /identity/v3/groups/4de3f41305d444eba650d8eddd87ad67/users/136fc4f978ef4d4890f4fa15469d678b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:39.092420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220829ae-5e81-4920-9f4d-c16b7e6d0850 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:39.112187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220829ae-5e81-4920-9f4d-c16b7e6d0850 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:39.221297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:39.325365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c96ee-30da-4653-8f2d-4d9ecdaf2f7e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:39.328253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c96ee-30da-4653-8f2d-4d9ecdaf2f7e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:39.329809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c96ee-30da-4653-8f2d-4d9ecdaf2f7e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:39.330308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c96ee-30da-4653-8f2d-4d9ecdaf2f7e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains/f9d916cded1f4383b9e79dd3fdb0ecc9/groups/4de3f41305d444eba650d8eddd87ad67/roles/4eb8af5bb3684f3eba70ade42fe635f4` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:39.340075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c96ee-30da-4653-8f2d-4d9ecdaf2f7e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f9d916cded1f4383b9e79dd3fdb0ecc9, group_id=4de3f41305d444eba650d8eddd87ad67, role_id=4eb8af5bb3684f3eba70ade42fe635f4)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:39.347511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c96ee-30da-4653-8f2d-4d9ecdaf2f7e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:39.456745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c1f5e-6242-4293-af1d-8e6e46e22587 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:39.457443 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3011/6089] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:39 2022] PUT /identity/v3/domains/f9d916cded1f4383b9e79dd3fdb0ecc9/groups/4de3f41305d444eba650d8eddd87ad67/roles/4eb8af5bb3684f3eba70ade42fe635f4 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:39.459230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0d1c1f5e-6242-4293-af1d-8e6e46e22587 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:39.654833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c1f5e-6242-4293-af1d-8e6e46e22587 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:39.767916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f805e-bd1b-4265-b10d-4fe34de24f25 tempest-TokensV3TestJSON-194513063 tempest-TokensV3TestJSON-194513063-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136fc4f978ef4d4890f4fa15469d678b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b9b3ad58ab24d55bc9a3e95f20d9813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:39.768641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f805e-bd1b-4265-b10d-4fe34de24f25 tempest-TokensV3TestJSON-194513063 tempest-TokensV3TestJSON-194513063-project] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:39.768930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f805e-bd1b-4265-b10d-4fe34de24f25 tempest-TokensV3TestJSON-194513063 tempest-TokensV3TestJSON-194513063-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:39.769263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f805e-bd1b-4265-b10d-4fe34de24f25 tempest-TokensV3TestJSON-194513063 tempest-TokensV3TestJSON-194513063-project] PATH_INFO: `/v3/auth/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:39.770020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f805e-bd1b-4265-b10d-4fe34de24f25 tempest-TokensV3TestJSON-194513063 tempest-TokensV3TestJSON-194513063-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:39.771206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f805e-bd1b-4265-b10d-4fe34de24f25 tempest-TokensV3TestJSON-194513063 tempest-TokensV3TestJSON-194513063-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:39.784239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:39.898530 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3079/6090] 10.222.0.16 () {58 vars in 1142 bytes} [Sat Jul 16 21:30:39 2022] GET /identity/v3/auth/domains => generated 1173 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:39.903755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c96ee-30da-4653-8f2d-4d9ecdaf2f7e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:40.059302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c96ee-30da-4653-8f2d-4d9ecdaf2f7e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:40.085511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fbc40-53cb-4d44-82d5-bf522dbefb71 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:40.088849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fbc40-53cb-4d44-82d5-bf522dbefb71 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:40.090191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fbc40-53cb-4d44-82d5-bf522dbefb71 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:40.090482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fbc40-53cb-4d44-82d5-bf522dbefb71 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains/f9d916cded1f4383b9e79dd3fdb0ecc9/groups/4de3f41305d444eba650d8eddd87ad67/roles/4eb8af5bb3684f3eba70ade42fe635f4` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:40.099626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fbc40-53cb-4d44-82d5-bf522dbefb71 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f9d916cded1f4383b9e79dd3fdb0ecc9, group_id=4de3f41305d444eba650d8eddd87ad67, role_id=4eb8af5bb3684f3eba70ade42fe635f4)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:40.103230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fbc40-53cb-4d44-82d5-bf522dbefb71 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:40.114289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f15fbc40-53cb-4d44-82d5-bf522dbefb71 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invalidating the token cache because role 4eb8af5bb3684f3eba70ade42fe635f4 was removed from group 4de3f41305d444eba650d8eddd87ad67 on domain f9d916cded1f4383b9e79dd3fdb0ecc9. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:40.114841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f15fbc40-53cb-4d44-82d5-bf522dbefb71 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:40.116192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f15fbc40-53cb-4d44-82d5-bf522dbefb71 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:40.221629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f805e-bd1b-4265-b10d-4fe34de24f25 tempest-TokensV3TestJSON-194513063 tempest-TokensV3TestJSON-194513063-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:40.223481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2c8f805e-bd1b-4265-b10d-4fe34de24f25 tempest-TokensV3TestJSON-194513063 tempest-TokensV3TestJSON-194513063-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:40.257376 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3012/6091] 10.222.0.16 () {58 vars in 1466 bytes} [Sat Jul 16 21:30:39 2022] DELETE /identity/v3/domains/f9d916cded1f4383b9e79dd3fdb0ecc9/groups/4de3f41305d444eba650d8eddd87ad67/roles/4eb8af5bb3684f3eba70ade42fe635f4 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:40.259633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fbc40-53cb-4d44-82d5-bf522dbefb71 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:40.261919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f15fbc40-53cb-4d44-82d5-bf522dbefb71 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:40.372075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fbc40-53cb-4d44-82d5-bf522dbefb71 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:40.387155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f805e-bd1b-4265-b10d-4fe34de24f25 tempest-TokensV3TestJSON-194513063 tempest-TokensV3TestJSON-194513063-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:40.387502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1119a-737b-4b6d-be9f-6a227f9d9c67 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:40.388906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1119a-737b-4b6d-be9f-6a227f9d9c67 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:40.389432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1119a-737b-4b6d-be9f-6a227f9d9c67 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:40.389869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1119a-737b-4b6d-be9f-6a227f9d9c67 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/groups/4de3f41305d444eba650d8eddd87ad67/users/136fc4f978ef4d4890f4fa15469d678b` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:40.393456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1119a-737b-4b6d-be9f-6a227f9d9c67 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=4de3f41305d444eba650d8eddd87ad67, user_id=136fc4f978ef4d4890f4fa15469d678b)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:40.397793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1119a-737b-4b6d-be9f-6a227f9d9c67 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:40.451967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:40.501994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e5e1119a-737b-4b6d-be9f-6a227f9d9c67 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '136fc4f978ef4d4890f4fa15469d678b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:40.513227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0e3c9-31ef-4327-9dba-2e5497de9a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:40.514359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0e3c9-31ef-4327-9dba-2e5497de9a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:40.514834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0e3c9-31ef-4327-9dba-2e5497de9a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:40.515355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0e3c9-31ef-4327-9dba-2e5497de9a79 admin admin] PATH_INFO: `/v3/projects/63dadc6386244ecbac04e8a5bcab6328` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:40.518128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0e3c9-31ef-4327-9dba-2e5497de9a79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63dadc6386244ecbac04e8a5bcab6328)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:40.521586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0e3c9-31ef-4327-9dba-2e5497de9a79 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:40.691791 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3013/6092] 10.222.0.16 () {58 vars in 1343 bytes} [Sat Jul 16 21:30:40 2022] DELETE /identity/v3/groups/4de3f41305d444eba650d8eddd87ad67/users/136fc4f978ef4d4890f4fa15469d678b => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:40.692792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1119a-737b-4b6d-be9f-6a227f9d9c67 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:40.732660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b4c0e3c9-31ef-4327-9dba-2e5497de9a79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63dadc6386244ecbac04e8a5bcab6328', 'request_id': 'req-b4c0e3c9-31ef-4327-9dba-2e5497de9a79'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:40.752351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b4c0e3c9-31ef-4327-9dba-2e5497de9a79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63dadc6386244ecbac04e8a5bcab6328', 'request_id': 'req-b4c0e3c9-31ef-4327-9dba-2e5497de9a79'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:40.765667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b4c0e3c9-31ef-4327-9dba-2e5497de9a79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63dadc6386244ecbac04e8a5bcab6328', 'request_id': 'req-b4c0e3c9-31ef-4327-9dba-2e5497de9a79'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:40.806229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1119a-737b-4b6d-be9f-6a227f9d9c67 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:40.938059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b4c0e3c9-31ef-4327-9dba-2e5497de9a79 admin admin] The token cache is being invalidate because project 63dadc6386244ecbac04e8a5bcab6328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:40.938728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b4c0e3c9-31ef-4327-9dba-2e5497de9a79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:40.939692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6ecc9-ad7e-407a-9293-6eb3d4964fb1 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:40.942034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b4c0e3c9-31ef-4327-9dba-2e5497de9a79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:40.950194 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3080/6093] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:40 2022] DELETE /identity/v3/projects/63dadc6386244ecbac04e8a5bcab6328 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:40.950378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6ecc9-ad7e-407a-9293-6eb3d4964fb1 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:40.950378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6ecc9-ad7e-407a-9293-6eb3d4964fb1 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:40.950378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6ecc9-ad7e-407a-9293-6eb3d4964fb1 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/groups/4de3f41305d444eba650d8eddd87ad67` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:40.950378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6ecc9-ad7e-407a-9293-6eb3d4964fb1 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4de3f41305d444eba650d8eddd87ad67)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:40.952459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2ecb6-c569-4570-8fa3-8d4ec345a385 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:40.952790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2ecb6-c569-4570-8fa3-8d4ec345a385 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:40.956592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2ecb6-c569-4570-8fa3-8d4ec345a385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:40.959156 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-dac6ecc9-ad7e-407a-9293-6eb3d4964fb1 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:30:40.959156 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:30:40.959156 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:30:40.975480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6ecc9-ad7e-407a-9293-6eb3d4964fb1 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:41.036072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-bef2ecb6-c569-4570-8fa3-8d4ec345a385 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:41.037542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bef2ecb6-c569-4570-8fa3-8d4ec345a385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:41.159288 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3014/6094] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Jul 16 21:30:40 2022] DELETE /identity/v3/groups/4de3f41305d444eba650d8eddd87ad67 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:41.163894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6ecc9-ad7e-407a-9293-6eb3d4964fb1 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:41.168627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-dac6ecc9-ad7e-407a-9293-6eb3d4964fb1 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:41.210868 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3081/6095] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:30:41.225553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35882b0-6933-4e28-a34d-ca74b6b42c87 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:41.225553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35882b0-6933-4e28-a34d-ca74b6b42c87 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:41.225553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35882b0-6933-4e28-a34d-ca74b6b42c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:41.252340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b35882b0-6933-4e28-a34d-ca74b6b42c87 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:41.254363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b35882b0-6933-4e28-a34d-ca74b6b42c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:41.297603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6ecc9-ad7e-407a-9293-6eb3d4964fb1 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:41.310742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364fd75-d2aa-4de0-b8ec-122ccbab276a tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:41.311800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364fd75-d2aa-4de0-b8ec-122ccbab276a tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:41.312477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364fd75-d2aa-4de0-b8ec-122ccbab276a tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:41.312761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364fd75-d2aa-4de0-b8ec-122ccbab276a tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/roles/4eb8af5bb3684f3eba70ade42fe635f4` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:41.316139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364fd75-d2aa-4de0-b8ec-122ccbab276a tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4eb8af5bb3684f3eba70ade42fe635f4)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:41.317781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364fd75-d2aa-4de0-b8ec-122ccbab276a tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:41.420591 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3082/6096] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:30:41.426522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35882b0-6933-4e28-a34d-ca74b6b42c87 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:41.441304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35882b0-6933-4e28-a34d-ca74b6b42c87 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:41.448425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984dafaf-0165-4024-b924-d77189631a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:41.455517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dafaf-0165-4024-b924-d77189631a07 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:41.455517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dafaf-0165-4024-b924-d77189631a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:41.455741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dafaf-0165-4024-b924-d77189631a07 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:41.456975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984dafaf-0165-4024-b924-d77189631a07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:30:41.457388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984dafaf-0165-4024-b924-d77189631a07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:41.459232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984dafaf-0165-4024-b924-d77189631a07 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:41.474260 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3083/6097] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:41.475051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0364fd75-d2aa-4de0-b8ec-122ccbab276a tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invalidating the token cache because role 4eb8af5bb3684f3eba70ade42fe635f4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:41.475486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0364fd75-d2aa-4de0-b8ec-122ccbab276a tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:41.476443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0364fd75-d2aa-4de0-b8ec-122ccbab276a tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:41.478584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984dafaf-0165-4024-b924-d77189631a07 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:41.482854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-984dafaf-0165-4024-b924-d77189631a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:41.490785 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3015/6098] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:41 2022] DELETE /identity/v3/roles/4eb8af5bb3684f3eba70ade42fe635f4 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:41.494410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364fd75-d2aa-4de0-b8ec-122ccbab276a tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:41.496867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984dafaf-0165-4024-b924-d77189631a07 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:41.502545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0364fd75-d2aa-4de0-b8ec-122ccbab276a tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:41.599924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364fd75-d2aa-4de0-b8ec-122ccbab276a tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:41.610589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddecb9-ec5e-4358-ac27-d3efc7e218ee tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:41.610589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddecb9-ec5e-4358-ac27-d3efc7e218ee tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:41.610589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddecb9-ec5e-4358-ac27-d3efc7e218ee tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:41.610871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddecb9-ec5e-4358-ac27-d3efc7e218ee tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains/f9d916cded1f4383b9e79dd3fdb0ecc9` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:41.610871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddecb9-ec5e-4358-ac27-d3efc7e218ee tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f9d916cded1f4383b9e79dd3fdb0ecc9)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:41.611770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddecb9-ec5e-4358-ac27-d3efc7e218ee tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:41.612375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207c59d-01a0-491e-a8ad-475c3f3682c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:41.613045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207c59d-01a0-491e-a8ad-475c3f3682c1 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:41.613336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207c59d-01a0-491e-a8ad-475c3f3682c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:41.613609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207c59d-01a0-491e-a8ad-475c3f3682c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:41.614299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207c59d-01a0-491e-a8ad-475c3f3682c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:41.616617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207c59d-01a0-491e-a8ad-475c3f3682c1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:41.640172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c5ddecb9-ec5e-4358-ac27-d3efc7e218ee tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f9d916cded1f4383b9e79dd3fdb0ecc9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:41.640921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c5ddecb9-ec5e-4358-ac27-d3efc7e218ee tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f9d916cded1f4383b9e79dd3fdb0ecc9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:41.732399 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3084/6099] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:41 2022] POST /identity/v3/projects => generated 359 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:41.732399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496baf63-0168-4dcd-b104-da5cce5f2a1e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:41.732399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496baf63-0168-4dcd-b104-da5cce5f2a1e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:41.732399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496baf63-0168-4dcd-b104-da5cce5f2a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:41.759890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-496baf63-0168-4dcd-b104-da5cce5f2a1e None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:41.759890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-496baf63-0168-4dcd-b104-da5cce5f2a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:41.765691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c5ddecb9-ec5e-4358-ac27-d3efc7e218ee tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f9d916cded1f4383b9e79dd3fdb0ecc9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:41.766571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c5ddecb9-ec5e-4358-ac27-d3efc7e218ee tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f9d916cded1f4383b9e79dd3fdb0ecc9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:41.770976 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3016/6100] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:30:41 2022] PATCH /identity/v3/domains/f9d916cded1f4383b9e79dd3fdb0ecc9 => generated 276 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:41.772249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddecb9-ec5e-4358-ac27-d3efc7e218ee tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:41.775609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c5ddecb9-ec5e-4358-ac27-d3efc7e218ee tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:41.880746 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3085/6101] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:30:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:41.886505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496baf63-0168-4dcd-b104-da5cce5f2a1e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:41.886505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-496baf63-0168-4dcd-b104-da5cce5f2a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:41.908810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddecb9-ec5e-4358-ac27-d3efc7e218ee tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:41.965568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496baf63-0168-4dcd-b104-da5cce5f2a1e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:41.971054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:41.976354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:41.976354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:41.976354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains/f9d916cded1f4383b9e79dd3fdb0ecc9` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:41.985224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25985a99-02d9-43d5-baac-0a5d7135ad1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:41.986082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25985a99-02d9-43d5-baac-0a5d7135ad1a admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:41.986467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25985a99-02d9-43d5-baac-0a5d7135ad1a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:41.987055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25985a99-02d9-43d5-baac-0a5d7135ad1a admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:41.987815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25985a99-02d9-43d5-baac-0a5d7135ad1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:41.989688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25985a99-02d9-43d5-baac-0a5d7135ad1a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:41.991192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f9d916cded1f4383b9e79dd3fdb0ecc9)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:41.995862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:42.027888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f9d916cded1f4383b9e79dd3fdb0ecc9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:42.058211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f9d916cded1f4383b9e79dd3fdb0ecc9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:42.202831 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3017/6102] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:41 2022] POST /identity/v3/users => generated 280 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:42.202831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25985a99-02d9-43d5-baac-0a5d7135ad1a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:42.202831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-25985a99-02d9-43d5-baac-0a5d7135ad1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:42.239306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9d916cded1f4383b9e79dd3fdb0ecc9', 'request_id': 'req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:42.247339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9d916cded1f4383b9e79dd3fdb0ecc9', 'request_id': 'req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:42.268026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9d916cded1f4383b9e79dd3fdb0ecc9', 'request_id': 'req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:42.280234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:42.318110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25985a99-02d9-43d5-baac-0a5d7135ad1a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:42.362814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=95,keystone:UPDATE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:42.371144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] The token cache is being invalidate because project f9d916cded1f4383b9e79dd3fdb0ecc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:42.371144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:42.372507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:42.385636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f9d916cded1f4383b9e79dd3fdb0ecc9', 'request_id': 'req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:42.392264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f9d916cded1f4383b9e79dd3fdb0ecc9', 'request_id': 'req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:42.399353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f9d916cded1f4383b9e79dd3fdb0ecc9', 'request_id': 'req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:42.401218 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3086/6103] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:30:41 2022] DELETE /identity/v3/domains/f9d916cded1f4383b9e79dd3fdb0ecc9 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:42.402117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:42.403712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:42.422210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfb04f-590b-4b9c-8b8c-0b495f5a360e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:42.422943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfb04f-590b-4b9c-8b8c-0b495f5a360e service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:42.423268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfb04f-590b-4b9c-8b8c-0b495f5a360e service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:42.426760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfb04f-590b-4b9c-8b8c-0b495f5a360e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:42.426760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e8dfb04f-590b-4b9c-8b8c-0b495f5a360e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:42.481499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd405d-9ba6-45ee-9f8b-bb2b11771554 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:42.490915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521786f2-cea7-4ff2-b0b0-82af781b7726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:42.496462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521786f2-cea7-4ff2-b0b0-82af781b7726 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:42.496462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521786f2-cea7-4ff2-b0b0-82af781b7726 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:42.496462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521786f2-cea7-4ff2-b0b0-82af781b7726 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:42.496462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521786f2-cea7-4ff2-b0b0-82af781b7726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:42.496462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521786f2-cea7-4ff2-b0b0-82af781b7726 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:42.519068 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3087/6104] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:42 2022] GET /identity/v3/roles => generated 2109 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:42.519068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521786f2-cea7-4ff2-b0b0-82af781b7726 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:42.519580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-521786f2-cea7-4ff2-b0b0-82af781b7726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:42.534353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfb04f-590b-4b9c-8b8c-0b495f5a360e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:42.537100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfb04f-590b-4b9c-8b8c-0b495f5a360e service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:42.565109 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3018/6105] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:30:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:30:42.566271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfb04f-590b-4b9c-8b8c-0b495f5a360e service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:42.599028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfb04f-590b-4b9c-8b8c-0b495f5a360e service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:42.605503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5d2c1-c2a1-4eb0-bf51-2f0affc22a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:42.637967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5d2c1-c2a1-4eb0-bf51-2f0affc22a74 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:42.638420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5d2c1-c2a1-4eb0-bf51-2f0affc22a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:42.638716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5d2c1-c2a1-4eb0-bf51-2f0affc22a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:42.639542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5d2c1-c2a1-4eb0-bf51-2f0affc22a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:42.641189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5d2c1-c2a1-4eb0-bf51-2f0affc22a74 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:42.645206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521786f2-cea7-4ff2-b0b0-82af781b7726 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:42.650654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d9243-ed6f-4dea-a8d0-dfeeb48cac19 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:42.651705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d9243-ed6f-4dea-a8d0-dfeeb48cac19 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:42.652038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d9243-ed6f-4dea-a8d0-dfeeb48cac19 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:42.652242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d9243-ed6f-4dea-a8d0-dfeeb48cac19 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains/d73835de813e488d8cf4f2da68df307f/users/136fc4f978ef4d4890f4fa15469d678b/roles/df522615270b44e4b7662ba6ddc694ec` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:42.655130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d9243-ed6f-4dea-a8d0-dfeeb48cac19 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=d73835de813e488d8cf4f2da68df307f, user_id=136fc4f978ef4d4890f4fa15469d678b, role_id=df522615270b44e4b7662ba6ddc694ec)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:42.657957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d9243-ed6f-4dea-a8d0-dfeeb48cac19 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:42.667481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e40d9243-ed6f-4dea-a8d0-dfeeb48cac19 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invalidating the token cache because role df522615270b44e4b7662ba6ddc694ec was removed from user 136fc4f978ef4d4890f4fa15469d678b on domain d73835de813e488d8cf4f2da68df307f. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:42.667744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e40d9243-ed6f-4dea-a8d0-dfeeb48cac19 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:42.677649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e40d9243-ed6f-4dea-a8d0-dfeeb48cac19 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:42.693840 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3019/6106] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:42 2022] GET /identity/v3/roles => generated 2109 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:42.698188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5d2c1-c2a1-4eb0-bf51-2f0affc22a74 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:42.708343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-36e5d2c1-c2a1-4eb0-bf51-2f0affc22a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:42.733730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5d2c1-c2a1-4eb0-bf51-2f0affc22a74 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:42.741419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1f314-8911-4b08-bcad-691486bb20ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:42.746669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1f314-8911-4b08-bcad-691486bb20ae admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:42.746669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1f314-8911-4b08-bcad-691486bb20ae admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:42.746669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1f314-8911-4b08-bcad-691486bb20ae admin admin] PATH_INFO: `/v3/projects/7fbdb1046a124c898f5026e9bcc3564d/users/4b8f5ad324ff4bb1aaba273ba83fccd5/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:42.768117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1f314-8911-4b08-bcad-691486bb20ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fbdb1046a124c898f5026e9bcc3564d, user_id=4b8f5ad324ff4bb1aaba273ba83fccd5, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:42.772202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1f314-8911-4b08-bcad-691486bb20ae admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:42.789092 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3088/6107] 10.222.0.16 () {58 vars in 1463 bytes} [Sat Jul 16 21:30:42 2022] DELETE /identity/v3/domains/d73835de813e488d8cf4f2da68df307f/users/136fc4f978ef4d4890f4fa15469d678b/roles/df522615270b44e4b7662ba6ddc694ec => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:42.794073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d9243-ed6f-4dea-a8d0-dfeeb48cac19 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:42.795554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e40d9243-ed6f-4dea-a8d0-dfeeb48cac19 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:42.878609 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3020/6108] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:42 2022] PUT /identity/v3/projects/7fbdb1046a124c898f5026e9bcc3564d/users/4b8f5ad324ff4bb1aaba273ba83fccd5/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:42.885175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d9243-ed6f-4dea-a8d0-dfeeb48cac19 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:42.890466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d818d3a-59f5-4bda-ad6e-4462c0b77798 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:42.890785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d818d3a-59f5-4bda-ad6e-4462c0b77798 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:42.891059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d818d3a-59f5-4bda-ad6e-4462c0b77798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:42.958534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8d818d3a-59f5-4bda-ad6e-4462c0b77798 None None] MFA Rules not processed for user `4b8f5ad324ff4bb1aaba273ba83fccd5`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:42.960284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8d818d3a-59f5-4bda-ad6e-4462c0b77798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:43.028354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338bd2e-3611-4e95-be84-ecfdbb11714c tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:43.029282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338bd2e-3611-4e95-be84-ecfdbb11714c tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:43.029578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338bd2e-3611-4e95-be84-ecfdbb11714c tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:43.029836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338bd2e-3611-4e95-be84-ecfdbb11714c tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/roles/df522615270b44e4b7662ba6ddc694ec` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:43.031673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338bd2e-3611-4e95-be84-ecfdbb11714c tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:delete_role(role_id=df522615270b44e4b7662ba6ddc694ec)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:43.033288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338bd2e-3611-4e95-be84-ecfdbb11714c tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:43.053766 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3021/6109] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:42 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:43.055992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36895f69-ddb3-4c5a-91ff-b71c553606fe None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:43.056373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36895f69-ddb3-4c5a-91ff-b71c553606fe None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:43.056965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36895f69-ddb3-4c5a-91ff-b71c553606fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:43.074315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-36895f69-ddb3-4c5a-91ff-b71c553606fe None None] MFA Rules not processed for user `4b8f5ad324ff4bb1aaba273ba83fccd5`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:43.075568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-36895f69-ddb3-4c5a-91ff-b71c553606fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:43.079157 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3022/6110] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:43 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 21:30:43.084392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eff0c0-da67-486e-a83e-a52586cdec05 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:43.084747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eff0c0-da67-486e-a83e-a52586cdec05 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:43.085031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eff0c0-da67-486e-a83e-a52586cdec05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:43.111333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-07eff0c0-da67-486e-a83e-a52586cdec05 None None] MFA Rules not processed for user `4b8f5ad324ff4bb1aaba273ba83fccd5`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:43.113159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-07eff0c0-da67-486e-a83e-a52586cdec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:43.121391 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3023/6111] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:43 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 16 21:30:43.126164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eff0c0-da67-486e-a83e-a52586cdec05 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:43.139386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eff0c0-da67-486e-a83e-a52586cdec05 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:43.144803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a7521-5d82-416a-b4c1-7ef148ab71f4 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b8f5ad324ff4bb1aaba273ba83fccd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fbdb1046a124c898f5026e9bcc3564d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:43.145463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a7521-5d82-416a-b4c1-7ef148ab71f4 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] REQUEST_METHOD: `HEAD` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:43.145747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a7521-5d82-416a-b4c1-7ef148ab71f4 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:43.146025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a7521-5d82-416a-b4c1-7ef148ab71f4 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:43.154125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a7521-5d82-416a-b4c1-7ef148ab71f4 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] RBAC: Authorizing `identity:check_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:43.155952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a7521-5d82-416a-b4c1-7ef148ab71f4 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:43.162576 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3024/6112] 10.222.0.16 () {56 vars in 1263 bytes} [Sat Jul 16 21:30:43 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Jul 16 21:30:43.167621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a7521-5d82-416a-b4c1-7ef148ab71f4 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:43.168976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a338bd2e-3611-4e95-be84-ecfdbb11714c tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invalidating the token cache because role df522615270b44e4b7662ba6ddc694ec has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:43.169318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a338bd2e-3611-4e95-be84-ecfdbb11714c tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:43.170130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a338bd2e-3611-4e95-be84-ecfdbb11714c tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:43.174282 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3089/6113] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:42 2022] DELETE /identity/v3/roles/df522615270b44e4b7662ba6ddc694ec => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:43.180388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338bd2e-3611-4e95-be84-ecfdbb11714c tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:43.182478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a338bd2e-3611-4e95-be84-ecfdbb11714c tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:43.183629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a7521-5d82-416a-b4c1-7ef148ab71f4 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:43.261093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea325019-df73-46fa-9951-6d7bf846df84 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b8f5ad324ff4bb1aaba273ba83fccd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fbdb1046a124c898f5026e9bcc3564d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:43.262497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea325019-df73-46fa-9951-6d7bf846df84 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:43.262783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea325019-df73-46fa-9951-6d7bf846df84 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:43.263151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea325019-df73-46fa-9951-6d7bf846df84 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:43.265868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ea325019-df73-46fa-9951-6d7bf846df84 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:43.275261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea325019-df73-46fa-9951-6d7bf846df84 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:43.276123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338bd2e-3611-4e95-be84-ecfdbb11714c tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:43.276931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea325019-df73-46fa-9951-6d7bf846df84 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:43.281015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58c0e2-3632-4623-98c6-9756d5e1d473 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:43.281910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58c0e2-3632-4623-98c6-9756d5e1d473 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:43.282191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58c0e2-3632-4623-98c6-9756d5e1d473 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:43.282470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58c0e2-3632-4623-98c6-9756d5e1d473 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains/d73835de813e488d8cf4f2da68df307f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:43.283961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58c0e2-3632-4623-98c6-9756d5e1d473 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d73835de813e488d8cf4f2da68df307f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:43.287081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58c0e2-3632-4623-98c6-9756d5e1d473 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:43.287222 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3025/6114] 10.222.0.16 () {56 vars in 1262 bytes} [Sat Jul 16 21:30:43 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 16 21:30:43.291171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea325019-df73-46fa-9951-6d7bf846df84 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:43.292573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ea325019-df73-46fa-9951-6d7bf846df84 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:43.305223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea325019-df73-46fa-9951-6d7bf846df84 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:43.310915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b29804-377c-4e4c-b500-727d27f0fa5c tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b8f5ad324ff4bb1aaba273ba83fccd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fbdb1046a124c898f5026e9bcc3564d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:43.311171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0c58c0e2-3632-4623-98c6-9756d5e1d473 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd73835de813e488d8cf4f2da68df307f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:43.311606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b29804-377c-4e4c-b500-727d27f0fa5c tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:43.311963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0c58c0e2-3632-4623-98c6-9756d5e1d473 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd73835de813e488d8cf4f2da68df307f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:43.312079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b29804-377c-4e4c-b500-727d27f0fa5c tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:43.312337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b29804-377c-4e4c-b500-727d27f0fa5c tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:43.314293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-02b29804-377c-4e4c-b500-727d27f0fa5c tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:43.322365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b29804-377c-4e4c-b500-727d27f0fa5c tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:43.324064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b29804-377c-4e4c-b500-727d27f0fa5c tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:43.420936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0c58c0e2-3632-4623-98c6-9756d5e1d473 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd73835de813e488d8cf4f2da68df307f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:43.421656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0c58c0e2-3632-4623-98c6-9756d5e1d473 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd73835de813e488d8cf4f2da68df307f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:43.424756 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3090/6115] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:30:43 2022] PATCH /identity/v3/domains/d73835de813e488d8cf4f2da68df307f => generated 278 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:43.428802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58c0e2-3632-4623-98c6-9756d5e1d473 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:43.431591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0c58c0e2-3632-4623-98c6-9756d5e1d473 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:43.437242 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3026/6116] 10.222.0.16 () {56 vars in 1265 bytes} [Sat Jul 16 21:30:43 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:43.440396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b29804-377c-4e4c-b500-727d27f0fa5c tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:43.442014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-02b29804-377c-4e4c-b500-727d27f0fa5c tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:43.460319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b29804-377c-4e4c-b500-727d27f0fa5c tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:43.531208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58c0e2-3632-4623-98c6-9756d5e1d473 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:43.538160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5a72d-a7f8-439c-823f-dd07d4ad5525 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:43.539595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5a72d-a7f8-439c-823f-dd07d4ad5525 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:43.540237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5a72d-a7f8-439c-823f-dd07d4ad5525 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:43.543279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5a72d-a7f8-439c-823f-dd07d4ad5525 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains/d73835de813e488d8cf4f2da68df307f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:43.547561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a59de-d2e2-4f40-ba02-3ae3ecdc2319 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b8f5ad324ff4bb1aaba273ba83fccd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fbdb1046a124c898f5026e9bcc3564d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:43.552166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a59de-d2e2-4f40-ba02-3ae3ecdc2319 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] REQUEST_METHOD: `HEAD` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:43.552166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a59de-d2e2-4f40-ba02-3ae3ecdc2319 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:43.552166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a59de-d2e2-4f40-ba02-3ae3ecdc2319 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:43.555337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d10a59de-d2e2-4f40-ba02-3ae3ecdc2319 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:43.561419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5a72d-a7f8-439c-823f-dd07d4ad5525 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d73835de813e488d8cf4f2da68df307f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:43.562611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5a72d-a7f8-439c-823f-dd07d4ad5525 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:43.589564 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-d10a59de-d2e2-4f40-ba02-3ae3ecdc2319 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 16 21:30:43.589564 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:30:43.589564 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:30:43.589564 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:30:43.589564 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:30:43.589564 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:30:43.589564 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:30:43.589564 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:30:43.589564 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:30:43.589564 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:30:43.589564 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:30:43.589564 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:30:43.589564 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Jul 16 21:30:43.589564 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Jul 16 21:30:43.589564 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 16 21:30:43.590841 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 16 21:30:43.590841 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 16 21:30:43.590841 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 16 21:30:43.590841 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:30:43.590841 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:30:43.590841 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 16 21:30:43.590841 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 16 21:30:43.590841 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 16 21:30:43.590841 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 16 21:30:43.590841 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:30:43.590841 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:30:43.590841 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 16 21:30:43.590841 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 16 21:30:43.590841 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:30:43.590841 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:30:43.590841 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 16 21:30:43.590841 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 16 21:30:43.592007 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:30:43.592007 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:30:43.592007 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 16 21:30:43.592007 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 16 21:30:43.592007 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 16 21:30:43.592007 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:30:43.592007 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3027/6117] 10.222.0.16 () {56 vars in 1263 bytes} [Sat Jul 16 21:30:43 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Jul 16 21:30:43.603058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa157cf9-c05a-4b67-97e0-6d2ac01cd7c0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:43.603358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa157cf9-c05a-4b67-97e0-6d2ac01cd7c0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:43.603643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa157cf9-c05a-4b67-97e0-6d2ac01cd7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:43.607808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-82c5a72d-a7f8-439c-823f-dd07d4ad5525 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd73835de813e488d8cf4f2da68df307f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:43.620281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-82c5a72d-a7f8-439c-823f-dd07d4ad5525 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd73835de813e488d8cf4f2da68df307f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:43.627593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-aa157cf9-c05a-4b67-97e0-6d2ac01cd7c0 None None] MFA Rules not processed for user `4b8f5ad324ff4bb1aaba273ba83fccd5`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:43.629437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-aa157cf9-c05a-4b67-97e0-6d2ac01cd7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:43.633773 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3028/6118] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:43 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 21:30:43.639149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa157cf9-c05a-4b67-97e0-6d2ac01cd7c0 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:43.643862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-aa157cf9-c05a-4b67-97e0-6d2ac01cd7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:43.659981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa157cf9-c05a-4b67-97e0-6d2ac01cd7c0 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:43.665473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9615fd6-d870-4cd3-b92c-69facb9ef636 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b8f5ad324ff4bb1aaba273ba83fccd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fbdb1046a124c898f5026e9bcc3564d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:43.666677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9615fd6-d870-4cd3-b92c-69facb9ef636 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:43.667412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9615fd6-d870-4cd3-b92c-69facb9ef636 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:43.667412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9615fd6-d870-4cd3-b92c-69facb9ef636 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:43.678522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9615fd6-d870-4cd3-b92c-69facb9ef636 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:43.681107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9615fd6-d870-4cd3-b92c-69facb9ef636 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:43.690531 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3029/6119] 10.222.0.16 () {56 vars in 1262 bytes} [Sat Jul 16 21:30:43 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 16 21:30:43.694746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9615fd6-d870-4cd3-b92c-69facb9ef636 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:43.704687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9615fd6-d870-4cd3-b92c-69facb9ef636 tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:43.710714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c60c9-d97e-4085-8269-7d44824855ed tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b8f5ad324ff4bb1aaba273ba83fccd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fbdb1046a124c898f5026e9bcc3564d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:43.710714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c60c9-d97e-4085-8269-7d44824855ed tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:43.710714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c60c9-d97e-4085-8269-7d44824855ed tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:43.711084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c60c9-d97e-4085-8269-7d44824855ed tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:43.720742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c60c9-d97e-4085-8269-7d44824855ed tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:43.722301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c60c9-d97e-4085-8269-7d44824855ed tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:43.751473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-82c5a72d-a7f8-439c-823f-dd07d4ad5525 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd73835de813e488d8cf4f2da68df307f', 'request_id': 'req-82c5a72d-a7f8-439c-823f-dd07d4ad5525'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:43.759072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-82c5a72d-a7f8-439c-823f-dd07d4ad5525 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd73835de813e488d8cf4f2da68df307f', 'request_id': 'req-82c5a72d-a7f8-439c-823f-dd07d4ad5525'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:43.764961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-82c5a72d-a7f8-439c-823f-dd07d4ad5525 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd73835de813e488d8cf4f2da68df307f', 'request_id': 'req-82c5a72d-a7f8-439c-823f-dd07d4ad5525'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:43.816928 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3030/6120] 10.222.0.16 () {56 vars in 1265 bytes} [Sat Jul 16 21:30:43 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:43.818469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c60c9-d97e-4085-8269-7d44824855ed tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:43.847771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c60c9-d97e-4085-8269-7d44824855ed tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:43.926090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-82c5a72d-a7f8-439c-823f-dd07d4ad5525 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] The token cache is being invalidate because project d73835de813e488d8cf4f2da68df307f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:43.926651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-82c5a72d-a7f8-439c-823f-dd07d4ad5525 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:43.927604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-82c5a72d-a7f8-439c-823f-dd07d4ad5525 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:43.951668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-82c5a72d-a7f8-439c-823f-dd07d4ad5525 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd73835de813e488d8cf4f2da68df307f', 'request_id': 'req-82c5a72d-a7f8-439c-823f-dd07d4ad5525'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:43.965610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac54db-6219-4f86-9d31-1fedfe78a59e tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b8f5ad324ff4bb1aaba273ba83fccd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fbdb1046a124c898f5026e9bcc3564d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:43.966291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac54db-6219-4f86-9d31-1fedfe78a59e tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:43.966575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac54db-6219-4f86-9d31-1fedfe78a59e tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:43.966852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac54db-6219-4f86-9d31-1fedfe78a59e tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:43.969184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-82c5a72d-a7f8-439c-823f-dd07d4ad5525 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd73835de813e488d8cf4f2da68df307f', 'request_id': 'req-82c5a72d-a7f8-439c-823f-dd07d4ad5525'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:43.970113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-82c5a72d-a7f8-439c-823f-dd07d4ad5525 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd73835de813e488d8cf4f2da68df307f', 'request_id': 'req-82c5a72d-a7f8-439c-823f-dd07d4ad5525'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:43.972333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3eac54db-6219-4f86-9d31-1fedfe78a59e tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:43.986493 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3091/6121] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:30:43 2022] DELETE /identity/v3/domains/d73835de813e488d8cf4f2da68df307f => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:43.987642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5a72d-a7f8-439c-823f-dd07d4ad5525 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:43.989193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-82c5a72d-a7f8-439c-823f-dd07d4ad5525 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:44.004444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-3eac54db-6219-4f86-9d31-1fedfe78a59e tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 16 21:30:44.004444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:30:44.004444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:30:44.004444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:30:44.004444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:30:44.004444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:30:44.004444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:30:44.004444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:30:44.004444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:30:44.004444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:30:44.004444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:30:44.004444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:30:44.004444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jul 16 21:30:44.004444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jul 16 21:30:44.004444 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 16 21:30:44.005667 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 16 21:30:44.005667 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 16 21:30:44.005667 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 16 21:30:44.005667 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:30:44.005667 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:30:44.005667 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 16 21:30:44.005667 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 16 21:30:44.005667 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 16 21:30:44.005667 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 16 21:30:44.005667 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:30:44.005667 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:30:44.005667 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 16 21:30:44.005667 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 16 21:30:44.005667 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:30:44.005667 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:30:44.005667 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 16 21:30:44.005667 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 16 21:30:44.007182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:30:44.007182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:30:44.007182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 16 21:30:44.007182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 16 21:30:44.007182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 16 21:30:44.007182 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:30:44.016127 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3031/6122] 10.222.0.16 () {56 vars in 1262 bytes} [Sat Jul 16 21:30:43 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 16 21:30:44.017048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac54db-6219-4f86-9d31-1fedfe78a59e tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:44.018911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3eac54db-6219-4f86-9d31-1fedfe78a59e tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:44.068912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5a72d-a7f8-439c-823f-dd07d4ad5525 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:44.076790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3c797-805c-4e21-81cc-aca6dc037dea tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:44.078217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c797-805c-4e21-81cc-aca6dc037dea tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:44.079161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c797-805c-4e21-81cc-aca6dc037dea tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:44.080063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c797-805c-4e21-81cc-aca6dc037dea tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains/a2724557a017425b92a4caac86ada08e/groups/38f485ed86f844ef82dd09c2311b41e0/roles/c241db24c09c42b0b5eaaca129b7095e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:44.086643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3c797-805c-4e21-81cc-aca6dc037dea tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a2724557a017425b92a4caac86ada08e, group_id=38f485ed86f844ef82dd09c2311b41e0, role_id=c241db24c09c42b0b5eaaca129b7095e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:44.089976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3c797-805c-4e21-81cc-aca6dc037dea tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:44.098727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-33c3c797-805c-4e21-81cc-aca6dc037dea tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invalidating the token cache because role c241db24c09c42b0b5eaaca129b7095e was removed from group 38f485ed86f844ef82dd09c2311b41e0 on domain a2724557a017425b92a4caac86ada08e. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:44.099344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-33c3c797-805c-4e21-81cc-aca6dc037dea tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:44.101638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-33c3c797-805c-4e21-81cc-aca6dc037dea tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:44.127245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac54db-6219-4f86-9d31-1fedfe78a59e tempest-TokensV3Test-914055447 tempest-TokensV3Test-914055447-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:44.132366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c43f3-8787-44dc-a479-19d14eac01ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:44.133875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c43f3-8787-44dc-a479-19d14eac01ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:44.134358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c43f3-8787-44dc-a479-19d14eac01ee admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:44.134799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c43f3-8787-44dc-a479-19d14eac01ee admin admin] PATH_INFO: `/v3/users/4b8f5ad324ff4bb1aaba273ba83fccd5` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:44.136142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c43f3-8787-44dc-a479-19d14eac01ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b8f5ad324ff4bb1aaba273ba83fccd5)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:44.138265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c43f3-8787-44dc-a479-19d14eac01ee admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:44.215332 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3092/6123] 10.222.0.16 () {58 vars in 1466 bytes} [Sat Jul 16 21:30:43 2022] DELETE /identity/v3/domains/a2724557a017425b92a4caac86ada08e/groups/38f485ed86f844ef82dd09c2311b41e0/roles/c241db24c09c42b0b5eaaca129b7095e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:44.219600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3c797-805c-4e21-81cc-aca6dc037dea tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:44.220988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-33c3c797-805c-4e21-81cc-aca6dc037dea tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:44.321214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3c797-805c-4e21-81cc-aca6dc037dea tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:44.333216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d558d05-29d6-4859-8c58-d24e344ae49e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:44.340473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d558d05-29d6-4859-8c58-d24e344ae49e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:44.340850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d558d05-29d6-4859-8c58-d24e344ae49e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:44.341222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d558d05-29d6-4859-8c58-d24e344ae49e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/groups/38f485ed86f844ef82dd09c2311b41e0/users/136fc4f978ef4d4890f4fa15469d678b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:44.343292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d558d05-29d6-4859-8c58-d24e344ae49e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=38f485ed86f844ef82dd09c2311b41e0, user_id=136fc4f978ef4d4890f4fa15469d678b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:44.346479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d558d05-29d6-4859-8c58-d24e344ae49e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:44.439070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6d558d05-29d6-4859-8c58-d24e344ae49e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '136fc4f978ef4d4890f4fa15469d678b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:44.454963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0a5c43f3-8787-44dc-a479-19d14eac01ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b8f5ad324ff4bb1aaba273ba83fccd5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:44.469498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0a5c43f3-8787-44dc-a479-19d14eac01ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b8f5ad324ff4bb1aaba273ba83fccd5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:44.554202 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3093/6124] 10.222.0.16 () {58 vars in 1343 bytes} [Sat Jul 16 21:30:44 2022] DELETE /identity/v3/groups/38f485ed86f844ef82dd09c2311b41e0/users/136fc4f978ef4d4890f4fa15469d678b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:44.558371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d558d05-29d6-4859-8c58-d24e344ae49e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:44.625537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d558d05-29d6-4859-8c58-d24e344ae49e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:44.630532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a67e89-3f30-4411-81fa-8df9f0021385 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:44.631435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a67e89-3f30-4411-81fa-8df9f0021385 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:44.631721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a67e89-3f30-4411-81fa-8df9f0021385 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:44.632148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a67e89-3f30-4411-81fa-8df9f0021385 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/groups/38f485ed86f844ef82dd09c2311b41e0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:44.634070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a67e89-3f30-4411-81fa-8df9f0021385 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:delete_group(group_id=38f485ed86f844ef82dd09c2311b41e0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:44.636117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a67e89-3f30-4411-81fa-8df9f0021385 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:44.656930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0a5c43f3-8787-44dc-a479-19d14eac01ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b8f5ad324ff4bb1aaba273ba83fccd5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:44.667530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0a5c43f3-8787-44dc-a479-19d14eac01ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b8f5ad324ff4bb1aaba273ba83fccd5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:44.668585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0a5c43f3-8787-44dc-a479-19d14eac01ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b8f5ad324ff4bb1aaba273ba83fccd5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:44.679680 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3032/6125] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:44 2022] DELETE /identity/v3/users/4b8f5ad324ff4bb1aaba273ba83fccd5 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:44.685652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510d964-fbf7-4cf4-9a2f-994e18ee2476 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:44.686025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510d964-fbf7-4cf4-9a2f-994e18ee2476 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:44.686399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510d964-fbf7-4cf4-9a2f-994e18ee2476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:44.710821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d510d964-fbf7-4cf4-9a2f-994e18ee2476 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:44.710821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d510d964-fbf7-4cf4-9a2f-994e18ee2476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:44.798891 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3033/6126] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:44.800251 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3094/6127] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Jul 16 21:30:44 2022] DELETE /identity/v3/groups/38f485ed86f844ef82dd09c2311b41e0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:44.804177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510d964-fbf7-4cf4-9a2f-994e18ee2476 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:44.806423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d510d964-fbf7-4cf4-9a2f-994e18ee2476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:44.811514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a67e89-3f30-4411-81fa-8df9f0021385 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:44.816895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d2a67e89-3f30-4411-81fa-8df9f0021385 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:44.872910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:44.896437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a67e89-3f30-4411-81fa-8df9f0021385 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:44.902437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e9b41-f2cf-4803-8a77-bc3a825ed331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:44.903477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e9b41-f2cf-4803-8a77-bc3a825ed331 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:44.903761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e9b41-f2cf-4803-8a77-bc3a825ed331 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:44.904292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e9b41-f2cf-4803-8a77-bc3a825ed331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:44.905936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510d964-fbf7-4cf4-9a2f-994e18ee2476 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:44.954889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:44.974141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945d0c6-5aae-476f-9628-dd59a6c72f53 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:44.977897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945d0c6-5aae-476f-9628-dd59a6c72f53 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:44.977897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945d0c6-5aae-476f-9628-dd59a6c72f53 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:44.977897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945d0c6-5aae-476f-9628-dd59a6c72f53 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/roles/c241db24c09c42b0b5eaaca129b7095e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:44.978379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945d0c6-5aae-476f-9628-dd59a6c72f53 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c241db24c09c42b0b5eaaca129b7095e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:44.980952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945d0c6-5aae-476f-9628-dd59a6c72f53 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:44.982132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e9b41-f2cf-4803-8a77-bc3a825ed331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:44.983730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e9b41-f2cf-4803-8a77-bc3a825ed331 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:44.996790 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3095/6128] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:30:45.120752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c945d0c6-5aae-476f-9628-dd59a6c72f53 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invalidating the token cache because role c241db24c09c42b0b5eaaca129b7095e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:45.120979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c945d0c6-5aae-476f-9628-dd59a6c72f53 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:45.121927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c945d0c6-5aae-476f-9628-dd59a6c72f53 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:45.124981 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3034/6129] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:44 2022] DELETE /identity/v3/roles/c241db24c09c42b0b5eaaca129b7095e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:45.129156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e9b41-f2cf-4803-8a77-bc3a825ed331 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:45.150315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e9b41-f2cf-4803-8a77-bc3a825ed331 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:45.224087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8fd29-b118-47ef-b376-90f3ce1b5cd0 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:45.225058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8fd29-b118-47ef-b376-90f3ce1b5cd0 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:45.225411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8fd29-b118-47ef-b376-90f3ce1b5cd0 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:45.225771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8fd29-b118-47ef-b376-90f3ce1b5cd0 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains/a2724557a017425b92a4caac86ada08e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:45.227395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8fd29-b118-47ef-b376-90f3ce1b5cd0 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a2724557a017425b92a4caac86ada08e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:45.229062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8fd29-b118-47ef-b376-90f3ce1b5cd0 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:45.249744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-08f8fd29-b118-47ef-b376-90f3ce1b5cd0 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a2724557a017425b92a4caac86ada08e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:45.250474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-08f8fd29-b118-47ef-b376-90f3ce1b5cd0 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a2724557a017425b92a4caac86ada08e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:45.374211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-08f8fd29-b118-47ef-b376-90f3ce1b5cd0 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a2724557a017425b92a4caac86ada08e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:45.375295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-08f8fd29-b118-47ef-b376-90f3ce1b5cd0 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a2724557a017425b92a4caac86ada08e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:45.382902 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3096/6130] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:30:45 2022] PATCH /identity/v3/domains/a2724557a017425b92a4caac86ada08e => generated 278 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:45.384990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945d0c6-5aae-476f-9628-dd59a6c72f53 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:45.387332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c945d0c6-5aae-476f-9628-dd59a6c72f53 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:45.404794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945d0c6-5aae-476f-9628-dd59a6c72f53 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:45.481122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f28597-5160-450e-95da-8684a71135db tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:45.488848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f28597-5160-450e-95da-8684a71135db tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:45.488848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f28597-5160-450e-95da-8684a71135db tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:45.488848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f28597-5160-450e-95da-8684a71135db tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains/a2724557a017425b92a4caac86ada08e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:45.499775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f28597-5160-450e-95da-8684a71135db tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a2724557a017425b92a4caac86ada08e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:45.501509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f28597-5160-450e-95da-8684a71135db tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:45.530105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0f28597-5160-450e-95da-8684a71135db tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a2724557a017425b92a4caac86ada08e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:45.543290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0f28597-5160-450e-95da-8684a71135db tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a2724557a017425b92a4caac86ada08e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:45.698007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0f28597-5160-450e-95da-8684a71135db tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2724557a017425b92a4caac86ada08e', 'request_id': 'req-b0f28597-5160-450e-95da-8684a71135db'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:45.704982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0f28597-5160-450e-95da-8684a71135db tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2724557a017425b92a4caac86ada08e', 'request_id': 'req-b0f28597-5160-450e-95da-8684a71135db'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:45.719672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0f28597-5160-450e-95da-8684a71135db tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2724557a017425b92a4caac86ada08e', 'request_id': 'req-b0f28597-5160-450e-95da-8684a71135db'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:45.821404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0f28597-5160-450e-95da-8684a71135db tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] The token cache is being invalidate because project a2724557a017425b92a4caac86ada08e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:45.822613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0f28597-5160-450e-95da-8684a71135db tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:45.823768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0f28597-5160-450e-95da-8684a71135db tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:45.834289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0f28597-5160-450e-95da-8684a71135db tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a2724557a017425b92a4caac86ada08e', 'request_id': 'req-b0f28597-5160-450e-95da-8684a71135db'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:45.839548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0f28597-5160-450e-95da-8684a71135db tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a2724557a017425b92a4caac86ada08e', 'request_id': 'req-b0f28597-5160-450e-95da-8684a71135db'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:45.839548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0f28597-5160-450e-95da-8684a71135db tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a2724557a017425b92a4caac86ada08e', 'request_id': 'req-b0f28597-5160-450e-95da-8684a71135db'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:45.848824 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3035/6131] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:30:45 2022] DELETE /identity/v3/domains/a2724557a017425b92a4caac86ada08e => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:45.853103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8fd29-b118-47ef-b376-90f3ce1b5cd0 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:45.855002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-08f8fd29-b118-47ef-b376-90f3ce1b5cd0 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:45.877419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8fd29-b118-47ef-b376-90f3ce1b5cd0 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:45.938632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ed96f-2fbf-450e-af83-aa979aff2fd7 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:45.939487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ed96f-2fbf-450e-af83-aa979aff2fd7 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:45.939785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ed96f-2fbf-450e-af83-aa979aff2fd7 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:45.940067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ed96f-2fbf-450e-af83-aa979aff2fd7 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains/d5597425d2e246189aee0edfa95627a6/users/136fc4f978ef4d4890f4fa15469d678b/roles/c0d7df8111f245f5858fd0d694956e91` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:45.942633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ed96f-2fbf-450e-af83-aa979aff2fd7 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=d5597425d2e246189aee0edfa95627a6, user_id=136fc4f978ef4d4890f4fa15469d678b, role_id=c0d7df8111f245f5858fd0d694956e91)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:45.946139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ed96f-2fbf-450e-af83-aa979aff2fd7 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:45.955973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d23ed96f-2fbf-450e-af83-aa979aff2fd7 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invalidating the token cache because role c0d7df8111f245f5858fd0d694956e91 was removed from user 136fc4f978ef4d4890f4fa15469d678b on domain d5597425d2e246189aee0edfa95627a6. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:45.956686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f28597-5160-450e-95da-8684a71135db tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:45.957326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d23ed96f-2fbf-450e-af83-aa979aff2fd7 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:45.958156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b0f28597-5160-450e-95da-8684a71135db tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:45.960354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d23ed96f-2fbf-450e-af83-aa979aff2fd7 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:46.042990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f28597-5160-450e-95da-8684a71135db tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:46.048019 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725ec03-8281-4bc1-9498-33145e011096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:46.049002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725ec03-8281-4bc1-9498-33145e011096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:46.049311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725ec03-8281-4bc1-9498-33145e011096 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:46.049587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725ec03-8281-4bc1-9498-33145e011096 admin admin] PATH_INFO: `/v3/projects/7fbdb1046a124c898f5026e9bcc3564d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:46.050818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725ec03-8281-4bc1-9498-33145e011096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fbdb1046a124c898f5026e9bcc3564d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:46.052864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725ec03-8281-4bc1-9498-33145e011096 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:46.080189 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3097/6132] 10.222.0.16 () {58 vars in 1463 bytes} [Sat Jul 16 21:30:45 2022] DELETE /identity/v3/domains/d5597425d2e246189aee0edfa95627a6/users/136fc4f978ef4d4890f4fa15469d678b/roles/c0d7df8111f245f5858fd0d694956e91 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:46.084014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ed96f-2fbf-450e-af83-aa979aff2fd7 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:46.085356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d23ed96f-2fbf-450e-af83-aa979aff2fd7 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:46.150219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ed96f-2fbf-450e-af83-aa979aff2fd7 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:46.155711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0075c9-4774-44ec-9fea-7b8f664cec46 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:46.156606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0075c9-4774-44ec-9fea-7b8f664cec46 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:46.156895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0075c9-4774-44ec-9fea-7b8f664cec46 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:46.157168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0075c9-4774-44ec-9fea-7b8f664cec46 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/roles/c0d7df8111f245f5858fd0d694956e91` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:46.161972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0075c9-4774-44ec-9fea-7b8f664cec46 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c0d7df8111f245f5858fd0d694956e91)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:46.164908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:46.165224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0075c9-4774-44ec-9fea-7b8f664cec46 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:46.191511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c725ec03-8281-4bc1-9498-33145e011096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fbdb1046a124c898f5026e9bcc3564d', 'request_id': 'req-c725ec03-8281-4bc1-9498-33145e011096'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:46.201063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c725ec03-8281-4bc1-9498-33145e011096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fbdb1046a124c898f5026e9bcc3564d', 'request_id': 'req-c725ec03-8281-4bc1-9498-33145e011096'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:46.212686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c725ec03-8281-4bc1-9498-33145e011096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fbdb1046a124c898f5026e9bcc3564d', 'request_id': 'req-c725ec03-8281-4bc1-9498-33145e011096'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:46.257331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:46.295218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c725ec03-8281-4bc1-9498-33145e011096 admin admin] The token cache is being invalidate because project 7fbdb1046a124c898f5026e9bcc3564d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:46.295632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c725ec03-8281-4bc1-9498-33145e011096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:46.296417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c725ec03-8281-4bc1-9498-33145e011096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:46.298108 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3036/6133] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:45 2022] DELETE /identity/v3/projects/7fbdb1046a124c898f5026e9bcc3564d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:46.304546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169610f-aedc-49eb-9574-dcf297da3194 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:46.304887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169610f-aedc-49eb-9574-dcf297da3194 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:46.305165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169610f-aedc-49eb-9574-dcf297da3194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:46.318630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6e0075c9-4774-44ec-9fea-7b8f664cec46 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invalidating the token cache because role c0d7df8111f245f5858fd0d694956e91 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:46.319365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6e0075c9-4774-44ec-9fea-7b8f664cec46 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:46.320225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6e0075c9-4774-44ec-9fea-7b8f664cec46 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:46.322842 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3098/6134] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:46 2022] DELETE /identity/v3/roles/c0d7df8111f245f5858fd0d694956e91 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:46.324956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a169610f-aedc-49eb-9574-dcf297da3194 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:46.326272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a169610f-aedc-49eb-9574-dcf297da3194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:46.326841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0075c9-4774-44ec-9fea-7b8f664cec46 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:46.328332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6e0075c9-4774-44ec-9fea-7b8f664cec46 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:46.397514 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3037/6135] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:30:46.406587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570c85f-c920-48bd-9b4d-a5f929906f9c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:46.407186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570c85f-c920-48bd-9b4d-a5f929906f9c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:46.407534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570c85f-c920-48bd-9b4d-a5f929906f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:46.409663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0075c9-4774-44ec-9fea-7b8f664cec46 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:46.415573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d055a-28c3-41c5-8e9d-ce5c05b7deb6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:46.416392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d055a-28c3-41c5-8e9d-ce5c05b7deb6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:46.416746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d055a-28c3-41c5-8e9d-ce5c05b7deb6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:46.417107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d055a-28c3-41c5-8e9d-ce5c05b7deb6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains/d5597425d2e246189aee0edfa95627a6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:46.418628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d055a-28c3-41c5-8e9d-ce5c05b7deb6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d5597425d2e246189aee0edfa95627a6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:46.420495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d055a-28c3-41c5-8e9d-ce5c05b7deb6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:46.431633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8570c85f-c920-48bd-9b4d-a5f929906f9c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:46.432923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8570c85f-c920-48bd-9b4d-a5f929906f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:46.443132 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3038/6136] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:30:46.447067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570c85f-c920-48bd-9b4d-a5f929906f9c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:46.448053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e88d055a-28c3-41c5-8e9d-ce5c05b7deb6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd5597425d2e246189aee0edfa95627a6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:46.448822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e88d055a-28c3-41c5-8e9d-ce5c05b7deb6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd5597425d2e246189aee0edfa95627a6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:46.457150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570c85f-c920-48bd-9b4d-a5f929906f9c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:46.525584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db406493-8809-4a0e-9b87-e45306d1636c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:46.526306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db406493-8809-4a0e-9b87-e45306d1636c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:46.526525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db406493-8809-4a0e-9b87-e45306d1636c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:46.526795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db406493-8809-4a0e-9b87-e45306d1636c admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:46.527674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db406493-8809-4a0e-9b87-e45306d1636c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:30:46.527986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db406493-8809-4a0e-9b87-e45306d1636c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:46.529718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db406493-8809-4a0e-9b87-e45306d1636c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:46.546676 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3039/6137] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:46.548027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db406493-8809-4a0e-9b87-e45306d1636c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:46.549809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-db406493-8809-4a0e-9b87-e45306d1636c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:46.561010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e88d055a-28c3-41c5-8e9d-ce5c05b7deb6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd5597425d2e246189aee0edfa95627a6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:46.561785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e88d055a-28c3-41c5-8e9d-ce5c05b7deb6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd5597425d2e246189aee0edfa95627a6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:46.564452 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3099/6138] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:30:46 2022] PATCH /identity/v3/domains/d5597425d2e246189aee0edfa95627a6 => generated 277 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:46.564799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db406493-8809-4a0e-9b87-e45306d1636c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:46.569257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d055a-28c3-41c5-8e9d-ce5c05b7deb6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:46.570819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e88d055a-28c3-41c5-8e9d-ce5c05b7deb6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:46.572857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc4af1-9a80-49ee-a430-bd5afbe57a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:46.573607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc4af1-9a80-49ee-a430-bd5afbe57a2e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:46.574016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc4af1-9a80-49ee-a430-bd5afbe57a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:46.574308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc4af1-9a80-49ee-a430-bd5afbe57a2e admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:46.575385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc4af1-9a80-49ee-a430-bd5afbe57a2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:46.579597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc4af1-9a80-49ee-a430-bd5afbe57a2e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:46.637804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d055a-28c3-41c5-8e9d-ce5c05b7deb6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:46.642588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:46.643515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:46.643879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:46.644153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains/d5597425d2e246189aee0edfa95627a6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:46.655454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d5597425d2e246189aee0edfa95627a6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:46.657108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:46.678729 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3040/6139] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:46 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:46.680381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc4af1-9a80-49ee-a430-bd5afbe57a2e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:46.682630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd5597425d2e246189aee0edfa95627a6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:46.682797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-45dc4af1-9a80-49ee-a430-bd5afbe57a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:46.695193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd5597425d2e246189aee0edfa95627a6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:46.749322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc4af1-9a80-49ee-a430-bd5afbe57a2e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:46.754955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622e94a-a92e-4064-a614-51d37de838e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:46.755668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622e94a-a92e-4064-a614-51d37de838e8 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:46.755952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622e94a-a92e-4064-a614-51d37de838e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:46.756229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622e94a-a92e-4064-a614-51d37de838e8 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:46.757602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622e94a-a92e-4064-a614-51d37de838e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:46.760101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622e94a-a92e-4064-a614-51d37de838e8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:46.856302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5597425d2e246189aee0edfa95627a6', 'request_id': 'req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:46.866739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5597425d2e246189aee0edfa95627a6', 'request_id': 'req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:46.869778 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3041/6140] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:46 2022] POST /identity/v3/users => generated 298 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:46.870866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622e94a-a92e-4064-a614-51d37de838e8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:46.886442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5597425d2e246189aee0edfa95627a6', 'request_id': 'req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:46.890627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622e94a-a92e-4064-a614-51d37de838e8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:46.955257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c143434-b29b-4963-9a0f-5ed545a06858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:46.955853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c143434-b29b-4963-9a0f-5ed545a06858 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:46.956135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c143434-b29b-4963-9a0f-5ed545a06858 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:46.956415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c143434-b29b-4963-9a0f-5ed545a06858 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:46.957137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c143434-b29b-4963-9a0f-5ed545a06858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:46.958798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c143434-b29b-4963-9a0f-5ed545a06858 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:46.970274 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3042/6141] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:46.976173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c143434-b29b-4963-9a0f-5ed545a06858 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:46.986680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c143434-b29b-4963-9a0f-5ed545a06858 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:46.991867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432407f-a719-40ae-8802-8cb515c9b3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:46.993690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432407f-a719-40ae-8802-8cb515c9b3bb admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:46.993897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432407f-a719-40ae-8802-8cb515c9b3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:46.994110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432407f-a719-40ae-8802-8cb515c9b3bb admin admin] PATH_INFO: `/v3/projects/1a3c5cbfa8ca48a198597d1e2aeb1a87/users/91356c39cb8f44fab73ce4ea2dca442b/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:47.010907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432407f-a719-40ae-8802-8cb515c9b3bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3c5cbfa8ca48a198597d1e2aeb1a87, user_id=91356c39cb8f44fab73ce4ea2dca442b, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:47.013726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432407f-a719-40ae-8802-8cb515c9b3bb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:47.033396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] The token cache is being invalidate because project d5597425d2e246189aee0edfa95627a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:47.033937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:47.036411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:47.042872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd5597425d2e246189aee0edfa95627a6', 'request_id': 'req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:47.046083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd5597425d2e246189aee0edfa95627a6', 'request_id': 'req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:47.046796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd5597425d2e246189aee0edfa95627a6', 'request_id': 'req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:47.052426 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3100/6142] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:30:46 2022] DELETE /identity/v3/domains/d5597425d2e246189aee0edfa95627a6 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:47.058120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:47.059528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:47.122090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b22fd0-979a-4888-b17f-32ff5c5a13b9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:47.127047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c36a6d-317f-41d2-8d8d-d8d5c290c1e8 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:47.127723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c36a6d-317f-41d2-8d8d-d8d5c290c1e8 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:47.128148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c36a6d-317f-41d2-8d8d-d8d5c290c1e8 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:47.128274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c36a6d-317f-41d2-8d8d-d8d5c290c1e8 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:47.128996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c36a6d-317f-41d2-8d8d-d8d5c290c1e8 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:47.130700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c36a6d-317f-41d2-8d8d-d8d5c290c1e8 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:47.131818 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3043/6143] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:46 2022] PUT /identity/v3/projects/1a3c5cbfa8ca48a198597d1e2aeb1a87/users/91356c39cb8f44fab73ce4ea2dca442b/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:47.136046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432407f-a719-40ae-8802-8cb515c9b3bb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:47.137725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f432407f-a719-40ae-8802-8cb515c9b3bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:47.145635 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3101/6144] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:30:47.154442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c36a6d-317f-41d2-8d8d-d8d5c290c1e8 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:47.168737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c36a6d-317f-41d2-8d8d-d8d5c290c1e8 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:47.226502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432407f-a719-40ae-8802-8cb515c9b3bb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:47.232651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482d212-db90-4862-a720-fae5313eadc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:47.233573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482d212-db90-4862-a720-fae5313eadc7 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:47.234330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482d212-db90-4862-a720-fae5313eadc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:47.234756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482d212-db90-4862-a720-fae5313eadc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:47.235894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482d212-db90-4862-a720-fae5313eadc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:47.237783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482d212-db90-4862-a720-fae5313eadc7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:47.251589 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3044/6145] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:47.252988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482d212-db90-4862-a720-fae5313eadc7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:47.261358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7ed01-c0ca-44d5-b4e0-003a0075f0d9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:47.262260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7ed01-c0ca-44d5-b4e0-003a0075f0d9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:47.262545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7ed01-c0ca-44d5-b4e0-003a0075f0d9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:47.262822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7ed01-c0ca-44d5-b4e0-003a0075f0d9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/projects/aff985fee96c4501b7671d45c3ffac39/users/862d611068f94b42b4dd8829ed5f212a/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:47.266162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7ed01-c0ca-44d5-b4e0-003a0075f0d9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:create_grant(project_id=aff985fee96c4501b7671d45c3ffac39, user_id=862d611068f94b42b4dd8829ed5f212a, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:47.267669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7ed01-c0ca-44d5-b4e0-003a0075f0d9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:47.268716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482d212-db90-4862-a720-fae5313eadc7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:47.274257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c8475-57a0-44e5-927f-3a6651f26091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:47.275255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c8475-57a0-44e5-927f-3a6651f26091 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:47.275537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c8475-57a0-44e5-927f-3a6651f26091 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:47.275813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c8475-57a0-44e5-927f-3a6651f26091 admin admin] PATH_INFO: `/v3/projects/1a3c5cbfa8ca48a198597d1e2aeb1a87/users/91356c39cb8f44fab73ce4ea2dca442b/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:47.277853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c8475-57a0-44e5-927f-3a6651f26091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3c5cbfa8ca48a198597d1e2aeb1a87, user_id=91356c39cb8f44fab73ce4ea2dca442b, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:47.280595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c8475-57a0-44e5-927f-3a6651f26091 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:47.290951 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3045/6146] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:47 2022] PUT /identity/v3/projects/1a3c5cbfa8ca48a198597d1e2aeb1a87/users/91356c39cb8f44fab73ce4ea2dca442b/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:47.300883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df8603-338e-47b6-a4cc-19d5123a9212 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:47.301171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df8603-338e-47b6-a4cc-19d5123a9212 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:47.301449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df8603-338e-47b6-a4cc-19d5123a9212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:47.327310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-20df8603-338e-47b6-a4cc-19d5123a9212 None None] MFA Rules not processed for user `91356c39cb8f44fab73ce4ea2dca442b`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:47.328509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-20df8603-338e-47b6-a4cc-19d5123a9212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:47.397093 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3046/6147] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:30:47.403532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df8603-338e-47b6-a4cc-19d5123a9212 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:47.406219 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3102/6148] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:47 2022] PUT /identity/v3/projects/aff985fee96c4501b7671d45c3ffac39/users/862d611068f94b42b4dd8829ed5f212a/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:47.410209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7ed01-c0ca-44d5-b4e0-003a0075f0d9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:47.473020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df8603-338e-47b6-a4cc-19d5123a9212 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:47.478668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7ed01-c0ca-44d5-b4e0-003a0075f0d9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:47.484142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f162e-191c-4dde-976c-8121db588309 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:47.484798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f162e-191c-4dde-976c-8121db588309 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:47.485084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f162e-191c-4dde-976c-8121db588309 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:47.485389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f162e-191c-4dde-976c-8121db588309 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:47.486082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f162e-191c-4dde-976c-8121db588309 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:47.487268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f162e-191c-4dde-976c-8121db588309 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:47.541100 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3103/6149] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Jul 16 21:30:47 2022] GET /identity/v3/auth/projects => generated 826 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:47.542284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f162e-191c-4dde-976c-8121db588309 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:47.553378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7676c-bc4c-4e32-8ad2-5576426d61de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:47.554150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7676c-bc4c-4e32-8ad2-5576426d61de admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:47.557483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7676c-bc4c-4e32-8ad2-5576426d61de admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:47.557483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7676c-bc4c-4e32-8ad2-5576426d61de admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:47.557483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7676c-bc4c-4e32-8ad2-5576426d61de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:47.557761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f162e-191c-4dde-976c-8121db588309 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:47.558086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7676c-bc4c-4e32-8ad2-5576426d61de admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:47.562759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d56119-5faa-457e-8c52-6deb4d7772e9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:47.563796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d56119-5faa-457e-8c52-6deb4d7772e9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:47.564170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d56119-5faa-457e-8c52-6deb4d7772e9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:47.564524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d56119-5faa-457e-8c52-6deb4d7772e9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/projects/aff985fee96c4501b7671d45c3ffac39/users/862d611068f94b42b4dd8829ed5f212a/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:47.567051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d56119-5faa-457e-8c52-6deb4d7772e9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=aff985fee96c4501b7671d45c3ffac39, user_id=862d611068f94b42b4dd8829ed5f212a, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:47.570016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d56119-5faa-457e-8c52-6deb4d7772e9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:47.576839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4d56119-5faa-457e-8c52-6deb4d7772e9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invalidating the token cache because role bd33b827674a4d4db30c164cab416056 was removed from user 862d611068f94b42b4dd8829ed5f212a on project aff985fee96c4501b7671d45c3ffac39. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:47.579684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4d56119-5faa-457e-8c52-6deb4d7772e9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:47.579684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4d56119-5faa-457e-8c52-6deb4d7772e9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:47.664273 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3047/6150] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:47 2022] POST /identity/v3/projects => generated 385 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:47.668409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7676c-bc4c-4e32-8ad2-5576426d61de admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:47.670215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-44e7676c-bc4c-4e32-8ad2-5576426d61de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:47.682731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=78,keystone:DELETE=19,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:47.689256 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3104/6151] 10.222.0.16 () {58 vars in 1466 bytes} [Sat Jul 16 21:30:47 2022] DELETE /identity/v3/projects/aff985fee96c4501b7671d45c3ffac39/users/862d611068f94b42b4dd8829ed5f212a/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:47.694624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d56119-5faa-457e-8c52-6deb4d7772e9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:47.696640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c4d56119-5faa-457e-8c52-6deb4d7772e9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:47.738634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:47.744763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7676c-bc4c-4e32-8ad2-5576426d61de admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:47.773725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d56119-5faa-457e-8c52-6deb4d7772e9 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:47.778808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21994cb6-93fd-44e6-98f1-bedf4c4fee44 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:47.779512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21994cb6-93fd-44e6-98f1-bedf4c4fee44 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:47.780189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21994cb6-93fd-44e6-98f1-bedf4c4fee44 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:47.780189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21994cb6-93fd-44e6-98f1-bedf4c4fee44 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:47.781042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21994cb6-93fd-44e6-98f1-bedf4c4fee44 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:47.783190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21994cb6-93fd-44e6-98f1-bedf4c4fee44 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:47.811335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626691c4-11d8-4e49-8f3c-0727b215e7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:47.812011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626691c4-11d8-4e49-8f3c-0727b215e7cb admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:47.812297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626691c4-11d8-4e49-8f3c-0727b215e7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:47.812567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626691c4-11d8-4e49-8f3c-0727b215e7cb admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:47.813342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626691c4-11d8-4e49-8f3c-0727b215e7cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:47.815259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626691c4-11d8-4e49-8f3c-0727b215e7cb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:47.874252 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3105/6152] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:47 2022] POST /identity/v3/users => generated 321 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:47.878239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21994cb6-93fd-44e6-98f1-bedf4c4fee44 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:47.889197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21994cb6-93fd-44e6-98f1-bedf4c4fee44 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:47.894435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f5a9a-0545-445a-ade2-cdccb5e15f64 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:47.895119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f5a9a-0545-445a-ade2-cdccb5e15f64 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:47.895407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f5a9a-0545-445a-ade2-cdccb5e15f64 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:47.895685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f5a9a-0545-445a-ade2-cdccb5e15f64 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:47.896152 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3048/6153] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:47 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:30:47.896531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f5a9a-0545-445a-ade2-cdccb5e15f64 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:47.898609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f5a9a-0545-445a-ade2-cdccb5e15f64 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:47.900436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626691c4-11d8-4e49-8f3c-0727b215e7cb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:47.910968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626691c4-11d8-4e49-8f3c-0727b215e7cb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:47.920775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c149b-6953-47fb-8fd4-155286bfb00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:47.920775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c149b-6953-47fb-8fd4-155286bfb00f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:47.920775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c149b-6953-47fb-8fd4-155286bfb00f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:47.920775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c149b-6953-47fb-8fd4-155286bfb00f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:47.921106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c149b-6953-47fb-8fd4-155286bfb00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:47.921106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c149b-6953-47fb-8fd4-155286bfb00f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:47.931929 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3049/6154] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:47.935726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c149b-6953-47fb-8fd4-155286bfb00f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:47.946050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c149b-6953-47fb-8fd4-155286bfb00f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:47.951184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88ca3a-50d4-42ea-897c-5b4ea4e20814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:47.952038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88ca3a-50d4-42ea-897c-5b4ea4e20814 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:47.952966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88ca3a-50d4-42ea-897c-5b4ea4e20814 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:47.952966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88ca3a-50d4-42ea-897c-5b4ea4e20814 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:47.953318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88ca3a-50d4-42ea-897c-5b4ea4e20814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:47.954885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88ca3a-50d4-42ea-897c-5b4ea4e20814 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:47.968860 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3050/6155] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:30:47.969893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88ca3a-50d4-42ea-897c-5b4ea4e20814 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:47.980967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88ca3a-50d4-42ea-897c-5b4ea4e20814 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:47.985780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdae5d-d06b-4e4a-bb79-fe83418dea82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:47.986660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdae5d-d06b-4e4a-bb79-fe83418dea82 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:47.986941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdae5d-d06b-4e4a-bb79-fe83418dea82 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:47.987306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdae5d-d06b-4e4a-bb79-fe83418dea82 admin admin] PATH_INFO: `/v3/projects/fea8ff3979e741a3a747e2812f335e7b/users/ff08865fbcbf40b58e8228671c79d11c/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:48.006865 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3106/6156] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:47 2022] POST /identity/v3/projects => generated 363 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:30:48.011725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f5a9a-0545-445a-ade2-cdccb5e15f64 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:48.029457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdae5d-d06b-4e4a-bb79-fe83418dea82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea8ff3979e741a3a747e2812f335e7b, user_id=ff08865fbcbf40b58e8228671c79d11c, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:48.033912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdae5d-d06b-4e4a-bb79-fe83418dea82 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:48.099608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f5a9a-0545-445a-ade2-cdccb5e15f64 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:48.105426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59c748-9af2-4e88-a465-9d9575b55e62 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:48.106153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59c748-9af2-4e88-a465-9d9575b55e62 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:48.106438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59c748-9af2-4e88-a465-9d9575b55e62 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:48.106716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59c748-9af2-4e88-a465-9d9575b55e62 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:48.107443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59c748-9af2-4e88-a465-9d9575b55e62 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:48.109342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59c748-9af2-4e88-a465-9d9575b55e62 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:48.121183 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3051/6157] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:47 2022] PUT /identity/v3/projects/fea8ff3979e741a3a747e2812f335e7b/users/ff08865fbcbf40b58e8228671c79d11c/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:48.132182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111028c9-8131-4962-9de2-2e57ebcf1b41 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:48.132472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111028c9-8131-4962-9de2-2e57ebcf1b41 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:48.132790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111028c9-8131-4962-9de2-2e57ebcf1b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:48.159831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-111028c9-8131-4962-9de2-2e57ebcf1b41 None None] MFA Rules not processed for user `ff08865fbcbf40b58e8228671c79d11c`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:48.161230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-111028c9-8131-4962-9de2-2e57ebcf1b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:48.214729 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3107/6158] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:48 2022] POST /identity/v3/projects => generated 364 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:48.218799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59c748-9af2-4e88-a465-9d9575b55e62 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:48.233286 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3052/6159] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:30:48.245981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111028c9-8131-4962-9de2-2e57ebcf1b41 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:48.248052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-111028c9-8131-4962-9de2-2e57ebcf1b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:48.301622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59c748-9af2-4e88-a465-9d9575b55e62 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:48.313630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d23fb-9767-4009-81dd-a47afccd9eb6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:48.314246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d23fb-9767-4009-81dd-a47afccd9eb6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:48.314533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d23fb-9767-4009-81dd-a47afccd9eb6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:48.314813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d23fb-9767-4009-81dd-a47afccd9eb6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:48.316051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d23fb-9767-4009-81dd-a47afccd9eb6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:48.321361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d23fb-9767-4009-81dd-a47afccd9eb6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:48.357116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111028c9-8131-4962-9de2-2e57ebcf1b41 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:48.407611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb4fe6-940b-4d5b-a721-2d45e45f3dfa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:48.408255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb4fe6-940b-4d5b-a721-2d45e45f3dfa service glance] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:48.408539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb4fe6-940b-4d5b-a721-2d45e45f3dfa service glance] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:48.408816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb4fe6-940b-4d5b-a721-2d45e45f3dfa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:48.410644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a9bb4fe6-940b-4d5b-a721-2d45e45f3dfa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:48.479240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb4fe6-940b-4d5b-a721-2d45e45f3dfa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:48.480986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb4fe6-940b-4d5b-a721-2d45e45f3dfa service glance] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:48.493278 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3108/6160] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:30:48 2022] POST /identity/v3/roles => generated 239 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:30:48.497373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d23fb-9767-4009-81dd-a47afccd9eb6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:48.501103 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3053/6161] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:30:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:30:48.523349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d23fb-9767-4009-81dd-a47afccd9eb6 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:48.528871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4cc1e-ab13-4aed-b3ee-81eaac111a83 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:48.529775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4cc1e-ab13-4aed-b3ee-81eaac111a83 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:48.530068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4cc1e-ab13-4aed-b3ee-81eaac111a83 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:48.530351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4cc1e-ab13-4aed-b3ee-81eaac111a83 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/projects/e3f3093b582b4cc085d37413792b52c5/users/e1f86d8a32554ff5aa2e2ca19a0bcc8f/roles/d53b42a81dd147e79da646185bba6823` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:48.549975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4cc1e-ab13-4aed-b3ee-81eaac111a83 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e3f3093b582b4cc085d37413792b52c5, user_id=e1f86d8a32554ff5aa2e2ca19a0bcc8f, role_id=d53b42a81dd147e79da646185bba6823)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:48.552798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4cc1e-ab13-4aed-b3ee-81eaac111a83 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:48.679458 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3109/6162] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:48 2022] PUT /identity/v3/projects/e3f3093b582b4cc085d37413792b52c5/users/e1f86d8a32554ff5aa2e2ca19a0bcc8f/roles/d53b42a81dd147e79da646185bba6823 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:48.683745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb4fe6-940b-4d5b-a721-2d45e45f3dfa service glance] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:48.694224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb4fe6-940b-4d5b-a721-2d45e45f3dfa service glance] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:48.754592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b48234-e5c9-40b0-be42-d2e8bb135de3 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:48.755526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b48234-e5c9-40b0-be42-d2e8bb135de3 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:48.755813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b48234-e5c9-40b0-be42-d2e8bb135de3 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:48.756096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b48234-e5c9-40b0-be42-d2e8bb135de3 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/projects/d8697ed382854619bad5809be7e3d41b/users/e1f86d8a32554ff5aa2e2ca19a0bcc8f/roles/d53b42a81dd147e79da646185bba6823` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:48.759148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b48234-e5c9-40b0-be42-d2e8bb135de3 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d8697ed382854619bad5809be7e3d41b, user_id=e1f86d8a32554ff5aa2e2ca19a0bcc8f, role_id=d53b42a81dd147e79da646185bba6823)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:48.761807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b48234-e5c9-40b0-be42-d2e8bb135de3 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:48.857681 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3054/6163] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:48 2022] PUT /identity/v3/projects/d8697ed382854619bad5809be7e3d41b/users/e1f86d8a32554ff5aa2e2ca19a0bcc8f/roles/d53b42a81dd147e79da646185bba6823 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:48.862402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab010c9-def1-4cb1-81a7-881b03e21835 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:48.863141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab010c9-def1-4cb1-81a7-881b03e21835 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:48.863611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab010c9-def1-4cb1-81a7-881b03e21835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:48.895319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-eab010c9-def1-4cb1-81a7-881b03e21835 None None] MFA Rules not processed for user `e1f86d8a32554ff5aa2e2ca19a0bcc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:48.896824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-eab010c9-def1-4cb1-81a7-881b03e21835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:48.900777 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3110/6164] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:48 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 16 21:30:48.905511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e72de-88bf-4673-a21c-88b9623c7cb9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:48.906015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e72de-88bf-4673-a21c-88b9623c7cb9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:48.908174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e72de-88bf-4673-a21c-88b9623c7cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:48.918890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7c2e72de-88bf-4673-a21c-88b9623c7cb9 None None] MFA Rules not processed for user `e1f86d8a32554ff5aa2e2ca19a0bcc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:48.920060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7c2e72de-88bf-4673-a21c-88b9623c7cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:48.992655 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3055/6165] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:48 2022] POST /identity/v3/auth/tokens => generated 3213 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 16 21:30:48.999926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab010c9-def1-4cb1-81a7-881b03e21835 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:49.074044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:49.102825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab010c9-def1-4cb1-81a7-881b03e21835 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:49.109791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e88dc-2ecf-43fa-9ea7-47f15a5693f8 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:49.110456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e88dc-2ecf-43fa-9ea7-47f15a5693f8 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:49.110797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e88dc-2ecf-43fa-9ea7-47f15a5693f8 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:49.111107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e88dc-2ecf-43fa-9ea7-47f15a5693f8 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:49.125077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e88dc-2ecf-43fa-9ea7-47f15a5693f8 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:49.127329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e88dc-2ecf-43fa-9ea7-47f15a5693f8 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:49.189705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:49.262018 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3111/6166] 10.222.0.16 () {56 vars in 1307 bytes} [Sat Jul 16 21:30:48 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:49.266670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c5a97-3c2e-4ff5-bd97-acebe93676ef None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:49.267400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c5a97-3c2e-4ff5-bd97-acebe93676ef None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:49.267683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c5a97-3c2e-4ff5-bd97-acebe93676ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:49.279782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-771c5a97-3c2e-4ff5-bd97-acebe93676ef None None] MFA Rules not processed for user `e1f86d8a32554ff5aa2e2ca19a0bcc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:49.281055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-771c5a97-3c2e-4ff5-bd97-acebe93676ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:49.380829 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3056/6167] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:49 2022] POST /identity/v3/auth/tokens => generated 3214 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 16 21:30:49.385824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e88dc-2ecf-43fa-9ea7-47f15a5693f8 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:49.400352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e88dc-2ecf-43fa-9ea7-47f15a5693f8 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:49.412165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574acc8-f77f-4bc9-ac11-ea7707e4cd72 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:49.413042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574acc8-f77f-4bc9-ac11-ea7707e4cd72 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:49.413323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574acc8-f77f-4bc9-ac11-ea7707e4cd72 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:49.414896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574acc8-f77f-4bc9-ac11-ea7707e4cd72 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/roles/d53b42a81dd147e79da646185bba6823` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:49.416108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574acc8-f77f-4bc9-ac11-ea7707e4cd72 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d53b42a81dd147e79da646185bba6823)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:49.417716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574acc8-f77f-4bc9-ac11-ea7707e4cd72 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:49.688064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1574acc8-f77f-4bc9-ac11-ea7707e4cd72 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invalidating the token cache because role d53b42a81dd147e79da646185bba6823 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:49.688064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1574acc8-f77f-4bc9-ac11-ea7707e4cd72 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:49.688064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1574acc8-f77f-4bc9-ac11-ea7707e4cd72 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:49.690748 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3112/6168] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:49 2022] DELETE /identity/v3/roles/d53b42a81dd147e79da646185bba6823 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:49.694859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c5a97-3c2e-4ff5-bd97-acebe93676ef None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:49.707513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c5a97-3c2e-4ff5-bd97-acebe93676ef None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:49.802447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11e251-82a2-473f-8503-1a467ec72f0b tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:49.803380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11e251-82a2-473f-8503-1a467ec72f0b tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:49.803674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11e251-82a2-473f-8503-1a467ec72f0b tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:49.803984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11e251-82a2-473f-8503-1a467ec72f0b tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/projects/d8697ed382854619bad5809be7e3d41b` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:49.808169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11e251-82a2-473f-8503-1a467ec72f0b tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d8697ed382854619bad5809be7e3d41b)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:49.810918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11e251-82a2-473f-8503-1a467ec72f0b tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:49.960239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6f11e251-82a2-473f-8503-1a467ec72f0b tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8697ed382854619bad5809be7e3d41b', 'request_id': 'req-6f11e251-82a2-473f-8503-1a467ec72f0b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:49.966732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6f11e251-82a2-473f-8503-1a467ec72f0b tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8697ed382854619bad5809be7e3d41b', 'request_id': 'req-6f11e251-82a2-473f-8503-1a467ec72f0b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:49.974751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6f11e251-82a2-473f-8503-1a467ec72f0b tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8697ed382854619bad5809be7e3d41b', 'request_id': 'req-6f11e251-82a2-473f-8503-1a467ec72f0b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:50.112398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6f11e251-82a2-473f-8503-1a467ec72f0b tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] The token cache is being invalidate because project d8697ed382854619bad5809be7e3d41b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:50.112603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6f11e251-82a2-473f-8503-1a467ec72f0b tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:50.113305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6f11e251-82a2-473f-8503-1a467ec72f0b tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:50.115065 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3057/6169] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:49 2022] DELETE /identity/v3/projects/d8697ed382854619bad5809be7e3d41b => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:50.119825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574acc8-f77f-4bc9-ac11-ea7707e4cd72 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:50.121316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1574acc8-f77f-4bc9-ac11-ea7707e4cd72 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:50.135146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574acc8-f77f-4bc9-ac11-ea7707e4cd72 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:50.165588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11e251-82a2-473f-8503-1a467ec72f0b tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:50.167373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6f11e251-82a2-473f-8503-1a467ec72f0b tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:50.221770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ad83c-8af7-429a-8e17-4a58a0c10f08 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:50.222836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ad83c-8af7-429a-8e17-4a58a0c10f08 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:50.223182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ad83c-8af7-429a-8e17-4a58a0c10f08 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:50.223468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ad83c-8af7-429a-8e17-4a58a0c10f08 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/projects/d8697ed382854619bad5809be7e3d41b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:50.236787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ad83c-8af7-429a-8e17-4a58a0c10f08 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d8697ed382854619bad5809be7e3d41b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:50.238982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ad83c-8af7-429a-8e17-4a58a0c10f08 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:50.259141 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-0a6ad83c-8af7-429a-8e17-4a58a0c10f08 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Could not find project: d8697ed382854619bad5809be7e3d41b.: keystone.exception.ProjectNotFound: Could not find project: d8697ed382854619bad5809be7e3d41b. Jul 16 21:30:50.259141 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:30:50.259141 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:30:50.259141 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:30:50.259141 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:30:50.259141 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:30:50.259141 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:30:50.259141 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:30:50.259141 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:30:50.259141 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:30:50.259141 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:30:50.259141 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:30:50.259141 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 16 21:30:50.259141 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 16 21:30:50.260319 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:30:50.260319 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:30:50.260319 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 16 21:30:50.260319 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 16 21:30:50.260319 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 21:30:50.260319 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 21:30:50.260319 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 21:30:50.260319 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 21:30:50.260319 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d8697ed382854619bad5809be7e3d41b. Jul 16 21:30:50.260319 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:30:50.263114 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3113/6170] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:50 2022] DELETE /identity/v3/projects/d8697ed382854619bad5809be7e3d41b => generated 113 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:30:50.264858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11e251-82a2-473f-8503-1a467ec72f0b tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:50.267092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ad83c-8af7-429a-8e17-4a58a0c10f08 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:50.270112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0a6ad83c-8af7-429a-8e17-4a58a0c10f08 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:50.270371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e6030-4cfe-41c7-a1e1-c3d886b57cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:50.271445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e6030-4cfe-41c7-a1e1-c3d886b57cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:50.271806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e6030-4cfe-41c7-a1e1-c3d886b57cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:50.272308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e6030-4cfe-41c7-a1e1-c3d886b57cb0 admin admin] PATH_INFO: `/v3/users/91356c39cb8f44fab73ce4ea2dca442b` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:50.277804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e6030-4cfe-41c7-a1e1-c3d886b57cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91356c39cb8f44fab73ce4ea2dca442b)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:50.280577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e6030-4cfe-41c7-a1e1-c3d886b57cb0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:50.322533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ad83c-8af7-429a-8e17-4a58a0c10f08 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:50.331429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99458ec-8669-4eb7-9ba0-bdf2f81154d4 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:50.332325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99458ec-8669-4eb7-9ba0-bdf2f81154d4 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:50.332609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99458ec-8669-4eb7-9ba0-bdf2f81154d4 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:50.332883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99458ec-8669-4eb7-9ba0-bdf2f81154d4 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/projects/e3f3093b582b4cc085d37413792b52c5` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:50.334179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99458ec-8669-4eb7-9ba0-bdf2f81154d4 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e3f3093b582b4cc085d37413792b52c5)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:50.336359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99458ec-8669-4eb7-9ba0-bdf2f81154d4 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:50.538810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f99458ec-8669-4eb7-9ba0-bdf2f81154d4 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3f3093b582b4cc085d37413792b52c5', 'request_id': 'req-f99458ec-8669-4eb7-9ba0-bdf2f81154d4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:50.556660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f99458ec-8669-4eb7-9ba0-bdf2f81154d4 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3f3093b582b4cc085d37413792b52c5', 'request_id': 'req-f99458ec-8669-4eb7-9ba0-bdf2f81154d4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:50.575688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f99458ec-8669-4eb7-9ba0-bdf2f81154d4 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3f3093b582b4cc085d37413792b52c5', 'request_id': 'req-f99458ec-8669-4eb7-9ba0-bdf2f81154d4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:50.642622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-005e6030-4cfe-41c7-a1e1-c3d886b57cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91356c39cb8f44fab73ce4ea2dca442b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:50.662421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-005e6030-4cfe-41c7-a1e1-c3d886b57cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91356c39cb8f44fab73ce4ea2dca442b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:50.691208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f99458ec-8669-4eb7-9ba0-bdf2f81154d4 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] The token cache is being invalidate because project e3f3093b582b4cc085d37413792b52c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:50.691870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f99458ec-8669-4eb7-9ba0-bdf2f81154d4 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:50.692605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f99458ec-8669-4eb7-9ba0-bdf2f81154d4 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:50.697406 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3114/6171] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:50 2022] DELETE /identity/v3/projects/e3f3093b582b4cc085d37413792b52c5 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:50.701469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99458ec-8669-4eb7-9ba0-bdf2f81154d4 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:50.705715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f99458ec-8669-4eb7-9ba0-bdf2f81154d4 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:50.780185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-005e6030-4cfe-41c7-a1e1-c3d886b57cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91356c39cb8f44fab73ce4ea2dca442b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:50.800214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-005e6030-4cfe-41c7-a1e1-c3d886b57cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91356c39cb8f44fab73ce4ea2dca442b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:50.803424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-005e6030-4cfe-41c7-a1e1-c3d886b57cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91356c39cb8f44fab73ce4ea2dca442b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:50.814227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99458ec-8669-4eb7-9ba0-bdf2f81154d4 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:50.819207 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3058/6172] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:50 2022] DELETE /identity/v3/users/91356c39cb8f44fab73ce4ea2dca442b => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:50.825687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8a855-8169-4b21-ac51-29da93fa4e9c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:50.828332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8a855-8169-4b21-ac51-29da93fa4e9c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:50.829617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8a855-8169-4b21-ac51-29da93fa4e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:50.860216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-19e8a855-8169-4b21-ac51-29da93fa4e9c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:50.863684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-19e8a855-8169-4b21-ac51-29da93fa4e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:50.946898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093eb0e-402e-4afe-9140-3a70c8c50e90 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:50.946898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093eb0e-402e-4afe-9140-3a70c8c50e90 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:50.946898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093eb0e-402e-4afe-9140-3a70c8c50e90 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:50.947239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093eb0e-402e-4afe-9140-3a70c8c50e90 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/users/e1f86d8a32554ff5aa2e2ca19a0bcc8f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:50.947422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093eb0e-402e-4afe-9140-3a70c8c50e90 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e1f86d8a32554ff5aa2e2ca19a0bcc8f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:50.949565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093eb0e-402e-4afe-9140-3a70c8c50e90 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:50.960010 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3059/6173] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:50.971346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8a855-8169-4b21-ac51-29da93fa4e9c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:50.972905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-19e8a855-8169-4b21-ac51-29da93fa4e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:51.040656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8a855-8169-4b21-ac51-29da93fa4e9c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:51.045650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a822c-7fbf-4956-80ac-e21a661a249a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:51.046884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a822c-7fbf-4956-80ac-e21a661a249a service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:51.048062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a822c-7fbf-4956-80ac-e21a661a249a service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:51.048677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a822c-7fbf-4956-80ac-e21a661a249a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:51.061477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a822c-7fbf-4956-80ac-e21a661a249a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:51.063641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a822c-7fbf-4956-80ac-e21a661a249a service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:51.079974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b093eb0e-402e-4afe-9140-3a70c8c50e90 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f86d8a32554ff5aa2e2ca19a0bcc8f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:51.082041 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3060/6174] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:30:51.100603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b093eb0e-402e-4afe-9140-3a70c8c50e90 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f86d8a32554ff5aa2e2ca19a0bcc8f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:51.252213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b093eb0e-402e-4afe-9140-3a70c8c50e90 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f86d8a32554ff5aa2e2ca19a0bcc8f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:51.253333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b093eb0e-402e-4afe-9140-3a70c8c50e90 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f86d8a32554ff5aa2e2ca19a0bcc8f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:51.268071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b093eb0e-402e-4afe-9140-3a70c8c50e90 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f86d8a32554ff5aa2e2ca19a0bcc8f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:51.276812 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3115/6175] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:50 2022] DELETE /identity/v3/users/e1f86d8a32554ff5aa2e2ca19a0bcc8f => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:51.282307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a822c-7fbf-4956-80ac-e21a661a249a service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:51.287579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-061a822c-7fbf-4956-80ac-e21a661a249a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:51.303618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a822c-7fbf-4956-80ac-e21a661a249a service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:51.378551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ecd53-39e2-4342-9a6d-5fc316d5200e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:51.379623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ecd53-39e2-4342-9a6d-5fc316d5200e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:51.380021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ecd53-39e2-4342-9a6d-5fc316d5200e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:51.380733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ecd53-39e2-4342-9a6d-5fc316d5200e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains/f9d916cded1f4383b9e79dd3fdb0ecc9` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:51.401644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ecd53-39e2-4342-9a6d-5fc316d5200e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 21:30:51.419542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-855ecd53-39e2-4342-9a6d-5fc316d5200e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Could not find domain: f9d916cded1f4383b9e79dd3fdb0ecc9.: keystone.exception.DomainNotFound: Could not find domain: f9d916cded1f4383b9e79dd3fdb0ecc9. Jul 16 21:30:51.419542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:30:51.419542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 16 21:30:51.419542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 16 21:30:51.419542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 21:30:51.419542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 21:30:51.419542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 21:30:51.419542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 21:30:51.419542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f9d916cded1f4383b9e79dd3fdb0ecc9. Jul 16 21:30:51.419542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:30:51.419542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:30:51.419542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:30:51.419542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:30:51.419542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:30:51.419542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:30:51.419542 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:30:51.426988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:30:51.426988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:30:51.426988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:30:51.426988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:30:51.426988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:30:51.426988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:30:51.426988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:30:51.426988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 16 21:30:51.426988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 16 21:30:51.426988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 21:30:51.426988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 21:30:51.426988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 21:30:51.426988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 21:30:51.426988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:30:51.426988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:30:51.426988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:30:51.428263 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:30:51.428263 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:30:51.428263 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:30:51.428263 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:30:51.428263 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 21:30:51.428263 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:30:51.428263 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:30:51.428263 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:30:51.428263 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:30:51.428263 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:30:51.428263 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:30:51.428263 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:30:51.428263 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:30:51.428263 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 16 21:30:51.428263 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 21:30:51.428263 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f9d916cded1f4383b9e79dd3fdb0ecc9. Jul 16 21:30:51.428263 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:30:51.430299 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3061/6176] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:30:51 2022] PATCH /identity/v3/domains/f9d916cded1f4383b9e79dd3fdb0ecc9 => generated 112 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:30:51.432152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093eb0e-402e-4afe-9140-3a70c8c50e90 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:51.433817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b093eb0e-402e-4afe-9140-3a70c8c50e90 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:51.451306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093eb0e-402e-4afe-9140-3a70c8c50e90 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:51.456613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09b29b-bad0-45e5-8981-f85b9dd4c9eb tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:51.457549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09b29b-bad0-45e5-8981-f85b9dd4c9eb tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:51.457892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09b29b-bad0-45e5-8981-f85b9dd4c9eb tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:51.458175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09b29b-bad0-45e5-8981-f85b9dd4c9eb tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains/d73835de813e488d8cf4f2da68df307f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:51.469089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09b29b-bad0-45e5-8981-f85b9dd4c9eb tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 21:30:51.483316 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-5c09b29b-bad0-45e5-8981-f85b9dd4c9eb tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Could not find domain: d73835de813e488d8cf4f2da68df307f.: keystone.exception.DomainNotFound: Could not find domain: d73835de813e488d8cf4f2da68df307f. Jul 16 21:30:51.483316 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:30:51.483316 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 16 21:30:51.483316 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 16 21:30:51.483316 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 21:30:51.483316 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 21:30:51.483316 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 21:30:51.483316 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 21:30:51.483316 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d73835de813e488d8cf4f2da68df307f. Jul 16 21:30:51.483316 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:30:51.483316 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:30:51.483316 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:30:51.483316 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:30:51.483316 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:30:51.483316 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:30:51.483316 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:30:51.484447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:30:51.484447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:30:51.484447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:30:51.484447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:30:51.484447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:30:51.484447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:30:51.484447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:30:51.484447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 16 21:30:51.484447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 16 21:30:51.484447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 21:30:51.484447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 21:30:51.484447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 21:30:51.484447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 21:30:51.484447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:30:51.484447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:30:51.484447 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:30:51.487856 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:30:51.487856 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:30:51.487856 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:30:51.487856 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:30:51.487856 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 21:30:51.487856 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:30:51.487856 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:30:51.487856 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:30:51.487856 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:30:51.487856 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:30:51.487856 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:30:51.487856 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:30:51.487856 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:30:51.487856 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 16 21:30:51.487856 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 21:30:51.487856 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d73835de813e488d8cf4f2da68df307f. Jul 16 21:30:51.487856 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:30:51.489031 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3116/6177] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:30:51 2022] PATCH /identity/v3/domains/d73835de813e488d8cf4f2da68df307f => generated 112 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 16 21:30:51.490279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ecd53-39e2-4342-9a6d-5fc316d5200e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:51.502554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ecd53-39e2-4342-9a6d-5fc316d5200e tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:51.507654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04640db-174f-4575-9fe4-c046ffc3f17c tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:51.508536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04640db-174f-4575-9fe4-c046ffc3f17c tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:51.508826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04640db-174f-4575-9fe4-c046ffc3f17c tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:51.509109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04640db-174f-4575-9fe4-c046ffc3f17c tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains/a2724557a017425b92a4caac86ada08e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:51.519165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04640db-174f-4575-9fe4-c046ffc3f17c tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 21:30:51.530106 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-a04640db-174f-4575-9fe4-c046ffc3f17c tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Could not find domain: a2724557a017425b92a4caac86ada08e.: keystone.exception.DomainNotFound: Could not find domain: a2724557a017425b92a4caac86ada08e. Jul 16 21:30:51.530106 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:30:51.530106 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 16 21:30:51.530106 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 16 21:30:51.530106 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 21:30:51.530106 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 21:30:51.530106 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 21:30:51.530106 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 21:30:51.530106 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a2724557a017425b92a4caac86ada08e. Jul 16 21:30:51.530106 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:30:51.530106 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:30:51.530106 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:30:51.530106 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:30:51.530106 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:30:51.530106 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:30:51.530106 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:30:51.531434 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:30:51.531434 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:30:51.531434 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:30:51.531434 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:30:51.531434 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:30:51.531434 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:30:51.531434 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:30:51.531434 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 16 21:30:51.531434 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 16 21:30:51.531434 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 21:30:51.531434 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 21:30:51.531434 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 21:30:51.531434 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 21:30:51.531434 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:30:51.531434 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:30:51.531434 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:30:51.532586 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:30:51.532586 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:30:51.532586 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:30:51.532586 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:30:51.532586 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 21:30:51.532586 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:30:51.532586 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:30:51.532586 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:30:51.532586 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:30:51.532586 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:30:51.532586 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:30:51.532586 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:30:51.532586 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:30:51.532586 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 16 21:30:51.532586 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 21:30:51.532586 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a2724557a017425b92a4caac86ada08e. Jul 16 21:30:51.532586 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:30:51.534132 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3062/6178] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:30:51 2022] PATCH /identity/v3/domains/a2724557a017425b92a4caac86ada08e => generated 112 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:30:51.537696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09b29b-bad0-45e5-8981-f85b9dd4c9eb tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:51.551821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09b29b-bad0-45e5-8981-f85b9dd4c9eb tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:51.559084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061aa05-f231-4f42-aca5-3dd99a028f03 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '862d611068f94b42b4dd8829ed5f212a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69cd4349d9cf46c3ad23e42f907ac72a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:51.559969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061aa05-f231-4f42-aca5-3dd99a028f03 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:51.560340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061aa05-f231-4f42-aca5-3dd99a028f03 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:51.560689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061aa05-f231-4f42-aca5-3dd99a028f03 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] PATH_INFO: `/v3/domains/d5597425d2e246189aee0edfa95627a6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:51.574111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061aa05-f231-4f42-aca5-3dd99a028f03 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 21:30:51.590537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-1061aa05-f231-4f42-aca5-3dd99a028f03 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Could not find domain: d5597425d2e246189aee0edfa95627a6.: keystone.exception.DomainNotFound: Could not find domain: d5597425d2e246189aee0edfa95627a6. Jul 16 21:30:51.590537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:30:51.590537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 16 21:30:51.590537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 16 21:30:51.590537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 21:30:51.590537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 21:30:51.590537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 21:30:51.590537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 21:30:51.590537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d5597425d2e246189aee0edfa95627a6. Jul 16 21:30:51.590537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:30:51.590537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:30:51.590537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:30:51.590537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:30:51.590537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:30:51.590537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:30:51.590537 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:30:51.591875 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:30:51.591875 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:30:51.591875 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:30:51.591875 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:30:51.591875 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:30:51.591875 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:30:51.591875 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:30:51.591875 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 16 21:30:51.591875 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 16 21:30:51.591875 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 21:30:51.591875 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 21:30:51.591875 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 21:30:51.591875 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 21:30:51.591875 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:30:51.591875 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:30:51.591875 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:30:51.593021 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:30:51.593021 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:30:51.593021 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:30:51.593021 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:30:51.593021 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 21:30:51.593021 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:30:51.593021 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:30:51.593021 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:30:51.593021 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:30:51.593021 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:30:51.593021 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:30:51.593021 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:30:51.593021 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:30:51.593021 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 16 21:30:51.593021 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 21:30:51.593021 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d5597425d2e246189aee0edfa95627a6. Jul 16 21:30:51.593021 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:30:51.595147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04640db-174f-4575-9fe4-c046ffc3f17c tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:51.597135 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3117/6179] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:30:51 2022] PATCH /identity/v3/domains/d5597425d2e246189aee0edfa95627a6 => generated 112 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:30:51.597417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a04640db-174f-4575-9fe4-c046ffc3f17c tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:51.601085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061aa05-f231-4f42-aca5-3dd99a028f03 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:51.604266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1061aa05-f231-4f42-aca5-3dd99a028f03 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:51.716454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061aa05-f231-4f42-aca5-3dd99a028f03 tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:51.723243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9b0fb-e9c7-4ec0-91a2-c2bf5cca1ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:51.723464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04640db-174f-4575-9fe4-c046ffc3f17c tempest-TokensV3TestJSON-1151826319 tempest-TokensV3TestJSON-1151826319-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:51.724701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9b0fb-e9c7-4ec0-91a2-c2bf5cca1ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:51.725208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9b0fb-e9c7-4ec0-91a2-c2bf5cca1ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:51.725641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9b0fb-e9c7-4ec0-91a2-c2bf5cca1ea1 admin admin] PATH_INFO: `/v3/users/ff8d9f5f70074fb2ad870d0453d8ca26` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:51.728969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9b0fb-e9c7-4ec0-91a2-c2bf5cca1ea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff8d9f5f70074fb2ad870d0453d8ca26)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:51.729944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d837b-c017-45da-94e5-28e98736c7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:51.731431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d837b-c017-45da-94e5-28e98736c7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:51.731795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d837b-c017-45da-94e5-28e98736c7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:51.732291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d837b-c017-45da-94e5-28e98736c7b8 admin admin] PATH_INFO: `/v3/users/bb1f6532421745a4b0de70356748a647` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:51.733406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9b0fb-e9c7-4ec0-91a2-c2bf5cca1ea1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:51.733794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d837b-c017-45da-94e5-28e98736c7b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb1f6532421745a4b0de70356748a647)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:51.736085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d837b-c017-45da-94e5-28e98736c7b8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:52.032048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5fb9b0fb-e9c7-4ec0-91a2-c2bf5cca1ea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff8d9f5f70074fb2ad870d0453d8ca26'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:52.049023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-124d837b-c017-45da-94e5-28e98736c7b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb1f6532421745a4b0de70356748a647'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:52.053788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5fb9b0fb-e9c7-4ec0-91a2-c2bf5cca1ea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff8d9f5f70074fb2ad870d0453d8ca26'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:52.069097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-124d837b-c017-45da-94e5-28e98736c7b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb1f6532421745a4b0de70356748a647'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:52.170780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5fb9b0fb-e9c7-4ec0-91a2-c2bf5cca1ea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff8d9f5f70074fb2ad870d0453d8ca26'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:52.171741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5fb9b0fb-e9c7-4ec0-91a2-c2bf5cca1ea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff8d9f5f70074fb2ad870d0453d8ca26'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:52.185126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5fb9b0fb-e9c7-4ec0-91a2-c2bf5cca1ea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff8d9f5f70074fb2ad870d0453d8ca26'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:52.191577 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3118/6180] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:51 2022] DELETE /identity/v3/users/ff8d9f5f70074fb2ad870d0453d8ca26 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:52.192491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9b0fb-e9c7-4ec0-91a2-c2bf5cca1ea1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:52.196335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5fb9b0fb-e9c7-4ec0-91a2-c2bf5cca1ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:52.268648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9b0fb-e9c7-4ec0-91a2-c2bf5cca1ea1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:52.274278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e1bae-e4a0-4088-9d40-74d87a480b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:52.275190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e1bae-e4a0-4088-9d40-74d87a480b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:52.275519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e1bae-e4a0-4088-9d40-74d87a480b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:52.275799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e1bae-e4a0-4088-9d40-74d87a480b57 admin admin] PATH_INFO: `/v3/projects/1a3c5cbfa8ca48a198597d1e2aeb1a87` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:52.277054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e1bae-e4a0-4088-9d40-74d87a480b57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a3c5cbfa8ca48a198597d1e2aeb1a87)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:52.279443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e1bae-e4a0-4088-9d40-74d87a480b57 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:52.319921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-124d837b-c017-45da-94e5-28e98736c7b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb1f6532421745a4b0de70356748a647'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:52.329545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-124d837b-c017-45da-94e5-28e98736c7b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb1f6532421745a4b0de70356748a647'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:52.330510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-124d837b-c017-45da-94e5-28e98736c7b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb1f6532421745a4b0de70356748a647'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:52.341322 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3063/6181] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:51 2022] DELETE /identity/v3/users/bb1f6532421745a4b0de70356748a647 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:52.341932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278e87c-a4fb-42cd-9550-e4561d2a6a76 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:52.342654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278e87c-a4fb-42cd-9550-e4561d2a6a76 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:52.343238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278e87c-a4fb-42cd-9550-e4561d2a6a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:52.367722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d278e87c-a4fb-42cd-9550-e4561d2a6a76 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:52.372553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d278e87c-a4fb-42cd-9550-e4561d2a6a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:52.399275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:52.424627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-846e1bae-e4a0-4088-9d40-74d87a480b57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a3c5cbfa8ca48a198597d1e2aeb1a87', 'request_id': 'req-846e1bae-e4a0-4088-9d40-74d87a480b57'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:52.431903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-846e1bae-e4a0-4088-9d40-74d87a480b57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a3c5cbfa8ca48a198597d1e2aeb1a87', 'request_id': 'req-846e1bae-e4a0-4088-9d40-74d87a480b57'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:52.446292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-846e1bae-e4a0-4088-9d40-74d87a480b57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a3c5cbfa8ca48a198597d1e2aeb1a87', 'request_id': 'req-846e1bae-e4a0-4088-9d40-74d87a480b57'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:52.459149 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3064/6182] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:52.460632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8494473-4116-4679-937a-b50abb0146c4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:52.461624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8494473-4116-4679-937a-b50abb0146c4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:52.461907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8494473-4116-4679-937a-b50abb0146c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:52.488524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a8494473-4116-4679-937a-b50abb0146c4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:52.489836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a8494473-4116-4679-937a-b50abb0146c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:52.567994 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3065/6183] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:52.568904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8494473-4116-4679-937a-b50abb0146c4 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:52.571208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a8494473-4116-4679-937a-b50abb0146c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:52.616060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-846e1bae-e4a0-4088-9d40-74d87a480b57 admin admin] The token cache is being invalidate because project 1a3c5cbfa8ca48a198597d1e2aeb1a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:52.616353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-846e1bae-e4a0-4088-9d40-74d87a480b57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:52.617498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-846e1bae-e4a0-4088-9d40-74d87a480b57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:52.619421 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3119/6184] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:52 2022] DELETE /identity/v3/projects/1a3c5cbfa8ca48a198597d1e2aeb1a87 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:52.620372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e1bae-e4a0-4088-9d40-74d87a480b57 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:52.623328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-846e1bae-e4a0-4088-9d40-74d87a480b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:52.661832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:52.667556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8494473-4116-4679-937a-b50abb0146c4 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:52.674186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e3eea-e3df-4e60-aa60-ce99b59198ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:52.674995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e3eea-e3df-4e60-aa60-ce99b59198ad service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:52.675414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e3eea-e3df-4e60-aa60-ce99b59198ad service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:52.675947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e3eea-e3df-4e60-aa60-ce99b59198ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:52.679118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a49e3eea-e3df-4e60-aa60-ce99b59198ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:52.696243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e3eea-e3df-4e60-aa60-ce99b59198ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:52.698541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e3eea-e3df-4e60-aa60-ce99b59198ad service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:52.716252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e1bae-e4a0-4088-9d40-74d87a480b57 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:52.717214 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3066/6185] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:30:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:30:52.721041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762fc82-5faf-48ed-88df-c270d9874a84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:52.723395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762fc82-5faf-48ed-88df-c270d9874a84 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:52.724043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762fc82-5faf-48ed-88df-c270d9874a84 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:52.724607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762fc82-5faf-48ed-88df-c270d9874a84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:52.726963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2762fc82-5faf-48ed-88df-c270d9874a84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:52.727636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e3eea-e3df-4e60-aa60-ce99b59198ad service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:52.743928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a49e3eea-e3df-4e60-aa60-ce99b59198ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:52.746644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762fc82-5faf-48ed-88df-c270d9874a84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:52.748316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762fc82-5faf-48ed-88df-c270d9874a84 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:52.762287 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3120/6186] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:30:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:30:52.769502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e3eea-e3df-4e60-aa60-ce99b59198ad service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:52.774493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecf700-6652-4af0-931c-6aa0701bb4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:52.775674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecf700-6652-4af0-931c-6aa0701bb4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:52.775955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecf700-6652-4af0-931c-6aa0701bb4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:52.776227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecf700-6652-4af0-931c-6aa0701bb4e1 admin admin] PATH_INFO: `/v3/users/ff08865fbcbf40b58e8228671c79d11c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:52.778146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ecf700-6652-4af0-931c-6aa0701bb4e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff08865fbcbf40b58e8228671c79d11c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:52.780818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ecf700-6652-4af0-931c-6aa0701bb4e1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:53.014405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-85ecf700-6652-4af0-931c-6aa0701bb4e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff08865fbcbf40b58e8228671c79d11c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:53.032714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-85ecf700-6652-4af0-931c-6aa0701bb4e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff08865fbcbf40b58e8228671c79d11c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:53.118027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-85ecf700-6652-4af0-931c-6aa0701bb4e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff08865fbcbf40b58e8228671c79d11c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:53.130054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-85ecf700-6652-4af0-931c-6aa0701bb4e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff08865fbcbf40b58e8228671c79d11c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:53.130824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-85ecf700-6652-4af0-931c-6aa0701bb4e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff08865fbcbf40b58e8228671c79d11c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:53.141367 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3067/6187] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:52 2022] DELETE /identity/v3/users/ff08865fbcbf40b58e8228671c79d11c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:53.377596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762fc82-5faf-48ed-88df-c270d9874a84 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:53.380949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2762fc82-5faf-48ed-88df-c270d9874a84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:53.402485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762fc82-5faf-48ed-88df-c270d9874a84 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:53.469050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecf700-6652-4af0-931c-6aa0701bb4e1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:53.470815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-85ecf700-6652-4af0-931c-6aa0701bb4e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:53.549419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc103d80-46fd-4eda-ba35-86f75273a789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:53.550373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc103d80-46fd-4eda-ba35-86f75273a789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:53.550659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc103d80-46fd-4eda-ba35-86f75273a789 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:53.550931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc103d80-46fd-4eda-ba35-86f75273a789 admin admin] PATH_INFO: `/v3/projects/7d5a798ee507429bb70566356229535d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:53.553111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc103d80-46fd-4eda-ba35-86f75273a789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d5a798ee507429bb70566356229535d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:53.560303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc103d80-46fd-4eda-ba35-86f75273a789 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:53.637595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecf700-6652-4af0-931c-6aa0701bb4e1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:53.647809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0420e-3a3f-4beb-b4de-7e90933495cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:53.649730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0420e-3a3f-4beb-b4de-7e90933495cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:53.650121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0420e-3a3f-4beb-b4de-7e90933495cc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:53.650500 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0420e-3a3f-4beb-b4de-7e90933495cc admin admin] PATH_INFO: `/v3/projects/aff985fee96c4501b7671d45c3ffac39` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:53.651982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0420e-3a3f-4beb-b4de-7e90933495cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff985fee96c4501b7671d45c3ffac39)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:53.654834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0420e-3a3f-4beb-b4de-7e90933495cc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:53.693947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bc103d80-46fd-4eda-ba35-86f75273a789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d5a798ee507429bb70566356229535d', 'request_id': 'req-bc103d80-46fd-4eda-ba35-86f75273a789'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:53.723784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bc103d80-46fd-4eda-ba35-86f75273a789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d5a798ee507429bb70566356229535d', 'request_id': 'req-bc103d80-46fd-4eda-ba35-86f75273a789'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:53.733350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bc103d80-46fd-4eda-ba35-86f75273a789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d5a798ee507429bb70566356229535d', 'request_id': 'req-bc103d80-46fd-4eda-ba35-86f75273a789'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:53.831093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1ad0420e-3a3f-4beb-b4de-7e90933495cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff985fee96c4501b7671d45c3ffac39', 'request_id': 'req-1ad0420e-3a3f-4beb-b4de-7e90933495cc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:53.838775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1ad0420e-3a3f-4beb-b4de-7e90933495cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff985fee96c4501b7671d45c3ffac39', 'request_id': 'req-1ad0420e-3a3f-4beb-b4de-7e90933495cc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:53.846994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1ad0420e-3a3f-4beb-b4de-7e90933495cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff985fee96c4501b7671d45c3ffac39', 'request_id': 'req-1ad0420e-3a3f-4beb-b4de-7e90933495cc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:53.880542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bc103d80-46fd-4eda-ba35-86f75273a789 admin admin] The token cache is being invalidate because project 7d5a798ee507429bb70566356229535d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:53.881129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bc103d80-46fd-4eda-ba35-86f75273a789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:53.882129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bc103d80-46fd-4eda-ba35-86f75273a789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:53.885511 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3121/6188] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:53 2022] DELETE /identity/v3/projects/7d5a798ee507429bb70566356229535d => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:53.892104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42911440-b647-4f96-be85-fcc180ae400e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:53.892397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42911440-b647-4f96-be85-fcc180ae400e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:53.892670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42911440-b647-4f96-be85-fcc180ae400e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:53.913603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-42911440-b647-4f96-be85-fcc180ae400e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:53.914904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-42911440-b647-4f96-be85-fcc180ae400e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:53.984469 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3122/6189] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:30:54.002315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c010c31-59fe-4d41-ae88-128b27ac95cf None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:54.002315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c010c31-59fe-4d41-ae88-128b27ac95cf None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:54.002315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c010c31-59fe-4d41-ae88-128b27ac95cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:54.002565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1ad0420e-3a3f-4beb-b4de-7e90933495cc admin admin] The token cache is being invalidate because project aff985fee96c4501b7671d45c3ffac39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:54.002565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1ad0420e-3a3f-4beb-b4de-7e90933495cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:54.002725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1ad0420e-3a3f-4beb-b4de-7e90933495cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:54.012796 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3068/6190] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:53 2022] DELETE /identity/v3/projects/aff985fee96c4501b7671d45c3ffac39 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:54.013921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0420e-3a3f-4beb-b4de-7e90933495cc admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:54.019463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1ad0420e-3a3f-4beb-b4de-7e90933495cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:54.026872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9c010c31-59fe-4d41-ae88-128b27ac95cf None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:54.026872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9c010c31-59fe-4d41-ae88-128b27ac95cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:54.037500 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3123/6191] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:54.041690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c010c31-59fe-4d41-ae88-128b27ac95cf None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:54.047337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0420e-3a3f-4beb-b4de-7e90933495cc admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:54.055153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02586e-5604-43c6-8ec5-8af8c1d79fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:54.059634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02586e-5604-43c6-8ec5-8af8c1d79fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:54.059634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02586e-5604-43c6-8ec5-8af8c1d79fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:54.059634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02586e-5604-43c6-8ec5-8af8c1d79fa5 admin admin] PATH_INFO: `/v3/users/862d611068f94b42b4dd8829ed5f212a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:54.059634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02586e-5604-43c6-8ec5-8af8c1d79fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=862d611068f94b42b4dd8829ed5f212a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:54.062499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02586e-5604-43c6-8ec5-8af8c1d79fa5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:54.064007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c010c31-59fe-4d41-ae88-128b27ac95cf None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:54.075441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cf585-7cd2-40cc-8f6a-38ff20c7c50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:54.076235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cf585-7cd2-40cc-8f6a-38ff20c7c50b admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:54.076535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cf585-7cd2-40cc-8f6a-38ff20c7c50b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:54.077130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cf585-7cd2-40cc-8f6a-38ff20c7c50b admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:54.078024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cf585-7cd2-40cc-8f6a-38ff20c7c50b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:30:54.078339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cf585-7cd2-40cc-8f6a-38ff20c7c50b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:54.081466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cf585-7cd2-40cc-8f6a-38ff20c7c50b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:54.103755 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3124/6192] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:30:54.107115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cf585-7cd2-40cc-8f6a-38ff20c7c50b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:54.119862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cf585-7cd2-40cc-8f6a-38ff20c7c50b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:54.125642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83f548-eab3-4ce5-9311-83716cd54fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:54.126320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83f548-eab3-4ce5-9311-83716cd54fec admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:54.126656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83f548-eab3-4ce5-9311-83716cd54fec admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:54.126951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83f548-eab3-4ce5-9311-83716cd54fec admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:54.127882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83f548-eab3-4ce5-9311-83716cd54fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:54.129749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83f548-eab3-4ce5-9311-83716cd54fec admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:54.248263 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3125/6193] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:54 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:54.251964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83f548-eab3-4ce5-9311-83716cd54fec admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:54.285890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5f02586e-5604-43c6-8ec5-8af8c1d79fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '862d611068f94b42b4dd8829ed5f212a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:54.318289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5f02586e-5604-43c6-8ec5-8af8c1d79fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '862d611068f94b42b4dd8829ed5f212a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:54.342494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83f548-eab3-4ce5-9311-83716cd54fec admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:54.347574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f63cd-e5a0-46ef-b3a2-7154ab1eba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:54.348257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f63cd-e5a0-46ef-b3a2-7154ab1eba46 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:54.348679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f63cd-e5a0-46ef-b3a2-7154ab1eba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:54.349105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f63cd-e5a0-46ef-b3a2-7154ab1eba46 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:54.350217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f63cd-e5a0-46ef-b3a2-7154ab1eba46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:54.353058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f63cd-e5a0-46ef-b3a2-7154ab1eba46 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:54.409699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5f02586e-5604-43c6-8ec5-8af8c1d79fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '862d611068f94b42b4dd8829ed5f212a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:54.420747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5f02586e-5604-43c6-8ec5-8af8c1d79fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '862d611068f94b42b4dd8829ed5f212a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:54.421499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5f02586e-5604-43c6-8ec5-8af8c1d79fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '862d611068f94b42b4dd8829ed5f212a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:54.431832 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3069/6194] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:54 2022] DELETE /identity/v3/users/862d611068f94b42b4dd8829ed5f212a => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:54.433000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02586e-5604-43c6-8ec5-8af8c1d79fa5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:54.434354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5f02586e-5604-43c6-8ec5-8af8c1d79fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:54.517612 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3126/6195] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:54 2022] POST /identity/v3/users => generated 289 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:30:54.522062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f63cd-e5a0-46ef-b3a2-7154ab1eba46 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:54.525381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-be3f63cd-e5a0-46ef-b3a2-7154ab1eba46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:54.540708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f63cd-e5a0-46ef-b3a2-7154ab1eba46 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:54.582841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02586e-5604-43c6-8ec5-8af8c1d79fa5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:54.592727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a9357-18b6-4423-b00b-3125cadc19a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:54.593828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a9357-18b6-4423-b00b-3125cadc19a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:54.594479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a9357-18b6-4423-b00b-3125cadc19a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:54.594918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a9357-18b6-4423-b00b-3125cadc19a9 admin admin] PATH_INFO: `/v3/projects/fea8ff3979e741a3a747e2812f335e7b` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:54.596525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a9357-18b6-4423-b00b-3125cadc19a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea8ff3979e741a3a747e2812f335e7b)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:54.598778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a9357-18b6-4423-b00b-3125cadc19a9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:54.625236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f466725-7d9d-4a24-9e25-337233c6a687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:54.626295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f466725-7d9d-4a24-9e25-337233c6a687 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:54.626802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f466725-7d9d-4a24-9e25-337233c6a687 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:54.627463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f466725-7d9d-4a24-9e25-337233c6a687 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:54.628263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f466725-7d9d-4a24-9e25-337233c6a687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:54.634040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f466725-7d9d-4a24-9e25-337233c6a687 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:54.644608 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3127/6196] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:54.649609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f466725-7d9d-4a24-9e25-337233c6a687 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:54.660468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f466725-7d9d-4a24-9e25-337233c6a687 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:54.665651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bba42d-1618-4cb2-94b2-0c886d2ccc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:54.666402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bba42d-1618-4cb2-94b2-0c886d2ccc8a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:54.666752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bba42d-1618-4cb2-94b2-0c886d2ccc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:54.667128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bba42d-1618-4cb2-94b2-0c886d2ccc8a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:54.667922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bba42d-1618-4cb2-94b2-0c886d2ccc8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:54.671124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bba42d-1618-4cb2-94b2-0c886d2ccc8a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:54.690342 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3128/6197] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:54.691698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bba42d-1618-4cb2-94b2-0c886d2ccc8a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:54.705902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bba42d-1618-4cb2-94b2-0c886d2ccc8a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:54.713851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33d0f6-5fd7-4403-8dc5-37dc48e40e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:54.714760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33d0f6-5fd7-4403-8dc5-37dc48e40e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:54.715072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33d0f6-5fd7-4403-8dc5-37dc48e40e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:54.715353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33d0f6-5fd7-4403-8dc5-37dc48e40e32 admin admin] PATH_INFO: `/v3/projects/1e8c65e58fac42c4bd7f49eaa3a14115/users/1006989e743247bdb29a51b3a634afd9/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:54.729696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:54.738683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33d0f6-5fd7-4403-8dc5-37dc48e40e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e8c65e58fac42c4bd7f49eaa3a14115, user_id=1006989e743247bdb29a51b3a634afd9, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:54.742620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33d0f6-5fd7-4403-8dc5-37dc48e40e32 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:54.843620 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3129/6198] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:54 2022] PUT /identity/v3/projects/1e8c65e58fac42c4bd7f49eaa3a14115/users/1006989e743247bdb29a51b3a634afd9/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:54.849573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-007a9357-18b6-4423-b00b-3125cadc19a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea8ff3979e741a3a747e2812f335e7b', 'request_id': 'req-007a9357-18b6-4423-b00b-3125cadc19a9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:54.852638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c4aa5-c0f6-4109-8cf4-3280d85a138c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:54.852638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c4aa5-c0f6-4109-8cf4-3280d85a138c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:54.852638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c4aa5-c0f6-4109-8cf4-3280d85a138c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:54.857768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-007a9357-18b6-4423-b00b-3125cadc19a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea8ff3979e741a3a747e2812f335e7b', 'request_id': 'req-007a9357-18b6-4423-b00b-3125cadc19a9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:54.874057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-007a9357-18b6-4423-b00b-3125cadc19a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea8ff3979e741a3a747e2812f335e7b', 'request_id': 'req-007a9357-18b6-4423-b00b-3125cadc19a9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:54.884976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-241c4aa5-c0f6-4109-8cf4-3280d85a138c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:54.884976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-241c4aa5-c0f6-4109-8cf4-3280d85a138c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:54.915176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:54.952920 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3130/6199] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:30:54.964105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c4aa5-c0f6-4109-8cf4-3280d85a138c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:54.965587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-241c4aa5-c0f6-4109-8cf4-3280d85a138c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:54.975567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-007a9357-18b6-4423-b00b-3125cadc19a9 admin admin] The token cache is being invalidate because project fea8ff3979e741a3a747e2812f335e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:54.975830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-007a9357-18b6-4423-b00b-3125cadc19a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:54.976955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-007a9357-18b6-4423-b00b-3125cadc19a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:54.978853 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3070/6200] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:54 2022] DELETE /identity/v3/projects/fea8ff3979e741a3a747e2812f335e7b => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:54.983760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e9fd3-ab91-4b95-9877-98ee15de6ef2 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:54.984049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e9fd3-ab91-4b95-9877-98ee15de6ef2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:54.984323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e9fd3-ab91-4b95-9877-98ee15de6ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:55.004554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-481e9fd3-ab91-4b95-9877-98ee15de6ef2 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:55.006189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-481e9fd3-ab91-4b95-9877-98ee15de6ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:55.015550 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3071/6201] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:55.024809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c463b-6b61-4909-bb67-53b80f73fdd6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:55.025372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c463b-6b61-4909-bb67-53b80f73fdd6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:55.025659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c463b-6b61-4909-bb67-53b80f73fdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:55.051716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c4aa5-c0f6-4109-8cf4-3280d85a138c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:55.051911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-be1c463b-6b61-4909-bb67-53b80f73fdd6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:55.051911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-be1c463b-6b61-4909-bb67-53b80f73fdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:55.052129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0e5a0-3f00-4deb-83e1-141357018352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:55.052129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0e5a0-3f00-4deb-83e1-141357018352 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:55.052129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0e5a0-3f00-4deb-83e1-141357018352 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:55.052129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0e5a0-3f00-4deb-83e1-141357018352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:55.055633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-56c0e5a0-3f00-4deb-83e1-141357018352 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:55.070976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0e5a0-3f00-4deb-83e1-141357018352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:55.071204 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3072/6202] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:55.072174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c463b-6b61-4909-bb67-53b80f73fdd6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:55.072421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0e5a0-3f00-4deb-83e1-141357018352 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:55.083594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c463b-6b61-4909-bb67-53b80f73fdd6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:55.084063 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3131/6203] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:30:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:30:55.085048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0e5a0-3f00-4deb-83e1-141357018352 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:55.087446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-56c0e5a0-3f00-4deb-83e1-141357018352 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:55.089554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d32bfa-0563-47c6-8f93-c992428e8bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:55.090443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d32bfa-0563-47c6-8f93-c992428e8bba admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:55.091197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d32bfa-0563-47c6-8f93-c992428e8bba admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:55.091689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d32bfa-0563-47c6-8f93-c992428e8bba admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:55.093472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d32bfa-0563-47c6-8f93-c992428e8bba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:30:55.093949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d32bfa-0563-47c6-8f93-c992428e8bba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:55.096084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d32bfa-0563-47c6-8f93-c992428e8bba admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:55.116040 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3073/6204] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:55.116181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0e5a0-3f00-4deb-83e1-141357018352 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:55.120992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d32bfa-0563-47c6-8f93-c992428e8bba admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:55.125400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180cb26-adbd-416d-aff7-702f8501d384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:55.127197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180cb26-adbd-416d-aff7-702f8501d384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:55.127489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180cb26-adbd-416d-aff7-702f8501d384 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:55.127768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180cb26-adbd-416d-aff7-702f8501d384 admin admin] PATH_INFO: `/v3/projects/69cd4349d9cf46c3ad23e42f907ac72a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:55.129059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180cb26-adbd-416d-aff7-702f8501d384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69cd4349d9cf46c3ad23e42f907ac72a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:55.132548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180cb26-adbd-416d-aff7-702f8501d384 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:55.136033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d32bfa-0563-47c6-8f93-c992428e8bba admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:55.142144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1345b-cc12-44c0-b42b-97b845b6a9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:55.144052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1345b-cc12-44c0-b42b-97b845b6a9af admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:55.144355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1345b-cc12-44c0-b42b-97b845b6a9af admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:55.144712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1345b-cc12-44c0-b42b-97b845b6a9af admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:55.145647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1345b-cc12-44c0-b42b-97b845b6a9af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:55.148884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1345b-cc12-44c0-b42b-97b845b6a9af admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:55.271256 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3074/6205] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:55 2022] POST /identity/v3/projects => generated 367 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:30:55.272444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1345b-cc12-44c0-b42b-97b845b6a9af admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:55.296648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d180cb26-adbd-416d-aff7-702f8501d384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69cd4349d9cf46c3ad23e42f907ac72a', 'request_id': 'req-d180cb26-adbd-416d-aff7-702f8501d384'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:55.305074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d180cb26-adbd-416d-aff7-702f8501d384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69cd4349d9cf46c3ad23e42f907ac72a', 'request_id': 'req-d180cb26-adbd-416d-aff7-702f8501d384'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:55.321313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d180cb26-adbd-416d-aff7-702f8501d384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69cd4349d9cf46c3ad23e42f907ac72a', 'request_id': 'req-d180cb26-adbd-416d-aff7-702f8501d384'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:55.389566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1345b-cc12-44c0-b42b-97b845b6a9af admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:55.495244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d180cb26-adbd-416d-aff7-702f8501d384 admin admin] The token cache is being invalidate because project 69cd4349d9cf46c3ad23e42f907ac72a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:55.496006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d180cb26-adbd-416d-aff7-702f8501d384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:55.497144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d180cb26-adbd-416d-aff7-702f8501d384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:55.500309 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3132/6206] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:55 2022] DELETE /identity/v3/projects/69cd4349d9cf46c3ad23e42f907ac72a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:55.504750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180cb26-adbd-416d-aff7-702f8501d384 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:55.507260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d180cb26-adbd-416d-aff7-702f8501d384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:55.532043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbdd668-a342-4565-a25d-ca103a65ec90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:55.532880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdd668-a342-4565-a25d-ca103a65ec90 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:55.533748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdd668-a342-4565-a25d-ca103a65ec90 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:55.534694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdd668-a342-4565-a25d-ca103a65ec90 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:55.535608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbdd668-a342-4565-a25d-ca103a65ec90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:55.538605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbdd668-a342-4565-a25d-ca103a65ec90 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:55.650847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180cb26-adbd-416d-aff7-702f8501d384 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:55.651577 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3075/6207] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:55 2022] POST /identity/v3/users => generated 284 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:55.651930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbdd668-a342-4565-a25d-ca103a65ec90 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:55.654100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-edbdd668-a342-4565-a25d-ca103a65ec90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:55.656587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a47ed-5816-435f-b6aa-29ff98037b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:55.657823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a47ed-5816-435f-b6aa-29ff98037b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:55.658269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a47ed-5816-435f-b6aa-29ff98037b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:55.658842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a47ed-5816-435f-b6aa-29ff98037b9c admin admin] PATH_INFO: `/v3/users/136fc4f978ef4d4890f4fa15469d678b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:55.660426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a47ed-5816-435f-b6aa-29ff98037b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=136fc4f978ef4d4890f4fa15469d678b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:55.665918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a47ed-5816-435f-b6aa-29ff98037b9c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:55.677617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbdd668-a342-4565-a25d-ca103a65ec90 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:55.687553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e2240-6f06-43e0-92b1-6bae7872ee83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:55.688487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e2240-6f06-43e0-92b1-6bae7872ee83 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:55.688487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e2240-6f06-43e0-92b1-6bae7872ee83 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:55.689562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e2240-6f06-43e0-92b1-6bae7872ee83 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:55.690376 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e2240-6f06-43e0-92b1-6bae7872ee83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:55.692044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e2240-6f06-43e0-92b1-6bae7872ee83 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:55.703888 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3076/6208] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:30:55.707518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e2240-6f06-43e0-92b1-6bae7872ee83 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:55.719937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e2240-6f06-43e0-92b1-6bae7872ee83 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:55.727496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd578f-c258-48bb-a584-aa5d22176b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:55.728371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd578f-c258-48bb-a584-aa5d22176b28 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:55.728793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd578f-c258-48bb-a584-aa5d22176b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:55.729286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd578f-c258-48bb-a584-aa5d22176b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:55.730846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd578f-c258-48bb-a584-aa5d22176b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:55.733357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd578f-c258-48bb-a584-aa5d22176b28 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:55.751377 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3077/6209] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:55.763571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd578f-c258-48bb-a584-aa5d22176b28 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:55.775406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd578f-c258-48bb-a584-aa5d22176b28 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:55.782240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bccb9-685e-4b97-8ba9-9d9934eacba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:55.783819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bccb9-685e-4b97-8ba9-9d9934eacba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:55.784275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bccb9-685e-4b97-8ba9-9d9934eacba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:55.784608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bccb9-685e-4b97-8ba9-9d9934eacba8 admin admin] PATH_INFO: `/v3/projects/e307b4842fa742089707361a927e2903/users/36edd7990bc74237bc42da638e7f22bd/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:55.801573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bccb9-685e-4b97-8ba9-9d9934eacba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e307b4842fa742089707361a927e2903, user_id=36edd7990bc74237bc42da638e7f22bd, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:55.804365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bccb9-685e-4b97-8ba9-9d9934eacba8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:55.908759 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3078/6210] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:55 2022] PUT /identity/v3/projects/e307b4842fa742089707361a927e2903/users/36edd7990bc74237bc42da638e7f22bd/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:55.920184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f49c0-2572-4600-aacc-a61c480a0412 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:55.920549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f49c0-2572-4600-aacc-a61c480a0412 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:55.920793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f49c0-2572-4600-aacc-a61c480a0412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:55.927736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d1a47ed-5816-435f-b6aa-29ff98037b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '136fc4f978ef4d4890f4fa15469d678b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:55.943182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d1a47ed-5816-435f-b6aa-29ff98037b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '136fc4f978ef4d4890f4fa15469d678b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:55.968290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-625f49c0-2572-4600-aacc-a61c480a0412 None None] MFA Rules not processed for user `36edd7990bc74237bc42da638e7f22bd`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:55.969700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-625f49c0-2572-4600-aacc-a61c480a0412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:56.033707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d1a47ed-5816-435f-b6aa-29ff98037b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '136fc4f978ef4d4890f4fa15469d678b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:56.036646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d1a47ed-5816-435f-b6aa-29ff98037b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '136fc4f978ef4d4890f4fa15469d678b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:56.055550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d1a47ed-5816-435f-b6aa-29ff98037b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '136fc4f978ef4d4890f4fa15469d678b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:56.067071 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3133/6211] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:55 2022] DELETE /identity/v3/users/136fc4f978ef4d4890f4fa15469d678b => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:56.072378 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3079/6212] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:56.076550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a47ed-5816-435f-b6aa-29ff98037b9c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:56.078111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3d1a47ed-5816-435f-b6aa-29ff98037b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:56.159379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a47ed-5816-435f-b6aa-29ff98037b9c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:56.167196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db02691-d964-4093-a52c-68a604b647a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:56.173528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db02691-d964-4093-a52c-68a604b647a2 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:56.173686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db02691-d964-4093-a52c-68a604b647a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:56.173882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db02691-d964-4093-a52c-68a604b647a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:56.174779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db02691-d964-4093-a52c-68a604b647a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:56.177448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db02691-d964-4093-a52c-68a604b647a2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:56.667497 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3134/6213] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:56 2022] POST /identity/v3/projects => generated 369 bytes in 587 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:30:56.668714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f49c0-2572-4600-aacc-a61c480a0412 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:56.733296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f49c0-2572-4600-aacc-a61c480a0412 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:56.790939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa1abe-7f59-4f51-888f-1978a2df24cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:56.791718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa1abe-7f59-4f51-888f-1978a2df24cc admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:56.792211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa1abe-7f59-4f51-888f-1978a2df24cc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:56.792375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa1abe-7f59-4f51-888f-1978a2df24cc admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:56.793125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa1abe-7f59-4f51-888f-1978a2df24cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:56.795163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa1abe-7f59-4f51-888f-1978a2df24cc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:56.957956 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3080/6214] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:56 2022] POST /identity/v3/users => generated 285 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:56.963113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db02691-d964-4093-a52c-68a604b647a2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:56.978829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db02691-d964-4093-a52c-68a604b647a2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:56.984533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a0cdc-b866-48ca-a2b4-f1e596769e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:56.985203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a0cdc-b866-48ca-a2b4-f1e596769e23 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:56.985487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a0cdc-b866-48ca-a2b4-f1e596769e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:56.985762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a0cdc-b866-48ca-a2b4-f1e596769e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:56.987072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a0cdc-b866-48ca-a2b4-f1e596769e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:56.989196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a0cdc-b866-48ca-a2b4-f1e596769e23 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:57.002302 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3135/6215] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:57.007344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa1abe-7f59-4f51-888f-1978a2df24cc admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:57.017512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa1abe-7f59-4f51-888f-1978a2df24cc admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:57.022843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb1632-e9fc-4263-96bd-973d1ad0a8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:57.023835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb1632-e9fc-4263-96bd-973d1ad0a8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:57.024124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb1632-e9fc-4263-96bd-973d1ad0a8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:57.024405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb1632-e9fc-4263-96bd-973d1ad0a8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:57.025137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb1632-e9fc-4263-96bd-973d1ad0a8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:57.027088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb1632-e9fc-4263-96bd-973d1ad0a8c3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:57.037481 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3081/6216] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:57.042422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a0cdc-b866-48ca-a2b4-f1e596769e23 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:57.052776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a0cdc-b866-48ca-a2b4-f1e596769e23 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:57.058516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472adfd-d763-4f9f-86f3-c649fdcbafc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:57.059506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472adfd-d763-4f9f-86f3-c649fdcbafc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:57.059790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472adfd-d763-4f9f-86f3-c649fdcbafc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:57.060066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472adfd-d763-4f9f-86f3-c649fdcbafc7 admin admin] PATH_INFO: `/v3/projects/5d077f6063184787bd7354033597c3eb/users/8c6b5c30e3b0499a892f781c65306cd5/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:57.076679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472adfd-d763-4f9f-86f3-c649fdcbafc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d077f6063184787bd7354033597c3eb, user_id=8c6b5c30e3b0499a892f781c65306cd5, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:57.081744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472adfd-d763-4f9f-86f3-c649fdcbafc7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:57.127869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:57.171934 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3136/6217] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:57 2022] PUT /identity/v3/projects/5d077f6063184787bd7354033597c3eb/users/8c6b5c30e3b0499a892f781c65306cd5/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:57.183715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827177e-2a3c-4b4a-8d33-278871524b4f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:57.184013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827177e-2a3c-4b4a-8d33-278871524b4f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:57.184299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827177e-2a3c-4b4a-8d33-278871524b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:57.225373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2827177e-2a3c-4b4a-8d33-278871524b4f None None] MFA Rules not processed for user `8c6b5c30e3b0499a892f781c65306cd5`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:57.227588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2827177e-2a3c-4b4a-8d33-278871524b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:57.297889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:57.321999 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3082/6218] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:57.334628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472adfd-d763-4f9f-86f3-c649fdcbafc7 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:57.339880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827177e-2a3c-4b4a-8d33-278871524b4f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:57.339880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2827177e-2a3c-4b4a-8d33-278871524b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:57.340090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c472adfd-d763-4f9f-86f3-c649fdcbafc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:57.447083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827177e-2a3c-4b4a-8d33-278871524b4f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:57.452231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41480ef-857c-4249-8366-f71373529f69 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:57.453096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41480ef-857c-4249-8366-f71373529f69 service glance] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:57.453402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41480ef-857c-4249-8366-f71373529f69 service glance] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:57.453672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41480ef-857c-4249-8366-f71373529f69 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:57.501607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472adfd-d763-4f9f-86f3-c649fdcbafc7 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:57.511769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf37e5-aab0-435b-8d0c-3c5c86e771ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:57.512567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf37e5-aab0-435b-8d0c-3c5c86e771ee service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:57.512971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf37e5-aab0-435b-8d0c-3c5c86e771ee service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:57.513447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf37e5-aab0-435b-8d0c-3c5c86e771ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:57.515520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a7cf37e5-aab0-435b-8d0c-3c5c86e771ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:57.544755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf37e5-aab0-435b-8d0c-3c5c86e771ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:57.544755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf37e5-aab0-435b-8d0c-3c5c86e771ee service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:57.544976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41480ef-857c-4249-8366-f71373529f69 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:57.546451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41480ef-857c-4249-8366-f71373529f69 service glance] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:57.564845 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3137/6219] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:30:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:30:57.566534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c8317-9795-4185-86df-d02369609baf None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:57.566814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c8317-9795-4185-86df-d02369609baf None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:57.567125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c8317-9795-4185-86df-d02369609baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:57.580264 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3083/6220] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:30:57 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:30:57.583386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41480ef-857c-4249-8366-f71373529f69 service glance] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:57.585068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e41480ef-857c-4249-8366-f71373529f69 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:57.614017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e09c8317-9795-4185-86df-d02369609baf None None] MFA Rules not processed for user `1006989e743247bdb29a51b3a634afd9`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:57.615306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e09c8317-9795-4185-86df-d02369609baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:57.670028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41480ef-857c-4249-8366-f71373529f69 service glance] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:57.674766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1583b-a5e5-4d63-b97f-4cebc5f80262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:57.675725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1583b-a5e5-4d63-b97f-4cebc5f80262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:57.676075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1583b-a5e5-4d63-b97f-4cebc5f80262 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:57.676363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1583b-a5e5-4d63-b97f-4cebc5f80262 admin admin] PATH_INFO: `/v3/projects/2b9b3ad58ab24d55bc9a3e95f20d9813` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:57.677575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1583b-a5e5-4d63-b97f-4cebc5f80262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b9b3ad58ab24d55bc9a3e95f20d9813)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:57.679885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1583b-a5e5-4d63-b97f-4cebc5f80262 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:57.681908 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3138/6221] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:57.686356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c8317-9795-4185-86df-d02369609baf None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:57.687733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e09c8317-9795-4185-86df-d02369609baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:57.706315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c8317-9795-4185-86df-d02369609baf None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:57.717922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9bdaf-a877-4efe-acfc-76bc13598349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:57.719260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9bdaf-a877-4efe-acfc-76bc13598349 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:57.719749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9bdaf-a877-4efe-acfc-76bc13598349 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:57.720221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9bdaf-a877-4efe-acfc-76bc13598349 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:57.720898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9bdaf-a877-4efe-acfc-76bc13598349 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:57.723377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9bdaf-a877-4efe-acfc-76bc13598349 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:57.858493 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3139/6222] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:57 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:30:57.865882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9bdaf-a877-4efe-acfc-76bc13598349 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:57.871332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cdd1583b-a5e5-4d63-b97f-4cebc5f80262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b9b3ad58ab24d55bc9a3e95f20d9813', 'request_id': 'req-cdd1583b-a5e5-4d63-b97f-4cebc5f80262'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:57.876681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cdd1583b-a5e5-4d63-b97f-4cebc5f80262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b9b3ad58ab24d55bc9a3e95f20d9813', 'request_id': 'req-cdd1583b-a5e5-4d63-b97f-4cebc5f80262'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:57.892080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cdd1583b-a5e5-4d63-b97f-4cebc5f80262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b9b3ad58ab24d55bc9a3e95f20d9813', 'request_id': 'req-cdd1583b-a5e5-4d63-b97f-4cebc5f80262'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:57.943977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9bdaf-a877-4efe-acfc-76bc13598349 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:57.949442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a39c4-c2a5-4474-83f3-4c50901478b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:57.950150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a39c4-c2a5-4474-83f3-4c50901478b3 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:57.950434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a39c4-c2a5-4474-83f3-4c50901478b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:57.950708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a39c4-c2a5-4474-83f3-4c50901478b3 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:57.951509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a39c4-c2a5-4474-83f3-4c50901478b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:57.953494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a39c4-c2a5-4474-83f3-4c50901478b3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:58.002989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cdd1583b-a5e5-4d63-b97f-4cebc5f80262 admin admin] The token cache is being invalidate because project 2b9b3ad58ab24d55bc9a3e95f20d9813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:30:58.006900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cdd1583b-a5e5-4d63-b97f-4cebc5f80262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:58.006900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cdd1583b-a5e5-4d63-b97f-4cebc5f80262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:58.006900 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3084/6223] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:30:57 2022] DELETE /identity/v3/projects/2b9b3ad58ab24d55bc9a3e95f20d9813 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:58.006900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1583b-a5e5-4d63-b97f-4cebc5f80262 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:58.008711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cdd1583b-a5e5-4d63-b97f-4cebc5f80262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:58.041463 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3140/6224] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:57 2022] POST /identity/v3/users => generated 296 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:30:58.042871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580088e-5891-4910-b44a-ab400918bc0f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:58.043203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580088e-5891-4910-b44a-ab400918bc0f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:58.043482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580088e-5891-4910-b44a-ab400918bc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:58.067284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2580088e-5891-4910-b44a-ab400918bc0f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:58.068640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2580088e-5891-4910-b44a-ab400918bc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:58.081265 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3141/6225] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:58.082248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580088e-5891-4910-b44a-ab400918bc0f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:58.086350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2580088e-5891-4910-b44a-ab400918bc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:58.096887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580088e-5891-4910-b44a-ab400918bc0f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:58.099992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1583b-a5e5-4d63-b97f-4cebc5f80262 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:58.103693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8eb878-aa92-45ab-bd9a-85c0b44f0a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:58.105164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eb878-aa92-45ab-bd9a-85c0b44f0a8a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:58.105469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eb878-aa92-45ab-bd9a-85c0b44f0a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:58.105951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eb878-aa92-45ab-bd9a-85c0b44f0a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:58.106604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8eb878-aa92-45ab-bd9a-85c0b44f0a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:58.108362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8eb878-aa92-45ab-bd9a-85c0b44f0a8a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:58.120998 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3142/6226] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:58.122311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6aa4f5-d5b0-4bf3-8a15-2a381f3b78a5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:58.122716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6aa4f5-d5b0-4bf3-8a15-2a381f3b78a5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:58.123075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6aa4f5-d5b0-4bf3-8a15-2a381f3b78a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:58.149922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-df6aa4f5-d5b0-4bf3-8a15-2a381f3b78a5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:58.150301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-df6aa4f5-d5b0-4bf3-8a15-2a381f3b78a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:58.161227 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3143/6227] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:58.162934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6aa4f5-d5b0-4bf3-8a15-2a381f3b78a5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:58.175433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6aa4f5-d5b0-4bf3-8a15-2a381f3b78a5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:58.181515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc01c22-d6e5-4d86-bd1f-60c594f64114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:58.182497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc01c22-d6e5-4d86-bd1f-60c594f64114 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:58.182864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc01c22-d6e5-4d86-bd1f-60c594f64114 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:58.182973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76506bc6-6258-4d42-898a-433b42a7dcf8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:58.183449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc01c22-d6e5-4d86-bd1f-60c594f64114 admin admin] PATH_INFO: `/v3/projects/afdb1fa03c5746618068bca1af8f825e/users/82c9a9a2c0314af6b17278c94b73c7e0/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:58.183786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76506bc6-6258-4d42-898a-433b42a7dcf8 service glance] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:58.184086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76506bc6-6258-4d42-898a-433b42a7dcf8 service glance] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:58.184367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76506bc6-6258-4d42-898a-433b42a7dcf8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:58.186263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-76506bc6-6258-4d42-898a-433b42a7dcf8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:58.201178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc01c22-d6e5-4d86-bd1f-60c594f64114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afdb1fa03c5746618068bca1af8f825e, user_id=82c9a9a2c0314af6b17278c94b73c7e0, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:58.203800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc01c22-d6e5-4d86-bd1f-60c594f64114 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:58.254269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76506bc6-6258-4d42-898a-433b42a7dcf8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:58.259416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76506bc6-6258-4d42-898a-433b42a7dcf8 service glance] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:58.267234 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3085/6228] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:30:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:30:58.268255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76506bc6-6258-4d42-898a-433b42a7dcf8 service glance] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:58.281262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76506bc6-6258-4d42-898a-433b42a7dcf8 service glance] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:58.288033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e90f1-0cfc-4a34-afc1-0ce13eabfa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:58.290016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e90f1-0cfc-4a34-afc1-0ce13eabfa20 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:58.290016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e90f1-0cfc-4a34-afc1-0ce13eabfa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:58.290542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e90f1-0cfc-4a34-afc1-0ce13eabfa20 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:58.291845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e90f1-0cfc-4a34-afc1-0ce13eabfa20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:30:58.292159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e90f1-0cfc-4a34-afc1-0ce13eabfa20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:58.293748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e90f1-0cfc-4a34-afc1-0ce13eabfa20 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:58.318912 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3086/6230] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:58.320826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:58.322271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e90f1-0cfc-4a34-afc1-0ce13eabfa20 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:58.323850 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3144/6230] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:58 2022] PUT /identity/v3/projects/afdb1fa03c5746618068bca1af8f825e/users/82c9a9a2c0314af6b17278c94b73c7e0/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:58.325036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc01c22-d6e5-4d86-bd1f-60c594f64114 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:58.338087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e90f1-0cfc-4a34-afc1-0ce13eabfa20 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:58.410516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc01c22-d6e5-4d86-bd1f-60c594f64114 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:58.418129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138a178-86ec-4acf-8fc8-36233a8ff2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:58.418860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138a178-86ec-4acf-8fc8-36233a8ff2b3 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:58.419171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138a178-86ec-4acf-8fc8-36233a8ff2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:58.419715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138a178-86ec-4acf-8fc8-36233a8ff2b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:58.420140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138a178-86ec-4acf-8fc8-36233a8ff2b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:58.422066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138a178-86ec-4acf-8fc8-36233a8ff2b3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:58.430823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797fc14-f0e0-43f5-90ed-57ec6af55c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:58.435306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797fc14-f0e0-43f5-90ed-57ec6af55c67 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:58.435306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797fc14-f0e0-43f5-90ed-57ec6af55c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:58.435306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797fc14-f0e0-43f5-90ed-57ec6af55c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:58.435306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797fc14-f0e0-43f5-90ed-57ec6af55c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:58.436679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797fc14-f0e0-43f5-90ed-57ec6af55c67 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:58.446791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:58.455122 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3087/6231] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:58.459226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797fc14-f0e0-43f5-90ed-57ec6af55c67 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:58.471888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797fc14-f0e0-43f5-90ed-57ec6af55c67 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:58.478794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7ef2d-b5b6-4b5a-8f73-99e837903c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:58.480317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7ef2d-b5b6-4b5a-8f73-99e837903c60 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:58.480895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7ef2d-b5b6-4b5a-8f73-99e837903c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:58.481223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7ef2d-b5b6-4b5a-8f73-99e837903c60 admin admin] PATH_INFO: `/v3/projects/afdb1fa03c5746618068bca1af8f825e/users/82c9a9a2c0314af6b17278c94b73c7e0/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:58.483395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7ef2d-b5b6-4b5a-8f73-99e837903c60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afdb1fa03c5746618068bca1af8f825e, user_id=82c9a9a2c0314af6b17278c94b73c7e0, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:58.498794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7ef2d-b5b6-4b5a-8f73-99e837903c60 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:58.518718 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3088/6232] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:58 2022] PUT /identity/v3/projects/afdb1fa03c5746618068bca1af8f825e/users/82c9a9a2c0314af6b17278c94b73c7e0/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:58.567633 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3145/6233] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:30:58 2022] POST /identity/v3/projects => generated 367 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:58.572191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7ef2d-b5b6-4b5a-8f73-99e837903c60 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:58.656239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7ef2d-b5b6-4b5a-8f73-99e837903c60 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:58.731124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9036147-6d26-4d80-b689-cb827d9a7a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:58.731124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9036147-6d26-4d80-b689-cb827d9a7a21 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:58.731124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9036147-6d26-4d80-b689-cb827d9a7a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:58.731124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9036147-6d26-4d80-b689-cb827d9a7a21 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:58.732178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9036147-6d26-4d80-b689-cb827d9a7a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:58.732178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9036147-6d26-4d80-b689-cb827d9a7a21 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:58.826416 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3089/6234] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:30:58 2022] POST /identity/v3/users => generated 284 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:30:58.826805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138a178-86ec-4acf-8fc8-36233a8ff2b3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:58.838306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138a178-86ec-4acf-8fc8-36233a8ff2b3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:58.843675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c46d0-2016-4bab-bc90-09617adf99db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:58.844339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c46d0-2016-4bab-bc90-09617adf99db admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:58.844625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c46d0-2016-4bab-bc90-09617adf99db admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:58.844906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c46d0-2016-4bab-bc90-09617adf99db admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:58.845635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c46d0-2016-4bab-bc90-09617adf99db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:58.847262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c46d0-2016-4bab-bc90-09617adf99db admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:58.862232 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3146/6235] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:30:58.863809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9036147-6d26-4d80-b689-cb827d9a7a21 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:58.880828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9036147-6d26-4d80-b689-cb827d9a7a21 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:58.887693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868681d-98c6-478a-8d03-15938d408096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:58.893194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868681d-98c6-478a-8d03-15938d408096 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:58.893194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868681d-98c6-478a-8d03-15938d408096 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:58.893194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868681d-98c6-478a-8d03-15938d408096 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:58.893194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868681d-98c6-478a-8d03-15938d408096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:58.893194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868681d-98c6-478a-8d03-15938d408096 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:58.909375 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3090/6236] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:30:58.910942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c46d0-2016-4bab-bc90-09617adf99db admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:58.923888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c46d0-2016-4bab-bc90-09617adf99db admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:58.928718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ae8e9-e681-4e52-90e9-07cb083b4583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:58.929785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ae8e9-e681-4e52-90e9-07cb083b4583 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:58.930141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ae8e9-e681-4e52-90e9-07cb083b4583 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:58.930463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ae8e9-e681-4e52-90e9-07cb083b4583 admin admin] PATH_INFO: `/v3/projects/67bcce7e44eb43f6933acc741684599d/users/151b20b0b24e45dcb1ea34f2a6340dfd/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:58.950048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ae8e9-e681-4e52-90e9-07cb083b4583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67bcce7e44eb43f6933acc741684599d, user_id=151b20b0b24e45dcb1ea34f2a6340dfd, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:58.953313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ae8e9-e681-4e52-90e9-07cb083b4583 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:59.065120 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3147/6237] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:30:58 2022] PUT /identity/v3/projects/67bcce7e44eb43f6933acc741684599d/users/151b20b0b24e45dcb1ea34f2a6340dfd/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:30:59.069201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8daf1-edd0-4dcd-858c-823ca3cbf949 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:59.069491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8daf1-edd0-4dcd-858c-823ca3cbf949 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:59.069859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8daf1-edd0-4dcd-858c-823ca3cbf949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:59.103023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2ec8daf1-edd0-4dcd-858c-823ca3cbf949 None None] MFA Rules not processed for user `151b20b0b24e45dcb1ea34f2a6340dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:59.104420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2ec8daf1-edd0-4dcd-858c-823ca3cbf949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:30:59.236506 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3091/6238] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:30:59.241616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ae8e9-e681-4e52-90e9-07cb083b4583 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:59.253728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ae8e9-e681-4e52-90e9-07cb083b4583 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:59.258899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462eedf-c4fc-4788-9b7e-9b8efa3c741a tempest-TestApiDiscovery-112560161 tempest-TestApiDiscovery-112560161-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151b20b0b24e45dcb1ea34f2a6340dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67bcce7e44eb43f6933acc741684599d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:59.259720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462eedf-c4fc-4788-9b7e-9b8efa3c741a tempest-TestApiDiscovery-112560161 tempest-TestApiDiscovery-112560161-project] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:59.260086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462eedf-c4fc-4788-9b7e-9b8efa3c741a tempest-TestApiDiscovery-112560161 tempest-TestApiDiscovery-112560161-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:59.260438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462eedf-c4fc-4788-9b7e-9b8efa3c741a tempest-TestApiDiscovery-112560161 tempest-TestApiDiscovery-112560161-project] PATH_INFO: `/v3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:59.263169 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3148/6239] 10.222.0.16 () {58 vars in 1103 bytes} [Sat Jul 16 21:30:59 2022] GET /identity/v3 => generated 255 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:30:59.269733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8daf1-edd0-4dcd-858c-823ca3cbf949 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:59.281051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8daf1-edd0-4dcd-858c-823ca3cbf949 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:59.286111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be318a77-b839-463b-8a25-1ea900b72f2f tempest-TestApiDiscovery-112560161 tempest-TestApiDiscovery-112560161-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151b20b0b24e45dcb1ea34f2a6340dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67bcce7e44eb43f6933acc741684599d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:59.298441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be318a77-b839-463b-8a25-1ea900b72f2f tempest-TestApiDiscovery-112560161 tempest-TestApiDiscovery-112560161-project] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:59.298441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be318a77-b839-463b-8a25-1ea900b72f2f tempest-TestApiDiscovery-112560161 tempest-TestApiDiscovery-112560161-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:59.298441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be318a77-b839-463b-8a25-1ea900b72f2f tempest-TestApiDiscovery-112560161 tempest-TestApiDiscovery-112560161-project] PATH_INFO: `/v3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:59.298441 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3092/6240] 10.222.0.16 () {58 vars in 1103 bytes} [Sat Jul 16 21:30:59 2022] GET /identity/v3 => generated 255 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:59.299515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462eedf-c4fc-4788-9b7e-9b8efa3c741a tempest-TestApiDiscovery-112560161 tempest-TestApiDiscovery-112560161-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:59.311059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462eedf-c4fc-4788-9b7e-9b8efa3c741a tempest-TestApiDiscovery-112560161 tempest-TestApiDiscovery-112560161-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:59.316421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d07b5-0b81-4ea9-94a8-5f374bc58fd8 tempest-TestApiDiscovery-112560161 tempest-TestApiDiscovery-112560161-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151b20b0b24e45dcb1ea34f2a6340dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67bcce7e44eb43f6933acc741684599d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:59.318594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d07b5-0b81-4ea9-94a8-5f374bc58fd8 tempest-TestApiDiscovery-112560161 tempest-TestApiDiscovery-112560161-project] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:59.318594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d07b5-0b81-4ea9-94a8-5f374bc58fd8 tempest-TestApiDiscovery-112560161 tempest-TestApiDiscovery-112560161-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:59.318594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d07b5-0b81-4ea9-94a8-5f374bc58fd8 tempest-TestApiDiscovery-112560161 tempest-TestApiDiscovery-112560161-project] PATH_INFO: `/v3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:59.326204 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3149/6241] 10.222.0.16 () {58 vars in 1103 bytes} [Sat Jul 16 21:30:59 2022] GET /identity/v3 => generated 255 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:30:59.328828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51c031-b4ed-4fa4-a962-a6b087ecad83 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:59.329117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51c031-b4ed-4fa4-a962-a6b087ecad83 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:59.330101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51c031-b4ed-4fa4-a962-a6b087ecad83 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:59.335618 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3093/6242] 10.222.0.16 () {56 vars in 894 bytes} [Sat Jul 16 21:30:59 2022] GET /identity/ => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:30:59.345385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e97db-a296-46ac-aba1-f832979caf53 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:59.345385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e97db-a296-46ac-aba1-f832979caf53 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:59.345385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e97db-a296-46ac-aba1-f832979caf53 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:59.345385 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3150/6243] 10.222.0.16 () {56 vars in 894 bytes} [Sat Jul 16 21:30:59 2022] GET /identity/ => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:30:59.349169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51c031-b4ed-4fa4-a962-a6b087ecad83 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:30:59.474495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51c031-b4ed-4fa4-a962-a6b087ecad83 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:30:59.481630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca167f4-201a-4a53-97dc-9a80c9adde42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:30:59.483221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca167f4-201a-4a53-97dc-9a80c9adde42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:59.483570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca167f4-201a-4a53-97dc-9a80c9adde42 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:59.483942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca167f4-201a-4a53-97dc-9a80c9adde42 admin admin] PATH_INFO: `/v3/users/151b20b0b24e45dcb1ea34f2a6340dfd` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:59.485261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca167f4-201a-4a53-97dc-9a80c9adde42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=151b20b0b24e45dcb1ea34f2a6340dfd)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:30:59.487540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca167f4-201a-4a53-97dc-9a80c9adde42 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:30:59.707252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4ca167f4-201a-4a53-97dc-9a80c9adde42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '151b20b0b24e45dcb1ea34f2a6340dfd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:59.747185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4ca167f4-201a-4a53-97dc-9a80c9adde42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '151b20b0b24e45dcb1ea34f2a6340dfd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:59.890502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:30:59.893396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4ca167f4-201a-4a53-97dc-9a80c9adde42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '151b20b0b24e45dcb1ea34f2a6340dfd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:59.901517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4ca167f4-201a-4a53-97dc-9a80c9adde42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '151b20b0b24e45dcb1ea34f2a6340dfd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:59.902313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4ca167f4-201a-4a53-97dc-9a80c9adde42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '151b20b0b24e45dcb1ea34f2a6340dfd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:30:59.909360 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3094/6244] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:30:59 2022] DELETE /identity/v3/users/151b20b0b24e45dcb1ea34f2a6340dfd => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:30:59.913917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa33687-e16f-4e1d-8568-a2ee27f2934d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:30:59.916808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa33687-e16f-4e1d-8568-a2ee27f2934d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:30:59.916808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa33687-e16f-4e1d-8568-a2ee27f2934d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:30:59.932699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5fa33687-e16f-4e1d-8568-a2ee27f2934d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:30:59.933912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5fa33687-e16f-4e1d-8568-a2ee27f2934d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:00.008284 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3151/6245] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:00.037994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca167f4-201a-4a53-97dc-9a80c9adde42 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:00.051226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4ca167f4-201a-4a53-97dc-9a80c9adde42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:00.185030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca167f4-201a-4a53-97dc-9a80c9adde42 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:00.198206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6906c8d-7d31-4f79-b434-f8812661c33c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:00.198838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6906c8d-7d31-4f79-b434-f8812661c33c service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:00.199239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6906c8d-7d31-4f79-b434-f8812661c33c service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:00.199614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6906c8d-7d31-4f79-b434-f8812661c33c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:00.214355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6906c8d-7d31-4f79-b434-f8812661c33c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:00.218163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6906c8d-7d31-4f79-b434-f8812661c33c service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:00.250633 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3095/6246] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:31:00.949444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b88bc3-4341-446b-ace3-5a1151a273ce None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:00.949947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b88bc3-4341-446b-ace3-5a1151a273ce None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:00.950227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b88bc3-4341-446b-ace3-5a1151a273ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:00.981847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a1b88bc3-4341-446b-ace3-5a1151a273ce None None] MFA Rules not processed for user `82c9a9a2c0314af6b17278c94b73c7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:00.983240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a1b88bc3-4341-446b-ace3-5a1151a273ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:01.102848 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3152/6247] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:01.230159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fce57-da26-45c5-a19e-fa1ba10b6b64 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:01.231295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fce57-da26-45c5-a19e-fa1ba10b6b64 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:01.231558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fce57-da26-45c5-a19e-fa1ba10b6b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:01.275786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2f3fce57-da26-45c5-a19e-fa1ba10b6b64 None None] MFA Rules not processed for user `1006989e743247bdb29a51b3a634afd9`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:01.277695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2f3fce57-da26-45c5-a19e-fa1ba10b6b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:01.296428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:01.370065 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3096/6248] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:01.381390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b88bc3-4341-446b-ace3-5a1151a273ce None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:01.383757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a1b88bc3-4341-446b-ace3-5a1151a273ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:01.587785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b88bc3-4341-446b-ace3-5a1151a273ce None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:01.610073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ca33e-f21a-4b50-bb50-130b7806aa82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:01.611171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ca33e-f21a-4b50-bb50-130b7806aa82 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:01.611772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ca33e-f21a-4b50-bb50-130b7806aa82 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:01.612210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ca33e-f21a-4b50-bb50-130b7806aa82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:01.614874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8a5ca33e-f21a-4b50-bb50-130b7806aa82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:01.646815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ca33e-f21a-4b50-bb50-130b7806aa82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:01.648590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ca33e-f21a-4b50-bb50-130b7806aa82 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:01.659176 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3153/6249] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:31:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:31:01.690918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fce57-da26-45c5-a19e-fa1ba10b6b64 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:01.692755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2f3fce57-da26-45c5-a19e-fa1ba10b6b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:01.714706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:01.718755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fce57-da26-45c5-a19e-fa1ba10b6b64 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:01.728694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b3a2e-d7f2-4c58-a1fe-4abf637305a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:01.730202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b3a2e-d7f2-4c58-a1fe-4abf637305a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:01.730488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b3a2e-d7f2-4c58-a1fe-4abf637305a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:01.730766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b3a2e-d7f2-4c58-a1fe-4abf637305a7 admin admin] PATH_INFO: `/v3/projects/67bcce7e44eb43f6933acc741684599d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:01.732032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b3a2e-d7f2-4c58-a1fe-4abf637305a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67bcce7e44eb43f6933acc741684599d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:01.733961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b3a2e-d7f2-4c58-a1fe-4abf637305a7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:01.876272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ec1b3a2e-d7f2-4c58-a1fe-4abf637305a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67bcce7e44eb43f6933acc741684599d', 'request_id': 'req-ec1b3a2e-d7f2-4c58-a1fe-4abf637305a7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:01.889649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ec1b3a2e-d7f2-4c58-a1fe-4abf637305a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67bcce7e44eb43f6933acc741684599d', 'request_id': 'req-ec1b3a2e-d7f2-4c58-a1fe-4abf637305a7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:01.910503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ec1b3a2e-d7f2-4c58-a1fe-4abf637305a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67bcce7e44eb43f6933acc741684599d', 'request_id': 'req-ec1b3a2e-d7f2-4c58-a1fe-4abf637305a7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:02.042742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ec1b3a2e-d7f2-4c58-a1fe-4abf637305a7 admin admin] The token cache is being invalidate because project 67bcce7e44eb43f6933acc741684599d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:31:02.042870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ec1b3a2e-d7f2-4c58-a1fe-4abf637305a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:02.044323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ec1b3a2e-d7f2-4c58-a1fe-4abf637305a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:02.047200 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3097/6250] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:31:01 2022] DELETE /identity/v3/projects/67bcce7e44eb43f6933acc741684599d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:02.052201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ab2e1-07ef-4771-afa3-043d364c8e18 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:02.052772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ab2e1-07ef-4771-afa3-043d364c8e18 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:02.053727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ab2e1-07ef-4771-afa3-043d364c8e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:02.097649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7f1ab2e1-07ef-4771-afa3-043d364c8e18 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:02.099887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7f1ab2e1-07ef-4771-afa3-043d364c8e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:02.249230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d28d7d-4700-4b8b-bba1-728e56515533 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:02.250961 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3154/6251] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:02.251503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d28d7d-4700-4b8b-bba1-728e56515533 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:02.251964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d28d7d-4700-4b8b-bba1-728e56515533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:02.290346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e2d28d7d-4700-4b8b-bba1-728e56515533 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:02.291875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e2d28d7d-4700-4b8b-bba1-728e56515533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:02.310528 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3098/6252] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:31:02.315778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ab2e1-07ef-4771-afa3-043d364c8e18 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:02.333833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ab2e1-07ef-4771-afa3-043d364c8e18 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:02.341711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d11200-e927-4f2f-ac92-8bcd40b41bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:02.342626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d11200-e927-4f2f-ac92-8bcd40b41bdc admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:02.343206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d11200-e927-4f2f-ac92-8bcd40b41bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:02.343692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d11200-e927-4f2f-ac92-8bcd40b41bdc admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:02.344639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d11200-e927-4f2f-ac92-8bcd40b41bdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:31:02.345140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d11200-e927-4f2f-ac92-8bcd40b41bdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:02.347729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d11200-e927-4f2f-ac92-8bcd40b41bdc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:02.376615 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3155/6253] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:31:02.377128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d28d7d-4700-4b8b-bba1-728e56515533 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:02.393199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d28d7d-4700-4b8b-bba1-728e56515533 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:02.409818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301170a-39f0-4a0f-a4d3-3101798f99c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:02.410501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301170a-39f0-4a0f-a4d3-3101798f99c1 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:02.410832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301170a-39f0-4a0f-a4d3-3101798f99c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:02.411649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301170a-39f0-4a0f-a4d3-3101798f99c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:02.412550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301170a-39f0-4a0f-a4d3-3101798f99c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:02.414853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301170a-39f0-4a0f-a4d3-3101798f99c1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:02.517976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d11200-e927-4f2f-ac92-8bcd40b41bdc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:02.520733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-33d11200-e927-4f2f-ac92-8bcd40b41bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:02.553073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d11200-e927-4f2f-ac92-8bcd40b41bdc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:02.571609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa087b1-2bf3-4508-bc91-5ee0aedafd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:02.572713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa087b1-2bf3-4508-bc91-5ee0aedafd41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:02.573011 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa087b1-2bf3-4508-bc91-5ee0aedafd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:02.573299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa087b1-2bf3-4508-bc91-5ee0aedafd41 admin admin] PATH_INFO: `/v3/users/36edd7990bc74237bc42da638e7f22bd` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:02.574704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa087b1-2bf3-4508-bc91-5ee0aedafd41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36edd7990bc74237bc42da638e7f22bd)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:02.580130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa087b1-2bf3-4508-bc91-5ee0aedafd41 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:02.638189 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3099/6254] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:31:02 2022] POST /identity/v3/projects => generated 371 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:31:02.641739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301170a-39f0-4a0f-a4d3-3101798f99c1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:02.791903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301170a-39f0-4a0f-a4d3-3101798f99c1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:02.813285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05dcd7-b51e-49eb-96f1-2b1abd3e34e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:02.816255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05dcd7-b51e-49eb-96f1-2b1abd3e34e4 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:02.816572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05dcd7-b51e-49eb-96f1-2b1abd3e34e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:02.816901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05dcd7-b51e-49eb-96f1-2b1abd3e34e4 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:02.819305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05dcd7-b51e-49eb-96f1-2b1abd3e34e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:02.825358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05dcd7-b51e-49eb-96f1-2b1abd3e34e4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:02.868900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2aa087b1-2bf3-4508-bc91-5ee0aedafd41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36edd7990bc74237bc42da638e7f22bd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:02.885191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2aa087b1-2bf3-4508-bc91-5ee0aedafd41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36edd7990bc74237bc42da638e7f22bd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:02.993901 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3100/6255] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:31:02 2022] POST /identity/v3/users => generated 286 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:31:03.002602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05dcd7-b51e-49eb-96f1-2b1abd3e34e4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:03.015491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2aa087b1-2bf3-4508-bc91-5ee0aedafd41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36edd7990bc74237bc42da638e7f22bd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:03.016343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2aa087b1-2bf3-4508-bc91-5ee0aedafd41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36edd7990bc74237bc42da638e7f22bd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:03.036874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05dcd7-b51e-49eb-96f1-2b1abd3e34e4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:03.040252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2aa087b1-2bf3-4508-bc91-5ee0aedafd41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36edd7990bc74237bc42da638e7f22bd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:03.043847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7425909-1982-4641-a2e6-4b4847f22de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:03.045168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7425909-1982-4641-a2e6-4b4847f22de8 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:03.045371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7425909-1982-4641-a2e6-4b4847f22de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:03.046044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7425909-1982-4641-a2e6-4b4847f22de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:03.047080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7425909-1982-4641-a2e6-4b4847f22de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:03.049280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7425909-1982-4641-a2e6-4b4847f22de8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:03.056823 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3156/6256] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:31:02 2022] DELETE /identity/v3/users/36edd7990bc74237bc42da638e7f22bd => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:03.061170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce084a-e4bc-4cda-9e40-ca746be7deb6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:03.061699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce084a-e4bc-4cda-9e40-ca746be7deb6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:03.062199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce084a-e4bc-4cda-9e40-ca746be7deb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:03.067583 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3101/6257] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:31:03.073801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7425909-1982-4641-a2e6-4b4847f22de8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:03.076952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b7425909-1982-4641-a2e6-4b4847f22de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:03.093378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3dce084a-e4bc-4cda-9e40-ca746be7deb6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:03.094410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3dce084a-e4bc-4cda-9e40-ca746be7deb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:03.096126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7425909-1982-4641-a2e6-4b4847f22de8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:03.187701 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3157/6258] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:31:03.206992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce084a-e4bc-4cda-9e40-ca746be7deb6 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:03.207423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898049ab-ecce-46bf-b753-7c25ec1e61fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:03.208296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898049ab-ecce-46bf-b753-7c25ec1e61fc admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:03.209202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898049ab-ecce-46bf-b753-7c25ec1e61fc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:03.211174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898049ab-ecce-46bf-b753-7c25ec1e61fc admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:03.214337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3dce084a-e4bc-4cda-9e40-ca746be7deb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:03.217471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898049ab-ecce-46bf-b753-7c25ec1e61fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:03.221137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898049ab-ecce-46bf-b753-7c25ec1e61fc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:03.243060 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3102/6259] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:31:03.245996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898049ab-ecce-46bf-b753-7c25ec1e61fc admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:03.267677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898049ab-ecce-46bf-b753-7c25ec1e61fc admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:03.278104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc575a-2229-42e4-9824-4e073ea834f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:03.280210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc575a-2229-42e4-9824-4e073ea834f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:03.280706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc575a-2229-42e4-9824-4e073ea834f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:03.284775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc575a-2229-42e4-9824-4e073ea834f9 admin admin] PATH_INFO: `/v3/projects/f8176c18e3984c12b0d61ef9b22a7c12/users/78dbc4982ee04e718364555d1e38ad4f/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:03.307127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc575a-2229-42e4-9824-4e073ea834f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8176c18e3984c12b0d61ef9b22a7c12, user_id=78dbc4982ee04e718364555d1e38ad4f, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:03.311717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc575a-2229-42e4-9824-4e073ea834f9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:03.338014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce084a-e4bc-4cda-9e40-ca746be7deb6 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:03.344615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24239bcf-438e-4c57-8c57-494dd08ad966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:03.346074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24239bcf-438e-4c57-8c57-494dd08ad966 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:03.346437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24239bcf-438e-4c57-8c57-494dd08ad966 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:03.348980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24239bcf-438e-4c57-8c57-494dd08ad966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:03.364577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24239bcf-438e-4c57-8c57-494dd08ad966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:03.369560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24239bcf-438e-4c57-8c57-494dd08ad966 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:03.383078 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3158/6260] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:31:03.467573 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3103/6261] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:31:03 2022] PUT /identity/v3/projects/f8176c18e3984c12b0d61ef9b22a7c12/users/78dbc4982ee04e718364555d1e38ad4f/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:03.471637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a23fbd-ce3f-4163-8f1c-16fcb9827a51 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:03.474353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a23fbd-ce3f-4163-8f1c-16fcb9827a51 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:03.474353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a23fbd-ce3f-4163-8f1c-16fcb9827a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:03.547889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-38a23fbd-ce3f-4163-8f1c-16fcb9827a51 None None] MFA Rules not processed for user `78dbc4982ee04e718364555d1e38ad4f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:03.548993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-38a23fbd-ce3f-4163-8f1c-16fcb9827a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:03.591477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:03.727060 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3159/6262] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:03.741828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc575a-2229-42e4-9824-4e073ea834f9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:03.752239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-67bc575a-2229-42e4-9824-4e073ea834f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:03.833601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc575a-2229-42e4-9824-4e073ea834f9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:03.839085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ff249-3b3f-4fd8-b0e4-6cf2fd727547 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:03.839979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ff249-3b3f-4fd8-b0e4-6cf2fd727547 service glance] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:03.840555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ff249-3b3f-4fd8-b0e4-6cf2fd727547 service glance] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:03.841037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ff249-3b3f-4fd8-b0e4-6cf2fd727547 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:03.853016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ff249-3b3f-4fd8-b0e4-6cf2fd727547 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:03.854565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ff249-3b3f-4fd8-b0e4-6cf2fd727547 service glance] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:03.867410 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3104/6263] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:31:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:31:04.506707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:04.810785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a23fbd-ce3f-4163-8f1c-16fcb9827a51 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:04.812336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-38a23fbd-ce3f-4163-8f1c-16fcb9827a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:04.994729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a23fbd-ce3f-4163-8f1c-16fcb9827a51 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:05.000465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65926ec7-ac19-4743-a6fb-1808fb4b6708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:05.001553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65926ec7-ac19-4743-a6fb-1808fb4b6708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:05.001936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65926ec7-ac19-4743-a6fb-1808fb4b6708 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:05.003553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65926ec7-ac19-4743-a6fb-1808fb4b6708 admin admin] PATH_INFO: `/v3/projects/e307b4842fa742089707361a927e2903` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:05.009122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65926ec7-ac19-4743-a6fb-1808fb4b6708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e307b4842fa742089707361a927e2903)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:05.009122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65926ec7-ac19-4743-a6fb-1808fb4b6708 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:05.202825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-65926ec7-ac19-4743-a6fb-1808fb4b6708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e307b4842fa742089707361a927e2903', 'request_id': 'req-65926ec7-ac19-4743-a6fb-1808fb4b6708'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:05.223512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-65926ec7-ac19-4743-a6fb-1808fb4b6708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e307b4842fa742089707361a927e2903', 'request_id': 'req-65926ec7-ac19-4743-a6fb-1808fb4b6708'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:05.233465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-65926ec7-ac19-4743-a6fb-1808fb4b6708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e307b4842fa742089707361a927e2903', 'request_id': 'req-65926ec7-ac19-4743-a6fb-1808fb4b6708'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:05.325611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-65926ec7-ac19-4743-a6fb-1808fb4b6708 admin admin] The token cache is being invalidate because project e307b4842fa742089707361a927e2903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:31:05.326222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-65926ec7-ac19-4743-a6fb-1808fb4b6708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:05.327111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-65926ec7-ac19-4743-a6fb-1808fb4b6708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:05.328768 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3160/6264] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:31:04 2022] DELETE /identity/v3/projects/e307b4842fa742089707361a927e2903 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:05.332979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ff249-3b3f-4fd8-b0e4-6cf2fd727547 service glance] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:05.352919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ff249-3b3f-4fd8-b0e4-6cf2fd727547 service glance] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:05.556625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4e750-3a1c-4e0a-b019-b5aa3edf191b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:05.558978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4e750-3a1c-4e0a-b019-b5aa3edf191b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:05.560650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4e750-3a1c-4e0a-b019-b5aa3edf191b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:05.560941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4e750-3a1c-4e0a-b019-b5aa3edf191b admin admin] PATH_INFO: `/v3/users/8c6b5c30e3b0499a892f781c65306cd5` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:05.562433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4e750-3a1c-4e0a-b019-b5aa3edf191b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c6b5c30e3b0499a892f781c65306cd5)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:05.565381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4e750-3a1c-4e0a-b019-b5aa3edf191b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:05.831824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65926ec7-ac19-4743-a6fb-1808fb4b6708 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:05.832763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-65926ec7-ac19-4743-a6fb-1808fb4b6708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:05.845335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-00f4e750-3a1c-4e0a-b019-b5aa3edf191b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c6b5c30e3b0499a892f781c65306cd5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:05.856525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65926ec7-ac19-4743-a6fb-1808fb4b6708 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:05.861932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874dd3c1-5a45-4d55-88bd-ddebeb3c64df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:05.862815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dd3c1-5a45-4d55-88bd-ddebeb3c64df admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:05.866508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dd3c1-5a45-4d55-88bd-ddebeb3c64df admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:05.866508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dd3c1-5a45-4d55-88bd-ddebeb3c64df admin admin] PATH_INFO: `/v3/users/78dbc4982ee04e718364555d1e38ad4f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:05.866716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-00f4e750-3a1c-4e0a-b019-b5aa3edf191b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c6b5c30e3b0499a892f781c65306cd5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:05.866817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874dd3c1-5a45-4d55-88bd-ddebeb3c64df admin admin] RBAC: Authorizing `identity:delete_user(user_id=78dbc4982ee04e718364555d1e38ad4f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:05.866817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874dd3c1-5a45-4d55-88bd-ddebeb3c64df admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:05.940653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-00f4e750-3a1c-4e0a-b019-b5aa3edf191b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c6b5c30e3b0499a892f781c65306cd5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:05.950819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-00f4e750-3a1c-4e0a-b019-b5aa3edf191b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c6b5c30e3b0499a892f781c65306cd5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:05.951683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-00f4e750-3a1c-4e0a-b019-b5aa3edf191b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c6b5c30e3b0499a892f781c65306cd5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:05.961879 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3105/6265] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:31:05 2022] DELETE /identity/v3/users/8c6b5c30e3b0499a892f781c65306cd5 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:06.218499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-874dd3c1-5a45-4d55-88bd-ddebeb3c64df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78dbc4982ee04e718364555d1e38ad4f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:06.231415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-874dd3c1-5a45-4d55-88bd-ddebeb3c64df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78dbc4982ee04e718364555d1e38ad4f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:06.343703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-874dd3c1-5a45-4d55-88bd-ddebeb3c64df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78dbc4982ee04e718364555d1e38ad4f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:06.345490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-874dd3c1-5a45-4d55-88bd-ddebeb3c64df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78dbc4982ee04e718364555d1e38ad4f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:06.380950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-874dd3c1-5a45-4d55-88bd-ddebeb3c64df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78dbc4982ee04e718364555d1e38ad4f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:06.398633 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3161/6266] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:31:05 2022] DELETE /identity/v3/users/78dbc4982ee04e718364555d1e38ad4f => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:31:06.400616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ee2f1-8bf7-43ee-ab9c-c733d4cf5086 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:06.401087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ee2f1-8bf7-43ee-ab9c-c733d4cf5086 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:06.401458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ee2f1-8bf7-43ee-ab9c-c733d4cf5086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:06.428646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7e9ee2f1-8bf7-43ee-ab9c-c733d4cf5086 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:06.431711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7e9ee2f1-8bf7-43ee-ab9c-c733d4cf5086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:06.526705 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3106/6267] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:06.537099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874dd3c1-5a45-4d55-88bd-ddebeb3c64df admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:06.539755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-874dd3c1-5a45-4d55-88bd-ddebeb3c64df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:06.560659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ee2f1-8bf7-43ee-ab9c-c733d4cf5086 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:06.562095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7e9ee2f1-8bf7-43ee-ab9c-c733d4cf5086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:06.598946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ee2f1-8bf7-43ee-ab9c-c733d4cf5086 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:06.605939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aede62e-2baa-4280-912e-44fc4948d564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:06.609292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aede62e-2baa-4280-912e-44fc4948d564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:06.609696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aede62e-2baa-4280-912e-44fc4948d564 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:06.610501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aede62e-2baa-4280-912e-44fc4948d564 admin admin] PATH_INFO: `/v3/projects/5d077f6063184787bd7354033597c3eb` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:06.613520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aede62e-2baa-4280-912e-44fc4948d564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d077f6063184787bd7354033597c3eb)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:06.616344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aede62e-2baa-4280-912e-44fc4948d564 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:06.670221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874dd3c1-5a45-4d55-88bd-ddebeb3c64df admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:06.694051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8ab0a-f503-466b-987d-3259ed6b5ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:06.695791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8ab0a-f503-466b-987d-3259ed6b5ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:06.695791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8ab0a-f503-466b-987d-3259ed6b5ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:06.709104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8ab0a-f503-466b-987d-3259ed6b5ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:06.709104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8ab0a-f503-466b-987d-3259ed6b5ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:06.709104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8ab0a-f503-466b-987d-3259ed6b5ca7 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:06.719954 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3162/6268] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:31:06.812372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8aede62e-2baa-4280-912e-44fc4948d564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d077f6063184787bd7354033597c3eb', 'request_id': 'req-8aede62e-2baa-4280-912e-44fc4948d564'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:06.831741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8aede62e-2baa-4280-912e-44fc4948d564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d077f6063184787bd7354033597c3eb', 'request_id': 'req-8aede62e-2baa-4280-912e-44fc4948d564'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:06.841409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8aede62e-2baa-4280-912e-44fc4948d564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d077f6063184787bd7354033597c3eb', 'request_id': 'req-8aede62e-2baa-4280-912e-44fc4948d564'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:06.982391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8aede62e-2baa-4280-912e-44fc4948d564 admin admin] The token cache is being invalidate because project 5d077f6063184787bd7354033597c3eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:31:06.982695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8aede62e-2baa-4280-912e-44fc4948d564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:06.983399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8aede62e-2baa-4280-912e-44fc4948d564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:06.984994 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3107/6269] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:31:06 2022] DELETE /identity/v3/projects/5d077f6063184787bd7354033597c3eb => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:06.991247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24175457-30dc-47d4-8847-b545021280ae None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:06.991772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24175457-30dc-47d4-8847-b545021280ae None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:06.991989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24175457-30dc-47d4-8847-b545021280ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:07.011542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-24175457-30dc-47d4-8847-b545021280ae None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:07.012872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-24175457-30dc-47d4-8847-b545021280ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:07.081488 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3163/6270] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:07.091746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693ad2b-70dc-4ee9-8f84-50f7e3b06a66 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:07.094236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693ad2b-70dc-4ee9-8f84-50f7e3b06a66 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:07.094236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693ad2b-70dc-4ee9-8f84-50f7e3b06a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:07.134239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0693ad2b-70dc-4ee9-8f84-50f7e3b06a66 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:07.135861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0693ad2b-70dc-4ee9-8f84-50f7e3b06a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:07.145149 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3108/6271] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:07.149716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24175457-30dc-47d4-8847-b545021280ae None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:07.160939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24175457-30dc-47d4-8847-b545021280ae None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:07.169418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5ed20-bcc0-41c0-91f5-96e11d08e7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:07.171982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5ed20-bcc0-41c0-91f5-96e11d08e7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:07.171982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5ed20-bcc0-41c0-91f5-96e11d08e7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:07.171982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5ed20-bcc0-41c0-91f5-96e11d08e7d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:07.171982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5ed20-bcc0-41c0-91f5-96e11d08e7d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:31:07.171982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5ed20-bcc0-41c0-91f5-96e11d08e7d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:07.173911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5ed20-bcc0-41c0-91f5-96e11d08e7d5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:07.187353 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3164/6272] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:31:07.191949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693ad2b-70dc-4ee9-8f84-50f7e3b06a66 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:07.202784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693ad2b-70dc-4ee9-8f84-50f7e3b06a66 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:07.207815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e769d60-dfd6-4238-993d-9b940eef0977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:07.208483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e769d60-dfd6-4238-993d-9b940eef0977 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:07.208766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e769d60-dfd6-4238-993d-9b940eef0977 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:07.209067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e769d60-dfd6-4238-993d-9b940eef0977 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:07.209762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e769d60-dfd6-4238-993d-9b940eef0977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:07.211782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e769d60-dfd6-4238-993d-9b940eef0977 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:07.341056 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3109/6273] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:31:07 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:31:07.345314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5ed20-bcc0-41c0-91f5-96e11d08e7d5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:07.359212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5ed20-bcc0-41c0-91f5-96e11d08e7d5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:07.427703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:07.447604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b8762-bd0e-4449-af60-8a007eeecaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:07.448517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b8762-bd0e-4449-af60-8a007eeecaec admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:07.448819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b8762-bd0e-4449-af60-8a007eeecaec admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:07.449203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b8762-bd0e-4449-af60-8a007eeecaec admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:07.449879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b8762-bd0e-4449-af60-8a007eeecaec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:07.454966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b8762-bd0e-4449-af60-8a007eeecaec admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:07.564025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e769d60-dfd6-4238-993d-9b940eef0977 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:07.565998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4e769d60-dfd6-4238-993d-9b940eef0977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:07.580070 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3165/6274] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:31:07 2022] POST /identity/v3/users => generated 283 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:31:07.581261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e769d60-dfd6-4238-993d-9b940eef0977 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:07.581387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b8762-bd0e-4449-af60-8a007eeecaec admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:07.585914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffbd06-9626-40b2-8d36-48f4fbeb8558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:07.586981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffbd06-9626-40b2-8d36-48f4fbeb8558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:07.587473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffbd06-9626-40b2-8d36-48f4fbeb8558 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:07.587932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffbd06-9626-40b2-8d36-48f4fbeb8558 admin admin] PATH_INFO: `/v3/projects/f8176c18e3984c12b0d61ef9b22a7c12` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:07.589386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffbd06-9626-40b2-8d36-48f4fbeb8558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8176c18e3984c12b0d61ef9b22a7c12)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:07.591662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffbd06-9626-40b2-8d36-48f4fbeb8558 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:07.598749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b8762-bd0e-4449-af60-8a007eeecaec admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:07.607413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fad1f9-980e-4569-bf6d-4c6a15c8af18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:07.608220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fad1f9-980e-4569-bf6d-4c6a15c8af18 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:07.608604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fad1f9-980e-4569-bf6d-4c6a15c8af18 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:07.608988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fad1f9-980e-4569-bf6d-4c6a15c8af18 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:07.610609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fad1f9-980e-4569-bf6d-4c6a15c8af18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:07.612692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fad1f9-980e-4569-bf6d-4c6a15c8af18 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:07.632093 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3166/6275] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:31:07.636162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fad1f9-980e-4569-bf6d-4c6a15c8af18 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:07.648288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fad1f9-980e-4569-bf6d-4c6a15c8af18 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:07.655704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6487dae-463e-4e1d-bc89-36f3deec7432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:07.655704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6487dae-463e-4e1d-bc89-36f3deec7432 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:07.655704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6487dae-463e-4e1d-bc89-36f3deec7432 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:07.655704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6487dae-463e-4e1d-bc89-36f3deec7432 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:07.656756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6487dae-463e-4e1d-bc89-36f3deec7432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:07.658572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6487dae-463e-4e1d-bc89-36f3deec7432 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:07.674223 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3167/6276] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:31:07.678334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6487dae-463e-4e1d-bc89-36f3deec7432 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:07.690322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6487dae-463e-4e1d-bc89-36f3deec7432 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:07.697116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597285c-2b12-497c-9547-b982893ddf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:07.698254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597285c-2b12-497c-9547-b982893ddf15 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:07.698634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597285c-2b12-497c-9547-b982893ddf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:07.699034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597285c-2b12-497c-9547-b982893ddf15 admin admin] PATH_INFO: `/v3/projects/fadc8554d7e74d53a2a84f8c1ff2cd99/users/f3324dac4275470ba4bc74bc149a16e2/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:07.719245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597285c-2b12-497c-9547-b982893ddf15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fadc8554d7e74d53a2a84f8c1ff2cd99, user_id=f3324dac4275470ba4bc74bc149a16e2, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:07.722859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597285c-2b12-497c-9547-b982893ddf15 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:07.839317 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3168/6277] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:31:07 2022] PUT /identity/v3/projects/fadc8554d7e74d53a2a84f8c1ff2cd99/users/f3324dac4275470ba4bc74bc149a16e2/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:31:07.841308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cb284-4b3e-4344-b227-77ae9788d9d3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:07.843164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cb284-4b3e-4344-b227-77ae9788d9d3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:07.844050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cb284-4b3e-4344-b227-77ae9788d9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:07.844898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-17ffbd06-9626-40b2-8d36-48f4fbeb8558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8176c18e3984c12b0d61ef9b22a7c12', 'request_id': 'req-17ffbd06-9626-40b2-8d36-48f4fbeb8558'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:07.856329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-17ffbd06-9626-40b2-8d36-48f4fbeb8558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8176c18e3984c12b0d61ef9b22a7c12', 'request_id': 'req-17ffbd06-9626-40b2-8d36-48f4fbeb8558'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:07.868932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-17ffbd06-9626-40b2-8d36-48f4fbeb8558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8176c18e3984c12b0d61ef9b22a7c12', 'request_id': 'req-17ffbd06-9626-40b2-8d36-48f4fbeb8558'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:07.881084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ae9cb284-4b3e-4344-b227-77ae9788d9d3 None None] MFA Rules not processed for user `f3324dac4275470ba4bc74bc149a16e2`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:07.882448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ae9cb284-4b3e-4344-b227-77ae9788d9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:07.977170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-17ffbd06-9626-40b2-8d36-48f4fbeb8558 admin admin] The token cache is being invalidate because project f8176c18e3984c12b0d61ef9b22a7c12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:31:07.977741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-17ffbd06-9626-40b2-8d36-48f4fbeb8558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:07.978710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-17ffbd06-9626-40b2-8d36-48f4fbeb8558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:07.985952 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3110/6278] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:31:07 2022] DELETE /identity/v3/projects/f8176c18e3984c12b0d61ef9b22a7c12 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:31:07.987691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66b320-d1ef-4a0b-a019-606c5080a390 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:07.988237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66b320-d1ef-4a0b-a019-606c5080a390 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:07.989304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66b320-d1ef-4a0b-a019-606c5080a390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:07.991169 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3169/6279] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:07.996356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cb284-4b3e-4344-b227-77ae9788d9d3 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:08.043555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7b66b320-d1ef-4a0b-a019-606c5080a390 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:08.043555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7b66b320-d1ef-4a0b-a019-606c5080a390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:08.066438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:08.115142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cb284-4b3e-4344-b227-77ae9788d9d3 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:08.145442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753bb6d-de32-4f61-a2f7-f52d62b24b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:08.149303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753bb6d-de32-4f61-a2f7-f52d62b24b0b admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:08.150159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753bb6d-de32-4f61-a2f7-f52d62b24b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:08.152042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753bb6d-de32-4f61-a2f7-f52d62b24b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:08.153176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753bb6d-de32-4f61-a2f7-f52d62b24b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:08.156580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753bb6d-de32-4f61-a2f7-f52d62b24b0b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:08.157525 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3111/6280] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:08.182817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319ddca-09f0-4a8a-957f-e19eb414b855 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:08.184505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319ddca-09f0-4a8a-957f-e19eb414b855 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:08.184505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319ddca-09f0-4a8a-957f-e19eb414b855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:08.250342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f319ddca-09f0-4a8a-957f-e19eb414b855 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:08.259078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f319ddca-09f0-4a8a-957f-e19eb414b855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:08.267875 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3112/6281] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:08.273722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319ddca-09f0-4a8a-957f-e19eb414b855 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:08.290015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319ddca-09f0-4a8a-957f-e19eb414b855 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:08.290693 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3170/6282] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:31:07 2022] POST /identity/v3/projects => generated 363 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:31:08.297631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753bb6d-de32-4f61-a2f7-f52d62b24b0b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:08.302268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8753bb6d-de32-4f61-a2f7-f52d62b24b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:08.448183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77d30e-35f6-4c0b-b60a-55bffb80639d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:08.449332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77d30e-35f6-4c0b-b60a-55bffb80639d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:08.449827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77d30e-35f6-4c0b-b60a-55bffb80639d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:08.450518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77d30e-35f6-4c0b-b60a-55bffb80639d admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:08.452354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77d30e-35f6-4c0b-b60a-55bffb80639d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:31:08.453752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753bb6d-de32-4f61-a2f7-f52d62b24b0b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:08.456476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77d30e-35f6-4c0b-b60a-55bffb80639d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:08.460848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77d30e-35f6-4c0b-b60a-55bffb80639d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:08.469016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e7643-3e89-49e3-9c4d-30703dd8e7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:08.469804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e7643-3e89-49e3-9c4d-30703dd8e7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:08.470157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e7643-3e89-49e3-9c4d-30703dd8e7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:08.470502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e7643-3e89-49e3-9c4d-30703dd8e7a3 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:08.471369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e7643-3e89-49e3-9c4d-30703dd8e7a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:08.473505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e7643-3e89-49e3-9c4d-30703dd8e7a3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:08.543991 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3113/6283] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:31:08.550961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77d30e-35f6-4c0b-b60a-55bffb80639d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:08.604960 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3171/6284] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:31:08 2022] POST /identity/v3/users => generated 288 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:31:08.624819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e7643-3e89-49e3-9c4d-30703dd8e7a3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:08.626089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b21e7643-3e89-49e3-9c4d-30703dd8e7a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:08.639563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77d30e-35f6-4c0b-b60a-55bffb80639d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:08.651331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ec95f-49ad-4203-a1fb-561c4da6a9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:08.656301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ec95f-49ad-4203-a1fb-561c4da6a9a5 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:08.656301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ec95f-49ad-4203-a1fb-561c4da6a9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:08.656301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ec95f-49ad-4203-a1fb-561c4da6a9a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:08.656301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ec95f-49ad-4203-a1fb-561c4da6a9a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:08.657664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ec95f-49ad-4203-a1fb-561c4da6a9a5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:08.761423 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3114/6285] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:31:08 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:31:08.761423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ec95f-49ad-4203-a1fb-561c4da6a9a5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:08.827344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e7643-3e89-49e3-9c4d-30703dd8e7a3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:08.950197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ec95f-49ad-4203-a1fb-561c4da6a9a5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:08.962951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c14a4-4528-474b-95e5-e14d2b2478ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:08.963851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c14a4-4528-474b-95e5-e14d2b2478ad admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:08.964300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c14a4-4528-474b-95e5-e14d2b2478ad admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:08.964673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c14a4-4528-474b-95e5-e14d2b2478ad admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:08.965550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c14a4-4528-474b-95e5-e14d2b2478ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:08.967446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c14a4-4528-474b-95e5-e14d2b2478ad admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:08.993648 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3115/6286] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:31:08.995292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c14a4-4528-474b-95e5-e14d2b2478ad admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:09.015713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c14a4-4528-474b-95e5-e14d2b2478ad admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:09.041558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a12b82-f979-4e3b-b211-08c482663aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:09.044682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a12b82-f979-4e3b-b211-08c482663aca admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:09.045180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a12b82-f979-4e3b-b211-08c482663aca admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:09.047126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a12b82-f979-4e3b-b211-08c482663aca admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:09.061600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a12b82-f979-4e3b-b211-08c482663aca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:09.062507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531d6f7-caeb-4836-af44-7f6224d1fded service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:09.063804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a12b82-f979-4e3b-b211-08c482663aca admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:09.063931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531d6f7-caeb-4836-af44-7f6224d1fded service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:09.064363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531d6f7-caeb-4836-af44-7f6224d1fded service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:09.064820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531d6f7-caeb-4836-af44-7f6224d1fded service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:09.069566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0531d6f7-caeb-4836-af44-7f6224d1fded service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:09.097300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531d6f7-caeb-4836-af44-7f6224d1fded service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:09.101307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531d6f7-caeb-4836-af44-7f6224d1fded service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:09.151286 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3172/6287] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:31:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:31:09.152875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531d6f7-caeb-4836-af44-7f6224d1fded service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:09.177786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531d6f7-caeb-4836-af44-7f6224d1fded service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:09.187444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237770cb-fbdd-4f88-b22d-c2a89f0c5197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:09.189127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237770cb-fbdd-4f88-b22d-c2a89f0c5197 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:09.189464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237770cb-fbdd-4f88-b22d-c2a89f0c5197 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:09.190644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237770cb-fbdd-4f88-b22d-c2a89f0c5197 admin admin] PATH_INFO: `/v3/projects/5fcaa84fd8bf4732a656f1e8ef6d5a4f/users/13b6eaed879349d28ecf2e0843255148/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:09.223382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237770cb-fbdd-4f88-b22d-c2a89f0c5197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fcaa84fd8bf4732a656f1e8ef6d5a4f, user_id=13b6eaed879349d28ecf2e0843255148, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:09.235406 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3116/6288] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:31:08 2022] POST /identity/v3/users => generated 290 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:31:09.241984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a12b82-f979-4e3b-b211-08c482663aca admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:09.245894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237770cb-fbdd-4f88-b22d-c2a89f0c5197 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:09.262562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a12b82-f979-4e3b-b211-08c482663aca admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:09.269585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abcb74-856d-4d5f-a75c-2f63f9354463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:09.270455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abcb74-856d-4d5f-a75c-2f63f9354463 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:09.270817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abcb74-856d-4d5f-a75c-2f63f9354463 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:09.271803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abcb74-856d-4d5f-a75c-2f63f9354463 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:09.272661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abcb74-856d-4d5f-a75c-2f63f9354463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:09.274547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abcb74-856d-4d5f-a75c-2f63f9354463 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:09.291123 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3117/6289] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:31:09.295737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abcb74-856d-4d5f-a75c-2f63f9354463 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:09.326014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abcb74-856d-4d5f-a75c-2f63f9354463 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:09.331306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b88a3-39ae-40a0-a53b-2248b5862573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:09.332061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b88a3-39ae-40a0-a53b-2248b5862573 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:09.335669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b88a3-39ae-40a0-a53b-2248b5862573 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:09.337281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b88a3-39ae-40a0-a53b-2248b5862573 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:09.345296 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3173/6290] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:31:09 2022] PUT /identity/v3/projects/5fcaa84fd8bf4732a656f1e8ef6d5a4f/users/13b6eaed879349d28ecf2e0843255148/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:09.346542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237770cb-fbdd-4f88-b22d-c2a89f0c5197 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:09.348018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b88a3-39ae-40a0-a53b-2248b5862573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:09.359053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b88a3-39ae-40a0-a53b-2248b5862573 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:09.382737 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3118/6291] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:31:09.383913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b88a3-39ae-40a0-a53b-2248b5862573 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:09.396120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b88a3-39ae-40a0-a53b-2248b5862573 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:09.478732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237770cb-fbdd-4f88-b22d-c2a89f0c5197 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:09.484930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa9f31-9786-41a4-82d5-c60a3722647f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:09.485873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa9f31-9786-41a4-82d5-c60a3722647f admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:09.486257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa9f31-9786-41a4-82d5-c60a3722647f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:09.486632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa9f31-9786-41a4-82d5-c60a3722647f admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:09.488085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa9f31-9786-41a4-82d5-c60a3722647f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:09.491740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa9f31-9786-41a4-82d5-c60a3722647f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:09.515828 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3174/6292] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:31:09.519362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1f18b-9094-437e-9353-075aaef20912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:09.520422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa9f31-9786-41a4-82d5-c60a3722647f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:09.520648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1f18b-9094-437e-9353-075aaef20912 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:09.521438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1f18b-9094-437e-9353-075aaef20912 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:09.521736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1f18b-9094-437e-9353-075aaef20912 admin admin] PATH_INFO: `/v3/projects/3c8bccd55ba147719550062b6ef548e3/users/44b8e4a55050428dba69abcf56ea5578/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:09.548422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa9f31-9786-41a4-82d5-c60a3722647f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:09.557354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1f18b-9094-437e-9353-075aaef20912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8bccd55ba147719550062b6ef548e3, user_id=44b8e4a55050428dba69abcf56ea5578, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:09.563902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed85595-72c7-4f4c-9357-c8b4c498c3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:09.564153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1f18b-9094-437e-9353-075aaef20912 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:09.567357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed85595-72c7-4f4c-9357-c8b4c498c3dc admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:09.568918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed85595-72c7-4f4c-9357-c8b4c498c3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:09.571165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed85595-72c7-4f4c-9357-c8b4c498c3dc admin admin] PATH_INFO: `/v3/projects/5fcaa84fd8bf4732a656f1e8ef6d5a4f/users/13b6eaed879349d28ecf2e0843255148/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:09.576730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed85595-72c7-4f4c-9357-c8b4c498c3dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fcaa84fd8bf4732a656f1e8ef6d5a4f, user_id=13b6eaed879349d28ecf2e0843255148, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:09.582332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed85595-72c7-4f4c-9357-c8b4c498c3dc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:09.611781 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3175/6293] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:31:09 2022] PUT /identity/v3/projects/5fcaa84fd8bf4732a656f1e8ef6d5a4f/users/13b6eaed879349d28ecf2e0843255148/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:31:09.681686 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3119/6294] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:31:09 2022] PUT /identity/v3/projects/3c8bccd55ba147719550062b6ef548e3/users/44b8e4a55050428dba69abcf56ea5578/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:09.693239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfa1be-b482-464f-926d-4be47f64ecfb None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:09.695597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfa1be-b482-464f-926d-4be47f64ecfb None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:09.696416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfa1be-b482-464f-926d-4be47f64ecfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:09.716278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c9458-d5fa-4322-966d-012147071a65 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:09.716785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c9458-d5fa-4322-966d-012147071a65 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:09.717424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c9458-d5fa-4322-966d-012147071a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:09.766552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b25c9458-d5fa-4322-966d-012147071a65 None None] MFA Rules not processed for user `13b6eaed879349d28ecf2e0843255148`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:09.768487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b25c9458-d5fa-4322-966d-012147071a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:09.777031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-70dfa1be-b482-464f-926d-4be47f64ecfb None None] MFA Rules not processed for user `44b8e4a55050428dba69abcf56ea5578`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:09.781872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-70dfa1be-b482-464f-926d-4be47f64ecfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:09.878271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:09.888519 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3120/6295] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:09 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:31:09.950110 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3176/6296] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:31:09.962906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c9458-d5fa-4322-966d-012147071a65 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:09.964722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b25c9458-d5fa-4322-966d-012147071a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:10.025790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfa1be-b482-464f-926d-4be47f64ecfb None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:10.027734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-70dfa1be-b482-464f-926d-4be47f64ecfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:10.084602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c9458-d5fa-4322-966d-012147071a65 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:10.090356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539a771-c936-42ae-983a-1e0135b5b3d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:10.092856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539a771-c936-42ae-983a-1e0135b5b3d7 service glance] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:10.092856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539a771-c936-42ae-983a-1e0135b5b3d7 service glance] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:10.092856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539a771-c936-42ae-983a-1e0135b5b3d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:10.108117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539a771-c936-42ae-983a-1e0135b5b3d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:10.110600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539a771-c936-42ae-983a-1e0135b5b3d7 service glance] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:10.140447 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3121/6297] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:31:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:31:10.164244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfa1be-b482-464f-926d-4be47f64ecfb None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:10.172323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a12bb8-6558-4163-a869-9c4dad843ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:10.173001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a12bb8-6558-4163-a869-9c4dad843ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:10.173442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a12bb8-6558-4163-a869-9c4dad843ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:10.173774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a12bb8-6558-4163-a869-9c4dad843ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:10.201873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a12bb8-6558-4163-a869-9c4dad843ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:10.204264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a12bb8-6558-4163-a869-9c4dad843ef4 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:10.254871 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3177/6298] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:31:10 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:31:10.571451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:10.770794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539a771-c936-42ae-983a-1e0135b5b3d7 service glance] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:10.878752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539a771-c936-42ae-983a-1e0135b5b3d7 service glance] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:10.885227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23687e2c-1536-43fa-b2f5-9d899e842482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:10.886432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23687e2c-1536-43fa-b2f5-9d899e842482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:10.890588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23687e2c-1536-43fa-b2f5-9d899e842482 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:10.890588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23687e2c-1536-43fa-b2f5-9d899e842482 admin admin] PATH_INFO: `/v3/users/44b8e4a55050428dba69abcf56ea5578` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:10.897749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23687e2c-1536-43fa-b2f5-9d899e842482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44b8e4a55050428dba69abcf56ea5578)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:10.899749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23687e2c-1536-43fa-b2f5-9d899e842482 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:11.150228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-23687e2c-1536-43fa-b2f5-9d899e842482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44b8e4a55050428dba69abcf56ea5578'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:11.164844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-23687e2c-1536-43fa-b2f5-9d899e842482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44b8e4a55050428dba69abcf56ea5578'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:11.274320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-23687e2c-1536-43fa-b2f5-9d899e842482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44b8e4a55050428dba69abcf56ea5578'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:11.286955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-23687e2c-1536-43fa-b2f5-9d899e842482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44b8e4a55050428dba69abcf56ea5578'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:11.289898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-23687e2c-1536-43fa-b2f5-9d899e842482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44b8e4a55050428dba69abcf56ea5578'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:11.305076 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3122/6299] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:31:10 2022] DELETE /identity/v3/users/44b8e4a55050428dba69abcf56ea5578 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:11.309444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec69999-5a61-477a-b7af-335c0452b450 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:11.309959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec69999-5a61-477a-b7af-335c0452b450 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:11.310302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec69999-5a61-477a-b7af-335c0452b450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:11.346298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6ec69999-5a61-477a-b7af-335c0452b450 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:11.347816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6ec69999-5a61-477a-b7af-335c0452b450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:11.451111 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3178/6300] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:11.468996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23687e2c-1536-43fa-b2f5-9d899e842482 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:11.471857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-23687e2c-1536-43fa-b2f5-9d899e842482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:11.500042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:11.606754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23687e2c-1536-43fa-b2f5-9d899e842482 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:11.619881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35d1ec-8c2c-47a7-92d3-6c4816a06035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:11.621024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35d1ec-8c2c-47a7-92d3-6c4816a06035 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:11.621527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35d1ec-8c2c-47a7-92d3-6c4816a06035 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:11.622051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35d1ec-8c2c-47a7-92d3-6c4816a06035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:11.648388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35d1ec-8c2c-47a7-92d3-6c4816a06035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:11.650341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35d1ec-8c2c-47a7-92d3-6c4816a06035 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:11.671497 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3123/6301] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:31:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:31:12.588280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:12.643988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec69999-5a61-477a-b7af-335c0452b450 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:12.645593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6ec69999-5a61-477a-b7af-335c0452b450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:12.662188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:12.807514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec69999-5a61-477a-b7af-335c0452b450 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:12.820394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077523b-a02a-4547-9486-aed72638df49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:12.823694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077523b-a02a-4547-9486-aed72638df49 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:12.824249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077523b-a02a-4547-9486-aed72638df49 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:12.824830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077523b-a02a-4547-9486-aed72638df49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:12.830695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8077523b-a02a-4547-9486-aed72638df49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:12.848148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077523b-a02a-4547-9486-aed72638df49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:12.853498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077523b-a02a-4547-9486-aed72638df49 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:12.880343 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3179/6302] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:31:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:31:13.097747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35d1ec-8c2c-47a7-92d3-6c4816a06035 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:13.099300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3c35d1ec-8c2c-47a7-92d3-6c4816a06035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:13.116492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35d1ec-8c2c-47a7-92d3-6c4816a06035 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:13.131647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcafbd-2468-43b4-9aaf-ceb2fe3c8cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:13.132589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcafbd-2468-43b4-9aaf-ceb2fe3c8cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:13.133277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcafbd-2468-43b4-9aaf-ceb2fe3c8cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:13.133767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcafbd-2468-43b4-9aaf-ceb2fe3c8cc3 admin admin] PATH_INFO: `/v3/projects/3c8bccd55ba147719550062b6ef548e3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:13.135624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcafbd-2468-43b4-9aaf-ceb2fe3c8cc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c8bccd55ba147719550062b6ef548e3)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:13.138062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcafbd-2468-43b4-9aaf-ceb2fe3c8cc3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:13.321295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4cbcafbd-2468-43b4-9aaf-ceb2fe3c8cc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8bccd55ba147719550062b6ef548e3', 'request_id': 'req-4cbcafbd-2468-43b4-9aaf-ceb2fe3c8cc3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:13.328155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4cbcafbd-2468-43b4-9aaf-ceb2fe3c8cc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8bccd55ba147719550062b6ef548e3', 'request_id': 'req-4cbcafbd-2468-43b4-9aaf-ceb2fe3c8cc3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:13.334668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4cbcafbd-2468-43b4-9aaf-ceb2fe3c8cc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8bccd55ba147719550062b6ef548e3', 'request_id': 'req-4cbcafbd-2468-43b4-9aaf-ceb2fe3c8cc3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:13.436353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4cbcafbd-2468-43b4-9aaf-ceb2fe3c8cc3 admin admin] The token cache is being invalidate because project 3c8bccd55ba147719550062b6ef548e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:31:13.437253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4cbcafbd-2468-43b4-9aaf-ceb2fe3c8cc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:13.438650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4cbcafbd-2468-43b4-9aaf-ceb2fe3c8cc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:13.443411 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3124/6303] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:31:13 2022] DELETE /identity/v3/projects/3c8bccd55ba147719550062b6ef548e3 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:13.449566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73ef15-586e-4544-a7f0-39aa72438df3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:13.452505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73ef15-586e-4544-a7f0-39aa72438df3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:13.452505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73ef15-586e-4544-a7f0-39aa72438df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:13.473442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8c73ef15-586e-4544-a7f0-39aa72438df3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:13.475946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8c73ef15-586e-4544-a7f0-39aa72438df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:13.557156 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3180/6304] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:31:13.566887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0521d-a70e-4d8c-b095-f6cb2c478324 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:13.568293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0521d-a70e-4d8c-b095-f6cb2c478324 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:13.568996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0521d-a70e-4d8c-b095-f6cb2c478324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:13.594093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-dcb0521d-a70e-4d8c-b095-f6cb2c478324 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:13.595315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-dcb0521d-a70e-4d8c-b095-f6cb2c478324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:13.605722 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3125/6305] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:13.611970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73ef15-586e-4544-a7f0-39aa72438df3 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:13.625453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73ef15-586e-4544-a7f0-39aa72438df3 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:13.634518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe130f4-2684-496b-9336-94ed3551ea38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:13.635355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe130f4-2684-496b-9336-94ed3551ea38 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:13.635861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe130f4-2684-496b-9336-94ed3551ea38 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:13.636367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe130f4-2684-496b-9336-94ed3551ea38 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:13.637615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe130f4-2684-496b-9336-94ed3551ea38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:31:13.638257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe130f4-2684-496b-9336-94ed3551ea38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:13.640449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe130f4-2684-496b-9336-94ed3551ea38 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:13.656756 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3181/6306] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:31:13.662291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0521d-a70e-4d8c-b095-f6cb2c478324 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:13.677206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0521d-a70e-4d8c-b095-f6cb2c478324 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:13.685268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe29f9e-0799-4055-bcce-219d022f4881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:13.686466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe29f9e-0799-4055-bcce-219d022f4881 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:13.686779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe29f9e-0799-4055-bcce-219d022f4881 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:13.687485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe29f9e-0799-4055-bcce-219d022f4881 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:13.688815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe29f9e-0799-4055-bcce-219d022f4881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:13.691369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe29f9e-0799-4055-bcce-219d022f4881 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:13.785578 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3126/6307] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:31:13 2022] POST /identity/v3/projects => generated 389 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:31:13.793327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe130f4-2684-496b-9336-94ed3551ea38 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:13.812182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe130f4-2684-496b-9336-94ed3551ea38 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:13.911159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb3e4f-540d-4a95-a93c-fea38cca8a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:13.912244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb3e4f-540d-4a95-a93c-fea38cca8a84 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:13.912531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb3e4f-540d-4a95-a93c-fea38cca8a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:13.913323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb3e4f-540d-4a95-a93c-fea38cca8a84 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:13.914072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb3e4f-540d-4a95-a93c-fea38cca8a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:13.917585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb3e4f-540d-4a95-a93c-fea38cca8a84 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:14.038987 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3182/6308] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:31:13 2022] POST /identity/v3/users => generated 295 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:31:14.041855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe29f9e-0799-4055-bcce-219d022f4881 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:14.058471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe29f9e-0799-4055-bcce-219d022f4881 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:14.063811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eae1f-35b9-4997-bb2f-8fdf029cb75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:14.066531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eae1f-35b9-4997-bb2f-8fdf029cb75b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:14.066531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eae1f-35b9-4997-bb2f-8fdf029cb75b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:14.066531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eae1f-35b9-4997-bb2f-8fdf029cb75b admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:14.066531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282eae1f-35b9-4997-bb2f-8fdf029cb75b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:14.067657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282eae1f-35b9-4997-bb2f-8fdf029cb75b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:14.095886 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3127/6309] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:31:14.099974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb3e4f-540d-4a95-a93c-fea38cca8a84 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:14.119180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb3e4f-540d-4a95-a93c-fea38cca8a84 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:14.126016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c192412-bac8-4e14-8ed1-ef59ade236c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:14.126771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c192412-bac8-4e14-8ed1-ef59ade236c2 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:14.127176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c192412-bac8-4e14-8ed1-ef59ade236c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:14.133096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c192412-bac8-4e14-8ed1-ef59ade236c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:14.134375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c192412-bac8-4e14-8ed1-ef59ade236c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:14.136210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c192412-bac8-4e14-8ed1-ef59ade236c2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:14.157314 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3183/6310] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:31:14.158133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eae1f-35b9-4997-bb2f-8fdf029cb75b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:14.175936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eae1f-35b9-4997-bb2f-8fdf029cb75b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:14.181496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef7b95-0207-4bd3-8ba8-c34db91f712c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:14.182396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef7b95-0207-4bd3-8ba8-c34db91f712c admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:14.182678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef7b95-0207-4bd3-8ba8-c34db91f712c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:14.182951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef7b95-0207-4bd3-8ba8-c34db91f712c admin admin] PATH_INFO: `/v3/projects/489e271a765e401eb3a342c4f04c84f3/users/8b1201a39b424db499e9e028eb0193d5/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:14.199818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef7b95-0207-4bd3-8ba8-c34db91f712c admin admin] RBAC: Authorizing `identity:create_grant(project_id=489e271a765e401eb3a342c4f04c84f3, user_id=8b1201a39b424db499e9e028eb0193d5, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:14.202465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef7b95-0207-4bd3-8ba8-c34db91f712c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:14.307616 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3128/6311] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:31:14 2022] PUT /identity/v3/projects/489e271a765e401eb3a342c4f04c84f3/users/8b1201a39b424db499e9e028eb0193d5/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:31:14.319534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788a56e-beb2-4b3f-8bda-c1fda777e43f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:14.320095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788a56e-beb2-4b3f-8bda-c1fda777e43f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:14.320410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788a56e-beb2-4b3f-8bda-c1fda777e43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:14.364499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0788a56e-beb2-4b3f-8bda-c1fda777e43f None None] MFA Rules not processed for user `8b1201a39b424db499e9e028eb0193d5`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:14.365766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0788a56e-beb2-4b3f-8bda-c1fda777e43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:14.451458 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3184/6312] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:14.452311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef7b95-0207-4bd3-8ba8-c34db91f712c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:14.531219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef7b95-0207-4bd3-8ba8-c34db91f712c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:14.537666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5588f-36bf-46e6-a634-50d60378e631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:14.538427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5588f-36bf-46e6-a634-50d60378e631 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:14.538892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5588f-36bf-46e6-a634-50d60378e631 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:14.539405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5588f-36bf-46e6-a634-50d60378e631 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:14.540224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5588f-36bf-46e6-a634-50d60378e631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:14.542577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5588f-36bf-46e6-a634-50d60378e631 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:14.566242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:14.734501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:14.738756 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3129/6313] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:31:14 2022] POST /identity/v3/projects => generated 391 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:31:14.742929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788a56e-beb2-4b3f-8bda-c1fda777e43f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:14.757813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788a56e-beb2-4b3f-8bda-c1fda777e43f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:14.859316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc746b-2c57-4414-94d8-472934b8d931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:14.860544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc746b-2c57-4414-94d8-472934b8d931 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:14.860984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc746b-2c57-4414-94d8-472934b8d931 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:14.861363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc746b-2c57-4414-94d8-472934b8d931 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:14.862166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc746b-2c57-4414-94d8-472934b8d931 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:14.864396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc746b-2c57-4414-94d8-472934b8d931 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:14.973818 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3185/6314] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:31:14 2022] POST /identity/v3/users => generated 302 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:31:14.978285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5588f-36bf-46e6-a634-50d60378e631 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:14.992185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5588f-36bf-46e6-a634-50d60378e631 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:14.997958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834f3f3-249b-45d7-b7fc-99f2fd829632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:14.999315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834f3f3-249b-45d7-b7fc-99f2fd829632 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:15.001195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834f3f3-249b-45d7-b7fc-99f2fd829632 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:15.001720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834f3f3-249b-45d7-b7fc-99f2fd829632 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:15.003047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834f3f3-249b-45d7-b7fc-99f2fd829632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:15.005332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834f3f3-249b-45d7-b7fc-99f2fd829632 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:15.023065 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3130/6315] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:31:15.024614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc746b-2c57-4414-94d8-472934b8d931 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:15.041702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc746b-2c57-4414-94d8-472934b8d931 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:15.049607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6584e7a-f109-4512-b86b-747a0b05baf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:15.051080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6584e7a-f109-4512-b86b-747a0b05baf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:15.051462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6584e7a-f109-4512-b86b-747a0b05baf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:15.051815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6584e7a-f109-4512-b86b-747a0b05baf8 admin admin] PATH_INFO: `/v3/projects/b5a02154127c4532a9a3d039227de204/users/7f44ec021d36459991aad0c8e1198fc3/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:15.075982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6584e7a-f109-4512-b86b-747a0b05baf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a02154127c4532a9a3d039227de204, user_id=7f44ec021d36459991aad0c8e1198fc3, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:15.079559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6584e7a-f109-4512-b86b-747a0b05baf8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:15.198274 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3186/6316] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:31:15 2022] PUT /identity/v3/projects/b5a02154127c4532a9a3d039227de204/users/7f44ec021d36459991aad0c8e1198fc3/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:15.201897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834f3f3-249b-45d7-b7fc-99f2fd829632 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:15.213190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834f3f3-249b-45d7-b7fc-99f2fd829632 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:15.291580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac3434-b670-4df6-ab0b-a4fabbd5706f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:15.292667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac3434-b670-4df6-ab0b-a4fabbd5706f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:15.293185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac3434-b670-4df6-ab0b-a4fabbd5706f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:15.293623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac3434-b670-4df6-ab0b-a4fabbd5706f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:15.294521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac3434-b670-4df6-ab0b-a4fabbd5706f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:15.296725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac3434-b670-4df6-ab0b-a4fabbd5706f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:15.321046 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3131/6317] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:31:15.322554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6584e7a-f109-4512-b86b-747a0b05baf8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:15.338452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6584e7a-f109-4512-b86b-747a0b05baf8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:15.344794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe0984-bc0e-4891-94fd-eddfdf666b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:15.347122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe0984-bc0e-4891-94fd-eddfdf666b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:15.347122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe0984-bc0e-4891-94fd-eddfdf666b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:15.347122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe0984-bc0e-4891-94fd-eddfdf666b74 admin admin] PATH_INFO: `/v3/projects/b5a02154127c4532a9a3d039227de204/users/7f44ec021d36459991aad0c8e1198fc3/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:15.348775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe0984-bc0e-4891-94fd-eddfdf666b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a02154127c4532a9a3d039227de204, user_id=7f44ec021d36459991aad0c8e1198fc3, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:15.352647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe0984-bc0e-4891-94fd-eddfdf666b74 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:15.362196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:15.375748 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3187/6318] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:31:15 2022] PUT /identity/v3/projects/b5a02154127c4532a9a3d039227de204/users/7f44ec021d36459991aad0c8e1198fc3/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:15.389214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999b56f-2fb4-44c5-b7cd-fe21eb7ae29e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:15.389214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999b56f-2fb4-44c5-b7cd-fe21eb7ae29e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:15.389214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999b56f-2fb4-44c5-b7cd-fe21eb7ae29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:15.430203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3999b56f-2fb4-44c5-b7cd-fe21eb7ae29e None None] MFA Rules not processed for user `7f44ec021d36459991aad0c8e1198fc3`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:15.431680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3999b56f-2fb4-44c5-b7cd-fe21eb7ae29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:15.527091 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3132/6319] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:15.547994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe0984-bc0e-4891-94fd-eddfdf666b74 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:15.547994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4abe0984-bc0e-4891-94fd-eddfdf666b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:15.624101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe0984-bc0e-4891-94fd-eddfdf666b74 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:15.628721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05021456-9d70-45b9-b542-4fd4ca4437e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:15.629548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05021456-9d70-45b9-b542-4fd4ca4437e7 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:15.629788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05021456-9d70-45b9-b542-4fd4ca4437e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:15.630167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05021456-9d70-45b9-b542-4fd4ca4437e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:15.706416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05021456-9d70-45b9-b542-4fd4ca4437e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:15.708168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05021456-9d70-45b9-b542-4fd4ca4437e7 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:15.719936 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3188/6320] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:31:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:31:15.728487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:16.169053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999b56f-2fb4-44c5-b7cd-fe21eb7ae29e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:16.170670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3999b56f-2fb4-44c5-b7cd-fe21eb7ae29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:16.187618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999b56f-2fb4-44c5-b7cd-fe21eb7ae29e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:16.192979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6b05c-d629-4f34-92e9-e46ea7de1e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:16.193657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6b05c-d629-4f34-92e9-e46ea7de1e5f service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:16.194004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6b05c-d629-4f34-92e9-e46ea7de1e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:16.194284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6b05c-d629-4f34-92e9-e46ea7de1e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:16.196236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e2f6b05c-d629-4f34-92e9-e46ea7de1e5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:16.258635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6b05c-d629-4f34-92e9-e46ea7de1e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:16.260112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6b05c-d629-4f34-92e9-e46ea7de1e5f service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:16.269235 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3133/6321] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:31:16 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:31:17.125581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:17.226178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:18.266906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05021456-9d70-45b9-b542-4fd4ca4437e7 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:18.268435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-05021456-9d70-45b9-b542-4fd4ca4437e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:18.349937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05021456-9d70-45b9-b542-4fd4ca4437e7 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:18.358188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fcd8c-1cef-4eb5-b85e-5a8a6031bbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:18.359251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fcd8c-1cef-4eb5-b85e-5a8a6031bbba admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:18.359632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fcd8c-1cef-4eb5-b85e-5a8a6031bbba admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:18.359982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fcd8c-1cef-4eb5-b85e-5a8a6031bbba admin admin] PATH_INFO: `/v3/users/f3324dac4275470ba4bc74bc149a16e2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:18.361407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fcd8c-1cef-4eb5-b85e-5a8a6031bbba admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3324dac4275470ba4bc74bc149a16e2)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:18.363547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fcd8c-1cef-4eb5-b85e-5a8a6031bbba admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:18.691073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-635fcd8c-1cef-4eb5-b85e-5a8a6031bbba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3324dac4275470ba4bc74bc149a16e2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:18.701363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-635fcd8c-1cef-4eb5-b85e-5a8a6031bbba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3324dac4275470ba4bc74bc149a16e2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:18.776018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-635fcd8c-1cef-4eb5-b85e-5a8a6031bbba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3324dac4275470ba4bc74bc149a16e2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:18.777402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-635fcd8c-1cef-4eb5-b85e-5a8a6031bbba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3324dac4275470ba4bc74bc149a16e2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:18.801829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-635fcd8c-1cef-4eb5-b85e-5a8a6031bbba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3324dac4275470ba4bc74bc149a16e2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:18.813602 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3189/6322] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:31:18 2022] DELETE /identity/v3/users/f3324dac4275470ba4bc74bc149a16e2 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:18.818171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5560cc4-7161-47ac-b12a-2bf34380c2c8 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:18.829050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5560cc4-7161-47ac-b12a-2bf34380c2c8 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:18.829455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5560cc4-7161-47ac-b12a-2bf34380c2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:18.858161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b5560cc4-7161-47ac-b12a-2bf34380c2c8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:18.859943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b5560cc4-7161-47ac-b12a-2bf34380c2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:19.026600 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3134/6323] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:19.066019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fcd8c-1cef-4eb5-b85e-5a8a6031bbba admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:19.067643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-635fcd8c-1cef-4eb5-b85e-5a8a6031bbba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:19.159937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fcd8c-1cef-4eb5-b85e-5a8a6031bbba admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:19.166713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d827fb9-00f8-4bb9-8823-a36b4fa89284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:19.168307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d827fb9-00f8-4bb9-8823-a36b4fa89284 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:19.169450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d827fb9-00f8-4bb9-8823-a36b4fa89284 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:19.169830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d827fb9-00f8-4bb9-8823-a36b4fa89284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:19.174291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:19.202776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d827fb9-00f8-4bb9-8823-a36b4fa89284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:19.208306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d827fb9-00f8-4bb9-8823-a36b4fa89284 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:19.244404 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3190/6324] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:31:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:31:19.724731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:20.168222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5560cc4-7161-47ac-b12a-2bf34380c2c8 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:20.174509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b5560cc4-7161-47ac-b12a-2bf34380c2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:20.215835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5560cc4-7161-47ac-b12a-2bf34380c2c8 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:20.225000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb96de7-61be-4458-8179-5c7da2ec93e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:20.226409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb96de7-61be-4458-8179-5c7da2ec93e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:20.226881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb96de7-61be-4458-8179-5c7da2ec93e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:20.228517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb96de7-61be-4458-8179-5c7da2ec93e7 admin admin] PATH_INFO: `/v3/projects/fadc8554d7e74d53a2a84f8c1ff2cd99` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:20.233113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb96de7-61be-4458-8179-5c7da2ec93e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fadc8554d7e74d53a2a84f8c1ff2cd99)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:20.235654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb96de7-61be-4458-8179-5c7da2ec93e7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:20.462039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ffb96de7-61be-4458-8179-5c7da2ec93e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fadc8554d7e74d53a2a84f8c1ff2cd99', 'request_id': 'req-ffb96de7-61be-4458-8179-5c7da2ec93e7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:20.489835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ffb96de7-61be-4458-8179-5c7da2ec93e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fadc8554d7e74d53a2a84f8c1ff2cd99', 'request_id': 'req-ffb96de7-61be-4458-8179-5c7da2ec93e7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:20.557768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ffb96de7-61be-4458-8179-5c7da2ec93e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fadc8554d7e74d53a2a84f8c1ff2cd99', 'request_id': 'req-ffb96de7-61be-4458-8179-5c7da2ec93e7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:20.744716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ffb96de7-61be-4458-8179-5c7da2ec93e7 admin admin] The token cache is being invalidate because project fadc8554d7e74d53a2a84f8c1ff2cd99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:31:20.745093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ffb96de7-61be-4458-8179-5c7da2ec93e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:20.745855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ffb96de7-61be-4458-8179-5c7da2ec93e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:20.747798 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3135/6325] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:31:20 2022] DELETE /identity/v3/projects/fadc8554d7e74d53a2a84f8c1ff2cd99 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:20.752145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d827fb9-00f8-4bb9-8823-a36b4fa89284 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:20.767520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d827fb9-00f8-4bb9-8823-a36b4fa89284 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:20.943322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7802d51-32d6-4c32-bcdf-3941242d8ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:20.944748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7802d51-32d6-4c32-bcdf-3941242d8ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:20.945035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7802d51-32d6-4c32-bcdf-3941242d8ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:20.945313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7802d51-32d6-4c32-bcdf-3941242d8ed2 admin admin] PATH_INFO: `/v3/users/13b6eaed879349d28ecf2e0843255148` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:20.949188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7802d51-32d6-4c32-bcdf-3941242d8ed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13b6eaed879349d28ecf2e0843255148)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:20.966298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7802d51-32d6-4c32-bcdf-3941242d8ed2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:21.216042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e7802d51-32d6-4c32-bcdf-3941242d8ed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13b6eaed879349d28ecf2e0843255148'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:21.234976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e7802d51-32d6-4c32-bcdf-3941242d8ed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13b6eaed879349d28ecf2e0843255148'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:21.252049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb96de7-61be-4458-8179-5c7da2ec93e7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:21.253685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ffb96de7-61be-4458-8179-5c7da2ec93e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:21.316564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e7802d51-32d6-4c32-bcdf-3941242d8ed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13b6eaed879349d28ecf2e0843255148'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:21.317614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e7802d51-32d6-4c32-bcdf-3941242d8ed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13b6eaed879349d28ecf2e0843255148'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:21.337882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e7802d51-32d6-4c32-bcdf-3941242d8ed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13b6eaed879349d28ecf2e0843255148'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:21.356397 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3191/6326] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:31:20 2022] DELETE /identity/v3/users/13b6eaed879349d28ecf2e0843255148 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:21.378941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb96de7-61be-4458-8179-5c7da2ec93e7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:21.506783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a755459-83b2-41a3-afff-c48e9318be29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:21.507738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a755459-83b2-41a3-afff-c48e9318be29 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:21.508023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a755459-83b2-41a3-afff-c48e9318be29 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:21.508314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a755459-83b2-41a3-afff-c48e9318be29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:21.517612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7a755459-83b2-41a3-afff-c48e9318be29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:21.669452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a755459-83b2-41a3-afff-c48e9318be29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:21.671956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a755459-83b2-41a3-afff-c48e9318be29 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:21.687419 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3136/6327] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:31:21 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:31:21.804091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:22.415916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:23.658033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7802d51-32d6-4c32-bcdf-3941242d8ed2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:23.658033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e7802d51-32d6-4c32-bcdf-3941242d8ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:23.770508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7802d51-32d6-4c32-bcdf-3941242d8ed2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:23.776967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa13b0-fac2-4cdd-837a-071f39d89a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:23.778681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa13b0-fac2-4cdd-837a-071f39d89a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:23.779182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa13b0-fac2-4cdd-837a-071f39d89a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:23.779652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa13b0-fac2-4cdd-837a-071f39d89a7a admin admin] PATH_INFO: `/v3/projects/5fcaa84fd8bf4732a656f1e8ef6d5a4f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:23.781571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa13b0-fac2-4cdd-837a-071f39d89a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fcaa84fd8bf4732a656f1e8ef6d5a4f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:23.784037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa13b0-fac2-4cdd-837a-071f39d89a7a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:23.842867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:DELETE=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:23.929571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55aa13b0-fac2-4cdd-837a-071f39d89a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fcaa84fd8bf4732a656f1e8ef6d5a4f', 'request_id': 'req-55aa13b0-fac2-4cdd-837a-071f39d89a7a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:23.942447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55aa13b0-fac2-4cdd-837a-071f39d89a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fcaa84fd8bf4732a656f1e8ef6d5a4f', 'request_id': 'req-55aa13b0-fac2-4cdd-837a-071f39d89a7a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:23.960422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55aa13b0-fac2-4cdd-837a-071f39d89a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fcaa84fd8bf4732a656f1e8ef6d5a4f', 'request_id': 'req-55aa13b0-fac2-4cdd-837a-071f39d89a7a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:24.069651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55aa13b0-fac2-4cdd-837a-071f39d89a7a admin admin] The token cache is being invalidate because project 5fcaa84fd8bf4732a656f1e8ef6d5a4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:31:24.069987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55aa13b0-fac2-4cdd-837a-071f39d89a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:24.075296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55aa13b0-fac2-4cdd-837a-071f39d89a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:24.077577 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3192/6328] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:31:23 2022] DELETE /identity/v3/projects/5fcaa84fd8bf4732a656f1e8ef6d5a4f => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:24.082945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae6185-b841-44b6-a44b-0f8cb64211bf None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:24.088384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae6185-b841-44b6-a44b-0f8cb64211bf None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:24.088853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae6185-b841-44b6-a44b-0f8cb64211bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:24.114373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-06ae6185-b841-44b6-a44b-0f8cb64211bf None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:24.116723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-06ae6185-b841-44b6-a44b-0f8cb64211bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:24.231193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f6383-fa95-4516-bba6-bfb09c9b42e6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:24.231828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f6383-fa95-4516-bba6-bfb09c9b42e6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:24.232298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f6383-fa95-4516-bba6-bfb09c9b42e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:24.239668 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3137/6329] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:24.261160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f39f6383-fa95-4516-bba6-bfb09c9b42e6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:24.262498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f39f6383-fa95-4516-bba6-bfb09c9b42e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:24.277021 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3193/6330] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:31:24.278823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae6185-b841-44b6-a44b-0f8cb64211bf None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:24.290232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae6185-b841-44b6-a44b-0f8cb64211bf None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:24.295972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070516c3-52a9-4655-a16f-cb8e89a22211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:24.296831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070516c3-52a9-4655-a16f-cb8e89a22211 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:24.300367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070516c3-52a9-4655-a16f-cb8e89a22211 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:24.300367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070516c3-52a9-4655-a16f-cb8e89a22211 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:24.300367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070516c3-52a9-4655-a16f-cb8e89a22211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:31:24.300367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070516c3-52a9-4655-a16f-cb8e89a22211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:24.300367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070516c3-52a9-4655-a16f-cb8e89a22211 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:24.319857 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3138/6331] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:31:24.324026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f6383-fa95-4516-bba6-bfb09c9b42e6 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:24.337936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f6383-fa95-4516-bba6-bfb09c9b42e6 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:24.349908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86004cd2-6e96-4b22-8e67-152a019d8ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:24.350575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86004cd2-6e96-4b22-8e67-152a019d8ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:24.350863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86004cd2-6e96-4b22-8e67-152a019d8ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:24.351324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86004cd2-6e96-4b22-8e67-152a019d8ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:24.352052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86004cd2-6e96-4b22-8e67-152a019d8ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:24.357785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86004cd2-6e96-4b22-8e67-152a019d8ab9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:24.399406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:24.520714 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3194/6332] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:31:24 2022] POST /identity/v3/projects => generated 375 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:31:24.526645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070516c3-52a9-4655-a16f-cb8e89a22211 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:24.541691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070516c3-52a9-4655-a16f-cb8e89a22211 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:24.666911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762654c9-d0ca-40eb-a668-2074f2eb04cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:24.671440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762654c9-d0ca-40eb-a668-2074f2eb04cb admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:24.671440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762654c9-d0ca-40eb-a668-2074f2eb04cb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:24.671440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762654c9-d0ca-40eb-a668-2074f2eb04cb admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:24.671440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762654c9-d0ca-40eb-a668-2074f2eb04cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:24.671440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762654c9-d0ca-40eb-a668-2074f2eb04cb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:24.793128 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3139/6333] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:31:24 2022] POST /identity/v3/users => generated 288 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:31:24.795143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86004cd2-6e96-4b22-8e67-152a019d8ab9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:24.811910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86004cd2-6e96-4b22-8e67-152a019d8ab9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:24.838333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75749204-e739-430f-83a3-d0a6eff0129e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:24.839235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75749204-e739-430f-83a3-d0a6eff0129e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:24.839520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75749204-e739-430f-83a3-d0a6eff0129e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:24.839800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75749204-e739-430f-83a3-d0a6eff0129e admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:24.840563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75749204-e739-430f-83a3-d0a6eff0129e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:24.842192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75749204-e739-430f-83a3-d0a6eff0129e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:24.871514 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3195/6334] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:31:24.877690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762654c9-d0ca-40eb-a668-2074f2eb04cb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:24.903301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762654c9-d0ca-40eb-a668-2074f2eb04cb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:24.917149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03aa3d-a066-40fd-bf84-fc5cba86c72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:24.917892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03aa3d-a066-40fd-bf84-fc5cba86c72a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:24.918178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03aa3d-a066-40fd-bf84-fc5cba86c72a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:24.918652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03aa3d-a066-40fd-bf84-fc5cba86c72a admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:24.919594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03aa3d-a066-40fd-bf84-fc5cba86c72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:24.922472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03aa3d-a066-40fd-bf84-fc5cba86c72a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:24.945482 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3140/6335] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:31:24.949438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75749204-e739-430f-83a3-d0a6eff0129e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:24.968539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75749204-e739-430f-83a3-d0a6eff0129e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:24.975668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa81ef-2bc1-4618-96bd-a71c578538be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:24.987923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa81ef-2bc1-4618-96bd-a71c578538be admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:24.988620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa81ef-2bc1-4618-96bd-a71c578538be admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:24.989071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa81ef-2bc1-4618-96bd-a71c578538be admin admin] PATH_INFO: `/v3/projects/86076848c9fd4d76baba66819f4bf8fe/users/069347db04724833978612d1534ef59b/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:25.014555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa81ef-2bc1-4618-96bd-a71c578538be admin admin] RBAC: Authorizing `identity:create_grant(project_id=86076848c9fd4d76baba66819f4bf8fe, user_id=069347db04724833978612d1534ef59b, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:25.020515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa81ef-2bc1-4618-96bd-a71c578538be admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:25.152339 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3196/6336] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:31:24 2022] PUT /identity/v3/projects/86076848c9fd4d76baba66819f4bf8fe/users/069347db04724833978612d1534ef59b/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:25.163952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd7303-a1e4-48e4-98af-01202f563979 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:25.171680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd7303-a1e4-48e4-98af-01202f563979 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:25.173900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd7303-a1e4-48e4-98af-01202f563979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:25.209280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c0bd7303-a1e4-48e4-98af-01202f563979 None None] MFA Rules not processed for user `069347db04724833978612d1534ef59b`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:25.210756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c0bd7303-a1e4-48e4-98af-01202f563979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:25.304579 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3141/6337] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:25.357450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa81ef-2bc1-4618-96bd-a71c578538be admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:25.359392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9efa81ef-2bc1-4618-96bd-a71c578538be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:25.444510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa81ef-2bc1-4618-96bd-a71c578538be admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:25.451319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a6436-41d5-47cc-a05c-b23c8c9946a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:25.452392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a6436-41d5-47cc-a05c-b23c8c9946a4 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:25.456452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a6436-41d5-47cc-a05c-b23c8c9946a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:25.456452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a6436-41d5-47cc-a05c-b23c8c9946a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:25.463862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a6436-41d5-47cc-a05c-b23c8c9946a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:25.465239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a6436-41d5-47cc-a05c-b23c8c9946a4 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:25.475916 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3197/6338] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:31:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:31:25.774202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:26.148565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:27.434976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:27.608605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:28.976804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:29.239772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:30.798236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:30.839305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd7303-a1e4-48e4-98af-01202f563979 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:30.841436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c0bd7303-a1e4-48e4-98af-01202f563979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:30.938489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd7303-a1e4-48e4-98af-01202f563979 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:30.948823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1484e0-2a2c-4c2f-9531-63f7716ec6c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:30.950292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1484e0-2a2c-4c2f-9531-63f7716ec6c5 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:30.950292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1484e0-2a2c-4c2f-9531-63f7716ec6c5 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:30.950989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1484e0-2a2c-4c2f-9531-63f7716ec6c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:30.953322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2e1484e0-2a2c-4c2f-9531-63f7716ec6c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:30.970845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1484e0-2a2c-4c2f-9531-63f7716ec6c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:30.973209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1484e0-2a2c-4c2f-9531-63f7716ec6c5 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:30.990826 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3142/6339] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:31:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:31:31.072710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a6436-41d5-47cc-a05c-b23c8c9946a4 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:31.074850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-956a6436-41d5-47cc-a05c-b23c8c9946a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:31.155247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a6436-41d5-47cc-a05c-b23c8c9946a4 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:31.179932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb75619-7b4d-48d7-8396-16dc23fa148a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:31.181306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb75619-7b4d-48d7-8396-16dc23fa148a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:31.181806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb75619-7b4d-48d7-8396-16dc23fa148a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:31.182270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb75619-7b4d-48d7-8396-16dc23fa148a admin admin] PATH_INFO: `/v3/users/8b1201a39b424db499e9e028eb0193d5` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:31.184494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb75619-7b4d-48d7-8396-16dc23fa148a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b1201a39b424db499e9e028eb0193d5)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:31.186493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb75619-7b4d-48d7-8396-16dc23fa148a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:31.473046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0eb75619-7b4d-48d7-8396-16dc23fa148a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b1201a39b424db499e9e028eb0193d5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:31.504228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0eb75619-7b4d-48d7-8396-16dc23fa148a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b1201a39b424db499e9e028eb0193d5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:31.658894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0eb75619-7b4d-48d7-8396-16dc23fa148a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b1201a39b424db499e9e028eb0193d5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:31.660025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0eb75619-7b4d-48d7-8396-16dc23fa148a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b1201a39b424db499e9e028eb0193d5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:31.684792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0eb75619-7b4d-48d7-8396-16dc23fa148a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b1201a39b424db499e9e028eb0193d5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:31.703504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389161a-06db-45d1-a585-c83c39bf28d8 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:31.704115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389161a-06db-45d1-a585-c83c39bf28d8 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:31.704756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389161a-06db-45d1-a585-c83c39bf28d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:31.706621 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3198/6340] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:31:31 2022] DELETE /identity/v3/users/8b1201a39b424db499e9e028eb0193d5 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:31.736217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3389161a-06db-45d1-a585-c83c39bf28d8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:31.737854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3389161a-06db-45d1-a585-c83c39bf28d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:31.893086 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3143/6341] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:31.912161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb75619-7b4d-48d7-8396-16dc23fa148a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:31.915072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0eb75619-7b4d-48d7-8396-16dc23fa148a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:32.050902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb75619-7b4d-48d7-8396-16dc23fa148a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:32.056244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbe678-3076-4523-b715-ad53c82b4d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:32.057118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbe678-3076-4523-b715-ad53c82b4d35 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:32.057509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbe678-3076-4523-b715-ad53c82b4d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:32.059078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbe678-3076-4523-b715-ad53c82b4d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:32.073355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbe678-3076-4523-b715-ad53c82b4d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:32.074991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbe678-3076-4523-b715-ad53c82b4d35 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:32.106599 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3199/6342] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:31:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:31:32.347685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:32.911776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389161a-06db-45d1-a585-c83c39bf28d8 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:32.913332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3389161a-06db-45d1-a585-c83c39bf28d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:32.936750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389161a-06db-45d1-a585-c83c39bf28d8 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:32.949673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a16d69-a451-452e-9cbf-9c26fcbd7315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:32.951134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a16d69-a451-452e-9cbf-9c26fcbd7315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:32.951832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a16d69-a451-452e-9cbf-9c26fcbd7315 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:32.952462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a16d69-a451-452e-9cbf-9c26fcbd7315 admin admin] PATH_INFO: `/v3/projects/489e271a765e401eb3a342c4f04c84f3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:32.959820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a16d69-a451-452e-9cbf-9c26fcbd7315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=489e271a765e401eb3a342c4f04c84f3)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:32.960071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a16d69-a451-452e-9cbf-9c26fcbd7315 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:33.133073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b7a16d69-a451-452e-9cbf-9c26fcbd7315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '489e271a765e401eb3a342c4f04c84f3', 'request_id': 'req-b7a16d69-a451-452e-9cbf-9c26fcbd7315'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:33.164876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b7a16d69-a451-452e-9cbf-9c26fcbd7315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '489e271a765e401eb3a342c4f04c84f3', 'request_id': 'req-b7a16d69-a451-452e-9cbf-9c26fcbd7315'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:33.173344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b7a16d69-a451-452e-9cbf-9c26fcbd7315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '489e271a765e401eb3a342c4f04c84f3', 'request_id': 'req-b7a16d69-a451-452e-9cbf-9c26fcbd7315'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:33.356904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b7a16d69-a451-452e-9cbf-9c26fcbd7315 admin admin] The token cache is being invalidate because project 489e271a765e401eb3a342c4f04c84f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:31:33.357592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b7a16d69-a451-452e-9cbf-9c26fcbd7315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:33.358564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b7a16d69-a451-452e-9cbf-9c26fcbd7315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:33.360732 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3144/6343] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:31:32 2022] DELETE /identity/v3/projects/489e271a765e401eb3a342c4f04c84f3 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:33.366202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbe678-3076-4523-b715-ad53c82b4d35 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:33.377595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:33.377736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbe678-3076-4523-b715-ad53c82b4d35 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:33.452935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce240577-2459-4a1e-995f-fa20ece0c248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:33.457043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce240577-2459-4a1e-995f-fa20ece0c248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:33.457043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce240577-2459-4a1e-995f-fa20ece0c248 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:33.457043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce240577-2459-4a1e-995f-fa20ece0c248 admin admin] PATH_INFO: `/v3/users/7f44ec021d36459991aad0c8e1198fc3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:33.458436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce240577-2459-4a1e-995f-fa20ece0c248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f44ec021d36459991aad0c8e1198fc3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:33.462071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce240577-2459-4a1e-995f-fa20ece0c248 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:33.717588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ce240577-2459-4a1e-995f-fa20ece0c248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f44ec021d36459991aad0c8e1198fc3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:33.730127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ce240577-2459-4a1e-995f-fa20ece0c248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f44ec021d36459991aad0c8e1198fc3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:33.816902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ce240577-2459-4a1e-995f-fa20ece0c248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f44ec021d36459991aad0c8e1198fc3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:33.817851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ce240577-2459-4a1e-995f-fa20ece0c248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f44ec021d36459991aad0c8e1198fc3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:33.841006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ce240577-2459-4a1e-995f-fa20ece0c248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f44ec021d36459991aad0c8e1198fc3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:33.853185 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3200/6344] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:31:33 2022] DELETE /identity/v3/users/7f44ec021d36459991aad0c8e1198fc3 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:34.566776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a16d69-a451-452e-9cbf-9c26fcbd7315 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:34.568292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b7a16d69-a451-452e-9cbf-9c26fcbd7315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:34.596185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a16d69-a451-452e-9cbf-9c26fcbd7315 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:34.708308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcf1cc-dca9-4241-90cc-3d9f80e3ab5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:34.711842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcf1cc-dca9-4241-90cc-3d9f80e3ab5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:34.712484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcf1cc-dca9-4241-90cc-3d9f80e3ab5d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:34.713134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcf1cc-dca9-4241-90cc-3d9f80e3ab5d admin admin] PATH_INFO: `/v3/projects/b5a02154127c4532a9a3d039227de204` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:34.717082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcf1cc-dca9-4241-90cc-3d9f80e3ab5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5a02154127c4532a9a3d039227de204)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:34.717447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcf1cc-dca9-4241-90cc-3d9f80e3ab5d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:34.867738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-85fcf1cc-dca9-4241-90cc-3d9f80e3ab5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a02154127c4532a9a3d039227de204', 'request_id': 'req-85fcf1cc-dca9-4241-90cc-3d9f80e3ab5d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:34.877851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-85fcf1cc-dca9-4241-90cc-3d9f80e3ab5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a02154127c4532a9a3d039227de204', 'request_id': 'req-85fcf1cc-dca9-4241-90cc-3d9f80e3ab5d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:34.888511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-85fcf1cc-dca9-4241-90cc-3d9f80e3ab5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a02154127c4532a9a3d039227de204', 'request_id': 'req-85fcf1cc-dca9-4241-90cc-3d9f80e3ab5d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:35.027798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-85fcf1cc-dca9-4241-90cc-3d9f80e3ab5d admin admin] The token cache is being invalidate because project b5a02154127c4532a9a3d039227de204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:31:35.030005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-85fcf1cc-dca9-4241-90cc-3d9f80e3ab5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:35.031457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-85fcf1cc-dca9-4241-90cc-3d9f80e3ab5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:35.034681 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3145/6345] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:31:34 2022] DELETE /identity/v3/projects/b5a02154127c4532a9a3d039227de204 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:35.040343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9516a-0b2b-4f7a-945e-5bbfae126afa None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:35.040865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9516a-0b2b-4f7a-945e-5bbfae126afa None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:35.040953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9516a-0b2b-4f7a-945e-5bbfae126afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:35.077156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-31f9516a-0b2b-4f7a-945e-5bbfae126afa None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:35.078995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-31f9516a-0b2b-4f7a-945e-5bbfae126afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:35.197965 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3201/6346] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:35.205835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d578d-1fbb-4782-b9a5-004d3a0bf855 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:35.206765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d578d-1fbb-4782-b9a5-004d3a0bf855 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:35.207254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d578d-1fbb-4782-b9a5-004d3a0bf855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:35.237095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-320d578d-1fbb-4782-b9a5-004d3a0bf855 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:35.240750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-320d578d-1fbb-4782-b9a5-004d3a0bf855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:35.264788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9516a-0b2b-4f7a-945e-5bbfae126afa None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:35.265151 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3146/6347] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:35.278394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9516a-0b2b-4f7a-945e-5bbfae126afa None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:35.302368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783f485-f815-4d5d-ae2c-7cac70d97f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:35.309674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783f485-f815-4d5d-ae2c-7cac70d97f64 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:35.310394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783f485-f815-4d5d-ae2c-7cac70d97f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:35.310932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783f485-f815-4d5d-ae2c-7cac70d97f64 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:35.312456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783f485-f815-4d5d-ae2c-7cac70d97f64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:31:35.314175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783f485-f815-4d5d-ae2c-7cac70d97f64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:35.316116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783f485-f815-4d5d-ae2c-7cac70d97f64 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:35.349854 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3202/6348] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:31:35.350825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d578d-1fbb-4782-b9a5-004d3a0bf855 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:35.366194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d578d-1fbb-4782-b9a5-004d3a0bf855 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:35.372920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd3ef8-5ada-464b-8b4c-6d36010210e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:35.373953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd3ef8-5ada-464b-8b4c-6d36010210e5 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:35.374464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd3ef8-5ada-464b-8b4c-6d36010210e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:35.374974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd3ef8-5ada-464b-8b4c-6d36010210e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:35.376055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd3ef8-5ada-464b-8b4c-6d36010210e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:35.378534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd3ef8-5ada-464b-8b4c-6d36010210e5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:35.621360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783f485-f815-4d5d-ae2c-7cac70d97f64 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:35.622113 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3147/6349] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:31:35 2022] POST /identity/v3/projects => generated 383 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:31:35.639418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:35.656259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783f485-f815-4d5d-ae2c-7cac70d97f64 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:35.786429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fa5cb-be0a-445d-a75d-dd33341c39ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:35.787539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fa5cb-be0a-445d-a75d-dd33341c39ca admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:35.787868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fa5cb-be0a-445d-a75d-dd33341c39ca admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:35.788354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fa5cb-be0a-445d-a75d-dd33341c39ca admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:35.789227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fa5cb-be0a-445d-a75d-dd33341c39ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:35.792217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fa5cb-be0a-445d-a75d-dd33341c39ca admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:35.901507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:35.958715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd3ef8-5ada-464b-8b4c-6d36010210e5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:35.970971 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3203/6350] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:31:35 2022] POST /identity/v3/users => generated 292 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:31:35.980060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd3ef8-5ada-464b-8b4c-6d36010210e5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:35.991910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f7090-aa12-4b8d-89f6-73e2685a0aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:35.995272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f7090-aa12-4b8d-89f6-73e2685a0aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:35.995860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f7090-aa12-4b8d-89f6-73e2685a0aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:35.999316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f7090-aa12-4b8d-89f6-73e2685a0aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:35.999316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f7090-aa12-4b8d-89f6-73e2685a0aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:36.004414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f7090-aa12-4b8d-89f6-73e2685a0aa3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:36.047107 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3148/6351] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:31:36.049062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fa5cb-be0a-445d-a75d-dd33341c39ca admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:36.062092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fa5cb-be0a-445d-a75d-dd33341c39ca admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:36.067840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb564705-2aa8-4c8f-9e16-b82dada6f056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:36.069578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb564705-2aa8-4c8f-9e16-b82dada6f056 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:36.070102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb564705-2aa8-4c8f-9e16-b82dada6f056 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:36.070557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb564705-2aa8-4c8f-9e16-b82dada6f056 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:36.071543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb564705-2aa8-4c8f-9e16-b82dada6f056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:36.073365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb564705-2aa8-4c8f-9e16-b82dada6f056 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:36.092670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f7090-aa12-4b8d-89f6-73e2685a0aa3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:36.092901 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3204/6352] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:31:36.105337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f7090-aa12-4b8d-89f6-73e2685a0aa3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:36.111823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f245016-c534-4801-8beb-4ed65bd3b284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:36.113281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f245016-c534-4801-8beb-4ed65bd3b284 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:36.113800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f245016-c534-4801-8beb-4ed65bd3b284 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:36.114301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f245016-c534-4801-8beb-4ed65bd3b284 admin admin] PATH_INFO: `/v3/projects/02d25afabe4c42da90339ef48a34c4d5/users/aff30a303c074d6fb9e032fa8cd2a20d/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:36.133265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f245016-c534-4801-8beb-4ed65bd3b284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d25afabe4c42da90339ef48a34c4d5, user_id=aff30a303c074d6fb9e032fa8cd2a20d, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:36.136511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f245016-c534-4801-8beb-4ed65bd3b284 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:36.277401 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3149/6353] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:31:36 2022] PUT /identity/v3/projects/02d25afabe4c42da90339ef48a34c4d5/users/aff30a303c074d6fb9e032fa8cd2a20d/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:36.289448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be09029-0cf2-481e-94a6-e54dc705d3d9 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:36.289747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be09029-0cf2-481e-94a6-e54dc705d3d9 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:36.290075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be09029-0cf2-481e-94a6-e54dc705d3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:36.344739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2be09029-0cf2-481e-94a6-e54dc705d3d9 None None] MFA Rules not processed for user `aff30a303c074d6fb9e032fa8cd2a20d`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:36.346278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2be09029-0cf2-481e-94a6-e54dc705d3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:36.470608 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3205/6354] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:31:36.474460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f245016-c534-4801-8beb-4ed65bd3b284 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:36.672100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f245016-c534-4801-8beb-4ed65bd3b284 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:36.687596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc12c59-cc9b-4862-b824-22e1156d26f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:36.688554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc12c59-cc9b-4862-b824-22e1156d26f1 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:36.688831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc12c59-cc9b-4862-b824-22e1156d26f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:36.689117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc12c59-cc9b-4862-b824-22e1156d26f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:36.689826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc12c59-cc9b-4862-b824-22e1156d26f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:36.691803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc12c59-cc9b-4862-b824-22e1156d26f1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:36.877073 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3150/6355] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:31:36 2022] POST /identity/v3/projects => generated 383 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:31:36.881856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be09029-0cf2-481e-94a6-e54dc705d3d9 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:36.900206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be09029-0cf2-481e-94a6-e54dc705d3d9 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:37.026035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7d5d5-f9b1-4be2-a119-8c2157a76bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:37.027182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7d5d5-f9b1-4be2-a119-8c2157a76bfc admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:37.027726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7d5d5-f9b1-4be2-a119-8c2157a76bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:37.028272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7d5d5-f9b1-4be2-a119-8c2157a76bfc admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:37.029738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7d5d5-f9b1-4be2-a119-8c2157a76bfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:37.032897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7d5d5-f9b1-4be2-a119-8c2157a76bfc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:37.160142 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3206/6356] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:31:36 2022] POST /identity/v3/users => generated 298 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:31:37.164689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc12c59-cc9b-4862-b824-22e1156d26f1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:37.182039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc12c59-cc9b-4862-b824-22e1156d26f1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:37.188126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e342f25-7287-433f-b91f-04f22193edbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:37.189375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e342f25-7287-433f-b91f-04f22193edbd admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:37.190009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e342f25-7287-433f-b91f-04f22193edbd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:37.190499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e342f25-7287-433f-b91f-04f22193edbd admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:37.191581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e342f25-7287-433f-b91f-04f22193edbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:37.193963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e342f25-7287-433f-b91f-04f22193edbd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:37.215430 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3151/6357] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:31:37.216540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7d5d5-f9b1-4be2-a119-8c2157a76bfc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:37.233733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7d5d5-f9b1-4be2-a119-8c2157a76bfc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:37.240291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a7d19-3eec-4c37-95c7-3633e9a9a514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:37.242234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a7d19-3eec-4c37-95c7-3633e9a9a514 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:37.243164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a7d19-3eec-4c37-95c7-3633e9a9a514 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:37.243733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a7d19-3eec-4c37-95c7-3633e9a9a514 admin admin] PATH_INFO: `/v3/projects/2adf030f48234850990b88d7570deeb0/users/1f8f2dd4ecc94cd0a61964a27172569b/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:37.276721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a7d19-3eec-4c37-95c7-3633e9a9a514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2adf030f48234850990b88d7570deeb0, user_id=1f8f2dd4ecc94cd0a61964a27172569b, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:37.281147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a7d19-3eec-4c37-95c7-3633e9a9a514 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:37.452868 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3207/6358] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:31:37 2022] PUT /identity/v3/projects/2adf030f48234850990b88d7570deeb0/users/1f8f2dd4ecc94cd0a61964a27172569b/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:31:37.457133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e342f25-7287-433f-b91f-04f22193edbd admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:37.472519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e342f25-7287-433f-b91f-04f22193edbd admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:37.564745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a092c-fc4d-4398-bb66-e7312172e1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:37.565533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a092c-fc4d-4398-bb66-e7312172e1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:37.565981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a092c-fc4d-4398-bb66-e7312172e1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:37.566322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a092c-fc4d-4398-bb66-e7312172e1f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:37.567866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a092c-fc4d-4398-bb66-e7312172e1f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:37.569330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a092c-fc4d-4398-bb66-e7312172e1f2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:37.587861 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3152/6359] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:31:37.594416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a7d19-3eec-4c37-95c7-3633e9a9a514 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:37.619387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a7d19-3eec-4c37-95c7-3633e9a9a514 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:37.646718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835aa7b-d570-430a-a6fc-a68e83357dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:37.651513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835aa7b-d570-430a-a6fc-a68e83357dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:37.651513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835aa7b-d570-430a-a6fc-a68e83357dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:37.651513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835aa7b-d570-430a-a6fc-a68e83357dc8 admin admin] PATH_INFO: `/v3/projects/2adf030f48234850990b88d7570deeb0/users/1f8f2dd4ecc94cd0a61964a27172569b/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:37.654443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835aa7b-d570-430a-a6fc-a68e83357dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2adf030f48234850990b88d7570deeb0, user_id=1f8f2dd4ecc94cd0a61964a27172569b, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:37.657532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835aa7b-d570-430a-a6fc-a68e83357dc8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:37.697551 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3208/6360] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:31:37 2022] PUT /identity/v3/projects/2adf030f48234850990b88d7570deeb0/users/1f8f2dd4ecc94cd0a61964a27172569b/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:37.699729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3779f-cc29-4456-a2fb-71d8be3fbe52 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:37.700222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3779f-cc29-4456-a2fb-71d8be3fbe52 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:37.700312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3779f-cc29-4456-a2fb-71d8be3fbe52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:37.745193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4de3779f-cc29-4456-a2fb-71d8be3fbe52 None None] MFA Rules not processed for user `1f8f2dd4ecc94cd0a61964a27172569b`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:37.746540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4de3779f-cc29-4456-a2fb-71d8be3fbe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:37.880414 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3153/6361] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:37.916882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835aa7b-d570-430a-a6fc-a68e83357dc8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:37.918719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6835aa7b-d570-430a-a6fc-a68e83357dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:37.965241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:38.075201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:38.077724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835aa7b-d570-430a-a6fc-a68e83357dc8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:38.096225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbaa086-4499-432a-8828-6036981d3e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:38.101003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaa086-4499-432a-8828-6036981d3e8f service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:38.101677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaa086-4499-432a-8828-6036981d3e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:38.101960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaa086-4499-432a-8828-6036981d3e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:38.263483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbaa086-4499-432a-8828-6036981d3e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:38.266243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbaa086-4499-432a-8828-6036981d3e8f service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:38.286572 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3209/6362] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:31:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:31:38.319477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365510f-c17f-4b17-b406-5dcaaf87b0a6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:38.319477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365510f-c17f-4b17-b406-5dcaaf87b0a6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:38.319477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365510f-c17f-4b17-b406-5dcaaf87b0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:38.381883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a365510f-c17f-4b17-b406-5dcaaf87b0a6 None None] MFA Rules not processed for user `ca2c9e7e6d61414cbf2c7e17753bc0df`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:38.384291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a365510f-c17f-4b17-b406-5dcaaf87b0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:38.498717 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3154/6363] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:39.926180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbaa086-4499-432a-8828-6036981d3e8f service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:39.926679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0fbaa086-4499-432a-8828-6036981d3e8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:39.946399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbaa086-4499-432a-8828-6036981d3e8f service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:39.957687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5cd46-2149-4c60-b4e1-19fe59b25f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:39.959259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5cd46-2149-4c60-b4e1-19fe59b25f65 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:39.959688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5cd46-2149-4c60-b4e1-19fe59b25f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:39.960028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5cd46-2149-4c60-b4e1-19fe59b25f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:39.983943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5cd46-2149-4c60-b4e1-19fe59b25f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:39.991375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5cd46-2149-4c60-b4e1-19fe59b25f65 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:40.006352 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3210/6364] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:31:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:31:40.799059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:41.179852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:44.073206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:44.128344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:45.950693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:46.843710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:47.988521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:48.643789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:48.795233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365510f-c17f-4b17-b406-5dcaaf87b0a6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:48.797720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a365510f-c17f-4b17-b406-5dcaaf87b0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:49.054347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365510f-c17f-4b17-b406-5dcaaf87b0a6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:49.070264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43eb1c3-3a78-4a72-9947-31d4118b30e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:49.075154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43eb1c3-3a78-4a72-9947-31d4118b30e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:49.075708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43eb1c3-3a78-4a72-9947-31d4118b30e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:49.076423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43eb1c3-3a78-4a72-9947-31d4118b30e4 admin admin] PATH_INFO: `/v3/users/1006989e743247bdb29a51b3a634afd9` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:49.080417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43eb1c3-3a78-4a72-9947-31d4118b30e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1006989e743247bdb29a51b3a634afd9)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:49.086272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43eb1c3-3a78-4a72-9947-31d4118b30e4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:49.349224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d43eb1c3-3a78-4a72-9947-31d4118b30e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1006989e743247bdb29a51b3a634afd9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:49.363905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d43eb1c3-3a78-4a72-9947-31d4118b30e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1006989e743247bdb29a51b3a634afd9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:49.472376 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d43eb1c3-3a78-4a72-9947-31d4118b30e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1006989e743247bdb29a51b3a634afd9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:49.488942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d43eb1c3-3a78-4a72-9947-31d4118b30e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1006989e743247bdb29a51b3a634afd9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:49.490750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d43eb1c3-3a78-4a72-9947-31d4118b30e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1006989e743247bdb29a51b3a634afd9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:49.509988 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3155/6365] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:31:48 2022] DELETE /identity/v3/users/1006989e743247bdb29a51b3a634afd9 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:50.267617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5cd46-2149-4c60-b4e1-19fe59b25f65 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:50.282237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5cd46-2149-4c60-b4e1-19fe59b25f65 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:50.354219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:50.410442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249889fe-2a0c-49d4-87ba-134c4bb44e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:50.411807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249889fe-2a0c-49d4-87ba-134c4bb44e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:50.412834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249889fe-2a0c-49d4-87ba-134c4bb44e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:50.413693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249889fe-2a0c-49d4-87ba-134c4bb44e69 admin admin] PATH_INFO: `/v3/projects/1e8c65e58fac42c4bd7f49eaa3a14115` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:50.416351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249889fe-2a0c-49d4-87ba-134c4bb44e69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e8c65e58fac42c4bd7f49eaa3a14115)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:50.423613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249889fe-2a0c-49d4-87ba-134c4bb44e69 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:50.698657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-249889fe-2a0c-49d4-87ba-134c4bb44e69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e8c65e58fac42c4bd7f49eaa3a14115', 'request_id': 'req-249889fe-2a0c-49d4-87ba-134c4bb44e69'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:50.705788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-249889fe-2a0c-49d4-87ba-134c4bb44e69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e8c65e58fac42c4bd7f49eaa3a14115', 'request_id': 'req-249889fe-2a0c-49d4-87ba-134c4bb44e69'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:50.714926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-249889fe-2a0c-49d4-87ba-134c4bb44e69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e8c65e58fac42c4bd7f49eaa3a14115', 'request_id': 'req-249889fe-2a0c-49d4-87ba-134c4bb44e69'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:50.822087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-249889fe-2a0c-49d4-87ba-134c4bb44e69 admin admin] The token cache is being invalidate because project 1e8c65e58fac42c4bd7f49eaa3a14115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:31:50.822403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-249889fe-2a0c-49d4-87ba-134c4bb44e69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:50.823394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-249889fe-2a0c-49d4-87ba-134c4bb44e69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:50.826604 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3211/6366] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:31:50 2022] DELETE /identity/v3/projects/1e8c65e58fac42c4bd7f49eaa3a14115 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:50.830615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43eb1c3-3a78-4a72-9947-31d4118b30e4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:50.833358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d43eb1c3-3a78-4a72-9947-31d4118b30e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:50.855845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43eb1c3-3a78-4a72-9947-31d4118b30e4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:50.972686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf467d1-d9b4-47bc-9634-0ddb2d824201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:50.975073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf467d1-d9b4-47bc-9634-0ddb2d824201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:50.975073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf467d1-d9b4-47bc-9634-0ddb2d824201 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:50.975505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf467d1-d9b4-47bc-9634-0ddb2d824201 admin admin] PATH_INFO: `/v3/users/82c9a9a2c0314af6b17278c94b73c7e0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:50.977324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf467d1-d9b4-47bc-9634-0ddb2d824201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82c9a9a2c0314af6b17278c94b73c7e0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:50.981602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf467d1-d9b4-47bc-9634-0ddb2d824201 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:51.284805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7bf467d1-d9b4-47bc-9634-0ddb2d824201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82c9a9a2c0314af6b17278c94b73c7e0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:51.307314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:51.322159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7bf467d1-d9b4-47bc-9634-0ddb2d824201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82c9a9a2c0314af6b17278c94b73c7e0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:51.454841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7bf467d1-d9b4-47bc-9634-0ddb2d824201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82c9a9a2c0314af6b17278c94b73c7e0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:51.467690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7bf467d1-d9b4-47bc-9634-0ddb2d824201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82c9a9a2c0314af6b17278c94b73c7e0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:51.468468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7bf467d1-d9b4-47bc-9634-0ddb2d824201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82c9a9a2c0314af6b17278c94b73c7e0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:51.482967 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3156/6367] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:31:50 2022] DELETE /identity/v3/users/82c9a9a2c0314af6b17278c94b73c7e0 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:51.950987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:52.737928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249889fe-2a0c-49d4-87ba-134c4bb44e69 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:52.741388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-249889fe-2a0c-49d4-87ba-134c4bb44e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:52.779657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249889fe-2a0c-49d4-87ba-134c4bb44e69 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:52.934333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ac622-7096-4a7a-a37c-3059237d89fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:52.935684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ac622-7096-4a7a-a37c-3059237d89fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:52.936802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ac622-7096-4a7a-a37c-3059237d89fc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:52.937954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ac622-7096-4a7a-a37c-3059237d89fc admin admin] PATH_INFO: `/v3/projects/afdb1fa03c5746618068bca1af8f825e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:52.939778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ac622-7096-4a7a-a37c-3059237d89fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=afdb1fa03c5746618068bca1af8f825e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:52.946168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ac622-7096-4a7a-a37c-3059237d89fc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:53.157258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-296ac622-7096-4a7a-a37c-3059237d89fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afdb1fa03c5746618068bca1af8f825e', 'request_id': 'req-296ac622-7096-4a7a-a37c-3059237d89fc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:53.171446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-296ac622-7096-4a7a-a37c-3059237d89fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afdb1fa03c5746618068bca1af8f825e', 'request_id': 'req-296ac622-7096-4a7a-a37c-3059237d89fc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:53.184248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-296ac622-7096-4a7a-a37c-3059237d89fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afdb1fa03c5746618068bca1af8f825e', 'request_id': 'req-296ac622-7096-4a7a-a37c-3059237d89fc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:53.319506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-296ac622-7096-4a7a-a37c-3059237d89fc admin admin] The token cache is being invalidate because project afdb1fa03c5746618068bca1af8f825e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:31:53.320721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-296ac622-7096-4a7a-a37c-3059237d89fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:53.322160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-296ac622-7096-4a7a-a37c-3059237d89fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:53.332365 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3212/6368] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:31:52 2022] DELETE /identity/v3/projects/afdb1fa03c5746618068bca1af8f825e => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:53.332457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a864605-d343-43f6-9f04-3ad82ad529fe None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:53.332457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a864605-d343-43f6-9f04-3ad82ad529fe None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:53.332457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a864605-d343-43f6-9f04-3ad82ad529fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:53.357240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8a864605-d343-43f6-9f04-3ad82ad529fe None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:53.358560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8a864605-d343-43f6-9f04-3ad82ad529fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:53.455180 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3157/6369] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:53.457117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b4bb2-c29a-481f-96d8-9d35fbda1ba5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:53.457554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b4bb2-c29a-481f-96d8-9d35fbda1ba5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:53.458344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b4bb2-c29a-481f-96d8-9d35fbda1ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:53.487080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-003b4bb2-c29a-481f-96d8-9d35fbda1ba5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:53.491425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-003b4bb2-c29a-481f-96d8-9d35fbda1ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:53.505979 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3213/6370] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:53.510664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a864605-d343-43f6-9f04-3ad82ad529fe None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:53.527694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a864605-d343-43f6-9f04-3ad82ad529fe None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:53.533632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802416af-05e0-4341-9f45-af48d8a0316f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:53.534510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802416af-05e0-4341-9f45-af48d8a0316f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:53.538144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802416af-05e0-4341-9f45-af48d8a0316f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:53.538144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802416af-05e0-4341-9f45-af48d8a0316f admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:53.538144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802416af-05e0-4341-9f45-af48d8a0316f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:31:53.538144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802416af-05e0-4341-9f45-af48d8a0316f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:53.538951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802416af-05e0-4341-9f45-af48d8a0316f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:53.558691 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3158/6371] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:31:53.560434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b4bb2-c29a-481f-96d8-9d35fbda1ba5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:53.579806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b4bb2-c29a-481f-96d8-9d35fbda1ba5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:53.588544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bef0d-2183-4107-86f1-96961ce04562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:53.589227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bef0d-2183-4107-86f1-96961ce04562 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:53.589560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bef0d-2183-4107-86f1-96961ce04562 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:53.590027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bef0d-2183-4107-86f1-96961ce04562 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:53.591229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bef0d-2183-4107-86f1-96961ce04562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:53.593910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bef0d-2183-4107-86f1-96961ce04562 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:53.719599 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3214/6372] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:31:53 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:31:53.720592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802416af-05e0-4341-9f45-af48d8a0316f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:53.729766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:53.738432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802416af-05e0-4341-9f45-af48d8a0316f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:53.838644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:53.882298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d466d-6420-48f4-87e8-4c381fc691d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:53.882950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d466d-6420-48f4-87e8-4c381fc691d8 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:53.883330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d466d-6420-48f4-87e8-4c381fc691d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:53.883616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d466d-6420-48f4-87e8-4c381fc691d8 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:53.884370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d466d-6420-48f4-87e8-4c381fc691d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:53.886440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d466d-6420-48f4-87e8-4c381fc691d8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:53.996081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bef0d-2183-4107-86f1-96961ce04562 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:53.996417 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3159/6373] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:31:53 2022] POST /identity/v3/users => generated 286 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:31:54.015234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bef0d-2183-4107-86f1-96961ce04562 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:54.033502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7716e-1d6c-430e-b653-85fdd30a6d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:54.041083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7716e-1d6c-430e-b653-85fdd30a6d24 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:54.041960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7716e-1d6c-430e-b653-85fdd30a6d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:54.042459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7716e-1d6c-430e-b653-85fdd30a6d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:54.044013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7716e-1d6c-430e-b653-85fdd30a6d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:54.045832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7716e-1d6c-430e-b653-85fdd30a6d24 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:54.066441 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3215/6374] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:31:54.072585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d466d-6420-48f4-87e8-4c381fc691d8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:54.087506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d466d-6420-48f4-87e8-4c381fc691d8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:54.104109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c0373-3344-4a08-846a-c33d46ad285f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:54.105028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c0373-3344-4a08-846a-c33d46ad285f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:54.105430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c0373-3344-4a08-846a-c33d46ad285f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:54.105841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c0373-3344-4a08-846a-c33d46ad285f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:54.106667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c0373-3344-4a08-846a-c33d46ad285f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:54.110709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c0373-3344-4a08-846a-c33d46ad285f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:54.139677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7716e-1d6c-430e-b653-85fdd30a6d24 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:54.142465 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3160/6375] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:31:54.157891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7716e-1d6c-430e-b653-85fdd30a6d24 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:54.171781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e2e0b-5262-4e81-a699-f8953603d5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:54.172954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e2e0b-5262-4e81-a699-f8953603d5d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:54.173400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e2e0b-5262-4e81-a699-f8953603d5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:54.176450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e2e0b-5262-4e81-a699-f8953603d5d0 admin admin] PATH_INFO: `/v3/projects/ce30584a7dfa4ab19de73aa8b18b113b/users/4fa446573f7d42de816280280c3dec19/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:54.210765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e2e0b-5262-4e81-a699-f8953603d5d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce30584a7dfa4ab19de73aa8b18b113b, user_id=4fa446573f7d42de816280280c3dec19, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:54.213727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e2e0b-5262-4e81-a699-f8953603d5d0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:54.402906 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3216/6376] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:31:54 2022] PUT /identity/v3/projects/ce30584a7dfa4ab19de73aa8b18b113b/users/4fa446573f7d42de816280280c3dec19/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:54.407970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0068933-3f5f-417b-b173-193277e54491 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:54.408886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0068933-3f5f-417b-b173-193277e54491 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:54.409621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0068933-3f5f-417b-b173-193277e54491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:54.433514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c0068933-3f5f-417b-b173-193277e54491 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:54.435129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c0068933-3f5f-417b-b173-193277e54491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:54.525736 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3161/6377] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:31:54.539543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e2e0b-5262-4e81-a699-f8953603d5d0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:54.548084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-343e2e0b-5262-4e81-a699-f8953603d5d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:54.658424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e2e0b-5262-4e81-a699-f8953603d5d0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:54.664390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9add0-1c17-4882-ad09-3dba12a173ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:54.665455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9add0-1c17-4882-ad09-3dba12a173ff service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:54.665898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9add0-1c17-4882-ad09-3dba12a173ff service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:54.666377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9add0-1c17-4882-ad09-3dba12a173ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:54.688781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9add0-1c17-4882-ad09-3dba12a173ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:54.688781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9add0-1c17-4882-ad09-3dba12a173ff service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:54.695132 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3217/6378] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:31:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:31:55.292917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:55.447366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:56.055214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021ee34-2049-4f29-a97b-e7a438bcee53 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:56.055742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021ee34-2049-4f29-a97b-e7a438bcee53 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:56.055913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021ee34-2049-4f29-a97b-e7a438bcee53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:56.086795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6021ee34-2049-4f29-a97b-e7a438bcee53 None None] MFA Rules not processed for user `4ddfae3448704591b662de83b97a1876`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:56.088326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6021ee34-2049-4f29-a97b-e7a438bcee53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:56.191758 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3162/6379] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:56.709858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9add0-1c17-4882-ad09-3dba12a173ff service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:56.721139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9add0-1c17-4882-ad09-3dba12a173ff service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:56.725584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d8709-0205-4d56-b65d-f6ce61f1b2b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:56.726253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d8709-0205-4d56-b65d-f6ce61f1b2b1 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:56.726539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d8709-0205-4d56-b65d-f6ce61f1b2b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:56.726817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d8709-0205-4d56-b65d-f6ce61f1b2b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:56.729027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-da9d8709-0205-4d56-b65d-f6ce61f1b2b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:56.741010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d8709-0205-4d56-b65d-f6ce61f1b2b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:56.742518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d8709-0205-4d56-b65d-f6ce61f1b2b1 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:56.752529 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3218/6380] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:31:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:31:56.898489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021ee34-2049-4f29-a97b-e7a438bcee53 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:56.898489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6021ee34-2049-4f29-a97b-e7a438bcee53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:56.913475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021ee34-2049-4f29-a97b-e7a438bcee53 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:56.935038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74550721-7c86-43d2-a290-8d1ef55682d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:56.936411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74550721-7c86-43d2-a290-8d1ef55682d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:56.936885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74550721-7c86-43d2-a290-8d1ef55682d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:56.937381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74550721-7c86-43d2-a290-8d1ef55682d0 admin admin] PATH_INFO: `/v3/users/da77ec3d0f04496d8c8df4025bba76d1` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:56.941491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74550721-7c86-43d2-a290-8d1ef55682d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da77ec3d0f04496d8c8df4025bba76d1)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:56.945445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74550721-7c86-43d2-a290-8d1ef55682d0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:57.181342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-74550721-7c86-43d2-a290-8d1ef55682d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da77ec3d0f04496d8c8df4025bba76d1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:57.206268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-74550721-7c86-43d2-a290-8d1ef55682d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da77ec3d0f04496d8c8df4025bba76d1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:57.301080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-74550721-7c86-43d2-a290-8d1ef55682d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da77ec3d0f04496d8c8df4025bba76d1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:57.313171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-74550721-7c86-43d2-a290-8d1ef55682d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da77ec3d0f04496d8c8df4025bba76d1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:57.315217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-74550721-7c86-43d2-a290-8d1ef55682d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da77ec3d0f04496d8c8df4025bba76d1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:57.329770 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3163/6381] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:31:56 2022] DELETE /identity/v3/users/da77ec3d0f04496d8c8df4025bba76d1 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:57.390002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:57.557882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:58.203063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d8709-0205-4d56-b65d-f6ce61f1b2b1 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:58.224085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d8709-0205-4d56-b65d-f6ce61f1b2b1 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:58.353957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147009f-561e-4c35-9dee-4ef952d717a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:58.355614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147009f-561e-4c35-9dee-4ef952d717a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:58.356158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147009f-561e-4c35-9dee-4ef952d717a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:58.356608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147009f-561e-4c35-9dee-4ef952d717a6 admin admin] PATH_INFO: `/v3/projects/207ec2d1883c4a1ba89696e6e77cf3aa` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:58.358691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147009f-561e-4c35-9dee-4ef952d717a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=207ec2d1883c4a1ba89696e6e77cf3aa)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:58.361496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147009f-561e-4c35-9dee-4ef952d717a6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:58.592181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7147009f-561e-4c35-9dee-4ef952d717a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '207ec2d1883c4a1ba89696e6e77cf3aa', 'request_id': 'req-7147009f-561e-4c35-9dee-4ef952d717a6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:58.600045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7147009f-561e-4c35-9dee-4ef952d717a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '207ec2d1883c4a1ba89696e6e77cf3aa', 'request_id': 'req-7147009f-561e-4c35-9dee-4ef952d717a6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:58.607608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7147009f-561e-4c35-9dee-4ef952d717a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '207ec2d1883c4a1ba89696e6e77cf3aa', 'request_id': 'req-7147009f-561e-4c35-9dee-4ef952d717a6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:58.735183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7147009f-561e-4c35-9dee-4ef952d717a6 admin admin] The token cache is being invalidate because project 207ec2d1883c4a1ba89696e6e77cf3aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:31:58.735472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7147009f-561e-4c35-9dee-4ef952d717a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:58.738395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7147009f-561e-4c35-9dee-4ef952d717a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:31:58.747535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60274ccb-c6ac-44b2-88c7-a4ed54e4d46d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:58.748136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60274ccb-c6ac-44b2-88c7-a4ed54e4d46d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:58.748136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60274ccb-c6ac-44b2-88c7-a4ed54e4d46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:58.751240 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3219/6382] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:31:58 2022] DELETE /identity/v3/projects/207ec2d1883c4a1ba89696e6e77cf3aa => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:58.773848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-60274ccb-c6ac-44b2-88c7-a4ed54e4d46d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:58.775614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-60274ccb-c6ac-44b2-88c7-a4ed54e4d46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:58.877087 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3164/6383] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:58.885167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118fff4-7812-436d-b333-82cdd8ef2974 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:58.885514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118fff4-7812-436d-b333-82cdd8ef2974 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:58.886184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118fff4-7812-436d-b333-82cdd8ef2974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:58.929569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5118fff4-7812-436d-b333-82cdd8ef2974 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:58.931056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5118fff4-7812-436d-b333-82cdd8ef2974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:31:58.950472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60274ccb-c6ac-44b2-88c7-a4ed54e4d46d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:58.958047 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3220/6384] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:31:58.963280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60274ccb-c6ac-44b2-88c7-a4ed54e4d46d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:58.969311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b73579-69ff-47c5-b695-d4e90dd4dabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:58.970307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b73579-69ff-47c5-b695-d4e90dd4dabf admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:58.970768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b73579-69ff-47c5-b695-d4e90dd4dabf admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:58.971273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b73579-69ff-47c5-b695-d4e90dd4dabf admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:58.972326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b73579-69ff-47c5-b695-d4e90dd4dabf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:31:58.972813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b73579-69ff-47c5-b695-d4e90dd4dabf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:58.975589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b73579-69ff-47c5-b695-d4e90dd4dabf admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:58.992752 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3165/6385] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:31:58.996858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118fff4-7812-436d-b333-82cdd8ef2974 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:59.014918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118fff4-7812-436d-b333-82cdd8ef2974 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:59.021303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef18892-d261-4a4d-9728-549163e2d65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:59.021988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef18892-d261-4a4d-9728-549163e2d65a admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:59.022274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef18892-d261-4a4d-9728-549163e2d65a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:59.029991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef18892-d261-4a4d-9728-549163e2d65a admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:59.031866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef18892-d261-4a4d-9728-549163e2d65a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:59.033213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:59.039560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef18892-d261-4a4d-9728-549163e2d65a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:59.185048 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3221/6386] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:31:58 2022] POST /identity/v3/projects => generated 371 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:31:59.189088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b73579-69ff-47c5-b695-d4e90dd4dabf admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:59.202713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b73579-69ff-47c5-b695-d4e90dd4dabf admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:59.374305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb920a-2800-411f-b9cd-0944e2ca6b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:59.375305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb920a-2800-411f-b9cd-0944e2ca6b1c admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:59.375878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb920a-2800-411f-b9cd-0944e2ca6b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:59.376362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb920a-2800-411f-b9cd-0944e2ca6b1c admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:59.377990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb920a-2800-411f-b9cd-0944e2ca6b1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:59.381470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb920a-2800-411f-b9cd-0944e2ca6b1c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:59.522308 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3166/6387] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:31:59 2022] POST /identity/v3/users => generated 286 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:31:59.526263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef18892-d261-4a4d-9728-549163e2d65a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:59.542252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef18892-d261-4a4d-9728-549163e2d65a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:59.548938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95afdf4-36ac-435f-b73c-cf4bf9ba9f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:59.550083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95afdf4-36ac-435f-b73c-cf4bf9ba9f88 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:59.550548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95afdf4-36ac-435f-b73c-cf4bf9ba9f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:59.550983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95afdf4-36ac-435f-b73c-cf4bf9ba9f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:59.552738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95afdf4-36ac-435f-b73c-cf4bf9ba9f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:59.554839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95afdf4-36ac-435f-b73c-cf4bf9ba9f88 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:59.568129 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3222/6388] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:31:59.572497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb920a-2800-411f-b9cd-0944e2ca6b1c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:59.586165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb920a-2800-411f-b9cd-0944e2ca6b1c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:59.592628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294e9eb-d3fd-42e8-922f-b1065cded59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:59.593447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294e9eb-d3fd-42e8-922f-b1065cded59f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:59.593836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294e9eb-d3fd-42e8-922f-b1065cded59f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:59.594262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294e9eb-d3fd-42e8-922f-b1065cded59f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:59.595138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294e9eb-d3fd-42e8-922f-b1065cded59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:59.598000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294e9eb-d3fd-42e8-922f-b1065cded59f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:59.634444 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3167/6389] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:31:59.639082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95afdf4-36ac-435f-b73c-cf4bf9ba9f88 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:31:59.682288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95afdf4-36ac-435f-b73c-cf4bf9ba9f88 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:31:59.697185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bdac4-08c1-49b4-83d5-799d8875e99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:31:59.721161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bdac4-08c1-49b4-83d5-799d8875e99e admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:59.721161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bdac4-08c1-49b4-83d5-799d8875e99e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:59.721161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bdac4-08c1-49b4-83d5-799d8875e99e admin admin] PATH_INFO: `/v3/projects/367c69301e6a44419af5c2d28b616b80/users/08abcba4284e434680ee4640f1541cf9/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:59.737708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bdac4-08c1-49b4-83d5-799d8875e99e admin admin] RBAC: Authorizing `identity:create_grant(project_id=367c69301e6a44419af5c2d28b616b80, user_id=08abcba4284e434680ee4640f1541cf9, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:31:59.741002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bdac4-08c1-49b4-83d5-799d8875e99e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:31:59.924346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:31:59.938433 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3223/6390] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:31:59 2022] PUT /identity/v3/projects/367c69301e6a44419af5c2d28b616b80/users/08abcba4284e434680ee4640f1541cf9/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:31:59.944531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e032c1-0a6b-4bbd-a5cb-f57c9f4853b3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:31:59.945550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e032c1-0a6b-4bbd-a5cb-f57c9f4853b3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:31:59.946014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e032c1-0a6b-4bbd-a5cb-f57c9f4853b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:31:59.984017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-45e032c1-0a6b-4bbd-a5cb-f57c9f4853b3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:31:59.986807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-45e032c1-0a6b-4bbd-a5cb-f57c9f4853b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:00.194160 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3168/6391] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:00.237448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bdac4-08c1-49b4-83d5-799d8875e99e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:00.239533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-702bdac4-08c1-49b4-83d5-799d8875e99e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:00.384841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bdac4-08c1-49b4-83d5-799d8875e99e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:00.390431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc40e83-63c6-4e30-8dc2-4ba1e82cac8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:00.391748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc40e83-63c6-4e30-8dc2-4ba1e82cac8b service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:00.399690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc40e83-63c6-4e30-8dc2-4ba1e82cac8b service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:00.400243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc40e83-63c6-4e30-8dc2-4ba1e82cac8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:00.418124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc40e83-63c6-4e30-8dc2-4ba1e82cac8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:00.420430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc40e83-63c6-4e30-8dc2-4ba1e82cac8b service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:00.436159 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3224/6392] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:32:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:32:01.357804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:01.666963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:03.730494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:04.142841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:04.470936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e032c1-0a6b-4bbd-a5cb-f57c9f4853b3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:04.470936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-45e032c1-0a6b-4bbd-a5cb-f57c9f4853b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:04.512851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:04.614600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e032c1-0a6b-4bbd-a5cb-f57c9f4853b3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:04.628454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b6ad6-69df-4eb2-a35c-2fde0ecb2b77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:04.630187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b6ad6-69df-4eb2-a35c-2fde0ecb2b77 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:04.630644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b6ad6-69df-4eb2-a35c-2fde0ecb2b77 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:04.631122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b6ad6-69df-4eb2-a35c-2fde0ecb2b77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:04.640455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8f8b6ad6-69df-4eb2-a35c-2fde0ecb2b77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:04.671061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b6ad6-69df-4eb2-a35c-2fde0ecb2b77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:04.673662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b6ad6-69df-4eb2-a35c-2fde0ecb2b77 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:04.708244 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3169/6393] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:32:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:32:05.859244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:06.346908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:07.481278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:07.871780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:08.542423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:08.976795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc40e83-63c6-4e30-8dc2-4ba1e82cac8b service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:08.981900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1bc40e83-63c6-4e30-8dc2-4ba1e82cac8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:09.003044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc40e83-63c6-4e30-8dc2-4ba1e82cac8b service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:09.009413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc9141-e32e-45b7-93cf-3491b0783edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:09.010785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc9141-e32e-45b7-93cf-3491b0783edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:09.011312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc9141-e32e-45b7-93cf-3491b0783edd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:09.011929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc9141-e32e-45b7-93cf-3491b0783edd admin admin] PATH_INFO: `/v3/users/069347db04724833978612d1534ef59b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:09.013917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc9141-e32e-45b7-93cf-3491b0783edd admin admin] RBAC: Authorizing `identity:delete_user(user_id=069347db04724833978612d1534ef59b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:09.016310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc9141-e32e-45b7-93cf-3491b0783edd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:09.106375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:09.193303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a7e6f-7e1a-4411-9aba-c9b6c734b68b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:09.194024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a7e6f-7e1a-4411-9aba-c9b6c734b68b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:09.194378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a7e6f-7e1a-4411-9aba-c9b6c734b68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:09.230954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-326a7e6f-7e1a-4411-9aba-c9b6c734b68b None None] MFA Rules not processed for user `4fa446573f7d42de816280280c3dec19`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:09.232634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-326a7e6f-7e1a-4411-9aba-c9b6c734b68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:09.278759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-32cc9141-e32e-45b7-93cf-3491b0783edd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '069347db04724833978612d1534ef59b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:09.294807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-32cc9141-e32e-45b7-93cf-3491b0783edd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '069347db04724833978612d1534ef59b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:09.354590 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3170/6394] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:09.359167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a7e6f-7e1a-4411-9aba-c9b6c734b68b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:09.361309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-326a7e6f-7e1a-4411-9aba-c9b6c734b68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:09.402584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-32cc9141-e32e-45b7-93cf-3491b0783edd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '069347db04724833978612d1534ef59b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:09.405930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-32cc9141-e32e-45b7-93cf-3491b0783edd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '069347db04724833978612d1534ef59b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:09.424851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a7e6f-7e1a-4411-9aba-c9b6c734b68b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:09.435334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-32cc9141-e32e-45b7-93cf-3491b0783edd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '069347db04724833978612d1534ef59b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:09.438656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08632ce0-53fc-44bd-9c4c-033fbf4efa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:09.440200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08632ce0-53fc-44bd-9c4c-033fbf4efa3f admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:09.443384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08632ce0-53fc-44bd-9c4c-033fbf4efa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:09.443812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08632ce0-53fc-44bd-9c4c-033fbf4efa3f admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:09.445063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08632ce0-53fc-44bd-9c4c-033fbf4efa3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:09.470356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08632ce0-53fc-44bd-9c4c-033fbf4efa3f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:09.480547 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3225/6395] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:32:08 2022] DELETE /identity/v3/users/069347db04724833978612d1534ef59b => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:09.482512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50541a0-8089-435d-84c1-712af0b37e4c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:09.482907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50541a0-8089-435d-84c1-712af0b37e4c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:09.488003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50541a0-8089-435d-84c1-712af0b37e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:09.526288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e50541a0-8089-435d-84c1-712af0b37e4c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:09.527843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e50541a0-8089-435d-84c1-712af0b37e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:09.644483 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3171/6396] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:32:09 2022] POST /identity/v3/projects => generated 371 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:32:09.648647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08632ce0-53fc-44bd-9c4c-033fbf4efa3f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:09.650590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-08632ce0-53fc-44bd-9c4c-033fbf4efa3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:09.665673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:09.735338 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3226/6397] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:09.814677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50541a0-8089-435d-84c1-712af0b37e4c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:09.818223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e50541a0-8089-435d-84c1-712af0b37e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:09.825928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08632ce0-53fc-44bd-9c4c-033fbf4efa3f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:09.845515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86facba-20ef-4dae-8741-cc79ea3a860e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:09.846529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86facba-20ef-4dae-8741-cc79ea3a860e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:09.846973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86facba-20ef-4dae-8741-cc79ea3a860e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:09.848000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86facba-20ef-4dae-8741-cc79ea3a860e admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:09.849477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86facba-20ef-4dae-8741-cc79ea3a860e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:09.851680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86facba-20ef-4dae-8741-cc79ea3a860e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:09.970419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50541a0-8089-435d-84c1-712af0b37e4c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:09.978009 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3172/6398] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:32:09 2022] POST /identity/v3/users => generated 292 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:32:09.982602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86facba-20ef-4dae-8741-cc79ea3a860e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:10.006022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86facba-20ef-4dae-8741-cc79ea3a860e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:10.019995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5327ab-1d91-4c0d-967e-6816b7905d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:10.021199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5327ab-1d91-4c0d-967e-6816b7905d23 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:10.022172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5327ab-1d91-4c0d-967e-6816b7905d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:10.023270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5327ab-1d91-4c0d-967e-6816b7905d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:10.024014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5327ab-1d91-4c0d-967e-6816b7905d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:10.028815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5327ab-1d91-4c0d-967e-6816b7905d23 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:10.054505 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3173/6399] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:32:10.060818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5327ab-1d91-4c0d-967e-6816b7905d23 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:10.087298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb512f-b1da-414e-960e-09721ca7aac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:10.087914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb512f-b1da-414e-960e-09721ca7aac7 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:10.088122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb512f-b1da-414e-960e-09721ca7aac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:10.088391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb512f-b1da-414e-960e-09721ca7aac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:10.094513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5327ab-1d91-4c0d-967e-6816b7905d23 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:10.110570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39466c4-582c-481d-8c2d-91fcc986861a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:10.111513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39466c4-582c-481d-8c2d-91fcc986861a admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:10.111798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39466c4-582c-481d-8c2d-91fcc986861a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:10.112078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39466c4-582c-481d-8c2d-91fcc986861a admin admin] PATH_INFO: `/v3/projects/6cb863c3800a43239b21550bfdf9fc86/users/fb1da7e5955443499f924292d85445fe/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:10.114939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb512f-b1da-414e-960e-09721ca7aac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:10.116888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb512f-b1da-414e-960e-09721ca7aac7 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:10.152603 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3227/6400] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:32:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:32:10.159155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39466c4-582c-481d-8c2d-91fcc986861a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb863c3800a43239b21550bfdf9fc86, user_id=fb1da7e5955443499f924292d85445fe, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:10.164131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39466c4-582c-481d-8c2d-91fcc986861a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:10.273016 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3174/6401] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:32:10 2022] PUT /identity/v3/projects/6cb863c3800a43239b21550bfdf9fc86/users/fb1da7e5955443499f924292d85445fe/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:10.276958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb512f-b1da-414e-960e-09721ca7aac7 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:10.294691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb512f-b1da-414e-960e-09721ca7aac7 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:10.420861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15da31-5129-4074-a520-a3a062b65e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:10.421653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15da31-5129-4074-a520-a3a062b65e12 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:10.422015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15da31-5129-4074-a520-a3a062b65e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:10.422433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15da31-5129-4074-a520-a3a062b65e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:10.423309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15da31-5129-4074-a520-a3a062b65e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:10.426562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15da31-5129-4074-a520-a3a062b65e12 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:10.439103 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3228/6402] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:32:10.443849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39466c4-582c-481d-8c2d-91fcc986861a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:10.457132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39466c4-582c-481d-8c2d-91fcc986861a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:10.469489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55256578-d53b-4eba-8ad7-f9b5927d8394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:10.471254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55256578-d53b-4eba-8ad7-f9b5927d8394 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:10.471605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55256578-d53b-4eba-8ad7-f9b5927d8394 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:10.472011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55256578-d53b-4eba-8ad7-f9b5927d8394 admin admin] PATH_INFO: `/v3/projects/6cb863c3800a43239b21550bfdf9fc86/users/fb1da7e5955443499f924292d85445fe/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:10.476772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55256578-d53b-4eba-8ad7-f9b5927d8394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb863c3800a43239b21550bfdf9fc86, user_id=fb1da7e5955443499f924292d85445fe, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:10.482147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55256578-d53b-4eba-8ad7-f9b5927d8394 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:10.503087 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3175/6403] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:32:10 2022] PUT /identity/v3/projects/6cb863c3800a43239b21550bfdf9fc86/users/fb1da7e5955443499f924292d85445fe/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:32:10.819179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15da31-5129-4074-a520-a3a062b65e12 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:10.825590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7d15da31-5129-4074-a520-a3a062b65e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:10.841751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15da31-5129-4074-a520-a3a062b65e12 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:10.932276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:10.997673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41390bee-cfa2-472a-bddb-0add222b64cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:10.998769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41390bee-cfa2-472a-bddb-0add222b64cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:10.999083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41390bee-cfa2-472a-bddb-0add222b64cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:10.999421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41390bee-cfa2-472a-bddb-0add222b64cd admin admin] PATH_INFO: `/v3/projects/86076848c9fd4d76baba66819f4bf8fe` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:11.006159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41390bee-cfa2-472a-bddb-0add222b64cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=86076848c9fd4d76baba66819f4bf8fe)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:11.006159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41390bee-cfa2-472a-bddb-0add222b64cd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:11.220975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-41390bee-cfa2-472a-bddb-0add222b64cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86076848c9fd4d76baba66819f4bf8fe', 'request_id': 'req-41390bee-cfa2-472a-bddb-0add222b64cd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:11.234521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-41390bee-cfa2-472a-bddb-0add222b64cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86076848c9fd4d76baba66819f4bf8fe', 'request_id': 'req-41390bee-cfa2-472a-bddb-0add222b64cd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:11.251275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55256578-d53b-4eba-8ad7-f9b5927d8394 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:11.254405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-55256578-d53b-4eba-8ad7-f9b5927d8394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:11.278673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55256578-d53b-4eba-8ad7-f9b5927d8394 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:11.295050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-41390bee-cfa2-472a-bddb-0add222b64cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86076848c9fd4d76baba66819f4bf8fe', 'request_id': 'req-41390bee-cfa2-472a-bddb-0add222b64cd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:11.423510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea58a9-f404-46b9-9df3-209d0627c382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:11.424565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea58a9-f404-46b9-9df3-209d0627c382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:11.424849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea58a9-f404-46b9-9df3-209d0627c382 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:11.425378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea58a9-f404-46b9-9df3-209d0627c382 admin admin] PATH_INFO: `/v3/users/aff30a303c074d6fb9e032fa8cd2a20d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:11.427155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea58a9-f404-46b9-9df3-209d0627c382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff30a303c074d6fb9e032fa8cd2a20d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:11.431872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:11.439825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-41390bee-cfa2-472a-bddb-0add222b64cd admin admin] The token cache is being invalidate because project 86076848c9fd4d76baba66819f4bf8fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:32:11.439825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-41390bee-cfa2-472a-bddb-0add222b64cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:11.439825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-41390bee-cfa2-472a-bddb-0add222b64cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:11.440247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea58a9-f404-46b9-9df3-209d0627c382 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:11.440346 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3229/6404] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:32:10 2022] DELETE /identity/v3/projects/86076848c9fd4d76baba66819f4bf8fe => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:11.445403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad58df-53f0-4b49-8643-f3f4e7ac1ff3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:11.446448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad58df-53f0-4b49-8643-f3f4e7ac1ff3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:11.447443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad58df-53f0-4b49-8643-f3f4e7ac1ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:11.499414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3aad58df-53f0-4b49-8643-f3f4e7ac1ff3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:11.501655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3aad58df-53f0-4b49-8643-f3f4e7ac1ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:11.531471 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3230/6405] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:11.538999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4b3dc-5fc6-423a-9750-c49d2d2ad134 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:11.543386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4b3dc-5fc6-423a-9750-c49d2d2ad134 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:11.543386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4b3dc-5fc6-423a-9750-c49d2d2ad134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:11.587983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-86f4b3dc-5fc6-423a-9750-c49d2d2ad134 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:11.595676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-86f4b3dc-5fc6-423a-9750-c49d2d2ad134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:11.615834 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3231/6406] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:11.620103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4b3dc-5fc6-423a-9750-c49d2d2ad134 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:11.641206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4b3dc-5fc6-423a-9750-c49d2d2ad134 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:11.656137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667d4e1-8bb3-4c7d-85b7-baf00418f124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:11.656999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667d4e1-8bb3-4c7d-85b7-baf00418f124 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:11.657281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667d4e1-8bb3-4c7d-85b7-baf00418f124 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:11.657554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667d4e1-8bb3-4c7d-85b7-baf00418f124 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:11.658280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667d4e1-8bb3-4c7d-85b7-baf00418f124 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:32:11.658585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667d4e1-8bb3-4c7d-85b7-baf00418f124 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:11.667499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667d4e1-8bb3-4c7d-85b7-baf00418f124 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:11.693009 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3232/6407] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:32:11.697601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667d4e1-8bb3-4c7d-85b7-baf00418f124 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:11.703879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8cea58a9-f404-46b9-9df3-209d0627c382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff30a303c074d6fb9e032fa8cd2a20d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:11.721758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667d4e1-8bb3-4c7d-85b7-baf00418f124 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:11.726182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8cea58a9-f404-46b9-9df3-209d0627c382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff30a303c074d6fb9e032fa8cd2a20d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:11.740008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd0be9-535f-451a-b7d7-bcd936792051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:11.741278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd0be9-535f-451a-b7d7-bcd936792051 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:11.742379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd0be9-535f-451a-b7d7-bcd936792051 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:11.742835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd0be9-535f-451a-b7d7-bcd936792051 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:11.743751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd0be9-535f-451a-b7d7-bcd936792051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:11.746110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd0be9-535f-451a-b7d7-bcd936792051 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:11.832876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8cea58a9-f404-46b9-9df3-209d0627c382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff30a303c074d6fb9e032fa8cd2a20d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:11.845585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8cea58a9-f404-46b9-9df3-209d0627c382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff30a303c074d6fb9e032fa8cd2a20d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:11.848425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8cea58a9-f404-46b9-9df3-209d0627c382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff30a303c074d6fb9e032fa8cd2a20d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:11.870088 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3176/6408] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:32:11 2022] DELETE /identity/v3/users/aff30a303c074d6fb9e032fa8cd2a20d => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:11.872302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a5d94-dbd7-4b1b-945c-6a3df772c210 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:11.872882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a5d94-dbd7-4b1b-945c-6a3df772c210 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:11.873565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a5d94-dbd7-4b1b-945c-6a3df772c210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:11.894085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-981a5d94-dbd7-4b1b-945c-6a3df772c210 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:11.896100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-981a5d94-dbd7-4b1b-945c-6a3df772c210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:11.958837 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3233/6409] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:32:11 2022] POST /identity/v3/projects => generated 373 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:32:11.959854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd0be9-535f-451a-b7d7-bcd936792051 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:11.964577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-afcd0be9-535f-451a-b7d7-bcd936792051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:12.047850 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3177/6410] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:12.113003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd0be9-535f-451a-b7d7-bcd936792051 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:12.119909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639069f-d4f2-4a13-b7cd-3a561d15483b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:12.120659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639069f-d4f2-4a13-b7cd-3a561d15483b admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:12.121911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639069f-d4f2-4a13-b7cd-3a561d15483b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:12.121911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639069f-d4f2-4a13-b7cd-3a561d15483b admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:12.122260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639069f-d4f2-4a13-b7cd-3a561d15483b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:12.124663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639069f-d4f2-4a13-b7cd-3a561d15483b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:12.167790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a5d94-dbd7-4b1b-945c-6a3df772c210 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:12.170397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-981a5d94-dbd7-4b1b-945c-6a3df772c210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:12.212107 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3234/6411] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:32:11 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:32:12.224746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639069f-d4f2-4a13-b7cd-3a561d15483b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:12.255536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639069f-d4f2-4a13-b7cd-3a561d15483b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:12.266754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea0ab2-84ef-41be-b964-ad10d9c43e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:12.266754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea0ab2-84ef-41be-b964-ad10d9c43e54 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:12.267229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea0ab2-84ef-41be-b964-ad10d9c43e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:12.267229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea0ab2-84ef-41be-b964-ad10d9c43e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:12.268127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea0ab2-84ef-41be-b964-ad10d9c43e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:12.270674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea0ab2-84ef-41be-b964-ad10d9c43e54 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:12.287169 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3235/6412] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:32:12.288247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea0ab2-84ef-41be-b964-ad10d9c43e54 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:12.300314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea0ab2-84ef-41be-b964-ad10d9c43e54 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:12.306036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3181bb8-bf74-4fc2-8a37-9e13936736c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:12.306901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3181bb8-bf74-4fc2-8a37-9e13936736c7 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:12.307299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3181bb8-bf74-4fc2-8a37-9e13936736c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:12.312211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3181bb8-bf74-4fc2-8a37-9e13936736c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:12.312211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3181bb8-bf74-4fc2-8a37-9e13936736c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:12.312211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3181bb8-bf74-4fc2-8a37-9e13936736c7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:12.326412 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3236/6413] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:32:12.331833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3181bb8-bf74-4fc2-8a37-9e13936736c7 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:12.344420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3181bb8-bf74-4fc2-8a37-9e13936736c7 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:12.349979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf603e70-6605-481d-a3be-340fa93c1bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:12.351112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf603e70-6605-481d-a3be-340fa93c1bb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:12.351502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf603e70-6605-481d-a3be-340fa93c1bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:12.351884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf603e70-6605-481d-a3be-340fa93c1bb8 admin admin] PATH_INFO: `/v3/projects/20d6ad3663924aa3a52b865623907f39/users/4757098bb5a64b1990b95f97e1ab9493/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:12.372846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf603e70-6605-481d-a3be-340fa93c1bb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d6ad3663924aa3a52b865623907f39, user_id=4757098bb5a64b1990b95f97e1ab9493, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:12.375427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a5d94-dbd7-4b1b-945c-6a3df772c210 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:12.390333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf603e70-6605-481d-a3be-340fa93c1bb8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:12.498123 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3237/6414] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:32:12 2022] PUT /identity/v3/projects/20d6ad3663924aa3a52b865623907f39/users/4757098bb5a64b1990b95f97e1ab9493/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:12.509221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f633d-72ca-428d-9336-53b442dce5de None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:12.509946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f633d-72ca-428d-9336-53b442dce5de None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:12.510438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f633d-72ca-428d-9336-53b442dce5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:12.515045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3fb85-7d0a-4b16-b06e-ede901327d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:12.515870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3fb85-7d0a-4b16-b06e-ede901327d7d service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:12.516155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3fb85-7d0a-4b16-b06e-ede901327d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:12.516432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3fb85-7d0a-4b16-b06e-ede901327d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:12.540817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3fb85-7d0a-4b16-b06e-ede901327d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:12.542282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3fb85-7d0a-4b16-b06e-ede901327d7d service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:12.567414 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3178/6415] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:32:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:32:12.584878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-481f633d-72ca-428d-9336-53b442dce5de None None] MFA Rules not processed for user `4757098bb5a64b1990b95f97e1ab9493`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:12.587741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-481f633d-72ca-428d-9336-53b442dce5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:12.640633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:12.737404 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3238/6416] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:12.742618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3fb85-7d0a-4b16-b06e-ede901327d7d service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:12.770930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3fb85-7d0a-4b16-b06e-ede901327d7d service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:12.937471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36e888-4b8d-4fc9-bbd5-fdc8616ff647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:12.939750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36e888-4b8d-4fc9-bbd5-fdc8616ff647 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:12.940352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36e888-4b8d-4fc9-bbd5-fdc8616ff647 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:12.947624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36e888-4b8d-4fc9-bbd5-fdc8616ff647 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:12.947624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36e888-4b8d-4fc9-bbd5-fdc8616ff647 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:12.947624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36e888-4b8d-4fc9-bbd5-fdc8616ff647 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:13.071843 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3179/6417] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:32:12 2022] POST /identity/v3/projects => generated 369 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:32:13.076193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f633d-72ca-428d-9336-53b442dce5de None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:13.092537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f633d-72ca-428d-9336-53b442dce5de None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:13.187704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b5a61-ce3c-4081-97e0-293cd19dcefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:13.188542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b5a61-ce3c-4081-97e0-293cd19dcefb admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:13.189056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b5a61-ce3c-4081-97e0-293cd19dcefb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:13.189202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b5a61-ce3c-4081-97e0-293cd19dcefb admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:13.189974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b5a61-ce3c-4081-97e0-293cd19dcefb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:13.192533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b5a61-ce3c-4081-97e0-293cd19dcefb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:13.377971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:13.390988 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3239/6418] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:32:13 2022] POST /identity/v3/users => generated 291 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:32:13.395461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36e888-4b8d-4fc9-bbd5-fdc8616ff647 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:13.427678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36e888-4b8d-4fc9-bbd5-fdc8616ff647 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:13.446299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad875503-af0d-4954-b3da-c2e39fe8912b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:13.447722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad875503-af0d-4954-b3da-c2e39fe8912b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:13.447892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad875503-af0d-4954-b3da-c2e39fe8912b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:13.448180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad875503-af0d-4954-b3da-c2e39fe8912b admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:13.448930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad875503-af0d-4954-b3da-c2e39fe8912b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:13.455725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad875503-af0d-4954-b3da-c2e39fe8912b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:13.483925 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3180/6419] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:32:13.485536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b5a61-ce3c-4081-97e0-293cd19dcefb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:13.512468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b5a61-ce3c-4081-97e0-293cd19dcefb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:13.528287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6323f5-1d04-4958-b1c6-70d6fc0ff350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:13.529276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6323f5-1d04-4958-b1c6-70d6fc0ff350 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:13.529569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6323f5-1d04-4958-b1c6-70d6fc0ff350 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:13.529848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6323f5-1d04-4958-b1c6-70d6fc0ff350 admin admin] PATH_INFO: `/v3/projects/6d65d0a55d2440279b703e4a35b7f145/users/700d0ec125254dad97d1464164f64ff8/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:13.570072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6323f5-1d04-4958-b1c6-70d6fc0ff350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d65d0a55d2440279b703e4a35b7f145, user_id=700d0ec125254dad97d1464164f64ff8, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:13.573243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6323f5-1d04-4958-b1c6-70d6fc0ff350 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:13.686383 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3240/6420] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:32:13 2022] PUT /identity/v3/projects/6d65d0a55d2440279b703e4a35b7f145/users/700d0ec125254dad97d1464164f64ff8/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:32:13.690873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad875503-af0d-4954-b3da-c2e39fe8912b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:13.708551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad875503-af0d-4954-b3da-c2e39fe8912b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:13.809020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c4a17-d1c3-4d0d-bb96-a8a24b267da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:13.810065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c4a17-d1c3-4d0d-bb96-a8a24b267da6 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:13.810618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c4a17-d1c3-4d0d-bb96-a8a24b267da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:13.811270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c4a17-d1c3-4d0d-bb96-a8a24b267da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:13.812256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c4a17-d1c3-4d0d-bb96-a8a24b267da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:13.815415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c4a17-d1c3-4d0d-bb96-a8a24b267da6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:13.848913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6323f5-1d04-4958-b1c6-70d6fc0ff350 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:13.866084 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3181/6421] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:32:13.874788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6323f5-1d04-4958-b1c6-70d6fc0ff350 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:13.877585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:13.899165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8e04b-83f3-4d20-82de-05a10635106e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:13.900147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8e04b-83f3-4d20-82de-05a10635106e admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:13.900431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8e04b-83f3-4d20-82de-05a10635106e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:13.900923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8e04b-83f3-4d20-82de-05a10635106e admin admin] PATH_INFO: `/v3/projects/6d65d0a55d2440279b703e4a35b7f145/users/700d0ec125254dad97d1464164f64ff8/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:13.904123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8e04b-83f3-4d20-82de-05a10635106e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d65d0a55d2440279b703e4a35b7f145, user_id=700d0ec125254dad97d1464164f64ff8, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:13.906858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8e04b-83f3-4d20-82de-05a10635106e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:13.940501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5b9f9-7312-4cea-a50f-829752b5ad0d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:13.941952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5b9f9-7312-4cea-a50f-829752b5ad0d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:13.942491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5b9f9-7312-4cea-a50f-829752b5ad0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:13.944963 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3241/6422] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:32:13 2022] PUT /identity/v3/projects/6d65d0a55d2440279b703e4a35b7f145/users/700d0ec125254dad97d1464164f64ff8/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:14.007770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2df5b9f9-7312-4cea-a50f-829752b5ad0d None None] MFA Rules not processed for user `700d0ec125254dad97d1464164f64ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:14.010998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2df5b9f9-7312-4cea-a50f-829752b5ad0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:14.163415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:14.232643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:14.236814 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3182/6423] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:13 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:14.242124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8e04b-83f3-4d20-82de-05a10635106e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:14.244440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-97b8e04b-83f3-4d20-82de-05a10635106e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:14.356951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8e04b-83f3-4d20-82de-05a10635106e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:14.362309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096a0ba-b125-4af7-bcda-10756c686139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:14.364481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096a0ba-b125-4af7-bcda-10756c686139 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:14.364939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096a0ba-b125-4af7-bcda-10756c686139 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:14.365414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096a0ba-b125-4af7-bcda-10756c686139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:14.400817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096a0ba-b125-4af7-bcda-10756c686139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:14.402374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096a0ba-b125-4af7-bcda-10756c686139 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:14.417865 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3242/6424] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:32:14 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:32:14.573148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5b9f9-7312-4cea-a50f-829752b5ad0d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:14.575256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2df5b9f9-7312-4cea-a50f-829752b5ad0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:14.749747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5b9f9-7312-4cea-a50f-829752b5ad0d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:14.772617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de70ee4-796c-48c4-a0bd-5b618fe48357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:14.774535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de70ee4-796c-48c4-a0bd-5b618fe48357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:14.775264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de70ee4-796c-48c4-a0bd-5b618fe48357 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:14.775424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096a0ba-b125-4af7-bcda-10756c686139 service cinder] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:14.777672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de70ee4-796c-48c4-a0bd-5b618fe48357 admin admin] PATH_INFO: `/v3/projects/02d25afabe4c42da90339ef48a34c4d5` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:14.779802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de70ee4-796c-48c4-a0bd-5b618fe48357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d25afabe4c42da90339ef48a34c4d5)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:14.784875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de70ee4-796c-48c4-a0bd-5b618fe48357 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:14.789532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096a0ba-b125-4af7-bcda-10756c686139 service cinder] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:14.807605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0533e17-99dc-4c6e-9421-1d65f013f3bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:14.808539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0533e17-99dc-4c6e-9421-1d65f013f3bd service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:14.809238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0533e17-99dc-4c6e-9421-1d65f013f3bd service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:14.809590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0533e17-99dc-4c6e-9421-1d65f013f3bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:14.930288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0533e17-99dc-4c6e-9421-1d65f013f3bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:14.932775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0533e17-99dc-4c6e-9421-1d65f013f3bd service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:14.947587 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3243/6425] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:32:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:32:15.014783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4de70ee4-796c-48c4-a0bd-5b618fe48357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d25afabe4c42da90339ef48a34c4d5', 'request_id': 'req-4de70ee4-796c-48c4-a0bd-5b618fe48357'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:15.031861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4de70ee4-796c-48c4-a0bd-5b618fe48357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d25afabe4c42da90339ef48a34c4d5', 'request_id': 'req-4de70ee4-796c-48c4-a0bd-5b618fe48357'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:15.052285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4de70ee4-796c-48c4-a0bd-5b618fe48357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d25afabe4c42da90339ef48a34c4d5', 'request_id': 'req-4de70ee4-796c-48c4-a0bd-5b618fe48357'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:15.151649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4de70ee4-796c-48c4-a0bd-5b618fe48357 admin admin] The token cache is being invalidate because project 02d25afabe4c42da90339ef48a34c4d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:32:15.151972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4de70ee4-796c-48c4-a0bd-5b618fe48357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:15.152984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4de70ee4-796c-48c4-a0bd-5b618fe48357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:15.154801 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3183/6426] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:32:14 2022] DELETE /identity/v3/projects/02d25afabe4c42da90339ef48a34c4d5 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:15.158725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0533e17-99dc-4c6e-9421-1d65f013f3bd service cinder] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:15.174270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0533e17-99dc-4c6e-9421-1d65f013f3bd service cinder] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:15.326086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76958a4-29f7-4752-a903-eed94da27717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:15.327378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76958a4-29f7-4752-a903-eed94da27717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:15.327849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76958a4-29f7-4752-a903-eed94da27717 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:15.328622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76958a4-29f7-4752-a903-eed94da27717 admin admin] PATH_INFO: `/v3/users/1f8f2dd4ecc94cd0a61964a27172569b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:15.330366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76958a4-29f7-4752-a903-eed94da27717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f8f2dd4ecc94cd0a61964a27172569b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:15.334293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76958a4-29f7-4752-a903-eed94da27717 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:15.394361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:15.577971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:15.639986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f76958a4-29f7-4752-a903-eed94da27717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f8f2dd4ecc94cd0a61964a27172569b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:15.684126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f76958a4-29f7-4752-a903-eed94da27717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f8f2dd4ecc94cd0a61964a27172569b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:15.806236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef18f02-443b-400b-9cff-21f204476a11 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:15.807138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef18f02-443b-400b-9cff-21f204476a11 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:15.807603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef18f02-443b-400b-9cff-21f204476a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:15.857321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-fef18f02-443b-400b-9cff-21f204476a11 None None] MFA Rules not processed for user `08abcba4284e434680ee4640f1541cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:15.859151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fef18f02-443b-400b-9cff-21f204476a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:15.876144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f76958a4-29f7-4752-a903-eed94da27717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f8f2dd4ecc94cd0a61964a27172569b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:15.883632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f76958a4-29f7-4752-a903-eed94da27717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f8f2dd4ecc94cd0a61964a27172569b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:15.911940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f76958a4-29f7-4752-a903-eed94da27717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f8f2dd4ecc94cd0a61964a27172569b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:15.922196 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3244/6427] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:32:15 2022] DELETE /identity/v3/users/1f8f2dd4ecc94cd0a61964a27172569b => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:15.995635 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3184/6428] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:16.009061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6960538-8a54-4ab9-b797-4be9bcacbf24 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:16.009061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6960538-8a54-4ab9-b797-4be9bcacbf24 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:16.009061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6960538-8a54-4ab9-b797-4be9bcacbf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:16.037770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f6960538-8a54-4ab9-b797-4be9bcacbf24 None None] MFA Rules not processed for user `08abcba4284e434680ee4640f1541cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:16.045108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f6960538-8a54-4ab9-b797-4be9bcacbf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:16.165440 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3245/6429] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:16.176223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef18f02-443b-400b-9cff-21f204476a11 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:16.177811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fef18f02-443b-400b-9cff-21f204476a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:16.340556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef18f02-443b-400b-9cff-21f204476a11 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:16.449815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9fbd8-f560-4b28-8130-01214756a8ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:16.450568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9fbd8-f560-4b28-8130-01214756a8ac service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:16.450909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9fbd8-f560-4b28-8130-01214756a8ac service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:16.451339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9fbd8-f560-4b28-8130-01214756a8ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:16.467801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9fbd8-f560-4b28-8130-01214756a8ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:16.469725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9fbd8-f560-4b28-8130-01214756a8ac service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:16.531099 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3185/6430] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:32:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:32:16.594049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:17.118998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6960538-8a54-4ab9-b797-4be9bcacbf24 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:17.120628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f6960538-8a54-4ab9-b797-4be9bcacbf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:17.271605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6960538-8a54-4ab9-b797-4be9bcacbf24 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:17.280744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2430b7d-a6af-46cd-8d97-fc39f2c9349f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:17.282629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2430b7d-a6af-46cd-8d97-fc39f2c9349f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:17.282897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2430b7d-a6af-46cd-8d97-fc39f2c9349f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:17.284547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2430b7d-a6af-46cd-8d97-fc39f2c9349f admin admin] PATH_INFO: `/v3/projects/2adf030f48234850990b88d7570deeb0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:17.288028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2430b7d-a6af-46cd-8d97-fc39f2c9349f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2adf030f48234850990b88d7570deeb0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:17.292118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2430b7d-a6af-46cd-8d97-fc39f2c9349f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:17.317953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:17.527371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c2430b7d-a6af-46cd-8d97-fc39f2c9349f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2adf030f48234850990b88d7570deeb0', 'request_id': 'req-c2430b7d-a6af-46cd-8d97-fc39f2c9349f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:17.549700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c2430b7d-a6af-46cd-8d97-fc39f2c9349f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2adf030f48234850990b88d7570deeb0', 'request_id': 'req-c2430b7d-a6af-46cd-8d97-fc39f2c9349f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:17.565615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c2430b7d-a6af-46cd-8d97-fc39f2c9349f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2adf030f48234850990b88d7570deeb0', 'request_id': 'req-c2430b7d-a6af-46cd-8d97-fc39f2c9349f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:17.724162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c2430b7d-a6af-46cd-8d97-fc39f2c9349f admin admin] The token cache is being invalidate because project 2adf030f48234850990b88d7570deeb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:32:17.724549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c2430b7d-a6af-46cd-8d97-fc39f2c9349f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:17.730807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c2430b7d-a6af-46cd-8d97-fc39f2c9349f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:17.734191 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3246/6431] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:32:17 2022] DELETE /identity/v3/projects/2adf030f48234850990b88d7570deeb0 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:17.744913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dd51f-c0d9-42c1-948d-70418ce1ad89 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:17.744913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dd51f-c0d9-42c1-948d-70418ce1ad89 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:17.744913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dd51f-c0d9-42c1-948d-70418ce1ad89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:17.767501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f52dd51f-c0d9-42c1-948d-70418ce1ad89 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:17.767501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f52dd51f-c0d9-42c1-948d-70418ce1ad89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:17.905508 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3186/6432] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:17.914900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26afb7f-e9eb-46d2-a5f1-b70a00320ff6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:17.914900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26afb7f-e9eb-46d2-a5f1-b70a00320ff6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:17.915403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26afb7f-e9eb-46d2-a5f1-b70a00320ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:17.955274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e26afb7f-e9eb-46d2-a5f1-b70a00320ff6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:17.957800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e26afb7f-e9eb-46d2-a5f1-b70a00320ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:17.984360 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3247/6433] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:17.990635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52dd51f-c0d9-42c1-948d-70418ce1ad89 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:18.006661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52dd51f-c0d9-42c1-948d-70418ce1ad89 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:18.021280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2559b-b3ba-41f9-b2af-e538f9eb9cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:18.023605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2559b-b3ba-41f9-b2af-e538f9eb9cfb admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:18.023988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2559b-b3ba-41f9-b2af-e538f9eb9cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:18.024423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2559b-b3ba-41f9-b2af-e538f9eb9cfb admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:18.025191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2559b-b3ba-41f9-b2af-e538f9eb9cfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:32:18.025518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2559b-b3ba-41f9-b2af-e538f9eb9cfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:18.027230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2559b-b3ba-41f9-b2af-e538f9eb9cfb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:18.060957 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3187/6434] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:32:18.067704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26afb7f-e9eb-46d2-a5f1-b70a00320ff6 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:18.080093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26afb7f-e9eb-46d2-a5f1-b70a00320ff6 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:18.093250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53a9d6-4ba1-498f-97b9-21c468698c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:18.093949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53a9d6-4ba1-498f-97b9-21c468698c16 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:18.094309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53a9d6-4ba1-498f-97b9-21c468698c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:18.094523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53a9d6-4ba1-498f-97b9-21c468698c16 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:18.095439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53a9d6-4ba1-498f-97b9-21c468698c16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:18.099856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53a9d6-4ba1-498f-97b9-21c468698c16 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:18.252398 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3248/6435] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:32:18 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:32:18.263434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2559b-b3ba-41f9-b2af-e538f9eb9cfb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:18.272392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2559b-b3ba-41f9-b2af-e538f9eb9cfb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:18.379910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:18.406309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28033fc7-19fe-4aa4-b8ac-4cc0aacbab69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:18.409189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28033fc7-19fe-4aa4-b8ac-4cc0aacbab69 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:18.409481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28033fc7-19fe-4aa4-b8ac-4cc0aacbab69 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:18.410438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28033fc7-19fe-4aa4-b8ac-4cc0aacbab69 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:18.415957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28033fc7-19fe-4aa4-b8ac-4cc0aacbab69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:18.418541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28033fc7-19fe-4aa4-b8ac-4cc0aacbab69 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:18.584553 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3188/6436] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:32:18 2022] POST /identity/v3/users => generated 289 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:32:18.585972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53a9d6-4ba1-498f-97b9-21c468698c16 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:18.587300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:18.601259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53a9d6-4ba1-498f-97b9-21c468698c16 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:18.610088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6ec5c-02f3-4358-968d-52ceeedd1dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:18.610875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6ec5c-02f3-4358-968d-52ceeedd1dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:18.612104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6ec5c-02f3-4358-968d-52ceeedd1dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:18.613011 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6ec5c-02f3-4358-968d-52ceeedd1dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:18.614493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6ec5c-02f3-4358-968d-52ceeedd1dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:18.616488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6ec5c-02f3-4358-968d-52ceeedd1dc2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:18.636278 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3249/6437] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:32:18.638870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28033fc7-19fe-4aa4-b8ac-4cc0aacbab69 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:18.651546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28033fc7-19fe-4aa4-b8ac-4cc0aacbab69 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:18.656986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26e5f7-45cd-4f20-8d8f-cc42bcc0827a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:18.657994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26e5f7-45cd-4f20-8d8f-cc42bcc0827a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:18.658352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26e5f7-45cd-4f20-8d8f-cc42bcc0827a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:18.658699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26e5f7-45cd-4f20-8d8f-cc42bcc0827a admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:18.660614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26e5f7-45cd-4f20-8d8f-cc42bcc0827a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:18.662568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26e5f7-45cd-4f20-8d8f-cc42bcc0827a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:18.679611 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3189/6438] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:32:18.684161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6ec5c-02f3-4358-968d-52ceeedd1dc2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:18.716108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6ec5c-02f3-4358-968d-52ceeedd1dc2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:18.724359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9d917-6eb2-48a1-976a-5c32df8f9b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:18.725298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9d917-6eb2-48a1-976a-5c32df8f9b6e admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:18.725668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9d917-6eb2-48a1-976a-5c32df8f9b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:18.726161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9d917-6eb2-48a1-976a-5c32df8f9b6e admin admin] PATH_INFO: `/v3/projects/16a10d534ff748a98881b4091ab41914/users/170ea91a523444618d58e7fff9441f09/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:18.759409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9d917-6eb2-48a1-976a-5c32df8f9b6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a10d534ff748a98881b4091ab41914, user_id=170ea91a523444618d58e7fff9441f09, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:18.763229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9d917-6eb2-48a1-976a-5c32df8f9b6e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:18.901981 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3250/6439] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:32:18 2022] PUT /identity/v3/projects/16a10d534ff748a98881b4091ab41914/users/170ea91a523444618d58e7fff9441f09/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:18.912356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498965e-8375-4050-8916-12b5a45e4a60 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:18.912901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498965e-8375-4050-8916-12b5a45e4a60 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:18.913341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498965e-8375-4050-8916-12b5a45e4a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:18.973506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6498965e-8375-4050-8916-12b5a45e4a60 None None] MFA Rules not processed for user `170ea91a523444618d58e7fff9441f09`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:18.974916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6498965e-8375-4050-8916-12b5a45e4a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:19.104908 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3190/6440] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:19.105835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9d917-6eb2-48a1-976a-5c32df8f9b6e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:19.255091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9d917-6eb2-48a1-976a-5c32df8f9b6e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:19.268132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9f301-5096-4d69-a02b-818a0f196ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:19.273167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9f301-5096-4d69-a02b-818a0f196ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:19.273167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9f301-5096-4d69-a02b-818a0f196ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:19.273167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9f301-5096-4d69-a02b-818a0f196ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:19.274638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9f301-5096-4d69-a02b-818a0f196ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:19.278926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9f301-5096-4d69-a02b-818a0f196ad2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:19.413806 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3251/6441] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:32:19 2022] POST /identity/v3/projects => generated 375 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:32:19.418195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498965e-8375-4050-8916-12b5a45e4a60 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:19.452902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498965e-8375-4050-8916-12b5a45e4a60 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:19.536408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9f301-5096-4d69-a02b-818a0f196ad2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:19.538315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c6c9f301-5096-4d69-a02b-818a0f196ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:19.543108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2cee7-fc71-49d4-b2c2-69d09815025d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:19.544155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2cee7-fc71-49d4-b2c2-69d09815025d admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:19.544599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2cee7-fc71-49d4-b2c2-69d09815025d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:19.545304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2cee7-fc71-49d4-b2c2-69d09815025d admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:19.546378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2cee7-fc71-49d4-b2c2-69d09815025d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:19.550969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2cee7-fc71-49d4-b2c2-69d09815025d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:19.573767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9f301-5096-4d69-a02b-818a0f196ad2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:19.582911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92fd80-3a23-4aff-b9bc-fdc79f7a7b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:19.584024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92fd80-3a23-4aff-b9bc-fdc79f7a7b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:19.584316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92fd80-3a23-4aff-b9bc-fdc79f7a7b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:19.584600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92fd80-3a23-4aff-b9bc-fdc79f7a7b76 admin admin] PATH_INFO: `/v3/users/1c2f611a34d442b882c1ba152e7ed628` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:19.585942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92fd80-3a23-4aff-b9bc-fdc79f7a7b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c2f611a34d442b882c1ba152e7ed628)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:19.588746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92fd80-3a23-4aff-b9bc-fdc79f7a7b76 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:19.672287 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3191/6442] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:32:19 2022] POST /identity/v3/users => generated 294 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:32:19.676429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2cee7-fc71-49d4-b2c2-69d09815025d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:19.702965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2cee7-fc71-49d4-b2c2-69d09815025d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:19.702965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c7bf3-481a-4831-a356-7ccb401bc716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:19.702965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c7bf3-481a-4831-a356-7ccb401bc716 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:19.702965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c7bf3-481a-4831-a356-7ccb401bc716 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:19.703483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c7bf3-481a-4831-a356-7ccb401bc716 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:19.703580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c7bf3-481a-4831-a356-7ccb401bc716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:19.705142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c7bf3-481a-4831-a356-7ccb401bc716 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:19.742789 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3192/6443] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:32:19.744118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c7bf3-481a-4831-a356-7ccb401bc716 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:19.756552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c7bf3-481a-4831-a356-7ccb401bc716 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:19.763468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659ff90-dd4f-467d-8e29-0d216a3d83b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:19.764598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659ff90-dd4f-467d-8e29-0d216a3d83b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:19.765081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659ff90-dd4f-467d-8e29-0d216a3d83b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:19.766164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659ff90-dd4f-467d-8e29-0d216a3d83b1 admin admin] PATH_INFO: `/v3/projects/821ca239823a4be79fd1d169b5ed59bb/users/6514e6ab103544e985110ba788e14448/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:19.790686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659ff90-dd4f-467d-8e29-0d216a3d83b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=821ca239823a4be79fd1d169b5ed59bb, user_id=6514e6ab103544e985110ba788e14448, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:19.794114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659ff90-dd4f-467d-8e29-0d216a3d83b1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:19.856455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5a92fd80-3a23-4aff-b9bc-fdc79f7a7b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c2f611a34d442b882c1ba152e7ed628'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:19.887548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5a92fd80-3a23-4aff-b9bc-fdc79f7a7b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c2f611a34d442b882c1ba152e7ed628'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:19.943446 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3193/6444] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:32:19 2022] PUT /identity/v3/projects/821ca239823a4be79fd1d169b5ed59bb/users/6514e6ab103544e985110ba788e14448/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:19.944451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659ff90-dd4f-467d-8e29-0d216a3d83b1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:20.036835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5a92fd80-3a23-4aff-b9bc-fdc79f7a7b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c2f611a34d442b882c1ba152e7ed628'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:20.038360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5a92fd80-3a23-4aff-b9bc-fdc79f7a7b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c2f611a34d442b882c1ba152e7ed628'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:20.077737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659ff90-dd4f-467d-8e29-0d216a3d83b1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:20.086420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5a92fd80-3a23-4aff-b9bc-fdc79f7a7b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c2f611a34d442b882c1ba152e7ed628'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:20.089107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145939b5-982b-4aec-b61b-f20c0a08ea28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:20.090045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145939b5-982b-4aec-b61b-f20c0a08ea28 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:20.090339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145939b5-982b-4aec-b61b-f20c0a08ea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:20.090628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145939b5-982b-4aec-b61b-f20c0a08ea28 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:20.091598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145939b5-982b-4aec-b61b-f20c0a08ea28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:20.093443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145939b5-982b-4aec-b61b-f20c0a08ea28 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:20.100038 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3252/6445] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:32:19 2022] DELETE /identity/v3/users/1c2f611a34d442b882c1ba152e7ed628 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:20.113992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d7dd8-2abd-44dc-8284-d9c8d7b22b30 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:20.113992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d7dd8-2abd-44dc-8284-d9c8d7b22b30 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:20.113992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d7dd8-2abd-44dc-8284-d9c8d7b22b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:20.125725 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3194/6446] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:32:20.130229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145939b5-982b-4aec-b61b-f20c0a08ea28 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:20.132212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-145939b5-982b-4aec-b61b-f20c0a08ea28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:20.146881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-dd5d7dd8-2abd-44dc-8284-d9c8d7b22b30 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:20.148406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dd5d7dd8-2abd-44dc-8284-d9c8d7b22b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:20.186500 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145939b5-982b-4aec-b61b-f20c0a08ea28 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:20.249492 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3253/6447] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:20.258842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d7dd8-2abd-44dc-8284-d9c8d7b22b30 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:20.261848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dd5d7dd8-2abd-44dc-8284-d9c8d7b22b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:20.325238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d746a-dca0-42ec-b7eb-23a24d0da696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:20.327984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d746a-dca0-42ec-b7eb-23a24d0da696 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:20.332441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d746a-dca0-42ec-b7eb-23a24d0da696 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:20.332792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d746a-dca0-42ec-b7eb-23a24d0da696 admin admin] PATH_INFO: `/v3/projects/821ca239823a4be79fd1d169b5ed59bb/users/6514e6ab103544e985110ba788e14448/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:20.341312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d746a-dca0-42ec-b7eb-23a24d0da696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=821ca239823a4be79fd1d169b5ed59bb, user_id=6514e6ab103544e985110ba788e14448, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:20.350096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d746a-dca0-42ec-b7eb-23a24d0da696 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:20.383927 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3195/6448] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:32:20 2022] PUT /identity/v3/projects/821ca239823a4be79fd1d169b5ed59bb/users/6514e6ab103544e985110ba788e14448/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:32:20.390382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d2aff-2468-4407-93f3-7921ac63ab1d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:20.390757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d2aff-2468-4407-93f3-7921ac63ab1d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:20.394753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d2aff-2468-4407-93f3-7921ac63ab1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:20.455222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c21d2aff-2468-4407-93f3-7921ac63ab1d None None] MFA Rules not processed for user `6514e6ab103544e985110ba788e14448`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:20.460625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c21d2aff-2468-4407-93f3-7921ac63ab1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:20.478695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d7dd8-2abd-44dc-8284-d9c8d7b22b30 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:20.574741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d488c-f739-4ac9-a348-24d7c09b86fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:20.575489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d488c-f739-4ac9-a348-24d7c09b86fd service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:20.575811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d488c-f739-4ac9-a348-24d7c09b86fd service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:20.576094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d488c-f739-4ac9-a348-24d7c09b86fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:20.588676 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3196/6449] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:20.592005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:20.597485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d2aff-2468-4407-93f3-7921ac63ab1d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:20.597485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c21d2aff-2468-4407-93f3-7921ac63ab1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:20.613370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d2aff-2468-4407-93f3-7921ac63ab1d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:20.633312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85994e-a478-41e2-8e8f-1ce81f48fc6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:20.634056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85994e-a478-41e2-8e8f-1ce81f48fc6b service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:20.634345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85994e-a478-41e2-8e8f-1ce81f48fc6b service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:20.634801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85994e-a478-41e2-8e8f-1ce81f48fc6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:20.646420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85994e-a478-41e2-8e8f-1ce81f48fc6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:20.649827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85994e-a478-41e2-8e8f-1ce81f48fc6b service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:20.666915 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3197/6450] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:32:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:32:20.710208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d488c-f739-4ac9-a348-24d7c09b86fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:20.712063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d488c-f739-4ac9-a348-24d7c09b86fd service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:20.724235 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3254/6451] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:32:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:32:21.139928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85994e-a478-41e2-8e8f-1ce81f48fc6b service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:21.141631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3a85994e-a478-41e2-8e8f-1ce81f48fc6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:21.222486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85994e-a478-41e2-8e8f-1ce81f48fc6b service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:21.229431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22611c2-01e9-41b3-9e0a-7ed08437b4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:21.230466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22611c2-01e9-41b3-9e0a-7ed08437b4eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:21.230768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22611c2-01e9-41b3-9e0a-7ed08437b4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:21.232241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22611c2-01e9-41b3-9e0a-7ed08437b4eb admin admin] PATH_INFO: `/v3/projects/7658815dc50d42f49ed6d9aac9a6c98b` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:21.233932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22611c2-01e9-41b3-9e0a-7ed08437b4eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7658815dc50d42f49ed6d9aac9a6c98b)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:21.236489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22611c2-01e9-41b3-9e0a-7ed08437b4eb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:21.310762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:21.438673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f22611c2-01e9-41b3-9e0a-7ed08437b4eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7658815dc50d42f49ed6d9aac9a6c98b', 'request_id': 'req-f22611c2-01e9-41b3-9e0a-7ed08437b4eb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:21.446330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f22611c2-01e9-41b3-9e0a-7ed08437b4eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7658815dc50d42f49ed6d9aac9a6c98b', 'request_id': 'req-f22611c2-01e9-41b3-9e0a-7ed08437b4eb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:21.457358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f22611c2-01e9-41b3-9e0a-7ed08437b4eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7658815dc50d42f49ed6d9aac9a6c98b', 'request_id': 'req-f22611c2-01e9-41b3-9e0a-7ed08437b4eb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:21.586276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f22611c2-01e9-41b3-9e0a-7ed08437b4eb admin admin] The token cache is being invalidate because project 7658815dc50d42f49ed6d9aac9a6c98b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:32:21.587053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f22611c2-01e9-41b3-9e0a-7ed08437b4eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:21.588105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f22611c2-01e9-41b3-9e0a-7ed08437b4eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:21.594706 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3198/6452] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:32:21 2022] DELETE /identity/v3/projects/7658815dc50d42f49ed6d9aac9a6c98b => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:21.595659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773eaecb-046d-4483-99c7-2effc298b9e9 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:21.596117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773eaecb-046d-4483-99c7-2effc298b9e9 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:21.596241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773eaecb-046d-4483-99c7-2effc298b9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:21.628838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-773eaecb-046d-4483-99c7-2effc298b9e9 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:21.632061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-773eaecb-046d-4483-99c7-2effc298b9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:21.713538 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3255/6453] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:21.721904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095af9c4-a7f6-4e89-b419-b838e2a6d568 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:21.722464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095af9c4-a7f6-4e89-b419-b838e2a6d568 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:21.722965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095af9c4-a7f6-4e89-b419-b838e2a6d568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:21.752923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-095af9c4-a7f6-4e89-b419-b838e2a6d568 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:21.756376 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-095af9c4-a7f6-4e89-b419-b838e2a6d568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:21.778580 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3199/6454] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:21.783334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773eaecb-046d-4483-99c7-2effc298b9e9 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:21.806177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773eaecb-046d-4483-99c7-2effc298b9e9 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:21.814422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33ebcf-83b5-4d26-8bf9-3f494946899b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:21.815232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33ebcf-83b5-4d26-8bf9-3f494946899b admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:21.815575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33ebcf-83b5-4d26-8bf9-3f494946899b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:21.825192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33ebcf-83b5-4d26-8bf9-3f494946899b admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:21.825641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33ebcf-83b5-4d26-8bf9-3f494946899b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:32:21.826295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33ebcf-83b5-4d26-8bf9-3f494946899b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:21.828353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33ebcf-83b5-4d26-8bf9-3f494946899b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:21.851179 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3256/6455] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:32:21.855767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095af9c4-a7f6-4e89-b419-b838e2a6d568 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:21.875496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095af9c4-a7f6-4e89-b419-b838e2a6d568 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:21.882272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37782965-2ff2-40ec-aa96-55cd42864e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:21.883179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37782965-2ff2-40ec-aa96-55cd42864e08 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:21.883487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37782965-2ff2-40ec-aa96-55cd42864e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:21.883751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37782965-2ff2-40ec-aa96-55cd42864e08 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:21.884491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37782965-2ff2-40ec-aa96-55cd42864e08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:21.891278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37782965-2ff2-40ec-aa96-55cd42864e08 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:22.006975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33ebcf-83b5-4d26-8bf9-3f494946899b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:22.008390 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3200/6456] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:32:21 2022] POST /identity/v3/projects => generated 363 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:32:22.021498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33ebcf-83b5-4d26-8bf9-3f494946899b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:22.175833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd24a26-d59c-4276-af3b-b796f34414eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:22.180453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd24a26-d59c-4276-af3b-b796f34414eb admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:22.180743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd24a26-d59c-4276-af3b-b796f34414eb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:22.181024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd24a26-d59c-4276-af3b-b796f34414eb admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:22.182433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd24a26-d59c-4276-af3b-b796f34414eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:22.185831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd24a26-d59c-4276-af3b-b796f34414eb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:22.281183 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3257/6457] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:32:22 2022] POST /identity/v3/users => generated 282 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:32:22.282308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37782965-2ff2-40ec-aa96-55cd42864e08 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:22.310918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37782965-2ff2-40ec-aa96-55cd42864e08 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:22.324980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96cde9-8cf8-488a-9d27-fdfe7544db84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:22.329770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96cde9-8cf8-488a-9d27-fdfe7544db84 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:22.330574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96cde9-8cf8-488a-9d27-fdfe7544db84 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:22.332540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96cde9-8cf8-488a-9d27-fdfe7544db84 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:22.335931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96cde9-8cf8-488a-9d27-fdfe7544db84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:22.338655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96cde9-8cf8-488a-9d27-fdfe7544db84 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:22.363091 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3201/6458] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:32:22.372619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd24a26-d59c-4276-af3b-b796f34414eb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:22.384114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd24a26-d59c-4276-af3b-b796f34414eb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:22.398862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6ec1a-1ac6-4056-9182-37e45f07603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:22.399612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6ec1a-1ac6-4056-9182-37e45f07603c admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:22.399888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6ec1a-1ac6-4056-9182-37e45f07603c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:22.400172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6ec1a-1ac6-4056-9182-37e45f07603c admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:22.400933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6ec1a-1ac6-4056-9182-37e45f07603c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:22.402596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6ec1a-1ac6-4056-9182-37e45f07603c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:22.433501 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3258/6459] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:32:22.434562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96cde9-8cf8-488a-9d27-fdfe7544db84 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:22.454955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96cde9-8cf8-488a-9d27-fdfe7544db84 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:22.472507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cc0a3-ff7d-4d7e-85f0-f5e0aa98ad66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:22.473397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cc0a3-ff7d-4d7e-85f0-f5e0aa98ad66 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:22.473682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cc0a3-ff7d-4d7e-85f0-f5e0aa98ad66 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:22.474162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cc0a3-ff7d-4d7e-85f0-f5e0aa98ad66 admin admin] PATH_INFO: `/v3/projects/183be60f687e4591b55394d821ce1afa/users/5de7daf223b846728db15890bc4e1bae/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:22.520275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4cc0a3-ff7d-4d7e-85f0-f5e0aa98ad66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=183be60f687e4591b55394d821ce1afa, user_id=5de7daf223b846728db15890bc4e1bae, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:22.523453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4cc0a3-ff7d-4d7e-85f0-f5e0aa98ad66 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:22.639455 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3202/6460] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:32:22 2022] PUT /identity/v3/projects/183be60f687e4591b55394d821ce1afa/users/5de7daf223b846728db15890bc4e1bae/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:22.651629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928146f-005a-420f-bd92-db9bf3c35a0c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:22.652517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928146f-005a-420f-bd92-db9bf3c35a0c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:22.652956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928146f-005a-420f-bd92-db9bf3c35a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:22.687644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4928146f-005a-420f-bd92-db9bf3c35a0c None None] MFA Rules not processed for user `5de7daf223b846728db15890bc4e1bae`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:22.688887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4928146f-005a-420f-bd92-db9bf3c35a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:22.828122 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3259/6461] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:22 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:22.883341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cc0a3-ff7d-4d7e-85f0-f5e0aa98ad66 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:22.886100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4e4cc0a3-ff7d-4d7e-85f0-f5e0aa98ad66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:23.042080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cc0a3-ff7d-4d7e-85f0-f5e0aa98ad66 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:23.048559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cce3d-d579-48fd-b485-0c06301138dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:23.049244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cce3d-d579-48fd-b485-0c06301138dc service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:23.049537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cce3d-d579-48fd-b485-0c06301138dc service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:23.049901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cce3d-d579-48fd-b485-0c06301138dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:23.064738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cce3d-d579-48fd-b485-0c06301138dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:23.066267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cce3d-d579-48fd-b485-0c06301138dc service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:23.079797 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3203/6462] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:32:22 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:32:23.552110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:24.220678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:24.960856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928146f-005a-420f-bd92-db9bf3c35a0c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:24.962461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4928146f-005a-420f-bd92-db9bf3c35a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:25.074845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928146f-005a-420f-bd92-db9bf3c35a0c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:25.080419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3573f-ef14-4d2e-9403-d385dab3ee64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:25.081953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3573f-ef14-4d2e-9403-d385dab3ee64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:25.082440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3573f-ef14-4d2e-9403-d385dab3ee64 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:25.082868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3573f-ef14-4d2e-9403-d385dab3ee64 admin admin] PATH_INFO: `/v3/users/170ea91a523444618d58e7fff9441f09` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:25.084286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3573f-ef14-4d2e-9403-d385dab3ee64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=170ea91a523444618d58e7fff9441f09)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:25.086318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3573f-ef14-4d2e-9403-d385dab3ee64 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:25.388182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5db3573f-ef14-4d2e-9403-d385dab3ee64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '170ea91a523444618d58e7fff9441f09'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:25.398743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5db3573f-ef14-4d2e-9403-d385dab3ee64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '170ea91a523444618d58e7fff9441f09'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:25.554323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5db3573f-ef14-4d2e-9403-d385dab3ee64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '170ea91a523444618d58e7fff9441f09'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:25.558666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:25.559393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5db3573f-ef14-4d2e-9403-d385dab3ee64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '170ea91a523444618d58e7fff9441f09'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:25.572614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5db3573f-ef14-4d2e-9403-d385dab3ee64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '170ea91a523444618d58e7fff9441f09'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:25.580346 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3260/6463] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:32:24 2022] DELETE /identity/v3/users/170ea91a523444618d58e7fff9441f09 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:25.586642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cac8fe-fc6a-4950-8889-33d30067fc8f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:25.587885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cac8fe-fc6a-4950-8889-33d30067fc8f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:25.588348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cac8fe-fc6a-4950-8889-33d30067fc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:25.627341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e7cac8fe-fc6a-4950-8889-33d30067fc8f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:25.645282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e7cac8fe-fc6a-4950-8889-33d30067fc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:25.763631 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3204/6464] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:32:26.133487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3573f-ef14-4d2e-9403-d385dab3ee64 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:26.135767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5db3573f-ef14-4d2e-9403-d385dab3ee64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:26.218287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3573f-ef14-4d2e-9403-d385dab3ee64 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:26.224393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b4e58-7465-4d2a-9875-615ad2b19bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:26.224957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b4e58-7465-4d2a-9875-615ad2b19bfa service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:26.225414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b4e58-7465-4d2a-9875-615ad2b19bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:26.225867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b4e58-7465-4d2a-9875-615ad2b19bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:26.238287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b4e58-7465-4d2a-9875-615ad2b19bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:26.239785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b4e58-7465-4d2a-9875-615ad2b19bfa service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:26.251429 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3261/6465] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:32:26.589687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:27.872439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cac8fe-fc6a-4950-8889-33d30067fc8f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:27.874313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e7cac8fe-fc6a-4950-8889-33d30067fc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:27.897050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cac8fe-fc6a-4950-8889-33d30067fc8f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:27.911215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55953e-6005-490f-955f-c13c3b176015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:27.912424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55953e-6005-490f-955f-c13c3b176015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:27.912885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55953e-6005-490f-955f-c13c3b176015 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:27.913420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55953e-6005-490f-955f-c13c3b176015 admin admin] PATH_INFO: `/v3/projects/16a10d534ff748a98881b4091ab41914` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:27.915989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55953e-6005-490f-955f-c13c3b176015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16a10d534ff748a98881b4091ab41914)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:27.918079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55953e-6005-490f-955f-c13c3b176015 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:28.073099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:28.147095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bb55953e-6005-490f-955f-c13c3b176015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16a10d534ff748a98881b4091ab41914', 'request_id': 'req-bb55953e-6005-490f-955f-c13c3b176015'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:28.176328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bb55953e-6005-490f-955f-c13c3b176015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16a10d534ff748a98881b4091ab41914', 'request_id': 'req-bb55953e-6005-490f-955f-c13c3b176015'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:28.189407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bb55953e-6005-490f-955f-c13c3b176015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16a10d534ff748a98881b4091ab41914', 'request_id': 'req-bb55953e-6005-490f-955f-c13c3b176015'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:28.219611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e832e7-ab4f-4aba-bd69-74aa8c19d882 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:28.220210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e832e7-ab4f-4aba-bd69-74aa8c19d882 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:28.220210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e832e7-ab4f-4aba-bd69-74aa8c19d882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:28.265484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c3e832e7-ab4f-4aba-bd69-74aa8c19d882 None None] MFA Rules not processed for user `fb1da7e5955443499f924292d85445fe`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:28.267074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c3e832e7-ab4f-4aba-bd69-74aa8c19d882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:28.285305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:28.318897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bb55953e-6005-490f-955f-c13c3b176015 admin admin] The token cache is being invalidate because project 16a10d534ff748a98881b4091ab41914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:32:28.319465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bb55953e-6005-490f-955f-c13c3b176015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:28.320916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bb55953e-6005-490f-955f-c13c3b176015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:28.323947 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3205/6466] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:32:27 2022] DELETE /identity/v3/projects/16a10d534ff748a98881b4091ab41914 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:28.332328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55953e-6005-490f-955f-c13c3b176015 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:28.339560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bb55953e-6005-490f-955f-c13c3b176015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:28.436537 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3262/6467] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:28 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:28.460122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55953e-6005-490f-955f-c13c3b176015 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:28.463970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e832e7-ab4f-4aba-bd69-74aa8c19d882 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:28.466192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c3e832e7-ab4f-4aba-bd69-74aa8c19d882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:28.472308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3af14-615e-46ae-aedd-2107299d29cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:28.473644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3af14-615e-46ae-aedd-2107299d29cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:28.474020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3af14-615e-46ae-aedd-2107299d29cf admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:28.474447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3af14-615e-46ae-aedd-2107299d29cf admin admin] PATH_INFO: `/v3/users/6514e6ab103544e985110ba788e14448` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:28.477498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3af14-615e-46ae-aedd-2107299d29cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6514e6ab103544e985110ba788e14448)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:28.481023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3af14-615e-46ae-aedd-2107299d29cf admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:28.578821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e832e7-ab4f-4aba-bd69-74aa8c19d882 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:28.588457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624a090-e734-47a6-b49c-db34073b1741 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:28.589125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624a090-e734-47a6-b49c-db34073b1741 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:28.589408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624a090-e734-47a6-b49c-db34073b1741 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:28.589717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624a090-e734-47a6-b49c-db34073b1741 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:28.593409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1624a090-e734-47a6-b49c-db34073b1741 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:28.676082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624a090-e734-47a6-b49c-db34073b1741 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:28.678062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624a090-e734-47a6-b49c-db34073b1741 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:28.694824 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3263/6468] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:32:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:32:28.780757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-44b3af14-615e-46ae-aedd-2107299d29cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6514e6ab103544e985110ba788e14448'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:28.806453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-44b3af14-615e-46ae-aedd-2107299d29cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6514e6ab103544e985110ba788e14448'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:29.138791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-44b3af14-615e-46ae-aedd-2107299d29cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6514e6ab103544e985110ba788e14448'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:29.147576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-44b3af14-615e-46ae-aedd-2107299d29cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6514e6ab103544e985110ba788e14448'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:29.148802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-44b3af14-615e-46ae-aedd-2107299d29cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6514e6ab103544e985110ba788e14448'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:29.156959 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3206/6469] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:32:28 2022] DELETE /identity/v3/users/6514e6ab103544e985110ba788e14448 => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:29.927791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624a090-e734-47a6-b49c-db34073b1741 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:29.946811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624a090-e734-47a6-b49c-db34073b1741 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:30.120705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a718414-8e43-45e2-be15-df7d96d3115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:30.121579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a718414-8e43-45e2-be15-df7d96d3115b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:30.121859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a718414-8e43-45e2-be15-df7d96d3115b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:30.122136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a718414-8e43-45e2-be15-df7d96d3115b admin admin] PATH_INFO: `/v3/projects/821ca239823a4be79fd1d169b5ed59bb` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:30.124239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a718414-8e43-45e2-be15-df7d96d3115b admin admin] RBAC: Authorizing `identity:delete_project(project_id=821ca239823a4be79fd1d169b5ed59bb)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:30.126218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a718414-8e43-45e2-be15-df7d96d3115b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:30.302794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:30.302794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3a718414-8e43-45e2-be15-df7d96d3115b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '821ca239823a4be79fd1d169b5ed59bb', 'request_id': 'req-3a718414-8e43-45e2-be15-df7d96d3115b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:30.334662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3a718414-8e43-45e2-be15-df7d96d3115b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '821ca239823a4be79fd1d169b5ed59bb', 'request_id': 'req-3a718414-8e43-45e2-be15-df7d96d3115b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:30.357560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3a718414-8e43-45e2-be15-df7d96d3115b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '821ca239823a4be79fd1d169b5ed59bb', 'request_id': 'req-3a718414-8e43-45e2-be15-df7d96d3115b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:30.516884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3a718414-8e43-45e2-be15-df7d96d3115b admin admin] The token cache is being invalidate because project 821ca239823a4be79fd1d169b5ed59bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:32:30.517573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3a718414-8e43-45e2-be15-df7d96d3115b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:30.520089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3a718414-8e43-45e2-be15-df7d96d3115b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:30.525665 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3264/6470] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:32:29 2022] DELETE /identity/v3/projects/821ca239823a4be79fd1d169b5ed59bb => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:30.527445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfa40d-98eb-48e9-a100-63cf937814c8 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:30.531609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfa40d-98eb-48e9-a100-63cf937814c8 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:30.531609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfa40d-98eb-48e9-a100-63cf937814c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:30.555889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a2dfa40d-98eb-48e9-a100-63cf937814c8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:30.560848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a2dfa40d-98eb-48e9-a100-63cf937814c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:30.678568 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3207/6471] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:32:30.688239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15ad66-01ac-461e-a3a9-4faefcdd5032 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:30.690891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15ad66-01ac-461e-a3a9-4faefcdd5032 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:30.690891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15ad66-01ac-461e-a3a9-4faefcdd5032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:30.730968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7c15ad66-01ac-461e-a3a9-4faefcdd5032 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:30.736135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7c15ad66-01ac-461e-a3a9-4faefcdd5032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:30.750186 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3265/6472] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:30.756107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfa40d-98eb-48e9-a100-63cf937814c8 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:30.772778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfa40d-98eb-48e9-a100-63cf937814c8 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:30.780195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b03a0-79ff-486e-a546-6d85c9656023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:30.781246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b03a0-79ff-486e-a546-6d85c9656023 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:30.781917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b03a0-79ff-486e-a546-6d85c9656023 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:30.782366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b03a0-79ff-486e-a546-6d85c9656023 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:30.783369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b03a0-79ff-486e-a546-6d85c9656023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:32:30.784359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b03a0-79ff-486e-a546-6d85c9656023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:30.786812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b03a0-79ff-486e-a546-6d85c9656023 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:30.805570 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3208/6473] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:32:30.816633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15ad66-01ac-461e-a3a9-4faefcdd5032 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:30.840491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15ad66-01ac-461e-a3a9-4faefcdd5032 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:30.858876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dfa2e-0b3a-4f96-8bc4-43a0680c53d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:30.865357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dfa2e-0b3a-4f96-8bc4-43a0680c53d9 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:30.865357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dfa2e-0b3a-4f96-8bc4-43a0680c53d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:30.865357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dfa2e-0b3a-4f96-8bc4-43a0680c53d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:30.865357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dfa2e-0b3a-4f96-8bc4-43a0680c53d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:30.865357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dfa2e-0b3a-4f96-8bc4-43a0680c53d9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:31.000543 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3266/6474] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:32:30 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:32:31.004987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b03a0-79ff-486e-a546-6d85c9656023 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:31.024290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b03a0-79ff-486e-a546-6d85c9656023 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:31.086370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27ca96-a348-47f8-8bc7-ece43c03ad45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:31.087444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27ca96-a348-47f8-8bc7-ece43c03ad45 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:31.087745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27ca96-a348-47f8-8bc7-ece43c03ad45 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:31.088263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27ca96-a348-47f8-8bc7-ece43c03ad45 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:31.088890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27ca96-a348-47f8-8bc7-ece43c03ad45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:31.091121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27ca96-a348-47f8-8bc7-ece43c03ad45 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:31.188624 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3209/6475] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:32:31 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:32:31.192596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dfa2e-0b3a-4f96-8bc4-43a0680c53d9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:31.226558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dfa2e-0b3a-4f96-8bc4-43a0680c53d9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:31.240691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e13e42-5c2a-4184-ac81-1ce17b20a68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:31.244244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e13e42-5c2a-4184-ac81-1ce17b20a68a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:31.244537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e13e42-5c2a-4184-ac81-1ce17b20a68a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:31.244867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e13e42-5c2a-4184-ac81-1ce17b20a68a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:31.245645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e13e42-5c2a-4184-ac81-1ce17b20a68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:31.248473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e13e42-5c2a-4184-ac81-1ce17b20a68a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:31.265072 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3267/6476] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:32:31.269930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27ca96-a348-47f8-8bc7-ece43c03ad45 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:31.328028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27ca96-a348-47f8-8bc7-ece43c03ad45 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:31.365805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fb3f8-7845-47e9-aae5-0416f6efb318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:31.366662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fb3f8-7845-47e9-aae5-0416f6efb318 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:31.366957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fb3f8-7845-47e9-aae5-0416f6efb318 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:31.367288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fb3f8-7845-47e9-aae5-0416f6efb318 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:31.368047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fb3f8-7845-47e9-aae5-0416f6efb318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:31.374017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fb3f8-7845-47e9-aae5-0416f6efb318 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:31.386110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:31.391926 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3210/6477] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:32:31.396399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e13e42-5c2a-4184-ac81-1ce17b20a68a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:31.480176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e13e42-5c2a-4184-ac81-1ce17b20a68a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:31.519553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2002a-db87-42c7-8702-2e38f28d73bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:31.523257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2002a-db87-42c7-8702-2e38f28d73bc admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:31.523634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2002a-db87-42c7-8702-2e38f28d73bc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:31.523926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2002a-db87-42c7-8702-2e38f28d73bc admin admin] PATH_INFO: `/v3/projects/f28da8bb219c45d0a8b2f74a6cb54234/users/f498aec3fca741e9ac929be7ea7582a8/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:31.566372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2002a-db87-42c7-8702-2e38f28d73bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f28da8bb219c45d0a8b2f74a6cb54234, user_id=f498aec3fca741e9ac929be7ea7582a8, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:31.569110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2002a-db87-42c7-8702-2e38f28d73bc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:31.759440 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3268/6478] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:32:31 2022] PUT /identity/v3/projects/f28da8bb219c45d0a8b2f74a6cb54234/users/f498aec3fca741e9ac929be7ea7582a8/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:31.776435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc830aff-08a7-4fe3-b39b-5aff65730e4a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:31.777007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc830aff-08a7-4fe3-b39b-5aff65730e4a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:31.777007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc830aff-08a7-4fe3-b39b-5aff65730e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:31.808478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-dc830aff-08a7-4fe3-b39b-5aff65730e4a None None] MFA Rules not processed for user `f498aec3fca741e9ac929be7ea7582a8`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:31.809935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-dc830aff-08a7-4fe3-b39b-5aff65730e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:31.938548 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3211/6479] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:31.946940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2002a-db87-42c7-8702-2e38f28d73bc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:31.948822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ddc2002a-db87-42c7-8702-2e38f28d73bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:32.040034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2002a-db87-42c7-8702-2e38f28d73bc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:32.044270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c532fc1-e775-48a7-a25d-41430ff5b4ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:32.048684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c532fc1-e775-48a7-a25d-41430ff5b4ad service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:32.048684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c532fc1-e775-48a7-a25d-41430ff5b4ad service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:32.048684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c532fc1-e775-48a7-a25d-41430ff5b4ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:32.059154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c532fc1-e775-48a7-a25d-41430ff5b4ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:32.060965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c532fc1-e775-48a7-a25d-41430ff5b4ad service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:32.076849 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3269/6480] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:32:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:32:34.127678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217f1d1-f9f6-4dc6-8abd-32691373aad4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:34.128408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217f1d1-f9f6-4dc6-8abd-32691373aad4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:34.128408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217f1d1-f9f6-4dc6-8abd-32691373aad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:34.152079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f217f1d1-f9f6-4dc6-8abd-32691373aad4 None None] MFA Rules not processed for user `4fa446573f7d42de816280280c3dec19`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:34.153365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f217f1d1-f9f6-4dc6-8abd-32691373aad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:34.222053 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3212/6481] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:34.608908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:35.365314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:37.478175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:37.675490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:38.622814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:39.836365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:41.108244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:42.559762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:42.802362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c532fc1-e775-48a7-a25d-41430ff5b4ad service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:42.893920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c532fc1-e775-48a7-a25d-41430ff5b4ad service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:42.902149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6742db-0f48-4a4f-b6bc-f4b0d77b1e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:42.903215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6742db-0f48-4a4f-b6bc-f4b0d77b1e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:42.903573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6742db-0f48-4a4f-b6bc-f4b0d77b1e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:42.903931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6742db-0f48-4a4f-b6bc-f4b0d77b1e84 admin admin] PATH_INFO: `/v3/users/f498aec3fca741e9ac929be7ea7582a8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:42.905276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6742db-0f48-4a4f-b6bc-f4b0d77b1e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f498aec3fca741e9ac929be7ea7582a8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:42.907697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6742db-0f48-4a4f-b6bc-f4b0d77b1e84 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:43.099761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:43.141291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ba6742db-0f48-4a4f-b6bc-f4b0d77b1e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f498aec3fca741e9ac929be7ea7582a8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:43.148906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ba6742db-0f48-4a4f-b6bc-f4b0d77b1e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f498aec3fca741e9ac929be7ea7582a8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:43.214273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ba6742db-0f48-4a4f-b6bc-f4b0d77b1e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f498aec3fca741e9ac929be7ea7582a8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:43.222177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ba6742db-0f48-4a4f-b6bc-f4b0d77b1e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f498aec3fca741e9ac929be7ea7582a8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:43.232860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ba6742db-0f48-4a4f-b6bc-f4b0d77b1e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f498aec3fca741e9ac929be7ea7582a8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:43.240597 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3270/6482] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:32:42 2022] DELETE /identity/v3/users/f498aec3fca741e9ac929be7ea7582a8 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:43.244744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111ba99-d9da-499d-a4e4-49c89b028e38 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:43.245383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111ba99-d9da-499d-a4e4-49c89b028e38 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:43.245831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111ba99-d9da-499d-a4e4-49c89b028e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:43.308953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8111ba99-d9da-499d-a4e4-49c89b028e38 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:43.310182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8111ba99-d9da-499d-a4e4-49c89b028e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:43.399759 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3213/6483] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:43.410946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6742db-0f48-4a4f-b6bc-f4b0d77b1e84 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:43.412575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ba6742db-0f48-4a4f-b6bc-f4b0d77b1e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:43.516349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6742db-0f48-4a4f-b6bc-f4b0d77b1e84 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:43.525202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0d183-a11b-476c-9ae3-9acac81c347d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:43.525202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0d183-a11b-476c-9ae3-9acac81c347d service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:43.525202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0d183-a11b-476c-9ae3-9acac81c347d service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:43.525202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0d183-a11b-476c-9ae3-9acac81c347d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:43.535039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0d183-a11b-476c-9ae3-9acac81c347d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:43.536944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0d183-a11b-476c-9ae3-9acac81c347d service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:43.550277 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3271/6484] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:32:44.155921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111ba99-d9da-499d-a4e4-49c89b028e38 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:44.157667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8111ba99-d9da-499d-a4e4-49c89b028e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:44.177341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111ba99-d9da-499d-a4e4-49c89b028e38 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:44.182518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6752f5-6b25-4282-8e90-180a9fb9ccf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:44.183657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6752f5-6b25-4282-8e90-180a9fb9ccf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:44.184107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6752f5-6b25-4282-8e90-180a9fb9ccf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:44.184580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6752f5-6b25-4282-8e90-180a9fb9ccf0 admin admin] PATH_INFO: `/v3/projects/f28da8bb219c45d0a8b2f74a6cb54234` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:44.186189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6752f5-6b25-4282-8e90-180a9fb9ccf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f28da8bb219c45d0a8b2f74a6cb54234)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:44.188370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6752f5-6b25-4282-8e90-180a9fb9ccf0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:44.340591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9a6752f5-6b25-4282-8e90-180a9fb9ccf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f28da8bb219c45d0a8b2f74a6cb54234', 'request_id': 'req-9a6752f5-6b25-4282-8e90-180a9fb9ccf0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:44.362251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9a6752f5-6b25-4282-8e90-180a9fb9ccf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f28da8bb219c45d0a8b2f74a6cb54234', 'request_id': 'req-9a6752f5-6b25-4282-8e90-180a9fb9ccf0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:44.379436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9a6752f5-6b25-4282-8e90-180a9fb9ccf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f28da8bb219c45d0a8b2f74a6cb54234', 'request_id': 'req-9a6752f5-6b25-4282-8e90-180a9fb9ccf0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:44.547836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9a6752f5-6b25-4282-8e90-180a9fb9ccf0 admin admin] The token cache is being invalidate because project f28da8bb219c45d0a8b2f74a6cb54234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:32:44.548400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9a6752f5-6b25-4282-8e90-180a9fb9ccf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:44.549296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9a6752f5-6b25-4282-8e90-180a9fb9ccf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:44.551552 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3214/6485] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:32:44 2022] DELETE /identity/v3/projects/f28da8bb219c45d0a8b2f74a6cb54234 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:44.556714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778621d-ccf7-40fa-bd75-94b8e75614cd None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:44.557583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778621d-ccf7-40fa-bd75-94b8e75614cd None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:44.558029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778621d-ccf7-40fa-bd75-94b8e75614cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:44.667446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b778621d-ccf7-40fa-bd75-94b8e75614cd None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:44.670852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b778621d-ccf7-40fa-bd75-94b8e75614cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:44.770708 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3272/6486] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:44.779197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79891df-7727-4a02-a8f3-03f7d6e6c7ed None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:44.779610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79891df-7727-4a02-a8f3-03f7d6e6c7ed None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:44.779761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79891df-7727-4a02-a8f3-03f7d6e6c7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:44.829942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a79891df-7727-4a02-a8f3-03f7d6e6c7ed None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:44.832302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a79891df-7727-4a02-a8f3-03f7d6e6c7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:44.850817 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3215/6487] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:44.859684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778621d-ccf7-40fa-bd75-94b8e75614cd None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:44.874587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778621d-ccf7-40fa-bd75-94b8e75614cd None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:44.881608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38826a-9bc3-4d42-82c1-82d5c39f9360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:44.882370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38826a-9bc3-4d42-82c1-82d5c39f9360 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:44.882724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38826a-9bc3-4d42-82c1-82d5c39f9360 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:44.883212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38826a-9bc3-4d42-82c1-82d5c39f9360 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:44.884001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be38826a-9bc3-4d42-82c1-82d5c39f9360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:32:44.888718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be38826a-9bc3-4d42-82c1-82d5c39f9360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:44.888718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be38826a-9bc3-4d42-82c1-82d5c39f9360 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:44.902327 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3273/6488] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:32:44.903571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79891df-7727-4a02-a8f3-03f7d6e6c7ed None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:44.913476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79891df-7727-4a02-a8f3-03f7d6e6c7ed None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:44.918639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaeab44-ac79-4a59-ab99-5db0d4afa822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:44.919373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeab44-ac79-4a59-ab99-5db0d4afa822 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:44.919660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeab44-ac79-4a59-ab99-5db0d4afa822 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:44.919937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeab44-ac79-4a59-ab99-5db0d4afa822 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:44.920627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaeab44-ac79-4a59-ab99-5db0d4afa822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:44.922548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaeab44-ac79-4a59-ab99-5db0d4afa822 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:45.067704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38826a-9bc3-4d42-82c1-82d5c39f9360 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:45.077471 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3216/6489] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:32:44 2022] POST /identity/v3/projects => generated 371 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:32:45.084673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38826a-9bc3-4d42-82c1-82d5c39f9360 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:45.164235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ab6fd-da2f-49cf-9b0e-c71006829446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:45.165635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ab6fd-da2f-49cf-9b0e-c71006829446 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:45.166317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ab6fd-da2f-49cf-9b0e-c71006829446 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:45.166454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ab6fd-da2f-49cf-9b0e-c71006829446 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:45.167241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ab6fd-da2f-49cf-9b0e-c71006829446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:45.190366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ab6fd-da2f-49cf-9b0e-c71006829446 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:45.318438 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3274/6490] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:32:45 2022] POST /identity/v3/users => generated 286 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:32:45.324047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaeab44-ac79-4a59-ab99-5db0d4afa822 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:45.340815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaeab44-ac79-4a59-ab99-5db0d4afa822 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:45.355658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a811f4-b117-4122-a428-cadd3bf26594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:45.356367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a811f4-b117-4122-a428-cadd3bf26594 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:45.356640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a811f4-b117-4122-a428-cadd3bf26594 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:45.356916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a811f4-b117-4122-a428-cadd3bf26594 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:45.357839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a811f4-b117-4122-a428-cadd3bf26594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:45.365781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a811f4-b117-4122-a428-cadd3bf26594 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:45.385370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ab6fd-da2f-49cf-9b0e-c71006829446 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:45.385881 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3217/6491] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:32:45.391620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:45.397922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ab6fd-da2f-49cf-9b0e-c71006829446 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:45.405919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ee766-4536-4247-a745-bf3ab3f04e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:45.406606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ee766-4536-4247-a745-bf3ab3f04e0e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:45.406894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ee766-4536-4247-a745-bf3ab3f04e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:45.407213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ee766-4536-4247-a745-bf3ab3f04e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:45.408093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ee766-4536-4247-a745-bf3ab3f04e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:45.410621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ee766-4536-4247-a745-bf3ab3f04e0e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:45.424923 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3275/6492] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:32:45.426954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a811f4-b117-4122-a428-cadd3bf26594 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:45.437254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a811f4-b117-4122-a428-cadd3bf26594 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:45.443162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5c948-c1f6-4bb6-8c9b-fc423b04524e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:45.444057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5c948-c1f6-4bb6-8c9b-fc423b04524e admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:45.444342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5c948-c1f6-4bb6-8c9b-fc423b04524e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:45.444621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5c948-c1f6-4bb6-8c9b-fc423b04524e admin admin] PATH_INFO: `/v3/projects/7c6abedcdee44e27947e60ee51754290/users/54beecf18b6d4f6580693cc45ec9d51d/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:45.461142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5c948-c1f6-4bb6-8c9b-fc423b04524e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c6abedcdee44e27947e60ee51754290, user_id=54beecf18b6d4f6580693cc45ec9d51d, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:45.464309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5c948-c1f6-4bb6-8c9b-fc423b04524e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:45.579524 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3218/6493] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:32:45 2022] PUT /identity/v3/projects/7c6abedcdee44e27947e60ee51754290/users/54beecf18b6d4f6580693cc45ec9d51d/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:32:45.586664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7581ff-0d20-41ba-9978-97c7d9dd6b6e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:45.587561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7581ff-0d20-41ba-9978-97c7d9dd6b6e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:45.587894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7581ff-0d20-41ba-9978-97c7d9dd6b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:45.643166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ae7581ff-0d20-41ba-9978-97c7d9dd6b6e None None] MFA Rules not processed for user `54beecf18b6d4f6580693cc45ec9d51d`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:45.644530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ae7581ff-0d20-41ba-9978-97c7d9dd6b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:45.793434 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3276/6494] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:45.806030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5c948-c1f6-4bb6-8c9b-fc423b04524e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:45.808360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9dd5c948-c1f6-4bb6-8c9b-fc423b04524e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:45.962211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5c948-c1f6-4bb6-8c9b-fc423b04524e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:45.967259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ef9e9-78f2-4f5b-97c1-04b34316d7e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:45.971521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ef9e9-78f2-4f5b-97c1-04b34316d7e5 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:45.971521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ef9e9-78f2-4f5b-97c1-04b34316d7e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:45.971521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ef9e9-78f2-4f5b-97c1-04b34316d7e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:46.000037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:46.009326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ef9e9-78f2-4f5b-97c1-04b34316d7e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:46.011081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ef9e9-78f2-4f5b-97c1-04b34316d7e5 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:46.035641 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3219/6495] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:32:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:32:48.317150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:48.827071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:49.864174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:50.246851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:51.328314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7581ff-0d20-41ba-9978-97c7d9dd6b6e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:51.341165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7581ff-0d20-41ba-9978-97c7d9dd6b6e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:51.345199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2649bd-312d-4bda-bf11-f5509ba0b2a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:51.345886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2649bd-312d-4bda-bf11-f5509ba0b2a0 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:51.346170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2649bd-312d-4bda-bf11-f5509ba0b2a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:51.346590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2649bd-312d-4bda-bf11-f5509ba0b2a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:51.348498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-be2649bd-312d-4bda-bf11-f5509ba0b2a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:51.454360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2649bd-312d-4bda-bf11-f5509ba0b2a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:51.457042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2649bd-312d-4bda-bf11-f5509ba0b2a0 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:51.473086 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3277/6496] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:32:51 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:32:51.522337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:51.751806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:52.601739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ef9e9-78f2-4f5b-97c1-04b34316d7e5 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:52.604400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0d6ef9e9-78f2-4f5b-97c1-04b34316d7e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:52.682332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ef9e9-78f2-4f5b-97c1-04b34316d7e5 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:52.688903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfc531-8039-4797-9666-ac4f906b8dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:52.690324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfc531-8039-4797-9666-ac4f906b8dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:52.690819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfc531-8039-4797-9666-ac4f906b8dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:52.691324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfc531-8039-4797-9666-ac4f906b8dcf admin admin] PATH_INFO: `/v3/users/08abcba4284e434680ee4640f1541cf9` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:52.692852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfc531-8039-4797-9666-ac4f906b8dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=08abcba4284e434680ee4640f1541cf9)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:52.695103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfc531-8039-4797-9666-ac4f906b8dcf admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:52.922560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b4dfc531-8039-4797-9666-ac4f906b8dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08abcba4284e434680ee4640f1541cf9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:52.942587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b4dfc531-8039-4797-9666-ac4f906b8dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08abcba4284e434680ee4640f1541cf9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:53.021049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b4dfc531-8039-4797-9666-ac4f906b8dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08abcba4284e434680ee4640f1541cf9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:53.030918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b4dfc531-8039-4797-9666-ac4f906b8dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08abcba4284e434680ee4640f1541cf9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:53.031769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b4dfc531-8039-4797-9666-ac4f906b8dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08abcba4284e434680ee4640f1541cf9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:53.042910 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3220/6497] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:32:52 2022] DELETE /identity/v3/users/08abcba4284e434680ee4640f1541cf9 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:53.562578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:53.573846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2649bd-312d-4bda-bf11-f5509ba0b2a0 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:53.593263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2649bd-312d-4bda-bf11-f5509ba0b2a0 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:53.697858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bddc293-2cdc-4204-8dc2-a894826e5f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:53.698913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddc293-2cdc-4204-8dc2-a894826e5f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:53.699307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddc293-2cdc-4204-8dc2-a894826e5f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:53.699660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddc293-2cdc-4204-8dc2-a894826e5f57 admin admin] PATH_INFO: `/v3/projects/367c69301e6a44419af5c2d28b616b80` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:53.702377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bddc293-2cdc-4204-8dc2-a894826e5f57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=367c69301e6a44419af5c2d28b616b80)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:53.704680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bddc293-2cdc-4204-8dc2-a894826e5f57 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:53.747462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:53.908842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2bddc293-2cdc-4204-8dc2-a894826e5f57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '367c69301e6a44419af5c2d28b616b80', 'request_id': 'req-2bddc293-2cdc-4204-8dc2-a894826e5f57'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:53.919543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2bddc293-2cdc-4204-8dc2-a894826e5f57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '367c69301e6a44419af5c2d28b616b80', 'request_id': 'req-2bddc293-2cdc-4204-8dc2-a894826e5f57'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:53.931222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2bddc293-2cdc-4204-8dc2-a894826e5f57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '367c69301e6a44419af5c2d28b616b80', 'request_id': 'req-2bddc293-2cdc-4204-8dc2-a894826e5f57'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:54.036285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2bddc293-2cdc-4204-8dc2-a894826e5f57 admin admin] The token cache is being invalidate because project 367c69301e6a44419af5c2d28b616b80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:32:54.036710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2bddc293-2cdc-4204-8dc2-a894826e5f57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:54.039051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2bddc293-2cdc-4204-8dc2-a894826e5f57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:32:54.043096 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3278/6498] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:32:53 2022] DELETE /identity/v3/projects/367c69301e6a44419af5c2d28b616b80 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:54.048588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15780660-431e-4708-a563-b4ae9ed5324d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:54.048588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15780660-431e-4708-a563-b4ae9ed5324d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:54.049719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15780660-431e-4708-a563-b4ae9ed5324d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:54.084074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-15780660-431e-4708-a563-b4ae9ed5324d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:54.094946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-15780660-431e-4708-a563-b4ae9ed5324d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:54.223530 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3221/6499] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:54.235429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67ecee-0b2f-48d0-8ddc-4757f00253d5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:54.253694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67ecee-0b2f-48d0-8ddc-4757f00253d5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:54.253694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67ecee-0b2f-48d0-8ddc-4757f00253d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:54.263622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8d67ecee-0b2f-48d0-8ddc-4757f00253d5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:54.265193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8d67ecee-0b2f-48d0-8ddc-4757f00253d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:54.294792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15780660-431e-4708-a563-b4ae9ed5324d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:54.295285 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3279/6500] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:54.310962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15780660-431e-4708-a563-b4ae9ed5324d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:54.315958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b8394-b9f8-4239-b975-e025f0943720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:54.316641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b8394-b9f8-4239-b975-e025f0943720 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:54.317147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b8394-b9f8-4239-b975-e025f0943720 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:54.317909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b8394-b9f8-4239-b975-e025f0943720 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:54.318302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b8394-b9f8-4239-b975-e025f0943720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:32:54.318785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b8394-b9f8-4239-b975-e025f0943720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:54.320612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b8394-b9f8-4239-b975-e025f0943720 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:54.351709 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3222/6501] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:32:54.355958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67ecee-0b2f-48d0-8ddc-4757f00253d5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:54.366690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67ecee-0b2f-48d0-8ddc-4757f00253d5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:54.372002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a8de5-ebeb-4990-8448-7d993fab07a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:54.372610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a8de5-ebeb-4990-8448-7d993fab07a2 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:54.372921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a8de5-ebeb-4990-8448-7d993fab07a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:54.373326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a8de5-ebeb-4990-8448-7d993fab07a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:54.374018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a8de5-ebeb-4990-8448-7d993fab07a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:54.376063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a8de5-ebeb-4990-8448-7d993fab07a2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:54.510741 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3280/6502] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:32:54 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:32:54.514900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b8394-b9f8-4239-b975-e025f0943720 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:54.526987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b8394-b9f8-4239-b975-e025f0943720 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:54.604905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64638b8c-aa6e-4ec9-b8df-0fde24fcfe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:54.605591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64638b8c-aa6e-4ec9-b8df-0fde24fcfe44 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:54.605881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64638b8c-aa6e-4ec9-b8df-0fde24fcfe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:54.606161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64638b8c-aa6e-4ec9-b8df-0fde24fcfe44 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:54.606916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64638b8c-aa6e-4ec9-b8df-0fde24fcfe44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:54.609019 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64638b8c-aa6e-4ec9-b8df-0fde24fcfe44 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:54.741564 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3223/6503] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:32:54 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:32:54.742885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a8de5-ebeb-4990-8448-7d993fab07a2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:54.765996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a8de5-ebeb-4990-8448-7d993fab07a2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:54.780757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25727317-2fca-4e68-95a9-dc273fb2aaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:54.781511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25727317-2fca-4e68-95a9-dc273fb2aaa1 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:54.781858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25727317-2fca-4e68-95a9-dc273fb2aaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:54.782397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25727317-2fca-4e68-95a9-dc273fb2aaa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:54.783839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25727317-2fca-4e68-95a9-dc273fb2aaa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:54.787717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25727317-2fca-4e68-95a9-dc273fb2aaa1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:54.806444 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3281/6504] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:32:54.810821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64638b8c-aa6e-4ec9-b8df-0fde24fcfe44 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:54.831229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64638b8c-aa6e-4ec9-b8df-0fde24fcfe44 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:54.847869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9469e5-b462-4533-9636-c5a3a712cbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:54.848130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9469e5-b462-4533-9636-c5a3a712cbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:54.848379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9469e5-b462-4533-9636-c5a3a712cbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:54.849548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9469e5-b462-4533-9636-c5a3a712cbf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:54.850306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9469e5-b462-4533-9636-c5a3a712cbf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:54.852326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9469e5-b462-4533-9636-c5a3a712cbf1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:54.871680 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3224/6505] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:32:54.880040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25727317-2fca-4e68-95a9-dc273fb2aaa1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:54.903394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25727317-2fca-4e68-95a9-dc273fb2aaa1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:54.922940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257719d-f22d-43ad-8769-57e1ab7df051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:54.924595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257719d-f22d-43ad-8769-57e1ab7df051 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:54.924975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257719d-f22d-43ad-8769-57e1ab7df051 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:54.925348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257719d-f22d-43ad-8769-57e1ab7df051 admin admin] PATH_INFO: `/v3/projects/da2248fa190342f0bfe9211cae1e403b/users/22e264440fff43cdb7be6702839af37f/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:54.957829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257719d-f22d-43ad-8769-57e1ab7df051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da2248fa190342f0bfe9211cae1e403b, user_id=22e264440fff43cdb7be6702839af37f, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:54.960733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257719d-f22d-43ad-8769-57e1ab7df051 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:55.092772 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3282/6506] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:32:54 2022] PUT /identity/v3/projects/da2248fa190342f0bfe9211cae1e403b/users/22e264440fff43cdb7be6702839af37f/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:32:55.098302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7342607-f4af-4002-9aed-c140d0b356cc None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:55.098811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7342607-f4af-4002-9aed-c140d0b356cc None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:55.099253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7342607-f4af-4002-9aed-c140d0b356cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:55.165892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c7342607-f4af-4002-9aed-c140d0b356cc None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:32:55.168897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c7342607-f4af-4002-9aed-c140d0b356cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:55.279431 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3225/6507] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:32:55.294098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257719d-f22d-43ad-8769-57e1ab7df051 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:32:55.296282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4257719d-f22d-43ad-8769-57e1ab7df051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:32:55.417914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257719d-f22d-43ad-8769-57e1ab7df051 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:32:55.424618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69672fea-880d-4c4a-994d-d2973f6507d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:32:55.426903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69672fea-880d-4c4a-994d-d2973f6507d9 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:32:55.427417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69672fea-880d-4c4a-994d-d2973f6507d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:32:55.427855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69672fea-880d-4c4a-994d-d2973f6507d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:32:55.443909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69672fea-880d-4c4a-994d-d2973f6507d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:32:55.445632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69672fea-880d-4c4a-994d-d2973f6507d9 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:32:55.458672 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3283/6508] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:32:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:32:55.664295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:55.897048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:56.788662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:58.066477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:59.122005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:32:59.625734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:01.889328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:02.762584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:04.537665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:04.586639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8eeb52-c281-485d-bc5d-bafdcb59d5e3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:33:04.587290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8eeb52-c281-485d-bc5d-bafdcb59d5e3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:33:04.587290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8eeb52-c281-485d-bc5d-bafdcb59d5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:33:04.635473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9b8eeb52-c281-485d-bc5d-bafdcb59d5e3 None None] MFA Rules not processed for user `22e264440fff43cdb7be6702839af37f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:33:04.637301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9b8eeb52-c281-485d-bc5d-bafdcb59d5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:33:04.761038 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3226/6509] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:33:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:33:04.777868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829d17c-7521-42d5-991d-7fd90fd46ede None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:33:04.779116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829d17c-7521-42d5-991d-7fd90fd46ede None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:33:04.779572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829d17c-7521-42d5-991d-7fd90fd46ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:33:04.797495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:04.823601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d829d17c-7521-42d5-991d-7fd90fd46ede None None] MFA Rules not processed for user `22e264440fff43cdb7be6702839af37f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:33:04.825204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d829d17c-7521-42d5-991d-7fd90fd46ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:33:04.834530 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3284/6510] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:33:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:33:05.160402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8eeb52-c281-485d-bc5d-bafdcb59d5e3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:33:05.162367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9b8eeb52-c281-485d-bc5d-bafdcb59d5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:33:05.331508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8eeb52-c281-485d-bc5d-bafdcb59d5e3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:33:05.339526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75422e2-9db1-4c0c-8b0d-d03bca787c4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:33:05.345077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75422e2-9db1-4c0c-8b0d-d03bca787c4f service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:33:05.347939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75422e2-9db1-4c0c-8b0d-d03bca787c4f service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:33:05.349086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75422e2-9db1-4c0c-8b0d-d03bca787c4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:33:05.375437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75422e2-9db1-4c0c-8b0d-d03bca787c4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:33:05.377662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75422e2-9db1-4c0c-8b0d-d03bca787c4f service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:33:05.411577 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3227/6511] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:33:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:33:06.043607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:06.236088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465035d8-0136-459a-8bf6-3f72288efb92 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:33:06.237802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465035d8-0136-459a-8bf6-3f72288efb92 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:33:06.238462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465035d8-0136-459a-8bf6-3f72288efb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:33:06.305205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-465035d8-0136-459a-8bf6-3f72288efb92 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:33:06.306335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-465035d8-0136-459a-8bf6-3f72288efb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:33:06.457565 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3285/6512] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:33:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:33:06.657574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75422e2-9db1-4c0c-8b0d-d03bca787c4f service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:33:06.660028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b75422e2-9db1-4c0c-8b0d-d03bca787c4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:33:06.849036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75422e2-9db1-4c0c-8b0d-d03bca787c4f service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:33:06.855251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fd9ed-66dc-47e9-a78a-64474b88a065 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:33:06.856149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fd9ed-66dc-47e9-a78a-64474b88a065 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:33:06.856543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fd9ed-66dc-47e9-a78a-64474b88a065 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:33:06.857123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fd9ed-66dc-47e9-a78a-64474b88a065 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:33:06.875207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fd9ed-66dc-47e9-a78a-64474b88a065 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:33:06.877100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fd9ed-66dc-47e9-a78a-64474b88a065 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:33:06.885105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:06.912368 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3228/6513] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:33:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:33:07.231454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:07.798061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:13.451682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465035d8-0136-459a-8bf6-3f72288efb92 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:33:13.453156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-465035d8-0136-459a-8bf6-3f72288efb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:33:13.494619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465035d8-0136-459a-8bf6-3f72288efb92 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:33:13.498812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac7a11-218b-4cc5-bcec-242bb00d220f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:33:13.500160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac7a11-218b-4cc5-bcec-242bb00d220f service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:33:13.500611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac7a11-218b-4cc5-bcec-242bb00d220f service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:33:13.501040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac7a11-218b-4cc5-bcec-242bb00d220f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:33:13.504104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c6ac7a11-218b-4cc5-bcec-242bb00d220f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:33:13.529854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac7a11-218b-4cc5-bcec-242bb00d220f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:33:13.532776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac7a11-218b-4cc5-bcec-242bb00d220f service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:33:13.562345 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3286/6514] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:33:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:33:15.180711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fd9ed-66dc-47e9-a78a-64474b88a065 service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:33:15.196313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fd9ed-66dc-47e9-a78a-64474b88a065 service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:33:15.210745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cb41a-eb97-46d9-bfb2-d530b5c56812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:33:15.213335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cb41a-eb97-46d9-bfb2-d530b5c56812 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:33:15.213814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cb41a-eb97-46d9-bfb2-d530b5c56812 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:33:15.214325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cb41a-eb97-46d9-bfb2-d530b5c56812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:33:15.216683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-907cb41a-eb97-46d9-bfb2-d530b5c56812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:33:15.264325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cb41a-eb97-46d9-bfb2-d530b5c56812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:33:15.269042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cb41a-eb97-46d9-bfb2-d530b5c56812 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:33:15.326707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac7a11-218b-4cc5-bcec-242bb00d220f service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:33:15.335255 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3229/6515] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:33:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:33:15.354668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac7a11-218b-4cc5-bcec-242bb00d220f service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:33:15.370979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55016bdd-e1c1-436c-992b-c75b5eb29267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:33:15.385492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55016bdd-e1c1-436c-992b-c75b5eb29267 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:33:15.385492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55016bdd-e1c1-436c-992b-c75b5eb29267 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:33:15.385492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55016bdd-e1c1-436c-992b-c75b5eb29267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:33:15.394360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-55016bdd-e1c1-436c-992b-c75b5eb29267 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:33:15.597726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55016bdd-e1c1-436c-992b-c75b5eb29267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:33:15.599843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55016bdd-e1c1-436c-992b-c75b5eb29267 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:33:15.613443 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3287/6516] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:33:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:33:25.291553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:25.609966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=80 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:25.802379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14092ba-f004-4ec9-b893-d38448e16f07 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:33:25.803691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14092ba-f004-4ec9-b893-d38448e16f07 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:33:25.809810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14092ba-f004-4ec9-b893-d38448e16f07 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:33:25.812036 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3230/6517] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:33:25 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:33:25.839365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85963016-6234-49e0-825c-74927bc36736 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:33:25.839365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85963016-6234-49e0-825c-74927bc36736 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:33:25.839365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85963016-6234-49e0-825c-74927bc36736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:33:25.936231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-85963016-6234-49e0-825c-74927bc36736 None None] MFA Rules not processed for user `fbd858f3e6ba4523b056bbdc2af427b0`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:33:25.938931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-85963016-6234-49e0-825c-74927bc36736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:33:25.959753 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3288/6518] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:33:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:33:25.985782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14092ba-f004-4ec9-b893-d38448e16f07 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:33:26.019610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14092ba-f004-4ec9-b893-d38448e16f07 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:33:26.038857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efb4d4-62c2-4649-91c7-ee3c37e35a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:33:26.041583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efb4d4-62c2-4649-91c7-ee3c37e35a53 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:33:26.041974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efb4d4-62c2-4649-91c7-ee3c37e35a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:33:26.046697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85963016-6234-49e0-825c-74927bc36736 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:33:26.048226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-85963016-6234-49e0-825c-74927bc36736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:33:26.051574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efb4d4-62c2-4649-91c7-ee3c37e35a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:33:26.063490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efb4d4-62c2-4649-91c7-ee3c37e35a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:33:26.069776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efb4d4-62c2-4649-91c7-ee3c37e35a53 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:33:26.088900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85963016-6234-49e0-825c-74927bc36736 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:33:26.090958 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3231/6519] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:33:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:33:26.114501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bc7cc-7160-447f-9297-4f963753bdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:33:26.115614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bc7cc-7160-447f-9297-4f963753bdd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:33:26.115899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bc7cc-7160-447f-9297-4f963753bdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:33:26.116179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bc7cc-7160-447f-9297-4f963753bdd4 admin admin] PATH_INFO: `/v3/users/4ddfae3448704591b662de83b97a1876` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:33:26.119544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2bc7cc-7160-447f-9297-4f963753bdd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ddfae3448704591b662de83b97a1876)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:33:26.121577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2bc7cc-7160-447f-9297-4f963753bdd4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:33:26.411247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-db2bc7cc-7160-447f-9297-4f963753bdd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ddfae3448704591b662de83b97a1876'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:33:26.431284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-db2bc7cc-7160-447f-9297-4f963753bdd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ddfae3448704591b662de83b97a1876'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:33:26.581427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-db2bc7cc-7160-447f-9297-4f963753bdd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ddfae3448704591b662de83b97a1876'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:33:26.582513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-db2bc7cc-7160-447f-9297-4f963753bdd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ddfae3448704591b662de83b97a1876'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:33:26.646193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-db2bc7cc-7160-447f-9297-4f963753bdd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ddfae3448704591b662de83b97a1876'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:33:26.662521 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3289/6520] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:33:26 2022] DELETE /identity/v3/users/4ddfae3448704591b662de83b97a1876 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:33:26.664281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58885974-3e12-4926-bb29-534c4a0ba3ec None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:33:26.665093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58885974-3e12-4926-bb29-534c4a0ba3ec None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:33:26.665529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58885974-3e12-4926-bb29-534c4a0ba3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:33:26.707755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-58885974-3e12-4926-bb29-534c4a0ba3ec None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:33:26.709000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-58885974-3e12-4926-bb29-534c4a0ba3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:33:26.945159 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3232/6521] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:33:26.986350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bc7cc-7160-447f-9297-4f963753bdd4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:33:26.988685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-db2bc7cc-7160-447f-9297-4f963753bdd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:33:27.190681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bc7cc-7160-447f-9297-4f963753bdd4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:33:27.193954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24e8fd-db6c-47b1-a09c-0130b80cfd3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:33:27.194617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24e8fd-db6c-47b1-a09c-0130b80cfd3a service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:33:27.194896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24e8fd-db6c-47b1-a09c-0130b80cfd3a service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:33:27.195243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24e8fd-db6c-47b1-a09c-0130b80cfd3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:33:27.231426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24e8fd-db6c-47b1-a09c-0130b80cfd3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:33:27.240231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24e8fd-db6c-47b1-a09c-0130b80cfd3a service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:33:27.268831 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3290/6522] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:33:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:33:28.401398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58885974-3e12-4926-bb29-534c4a0ba3ec None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:33:28.403580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-58885974-3e12-4926-bb29-534c4a0ba3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:33:28.439570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58885974-3e12-4926-bb29-534c4a0ba3ec None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:33:28.444059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203bf86-688e-4ead-b41e-2047bd7130b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:33:28.445498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203bf86-688e-4ead-b41e-2047bd7130b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:33:28.446674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203bf86-688e-4ead-b41e-2047bd7130b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:33:28.447383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203bf86-688e-4ead-b41e-2047bd7130b1 admin admin] PATH_INFO: `/v3/projects/bed7c94624484c7cb8abeb3bfc8757b9` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:33:28.450072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203bf86-688e-4ead-b41e-2047bd7130b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bed7c94624484c7cb8abeb3bfc8757b9)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:33:28.452724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203bf86-688e-4ead-b41e-2047bd7130b1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:33:28.733016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3203bf86-688e-4ead-b41e-2047bd7130b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bed7c94624484c7cb8abeb3bfc8757b9', 'request_id': 'req-3203bf86-688e-4ead-b41e-2047bd7130b1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:33:28.750389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3203bf86-688e-4ead-b41e-2047bd7130b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bed7c94624484c7cb8abeb3bfc8757b9', 'request_id': 'req-3203bf86-688e-4ead-b41e-2047bd7130b1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:33:28.766320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3203bf86-688e-4ead-b41e-2047bd7130b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bed7c94624484c7cb8abeb3bfc8757b9', 'request_id': 'req-3203bf86-688e-4ead-b41e-2047bd7130b1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:33:28.876527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3203bf86-688e-4ead-b41e-2047bd7130b1 admin admin] The token cache is being invalidate because project bed7c94624484c7cb8abeb3bfc8757b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:33:28.876985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3203bf86-688e-4ead-b41e-2047bd7130b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:33:28.878399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3203bf86-688e-4ead-b41e-2047bd7130b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:33:28.880657 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3233/6523] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:33:28 2022] DELETE /identity/v3/projects/bed7c94624484c7cb8abeb3bfc8757b9 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:33:28.884873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24e8fd-db6c-47b1-a09c-0130b80cfd3a service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:33:28.899616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24e8fd-db6c-47b1-a09c-0130b80cfd3a service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:33:28.983611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:28.997501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebdcfa-22fa-43ac-922e-505e52d15af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:33:29.003401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebdcfa-22fa-43ac-922e-505e52d15af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:33:29.003401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebdcfa-22fa-43ac-922e-505e52d15af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:33:29.003401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebdcfa-22fa-43ac-922e-505e52d15af3 admin admin] PATH_INFO: `/v3/users/e91db1cb21c14af69597f34b4ea1e41e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:33:29.003401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebdcfa-22fa-43ac-922e-505e52d15af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e91db1cb21c14af69597f34b4ea1e41e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:33:29.003401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebdcfa-22fa-43ac-922e-505e52d15af3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:33:29.317492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a1ebdcfa-22fa-43ac-922e-505e52d15af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e91db1cb21c14af69597f34b4ea1e41e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:33:29.334054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a1ebdcfa-22fa-43ac-922e-505e52d15af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e91db1cb21c14af69597f34b4ea1e41e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:33:29.442487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a1ebdcfa-22fa-43ac-922e-505e52d15af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e91db1cb21c14af69597f34b4ea1e41e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:33:29.444082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a1ebdcfa-22fa-43ac-922e-505e52d15af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e91db1cb21c14af69597f34b4ea1e41e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:33:29.467150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a1ebdcfa-22fa-43ac-922e-505e52d15af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e91db1cb21c14af69597f34b4ea1e41e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:33:29.493097 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3291/6524] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:33:28 2022] DELETE /identity/v3/users/e91db1cb21c14af69597f34b4ea1e41e => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:33:30.345327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203bf86-688e-4ead-b41e-2047bd7130b1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:33:30.347726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3203bf86-688e-4ead-b41e-2047bd7130b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:33:30.417171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203bf86-688e-4ead-b41e-2047bd7130b1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:33:30.673143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc273e3b-43ef-4afc-b04e-bdc8a3a988fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:33:30.676905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc273e3b-43ef-4afc-b04e-bdc8a3a988fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:33:30.677510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc273e3b-43ef-4afc-b04e-bdc8a3a988fe admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:33:30.678027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc273e3b-43ef-4afc-b04e-bdc8a3a988fe admin admin] PATH_INFO: `/v3/projects/db44b6fa072a42b688c7ca77cc51856b` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:33:30.681358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc273e3b-43ef-4afc-b04e-bdc8a3a988fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=db44b6fa072a42b688c7ca77cc51856b)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:33:30.683636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc273e3b-43ef-4afc-b04e-bdc8a3a988fe admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:33:30.725858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:30.904980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cc273e3b-43ef-4afc-b04e-bdc8a3a988fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db44b6fa072a42b688c7ca77cc51856b', 'request_id': 'req-cc273e3b-43ef-4afc-b04e-bdc8a3a988fe'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:33:30.919935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cc273e3b-43ef-4afc-b04e-bdc8a3a988fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db44b6fa072a42b688c7ca77cc51856b', 'request_id': 'req-cc273e3b-43ef-4afc-b04e-bdc8a3a988fe'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:33:30.933849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cc273e3b-43ef-4afc-b04e-bdc8a3a988fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db44b6fa072a42b688c7ca77cc51856b', 'request_id': 'req-cc273e3b-43ef-4afc-b04e-bdc8a3a988fe'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:33:31.054032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cc273e3b-43ef-4afc-b04e-bdc8a3a988fe admin admin] The token cache is being invalidate because project db44b6fa072a42b688c7ca77cc51856b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:33:31.054513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cc273e3b-43ef-4afc-b04e-bdc8a3a988fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:33:31.055465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cc273e3b-43ef-4afc-b04e-bdc8a3a988fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:33:31.058727 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3234/6525] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:33:30 2022] DELETE /identity/v3/projects/db44b6fa072a42b688c7ca77cc51856b => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:33:31.728791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cb78d-cd86-4a33-b410-6800ba85e862 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:33:31.729338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cb78d-cd86-4a33-b410-6800ba85e862 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:33:31.729338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cb78d-cd86-4a33-b410-6800ba85e862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:33:31.758184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7b4cb78d-cd86-4a33-b410-6800ba85e862 None None] MFA Rules not processed for user `22e264440fff43cdb7be6702839af37f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:33:31.760066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7b4cb78d-cd86-4a33-b410-6800ba85e862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:33:31.890507 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3292/6526] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:33:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:33:41.794009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:41.843784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:46.164116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd477421-ea8e-4a93-bc34-346b3c3fa06c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:33:46.165176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd477421-ea8e-4a93-bc34-346b3c3fa06c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:33:46.165636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd477421-ea8e-4a93-bc34-346b3c3fa06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:33:46.190411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-fd477421-ea8e-4a93-bc34-346b3c3fa06c None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:33:46.191918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fd477421-ea8e-4a93-bc34-346b3c3fa06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:33:46.323587 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3235/6527] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:33:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:33:46.338501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cb78d-cd86-4a33-b410-6800ba85e862 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:33:46.341007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7b4cb78d-cd86-4a33-b410-6800ba85e862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:33:46.456316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cb78d-cd86-4a33-b410-6800ba85e862 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:33:46.457652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f798e1-6323-4349-ac1c-88fe548074f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:33:46.458311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f798e1-6323-4349-ac1c-88fe548074f2 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:33:46.458595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f798e1-6323-4349-ac1c-88fe548074f2 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:33:46.458868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f798e1-6323-4349-ac1c-88fe548074f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:33:46.468325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f798e1-6323-4349-ac1c-88fe548074f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:33:46.470208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f798e1-6323-4349-ac1c-88fe548074f2 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:33:46.497144 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3293/6528] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:33:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:33:55.365905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cc542-58cd-4bd9-b319-c98b8d305781 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:33:55.366537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cc542-58cd-4bd9-b319-c98b8d305781 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:33:55.366537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cc542-58cd-4bd9-b319-c98b8d305781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:33:55.415614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b80cc542-58cd-4bd9-b319-c98b8d305781 None None] MFA Rules not processed for user `22e264440fff43cdb7be6702839af37f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:33:55.417152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b80cc542-58cd-4bd9-b319-c98b8d305781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:33:55.438869 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3236/6529] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:33:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:33:56.477331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=32 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:33:59.446625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9be18-3fdb-4e81-9704-297719a7b0f4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:33:59.447793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9be18-3fdb-4e81-9704-297719a7b0f4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:33:59.449084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9be18-3fdb-4e81-9704-297719a7b0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:33:59.469848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c6f9be18-3fdb-4e81-9704-297719a7b0f4 None None] MFA Rules not processed for user `22e264440fff43cdb7be6702839af37f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:33:59.472086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c6f9be18-3fdb-4e81-9704-297719a7b0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:33:59.500077 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3294/6530] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:33:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:01.857380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cc542-58cd-4bd9-b319-c98b8d305781 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:01.859665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b80cc542-58cd-4bd9-b319-c98b8d305781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:01.963916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cc542-58cd-4bd9-b319-c98b8d305781 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:01.971625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b27b1d-ebbf-4e97-b0d9-e6bbfc562248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:01.971625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b27b1d-ebbf-4e97-b0d9-e6bbfc562248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:01.971625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b27b1d-ebbf-4e97-b0d9-e6bbfc562248 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:01.971625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b27b1d-ebbf-4e97-b0d9-e6bbfc562248 admin admin] PATH_INFO: `/v3/users/4757098bb5a64b1990b95f97e1ab9493` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:01.972975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b27b1d-ebbf-4e97-b0d9-e6bbfc562248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4757098bb5a64b1990b95f97e1ab9493)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:01.974972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b27b1d-ebbf-4e97-b0d9-e6bbfc562248 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:02.224216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-53b27b1d-ebbf-4e97-b0d9-e6bbfc562248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4757098bb5a64b1990b95f97e1ab9493'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:02.247649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9be18-3fdb-4e81-9704-297719a7b0f4 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:02.249064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c6f9be18-3fdb-4e81-9704-297719a7b0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:02.254314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-53b27b1d-ebbf-4e97-b0d9-e6bbfc562248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4757098bb5a64b1990b95f97e1ab9493'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:02.338776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9be18-3fdb-4e81-9704-297719a7b0f4 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:02.341141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-53b27b1d-ebbf-4e97-b0d9-e6bbfc562248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4757098bb5a64b1990b95f97e1ab9493'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:02.344104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628b927-b61c-4b65-be07-9b81645c24cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:02.344914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628b927-b61c-4b65-be07-9b81645c24cb service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:02.345331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628b927-b61c-4b65-be07-9b81645c24cb service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:02.345769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628b927-b61c-4b65-be07-9b81645c24cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:02.348622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2628b927-b61c-4b65-be07-9b81645c24cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:02.351876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-53b27b1d-ebbf-4e97-b0d9-e6bbfc562248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4757098bb5a64b1990b95f97e1ab9493'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:02.352583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-53b27b1d-ebbf-4e97-b0d9-e6bbfc562248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4757098bb5a64b1990b95f97e1ab9493'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:02.359242 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3237/6531] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:34:01 2022] DELETE /identity/v3/users/4757098bb5a64b1990b95f97e1ab9493 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:02.364593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c18f9-ed1d-450c-9639-5e7bc3078db4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:02.364890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c18f9-ed1d-450c-9639-5e7bc3078db4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:02.365168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c18f9-ed1d-450c-9639-5e7bc3078db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:02.368841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628b927-b61c-4b65-be07-9b81645c24cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:02.370650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628b927-b61c-4b65-be07-9b81645c24cb service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:02.384864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-db0c18f9-ed1d-450c-9639-5e7bc3078db4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:02.385724 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3295/6532] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:34:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:34:02.386114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-db0c18f9-ed1d-450c-9639-5e7bc3078db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:02.398880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:02.459748 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3238/6533] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:02.470302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628b927-b61c-4b65-be07-9b81645c24cb service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:02.472736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2628b927-b61c-4b65-be07-9b81645c24cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:02.498258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628b927-b61c-4b65-be07-9b81645c24cb service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:02.559304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0056fa-cc1a-498a-81ee-b7de3f584c23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:02.560467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0056fa-cc1a-498a-81ee-b7de3f584c23 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:02.560467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0056fa-cc1a-498a-81ee-b7de3f584c23 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:02.560682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0056fa-cc1a-498a-81ee-b7de3f584c23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:02.573434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0056fa-cc1a-498a-81ee-b7de3f584c23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:02.578108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0056fa-cc1a-498a-81ee-b7de3f584c23 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:02.587692 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3296/6534] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:34:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:34:03.068798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c18f9-ed1d-450c-9639-5e7bc3078db4 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:03.070966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-db0c18f9-ed1d-450c-9639-5e7bc3078db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:03.097092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c18f9-ed1d-450c-9639-5e7bc3078db4 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:03.102732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395e46a-e94f-47ee-8c0b-93d7b38d46c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:03.104164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395e46a-e94f-47ee-8c0b-93d7b38d46c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:03.104777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395e46a-e94f-47ee-8c0b-93d7b38d46c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:03.106705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395e46a-e94f-47ee-8c0b-93d7b38d46c7 admin admin] PATH_INFO: `/v3/projects/20d6ad3663924aa3a52b865623907f39` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:03.108359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395e46a-e94f-47ee-8c0b-93d7b38d46c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20d6ad3663924aa3a52b865623907f39)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:03.111246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395e46a-e94f-47ee-8c0b-93d7b38d46c7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:03.140833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c7de7-a7b4-4a1b-b311-36b88b82e0e8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:03.141172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c7de7-a7b4-4a1b-b311-36b88b82e0e8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:03.141489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c7de7-a7b4-4a1b-b311-36b88b82e0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:03.185634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1d3c7de7-a7b4-4a1b-b311-36b88b82e0e8 None None] MFA Rules not processed for user `22e264440fff43cdb7be6702839af37f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:03.187422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1d3c7de7-a7b4-4a1b-b311-36b88b82e0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:03.262027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f395e46a-e94f-47ee-8c0b-93d7b38d46c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20d6ad3663924aa3a52b865623907f39', 'request_id': 'req-f395e46a-e94f-47ee-8c0b-93d7b38d46c7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:03.272909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f395e46a-e94f-47ee-8c0b-93d7b38d46c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20d6ad3663924aa3a52b865623907f39', 'request_id': 'req-f395e46a-e94f-47ee-8c0b-93d7b38d46c7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:03.282332 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3297/6535] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:03.282847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f395e46a-e94f-47ee-8c0b-93d7b38d46c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20d6ad3663924aa3a52b865623907f39', 'request_id': 'req-f395e46a-e94f-47ee-8c0b-93d7b38d46c7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:03.468741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f395e46a-e94f-47ee-8c0b-93d7b38d46c7 admin admin] The token cache is being invalidate because project 20d6ad3663924aa3a52b865623907f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:34:03.468741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f395e46a-e94f-47ee-8c0b-93d7b38d46c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:03.468741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f395e46a-e94f-47ee-8c0b-93d7b38d46c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:03.468741 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3239/6536] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:34:03 2022] DELETE /identity/v3/projects/20d6ad3663924aa3a52b865623907f39 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:03.469351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c7de7-a7b4-4a1b-b311-36b88b82e0e8 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:03.482518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c7de7-a7b4-4a1b-b311-36b88b82e0e8 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:03.550164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:03.574462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b6943-f491-450d-816b-625184222066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:03.575541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b6943-f491-450d-816b-625184222066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:03.575927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b6943-f491-450d-816b-625184222066 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:03.576755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b6943-f491-450d-816b-625184222066 admin admin] PATH_INFO: `/v3/users/700d0ec125254dad97d1464164f64ff8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:03.577742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b6943-f491-450d-816b-625184222066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=700d0ec125254dad97d1464164f64ff8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:03.584056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b6943-f491-450d-816b-625184222066 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:04.087236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-875b6943-f491-450d-816b-625184222066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '700d0ec125254dad97d1464164f64ff8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:04.101384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-875b6943-f491-450d-816b-625184222066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '700d0ec125254dad97d1464164f64ff8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:04.224750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-875b6943-f491-450d-816b-625184222066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '700d0ec125254dad97d1464164f64ff8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:04.225427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-875b6943-f491-450d-816b-625184222066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '700d0ec125254dad97d1464164f64ff8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:04.245285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-875b6943-f491-450d-816b-625184222066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '700d0ec125254dad97d1464164f64ff8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:04.270746 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3298/6537] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:34:03 2022] DELETE /identity/v3/users/700d0ec125254dad97d1464164f64ff8 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:04.294575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f5aa2-aac6-454a-8a69-6329d120531a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:04.301238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f5aa2-aac6-454a-8a69-6329d120531a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:04.301238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f5aa2-aac6-454a-8a69-6329d120531a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:04.328348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-584f5aa2-aac6-454a-8a69-6329d120531a None None] MFA Rules not processed for user `22e264440fff43cdb7be6702839af37f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:04.330692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-584f5aa2-aac6-454a-8a69-6329d120531a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:04.399165 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3240/6538] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:05.148924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b6943-f491-450d-816b-625184222066 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:05.150723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-875b6943-f491-450d-816b-625184222066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:05.246607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b6943-f491-450d-816b-625184222066 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:05.251071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241e95b-feb5-45b6-a7e3-6bf376f2e041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:05.252037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241e95b-feb5-45b6-a7e3-6bf376f2e041 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:05.252328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241e95b-feb5-45b6-a7e3-6bf376f2e041 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:05.253121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241e95b-feb5-45b6-a7e3-6bf376f2e041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:05.259504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0241e95b-feb5-45b6-a7e3-6bf376f2e041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:05.275519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241e95b-feb5-45b6-a7e3-6bf376f2e041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:05.294162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241e95b-feb5-45b6-a7e3-6bf376f2e041 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:05.294162 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3299/6539] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:34:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:34:05.620728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddf1b3-c540-4855-ad02-772615a3fe91 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:05.621317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddf1b3-c540-4855-ad02-772615a3fe91 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:05.621317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddf1b3-c540-4855-ad02-772615a3fe91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:05.650814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-caddf1b3-c540-4855-ad02-772615a3fe91 None None] MFA Rules not processed for user `22e264440fff43cdb7be6702839af37f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:05.653398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-caddf1b3-c540-4855-ad02-772615a3fe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:05.661961 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3241/6540] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:05.816596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241e95b-feb5-45b6-a7e3-6bf376f2e041 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:05.818076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0241e95b-feb5-45b6-a7e3-6bf376f2e041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:05.986580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241e95b-feb5-45b6-a7e3-6bf376f2e041 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:05.992343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a643c-3220-471e-b47a-ae5e58a7721d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:05.993535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a643c-3220-471e-b47a-ae5e58a7721d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:05.994006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a643c-3220-471e-b47a-ae5e58a7721d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:05.994450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a643c-3220-471e-b47a-ae5e58a7721d admin admin] PATH_INFO: `/v3/projects/6d65d0a55d2440279b703e4a35b7f145` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:05.996280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a643c-3220-471e-b47a-ae5e58a7721d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d65d0a55d2440279b703e4a35b7f145)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:05.999212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a643c-3220-471e-b47a-ae5e58a7721d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:06.009529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:06.220294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0d6a643c-3220-471e-b47a-ae5e58a7721d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d65d0a55d2440279b703e4a35b7f145', 'request_id': 'req-0d6a643c-3220-471e-b47a-ae5e58a7721d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:06.234408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0d6a643c-3220-471e-b47a-ae5e58a7721d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d65d0a55d2440279b703e4a35b7f145', 'request_id': 'req-0d6a643c-3220-471e-b47a-ae5e58a7721d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:06.240957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0d6a643c-3220-471e-b47a-ae5e58a7721d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d65d0a55d2440279b703e4a35b7f145', 'request_id': 'req-0d6a643c-3220-471e-b47a-ae5e58a7721d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:06.248988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddf1b3-c540-4855-ad02-772615a3fe91 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:06.252031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-caddf1b3-c540-4855-ad02-772615a3fe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:06.275126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddf1b3-c540-4855-ad02-772615a3fe91 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:06.339052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0d6a643c-3220-471e-b47a-ae5e58a7721d admin admin] The token cache is being invalidate because project 6d65d0a55d2440279b703e4a35b7f145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:34:06.339620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0d6a643c-3220-471e-b47a-ae5e58a7721d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:06.340539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0d6a643c-3220-471e-b47a-ae5e58a7721d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:06.349740 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3300/6541] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:34:05 2022] DELETE /identity/v3/projects/6d65d0a55d2440279b703e4a35b7f145 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:06.355241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:06.358482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc023b-8afb-4829-ac28-e7e223261647 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:06.358769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc023b-8afb-4829-ac28-e7e223261647 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:06.361068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc023b-8afb-4829-ac28-e7e223261647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:06.382860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817fa40-d037-464e-9a2e-6926aefa4780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:06.383856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817fa40-d037-464e-9a2e-6926aefa4780 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:06.384346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817fa40-d037-464e-9a2e-6926aefa4780 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:06.384810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817fa40-d037-464e-9a2e-6926aefa4780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:06.388765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a817fa40-d037-464e-9a2e-6926aefa4780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:06.404761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-aacc023b-8afb-4829-ac28-e7e223261647 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:06.406793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-aacc023b-8afb-4829-ac28-e7e223261647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:06.414814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a817fa40-d037-464e-9a2e-6926aefa4780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:06.416936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a817fa40-d037-464e-9a2e-6926aefa4780 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:06.431918 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3242/6542] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:34:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:34:06.507628 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3301/6543] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:06.515474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535386f9-e4b1-40b3-acc1-090a110d88e9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:06.516519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535386f9-e4b1-40b3-acc1-090a110d88e9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:06.517034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535386f9-e4b1-40b3-acc1-090a110d88e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:06.545196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-535386f9-e4b1-40b3-acc1-090a110d88e9 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:06.550661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-535386f9-e4b1-40b3-acc1-090a110d88e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:06.563416 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3243/6544] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:06.565043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc023b-8afb-4829-ac28-e7e223261647 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:06.586348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc023b-8afb-4829-ac28-e7e223261647 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:06.591694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e104f-cd16-4b5a-bc3b-79538e52387e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:06.592663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e104f-cd16-4b5a-bc3b-79538e52387e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:06.593160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e104f-cd16-4b5a-bc3b-79538e52387e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:06.594167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e104f-cd16-4b5a-bc3b-79538e52387e admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:06.595152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e104f-cd16-4b5a-bc3b-79538e52387e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:34:06.595686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e104f-cd16-4b5a-bc3b-79538e52387e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:06.598452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e104f-cd16-4b5a-bc3b-79538e52387e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:06.631068 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3302/6545] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:34:06.635835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535386f9-e4b1-40b3-acc1-090a110d88e9 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:06.647735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535386f9-e4b1-40b3-acc1-090a110d88e9 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:06.664976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7589c11-331a-4f6a-9775-965f70001dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:06.665939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7589c11-331a-4f6a-9775-965f70001dcc admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:06.666467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7589c11-331a-4f6a-9775-965f70001dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:06.666980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7589c11-331a-4f6a-9775-965f70001dcc admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:06.667945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7589c11-331a-4f6a-9775-965f70001dcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:06.670241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7589c11-331a-4f6a-9775-965f70001dcc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:06.793534 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3244/6546] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:34:06 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:34:06.798509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e104f-cd16-4b5a-bc3b-79538e52387e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:06.818960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e104f-cd16-4b5a-bc3b-79538e52387e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:06.850173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e3e85-a5c4-405f-8394-3f9d29d55eb4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:06.851033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e3e85-a5c4-405f-8394-3f9d29d55eb4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:06.851553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e3e85-a5c4-405f-8394-3f9d29d55eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:06.902070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-612e3e85-a5c4-405f-8394-3f9d29d55eb4 None None] MFA Rules not processed for user `22e264440fff43cdb7be6702839af37f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:06.904299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-612e3e85-a5c4-405f-8394-3f9d29d55eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:06.948198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1452585-7105-4a2c-a1a6-e13e5aa524da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:06.949023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1452585-7105-4a2c-a1a6-e13e5aa524da admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:06.953438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1452585-7105-4a2c-a1a6-e13e5aa524da admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:06.954084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1452585-7105-4a2c-a1a6-e13e5aa524da admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:06.955293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1452585-7105-4a2c-a1a6-e13e5aa524da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:06.960582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1452585-7105-4a2c-a1a6-e13e5aa524da admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:07.023763 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3245/6547] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:34:07.097586 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3303/6548] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:34:06 2022] POST /identity/v3/users => generated 289 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:34:07.104097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e3e85-a5c4-405f-8394-3f9d29d55eb4 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:07.139245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e3e85-a5c4-405f-8394-3f9d29d55eb4 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:07.169211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57b1f1-b201-4c2a-8c73-f699debb2219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:07.170106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57b1f1-b201-4c2a-8c73-f699debb2219 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:07.170450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57b1f1-b201-4c2a-8c73-f699debb2219 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:07.171592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57b1f1-b201-4c2a-8c73-f699debb2219 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:07.172560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57b1f1-b201-4c2a-8c73-f699debb2219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:07.174411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57b1f1-b201-4c2a-8c73-f699debb2219 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:07.188771 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3246/6549] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:34:07.194576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1452585-7105-4a2c-a1a6-e13e5aa524da admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:07.219628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1452585-7105-4a2c-a1a6-e13e5aa524da admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:07.231610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad090ee-e8e5-47b2-9a47-b24336366eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:07.234384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad090ee-e8e5-47b2-9a47-b24336366eea admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:07.235394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad090ee-e8e5-47b2-9a47-b24336366eea admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:07.236214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad090ee-e8e5-47b2-9a47-b24336366eea admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:07.238544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad090ee-e8e5-47b2-9a47-b24336366eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:07.243036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad090ee-e8e5-47b2-9a47-b24336366eea admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:07.274998 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3304/6550] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:34:07.279339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57b1f1-b201-4c2a-8c73-f699debb2219 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:07.306955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57b1f1-b201-4c2a-8c73-f699debb2219 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:07.319898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187c052-380e-4d14-ac0e-acb6cbe0c5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:07.321417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187c052-380e-4d14-ac0e-acb6cbe0c5a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:07.322261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187c052-380e-4d14-ac0e-acb6cbe0c5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:07.322951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187c052-380e-4d14-ac0e-acb6cbe0c5a6 admin admin] PATH_INFO: `/v3/projects/9b06d64221ed42c5ae21cdae5223f4c1/users/6533ec85d2fc48d9925a88e3bbeed380/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:07.371905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187c052-380e-4d14-ac0e-acb6cbe0c5a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b06d64221ed42c5ae21cdae5223f4c1, user_id=6533ec85d2fc48d9925a88e3bbeed380, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:07.379592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187c052-380e-4d14-ac0e-acb6cbe0c5a6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:07.494768 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3247/6551] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:34:07 2022] PUT /identity/v3/projects/9b06d64221ed42c5ae21cdae5223f4c1/users/6533ec85d2fc48d9925a88e3bbeed380/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:07.509806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff89117-4729-4d19-a125-fb162c68705f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:07.510975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff89117-4729-4d19-a125-fb162c68705f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:07.511287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff89117-4729-4d19-a125-fb162c68705f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:07.518107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:07.554713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-fff89117-4729-4d19-a125-fb162c68705f None None] MFA Rules not processed for user `6533ec85d2fc48d9925a88e3bbeed380`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:07.556556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fff89117-4729-4d19-a125-fb162c68705f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:07.647362 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3305/6552] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:07.651684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187c052-380e-4d14-ac0e-acb6cbe0c5a6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:07.754219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187c052-380e-4d14-ac0e-acb6cbe0c5a6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:07.760277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1dfc3-806c-4063-971e-960a5492914e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:07.763905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1dfc3-806c-4063-971e-960a5492914e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:07.763905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1dfc3-806c-4063-971e-960a5492914e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:07.763905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1dfc3-806c-4063-971e-960a5492914e admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:07.763905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1dfc3-806c-4063-971e-960a5492914e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:07.767290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1dfc3-806c-4063-971e-960a5492914e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:07.874421 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3248/6553] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:34:07 2022] POST /identity/v3/projects => generated 375 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:34:07.880247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff89117-4729-4d19-a125-fb162c68705f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:07.910661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042a559-ee09-4d36-bd99-f23011f9b427 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:07.911300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042a559-ee09-4d36-bd99-f23011f9b427 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:07.911763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042a559-ee09-4d36-bd99-f23011f9b427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:07.912589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff89117-4729-4d19-a125-fb162c68705f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:07.934155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f042a559-ee09-4d36-bd99-f23011f9b427 None None] MFA Rules not processed for user `22e264440fff43cdb7be6702839af37f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:07.935837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f042a559-ee09-4d36-bd99-f23011f9b427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:07.943721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:08.007180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578fbd5-aec5-4d4d-8f2b-2f331711185a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:08.008719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578fbd5-aec5-4d4d-8f2b-2f331711185a admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:08.009247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578fbd5-aec5-4d4d-8f2b-2f331711185a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:08.009719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578fbd5-aec5-4d4d-8f2b-2f331711185a admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:08.010728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578fbd5-aec5-4d4d-8f2b-2f331711185a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:08.013386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578fbd5-aec5-4d4d-8f2b-2f331711185a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:08.067391 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3249/6554] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:34:08.139866 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3306/6555] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:34:07 2022] POST /identity/v3/users => generated 294 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:34:08.142578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a61ac-833d-4429-b403-750d0e60cf2b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:08.144516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578fbd5-aec5-4d4d-8f2b-2f331711185a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:08.144687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a61ac-833d-4429-b403-750d0e60cf2b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:08.145003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a61ac-833d-4429-b403-750d0e60cf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:08.167740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578fbd5-aec5-4d4d-8f2b-2f331711185a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:08.176935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f530223-df4f-4851-9206-e077cca11eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:08.177929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f530223-df4f-4851-9206-e077cca11eda admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:08.178392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f530223-df4f-4851-9206-e077cca11eda admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:08.178846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f530223-df4f-4851-9206-e077cca11eda admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:08.179549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-895a61ac-833d-4429-b403-750d0e60cf2b None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:08.180021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f530223-df4f-4851-9206-e077cca11eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:08.180769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-895a61ac-833d-4429-b403-750d0e60cf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:08.182335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f530223-df4f-4851-9206-e077cca11eda admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:08.202772 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3307/6556] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:34:08.207573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f530223-df4f-4851-9206-e077cca11eda admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:08.229014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f530223-df4f-4851-9206-e077cca11eda admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:08.238405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857020a-9e89-43f0-b3e5-0585c88e10ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:08.240467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857020a-9e89-43f0-b3e5-0585c88e10ee admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:08.240921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857020a-9e89-43f0-b3e5-0585c88e10ee admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:08.241377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857020a-9e89-43f0-b3e5-0585c88e10ee admin admin] PATH_INFO: `/v3/projects/4d251f10a63c476ca0d0e226ed1d9d8f/users/e1dc4bacde5b42da8a5a52fde372f890/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:08.266187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857020a-9e89-43f0-b3e5-0585c88e10ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d251f10a63c476ca0d0e226ed1d9d8f, user_id=e1dc4bacde5b42da8a5a52fde372f890, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:08.271205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857020a-9e89-43f0-b3e5-0585c88e10ee admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:08.279743 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3250/6557] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:34:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:34:08.296824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a61ac-833d-4429-b403-750d0e60cf2b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:08.302101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-895a61ac-833d-4429-b403-750d0e60cf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:08.376019 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3308/6558] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:34:08 2022] PUT /identity/v3/projects/4d251f10a63c476ca0d0e226ed1d9d8f/users/e1dc4bacde5b42da8a5a52fde372f890/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:08.380841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857020a-9e89-43f0-b3e5-0585c88e10ee admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:08.455064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a61ac-833d-4429-b403-750d0e60cf2b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:08.559265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857020a-9e89-43f0-b3e5-0585c88e10ee admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:08.577600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3bbf9-d15e-4ba3-9db4-af79037a4864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:08.579497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3bbf9-d15e-4ba3-9db4-af79037a4864 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:08.582057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3bbf9-d15e-4ba3-9db4-af79037a4864 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:08.582523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3bbf9-d15e-4ba3-9db4-af79037a4864 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:08.584806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3bbf9-d15e-4ba3-9db4-af79037a4864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:08.592622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3bbf9-d15e-4ba3-9db4-af79037a4864 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:08.619496 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3309/6559] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:34:08.620476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3bbf9-d15e-4ba3-9db4-af79037a4864 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:08.646924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3bbf9-d15e-4ba3-9db4-af79037a4864 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:08.648358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ce061-dbb8-4d7c-b517-534a8232c477 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:08.649090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ce061-dbb8-4d7c-b517-534a8232c477 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:08.649379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ce061-dbb8-4d7c-b517-534a8232c477 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:08.649659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ce061-dbb8-4d7c-b517-534a8232c477 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:08.652386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58a227-95ce-44cc-a1c4-9faf83165c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:08.653285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58a227-95ce-44cc-a1c4-9faf83165c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:08.653575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58a227-95ce-44cc-a1c4-9faf83165c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:08.653926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58a227-95ce-44cc-a1c4-9faf83165c1f admin admin] PATH_INFO: `/v3/projects/4d251f10a63c476ca0d0e226ed1d9d8f/users/e1dc4bacde5b42da8a5a52fde372f890/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:08.656521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58a227-95ce-44cc-a1c4-9faf83165c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d251f10a63c476ca0d0e226ed1d9d8f, user_id=e1dc4bacde5b42da8a5a52fde372f890, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:08.659443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58a227-95ce-44cc-a1c4-9faf83165c1f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:08.675578 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3310/6560] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:34:08 2022] PUT /identity/v3/projects/4d251f10a63c476ca0d0e226ed1d9d8f/users/e1dc4bacde5b42da8a5a52fde372f890/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:08.687028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba03f51-78d9-4246-8e6d-8f9dbdfae93d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:08.687353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba03f51-78d9-4246-8e6d-8f9dbdfae93d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:08.687696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba03f51-78d9-4246-8e6d-8f9dbdfae93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:08.729663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-aba03f51-78d9-4246-8e6d-8f9dbdfae93d None None] MFA Rules not processed for user `e1dc4bacde5b42da8a5a52fde372f890`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:08.730946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-aba03f51-78d9-4246-8e6d-8f9dbdfae93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:08.750305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ce061-dbb8-4d7c-b517-534a8232c477 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:08.752364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ce061-dbb8-4d7c-b517-534a8232c477 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:08.762980 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3251/6561] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:34:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:34:08.899746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:08.910556 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3311/6562] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:08.922260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ce061-dbb8-4d7c-b517-534a8232c477 service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:08.923776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-119ce061-dbb8-4d7c-b517-534a8232c477 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:08.930176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:09.064511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ce061-dbb8-4d7c-b517-534a8232c477 service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:09.189426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ca0a4-8e91-4dbc-b8c3-1db0533eff74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:09.190244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ca0a4-8e91-4dbc-b8c3-1db0533eff74 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:09.193194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ca0a4-8e91-4dbc-b8c3-1db0533eff74 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:09.193816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ca0a4-8e91-4dbc-b8c3-1db0533eff74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:09.297992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b867cf-244e-4bd4-a0ac-2c8d0ce1daa6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:09.301666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b867cf-244e-4bd4-a0ac-2c8d0ce1daa6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:09.302475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b867cf-244e-4bd4-a0ac-2c8d0ce1daa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:09.338896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-92b867cf-244e-4bd4-a0ac-2c8d0ce1daa6 None None] MFA Rules not processed for user `22e264440fff43cdb7be6702839af37f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:09.339971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ca0a4-8e91-4dbc-b8c3-1db0533eff74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:09.340771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-92b867cf-244e-4bd4-a0ac-2c8d0ce1daa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:09.342018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ca0a4-8e91-4dbc-b8c3-1db0533eff74 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:09.366583 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3252/6563] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:34:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:34:09.473217 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3312/6564] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:10.898073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fd718-fbfe-4ef2-868b-41d2fe1d9540 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:10.898563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fd718-fbfe-4ef2-868b-41d2fe1d9540 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:10.898667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fd718-fbfe-4ef2-868b-41d2fe1d9540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:10.934073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c44fd718-fbfe-4ef2-868b-41d2fe1d9540 None None] MFA Rules not processed for user `22e264440fff43cdb7be6702839af37f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:10.937700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c44fd718-fbfe-4ef2-868b-41d2fe1d9540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:10.962399 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3253/6565] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:11.980183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb2020-da1b-4c20-8918-e64dd1587709 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:11.981083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb2020-da1b-4c20-8918-e64dd1587709 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:11.981519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb2020-da1b-4c20-8918-e64dd1587709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:12.004587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-64bb2020-da1b-4c20-8918-e64dd1587709 None None] MFA Rules not processed for user `22e264440fff43cdb7be6702839af37f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:12.007266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-64bb2020-da1b-4c20-8918-e64dd1587709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:12.024595 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3313/6566] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:15.086927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fd718-fbfe-4ef2-868b-41d2fe1d9540 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:15.103177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fd718-fbfe-4ef2-868b-41d2fe1d9540 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:15.110897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6780f9-94b9-4a64-a741-2b289543f5d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:15.111842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6780f9-94b9-4a64-a741-2b289543f5d1 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:15.114033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6780f9-94b9-4a64-a741-2b289543f5d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:15.114033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6780f9-94b9-4a64-a741-2b289543f5d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:15.137778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:15.142761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6780f9-94b9-4a64-a741-2b289543f5d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:15.151408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6780f9-94b9-4a64-a741-2b289543f5d1 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:15.157711 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3254/6567] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:34:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:34:16.902710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b0edf-44b2-415e-a1fa-01a8895f52d7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:16.903301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b0edf-44b2-415e-a1fa-01a8895f52d7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:16.903531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b0edf-44b2-415e-a1fa-01a8895f52d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:16.974420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-049b0edf-44b2-415e-a1fa-01a8895f52d7 None None] MFA Rules not processed for user `22e264440fff43cdb7be6702839af37f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:16.976508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-049b0edf-44b2-415e-a1fa-01a8895f52d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:16.985107 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3314/6568] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:18.144405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83596f8d-4d0c-4380-bf3a-84201f8596f8 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:18.148533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83596f8d-4d0c-4380-bf3a-84201f8596f8 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:18.148533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83596f8d-4d0c-4380-bf3a-84201f8596f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:18.168383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-83596f8d-4d0c-4380-bf3a-84201f8596f8 None None] MFA Rules not processed for user `22e264440fff43cdb7be6702839af37f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:18.171654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-83596f8d-4d0c-4380-bf3a-84201f8596f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:18.183134 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3255/6569] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:18.692926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b0edf-44b2-415e-a1fa-01a8895f52d7 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:18.694648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-049b0edf-44b2-415e-a1fa-01a8895f52d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:18.750182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:18.784908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b0edf-44b2-415e-a1fa-01a8895f52d7 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:18.789599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa863dd7-7f80-45ed-a3b7-697342de2526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:18.790791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa863dd7-7f80-45ed-a3b7-697342de2526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:18.791111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa863dd7-7f80-45ed-a3b7-697342de2526 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:18.791781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa863dd7-7f80-45ed-a3b7-697342de2526 admin admin] PATH_INFO: `/v3/users/a23fafbab18d41ee82b84bbdf94cf0fe` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:18.817632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa863dd7-7f80-45ed-a3b7-697342de2526 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a23fafbab18d41ee82b84bbdf94cf0fe)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:18.820436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa863dd7-7f80-45ed-a3b7-697342de2526 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:19.100916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fa863dd7-7f80-45ed-a3b7-697342de2526 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a23fafbab18d41ee82b84bbdf94cf0fe'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:19.116239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fa863dd7-7f80-45ed-a3b7-697342de2526 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a23fafbab18d41ee82b84bbdf94cf0fe'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:19.198980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fa863dd7-7f80-45ed-a3b7-697342de2526 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a23fafbab18d41ee82b84bbdf94cf0fe'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:19.199825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fa863dd7-7f80-45ed-a3b7-697342de2526 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a23fafbab18d41ee82b84bbdf94cf0fe'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:19.214567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fa863dd7-7f80-45ed-a3b7-697342de2526 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a23fafbab18d41ee82b84bbdf94cf0fe'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:19.223356 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3315/6570] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:34:18 2022] DELETE /identity/v3/users/a23fafbab18d41ee82b84bbdf94cf0fe => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:19.953535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83596f8d-4d0c-4380-bf3a-84201f8596f8 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:19.976487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83596f8d-4d0c-4380-bf3a-84201f8596f8 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:20.113098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbed673-4b02-4dc3-b086-89f9bcb9e8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:20.114276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbed673-4b02-4dc3-b086-89f9bcb9e8ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:20.114733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbed673-4b02-4dc3-b086-89f9bcb9e8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:20.119987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbed673-4b02-4dc3-b086-89f9bcb9e8ea admin admin] PATH_INFO: `/v3/projects/cfc2e42a0df346f4adef152ba2e3fa71` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:20.133835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbed673-4b02-4dc3-b086-89f9bcb9e8ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfc2e42a0df346f4adef152ba2e3fa71)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:20.140530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbed673-4b02-4dc3-b086-89f9bcb9e8ea admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:20.338252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9dbed673-4b02-4dc3-b086-89f9bcb9e8ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfc2e42a0df346f4adef152ba2e3fa71', 'request_id': 'req-9dbed673-4b02-4dc3-b086-89f9bcb9e8ea'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:20.344997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9dbed673-4b02-4dc3-b086-89f9bcb9e8ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfc2e42a0df346f4adef152ba2e3fa71', 'request_id': 'req-9dbed673-4b02-4dc3-b086-89f9bcb9e8ea'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:20.353530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9dbed673-4b02-4dc3-b086-89f9bcb9e8ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfc2e42a0df346f4adef152ba2e3fa71', 'request_id': 'req-9dbed673-4b02-4dc3-b086-89f9bcb9e8ea'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:20.521550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9dbed673-4b02-4dc3-b086-89f9bcb9e8ea admin admin] The token cache is being invalidate because project cfc2e42a0df346f4adef152ba2e3fa71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:34:20.521860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9dbed673-4b02-4dc3-b086-89f9bcb9e8ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:20.522836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9dbed673-4b02-4dc3-b086-89f9bcb9e8ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:20.525190 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3256/6571] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:34:19 2022] DELETE /identity/v3/projects/cfc2e42a0df346f4adef152ba2e3fa71 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:20.528996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa863dd7-7f80-45ed-a3b7-697342de2526 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:20.530499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fa863dd7-7f80-45ed-a3b7-697342de2526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:20.575707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa863dd7-7f80-45ed-a3b7-697342de2526 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:20.662393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06631803-a729-4598-ad2e-6f19e6e4d05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:20.663331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06631803-a729-4598-ad2e-6f19e6e4d05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:20.663622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06631803-a729-4598-ad2e-6f19e6e4d05a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:20.663904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06631803-a729-4598-ad2e-6f19e6e4d05a admin admin] PATH_INFO: `/v3/users/f01ecd9543134b1f8a3c089fdba63fb2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:20.721753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06631803-a729-4598-ad2e-6f19e6e4d05a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01ecd9543134b1f8a3c089fdba63fb2)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:20.724483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06631803-a729-4598-ad2e-6f19e6e4d05a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:21.016488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:21.019523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-06631803-a729-4598-ad2e-6f19e6e4d05a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01ecd9543134b1f8a3c089fdba63fb2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:21.040028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-06631803-a729-4598-ad2e-6f19e6e4d05a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01ecd9543134b1f8a3c089fdba63fb2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:21.110296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-06631803-a729-4598-ad2e-6f19e6e4d05a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01ecd9543134b1f8a3c089fdba63fb2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:21.111421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-06631803-a729-4598-ad2e-6f19e6e4d05a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01ecd9543134b1f8a3c089fdba63fb2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:21.137291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-06631803-a729-4598-ad2e-6f19e6e4d05a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01ecd9543134b1f8a3c089fdba63fb2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:21.150217 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3316/6572] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:34:20 2022] DELETE /identity/v3/users/f01ecd9543134b1f8a3c089fdba63fb2 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:21.657752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbed673-4b02-4dc3-b086-89f9bcb9e8ea admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:21.660298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9dbed673-4b02-4dc3-b086-89f9bcb9e8ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:21.679829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbed673-4b02-4dc3-b086-89f9bcb9e8ea admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:21.798400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c9d04-7866-428c-b4b9-43388b5038fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:21.805681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c9d04-7866-428c-b4b9-43388b5038fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:21.806069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c9d04-7866-428c-b4b9-43388b5038fe admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:21.806413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c9d04-7866-428c-b4b9-43388b5038fe admin admin] PATH_INFO: `/v3/projects/5a4706830b164b0080150ff24c137ece` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:21.819514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c9d04-7866-428c-b4b9-43388b5038fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4706830b164b0080150ff24c137ece)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:21.821750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c9d04-7866-428c-b4b9-43388b5038fe admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:21.823754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:21.966427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ce0c9d04-7866-428c-b4b9-43388b5038fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4706830b164b0080150ff24c137ece', 'request_id': 'req-ce0c9d04-7866-428c-b4b9-43388b5038fe'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:21.975611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ce0c9d04-7866-428c-b4b9-43388b5038fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4706830b164b0080150ff24c137ece', 'request_id': 'req-ce0c9d04-7866-428c-b4b9-43388b5038fe'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:21.984703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ce0c9d04-7866-428c-b4b9-43388b5038fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4706830b164b0080150ff24c137ece', 'request_id': 'req-ce0c9d04-7866-428c-b4b9-43388b5038fe'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:22.147523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ce0c9d04-7866-428c-b4b9-43388b5038fe admin admin] The token cache is being invalidate because project 5a4706830b164b0080150ff24c137ece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:34:22.148349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ce0c9d04-7866-428c-b4b9-43388b5038fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:22.149295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ce0c9d04-7866-428c-b4b9-43388b5038fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:22.151358 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3257/6573] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:34:21 2022] DELETE /identity/v3/projects/5a4706830b164b0080150ff24c137ece => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:22.156139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633241c6-00d9-469a-bac9-fd046ebce1a7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:22.156646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633241c6-00d9-469a-bac9-fd046ebce1a7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:22.156944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633241c6-00d9-469a-bac9-fd046ebce1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:22.176997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-633241c6-00d9-469a-bac9-fd046ebce1a7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:22.178380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-633241c6-00d9-469a-bac9-fd046ebce1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:22.259551 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3317/6574] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:34:22.267756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39062bcc-6ea1-49d2-88a9-8722461f648a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:22.268053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39062bcc-6ea1-49d2-88a9-8722461f648a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:22.269539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39062bcc-6ea1-49d2-88a9-8722461f648a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:22.289530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-39062bcc-6ea1-49d2-88a9-8722461f648a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:22.290750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-39062bcc-6ea1-49d2-88a9-8722461f648a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:22.302927 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3258/6575] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:34:22.306764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633241c6-00d9-469a-bac9-fd046ebce1a7 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:22.318273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633241c6-00d9-469a-bac9-fd046ebce1a7 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:22.325191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891f9c6-8b96-453f-8702-08eebf543a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:22.329254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891f9c6-8b96-453f-8702-08eebf543a7f admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:22.329254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891f9c6-8b96-453f-8702-08eebf543a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:22.329254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891f9c6-8b96-453f-8702-08eebf543a7f admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:22.329254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891f9c6-8b96-453f-8702-08eebf543a7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:34:22.329254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891f9c6-8b96-453f-8702-08eebf543a7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:22.331441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891f9c6-8b96-453f-8702-08eebf543a7f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:22.349182 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3318/6576] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:34:22.350696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39062bcc-6ea1-49d2-88a9-8722461f648a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:22.361136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39062bcc-6ea1-49d2-88a9-8722461f648a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:22.368281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293446af-4d42-4930-b5a6-ea0d65c29d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:22.370095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293446af-4d42-4930-b5a6-ea0d65c29d65 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:22.370556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293446af-4d42-4930-b5a6-ea0d65c29d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:22.371000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293446af-4d42-4930-b5a6-ea0d65c29d65 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:22.371927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293446af-4d42-4930-b5a6-ea0d65c29d65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:22.374247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293446af-4d42-4930-b5a6-ea0d65c29d65 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:22.526703 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3259/6577] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:34:22 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:34:22.528364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891f9c6-8b96-453f-8702-08eebf543a7f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:22.539651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891f9c6-8b96-453f-8702-08eebf543a7f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:22.622652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1bc72-05f0-409f-aea7-03ca26fc4e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:22.622827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293446af-4d42-4930-b5a6-ea0d65c29d65 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:22.623468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1bc72-05f0-409f-aea7-03ca26fc4e86 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:22.623763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1bc72-05f0-409f-aea7-03ca26fc4e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:22.624045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1bc72-05f0-409f-aea7-03ca26fc4e86 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:22.624871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-293446af-4d42-4930-b5a6-ea0d65c29d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:22.625043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1bc72-05f0-409f-aea7-03ca26fc4e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:22.626818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1bc72-05f0-409f-aea7-03ca26fc4e86 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:22.640564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293446af-4d42-4930-b5a6-ea0d65c29d65 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:22.664188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa4137-fd45-4314-8e23-7be91aa3bd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:22.665802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa4137-fd45-4314-8e23-7be91aa3bd53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:22.666245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa4137-fd45-4314-8e23-7be91aa3bd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:22.666718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa4137-fd45-4314-8e23-7be91aa3bd53 admin admin] PATH_INFO: `/v3/users/5de7daf223b846728db15890bc4e1bae` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:22.668227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa4137-fd45-4314-8e23-7be91aa3bd53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de7daf223b846728db15890bc4e1bae)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:22.670445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa4137-fd45-4314-8e23-7be91aa3bd53 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:22.705998 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3319/6578] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:34:22 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:34:22.710580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1bc72-05f0-409f-aea7-03ca26fc4e86 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:22.720760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1bc72-05f0-409f-aea7-03ca26fc4e86 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:22.725947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437de5e4-7600-4cd2-a007-1780b5747e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:22.726606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437de5e4-7600-4cd2-a007-1780b5747e10 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:22.726877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437de5e4-7600-4cd2-a007-1780b5747e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:22.727189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437de5e4-7600-4cd2-a007-1780b5747e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:22.727908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437de5e4-7600-4cd2-a007-1780b5747e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:22.729813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437de5e4-7600-4cd2-a007-1780b5747e10 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:22.740818 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3320/6579] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:34:22.744734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437de5e4-7600-4cd2-a007-1780b5747e10 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:22.754965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437de5e4-7600-4cd2-a007-1780b5747e10 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:22.760435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9ea11-f05a-4b04-b482-06690942d303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:22.766315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9ea11-f05a-4b04-b482-06690942d303 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:22.766315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9ea11-f05a-4b04-b482-06690942d303 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:22.766315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9ea11-f05a-4b04-b482-06690942d303 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:22.766315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9ea11-f05a-4b04-b482-06690942d303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:22.766315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9ea11-f05a-4b04-b482-06690942d303 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:22.775950 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3321/6580] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:34:22.780018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9ea11-f05a-4b04-b482-06690942d303 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:22.798563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9ea11-f05a-4b04-b482-06690942d303 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:22.808229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3d3f0-4fa7-4682-a113-93e0b718abbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:22.810147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3d3f0-4fa7-4682-a113-93e0b718abbb admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:22.810147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3d3f0-4fa7-4682-a113-93e0b718abbb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:22.810471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3d3f0-4fa7-4682-a113-93e0b718abbb admin admin] PATH_INFO: `/v3/projects/0fd0ce287cb44cd59045868ce688909a/users/726b46c54e9541fbb7825607bac3abe5/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:22.832862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3d3f0-4fa7-4682-a113-93e0b718abbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd0ce287cb44cd59045868ce688909a, user_id=726b46c54e9541fbb7825607bac3abe5, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:22.836028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3d3f0-4fa7-4682-a113-93e0b718abbb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:22.847181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:22.886787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cdfa4137-fd45-4314-8e23-7be91aa3bd53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de7daf223b846728db15890bc4e1bae'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:22.906181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cdfa4137-fd45-4314-8e23-7be91aa3bd53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de7daf223b846728db15890bc4e1bae'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:22.953917 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3322/6581] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:34:22 2022] PUT /identity/v3/projects/0fd0ce287cb44cd59045868ce688909a/users/726b46c54e9541fbb7825607bac3abe5/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:34:22.955442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04191699-dbf5-4149-aef5-dc24e3ab9bde None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:22.955925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04191699-dbf5-4149-aef5-dc24e3ab9bde None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:22.957568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04191699-dbf5-4149-aef5-dc24e3ab9bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:22.970407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cdfa4137-fd45-4314-8e23-7be91aa3bd53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de7daf223b846728db15890bc4e1bae'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:22.979262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-04191699-dbf5-4149-aef5-dc24e3ab9bde None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:22.980040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cdfa4137-fd45-4314-8e23-7be91aa3bd53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de7daf223b846728db15890bc4e1bae'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:22.980874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cdfa4137-fd45-4314-8e23-7be91aa3bd53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de7daf223b846728db15890bc4e1bae'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:22.981496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-04191699-dbf5-4149-aef5-dc24e3ab9bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:22.993064 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3260/6582] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:34:22 2022] DELETE /identity/v3/users/5de7daf223b846728db15890bc4e1bae => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:34:22.997428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e53b39-c318-433a-9319-20307cf97b07 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:22.997728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e53b39-c318-433a-9319-20307cf97b07 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:22.998014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e53b39-c318-433a-9319-20307cf97b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:23.028128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-15e53b39-c318-433a-9319-20307cf97b07 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:23.033785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-15e53b39-c318-433a-9319-20307cf97b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:23.124201 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3323/6583] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:23.137119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04191699-dbf5-4149-aef5-dc24e3ab9bde None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:23.140020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-04191699-dbf5-4149-aef5-dc24e3ab9bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:23.188900 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3261/6584] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:23.191167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e53b39-c318-433a-9319-20307cf97b07 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:23.193456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-15e53b39-c318-433a-9319-20307cf97b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:23.233498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04191699-dbf5-4149-aef5-dc24e3ab9bde None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:23.266802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e53b39-c318-433a-9319-20307cf97b07 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:23.271549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a588c-e8a7-4338-8079-4803565005c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:23.272598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a588c-e8a7-4338-8079-4803565005c1 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:23.273022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a588c-e8a7-4338-8079-4803565005c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:23.273379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a588c-e8a7-4338-8079-4803565005c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:23.304142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8618619-f94f-461e-9cd4-8f04e4d168c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:23.305453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a588c-e8a7-4338-8079-4803565005c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:23.305869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8618619-f94f-461e-9cd4-8f04e4d168c6 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:23.305869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8618619-f94f-461e-9cd4-8f04e4d168c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:23.305869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8618619-f94f-461e-9cd4-8f04e4d168c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:23.307163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a588c-e8a7-4338-8079-4803565005c1 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:23.317385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8618619-f94f-461e-9cd4-8f04e4d168c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:23.319089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8618619-f94f-461e-9cd4-8f04e4d168c6 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:23.322707 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3262/6585] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:34:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:34:23.330147 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3324/6586] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:34:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:34:23.403549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:23.716219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a588c-e8a7-4338-8079-4803565005c1 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:23.717768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-440a588c-e8a7-4338-8079-4803565005c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:23.735827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a588c-e8a7-4338-8079-4803565005c1 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:23.741824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093de2b-83f7-42db-b73e-9175e6a67440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:23.743077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093de2b-83f7-42db-b73e-9175e6a67440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:23.743556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093de2b-83f7-42db-b73e-9175e6a67440 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:23.743980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093de2b-83f7-42db-b73e-9175e6a67440 admin admin] PATH_INFO: `/v3/projects/183be60f687e4591b55394d821ce1afa` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:23.745481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093de2b-83f7-42db-b73e-9175e6a67440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=183be60f687e4591b55394d821ce1afa)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:23.749058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093de2b-83f7-42db-b73e-9175e6a67440 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:23.917223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5093de2b-83f7-42db-b73e-9175e6a67440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '183be60f687e4591b55394d821ce1afa', 'request_id': 'req-5093de2b-83f7-42db-b73e-9175e6a67440'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:23.923782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5093de2b-83f7-42db-b73e-9175e6a67440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '183be60f687e4591b55394d821ce1afa', 'request_id': 'req-5093de2b-83f7-42db-b73e-9175e6a67440'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:23.930922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5093de2b-83f7-42db-b73e-9175e6a67440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '183be60f687e4591b55394d821ce1afa', 'request_id': 'req-5093de2b-83f7-42db-b73e-9175e6a67440'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:24.004965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5093de2b-83f7-42db-b73e-9175e6a67440 admin admin] The token cache is being invalidate because project 183be60f687e4591b55394d821ce1afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:34:24.005294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5093de2b-83f7-42db-b73e-9175e6a67440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:24.005939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5093de2b-83f7-42db-b73e-9175e6a67440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:24.007623 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3263/6587] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:34:23 2022] DELETE /identity/v3/projects/183be60f687e4591b55394d821ce1afa => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:24.012947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68586861-cd0d-42f8-9984-6bf9c0d2dab3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:24.013239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68586861-cd0d-42f8-9984-6bf9c0d2dab3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:24.013537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68586861-cd0d-42f8-9984-6bf9c0d2dab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:24.039349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-68586861-cd0d-42f8-9984-6bf9c0d2dab3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:24.040928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-68586861-cd0d-42f8-9984-6bf9c0d2dab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:24.139496 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3325/6588] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:24.148086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03aed1-9104-4464-ae13-51af650921f8 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:24.148384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03aed1-9104-4464-ae13-51af650921f8 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:24.148668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03aed1-9104-4464-ae13-51af650921f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:24.185412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0b03aed1-9104-4464-ae13-51af650921f8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:24.185412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0b03aed1-9104-4464-ae13-51af650921f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:24.197118 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3264/6589] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:24.198320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68586861-cd0d-42f8-9984-6bf9c0d2dab3 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:24.209309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68586861-cd0d-42f8-9984-6bf9c0d2dab3 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:24.214374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027543d-9dcf-46bc-8688-55ed6d2ff179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:24.215075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027543d-9dcf-46bc-8688-55ed6d2ff179 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:24.215368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027543d-9dcf-46bc-8688-55ed6d2ff179 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:24.215974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027543d-9dcf-46bc-8688-55ed6d2ff179 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:24.216910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027543d-9dcf-46bc-8688-55ed6d2ff179 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:34:24.217221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027543d-9dcf-46bc-8688-55ed6d2ff179 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:24.218854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027543d-9dcf-46bc-8688-55ed6d2ff179 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:24.233713 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3326/6590] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:34:24.238475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03aed1-9104-4464-ae13-51af650921f8 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:24.249827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03aed1-9104-4464-ae13-51af650921f8 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:24.258082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfccc31-367c-4db5-b3fe-6d4df23fbf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:24.258774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfccc31-367c-4db5-b3fe-6d4df23fbf22 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:24.259150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfccc31-367c-4db5-b3fe-6d4df23fbf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:24.259429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfccc31-367c-4db5-b3fe-6d4df23fbf22 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:24.260144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfccc31-367c-4db5-b3fe-6d4df23fbf22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:24.262133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfccc31-367c-4db5-b3fe-6d4df23fbf22 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:24.319627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:24.351045 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3265/6591] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:34:24 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:34:24.352845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027543d-9dcf-46bc-8688-55ed6d2ff179 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:24.364324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027543d-9dcf-46bc-8688-55ed6d2ff179 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:24.430595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc8c8d-7b20-43db-a863-8a10b2e0d8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:24.431780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc8c8d-7b20-43db-a863-8a10b2e0d8bb admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:24.432159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc8c8d-7b20-43db-a863-8a10b2e0d8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:24.432557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc8c8d-7b20-43db-a863-8a10b2e0d8bb admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:24.433454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc8c8d-7b20-43db-a863-8a10b2e0d8bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:24.435880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc8c8d-7b20-43db-a863-8a10b2e0d8bb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:24.543805 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3327/6592] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:34:24 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:34:24.545201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfccc31-367c-4db5-b3fe-6d4df23fbf22 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:24.556927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfccc31-367c-4db5-b3fe-6d4df23fbf22 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:24.562391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35351d24-fe60-4a3a-b786-31b6892331cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:24.563210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35351d24-fe60-4a3a-b786-31b6892331cc admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:24.563529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35351d24-fe60-4a3a-b786-31b6892331cc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:24.563863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35351d24-fe60-4a3a-b786-31b6892331cc admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:24.564552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35351d24-fe60-4a3a-b786-31b6892331cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:24.567211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35351d24-fe60-4a3a-b786-31b6892331cc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:24.582044 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3266/6593] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:34:24.583291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc8c8d-7b20-43db-a863-8a10b2e0d8bb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:24.595418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc8c8d-7b20-43db-a863-8a10b2e0d8bb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:24.600661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86199b75-f5a8-419d-a182-3b52c96eae54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:24.601790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86199b75-f5a8-419d-a182-3b52c96eae54 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:24.602076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86199b75-f5a8-419d-a182-3b52c96eae54 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:24.602755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86199b75-f5a8-419d-a182-3b52c96eae54 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:24.603168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86199b75-f5a8-419d-a182-3b52c96eae54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:24.605070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86199b75-f5a8-419d-a182-3b52c96eae54 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:24.620430 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3328/6594] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:34:24.624491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35351d24-fe60-4a3a-b786-31b6892331cc admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:24.637256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35351d24-fe60-4a3a-b786-31b6892331cc admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:24.641923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7b4d7-cdaf-48a1-8084-b4d9f0c790af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:24.642828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7b4d7-cdaf-48a1-8084-b4d9f0c790af admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:24.643146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7b4d7-cdaf-48a1-8084-b4d9f0c790af admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:24.643472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7b4d7-cdaf-48a1-8084-b4d9f0c790af admin admin] PATH_INFO: `/v3/projects/103f37ee87bd47fb9048f54d092125ed/users/811f41c264a34d12a1d8934e7b928661/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:24.663889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7b4d7-cdaf-48a1-8084-b4d9f0c790af admin admin] RBAC: Authorizing `identity:create_grant(project_id=103f37ee87bd47fb9048f54d092125ed, user_id=811f41c264a34d12a1d8934e7b928661, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:24.667896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7b4d7-cdaf-48a1-8084-b4d9f0c790af admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:24.743821 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3267/6595] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:34:24 2022] PUT /identity/v3/projects/103f37ee87bd47fb9048f54d092125ed/users/811f41c264a34d12a1d8934e7b928661/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:34:24.761465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c527ce-c676-423b-92e7-aad545bb13c5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:24.761465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c527ce-c676-423b-92e7-aad545bb13c5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:24.761465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c527ce-c676-423b-92e7-aad545bb13c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:24.791878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-91c527ce-c676-423b-92e7-aad545bb13c5 None None] MFA Rules not processed for user `811f41c264a34d12a1d8934e7b928661`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:24.793312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-91c527ce-c676-423b-92e7-aad545bb13c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:24.883190 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3329/6596] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:34:24.894570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7b4d7-cdaf-48a1-8084-b4d9f0c790af admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:24.896662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5cf7b4d7-cdaf-48a1-8084-b4d9f0c790af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:24.995121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7b4d7-cdaf-48a1-8084-b4d9f0c790af admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:25.000416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e6a03-8d26-40d3-b7fb-5c1bd81f182b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:25.001938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e6a03-8d26-40d3-b7fb-5c1bd81f182b service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:25.005332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e6a03-8d26-40d3-b7fb-5c1bd81f182b service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:25.005332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e6a03-8d26-40d3-b7fb-5c1bd81f182b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:25.029791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e6a03-8d26-40d3-b7fb-5c1bd81f182b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:25.036413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e6a03-8d26-40d3-b7fb-5c1bd81f182b service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:25.058130 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3268/6597] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:34:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:34:25.313997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:29.478119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e9aee-20fa-43a3-9fa9-50b63dc367d8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:29.484164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e9aee-20fa-43a3-9fa9-50b63dc367d8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:29.484164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e9aee-20fa-43a3-9fa9-50b63dc367d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:29.497305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-427e9aee-20fa-43a3-9fa9-50b63dc367d8 None None] MFA Rules not processed for user `22e264440fff43cdb7be6702839af37f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:29.498881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-427e9aee-20fa-43a3-9fa9-50b63dc367d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:29.550337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:29.560499 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3330/6598] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:32.216771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1231d85-2e24-4f45-bc7c-40aca95abbfb None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:32.217317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1231d85-2e24-4f45-bc7c-40aca95abbfb None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:32.217516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1231d85-2e24-4f45-bc7c-40aca95abbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:32.252599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d1231d85-2e24-4f45-bc7c-40aca95abbfb None None] MFA Rules not processed for user `726b46c54e9541fbb7825607bac3abe5`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:32.252599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d1231d85-2e24-4f45-bc7c-40aca95abbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:32.335601 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3269/6599] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:32.345057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e9aee-20fa-43a3-9fa9-50b63dc367d8 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:32.347988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-427e9aee-20fa-43a3-9fa9-50b63dc367d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:32.419898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e9aee-20fa-43a3-9fa9-50b63dc367d8 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:32.426296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a862e-2163-4b5e-ab70-aa66f90135b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:32.426974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a862e-2163-4b5e-ab70-aa66f90135b7 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:32.427289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a862e-2163-4b5e-ab70-aa66f90135b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:32.427573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a862e-2163-4b5e-ab70-aa66f90135b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:32.428264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a862e-2163-4b5e-ab70-aa66f90135b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:32.430784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a862e-2163-4b5e-ab70-aa66f90135b7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:32.566149 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3331/6600] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:34:32 2022] POST /identity/v3/projects => generated 389 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:34:32.570558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1231d85-2e24-4f45-bc7c-40aca95abbfb None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:32.584212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1231d85-2e24-4f45-bc7c-40aca95abbfb None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:32.645719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432159e3-d8b9-4ae5-85b3-b684354ba99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:32.646425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432159e3-d8b9-4ae5-85b3-b684354ba99c admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:32.646716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432159e3-d8b9-4ae5-85b3-b684354ba99c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:32.646995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432159e3-d8b9-4ae5-85b3-b684354ba99c admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:32.647716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432159e3-d8b9-4ae5-85b3-b684354ba99c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:32.655561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432159e3-d8b9-4ae5-85b3-b684354ba99c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:32.765837 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3270/6601] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:34:32 2022] POST /identity/v3/users => generated 301 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:34:32.766590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a862e-2163-4b5e-ab70-aa66f90135b7 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:32.781727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a862e-2163-4b5e-ab70-aa66f90135b7 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:32.787815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abc442-d285-40cf-a1a3-67a9400fd627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:32.788711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abc442-d285-40cf-a1a3-67a9400fd627 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:32.790588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abc442-d285-40cf-a1a3-67a9400fd627 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:32.790588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abc442-d285-40cf-a1a3-67a9400fd627 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:32.790588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abc442-d285-40cf-a1a3-67a9400fd627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:32.792877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abc442-d285-40cf-a1a3-67a9400fd627 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:32.808296 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3332/6602] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:34:32.810252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432159e3-d8b9-4ae5-85b3-b684354ba99c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:32.822722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432159e3-d8b9-4ae5-85b3-b684354ba99c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:32.829346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d0134-5b89-4f5a-bf06-664151d05a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:32.830423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d0134-5b89-4f5a-bf06-664151d05a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:32.831556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d0134-5b89-4f5a-bf06-664151d05a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:32.831556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d0134-5b89-4f5a-bf06-664151d05a40 admin admin] PATH_INFO: `/v3/projects/db5e06f3331c4c3bae79e05741e91534/users/0ba5f87a4b70404094fd8e8300b283c0/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:32.851501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d0134-5b89-4f5a-bf06-664151d05a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db5e06f3331c4c3bae79e05741e91534, user_id=0ba5f87a4b70404094fd8e8300b283c0, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:32.854642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d0134-5b89-4f5a-bf06-664151d05a40 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:32.857329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:32.935949 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3271/6603] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:34:32 2022] PUT /identity/v3/projects/db5e06f3331c4c3bae79e05741e91534/users/0ba5f87a4b70404094fd8e8300b283c0/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:32.941327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abc442-d285-40cf-a1a3-67a9400fd627 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:32.968569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abc442-d285-40cf-a1a3-67a9400fd627 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:33.105444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f74f9-1924-4e67-bea9-3d0dadcb486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:33.106224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f74f9-1924-4e67-bea9-3d0dadcb486d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:33.106580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f74f9-1924-4e67-bea9-3d0dadcb486d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:33.106925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f74f9-1924-4e67-bea9-3d0dadcb486d admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:33.107851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f74f9-1924-4e67-bea9-3d0dadcb486d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:33.109911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f74f9-1924-4e67-bea9-3d0dadcb486d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:33.127644 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3333/6604] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:34:33.132481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d0134-5b89-4f5a-bf06-664151d05a40 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:33.166070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f74f9-1924-4e67-bea9-3d0dadcb486d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:33.168324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d0134-5b89-4f5a-bf06-664151d05a40 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:33.168472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-859f74f9-1924-4e67-bea9-3d0dadcb486d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:33.176247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188935b8-fe69-402e-a951-a5040b703c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:33.177155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188935b8-fe69-402e-a951-a5040b703c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:33.178721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188935b8-fe69-402e-a951-a5040b703c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:33.178721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188935b8-fe69-402e-a951-a5040b703c78 admin admin] PATH_INFO: `/v3/projects/db5e06f3331c4c3bae79e05741e91534/users/0ba5f87a4b70404094fd8e8300b283c0/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:33.185456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188935b8-fe69-402e-a951-a5040b703c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db5e06f3331c4c3bae79e05741e91534, user_id=0ba5f87a4b70404094fd8e8300b283c0, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:33.188296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188935b8-fe69-402e-a951-a5040b703c78 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:33.192582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f74f9-1924-4e67-bea9-3d0dadcb486d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:33.207122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc8163-6f4d-4ca3-a61e-613d84a0b42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:33.209305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc8163-6f4d-4ca3-a61e-613d84a0b42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:33.216063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc8163-6f4d-4ca3-a61e-613d84a0b42f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:33.217243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc8163-6f4d-4ca3-a61e-613d84a0b42f admin admin] PATH_INFO: `/v3/users/54beecf18b6d4f6580693cc45ec9d51d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:33.217740 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3272/6605] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:34:33 2022] PUT /identity/v3/projects/db5e06f3331c4c3bae79e05741e91534/users/0ba5f87a4b70404094fd8e8300b283c0/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:34:33.223790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc8163-6f4d-4ca3-a61e-613d84a0b42f admin admin] RBAC: Authorizing `identity:delete_user(user_id=54beecf18b6d4f6580693cc45ec9d51d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:33.229657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc8163-6f4d-4ca3-a61e-613d84a0b42f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:33.519462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-37bc8163-6f4d-4ca3-a61e-613d84a0b42f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54beecf18b6d4f6580693cc45ec9d51d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:33.528905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-37bc8163-6f4d-4ca3-a61e-613d84a0b42f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54beecf18b6d4f6580693cc45ec9d51d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:33.532106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:33.714161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-37bc8163-6f4d-4ca3-a61e-613d84a0b42f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54beecf18b6d4f6580693cc45ec9d51d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:33.714966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-37bc8163-6f4d-4ca3-a61e-613d84a0b42f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54beecf18b6d4f6580693cc45ec9d51d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:33.729439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-37bc8163-6f4d-4ca3-a61e-613d84a0b42f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54beecf18b6d4f6580693cc45ec9d51d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:33.737988 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3334/6606] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:34:33 2022] DELETE /identity/v3/users/54beecf18b6d4f6580693cc45ec9d51d => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:33.743401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cd24a-c95e-4f84-8a1c-e240ebca3ce9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:33.744068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cd24a-c95e-4f84-8a1c-e240ebca3ce9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:33.746016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cd24a-c95e-4f84-8a1c-e240ebca3ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:33.780827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7d9cd24a-c95e-4f84-8a1c-e240ebca3ce9 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:33.788946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7d9cd24a-c95e-4f84-8a1c-e240ebca3ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:33.913369 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3273/6607] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:33.923315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc8163-6f4d-4ca3-a61e-613d84a0b42f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:33.924960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-37bc8163-6f4d-4ca3-a61e-613d84a0b42f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:34.016239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc8163-6f4d-4ca3-a61e-613d84a0b42f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:34.021046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4247e1-9586-48c7-9e82-d0229d3b7a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:34.021715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4247e1-9586-48c7-9e82-d0229d3b7a94 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:34.026859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4247e1-9586-48c7-9e82-d0229d3b7a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:34.026859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4247e1-9586-48c7-9e82-d0229d3b7a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:34.044918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4247e1-9586-48c7-9e82-d0229d3b7a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:34.046604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4247e1-9586-48c7-9e82-d0229d3b7a94 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:34.060639 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3335/6608] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:34:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:34:34.488966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9cd24a-c95e-4f84-8a1c-e240ebca3ce9 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:34.490401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7d9cd24a-c95e-4f84-8a1c-e240ebca3ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:34.505206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9cd24a-c95e-4f84-8a1c-e240ebca3ce9 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:34.529807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768393bb-ecec-4051-af51-c35b86a31c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:34.532138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768393bb-ecec-4051-af51-c35b86a31c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:34.532386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768393bb-ecec-4051-af51-c35b86a31c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:34.532675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768393bb-ecec-4051-af51-c35b86a31c66 admin admin] PATH_INFO: `/v3/projects/7c6abedcdee44e27947e60ee51754290` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:34.543820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768393bb-ecec-4051-af51-c35b86a31c66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c6abedcdee44e27947e60ee51754290)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:34.546261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768393bb-ecec-4051-af51-c35b86a31c66 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:34.696161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-768393bb-ecec-4051-af51-c35b86a31c66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c6abedcdee44e27947e60ee51754290', 'request_id': 'req-768393bb-ecec-4051-af51-c35b86a31c66'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:34.702526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-768393bb-ecec-4051-af51-c35b86a31c66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c6abedcdee44e27947e60ee51754290', 'request_id': 'req-768393bb-ecec-4051-af51-c35b86a31c66'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:34.712394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-768393bb-ecec-4051-af51-c35b86a31c66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c6abedcdee44e27947e60ee51754290', 'request_id': 'req-768393bb-ecec-4051-af51-c35b86a31c66'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:34.842327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-768393bb-ecec-4051-af51-c35b86a31c66 admin admin] The token cache is being invalidate because project 7c6abedcdee44e27947e60ee51754290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:34:34.842694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-768393bb-ecec-4051-af51-c35b86a31c66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:34.843463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-768393bb-ecec-4051-af51-c35b86a31c66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:34.845535 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3274/6609] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:34:34 2022] DELETE /identity/v3/projects/7c6abedcdee44e27947e60ee51754290 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:34.850872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424116b-eb2b-47d1-bea6-f0296ee3ac3e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:34.851448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424116b-eb2b-47d1-bea6-f0296ee3ac3e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:34.851448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424116b-eb2b-47d1-bea6-f0296ee3ac3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:34.876409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d424116b-eb2b-47d1-bea6-f0296ee3ac3e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:34.878795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d424116b-eb2b-47d1-bea6-f0296ee3ac3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:34.972789 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3336/6610] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:34:34.973853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d61d26-8d25-4dd0-aa79-58bda6e69c42 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:34.974147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d61d26-8d25-4dd0-aa79-58bda6e69c42 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:34.974429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d61d26-8d25-4dd0-aa79-58bda6e69c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:34.996667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a3d61d26-8d25-4dd0-aa79-58bda6e69c42 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:34.997970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a3d61d26-8d25-4dd0-aa79-58bda6e69c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:35.015196 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3275/6611] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:34:35.021339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424116b-eb2b-47d1-bea6-f0296ee3ac3e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:35.032904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424116b-eb2b-47d1-bea6-f0296ee3ac3e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:35.038968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1667b4-9264-48a8-8c83-5122696e17cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:35.039858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1667b4-9264-48a8-8c83-5122696e17cc admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:35.040210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1667b4-9264-48a8-8c83-5122696e17cc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:35.040623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1667b4-9264-48a8-8c83-5122696e17cc admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:35.041520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1667b4-9264-48a8-8c83-5122696e17cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:34:35.041859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1667b4-9264-48a8-8c83-5122696e17cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:35.044457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1667b4-9264-48a8-8c83-5122696e17cc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:35.075043 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3337/6612] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:34:35.076095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d61d26-8d25-4dd0-aa79-58bda6e69c42 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:35.099659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d61d26-8d25-4dd0-aa79-58bda6e69c42 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:35.106797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6cde8-1093-4687-b9a0-ff53ad3d4c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:35.107518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6cde8-1093-4687-b9a0-ff53ad3d4c39 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:35.107806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6cde8-1093-4687-b9a0-ff53ad3d4c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:35.108087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6cde8-1093-4687-b9a0-ff53ad3d4c39 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:35.108787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6cde8-1093-4687-b9a0-ff53ad3d4c39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:35.110776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6cde8-1093-4687-b9a0-ff53ad3d4c39 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:35.249043 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3276/6613] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:34:35 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:34:35.249442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1667b4-9264-48a8-8c83-5122696e17cc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:35.262384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1667b4-9264-48a8-8c83-5122696e17cc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:35.374325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fcbb08-5c37-4d51-80d9-666794de3874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:35.375616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcbb08-5c37-4d51-80d9-666794de3874 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:35.376662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcbb08-5c37-4d51-80d9-666794de3874 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:35.376662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcbb08-5c37-4d51-80d9-666794de3874 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:35.376989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fcbb08-5c37-4d51-80d9-666794de3874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:35.379628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fcbb08-5c37-4d51-80d9-666794de3874 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:35.917067 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3338/6614] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:34:35 2022] POST /identity/v3/users => generated 292 bytes in 671 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:34:35.924126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6cde8-1093-4687-b9a0-ff53ad3d4c39 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:35.935733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6cde8-1093-4687-b9a0-ff53ad3d4c39 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:35.942257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5b712-9e04-48a7-8efc-ebab46e16b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:35.943039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5b712-9e04-48a7-8efc-ebab46e16b18 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:35.943507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5b712-9e04-48a7-8efc-ebab46e16b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:35.944238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5b712-9e04-48a7-8efc-ebab46e16b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:35.945221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5b712-9e04-48a7-8efc-ebab46e16b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:35.947306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5b712-9e04-48a7-8efc-ebab46e16b18 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:35.966300 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3277/6615] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:34:35.970394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fcbb08-5c37-4d51-80d9-666794de3874 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:35.986943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fcbb08-5c37-4d51-80d9-666794de3874 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:36.006796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2ba27-b267-4f4b-a16f-8104c2965507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:36.007808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2ba27-b267-4f4b-a16f-8104c2965507 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:36.008752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2ba27-b267-4f4b-a16f-8104c2965507 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:36.009253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2ba27-b267-4f4b-a16f-8104c2965507 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:36.010816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2ba27-b267-4f4b-a16f-8104c2965507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:36.014387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2ba27-b267-4f4b-a16f-8104c2965507 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:36.035359 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3339/6616] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:34:36.042360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5b712-9e04-48a7-8efc-ebab46e16b18 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:36.055706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5b712-9e04-48a7-8efc-ebab46e16b18 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:36.070565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da113370-70b6-4570-878f-388dbaac7214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:36.071556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da113370-70b6-4570-878f-388dbaac7214 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:36.071804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da113370-70b6-4570-878f-388dbaac7214 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:36.072332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da113370-70b6-4570-878f-388dbaac7214 admin admin] PATH_INFO: `/v3/projects/f2a1a477caa64bc199dd7b8e81942db8/users/ad24348a693d463d9cfa086c93273b2f/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:36.074358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:36.102128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da113370-70b6-4570-878f-388dbaac7214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a1a477caa64bc199dd7b8e81942db8, user_id=ad24348a693d463d9cfa086c93273b2f, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:36.106270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da113370-70b6-4570-878f-388dbaac7214 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:36.160897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:36.166695 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3278/6617] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:34:36 2022] PUT /identity/v3/projects/f2a1a477caa64bc199dd7b8e81942db8/users/ad24348a693d463d9cfa086c93273b2f/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:36.177867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4798837-9c1e-4914-9f96-11b9f093e39c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:36.178185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4798837-9c1e-4914-9f96-11b9f093e39c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:36.178776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4798837-9c1e-4914-9f96-11b9f093e39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:36.213734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d4798837-9c1e-4914-9f96-11b9f093e39c None None] MFA Rules not processed for user `ad24348a693d463d9cfa086c93273b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:36.216908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d4798837-9c1e-4914-9f96-11b9f093e39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:36.282334 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3340/6618] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:36.300699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da113370-70b6-4570-878f-388dbaac7214 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:36.302992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-da113370-70b6-4570-878f-388dbaac7214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:36.396087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da113370-70b6-4570-878f-388dbaac7214 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:36.399864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e30225-daec-40fd-a84c-fc873d1185c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:36.400518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e30225-daec-40fd-a84c-fc873d1185c4 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:36.400800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e30225-daec-40fd-a84c-fc873d1185c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:36.401080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e30225-daec-40fd-a84c-fc873d1185c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:36.421455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e30225-daec-40fd-a84c-fc873d1185c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:36.422861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e30225-daec-40fd-a84c-fc873d1185c4 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:36.442983 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3279/6619] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:34:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:34:41.402944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f92ca-2a57-46a4-a387-acef38ad04bb None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:41.403443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f92ca-2a57-46a4-a387-acef38ad04bb None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:41.404377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f92ca-2a57-46a4-a387-acef38ad04bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:41.459613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7e3f92ca-2a57-46a4-a387-acef38ad04bb None None] MFA Rules not processed for user `0ba5f87a4b70404094fd8e8300b283c0`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:41.466032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7e3f92ca-2a57-46a4-a387-acef38ad04bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:41.605608 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3341/6620] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:41.620766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e30225-daec-40fd-a84c-fc873d1185c4 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:41.622940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-36e30225-daec-40fd-a84c-fc873d1185c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:41.767497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f92ca-2a57-46a4-a387-acef38ad04bb None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:41.770442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7e3f92ca-2a57-46a4-a387-acef38ad04bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:41.831328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e30225-daec-40fd-a84c-fc873d1185c4 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:41.842589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f5b25-f7fd-4ed8-b7b9-96906d18bb57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:41.843284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f5b25-f7fd-4ed8-b7b9-96906d18bb57 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:41.843752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f5b25-f7fd-4ed8-b7b9-96906d18bb57 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:41.844191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f5b25-f7fd-4ed8-b7b9-96906d18bb57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:41.849152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d54f5b25-f7fd-4ed8-b7b9-96906d18bb57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:41.930048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f92ca-2a57-46a4-a387-acef38ad04bb None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:41.951825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60573f3-9dfd-4a4b-af57-714627ba2e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:41.951825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60573f3-9dfd-4a4b-af57-714627ba2e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:41.951825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60573f3-9dfd-4a4b-af57-714627ba2e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:41.951825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60573f3-9dfd-4a4b-af57-714627ba2e12 admin admin] PATH_INFO: `/v3/users/811f41c264a34d12a1d8934e7b928661` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:41.959804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60573f3-9dfd-4a4b-af57-714627ba2e12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=811f41c264a34d12a1d8934e7b928661)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:41.962471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60573f3-9dfd-4a4b-af57-714627ba2e12 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:41.964743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:42.025277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f5b25-f7fd-4ed8-b7b9-96906d18bb57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:42.028916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f5b25-f7fd-4ed8-b7b9-96906d18bb57 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:42.041487 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3280/6621] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:34:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:34:42.157521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c60573f3-9dfd-4a4b-af57-714627ba2e12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '811f41c264a34d12a1d8934e7b928661'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:42.175840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c60573f3-9dfd-4a4b-af57-714627ba2e12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '811f41c264a34d12a1d8934e7b928661'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:42.317249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c60573f3-9dfd-4a4b-af57-714627ba2e12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '811f41c264a34d12a1d8934e7b928661'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:42.320025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c60573f3-9dfd-4a4b-af57-714627ba2e12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '811f41c264a34d12a1d8934e7b928661'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:42.342250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c60573f3-9dfd-4a4b-af57-714627ba2e12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '811f41c264a34d12a1d8934e7b928661'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:42.352021 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3342/6622] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:34:41 2022] DELETE /identity/v3/users/811f41c264a34d12a1d8934e7b928661 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:42.357280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba686608-f244-4b54-83d5-04dc65146322 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:42.357576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba686608-f244-4b54-83d5-04dc65146322 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:42.357862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba686608-f244-4b54-83d5-04dc65146322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:42.380377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ba686608-f244-4b54-83d5-04dc65146322 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:42.381635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ba686608-f244-4b54-83d5-04dc65146322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:42.443720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:42.466250 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3281/6623] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:42.480551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60573f3-9dfd-4a4b-af57-714627ba2e12 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:42.485445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c60573f3-9dfd-4a4b-af57-714627ba2e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:42.609023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60573f3-9dfd-4a4b-af57-714627ba2e12 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:42.614179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4219a2-9815-4716-aea9-ef6fa995c5fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:42.615222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4219a2-9815-4716-aea9-ef6fa995c5fc service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:42.615683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4219a2-9815-4716-aea9-ef6fa995c5fc service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:42.616129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4219a2-9815-4716-aea9-ef6fa995c5fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:42.637010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4219a2-9815-4716-aea9-ef6fa995c5fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:42.639709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4219a2-9815-4716-aea9-ef6fa995c5fc service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:42.658094 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3343/6624] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:34:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:34:43.247807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba686608-f244-4b54-83d5-04dc65146322 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:43.249976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ba686608-f244-4b54-83d5-04dc65146322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:43.283893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba686608-f244-4b54-83d5-04dc65146322 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:43.298061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812391b-9654-4131-a1e8-7b9d7815b75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:43.298954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812391b-9654-4131-a1e8-7b9d7815b75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:43.299444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812391b-9654-4131-a1e8-7b9d7815b75f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:43.300471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812391b-9654-4131-a1e8-7b9d7815b75f admin admin] PATH_INFO: `/v3/projects/103f37ee87bd47fb9048f54d092125ed` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:43.303999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812391b-9654-4131-a1e8-7b9d7815b75f admin admin] RBAC: Authorizing `identity:delete_project(project_id=103f37ee87bd47fb9048f54d092125ed)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:43.314221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812391b-9654-4131-a1e8-7b9d7815b75f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:43.482236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7812391b-9654-4131-a1e8-7b9d7815b75f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103f37ee87bd47fb9048f54d092125ed', 'request_id': 'req-7812391b-9654-4131-a1e8-7b9d7815b75f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:43.489591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7812391b-9654-4131-a1e8-7b9d7815b75f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103f37ee87bd47fb9048f54d092125ed', 'request_id': 'req-7812391b-9654-4131-a1e8-7b9d7815b75f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:43.497422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7812391b-9654-4131-a1e8-7b9d7815b75f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103f37ee87bd47fb9048f54d092125ed', 'request_id': 'req-7812391b-9654-4131-a1e8-7b9d7815b75f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:43.607612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7812391b-9654-4131-a1e8-7b9d7815b75f admin admin] The token cache is being invalidate because project 103f37ee87bd47fb9048f54d092125ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:34:43.608005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7812391b-9654-4131-a1e8-7b9d7815b75f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:43.608898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7812391b-9654-4131-a1e8-7b9d7815b75f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:43.614556 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3282/6625] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:34:43 2022] DELETE /identity/v3/projects/103f37ee87bd47fb9048f54d092125ed => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:43.620710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3d964-2162-4cb9-9eae-c28d9aa94e75 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:43.621363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3d964-2162-4cb9-9eae-c28d9aa94e75 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:43.621809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3d964-2162-4cb9-9eae-c28d9aa94e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:43.656931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3df3d964-2162-4cb9-9eae-c28d9aa94e75 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:43.659628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3df3d964-2162-4cb9-9eae-c28d9aa94e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:43.799795 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3344/6626] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:43.808428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7a58a-7f10-4cbb-876b-b7728a9e25b3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:43.808848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7a58a-7f10-4cbb-876b-b7728a9e25b3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:43.809444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7a58a-7f10-4cbb-876b-b7728a9e25b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:43.873505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e5a7a58a-7f10-4cbb-876b-b7728a9e25b3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:43.875102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e5a7a58a-7f10-4cbb-876b-b7728a9e25b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:43.886963 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3283/6627] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:43.891185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3d964-2162-4cb9-9eae-c28d9aa94e75 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:43.903262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3d964-2162-4cb9-9eae-c28d9aa94e75 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:43.930097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c517bc-3a7d-4e30-acf8-c8247724ac06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:43.930097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c517bc-3a7d-4e30-acf8-c8247724ac06 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:43.930097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c517bc-3a7d-4e30-acf8-c8247724ac06 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:43.930097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c517bc-3a7d-4e30-acf8-c8247724ac06 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:43.931219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c517bc-3a7d-4e30-acf8-c8247724ac06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:34:43.932994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c517bc-3a7d-4e30-acf8-c8247724ac06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:43.938207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c517bc-3a7d-4e30-acf8-c8247724ac06 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:43.961104 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3345/6628] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:34:43.965308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7a58a-7f10-4cbb-876b-b7728a9e25b3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:43.978166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7a58a-7f10-4cbb-876b-b7728a9e25b3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:43.999669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16e28d-c400-498d-aea2-5b2866a8a450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:44.000757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16e28d-c400-498d-aea2-5b2866a8a450 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:44.001205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16e28d-c400-498d-aea2-5b2866a8a450 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:44.001670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16e28d-c400-498d-aea2-5b2866a8a450 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:44.002552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16e28d-c400-498d-aea2-5b2866a8a450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:44.005913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16e28d-c400-498d-aea2-5b2866a8a450 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:44.158694 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3284/6629] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:34:43 2022] POST /identity/v3/projects => generated 375 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:34:44.165848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c517bc-3a7d-4e30-acf8-c8247724ac06 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:44.210493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c517bc-3a7d-4e30-acf8-c8247724ac06 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:44.228166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:44.364302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46435a35-2693-49b6-897b-4159c836b30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:44.368929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46435a35-2693-49b6-897b-4159c836b30b admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:44.368929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46435a35-2693-49b6-897b-4159c836b30b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:44.368929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46435a35-2693-49b6-897b-4159c836b30b admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:44.368929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46435a35-2693-49b6-897b-4159c836b30b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:44.371212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46435a35-2693-49b6-897b-4159c836b30b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:44.520921 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3346/6630] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:34:44 2022] POST /identity/v3/users => generated 288 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:34:44.526534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16e28d-c400-498d-aea2-5b2866a8a450 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:44.548015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16e28d-c400-498d-aea2-5b2866a8a450 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:44.553388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe4138-99b4-4d36-ada8-bffb951faf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:44.556446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe4138-99b4-4d36-ada8-bffb951faf47 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:44.556746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe4138-99b4-4d36-ada8-bffb951faf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:44.557451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe4138-99b4-4d36-ada8-bffb951faf47 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:44.558653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe4138-99b4-4d36-ada8-bffb951faf47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:44.560727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe4138-99b4-4d36-ada8-bffb951faf47 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:44.576811 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3285/6631] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:34:44.581566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46435a35-2693-49b6-897b-4159c836b30b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:44.599826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46435a35-2693-49b6-897b-4159c836b30b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:44.605295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfac14f-507e-490d-9eb8-b0ab33b80df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:44.606086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfac14f-507e-490d-9eb8-b0ab33b80df9 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:44.606471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfac14f-507e-490d-9eb8-b0ab33b80df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:44.606849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfac14f-507e-490d-9eb8-b0ab33b80df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:44.607870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfac14f-507e-490d-9eb8-b0ab33b80df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:44.609587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfac14f-507e-490d-9eb8-b0ab33b80df9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:44.625910 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3347/6632] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:34:44.631132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe4138-99b4-4d36-ada8-bffb951faf47 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:44.641812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe4138-99b4-4d36-ada8-bffb951faf47 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:44.647832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51570b-8612-4d30-879a-6405f709ae02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:44.648766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51570b-8612-4d30-879a-6405f709ae02 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:44.649048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51570b-8612-4d30-879a-6405f709ae02 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:44.649327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51570b-8612-4d30-879a-6405f709ae02 admin admin] PATH_INFO: `/v3/projects/2d1bd8ef8f5348adac5e3371b17d3503/users/c536dabecea04a33bae71b285884a4b0/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:44.666139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51570b-8612-4d30-879a-6405f709ae02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d1bd8ef8f5348adac5e3371b17d3503, user_id=c536dabecea04a33bae71b285884a4b0, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:44.669116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51570b-8612-4d30-879a-6405f709ae02 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:44.801832 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3286/6633] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:34:44 2022] PUT /identity/v3/projects/2d1bd8ef8f5348adac5e3371b17d3503/users/c536dabecea04a33bae71b285884a4b0/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:34:44.812061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad22451-f93e-448d-b680-15bb97020dc1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:44.812345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad22451-f93e-448d-b680-15bb97020dc1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:44.812827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad22451-f93e-448d-b680-15bb97020dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:44.858515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9ad22451-f93e-448d-b680-15bb97020dc1 None None] MFA Rules not processed for user `c536dabecea04a33bae71b285884a4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:44.868177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9ad22451-f93e-448d-b680-15bb97020dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:44.960462 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3348/6634] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:44.986902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51570b-8612-4d30-879a-6405f709ae02 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:44.989944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9a51570b-8612-4d30-879a-6405f709ae02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:45.134431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51570b-8612-4d30-879a-6405f709ae02 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:45.144323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a2395-fc8f-4e2f-99ed-a06b5fb15475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:45.145522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a2395-fc8f-4e2f-99ed-a06b5fb15475 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:45.145522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a2395-fc8f-4e2f-99ed-a06b5fb15475 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:45.145522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a2395-fc8f-4e2f-99ed-a06b5fb15475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:45.176988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a2395-fc8f-4e2f-99ed-a06b5fb15475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:45.183725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a2395-fc8f-4e2f-99ed-a06b5fb15475 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:45.224055 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3287/6635] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:34:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:34:45.239870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad22451-f93e-448d-b680-15bb97020dc1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:45.430080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad22451-f93e-448d-b680-15bb97020dc1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:45.449757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d63cbb-ae09-48ae-b02b-705113cdc229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:45.453461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d63cbb-ae09-48ae-b02b-705113cdc229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:45.458249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d63cbb-ae09-48ae-b02b-705113cdc229 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:45.459486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d63cbb-ae09-48ae-b02b-705113cdc229 admin admin] PATH_INFO: `/v3/users/c536dabecea04a33bae71b285884a4b0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:45.464239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d63cbb-ae09-48ae-b02b-705113cdc229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c536dabecea04a33bae71b285884a4b0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:45.481984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d63cbb-ae09-48ae-b02b-705113cdc229 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:45.791997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-22d63cbb-ae09-48ae-b02b-705113cdc229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c536dabecea04a33bae71b285884a4b0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:45.792735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af57ce-54ab-4cf9-b9b5-5f53e0d81978 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:45.793094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af57ce-54ab-4cf9-b9b5-5f53e0d81978 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:45.793220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af57ce-54ab-4cf9-b9b5-5f53e0d81978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:45.805583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-22d63cbb-ae09-48ae-b02b-705113cdc229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c536dabecea04a33bae71b285884a4b0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:45.895274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a0af57ce-54ab-4cf9-b9b5-5f53e0d81978 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:45.897056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a0af57ce-54ab-4cf9-b9b5-5f53e0d81978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:45.903257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:45.979885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-22d63cbb-ae09-48ae-b02b-705113cdc229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c536dabecea04a33bae71b285884a4b0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:45.979885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-22d63cbb-ae09-48ae-b02b-705113cdc229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c536dabecea04a33bae71b285884a4b0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:46.000943 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3288/6636] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:34:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:46.008098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-22d63cbb-ae09-48ae-b02b-705113cdc229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c536dabecea04a33bae71b285884a4b0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:46.017575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af57ce-54ab-4cf9-b9b5-5f53e0d81978 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:46.019688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a0af57ce-54ab-4cf9-b9b5-5f53e0d81978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:46.028996 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3349/6637] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:34:45 2022] DELETE /identity/v3/users/c536dabecea04a33bae71b285884a4b0 => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:46.033602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349d0ce-4ccd-4749-bdbd-799999efa2c5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:46.033954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349d0ce-4ccd-4749-bdbd-799999efa2c5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:46.034749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349d0ce-4ccd-4749-bdbd-799999efa2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:46.065125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d349d0ce-4ccd-4749-bdbd-799999efa2c5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:46.067518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d349d0ce-4ccd-4749-bdbd-799999efa2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:46.193928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:46.228468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af57ce-54ab-4cf9-b9b5-5f53e0d81978 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:46.292837 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3350/6638] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:34:46.321387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349d0ce-4ccd-4749-bdbd-799999efa2c5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:46.323652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d349d0ce-4ccd-4749-bdbd-799999efa2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:46.344208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc3b79-12f3-4024-b168-d1390173d722 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:46.344208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc3b79-12f3-4024-b168-d1390173d722 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:46.344539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc3b79-12f3-4024-b168-d1390173d722 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:46.344911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc3b79-12f3-4024-b168-d1390173d722 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:46.488135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc3b79-12f3-4024-b168-d1390173d722 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:46.488135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc3b79-12f3-4024-b168-d1390173d722 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:46.496891 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3289/6639] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:34:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:34:46.532821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349d0ce-4ccd-4749-bdbd-799999efa2c5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:46.545836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22991ce-d675-4bef-b0ee-1842266dd3d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:46.546518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22991ce-d675-4bef-b0ee-1842266dd3d2 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:46.548824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22991ce-d675-4bef-b0ee-1842266dd3d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:46.548824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22991ce-d675-4bef-b0ee-1842266dd3d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:46.573535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22991ce-d675-4bef-b0ee-1842266dd3d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:46.575936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22991ce-d675-4bef-b0ee-1842266dd3d2 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:46.640788 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3351/6640] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:34:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:34:47.852302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:48.330489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc3b79-12f3-4024-b168-d1390173d722 service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:48.335544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-adbc3b79-12f3-4024-b168-d1390173d722 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:48.380250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc3b79-12f3-4024-b168-d1390173d722 service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:48.403430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a45e2-b987-4f3e-9293-ddd0d45d8c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:48.406005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a45e2-b987-4f3e-9293-ddd0d45d8c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:48.407224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a45e2-b987-4f3e-9293-ddd0d45d8c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:48.409981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a45e2-b987-4f3e-9293-ddd0d45d8c83 admin admin] PATH_INFO: `/v3/projects/2d1bd8ef8f5348adac5e3371b17d3503` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:48.415742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a45e2-b987-4f3e-9293-ddd0d45d8c83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d1bd8ef8f5348adac5e3371b17d3503)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:48.421858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a45e2-b987-4f3e-9293-ddd0d45d8c83 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:48.644796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-be8a45e2-b987-4f3e-9293-ddd0d45d8c83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d1bd8ef8f5348adac5e3371b17d3503', 'request_id': 'req-be8a45e2-b987-4f3e-9293-ddd0d45d8c83'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:48.654646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-be8a45e2-b987-4f3e-9293-ddd0d45d8c83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d1bd8ef8f5348adac5e3371b17d3503', 'request_id': 'req-be8a45e2-b987-4f3e-9293-ddd0d45d8c83'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:48.672000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-be8a45e2-b987-4f3e-9293-ddd0d45d8c83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d1bd8ef8f5348adac5e3371b17d3503', 'request_id': 'req-be8a45e2-b987-4f3e-9293-ddd0d45d8c83'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:48.784921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-be8a45e2-b987-4f3e-9293-ddd0d45d8c83 admin admin] The token cache is being invalidate because project 2d1bd8ef8f5348adac5e3371b17d3503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:34:48.785397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-be8a45e2-b987-4f3e-9293-ddd0d45d8c83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:48.791502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-be8a45e2-b987-4f3e-9293-ddd0d45d8c83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:48.800914 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3290/6641] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:34:48 2022] DELETE /identity/v3/projects/2d1bd8ef8f5348adac5e3371b17d3503 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:48.805803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8748707-024d-4702-96a6-cf965dd6d764 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:48.806348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8748707-024d-4702-96a6-cf965dd6d764 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:48.806457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8748707-024d-4702-96a6-cf965dd6d764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:48.846703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c8748707-024d-4702-96a6-cf965dd6d764 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:48.850905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c8748707-024d-4702-96a6-cf965dd6d764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:48.971738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:49.071105 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3352/6642] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:49.084368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ee310-328b-4ee3-8469-8b65338f9b5f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:49.099729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ee310-328b-4ee3-8469-8b65338f9b5f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:49.099729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ee310-328b-4ee3-8469-8b65338f9b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:49.149366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-070ee310-328b-4ee3-8469-8b65338f9b5f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:49.157255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-070ee310-328b-4ee3-8469-8b65338f9b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:49.185842 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3291/6643] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:49.187446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8748707-024d-4702-96a6-cf965dd6d764 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:49.202569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8748707-024d-4702-96a6-cf965dd6d764 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:49.213686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f8f69-73f9-49c0-b178-8eaa8bc5610d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:49.214532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f8f69-73f9-49c0-b178-8eaa8bc5610d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:49.215177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f8f69-73f9-49c0-b178-8eaa8bc5610d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:49.215464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f8f69-73f9-49c0-b178-8eaa8bc5610d admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:49.216214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f8f69-73f9-49c0-b178-8eaa8bc5610d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:34:49.216600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f8f69-73f9-49c0-b178-8eaa8bc5610d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:49.224644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f8f69-73f9-49c0-b178-8eaa8bc5610d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:49.258763 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3353/6644] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:34:49.261760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ee310-328b-4ee3-8469-8b65338f9b5f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:49.277653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ee310-328b-4ee3-8469-8b65338f9b5f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:49.296678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceabe12-4e2d-4c43-a39b-714383249a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:49.297674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceabe12-4e2d-4c43-a39b-714383249a78 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:49.297968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceabe12-4e2d-4c43-a39b-714383249a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:49.298248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceabe12-4e2d-4c43-a39b-714383249a78 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:49.299403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceabe12-4e2d-4c43-a39b-714383249a78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:49.301288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceabe12-4e2d-4c43-a39b-714383249a78 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:49.465739 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3292/6645] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:34:49 2022] POST /identity/v3/projects => generated 375 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:34:49.466579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f8f69-73f9-49c0-b178-8eaa8bc5610d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:49.495121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f8f69-73f9-49c0-b178-8eaa8bc5610d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:49.586876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc402686-2dfc-45c6-84b5-f105f4dae307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:49.587626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc402686-2dfc-45c6-84b5-f105f4dae307 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:49.587913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc402686-2dfc-45c6-84b5-f105f4dae307 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:49.588197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc402686-2dfc-45c6-84b5-f105f4dae307 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:49.589617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc402686-2dfc-45c6-84b5-f105f4dae307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:49.591763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc402686-2dfc-45c6-84b5-f105f4dae307 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:49.703439 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3354/6646] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:34:49 2022] POST /identity/v3/users => generated 288 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:34:49.708085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceabe12-4e2d-4c43-a39b-714383249a78 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:49.726004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceabe12-4e2d-4c43-a39b-714383249a78 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:49.741388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bf086-d909-4517-be84-ec78c09cf11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:49.742312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bf086-d909-4517-be84-ec78c09cf11a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:49.743830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bf086-d909-4517-be84-ec78c09cf11a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:49.744294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bf086-d909-4517-be84-ec78c09cf11a admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:49.745746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bf086-d909-4517-be84-ec78c09cf11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:49.749616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bf086-d909-4517-be84-ec78c09cf11a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:49.804495 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3293/6647] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:34:49.805676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc402686-2dfc-45c6-84b5-f105f4dae307 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:49.836616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc402686-2dfc-45c6-84b5-f105f4dae307 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:49.851576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc98eeb-c98b-4e93-b053-25525dd630d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:49.858714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc98eeb-c98b-4e93-b053-25525dd630d0 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:49.859030 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc98eeb-c98b-4e93-b053-25525dd630d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:49.859496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc98eeb-c98b-4e93-b053-25525dd630d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:49.860436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc98eeb-c98b-4e93-b053-25525dd630d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:49.881459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc98eeb-c98b-4e93-b053-25525dd630d0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:49.908366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bf086-d909-4517-be84-ec78c09cf11a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:49.916607 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3355/6648] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:34:49.926258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bf086-d909-4517-be84-ec78c09cf11a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:49.935817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6ee72-3c6e-42bc-9990-ca3d93dccead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:49.936730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6ee72-3c6e-42bc-9990-ca3d93dccead admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:49.937012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6ee72-3c6e-42bc-9990-ca3d93dccead admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:49.939443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6ee72-3c6e-42bc-9990-ca3d93dccead admin admin] PATH_INFO: `/v3/projects/ed743c7d588e4033933afa87da93272c/users/5fa601de9c4a41ee83997ea812c1ad16/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:49.976767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6ee72-3c6e-42bc-9990-ca3d93dccead admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed743c7d588e4033933afa87da93272c, user_id=5fa601de9c4a41ee83997ea812c1ad16, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:49.980151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6ee72-3c6e-42bc-9990-ca3d93dccead admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:50.086555 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3294/6649] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:34:49 2022] PUT /identity/v3/projects/ed743c7d588e4033933afa87da93272c/users/5fa601de9c4a41ee83997ea812c1ad16/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:50.094257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d1ac0-3dec-4e8e-8d6b-ce49a7730f2d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:50.094562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d1ac0-3dec-4e8e-8d6b-ce49a7730f2d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:50.094824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d1ac0-3dec-4e8e-8d6b-ce49a7730f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:50.156123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-012d1ac0-3dec-4e8e-8d6b-ce49a7730f2d None None] MFA Rules not processed for user `5fa601de9c4a41ee83997ea812c1ad16`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:50.157833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-012d1ac0-3dec-4e8e-8d6b-ce49a7730f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:50.357335 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3356/6650] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:50.406470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6ee72-3c6e-42bc-9990-ca3d93dccead admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:50.408634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1ea6ee72-3c6e-42bc-9990-ca3d93dccead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:50.483453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d1ac0-3dec-4e8e-8d6b-ce49a7730f2d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:50.484690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-012d1ac0-3dec-4e8e-8d6b-ce49a7730f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:50.598130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6ee72-3c6e-42bc-9990-ca3d93dccead admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:50.638108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154bca8-37a1-4660-b1dc-fb1a54810252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:50.654660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154bca8-37a1-4660-b1dc-fb1a54810252 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:50.656073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154bca8-37a1-4660-b1dc-fb1a54810252 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:50.658009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154bca8-37a1-4660-b1dc-fb1a54810252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:50.694701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154bca8-37a1-4660-b1dc-fb1a54810252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:50.698704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154bca8-37a1-4660-b1dc-fb1a54810252 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:50.737206 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3295/6651] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:34:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:34:50.749390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:50.765824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d1ac0-3dec-4e8e-8d6b-ce49a7730f2d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:50.785961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5305eeb-4eaf-459a-9c44-72baa2aca6f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:50.786664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5305eeb-4eaf-459a-9c44-72baa2aca6f3 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:50.786931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5305eeb-4eaf-459a-9c44-72baa2aca6f3 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:50.787234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5305eeb-4eaf-459a-9c44-72baa2aca6f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:50.810021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d5305eeb-4eaf-459a-9c44-72baa2aca6f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:50.853976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5305eeb-4eaf-459a-9c44-72baa2aca6f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:50.863969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5305eeb-4eaf-459a-9c44-72baa2aca6f3 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:50.901826 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3357/6652] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:34:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:34:51.720524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154bca8-37a1-4660-b1dc-fb1a54810252 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:51.724153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7154bca8-37a1-4660-b1dc-fb1a54810252 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:51.752886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154bca8-37a1-4660-b1dc-fb1a54810252 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:51.761516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fbb52-8f58-4cfd-91b2-2fd79a89fd78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:51.762749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fbb52-8f58-4cfd-91b2-2fd79a89fd78 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:51.763344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fbb52-8f58-4cfd-91b2-2fd79a89fd78 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:51.763870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fbb52-8f58-4cfd-91b2-2fd79a89fd78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:51.767887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-497fbb52-8f58-4cfd-91b2-2fd79a89fd78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:51.892529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497fbb52-8f58-4cfd-91b2-2fd79a89fd78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:51.901466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497fbb52-8f58-4cfd-91b2-2fd79a89fd78 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:51.970622 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3296/6653] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:34:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:34:52.615498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5305eeb-4eaf-459a-9c44-72baa2aca6f3 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:52.798883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5305eeb-4eaf-459a-9c44-72baa2aca6f3 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:52.803940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3c2fd-c80c-422a-aa38-229fde7d1107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:52.804968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3c2fd-c80c-422a-aa38-229fde7d1107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:52.805360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3c2fd-c80c-422a-aa38-229fde7d1107 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:52.806146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3c2fd-c80c-422a-aa38-229fde7d1107 admin admin] PATH_INFO: `/v3/users/5fa601de9c4a41ee83997ea812c1ad16` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:52.813178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3c2fd-c80c-422a-aa38-229fde7d1107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa601de9c4a41ee83997ea812c1ad16)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:52.817354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3c2fd-c80c-422a-aa38-229fde7d1107 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:53.113358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-65a3c2fd-c80c-422a-aa38-229fde7d1107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa601de9c4a41ee83997ea812c1ad16'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:53.124596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-65a3c2fd-c80c-422a-aa38-229fde7d1107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa601de9c4a41ee83997ea812c1ad16'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:53.201334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-65a3c2fd-c80c-422a-aa38-229fde7d1107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa601de9c4a41ee83997ea812c1ad16'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:53.202114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-65a3c2fd-c80c-422a-aa38-229fde7d1107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa601de9c4a41ee83997ea812c1ad16'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:53.230199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-65a3c2fd-c80c-422a-aa38-229fde7d1107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa601de9c4a41ee83997ea812c1ad16'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:53.256486 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3358/6654] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:34:52 2022] DELETE /identity/v3/users/5fa601de9c4a41ee83997ea812c1ad16 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:53.261215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59e75d-929a-4fce-b3b2-490c343066dc None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:53.262293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59e75d-929a-4fce-b3b2-490c343066dc None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:53.262800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59e75d-929a-4fce-b3b2-490c343066dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:53.287139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:53.304713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ad59e75d-929a-4fce-b3b2-490c343066dc None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:53.306691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ad59e75d-929a-4fce-b3b2-490c343066dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:53.498347 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3297/6655] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:53.515644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3c2fd-c80c-422a-aa38-229fde7d1107 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:53.517329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-65a3c2fd-c80c-422a-aa38-229fde7d1107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:53.604045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:53.636798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3c2fd-c80c-422a-aa38-229fde7d1107 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:53.645989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff80f3f-6fb7-4bb4-8c8c-e27ba99c6a17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:53.647262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff80f3f-6fb7-4bb4-8c8c-e27ba99c6a17 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:53.647749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff80f3f-6fb7-4bb4-8c8c-e27ba99c6a17 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:53.647990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff80f3f-6fb7-4bb4-8c8c-e27ba99c6a17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:53.660716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff80f3f-6fb7-4bb4-8c8c-e27ba99c6a17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:53.662124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff80f3f-6fb7-4bb4-8c8c-e27ba99c6a17 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:53.679442 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3359/6656] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:34:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:34:54.682448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59e75d-929a-4fce-b3b2-490c343066dc None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:54.684098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ad59e75d-929a-4fce-b3b2-490c343066dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:54.725850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59e75d-929a-4fce-b3b2-490c343066dc None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:54.734190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6e063-a8d1-4aed-a2a0-02e018409c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:54.736016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6e063-a8d1-4aed-a2a0-02e018409c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:54.736492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6e063-a8d1-4aed-a2a0-02e018409c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:54.736944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6e063-a8d1-4aed-a2a0-02e018409c8b admin admin] PATH_INFO: `/v3/projects/ed743c7d588e4033933afa87da93272c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:54.738975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6e063-a8d1-4aed-a2a0-02e018409c8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed743c7d588e4033933afa87da93272c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:54.741326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6e063-a8d1-4aed-a2a0-02e018409c8b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:54.923482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-acf6e063-a8d1-4aed-a2a0-02e018409c8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed743c7d588e4033933afa87da93272c', 'request_id': 'req-acf6e063-a8d1-4aed-a2a0-02e018409c8b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:54.939550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-acf6e063-a8d1-4aed-a2a0-02e018409c8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed743c7d588e4033933afa87da93272c', 'request_id': 'req-acf6e063-a8d1-4aed-a2a0-02e018409c8b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:54.951699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-acf6e063-a8d1-4aed-a2a0-02e018409c8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed743c7d588e4033933afa87da93272c', 'request_id': 'req-acf6e063-a8d1-4aed-a2a0-02e018409c8b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:55.047979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-acf6e063-a8d1-4aed-a2a0-02e018409c8b admin admin] The token cache is being invalidate because project ed743c7d588e4033933afa87da93272c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:34:55.048274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-acf6e063-a8d1-4aed-a2a0-02e018409c8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:55.050866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-acf6e063-a8d1-4aed-a2a0-02e018409c8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:55.052763 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3298/6657] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:34:54 2022] DELETE /identity/v3/projects/ed743c7d588e4033933afa87da93272c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:55.058823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000a830-08a8-4301-aed1-9c27dd00790d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:55.059496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000a830-08a8-4301-aed1-9c27dd00790d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:55.059966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000a830-08a8-4301-aed1-9c27dd00790d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:55.118929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1000a830-08a8-4301-aed1-9c27dd00790d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:55.120362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1000a830-08a8-4301-aed1-9c27dd00790d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:55.291703 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3360/6658] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:55.301185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7b504-90a2-45ac-a114-4020eaeb4366 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:55.301664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7b504-90a2-45ac-a114-4020eaeb4366 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:55.302061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7b504-90a2-45ac-a114-4020eaeb4366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:55.348045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-11b7b504-90a2-45ac-a114-4020eaeb4366 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:55.349389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-11b7b504-90a2-45ac-a114-4020eaeb4366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:55.377364 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3299/6659] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:55.382490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000a830-08a8-4301-aed1-9c27dd00790d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:55.396291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000a830-08a8-4301-aed1-9c27dd00790d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:55.413715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abf7e1-6ac3-428d-af0e-701c1ab43d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:55.415423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abf7e1-6ac3-428d-af0e-701c1ab43d94 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:55.415984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abf7e1-6ac3-428d-af0e-701c1ab43d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:55.416606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abf7e1-6ac3-428d-af0e-701c1ab43d94 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:55.417726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abf7e1-6ac3-428d-af0e-701c1ab43d94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:34:55.418231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abf7e1-6ac3-428d-af0e-701c1ab43d94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:55.420127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abf7e1-6ac3-428d-af0e-701c1ab43d94 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:55.445941 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3361/6660] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:34:55.448096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7b504-90a2-45ac-a114-4020eaeb4366 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:55.461622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7b504-90a2-45ac-a114-4020eaeb4366 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:55.481293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb723c-bacc-4e1a-ae18-61e445eb6199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:55.481422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb723c-bacc-4e1a-ae18-61e445eb6199 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:55.481695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb723c-bacc-4e1a-ae18-61e445eb6199 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:55.481991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb723c-bacc-4e1a-ae18-61e445eb6199 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:55.483434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb723c-bacc-4e1a-ae18-61e445eb6199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:55.485392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb723c-bacc-4e1a-ae18-61e445eb6199 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:55.615530 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3300/6661] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:34:55 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:34:55.619892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abf7e1-6ac3-428d-af0e-701c1ab43d94 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:55.633375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abf7e1-6ac3-428d-af0e-701c1ab43d94 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:55.761346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b0b65-97a3-4757-b045-fe5757e04c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:55.762496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b0b65-97a3-4757-b045-fe5757e04c37 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:55.763384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b0b65-97a3-4757-b045-fe5757e04c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:55.764044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b0b65-97a3-4757-b045-fe5757e04c37 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:55.765204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b0b65-97a3-4757-b045-fe5757e04c37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:55.768148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b0b65-97a3-4757-b045-fe5757e04c37 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:55.936936 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3362/6662] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:34:55 2022] POST /identity/v3/users => generated 288 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:34:55.938134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb723c-bacc-4e1a-ae18-61e445eb6199 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:55.956574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb723c-bacc-4e1a-ae18-61e445eb6199 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:55.963506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61476dd-1f04-44f4-b684-24beae511b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:55.964966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61476dd-1f04-44f4-b684-24beae511b5c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:55.965356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61476dd-1f04-44f4-b684-24beae511b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:55.965825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61476dd-1f04-44f4-b684-24beae511b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:55.967307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61476dd-1f04-44f4-b684-24beae511b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:55.969605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61476dd-1f04-44f4-b684-24beae511b5c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:55.985224 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3301/6663] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:34:55.989903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b0b65-97a3-4757-b045-fe5757e04c37 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:56.009462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b0b65-97a3-4757-b045-fe5757e04c37 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:56.020390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb8d97-f55b-402c-b7ee-8b17bb8dd004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:56.021734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb8d97-f55b-402c-b7ee-8b17bb8dd004 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:56.022218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb8d97-f55b-402c-b7ee-8b17bb8dd004 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:56.023337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb8d97-f55b-402c-b7ee-8b17bb8dd004 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:56.024248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb8d97-f55b-402c-b7ee-8b17bb8dd004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:56.026134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb8d97-f55b-402c-b7ee-8b17bb8dd004 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:56.040836 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3363/6664] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:34:56.045346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61476dd-1f04-44f4-b684-24beae511b5c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:56.063201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61476dd-1f04-44f4-b684-24beae511b5c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:56.068940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc954a8-64ae-46a7-a477-78aaef4501fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:56.070363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc954a8-64ae-46a7-a477-78aaef4501fc admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:56.070830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc954a8-64ae-46a7-a477-78aaef4501fc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:56.071454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc954a8-64ae-46a7-a477-78aaef4501fc admin admin] PATH_INFO: `/v3/projects/b6d9739f299747a490842a33c20b6222/users/62f684180eaf48b784f37bfd54fec7b0/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:56.111000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc954a8-64ae-46a7-a477-78aaef4501fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d9739f299747a490842a33c20b6222, user_id=62f684180eaf48b784f37bfd54fec7b0, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:56.120931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc954a8-64ae-46a7-a477-78aaef4501fc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:56.251053 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3302/6665] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:34:56 2022] PUT /identity/v3/projects/b6d9739f299747a490842a33c20b6222/users/62f684180eaf48b784f37bfd54fec7b0/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:56.259485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69f6f7-b209-46e2-9c93-e9759ec087d3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:56.260433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69f6f7-b209-46e2-9c93-e9759ec087d3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:56.260919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69f6f7-b209-46e2-9c93-e9759ec087d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:56.346991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-bb69f6f7-b209-46e2-9c93-e9759ec087d3 None None] MFA Rules not processed for user `62f684180eaf48b784f37bfd54fec7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:56.348373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bb69f6f7-b209-46e2-9c93-e9759ec087d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:56.458773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:56.540820 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3364/6666] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:56.591808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc954a8-64ae-46a7-a477-78aaef4501fc admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:56.597280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-dcc954a8-64ae-46a7-a477-78aaef4501fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:56.649165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:56.737325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc954a8-64ae-46a7-a477-78aaef4501fc admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:56.750593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b199401-d14f-4f90-87eb-0e08059d1f5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:56.752318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b199401-d14f-4f90-87eb-0e08059d1f5d service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:56.752578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b199401-d14f-4f90-87eb-0e08059d1f5d service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:56.752906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b199401-d14f-4f90-87eb-0e08059d1f5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:56.779868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b199401-d14f-4f90-87eb-0e08059d1f5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:56.784920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b199401-d14f-4f90-87eb-0e08059d1f5d service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:56.824614 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3303/6667] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:34:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:34:56.850899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69f6f7-b209-46e2-9c93-e9759ec087d3 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:57.000605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69f6f7-b209-46e2-9c93-e9759ec087d3 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:57.006784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa58fc-46ad-49bf-ac35-93107ba1893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:57.010103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa58fc-46ad-49bf-ac35-93107ba1893d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:57.010103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa58fc-46ad-49bf-ac35-93107ba1893d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:57.010103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa58fc-46ad-49bf-ac35-93107ba1893d admin admin] PATH_INFO: `/v3/users/62f684180eaf48b784f37bfd54fec7b0` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:57.010103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa58fc-46ad-49bf-ac35-93107ba1893d admin admin] RBAC: Authorizing `identity:delete_user(user_id=62f684180eaf48b784f37bfd54fec7b0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:57.011568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa58fc-46ad-49bf-ac35-93107ba1893d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:57.292699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3caa58fc-46ad-49bf-ac35-93107ba1893d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62f684180eaf48b784f37bfd54fec7b0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:57.303260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3caa58fc-46ad-49bf-ac35-93107ba1893d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62f684180eaf48b784f37bfd54fec7b0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:57.449782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3caa58fc-46ad-49bf-ac35-93107ba1893d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62f684180eaf48b784f37bfd54fec7b0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:57.449782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3caa58fc-46ad-49bf-ac35-93107ba1893d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62f684180eaf48b784f37bfd54fec7b0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:57.479618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3caa58fc-46ad-49bf-ac35-93107ba1893d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62f684180eaf48b784f37bfd54fec7b0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:57.498957 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3365/6668] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:34:56 2022] DELETE /identity/v3/users/62f684180eaf48b784f37bfd54fec7b0 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:57.504029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fad3a0-e87e-4a62-b5fe-4c3262205fe7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:57.504557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fad3a0-e87e-4a62-b5fe-4c3262205fe7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:57.504649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fad3a0-e87e-4a62-b5fe-4c3262205fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:57.545772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d1fad3a0-e87e-4a62-b5fe-4c3262205fe7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:57.547476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d1fad3a0-e87e-4a62-b5fe-4c3262205fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:57.669913 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3304/6669] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:34:57.707113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa58fc-46ad-49bf-ac35-93107ba1893d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:57.709532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3caa58fc-46ad-49bf-ac35-93107ba1893d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:57.928422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa58fc-46ad-49bf-ac35-93107ba1893d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:57.943884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4924071-16ca-47d1-ae22-ec148af47f6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:57.944745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4924071-16ca-47d1-ae22-ec148af47f6e service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:57.945131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4924071-16ca-47d1-ae22-ec148af47f6e service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:57.945508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4924071-16ca-47d1-ae22-ec148af47f6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:57.972922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4924071-16ca-47d1-ae22-ec148af47f6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:57.975916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4924071-16ca-47d1-ae22-ec148af47f6e service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:57.993861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:58.009669 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3366/6670] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:34:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:34:59.117719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fad3a0-e87e-4a62-b5fe-4c3262205fe7 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:59.121769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d1fad3a0-e87e-4a62-b5fe-4c3262205fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:59.137259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fad3a0-e87e-4a62-b5fe-4c3262205fe7 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:59.144064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20e893-1e85-4c2a-bcc2-a8199dca247e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:59.145430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20e893-1e85-4c2a-bcc2-a8199dca247e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:59.146040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20e893-1e85-4c2a-bcc2-a8199dca247e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:59.146576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20e893-1e85-4c2a-bcc2-a8199dca247e admin admin] PATH_INFO: `/v3/users/6533ec85d2fc48d9925a88e3bbeed380` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:59.148487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20e893-1e85-4c2a-bcc2-a8199dca247e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6533ec85d2fc48d9925a88e3bbeed380)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:59.151235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20e893-1e85-4c2a-bcc2-a8199dca247e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:59.234655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4924071-16ca-47d1-ae22-ec148af47f6e service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:34:59.236156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b4924071-16ca-47d1-ae22-ec148af47f6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:59.253670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4924071-16ca-47d1-ae22-ec148af47f6e service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:34:59.260409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597b819-0f59-4ffd-803a-31df5a9dcd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:34:59.261287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597b819-0f59-4ffd-803a-31df5a9dcd81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:59.261572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597b819-0f59-4ffd-803a-31df5a9dcd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:59.261852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597b819-0f59-4ffd-803a-31df5a9dcd81 admin admin] PATH_INFO: `/v3/projects/b6d9739f299747a490842a33c20b6222` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:59.263105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597b819-0f59-4ffd-803a-31df5a9dcd81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6d9739f299747a490842a33c20b6222)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:34:59.265537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597b819-0f59-4ffd-803a-31df5a9dcd81 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:34:59.483199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0f20e893-1e85-4c2a-bcc2-a8199dca247e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6533ec85d2fc48d9925a88e3bbeed380'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:59.488779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9597b819-0f59-4ffd-803a-31df5a9dcd81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6d9739f299747a490842a33c20b6222', 'request_id': 'req-9597b819-0f59-4ffd-803a-31df5a9dcd81'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:59.519950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9597b819-0f59-4ffd-803a-31df5a9dcd81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6d9739f299747a490842a33c20b6222', 'request_id': 'req-9597b819-0f59-4ffd-803a-31df5a9dcd81'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:59.534256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0f20e893-1e85-4c2a-bcc2-a8199dca247e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6533ec85d2fc48d9925a88e3bbeed380'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:59.536018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9597b819-0f59-4ffd-803a-31df5a9dcd81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6d9739f299747a490842a33c20b6222', 'request_id': 'req-9597b819-0f59-4ffd-803a-31df5a9dcd81'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:59.700299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0f20e893-1e85-4c2a-bcc2-a8199dca247e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6533ec85d2fc48d9925a88e3bbeed380'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:59.715640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0f20e893-1e85-4c2a-bcc2-a8199dca247e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6533ec85d2fc48d9925a88e3bbeed380'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:59.716234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0f20e893-1e85-4c2a-bcc2-a8199dca247e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6533ec85d2fc48d9925a88e3bbeed380'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:59.727629 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3305/6671] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:34:59 2022] DELETE /identity/v3/users/6533ec85d2fc48d9925a88e3bbeed380 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:34:59.736788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a81593-a4d1-4a23-a35d-08dd972f8d8d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:59.737098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a81593-a4d1-4a23-a35d-08dd972f8d8d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:59.737409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a81593-a4d1-4a23-a35d-08dd972f8d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:59.774352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-23a81593-a4d1-4a23-a35d-08dd972f8d8d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:59.775671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-23a81593-a4d1-4a23-a35d-08dd972f8d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:59.822505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9597b819-0f59-4ffd-803a-31df5a9dcd81 admin admin] The token cache is being invalidate because project b6d9739f299747a490842a33c20b6222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:34:59.822805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9597b819-0f59-4ffd-803a-31df5a9dcd81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:59.824292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9597b819-0f59-4ffd-803a-31df5a9dcd81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:34:59.825483 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3367/6672] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:34:59 2022] DELETE /identity/v3/projects/b6d9739f299747a490842a33c20b6222 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:34:59.831097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfec191-5fef-4350-8f10-0d01e07d0706 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:34:59.831378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfec191-5fef-4350-8f10-0d01e07d0706 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:34:59.839696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfec191-5fef-4350-8f10-0d01e07d0706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:34:59.904619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:34:59.912187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-bbfec191-5fef-4350-8f10-0d01e07d0706 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:34:59.913226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bbfec191-5fef-4350-8f10-0d01e07d0706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:34:59.965824 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3306/6673] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:00.083891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a81593-a4d1-4a23-a35d-08dd972f8d8d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:00.083891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-23a81593-a4d1-4a23-a35d-08dd972f8d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:00.084290 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3368/6674] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:35:00.084290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec3cd6-5a91-4e01-91bb-404a2b1103d0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:00.084290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec3cd6-5a91-4e01-91bb-404a2b1103d0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:00.084290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec3cd6-5a91-4e01-91bb-404a2b1103d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:00.102174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4eec3cd6-5a91-4e01-91bb-404a2b1103d0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:00.106733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4eec3cd6-5a91-4e01-91bb-404a2b1103d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:00.123536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a81593-a4d1-4a23-a35d-08dd972f8d8d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:00.125132 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3369/6675] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:00.129908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec3cd6-5a91-4e01-91bb-404a2b1103d0 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:00.132877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb325e6-9507-44a9-9396-8c1932b7362a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:00.134391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb325e6-9507-44a9-9396-8c1932b7362a service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:00.136122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb325e6-9507-44a9-9396-8c1932b7362a service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:00.136676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb325e6-9507-44a9-9396-8c1932b7362a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:00.144817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec3cd6-5a91-4e01-91bb-404a2b1103d0 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:00.160673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb325e6-9507-44a9-9396-8c1932b7362a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:00.162342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb325e6-9507-44a9-9396-8c1932b7362a service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:00.165689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a500f-86d4-4d39-a8a7-765a58f900bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:00.166570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a500f-86d4-4d39-a8a7-765a58f900bd admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:00.166940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a500f-86d4-4d39-a8a7-765a58f900bd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:00.167283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a500f-86d4-4d39-a8a7-765a58f900bd admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:00.170365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a500f-86d4-4d39-a8a7-765a58f900bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:35:00.170722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a500f-86d4-4d39-a8a7-765a58f900bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:00.174981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a500f-86d4-4d39-a8a7-765a58f900bd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:00.180254 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3307/6676] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:34:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:00.201452 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3370/6677] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:35:00.206985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb325e6-9507-44a9-9396-8c1932b7362a service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:00.222769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb325e6-9507-44a9-9396-8c1932b7362a service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:00.228791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f7d4c-bae4-47d1-a80c-563a45d47326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:00.230026 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f7d4c-bae4-47d1-a80c-563a45d47326 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:00.230529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f7d4c-bae4-47d1-a80c-563a45d47326 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:00.231209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f7d4c-bae4-47d1-a80c-563a45d47326 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:00.232168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f7d4c-bae4-47d1-a80c-563a45d47326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:00.234435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f7d4c-bae4-47d1-a80c-563a45d47326 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:00.366850 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3308/6678] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:35:00 2022] POST /identity/v3/projects => generated 363 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:35:00.369638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a500f-86d4-4d39-a8a7-765a58f900bd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:00.389763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a500f-86d4-4d39-a8a7-765a58f900bd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:00.616626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c319b34-1fde-4308-87d6-46f8b7a9baa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:00.617368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c319b34-1fde-4308-87d6-46f8b7a9baa2 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:00.617686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c319b34-1fde-4308-87d6-46f8b7a9baa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:00.618462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c319b34-1fde-4308-87d6-46f8b7a9baa2 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:00.618752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c319b34-1fde-4308-87d6-46f8b7a9baa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:00.629148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c319b34-1fde-4308-87d6-46f8b7a9baa2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:00.645305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:00.764695 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3371/6679] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:35:00 2022] POST /identity/v3/users => generated 282 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:35:00.769305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f7d4c-bae4-47d1-a80c-563a45d47326 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:00.788759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f7d4c-bae4-47d1-a80c-563a45d47326 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:00.798896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6bef5-cd8b-4e21-8c64-f1f0d1aaafd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:00.803388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6bef5-cd8b-4e21-8c64-f1f0d1aaafd3 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:00.803924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6bef5-cd8b-4e21-8c64-f1f0d1aaafd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:00.804380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6bef5-cd8b-4e21-8c64-f1f0d1aaafd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:00.805550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6bef5-cd8b-4e21-8c64-f1f0d1aaafd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:00.807956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6bef5-cd8b-4e21-8c64-f1f0d1aaafd3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:00.841893 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3309/6680] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:00.845739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c319b34-1fde-4308-87d6-46f8b7a9baa2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:00.883241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c319b34-1fde-4308-87d6-46f8b7a9baa2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:00.912200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56cde2-ae1e-4f68-9027-8b092a17252f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:00.916990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56cde2-ae1e-4f68-9027-8b092a17252f admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:00.917468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56cde2-ae1e-4f68-9027-8b092a17252f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:00.919651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56cde2-ae1e-4f68-9027-8b092a17252f admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:00.920680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56cde2-ae1e-4f68-9027-8b092a17252f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:00.929019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56cde2-ae1e-4f68-9027-8b092a17252f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:00.959343 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3372/6681] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:00.963428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6bef5-cd8b-4e21-8c64-f1f0d1aaafd3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:00.976507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6bef5-cd8b-4e21-8c64-f1f0d1aaafd3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:00.984677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c58456-0fd6-40f6-8b83-cce5c6a5d6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:00.986137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c58456-0fd6-40f6-8b83-cce5c6a5d6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:00.986589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c58456-0fd6-40f6-8b83-cce5c6a5d6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:00.987087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c58456-0fd6-40f6-8b83-cce5c6a5d6d7 admin admin] PATH_INFO: `/v3/projects/fcc32d1f1c894e2f8207fbebe1d6c71c/users/da9c5eb730564c47965b28ffddfeeacc/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:01.019238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c58456-0fd6-40f6-8b83-cce5c6a5d6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcc32d1f1c894e2f8207fbebe1d6c71c, user_id=da9c5eb730564c47965b28ffddfeeacc, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:01.025463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c58456-0fd6-40f6-8b83-cce5c6a5d6d7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:01.139140 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3310/6682] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:35:00 2022] PUT /identity/v3/projects/fcc32d1f1c894e2f8207fbebe1d6c71c/users/da9c5eb730564c47965b28ffddfeeacc/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:35:01.151867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dee52-2426-41a6-9a06-2c37482eefed None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:01.152161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dee52-2426-41a6-9a06-2c37482eefed None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:01.152445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dee52-2426-41a6-9a06-2c37482eefed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:01.224018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-319dee52-2426-41a6-9a06-2c37482eefed None None] MFA Rules not processed for user `da9c5eb730564c47965b28ffddfeeacc`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:01.225964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-319dee52-2426-41a6-9a06-2c37482eefed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:01.381117 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3373/6683] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:01 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:01.385787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c58456-0fd6-40f6-8b83-cce5c6a5d6d7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:01.402548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dee52-2426-41a6-9a06-2c37482eefed None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:01.405322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-319dee52-2426-41a6-9a06-2c37482eefed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:01.534136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c58456-0fd6-40f6-8b83-cce5c6a5d6d7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:01.550365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dee52-2426-41a6-9a06-2c37482eefed None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:01.552250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f4d6b-a15a-4a4d-aaf9-14100d8777f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:01.555217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f4d6b-a15a-4a4d-aaf9-14100d8777f0 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:01.555519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f4d6b-a15a-4a4d-aaf9-14100d8777f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:01.555880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f4d6b-a15a-4a4d-aaf9-14100d8777f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:01.556598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f4d6b-a15a-4a4d-aaf9-14100d8777f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:01.563262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77470d5-090c-42c2-a6c9-bd06860fbb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:01.564161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77470d5-090c-42c2-a6c9-bd06860fbb89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:01.567900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77470d5-090c-42c2-a6c9-bd06860fbb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:01.567900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77470d5-090c-42c2-a6c9-bd06860fbb89 admin admin] PATH_INFO: `/v3/projects/9b06d64221ed42c5ae21cdae5223f4c1` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:01.568142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f4d6b-a15a-4a4d-aaf9-14100d8777f0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:01.569068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77470d5-090c-42c2-a6c9-bd06860fbb89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b06d64221ed42c5ae21cdae5223f4c1)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:01.573302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77470d5-090c-42c2-a6c9-bd06860fbb89 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:01.715451 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3311/6684] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:35:01 2022] POST /identity/v3/projects => generated 365 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:35:01.719436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f4d6b-a15a-4a4d-aaf9-14100d8777f0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:01.870827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b77470d5-090c-42c2-a6c9-bd06860fbb89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b06d64221ed42c5ae21cdae5223f4c1', 'request_id': 'req-b77470d5-090c-42c2-a6c9-bd06860fbb89'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:01.905527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b77470d5-090c-42c2-a6c9-bd06860fbb89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b06d64221ed42c5ae21cdae5223f4c1', 'request_id': 'req-b77470d5-090c-42c2-a6c9-bd06860fbb89'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:01.926958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b77470d5-090c-42c2-a6c9-bd06860fbb89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b06d64221ed42c5ae21cdae5223f4c1', 'request_id': 'req-b77470d5-090c-42c2-a6c9-bd06860fbb89'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:01.988660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f4d6b-a15a-4a4d-aaf9-14100d8777f0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:02.090110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b77470d5-090c-42c2-a6c9-bd06860fbb89 admin admin] The token cache is being invalidate because project 9b06d64221ed42c5ae21cdae5223f4c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:35:02.094998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b77470d5-090c-42c2-a6c9-bd06860fbb89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:02.094998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b77470d5-090c-42c2-a6c9-bd06860fbb89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:02.094998 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3374/6685] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:35:01 2022] DELETE /identity/v3/projects/9b06d64221ed42c5ae21cdae5223f4c1 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:35:02.097929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77470d5-090c-42c2-a6c9-bd06860fbb89 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:02.100309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b77470d5-090c-42c2-a6c9-bd06860fbb89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:02.161863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cf1d1-4a99-4cc7-9327-fd860836d982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:02.161863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cf1d1-4a99-4cc7-9327-fd860836d982 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:02.161863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cf1d1-4a99-4cc7-9327-fd860836d982 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:02.161863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cf1d1-4a99-4cc7-9327-fd860836d982 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:02.162747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cf1d1-4a99-4cc7-9327-fd860836d982 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:02.163380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cf1d1-4a99-4cc7-9327-fd860836d982 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:02.291619 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3312/6686] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:35:01 2022] POST /identity/v3/users => generated 289 bytes in 572 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:35:02.297347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cf1d1-4a99-4cc7-9327-fd860836d982 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:02.300054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-572cf1d1-4a99-4cc7-9327-fd860836d982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:02.306902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77470d5-090c-42c2-a6c9-bd06860fbb89 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:02.322755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cf1d1-4a99-4cc7-9327-fd860836d982 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:02.332613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07c8b4-c887-4a53-9b72-ccc24e925b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:02.334150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07c8b4-c887-4a53-9b72-ccc24e925b6b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:02.334150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07c8b4-c887-4a53-9b72-ccc24e925b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:02.334855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07c8b4-c887-4a53-9b72-ccc24e925b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:02.335872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07c8b4-c887-4a53-9b72-ccc24e925b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:02.337744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07c8b4-c887-4a53-9b72-ccc24e925b6b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:02.377341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898067c-8deb-40fc-8e74-e8ed70205fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:02.381968 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3313/6687] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:02.383342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898067c-8deb-40fc-8e74-e8ed70205fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:02.383891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898067c-8deb-40fc-8e74-e8ed70205fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:02.383891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898067c-8deb-40fc-8e74-e8ed70205fd8 admin admin] PATH_INFO: `/v3/users/e1dc4bacde5b42da8a5a52fde372f890` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:02.389596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07c8b4-c887-4a53-9b72-ccc24e925b6b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:02.402275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898067c-8deb-40fc-8e74-e8ed70205fd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1dc4bacde5b42da8a5a52fde372f890)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:02.407904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898067c-8deb-40fc-8e74-e8ed70205fd8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:02.417110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07c8b4-c887-4a53-9b72-ccc24e925b6b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:02.433789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e61fe4-77ea-46b2-bf44-0ce9bd1f35b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:02.435855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e61fe4-77ea-46b2-bf44-0ce9bd1f35b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:02.436579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e61fe4-77ea-46b2-bf44-0ce9bd1f35b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:02.437271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e61fe4-77ea-46b2-bf44-0ce9bd1f35b6 admin admin] PATH_INFO: `/v3/projects/cf716f2078704e16ab1bdf7d00335841/users/61af9d10e43846529a162cbf49512d0c/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:02.478421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e61fe4-77ea-46b2-bf44-0ce9bd1f35b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf716f2078704e16ab1bdf7d00335841, user_id=61af9d10e43846529a162cbf49512d0c, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:02.483036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e61fe4-77ea-46b2-bf44-0ce9bd1f35b6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:02.602079 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3314/6688] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:35:02 2022] PUT /identity/v3/projects/cf716f2078704e16ab1bdf7d00335841/users/61af9d10e43846529a162cbf49512d0c/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:35:02.609288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e61fe4-77ea-46b2-bf44-0ce9bd1f35b6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:02.665590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:02.741971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b898067c-8deb-40fc-8e74-e8ed70205fd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1dc4bacde5b42da8a5a52fde372f890'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:02.766642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b898067c-8deb-40fc-8e74-e8ed70205fd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1dc4bacde5b42da8a5a52fde372f890'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:02.840802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b898067c-8deb-40fc-8e74-e8ed70205fd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1dc4bacde5b42da8a5a52fde372f890'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:02.842596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b898067c-8deb-40fc-8e74-e8ed70205fd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1dc4bacde5b42da8a5a52fde372f890'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:02.845492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e61fe4-77ea-46b2-bf44-0ce9bd1f35b6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:02.860379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbbee7-962f-48da-97ee-c95fb3128a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:02.861522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbbee7-962f-48da-97ee-c95fb3128a0f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:02.862005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbbee7-962f-48da-97ee-c95fb3128a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:02.863308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbbee7-962f-48da-97ee-c95fb3128a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:02.864212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbbee7-962f-48da-97ee-c95fb3128a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:02.870427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:02.872361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbbee7-962f-48da-97ee-c95fb3128a0f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:02.897524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b898067c-8deb-40fc-8e74-e8ed70205fd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1dc4bacde5b42da8a5a52fde372f890'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:02.916812 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3315/6689] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:02.918105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbbee7-962f-48da-97ee-c95fb3128a0f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:02.918816 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3375/6690] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:35:02 2022] DELETE /identity/v3/users/e1dc4bacde5b42da8a5a52fde372f890 => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:02.929271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-75fbbee7-962f-48da-97ee-c95fb3128a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:03.001159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbbee7-962f-48da-97ee-c95fb3128a0f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:03.145950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd7f5f-6782-4302-9def-e7cb9be5cad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:03.148958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd7f5f-6782-4302-9def-e7cb9be5cad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:03.149689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd7f5f-6782-4302-9def-e7cb9be5cad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:03.150161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd7f5f-6782-4302-9def-e7cb9be5cad8 admin admin] PATH_INFO: `/v3/projects/cf716f2078704e16ab1bdf7d00335841/users/61af9d10e43846529a162cbf49512d0c/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:03.153725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd7f5f-6782-4302-9def-e7cb9be5cad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf716f2078704e16ab1bdf7d00335841, user_id=61af9d10e43846529a162cbf49512d0c, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:03.157583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd7f5f-6782-4302-9def-e7cb9be5cad8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:03.176673 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3316/6691] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:35:02 2022] PUT /identity/v3/projects/cf716f2078704e16ab1bdf7d00335841/users/61af9d10e43846529a162cbf49512d0c/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:03.187565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71829b17-13a4-4b09-9c05-5700ce82f36c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:03.188299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71829b17-13a4-4b09-9c05-5700ce82f36c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:03.189141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71829b17-13a4-4b09-9c05-5700ce82f36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:03.273206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-71829b17-13a4-4b09-9c05-5700ce82f36c None None] MFA Rules not processed for user `61af9d10e43846529a162cbf49512d0c`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:03.277006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-71829b17-13a4-4b09-9c05-5700ce82f36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:03.466471 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3376/6692] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:03.492725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd7f5f-6782-4302-9def-e7cb9be5cad8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:03.492725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cbcd7f5f-6782-4302-9def-e7cb9be5cad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:03.685073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71829b17-13a4-4b09-9c05-5700ce82f36c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:03.687406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-71829b17-13a4-4b09-9c05-5700ce82f36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:03.787150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd7f5f-6782-4302-9def-e7cb9be5cad8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:03.800305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ebdbd-cb0b-469f-8102-762d6ea72e47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:03.804021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ebdbd-cb0b-469f-8102-762d6ea72e47 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:03.804021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ebdbd-cb0b-469f-8102-762d6ea72e47 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:03.804021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ebdbd-cb0b-469f-8102-762d6ea72e47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:03.832605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ebdbd-cb0b-469f-8102-762d6ea72e47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:03.838491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ebdbd-cb0b-469f-8102-762d6ea72e47 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:03.888519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71829b17-13a4-4b09-9c05-5700ce82f36c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:03.894416 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3317/6693] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:03 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:03.921715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4afee5-9ecb-49a4-a36c-10f94618e4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:03.930223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4afee5-9ecb-49a4-a36c-10f94618e4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:03.930446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4afee5-9ecb-49a4-a36c-10f94618e4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:03.932655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4afee5-9ecb-49a4-a36c-10f94618e4b3 admin admin] PATH_INFO: `/v3/projects/4d251f10a63c476ca0d0e226ed1d9d8f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:03.939964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4afee5-9ecb-49a4-a36c-10f94618e4b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d251f10a63c476ca0d0e226ed1d9d8f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:03.939964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4afee5-9ecb-49a4-a36c-10f94618e4b3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:04.137485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:04.157571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2e4afee5-9ecb-49a4-a36c-10f94618e4b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d251f10a63c476ca0d0e226ed1d9d8f', 'request_id': 'req-2e4afee5-9ecb-49a4-a36c-10f94618e4b3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:04.175535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2e4afee5-9ecb-49a4-a36c-10f94618e4b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d251f10a63c476ca0d0e226ed1d9d8f', 'request_id': 'req-2e4afee5-9ecb-49a4-a36c-10f94618e4b3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:04.188954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2e4afee5-9ecb-49a4-a36c-10f94618e4b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d251f10a63c476ca0d0e226ed1d9d8f', 'request_id': 'req-2e4afee5-9ecb-49a4-a36c-10f94618e4b3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:04.227460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ebdbd-cb0b-469f-8102-762d6ea72e47 service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:04.240303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ebdbd-cb0b-469f-8102-762d6ea72e47 service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:04.266312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2e4afee5-9ecb-49a4-a36c-10f94618e4b3 admin admin] The token cache is being invalidate because project 4d251f10a63c476ca0d0e226ed1d9d8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:35:04.266929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2e4afee5-9ecb-49a4-a36c-10f94618e4b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:04.279318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2e4afee5-9ecb-49a4-a36c-10f94618e4b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:04.281355 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3377/6694] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:35:03 2022] DELETE /identity/v3/projects/4d251f10a63c476ca0d0e226ed1d9d8f => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:35:04.294738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ac0d0-420f-4a7c-8343-608c1e0edb24 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:04.298644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ac0d0-420f-4a7c-8343-608c1e0edb24 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:04.298930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ac0d0-420f-4a7c-8343-608c1e0edb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:04.384164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ad1ac0d0-420f-4a7c-8343-608c1e0edb24 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:04.386722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ad1ac0d0-420f-4a7c-8343-608c1e0edb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:04.431216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f37f9-6f99-449b-81bc-5804d87297db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:04.432585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f37f9-6f99-449b-81bc-5804d87297db service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:04.432877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f37f9-6f99-449b-81bc-5804d87297db service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:04.433154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f37f9-6f99-449b-81bc-5804d87297db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:04.435882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-411f37f9-6f99-449b-81bc-5804d87297db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:04.520905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f37f9-6f99-449b-81bc-5804d87297db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:04.522686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f37f9-6f99-449b-81bc-5804d87297db service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:04.549967 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3318/6695] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:04 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:35:04.569222 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3378/6696] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:04.569713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aca55f-e8ed-4b80-983c-eabacec5f2a7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:04.569713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aca55f-e8ed-4b80-983c-eabacec5f2a7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:04.569713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aca55f-e8ed-4b80-983c-eabacec5f2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:04.608223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-30aca55f-e8ed-4b80-983c-eabacec5f2a7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:04.612169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-30aca55f-e8ed-4b80-983c-eabacec5f2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:04.637104 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3319/6697] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:04.638140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ac0d0-420f-4a7c-8343-608c1e0edb24 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:04.652688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ac0d0-420f-4a7c-8343-608c1e0edb24 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:04.678370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3326184-20c7-46c4-b8b5-25d132513ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:04.680948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3326184-20c7-46c4-b8b5-25d132513ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:04.682812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3326184-20c7-46c4-b8b5-25d132513ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:04.685422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3326184-20c7-46c4-b8b5-25d132513ca9 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:04.686470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3326184-20c7-46c4-b8b5-25d132513ca9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:35:04.689392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3326184-20c7-46c4-b8b5-25d132513ca9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:04.693638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3326184-20c7-46c4-b8b5-25d132513ca9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:04.735212 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3379/6698] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:35:04.736531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aca55f-e8ed-4b80-983c-eabacec5f2a7 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:04.755614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aca55f-e8ed-4b80-983c-eabacec5f2a7 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:04.762014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047678cc-0a0c-43ae-a1a9-5e8d33ad2eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:04.762800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047678cc-0a0c-43ae-a1a9-5e8d33ad2eaa admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:04.763233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047678cc-0a0c-43ae-a1a9-5e8d33ad2eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:04.763617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047678cc-0a0c-43ae-a1a9-5e8d33ad2eaa admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:04.764427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047678cc-0a0c-43ae-a1a9-5e8d33ad2eaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:04.766468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047678cc-0a0c-43ae-a1a9-5e8d33ad2eaa admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:04.806558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:04.911668 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3320/6699] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:35:04 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:35:04.915210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3326184-20c7-46c4-b8b5-25d132513ca9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:04.928921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3326184-20c7-46c4-b8b5-25d132513ca9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:05.105809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f97264-0a71-419d-9903-83f088906a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:05.109299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f97264-0a71-419d-9903-83f088906a3a admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:05.109299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f97264-0a71-419d-9903-83f088906a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:05.109299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f97264-0a71-419d-9903-83f088906a3a admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:05.109299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f97264-0a71-419d-9903-83f088906a3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:05.111476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f97264-0a71-419d-9903-83f088906a3a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:05.235771 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3380/6700] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:35:04 2022] POST /identity/v3/users => generated 292 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:35:05.239843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047678cc-0a0c-43ae-a1a9-5e8d33ad2eaa admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:05.252740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047678cc-0a0c-43ae-a1a9-5e8d33ad2eaa admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:05.275573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1353361-333e-4339-b4b5-1da229de4f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:05.276433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1353361-333e-4339-b4b5-1da229de4f3e admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:05.277419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1353361-333e-4339-b4b5-1da229de4f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:05.278049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1353361-333e-4339-b4b5-1da229de4f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:05.279056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1353361-333e-4339-b4b5-1da229de4f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:05.283504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1353361-333e-4339-b4b5-1da229de4f3e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:05.304709 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3321/6701] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:05.309216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f97264-0a71-419d-9903-83f088906a3a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:05.317931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:05.326969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f97264-0a71-419d-9903-83f088906a3a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:05.333901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ff23a-7fab-4e50-9a31-354bbe9401ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:05.335355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ff23a-7fab-4e50-9a31-354bbe9401ce admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:05.336436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ff23a-7fab-4e50-9a31-354bbe9401ce admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:05.336966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ff23a-7fab-4e50-9a31-354bbe9401ce admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:05.338044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ff23a-7fab-4e50-9a31-354bbe9401ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:05.340131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ff23a-7fab-4e50-9a31-354bbe9401ce admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:05.359976 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3381/6702] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:35:05.361447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1353361-333e-4339-b4b5-1da229de4f3e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:05.374451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1353361-333e-4339-b4b5-1da229de4f3e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:05.383838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e8d0d-00ec-4c6e-95ef-6117285cc1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:05.385444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e8d0d-00ec-4c6e-95ef-6117285cc1b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:05.386112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e8d0d-00ec-4c6e-95ef-6117285cc1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:05.387210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e8d0d-00ec-4c6e-95ef-6117285cc1b4 admin admin] PATH_INFO: `/v3/projects/1a73639b88974ba3ae4e94485cc0beac/users/45b11273f4554199a70c95c3ef68ebb6/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:05.412194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e8d0d-00ec-4c6e-95ef-6117285cc1b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a73639b88974ba3ae4e94485cc0beac, user_id=45b11273f4554199a70c95c3ef68ebb6, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:05.417241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e8d0d-00ec-4c6e-95ef-6117285cc1b4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:05.591235 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3322/6703] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:35:05 2022] PUT /identity/v3/projects/1a73639b88974ba3ae4e94485cc0beac/users/45b11273f4554199a70c95c3ef68ebb6/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:05.602279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4c014-b443-41e9-a26a-c949df88ae11 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:05.602836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4c014-b443-41e9-a26a-c949df88ae11 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:05.602947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4c014-b443-41e9-a26a-c949df88ae11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:05.648096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-42f4c014-b443-41e9-a26a-c949df88ae11 None None] MFA Rules not processed for user `45b11273f4554199a70c95c3ef68ebb6`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:05.653777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-42f4c014-b443-41e9-a26a-c949df88ae11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:05.783236 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3382/6704] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:05.791346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e8d0d-00ec-4c6e-95ef-6117285cc1b4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:05.794952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-191e8d0d-00ec-4c6e-95ef-6117285cc1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:05.987927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e8d0d-00ec-4c6e-95ef-6117285cc1b4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:06.000151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711de0b-9f68-44f5-97b7-754e7baae5ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:06.001275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711de0b-9f68-44f5-97b7-754e7baae5ab service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:06.002456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711de0b-9f68-44f5-97b7-754e7baae5ab service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:06.002925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711de0b-9f68-44f5-97b7-754e7baae5ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:06.013958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711de0b-9f68-44f5-97b7-754e7baae5ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:06.016186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711de0b-9f68-44f5-97b7-754e7baae5ab service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:06.037310 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3323/6705] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:06.519918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4c014-b443-41e9-a26a-c949df88ae11 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:06.521478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-42f4c014-b443-41e9-a26a-c949df88ae11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:06.652700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4c014-b443-41e9-a26a-c949df88ae11 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:06.664255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bae1d-d971-4065-90b7-2bce5e3b3dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:06.664989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bae1d-d971-4065-90b7-2bce5e3b3dba service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:06.665297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bae1d-d971-4065-90b7-2bce5e3b3dba service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:06.665618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bae1d-d971-4065-90b7-2bce5e3b3dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:06.667884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-865bae1d-d971-4065-90b7-2bce5e3b3dba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:06.746594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bae1d-d971-4065-90b7-2bce5e3b3dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:06.749528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bae1d-d971-4065-90b7-2bce5e3b3dba service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:06.764636 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3383/6706] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:07.732391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:10.517598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:10.927380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9095d81-0619-4b94-831a-5dc396dba71d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:10.928537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9095d81-0619-4b94-831a-5dc396dba71d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:10.929038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9095d81-0619-4b94-831a-5dc396dba71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:10.951780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c9095d81-0619-4b94-831a-5dc396dba71d None None] MFA Rules not processed for user `726b46c54e9541fbb7825607bac3abe5`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:10.953006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c9095d81-0619-4b94-831a-5dc396dba71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:11.025441 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3324/6707] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:11.035896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ea35d-0563-4214-a90f-8cb05498789a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:11.036569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ea35d-0563-4214-a90f-8cb05498789a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:11.036850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ea35d-0563-4214-a90f-8cb05498789a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:11.059273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7d6ea35d-0563-4214-a90f-8cb05498789a None None] MFA Rules not processed for user `726b46c54e9541fbb7825607bac3abe5`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:11.060536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7d6ea35d-0563-4214-a90f-8cb05498789a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:11.073878 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3384/6708] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:12.452923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9095d81-0619-4b94-831a-5dc396dba71d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:12.456949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c9095d81-0619-4b94-831a-5dc396dba71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:12.721473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9095d81-0619-4b94-831a-5dc396dba71d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:12.721473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cb814-aeb1-49ab-a2ad-572688187a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:12.721473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cb814-aeb1-49ab-a2ad-572688187a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:12.721473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cb814-aeb1-49ab-a2ad-572688187a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:12.728602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cb814-aeb1-49ab-a2ad-572688187a69 admin admin] PATH_INFO: `/v3/users/ad24348a693d463d9cfa086c93273b2f` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:12.728602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4cb814-aeb1-49ab-a2ad-572688187a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad24348a693d463d9cfa086c93273b2f)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:12.728602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4cb814-aeb1-49ab-a2ad-572688187a69 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:12.728602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:12.737629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5a4cb814-aeb1-49ab-a2ad-572688187a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad24348a693d463d9cfa086c93273b2f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:12.760047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5a4cb814-aeb1-49ab-a2ad-572688187a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad24348a693d463d9cfa086c93273b2f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:12.869531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5a4cb814-aeb1-49ab-a2ad-572688187a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad24348a693d463d9cfa086c93273b2f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:12.880857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5a4cb814-aeb1-49ab-a2ad-572688187a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad24348a693d463d9cfa086c93273b2f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:12.881877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5a4cb814-aeb1-49ab-a2ad-572688187a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad24348a693d463d9cfa086c93273b2f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:12.888502 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3325/6709] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:35:12 2022] DELETE /identity/v3/users/ad24348a693d463d9cfa086c93273b2f => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:12.896165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34be83f-53c0-4332-8319-da5c16c4ebf0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:12.896672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34be83f-53c0-4332-8319-da5c16c4ebf0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:12.896751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34be83f-53c0-4332-8319-da5c16c4ebf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:12.938624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c34be83f-53c0-4332-8319-da5c16c4ebf0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:12.939923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c34be83f-53c0-4332-8319-da5c16c4ebf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:13.022117 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3385/6710] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:13.032610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cb814-aeb1-49ab-a2ad-572688187a69 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:13.037474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5a4cb814-aeb1-49ab-a2ad-572688187a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:13.113463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cb814-aeb1-49ab-a2ad-572688187a69 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:13.117274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea053b-1507-4db5-8d9e-9e3fedc7b497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:13.117941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea053b-1507-4db5-8d9e-9e3fedc7b497 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:13.118281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea053b-1507-4db5-8d9e-9e3fedc7b497 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:13.118660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea053b-1507-4db5-8d9e-9e3fedc7b497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:13.129097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea053b-1507-4db5-8d9e-9e3fedc7b497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:13.130547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea053b-1507-4db5-8d9e-9e3fedc7b497 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:13.141613 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3326/6711] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:13.460681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34be83f-53c0-4332-8319-da5c16c4ebf0 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:13.462340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c34be83f-53c0-4332-8319-da5c16c4ebf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:13.485967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34be83f-53c0-4332-8319-da5c16c4ebf0 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:13.493782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49ffe2-0626-4744-ba54-addbffbb58c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:13.494722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49ffe2-0626-4744-ba54-addbffbb58c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:13.495002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49ffe2-0626-4744-ba54-addbffbb58c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:13.495688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49ffe2-0626-4744-ba54-addbffbb58c4 admin admin] PATH_INFO: `/v3/projects/f2a1a477caa64bc199dd7b8e81942db8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:13.497296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49ffe2-0626-4744-ba54-addbffbb58c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2a1a477caa64bc199dd7b8e81942db8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:13.499263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49ffe2-0626-4744-ba54-addbffbb58c4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:13.697848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d49ffe2-0626-4744-ba54-addbffbb58c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2a1a477caa64bc199dd7b8e81942db8', 'request_id': 'req-3d49ffe2-0626-4744-ba54-addbffbb58c4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:13.708167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d49ffe2-0626-4744-ba54-addbffbb58c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2a1a477caa64bc199dd7b8e81942db8', 'request_id': 'req-3d49ffe2-0626-4744-ba54-addbffbb58c4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:13.716555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d49ffe2-0626-4744-ba54-addbffbb58c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2a1a477caa64bc199dd7b8e81942db8', 'request_id': 'req-3d49ffe2-0626-4744-ba54-addbffbb58c4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:13.823963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d49ffe2-0626-4744-ba54-addbffbb58c4 admin admin] The token cache is being invalidate because project f2a1a477caa64bc199dd7b8e81942db8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:35:13.823963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d49ffe2-0626-4744-ba54-addbffbb58c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:13.823963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d49ffe2-0626-4744-ba54-addbffbb58c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:13.823963 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3386/6712] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:35:13 2022] DELETE /identity/v3/projects/f2a1a477caa64bc199dd7b8e81942db8 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:13.833521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77827d58-16b5-45b4-b1a8-2095b76b4ba8 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:13.834002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77827d58-16b5-45b4-b1a8-2095b76b4ba8 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:13.834098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77827d58-16b5-45b4-b1a8-2095b76b4ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:13.852473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-77827d58-16b5-45b4-b1a8-2095b76b4ba8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:13.853688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-77827d58-16b5-45b4-b1a8-2095b76b4ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:13.927534 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3327/6713] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:35:13.930521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a582d-5d3c-4bf1-8ca1-fe3ab4833f4e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:13.930974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a582d-5d3c-4bf1-8ca1-fe3ab4833f4e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:13.931321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a582d-5d3c-4bf1-8ca1-fe3ab4833f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:13.952861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-dd3a582d-5d3c-4bf1-8ca1-fe3ab4833f4e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:13.954100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dd3a582d-5d3c-4bf1-8ca1-fe3ab4833f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:13.963270 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3387/6714] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:13.967631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77827d58-16b5-45b4-b1a8-2095b76b4ba8 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:13.978341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77827d58-16b5-45b4-b1a8-2095b76b4ba8 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:13.983608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be925abb-f8ff-4f26-a211-f13ac8365964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:13.984301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be925abb-f8ff-4f26-a211-f13ac8365964 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:13.984591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be925abb-f8ff-4f26-a211-f13ac8365964 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:13.984859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be925abb-f8ff-4f26-a211-f13ac8365964 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:13.985614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be925abb-f8ff-4f26-a211-f13ac8365964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:35:13.986186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be925abb-f8ff-4f26-a211-f13ac8365964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:13.988239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be925abb-f8ff-4f26-a211-f13ac8365964 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:14.002850 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3328/6715] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:35:14.006800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a582d-5d3c-4bf1-8ca1-fe3ab4833f4e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:14.016562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a582d-5d3c-4bf1-8ca1-fe3ab4833f4e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:14.024365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb709d75-88ff-401d-bce4-60edb478d0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:14.029311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb709d75-88ff-401d-bce4-60edb478d0d9 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:14.029311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb709d75-88ff-401d-bce4-60edb478d0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:14.029311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb709d75-88ff-401d-bce4-60edb478d0d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:14.029311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb709d75-88ff-401d-bce4-60edb478d0d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:14.029311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb709d75-88ff-401d-bce4-60edb478d0d9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:14.156674 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3388/6716] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:35:14 2022] POST /identity/v3/projects => generated 357 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:35:14.161299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be925abb-f8ff-4f26-a211-f13ac8365964 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:14.173443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be925abb-f8ff-4f26-a211-f13ac8365964 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:14.251429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:14.276379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e93c75-cf4a-4357-9f87-d9e99539d1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:14.276744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e93c75-cf4a-4357-9f87-d9e99539d1ac admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:14.276962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e93c75-cf4a-4357-9f87-d9e99539d1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:14.277261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e93c75-cf4a-4357-9f87-d9e99539d1ac admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:14.277931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e93c75-cf4a-4357-9f87-d9e99539d1ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:14.279988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e93c75-cf4a-4357-9f87-d9e99539d1ac admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:14.393007 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3329/6717] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:35:14 2022] POST /identity/v3/users => generated 279 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:35:14.396975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb709d75-88ff-401d-bce4-60edb478d0d9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:14.410947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb709d75-88ff-401d-bce4-60edb478d0d9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:14.416692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7ee35-e423-476e-abf3-6b8e6b221077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:14.417600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7ee35-e423-476e-abf3-6b8e6b221077 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:14.421371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7ee35-e423-476e-abf3-6b8e6b221077 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:14.421371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7ee35-e423-476e-abf3-6b8e6b221077 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:14.421371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7ee35-e423-476e-abf3-6b8e6b221077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:14.421371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7ee35-e423-476e-abf3-6b8e6b221077 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:14.435588 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3389/6718] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:35:14.440469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e93c75-cf4a-4357-9f87-d9e99539d1ac admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:14.454635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e93c75-cf4a-4357-9f87-d9e99539d1ac admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:14.466409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae61b4-cbe2-4e89-a83a-bf2933e8b47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:14.467474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae61b4-cbe2-4e89-a83a-bf2933e8b47f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:14.468032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae61b4-cbe2-4e89-a83a-bf2933e8b47f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:14.468405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae61b4-cbe2-4e89-a83a-bf2933e8b47f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:14.469207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae61b4-cbe2-4e89-a83a-bf2933e8b47f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:14.471078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae61b4-cbe2-4e89-a83a-bf2933e8b47f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:14.483678 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3330/6719] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:14.488703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7ee35-e423-476e-abf3-6b8e6b221077 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:14.501622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7ee35-e423-476e-abf3-6b8e6b221077 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:14.507326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f56b2-8de2-457b-b5e0-97e64776d345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:14.508244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f56b2-8de2-457b-b5e0-97e64776d345 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:14.508500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f56b2-8de2-457b-b5e0-97e64776d345 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:14.508775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f56b2-8de2-457b-b5e0-97e64776d345 admin admin] PATH_INFO: `/v3/projects/64a78c2b045d4b57acf494f6af2a122c/users/22546f4823d2442c89e899c1980bea6a/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:14.530241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f56b2-8de2-457b-b5e0-97e64776d345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a78c2b045d4b57acf494f6af2a122c, user_id=22546f4823d2442c89e899c1980bea6a, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:14.533211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f56b2-8de2-457b-b5e0-97e64776d345 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:14.538417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:14.688536 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3390/6720] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:35:14 2022] PUT /identity/v3/projects/64a78c2b045d4b57acf494f6af2a122c/users/22546f4823d2442c89e899c1980bea6a/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:35:14.699800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eca975-1ede-4b3b-a64e-cfcd7b2f5684 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:14.700331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eca975-1ede-4b3b-a64e-cfcd7b2f5684 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:14.700711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eca975-1ede-4b3b-a64e-cfcd7b2f5684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:14.739257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b7eca975-1ede-4b3b-a64e-cfcd7b2f5684 None None] MFA Rules not processed for user `22546f4823d2442c89e899c1980bea6a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:14.740814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b7eca975-1ede-4b3b-a64e-cfcd7b2f5684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:14.846621 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3331/6721] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:14 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:14.857244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f56b2-8de2-457b-b5e0-97e64776d345 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:14.859070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3c3f56b2-8de2-457b-b5e0-97e64776d345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:14.950268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f56b2-8de2-457b-b5e0-97e64776d345 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:14.954464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b54098-3dbc-48ca-aa09-2fa240d9bf07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:14.955253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b54098-3dbc-48ca-aa09-2fa240d9bf07 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:14.955605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b54098-3dbc-48ca-aa09-2fa240d9bf07 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:14.956153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b54098-3dbc-48ca-aa09-2fa240d9bf07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:14.967339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eca975-1ede-4b3b-a64e-cfcd7b2f5684 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:14.967650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b54098-3dbc-48ca-aa09-2fa240d9bf07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:14.968818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b7eca975-1ede-4b3b-a64e-cfcd7b2f5684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:14.969261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b54098-3dbc-48ca-aa09-2fa240d9bf07 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:14.981656 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3391/6722] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:14 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:15.051386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eca975-1ede-4b3b-a64e-cfcd7b2f5684 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:15.056402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0d0d9-cd1c-4148-af86-404f4ad8d6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:15.057308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0d0d9-cd1c-4148-af86-404f4ad8d6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:15.057590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0d0d9-cd1c-4148-af86-404f4ad8d6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:15.057918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0d0d9-cd1c-4148-af86-404f4ad8d6a2 admin admin] PATH_INFO: `/v3/users/ca2c9e7e6d61414cbf2c7e17753bc0df` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:15.059189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0d0d9-cd1c-4148-af86-404f4ad8d6a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca2c9e7e6d61414cbf2c7e17753bc0df)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:15.061165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0d0d9-cd1c-4148-af86-404f4ad8d6a2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:15.341084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b3c0d0d9-cd1c-4148-af86-404f4ad8d6a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca2c9e7e6d61414cbf2c7e17753bc0df'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:15.358283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b3c0d0d9-cd1c-4148-af86-404f4ad8d6a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca2c9e7e6d61414cbf2c7e17753bc0df'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:15.465749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b3c0d0d9-cd1c-4148-af86-404f4ad8d6a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca2c9e7e6d61414cbf2c7e17753bc0df'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:15.474273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b3c0d0d9-cd1c-4148-af86-404f4ad8d6a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca2c9e7e6d61414cbf2c7e17753bc0df'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:15.474958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b3c0d0d9-cd1c-4148-af86-404f4ad8d6a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca2c9e7e6d61414cbf2c7e17753bc0df'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:15.481896 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3332/6723] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:35:14 2022] DELETE /identity/v3/users/ca2c9e7e6d61414cbf2c7e17753bc0df => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:35:15.602936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:15.861775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b54098-3dbc-48ca-aa09-2fa240d9bf07 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:15.876855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b54098-3dbc-48ca-aa09-2fa240d9bf07 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:15.961460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76547b-b579-461e-8119-168f98f79598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:15.962562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76547b-b579-461e-8119-168f98f79598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:15.962901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76547b-b579-461e-8119-168f98f79598 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:15.963384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76547b-b579-461e-8119-168f98f79598 admin admin] PATH_INFO: `/v3/projects/e451ee7bfd2d4ab58d30c33fef334b55` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:15.965086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76547b-b579-461e-8119-168f98f79598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e451ee7bfd2d4ab58d30c33fef334b55)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:15.968552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76547b-b579-461e-8119-168f98f79598 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:16.152684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bb76547b-b579-461e-8119-168f98f79598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e451ee7bfd2d4ab58d30c33fef334b55', 'request_id': 'req-bb76547b-b579-461e-8119-168f98f79598'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:16.166231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bb76547b-b579-461e-8119-168f98f79598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e451ee7bfd2d4ab58d30c33fef334b55', 'request_id': 'req-bb76547b-b579-461e-8119-168f98f79598'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:16.175723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bb76547b-b579-461e-8119-168f98f79598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e451ee7bfd2d4ab58d30c33fef334b55', 'request_id': 'req-bb76547b-b579-461e-8119-168f98f79598'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:16.269369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bb76547b-b579-461e-8119-168f98f79598 admin admin] The token cache is being invalidate because project e451ee7bfd2d4ab58d30c33fef334b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:35:16.269369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bb76547b-b579-461e-8119-168f98f79598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:16.269708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bb76547b-b579-461e-8119-168f98f79598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:16.278176 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3392/6724] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:35:15 2022] DELETE /identity/v3/projects/e451ee7bfd2d4ab58d30c33fef334b55 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:16.279508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efa788-b1ab-4346-9c5b-781b14c89b14 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:16.279942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efa788-b1ab-4346-9c5b-781b14c89b14 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:16.280106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efa788-b1ab-4346-9c5b-781b14c89b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:16.310500 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-58efa788-b1ab-4346-9c5b-781b14c89b14 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:16.312050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-58efa788-b1ab-4346-9c5b-781b14c89b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:16.394655 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3333/6725] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:35:16.402595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ead4b-4e02-4e1e-9691-bcb3d3e7562a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:16.402989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ead4b-4e02-4e1e-9691-bcb3d3e7562a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:16.404106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ead4b-4e02-4e1e-9691-bcb3d3e7562a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:16.426658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4d2ead4b-4e02-4e1e-9691-bcb3d3e7562a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:16.428121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4d2ead4b-4e02-4e1e-9691-bcb3d3e7562a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:16.480302 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3393/6726] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:16.483445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efa788-b1ab-4346-9c5b-781b14c89b14 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:16.495155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efa788-b1ab-4346-9c5b-781b14c89b14 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:16.500838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43609c-52e8-4586-884b-263ba71314f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:16.503074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43609c-52e8-4586-884b-263ba71314f0 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:16.503074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43609c-52e8-4586-884b-263ba71314f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:16.503074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43609c-52e8-4586-884b-263ba71314f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:16.503543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43609c-52e8-4586-884b-263ba71314f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:35:16.504138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43609c-52e8-4586-884b-263ba71314f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:16.505908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43609c-52e8-4586-884b-263ba71314f0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:16.519506 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3334/6727] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:35:16.529386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ead4b-4e02-4e1e-9691-bcb3d3e7562a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:16.541216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ead4b-4e02-4e1e-9691-bcb3d3e7562a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:16.546360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80614d9-8672-469b-91fe-c65e20df4345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:16.547047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80614d9-8672-469b-91fe-c65e20df4345 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:16.547338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80614d9-8672-469b-91fe-c65e20df4345 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:16.547617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80614d9-8672-469b-91fe-c65e20df4345 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:16.548321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80614d9-8672-469b-91fe-c65e20df4345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:16.551396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80614d9-8672-469b-91fe-c65e20df4345 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:16.655296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:16.663348 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3394/6728] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:35:16 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:35:16.667647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43609c-52e8-4586-884b-263ba71314f0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:16.679549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43609c-52e8-4586-884b-263ba71314f0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:16.765951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77348e18-3367-4215-8910-8df77244c07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:16.766642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77348e18-3367-4215-8910-8df77244c07d admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:16.766955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77348e18-3367-4215-8910-8df77244c07d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:16.767849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77348e18-3367-4215-8910-8df77244c07d admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:16.768615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77348e18-3367-4215-8910-8df77244c07d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:16.770965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77348e18-3367-4215-8910-8df77244c07d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:16.900299 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3335/6729] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:35:16 2022] POST /identity/v3/users => generated 291 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:35:16.904136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80614d9-8672-469b-91fe-c65e20df4345 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:16.923122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80614d9-8672-469b-91fe-c65e20df4345 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:16.942216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8fd76-370c-493d-befc-11cb1f740385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:16.944211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8fd76-370c-493d-befc-11cb1f740385 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:16.944655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8fd76-370c-493d-befc-11cb1f740385 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:16.946373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8fd76-370c-493d-befc-11cb1f740385 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:16.947988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8fd76-370c-493d-befc-11cb1f740385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:16.950874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8fd76-370c-493d-befc-11cb1f740385 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:16.971064 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3395/6730] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:16.974785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77348e18-3367-4215-8910-8df77244c07d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:17.000402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77348e18-3367-4215-8910-8df77244c07d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:17.006458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec295fb2-aaaf-4016-98e1-4d30dd879168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:17.008802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec295fb2-aaaf-4016-98e1-4d30dd879168 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:17.008985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec295fb2-aaaf-4016-98e1-4d30dd879168 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:17.009950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec295fb2-aaaf-4016-98e1-4d30dd879168 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:17.028322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec295fb2-aaaf-4016-98e1-4d30dd879168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:17.031238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec295fb2-aaaf-4016-98e1-4d30dd879168 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:17.079053 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3336/6731] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:17.081832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8fd76-370c-493d-befc-11cb1f740385 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:17.112947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8fd76-370c-493d-befc-11cb1f740385 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:17.119313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9b7d0-89e1-4d0a-b4da-3ef60cc1d7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:17.120222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9b7d0-89e1-4d0a-b4da-3ef60cc1d7b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:17.120743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec295fb2-aaaf-4016-98e1-4d30dd879168 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:17.121429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9b7d0-89e1-4d0a-b4da-3ef60cc1d7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:17.121850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9b7d0-89e1-4d0a-b4da-3ef60cc1d7b8 admin admin] PATH_INFO: `/v3/projects/e60c0863dc6f4313bdc873fda27ae2fc/users/0ab8b3f06e994bbca5d6dd14109bfe50/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:17.122955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ec295fb2-aaaf-4016-98e1-4d30dd879168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:17.144552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9b7d0-89e1-4d0a-b4da-3ef60cc1d7b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e60c0863dc6f4313bdc873fda27ae2fc, user_id=0ab8b3f06e994bbca5d6dd14109bfe50, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:17.149790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9b7d0-89e1-4d0a-b4da-3ef60cc1d7b8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:17.223786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec295fb2-aaaf-4016-98e1-4d30dd879168 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:17.229923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b076ae4-4d81-4a8b-9c6d-6639e15ab769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:17.230843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b076ae4-4d81-4a8b-9c6d-6639e15ab769 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:17.231321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b076ae4-4d81-4a8b-9c6d-6639e15ab769 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:17.231732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b076ae4-4d81-4a8b-9c6d-6639e15ab769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:17.235561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0b076ae4-4d81-4a8b-9c6d-6639e15ab769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:17.252814 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3396/6732] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:35:17 2022] PUT /identity/v3/projects/e60c0863dc6f4313bdc873fda27ae2fc/users/0ab8b3f06e994bbca5d6dd14109bfe50/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:17.256621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94835ba8-ffbb-4324-a860-5000b0057dfe None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:17.257231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94835ba8-ffbb-4324-a860-5000b0057dfe None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:17.260975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94835ba8-ffbb-4324-a860-5000b0057dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:17.279784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-94835ba8-ffbb-4324-a860-5000b0057dfe None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:17.282101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-94835ba8-ffbb-4324-a860-5000b0057dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:17.349309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b076ae4-4d81-4a8b-9c6d-6639e15ab769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:17.350847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b076ae4-4d81-4a8b-9c6d-6639e15ab769 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:17.361326 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3397/6733] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:17.367882 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3337/6734] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:35:17.374261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94835ba8-ffbb-4324-a860-5000b0057dfe None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:17.444025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:17.454616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94835ba8-ffbb-4324-a860-5000b0057dfe None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:17.468439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6675fa-57d1-48cd-bed9-4c218efb32da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:17.469561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6675fa-57d1-48cd-bed9-4c218efb32da service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:17.470677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6675fa-57d1-48cd-bed9-4c218efb32da service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:17.471890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6675fa-57d1-48cd-bed9-4c218efb32da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:17.498142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6675fa-57d1-48cd-bed9-4c218efb32da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:17.500337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6675fa-57d1-48cd-bed9-4c218efb32da service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:17.515951 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3398/6735] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:17.544756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b076ae4-4d81-4a8b-9c6d-6639e15ab769 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:17.546252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0b076ae4-4d81-4a8b-9c6d-6639e15ab769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:17.638592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b076ae4-4d81-4a8b-9c6d-6639e15ab769 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:17.718473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9dc3b3-ba45-4edd-85b2-9542cc07bda3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:17.719310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9dc3b3-ba45-4edd-85b2-9542cc07bda3 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:17.719705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9dc3b3-ba45-4edd-85b2-9542cc07bda3 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:17.720478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9dc3b3-ba45-4edd-85b2-9542cc07bda3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:17.727367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5c9dc3b3-ba45-4edd-85b2-9542cc07bda3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:17.749766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9dc3b3-ba45-4edd-85b2-9542cc07bda3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:17.751689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9dc3b3-ba45-4edd-85b2-9542cc07bda3 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:17.773315 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3338/6736] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:18.585325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6675fa-57d1-48cd-bed9-4c218efb32da service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:18.586864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ed6675fa-57d1-48cd-bed9-4c218efb32da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:18.663230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6675fa-57d1-48cd-bed9-4c218efb32da service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:18.677345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7922fd-2421-4f17-b2c1-2e024ea8f1b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:18.678019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7922fd-2421-4f17-b2c1-2e024ea8f1b6 service glance] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:18.678306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7922fd-2421-4f17-b2c1-2e024ea8f1b6 service glance] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:18.678586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7922fd-2421-4f17-b2c1-2e024ea8f1b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:18.680458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3e7922fd-2421-4f17-b2c1-2e024ea8f1b6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:18.760217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7922fd-2421-4f17-b2c1-2e024ea8f1b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:18.761844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7922fd-2421-4f17-b2c1-2e024ea8f1b6 service glance] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:18.780311 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3399/6737] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:19.016171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9dc3b3-ba45-4edd-85b2-9542cc07bda3 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:19.018206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5c9dc3b3-ba45-4edd-85b2-9542cc07bda3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:19.041887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9dc3b3-ba45-4edd-85b2-9542cc07bda3 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:19.045575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a5fd5-ca29-4ae4-a930-f7d64b441037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:19.046415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a5fd5-ca29-4ae4-a930-f7d64b441037 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:19.046699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a5fd5-ca29-4ae4-a930-f7d64b441037 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:19.046984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a5fd5-ca29-4ae4-a930-f7d64b441037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:19.053790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6a1a5fd5-ca29-4ae4-a930-f7d64b441037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:19.067833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a5fd5-ca29-4ae4-a930-f7d64b441037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:19.069360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a5fd5-ca29-4ae4-a930-f7d64b441037 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:19.080668 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3339/6738] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:19.179835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7922fd-2421-4f17-b2c1-2e024ea8f1b6 service glance] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:19.193820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7922fd-2421-4f17-b2c1-2e024ea8f1b6 service glance] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:19.198175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce595215-b70d-4cb7-8124-95e881048025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:19.198982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce595215-b70d-4cb7-8124-95e881048025 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:19.199446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce595215-b70d-4cb7-8124-95e881048025 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:19.199727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce595215-b70d-4cb7-8124-95e881048025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:19.201563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ce595215-b70d-4cb7-8124-95e881048025 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:19.218682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce595215-b70d-4cb7-8124-95e881048025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:19.220198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce595215-b70d-4cb7-8124-95e881048025 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:19.234590 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3400/6739] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:19.338022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:23.587727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da69209-c178-482a-b612-45e3e094f592 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:23.588575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da69209-c178-482a-b612-45e3e094f592 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:23.588995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da69209-c178-482a-b612-45e3e094f592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:23.600037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:23.629294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4da69209-c178-482a-b612-45e3e094f592 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:23.633062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4da69209-c178-482a-b612-45e3e094f592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:23.743364 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3340/6740] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:35:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:23.769551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce595215-b70d-4cb7-8124-95e881048025 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:23.771441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ce595215-b70d-4cb7-8124-95e881048025 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:23.904788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce595215-b70d-4cb7-8124-95e881048025 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:23.913297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c8836-61f6-42d4-944c-d0a828691ee0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:23.913973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c8836-61f6-42d4-944c-d0a828691ee0 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:23.914255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c8836-61f6-42d4-944c-d0a828691ee0 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:23.914530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c8836-61f6-42d4-944c-d0a828691ee0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:23.925853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c8836-61f6-42d4-944c-d0a828691ee0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:23.928908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c8836-61f6-42d4-944c-d0a828691ee0 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:23.943074 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3401/6741] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:35:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:35:28.793367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae663a9c-3738-43c3-8b9e-9b81f46f22d0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:28.794259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae663a9c-3738-43c3-8b9e-9b81f46f22d0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:28.794768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae663a9c-3738-43c3-8b9e-9b81f46f22d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:28.915937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ae663a9c-3738-43c3-8b9e-9b81f46f22d0 None None] MFA Rules not processed for user `0ab8b3f06e994bbca5d6dd14109bfe50`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:28.920362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ae663a9c-3738-43c3-8b9e-9b81f46f22d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:29.098483 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3341/6742] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:29.392023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c8836-61f6-42d4-944c-d0a828691ee0 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:29.394293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4e7c8836-61f6-42d4-944c-d0a828691ee0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:29.442974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c8836-61f6-42d4-944c-d0a828691ee0 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:29.469435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed843b-4132-4a69-b563-4484182fe9df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:29.473193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed843b-4132-4a69-b563-4484182fe9df service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:29.476394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed843b-4132-4a69-b563-4484182fe9df service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:29.476394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed843b-4132-4a69-b563-4484182fe9df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:29.514239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed843b-4132-4a69-b563-4484182fe9df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:29.531505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed843b-4132-4a69-b563-4484182fe9df service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:29.580763 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3402/6743] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:31.729383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae663a9c-3738-43c3-8b9e-9b81f46f22d0 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:31.736743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ae663a9c-3738-43c3-8b9e-9b81f46f22d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:31.779949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae663a9c-3738-43c3-8b9e-9b81f46f22d0 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:31.801210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4107c4-c2d9-4375-8cc0-5e92ad5653b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:31.802237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4107c4-c2d9-4375-8cc0-5e92ad5653b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:31.802630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4107c4-c2d9-4375-8cc0-5e92ad5653b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:31.805780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4107c4-c2d9-4375-8cc0-5e92ad5653b4 admin admin] PATH_INFO: `/v3/users/45b11273f4554199a70c95c3ef68ebb6` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:31.807648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4107c4-c2d9-4375-8cc0-5e92ad5653b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45b11273f4554199a70c95c3ef68ebb6)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:31.809770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4107c4-c2d9-4375-8cc0-5e92ad5653b4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:32.139606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ca4107c4-c2d9-4375-8cc0-5e92ad5653b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45b11273f4554199a70c95c3ef68ebb6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:32.171566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ca4107c4-c2d9-4375-8cc0-5e92ad5653b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45b11273f4554199a70c95c3ef68ebb6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:32.232813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ca4107c4-c2d9-4375-8cc0-5e92ad5653b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45b11273f4554199a70c95c3ef68ebb6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:32.248463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ca4107c4-c2d9-4375-8cc0-5e92ad5653b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45b11273f4554199a70c95c3ef68ebb6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:32.267052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ca4107c4-c2d9-4375-8cc0-5e92ad5653b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45b11273f4554199a70c95c3ef68ebb6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:32.299750 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3342/6744] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:35:31 2022] DELETE /identity/v3/users/45b11273f4554199a70c95c3ef68ebb6 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:32.305029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c9332-52da-4ebb-beff-1f1ee5de6ae1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:32.306802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c9332-52da-4ebb-beff-1f1ee5de6ae1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:32.306802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c9332-52da-4ebb-beff-1f1ee5de6ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:32.351616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-802c9332-52da-4ebb-beff-1f1ee5de6ae1 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:32.353262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-802c9332-52da-4ebb-beff-1f1ee5de6ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:32.589762 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3403/6745] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:32.594535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4107c4-c2d9-4375-8cc0-5e92ad5653b4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:32.596010 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ca4107c4-c2d9-4375-8cc0-5e92ad5653b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:32.618101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:32.736506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4107c4-c2d9-4375-8cc0-5e92ad5653b4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:32.744647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c9192-d6ff-469c-9de7-2e5485bda973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:32.747527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c9192-d6ff-469c-9de7-2e5485bda973 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:32.747527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c9192-d6ff-469c-9de7-2e5485bda973 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:32.747527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c9192-d6ff-469c-9de7-2e5485bda973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:32.818650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c9192-d6ff-469c-9de7-2e5485bda973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:32.818650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c9192-d6ff-469c-9de7-2e5485bda973 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:32.836523 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3343/6746] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:33.243845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c9332-52da-4ebb-beff-1f1ee5de6ae1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:33.246007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-802c9332-52da-4ebb-beff-1f1ee5de6ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:33.281448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c9332-52da-4ebb-beff-1f1ee5de6ae1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:33.290594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d7249-586d-422a-8601-067cc8dbbfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:33.291655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d7249-586d-422a-8601-067cc8dbbfd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:33.292047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d7249-586d-422a-8601-067cc8dbbfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:33.292446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d7249-586d-422a-8601-067cc8dbbfd5 admin admin] PATH_INFO: `/v3/users/da9c5eb730564c47965b28ffddfeeacc` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:33.293892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d7249-586d-422a-8601-067cc8dbbfd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da9c5eb730564c47965b28ffddfeeacc)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:33.297157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d7249-586d-422a-8601-067cc8dbbfd5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:33.333848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:34.261385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e98d7249-586d-422a-8601-067cc8dbbfd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da9c5eb730564c47965b28ffddfeeacc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:34.292892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e98d7249-586d-422a-8601-067cc8dbbfd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da9c5eb730564c47965b28ffddfeeacc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:34.381788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e98d7249-586d-422a-8601-067cc8dbbfd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da9c5eb730564c47965b28ffddfeeacc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:34.383291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e98d7249-586d-422a-8601-067cc8dbbfd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da9c5eb730564c47965b28ffddfeeacc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:34.405262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e98d7249-586d-422a-8601-067cc8dbbfd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da9c5eb730564c47965b28ffddfeeacc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:34.431914 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3404/6747] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:35:33 2022] DELETE /identity/v3/users/da9c5eb730564c47965b28ffddfeeacc => generated 0 bytes in 1188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:34.436766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c965cc-ec38-47d7-9f7e-d31b1ccf5c56 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:34.437611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c965cc-ec38-47d7-9f7e-d31b1ccf5c56 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:34.438095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c965cc-ec38-47d7-9f7e-d31b1ccf5c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:34.480517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-19c965cc-ec38-47d7-9f7e-d31b1ccf5c56 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:34.484225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-19c965cc-ec38-47d7-9f7e-d31b1ccf5c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:34.569631 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3344/6748] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:34.590308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d7249-586d-422a-8601-067cc8dbbfd5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:34.592257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e98d7249-586d-422a-8601-067cc8dbbfd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:34.783603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d7249-586d-422a-8601-067cc8dbbfd5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:34.793070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd571d9a-2724-4255-a01a-f537d7c6f3c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:34.793842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd571d9a-2724-4255-a01a-f537d7c6f3c9 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:34.794132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd571d9a-2724-4255-a01a-f537d7c6f3c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:34.794493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd571d9a-2724-4255-a01a-f537d7c6f3c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:34.830647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd571d9a-2724-4255-a01a-f537d7c6f3c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:34.832946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd571d9a-2724-4255-a01a-f537d7c6f3c9 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:34.859897 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3405/6749] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:35.255661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c965cc-ec38-47d7-9f7e-d31b1ccf5c56 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:35.265287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-19c965cc-ec38-47d7-9f7e-d31b1ccf5c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:35.282076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c965cc-ec38-47d7-9f7e-d31b1ccf5c56 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:35.287202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76cb83-d5e8-4dda-8294-50221ad31819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:35.288318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76cb83-d5e8-4dda-8294-50221ad31819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:35.288678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76cb83-d5e8-4dda-8294-50221ad31819 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:35.289302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76cb83-d5e8-4dda-8294-50221ad31819 admin admin] PATH_INFO: `/v3/projects/1a73639b88974ba3ae4e94485cc0beac` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:35.290921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76cb83-d5e8-4dda-8294-50221ad31819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a73639b88974ba3ae4e94485cc0beac)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:35.293358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76cb83-d5e8-4dda-8294-50221ad31819 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:35.477505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3a76cb83-d5e8-4dda-8294-50221ad31819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a73639b88974ba3ae4e94485cc0beac', 'request_id': 'req-3a76cb83-d5e8-4dda-8294-50221ad31819'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:35.494185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3a76cb83-d5e8-4dda-8294-50221ad31819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a73639b88974ba3ae4e94485cc0beac', 'request_id': 'req-3a76cb83-d5e8-4dda-8294-50221ad31819'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:35.509547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3a76cb83-d5e8-4dda-8294-50221ad31819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a73639b88974ba3ae4e94485cc0beac', 'request_id': 'req-3a76cb83-d5e8-4dda-8294-50221ad31819'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:35.634573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3a76cb83-d5e8-4dda-8294-50221ad31819 admin admin] The token cache is being invalidate because project 1a73639b88974ba3ae4e94485cc0beac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:35:35.635606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3a76cb83-d5e8-4dda-8294-50221ad31819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:35.637063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3a76cb83-d5e8-4dda-8294-50221ad31819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:35.639059 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3345/6750] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:35:35 2022] DELETE /identity/v3/projects/1a73639b88974ba3ae4e94485cc0beac => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:35.644662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf092e5-56cd-4bea-a42b-46435c4b8a32 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:35.650169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf092e5-56cd-4bea-a42b-46435c4b8a32 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:35.650169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf092e5-56cd-4bea-a42b-46435c4b8a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:35.679176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-bbf092e5-56cd-4bea-a42b-46435c4b8a32 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:35.681428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bbf092e5-56cd-4bea-a42b-46435c4b8a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:35.766954 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3406/6751] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:35.776284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36876e68-ccf7-4d31-8848-7e38ac838933 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:35.776744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36876e68-ccf7-4d31-8848-7e38ac838933 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:35.777192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36876e68-ccf7-4d31-8848-7e38ac838933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:35.853148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-36876e68-ccf7-4d31-8848-7e38ac838933 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:35.861578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-36876e68-ccf7-4d31-8848-7e38ac838933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:35.897079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf092e5-56cd-4bea-a42b-46435c4b8a32 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:35.897744 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3346/6752] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:35.912560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf092e5-56cd-4bea-a42b-46435c4b8a32 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:35.920212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e7c3b-11dd-429f-8124-ee6bf671268c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:35.931437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e7c3b-11dd-429f-8124-ee6bf671268c admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:35.931760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e7c3b-11dd-429f-8124-ee6bf671268c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:35.932205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e7c3b-11dd-429f-8124-ee6bf671268c admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:35.933173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e7c3b-11dd-429f-8124-ee6bf671268c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:35:35.933629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e7c3b-11dd-429f-8124-ee6bf671268c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:35.935496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e7c3b-11dd-429f-8124-ee6bf671268c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:35.961346 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3407/6753] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:35:35.966167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36876e68-ccf7-4d31-8848-7e38ac838933 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:35.990443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36876e68-ccf7-4d31-8848-7e38ac838933 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:36.009804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47b16e-75e0-442e-b908-118e6e32358d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:36.015130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47b16e-75e0-442e-b908-118e6e32358d admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:36.015483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47b16e-75e0-442e-b908-118e6e32358d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:36.015755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47b16e-75e0-442e-b908-118e6e32358d admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:36.016492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47b16e-75e0-442e-b908-118e6e32358d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:36.022036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47b16e-75e0-442e-b908-118e6e32358d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:36.159104 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3347/6754] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:35:35 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:35:36.163879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e7c3b-11dd-429f-8124-ee6bf671268c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:36.188256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e7c3b-11dd-429f-8124-ee6bf671268c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:36.267449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:36.402703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0b0bf-da52-4d95-bd0b-9d95ecfc09ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:36.404165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0b0bf-da52-4d95-bd0b-9d95ecfc09ed admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:36.404643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0b0bf-da52-4d95-bd0b-9d95ecfc09ed admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:36.405465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0b0bf-da52-4d95-bd0b-9d95ecfc09ed admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:36.406449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0b0bf-da52-4d95-bd0b-9d95ecfc09ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:36.435274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0b0bf-da52-4d95-bd0b-9d95ecfc09ed admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:36.606208 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3408/6755] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:35:36 2022] POST /identity/v3/users => generated 288 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:35:36.610452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47b16e-75e0-442e-b908-118e6e32358d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:36.624641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47b16e-75e0-442e-b908-118e6e32358d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:36.650265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38ce82-280e-4c63-8a07-e256a48e515f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:36.652194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38ce82-280e-4c63-8a07-e256a48e515f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:36.652194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38ce82-280e-4c63-8a07-e256a48e515f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:36.652194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38ce82-280e-4c63-8a07-e256a48e515f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:36.652997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38ce82-280e-4c63-8a07-e256a48e515f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:36.654932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38ce82-280e-4c63-8a07-e256a48e515f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:36.656752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:36.668401 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3348/6756] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:36.678771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0b0bf-da52-4d95-bd0b-9d95ecfc09ed admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:36.693567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0b0bf-da52-4d95-bd0b-9d95ecfc09ed admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:36.703127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4462c5c-2b91-43f2-b2f9-89ee05bf6123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:36.705744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4462c5c-2b91-43f2-b2f9-89ee05bf6123 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:36.705991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4462c5c-2b91-43f2-b2f9-89ee05bf6123 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:36.706280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4462c5c-2b91-43f2-b2f9-89ee05bf6123 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:36.708362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4462c5c-2b91-43f2-b2f9-89ee05bf6123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:36.710515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4462c5c-2b91-43f2-b2f9-89ee05bf6123 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:36.726222 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3409/6757] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:36.734531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38ce82-280e-4c63-8a07-e256a48e515f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:36.749190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38ce82-280e-4c63-8a07-e256a48e515f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:36.764970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa6db6-9286-4c6e-99cb-add7191e62e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:36.766564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa6db6-9286-4c6e-99cb-add7191e62e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:36.767260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa6db6-9286-4c6e-99cb-add7191e62e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:36.767762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa6db6-9286-4c6e-99cb-add7191e62e0 admin admin] PATH_INFO: `/v3/projects/dd90fa9beaa1427ba08d9c19e794e4a8/users/90540ab472324f9988e33e4fcc4eaebd/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:36.801707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d5426-a101-422e-8977-431bae84f51b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:36.802000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d5426-a101-422e-8977-431bae84f51b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:36.802330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d5426-a101-422e-8977-431bae84f51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:36.839088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-872d5426-a101-422e-8977-431bae84f51b None None] MFA Rules not processed for user `0ab8b3f06e994bbca5d6dd14109bfe50`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:36.844890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-872d5426-a101-422e-8977-431bae84f51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:36.845441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa6db6-9286-4c6e-99cb-add7191e62e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd90fa9beaa1427ba08d9c19e794e4a8, user_id=90540ab472324f9988e33e4fcc4eaebd, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:36.848247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa6db6-9286-4c6e-99cb-add7191e62e0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:36.975463 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3349/6758] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:35:36 2022] PUT /identity/v3/projects/dd90fa9beaa1427ba08d9c19e794e4a8/users/90540ab472324f9988e33e4fcc4eaebd/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:35:36.976430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa6db6-9286-4c6e-99cb-add7191e62e0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:36.989676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fefa6db6-9286-4c6e-99cb-add7191e62e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:37.028629 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3410/6759] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:37.031238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9d126-2faf-4b73-958d-7d48b1e36b78 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:37.035104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9d126-2faf-4b73-958d-7d48b1e36b78 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:37.035467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9d126-2faf-4b73-958d-7d48b1e36b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:37.088514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-59c9d126-2faf-4b73-958d-7d48b1e36b78 None None] MFA Rules not processed for user `90540ab472324f9988e33e4fcc4eaebd`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:37.096081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-59c9d126-2faf-4b73-958d-7d48b1e36b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:37.105371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa6db6-9286-4c6e-99cb-add7191e62e0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:37.117509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048b5f6-2522-4f9b-b8f2-f723437732bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:37.118966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048b5f6-2522-4f9b-b8f2-f723437732bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:37.119515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048b5f6-2522-4f9b-b8f2-f723437732bd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:37.119999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048b5f6-2522-4f9b-b8f2-f723437732bd admin admin] PATH_INFO: `/v3/projects/fcc32d1f1c894e2f8207fbebe1d6c71c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:37.122715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048b5f6-2522-4f9b-b8f2-f723437732bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcc32d1f1c894e2f8207fbebe1d6c71c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:37.127219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048b5f6-2522-4f9b-b8f2-f723437732bd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:37.240419 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3411/6760] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:37.241381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9d126-2faf-4b73-958d-7d48b1e36b78 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:37.242937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-59c9d126-2faf-4b73-958d-7d48b1e36b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:37.270387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9d126-2faf-4b73-958d-7d48b1e36b78 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:37.283591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d651a-c5d2-48d6-aae7-244659858cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:37.287251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d651a-c5d2-48d6-aae7-244659858cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:37.287547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d651a-c5d2-48d6-aae7-244659858cac admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:37.288952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d651a-c5d2-48d6-aae7-244659858cac admin admin] PATH_INFO: `/v3/users/22546f4823d2442c89e899c1980bea6a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:37.291284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d651a-c5d2-48d6-aae7-244659858cac admin admin] RBAC: Authorizing `identity:delete_user(user_id=22546f4823d2442c89e899c1980bea6a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:37.293688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d651a-c5d2-48d6-aae7-244659858cac admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:37.319550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e048b5f6-2522-4f9b-b8f2-f723437732bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcc32d1f1c894e2f8207fbebe1d6c71c', 'request_id': 'req-e048b5f6-2522-4f9b-b8f2-f723437732bd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:37.329904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e048b5f6-2522-4f9b-b8f2-f723437732bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcc32d1f1c894e2f8207fbebe1d6c71c', 'request_id': 'req-e048b5f6-2522-4f9b-b8f2-f723437732bd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:37.339549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e048b5f6-2522-4f9b-b8f2-f723437732bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcc32d1f1c894e2f8207fbebe1d6c71c', 'request_id': 'req-e048b5f6-2522-4f9b-b8f2-f723437732bd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:37.363096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:37.436769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e048b5f6-2522-4f9b-b8f2-f723437732bd admin admin] The token cache is being invalidate because project fcc32d1f1c894e2f8207fbebe1d6c71c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:35:37.437209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e048b5f6-2522-4f9b-b8f2-f723437732bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:37.439282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e048b5f6-2522-4f9b-b8f2-f723437732bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:37.445497 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3350/6761] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:35:36 2022] DELETE /identity/v3/projects/fcc32d1f1c894e2f8207fbebe1d6c71c => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:37.445497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048b5f6-2522-4f9b-b8f2-f723437732bd admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:37.447532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e048b5f6-2522-4f9b-b8f2-f723437732bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:37.529715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-343d651a-c5d2-48d6-aae7-244659858cac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22546f4823d2442c89e899c1980bea6a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:37.540379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-343d651a-c5d2-48d6-aae7-244659858cac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22546f4823d2442c89e899c1980bea6a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:37.558672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048b5f6-2522-4f9b-b8f2-f723437732bd admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:37.563208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750d188-1511-418c-a9b8-117b9f4030f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:37.563829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750d188-1511-418c-a9b8-117b9f4030f6 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:37.564128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750d188-1511-418c-a9b8-117b9f4030f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:37.564403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750d188-1511-418c-a9b8-117b9f4030f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:37.566714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f750d188-1511-418c-a9b8-117b9f4030f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:37.654380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750d188-1511-418c-a9b8-117b9f4030f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:37.655485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750d188-1511-418c-a9b8-117b9f4030f6 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:37.665794 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3351/6762] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:37.666837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750d188-1511-418c-a9b8-117b9f4030f6 service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:37.667892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f750d188-1511-418c-a9b8-117b9f4030f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:37.684159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-343d651a-c5d2-48d6-aae7-244659858cac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22546f4823d2442c89e899c1980bea6a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:37.684159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-343d651a-c5d2-48d6-aae7-244659858cac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22546f4823d2442c89e899c1980bea6a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:37.726782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-343d651a-c5d2-48d6-aae7-244659858cac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22546f4823d2442c89e899c1980bea6a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:37.739556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750d188-1511-418c-a9b8-117b9f4030f6 service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:37.745133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60ba07-1551-4a02-920a-fb10eece9533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:37.746018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60ba07-1551-4a02-920a-fb10eece9533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:37.746309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60ba07-1551-4a02-920a-fb10eece9533 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:37.746586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60ba07-1551-4a02-920a-fb10eece9533 admin admin] PATH_INFO: `/v3/users/61af9d10e43846529a162cbf49512d0c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:37.747884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60ba07-1551-4a02-920a-fb10eece9533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61af9d10e43846529a162cbf49512d0c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:37.748335 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3412/6763] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:35:37 2022] DELETE /identity/v3/users/22546f4823d2442c89e899c1980bea6a => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:37.754432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec9a12-82b8-4b9e-a879-d9797de3a15a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:37.754734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec9a12-82b8-4b9e-a879-d9797de3a15a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:37.755047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec9a12-82b8-4b9e-a879-d9797de3a15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:37.757635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60ba07-1551-4a02-920a-fb10eece9533 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:37.801849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-daec9a12-82b8-4b9e-a879-d9797de3a15a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:37.803195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-daec9a12-82b8-4b9e-a879-d9797de3a15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:37.896713 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3413/6764] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:37.896713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec9a12-82b8-4b9e-a879-d9797de3a15a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:37.906870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-daec9a12-82b8-4b9e-a879-d9797de3a15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:37.962749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8f60ba07-1551-4a02-920a-fb10eece9533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61af9d10e43846529a162cbf49512d0c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:37.969051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:37.971139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec9a12-82b8-4b9e-a879-d9797de3a15a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:37.975802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53772c0-aff3-4421-8e53-c9efad270f1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:37.982071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53772c0-aff3-4421-8e53-c9efad270f1f service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:37.982071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53772c0-aff3-4421-8e53-c9efad270f1f service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:37.982071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53772c0-aff3-4421-8e53-c9efad270f1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:37.982883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c53772c0-aff3-4421-8e53-c9efad270f1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:37.984837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8f60ba07-1551-4a02-920a-fb10eece9533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61af9d10e43846529a162cbf49512d0c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:37.999310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53772c0-aff3-4421-8e53-c9efad270f1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:38.000764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53772c0-aff3-4421-8e53-c9efad270f1f service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:38.013340 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3414/6765] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:38.014082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53772c0-aff3-4421-8e53-c9efad270f1f service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:38.015458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c53772c0-aff3-4421-8e53-c9efad270f1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:38.038985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53772c0-aff3-4421-8e53-c9efad270f1f service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:38.044678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04680aa4-b895-4c8d-8526-62337e880fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:38.045440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04680aa4-b895-4c8d-8526-62337e880fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:38.045800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04680aa4-b895-4c8d-8526-62337e880fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:38.046180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04680aa4-b895-4c8d-8526-62337e880fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:38.062691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8f60ba07-1551-4a02-920a-fb10eece9533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61af9d10e43846529a162cbf49512d0c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:38.067710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8f60ba07-1551-4a02-920a-fb10eece9533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61af9d10e43846529a162cbf49512d0c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:38.069316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8f60ba07-1551-4a02-920a-fb10eece9533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61af9d10e43846529a162cbf49512d0c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:38.071736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04680aa4-b895-4c8d-8526-62337e880fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:38.074453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04680aa4-b895-4c8d-8526-62337e880fb4 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:38.079498 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3352/6766] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:35:37 2022] DELETE /identity/v3/users/61af9d10e43846529a162cbf49512d0c => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:38.093370 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3415/6767] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:38.503891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60ba07-1551-4a02-920a-fb10eece9533 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:38.505019 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8f60ba07-1551-4a02-920a-fb10eece9533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:38.615034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60ba07-1551-4a02-920a-fb10eece9533 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:38.623193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065de0c5-4427-4894-b6d8-c613a7f1b3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:38.624111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065de0c5-4427-4894-b6d8-c613a7f1b3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:38.624400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065de0c5-4427-4894-b6d8-c613a7f1b3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:38.624675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065de0c5-4427-4894-b6d8-c613a7f1b3f1 admin admin] PATH_INFO: `/v3/projects/64a78c2b045d4b57acf494f6af2a122c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:38.627433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065de0c5-4427-4894-b6d8-c613a7f1b3f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64a78c2b045d4b57acf494f6af2a122c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:38.631282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065de0c5-4427-4894-b6d8-c613a7f1b3f1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:38.764139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-065de0c5-4427-4894-b6d8-c613a7f1b3f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64a78c2b045d4b57acf494f6af2a122c', 'request_id': 'req-065de0c5-4427-4894-b6d8-c613a7f1b3f1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:38.782620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-065de0c5-4427-4894-b6d8-c613a7f1b3f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64a78c2b045d4b57acf494f6af2a122c', 'request_id': 'req-065de0c5-4427-4894-b6d8-c613a7f1b3f1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:38.790464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-065de0c5-4427-4894-b6d8-c613a7f1b3f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64a78c2b045d4b57acf494f6af2a122c', 'request_id': 'req-065de0c5-4427-4894-b6d8-c613a7f1b3f1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:38.898790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-065de0c5-4427-4894-b6d8-c613a7f1b3f1 admin admin] The token cache is being invalidate because project 64a78c2b045d4b57acf494f6af2a122c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:35:38.899166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-065de0c5-4427-4894-b6d8-c613a7f1b3f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:38.905636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-065de0c5-4427-4894-b6d8-c613a7f1b3f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:38.905636 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3353/6768] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:35:38 2022] DELETE /identity/v3/projects/64a78c2b045d4b57acf494f6af2a122c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:38.907571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab2c0a-3f10-4e60-95be-1f64ac28eba5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:38.908036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab2c0a-3f10-4e60-95be-1f64ac28eba5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:38.908132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab2c0a-3f10-4e60-95be-1f64ac28eba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:38.939060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5dab2c0a-3f10-4e60-95be-1f64ac28eba5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:38.939060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5dab2c0a-3f10-4e60-95be-1f64ac28eba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:38.942428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065de0c5-4427-4894-b6d8-c613a7f1b3f1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:38.944428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-065de0c5-4427-4894-b6d8-c613a7f1b3f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:39.025083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:39.040089 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3416/6769] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:39.047781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065de0c5-4427-4894-b6d8-c613a7f1b3f1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:39.049290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3d61d-1d7d-4398-8e4e-cb37cf8632d5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:39.053626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3d61d-1d7d-4398-8e4e-cb37cf8632d5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:39.053626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3d61d-1d7d-4398-8e4e-cb37cf8632d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:39.068805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5d0c4-08ba-4c14-8d7b-3725de0141aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:39.070034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5d0c4-08ba-4c14-8d7b-3725de0141aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:39.070433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5d0c4-08ba-4c14-8d7b-3725de0141aa admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:39.070759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5d0c4-08ba-4c14-8d7b-3725de0141aa admin admin] PATH_INFO: `/v3/projects/cf716f2078704e16ab1bdf7d00335841` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:39.072099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5d0c4-08ba-4c14-8d7b-3725de0141aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf716f2078704e16ab1bdf7d00335841)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:39.072822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e3d3d61d-1d7d-4398-8e4e-cb37cf8632d5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:39.074049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e3d3d61d-1d7d-4398-8e4e-cb37cf8632d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:39.074227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5d0c4-08ba-4c14-8d7b-3725de0141aa admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:39.083609 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3417/6770] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:35:39.088046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3d61d-1d7d-4398-8e4e-cb37cf8632d5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:39.097868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3d61d-1d7d-4398-8e4e-cb37cf8632d5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:39.103431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f768a-b62a-4667-b482-235394e3a217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:39.104101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f768a-b62a-4667-b482-235394e3a217 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:39.105435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f768a-b62a-4667-b482-235394e3a217 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:39.105435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f768a-b62a-4667-b482-235394e3a217 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:39.105688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f768a-b62a-4667-b482-235394e3a217 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:35:39.106003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f768a-b62a-4667-b482-235394e3a217 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:39.107642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f768a-b62a-4667-b482-235394e3a217 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:39.123079 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3418/6771] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:35:39.128603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f768a-b62a-4667-b482-235394e3a217 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:39.136464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f768a-b62a-4667-b482-235394e3a217 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:39.142718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3419c-9682-4d3f-858d-e5e10b8b24ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:39.144332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3419c-9682-4d3f-858d-e5e10b8b24ec admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:39.145133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3419c-9682-4d3f-858d-e5e10b8b24ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:39.145452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3419c-9682-4d3f-858d-e5e10b8b24ec admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:39.146154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3419c-9682-4d3f-858d-e5e10b8b24ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:39.148121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3419c-9682-4d3f-858d-e5e10b8b24ec admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:39.254835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-51c5d0c4-08ba-4c14-8d7b-3725de0141aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf716f2078704e16ab1bdf7d00335841', 'request_id': 'req-51c5d0c4-08ba-4c14-8d7b-3725de0141aa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:39.260655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-51c5d0c4-08ba-4c14-8d7b-3725de0141aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf716f2078704e16ab1bdf7d00335841', 'request_id': 'req-51c5d0c4-08ba-4c14-8d7b-3725de0141aa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:39.267369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-51c5d0c4-08ba-4c14-8d7b-3725de0141aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf716f2078704e16ab1bdf7d00335841', 'request_id': 'req-51c5d0c4-08ba-4c14-8d7b-3725de0141aa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:39.280980 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3419/6772] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:35:39 2022] POST /identity/v3/projects => generated 405 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:35:39.281701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3419c-9682-4d3f-858d-e5e10b8b24ec admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:39.351287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3419c-9682-4d3f-858d-e5e10b8b24ec admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:39.359965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8036310-0220-4156-a1bf-bfd6b3b0b018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:39.361892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-51c5d0c4-08ba-4c14-8d7b-3725de0141aa admin admin] The token cache is being invalidate because project cf716f2078704e16ab1bdf7d00335841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:35:39.362004 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8036310-0220-4156-a1bf-bfd6b3b0b018 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:39.362142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-51c5d0c4-08ba-4c14-8d7b-3725de0141aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:39.362802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8036310-0220-4156-a1bf-bfd6b3b0b018 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:39.362802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8036310-0220-4156-a1bf-bfd6b3b0b018 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:39.363218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-51c5d0c4-08ba-4c14-8d7b-3725de0141aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:39.363325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8036310-0220-4156-a1bf-bfd6b3b0b018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:39.365112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8036310-0220-4156-a1bf-bfd6b3b0b018 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:39.370323 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3354/6773] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:35:38 2022] DELETE /identity/v3/projects/cf716f2078704e16ab1bdf7d00335841 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:39.372514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2f5e0-2af7-4b23-b822-73c71283fa21 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:39.372999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2f5e0-2af7-4b23-b822-73c71283fa21 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:39.373504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2f5e0-2af7-4b23-b822-73c71283fa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:39.394924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-22a2f5e0-2af7-4b23-b822-73c71283fa21 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:39.396253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-22a2f5e0-2af7-4b23-b822-73c71283fa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:39.405085 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3355/6774] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:39.413165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4b495-d35f-447f-85c0-e24bdc4d03c6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:39.413455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4b495-d35f-447f-85c0-e24bdc4d03c6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:39.415273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4b495-d35f-447f-85c0-e24bdc4d03c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:39.444837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0ff4b495-d35f-447f-85c0-e24bdc4d03c6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:39.444837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0ff4b495-d35f-447f-85c0-e24bdc4d03c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:39.457583 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3356/6775] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:35:39.458620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4b495-d35f-447f-85c0-e24bdc4d03c6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:39.469496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4b495-d35f-447f-85c0-e24bdc4d03c6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:39.477178 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3420/6776] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:35:39 2022] POST /identity/v3/users => generated 303 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:35:39.481393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6e197-d167-4bcc-a1d3-ef0ace10b7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:39.481902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8036310-0220-4156-a1bf-bfd6b3b0b018 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:39.482022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6e197-d167-4bcc-a1d3-ef0ace10b7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:39.482292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6e197-d167-4bcc-a1d3-ef0ace10b7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:39.482865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6e197-d167-4bcc-a1d3-ef0ace10b7f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:39.483704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6e197-d167-4bcc-a1d3-ef0ace10b7f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:35:39.484165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6e197-d167-4bcc-a1d3-ef0ace10b7f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:39.485126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e8036310-0220-4156-a1bf-bfd6b3b0b018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:39.485800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6e197-d167-4bcc-a1d3-ef0ace10b7f2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:39.500200 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3357/6777] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:35:39.505229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8036310-0220-4156-a1bf-bfd6b3b0b018 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:39.509445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6e197-d167-4bcc-a1d3-ef0ace10b7f2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:39.510931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee110ec-0b5d-4fae-a91f-9a19b10d140c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:39.511684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee110ec-0b5d-4fae-a91f-9a19b10d140c admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:39.511966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee110ec-0b5d-4fae-a91f-9a19b10d140c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:39.512248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee110ec-0b5d-4fae-a91f-9a19b10d140c admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:39.513035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee110ec-0b5d-4fae-a91f-9a19b10d140c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:39.514881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee110ec-0b5d-4fae-a91f-9a19b10d140c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:39.522520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6e197-d167-4bcc-a1d3-ef0ace10b7f2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:39.528387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6738d7-fe82-4735-9754-6a7eef4b30e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:39.529588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6738d7-fe82-4735-9754-6a7eef4b30e3 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:39.529736 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3421/6778] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:35:39.529979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6738d7-fe82-4735-9754-6a7eef4b30e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:39.530353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6738d7-fe82-4735-9754-6a7eef4b30e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:39.531309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6738d7-fe82-4735-9754-6a7eef4b30e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:39.533429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee110ec-0b5d-4fae-a91f-9a19b10d140c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:39.535255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6738d7-fe82-4735-9754-6a7eef4b30e3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:39.548426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee110ec-0b5d-4fae-a91f-9a19b10d140c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:39.571932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba5e63-e0f0-460e-8c1f-44966f10f24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:39.572624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba5e63-e0f0-460e-8c1f-44966f10f24a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:39.572907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba5e63-e0f0-460e-8c1f-44966f10f24a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:39.573193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba5e63-e0f0-460e-8c1f-44966f10f24a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:39.573924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba5e63-e0f0-460e-8c1f-44966f10f24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:39.575588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba5e63-e0f0-460e-8c1f-44966f10f24a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:39.587479 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3422/6779] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:39.595677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba5e63-e0f0-460e-8c1f-44966f10f24a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:39.607319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba5e63-e0f0-460e-8c1f-44966f10f24a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:39.614668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79307026-b93b-4705-a47f-ba761d7db540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:39.615603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79307026-b93b-4705-a47f-ba761d7db540 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:39.615951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79307026-b93b-4705-a47f-ba761d7db540 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:39.616221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79307026-b93b-4705-a47f-ba761d7db540 admin admin] PATH_INFO: `/v3/projects/73bc538f457d45d88c56a23d946a04be/users/0368bb7e320642c2b6b3410012c28180/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:39.637180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79307026-b93b-4705-a47f-ba761d7db540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73bc538f457d45d88c56a23d946a04be, user_id=0368bb7e320642c2b6b3410012c28180, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:39.640877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79307026-b93b-4705-a47f-ba761d7db540 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:39.655047 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3358/6780] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:35:39 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:35:39.657088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6738d7-fe82-4735-9754-6a7eef4b30e3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:39.724284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6738d7-fe82-4735-9754-6a7eef4b30e3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:39.729001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8a493-df8f-4129-bfd6-e8c680a36191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:39.729680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8a493-df8f-4129-bfd6-e8c680a36191 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:39.730209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8a493-df8f-4129-bfd6-e8c680a36191 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:39.730499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8a493-df8f-4129-bfd6-e8c680a36191 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:39.731217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8a493-df8f-4129-bfd6-e8c680a36191 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:39.733149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8a493-df8f-4129-bfd6-e8c680a36191 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:39.756502 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3423/6781] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:35:39 2022] PUT /identity/v3/projects/73bc538f457d45d88c56a23d946a04be/users/0368bb7e320642c2b6b3410012c28180/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:35:39.758169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1f785-48d1-4755-96c5-e1ed87baa4e0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:39.758508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1f785-48d1-4755-96c5-e1ed87baa4e0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:39.758774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1f785-48d1-4755-96c5-e1ed87baa4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:39.776683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-76f1f785-48d1-4755-96c5-e1ed87baa4e0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:39.778012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-76f1f785-48d1-4755-96c5-e1ed87baa4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:39.847056 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3424/6782] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:39.856469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1f785-48d1-4755-96c5-e1ed87baa4e0 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:39.857939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-76f1f785-48d1-4755-96c5-e1ed87baa4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:39.918035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:39.932682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1f785-48d1-4755-96c5-e1ed87baa4e0 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:39.938592 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3359/6783] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:35:39 2022] POST /identity/v3/users => generated 290 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:35:39.938728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185215fb-b57f-4e4c-8782-da024e5cc6e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:39.938728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185215fb-b57f-4e4c-8782-da024e5cc6e3 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:39.938728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185215fb-b57f-4e4c-8782-da024e5cc6e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:39.938728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185215fb-b57f-4e4c-8782-da024e5cc6e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:39.940039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8a493-df8f-4129-bfd6-e8c680a36191 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:39.948859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185215fb-b57f-4e4c-8782-da024e5cc6e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:39.950319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185215fb-b57f-4e4c-8782-da024e5cc6e3 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:39.950904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8a493-df8f-4129-bfd6-e8c680a36191 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:39.956576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512dcd8-3d01-4044-87df-f3e59b59230b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:39.957380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512dcd8-3d01-4044-87df-f3e59b59230b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:39.957684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512dcd8-3d01-4044-87df-f3e59b59230b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:39.958035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512dcd8-3d01-4044-87df-f3e59b59230b admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:39.958860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512dcd8-3d01-4044-87df-f3e59b59230b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:39.960608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512dcd8-3d01-4044-87df-f3e59b59230b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:39.962158 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3425/6784] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:35:39.988612 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3360/6785] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:39.989807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185215fb-b57f-4e4c-8782-da024e5cc6e3 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:40.000447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185215fb-b57f-4e4c-8782-da024e5cc6e3 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:40.005328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbacb3-a8e7-4d66-8ef3-ff91af1fc6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:40.005988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbacb3-a8e7-4d66-8ef3-ff91af1fc6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:40.006270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbacb3-a8e7-4d66-8ef3-ff91af1fc6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:40.006543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbacb3-a8e7-4d66-8ef3-ff91af1fc6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:40.007294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbacb3-a8e7-4d66-8ef3-ff91af1fc6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:40.008901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbacb3-a8e7-4d66-8ef3-ff91af1fc6d2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:40.022438 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3426/6786] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:40.023728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512dcd8-3d01-4044-87df-f3e59b59230b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:40.034774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512dcd8-3d01-4044-87df-f3e59b59230b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:40.040818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02d4d9-5013-4fde-9df7-7278fe62d123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:40.041703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02d4d9-5013-4fde-9df7-7278fe62d123 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:40.042319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02d4d9-5013-4fde-9df7-7278fe62d123 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:40.042319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02d4d9-5013-4fde-9df7-7278fe62d123 admin admin] PATH_INFO: `/v3/projects/12ce9d7001054043810d6ae8c948ed8b/users/6b5521fd324f41a3b789f9022f100f1c/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:40.059438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02d4d9-5013-4fde-9df7-7278fe62d123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ce9d7001054043810d6ae8c948ed8b, user_id=6b5521fd324f41a3b789f9022f100f1c, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:40.062167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02d4d9-5013-4fde-9df7-7278fe62d123 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:40.179488 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3361/6787] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:35:40 2022] PUT /identity/v3/projects/12ce9d7001054043810d6ae8c948ed8b/users/6b5521fd324f41a3b789f9022f100f1c/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:40.180870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebc765-2220-486e-871d-91ef65c3c837 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:40.181162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebc765-2220-486e-871d-91ef65c3c837 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:40.181949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebc765-2220-486e-871d-91ef65c3c837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:40.211996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5bebc765-2220-486e-871d-91ef65c3c837 None None] MFA Rules not processed for user `6b5521fd324f41a3b789f9022f100f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:40.213401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5bebc765-2220-486e-871d-91ef65c3c837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:40.293842 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3427/6788] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:40.298893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02d4d9-5013-4fde-9df7-7278fe62d123 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:40.394554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02d4d9-5013-4fde-9df7-7278fe62d123 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:40.400055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098acc7-dc01-4009-b15b-b3fbd7362abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:40.401085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098acc7-dc01-4009-b15b-b3fbd7362abe admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:40.401468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098acc7-dc01-4009-b15b-b3fbd7362abe admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:40.401843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098acc7-dc01-4009-b15b-b3fbd7362abe admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:40.402678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098acc7-dc01-4009-b15b-b3fbd7362abe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:40.404777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098acc7-dc01-4009-b15b-b3fbd7362abe admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:40.494465 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3362/6789] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:35:40 2022] POST /identity/v3/projects => generated 381 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:35:40.499372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebc765-2220-486e-871d-91ef65c3c837 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:40.518449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebc765-2220-486e-871d-91ef65c3c837 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:40.629808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b7a89-6245-4b8d-a1b3-54f7b8ef5b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:40.630496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b7a89-6245-4b8d-a1b3-54f7b8ef5b89 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:40.630784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b7a89-6245-4b8d-a1b3-54f7b8ef5b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:40.633570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b7a89-6245-4b8d-a1b3-54f7b8ef5b89 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:40.634664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b7a89-6245-4b8d-a1b3-54f7b8ef5b89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:40.636664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b7a89-6245-4b8d-a1b3-54f7b8ef5b89 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:40.747702 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3428/6790] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:35:40 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:35:40.751422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098acc7-dc01-4009-b15b-b3fbd7362abe admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:40.770162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:40.778893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098acc7-dc01-4009-b15b-b3fbd7362abe admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:40.801801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae53b4-278e-4577-8ea4-84839b678f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:40.802753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae53b4-278e-4577-8ea4-84839b678f69 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:40.802753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae53b4-278e-4577-8ea4-84839b678f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:40.803083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae53b4-278e-4577-8ea4-84839b678f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:40.803825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae53b4-278e-4577-8ea4-84839b678f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:40.806136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae53b4-278e-4577-8ea4-84839b678f69 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:40.822492 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3363/6791] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:40.829193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b7a89-6245-4b8d-a1b3-54f7b8ef5b89 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:40.844240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b7a89-6245-4b8d-a1b3-54f7b8ef5b89 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:40.857335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d17d0-dbee-41a1-852a-e499c2d010fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:40.857816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d17d0-dbee-41a1-852a-e499c2d010fc admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:40.858235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d17d0-dbee-41a1-852a-e499c2d010fc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:40.858645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d17d0-dbee-41a1-852a-e499c2d010fc admin admin] PATH_INFO: `/v3/projects/3f5d3294336a455d8a52b6b17b57e013/users/d89583ebffc84bbe98d8e9cae08a2307/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:40.882347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d17d0-dbee-41a1-852a-e499c2d010fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5d3294336a455d8a52b6b17b57e013, user_id=d89583ebffc84bbe98d8e9cae08a2307, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:40.887132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d17d0-dbee-41a1-852a-e499c2d010fc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:41.001601 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3429/6792] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:35:40 2022] PUT /identity/v3/projects/3f5d3294336a455d8a52b6b17b57e013/users/d89583ebffc84bbe98d8e9cae08a2307/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:41.005625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae53b4-278e-4577-8ea4-84839b678f69 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:41.018148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae53b4-278e-4577-8ea4-84839b678f69 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:41.095143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac6e19-aa84-4b74-aca3-246261bedbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:41.095946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac6e19-aa84-4b74-aca3-246261bedbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:41.096356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac6e19-aa84-4b74-aca3-246261bedbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:41.097376 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac6e19-aa84-4b74-aca3-246261bedbe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:41.098269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac6e19-aa84-4b74-aca3-246261bedbe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:41.114456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac6e19-aa84-4b74-aca3-246261bedbe2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:41.143937 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3364/6793] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:41.147927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d17d0-dbee-41a1-852a-e499c2d010fc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:41.162325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d17d0-dbee-41a1-852a-e499c2d010fc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:41.173274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bf96b-a0ed-407e-ae73-84601fc19888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:41.173274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bf96b-a0ed-407e-ae73-84601fc19888 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:41.173274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bf96b-a0ed-407e-ae73-84601fc19888 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:41.173274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bf96b-a0ed-407e-ae73-84601fc19888 admin admin] PATH_INFO: `/v3/projects/3f5d3294336a455d8a52b6b17b57e013/users/d89583ebffc84bbe98d8e9cae08a2307/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:41.174153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bf96b-a0ed-407e-ae73-84601fc19888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5d3294336a455d8a52b6b17b57e013, user_id=d89583ebffc84bbe98d8e9cae08a2307, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:41.178373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bf96b-a0ed-407e-ae73-84601fc19888 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:41.227063 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3430/6794] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:35:41 2022] PUT /identity/v3/projects/3f5d3294336a455d8a52b6b17b57e013/users/d89583ebffc84bbe98d8e9cae08a2307/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:41.230799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec5724-3f45-41c0-b5d0-a50acdd99d08 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:41.231121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec5724-3f45-41c0-b5d0-a50acdd99d08 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:41.231406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec5724-3f45-41c0-b5d0-a50acdd99d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:41.283647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-34ec5724-3f45-41c0-b5d0-a50acdd99d08 None None] MFA Rules not processed for user `d89583ebffc84bbe98d8e9cae08a2307`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:41.285712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-34ec5724-3f45-41c0-b5d0-a50acdd99d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:41.443394 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3365/6795] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:41.463662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bf96b-a0ed-407e-ae73-84601fc19888 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:41.465768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-190bf96b-a0ed-407e-ae73-84601fc19888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:41.616535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58020ef3-8f09-496a-b4ca-5d42ec0badf7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:41.617410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58020ef3-8f09-496a-b4ca-5d42ec0badf7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:41.617934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58020ef3-8f09-496a-b4ca-5d42ec0badf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:41.649245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bf96b-a0ed-407e-ae73-84601fc19888 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:41.660356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fe0f0-47d3-4d56-9c36-4ba36dcb9e31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:41.664763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fe0f0-47d3-4d56-9c36-4ba36dcb9e31 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:41.666659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fe0f0-47d3-4d56-9c36-4ba36dcb9e31 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:41.667117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fe0f0-47d3-4d56-9c36-4ba36dcb9e31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:41.694067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-58020ef3-8f09-496a-b4ca-5d42ec0badf7 None None] MFA Rules not processed for user `0368bb7e320642c2b6b3410012c28180`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:41.695470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-58020ef3-8f09-496a-b4ca-5d42ec0badf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:41.717050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fe0f0-47d3-4d56-9c36-4ba36dcb9e31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:41.720201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fe0f0-47d3-4d56-9c36-4ba36dcb9e31 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:41.761705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:41.778384 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3431/6796] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:41.822544 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3366/6797] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:35:41.834233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fe0f0-47d3-4d56-9c36-4ba36dcb9e31 service cinder] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:42.036810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fe0f0-47d3-4d56-9c36-4ba36dcb9e31 service cinder] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:42.050745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1eea6-c832-4eec-8689-7a2f90086138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:42.051485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1eea6-c832-4eec-8689-7a2f90086138 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:42.051773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1eea6-c832-4eec-8689-7a2f90086138 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:42.056462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1eea6-c832-4eec-8689-7a2f90086138 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:42.056462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1eea6-c832-4eec-8689-7a2f90086138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:42.056462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1eea6-c832-4eec-8689-7a2f90086138 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:42.078988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:42.210165 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3432/6798] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:35:41 2022] POST /identity/v3/projects => generated 403 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:35:42.212964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58020ef3-8f09-496a-b4ca-5d42ec0badf7 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:42.243296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58020ef3-8f09-496a-b4ca-5d42ec0badf7 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:42.353700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337ba25-28b9-4db9-b71b-b7b14ac3e9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:42.353700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337ba25-28b9-4db9-b71b-b7b14ac3e9cc admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:42.353700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337ba25-28b9-4db9-b71b-b7b14ac3e9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:42.353700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337ba25-28b9-4db9-b71b-b7b14ac3e9cc admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:42.354876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337ba25-28b9-4db9-b71b-b7b14ac3e9cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:42.356992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337ba25-28b9-4db9-b71b-b7b14ac3e9cc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:42.450470 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3367/6799] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:35:42 2022] POST /identity/v3/users => generated 308 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:35:42.450766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1eea6-c832-4eec-8689-7a2f90086138 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:42.466931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1eea6-c832-4eec-8689-7a2f90086138 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:42.487662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47808b70-3883-4391-9fcf-da4b9d8dcc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:42.488581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47808b70-3883-4391-9fcf-da4b9d8dcc18 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:42.491171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47808b70-3883-4391-9fcf-da4b9d8dcc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:42.491463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47808b70-3883-4391-9fcf-da4b9d8dcc18 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:42.492223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47808b70-3883-4391-9fcf-da4b9d8dcc18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:42.496455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47808b70-3883-4391-9fcf-da4b9d8dcc18 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:42.523821 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3433/6800] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:42.528064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337ba25-28b9-4db9-b71b-b7b14ac3e9cc admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:42.539187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337ba25-28b9-4db9-b71b-b7b14ac3e9cc admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:42.544954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434693be-e6c9-42ca-b146-35357bcf1d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:42.545896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434693be-e6c9-42ca-b146-35357bcf1d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:42.546300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434693be-e6c9-42ca-b146-35357bcf1d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:42.546614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434693be-e6c9-42ca-b146-35357bcf1d68 admin admin] PATH_INFO: `/v3/projects/e85c98bec1b14dd38c05145a133f1d80/users/501a2045193642c391a95ffe9a7ac07a/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:42.564044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434693be-e6c9-42ca-b146-35357bcf1d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85c98bec1b14dd38c05145a133f1d80, user_id=501a2045193642c391a95ffe9a7ac07a, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:42.568252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434693be-e6c9-42ca-b146-35357bcf1d68 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:42.685323 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3368/6801] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:35:42 2022] PUT /identity/v3/projects/e85c98bec1b14dd38c05145a133f1d80/users/501a2045193642c391a95ffe9a7ac07a/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:35:42.686550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47808b70-3883-4391-9fcf-da4b9d8dcc18 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:42.729210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47808b70-3883-4391-9fcf-da4b9d8dcc18 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:42.872690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:42.894828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c916d4c-0eeb-47c3-b916-3b5376839b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:42.895624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c916d4c-0eeb-47c3-b916-3b5376839b0b admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:42.895912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c916d4c-0eeb-47c3-b916-3b5376839b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:42.896190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c916d4c-0eeb-47c3-b916-3b5376839b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:42.898184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c916d4c-0eeb-47c3-b916-3b5376839b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:42.901452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c916d4c-0eeb-47c3-b916-3b5376839b0b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:42.931863 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3434/6802] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:42.935809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434693be-e6c9-42ca-b146-35357bcf1d68 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:42.951353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434693be-e6c9-42ca-b146-35357bcf1d68 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:42.965663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb6938-8523-4acd-bff5-b75ebe971c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:42.967513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb6938-8523-4acd-bff5-b75ebe971c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:42.972240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb6938-8523-4acd-bff5-b75ebe971c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:42.973518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb6938-8523-4acd-bff5-b75ebe971c98 admin admin] PATH_INFO: `/v3/projects/e85c98bec1b14dd38c05145a133f1d80/users/501a2045193642c391a95ffe9a7ac07a/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:42.979061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb6938-8523-4acd-bff5-b75ebe971c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85c98bec1b14dd38c05145a133f1d80, user_id=501a2045193642c391a95ffe9a7ac07a, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:42.982095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb6938-8523-4acd-bff5-b75ebe971c98 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:43.007505 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3369/6803] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:35:42 2022] PUT /identity/v3/projects/e85c98bec1b14dd38c05145a133f1d80/users/501a2045193642c391a95ffe9a7ac07a/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:43.265938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c916d4c-0eeb-47c3-b916-3b5376839b0b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:43.373664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c916d4c-0eeb-47c3-b916-3b5376839b0b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:43.451667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd9023-8166-4751-868c-7bd497bdd555 tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89583ebffc84bbe98d8e9cae08a2307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f5d3294336a455d8a52b6b17b57e013', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:43.452608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd9023-8166-4751-868c-7bd497bdd555 tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:43.452906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd9023-8166-4751-868c-7bd497bdd555 tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:43.453186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd9023-8166-4751-868c-7bd497bdd555 tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:43.453984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd9023-8166-4751-868c-7bd497bdd555 tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:35:43.454456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd9023-8166-4751-868c-7bd497bdd555 tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:43.456677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd9023-8166-4751-868c-7bd497bdd555 tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:43.471213 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3435/6804] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:35:43.476078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb6938-8523-4acd-bff5-b75ebe971c98 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:43.489614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb6938-8523-4acd-bff5-b75ebe971c98 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:43.494320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4027b9-497e-465b-9578-801876ac6828 tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89583ebffc84bbe98d8e9cae08a2307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f5d3294336a455d8a52b6b17b57e013', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:43.495000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4027b9-497e-465b-9578-801876ac6828 tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:43.495322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4027b9-497e-465b-9578-801876ac6828 tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:43.495597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4027b9-497e-465b-9578-801876ac6828 tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:43.496688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4027b9-497e-465b-9578-801876ac6828 tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:43.498869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4027b9-497e-465b-9578-801876ac6828 tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:43.666431 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3370/6805] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:35:43 2022] POST /identity/v3/projects => generated 355 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:35:43.671969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd9023-8166-4751-868c-7bd497bdd555 tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:43.683475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd9023-8166-4751-868c-7bd497bdd555 tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:43.789101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99383373-5e7f-4f6c-84b8-fae97b31768f tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89583ebffc84bbe98d8e9cae08a2307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f5d3294336a455d8a52b6b17b57e013', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:43.789924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99383373-5e7f-4f6c-84b8-fae97b31768f tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:43.790223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99383373-5e7f-4f6c-84b8-fae97b31768f tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:43.790739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99383373-5e7f-4f6c-84b8-fae97b31768f tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:43.791582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99383373-5e7f-4f6c-84b8-fae97b31768f tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:35:43.792089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99383373-5e7f-4f6c-84b8-fae97b31768f tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:43.800879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99383373-5e7f-4f6c-84b8-fae97b31768f tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:43.815884 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3436/6806] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:35:43.866735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4027b9-497e-465b-9578-801876ac6828 tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:43.882414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4027b9-497e-465b-9578-801876ac6828 tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:43.888495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d342518-7713-421d-9c74-807c8e65d29b tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89583ebffc84bbe98d8e9cae08a2307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f5d3294336a455d8a52b6b17b57e013', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:43.889581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d342518-7713-421d-9c74-807c8e65d29b tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:43.889769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d342518-7713-421d-9c74-807c8e65d29b tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:43.890170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d342518-7713-421d-9c74-807c8e65d29b tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] PATH_INFO: `/v3/projects/9262f32a7dd145e2aaf64968bdeab3cc` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:43.891572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d342518-7713-421d-9c74-807c8e65d29b tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9262f32a7dd145e2aaf64968bdeab3cc)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:43.893752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d342518-7713-421d-9c74-807c8e65d29b tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:43.963062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:44.030363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6d342518-7713-421d-9c74-807c8e65d29b tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9262f32a7dd145e2aaf64968bdeab3cc', 'request_id': 'req-6d342518-7713-421d-9c74-807c8e65d29b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:44.036930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6d342518-7713-421d-9c74-807c8e65d29b tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9262f32a7dd145e2aaf64968bdeab3cc', 'request_id': 'req-6d342518-7713-421d-9c74-807c8e65d29b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:44.048778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6d342518-7713-421d-9c74-807c8e65d29b tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9262f32a7dd145e2aaf64968bdeab3cc', 'request_id': 'req-6d342518-7713-421d-9c74-807c8e65d29b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:44.206197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6d342518-7713-421d-9c74-807c8e65d29b tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] The token cache is being invalidate because project 9262f32a7dd145e2aaf64968bdeab3cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:35:44.206631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6d342518-7713-421d-9c74-807c8e65d29b tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:44.207438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6d342518-7713-421d-9c74-807c8e65d29b tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:44.210890 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3371/6807] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:35:43 2022] DELETE /identity/v3/projects/9262f32a7dd145e2aaf64968bdeab3cc => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:44.243766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:45.122054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99383373-5e7f-4f6c-84b8-fae97b31768f tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:45.127535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-99383373-5e7f-4f6c-84b8-fae97b31768f tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:45.227250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99383373-5e7f-4f6c-84b8-fae97b31768f tempest-VolumeQuotaClassesTest-1217255583 tempest-VolumeQuotaClassesTest-1217255583-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:45.316660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699f673-6847-4328-acde-f11e592f62dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:45.318522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699f673-6847-4328-acde-f11e592f62dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:45.318522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699f673-6847-4328-acde-f11e592f62dc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:45.318758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699f673-6847-4328-acde-f11e592f62dc admin admin] PATH_INFO: `/v3/users/6b5521fd324f41a3b789f9022f100f1c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:45.320636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699f673-6847-4328-acde-f11e592f62dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b5521fd324f41a3b789f9022f100f1c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:45.323034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699f673-6847-4328-acde-f11e592f62dc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:45.583180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c699f673-6847-4328-acde-f11e592f62dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b5521fd324f41a3b789f9022f100f1c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:45.592751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c699f673-6847-4328-acde-f11e592f62dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b5521fd324f41a3b789f9022f100f1c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:45.599772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:45.677476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c699f673-6847-4328-acde-f11e592f62dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b5521fd324f41a3b789f9022f100f1c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:45.678131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c699f673-6847-4328-acde-f11e592f62dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b5521fd324f41a3b789f9022f100f1c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:45.695029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c699f673-6847-4328-acde-f11e592f62dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b5521fd324f41a3b789f9022f100f1c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:45.701830 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3437/6808] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:35:45 2022] DELETE /identity/v3/users/6b5521fd324f41a3b789f9022f100f1c => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:45.706961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e80dad-2cfb-4388-af57-1b8d636ca413 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:45.707329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e80dad-2cfb-4388-af57-1b8d636ca413 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:45.709671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e80dad-2cfb-4388-af57-1b8d636ca413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:45.740344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-58e80dad-2cfb-4388-af57-1b8d636ca413 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:45.741831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-58e80dad-2cfb-4388-af57-1b8d636ca413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:45.849789 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3372/6809] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:45.859900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699f673-6847-4328-acde-f11e592f62dc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:45.864914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c699f673-6847-4328-acde-f11e592f62dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:45.894385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:45.952609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699f673-6847-4328-acde-f11e592f62dc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:45.969157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0eb4d-b936-418b-9ee6-705184887f60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:45.969157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0eb4d-b936-418b-9ee6-705184887f60 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:45.969157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0eb4d-b936-418b-9ee6-705184887f60 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:45.969157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0eb4d-b936-418b-9ee6-705184887f60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:45.969449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751022c-6a28-4415-b793-d07e98ee993a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:45.969449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751022c-6a28-4415-b793-d07e98ee993a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:45.969449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751022c-6a28-4415-b793-d07e98ee993a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:45.980942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0eb4d-b936-418b-9ee6-705184887f60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:45.984220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0eb4d-b936-418b-9ee6-705184887f60 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:45.984333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1751022c-6a28-4415-b793-d07e98ee993a None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:45.985574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1751022c-6a28-4415-b793-d07e98ee993a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:46.011074 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3438/6810] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:46.077131 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3373/6811] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:35:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:35:46.087386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0eb4d-b936-418b-9ee6-705184887f60 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:46.089227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-39a0eb4d-b936-418b-9ee6-705184887f60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:46.181488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0eb4d-b936-418b-9ee6-705184887f60 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:46.186624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f56708-b1f4-46c6-9bd0-c733e9ae8055 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:46.187297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f56708-b1f4-46c6-9bd0-c733e9ae8055 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:46.187576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f56708-b1f4-46c6-9bd0-c733e9ae8055 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:46.187869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f56708-b1f4-46c6-9bd0-c733e9ae8055 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:46.196661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f56708-b1f4-46c6-9bd0-c733e9ae8055 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:46.198281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f56708-b1f4-46c6-9bd0-c733e9ae8055 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:46.208210 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3439/6812] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:35:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:35:46.370315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:46.610751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751022c-6a28-4415-b793-d07e98ee993a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:46.613193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1751022c-6a28-4415-b793-d07e98ee993a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:46.633633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751022c-6a28-4415-b793-d07e98ee993a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:46.638989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9839fbf-d0b7-46fe-93a8-c01c38a8089d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:46.640429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9839fbf-d0b7-46fe-93a8-c01c38a8089d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:46.640813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9839fbf-d0b7-46fe-93a8-c01c38a8089d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:46.641196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9839fbf-d0b7-46fe-93a8-c01c38a8089d admin admin] PATH_INFO: `/v3/projects/12ce9d7001054043810d6ae8c948ed8b` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:46.642577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9839fbf-d0b7-46fe-93a8-c01c38a8089d admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ce9d7001054043810d6ae8c948ed8b)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:46.646144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9839fbf-d0b7-46fe-93a8-c01c38a8089d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:46.713939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e5316-aab1-4c1c-b438-ff07f63cf726 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:46.714247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e5316-aab1-4c1c-b438-ff07f63cf726 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:46.714532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e5316-aab1-4c1c-b438-ff07f63cf726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:46.745446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ee9e5316-aab1-4c1c-b438-ff07f63cf726 None None] MFA Rules not processed for user `501a2045193642c391a95ffe9a7ac07a`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:46.746708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ee9e5316-aab1-4c1c-b438-ff07f63cf726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:46.854885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f9839fbf-d0b7-46fe-93a8-c01c38a8089d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ce9d7001054043810d6ae8c948ed8b', 'request_id': 'req-f9839fbf-d0b7-46fe-93a8-c01c38a8089d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:46.870746 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3440/6813] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:46 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:35:46.881972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f9839fbf-d0b7-46fe-93a8-c01c38a8089d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ce9d7001054043810d6ae8c948ed8b', 'request_id': 'req-f9839fbf-d0b7-46fe-93a8-c01c38a8089d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:46.890268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e5316-aab1-4c1c-b438-ff07f63cf726 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:46.891874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ee9e5316-aab1-4c1c-b438-ff07f63cf726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:46.905215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f9839fbf-d0b7-46fe-93a8-c01c38a8089d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ce9d7001054043810d6ae8c948ed8b', 'request_id': 'req-f9839fbf-d0b7-46fe-93a8-c01c38a8089d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:46.923770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e5316-aab1-4c1c-b438-ff07f63cf726 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:47.011918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f9839fbf-d0b7-46fe-93a8-c01c38a8089d admin admin] The token cache is being invalidate because project 12ce9d7001054043810d6ae8c948ed8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:35:47.013610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f9839fbf-d0b7-46fe-93a8-c01c38a8089d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:47.013907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f9839fbf-d0b7-46fe-93a8-c01c38a8089d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:47.015941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b317d95-7ab0-41a9-b6e4-32c3e2c9cab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:47.017751 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3374/6814] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:35:46 2022] DELETE /identity/v3/projects/12ce9d7001054043810d6ae8c948ed8b => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:47.022349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b317d95-7ab0-41a9-b6e4-32c3e2c9cab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:47.022578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b317d95-7ab0-41a9-b6e4-32c3e2c9cab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:47.022848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b317d95-7ab0-41a9-b6e4-32c3e2c9cab6 admin admin] PATH_INFO: `/v3/users/90540ab472324f9988e33e4fcc4eaebd` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:47.023578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9839fbf-d0b7-46fe-93a8-c01c38a8089d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:47.024335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b317d95-7ab0-41a9-b6e4-32c3e2c9cab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90540ab472324f9988e33e4fcc4eaebd)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:47.025654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f9839fbf-d0b7-46fe-93a8-c01c38a8089d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:47.026663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b317d95-7ab0-41a9-b6e4-32c3e2c9cab6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:47.055771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9839fbf-d0b7-46fe-93a8-c01c38a8089d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:47.068688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662209a-25a6-4024-9ff5-e1c090aca599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:47.070893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662209a-25a6-4024-9ff5-e1c090aca599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:47.071437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662209a-25a6-4024-9ff5-e1c090aca599 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:47.071868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662209a-25a6-4024-9ff5-e1c090aca599 admin admin] PATH_INFO: `/v3/users/d89583ebffc84bbe98d8e9cae08a2307` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:47.073384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662209a-25a6-4024-9ff5-e1c090aca599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d89583ebffc84bbe98d8e9cae08a2307)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:47.077448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662209a-25a6-4024-9ff5-e1c090aca599 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:47.294638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3b317d95-7ab0-41a9-b6e4-32c3e2c9cab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90540ab472324f9988e33e4fcc4eaebd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:47.301328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8662209a-25a6-4024-9ff5-e1c090aca599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd89583ebffc84bbe98d8e9cae08a2307'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:47.313901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3b317d95-7ab0-41a9-b6e4-32c3e2c9cab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90540ab472324f9988e33e4fcc4eaebd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:47.317525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8662209a-25a6-4024-9ff5-e1c090aca599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd89583ebffc84bbe98d8e9cae08a2307'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:47.472723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:47.550313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3b317d95-7ab0-41a9-b6e4-32c3e2c9cab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90540ab472324f9988e33e4fcc4eaebd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:47.550313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3b317d95-7ab0-41a9-b6e4-32c3e2c9cab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90540ab472324f9988e33e4fcc4eaebd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:47.562578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3b317d95-7ab0-41a9-b6e4-32c3e2c9cab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90540ab472324f9988e33e4fcc4eaebd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:47.574042 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3441/6815] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:35:46 2022] DELETE /identity/v3/users/90540ab472324f9988e33e4fcc4eaebd => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:47.578802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb3836-307b-436d-94aa-3036b8851bac None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:47.578802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb3836-307b-436d-94aa-3036b8851bac None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:47.578802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb3836-307b-436d-94aa-3036b8851bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:47.600209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d5fb3836-307b-436d-94aa-3036b8851bac None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:47.602261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d5fb3836-307b-436d-94aa-3036b8851bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:47.673376 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3442/6816] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:47.673984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8662209a-25a6-4024-9ff5-e1c090aca599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd89583ebffc84bbe98d8e9cae08a2307'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:47.681806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8662209a-25a6-4024-9ff5-e1c090aca599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd89583ebffc84bbe98d8e9cae08a2307'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:47.681998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb3836-307b-436d-94aa-3036b8851bac None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:47.682728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8662209a-25a6-4024-9ff5-e1c090aca599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd89583ebffc84bbe98d8e9cae08a2307'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:47.683463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d5fb3836-307b-436d-94aa-3036b8851bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:47.697556 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3375/6817] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:35:47 2022] DELETE /identity/v3/users/d89583ebffc84bbe98d8e9cae08a2307 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:47.765849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb3836-307b-436d-94aa-3036b8851bac None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:47.843060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2d8bf-03eb-4957-b749-07b097a6a8e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:47.843867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d8bf-03eb-4957-b749-07b097a6a8e6 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:47.844196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d8bf-03eb-4957-b749-07b097a6a8e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:47.844535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d8bf-03eb-4957-b749-07b097a6a8e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:47.846732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4de2d8bf-03eb-4957-b749-07b097a6a8e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:47.921505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2d8bf-03eb-4957-b749-07b097a6a8e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:47.923112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2d8bf-03eb-4957-b749-07b097a6a8e6 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:47.935597 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3443/6818] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:35:48.014898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:48.083046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:48.302623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662209a-25a6-4024-9ff5-e1c090aca599 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:48.304617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8662209a-25a6-4024-9ff5-e1c090aca599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:48.338208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662209a-25a6-4024-9ff5-e1c090aca599 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:48.347456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38060ac-25b3-4737-b1c1-04a8b44605d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:48.348774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38060ac-25b3-4737-b1c1-04a8b44605d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:48.349197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38060ac-25b3-4737-b1c1-04a8b44605d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:48.349614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38060ac-25b3-4737-b1c1-04a8b44605d1 admin admin] PATH_INFO: `/v3/projects/3f5d3294336a455d8a52b6b17b57e013` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:48.351269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38060ac-25b3-4737-b1c1-04a8b44605d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f5d3294336a455d8a52b6b17b57e013)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:48.355610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38060ac-25b3-4737-b1c1-04a8b44605d1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:48.524031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e38060ac-25b3-4737-b1c1-04a8b44605d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f5d3294336a455d8a52b6b17b57e013', 'request_id': 'req-e38060ac-25b3-4737-b1c1-04a8b44605d1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:48.530053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e38060ac-25b3-4737-b1c1-04a8b44605d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f5d3294336a455d8a52b6b17b57e013', 'request_id': 'req-e38060ac-25b3-4737-b1c1-04a8b44605d1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:48.540069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e38060ac-25b3-4737-b1c1-04a8b44605d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f5d3294336a455d8a52b6b17b57e013', 'request_id': 'req-e38060ac-25b3-4737-b1c1-04a8b44605d1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:48.545872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2d8bf-03eb-4957-b749-07b097a6a8e6 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:48.548995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4de2d8bf-03eb-4957-b749-07b097a6a8e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:48.569222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2d8bf-03eb-4957-b749-07b097a6a8e6 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:48.643965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fb290-09c2-49bb-bafa-7d1d8da61a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:48.644987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fb290-09c2-49bb-bafa-7d1d8da61a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:48.645273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fb290-09c2-49bb-bafa-7d1d8da61a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:48.645548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fb290-09c2-49bb-bafa-7d1d8da61a1b admin admin] PATH_INFO: `/v3/projects/dd90fa9beaa1427ba08d9c19e794e4a8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:48.651893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fb290-09c2-49bb-bafa-7d1d8da61a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd90fa9beaa1427ba08d9c19e794e4a8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:48.654389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fb290-09c2-49bb-bafa-7d1d8da61a1b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:48.662070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e38060ac-25b3-4737-b1c1-04a8b44605d1 admin admin] The token cache is being invalidate because project 3f5d3294336a455d8a52b6b17b57e013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:35:48.662542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e38060ac-25b3-4737-b1c1-04a8b44605d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:48.663391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e38060ac-25b3-4737-b1c1-04a8b44605d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:48.665179 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3376/6819] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:35:48 2022] DELETE /identity/v3/projects/3f5d3294336a455d8a52b6b17b57e013 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:48.672252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a06b8-751e-481d-9b52-e690317fb7fb None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:48.672802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a06b8-751e-481d-9b52-e690317fb7fb None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:48.673153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a06b8-751e-481d-9b52-e690317fb7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:48.702426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f55a06b8-751e-481d-9b52-e690317fb7fb None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:48.704663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f55a06b8-751e-481d-9b52-e690317fb7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:48.734510 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3377/6820] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:35:48.736828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf1e09-d8ed-4957-93a8-7961eecee683 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:48.737240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf1e09-d8ed-4957-93a8-7961eecee683 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:48.739361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf1e09-d8ed-4957-93a8-7961eecee683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:48.763957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6caf1e09-d8ed-4957-93a8-7961eecee683 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:48.765563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6caf1e09-d8ed-4957-93a8-7961eecee683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:48.779190 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3378/6821] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:48.784631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf1e09-d8ed-4957-93a8-7961eecee683 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:48.804726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf1e09-d8ed-4957-93a8-7961eecee683 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:48.809044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5f7fb290-09c2-49bb-bafa-7d1d8da61a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd90fa9beaa1427ba08d9c19e794e4a8', 'request_id': 'req-5f7fb290-09c2-49bb-bafa-7d1d8da61a1b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:48.820535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5f7fb290-09c2-49bb-bafa-7d1d8da61a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd90fa9beaa1427ba08d9c19e794e4a8', 'request_id': 'req-5f7fb290-09c2-49bb-bafa-7d1d8da61a1b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:48.836078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5f7fb290-09c2-49bb-bafa-7d1d8da61a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd90fa9beaa1427ba08d9c19e794e4a8', 'request_id': 'req-5f7fb290-09c2-49bb-bafa-7d1d8da61a1b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:48.907021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d321c-e046-4600-bccf-e7fe558674c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:48.908269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d321c-e046-4600-bccf-e7fe558674c5 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:48.908552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d321c-e046-4600-bccf-e7fe558674c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:48.908829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d321c-e046-4600-bccf-e7fe558674c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:48.911228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d321c-e046-4600-bccf-e7fe558674c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:35:48.911546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d321c-e046-4600-bccf-e7fe558674c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:48.913828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d321c-e046-4600-bccf-e7fe558674c5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:48.924654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5f7fb290-09c2-49bb-bafa-7d1d8da61a1b admin admin] The token cache is being invalidate because project dd90fa9beaa1427ba08d9c19e794e4a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:35:48.925440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5f7fb290-09c2-49bb-bafa-7d1d8da61a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:48.926327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5f7fb290-09c2-49bb-bafa-7d1d8da61a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:48.928286 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3444/6822] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:35:48 2022] DELETE /identity/v3/projects/dd90fa9beaa1427ba08d9c19e794e4a8 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:48.933495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4be6b-d5c9-4203-8bad-3887e10e408d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:48.934812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4be6b-d5c9-4203-8bad-3887e10e408d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:48.935271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4be6b-d5c9-4203-8bad-3887e10e408d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:48.952244 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3379/6823] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:35:48.953408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d321c-e046-4600-bccf-e7fe558674c5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:48.955279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-760d321c-e046-4600-bccf-e7fe558674c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:48.976793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-24e4be6b-d5c9-4203-8bad-3887e10e408d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:48.977921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d321c-e046-4600-bccf-e7fe558674c5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:48.978128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-24e4be6b-d5c9-4203-8bad-3887e10e408d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:48.984170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7045f76-6f8d-4e69-b649-52cba3d374e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:48.985399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7045f76-6f8d-4e69-b649-52cba3d374e5 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:48.985946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7045f76-6f8d-4e69-b649-52cba3d374e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:48.986405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7045f76-6f8d-4e69-b649-52cba3d374e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:48.987388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7045f76-6f8d-4e69-b649-52cba3d374e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:48.989966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7045f76-6f8d-4e69-b649-52cba3d374e5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:48.994287 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3445/6824] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:48.995898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd289a-787a-427a-ad52-5df8061c2cb4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:48.996197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd289a-787a-427a-ad52-5df8061c2cb4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:48.996482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd289a-787a-427a-ad52-5df8061c2cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:49.017866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-dbcd289a-787a-427a-ad52-5df8061c2cb4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:49.019731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dbcd289a-787a-427a-ad52-5df8061c2cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:49.029734 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3446/6825] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:49.035452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd289a-787a-427a-ad52-5df8061c2cb4 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:49.060885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd289a-787a-427a-ad52-5df8061c2cb4 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:49.070664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732088b-41d2-4106-99c7-d163a1b52341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:49.080581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732088b-41d2-4106-99c7-d163a1b52341 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:49.081632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732088b-41d2-4106-99c7-d163a1b52341 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:49.081874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732088b-41d2-4106-99c7-d163a1b52341 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:49.082851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732088b-41d2-4106-99c7-d163a1b52341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:35:49.083195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732088b-41d2-4106-99c7-d163a1b52341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:49.085786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732088b-41d2-4106-99c7-d163a1b52341 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:49.101302 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3447/6826] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:35:49.101830 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3380/6827] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:35:48 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:35:49.102291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732088b-41d2-4106-99c7-d163a1b52341 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:49.106103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7045f76-6f8d-4e69-b649-52cba3d374e5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:49.122734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732088b-41d2-4106-99c7-d163a1b52341 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:49.235332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7045f76-6f8d-4e69-b649-52cba3d374e5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:49.246087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f14307-83dd-4c6c-87d3-674886c50987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:49.247272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f14307-83dd-4c6c-87d3-674886c50987 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:49.248546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f14307-83dd-4c6c-87d3-674886c50987 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:49.249641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f14307-83dd-4c6c-87d3-674886c50987 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:49.249920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4413568-7ba6-4e5c-87d8-9b9f7500003d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:49.250696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4413568-7ba6-4e5c-87d8-9b9f7500003d admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:49.251559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f14307-83dd-4c6c-87d3-674886c50987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:49.251957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4413568-7ba6-4e5c-87d8-9b9f7500003d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:49.253168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4413568-7ba6-4e5c-87d8-9b9f7500003d admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:49.255796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4413568-7ba6-4e5c-87d8-9b9f7500003d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:49.257992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4413568-7ba6-4e5c-87d8-9b9f7500003d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:49.258684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f14307-83dd-4c6c-87d3-674886c50987 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:49.394173 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3381/6829] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:35:49 2022] POST /identity/v3/projects => generated 375 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:35:49.396543 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3448/6828] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:35:49 2022] POST /identity/v3/users => generated 294 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:35:49.397671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4413568-7ba6-4e5c-87d8-9b9f7500003d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:49.397960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f14307-83dd-4c6c-87d3-674886c50987 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:49.412447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f14307-83dd-4c6c-87d3-674886c50987 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:49.478545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4413568-7ba6-4e5c-87d8-9b9f7500003d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:49.485080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af437ad-a97f-4b37-97e4-fa9d1a348702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:49.485997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af437ad-a97f-4b37-97e4-fa9d1a348702 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:49.486469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af437ad-a97f-4b37-97e4-fa9d1a348702 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:49.487106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af437ad-a97f-4b37-97e4-fa9d1a348702 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:49.489723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af437ad-a97f-4b37-97e4-fa9d1a348702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:49.491600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af437ad-a97f-4b37-97e4-fa9d1a348702 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:49.514183 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3382/6830] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:35:49.518146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af437ad-a97f-4b37-97e4-fa9d1a348702 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:49.544370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb39b6c-a5d6-4795-a0ea-4b108f26e557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:49.545371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb39b6c-a5d6-4795-a0ea-4b108f26e557 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:49.546150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb39b6c-a5d6-4795-a0ea-4b108f26e557 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:49.547086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb39b6c-a5d6-4795-a0ea-4b108f26e557 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:49.547950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb39b6c-a5d6-4795-a0ea-4b108f26e557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:49.551794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb39b6c-a5d6-4795-a0ea-4b108f26e557 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:49.568747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af437ad-a97f-4b37-97e4-fa9d1a348702 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:49.582879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3b7f6-71f4-4aa6-a8f7-7ddccfe9d1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:49.583965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3b7f6-71f4-4aa6-a8f7-7ddccfe9d1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:49.584443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3b7f6-71f4-4aa6-a8f7-7ddccfe9d1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:49.585042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3b7f6-71f4-4aa6-a8f7-7ddccfe9d1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:49.586126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3b7f6-71f4-4aa6-a8f7-7ddccfe9d1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:49.588325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3b7f6-71f4-4aa6-a8f7-7ddccfe9d1f3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:49.600526 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3383/6831] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:49.601383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3b7f6-71f4-4aa6-a8f7-7ddccfe9d1f3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:49.603205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-83c3b7f6-71f4-4aa6-a8f7-7ddccfe9d1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:49.619129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3b7f6-71f4-4aa6-a8f7-7ddccfe9d1f3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:49.625037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273a347-9bac-4892-80fe-2cf4fa7acebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:49.625989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273a347-9bac-4892-80fe-2cf4fa7acebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:49.626278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273a347-9bac-4892-80fe-2cf4fa7acebd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:49.626569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273a347-9bac-4892-80fe-2cf4fa7acebd admin admin] PATH_INFO: `/v3/users/0368bb7e320642c2b6b3410012c28180` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:49.630590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273a347-9bac-4892-80fe-2cf4fa7acebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0368bb7e320642c2b6b3410012c28180)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:49.630917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273a347-9bac-4892-80fe-2cf4fa7acebd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:49.703240 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3449/6832] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:35:49 2022] POST /identity/v3/users => generated 288 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:35:49.704256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb39b6c-a5d6-4795-a0ea-4b108f26e557 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:49.722450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb39b6c-a5d6-4795-a0ea-4b108f26e557 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:49.734448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca158fd0-b6e6-4cb5-b4d8-7030a4719340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:49.735476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca158fd0-b6e6-4cb5-b4d8-7030a4719340 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:49.735916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca158fd0-b6e6-4cb5-b4d8-7030a4719340 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:49.736413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca158fd0-b6e6-4cb5-b4d8-7030a4719340 admin admin] PATH_INFO: `/v3/projects/d3cbf1e2ddad48cc9bfc38e8c93ed63b/users/3c57c0a417d94a51907ac4dd4509a322/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:49.755344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca158fd0-b6e6-4cb5-b4d8-7030a4719340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3cbf1e2ddad48cc9bfc38e8c93ed63b, user_id=3c57c0a417d94a51907ac4dd4509a322, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:49.758633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca158fd0-b6e6-4cb5-b4d8-7030a4719340 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:49.867989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7273a347-9bac-4892-80fe-2cf4fa7acebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0368bb7e320642c2b6b3410012c28180'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:49.884358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7273a347-9bac-4892-80fe-2cf4fa7acebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0368bb7e320642c2b6b3410012c28180'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:49.893660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:49.908950 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3450/6833] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:35:49 2022] PUT /identity/v3/projects/d3cbf1e2ddad48cc9bfc38e8c93ed63b/users/3c57c0a417d94a51907ac4dd4509a322/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:49.910476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca158fd0-b6e6-4cb5-b4d8-7030a4719340 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:49.967252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:49.997482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7273a347-9bac-4892-80fe-2cf4fa7acebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0368bb7e320642c2b6b3410012c28180'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:50.010068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7273a347-9bac-4892-80fe-2cf4fa7acebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0368bb7e320642c2b6b3410012c28180'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:50.011357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7273a347-9bac-4892-80fe-2cf4fa7acebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0368bb7e320642c2b6b3410012c28180'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:50.014350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca158fd0-b6e6-4cb5-b4d8-7030a4719340 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:50.022369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51260c2-ea60-4568-b840-1c5d9248bb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:50.023097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51260c2-ea60-4568-b840-1c5d9248bb49 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:50.023391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51260c2-ea60-4568-b840-1c5d9248bb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:50.023669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51260c2-ea60-4568-b840-1c5d9248bb49 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:50.024401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51260c2-ea60-4568-b840-1c5d9248bb49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:50.026020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51260c2-ea60-4568-b840-1c5d9248bb49 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:50.030534 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3384/6834] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:35:49 2022] DELETE /identity/v3/users/0368bb7e320642c2b6b3410012c28180 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:50.035441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40597e-13ea-4df4-9d93-d94d23c11a39 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:50.035728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40597e-13ea-4df4-9d93-d94d23c11a39 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:50.036009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40597e-13ea-4df4-9d93-d94d23c11a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:50.047769 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3451/6835] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:50.052094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51260c2-ea60-4568-b840-1c5d9248bb49 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:50.055274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c51260c2-ea60-4568-b840-1c5d9248bb49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:50.071956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51260c2-ea60-4568-b840-1c5d9248bb49 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:50.111869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-dd40597e-13ea-4df4-9d93-d94d23c11a39 None None] MFA Rules not processed for user `3c57c0a417d94a51907ac4dd4509a322`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:50.113850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-dd40597e-13ea-4df4-9d93-d94d23c11a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:50.195273 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3385/6836] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:50.200112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40597e-13ea-4df4-9d93-d94d23c11a39 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:50.201603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-dd40597e-13ea-4df4-9d93-d94d23c11a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:50.223133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cfbfd-0ab7-48cd-b961-f1b499f0505f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:50.224393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cfbfd-0ab7-48cd-b961-f1b499f0505f admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:50.224941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cfbfd-0ab7-48cd-b961-f1b499f0505f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:50.225378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cfbfd-0ab7-48cd-b961-f1b499f0505f admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:50.227033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cfbfd-0ab7-48cd-b961-f1b499f0505f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:50.231727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cfbfd-0ab7-48cd-b961-f1b499f0505f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:50.246955 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3452/6837] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:35:50.252385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cfbfd-0ab7-48cd-b961-f1b499f0505f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:50.272560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cfbfd-0ab7-48cd-b961-f1b499f0505f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:50.278767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc64d89-0709-4ccc-9e3d-6338161261cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:50.280431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc64d89-0709-4ccc-9e3d-6338161261cf admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:50.280881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc64d89-0709-4ccc-9e3d-6338161261cf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:50.281312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc64d89-0709-4ccc-9e3d-6338161261cf admin admin] PATH_INFO: `/v3/projects/17f9e0949e6b4269843b7afbdcb192eb/users/8a57d14469064f9f99a655a79f19a59e/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:50.289314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40597e-13ea-4df4-9d93-d94d23c11a39 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:50.295184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59906fba-0a07-459a-b1df-1a47bbb93f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:50.295902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59906fba-0a07-459a-b1df-1a47bbb93f45 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:50.296153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59906fba-0a07-459a-b1df-1a47bbb93f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:50.296488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59906fba-0a07-459a-b1df-1a47bbb93f45 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:50.297383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59906fba-0a07-459a-b1df-1a47bbb93f45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:50.299342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59906fba-0a07-459a-b1df-1a47bbb93f45 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:50.311221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc64d89-0709-4ccc-9e3d-6338161261cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f9e0949e6b4269843b7afbdcb192eb, user_id=8a57d14469064f9f99a655a79f19a59e, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:50.316965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc64d89-0709-4ccc-9e3d-6338161261cf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:50.431529 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3386/6838] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:35:50 2022] POST /identity/v3/projects => generated 381 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:35:50.432924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59906fba-0a07-459a-b1df-1a47bbb93f45 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:50.475287 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3453/6839] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:35:50 2022] PUT /identity/v3/projects/17f9e0949e6b4269843b7afbdcb192eb/users/8a57d14469064f9f99a655a79f19a59e/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:50.476502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc64d89-0709-4ccc-9e3d-6338161261cf admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:50.479823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dcc64d89-0709-4ccc-9e3d-6338161261cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:50.542243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59906fba-0a07-459a-b1df-1a47bbb93f45 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:50.633884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc64d89-0709-4ccc-9e3d-6338161261cf admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:50.634392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc42595-edec-4f2f-8663-430fdccd5060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:50.635310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc42595-edec-4f2f-8663-430fdccd5060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:50.635756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc42595-edec-4f2f-8663-430fdccd5060 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:50.636181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc42595-edec-4f2f-8663-430fdccd5060 admin admin] PATH_INFO: `/v3/projects/73bc538f457d45d88c56a23d946a04be` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:50.637763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc42595-edec-4f2f-8663-430fdccd5060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73bc538f457d45d88c56a23d946a04be)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:50.639785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc42595-edec-4f2f-8663-430fdccd5060 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:50.683514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce4b2b-4671-4dd3-a919-e17152cd4f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:50.684206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce4b2b-4671-4dd3-a919-e17152cd4f23 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:50.684520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce4b2b-4671-4dd3-a919-e17152cd4f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:50.687269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce4b2b-4671-4dd3-a919-e17152cd4f23 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:50.687269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce4b2b-4671-4dd3-a919-e17152cd4f23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:50.688004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce4b2b-4671-4dd3-a919-e17152cd4f23 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:50.804192 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3387/6840] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:35:50 2022] POST /identity/v3/users => generated 291 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:35:50.805675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3c61c-c8ff-4857-acad-fb9ec348365f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:50.806115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3c61c-c8ff-4857-acad-fb9ec348365f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:50.806544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3c61c-c8ff-4857-acad-fb9ec348365f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:50.815875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6bc42595-edec-4f2f-8663-430fdccd5060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73bc538f457d45d88c56a23d946a04be', 'request_id': 'req-6bc42595-edec-4f2f-8663-430fdccd5060'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:50.830124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6bc42595-edec-4f2f-8663-430fdccd5060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73bc538f457d45d88c56a23d946a04be', 'request_id': 'req-6bc42595-edec-4f2f-8663-430fdccd5060'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:50.837220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6bc42595-edec-4f2f-8663-430fdccd5060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73bc538f457d45d88c56a23d946a04be', 'request_id': 'req-6bc42595-edec-4f2f-8663-430fdccd5060'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:50.841823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ced3c61c-c8ff-4857-acad-fb9ec348365f None None] MFA Rules not processed for user `8a57d14469064f9f99a655a79f19a59e`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:50.848037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ced3c61c-c8ff-4857-acad-fb9ec348365f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:50.922319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6bc42595-edec-4f2f-8663-430fdccd5060 admin admin] The token cache is being invalidate because project 73bc538f457d45d88c56a23d946a04be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:35:50.922504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6bc42595-edec-4f2f-8663-430fdccd5060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:50.925306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6bc42595-edec-4f2f-8663-430fdccd5060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:50.925965 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3454/6841] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:35:50 2022] DELETE /identity/v3/projects/73bc538f457d45d88c56a23d946a04be => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:50.926880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc42595-edec-4f2f-8663-430fdccd5060 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:50.929921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6bc42595-edec-4f2f-8663-430fdccd5060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:50.960393 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3388/6842] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:50.961041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3c61c-c8ff-4857-acad-fb9ec348365f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:50.962391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ced3c61c-c8ff-4857-acad-fb9ec348365f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:51.023986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc42595-edec-4f2f-8663-430fdccd5060 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:51.029175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225de325-3a50-41a6-adba-a93acc785077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:51.030158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225de325-3a50-41a6-adba-a93acc785077 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:51.030325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225de325-3a50-41a6-adba-a93acc785077 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:51.030590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225de325-3a50-41a6-adba-a93acc785077 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:51.031357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225de325-3a50-41a6-adba-a93acc785077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:51.033024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225de325-3a50-41a6-adba-a93acc785077 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:51.058427 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3455/6843] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:51.059509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225de325-3a50-41a6-adba-a93acc785077 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:51.062653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-225de325-3a50-41a6-adba-a93acc785077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:51.068724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3c61c-c8ff-4857-acad-fb9ec348365f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:51.075292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81d4b8-b829-4a13-afa8-984ad6383390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:51.076194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81d4b8-b829-4a13-afa8-984ad6383390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:51.076654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81d4b8-b829-4a13-afa8-984ad6383390 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:51.076944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81d4b8-b829-4a13-afa8-984ad6383390 admin admin] PATH_INFO: `/v3/users/501a2045193642c391a95ffe9a7ac07a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:51.078775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81d4b8-b829-4a13-afa8-984ad6383390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=501a2045193642c391a95ffe9a7ac07a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:51.080779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81d4b8-b829-4a13-afa8-984ad6383390 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:51.154574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225de325-3a50-41a6-adba-a93acc785077 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:51.158454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ea6d8-0f5f-486f-b3d4-8d0be02c34db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:51.159841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ea6d8-0f5f-486f-b3d4-8d0be02c34db service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:51.160073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ea6d8-0f5f-486f-b3d4-8d0be02c34db service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:51.160349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ea6d8-0f5f-486f-b3d4-8d0be02c34db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:51.169710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ea6d8-0f5f-486f-b3d4-8d0be02c34db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:51.171223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ea6d8-0f5f-486f-b3d4-8d0be02c34db service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:51.181222 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3456/6844] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:51.181891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ea6d8-0f5f-486f-b3d4-8d0be02c34db service cinder] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:51.195041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ea6d8-0f5f-486f-b3d4-8d0be02c34db service cinder] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:51.204302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73044b2e-b8cf-4bc3-809e-9c016d7453cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:51.207737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73044b2e-b8cf-4bc3-809e-9c016d7453cb admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:51.208105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73044b2e-b8cf-4bc3-809e-9c016d7453cb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:51.208610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73044b2e-b8cf-4bc3-809e-9c016d7453cb admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:51.209421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73044b2e-b8cf-4bc3-809e-9c016d7453cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:51.214236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73044b2e-b8cf-4bc3-809e-9c016d7453cb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:51.230735 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3457/6845] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:51.232517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73044b2e-b8cf-4bc3-809e-9c016d7453cb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:51.247698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73044b2e-b8cf-4bc3-809e-9c016d7453cb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:51.253986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1721d-3a04-4e78-8803-aabf395cd8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:51.254705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1721d-3a04-4e78-8803-aabf395cd8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:51.254985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1721d-3a04-4e78-8803-aabf395cd8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:51.256156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1721d-3a04-4e78-8803-aabf395cd8ec admin admin] PATH_INFO: `/v3/projects/f5c332fdcb1f42d280736751d6d259bf/users/e4f03916d4b4423abe682a4bb6f15f0e/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:51.286255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1721d-3a04-4e78-8803-aabf395cd8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5c332fdcb1f42d280736751d6d259bf, user_id=e4f03916d4b4423abe682a4bb6f15f0e, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:51.292090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1721d-3a04-4e78-8803-aabf395cd8ec admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:51.319980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4f81d4b8-b829-4a13-afa8-984ad6383390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '501a2045193642c391a95ffe9a7ac07a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:51.361119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4f81d4b8-b829-4a13-afa8-984ad6383390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '501a2045193642c391a95ffe9a7ac07a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:51.428185 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3458/6846] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:35:51 2022] PUT /identity/v3/projects/f5c332fdcb1f42d280736751d6d259bf/users/e4f03916d4b4423abe682a4bb6f15f0e/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:35:51.429644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e46e2-f040-478c-ac87-1deb4a775379 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:51.430234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e46e2-f040-478c-ac87-1deb4a775379 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:51.430601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e46e2-f040-478c-ac87-1deb4a775379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:51.468400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-395e46e2-f040-478c-ac87-1deb4a775379 None None] MFA Rules not processed for user `e4f03916d4b4423abe682a4bb6f15f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:51.476707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-395e46e2-f040-478c-ac87-1deb4a775379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:51.481268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4f81d4b8-b829-4a13-afa8-984ad6383390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '501a2045193642c391a95ffe9a7ac07a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:51.490356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4f81d4b8-b829-4a13-afa8-984ad6383390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '501a2045193642c391a95ffe9a7ac07a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:51.491210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4f81d4b8-b829-4a13-afa8-984ad6383390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '501a2045193642c391a95ffe9a7ac07a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:51.498300 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3389/6847] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:35:50 2022] DELETE /identity/v3/users/501a2045193642c391a95ffe9a7ac07a => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:51.556425 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3459/6848] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:51.561432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81d4b8-b829-4a13-afa8-984ad6383390 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:51.562988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4f81d4b8-b829-4a13-afa8-984ad6383390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:51.653283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81d4b8-b829-4a13-afa8-984ad6383390 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:51.658419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11c9cd-6705-408a-a7b4-01fee678d10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:51.659986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11c9cd-6705-408a-a7b4-01fee678d10b admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:51.659986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11c9cd-6705-408a-a7b4-01fee678d10b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:51.660193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11c9cd-6705-408a-a7b4-01fee678d10b admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:51.661134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f11c9cd-6705-408a-a7b4-01fee678d10b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:51.663181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f11c9cd-6705-408a-a7b4-01fee678d10b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:51.806005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e46e2-f040-478c-ac87-1deb4a775379 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:51.807568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-395e46e2-f040-478c-ac87-1deb4a775379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:51.815334 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3390/6849] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:35:51 2022] POST /identity/v3/projects => generated 387 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:35:51.819170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11c9cd-6705-408a-a7b4-01fee678d10b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:51.912851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11c9cd-6705-408a-a7b4-01fee678d10b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:51.916416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e46e2-f040-478c-ac87-1deb4a775379 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:51.918613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f875d3-5fef-4c1f-8028-13b6062c9334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:51.919494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f875d3-5fef-4c1f-8028-13b6062c9334 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:51.919777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f875d3-5fef-4c1f-8028-13b6062c9334 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:51.921007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f875d3-5fef-4c1f-8028-13b6062c9334 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:51.921007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f875d3-5fef-4c1f-8028-13b6062c9334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:51.922670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a17dc-05d1-4dfa-849c-e24cb8bb345e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:51.922794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f875d3-5fef-4c1f-8028-13b6062c9334 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:51.923626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a17dc-05d1-4dfa-849c-e24cb8bb345e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:51.924026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a17dc-05d1-4dfa-849c-e24cb8bb345e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:51.924357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a17dc-05d1-4dfa-849c-e24cb8bb345e admin admin] PATH_INFO: `/v3/projects/e85c98bec1b14dd38c05145a133f1d80` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:51.926228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a17dc-05d1-4dfa-849c-e24cb8bb345e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85c98bec1b14dd38c05145a133f1d80)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:51.928300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a17dc-05d1-4dfa-849c-e24cb8bb345e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:51.995502 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3391/6850] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:35:51 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:35:51.999615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f875d3-5fef-4c1f-8028-13b6062c9334 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:52.010263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f875d3-5fef-4c1f-8028-13b6062c9334 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:52.015181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fdb89-7870-4b1e-b004-278d993044ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:52.015857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fdb89-7870-4b1e-b004-278d993044ec admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:52.016147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fdb89-7870-4b1e-b004-278d993044ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:52.016465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fdb89-7870-4b1e-b004-278d993044ec admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:52.017232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fdb89-7870-4b1e-b004-278d993044ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:52.019483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fdb89-7870-4b1e-b004-278d993044ec admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:52.029470 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3392/6851] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:35:52.033574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fdb89-7870-4b1e-b004-278d993044ec admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:52.047812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fdb89-7870-4b1e-b004-278d993044ec admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:52.061947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e40a17dc-05d1-4dfa-849c-e24cb8bb345e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85c98bec1b14dd38c05145a133f1d80', 'request_id': 'req-e40a17dc-05d1-4dfa-849c-e24cb8bb345e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:52.069571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e40a17dc-05d1-4dfa-849c-e24cb8bb345e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85c98bec1b14dd38c05145a133f1d80', 'request_id': 'req-e40a17dc-05d1-4dfa-849c-e24cb8bb345e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:52.076229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e40a17dc-05d1-4dfa-849c-e24cb8bb345e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85c98bec1b14dd38c05145a133f1d80', 'request_id': 'req-e40a17dc-05d1-4dfa-849c-e24cb8bb345e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:52.129552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c40ca-9fb1-4796-866e-08a10361b608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:52.132620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c40ca-9fb1-4796-866e-08a10361b608 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:52.132620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c40ca-9fb1-4796-866e-08a10361b608 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:52.132620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c40ca-9fb1-4796-866e-08a10361b608 admin admin] PATH_INFO: `/v3/projects/e89804af39e341dab495e21f28d166ba/users/66191b16e25548b983c5d7fd97c1245a/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:52.151455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c40ca-9fb1-4796-866e-08a10361b608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e89804af39e341dab495e21f28d166ba, user_id=66191b16e25548b983c5d7fd97c1245a, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:52.154273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c40ca-9fb1-4796-866e-08a10361b608 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:52.182544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e40a17dc-05d1-4dfa-849c-e24cb8bb345e admin admin] The token cache is being invalidate because project e85c98bec1b14dd38c05145a133f1d80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:35:52.182933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e40a17dc-05d1-4dfa-849c-e24cb8bb345e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:52.183707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e40a17dc-05d1-4dfa-849c-e24cb8bb345e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:35:52.190040 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3460/6852] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:35:51 2022] DELETE /identity/v3/projects/e85c98bec1b14dd38c05145a133f1d80 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:52.192252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d04b8-7971-459b-897a-0a8028e2c977 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:52.192809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d04b8-7971-459b-897a-0a8028e2c977 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:52.193281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d04b8-7971-459b-897a-0a8028e2c977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:52.215996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f50d04b8-7971-459b-897a-0a8028e2c977 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:52.217487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f50d04b8-7971-459b-897a-0a8028e2c977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:52.229416 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3461/6853] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:52.240134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824de07-2333-4da9-9290-bcd0577d6471 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:52.240444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824de07-2333-4da9-9290-bcd0577d6471 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:52.240885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824de07-2333-4da9-9290-bcd0577d6471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:52.274007 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3393/6854] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:35:52 2022] PUT /identity/v3/projects/e89804af39e341dab495e21f28d166ba/users/66191b16e25548b983c5d7fd97c1245a/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:35:52.274793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c40ca-9fb1-4796-866e-08a10361b608 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:52.284993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fa1c40ca-9fb1-4796-866e-08a10361b608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:52.286678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1824de07-2333-4da9-9290-bcd0577d6471 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:52.289928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:52.291140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1824de07-2333-4da9-9290-bcd0577d6471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:52.319139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:52.379784 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3462/6855] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:52.383713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824de07-2333-4da9-9290-bcd0577d6471 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:52.386254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c40ca-9fb1-4796-866e-08a10361b608 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:52.394891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c641f-1f54-4e31-a8cb-b1b73facf9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:52.396210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c641f-1f54-4e31-a8cb-b1b73facf9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:52.396696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c641f-1f54-4e31-a8cb-b1b73facf9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:52.397305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c641f-1f54-4e31-a8cb-b1b73facf9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:52.397826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824de07-2333-4da9-9290-bcd0577d6471 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:52.398480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c641f-1f54-4e31-a8cb-b1b73facf9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:52.400507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c641f-1f54-4e31-a8cb-b1b73facf9d0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:52.405014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94075348-a6fc-4006-ae7f-5cf81f21b173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:52.408987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94075348-a6fc-4006-ae7f-5cf81f21b173 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:52.408987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94075348-a6fc-4006-ae7f-5cf81f21b173 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:52.408987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94075348-a6fc-4006-ae7f-5cf81f21b173 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:52.408987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94075348-a6fc-4006-ae7f-5cf81f21b173 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:35:52.408987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94075348-a6fc-4006-ae7f-5cf81f21b173 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:52.411754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94075348-a6fc-4006-ae7f-5cf81f21b173 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:52.414425 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3394/6856] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:52.418037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c641f-1f54-4e31-a8cb-b1b73facf9d0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:52.434910 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3463/6857] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:35:52.435088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c641f-1f54-4e31-a8cb-b1b73facf9d0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:52.436787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94075348-a6fc-4006-ae7f-5cf81f21b173 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:52.440065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ce3d3-6ba6-4543-ab0d-be117d4ac9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:52.442357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ce3d3-6ba6-4543-ab0d-be117d4ac9f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:52.442782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ce3d3-6ba6-4543-ab0d-be117d4ac9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:52.444143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ce3d3-6ba6-4543-ab0d-be117d4ac9f4 admin admin] PATH_INFO: `/v3/projects/e89804af39e341dab495e21f28d166ba/users/66191b16e25548b983c5d7fd97c1245a/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:52.446327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ce3d3-6ba6-4543-ab0d-be117d4ac9f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e89804af39e341dab495e21f28d166ba, user_id=66191b16e25548b983c5d7fd97c1245a, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:52.450053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ce3d3-6ba6-4543-ab0d-be117d4ac9f4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:52.450415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94075348-a6fc-4006-ae7f-5cf81f21b173 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:52.456816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc658d-dd83-4d19-9ee8-0d57af46bf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:52.457413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc658d-dd83-4d19-9ee8-0d57af46bf4c admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:52.457705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc658d-dd83-4d19-9ee8-0d57af46bf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:52.458151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc658d-dd83-4d19-9ee8-0d57af46bf4c admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:52.459208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc658d-dd83-4d19-9ee8-0d57af46bf4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:52.461598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc658d-dd83-4d19-9ee8-0d57af46bf4c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:52.474491 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3395/6858] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:35:52 2022] PUT /identity/v3/projects/e89804af39e341dab495e21f28d166ba/users/66191b16e25548b983c5d7fd97c1245a/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:52.481005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc624a5-8039-47d7-af74-44982d81c479 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:52.481251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc624a5-8039-47d7-af74-44982d81c479 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:52.481637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc624a5-8039-47d7-af74-44982d81c479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:52.524468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-bbc624a5-8039-47d7-af74-44982d81c479 None None] MFA Rules not processed for user `66191b16e25548b983c5d7fd97c1245a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:52.525843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bbc624a5-8039-47d7-af74-44982d81c479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:52.615079 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3396/6859] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:52.628801 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3464/6860] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:35:52 2022] POST /identity/v3/projects => generated 369 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:35:52.631312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc624a5-8039-47d7-af74-44982d81c479 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:52.632411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc658d-dd83-4d19-9ee8-0d57af46bf4c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:52.636095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bbc624a5-8039-47d7-af74-44982d81c479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:52.717751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc658d-dd83-4d19-9ee8-0d57af46bf4c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:52.725495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b3318-0ccc-41ef-8c53-5f4f8620f822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:52.726298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc624a5-8039-47d7-af74-44982d81c479 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:52.726691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b3318-0ccc-41ef-8c53-5f4f8620f822 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:52.727595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b3318-0ccc-41ef-8c53-5f4f8620f822 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:52.728130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b3318-0ccc-41ef-8c53-5f4f8620f822 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:52.729262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b3318-0ccc-41ef-8c53-5f4f8620f822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:52.731909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b3318-0ccc-41ef-8c53-5f4f8620f822 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:52.786251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f44d3b-69b0-4e96-a315-a0ca37461941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:52.787763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f44d3b-69b0-4e96-a315-a0ca37461941 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:52.788101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f44d3b-69b0-4e96-a315-a0ca37461941 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:52.788384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f44d3b-69b0-4e96-a315-a0ca37461941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:52.859578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f44d3b-69b0-4e96-a315-a0ca37461941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:52.866584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f44d3b-69b0-4e96-a315-a0ca37461941 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:52.876023 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3397/6861] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:52.913026 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3465/6862] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:35:52 2022] POST /identity/v3/users => generated 285 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:35:52.917646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f44d3b-69b0-4e96-a315-a0ca37461941 service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:52.936668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f44d3b-69b0-4e96-a315-a0ca37461941 service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:52.942625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0ad5c-b901-47b9-9f51-55a3206dfd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:52.943411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0ad5c-b901-47b9-9f51-55a3206dfd86 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:52.943705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0ad5c-b901-47b9-9f51-55a3206dfd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:52.943987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0ad5c-b901-47b9-9f51-55a3206dfd86 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:52.944719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0ad5c-b901-47b9-9f51-55a3206dfd86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:52.946838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0ad5c-b901-47b9-9f51-55a3206dfd86 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:52.961113 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3398/6863] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:52.964850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b3318-0ccc-41ef-8c53-5f4f8620f822 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:52.977248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b3318-0ccc-41ef-8c53-5f4f8620f822 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:52.983633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7465a8-678c-453f-8936-1914cca9bc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:52.984548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7465a8-678c-453f-8936-1914cca9bc92 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:52.985035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7465a8-678c-453f-8936-1914cca9bc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:52.985505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7465a8-678c-453f-8936-1914cca9bc92 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:52.986687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7465a8-678c-453f-8936-1914cca9bc92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:52.991046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7465a8-678c-453f-8936-1914cca9bc92 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:53.003517 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3466/6864] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:53.008064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0ad5c-b901-47b9-9f51-55a3206dfd86 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:53.020318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0ad5c-b901-47b9-9f51-55a3206dfd86 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:53.049776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182dbef-380f-48f9-a99d-e67199038882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:53.051000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182dbef-380f-48f9-a99d-e67199038882 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:53.051269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182dbef-380f-48f9-a99d-e67199038882 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:53.051553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182dbef-380f-48f9-a99d-e67199038882 admin admin] PATH_INFO: `/v3/projects/7197762244c84ae7a0d8da5c01b5649f/users/e61619f7f83c465e934f4af41f5cc116/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:53.073605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182dbef-380f-48f9-a99d-e67199038882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7197762244c84ae7a0d8da5c01b5649f, user_id=e61619f7f83c465e934f4af41f5cc116, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:53.076700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182dbef-380f-48f9-a99d-e67199038882 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:53.203999 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3399/6865] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:35:53 2022] PUT /identity/v3/projects/7197762244c84ae7a0d8da5c01b5649f/users/e61619f7f83c465e934f4af41f5cc116/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:35:53.215946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42567895-caa2-4bbd-806c-9df1bce4d63a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:53.216334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42567895-caa2-4bbd-806c-9df1bce4d63a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:53.216826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42567895-caa2-4bbd-806c-9df1bce4d63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:53.273017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-42567895-caa2-4bbd-806c-9df1bce4d63a None None] MFA Rules not processed for user `e61619f7f83c465e934f4af41f5cc116`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:53.274466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-42567895-caa2-4bbd-806c-9df1bce4d63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:53.385554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:53.389364 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3467/6866] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:53.394548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182dbef-380f-48f9-a99d-e67199038882 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:53.499166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182dbef-380f-48f9-a99d-e67199038882 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:53.507940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d2fe2-d797-4574-9b2f-c1e84b834242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:53.508688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d2fe2-d797-4574-9b2f-c1e84b834242 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:53.509037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d2fe2-d797-4574-9b2f-c1e84b834242 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:53.509325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d2fe2-d797-4574-9b2f-c1e84b834242 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:53.510295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d2fe2-d797-4574-9b2f-c1e84b834242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:53.512458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d2fe2-d797-4574-9b2f-c1e84b834242 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:53.661243 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3400/6867] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:35:53 2022] POST /identity/v3/projects => generated 369 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:35:53.665303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42567895-caa2-4bbd-806c-9df1bce4d63a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:53.680682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42567895-caa2-4bbd-806c-9df1bce4d63a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:53.754513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b929f6b-3aa9-430a-a617-962bbf62cc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:53.755240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b929f6b-3aa9-430a-a617-962bbf62cc89 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:53.756064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b929f6b-3aa9-430a-a617-962bbf62cc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:53.756064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b929f6b-3aa9-430a-a617-962bbf62cc89 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:53.756666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b929f6b-3aa9-430a-a617-962bbf62cc89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:53.758823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b929f6b-3aa9-430a-a617-962bbf62cc89 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:53.841552 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3468/6868] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:35:53 2022] POST /identity/v3/users => generated 291 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:35:53.843632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d2fe2-d797-4574-9b2f-c1e84b834242 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:53.854695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d2fe2-d797-4574-9b2f-c1e84b834242 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:53.860097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f38e65-7b46-41d6-a094-7c43ac2a4756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:53.860467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f38e65-7b46-41d6-a094-7c43ac2a4756 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:53.860784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f38e65-7b46-41d6-a094-7c43ac2a4756 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:53.861074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f38e65-7b46-41d6-a094-7c43ac2a4756 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:53.861801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f38e65-7b46-41d6-a094-7c43ac2a4756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:53.864357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f38e65-7b46-41d6-a094-7c43ac2a4756 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:53.882297 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3401/6869] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:35:53.886551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b929f6b-3aa9-430a-a617-962bbf62cc89 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:53.897690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b929f6b-3aa9-430a-a617-962bbf62cc89 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:53.904834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9e72f-dd91-419b-8a30-08894a018984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:53.905939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9e72f-dd91-419b-8a30-08894a018984 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:53.906291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9e72f-dd91-419b-8a30-08894a018984 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:53.906585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9e72f-dd91-419b-8a30-08894a018984 admin admin] PATH_INFO: `/v3/projects/86e3f38a71ce4389bafa7ca48cd12f7e/users/0669721214c446f887be008674000b54/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:53.923570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9e72f-dd91-419b-8a30-08894a018984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e3f38a71ce4389bafa7ca48cd12f7e, user_id=0669721214c446f887be008674000b54, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:53.927707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9e72f-dd91-419b-8a30-08894a018984 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:54.023739 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3469/6870] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:35:53 2022] PUT /identity/v3/projects/86e3f38a71ce4389bafa7ca48cd12f7e/users/0669721214c446f887be008674000b54/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:54.027710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f38e65-7b46-41d6-a094-7c43ac2a4756 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:54.045825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f38e65-7b46-41d6-a094-7c43ac2a4756 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:54.121154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:54.142769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcdb6a-1144-41ef-8f79-3dc0478d3960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:54.143688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcdb6a-1144-41ef-8f79-3dc0478d3960 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:54.144103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcdb6a-1144-41ef-8f79-3dc0478d3960 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:54.144582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcdb6a-1144-41ef-8f79-3dc0478d3960 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:54.145403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcdb6a-1144-41ef-8f79-3dc0478d3960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:54.156665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcdb6a-1144-41ef-8f79-3dc0478d3960 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:54.182850 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3402/6871] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:35:54.184118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9e72f-dd91-419b-8a30-08894a018984 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:54.197727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9e72f-dd91-419b-8a30-08894a018984 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:54.204272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160330a-a9b7-4e39-9752-f9e12e9e3009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:54.205635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160330a-a9b7-4e39-9752-f9e12e9e3009 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:54.206483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160330a-a9b7-4e39-9752-f9e12e9e3009 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:54.206805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160330a-a9b7-4e39-9752-f9e12e9e3009 admin admin] PATH_INFO: `/v3/projects/86e3f38a71ce4389bafa7ca48cd12f7e/users/0669721214c446f887be008674000b54/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:54.210842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160330a-a9b7-4e39-9752-f9e12e9e3009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e3f38a71ce4389bafa7ca48cd12f7e, user_id=0669721214c446f887be008674000b54, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:54.213900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160330a-a9b7-4e39-9752-f9e12e9e3009 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:54.234332 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3470/6872] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:35:54 2022] PUT /identity/v3/projects/86e3f38a71ce4389bafa7ca48cd12f7e/users/0669721214c446f887be008674000b54/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:35:54.251687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e552b-7b58-46c6-a2df-4c0c305de914 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:54.254346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e552b-7b58-46c6-a2df-4c0c305de914 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:54.254862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e552b-7b58-46c6-a2df-4c0c305de914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:54.316972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8d3e552b-7b58-46c6-a2df-4c0c305de914 None None] MFA Rules not processed for user `0669721214c446f887be008674000b54`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:35:54.318329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8d3e552b-7b58-46c6-a2df-4c0c305de914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:54.479380 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3403/6873] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:35:54 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:35:54.494827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160330a-a9b7-4e39-9752-f9e12e9e3009 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:54.499170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5160330a-a9b7-4e39-9752-f9e12e9e3009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:54.499284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e552b-7b58-46c6-a2df-4c0c305de914 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:54.566834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e552b-7b58-46c6-a2df-4c0c305de914 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:54.570914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690af34-7ebc-45ff-a641-8da0cdd7999b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:54.571619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690af34-7ebc-45ff-a641-8da0cdd7999b service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:54.571907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690af34-7ebc-45ff-a641-8da0cdd7999b service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:54.572248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690af34-7ebc-45ff-a641-8da0cdd7999b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:54.574875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7690af34-7ebc-45ff-a641-8da0cdd7999b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:35:54.640943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690af34-7ebc-45ff-a641-8da0cdd7999b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:54.642336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690af34-7ebc-45ff-a641-8da0cdd7999b service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:54.654060 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3404/6874] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:54.694492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160330a-a9b7-4e39-9752-f9e12e9e3009 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:54.717870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1aeb91-9a56-466a-b80d-5964e87419d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:54.718542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1aeb91-9a56-466a-b80d-5964e87419d2 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:54.718822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1aeb91-9a56-466a-b80d-5964e87419d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:54.719128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1aeb91-9a56-466a-b80d-5964e87419d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:54.757431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1aeb91-9a56-466a-b80d-5964e87419d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:54.758898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1aeb91-9a56-466a-b80d-5964e87419d2 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:54.788232 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3471/6875] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:54 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:54.792061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:54.925756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690af34-7ebc-45ff-a641-8da0cdd7999b service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:35:54.944164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690af34-7ebc-45ff-a641-8da0cdd7999b service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:35:54.949286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a993e09-f105-4bde-9806-768b658e8e91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:35:54.949407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a993e09-f105-4bde-9806-768b658e8e91 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:35:54.950273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a993e09-f105-4bde-9806-768b658e8e91 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:35:54.950273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a993e09-f105-4bde-9806-768b658e8e91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:35:55.026240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a993e09-f105-4bde-9806-768b658e8e91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:35:55.030155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a993e09-f105-4bde-9806-768b658e8e91 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:35:55.066799 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3405/6876] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:35:54 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:35:55.529844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:56.803809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:56.866608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:58.745971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:35:58.788529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:00.236477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:00.818958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1aeb91-9a56-466a-b80d-5964e87419d2 service cinder] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:00.897742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1aeb91-9a56-466a-b80d-5964e87419d2 service cinder] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:00.902548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf56d6-3124-435f-a7be-ac776577c533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:00.903445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf56d6-3124-435f-a7be-ac776577c533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:00.903731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf56d6-3124-435f-a7be-ac776577c533 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:00.904009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf56d6-3124-435f-a7be-ac776577c533 admin admin] PATH_INFO: `/v3/users/e61619f7f83c465e934f4af41f5cc116` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:00.905190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf56d6-3124-435f-a7be-ac776577c533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e61619f7f83c465e934f4af41f5cc116)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:00.907313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf56d6-3124-435f-a7be-ac776577c533 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:00.923284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:01.141752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-dabf56d6-3124-435f-a7be-ac776577c533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e61619f7f83c465e934f4af41f5cc116'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:01.149456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-dabf56d6-3124-435f-a7be-ac776577c533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e61619f7f83c465e934f4af41f5cc116'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:01.269435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-dabf56d6-3124-435f-a7be-ac776577c533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e61619f7f83c465e934f4af41f5cc116'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:01.270154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-dabf56d6-3124-435f-a7be-ac776577c533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e61619f7f83c465e934f4af41f5cc116'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:01.282486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-dabf56d6-3124-435f-a7be-ac776577c533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e61619f7f83c465e934f4af41f5cc116'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:01.289482 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3472/6877] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:00 2022] DELETE /identity/v3/users/e61619f7f83c465e934f4af41f5cc116 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:01.298458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9197f-4672-44a8-81a0-2c950f429f02 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:01.298955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9197f-4672-44a8-81a0-2c950f429f02 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:01.298955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9197f-4672-44a8-81a0-2c950f429f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:01.317674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7db9197f-4672-44a8-81a0-2c950f429f02 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:01.318874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7db9197f-4672-44a8-81a0-2c950f429f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:01.388108 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3406/6878] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:01.399862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf56d6-3124-435f-a7be-ac776577c533 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:01.401461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dabf56d6-3124-435f-a7be-ac776577c533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:01.469043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf56d6-3124-435f-a7be-ac776577c533 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:01.475747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406957b-9ac2-48c5-aeed-0a9926f1c534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:01.475747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406957b-9ac2-48c5-aeed-0a9926f1c534 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:01.475747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406957b-9ac2-48c5-aeed-0a9926f1c534 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:01.475747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406957b-9ac2-48c5-aeed-0a9926f1c534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:01.489580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406957b-9ac2-48c5-aeed-0a9926f1c534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:01.491244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406957b-9ac2-48c5-aeed-0a9926f1c534 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:01.502219 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3473/6879] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:36:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:36:01.884142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:01.974670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9197f-4672-44a8-81a0-2c950f429f02 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:01.976199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7db9197f-4672-44a8-81a0-2c950f429f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:01.989142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9197f-4672-44a8-81a0-2c950f429f02 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:01.994009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8db244-4581-475a-bf9f-d1994dea6bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:01.994874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8db244-4581-475a-bf9f-d1994dea6bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:01.995198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8db244-4581-475a-bf9f-d1994dea6bda admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:01.995476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8db244-4581-475a-bf9f-d1994dea6bda admin admin] PATH_INFO: `/v3/projects/7197762244c84ae7a0d8da5c01b5649f` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:01.996745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8db244-4581-475a-bf9f-d1994dea6bda admin admin] RBAC: Authorizing `identity:delete_project(project_id=7197762244c84ae7a0d8da5c01b5649f)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:01.998653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8db244-4581-475a-bf9f-d1994dea6bda admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:02.128891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9a8db244-4581-475a-bf9f-d1994dea6bda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7197762244c84ae7a0d8da5c01b5649f', 'request_id': 'req-9a8db244-4581-475a-bf9f-d1994dea6bda'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:02.134700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9a8db244-4581-475a-bf9f-d1994dea6bda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7197762244c84ae7a0d8da5c01b5649f', 'request_id': 'req-9a8db244-4581-475a-bf9f-d1994dea6bda'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:02.141567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9a8db244-4581-475a-bf9f-d1994dea6bda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7197762244c84ae7a0d8da5c01b5649f', 'request_id': 'req-9a8db244-4581-475a-bf9f-d1994dea6bda'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:02.230675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406957b-9ac2-48c5-aeed-0a9926f1c534 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:02.232123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8406957b-9ac2-48c5-aeed-0a9926f1c534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:02.250833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9a8db244-4581-475a-bf9f-d1994dea6bda admin admin] The token cache is being invalidate because project 7197762244c84ae7a0d8da5c01b5649f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:02.251149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9a8db244-4581-475a-bf9f-d1994dea6bda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:02.251904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9a8db244-4581-475a-bf9f-d1994dea6bda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:02.255403 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3407/6880] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:36:01 2022] DELETE /identity/v3/projects/7197762244c84ae7a0d8da5c01b5649f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:02.260133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8db244-4581-475a-bf9f-d1994dea6bda admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:02.261742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9a8db244-4581-475a-bf9f-d1994dea6bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:02.329392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8db244-4581-475a-bf9f-d1994dea6bda admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:02.333008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406957b-9ac2-48c5-aeed-0a9926f1c534 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:02.335381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a91a3c-ff60-4bad-abcf-21ff54c6ba94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:02.336267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a91a3c-ff60-4bad-abcf-21ff54c6ba94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:02.336550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a91a3c-ff60-4bad-abcf-21ff54c6ba94 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:02.336876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a91a3c-ff60-4bad-abcf-21ff54c6ba94 admin admin] PATH_INFO: `/v3/users/0669721214c446f887be008674000b54` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:02.338098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a91a3c-ff60-4bad-abcf-21ff54c6ba94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0669721214c446f887be008674000b54)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:02.340101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a91a3c-ff60-4bad-abcf-21ff54c6ba94 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:02.394050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89873fff-7915-46b9-a0a2-5858b99aa49c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:02.394853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89873fff-7915-46b9-a0a2-5858b99aa49c service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:02.395418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89873fff-7915-46b9-a0a2-5858b99aa49c service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:02.395918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89873fff-7915-46b9-a0a2-5858b99aa49c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:02.397654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:02.399197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-89873fff-7915-46b9-a0a2-5858b99aa49c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:02.412926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89873fff-7915-46b9-a0a2-5858b99aa49c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:02.414507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89873fff-7915-46b9-a0a2-5858b99aa49c service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:02.427072 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3474/6881] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:36:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:36:02.546453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e3a91a3c-ff60-4bad-abcf-21ff54c6ba94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0669721214c446f887be008674000b54'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:02.558955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e3a91a3c-ff60-4bad-abcf-21ff54c6ba94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0669721214c446f887be008674000b54'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:02.692943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e3a91a3c-ff60-4bad-abcf-21ff54c6ba94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0669721214c446f887be008674000b54'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:02.700771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e3a91a3c-ff60-4bad-abcf-21ff54c6ba94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0669721214c446f887be008674000b54'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:02.701441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e3a91a3c-ff60-4bad-abcf-21ff54c6ba94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0669721214c446f887be008674000b54'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:02.708259 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3408/6882] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:02 2022] DELETE /identity/v3/users/0669721214c446f887be008674000b54 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:02.955458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:03.128684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89873fff-7915-46b9-a0a2-5858b99aa49c service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:03.147371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89873fff-7915-46b9-a0a2-5858b99aa49c service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:03.209858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adaec0f-63ca-48bc-ae0c-5b31a186d46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:03.210765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaec0f-63ca-48bc-ae0c-5b31a186d46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:03.211085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaec0f-63ca-48bc-ae0c-5b31a186d46a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:03.211497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaec0f-63ca-48bc-ae0c-5b31a186d46a admin admin] PATH_INFO: `/v3/projects/86e3f38a71ce4389bafa7ca48cd12f7e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:03.212696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adaec0f-63ca-48bc-ae0c-5b31a186d46a admin admin] RBAC: Authorizing `identity:delete_project(project_id=86e3f38a71ce4389bafa7ca48cd12f7e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:03.215409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adaec0f-63ca-48bc-ae0c-5b31a186d46a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:03.345007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0adaec0f-63ca-48bc-ae0c-5b31a186d46a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86e3f38a71ce4389bafa7ca48cd12f7e', 'request_id': 'req-0adaec0f-63ca-48bc-ae0c-5b31a186d46a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:03.352609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0adaec0f-63ca-48bc-ae0c-5b31a186d46a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86e3f38a71ce4389bafa7ca48cd12f7e', 'request_id': 'req-0adaec0f-63ca-48bc-ae0c-5b31a186d46a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:03.359212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0adaec0f-63ca-48bc-ae0c-5b31a186d46a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86e3f38a71ce4389bafa7ca48cd12f7e', 'request_id': 'req-0adaec0f-63ca-48bc-ae0c-5b31a186d46a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:03.460974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0adaec0f-63ca-48bc-ae0c-5b31a186d46a admin admin] The token cache is being invalidate because project 86e3f38a71ce4389bafa7ca48cd12f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:03.461181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0adaec0f-63ca-48bc-ae0c-5b31a186d46a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:03.461810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0adaec0f-63ca-48bc-ae0c-5b31a186d46a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:03.463425 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3475/6883] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:36:03 2022] DELETE /identity/v3/projects/86e3f38a71ce4389bafa7ca48cd12f7e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:36:03.468628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376ecbd-cbcf-49a0-bbe9-6cd0109b7b0d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:03.469094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376ecbd-cbcf-49a0-bbe9-6cd0109b7b0d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:03.469180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376ecbd-cbcf-49a0-bbe9-6cd0109b7b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:03.476742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:03.490408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d376ecbd-cbcf-49a0-bbe9-6cd0109b7b0d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:03.491955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d376ecbd-cbcf-49a0-bbe9-6cd0109b7b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:03.553137 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3409/6884] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:36:03.656980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d092930-0b2b-417d-ac8b-088f1920821a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:03.657271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d092930-0b2b-417d-ac8b-088f1920821a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:03.657561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d092930-0b2b-417d-ac8b-088f1920821a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:03.676893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6d092930-0b2b-417d-ac8b-088f1920821a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:03.678093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6d092930-0b2b-417d-ac8b-088f1920821a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:03.686211 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3476/6885] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:03.691451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376ecbd-cbcf-49a0-bbe9-6cd0109b7b0d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:03.701193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376ecbd-cbcf-49a0-bbe9-6cd0109b7b0d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:03.706493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069a03b-5b2c-4406-926c-24b539718e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:03.707475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069a03b-5b2c-4406-926c-24b539718e24 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:03.707758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069a03b-5b2c-4406-926c-24b539718e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:03.708035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069a03b-5b2c-4406-926c-24b539718e24 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:03.717611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069a03b-5b2c-4406-926c-24b539718e24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:36:03.717611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069a03b-5b2c-4406-926c-24b539718e24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:03.717611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069a03b-5b2c-4406-926c-24b539718e24 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:03.728903 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3410/6886] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:36:03.733549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d092930-0b2b-417d-ac8b-088f1920821a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:03.743125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d092930-0b2b-417d-ac8b-088f1920821a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:03.747951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744c995-b283-4d51-a6db-5cb5fb19780d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:03.755249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744c995-b283-4d51-a6db-5cb5fb19780d admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:03.755249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744c995-b283-4d51-a6db-5cb5fb19780d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:03.755249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744c995-b283-4d51-a6db-5cb5fb19780d admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:03.755249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744c995-b283-4d51-a6db-5cb5fb19780d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:03.755249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744c995-b283-4d51-a6db-5cb5fb19780d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:03.929690 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3477/6887] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:36:03 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:03.934127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069a03b-5b2c-4406-926c-24b539718e24 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:03.945970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069a03b-5b2c-4406-926c-24b539718e24 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:04.007088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5a01a-e596-4906-a881-ba238edebb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:04.007763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5a01a-e596-4906-a881-ba238edebb51 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:04.008045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5a01a-e596-4906-a881-ba238edebb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:04.008319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5a01a-e596-4906-a881-ba238edebb51 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:04.009296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5a01a-e596-4906-a881-ba238edebb51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:04.011697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5a01a-e596-4906-a881-ba238edebb51 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:04.132607 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3411/6888] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:36:03 2022] POST /identity/v3/users => generated 284 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:36:04.133915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744c995-b283-4d51-a6db-5cb5fb19780d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:04.145096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744c995-b283-4d51-a6db-5cb5fb19780d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:04.150833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dcb08-6b6a-4540-b443-697a0e2231bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:04.151273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dcb08-6b6a-4540-b443-697a0e2231bf admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:04.151548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dcb08-6b6a-4540-b443-697a0e2231bf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:04.151834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dcb08-6b6a-4540-b443-697a0e2231bf admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:04.152558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dcb08-6b6a-4540-b443-697a0e2231bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:04.154176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dcb08-6b6a-4540-b443-697a0e2231bf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:04.180297 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3478/6889] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:36:04.180385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5a01a-e596-4906-a881-ba238edebb51 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:04.192416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5a01a-e596-4906-a881-ba238edebb51 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:04.198237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c15083-fd8b-4cb4-9bc2-9904d9ec8deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:04.198911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c15083-fd8b-4cb4-9bc2-9904d9ec8deb admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:04.199226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c15083-fd8b-4cb4-9bc2-9904d9ec8deb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:04.199503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c15083-fd8b-4cb4-9bc2-9904d9ec8deb admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:04.200284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c15083-fd8b-4cb4-9bc2-9904d9ec8deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:04.201953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c15083-fd8b-4cb4-9bc2-9904d9ec8deb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:04.214116 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3412/6890] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:36:04.218486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dcb08-6b6a-4540-b443-697a0e2231bf admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:04.224838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:04.230680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dcb08-6b6a-4540-b443-697a0e2231bf admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:04.235586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fe8b9-a871-4ffa-b70f-8ade926c65e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:04.236468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fe8b9-a871-4ffa-b70f-8ade926c65e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:04.236758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fe8b9-a871-4ffa-b70f-8ade926c65e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:04.237078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fe8b9-a871-4ffa-b70f-8ade926c65e7 admin admin] PATH_INFO: `/v3/projects/74bc69aef04a436498a38c4f1efaf88a/users/a691f131ccef4fb4989137852816abc2/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:04.252277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fe8b9-a871-4ffa-b70f-8ade926c65e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74bc69aef04a436498a38c4f1efaf88a, user_id=a691f131ccef4fb4989137852816abc2, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:04.255260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fe8b9-a871-4ffa-b70f-8ade926c65e7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:04.378256 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3479/6891] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:36:04 2022] PUT /identity/v3/projects/74bc69aef04a436498a38c4f1efaf88a/users/a691f131ccef4fb4989137852816abc2/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:04.391546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410ae5d-8f31-4ffc-9251-99fdeaf235c7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:04.391733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410ae5d-8f31-4ffc-9251-99fdeaf235c7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:04.392013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410ae5d-8f31-4ffc-9251-99fdeaf235c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:04.420457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6410ae5d-8f31-4ffc-9251-99fdeaf235c7 None None] MFA Rules not processed for user `a691f131ccef4fb4989137852816abc2`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:04.421930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6410ae5d-8f31-4ffc-9251-99fdeaf235c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:04.506395 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3413/6892] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:04.516245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fe8b9-a871-4ffa-b70f-8ade926c65e7 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:04.518031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4b8fe8b9-a871-4ffa-b70f-8ade926c65e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:04.601039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fe8b9-a871-4ffa-b70f-8ade926c65e7 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:04.605086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3b348-561e-4893-bbd2-85335af51775 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:04.606000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3b348-561e-4893-bbd2-85335af51775 service glance] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:04.606285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3b348-561e-4893-bbd2-85335af51775 service glance] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:04.606566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3b348-561e-4893-bbd2-85335af51775 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:04.615781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3b348-561e-4893-bbd2-85335af51775 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:04.620717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3b348-561e-4893-bbd2-85335af51775 service glance] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:04.626433 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3480/6893] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:36:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:36:05.004188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:06.691245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410ae5d-8f31-4ffc-9251-99fdeaf235c7 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:06.692719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6410ae5d-8f31-4ffc-9251-99fdeaf235c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:06.752309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410ae5d-8f31-4ffc-9251-99fdeaf235c7 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:06.760516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad68041-8b8c-4996-b972-50fc8da989c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:06.760516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad68041-8b8c-4996-b972-50fc8da989c7 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:06.760516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad68041-8b8c-4996-b972-50fc8da989c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:06.760516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad68041-8b8c-4996-b972-50fc8da989c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:06.760802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9ad68041-8b8c-4996-b972-50fc8da989c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:06.837775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad68041-8b8c-4996-b972-50fc8da989c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:06.839527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad68041-8b8c-4996-b972-50fc8da989c7 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:06.850133 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3414/6894] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:36:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:36:13.024815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3b348-561e-4893-bbd2-85335af51775 service glance] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:13.026286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-08e3b348-561e-4893-bbd2-85335af51775 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:13.103401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3b348-561e-4893-bbd2-85335af51775 service glance] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:13.108858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953c137-6a2a-4a6d-b289-ea6f34df9789 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:13.109515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953c137-6a2a-4a6d-b289-ea6f34df9789 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:13.109797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953c137-6a2a-4a6d-b289-ea6f34df9789 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:13.110069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953c137-6a2a-4a6d-b289-ea6f34df9789 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:13.111846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d953c137-6a2a-4a6d-b289-ea6f34df9789 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:13.127424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953c137-6a2a-4a6d-b289-ea6f34df9789 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:13.129968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953c137-6a2a-4a6d-b289-ea6f34df9789 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:13.143343 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3481/6895] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:36:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:36:17.401796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=49 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:18.420336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad68041-8b8c-4996-b972-50fc8da989c7 service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:18.422055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9ad68041-8b8c-4996-b972-50fc8da989c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:18.496686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad68041-8b8c-4996-b972-50fc8da989c7 service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:18.501679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d58b7e-8b52-4bcb-8f8a-6d5d304f71d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:18.502577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d58b7e-8b52-4bcb-8f8a-6d5d304f71d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:18.502862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d58b7e-8b52-4bcb-8f8a-6d5d304f71d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:18.503174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d58b7e-8b52-4bcb-8f8a-6d5d304f71d6 admin admin] PATH_INFO: `/v3/users/3c57c0a417d94a51907ac4dd4509a322` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:18.504592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d58b7e-8b52-4bcb-8f8a-6d5d304f71d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c57c0a417d94a51907ac4dd4509a322)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:18.506694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d58b7e-8b52-4bcb-8f8a-6d5d304f71d6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:18.732836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-33d58b7e-8b52-4bcb-8f8a-6d5d304f71d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c57c0a417d94a51907ac4dd4509a322'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:18.747495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-33d58b7e-8b52-4bcb-8f8a-6d5d304f71d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c57c0a417d94a51907ac4dd4509a322'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:18.837298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-33d58b7e-8b52-4bcb-8f8a-6d5d304f71d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c57c0a417d94a51907ac4dd4509a322'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:18.845089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-33d58b7e-8b52-4bcb-8f8a-6d5d304f71d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c57c0a417d94a51907ac4dd4509a322'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:18.845854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-33d58b7e-8b52-4bcb-8f8a-6d5d304f71d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c57c0a417d94a51907ac4dd4509a322'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:18.859180 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3415/6896] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:18 2022] DELETE /identity/v3/users/3c57c0a417d94a51907ac4dd4509a322 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:18.862519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92769c2b-1118-4dc1-a587-ecfd274e9491 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:18.862519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92769c2b-1118-4dc1-a587-ecfd274e9491 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:18.862519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92769c2b-1118-4dc1-a587-ecfd274e9491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:18.877300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-92769c2b-1118-4dc1-a587-ecfd274e9491 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:18.878949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-92769c2b-1118-4dc1-a587-ecfd274e9491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:18.967540 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3482/6897] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:36:18.982184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d58b7e-8b52-4bcb-8f8a-6d5d304f71d6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:18.987883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-33d58b7e-8b52-4bcb-8f8a-6d5d304f71d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:19.050249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d58b7e-8b52-4bcb-8f8a-6d5d304f71d6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:19.055182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a53f24-4c49-43a0-a5b6-4681d2a44449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:19.055852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a53f24-4c49-43a0-a5b6-4681d2a44449 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:19.056847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a53f24-4c49-43a0-a5b6-4681d2a44449 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:19.056847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a53f24-4c49-43a0-a5b6-4681d2a44449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:19.067434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a53f24-4c49-43a0-a5b6-4681d2a44449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:19.069705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a53f24-4c49-43a0-a5b6-4681d2a44449 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:19.082716 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3416/6898] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:36:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:36:19.535881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92769c2b-1118-4dc1-a587-ecfd274e9491 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:19.538022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-92769c2b-1118-4dc1-a587-ecfd274e9491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:19.550870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92769c2b-1118-4dc1-a587-ecfd274e9491 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:19.556039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd2526-b93a-4cb9-b17a-00044aaea6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:19.556865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd2526-b93a-4cb9-b17a-00044aaea6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:19.557149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd2526-b93a-4cb9-b17a-00044aaea6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:19.557554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd2526-b93a-4cb9-b17a-00044aaea6f9 admin admin] PATH_INFO: `/v3/projects/d3cbf1e2ddad48cc9bfc38e8c93ed63b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:19.558748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd2526-b93a-4cb9-b17a-00044aaea6f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3cbf1e2ddad48cc9bfc38e8c93ed63b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:19.560746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd2526-b93a-4cb9-b17a-00044aaea6f9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:19.568052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:19.714104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16fd2526-b93a-4cb9-b17a-00044aaea6f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3cbf1e2ddad48cc9bfc38e8c93ed63b', 'request_id': 'req-16fd2526-b93a-4cb9-b17a-00044aaea6f9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:19.720963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16fd2526-b93a-4cb9-b17a-00044aaea6f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3cbf1e2ddad48cc9bfc38e8c93ed63b', 'request_id': 'req-16fd2526-b93a-4cb9-b17a-00044aaea6f9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:19.727185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16fd2526-b93a-4cb9-b17a-00044aaea6f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3cbf1e2ddad48cc9bfc38e8c93ed63b', 'request_id': 'req-16fd2526-b93a-4cb9-b17a-00044aaea6f9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:19.801667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16fd2526-b93a-4cb9-b17a-00044aaea6f9 admin admin] The token cache is being invalidate because project d3cbf1e2ddad48cc9bfc38e8c93ed63b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:19.801957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16fd2526-b93a-4cb9-b17a-00044aaea6f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:19.803107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-16fd2526-b93a-4cb9-b17a-00044aaea6f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:19.804697 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3483/6899] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:36:19 2022] DELETE /identity/v3/projects/d3cbf1e2ddad48cc9bfc38e8c93ed63b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:19.808935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a53f24-4c49-43a0-a5b6-4681d2a44449 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:19.819906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a53f24-4c49-43a0-a5b6-4681d2a44449 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:19.853635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:19.890206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd2526-b93a-4cb9-b17a-00044aaea6f9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:19.892411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-16fd2526-b93a-4cb9-b17a-00044aaea6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:19.907859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90a7f3-ce5f-45e6-8970-e12c831110e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:19.908768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90a7f3-ce5f-45e6-8970-e12c831110e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:19.909054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90a7f3-ce5f-45e6-8970-e12c831110e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:19.909383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90a7f3-ce5f-45e6-8970-e12c831110e8 admin admin] PATH_INFO: `/v3/users/e4f03916d4b4423abe682a4bb6f15f0e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:19.910918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90a7f3-ce5f-45e6-8970-e12c831110e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4f03916d4b4423abe682a4bb6f15f0e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:19.912918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90a7f3-ce5f-45e6-8970-e12c831110e8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:19.967551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd2526-b93a-4cb9-b17a-00044aaea6f9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:19.972452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b05d3-cec9-4928-8f6b-a3edbd311805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:19.973316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b05d3-cec9-4928-8f6b-a3edbd311805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:19.973665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b05d3-cec9-4928-8f6b-a3edbd311805 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:19.973980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b05d3-cec9-4928-8f6b-a3edbd311805 admin admin] PATH_INFO: `/v3/users/8a57d14469064f9f99a655a79f19a59e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:19.975234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b05d3-cec9-4928-8f6b-a3edbd311805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a57d14469064f9f99a655a79f19a59e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:19.977191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b05d3-cec9-4928-8f6b-a3edbd311805 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:20.205619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2f90a7f3-ce5f-45e6-8970-e12c831110e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4f03916d4b4423abe682a4bb6f15f0e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:20.222483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2f90a7f3-ce5f-45e6-8970-e12c831110e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4f03916d4b4423abe682a4bb6f15f0e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:20.262917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3e9b05d3-cec9-4928-8f6b-a3edbd311805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a57d14469064f9f99a655a79f19a59e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:20.270119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3e9b05d3-cec9-4928-8f6b-a3edbd311805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a57d14469064f9f99a655a79f19a59e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:20.306938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2f90a7f3-ce5f-45e6-8970-e12c831110e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4f03916d4b4423abe682a4bb6f15f0e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:20.315822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2f90a7f3-ce5f-45e6-8970-e12c831110e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4f03916d4b4423abe682a4bb6f15f0e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:20.316670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2f90a7f3-ce5f-45e6-8970-e12c831110e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4f03916d4b4423abe682a4bb6f15f0e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:20.323092 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3417/6900] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:19 2022] DELETE /identity/v3/users/e4f03916d4b4423abe682a4bb6f15f0e => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:36:20.402532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3e9b05d3-cec9-4928-8f6b-a3edbd311805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a57d14469064f9f99a655a79f19a59e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:20.404385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3e9b05d3-cec9-4928-8f6b-a3edbd311805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a57d14469064f9f99a655a79f19a59e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:20.439373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3e9b05d3-cec9-4928-8f6b-a3edbd311805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a57d14469064f9f99a655a79f19a59e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:20.446766 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3484/6901] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:19 2022] DELETE /identity/v3/users/8a57d14469064f9f99a655a79f19a59e => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:36:20.451561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4c340-6d1f-45c8-8df6-086fa799514c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:20.451871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4c340-6d1f-45c8-8df6-086fa799514c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:20.452158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4c340-6d1f-45c8-8df6-086fa799514c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:20.471628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-88d4c340-6d1f-45c8-8df6-086fa799514c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:20.472863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-88d4c340-6d1f-45c8-8df6-086fa799514c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:20.545713 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3418/6902] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:36:20.553724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b05d3-cec9-4928-8f6b-a3edbd311805 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:20.555295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3e9b05d3-cec9-4928-8f6b-a3edbd311805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:20.602273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:20.671822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b05d3-cec9-4928-8f6b-a3edbd311805 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:20.676483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd447d1-acee-478b-a2af-a90f8d9bfc7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:20.677667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd447d1-acee-478b-a2af-a90f8d9bfc7b service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:20.677950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd447d1-acee-478b-a2af-a90f8d9bfc7b service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:20.678275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd447d1-acee-478b-a2af-a90f8d9bfc7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:20.689024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd447d1-acee-478b-a2af-a90f8d9bfc7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:20.690482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd447d1-acee-478b-a2af-a90f8d9bfc7b service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:20.701975 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3485/6903] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:36:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:36:20.906469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4c340-6d1f-45c8-8df6-086fa799514c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:20.907994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-88d4c340-6d1f-45c8-8df6-086fa799514c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:20.937490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4c340-6d1f-45c8-8df6-086fa799514c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:20.946404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f54762-9f8b-4dc2-b660-a0718b0f96b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:20.948170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f54762-9f8b-4dc2-b660-a0718b0f96b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:20.948648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f54762-9f8b-4dc2-b660-a0718b0f96b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:20.949222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f54762-9f8b-4dc2-b660-a0718b0f96b6 admin admin] PATH_INFO: `/v3/projects/f5c332fdcb1f42d280736751d6d259bf` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:20.952301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f54762-9f8b-4dc2-b660-a0718b0f96b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5c332fdcb1f42d280736751d6d259bf)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:20.957960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f54762-9f8b-4dc2-b660-a0718b0f96b6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:21.093014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a0f54762-9f8b-4dc2-b660-a0718b0f96b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5c332fdcb1f42d280736751d6d259bf', 'request_id': 'req-a0f54762-9f8b-4dc2-b660-a0718b0f96b6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:21.099681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a0f54762-9f8b-4dc2-b660-a0718b0f96b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5c332fdcb1f42d280736751d6d259bf', 'request_id': 'req-a0f54762-9f8b-4dc2-b660-a0718b0f96b6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:21.106680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a0f54762-9f8b-4dc2-b660-a0718b0f96b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5c332fdcb1f42d280736751d6d259bf', 'request_id': 'req-a0f54762-9f8b-4dc2-b660-a0718b0f96b6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:21.183237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a0f54762-9f8b-4dc2-b660-a0718b0f96b6 admin admin] The token cache is being invalidate because project f5c332fdcb1f42d280736751d6d259bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:21.183645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a0f54762-9f8b-4dc2-b660-a0718b0f96b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:21.184421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a0f54762-9f8b-4dc2-b660-a0718b0f96b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:21.186261 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3419/6904] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:36:20 2022] DELETE /identity/v3/projects/f5c332fdcb1f42d280736751d6d259bf => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:21.190595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd447d1-acee-478b-a2af-a90f8d9bfc7b service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:21.202317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd447d1-acee-478b-a2af-a90f8d9bfc7b service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:21.269454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfc8a1-be8d-4853-bbc2-80ffc00e1b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:21.270477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfc8a1-be8d-4853-bbc2-80ffc00e1b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:21.271475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfc8a1-be8d-4853-bbc2-80ffc00e1b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:21.271960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfc8a1-be8d-4853-bbc2-80ffc00e1b7c admin admin] PATH_INFO: `/v3/users/66191b16e25548b983c5d7fd97c1245a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:21.273335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfc8a1-be8d-4853-bbc2-80ffc00e1b7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=66191b16e25548b983c5d7fd97c1245a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:21.273454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:21.275315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfc8a1-be8d-4853-bbc2-80ffc00e1b7c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:21.540603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f54762-9f8b-4dc2-b660-a0718b0f96b6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:21.542806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a0f54762-9f8b-4dc2-b660-a0718b0f96b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:21.563029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f54762-9f8b-4dc2-b660-a0718b0f96b6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:21.568851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc2264-75a1-4bb5-822a-be7b335df5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:21.569735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc2264-75a1-4bb5-822a-be7b335df5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:21.570021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc2264-75a1-4bb5-822a-be7b335df5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:21.570304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc2264-75a1-4bb5-822a-be7b335df5f7 admin admin] PATH_INFO: `/v3/projects/17f9e0949e6b4269843b7afbdcb192eb` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:21.571621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc2264-75a1-4bb5-822a-be7b335df5f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17f9e0949e6b4269843b7afbdcb192eb)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:21.574840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc2264-75a1-4bb5-822a-be7b335df5f7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:21.600514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-19dfc8a1-be8d-4853-bbc2-80ffc00e1b7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66191b16e25548b983c5d7fd97c1245a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:21.608963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-19dfc8a1-be8d-4853-bbc2-80ffc00e1b7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66191b16e25548b983c5d7fd97c1245a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:21.744683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-19dfc8a1-be8d-4853-bbc2-80ffc00e1b7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66191b16e25548b983c5d7fd97c1245a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:21.745124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-19dfc8a1-be8d-4853-bbc2-80ffc00e1b7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66191b16e25548b983c5d7fd97c1245a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:21.759327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-19dfc8a1-be8d-4853-bbc2-80ffc00e1b7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66191b16e25548b983c5d7fd97c1245a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:21.762980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-38fc2264-75a1-4bb5-822a-be7b335df5f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17f9e0949e6b4269843b7afbdcb192eb', 'request_id': 'req-38fc2264-75a1-4bb5-822a-be7b335df5f7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:21.766140 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3486/6905] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:21 2022] DELETE /identity/v3/users/66191b16e25548b983c5d7fd97c1245a => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:21.768714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-38fc2264-75a1-4bb5-822a-be7b335df5f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17f9e0949e6b4269843b7afbdcb192eb', 'request_id': 'req-38fc2264-75a1-4bb5-822a-be7b335df5f7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:21.775264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-38fc2264-75a1-4bb5-822a-be7b335df5f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17f9e0949e6b4269843b7afbdcb192eb', 'request_id': 'req-38fc2264-75a1-4bb5-822a-be7b335df5f7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:21.921151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-38fc2264-75a1-4bb5-822a-be7b335df5f7 admin admin] The token cache is being invalidate because project 17f9e0949e6b4269843b7afbdcb192eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:21.921882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-38fc2264-75a1-4bb5-822a-be7b335df5f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:21.922044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-38fc2264-75a1-4bb5-822a-be7b335df5f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:21.923652 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3420/6906] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:36:21 2022] DELETE /identity/v3/projects/17f9e0949e6b4269843b7afbdcb192eb => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:36:21.929148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bac649-0e2d-4468-a49b-7361965d0ee5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:21.929436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bac649-0e2d-4468-a49b-7361965d0ee5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:21.929704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bac649-0e2d-4468-a49b-7361965d0ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:21.949480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-97bac649-0e2d-4468-a49b-7361965d0ee5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:21.950775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-97bac649-0e2d-4468-a49b-7361965d0ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:22.047326 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3487/6907] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:22.054945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6e804-8dcf-4375-83b2-245b7a8d26ed None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:22.055197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6e804-8dcf-4375-83b2-245b7a8d26ed None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:22.055589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6e804-8dcf-4375-83b2-245b7a8d26ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:22.088607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-05d6e804-8dcf-4375-83b2-245b7a8d26ed None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:22.089934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-05d6e804-8dcf-4375-83b2-245b7a8d26ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:22.098531 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3421/6908] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:22.103024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:22.104774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bac649-0e2d-4468-a49b-7361965d0ee5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:22.120257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bac649-0e2d-4468-a49b-7361965d0ee5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:22.129324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b7ed6-5006-4327-858b-af852fa0bf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:22.129324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b7ed6-5006-4327-858b-af852fa0bf5a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:22.129324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b7ed6-5006-4327-858b-af852fa0bf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:22.129923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b7ed6-5006-4327-858b-af852fa0bf5a admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:22.130908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b7ed6-5006-4327-858b-af852fa0bf5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:36:22.131532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b7ed6-5006-4327-858b-af852fa0bf5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:22.133729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b7ed6-5006-4327-858b-af852fa0bf5a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:22.148491 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3488/6909] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:36:22.152724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6e804-8dcf-4375-83b2-245b7a8d26ed None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:22.163911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6e804-8dcf-4375-83b2-245b7a8d26ed None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:22.169470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc8a78-1445-4976-9247-fd77b36d13dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:22.170139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc8a78-1445-4976-9247-fd77b36d13dd admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:22.170419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc8a78-1445-4976-9247-fd77b36d13dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:22.170746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc8a78-1445-4976-9247-fd77b36d13dd admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:22.171670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc8a78-1445-4976-9247-fd77b36d13dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:22.173936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc8a78-1445-4976-9247-fd77b36d13dd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:22.320990 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3422/6910] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:36:22 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:36:22.324898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b7ed6-5006-4327-858b-af852fa0bf5a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:22.335728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b7ed6-5006-4327-858b-af852fa0bf5a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:22.366564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc8a78-1445-4976-9247-fd77b36d13dd admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:22.369081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4fdc8a78-1445-4976-9247-fd77b36d13dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:22.402773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083ccc3-07f4-4592-980f-cf3c7c647eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:22.402773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083ccc3-07f4-4592-980f-cf3c7c647eca admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:22.402773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083ccc3-07f4-4592-980f-cf3c7c647eca admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:22.402773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083ccc3-07f4-4592-980f-cf3c7c647eca admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:22.403382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083ccc3-07f4-4592-980f-cf3c7c647eca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:22.405809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083ccc3-07f4-4592-980f-cf3c7c647eca admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:22.458462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc8a78-1445-4976-9247-fd77b36d13dd admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:22.463590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028662a1-fa75-44b2-b8bb-df14da5bfd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:22.464530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028662a1-fa75-44b2-b8bb-df14da5bfd87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:22.464841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028662a1-fa75-44b2-b8bb-df14da5bfd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:22.465112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028662a1-fa75-44b2-b8bb-df14da5bfd87 admin admin] PATH_INFO: `/v3/projects/e89804af39e341dab495e21f28d166ba` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:22.466386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028662a1-fa75-44b2-b8bb-df14da5bfd87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e89804af39e341dab495e21f28d166ba)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:22.468481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028662a1-fa75-44b2-b8bb-df14da5bfd87 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:22.486879 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3489/6911] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:36:22 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:36:22.491572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083ccc3-07f4-4592-980f-cf3c7c647eca admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:22.507211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083ccc3-07f4-4592-980f-cf3c7c647eca admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:22.515376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e5b82-0854-4cc5-8b00-90766993c6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:22.516877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e5b82-0854-4cc5-8b00-90766993c6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:22.517339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e5b82-0854-4cc5-8b00-90766993c6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:22.518180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e5b82-0854-4cc5-8b00-90766993c6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:22.519145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e5b82-0854-4cc5-8b00-90766993c6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:22.522398 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e5b82-0854-4cc5-8b00-90766993c6f8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:22.534711 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3490/6912] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:36:22.539742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e5b82-0854-4cc5-8b00-90766993c6f8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:22.554782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e5b82-0854-4cc5-8b00-90766993c6f8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:22.561278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d99f14-a31e-4059-8b07-eaf13c634a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:22.562423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d99f14-a31e-4059-8b07-eaf13c634a7a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:22.562590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d99f14-a31e-4059-8b07-eaf13c634a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:22.563187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d99f14-a31e-4059-8b07-eaf13c634a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:22.563867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d99f14-a31e-4059-8b07-eaf13c634a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:22.565518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d99f14-a31e-4059-8b07-eaf13c634a7a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:22.582584 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3491/6913] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:36:22.583741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d99f14-a31e-4059-8b07-eaf13c634a7a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:22.594956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d99f14-a31e-4059-8b07-eaf13c634a7a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:22.606777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-028662a1-fa75-44b2-b8bb-df14da5bfd87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e89804af39e341dab495e21f28d166ba', 'request_id': 'req-028662a1-fa75-44b2-b8bb-df14da5bfd87'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:22.616042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-028662a1-fa75-44b2-b8bb-df14da5bfd87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e89804af39e341dab495e21f28d166ba', 'request_id': 'req-028662a1-fa75-44b2-b8bb-df14da5bfd87'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:22.623123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-028662a1-fa75-44b2-b8bb-df14da5bfd87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e89804af39e341dab495e21f28d166ba', 'request_id': 'req-028662a1-fa75-44b2-b8bb-df14da5bfd87'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:22.671764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd918202-18b1-4c55-b83b-54137e2d5d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:22.679542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd918202-18b1-4c55-b83b-54137e2d5d96 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:22.679542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd918202-18b1-4c55-b83b-54137e2d5d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:22.679542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd918202-18b1-4c55-b83b-54137e2d5d96 admin admin] PATH_INFO: `/v3/projects/56b8099d9406431284b4dd58b5c16359/users/95cd6b54d8164de1a524b407a1852ebd/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:22.693580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd918202-18b1-4c55-b83b-54137e2d5d96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b8099d9406431284b4dd58b5c16359, user_id=95cd6b54d8164de1a524b407a1852ebd, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:22.698604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd918202-18b1-4c55-b83b-54137e2d5d96 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:22.703065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:22.709197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-028662a1-fa75-44b2-b8bb-df14da5bfd87 admin admin] The token cache is being invalidate because project e89804af39e341dab495e21f28d166ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:22.709633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-028662a1-fa75-44b2-b8bb-df14da5bfd87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:22.710372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-028662a1-fa75-44b2-b8bb-df14da5bfd87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:22.712089 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3423/6914] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:36:22 2022] DELETE /identity/v3/projects/e89804af39e341dab495e21f28d166ba => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:22.718359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e4803-eac3-428a-b6dd-0f0d850fd578 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:22.718651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e4803-eac3-428a-b6dd-0f0d850fd578 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:22.718932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e4803-eac3-428a-b6dd-0f0d850fd578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:22.742872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f47e4803-eac3-428a-b6dd-0f0d850fd578 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:22.744964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f47e4803-eac3-428a-b6dd-0f0d850fd578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:22.754895 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3424/6915] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:22.762971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f07d2-7967-42ee-adda-8cb307f1f907 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:22.763391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f07d2-7967-42ee-adda-8cb307f1f907 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:22.763775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f07d2-7967-42ee-adda-8cb307f1f907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:22.790242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7e2f07d2-7967-42ee-adda-8cb307f1f907 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:22.792011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7e2f07d2-7967-42ee-adda-8cb307f1f907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:22.812395 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3425/6916] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:36:22.816231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f07d2-7967-42ee-adda-8cb307f1f907 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:22.839690 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3492/6917] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:36:22 2022] PUT /identity/v3/projects/56b8099d9406431284b4dd58b5c16359/users/95cd6b54d8164de1a524b407a1852ebd/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:22.843525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f07d2-7967-42ee-adda-8cb307f1f907 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:22.847076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebbd84-fa7b-4337-8853-4f288bd9c689 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:22.849740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebbd84-fa7b-4337-8853-4f288bd9c689 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:22.850235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebbd84-fa7b-4337-8853-4f288bd9c689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:22.883827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-28ebbd84-fa7b-4337-8853-4f288bd9c689 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:22.885186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-28ebbd84-fa7b-4337-8853-4f288bd9c689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:22.959915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10755b-02d0-4840-9415-aee4aec5db4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:22.960742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10755b-02d0-4840-9415-aee4aec5db4f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:22.961099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10755b-02d0-4840-9415-aee4aec5db4f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:22.961451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10755b-02d0-4840-9415-aee4aec5db4f admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:22.962283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10755b-02d0-4840-9415-aee4aec5db4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:36:22.962666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10755b-02d0-4840-9415-aee4aec5db4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:22.968373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10755b-02d0-4840-9415-aee4aec5db4f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:22.974349 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3493/6918] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:36:22.988146 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3426/6919] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:36:22.997071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebbd84-fa7b-4337-8853-4f288bd9c689 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:23.014500 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10755b-02d0-4840-9415-aee4aec5db4f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:23.025083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3f10755b-02d0-4840-9415-aee4aec5db4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:23.029065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebbd84-fa7b-4337-8853-4f288bd9c689 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:23.038333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e9620-d249-4447-9bc0-59712ad3a009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:23.038927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e9620-d249-4447-9bc0-59712ad3a009 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:23.039272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e9620-d249-4447-9bc0-59712ad3a009 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:23.039555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e9620-d249-4447-9bc0-59712ad3a009 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:23.040320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e9620-d249-4447-9bc0-59712ad3a009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:23.042293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e9620-d249-4447-9bc0-59712ad3a009 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:23.139589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10755b-02d0-4840-9415-aee4aec5db4f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:23.144774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02099b-f23d-4e5e-bba6-74b5ff30b9ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:23.145680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02099b-f23d-4e5e-bba6-74b5ff30b9ff service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:23.146212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02099b-f23d-4e5e-bba6-74b5ff30b9ff service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:23.146699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02099b-f23d-4e5e-bba6-74b5ff30b9ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:23.158307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02099b-f23d-4e5e-bba6-74b5ff30b9ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:23.161078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02099b-f23d-4e5e-bba6-74b5ff30b9ff service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:23.176688 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3494/6920] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:36:22 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:23.178783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e9620-d249-4447-9bc0-59712ad3a009 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:23.183163 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3427/6921] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:36:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:36:23.266467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e9620-d249-4447-9bc0-59712ad3a009 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:23.274071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42de19a-c331-42fe-95a1-37abbfd8cbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:23.275269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42de19a-c331-42fe-95a1-37abbfd8cbb2 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:23.275560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42de19a-c331-42fe-95a1-37abbfd8cbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:23.276276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42de19a-c331-42fe-95a1-37abbfd8cbb2 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:23.277132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42de19a-c331-42fe-95a1-37abbfd8cbb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:23.279699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42de19a-c331-42fe-95a1-37abbfd8cbb2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:23.307813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:23.403427 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3495/6922] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:36:23 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:36:23.407534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02099b-f23d-4e5e-bba6-74b5ff30b9ff service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:23.420994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02099b-f23d-4e5e-bba6-74b5ff30b9ff service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:23.428048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8efdcb-bac3-4eab-8a7d-22157ead6509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:23.429366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8efdcb-bac3-4eab-8a7d-22157ead6509 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:23.429650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8efdcb-bac3-4eab-8a7d-22157ead6509 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:23.429930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8efdcb-bac3-4eab-8a7d-22157ead6509 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:23.430708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8efdcb-bac3-4eab-8a7d-22157ead6509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:23.433133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8efdcb-bac3-4eab-8a7d-22157ead6509 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:23.456422 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3428/6923] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:36:23.457193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42de19a-c331-42fe-95a1-37abbfd8cbb2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:23.470118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42de19a-c331-42fe-95a1-37abbfd8cbb2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:23.476192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b782f86-db7b-4570-9680-0ccf402462f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:23.476892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782f86-db7b-4570-9680-0ccf402462f5 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:23.477396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782f86-db7b-4570-9680-0ccf402462f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:23.477712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782f86-db7b-4570-9680-0ccf402462f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:23.478611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b782f86-db7b-4570-9680-0ccf402462f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:23.480458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b782f86-db7b-4570-9680-0ccf402462f5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:23.494201 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3496/6924] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:36:23.498272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8efdcb-bac3-4eab-8a7d-22157ead6509 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:23.513715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8efdcb-bac3-4eab-8a7d-22157ead6509 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:23.521364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ac29a-a0f8-44c3-b371-135b3182fbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:23.524047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ac29a-a0f8-44c3-b371-135b3182fbe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:23.524342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ac29a-a0f8-44c3-b371-135b3182fbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:23.526394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ac29a-a0f8-44c3-b371-135b3182fbe0 admin admin] PATH_INFO: `/v3/projects/ed28a2c5cfd241d9ac065ed49746acef/users/8d681f1ba4214188a35667a47473633e/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:23.546677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ac29a-a0f8-44c3-b371-135b3182fbe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed28a2c5cfd241d9ac065ed49746acef, user_id=8d681f1ba4214188a35667a47473633e, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:23.549668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ac29a-a0f8-44c3-b371-135b3182fbe0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:23.722061 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3429/6925] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:36:23 2022] PUT /identity/v3/projects/ed28a2c5cfd241d9ac065ed49746acef/users/8d681f1ba4214188a35667a47473633e/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:23.724651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d6732-088d-4fbe-b3ba-f335c3b4b132 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:23.724949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d6732-088d-4fbe-b3ba-f335c3b4b132 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:23.725234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d6732-088d-4fbe-b3ba-f335c3b4b132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:23.756486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-de4d6732-088d-4fbe-b3ba-f335c3b4b132 None None] MFA Rules not processed for user `8d681f1ba4214188a35667a47473633e`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:23.757943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-de4d6732-088d-4fbe-b3ba-f335c3b4b132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:23.881602 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3497/6926] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:23.882902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ac29a-a0f8-44c3-b371-135b3182fbe0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:23.980109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ac29a-a0f8-44c3-b371-135b3182fbe0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:23.985760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a47b7-d11c-4148-aa09-194005ef1936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:23.986525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a47b7-d11c-4148-aa09-194005ef1936 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:23.986880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a47b7-d11c-4148-aa09-194005ef1936 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:23.987278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a47b7-d11c-4148-aa09-194005ef1936 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:23.988739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a47b7-d11c-4148-aa09-194005ef1936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:23.991822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a47b7-d11c-4148-aa09-194005ef1936 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:24.069758 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3430/6927] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:36:23 2022] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:24.071158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d6732-088d-4fbe-b3ba-f335c3b4b132 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:24.090309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:24.096319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d6732-088d-4fbe-b3ba-f335c3b4b132 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:24.213724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:24.251584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416535aa-4d14-420f-908e-e315171e135f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:24.252592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416535aa-4d14-420f-908e-e315171e135f admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:24.253043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416535aa-4d14-420f-908e-e315171e135f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:24.253425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416535aa-4d14-420f-908e-e315171e135f admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:24.254965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416535aa-4d14-420f-908e-e315171e135f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:24.257698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416535aa-4d14-420f-908e-e315171e135f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:24.372683 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3498/6928] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:36:24 2022] POST /identity/v3/users => generated 297 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:24.376797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a47b7-d11c-4148-aa09-194005ef1936 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:24.389775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a47b7-d11c-4148-aa09-194005ef1936 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:24.400452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6643c3-ff69-4c38-b3ea-38eabc335211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:24.402046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6643c3-ff69-4c38-b3ea-38eabc335211 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:24.402406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6643c3-ff69-4c38-b3ea-38eabc335211 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:24.403291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6643c3-ff69-4c38-b3ea-38eabc335211 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:24.404039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6643c3-ff69-4c38-b3ea-38eabc335211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:24.406160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6643c3-ff69-4c38-b3ea-38eabc335211 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:24.423141 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3431/6929] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:36:24.424563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416535aa-4d14-420f-908e-e315171e135f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:24.439906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416535aa-4d14-420f-908e-e315171e135f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:24.448310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13389d5-6125-4e8b-bd42-80973fc8ecd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:24.451556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13389d5-6125-4e8b-bd42-80973fc8ecd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:24.451556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13389d5-6125-4e8b-bd42-80973fc8ecd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:24.451556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13389d5-6125-4e8b-bd42-80973fc8ecd1 admin admin] PATH_INFO: `/v3/projects/e2bf985c7d224bfb911fc832c1033e5c/users/113ed3475ee84f08ad045c4e8645bbc3/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:24.479834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13389d5-6125-4e8b-bd42-80973fc8ecd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2bf985c7d224bfb911fc832c1033e5c, user_id=113ed3475ee84f08ad045c4e8645bbc3, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:24.479834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13389d5-6125-4e8b-bd42-80973fc8ecd1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:24.575855 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3499/6930] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:36:24 2022] PUT /identity/v3/projects/e2bf985c7d224bfb911fc832c1033e5c/users/113ed3475ee84f08ad045c4e8645bbc3/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:24.581195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6643c3-ff69-4c38-b3ea-38eabc335211 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:24.596280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6643c3-ff69-4c38-b3ea-38eabc335211 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:24.669514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cb41a-7c60-43a3-b797-27f00c395fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:24.670227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cb41a-7c60-43a3-b797-27f00c395fed admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:24.677801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cb41a-7c60-43a3-b797-27f00c395fed admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:24.677801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cb41a-7c60-43a3-b797-27f00c395fed admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:24.681107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cb41a-7c60-43a3-b797-27f00c395fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:24.683468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cb41a-7c60-43a3-b797-27f00c395fed admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:24.699199 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3432/6931] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:36:24.702100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13389d5-6125-4e8b-bd42-80973fc8ecd1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:24.720033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13389d5-6125-4e8b-bd42-80973fc8ecd1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:24.726608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ce918-675f-4467-9fcb-4c4d1707cc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:24.727679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ce918-675f-4467-9fcb-4c4d1707cc4f admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:24.728021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ce918-675f-4467-9fcb-4c4d1707cc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:24.728367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ce918-675f-4467-9fcb-4c4d1707cc4f admin admin] PATH_INFO: `/v3/projects/e2bf985c7d224bfb911fc832c1033e5c/users/113ed3475ee84f08ad045c4e8645bbc3/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:24.730788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ce918-675f-4467-9fcb-4c4d1707cc4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2bf985c7d224bfb911fc832c1033e5c, user_id=113ed3475ee84f08ad045c4e8645bbc3, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:24.733604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ce918-675f-4467-9fcb-4c4d1707cc4f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:24.746103 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3500/6932] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:36:24 2022] PUT /identity/v3/projects/e2bf985c7d224bfb911fc832c1033e5c/users/113ed3475ee84f08ad045c4e8645bbc3/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:24.757254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3842907-f4c7-4da3-a045-8393bb19d622 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:24.757544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3842907-f4c7-4da3-a045-8393bb19d622 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:24.757833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3842907-f4c7-4da3-a045-8393bb19d622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:24.791935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a3842907-f4c7-4da3-a045-8393bb19d622 None None] MFA Rules not processed for user `113ed3475ee84f08ad045c4e8645bbc3`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:24.793343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a3842907-f4c7-4da3-a045-8393bb19d622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:24.865765 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3433/6933] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:24.877581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ce918-675f-4467-9fcb-4c4d1707cc4f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:24.879440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cb5ce918-675f-4467-9fcb-4c4d1707cc4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:24.961872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ce918-675f-4467-9fcb-4c4d1707cc4f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:24.965777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ced790-14ee-4f91-96e5-b0b8ffaee70e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:24.966380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ced790-14ee-4f91-96e5-b0b8ffaee70e service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:24.966658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ced790-14ee-4f91-96e5-b0b8ffaee70e service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:24.966930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ced790-14ee-4f91-96e5-b0b8ffaee70e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:25.035411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60d583-db3c-4caa-8178-cb1fa715b9d8 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:25.035880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60d583-db3c-4caa-8178-cb1fa715b9d8 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:25.035970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60d583-db3c-4caa-8178-cb1fa715b9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:25.069103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ced790-14ee-4f91-96e5-b0b8ffaee70e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:25.071598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ced790-14ee-4f91-96e5-b0b8ffaee70e service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:25.085379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ab60d583-db3c-4caa-8178-cb1fa715b9d8 None None] MFA Rules not processed for user `95cd6b54d8164de1a524b407a1852ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:25.086940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ab60d583-db3c-4caa-8178-cb1fa715b9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:25.110217 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3501/6934] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:36:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:36:25.219209 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3434/6935] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:36:25.230137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ced790-14ee-4f91-96e5-b0b8ffaee70e service cinder] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:25.232029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a6ced790-14ee-4f91-96e5-b0b8ffaee70e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:25.247774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ced790-14ee-4f91-96e5-b0b8ffaee70e service cinder] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:25.251955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55a4e4-8ab3-4dd8-9716-8b9530a90d4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:25.252641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55a4e4-8ab3-4dd8-9716-8b9530a90d4a service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:25.252927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55a4e4-8ab3-4dd8-9716-8b9530a90d4a service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:25.253208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55a4e4-8ab3-4dd8-9716-8b9530a90d4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:25.259893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:25.264492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55a4e4-8ab3-4dd8-9716-8b9530a90d4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:25.271568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55a4e4-8ab3-4dd8-9716-8b9530a90d4a service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:25.278128 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3502/6936] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:36:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:36:25.507367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:26.517670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60d583-db3c-4caa-8178-cb1fa715b9d8 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:26.520172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ab60d583-db3c-4caa-8178-cb1fa715b9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:26.619406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60d583-db3c-4caa-8178-cb1fa715b9d8 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:26.623995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4868cf8-494d-4d06-a0d3-8d117bd8bb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:26.624844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4868cf8-494d-4d06-a0d3-8d117bd8bb5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:26.625125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4868cf8-494d-4d06-a0d3-8d117bd8bb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:26.625397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4868cf8-494d-4d06-a0d3-8d117bd8bb5c admin admin] PATH_INFO: `/v3/users/22e264440fff43cdb7be6702839af37f` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:26.626564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4868cf8-494d-4d06-a0d3-8d117bd8bb5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=22e264440fff43cdb7be6702839af37f)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:26.628508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4868cf8-494d-4d06-a0d3-8d117bd8bb5c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:26.772168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f4868cf8-494d-4d06-a0d3-8d117bd8bb5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22e264440fff43cdb7be6702839af37f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:26.786116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f4868cf8-494d-4d06-a0d3-8d117bd8bb5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22e264440fff43cdb7be6702839af37f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:26.848663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f4868cf8-494d-4d06-a0d3-8d117bd8bb5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22e264440fff43cdb7be6702839af37f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:26.857259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f4868cf8-494d-4d06-a0d3-8d117bd8bb5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22e264440fff43cdb7be6702839af37f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:26.857903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f4868cf8-494d-4d06-a0d3-8d117bd8bb5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22e264440fff43cdb7be6702839af37f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:26.863942 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3435/6937] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:26 2022] DELETE /identity/v3/users/22e264440fff43cdb7be6702839af37f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:27.188192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55a4e4-8ab3-4dd8-9716-8b9530a90d4a service cinder] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:27.192882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55a4e4-8ab3-4dd8-9716-8b9530a90d4a service cinder] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:27.262678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa325eb3-503a-4b49-9206-ffefff0d8ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:27.263572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa325eb3-503a-4b49-9206-ffefff0d8ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:27.263859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa325eb3-503a-4b49-9206-ffefff0d8ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:27.264189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa325eb3-503a-4b49-9206-ffefff0d8ccf admin admin] PATH_INFO: `/v3/projects/da2248fa190342f0bfe9211cae1e403b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:27.265938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa325eb3-503a-4b49-9206-ffefff0d8ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=da2248fa190342f0bfe9211cae1e403b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:27.268356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa325eb3-503a-4b49-9206-ffefff0d8ccf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:27.402769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa325eb3-503a-4b49-9206-ffefff0d8ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da2248fa190342f0bfe9211cae1e403b', 'request_id': 'req-aa325eb3-503a-4b49-9206-ffefff0d8ccf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:27.409075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa325eb3-503a-4b49-9206-ffefff0d8ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da2248fa190342f0bfe9211cae1e403b', 'request_id': 'req-aa325eb3-503a-4b49-9206-ffefff0d8ccf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:27.417133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa325eb3-503a-4b49-9206-ffefff0d8ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da2248fa190342f0bfe9211cae1e403b', 'request_id': 'req-aa325eb3-503a-4b49-9206-ffefff0d8ccf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:27.539190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa325eb3-503a-4b49-9206-ffefff0d8ccf admin admin] The token cache is being invalidate because project da2248fa190342f0bfe9211cae1e403b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:27.539480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa325eb3-503a-4b49-9206-ffefff0d8ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:27.540253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa325eb3-503a-4b49-9206-ffefff0d8ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:27.541788 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3503/6938] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:36:27 2022] DELETE /identity/v3/projects/da2248fa190342f0bfe9211cae1e403b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:36:27.548957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f478934-719b-4ca0-92c6-956bd316092f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:27.549408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f478934-719b-4ca0-92c6-956bd316092f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:27.549496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f478934-719b-4ca0-92c6-956bd316092f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:27.556288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:27.569081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5f478934-719b-4ca0-92c6-956bd316092f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:27.570334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5f478934-719b-4ca0-92c6-956bd316092f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:27.632677 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3436/6939] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:27.640990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb84d6-9f7f-4027-b678-98b70f770e08 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:27.641901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb84d6-9f7f-4027-b678-98b70f770e08 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:27.641901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb84d6-9f7f-4027-b678-98b70f770e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:27.664954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0efb84d6-9f7f-4027-b678-98b70f770e08 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:27.666072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0efb84d6-9f7f-4027-b678-98b70f770e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:27.674114 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3504/6940] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:27.679152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f478934-719b-4ca0-92c6-956bd316092f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:27.688973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f478934-719b-4ca0-92c6-956bd316092f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:27.694293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a969b-cc97-43d1-a72f-602b5d3649e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:27.694942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a969b-cc97-43d1-a72f-602b5d3649e8 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:27.695260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a969b-cc97-43d1-a72f-602b5d3649e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:27.695539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a969b-cc97-43d1-a72f-602b5d3649e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:27.696258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a969b-cc97-43d1-a72f-602b5d3649e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:36:27.696565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a969b-cc97-43d1-a72f-602b5d3649e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:27.698148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a969b-cc97-43d1-a72f-602b5d3649e8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:27.709854 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3437/6941] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:36:27.714681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb84d6-9f7f-4027-b678-98b70f770e08 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:27.724541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb84d6-9f7f-4027-b678-98b70f770e08 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:27.729530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679b9d3-a5a9-4334-a2d2-cfd6f0433892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:27.730185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679b9d3-a5a9-4334-a2d2-cfd6f0433892 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:27.730471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679b9d3-a5a9-4334-a2d2-cfd6f0433892 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:27.731091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679b9d3-a5a9-4334-a2d2-cfd6f0433892 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:27.731893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679b9d3-a5a9-4334-a2d2-cfd6f0433892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:27.733821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679b9d3-a5a9-4334-a2d2-cfd6f0433892 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:27.820927 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3505/6942] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:36:27 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:36:27.825225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a969b-cc97-43d1-a72f-602b5d3649e8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:27.835742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a969b-cc97-43d1-a72f-602b5d3649e8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:27.893069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c4e57-f3c6-4b92-a614-5a74d107e76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:27.893738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c4e57-f3c6-4b92-a614-5a74d107e76d admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:27.894023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c4e57-f3c6-4b92-a614-5a74d107e76d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:27.894299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c4e57-f3c6-4b92-a614-5a74d107e76d admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:27.894992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c4e57-f3c6-4b92-a614-5a74d107e76d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:27.896957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c4e57-f3c6-4b92-a614-5a74d107e76d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:27.993410 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3438/6943] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:36:27 2022] POST /identity/v3/users => generated 283 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:36:27.997177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679b9d3-a5a9-4334-a2d2-cfd6f0433892 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:28.009246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679b9d3-a5a9-4334-a2d2-cfd6f0433892 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:28.013960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fe479-2a85-4431-9800-1f6fd07be18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:28.014668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fe479-2a85-4431-9800-1f6fd07be18f admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:28.014951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fe479-2a85-4431-9800-1f6fd07be18f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:28.015258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fe479-2a85-4431-9800-1f6fd07be18f admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:28.016024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fe479-2a85-4431-9800-1f6fd07be18f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:28.017620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fe479-2a85-4431-9800-1f6fd07be18f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:28.028504 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3506/6944] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:36:28.032576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c4e57-f3c6-4b92-a614-5a74d107e76d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:28.044468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c4e57-f3c6-4b92-a614-5a74d107e76d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:28.049846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53127763-9078-482f-9584-6fb36885af2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:28.050515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53127763-9078-482f-9584-6fb36885af2f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:28.050797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53127763-9078-482f-9584-6fb36885af2f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:28.051105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53127763-9078-482f-9584-6fb36885af2f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:28.051823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53127763-9078-482f-9584-6fb36885af2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:28.055168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53127763-9078-482f-9584-6fb36885af2f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:28.067545 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3439/6945] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:36:28.072609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fe479-2a85-4431-9800-1f6fd07be18f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:28.083167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fe479-2a85-4431-9800-1f6fd07be18f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:28.092714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e82181-6ad1-401f-83eb-79d88f4c26a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:28.093597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e82181-6ad1-401f-83eb-79d88f4c26a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:28.093877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e82181-6ad1-401f-83eb-79d88f4c26a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:28.094152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e82181-6ad1-401f-83eb-79d88f4c26a0 admin admin] PATH_INFO: `/v3/projects/2732560d63404d88919ce794da0d212e/users/2a1cf32c5a494cc49e4c1984ec7f116a/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:28.112914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e82181-6ad1-401f-83eb-79d88f4c26a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2732560d63404d88919ce794da0d212e, user_id=2a1cf32c5a494cc49e4c1984ec7f116a, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:28.116785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e82181-6ad1-401f-83eb-79d88f4c26a0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:28.198682 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3507/6946] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:36:28 2022] PUT /identity/v3/projects/2732560d63404d88919ce794da0d212e/users/2a1cf32c5a494cc49e4c1984ec7f116a/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:28.208849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252f00b-284c-47e6-9333-43d436136988 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:28.209137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252f00b-284c-47e6-9333-43d436136988 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:28.209459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252f00b-284c-47e6-9333-43d436136988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:28.236984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e252f00b-284c-47e6-9333-43d436136988 None None] MFA Rules not processed for user `2a1cf32c5a494cc49e4c1984ec7f116a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:28.238244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e252f00b-284c-47e6-9333-43d436136988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:28.306627 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3440/6947] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:28.311918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e82181-6ad1-401f-83eb-79d88f4c26a0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:28.336526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:28.386147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e82181-6ad1-401f-83eb-79d88f4c26a0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:28.391255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb7d37-093e-43b5-b4ed-827d1a8453de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:28.391983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb7d37-093e-43b5-b4ed-827d1a8453de admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:28.392448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb7d37-093e-43b5-b4ed-827d1a8453de admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:28.392687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb7d37-093e-43b5-b4ed-827d1a8453de admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:28.393608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb7d37-093e-43b5-b4ed-827d1a8453de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:28.395505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb7d37-093e-43b5-b4ed-827d1a8453de admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:28.561849 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3508/6948] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:36:28 2022] POST /identity/v3/projects => generated 365 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:28.563122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252f00b-284c-47e6-9333-43d436136988 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:28.574861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252f00b-284c-47e6-9333-43d436136988 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:28.632697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368ca97-2fcd-4945-b44e-cb32239e9a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:28.633372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368ca97-2fcd-4945-b44e-cb32239e9a41 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:28.633654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368ca97-2fcd-4945-b44e-cb32239e9a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:28.633926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368ca97-2fcd-4945-b44e-cb32239e9a41 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:28.634744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368ca97-2fcd-4945-b44e-cb32239e9a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:28.636728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368ca97-2fcd-4945-b44e-cb32239e9a41 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:28.738850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:28.794916 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3441/6949] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:36:28 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:28.796093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb7d37-093e-43b5-b4ed-827d1a8453de admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:28.812192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb7d37-093e-43b5-b4ed-827d1a8453de admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:28.813600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3937d7-2399-4299-9299-1f50256fca26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:28.814306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3937d7-2399-4299-9299-1f50256fca26 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:28.814586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3937d7-2399-4299-9299-1f50256fca26 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:28.814857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3937d7-2399-4299-9299-1f50256fca26 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:28.815751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3937d7-2399-4299-9299-1f50256fca26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:28.817364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3937d7-2399-4299-9299-1f50256fca26 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:28.829291 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3509/6950] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:36:28.834018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368ca97-2fcd-4945-b44e-cb32239e9a41 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:28.844946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368ca97-2fcd-4945-b44e-cb32239e9a41 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:28.850479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1deea-7ca2-4e0f-8dff-120e75268bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:28.852052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1deea-7ca2-4e0f-8dff-120e75268bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:28.852379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1deea-7ca2-4e0f-8dff-120e75268bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:28.852776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1deea-7ca2-4e0f-8dff-120e75268bbe admin admin] PATH_INFO: `/v3/projects/9d224ba7f6bb4519ba1f8c54b2377171/users/55de0b6634f64f80be506945e96ed6a5/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:28.874531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1deea-7ca2-4e0f-8dff-120e75268bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d224ba7f6bb4519ba1f8c54b2377171, user_id=55de0b6634f64f80be506945e96ed6a5, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:28.877427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1deea-7ca2-4e0f-8dff-120e75268bbe admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:28.976279 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3442/6951] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:36:28 2022] PUT /identity/v3/projects/9d224ba7f6bb4519ba1f8c54b2377171/users/55de0b6634f64f80be506945e96ed6a5/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:28.980436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3937d7-2399-4299-9299-1f50256fca26 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:28.992018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3937d7-2399-4299-9299-1f50256fca26 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:29.098677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70923f9b-de35-4499-a9de-9411c48fe0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:29.100677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70923f9b-de35-4499-a9de-9411c48fe0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:29.116512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70923f9b-de35-4499-a9de-9411c48fe0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:29.116512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70923f9b-de35-4499-a9de-9411c48fe0d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:29.116512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70923f9b-de35-4499-a9de-9411c48fe0d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:29.116512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70923f9b-de35-4499-a9de-9411c48fe0d0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:29.116512 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3510/6952] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:36:29.120369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1deea-7ca2-4e0f-8dff-120e75268bbe admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:29.132930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1deea-7ca2-4e0f-8dff-120e75268bbe admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:29.139569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbab4f-7227-48ac-86d6-4935ea75a852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:29.140480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbab4f-7227-48ac-86d6-4935ea75a852 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:29.140769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbab4f-7227-48ac-86d6-4935ea75a852 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:29.141202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbab4f-7227-48ac-86d6-4935ea75a852 admin admin] PATH_INFO: `/v3/projects/9d224ba7f6bb4519ba1f8c54b2377171/users/55de0b6634f64f80be506945e96ed6a5/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:29.143531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbab4f-7227-48ac-86d6-4935ea75a852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d224ba7f6bb4519ba1f8c54b2377171, user_id=55de0b6634f64f80be506945e96ed6a5, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:29.147419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbab4f-7227-48ac-86d6-4935ea75a852 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:29.160695 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3443/6953] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:36:29 2022] PUT /identity/v3/projects/9d224ba7f6bb4519ba1f8c54b2377171/users/55de0b6634f64f80be506945e96ed6a5/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:29.172586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ae7bf-221c-44a3-90c6-7f425a0c89f4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:29.172966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ae7bf-221c-44a3-90c6-7f425a0c89f4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:29.173468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ae7bf-221c-44a3-90c6-7f425a0c89f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:29.209989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f39ae7bf-221c-44a3-90c6-7f425a0c89f4 None None] MFA Rules not processed for user `55de0b6634f64f80be506945e96ed6a5`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:29.211395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f39ae7bf-221c-44a3-90c6-7f425a0c89f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:29.291758 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3511/6954] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:29 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:29.296319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbab4f-7227-48ac-86d6-4935ea75a852 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:29.310251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbab4f-7227-48ac-86d6-4935ea75a852 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:29.318449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724eb72-8455-4824-8ae4-9f6e510b92dc tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:29.318449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724eb72-8455-4824-8ae4-9f6e510b92dc tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:29.318449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724eb72-8455-4824-8ae4-9f6e510b92dc tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:29.319333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724eb72-8455-4824-8ae4-9f6e510b92dc tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:29.319333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724eb72-8455-4824-8ae4-9f6e510b92dc tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:29.321320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724eb72-8455-4824-8ae4-9f6e510b92dc tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:29.401838 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3444/6955] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Jul 16 21:36:29 2022] POST /identity/v3/domains => generated 276 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:36:29.403922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ae7bf-221c-44a3-90c6-7f425a0c89f4 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:29.415253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ae7bf-221c-44a3-90c6-7f425a0c89f4 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:29.488118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35c9c0-e349-4600-979d-a032d28140b2 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:29.488792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35c9c0-e349-4600-979d-a032d28140b2 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:29.489081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35c9c0-e349-4600-979d-a032d28140b2 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:29.489870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35c9c0-e349-4600-979d-a032d28140b2 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:29.490614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35c9c0-e349-4600-979d-a032d28140b2 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:29.492265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35c9c0-e349-4600-979d-a032d28140b2 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:29.572490 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3512/6956] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Jul 16 21:36:29 2022] POST /identity/v3/domains => generated 276 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:29.576551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724eb72-8455-4824-8ae4-9f6e510b92dc tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:29.588749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724eb72-8455-4824-8ae4-9f6e510b92dc tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:29.649153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860d0fc-996f-4ed3-b907-10535c90a471 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:29.649843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860d0fc-996f-4ed3-b907-10535c90a471 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:29.650133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860d0fc-996f-4ed3-b907-10535c90a471 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:29.650417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860d0fc-996f-4ed3-b907-10535c90a471 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:29.651218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860d0fc-996f-4ed3-b907-10535c90a471 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:29.652819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860d0fc-996f-4ed3-b907-10535c90a471 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:29.759691 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3445/6957] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Jul 16 21:36:29 2022] POST /identity/v3/domains => generated 277 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:36:29.763984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35c9c0-e349-4600-979d-a032d28140b2 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:29.774935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35c9c0-e349-4600-979d-a032d28140b2 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:29.839205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5032b1-e1c2-4c8e-87c9-690b74be8539 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:29.839910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5032b1-e1c2-4c8e-87c9-690b74be8539 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:29.840198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5032b1-e1c2-4c8e-87c9-690b74be8539 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:29.840504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5032b1-e1c2-4c8e-87c9-690b74be8539 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:29.841250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5032b1-e1c2-4c8e-87c9-690b74be8539 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:29.842864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5032b1-e1c2-4c8e-87c9-690b74be8539 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:29.976324 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3513/6958] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Jul 16 21:36:29 2022] POST /identity/v3/domains => generated 278 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:29.978336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860d0fc-996f-4ed3-b907-10535c90a471 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:29.990093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860d0fc-996f-4ed3-b907-10535c90a471 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:30.060700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:30.061717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:30.062088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:30.062449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains/dee6f7084d6c4704a6ac1ae1f5630581` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:30.074688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=dee6f7084d6c4704a6ac1ae1f5630581)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:30.076214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:30.103733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'dee6f7084d6c4704a6ac1ae1f5630581'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:30.113690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'dee6f7084d6c4704a6ac1ae1f5630581'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:30.190873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:30.273756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee6f7084d6c4704a6ac1ae1f5630581', 'request_id': 'req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:30.279256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee6f7084d6c4704a6ac1ae1f5630581', 'request_id': 'req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:30.287324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee6f7084d6c4704a6ac1ae1f5630581', 'request_id': 'req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:30.393544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] The token cache is being invalidate because project dee6f7084d6c4704a6ac1ae1f5630581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:30.393850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:30.394552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:30.404133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'dee6f7084d6c4704a6ac1ae1f5630581', 'request_id': 'req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:30.404828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'dee6f7084d6c4704a6ac1ae1f5630581', 'request_id': 'req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:30.405468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'dee6f7084d6c4704a6ac1ae1f5630581', 'request_id': 'req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:30.413968 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3446/6959] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:36:29 2022] DELETE /identity/v3/domains/dee6f7084d6c4704a6ac1ae1f5630581 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:30.418986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5032b1-e1c2-4c8e-87c9-690b74be8539 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:30.420752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8d5032b1-e1c2-4c8e-87c9-690b74be8539 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:30.434680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5032b1-e1c2-4c8e-87c9-690b74be8539 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:30.497713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f271d7-121e-495d-99ed-a8fa3276fe82 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:30.498427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f271d7-121e-495d-99ed-a8fa3276fe82 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:30.498703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f271d7-121e-495d-99ed-a8fa3276fe82 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:30.498982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f271d7-121e-495d-99ed-a8fa3276fe82 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:30.499748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f271d7-121e-495d-99ed-a8fa3276fe82 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:30.501359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f271d7-121e-495d-99ed-a8fa3276fe82 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:30.552741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:30.587820 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3514/6960] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:36:30 2022] POST /identity/v3/domains => generated 249 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:30.591999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:30.603000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b6102-3d62-466d-8a05-18e5c4d7afdd tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:30.660411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f8168-b046-4295-8b9e-9ae018f98fd0 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:30.661835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f8168-b046-4295-8b9e-9ae018f98fd0 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:30.662604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f8168-b046-4295-8b9e-9ae018f98fd0 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:30.662885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f8168-b046-4295-8b9e-9ae018f98fd0 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains/47d05bad7a504bde886fa4c647ce3d4c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:30.674458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f8168-b046-4295-8b9e-9ae018f98fd0 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=47d05bad7a504bde886fa4c647ce3d4c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:30.678781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f8168-b046-4295-8b9e-9ae018f98fd0 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:30.699990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-148f8168-b046-4295-8b9e-9ae018f98fd0 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '47d05bad7a504bde886fa4c647ce3d4c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:30.700737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-148f8168-b046-4295-8b9e-9ae018f98fd0 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '47d05bad7a504bde886fa4c647ce3d4c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:30.817808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-148f8168-b046-4295-8b9e-9ae018f98fd0 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '47d05bad7a504bde886fa4c647ce3d4c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:30.818480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-148f8168-b046-4295-8b9e-9ae018f98fd0 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '47d05bad7a504bde886fa4c647ce3d4c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:30.821167 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3447/6961] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:36:30 2022] PATCH /identity/v3/domains/47d05bad7a504bde886fa4c647ce3d4c => generated 250 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:36:30.825268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f271d7-121e-495d-99ed-a8fa3276fe82 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:30.827163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-26f271d7-121e-495d-99ed-a8fa3276fe82 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:30.840672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f271d7-121e-495d-99ed-a8fa3276fe82 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:30.903326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0b16c-4805-4877-a549-c4cc8a4110aa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:30.905755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0b16c-4805-4877-a549-c4cc8a4110aa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:30.906119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0b16c-4805-4877-a549-c4cc8a4110aa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:30.906384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0b16c-4805-4877-a549-c4cc8a4110aa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains/47d05bad7a504bde886fa4c647ce3d4c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:30.926246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0b16c-4805-4877-a549-c4cc8a4110aa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=47d05bad7a504bde886fa4c647ce3d4c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:30.926246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0b16c-4805-4877-a549-c4cc8a4110aa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:30.953178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55d0b16c-4805-4877-a549-c4cc8a4110aa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '47d05bad7a504bde886fa4c647ce3d4c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:30.966609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55d0b16c-4805-4877-a549-c4cc8a4110aa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '47d05bad7a504bde886fa4c647ce3d4c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:31.109195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55d0b16c-4805-4877-a549-c4cc8a4110aa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47d05bad7a504bde886fa4c647ce3d4c', 'request_id': 'req-55d0b16c-4805-4877-a549-c4cc8a4110aa'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:31.118958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55d0b16c-4805-4877-a549-c4cc8a4110aa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47d05bad7a504bde886fa4c647ce3d4c', 'request_id': 'req-55d0b16c-4805-4877-a549-c4cc8a4110aa'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:31.125169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55d0b16c-4805-4877-a549-c4cc8a4110aa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47d05bad7a504bde886fa4c647ce3d4c', 'request_id': 'req-55d0b16c-4805-4877-a549-c4cc8a4110aa'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:31.233612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55d0b16c-4805-4877-a549-c4cc8a4110aa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] The token cache is being invalidate because project 47d05bad7a504bde886fa4c647ce3d4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:31.233897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55d0b16c-4805-4877-a549-c4cc8a4110aa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:31.234823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55d0b16c-4805-4877-a549-c4cc8a4110aa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:31.243271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55d0b16c-4805-4877-a549-c4cc8a4110aa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '47d05bad7a504bde886fa4c647ce3d4c', 'request_id': 'req-55d0b16c-4805-4877-a549-c4cc8a4110aa'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:31.247098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55d0b16c-4805-4877-a549-c4cc8a4110aa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '47d05bad7a504bde886fa4c647ce3d4c', 'request_id': 'req-55d0b16c-4805-4877-a549-c4cc8a4110aa'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:31.248551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-55d0b16c-4805-4877-a549-c4cc8a4110aa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '47d05bad7a504bde886fa4c647ce3d4c', 'request_id': 'req-55d0b16c-4805-4877-a549-c4cc8a4110aa'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:31.255867 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3515/6962] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:36:30 2022] DELETE /identity/v3/domains/47d05bad7a504bde886fa4c647ce3d4c => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:31.262459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f8168-b046-4295-8b9e-9ae018f98fd0 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:31.273490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f8168-b046-4295-8b9e-9ae018f98fd0 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:31.337346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818d6f2-4132-46b0-8812-60cfe0c0bb71 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:31.338014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818d6f2-4132-46b0-8812-60cfe0c0bb71 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:31.338304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818d6f2-4132-46b0-8812-60cfe0c0bb71 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:31.338586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818d6f2-4132-46b0-8812-60cfe0c0bb71 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:31.339354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818d6f2-4132-46b0-8812-60cfe0c0bb71 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:31.340986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818d6f2-4132-46b0-8812-60cfe0c0bb71 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:31.417784 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3448/6963] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:36:31 2022] POST /identity/v3/domains => generated 279 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:36:31.421284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0b16c-4805-4877-a549-c4cc8a4110aa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:31.422740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-55d0b16c-4805-4877-a549-c4cc8a4110aa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:31.436094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0b16c-4805-4877-a549-c4cc8a4110aa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:31.492870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d8a03-8e90-4b05-b07f-872c8dfbf19f tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:31.493740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d8a03-8e90-4b05-b07f-872c8dfbf19f tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:31.494023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d8a03-8e90-4b05-b07f-872c8dfbf19f tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:31.494298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d8a03-8e90-4b05-b07f-872c8dfbf19f tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains/e213f06ee40347c289b08abe90420508` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:31.504686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d8a03-8e90-4b05-b07f-872c8dfbf19f tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e213f06ee40347c289b08abe90420508)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:31.507233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d8a03-8e90-4b05-b07f-872c8dfbf19f tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:31.527478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c88d8a03-8e90-4b05-b07f-872c8dfbf19f tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e213f06ee40347c289b08abe90420508'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:31.528218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c88d8a03-8e90-4b05-b07f-872c8dfbf19f tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e213f06ee40347c289b08abe90420508'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:31.681659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:31.691443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c88d8a03-8e90-4b05-b07f-872c8dfbf19f tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e213f06ee40347c289b08abe90420508'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:31.692064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c88d8a03-8e90-4b05-b07f-872c8dfbf19f tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e213f06ee40347c289b08abe90420508'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:31.695385 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3516/6964] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Jul 16 21:36:31 2022] PATCH /identity/v3/domains/e213f06ee40347c289b08abe90420508 => generated 278 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:36:31.699582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818d6f2-4132-46b0-8812-60cfe0c0bb71 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:31.701281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0818d6f2-4132-46b0-8812-60cfe0c0bb71 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:31.714809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818d6f2-4132-46b0-8812-60cfe0c0bb71 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:31.773103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6fab6a-0f7a-4952-802d-aae880cb0497 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:31.774000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fab6a-0f7a-4952-802d-aae880cb0497 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:31.774283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fab6a-0f7a-4952-802d-aae880cb0497 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:31.774556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fab6a-0f7a-4952-802d-aae880cb0497 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains/e213f06ee40347c289b08abe90420508` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:31.784922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6fab6a-0f7a-4952-802d-aae880cb0497 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=e213f06ee40347c289b08abe90420508)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:31.786986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6fab6a-0f7a-4952-802d-aae880cb0497 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:31.788818 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3449/6965] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Jul 16 21:36:31 2022] GET /identity/v3/domains/e213f06ee40347c289b08abe90420508 => generated 278 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:36:31.792867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d8a03-8e90-4b05-b07f-872c8dfbf19f tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:31.804289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d8a03-8e90-4b05-b07f-872c8dfbf19f tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:31.809251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:31.810104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:31.810387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:31.810664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains/e213f06ee40347c289b08abe90420508` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:31.811942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e213f06ee40347c289b08abe90420508)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:31.813617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:31.839788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e213f06ee40347c289b08abe90420508'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:31.850890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e213f06ee40347c289b08abe90420508'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:31.930063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:31.950057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e213f06ee40347c289b08abe90420508', 'request_id': 'req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:31.958245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e213f06ee40347c289b08abe90420508', 'request_id': 'req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:31.965432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e213f06ee40347c289b08abe90420508', 'request_id': 'req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:32.066703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] The token cache is being invalidate because project e213f06ee40347c289b08abe90420508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:32.066997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:32.067726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:32.085316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e213f06ee40347c289b08abe90420508', 'request_id': 'req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:32.096182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e213f06ee40347c289b08abe90420508', 'request_id': 'req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:32.097031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e213f06ee40347c289b08abe90420508', 'request_id': 'req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:32.105562 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3517/6966] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:36:31 2022] DELETE /identity/v3/domains/e213f06ee40347c289b08abe90420508 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:32.109939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6fab6a-0f7a-4952-802d-aae880cb0497 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:32.111836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2c6fab6a-0f7a-4952-802d-aae880cb0497 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:32.131927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6fab6a-0f7a-4952-802d-aae880cb0497 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:32.204865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3d73a-7c13-4b13-925e-35410aa4be36 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:32.207416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3d73a-7c13-4b13-925e-35410aa4be36 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:32.207416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3d73a-7c13-4b13-925e-35410aa4be36 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:32.207416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3d73a-7c13-4b13-925e-35410aa4be36 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:32.207416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3d73a-7c13-4b13-925e-35410aa4be36 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:32.209621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3d73a-7c13-4b13-925e-35410aa4be36 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:32.233171 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3450/6967] 10.222.0.16 () {58 vars in 1127 bytes} [Sat Jul 16 21:36:32 2022] GET /identity/v3/domains => generated 1347 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:36:32.237420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:32.248197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0adc0-eefd-421d-be2f-d7283d7ac1ac tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:32.253355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6a954-c835-40b7-8c91-a5122aea8611 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:32.257044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6a954-c835-40b7-8c91-a5122aea8611 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:32.257338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6a954-c835-40b7-8c91-a5122aea8611 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:32.257623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6a954-c835-40b7-8c91-a5122aea8611 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains/e213f06ee40347c289b08abe90420508` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:32.266672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6a954-c835-40b7-8c91-a5122aea8611 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 21:36:32.279323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-e0d6a954-c835-40b7-8c91-a5122aea8611 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Could not find domain: e213f06ee40347c289b08abe90420508.: keystone.exception.DomainNotFound: Could not find domain: e213f06ee40347c289b08abe90420508. Jul 16 21:36:32.279323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:32.279323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 16 21:36:32.279323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 16 21:36:32.279323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 21:36:32.279323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 21:36:32.279323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 21:36:32.279323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 21:36:32.279323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e213f06ee40347c289b08abe90420508. Jul 16 21:36:32.279323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:36:32.279323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:36:32.279323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:36:32.279323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:32.279323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:36:32.279323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:36:32.279323 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:36:32.282932 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:36:32.282932 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:36:32.282932 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:36:32.282932 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:36:32.282932 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:36:32.282932 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:36:32.282932 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:36:32.282932 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 16 21:36:32.282932 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 16 21:36:32.282932 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 21:36:32.282932 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 21:36:32.282932 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 21:36:32.282932 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 21:36:32.282932 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:36:32.282932 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:36:32.282932 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:36:32.283919 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:36:32.283919 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:36:32.283919 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:36:32.283919 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:36:32.283919 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 21:36:32.283919 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:36:32.283919 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:36:32.283919 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:36:32.283919 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:36:32.283919 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:36:32.283919 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:36:32.283919 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:36:32.283919 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:36:32.283919 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 16 21:36:32.283919 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 21:36:32.283919 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e213f06ee40347c289b08abe90420508. Jul 16 21:36:32.283919 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:36:32.285003 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3518/6968] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:36:32 2022] PATCH /identity/v3/domains/e213f06ee40347c289b08abe90420508 => generated 112 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:36:32.286934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3d73a-7c13-4b13-925e-35410aa4be36 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:32.299876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3d73a-7c13-4b13-925e-35410aa4be36 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:32.305852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7b880-750a-4d47-b9ae-19dffd9a291e tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:32.306246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7b880-750a-4d47-b9ae-19dffd9a291e tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:32.306246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7b880-750a-4d47-b9ae-19dffd9a291e tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:32.306504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7b880-750a-4d47-b9ae-19dffd9a291e tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:32.307298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7b880-750a-4d47-b9ae-19dffd9a291e tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:32.308946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7b880-750a-4d47-b9ae-19dffd9a291e tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:32.387582 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3451/6969] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:36:32 2022] POST /identity/v3/domains => generated 275 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:32.387800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6a954-c835-40b7-8c91-a5122aea8611 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:32.392947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6a954-c835-40b7-8c91-a5122aea8611 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:32.459139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac611f6-9bb0-429f-a2ad-b1c5cf86166d tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:32.459784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac611f6-9bb0-429f-a2ad-b1c5cf86166d tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:32.459990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac611f6-9bb0-429f-a2ad-b1c5cf86166d tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:32.460392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac611f6-9bb0-429f-a2ad-b1c5cf86166d tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:32.461095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac611f6-9bb0-429f-a2ad-b1c5cf86166d tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:32.463055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac611f6-9bb0-429f-a2ad-b1c5cf86166d tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:32.604538 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3519/6970] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:36:32 2022] POST /identity/v3/users => generated 348 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:32.608952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7b880-750a-4d47-b9ae-19dffd9a291e tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:32.619932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7b880-750a-4d47-b9ae-19dffd9a291e tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:32.625069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fda337-9c8b-4e8a-a430-59428976eaaf tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:32.625728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fda337-9c8b-4e8a-a430-59428976eaaf tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:32.626010 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fda337-9c8b-4e8a-a430-59428976eaaf tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:32.626287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fda337-9c8b-4e8a-a430-59428976eaaf tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/groups` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:32.626973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fda337-9c8b-4e8a-a430-59428976eaaf tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:32.628900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fda337-9c8b-4e8a-a430-59428976eaaf tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:32.700016 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3452/6971] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jul 16 21:36:32 2022] POST /identity/v3/groups => generated 324 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:32.704340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac611f6-9bb0-429f-a2ad-b1c5cf86166d tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:32.716133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac611f6-9bb0-429f-a2ad-b1c5cf86166d tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:32.721165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b531d7d-a462-4852-a876-0c90b30eb739 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:32.722045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b531d7d-a462-4852-a876-0c90b30eb739 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:32.722332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b531d7d-a462-4852-a876-0c90b30eb739 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:32.722653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b531d7d-a462-4852-a876-0c90b30eb739 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains/f66220d2cc0340dd8c781b07e5d6cacb` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:32.724051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b531d7d-a462-4852-a876-0c90b30eb739 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f66220d2cc0340dd8c781b07e5d6cacb)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:32.725652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b531d7d-a462-4852-a876-0c90b30eb739 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:32.747908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9b531d7d-a462-4852-a876-0c90b30eb739 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f66220d2cc0340dd8c781b07e5d6cacb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:32.748807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9b531d7d-a462-4852-a876-0c90b30eb739 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f66220d2cc0340dd8c781b07e5d6cacb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:32.854514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9b531d7d-a462-4852-a876-0c90b30eb739 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f66220d2cc0340dd8c781b07e5d6cacb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:32.855184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9b531d7d-a462-4852-a876-0c90b30eb739 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f66220d2cc0340dd8c781b07e5d6cacb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:32.858091 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3520/6972] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:36:32 2022] PATCH /identity/v3/domains/f66220d2cc0340dd8c781b07e5d6cacb => generated 276 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:36:32.862192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fda337-9c8b-4e8a-a430-59428976eaaf tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:32.865310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-36fda337-9c8b-4e8a-a430-59428976eaaf tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:32.878588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fda337-9c8b-4e8a-a430-59428976eaaf tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:32.937588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:32.938450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:32.938732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:32.939526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains/f66220d2cc0340dd8c781b07e5d6cacb` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:32.957529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f66220d2cc0340dd8c781b07e5d6cacb)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:32.959323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:32.998993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f66220d2cc0340dd8c781b07e5d6cacb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:33.306602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '725daf821b0c4ff4b62f5897d667345a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:33.321349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '725daf821b0c4ff4b62f5897d667345a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:33.419263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '725daf821b0c4ff4b62f5897d667345a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:33.427936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '725daf821b0c4ff4b62f5897d667345a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:33.428824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '725daf821b0c4ff4b62f5897d667345a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:33.434504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f66220d2cc0340dd8c781b07e5d6cacb'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:33.539837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:33.591604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f66220d2cc0340dd8c781b07e5d6cacb', 'request_id': 'req-b440532d-e4c3-4d57-b85e-78f164423119'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:33.597439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f66220d2cc0340dd8c781b07e5d6cacb', 'request_id': 'req-b440532d-e4c3-4d57-b85e-78f164423119'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:33.604907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f66220d2cc0340dd8c781b07e5d6cacb', 'request_id': 'req-b440532d-e4c3-4d57-b85e-78f164423119'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:33.769173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] The token cache is being invalidate because project f66220d2cc0340dd8c781b07e5d6cacb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:33.769886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:33.770339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:33.778914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f66220d2cc0340dd8c781b07e5d6cacb', 'request_id': 'req-b440532d-e4c3-4d57-b85e-78f164423119'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:33.779608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f66220d2cc0340dd8c781b07e5d6cacb', 'request_id': 'req-b440532d-e4c3-4d57-b85e-78f164423119'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:33.780566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f66220d2cc0340dd8c781b07e5d6cacb', 'request_id': 'req-b440532d-e4c3-4d57-b85e-78f164423119'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:33.790183 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3453/6973] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:36:32 2022] DELETE /identity/v3/domains/f66220d2cc0340dd8c781b07e5d6cacb => generated 0 bytes in 928 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:33.794072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b531d7d-a462-4852-a876-0c90b30eb739 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:33.805180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b531d7d-a462-4852-a876-0c90b30eb739 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:33.901861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd1312-47d2-410b-afab-3e6e46c954d4 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:33.903683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd1312-47d2-410b-afab-3e6e46c954d4 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:33.903683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd1312-47d2-410b-afab-3e6e46c954d4 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:33.903683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd1312-47d2-410b-afab-3e6e46c954d4 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains/f66220d2cc0340dd8c781b07e5d6cacb` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:33.916096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd1312-47d2-410b-afab-3e6e46c954d4 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=f66220d2cc0340dd8c781b07e5d6cacb)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:33.918376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd1312-47d2-410b-afab-3e6e46c954d4 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:33.936874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-25bd1312-47d2-410b-afab-3e6e46c954d4 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Could not find domain: f66220d2cc0340dd8c781b07e5d6cacb.: keystone.exception.DomainNotFound: Could not find domain: f66220d2cc0340dd8c781b07e5d6cacb. Jul 16 21:36:33.936874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:33.936874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 16 21:36:33.936874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 16 21:36:33.936874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 21:36:33.936874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 21:36:33.936874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 21:36:33.936874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 21:36:33.936874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f66220d2cc0340dd8c781b07e5d6cacb. Jul 16 21:36:33.936874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:36:33.936874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:36:33.936874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:36:33.936874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:33.936874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:36:33.936874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:36:33.936874 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:36:33.937961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:36:33.937961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:36:33.937961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:36:33.937961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:36:33.937961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:36:33.937961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:36:33.937961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:36:33.937961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 16 21:36:33.937961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 16 21:36:33.937961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 16 21:36:33.937961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 16 21:36:33.937961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:36:33.937961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:36:33.937961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:36:33.937961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:36:33.937961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:36:33.937961 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:36:33.939000 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:36:33.939000 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 21:36:33.939000 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:36:33.939000 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:36:33.939000 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:36:33.939000 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:36:33.939000 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:36:33.939000 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:36:33.939000 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:36:33.939000 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:36:33.939000 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 16 21:36:33.939000 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 21:36:33.939000 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f66220d2cc0340dd8c781b07e5d6cacb. Jul 16 21:36:33.939000 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:36:33.939000 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3521/6974] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Jul 16 21:36:33 2022] GET /identity/v3/domains/f66220d2cc0340dd8c781b07e5d6cacb => generated 112 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:36:33.945842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:33.947422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:33.963285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440532d-e4c3-4d57-b85e-78f164423119 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:33.966015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:33.972079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455933d9-0f19-4719-8c30-19a50d5880ba tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:33.973158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455933d9-0f19-4719-8c30-19a50d5880ba tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:33.973521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455933d9-0f19-4719-8c30-19a50d5880ba tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:33.974229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455933d9-0f19-4719-8c30-19a50d5880ba tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/users/725daf821b0c4ff4b62f5897d667345a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:33.983975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455933d9-0f19-4719-8c30-19a50d5880ba tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:get_user(user_id=725daf821b0c4ff4b62f5897d667345a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:33.986180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455933d9-0f19-4719-8c30-19a50d5880ba tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:34.004922 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-455933d9-0f19-4719-8c30-19a50d5880ba tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Could not find user: 725daf821b0c4ff4b62f5897d667345a.: keystone.exception.UserNotFound: Could not find user: 725daf821b0c4ff4b62f5897d667345a. Jul 16 21:36:34.004922 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:34.004922 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:36:34.004922 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:36:34.004922 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:36:34.004922 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:36:34.004922 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:36:34.004922 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:36:34.004922 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:36:34.004922 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:36:34.004922 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:36:34.004922 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:36:34.004922 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 16 21:36:34.004922 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 16 21:36:34.004922 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 16 21:36:34.006780 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 16 21:36:34.006780 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:36:34.006780 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:36:34.006780 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 21:36:34.006780 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 21:36:34.006780 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 21:36:34.006780 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 21:36:34.006780 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:36:34.006780 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:36:34.006780 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:36:34.006780 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:36:34.006780 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:36:34.006780 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 21:36:34.006780 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:36:34.006780 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:36:34.006780 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:36:34.006780 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:36:34.011979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:36:34.011979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:36:34.011979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:36:34.011979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:36:34.011979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 21:36:34.011979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 21:36:34.011979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 21:36:34.011979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 21:36:34.011979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 21:36:34.011979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 21:36:34.011979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 725daf821b0c4ff4b62f5897d667345a. Jul 16 21:36:34.011979 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:34.011979 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3454/6975] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Jul 16 21:36:33 2022] GET /identity/v3/users/725daf821b0c4ff4b62f5897d667345a => generated 110 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:36:34.014148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd1312-47d2-410b-afab-3e6e46c954d4 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:34.027922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd1312-47d2-410b-afab-3e6e46c954d4 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:34.037516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80c048-f4a0-40cf-bebd-2287d01019fa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:34.038651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80c048-f4a0-40cf-bebd-2287d01019fa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:34.039181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80c048-f4a0-40cf-bebd-2287d01019fa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:34.040048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80c048-f4a0-40cf-bebd-2287d01019fa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/groups/9d01175a4533446eac872cb2b762db39` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:34.051177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80c048-f4a0-40cf-bebd-2287d01019fa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:get_group(group_id=9d01175a4533446eac872cb2b762db39)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:34.051177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80c048-f4a0-40cf-bebd-2287d01019fa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:34.070864 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-6e80c048-f4a0-40cf-bebd-2287d01019fa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Could not find group: 9d01175a4533446eac872cb2b762db39.: keystone.exception.GroupNotFound: Could not find group: 9d01175a4533446eac872cb2b762db39. Jul 16 21:36:34.070864 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:34.070864 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:36:34.070864 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:36:34.070864 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:36:34.070864 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:36:34.070864 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:36:34.070864 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:36:34.070864 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:36:34.070864 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:36:34.070864 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:36:34.070864 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:36:34.070864 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Jul 16 21:36:34.070864 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_group(group_id) Jul 16 21:36:34.075093 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Jul 16 21:36:34.075093 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Jul 16 21:36:34.075093 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:36:34.075093 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:36:34.075093 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 21:36:34.075093 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 21:36:34.075093 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 21:36:34.075093 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 21:36:34.075093 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:36:34.075093 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:36:34.075093 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:36:34.075093 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:36:34.075093 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:36:34.075093 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 21:36:34.075093 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:36:34.075093 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:36:34.075093 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:36:34.076122 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:36:34.076122 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:36:34.076122 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:36:34.076122 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:36:34.076122 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:36:34.076122 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jul 16 21:36:34.076122 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jul 16 21:36:34.076122 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jul 16 21:36:34.076122 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jul 16 21:36:34.076122 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jul 16 21:36:34.076122 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jul 16 21:36:34.076122 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 9d01175a4533446eac872cb2b762db39. Jul 16 21:36:34.076122 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:36:34.076122 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3522/6976] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:34 2022] GET /identity/v3/groups/9d01175a4533446eac872cb2b762db39 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:36:34.077760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455933d9-0f19-4719-8c30-19a50d5880ba tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:34.089984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455933d9-0f19-4719-8c30-19a50d5880ba tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:34.098318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73049d5-d27e-4dcf-a340-17f966cbc3c1 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:34.099786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73049d5-d27e-4dcf-a340-17f966cbc3c1 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:34.100431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73049d5-d27e-4dcf-a340-17f966cbc3c1 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:34.100676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73049d5-d27e-4dcf-a340-17f966cbc3c1 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/groups/9d01175a4533446eac872cb2b762db39` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:34.107774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73049d5-d27e-4dcf-a340-17f966cbc3c1 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 21:36:34.122574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-a73049d5-d27e-4dcf-a340-17f966cbc3c1 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Could not find group: 9d01175a4533446eac872cb2b762db39.: keystone.exception.GroupNotFound: Could not find group: 9d01175a4533446eac872cb2b762db39. Jul 16 21:36:34.122574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:34.122574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:36:34.122574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:36:34.122574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:36:34.122574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:36:34.122574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:36:34.122574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:36:34.122574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:36:34.122574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:36:34.122574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:36:34.122574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:36:34.122574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Jul 16 21:36:34.122574 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Jul 16 21:36:34.125788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 21:36:34.125788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 21:36:34.125788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 21:36:34.125788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 21:36:34.125788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:36:34.125788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:36:34.125788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 21:36:34.125788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 21:36:34.125788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 21:36:34.125788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 21:36:34.125788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:36:34.125788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:36:34.125788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:36:34.125788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:36:34.125788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:36:34.125788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 21:36:34.125788 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:36:34.126904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:36:34.126904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:36:34.126904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:36:34.126904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:36:34.126904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:36:34.126904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:36:34.126904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:36:34.126904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jul 16 21:36:34.126904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jul 16 21:36:34.126904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jul 16 21:36:34.126904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jul 16 21:36:34.126904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jul 16 21:36:34.126904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jul 16 21:36:34.126904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 9d01175a4533446eac872cb2b762db39. Jul 16 21:36:34.126904 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:34.126904 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3455/6977] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Jul 16 21:36:34 2022] DELETE /identity/v3/groups/9d01175a4533446eac872cb2b762db39 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:36:34.128508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80c048-f4a0-40cf-bebd-2287d01019fa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:34.141026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80c048-f4a0-40cf-bebd-2287d01019fa tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:34.147752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37655f-4772-48af-868e-ef7524da26f9 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:34.148767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37655f-4772-48af-868e-ef7524da26f9 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:34.149114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37655f-4772-48af-868e-ef7524da26f9 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:34.150571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37655f-4772-48af-868e-ef7524da26f9 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/users/725daf821b0c4ff4b62f5897d667345a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:34.159760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37655f-4772-48af-868e-ef7524da26f9 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:delete_user(user_id=725daf821b0c4ff4b62f5897d667345a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:34.161801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37655f-4772-48af-868e-ef7524da26f9 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:34.179452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-3b37655f-4772-48af-868e-ef7524da26f9 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Could not find user: 725daf821b0c4ff4b62f5897d667345a.: keystone.exception.UserNotFound: Could not find user: 725daf821b0c4ff4b62f5897d667345a. Jul 16 21:36:34.179452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:34.179452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:36:34.179452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:36:34.179452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:36:34.179452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:36:34.179452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:36:34.179452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:36:34.179452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:36:34.179452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:36:34.179452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:36:34.179452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:36:34.179452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Jul 16 21:36:34.179452 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Jul 16 21:36:34.180573 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:36:34.180573 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:36:34.180573 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 21:36:34.180573 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 21:36:34.180573 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 21:36:34.180573 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 21:36:34.180573 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Jul 16 21:36:34.180573 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Jul 16 21:36:34.180573 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:36:34.180573 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:36:34.180573 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 16 21:36:34.180573 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 21:36:34.180573 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 16 21:36:34.180573 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 16 21:36:34.180573 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:36:34.180573 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:36:34.180573 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:36:34.180573 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:36:34.181752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:36:34.181752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 21:36:34.181752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:36:34.181752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:36:34.181752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:36:34.181752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:36:34.181752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:36:34.181752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:36:34.181752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:36:34.181752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:36:34.181752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 16 21:36:34.181752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 16 21:36:34.181752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 16 21:36:34.181752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 16 21:36:34.181752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 16 21:36:34.181752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 16 21:36:34.181752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 725daf821b0c4ff4b62f5897d667345a. Jul 16 21:36:34.181752 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:36:34.182892 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3523/6978] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:34 2022] DELETE /identity/v3/users/725daf821b0c4ff4b62f5897d667345a => generated 110 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:36:34.185217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73049d5-d27e-4dcf-a340-17f966cbc3c1 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:34.197723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73049d5-d27e-4dcf-a340-17f966cbc3c1 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:34.202668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88a22d-16ab-4943-a1af-b6af43ef6770 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:34.203645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88a22d-16ab-4943-a1af-b6af43ef6770 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:34.204007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88a22d-16ab-4943-a1af-b6af43ef6770 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:34.204358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88a22d-16ab-4943-a1af-b6af43ef6770 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains/f66220d2cc0340dd8c781b07e5d6cacb` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:34.213288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88a22d-16ab-4943-a1af-b6af43ef6770 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 21:36:34.223764 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-1a88a22d-16ab-4943-a1af-b6af43ef6770 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Could not find domain: f66220d2cc0340dd8c781b07e5d6cacb.: keystone.exception.DomainNotFound: Could not find domain: f66220d2cc0340dd8c781b07e5d6cacb. Jul 16 21:36:34.223764 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:34.223764 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 16 21:36:34.223764 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 16 21:36:34.223764 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 21:36:34.223764 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 21:36:34.223764 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 21:36:34.223764 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 21:36:34.223764 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f66220d2cc0340dd8c781b07e5d6cacb. Jul 16 21:36:34.223764 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:34.223764 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:36:34.223764 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:34.223764 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:34.223764 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:36:34.223764 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:36:34.223764 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:36:34.224875 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:36:34.224875 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:36:34.224875 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:36:34.224875 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:36:34.224875 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:36:34.224875 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:36:34.224875 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:36:34.224875 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 16 21:36:34.224875 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 16 21:36:34.224875 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 21:36:34.224875 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 21:36:34.224875 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 21:36:34.224875 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 21:36:34.224875 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:36:34.224875 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:36:34.224875 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:36:34.225954 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:36:34.225954 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:36:34.225954 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:36:34.225954 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:36:34.225954 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 21:36:34.225954 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:36:34.225954 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:36:34.225954 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:36:34.225954 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:36:34.225954 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:36:34.225954 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:36:34.225954 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:36:34.225954 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:36:34.225954 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 16 21:36:34.225954 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 21:36:34.225954 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f66220d2cc0340dd8c781b07e5d6cacb. Jul 16 21:36:34.225954 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:34.228400 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3456/6979] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:36:34 2022] PATCH /identity/v3/domains/f66220d2cc0340dd8c781b07e5d6cacb => generated 112 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:36:34.235254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37655f-4772-48af-868e-ef7524da26f9 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:34.247629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37655f-4772-48af-868e-ef7524da26f9 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:34.252604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdae86a-29f7-473d-8ce6-0f33e02e03f1 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:34.253326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdae86a-29f7-473d-8ce6-0f33e02e03f1 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:34.253614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdae86a-29f7-473d-8ce6-0f33e02e03f1 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:34.253943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdae86a-29f7-473d-8ce6-0f33e02e03f1 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:34.254642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdae86a-29f7-473d-8ce6-0f33e02e03f1 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:34.257004 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdae86a-29f7-473d-8ce6-0f33e02e03f1 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:34.279119 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3524/6980] 10.222.0.16 () {58 vars in 1127 bytes} [Sat Jul 16 21:36:34 2022] GET /identity/v3/domains => generated 1347 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:36:34.284378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88a22d-16ab-4943-a1af-b6af43ef6770 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:34.295685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88a22d-16ab-4943-a1af-b6af43ef6770 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:34.300953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e58c8-0010-4a8b-94ac-e6fa4e0ae3cb tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:34.301795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e58c8-0010-4a8b-94ac-e6fa4e0ae3cb tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:34.302285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e58c8-0010-4a8b-94ac-e6fa4e0ae3cb tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:34.302727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e58c8-0010-4a8b-94ac-e6fa4e0ae3cb tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:34.303821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e58c8-0010-4a8b-94ac-e6fa4e0ae3cb tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:36:34.304284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e58c8-0010-4a8b-94ac-e6fa4e0ae3cb tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:34.308070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e58c8-0010-4a8b-94ac-e6fa4e0ae3cb tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:34.327655 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3457/6981] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:36:34 2022] GET /identity/v3/domains?enabled=True => generated 1094 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:36:34.332832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdae86a-29f7-473d-8ce6-0f33e02e03f1 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:34.344673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdae86a-29f7-473d-8ce6-0f33e02e03f1 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:34.349570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471ca0a-100a-4cbc-8167-5a64c63e1c7f tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:34.350225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471ca0a-100a-4cbc-8167-5a64c63e1c7f tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:34.350512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471ca0a-100a-4cbc-8167-5a64c63e1c7f tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:34.350792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471ca0a-100a-4cbc-8167-5a64c63e1c7f tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:34.351629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471ca0a-100a-4cbc-8167-5a64c63e1c7f tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-393973116) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:36:34.351938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471ca0a-100a-4cbc-8167-5a64c63e1c7f tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:34.353561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471ca0a-100a-4cbc-8167-5a64c63e1c7f tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:34.365497 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3525/6982] 10.222.0.16 () {58 vars in 1196 bytes} [Sat Jul 16 21:36:34 2022] GET /identity/v3/domains?name=tempest-test_domain-393973116 => generated 407 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:36:34.370146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e58c8-0010-4a8b-94ac-e6fa4e0ae3cb tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:34.381011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e58c8-0010-4a8b-94ac-e6fa4e0ae3cb tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:34.386290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66135ba6-e163-472f-a9bd-ba6a94d560a3 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:34.387199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66135ba6-e163-472f-a9bd-ba6a94d560a3 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:34.387488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66135ba6-e163-472f-a9bd-ba6a94d560a3 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:34.387763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66135ba6-e163-472f-a9bd-ba6a94d560a3 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains/f66220d2cc0340dd8c781b07e5d6cacb` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:34.394724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66135ba6-e163-472f-a9bd-ba6a94d560a3 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 21:36:34.405629 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-66135ba6-e163-472f-a9bd-ba6a94d560a3 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Could not find domain: f66220d2cc0340dd8c781b07e5d6cacb.: keystone.exception.DomainNotFound: Could not find domain: f66220d2cc0340dd8c781b07e5d6cacb. Jul 16 21:36:34.405629 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:34.405629 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 16 21:36:34.405629 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 16 21:36:34.405629 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 21:36:34.405629 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 21:36:34.405629 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 21:36:34.405629 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 21:36:34.405629 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f66220d2cc0340dd8c781b07e5d6cacb. Jul 16 21:36:34.405629 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:34.405629 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:36:34.405629 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:34.405629 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:34.405629 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:36:34.405629 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:36:34.405629 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:36:34.406793 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:36:34.406793 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:36:34.406793 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:36:34.406793 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:36:34.406793 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:36:34.406793 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:36:34.406793 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:36:34.406793 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 16 21:36:34.406793 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 16 21:36:34.406793 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 21:36:34.406793 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 21:36:34.406793 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 21:36:34.406793 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 21:36:34.406793 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:36:34.406793 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:36:34.406793 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:36:34.407988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:36:34.407988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:36:34.407988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:36:34.407988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:36:34.407988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 21:36:34.407988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:36:34.407988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:36:34.407988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:36:34.407988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:36:34.407988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:36:34.407988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:36:34.407988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:36:34.407988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:36:34.407988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 16 21:36:34.407988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 21:36:34.407988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f66220d2cc0340dd8c781b07e5d6cacb. Jul 16 21:36:34.407988 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:34.409090 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3458/6983] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:36:34 2022] PATCH /identity/v3/domains/f66220d2cc0340dd8c781b07e5d6cacb => generated 112 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:36:34.410824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471ca0a-100a-4cbc-8167-5a64c63e1c7f tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:34.422302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471ca0a-100a-4cbc-8167-5a64c63e1c7f tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:34.427975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84713145-13dc-4d07-8556-2f0b1c1e3ef7 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:34.432530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84713145-13dc-4d07-8556-2f0b1c1e3ef7 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:34.432530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84713145-13dc-4d07-8556-2f0b1c1e3ef7 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:34.432530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84713145-13dc-4d07-8556-2f0b1c1e3ef7 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains/f1119a0463034668906c86db6a4829e9` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:34.445093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84713145-13dc-4d07-8556-2f0b1c1e3ef7 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f1119a0463034668906c86db6a4829e9)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:34.446755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84713145-13dc-4d07-8556-2f0b1c1e3ef7 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:34.496110 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3526/6984] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:36:34 2022] PATCH /identity/v3/domains/f1119a0463034668906c86db6a4829e9 => generated 277 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:36:34.500020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66135ba6-e163-472f-a9bd-ba6a94d560a3 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:34.511030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66135ba6-e163-472f-a9bd-ba6a94d560a3 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:34.515576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acae4b-51ad-4e82-beac-027d5c43f2db tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:34.516421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acae4b-51ad-4e82-beac-027d5c43f2db tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:34.516706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acae4b-51ad-4e82-beac-027d5c43f2db tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:34.516985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acae4b-51ad-4e82-beac-027d5c43f2db tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains/f1119a0463034668906c86db6a4829e9` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:34.529494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acae4b-51ad-4e82-beac-027d5c43f2db tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f1119a0463034668906c86db6a4829e9)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:34.531072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acae4b-51ad-4e82-beac-027d5c43f2db tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:34.553727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-40acae4b-51ad-4e82-beac-027d5c43f2db tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f1119a0463034668906c86db6a4829e9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:34.563488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-40acae4b-51ad-4e82-beac-027d5c43f2db tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f1119a0463034668906c86db6a4829e9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:34.689764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-40acae4b-51ad-4e82-beac-027d5c43f2db tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1119a0463034668906c86db6a4829e9', 'request_id': 'req-40acae4b-51ad-4e82-beac-027d5c43f2db'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:34.695442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-40acae4b-51ad-4e82-beac-027d5c43f2db tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1119a0463034668906c86db6a4829e9', 'request_id': 'req-40acae4b-51ad-4e82-beac-027d5c43f2db'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:34.702300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-40acae4b-51ad-4e82-beac-027d5c43f2db tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1119a0463034668906c86db6a4829e9', 'request_id': 'req-40acae4b-51ad-4e82-beac-027d5c43f2db'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:34.807879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-40acae4b-51ad-4e82-beac-027d5c43f2db tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] The token cache is being invalidate because project f1119a0463034668906c86db6a4829e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:34.808502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-40acae4b-51ad-4e82-beac-027d5c43f2db tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:34.808896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-40acae4b-51ad-4e82-beac-027d5c43f2db tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:34.816517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-40acae4b-51ad-4e82-beac-027d5c43f2db tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f1119a0463034668906c86db6a4829e9', 'request_id': 'req-40acae4b-51ad-4e82-beac-027d5c43f2db'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:34.817213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-40acae4b-51ad-4e82-beac-027d5c43f2db tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f1119a0463034668906c86db6a4829e9', 'request_id': 'req-40acae4b-51ad-4e82-beac-027d5c43f2db'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:34.818691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-40acae4b-51ad-4e82-beac-027d5c43f2db tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f1119a0463034668906c86db6a4829e9', 'request_id': 'req-40acae4b-51ad-4e82-beac-027d5c43f2db'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:34.827607 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3459/6985] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:36:34 2022] DELETE /identity/v3/domains/f1119a0463034668906c86db6a4829e9 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:34.831766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84713145-13dc-4d07-8556-2f0b1c1e3ef7 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:34.834217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-84713145-13dc-4d07-8556-2f0b1c1e3ef7 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:34.848354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84713145-13dc-4d07-8556-2f0b1c1e3ef7 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:34.911779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc54bd-0937-4498-a023-8273dcb3f676 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:34.912913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc54bd-0937-4498-a023-8273dcb3f676 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:34.913174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc54bd-0937-4498-a023-8273dcb3f676 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:34.913448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc54bd-0937-4498-a023-8273dcb3f676 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains/cec61af363674a16862a2daad21f4291` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:34.926009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc54bd-0937-4498-a023-8273dcb3f676 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=cec61af363674a16862a2daad21f4291)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:34.928100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc54bd-0937-4498-a023-8273dcb3f676 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:34.962270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6afc54bd-0937-4498-a023-8273dcb3f676 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'cec61af363674a16862a2daad21f4291'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:34.963070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6afc54bd-0937-4498-a023-8273dcb3f676 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'cec61af363674a16862a2daad21f4291'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:35.080012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6afc54bd-0937-4498-a023-8273dcb3f676 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'cec61af363674a16862a2daad21f4291'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:35.080646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6afc54bd-0937-4498-a023-8273dcb3f676 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'cec61af363674a16862a2daad21f4291'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:35.083295 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3527/6986] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:36:34 2022] PATCH /identity/v3/domains/cec61af363674a16862a2daad21f4291 => generated 277 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:36:35.088195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acae4b-51ad-4e82-beac-027d5c43f2db tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:35.103056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acae4b-51ad-4e82-beac-027d5c43f2db tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:35.175078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379adbe-4004-4c51-ade5-492559d7dbbe tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:35.175078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379adbe-4004-4c51-ade5-492559d7dbbe tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:35.175078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379adbe-4004-4c51-ade5-492559d7dbbe tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:35.175342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379adbe-4004-4c51-ade5-492559d7dbbe tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains/cec61af363674a16862a2daad21f4291` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:35.180980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379adbe-4004-4c51-ade5-492559d7dbbe tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=cec61af363674a16862a2daad21f4291)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:35.182594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379adbe-4004-4c51-ade5-492559d7dbbe tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:35.204864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9379adbe-4004-4c51-ade5-492559d7dbbe tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'cec61af363674a16862a2daad21f4291'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:35.215154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9379adbe-4004-4c51-ade5-492559d7dbbe tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'cec61af363674a16862a2daad21f4291'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:35.313589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9379adbe-4004-4c51-ade5-492559d7dbbe tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cec61af363674a16862a2daad21f4291', 'request_id': 'req-9379adbe-4004-4c51-ade5-492559d7dbbe'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:35.320463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9379adbe-4004-4c51-ade5-492559d7dbbe tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cec61af363674a16862a2daad21f4291', 'request_id': 'req-9379adbe-4004-4c51-ade5-492559d7dbbe'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:35.327824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9379adbe-4004-4c51-ade5-492559d7dbbe tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cec61af363674a16862a2daad21f4291', 'request_id': 'req-9379adbe-4004-4c51-ade5-492559d7dbbe'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:35.409143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9379adbe-4004-4c51-ade5-492559d7dbbe tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] The token cache is being invalidate because project cec61af363674a16862a2daad21f4291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:35.409474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9379adbe-4004-4c51-ade5-492559d7dbbe tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:35.410055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9379adbe-4004-4c51-ade5-492559d7dbbe tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:35.418519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9379adbe-4004-4c51-ade5-492559d7dbbe tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'cec61af363674a16862a2daad21f4291', 'request_id': 'req-9379adbe-4004-4c51-ade5-492559d7dbbe'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:35.419225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9379adbe-4004-4c51-ade5-492559d7dbbe tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'cec61af363674a16862a2daad21f4291', 'request_id': 'req-9379adbe-4004-4c51-ade5-492559d7dbbe'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:35.421279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9379adbe-4004-4c51-ade5-492559d7dbbe tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'cec61af363674a16862a2daad21f4291', 'request_id': 'req-9379adbe-4004-4c51-ade5-492559d7dbbe'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:35.428460 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3460/6987] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:36:35 2022] DELETE /identity/v3/domains/cec61af363674a16862a2daad21f4291 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:36:35.432602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc54bd-0937-4498-a023-8273dcb3f676 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:35.433992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6afc54bd-0937-4498-a023-8273dcb3f676 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:35.448005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc54bd-0937-4498-a023-8273dcb3f676 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:35.469117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:35.508654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6ad67-df8d-49ec-994f-e56d78922564 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:35.509537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6ad67-df8d-49ec-994f-e56d78922564 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:35.509824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6ad67-df8d-49ec-994f-e56d78922564 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:35.510106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6ad67-df8d-49ec-994f-e56d78922564 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains/49bf9e46b3e04fc6baa0953ce0e1fca2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:35.520567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6ad67-df8d-49ec-994f-e56d78922564 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=49bf9e46b3e04fc6baa0953ce0e1fca2)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:35.522239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6ad67-df8d-49ec-994f-e56d78922564 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:35.542013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7cf6ad67-df8d-49ec-994f-e56d78922564 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '49bf9e46b3e04fc6baa0953ce0e1fca2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:35.542690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7cf6ad67-df8d-49ec-994f-e56d78922564 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '49bf9e46b3e04fc6baa0953ce0e1fca2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:35.641728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7cf6ad67-df8d-49ec-994f-e56d78922564 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '49bf9e46b3e04fc6baa0953ce0e1fca2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:35.642371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7cf6ad67-df8d-49ec-994f-e56d78922564 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '49bf9e46b3e04fc6baa0953ce0e1fca2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:35.645299 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3528/6988] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:36:35 2022] PATCH /identity/v3/domains/49bf9e46b3e04fc6baa0953ce0e1fca2 => generated 277 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:36:35.649816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379adbe-4004-4c51-ade5-492559d7dbbe tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:35.651269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9379adbe-4004-4c51-ade5-492559d7dbbe tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:35.665042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379adbe-4004-4c51-ade5-492559d7dbbe tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:35.718667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:35.722346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01822003-2e7f-4ac0-9442-2b1791b86339 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55de0b6634f64f80be506945e96ed6a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d224ba7f6bb4519ba1f8c54b2377171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:35.723247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01822003-2e7f-4ac0-9442-2b1791b86339 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:35.723532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01822003-2e7f-4ac0-9442-2b1791b86339 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:35.724315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01822003-2e7f-4ac0-9442-2b1791b86339 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] PATH_INFO: `/v3/domains/49bf9e46b3e04fc6baa0953ce0e1fca2` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:35.736117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01822003-2e7f-4ac0-9442-2b1791b86339 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=49bf9e46b3e04fc6baa0953ce0e1fca2)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:35.737736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01822003-2e7f-4ac0-9442-2b1791b86339 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:35.760760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-01822003-2e7f-4ac0-9442-2b1791b86339 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '49bf9e46b3e04fc6baa0953ce0e1fca2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:35.770119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-01822003-2e7f-4ac0-9442-2b1791b86339 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '49bf9e46b3e04fc6baa0953ce0e1fca2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:35.946558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-01822003-2e7f-4ac0-9442-2b1791b86339 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49bf9e46b3e04fc6baa0953ce0e1fca2', 'request_id': 'req-01822003-2e7f-4ac0-9442-2b1791b86339'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:35.952578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-01822003-2e7f-4ac0-9442-2b1791b86339 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49bf9e46b3e04fc6baa0953ce0e1fca2', 'request_id': 'req-01822003-2e7f-4ac0-9442-2b1791b86339'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:35.960269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-01822003-2e7f-4ac0-9442-2b1791b86339 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49bf9e46b3e04fc6baa0953ce0e1fca2', 'request_id': 'req-01822003-2e7f-4ac0-9442-2b1791b86339'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:36.202584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-01822003-2e7f-4ac0-9442-2b1791b86339 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] The token cache is being invalidate because project 49bf9e46b3e04fc6baa0953ce0e1fca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:36.202584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-01822003-2e7f-4ac0-9442-2b1791b86339 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:36.202584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-01822003-2e7f-4ac0-9442-2b1791b86339 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:36.211210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-01822003-2e7f-4ac0-9442-2b1791b86339 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '49bf9e46b3e04fc6baa0953ce0e1fca2', 'request_id': 'req-01822003-2e7f-4ac0-9442-2b1791b86339'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:36.212109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-01822003-2e7f-4ac0-9442-2b1791b86339 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '49bf9e46b3e04fc6baa0953ce0e1fca2', 'request_id': 'req-01822003-2e7f-4ac0-9442-2b1791b86339'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:36.212773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-01822003-2e7f-4ac0-9442-2b1791b86339 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '49bf9e46b3e04fc6baa0953ce0e1fca2', 'request_id': 'req-01822003-2e7f-4ac0-9442-2b1791b86339'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:36.222516 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3461/6989] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:36:35 2022] DELETE /identity/v3/domains/49bf9e46b3e04fc6baa0953ce0e1fca2 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:36.227595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6ad67-df8d-49ec-994f-e56d78922564 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:36.229663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7cf6ad67-df8d-49ec-994f-e56d78922564 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:36.305258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6ad67-df8d-49ec-994f-e56d78922564 tempest-DomainsTestJSON-326110183 tempest-DomainsTestJSON-326110183-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:36.376786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67aa5ec-f0f6-4a0c-bb06-e4094117a57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:36.377847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aa5ec-f0f6-4a0c-bb06-e4094117a57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:36.378126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aa5ec-f0f6-4a0c-bb06-e4094117a57d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:36.378401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aa5ec-f0f6-4a0c-bb06-e4094117a57d admin admin] PATH_INFO: `/v3/users/2a1cf32c5a494cc49e4c1984ec7f116a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:36.379677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67aa5ec-f0f6-4a0c-bb06-e4094117a57d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1cf32c5a494cc49e4c1984ec7f116a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:36.382306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67aa5ec-f0f6-4a0c-bb06-e4094117a57d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:36.651929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b67aa5ec-f0f6-4a0c-bb06-e4094117a57d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1cf32c5a494cc49e4c1984ec7f116a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:36.659209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b67aa5ec-f0f6-4a0c-bb06-e4094117a57d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1cf32c5a494cc49e4c1984ec7f116a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:36.728929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b67aa5ec-f0f6-4a0c-bb06-e4094117a57d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1cf32c5a494cc49e4c1984ec7f116a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:36.729568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b67aa5ec-f0f6-4a0c-bb06-e4094117a57d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1cf32c5a494cc49e4c1984ec7f116a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:36.743716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b67aa5ec-f0f6-4a0c-bb06-e4094117a57d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1cf32c5a494cc49e4c1984ec7f116a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:36.750045 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3529/6990] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:36 2022] DELETE /identity/v3/users/2a1cf32c5a494cc49e4c1984ec7f116a => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:36.754513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab547c-741b-43e9-bd55-ddb97799feee None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:36.754661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab547c-741b-43e9-bd55-ddb97799feee None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:36.754900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab547c-741b-43e9-bd55-ddb97799feee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:36.777393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-53ab547c-741b-43e9-bd55-ddb97799feee None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:36.778802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-53ab547c-741b-43e9-bd55-ddb97799feee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:36.861751 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3462/6991] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:36.876364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67aa5ec-f0f6-4a0c-bb06-e4094117a57d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:36.876799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b67aa5ec-f0f6-4a0c-bb06-e4094117a57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:36.945617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67aa5ec-f0f6-4a0c-bb06-e4094117a57d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:36.949336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e023d-2a94-4871-9d03-073e00cc061c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:36.953572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e023d-2a94-4871-9d03-073e00cc061c service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:36.953572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e023d-2a94-4871-9d03-073e00cc061c service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:36.953572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e023d-2a94-4871-9d03-073e00cc061c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:36.961525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e023d-2a94-4871-9d03-073e00cc061c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:36.962963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e023d-2a94-4871-9d03-073e00cc061c service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:36.974685 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3530/6992] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:36:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:36:37.177414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab547c-741b-43e9-bd55-ddb97799feee None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:37.179556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-53ab547c-741b-43e9-bd55-ddb97799feee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:37.246808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab547c-741b-43e9-bd55-ddb97799feee None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:37.257809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1fbc3-c7c2-44c3-9b57-d77768e1e3db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:37.258485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1fbc3-c7c2-44c3-9b57-d77768e1e3db service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:37.258801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1fbc3-c7c2-44c3-9b57-d77768e1e3db service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:37.259113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1fbc3-c7c2-44c3-9b57-d77768e1e3db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:37.261022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a4d1fbc3-c7c2-44c3-9b57-d77768e1e3db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:37.358336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1fbc3-c7c2-44c3-9b57-d77768e1e3db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:37.358336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1fbc3-c7c2-44c3-9b57-d77768e1e3db service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:37.366798 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3463/6993] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:36:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:36:37.437736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:37.514160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e023d-2a94-4871-9d03-073e00cc061c service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:37.515723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-492e023d-2a94-4871-9d03-073e00cc061c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:37.532702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e023d-2a94-4871-9d03-073e00cc061c service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:37.544684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c801b-b3be-45db-b93f-714f97017cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:37.545633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c801b-b3be-45db-b93f-714f97017cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:37.545918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c801b-b3be-45db-b93f-714f97017cea admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:37.546185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c801b-b3be-45db-b93f-714f97017cea admin admin] PATH_INFO: `/v3/projects/2732560d63404d88919ce794da0d212e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:37.547619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c801b-b3be-45db-b93f-714f97017cea admin admin] RBAC: Authorizing `identity:delete_project(project_id=2732560d63404d88919ce794da0d212e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:37.554719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c801b-b3be-45db-b93f-714f97017cea admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:37.760944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-210c801b-b3be-45db-b93f-714f97017cea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2732560d63404d88919ce794da0d212e', 'request_id': 'req-210c801b-b3be-45db-b93f-714f97017cea'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:37.767126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-210c801b-b3be-45db-b93f-714f97017cea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2732560d63404d88919ce794da0d212e', 'request_id': 'req-210c801b-b3be-45db-b93f-714f97017cea'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:37.772403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-210c801b-b3be-45db-b93f-714f97017cea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2732560d63404d88919ce794da0d212e', 'request_id': 'req-210c801b-b3be-45db-b93f-714f97017cea'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:37.843683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:37.878122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-210c801b-b3be-45db-b93f-714f97017cea admin admin] The token cache is being invalidate because project 2732560d63404d88919ce794da0d212e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:37.882202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-210c801b-b3be-45db-b93f-714f97017cea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:37.882202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-210c801b-b3be-45db-b93f-714f97017cea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:37.882202 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3531/6994] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:36:37 2022] DELETE /identity/v3/projects/2732560d63404d88919ce794da0d212e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:37.885564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1fbc3-c7c2-44c3-9b57-d77768e1e3db service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:37.896695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1fbc3-c7c2-44c3-9b57-d77768e1e3db service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:37.958230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035f007-1aee-4dff-81bf-a02bf8ef2871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:37.959660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035f007-1aee-4dff-81bf-a02bf8ef2871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:37.959943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035f007-1aee-4dff-81bf-a02bf8ef2871 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:37.960219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035f007-1aee-4dff-81bf-a02bf8ef2871 admin admin] PATH_INFO: `/v3/users/55de0b6634f64f80be506945e96ed6a5` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:37.961397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035f007-1aee-4dff-81bf-a02bf8ef2871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55de0b6634f64f80be506945e96ed6a5)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:37.963494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035f007-1aee-4dff-81bf-a02bf8ef2871 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:38.203930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a035f007-1aee-4dff-81bf-a02bf8ef2871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55de0b6634f64f80be506945e96ed6a5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:38.218419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a035f007-1aee-4dff-81bf-a02bf8ef2871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55de0b6634f64f80be506945e96ed6a5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:38.272641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a035f007-1aee-4dff-81bf-a02bf8ef2871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55de0b6634f64f80be506945e96ed6a5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:38.280853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a035f007-1aee-4dff-81bf-a02bf8ef2871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55de0b6634f64f80be506945e96ed6a5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:38.281698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a035f007-1aee-4dff-81bf-a02bf8ef2871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55de0b6634f64f80be506945e96ed6a5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:38.288503 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3464/6995] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:37 2022] DELETE /identity/v3/users/55de0b6634f64f80be506945e96ed6a5 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:38.790633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c801b-b3be-45db-b93f-714f97017cea admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:38.792108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-210c801b-b3be-45db-b93f-714f97017cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:38.805713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c801b-b3be-45db-b93f-714f97017cea admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:38.855576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:38.865283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd0671-b3c3-4b63-ba83-3d6e95f9e2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:38.866151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd0671-b3c3-4b63-ba83-3d6e95f9e2bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:38.866436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd0671-b3c3-4b63-ba83-3d6e95f9e2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:38.866714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd0671-b3c3-4b63-ba83-3d6e95f9e2bf admin admin] PATH_INFO: `/v3/projects/9d224ba7f6bb4519ba1f8c54b2377171` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:38.867956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd0671-b3c3-4b63-ba83-3d6e95f9e2bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d224ba7f6bb4519ba1f8c54b2377171)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:38.869901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd0671-b3c3-4b63-ba83-3d6e95f9e2bf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:39.079194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b3bd0671-b3c3-4b63-ba83-3d6e95f9e2bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d224ba7f6bb4519ba1f8c54b2377171', 'request_id': 'req-b3bd0671-b3c3-4b63-ba83-3d6e95f9e2bf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:39.083803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:UPDATE=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:39.088091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b3bd0671-b3c3-4b63-ba83-3d6e95f9e2bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d224ba7f6bb4519ba1f8c54b2377171', 'request_id': 'req-b3bd0671-b3c3-4b63-ba83-3d6e95f9e2bf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:39.093646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b3bd0671-b3c3-4b63-ba83-3d6e95f9e2bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d224ba7f6bb4519ba1f8c54b2377171', 'request_id': 'req-b3bd0671-b3c3-4b63-ba83-3d6e95f9e2bf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:39.186286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b3bd0671-b3c3-4b63-ba83-3d6e95f9e2bf admin admin] The token cache is being invalidate because project 9d224ba7f6bb4519ba1f8c54b2377171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:39.190891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b3bd0671-b3c3-4b63-ba83-3d6e95f9e2bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:39.190891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b3bd0671-b3c3-4b63-ba83-3d6e95f9e2bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:39.190891 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3532/6996] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:36:38 2022] DELETE /identity/v3/projects/9d224ba7f6bb4519ba1f8c54b2377171 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:39.195111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b0f9c-d12e-44f2-ab46-c0c319a8dba5 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:39.195439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b0f9c-d12e-44f2-ab46-c0c319a8dba5 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:39.195725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b0f9c-d12e-44f2-ab46-c0c319a8dba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:39.216836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ca1b0f9c-d12e-44f2-ab46-c0c319a8dba5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:39.219242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ca1b0f9c-d12e-44f2-ab46-c0c319a8dba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:39.298604 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3465/6997] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:39.307200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25df31-9c7e-4482-90eb-d2f6bfb5d498 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:39.307536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25df31-9c7e-4482-90eb-d2f6bfb5d498 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:39.307777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25df31-9c7e-4482-90eb-d2f6bfb5d498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:39.329545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8e25df31-9c7e-4482-90eb-d2f6bfb5d498 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:39.331694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8e25df31-9c7e-4482-90eb-d2f6bfb5d498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:39.340929 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3533/6998] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:36:39.345595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b0f9c-d12e-44f2-ab46-c0c319a8dba5 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:39.358027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b0f9c-d12e-44f2-ab46-c0c319a8dba5 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:39.363281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6a886-782b-4456-9d75-34520f5ab8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:39.364295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6a886-782b-4456-9d75-34520f5ab8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:39.364660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6a886-782b-4456-9d75-34520f5ab8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:39.365660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6a886-782b-4456-9d75-34520f5ab8b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:39.366663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6a886-782b-4456-9d75-34520f5ab8b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:36:39.367088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6a886-782b-4456-9d75-34520f5ab8b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:39.368955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6a886-782b-4456-9d75-34520f5ab8b3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:39.383709 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3466/6999] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:36:39.388354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25df31-9c7e-4482-90eb-d2f6bfb5d498 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:39.398668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25df31-9c7e-4482-90eb-d2f6bfb5d498 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:39.404310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03143c-eb70-4d99-aa88-47a6b3424250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:39.404981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03143c-eb70-4d99-aa88-47a6b3424250 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:39.405259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03143c-eb70-4d99-aa88-47a6b3424250 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:39.405531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03143c-eb70-4d99-aa88-47a6b3424250 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:39.406232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03143c-eb70-4d99-aa88-47a6b3424250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:39.408336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03143c-eb70-4d99-aa88-47a6b3424250 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:39.530688 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3534/7000] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:36:39 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:39.535179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6a886-782b-4456-9d75-34520f5ab8b3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:39.545983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6a886-782b-4456-9d75-34520f5ab8b3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:39.604110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4af25-1328-4502-989a-7d442b8b7533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:39.604773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4af25-1328-4502-989a-7d442b8b7533 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:39.605055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4af25-1328-4502-989a-7d442b8b7533 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:39.605336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4af25-1328-4502-989a-7d442b8b7533 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:39.606287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4af25-1328-4502-989a-7d442b8b7533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:39.608262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4af25-1328-4502-989a-7d442b8b7533 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:39.710710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:39.736563 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3467/7001] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:36:39 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:36:39.740778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03143c-eb70-4d99-aa88-47a6b3424250 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:39.752274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03143c-eb70-4d99-aa88-47a6b3424250 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:39.757616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b8ea7-124e-4d9a-897a-5f043e51d824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:39.758279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b8ea7-124e-4d9a-897a-5f043e51d824 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:39.758559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b8ea7-124e-4d9a-897a-5f043e51d824 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:39.758837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b8ea7-124e-4d9a-897a-5f043e51d824 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:39.759594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b8ea7-124e-4d9a-897a-5f043e51d824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:39.761203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b8ea7-124e-4d9a-897a-5f043e51d824 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:39.773819 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3535/7002] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:36:39.779711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4af25-1328-4502-989a-7d442b8b7533 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:39.789490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4af25-1328-4502-989a-7d442b8b7533 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:39.794444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5beb695-768a-4491-9d73-f7ca0e745109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:39.795223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5beb695-768a-4491-9d73-f7ca0e745109 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:39.795507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5beb695-768a-4491-9d73-f7ca0e745109 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:39.795781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5beb695-768a-4491-9d73-f7ca0e745109 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:39.796788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5beb695-768a-4491-9d73-f7ca0e745109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:39.798174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5beb695-768a-4491-9d73-f7ca0e745109 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:39.809874 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3468/7003] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:36:39.815903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b8ea7-124e-4d9a-897a-5f043e51d824 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:39.826792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b8ea7-124e-4d9a-897a-5f043e51d824 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:39.831422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875e5f1-f686-4bd4-8fdc-05808a405b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:39.832301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875e5f1-f686-4bd4-8fdc-05808a405b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:39.832582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875e5f1-f686-4bd4-8fdc-05808a405b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:39.832853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875e5f1-f686-4bd4-8fdc-05808a405b59 admin admin] PATH_INFO: `/v3/projects/d6173b4a2b13462d864768b0ed2dfb8d/users/ae296228d6ca48519a531179af606f74/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:39.849871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875e5f1-f686-4bd4-8fdc-05808a405b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6173b4a2b13462d864768b0ed2dfb8d, user_id=ae296228d6ca48519a531179af606f74, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:39.853125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875e5f1-f686-4bd4-8fdc-05808a405b59 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:39.965685 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3536/7004] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:36:39 2022] PUT /identity/v3/projects/d6173b4a2b13462d864768b0ed2dfb8d/users/ae296228d6ca48519a531179af606f74/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:39.966509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b8e62-62b4-44ae-b2bb-635ba9b8ebff None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:39.967280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b8e62-62b4-44ae-b2bb-635ba9b8ebff None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:39.967280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b8e62-62b4-44ae-b2bb-635ba9b8ebff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:39.998417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ec2b8e62-62b4-44ae-b2bb-635ba9b8ebff None None] MFA Rules not processed for user `ae296228d6ca48519a531179af606f74`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:39.999691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ec2b8e62-62b4-44ae-b2bb-635ba9b8ebff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:40.034871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:40.079783 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3469/7005] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:40.085069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875e5f1-f686-4bd4-8fdc-05808a405b59 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:40.178761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875e5f1-f686-4bd4-8fdc-05808a405b59 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:40.185204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819316eb-18da-4d5d-af5b-9b9877aa3c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:40.185204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819316eb-18da-4d5d-af5b-9b9877aa3c9a admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:40.185204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819316eb-18da-4d5d-af5b-9b9877aa3c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:40.185580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819316eb-18da-4d5d-af5b-9b9877aa3c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:40.186283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819316eb-18da-4d5d-af5b-9b9877aa3c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:40.188236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819316eb-18da-4d5d-af5b-9b9877aa3c9a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:40.205075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b8e62-62b4-44ae-b2bb-635ba9b8ebff None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:40.206700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ec2b8e62-62b4-44ae-b2bb-635ba9b8ebff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:40.222723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b8e62-62b4-44ae-b2bb-635ba9b8ebff None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:40.228722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7a2d0-7ea4-4b28-a634-37cd54eaeecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:40.229606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7a2d0-7ea4-4b28-a634-37cd54eaeecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:40.229888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7a2d0-7ea4-4b28-a634-37cd54eaeecb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:40.230164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7a2d0-7ea4-4b28-a634-37cd54eaeecb admin admin] PATH_INFO: `/v3/users/a691f131ccef4fb4989137852816abc2` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:40.231967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7a2d0-7ea4-4b28-a634-37cd54eaeecb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a691f131ccef4fb4989137852816abc2)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:40.233950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7a2d0-7ea4-4b28-a634-37cd54eaeecb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:40.327765 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3537/7006] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:36:40 2022] POST /identity/v3/projects => generated 381 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:40.331860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819316eb-18da-4d5d-af5b-9b9877aa3c9a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:40.401292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819316eb-18da-4d5d-af5b-9b9877aa3c9a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:40.405999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769f187-f4b8-41ea-80bc-b170662c2bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:40.406687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769f187-f4b8-41ea-80bc-b170662c2bdc admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:40.407100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769f187-f4b8-41ea-80bc-b170662c2bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:40.407381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769f187-f4b8-41ea-80bc-b170662c2bdc admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:40.408057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769f187-f4b8-41ea-80bc-b170662c2bdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:40.409997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769f187-f4b8-41ea-80bc-b170662c2bdc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:40.488032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6ff7a2d0-7ea4-4b28-a634-37cd54eaeecb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a691f131ccef4fb4989137852816abc2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:40.490215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6ff7a2d0-7ea4-4b28-a634-37cd54eaeecb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a691f131ccef4fb4989137852816abc2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:40.547094 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3538/7007] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:36:40 2022] POST /identity/v3/users => generated 297 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:36:40.548878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb548574-8868-45c4-a4e6-adfc595df90f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:40.549172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb548574-8868-45c4-a4e6-adfc595df90f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:40.549456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb548574-8868-45c4-a4e6-adfc595df90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:40.572161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-fb548574-8868-45c4-a4e6-adfc595df90f None None] MFA Rules not processed for user `0ab8b3f06e994bbca5d6dd14109bfe50`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:40.573430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fb548574-8868-45c4-a4e6-adfc595df90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:40.609565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6ff7a2d0-7ea4-4b28-a634-37cd54eaeecb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a691f131ccef4fb4989137852816abc2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:40.618224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6ff7a2d0-7ea4-4b28-a634-37cd54eaeecb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a691f131ccef4fb4989137852816abc2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:40.618922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6ff7a2d0-7ea4-4b28-a634-37cd54eaeecb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a691f131ccef4fb4989137852816abc2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:40.624991 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3470/7008] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:40 2022] DELETE /identity/v3/users/a691f131ccef4fb4989137852816abc2 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:36:40.625852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7a2d0-7ea4-4b28-a634-37cd54eaeecb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:40.627190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6ff7a2d0-7ea4-4b28-a634-37cd54eaeecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:40.633782 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3539/7009] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:40.635693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412c772-1fb2-48dd-95ee-8139ea93759c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:40.635991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412c772-1fb2-48dd-95ee-8139ea93759c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:40.636292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412c772-1fb2-48dd-95ee-8139ea93759c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:40.655572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3412c772-1fb2-48dd-95ee-8139ea93759c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:40.656913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3412c772-1fb2-48dd-95ee-8139ea93759c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:40.699495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7a2d0-7ea4-4b28-a634-37cd54eaeecb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:40.707901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46f65f-26ca-4a10-b650-adcddef71724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:40.708756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46f65f-26ca-4a10-b650-adcddef71724 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:40.709053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46f65f-26ca-4a10-b650-adcddef71724 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:40.709303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46f65f-26ca-4a10-b650-adcddef71724 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:40.710043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46f65f-26ca-4a10-b650-adcddef71724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:40.711693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46f65f-26ca-4a10-b650-adcddef71724 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:40.725874 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3471/7010] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:36:40.731130 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3540/7011] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:40.731258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46f65f-26ca-4a10-b650-adcddef71724 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:40.739060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46f65f-26ca-4a10-b650-adcddef71724 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:40.741122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412c772-1fb2-48dd-95ee-8139ea93759c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:40.742683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3412c772-1fb2-48dd-95ee-8139ea93759c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:40.746050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade2c53-639a-4362-b373-d9024b57f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:40.747129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade2c53-639a-4362-b373-d9024b57f65f admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:40.747422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade2c53-639a-4362-b373-d9024b57f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:40.747837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade2c53-639a-4362-b373-d9024b57f65f admin admin] PATH_INFO: `/v3/projects/b40c909d06284cc2a596bce1854c37c7/users/eae803e14ac44785a83d7d62edefae7a/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:40.766029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade2c53-639a-4362-b373-d9024b57f65f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b40c909d06284cc2a596bce1854c37c7, user_id=eae803e14ac44785a83d7d62edefae7a, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:40.768890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade2c53-639a-4362-b373-d9024b57f65f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:40.809010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412c772-1fb2-48dd-95ee-8139ea93759c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:40.812754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89436e-017e-4e0f-a203-f79115bafb01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:40.813431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89436e-017e-4e0f-a203-f79115bafb01 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:40.813715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89436e-017e-4e0f-a203-f79115bafb01 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:40.813991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89436e-017e-4e0f-a203-f79115bafb01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:40.824751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89436e-017e-4e0f-a203-f79115bafb01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:40.827622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89436e-017e-4e0f-a203-f79115bafb01 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:40.838740 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3541/7012] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:36:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:36:40.900354 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3472/7013] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:36:40 2022] PUT /identity/v3/projects/b40c909d06284cc2a596bce1854c37c7/users/eae803e14ac44785a83d7d62edefae7a/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:40.901413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89436e-017e-4e0f-a203-f79115bafb01 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:40.926684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89436e-017e-4e0f-a203-f79115bafb01 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:40.995533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d2b43-7185-45a5-96fc-3071b9491495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:40.996228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d2b43-7185-45a5-96fc-3071b9491495 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:40.997001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d2b43-7185-45a5-96fc-3071b9491495 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:40.997001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d2b43-7185-45a5-96fc-3071b9491495 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:40.997483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d2b43-7185-45a5-96fc-3071b9491495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:40.999222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d2b43-7185-45a5-96fc-3071b9491495 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:41.015052 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3542/7014] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:36:41.020108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade2c53-639a-4362-b373-d9024b57f65f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:41.033317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade2c53-639a-4362-b373-d9024b57f65f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:41.039372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e29638-0784-447d-b8a3-7da80f246f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:41.040325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e29638-0784-447d-b8a3-7da80f246f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:41.040639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e29638-0784-447d-b8a3-7da80f246f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:41.040921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e29638-0784-447d-b8a3-7da80f246f06 admin admin] PATH_INFO: `/v3/projects/b40c909d06284cc2a596bce1854c37c7/users/eae803e14ac44785a83d7d62edefae7a/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:41.043086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e29638-0784-447d-b8a3-7da80f246f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b40c909d06284cc2a596bce1854c37c7, user_id=eae803e14ac44785a83d7d62edefae7a, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:41.045777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e29638-0784-447d-b8a3-7da80f246f06 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:41.059428 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3473/7015] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:36:41 2022] PUT /identity/v3/projects/b40c909d06284cc2a596bce1854c37c7/users/eae803e14ac44785a83d7d62edefae7a/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:41.072994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a32ea-c8ab-44de-b82a-865d71481ace None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:41.073314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a32ea-c8ab-44de-b82a-865d71481ace None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:41.073593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a32ea-c8ab-44de-b82a-865d71481ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:41.106822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a71a32ea-c8ab-44de-b82a-865d71481ace None None] MFA Rules not processed for user `eae803e14ac44785a83d7d62edefae7a`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:41.108085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a71a32ea-c8ab-44de-b82a-865d71481ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:41.189718 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3543/7016] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:41.195328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e29638-0784-447d-b8a3-7da80f246f06 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:41.213770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e29638-0784-447d-b8a3-7da80f246f06 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:41.218929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b71a4-1e24-4520-9622-f7ef274a6457 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae803e14ac44785a83d7d62edefae7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b40c909d06284cc2a596bce1854c37c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:41.220095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b71a4-1e24-4520-9622-f7ef274a6457 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:41.223881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b71a4-1e24-4520-9622-f7ef274a6457 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:41.223881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b71a4-1e24-4520-9622-f7ef274a6457 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:41.223881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b71a4-1e24-4520-9622-f7ef274a6457 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:41.223881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b71a4-1e24-4520-9622-f7ef274a6457 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-796b71a4-1e24-4520-9622-f7ef274a6457 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invalid input for field 'name': '' is too short Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: Failed validating 'minLength' in schema['properties']['name']: Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: On instance['name']: Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: Failed validating 'minLength' in schema['properties']['name']: Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: On instance['name']: Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: '' Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise error Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application On instance['name']: Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application '' Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:41.231225 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:36:41.232690 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:41.232690 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:41.232690 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:36:41.232690 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:36:41.232690 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:36:41.232690 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:36:41.232690 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:36:41.232690 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:36:41.232690 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:36:41.232690 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:36:41.232690 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:36:41.232690 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:36:41.232690 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jul 16 21:36:41.232690 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jul 16 21:36:41.232690 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 16 21:36:41.232690 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 16 21:36:41.232690 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 16 21:36:41.233621 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 16 21:36:41.233621 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 16 21:36:41.233621 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:41.233621 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 16 21:36:41.233621 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 16 21:36:41.233621 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:41.233621 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application On instance['name']: Jul 16 21:36:41.233621 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application '' Jul 16 21:36:41.233621 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:41.233621 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3474/7017] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:36:41 2022] POST /identity/v3/domains => generated 283 bytes in 38 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jul 16 21:36:41.237721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a32ea-c8ab-44de-b82a-865d71481ace None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:41.252900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a32ea-c8ab-44de-b82a-865d71481ace None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:41.257974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68935a0b-a128-4d8f-8cf3-943986cc11d5 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae803e14ac44785a83d7d62edefae7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b40c909d06284cc2a596bce1854c37c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:41.258889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68935a0b-a128-4d8f-8cf3-943986cc11d5 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:41.259652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68935a0b-a128-4d8f-8cf3-943986cc11d5 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:41.259955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68935a0b-a128-4d8f-8cf3-943986cc11d5 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:41.260862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68935a0b-a128-4d8f-8cf3-943986cc11d5 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:41.262556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68935a0b-a128-4d8f-8cf3-943986cc11d5 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:41.271984 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-68935a0b-a128-4d8f-8cf3-943986cc11d5 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 16 21:36:41.271984 ncdv-master-1 devstack@keystone.service[98196]: Failed validating 'maxLength' in schema['properties']['name']: Jul 16 21:36:41.271984 ncdv-master-1 devstack@keystone.service[98196]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 16 21:36:41.271984 ncdv-master-1 devstack@keystone.service[98196]: On instance['name']: Jul 16 21:36:41.271984 ncdv-master-1 devstack@keystone.service[98196]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 16 21:36:41.271984 ncdv-master-1 devstack@keystone.service[98196]: Failed validating 'maxLength' in schema['properties']['name']: Jul 16 21:36:41.271984 ncdv-master-1 devstack@keystone.service[98196]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 16 21:36:41.271984 ncdv-master-1 devstack@keystone.service[98196]: On instance['name']: Jul 16 21:36:41.271984 ncdv-master-1 devstack@keystone.service[98196]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 16 21:36:41.271984 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:41.271984 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 16 21:36:41.271984 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 16 21:36:41.271984 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 16 21:36:41.271984 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise error Jul 16 21:36:41.271984 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 16 21:36:41.271984 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:36:41.271984 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 16 21:36:41.271984 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 16 21:36:41.271984 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:36:41.273334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application On instance['name']: Jul 16 21:36:41.273334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 16 21:36:41.273334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:36:41.273334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:36:41.273334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:36:41.273334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:41.273334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:36:41.273334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:36:41.273334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:36:41.273334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:36:41.273334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:36:41.273334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:36:41.273334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:36:41.273334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:36:41.273334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:36:41.273334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:36:41.273334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jul 16 21:36:41.273334 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jul 16 21:36:41.274294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 16 21:36:41.274294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 16 21:36:41.274294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 16 21:36:41.274294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 16 21:36:41.274294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 16 21:36:41.274294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:36:41.274294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 16 21:36:41.274294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 16 21:36:41.274294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:36:41.274294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application On instance['name']: Jul 16 21:36:41.274294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 16 21:36:41.274294 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:36:41.275478 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3544/7018] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:36:41 2022] POST /identity/v3/domains => generated 412 bytes in 38 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 16 21:36:41.279979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b71a4-1e24-4520-9622-f7ef274a6457 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:41.293690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b71a4-1e24-4520-9622-f7ef274a6457 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:41.299773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fa0af-7eab-4a7c-ba20-27be85d38ccf tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae803e14ac44785a83d7d62edefae7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b40c909d06284cc2a596bce1854c37c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:41.301148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fa0af-7eab-4a7c-ba20-27be85d38ccf tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:41.301517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fa0af-7eab-4a7c-ba20-27be85d38ccf tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:41.301893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fa0af-7eab-4a7c-ba20-27be85d38ccf tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:41.303408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fa0af-7eab-4a7c-ba20-27be85d38ccf tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:41.305829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fa0af-7eab-4a7c-ba20-27be85d38ccf tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:41.316022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68935a0b-a128-4d8f-8cf3-943986cc11d5 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:41.319229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-68935a0b-a128-4d8f-8cf3-943986cc11d5 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:41.361185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:41.407404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68935a0b-a128-4d8f-8cf3-943986cc11d5 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:41.413242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e539fd2-4a27-4de5-b887-af2f874f5e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:41.414246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e539fd2-4a27-4de5-b887-af2f874f5e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:41.414663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e539fd2-4a27-4de5-b887-af2f874f5e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:41.414858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e539fd2-4a27-4de5-b887-af2f874f5e8c admin admin] PATH_INFO: `/v3/projects/74bc69aef04a436498a38c4f1efaf88a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:41.416263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e539fd2-4a27-4de5-b887-af2f874f5e8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=74bc69aef04a436498a38c4f1efaf88a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:41.421246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e539fd2-4a27-4de5-b887-af2f874f5e8c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:41.483523 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3475/7019] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:36:41 2022] POST /identity/v3/domains => generated 277 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:41.484891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fa0af-7eab-4a7c-ba20-27be85d38ccf tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:41.580385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0e539fd2-4a27-4de5-b887-af2f874f5e8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74bc69aef04a436498a38c4f1efaf88a', 'request_id': 'req-0e539fd2-4a27-4de5-b887-af2f874f5e8c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:41.592692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0e539fd2-4a27-4de5-b887-af2f874f5e8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74bc69aef04a436498a38c4f1efaf88a', 'request_id': 'req-0e539fd2-4a27-4de5-b887-af2f874f5e8c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:41.602655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0e539fd2-4a27-4de5-b887-af2f874f5e8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74bc69aef04a436498a38c4f1efaf88a', 'request_id': 'req-0e539fd2-4a27-4de5-b887-af2f874f5e8c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:41.622215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fa0af-7eab-4a7c-ba20-27be85d38ccf tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:41.695888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ab776-d6f9-47a1-8696-cdc2279a2997 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae803e14ac44785a83d7d62edefae7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b40c909d06284cc2a596bce1854c37c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:41.695888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ab776-d6f9-47a1-8696-cdc2279a2997 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:41.695888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ab776-d6f9-47a1-8696-cdc2279a2997 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:41.696176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ab776-d6f9-47a1-8696-cdc2279a2997 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] PATH_INFO: `/v3/domains/07475a80cdcc4449af2b2f15c78cb379` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:41.696271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0e539fd2-4a27-4de5-b887-af2f874f5e8c admin admin] The token cache is being invalidate because project 74bc69aef04a436498a38c4f1efaf88a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:41.696271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0e539fd2-4a27-4de5-b887-af2f874f5e8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:41.696821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0e539fd2-4a27-4de5-b887-af2f874f5e8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:41.698714 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3545/7020] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:36:41 2022] DELETE /identity/v3/projects/74bc69aef04a436498a38c4f1efaf88a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:41.703686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222467d-f585-4bf9-a95e-4ea7ef3f793f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:41.704066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222467d-f585-4bf9-a95e-4ea7ef3f793f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:41.704353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222467d-f585-4bf9-a95e-4ea7ef3f793f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:41.714445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ab776-d6f9-47a1-8696-cdc2279a2997 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=07475a80cdcc4449af2b2f15c78cb379)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:41.714445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:41.717126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ab776-d6f9-47a1-8696-cdc2279a2997 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:41.726612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5222467d-f585-4bf9-a95e-4ea7ef3f793f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:41.728060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5222467d-f585-4bf9-a95e-4ea7ef3f793f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:41.742575 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-ee5ab776-d6f9-47a1-8696-cdc2279a2997 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jul 16 21:36:41.742575 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:41.742575 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:36:41.742575 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:36:41.742575 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:36:41.742575 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:36:41.742575 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:36:41.742575 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:36:41.742575 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:36:41.742575 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:36:41.742575 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:36:41.742575 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:36:41.742575 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Jul 16 21:36:41.742575 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Jul 16 21:36:41.743502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:36:41.743502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:36:41.743502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Jul 16 21:36:41.743502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Jul 16 21:36:41.743502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Jul 16 21:36:41.743502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jul 16 21:36:41.743502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jul 16 21:36:41.743502 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:41.747176 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3476/7021] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:36:41 2022] DELETE /identity/v3/domains/07475a80cdcc4449af2b2f15c78cb379 => generated 120 bytes in 263 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Jul 16 21:36:41.748266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ab776-d6f9-47a1-8696-cdc2279a2997 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:41.750764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ee5ab776-d6f9-47a1-8696-cdc2279a2997 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:41.766310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ab776-d6f9-47a1-8696-cdc2279a2997 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:41.774516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66181d1e-febc-4d78-b915-02e6526efb51 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae803e14ac44785a83d7d62edefae7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b40c909d06284cc2a596bce1854c37c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:41.775445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66181d1e-febc-4d78-b915-02e6526efb51 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:41.775737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66181d1e-febc-4d78-b915-02e6526efb51 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:41.776015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66181d1e-febc-4d78-b915-02e6526efb51 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] PATH_INFO: `/v3/domains/07475a80cdcc4449af2b2f15c78cb379` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:41.777630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66181d1e-febc-4d78-b915-02e6526efb51 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=07475a80cdcc4449af2b2f15c78cb379)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:41.779110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66181d1e-febc-4d78-b915-02e6526efb51 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:41.793719 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3546/7022] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:41.800056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-66181d1e-febc-4d78-b915-02e6526efb51 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '07475a80cdcc4449af2b2f15c78cb379'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:41.805715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-66181d1e-febc-4d78-b915-02e6526efb51 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '07475a80cdcc4449af2b2f15c78cb379'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:41.805844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dea07-a2e2-4c07-b7f4-4ea3a7ff04a1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:41.805844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dea07-a2e2-4c07-b7f4-4ea3a7ff04a1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:41.805844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dea07-a2e2-4c07-b7f4-4ea3a7ff04a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:41.823038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4e1dea07-a2e2-4c07-b7f4-4ea3a7ff04a1 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:41.824419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4e1dea07-a2e2-4c07-b7f4-4ea3a7ff04a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:41.892197 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3547/7023] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:41.893859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1dea07-a2e2-4c07-b7f4-4ea3a7ff04a1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:41.894239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-66181d1e-febc-4d78-b915-02e6526efb51 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '07475a80cdcc4449af2b2f15c78cb379'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:41.894896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-66181d1e-febc-4d78-b915-02e6526efb51 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '07475a80cdcc4449af2b2f15c78cb379'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:41.900697 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3477/7024] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:36:41 2022] PATCH /identity/v3/domains/07475a80cdcc4449af2b2f15c78cb379 => generated 278 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:36:41.901519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66181d1e-febc-4d78-b915-02e6526efb51 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:41.902885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-66181d1e-febc-4d78-b915-02e6526efb51 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:41.903522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1dea07-a2e2-4c07-b7f4-4ea3a7ff04a1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:41.908160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921499b-98f6-4304-8f86-89beaa8d23fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:41.908853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921499b-98f6-4304-8f86-89beaa8d23fe admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:41.909145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921499b-98f6-4304-8f86-89beaa8d23fe admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:41.909420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921499b-98f6-4304-8f86-89beaa8d23fe admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:41.910180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921499b-98f6-4304-8f86-89beaa8d23fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:36:41.910542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921499b-98f6-4304-8f86-89beaa8d23fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:41.913009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921499b-98f6-4304-8f86-89beaa8d23fe admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:41.930158 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3548/7025] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:36:41.931520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921499b-98f6-4304-8f86-89beaa8d23fe admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:41.933198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4921499b-98f6-4304-8f86-89beaa8d23fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:41.945994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921499b-98f6-4304-8f86-89beaa8d23fe admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:41.951615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5edaaa-c562-458c-a349-3c29ae85fd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:41.952292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5edaaa-c562-458c-a349-3c29ae85fd01 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:41.952578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5edaaa-c562-458c-a349-3c29ae85fd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:41.952853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5edaaa-c562-458c-a349-3c29ae85fd01 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:41.953544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5edaaa-c562-458c-a349-3c29ae85fd01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:41.955507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5edaaa-c562-458c-a349-3c29ae85fd01 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:41.976739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66181d1e-febc-4d78-b915-02e6526efb51 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:41.981734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c12ac2-94d9-4793-a572-4ebb3de53a1d tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae803e14ac44785a83d7d62edefae7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b40c909d06284cc2a596bce1854c37c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:41.982597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c12ac2-94d9-4793-a572-4ebb3de53a1d tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:41.982881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c12ac2-94d9-4793-a572-4ebb3de53a1d tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:41.983188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c12ac2-94d9-4793-a572-4ebb3de53a1d tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] PATH_INFO: `/v3/domains/07475a80cdcc4449af2b2f15c78cb379` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:41.994515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c12ac2-94d9-4793-a572-4ebb3de53a1d tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=07475a80cdcc4449af2b2f15c78cb379)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:41.996211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c12ac2-94d9-4793-a572-4ebb3de53a1d tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:42.022523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-74c12ac2-94d9-4793-a572-4ebb3de53a1d tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '07475a80cdcc4449af2b2f15c78cb379'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:42.033260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-74c12ac2-94d9-4793-a572-4ebb3de53a1d tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '07475a80cdcc4449af2b2f15c78cb379'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:42.067966 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3549/7026] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:36:41 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:36:42.072028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5edaaa-c562-458c-a349-3c29ae85fd01 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:42.133904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5edaaa-c562-458c-a349-3c29ae85fd01 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:42.138580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff322df1-e7c7-4d23-9412-503c455c1aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:42.139280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff322df1-e7c7-4d23-9412-503c455c1aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:42.139564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff322df1-e7c7-4d23-9412-503c455c1aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:42.139842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff322df1-e7c7-4d23-9412-503c455c1aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:42.140519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff322df1-e7c7-4d23-9412-503c455c1aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:42.142512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff322df1-e7c7-4d23-9412-503c455c1aa2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:42.228250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-74c12ac2-94d9-4793-a572-4ebb3de53a1d tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07475a80cdcc4449af2b2f15c78cb379', 'request_id': 'req-74c12ac2-94d9-4793-a572-4ebb3de53a1d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:42.234122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-74c12ac2-94d9-4793-a572-4ebb3de53a1d tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07475a80cdcc4449af2b2f15c78cb379', 'request_id': 'req-74c12ac2-94d9-4793-a572-4ebb3de53a1d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:42.241323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-74c12ac2-94d9-4793-a572-4ebb3de53a1d tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07475a80cdcc4449af2b2f15c78cb379', 'request_id': 'req-74c12ac2-94d9-4793-a572-4ebb3de53a1d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:42.308147 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3550/7027] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:36:42 2022] POST /identity/v3/users => generated 296 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:36:42.312702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff322df1-e7c7-4d23-9412-503c455c1aa2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:42.336423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff322df1-e7c7-4d23-9412-503c455c1aa2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:42.352984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-74c12ac2-94d9-4793-a572-4ebb3de53a1d tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] The token cache is being invalidate because project 07475a80cdcc4449af2b2f15c78cb379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:42.353247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-74c12ac2-94d9-4793-a572-4ebb3de53a1d tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:42.355518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-74c12ac2-94d9-4793-a572-4ebb3de53a1d tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:42.374955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-74c12ac2-94d9-4793-a572-4ebb3de53a1d tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '07475a80cdcc4449af2b2f15c78cb379', 'request_id': 'req-74c12ac2-94d9-4793-a572-4ebb3de53a1d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:42.387543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-74c12ac2-94d9-4793-a572-4ebb3de53a1d tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '07475a80cdcc4449af2b2f15c78cb379', 'request_id': 'req-74c12ac2-94d9-4793-a572-4ebb3de53a1d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:42.388495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-74c12ac2-94d9-4793-a572-4ebb3de53a1d tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '07475a80cdcc4449af2b2f15c78cb379', 'request_id': 'req-74c12ac2-94d9-4793-a572-4ebb3de53a1d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:42.400477 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3478/7028] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:36:41 2022] DELETE /identity/v3/domains/07475a80cdcc4449af2b2f15c78cb379 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:36:42.405560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c12ac2-94d9-4793-a572-4ebb3de53a1d tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:42.406950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-74c12ac2-94d9-4793-a572-4ebb3de53a1d tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:42.409831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f289c-125d-4e67-a2a9-cef9be93c591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:42.410676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f289c-125d-4e67-a2a9-cef9be93c591 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:42.411040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f289c-125d-4e67-a2a9-cef9be93c591 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:42.411345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f289c-125d-4e67-a2a9-cef9be93c591 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:42.412569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f289c-125d-4e67-a2a9-cef9be93c591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:42.414639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f289c-125d-4e67-a2a9-cef9be93c591 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:42.430482 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3551/7029] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:36:42.430662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f289c-125d-4e67-a2a9-cef9be93c591 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:42.432450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a67f289c-125d-4e67-a2a9-cef9be93c591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:42.447352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f289c-125d-4e67-a2a9-cef9be93c591 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:42.453505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41906ca-b1d8-4d34-a101-ef6c99538e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:42.454175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41906ca-b1d8-4d34-a101-ef6c99538e39 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:42.454492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41906ca-b1d8-4d34-a101-ef6c99538e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:42.454790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41906ca-b1d8-4d34-a101-ef6c99538e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:42.455524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41906ca-b1d8-4d34-a101-ef6c99538e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:42.457140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41906ca-b1d8-4d34-a101-ef6c99538e39 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:42.469179 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3552/7030] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:36:42.473387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41906ca-b1d8-4d34-a101-ef6c99538e39 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:42.487888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41906ca-b1d8-4d34-a101-ef6c99538e39 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:42.493593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538077c-5418-4f59-89c5-dff063e371c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:42.494523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538077c-5418-4f59-89c5-dff063e371c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:42.494771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538077c-5418-4f59-89c5-dff063e371c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:42.495078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538077c-5418-4f59-89c5-dff063e371c4 admin admin] PATH_INFO: `/v3/projects/fbb367bc7a20470f9af2e1387f654d99/users/27dd59929c0e400983543373d4ba0a98/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:42.498607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c12ac2-94d9-4793-a572-4ebb3de53a1d tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:42.504548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d1007-6091-4329-b138-f8cb598f1489 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae803e14ac44785a83d7d62edefae7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b40c909d06284cc2a596bce1854c37c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:42.505573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d1007-6091-4329-b138-f8cb598f1489 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:42.505989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d1007-6091-4329-b138-f8cb598f1489 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:42.509853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d1007-6091-4329-b138-f8cb598f1489 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] PATH_INFO: `/v3/domains/80a5a0c930284a9fbeeb8002a7f51342` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:42.515307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d1007-6091-4329-b138-f8cb598f1489 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 21:36:42.526406 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-fe0d1007-6091-4329-b138-f8cb598f1489 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Could not find domain: 80a5a0c930284a9fbeeb8002a7f51342.: keystone.exception.DomainNotFound: Could not find domain: 80a5a0c930284a9fbeeb8002a7f51342. Jul 16 21:36:42.526406 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:42.526406 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 16 21:36:42.526406 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 16 21:36:42.526406 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 21:36:42.526406 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 21:36:42.526406 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 21:36:42.526406 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 21:36:42.526406 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 80a5a0c930284a9fbeeb8002a7f51342. Jul 16 21:36:42.526406 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:42.526406 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:36:42.526406 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:42.526406 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:42.526406 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:36:42.526406 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:36:42.529748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:36:42.529748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:36:42.529748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:36:42.529748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:36:42.529748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:36:42.529748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:36:42.529748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:36:42.529748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:36:42.529748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Jul 16 21:36:42.529748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Jul 16 21:36:42.529748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 21:36:42.529748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 21:36:42.529748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 21:36:42.529748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 21:36:42.529748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:36:42.529748 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:36:42.530711 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:36:42.530711 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:36:42.530711 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:36:42.530711 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:36:42.530711 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:36:42.530711 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 21:36:42.530711 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:36:42.530711 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:36:42.530711 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:36:42.530711 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:36:42.530711 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:36:42.530711 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:36:42.530711 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:36:42.530711 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:36:42.530711 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 16 21:36:42.530711 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 21:36:42.530711 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 80a5a0c930284a9fbeeb8002a7f51342. Jul 16 21:36:42.532119 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:42.532896 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3479/7031] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:36:42 2022] DELETE /identity/v3/domains/80a5a0c930284a9fbeeb8002a7f51342 => generated 112 bytes in 127 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:36:42.533626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d1007-6091-4329-b138-f8cb598f1489 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:42.545502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d1007-6091-4329-b138-f8cb598f1489 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:42.550593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7f0eb-a041-4d82-8bae-83d3922a1165 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae803e14ac44785a83d7d62edefae7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b40c909d06284cc2a596bce1854c37c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:42.551319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7f0eb-a041-4d82-8bae-83d3922a1165 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:42.551609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7f0eb-a041-4d82-8bae-83d3922a1165 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:42.551894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7f0eb-a041-4d82-8bae-83d3922a1165 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:42.553688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a7f0eb-a041-4d82-8bae-83d3922a1165 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:42.555397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a7f0eb-a041-4d82-8bae-83d3922a1165 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:42.668956 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3480/7032] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:36:42 2022] POST /identity/v3/domains => generated 252 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:42.671898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538077c-5418-4f59-89c5-dff063e371c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbb367bc7a20470f9af2e1387f654d99, user_id=27dd59929c0e400983543373d4ba0a98, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:42.672996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7f0eb-a041-4d82-8bae-83d3922a1165 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:42.675467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538077c-5418-4f59-89c5-dff063e371c4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:42.749803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7f0eb-a041-4d82-8bae-83d3922a1165 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:42.755750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597f60e-fe14-4cea-9ec2-41769328158e tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae803e14ac44785a83d7d62edefae7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b40c909d06284cc2a596bce1854c37c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:42.761642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597f60e-fe14-4cea-9ec2-41769328158e tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:42.761642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597f60e-fe14-4cea-9ec2-41769328158e tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:42.761642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597f60e-fe14-4cea-9ec2-41769328158e tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:42.761642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597f60e-fe14-4cea-9ec2-41769328158e tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:42.761642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597f60e-fe14-4cea-9ec2-41769328158e tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:42.805307 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3553/7033] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:36:42 2022] PUT /identity/v3/projects/fbb367bc7a20470f9af2e1387f654d99/users/27dd59929c0e400983543373d4ba0a98/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:42.812928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.sql.core [None req-d597f60e-fe14-4cea-9ec2-41769328158e tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-878019933' for key 'project.ixu_project_name_domain_id'") Jul 16 21:36:42.812928 ncdv-master-1 devstack@keystone.service[98195]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 16 21:36:42.812928 ncdv-master-1 devstack@keystone.service[98195]: [parameters: {'id': '39fca16f29d048889cfdb1069abe9660', 'name': 'tempest-domain-dup-878019933', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jul 16 21:36:42.812928 ncdv-master-1 devstack@keystone.service[98195]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98195) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 16 21:36:42.816788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c318548-2fc0-40ab-b00b-269e2499ca48 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:42.817080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c318548-2fc0-40ab-b00b-269e2499ca48 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:42.817361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c318548-2fc0-40ab-b00b-269e2499ca48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:42.823847 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-d597f60e-fe14-4cea-9ec2-41769328158e tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-878019933.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-878019933. Jul 16 21:36:42.823847 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:42.823847 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 16 21:36:42.823847 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 16 21:36:42.823847 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 16 21:36:42.823847 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 16 21:36:42.823847 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 16 21:36:42.823847 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application result = self._query(query) Jul 16 21:36:42.823847 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 16 21:36:42.823847 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application conn.query(q) Jul 16 21:36:42.823847 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 16 21:36:42.823847 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 16 21:36:42.823847 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 16 21:36:42.824761 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application result.read() Jul 16 21:36:42.824761 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 16 21:36:42.824761 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 16 21:36:42.824761 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 16 21:36:42.824761 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 16 21:36:42.824761 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 16 21:36:42.824761 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 16 21:36:42.824761 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 16 21:36:42.824761 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 16 21:36:42.824761 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-878019933' for key 'project.ixu_project_name_domain_id'") Jul 16 21:36:42.824761 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:42.824761 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 16 21:36:42.824761 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:42.824761 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:42.824761 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 16 21:36:42.824761 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 16 21:36:42.824761 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 16 21:36:42.824761 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 16 21:36:42.825778 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 16 21:36:42.825778 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application next(self.gen) Jul 16 21:36:42.825778 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 16 21:36:42.825778 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application yield resource Jul 16 21:36:42.825778 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 16 21:36:42.825778 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application next(self.gen) Jul 16 21:36:42.825778 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 16 21:36:42.825778 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self.session.rollback() Jul 16 21:36:42.825778 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 16 21:36:42.825778 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self.force_reraise() Jul 16 21:36:42.825778 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 16 21:36:42.825778 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise self.value Jul 16 21:36:42.825778 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 16 21:36:42.825778 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 16 21:36:42.825778 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 16 21:36:42.825778 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application session.commit() Jul 16 21:36:42.825778 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 16 21:36:42.826728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 16 21:36:42.826728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 16 21:36:42.826728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._prepare_impl() Jul 16 21:36:42.826728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 16 21:36:42.826728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self.session.flush() Jul 16 21:36:42.826728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 16 21:36:42.826728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._flush(objects) Jul 16 21:36:42.826728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 16 21:36:42.826728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 16 21:36:42.826728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 16 21:36:42.826728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application compat.raise_( Jul 16 21:36:42.826728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 16 21:36:42.826728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception Jul 16 21:36:42.826728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 16 21:36:42.826728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application flush_context.execute() Jul 16 21:36:42.826728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 16 21:36:42.826728 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rec.execute(self) Jul 16 21:36:42.834710 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 16 21:36:42.834710 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 16 21:36:42.834710 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 16 21:36:42.834710 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 16 21:36:42.834710 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 16 21:36:42.834710 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 16 21:36:42.834710 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 16 21:36:42.834710 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 16 21:36:42.834710 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 16 21:36:42.834710 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 16 21:36:42.834710 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 16 21:36:42.834710 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 16 21:36:42.834710 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 16 21:36:42.834710 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 16 21:36:42.834710 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 16 21:36:42.835644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 16 21:36:42.835644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 16 21:36:42.835644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception Jul 16 21:36:42.835644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 16 21:36:42.835644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 16 21:36:42.835644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 16 21:36:42.835644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 16 21:36:42.835644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 16 21:36:42.835644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application result = self._query(query) Jul 16 21:36:42.835644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 16 21:36:42.835644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application conn.query(q) Jul 16 21:36:42.835644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 16 21:36:42.835644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 16 21:36:42.835644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 16 21:36:42.835644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application result.read() Jul 16 21:36:42.835644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 16 21:36:42.835644 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 16 21:36:42.836529 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 16 21:36:42.836529 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 16 21:36:42.836529 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 16 21:36:42.836529 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 16 21:36:42.836529 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 16 21:36:42.836529 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 16 21:36:42.836529 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-878019933' for key 'project.ixu_project_name_domain_id'") Jul 16 21:36:42.836529 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 16 21:36:42.836529 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [parameters: {'id': '39fca16f29d048889cfdb1069abe9660', 'name': 'tempest-domain-dup-878019933', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jul 16 21:36:42.836529 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 16 21:36:42.836529 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:42.836529 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:36:42.836529 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:42.836529 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:42.837289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 16 21:36:42.837289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 16 21:36:42.837289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 16 21:36:42.837289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 16 21:36:42.837289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-878019933. Jul 16 21:36:42.837289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:42.837289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:36:42.837289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:42.837289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:42.837289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:36:42.837289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:36:42.837289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:36:42.837289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:36:42.837289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:36:42.837289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:36:42.837289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:36:42.837289 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:36:42.838190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:36:42.838190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:36:42.838190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Jul 16 21:36:42.838190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Jul 16 21:36:42.838190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:36:42.838190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:36:42.838190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Jul 16 21:36:42.838190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Jul 16 21:36:42.838190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:36:42.838190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:36:42.838190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 16 21:36:42.838190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 16 21:36:42.838190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-878019933. Jul 16 21:36:42.838190 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:36:42.838190 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3481/7034] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:36:42 2022] POST /identity/v3/domains => generated 211 bytes in 153 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 16 21:36:42.839256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597f60e-fe14-4cea-9ec2-41769328158e tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:42.847392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597f60e-fe14-4cea-9ec2-41769328158e tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:42.860201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6c318548-2fc0-40ab-b00b-269e2499ca48 None None] MFA Rules not processed for user `27dd59929c0e400983543373d4ba0a98`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:42.861914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6c318548-2fc0-40ab-b00b-269e2499ca48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:42.915176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09040291-80a8-48aa-b476-99b76f5aca63 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae803e14ac44785a83d7d62edefae7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b40c909d06284cc2a596bce1854c37c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:42.916102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09040291-80a8-48aa-b476-99b76f5aca63 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:42.916397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09040291-80a8-48aa-b476-99b76f5aca63 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:42.916684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09040291-80a8-48aa-b476-99b76f5aca63 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] PATH_INFO: `/v3/domains/3e2603d2fe5240cc876c3755a7496e9d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:42.931719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09040291-80a8-48aa-b476-99b76f5aca63 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3e2603d2fe5240cc876c3755a7496e9d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:42.933303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09040291-80a8-48aa-b476-99b76f5aca63 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:42.947657 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3554/7035] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:36:42.959267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c318548-2fc0-40ab-b00b-269e2499ca48 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:42.961952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6c318548-2fc0-40ab-b00b-269e2499ca48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:42.964067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-09040291-80a8-48aa-b476-99b76f5aca63 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3e2603d2fe5240cc876c3755a7496e9d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:42.964973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-09040291-80a8-48aa-b476-99b76f5aca63 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3e2603d2fe5240cc876c3755a7496e9d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:43.023328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c318548-2fc0-40ab-b00b-269e2499ca48 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:43.026908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:43.078076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f01b66-dde3-4e8f-9906-3aead023a81c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:43.078794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f01b66-dde3-4e8f-9906-3aead023a81c service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:43.079110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f01b66-dde3-4e8f-9906-3aead023a81c service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:43.079390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f01b66-dde3-4e8f-9906-3aead023a81c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:43.081852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a5f01b66-dde3-4e8f-9906-3aead023a81c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:43.095567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-09040291-80a8-48aa-b476-99b76f5aca63 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3e2603d2fe5240cc876c3755a7496e9d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:43.096903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-09040291-80a8-48aa-b476-99b76f5aca63 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3e2603d2fe5240cc876c3755a7496e9d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:43.100164 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3482/7036] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:36:42 2022] PATCH /identity/v3/domains/3e2603d2fe5240cc876c3755a7496e9d => generated 253 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:36:43.104608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09040291-80a8-48aa-b476-99b76f5aca63 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:43.106419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-09040291-80a8-48aa-b476-99b76f5aca63 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:43.168317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f01b66-dde3-4e8f-9906-3aead023a81c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:43.169992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f01b66-dde3-4e8f-9906-3aead023a81c service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:43.185100 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3555/7037] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:36:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:36:43.185228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09040291-80a8-48aa-b476-99b76f5aca63 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:43.191551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae803e14ac44785a83d7d62edefae7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b40c909d06284cc2a596bce1854c37c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:43.192571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:43.194610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:43.195002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] PATH_INFO: `/v3/domains/3e2603d2fe5240cc876c3755a7496e9d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:43.212398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3e2603d2fe5240cc876c3755a7496e9d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:43.215114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:43.251681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3e2603d2fe5240cc876c3755a7496e9d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:43.264762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3e2603d2fe5240cc876c3755a7496e9d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:43.361974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:43.442387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e2603d2fe5240cc876c3755a7496e9d', 'request_id': 'req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:43.449385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e2603d2fe5240cc876c3755a7496e9d', 'request_id': 'req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:43.458402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e2603d2fe5240cc876c3755a7496e9d', 'request_id': 'req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:43.616764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] The token cache is being invalidate because project 3e2603d2fe5240cc876c3755a7496e9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:43.617059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:43.617909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:43.626036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3e2603d2fe5240cc876c3755a7496e9d', 'request_id': 'req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:43.626692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3e2603d2fe5240cc876c3755a7496e9d', 'request_id': 'req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:43.627326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3e2603d2fe5240cc876c3755a7496e9d', 'request_id': 'req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:43.636586 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3483/7038] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:36:43 2022] DELETE /identity/v3/domains/3e2603d2fe5240cc876c3755a7496e9d => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:43.641472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f01b66-dde3-4e8f-9906-3aead023a81c service cinder] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:43.642952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a5f01b66-dde3-4e8f-9906-3aead023a81c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:43.656444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f01b66-dde3-4e8f-9906-3aead023a81c service cinder] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:43.715767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860c8c4-d00d-41dd-b9df-820f2d6c1547 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eae803e14ac44785a83d7d62edefae7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b40c909d06284cc2a596bce1854c37c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:43.716590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860c8c4-d00d-41dd-b9df-820f2d6c1547 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:43.716877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860c8c4-d00d-41dd-b9df-820f2d6c1547 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:43.717157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860c8c4-d00d-41dd-b9df-820f2d6c1547 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] PATH_INFO: `/v3/domains/07475a80cdcc4449af2b2f15c78cb379` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:43.723990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860c8c4-d00d-41dd-b9df-820f2d6c1547 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 21:36:43.734336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-f860c8c4-d00d-41dd-b9df-820f2d6c1547 tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Could not find domain: 07475a80cdcc4449af2b2f15c78cb379.: keystone.exception.DomainNotFound: Could not find domain: 07475a80cdcc4449af2b2f15c78cb379. Jul 16 21:36:43.734336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:43.734336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 16 21:36:43.734336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 16 21:36:43.734336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 21:36:43.734336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 21:36:43.734336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 21:36:43.734336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 21:36:43.734336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 07475a80cdcc4449af2b2f15c78cb379. Jul 16 21:36:43.734336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:36:43.734336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:36:43.734336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:36:43.734336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:36:43.734336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:36:43.734336 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:36:43.735578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:36:43.735578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:36:43.735578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:36:43.735578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:36:43.735578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:36:43.735578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:36:43.735578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:36:43.735578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:36:43.735578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 16 21:36:43.735578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 16 21:36:43.735578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 21:36:43.735578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 21:36:43.735578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 21:36:43.735578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 21:36:43.735578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:36:43.735578 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:36:43.736784 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:36:43.736784 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:36:43.736784 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:36:43.736784 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:36:43.736784 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:36:43.736784 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 21:36:43.736784 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:36:43.736784 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:36:43.736784 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:36:43.736784 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:36:43.736784 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:36:43.736784 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:36:43.736784 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:36:43.736784 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:36:43.736784 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 16 21:36:43.736784 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 21:36:43.736784 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 07475a80cdcc4449af2b2f15c78cb379. Jul 16 21:36:43.738225 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:36:43.738225 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3556/7039] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:36:43 2022] PATCH /identity/v3/domains/07475a80cdcc4449af2b2f15c78cb379 => generated 112 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:36:43.740492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:43.742141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:43.809181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5265c5e-a711-4a4f-8af7-51a5dc8685bd tempest-DomainsNegativeTestJSON-538734025 tempest-DomainsNegativeTestJSON-538734025-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:43.814619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62eb86c-cb9b-4b34-99e4-e1fafef9f489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:43.815679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62eb86c-cb9b-4b34-99e4-e1fafef9f489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:43.816084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62eb86c-cb9b-4b34-99e4-e1fafef9f489 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:43.816476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62eb86c-cb9b-4b34-99e4-e1fafef9f489 admin admin] PATH_INFO: `/v3/users/ae296228d6ca48519a531179af606f74` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:43.817839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62eb86c-cb9b-4b34-99e4-e1fafef9f489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae296228d6ca48519a531179af606f74)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:43.820604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62eb86c-cb9b-4b34-99e4-e1fafef9f489 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:44.090644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b62eb86c-cb9b-4b34-99e4-e1fafef9f489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae296228d6ca48519a531179af606f74'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:44.105106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b62eb86c-cb9b-4b34-99e4-e1fafef9f489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae296228d6ca48519a531179af606f74'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:44.207359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b62eb86c-cb9b-4b34-99e4-e1fafef9f489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae296228d6ca48519a531179af606f74'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:44.215613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b62eb86c-cb9b-4b34-99e4-e1fafef9f489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae296228d6ca48519a531179af606f74'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:44.216445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b62eb86c-cb9b-4b34-99e4-e1fafef9f489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae296228d6ca48519a531179af606f74'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:44.227863 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3484/7040] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:43 2022] DELETE /identity/v3/users/ae296228d6ca48519a531179af606f74 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:36:44.229703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cff9a8-b428-4ecb-9910-c14e55268029 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:44.230164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cff9a8-b428-4ecb-9910-c14e55268029 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:44.230305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cff9a8-b428-4ecb-9910-c14e55268029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:44.253488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-94cff9a8-b428-4ecb-9910-c14e55268029 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:44.256776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-94cff9a8-b428-4ecb-9910-c14e55268029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:44.343982 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3557/7041] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:44.356252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62eb86c-cb9b-4b34-99e4-e1fafef9f489 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:44.357715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b62eb86c-cb9b-4b34-99e4-e1fafef9f489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:44.430062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62eb86c-cb9b-4b34-99e4-e1fafef9f489 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:44.433697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e2acf-147c-4cf2-be96-2b865fbf2896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:44.434351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e2acf-147c-4cf2-be96-2b865fbf2896 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:44.434631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e2acf-147c-4cf2-be96-2b865fbf2896 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:44.435071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e2acf-147c-4cf2-be96-2b865fbf2896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:44.445136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e2acf-147c-4cf2-be96-2b865fbf2896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:44.449727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e2acf-147c-4cf2-be96-2b865fbf2896 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:44.465754 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3485/7042] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:36:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:36:44.791049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:44.906547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cff9a8-b428-4ecb-9910-c14e55268029 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:44.908000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-94cff9a8-b428-4ecb-9910-c14e55268029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:44.921154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cff9a8-b428-4ecb-9910-c14e55268029 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:44.939783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e16bc-4d27-41e6-afa3-5fa99f62718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:44.941095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e16bc-4d27-41e6-afa3-5fa99f62718e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:44.941616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e16bc-4d27-41e6-afa3-5fa99f62718e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:44.941959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e16bc-4d27-41e6-afa3-5fa99f62718e admin admin] PATH_INFO: `/v3/projects/d6173b4a2b13462d864768b0ed2dfb8d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:44.944606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e16bc-4d27-41e6-afa3-5fa99f62718e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6173b4a2b13462d864768b0ed2dfb8d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:44.949265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e16bc-4d27-41e6-afa3-5fa99f62718e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:45.141279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d9e16bc-4d27-41e6-afa3-5fa99f62718e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6173b4a2b13462d864768b0ed2dfb8d', 'request_id': 'req-3d9e16bc-4d27-41e6-afa3-5fa99f62718e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:45.158498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d9e16bc-4d27-41e6-afa3-5fa99f62718e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6173b4a2b13462d864768b0ed2dfb8d', 'request_id': 'req-3d9e16bc-4d27-41e6-afa3-5fa99f62718e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:45.170785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d9e16bc-4d27-41e6-afa3-5fa99f62718e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6173b4a2b13462d864768b0ed2dfb8d', 'request_id': 'req-3d9e16bc-4d27-41e6-afa3-5fa99f62718e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:45.268926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:45.301442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d9e16bc-4d27-41e6-afa3-5fa99f62718e admin admin] The token cache is being invalidate because project d6173b4a2b13462d864768b0ed2dfb8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:45.301989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d9e16bc-4d27-41e6-afa3-5fa99f62718e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:45.303139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d9e16bc-4d27-41e6-afa3-5fa99f62718e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:45.304796 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3558/7043] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:36:44 2022] DELETE /identity/v3/projects/d6173b4a2b13462d864768b0ed2dfb8d => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:45.309223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e2acf-147c-4cf2-be96-2b865fbf2896 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:45.320122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e2acf-147c-4cf2-be96-2b865fbf2896 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:45.358339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:45.533765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152162d8-5838-435c-8d51-289fbf6c309f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:45.534764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152162d8-5838-435c-8d51-289fbf6c309f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:45.535180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152162d8-5838-435c-8d51-289fbf6c309f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:45.535685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152162d8-5838-435c-8d51-289fbf6c309f admin admin] PATH_INFO: `/v3/users/eae803e14ac44785a83d7d62edefae7a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:45.537606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152162d8-5838-435c-8d51-289fbf6c309f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eae803e14ac44785a83d7d62edefae7a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:45.539650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152162d8-5838-435c-8d51-289fbf6c309f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:45.857744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-152162d8-5838-435c-8d51-289fbf6c309f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eae803e14ac44785a83d7d62edefae7a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:45.876862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-152162d8-5838-435c-8d51-289fbf6c309f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eae803e14ac44785a83d7d62edefae7a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:45.942604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-152162d8-5838-435c-8d51-289fbf6c309f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eae803e14ac44785a83d7d62edefae7a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:45.950604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-152162d8-5838-435c-8d51-289fbf6c309f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eae803e14ac44785a83d7d62edefae7a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:45.951295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-152162d8-5838-435c-8d51-289fbf6c309f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eae803e14ac44785a83d7d62edefae7a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:45.957376 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3486/7044] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:45 2022] DELETE /identity/v3/users/eae803e14ac44785a83d7d62edefae7a => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:46.048018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e16bc-4d27-41e6-afa3-5fa99f62718e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:46.049466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3d9e16bc-4d27-41e6-afa3-5fa99f62718e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:46.165752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e16bc-4d27-41e6-afa3-5fa99f62718e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:46.248053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b07840-0f02-4021-9f70-5de91bc3efba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:46.248719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b07840-0f02-4021-9f70-5de91bc3efba service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:46.249002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b07840-0f02-4021-9f70-5de91bc3efba service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:46.249269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b07840-0f02-4021-9f70-5de91bc3efba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:46.251280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-70b07840-0f02-4021-9f70-5de91bc3efba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:46.268401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b07840-0f02-4021-9f70-5de91bc3efba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:46.270394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b07840-0f02-4021-9f70-5de91bc3efba service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:46.302650 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3559/7045] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:36:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:36:46.640445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152162d8-5838-435c-8d51-289fbf6c309f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:46.642949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-152162d8-5838-435c-8d51-289fbf6c309f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:46.718332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152162d8-5838-435c-8d51-289fbf6c309f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:46.723023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280a0a0-ed5b-4db1-af69-f7dd34f483f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:46.723885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280a0a0-ed5b-4db1-af69-f7dd34f483f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:46.724878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280a0a0-ed5b-4db1-af69-f7dd34f483f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:46.725132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280a0a0-ed5b-4db1-af69-f7dd34f483f0 admin admin] PATH_INFO: `/v3/projects/b40c909d06284cc2a596bce1854c37c7` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:46.729972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280a0a0-ed5b-4db1-af69-f7dd34f483f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b40c909d06284cc2a596bce1854c37c7)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:46.729972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280a0a0-ed5b-4db1-af69-f7dd34f483f0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:46.892726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1280a0a0-ed5b-4db1-af69-f7dd34f483f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b40c909d06284cc2a596bce1854c37c7', 'request_id': 'req-1280a0a0-ed5b-4db1-af69-f7dd34f483f0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:46.898691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1280a0a0-ed5b-4db1-af69-f7dd34f483f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b40c909d06284cc2a596bce1854c37c7', 'request_id': 'req-1280a0a0-ed5b-4db1-af69-f7dd34f483f0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:46.905083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1280a0a0-ed5b-4db1-af69-f7dd34f483f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b40c909d06284cc2a596bce1854c37c7', 'request_id': 'req-1280a0a0-ed5b-4db1-af69-f7dd34f483f0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:46.981287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:47.032050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1280a0a0-ed5b-4db1-af69-f7dd34f483f0 admin admin] The token cache is being invalidate because project b40c909d06284cc2a596bce1854c37c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:47.032469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1280a0a0-ed5b-4db1-af69-f7dd34f483f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:47.033122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-1280a0a0-ed5b-4db1-af69-f7dd34f483f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:47.034730 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3487/7046] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:36:46 2022] DELETE /identity/v3/projects/b40c909d06284cc2a596bce1854c37c7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:47.040805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b103e5-951b-4b09-a190-2424e77d14c5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:47.041099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b103e5-951b-4b09-a190-2424e77d14c5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:47.041409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b103e5-951b-4b09-a190-2424e77d14c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:47.060574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-78b103e5-951b-4b09-a190-2424e77d14c5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:47.061778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-78b103e5-951b-4b09-a190-2424e77d14c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:47.120666 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3560/7047] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:47.128455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be13c9-81da-4d04-9c81-5635db11ef57 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:47.128762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be13c9-81da-4d04-9c81-5635db11ef57 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:47.129022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be13c9-81da-4d04-9c81-5635db11ef57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:47.135454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:47.148002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e2be13c9-81da-4d04-9c81-5635db11ef57 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:47.149218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e2be13c9-81da-4d04-9c81-5635db11ef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:47.158081 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3488/7048] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:47.163190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b103e5-951b-4b09-a190-2424e77d14c5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:47.173211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b103e5-951b-4b09-a190-2424e77d14c5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:47.178661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a295d-7474-4208-aecb-069579be13db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:47.179361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a295d-7474-4208-aecb-069579be13db admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:47.179647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a295d-7474-4208-aecb-069579be13db admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:47.179923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a295d-7474-4208-aecb-069579be13db admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:47.180647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a295d-7474-4208-aecb-069579be13db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:36:47.180954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a295d-7474-4208-aecb-069579be13db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:47.182635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a295d-7474-4208-aecb-069579be13db admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:47.194312 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3561/7049] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:36:47.198930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be13c9-81da-4d04-9c81-5635db11ef57 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:47.209025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be13c9-81da-4d04-9c81-5635db11ef57 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:47.214010 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78adf8-32ee-4c47-878d-49b7645b5fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:47.214658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78adf8-32ee-4c47-878d-49b7645b5fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:47.214941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78adf8-32ee-4c47-878d-49b7645b5fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:47.215265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78adf8-32ee-4c47-878d-49b7645b5fb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:47.215941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78adf8-32ee-4c47-878d-49b7645b5fb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:47.217908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78adf8-32ee-4c47-878d-49b7645b5fb4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:47.309001 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3489/7050] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:36:47 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:47.313213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a295d-7474-4208-aecb-069579be13db admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:47.323646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a295d-7474-4208-aecb-069579be13db admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:47.385203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a08c3-a092-4016-bdbf-43b1098cfe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:47.385781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a08c3-a092-4016-bdbf-43b1098cfe5a admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:47.386065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a08c3-a092-4016-bdbf-43b1098cfe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:47.386347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a08c3-a092-4016-bdbf-43b1098cfe5a admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:47.387040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a08c3-a092-4016-bdbf-43b1098cfe5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:47.388966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a08c3-a092-4016-bdbf-43b1098cfe5a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:47.522200 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3562/7051] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:36:47 2022] POST /identity/v3/users => generated 285 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:47.526378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78adf8-32ee-4c47-878d-49b7645b5fb4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:47.537228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78adf8-32ee-4c47-878d-49b7645b5fb4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:47.542234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92a2f1-2a8d-40b0-a877-06a9e985ef88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:47.544666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92a2f1-2a8d-40b0-a877-06a9e985ef88 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:47.544666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92a2f1-2a8d-40b0-a877-06a9e985ef88 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:47.544666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92a2f1-2a8d-40b0-a877-06a9e985ef88 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:47.544666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92a2f1-2a8d-40b0-a877-06a9e985ef88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:47.550109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92a2f1-2a8d-40b0-a877-06a9e985ef88 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:47.562426 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3490/7052] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:36:47.564719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a08c3-a092-4016-bdbf-43b1098cfe5a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:47.576329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a08c3-a092-4016-bdbf-43b1098cfe5a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:47.582345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431be1c9-1ffe-4173-a43a-d7b90620d101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:47.583155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431be1c9-1ffe-4173-a43a-d7b90620d101 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:47.583692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431be1c9-1ffe-4173-a43a-d7b90620d101 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:47.584337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431be1c9-1ffe-4173-a43a-d7b90620d101 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:47.585227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431be1c9-1ffe-4173-a43a-d7b90620d101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:47.587088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431be1c9-1ffe-4173-a43a-d7b90620d101 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:47.604518 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3563/7053] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:36:47.608844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92a2f1-2a8d-40b0-a877-06a9e985ef88 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:47.620346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92a2f1-2a8d-40b0-a877-06a9e985ef88 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:47.626737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2c89d-9923-492e-a5ea-29901f1a864d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:47.627802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2c89d-9923-492e-a5ea-29901f1a864d admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:47.628330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2c89d-9923-492e-a5ea-29901f1a864d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:47.628745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2c89d-9923-492e-a5ea-29901f1a864d admin admin] PATH_INFO: `/v3/projects/4212bc2a7e494090b096a7150b1bd7d1/users/878df121f92d4de0bfea3f6628f4eaf1/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:47.648253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2c89d-9923-492e-a5ea-29901f1a864d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4212bc2a7e494090b096a7150b1bd7d1, user_id=878df121f92d4de0bfea3f6628f4eaf1, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:47.651232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2c89d-9923-492e-a5ea-29901f1a864d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:47.763084 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3491/7054] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:36:47 2022] PUT /identity/v3/projects/4212bc2a7e494090b096a7150b1bd7d1/users/878df121f92d4de0bfea3f6628f4eaf1/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:47.769268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc249696-e6ed-431a-b546-fdcbf3f01528 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:47.769602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc249696-e6ed-431a-b546-fdcbf3f01528 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:47.769909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc249696-e6ed-431a-b546-fdcbf3f01528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:47.799743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-dc249696-e6ed-431a-b546-fdcbf3f01528 None None] MFA Rules not processed for user `878df121f92d4de0bfea3f6628f4eaf1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:47.801106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dc249696-e6ed-431a-b546-fdcbf3f01528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:47.897344 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3564/7055] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:47.906202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2c89d-9923-492e-a5ea-29901f1a864d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:47.983646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2c89d-9923-492e-a5ea-29901f1a864d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:47.989498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57faa8b4-897b-4020-a0c1-845d0445fa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:47.990601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faa8b4-897b-4020-a0c1-845d0445fa14 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:47.991440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faa8b4-897b-4020-a0c1-845d0445fa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:47.991440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faa8b4-897b-4020-a0c1-845d0445fa14 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:47.992299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57faa8b4-897b-4020-a0c1-845d0445fa14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:47.995136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57faa8b4-897b-4020-a0c1-845d0445fa14 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:48.004590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:48.118164 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3492/7056] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:36:47 2022] POST /identity/v3/projects => generated 373 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:48.122471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:48.123728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc249696-e6ed-431a-b546-fdcbf3f01528 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:48.136119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc249696-e6ed-431a-b546-fdcbf3f01528 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:48.195688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bfd6e-9915-4e34-b2f4-9a1f8611c16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:48.196384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bfd6e-9915-4e34-b2f4-9a1f8611c16d admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:48.197662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bfd6e-9915-4e34-b2f4-9a1f8611c16d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:48.197947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bfd6e-9915-4e34-b2f4-9a1f8611c16d admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:48.198667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576bfd6e-9915-4e34-b2f4-9a1f8611c16d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:48.200633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576bfd6e-9915-4e34-b2f4-9a1f8611c16d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:48.282076 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3565/7057] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:36:48 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:48.283377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57faa8b4-897b-4020-a0c1-845d0445fa14 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:48.295428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57faa8b4-897b-4020-a0c1-845d0445fa14 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:48.310161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b1eca-8c3e-4e02-beb1-10436b69c99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:48.310876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b1eca-8c3e-4e02-beb1-10436b69c99c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:48.311198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b1eca-8c3e-4e02-beb1-10436b69c99c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:48.311478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b1eca-8c3e-4e02-beb1-10436b69c99c admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:48.312236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b1eca-8c3e-4e02-beb1-10436b69c99c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:48.313881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b1eca-8c3e-4e02-beb1-10436b69c99c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:48.326011 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3493/7058] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:36:48.330129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bfd6e-9915-4e34-b2f4-9a1f8611c16d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:48.341970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bfd6e-9915-4e34-b2f4-9a1f8611c16d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:48.346877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea30998-0af9-4d97-84a3-bcb83acd7b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:48.348297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea30998-0af9-4d97-84a3-bcb83acd7b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:48.348585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea30998-0af9-4d97-84a3-bcb83acd7b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:48.348862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea30998-0af9-4d97-84a3-bcb83acd7b8a admin admin] PATH_INFO: `/v3/projects/aee0788a6dbb4ae3af92276367dda5eb/users/e5a7f3b5c24540238fce2e220d5a1dae/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:48.364429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea30998-0af9-4d97-84a3-bcb83acd7b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee0788a6dbb4ae3af92276367dda5eb, user_id=e5a7f3b5c24540238fce2e220d5a1dae, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:48.367261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea30998-0af9-4d97-84a3-bcb83acd7b8a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:48.485068 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3566/7059] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:36:48 2022] PUT /identity/v3/projects/aee0788a6dbb4ae3af92276367dda5eb/users/e5a7f3b5c24540238fce2e220d5a1dae/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:48.489065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b1eca-8c3e-4e02-beb1-10436b69c99c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:48.500468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b1eca-8c3e-4e02-beb1-10436b69c99c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:48.560094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df290297-6be3-4455-9bdb-f101a1f981ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:48.560773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df290297-6be3-4455-9bdb-f101a1f981ba admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:48.561060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df290297-6be3-4455-9bdb-f101a1f981ba admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:48.561339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df290297-6be3-4455-9bdb-f101a1f981ba admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:48.562177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df290297-6be3-4455-9bdb-f101a1f981ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:48.563778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df290297-6be3-4455-9bdb-f101a1f981ba admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:48.574782 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3494/7060] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:36:48.578923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea30998-0af9-4d97-84a3-bcb83acd7b8a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:48.590372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea30998-0af9-4d97-84a3-bcb83acd7b8a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:48.595066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73245c-f586-4bb0-9652-144636ed3f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:48.595940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73245c-f586-4bb0-9652-144636ed3f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:48.596220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73245c-f586-4bb0-9652-144636ed3f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:48.596518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73245c-f586-4bb0-9652-144636ed3f96 admin admin] PATH_INFO: `/v3/projects/aee0788a6dbb4ae3af92276367dda5eb/users/e5a7f3b5c24540238fce2e220d5a1dae/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:48.600187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73245c-f586-4bb0-9652-144636ed3f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee0788a6dbb4ae3af92276367dda5eb, user_id=e5a7f3b5c24540238fce2e220d5a1dae, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:48.602831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73245c-f586-4bb0-9652-144636ed3f96 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:48.614408 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3567/7061] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:36:48 2022] PUT /identity/v3/projects/aee0788a6dbb4ae3af92276367dda5eb/users/e5a7f3b5c24540238fce2e220d5a1dae/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:48.626033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd69c8d-f441-47c2-abb8-19d20ab6d855 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:48.626326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd69c8d-f441-47c2-abb8-19d20ab6d855 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:48.626611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd69c8d-f441-47c2-abb8-19d20ab6d855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:48.654451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6cd69c8d-f441-47c2-abb8-19d20ab6d855 None None] MFA Rules not processed for user `e5a7f3b5c24540238fce2e220d5a1dae`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:48.655698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6cd69c8d-f441-47c2-abb8-19d20ab6d855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:48.725574 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3495/7062] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:48.730096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73245c-f586-4bb0-9652-144636ed3f96 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:48.742864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73245c-f586-4bb0-9652-144636ed3f96 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:48.748057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d30b5-5710-4be8-b291-5a2ffd64fb3a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:48.748719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d30b5-5710-4be8-b291-5a2ffd64fb3a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:48.749000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d30b5-5710-4be8-b291-5a2ffd64fb3a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:48.749279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d30b5-5710-4be8-b291-5a2ffd64fb3a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:48.750017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d30b5-5710-4be8-b291-5a2ffd64fb3a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:48.751686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d30b5-5710-4be8-b291-5a2ffd64fb3a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:48.837923 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3568/7063] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:36:48 2022] POST /identity/v3/domains => generated 277 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:48.839158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd69c8d-f441-47c2-abb8-19d20ab6d855 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:48.849465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd69c8d-f441-47c2-abb8-19d20ab6d855 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:48.913529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c25b2-df43-4369-bb37-5c6ad4f0f11b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:48.914192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c25b2-df43-4369-bb37-5c6ad4f0f11b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:48.914478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c25b2-df43-4369-bb37-5c6ad4f0f11b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:48.914773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c25b2-df43-4369-bb37-5c6ad4f0f11b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:48.915522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c25b2-df43-4369-bb37-5c6ad4f0f11b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:48.917460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c25b2-df43-4369-bb37-5c6ad4f0f11b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:48.984857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:49.038220 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3496/7064] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:36:48 2022] POST /identity/v3/projects => generated 403 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:49.042148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d30b5-5710-4be8-b291-5a2ffd64fb3a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:49.053305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d30b5-5710-4be8-b291-5a2ffd64fb3a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:49.115726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd07cb0-9a97-48c6-8a1e-7e92a28de45f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:49.116395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd07cb0-9a97-48c6-8a1e-7e92a28de45f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:49.116681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd07cb0-9a97-48c6-8a1e-7e92a28de45f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:49.116961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd07cb0-9a97-48c6-8a1e-7e92a28de45f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/groups` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:49.117642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd07cb0-9a97-48c6-8a1e-7e92a28de45f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:49.119574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd07cb0-9a97-48c6-8a1e-7e92a28de45f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:49.192390 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3569/7065] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Jul 16 21:36:49 2022] POST /identity/v3/groups => generated 301 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:49.196779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c25b2-df43-4369-bb37-5c6ad4f0f11b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:49.207362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c25b2-df43-4369-bb37-5c6ad4f0f11b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:49.212652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa90137-43c8-4988-a279-2a01d5bf3eb1 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:49.213321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa90137-43c8-4988-a279-2a01d5bf3eb1 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:49.213609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa90137-43c8-4988-a279-2a01d5bf3eb1 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:49.213893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa90137-43c8-4988-a279-2a01d5bf3eb1 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:49.214641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa90137-43c8-4988-a279-2a01d5bf3eb1 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:49.216613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa90137-43c8-4988-a279-2a01d5bf3eb1 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:49.311487 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3497/7066] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:36:49 2022] POST /identity/v3/users => generated 445 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:49.316262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd07cb0-9a97-48c6-8a1e-7e92a28de45f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:49.326904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd07cb0-9a97-48c6-8a1e-7e92a28de45f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:49.331472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcda2d-85b5-47e2-aef9-72ca6cddfc54 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:49.333444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcda2d-85b5-47e2-aef9-72ca6cddfc54 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:49.333850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcda2d-85b5-47e2-aef9-72ca6cddfc54 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:49.334216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcda2d-85b5-47e2-aef9-72ca6cddfc54 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:49.334944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dcda2d-85b5-47e2-aef9-72ca6cddfc54 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:49.336613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dcda2d-85b5-47e2-aef9-72ca6cddfc54 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:49.444554 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3570/7067] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:36:49 2022] POST /identity/v3/roles => generated 240 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:36:49.449088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa90137-43c8-4988-a279-2a01d5bf3eb1 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:49.460459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa90137-43c8-4988-a279-2a01d5bf3eb1 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:49.465127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a069bf8-e350-4074-af83-5b4a4ad491f8 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:49.465963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a069bf8-e350-4074-af83-5b4a4ad491f8 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:49.466238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a069bf8-e350-4074-af83-5b4a4ad491f8 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:49.466519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a069bf8-e350-4074-af83-5b4a4ad491f8 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f8527b1823704a9da7ba970b33ba7dce/groups/92d9683ee8b14c039979bd552f45abd0/roles/c42f51fa481e4366b484720ec21a5245/inherited_to_projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:49.472582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a069bf8-e350-4074-af83-5b4a4ad491f8 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f8527b1823704a9da7ba970b33ba7dce, group_id=92d9683ee8b14c039979bd552f45abd0, role_id=c42f51fa481e4366b484720ec21a5245)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:49.475936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a069bf8-e350-4074-af83-5b4a4ad491f8 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:49.568787 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3498/7068] 10.222.0.16 () {60 vars in 1584 bytes} [Sat Jul 16 21:36:49 2022] PUT /identity/v3/OS-INHERIT/projects/f8527b1823704a9da7ba970b33ba7dce/groups/92d9683ee8b14c039979bd552f45abd0/roles/c42f51fa481e4366b484720ec21a5245/inherited_to_projects => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:49.573005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcda2d-85b5-47e2-aef9-72ca6cddfc54 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:49.583109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcda2d-85b5-47e2-aef9-72ca6cddfc54 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:49.641217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30fb7f-9c03-45c9-8206-e8bfebe42018 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:49.642106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30fb7f-9c03-45c9-8206-e8bfebe42018 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `HEAD` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:49.642416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30fb7f-9c03-45c9-8206-e8bfebe42018 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:49.642698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30fb7f-9c03-45c9-8206-e8bfebe42018 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f8527b1823704a9da7ba970b33ba7dce/groups/92d9683ee8b14c039979bd552f45abd0/roles/c42f51fa481e4366b484720ec21a5245/inherited_to_projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:49.645018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30fb7f-9c03-45c9-8206-e8bfebe42018 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:check_grant(project_id=f8527b1823704a9da7ba970b33ba7dce, group_id=92d9683ee8b14c039979bd552f45abd0, role_id=c42f51fa481e4366b484720ec21a5245)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:49.648291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30fb7f-9c03-45c9-8206-e8bfebe42018 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:49.655151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:49.657618 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3571/7069] 10.222.0.16 () {58 vars in 1566 bytes} [Sat Jul 16 21:36:49 2022] HEAD /identity/v3/OS-INHERIT/projects/f8527b1823704a9da7ba970b33ba7dce/groups/92d9683ee8b14c039979bd552f45abd0/roles/c42f51fa481e4366b484720ec21a5245/inherited_to_projects => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:49.662943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a069bf8-e350-4074-af83-5b4a4ad491f8 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:49.673201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a069bf8-e350-4074-af83-5b4a4ad491f8 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:49.678142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed31b7-0156-4756-a697-be7ddc98ca3e tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:49.678990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed31b7-0156-4756-a697-be7ddc98ca3e tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:49.680623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed31b7-0156-4756-a697-be7ddc98ca3e tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:49.680623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed31b7-0156-4756-a697-be7ddc98ca3e tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f8527b1823704a9da7ba970b33ba7dce/groups/92d9683ee8b14c039979bd552f45abd0/roles/c42f51fa481e4366b484720ec21a5245/inherited_to_projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:49.681822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed31b7-0156-4756-a697-be7ddc98ca3e tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=f8527b1823704a9da7ba970b33ba7dce, group_id=92d9683ee8b14c039979bd552f45abd0, role_id=c42f51fa481e4366b484720ec21a5245)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:49.684570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed31b7-0156-4756-a697-be7ddc98ca3e tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:49.690842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-feed31b7-0156-4756-a697-be7ddc98ca3e tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invalidating the token cache because role c42f51fa481e4366b484720ec21a5245 was removed from group 92d9683ee8b14c039979bd552f45abd0 on project f8527b1823704a9da7ba970b33ba7dce. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:49.691158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-feed31b7-0156-4756-a697-be7ddc98ca3e tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:49.691849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-feed31b7-0156-4756-a697-be7ddc98ca3e tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:49.758400 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3499/7070] 10.222.0.16 () {58 vars in 1568 bytes} [Sat Jul 16 21:36:49 2022] DELETE /identity/v3/OS-INHERIT/projects/f8527b1823704a9da7ba970b33ba7dce/groups/92d9683ee8b14c039979bd552f45abd0/roles/c42f51fa481e4366b484720ec21a5245/inherited_to_projects => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:36:49.762668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30fb7f-9c03-45c9-8206-e8bfebe42018 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:49.764602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-de30fb7f-9c03-45c9-8206-e8bfebe42018 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:49.777899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30fb7f-9c03-45c9-8206-e8bfebe42018 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:49.843629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da603e-eaed-4b79-b465-210523244be7 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:49.844487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da603e-eaed-4b79-b465-210523244be7 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:49.844774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da603e-eaed-4b79-b465-210523244be7 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:49.845051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da603e-eaed-4b79-b465-210523244be7 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/roles/c42f51fa481e4366b484720ec21a5245` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:49.846579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da603e-eaed-4b79-b465-210523244be7 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c42f51fa481e4366b484720ec21a5245)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:49.848601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da603e-eaed-4b79-b465-210523244be7 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:49.923175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:49.992828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-85da603e-eaed-4b79-b465-210523244be7 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invalidating the token cache because role c42f51fa481e4366b484720ec21a5245 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:49.993104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-85da603e-eaed-4b79-b465-210523244be7 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:49.993820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-85da603e-eaed-4b79-b465-210523244be7 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:49.996246 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3572/7071] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:49 2022] DELETE /identity/v3/roles/c42f51fa481e4366b484720ec21a5245 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:50.001364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed31b7-0156-4756-a697-be7ddc98ca3e tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:50.015718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed31b7-0156-4756-a697-be7ddc98ca3e tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:50.087085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04fa00-fc14-4a94-a7b2-d95760d6267a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:50.088203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04fa00-fc14-4a94-a7b2-d95760d6267a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:50.088452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04fa00-fc14-4a94-a7b2-d95760d6267a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:50.088735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04fa00-fc14-4a94-a7b2-d95760d6267a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:50.089671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04fa00-fc14-4a94-a7b2-d95760d6267a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:50.092103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04fa00-fc14-4a94-a7b2-d95760d6267a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:50.233733 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3500/7072] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:36:50 2022] POST /identity/v3/roles => generated 239 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:50.237965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da603e-eaed-4b79-b465-210523244be7 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:50.239412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-85da603e-eaed-4b79-b465-210523244be7 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:50.254368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da603e-eaed-4b79-b465-210523244be7 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:50.260304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14dc44-11d7-44f7-a5d9-36e9a0550cf7 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:50.261306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14dc44-11d7-44f7-a5d9-36e9a0550cf7 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:50.261625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14dc44-11d7-44f7-a5d9-36e9a0550cf7 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:50.261972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14dc44-11d7-44f7-a5d9-36e9a0550cf7 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f8527b1823704a9da7ba970b33ba7dce/users/09b34b305c4c4ada9d3fb396663f57aa/roles/9b1162f701744a0eae91c57db371b8cc/inherited_to_projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:50.279593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14dc44-11d7-44f7-a5d9-36e9a0550cf7 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f8527b1823704a9da7ba970b33ba7dce, user_id=09b34b305c4c4ada9d3fb396663f57aa, role_id=9b1162f701744a0eae91c57db371b8cc)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:50.282276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14dc44-11d7-44f7-a5d9-36e9a0550cf7 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:50.380230 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3573/7073] 10.222.0.16 () {60 vars in 1581 bytes} [Sat Jul 16 21:36:50 2022] PUT /identity/v3/OS-INHERIT/projects/f8527b1823704a9da7ba970b33ba7dce/users/09b34b305c4c4ada9d3fb396663f57aa/roles/9b1162f701744a0eae91c57db371b8cc/inherited_to_projects => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:50.384438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04fa00-fc14-4a94-a7b2-d95760d6267a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:50.394480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04fa00-fc14-4a94-a7b2-d95760d6267a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:50.453570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2c4b2-c704-46a4-88a5-4cbb0809b176 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:50.454405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2c4b2-c704-46a4-88a5-4cbb0809b176 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `HEAD` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:50.454690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2c4b2-c704-46a4-88a5-4cbb0809b176 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:50.454972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2c4b2-c704-46a4-88a5-4cbb0809b176 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f8527b1823704a9da7ba970b33ba7dce/users/09b34b305c4c4ada9d3fb396663f57aa/roles/9b1162f701744a0eae91c57db371b8cc/inherited_to_projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:50.457292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2c4b2-c704-46a4-88a5-4cbb0809b176 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:check_grant(project_id=f8527b1823704a9da7ba970b33ba7dce, user_id=09b34b305c4c4ada9d3fb396663f57aa, role_id=9b1162f701744a0eae91c57db371b8cc)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:50.460558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2c4b2-c704-46a4-88a5-4cbb0809b176 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:50.466260 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3501/7074] 10.222.0.16 () {58 vars in 1563 bytes} [Sat Jul 16 21:36:50 2022] HEAD /identity/v3/OS-INHERIT/projects/f8527b1823704a9da7ba970b33ba7dce/users/09b34b305c4c4ada9d3fb396663f57aa/roles/9b1162f701744a0eae91c57db371b8cc/inherited_to_projects => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:50.470440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14dc44-11d7-44f7-a5d9-36e9a0550cf7 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:50.481828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14dc44-11d7-44f7-a5d9-36e9a0550cf7 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:50.486400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d61e7-7b17-4531-97ba-6b445b97abd0 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:50.487249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d61e7-7b17-4531-97ba-6b445b97abd0 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:50.487530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d61e7-7b17-4531-97ba-6b445b97abd0 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:50.487803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d61e7-7b17-4531-97ba-6b445b97abd0 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f8527b1823704a9da7ba970b33ba7dce/users/09b34b305c4c4ada9d3fb396663f57aa/roles/9b1162f701744a0eae91c57db371b8cc/inherited_to_projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:50.490043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d61e7-7b17-4531-97ba-6b445b97abd0 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=f8527b1823704a9da7ba970b33ba7dce, user_id=09b34b305c4c4ada9d3fb396663f57aa, role_id=9b1162f701744a0eae91c57db371b8cc)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:50.493872 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d61e7-7b17-4531-97ba-6b445b97abd0 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:50.499833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a97d61e7-7b17-4531-97ba-6b445b97abd0 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invalidating the token cache because role 9b1162f701744a0eae91c57db371b8cc was removed from user 09b34b305c4c4ada9d3fb396663f57aa on project f8527b1823704a9da7ba970b33ba7dce. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:50.500122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a97d61e7-7b17-4531-97ba-6b445b97abd0 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:50.500869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a97d61e7-7b17-4531-97ba-6b445b97abd0 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:50.608098 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3574/7075] 10.222.0.16 () {58 vars in 1565 bytes} [Sat Jul 16 21:36:50 2022] DELETE /identity/v3/OS-INHERIT/projects/f8527b1823704a9da7ba970b33ba7dce/users/09b34b305c4c4ada9d3fb396663f57aa/roles/9b1162f701744a0eae91c57db371b8cc/inherited_to_projects => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:50.612353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2c4b2-c704-46a4-88a5-4cbb0809b176 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:50.614108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a3b2c4b2-c704-46a4-88a5-4cbb0809b176 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:50.627295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2c4b2-c704-46a4-88a5-4cbb0809b176 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:50.683954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f085d-76f7-4014-82c0-f08b2e11e940 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:50.684826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f085d-76f7-4014-82c0-f08b2e11e940 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:50.685117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f085d-76f7-4014-82c0-f08b2e11e940 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:50.685398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f085d-76f7-4014-82c0-f08b2e11e940 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/roles/9b1162f701744a0eae91c57db371b8cc` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:50.686909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f085d-76f7-4014-82c0-f08b2e11e940 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9b1162f701744a0eae91c57db371b8cc)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:50.688668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f085d-76f7-4014-82c0-f08b2e11e940 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:50.791902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-165f085d-76f7-4014-82c0-f08b2e11e940 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invalidating the token cache because role 9b1162f701744a0eae91c57db371b8cc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:50.792194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-165f085d-76f7-4014-82c0-f08b2e11e940 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:50.792907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-165f085d-76f7-4014-82c0-f08b2e11e940 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:50.794855 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3502/7076] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:50 2022] DELETE /identity/v3/roles/9b1162f701744a0eae91c57db371b8cc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:50.800027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d61e7-7b17-4531-97ba-6b445b97abd0 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:50.810358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d61e7-7b17-4531-97ba-6b445b97abd0 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:50.885427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c690db-9c20-46fe-b66f-bf4ee993301f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:50.886568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c690db-9c20-46fe-b66f-bf4ee993301f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:50.887113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c690db-9c20-46fe-b66f-bf4ee993301f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:50.887609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c690db-9c20-46fe-b66f-bf4ee993301f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:50.889144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c690db-9c20-46fe-b66f-bf4ee993301f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:50.891731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c690db-9c20-46fe-b66f-bf4ee993301f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:51.011489 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3575/7077] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:36:50 2022] POST /identity/v3/roles => generated 240 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:51.024767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f085d-76f7-4014-82c0-f08b2e11e940 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:51.026558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-165f085d-76f7-4014-82c0-f08b2e11e940 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:51.039685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f085d-76f7-4014-82c0-f08b2e11e940 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:51.045766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd21dc2-7f26-4f75-916c-d9e26b8b9c80 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:51.046647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd21dc2-7f26-4f75-916c-d9e26b8b9c80 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:51.046937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd21dc2-7f26-4f75-916c-d9e26b8b9c80 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:51.047271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd21dc2-7f26-4f75-916c-d9e26b8b9c80 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/16f731aceef146eba1d4491450fb2cd7/groups/92d9683ee8b14c039979bd552f45abd0/roles/bdd5b924584949a78a1ef282d6bdc9e5/inherited_to_projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:51.049618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd21dc2-7f26-4f75-916c-d9e26b8b9c80 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=16f731aceef146eba1d4491450fb2cd7, group_id=92d9683ee8b14c039979bd552f45abd0, role_id=bdd5b924584949a78a1ef282d6bdc9e5)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:51.052914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd21dc2-7f26-4f75-916c-d9e26b8b9c80 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:51.133865 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3503/7078] 10.222.0.16 () {60 vars in 1581 bytes} [Sat Jul 16 21:36:51 2022] PUT /identity/v3/OS-INHERIT/domains/16f731aceef146eba1d4491450fb2cd7/groups/92d9683ee8b14c039979bd552f45abd0/roles/bdd5b924584949a78a1ef282d6bdc9e5/inherited_to_projects => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:51.138290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c690db-9c20-46fe-b66f-bf4ee993301f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:51.149418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c690db-9c20-46fe-b66f-bf4ee993301f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:51.212257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0482f-141a-4d33-aab6-7c32f40572f2 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:51.213216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0482f-141a-4d33-aab6-7c32f40572f2 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:51.213508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0482f-141a-4d33-aab6-7c32f40572f2 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:51.213780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0482f-141a-4d33-aab6-7c32f40572f2 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/16f731aceef146eba1d4491450fb2cd7/groups/92d9683ee8b14c039979bd552f45abd0/roles/inherited_to_projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:51.215625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0482f-141a-4d33-aab6-7c32f40572f2 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=16f731aceef146eba1d4491450fb2cd7, group_id=92d9683ee8b14c039979bd552f45abd0)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:51.218495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0482f-141a-4d33-aab6-7c32f40572f2 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:51.241392 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3576/7079] 10.222.0.16 () {58 vars in 1463 bytes} [Sat Jul 16 21:36:51 2022] GET /identity/v3/OS-INHERIT/domains/16f731aceef146eba1d4491450fb2cd7/groups/92d9683ee8b14c039979bd552f45abd0/roles/inherited_to_projects => generated 448 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:36:51.242301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd21dc2-7f26-4f75-916c-d9e26b8b9c80 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:51.253137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd21dc2-7f26-4f75-916c-d9e26b8b9c80 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:51.257978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980214ba-2733-48e7-a687-cbce35360438 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:51.259045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980214ba-2733-48e7-a687-cbce35360438 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `HEAD` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:51.259745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980214ba-2733-48e7-a687-cbce35360438 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:51.259745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980214ba-2733-48e7-a687-cbce35360438 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/16f731aceef146eba1d4491450fb2cd7/groups/92d9683ee8b14c039979bd552f45abd0/roles/bdd5b924584949a78a1ef282d6bdc9e5/inherited_to_projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:51.263601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:51.263733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980214ba-2733-48e7-a687-cbce35360438 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=16f731aceef146eba1d4491450fb2cd7, group_id=92d9683ee8b14c039979bd552f45abd0, role_id=bdd5b924584949a78a1ef282d6bdc9e5)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:51.264475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980214ba-2733-48e7-a687-cbce35360438 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:51.270681 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3504/7080] 10.222.0.16 () {58 vars in 1563 bytes} [Sat Jul 16 21:36:51 2022] HEAD /identity/v3/OS-INHERIT/domains/16f731aceef146eba1d4491450fb2cd7/groups/92d9683ee8b14c039979bd552f45abd0/roles/bdd5b924584949a78a1ef282d6bdc9e5/inherited_to_projects => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:51.275356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0482f-141a-4d33-aab6-7c32f40572f2 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:51.285260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0482f-141a-4d33-aab6-7c32f40572f2 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:51.290793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f53a02-f6b9-43d6-a7f3-454c053a331c tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:51.291656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f53a02-f6b9-43d6-a7f3-454c053a331c tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:51.291964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f53a02-f6b9-43d6-a7f3-454c053a331c tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:51.292242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f53a02-f6b9-43d6-a7f3-454c053a331c tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/16f731aceef146eba1d4491450fb2cd7/groups/92d9683ee8b14c039979bd552f45abd0/roles/bdd5b924584949a78a1ef282d6bdc9e5/inherited_to_projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:51.294542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f53a02-f6b9-43d6-a7f3-454c053a331c tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=16f731aceef146eba1d4491450fb2cd7, group_id=92d9683ee8b14c039979bd552f45abd0, role_id=bdd5b924584949a78a1ef282d6bdc9e5)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:51.297195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f53a02-f6b9-43d6-a7f3-454c053a331c tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:51.302309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-35f53a02-f6b9-43d6-a7f3-454c053a331c tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invalidating the token cache because role bdd5b924584949a78a1ef282d6bdc9e5 was removed from group 92d9683ee8b14c039979bd552f45abd0 on domain 16f731aceef146eba1d4491450fb2cd7. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:51.302832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-35f53a02-f6b9-43d6-a7f3-454c053a331c tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:51.303602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-35f53a02-f6b9-43d6-a7f3-454c053a331c tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:51.414337 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3577/7081] 10.222.0.16 () {58 vars in 1565 bytes} [Sat Jul 16 21:36:51 2022] DELETE /identity/v3/OS-INHERIT/domains/16f731aceef146eba1d4491450fb2cd7/groups/92d9683ee8b14c039979bd552f45abd0/roles/bdd5b924584949a78a1ef282d6bdc9e5/inherited_to_projects => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:51.418485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980214ba-2733-48e7-a687-cbce35360438 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:51.420286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-980214ba-2733-48e7-a687-cbce35360438 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:51.433583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980214ba-2733-48e7-a687-cbce35360438 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:51.524413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd7c12-d4b1-402d-a152-4fd6c3686d73 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:51.525555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd7c12-d4b1-402d-a152-4fd6c3686d73 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:51.526006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd7c12-d4b1-402d-a152-4fd6c3686d73 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:51.526435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd7c12-d4b1-402d-a152-4fd6c3686d73 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/roles/bdd5b924584949a78a1ef282d6bdc9e5` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:51.528545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd7c12-d4b1-402d-a152-4fd6c3686d73 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bdd5b924584949a78a1ef282d6bdc9e5)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:51.530332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd7c12-d4b1-402d-a152-4fd6c3686d73 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:51.575336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:51.638604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fecd7c12-d4b1-402d-a152-4fd6c3686d73 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invalidating the token cache because role bdd5b924584949a78a1ef282d6bdc9e5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:51.638994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fecd7c12-d4b1-402d-a152-4fd6c3686d73 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:51.639812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fecd7c12-d4b1-402d-a152-4fd6c3686d73 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:51.642172 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3505/7082] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:51 2022] DELETE /identity/v3/roles/bdd5b924584949a78a1ef282d6bdc9e5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:51.647908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f53a02-f6b9-43d6-a7f3-454c053a331c tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:51.658953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f53a02-f6b9-43d6-a7f3-454c053a331c tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:51.722001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7ace3-4c81-4932-b8a1-8967cf5bfb89 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:51.722965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7ace3-4c81-4932-b8a1-8967cf5bfb89 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:51.723288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7ace3-4c81-4932-b8a1-8967cf5bfb89 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:51.723572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7ace3-4c81-4932-b8a1-8967cf5bfb89 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:51.724365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7ace3-4c81-4932-b8a1-8967cf5bfb89 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:51.726050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7ace3-4c81-4932-b8a1-8967cf5bfb89 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:51.836000 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3578/7083] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:36:51 2022] POST /identity/v3/roles => generated 239 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:51.839989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd7c12-d4b1-402d-a152-4fd6c3686d73 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:51.841486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fecd7c12-d4b1-402d-a152-4fd6c3686d73 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:51.854633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd7c12-d4b1-402d-a152-4fd6c3686d73 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:51.859719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13540ea-4678-48f3-9c0f-3747dc24b4e2 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:51.860827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13540ea-4678-48f3-9c0f-3747dc24b4e2 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:51.860827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13540ea-4678-48f3-9c0f-3747dc24b4e2 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:51.861121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13540ea-4678-48f3-9c0f-3747dc24b4e2 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/16f731aceef146eba1d4491450fb2cd7/users/09b34b305c4c4ada9d3fb396663f57aa/roles/92944ea43a574b30ab44c0e68061d9f7/inherited_to_projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:51.863424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13540ea-4678-48f3-9c0f-3747dc24b4e2 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=16f731aceef146eba1d4491450fb2cd7, user_id=09b34b305c4c4ada9d3fb396663f57aa, role_id=92944ea43a574b30ab44c0e68061d9f7)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:51.866983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13540ea-4678-48f3-9c0f-3747dc24b4e2 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:51.946749 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3506/7084] 10.222.0.16 () {60 vars in 1578 bytes} [Sat Jul 16 21:36:51 2022] PUT /identity/v3/OS-INHERIT/domains/16f731aceef146eba1d4491450fb2cd7/users/09b34b305c4c4ada9d3fb396663f57aa/roles/92944ea43a574b30ab44c0e68061d9f7/inherited_to_projects => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:51.950957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7ace3-4c81-4932-b8a1-8967cf5bfb89 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:51.961193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7ace3-4c81-4932-b8a1-8967cf5bfb89 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:52.020942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b7ac0-1355-437c-86af-6fb2fc9b036b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:52.021944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b7ac0-1355-437c-86af-6fb2fc9b036b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:52.022271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b7ac0-1355-437c-86af-6fb2fc9b036b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:52.022553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b7ac0-1355-437c-86af-6fb2fc9b036b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/16f731aceef146eba1d4491450fb2cd7/users/09b34b305c4c4ada9d3fb396663f57aa/roles/inherited_to_projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:52.024338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b7ac0-1355-437c-86af-6fb2fc9b036b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=16f731aceef146eba1d4491450fb2cd7, user_id=09b34b305c4c4ada9d3fb396663f57aa)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:52.026897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b7ac0-1355-437c-86af-6fb2fc9b036b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:52.040864 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3579/7085] 10.222.0.16 () {58 vars in 1460 bytes} [Sat Jul 16 21:36:51 2022] GET /identity/v3/OS-INHERIT/domains/16f731aceef146eba1d4491450fb2cd7/users/09b34b305c4c4ada9d3fb396663f57aa/roles/inherited_to_projects => generated 446 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:36:52.043427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13540ea-4678-48f3-9c0f-3747dc24b4e2 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:52.064521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13540ea-4678-48f3-9c0f-3747dc24b4e2 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:52.064521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94536212-6e7a-48dc-a539-56eb8ef52335 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:52.064521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94536212-6e7a-48dc-a539-56eb8ef52335 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `HEAD` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:52.065284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94536212-6e7a-48dc-a539-56eb8ef52335 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:52.065284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94536212-6e7a-48dc-a539-56eb8ef52335 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/16f731aceef146eba1d4491450fb2cd7/users/09b34b305c4c4ada9d3fb396663f57aa/roles/92944ea43a574b30ab44c0e68061d9f7/inherited_to_projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:52.066202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94536212-6e7a-48dc-a539-56eb8ef52335 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=16f731aceef146eba1d4491450fb2cd7, user_id=09b34b305c4c4ada9d3fb396663f57aa, role_id=92944ea43a574b30ab44c0e68061d9f7)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:52.069747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94536212-6e7a-48dc-a539-56eb8ef52335 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:52.076193 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3507/7086] 10.222.0.16 () {58 vars in 1560 bytes} [Sat Jul 16 21:36:52 2022] HEAD /identity/v3/OS-INHERIT/domains/16f731aceef146eba1d4491450fb2cd7/users/09b34b305c4c4ada9d3fb396663f57aa/roles/92944ea43a574b30ab44c0e68061d9f7/inherited_to_projects => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:52.080579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b7ac0-1355-437c-86af-6fb2fc9b036b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:52.094858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b7ac0-1355-437c-86af-6fb2fc9b036b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:52.100365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19d169-8877-432c-81f3-8a670d97e889 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:52.101214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19d169-8877-432c-81f3-8a670d97e889 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:52.101495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19d169-8877-432c-81f3-8a670d97e889 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:52.101767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19d169-8877-432c-81f3-8a670d97e889 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/16f731aceef146eba1d4491450fb2cd7/users/09b34b305c4c4ada9d3fb396663f57aa/roles/92944ea43a574b30ab44c0e68061d9f7/inherited_to_projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:52.104054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19d169-8877-432c-81f3-8a670d97e889 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=16f731aceef146eba1d4491450fb2cd7, user_id=09b34b305c4c4ada9d3fb396663f57aa, role_id=92944ea43a574b30ab44c0e68061d9f7)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:52.107035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19d169-8877-432c-81f3-8a670d97e889 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:52.112461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2b19d169-8877-432c-81f3-8a670d97e889 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invalidating the token cache because role 92944ea43a574b30ab44c0e68061d9f7 was removed from user 09b34b305c4c4ada9d3fb396663f57aa on domain 16f731aceef146eba1d4491450fb2cd7. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:52.112757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2b19d169-8877-432c-81f3-8a670d97e889 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:52.113599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2b19d169-8877-432c-81f3-8a670d97e889 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:52.278878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:52.285336 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3580/7087] 10.222.0.16 () {58 vars in 1562 bytes} [Sat Jul 16 21:36:52 2022] DELETE /identity/v3/OS-INHERIT/domains/16f731aceef146eba1d4491450fb2cd7/users/09b34b305c4c4ada9d3fb396663f57aa/roles/92944ea43a574b30ab44c0e68061d9f7/inherited_to_projects => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:36:52.290383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94536212-6e7a-48dc-a539-56eb8ef52335 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:52.292325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-94536212-6e7a-48dc-a539-56eb8ef52335 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:52.306710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94536212-6e7a-48dc-a539-56eb8ef52335 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:52.367637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b2d27-538d-4f07-b2c4-74d45d490415 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:52.368514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b2d27-538d-4f07-b2c4-74d45d490415 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:52.368804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b2d27-538d-4f07-b2c4-74d45d490415 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:52.369081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b2d27-538d-4f07-b2c4-74d45d490415 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/roles/92944ea43a574b30ab44c0e68061d9f7` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:52.370602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b2d27-538d-4f07-b2c4-74d45d490415 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:delete_role(role_id=92944ea43a574b30ab44c0e68061d9f7)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:52.372255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b2d27-538d-4f07-b2c4-74d45d490415 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:52.494794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6b7b2d27-538d-4f07-b2c4-74d45d490415 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invalidating the token cache because role 92944ea43a574b30ab44c0e68061d9f7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:52.495126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6b7b2d27-538d-4f07-b2c4-74d45d490415 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:52.495796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6b7b2d27-538d-4f07-b2c4-74d45d490415 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:52.497682 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3508/7088] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:52 2022] DELETE /identity/v3/roles/92944ea43a574b30ab44c0e68061d9f7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:36:52.502826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19d169-8877-432c-81f3-8a670d97e889 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:52.523621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19d169-8877-432c-81f3-8a670d97e889 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:52.588461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac8ed6-9796-427a-8651-a5e489bdac3a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:52.589059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac8ed6-9796-427a-8651-a5e489bdac3a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:52.589343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac8ed6-9796-427a-8651-a5e489bdac3a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:52.589621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac8ed6-9796-427a-8651-a5e489bdac3a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:52.590365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac8ed6-9796-427a-8651-a5e489bdac3a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:52.592149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac8ed6-9796-427a-8651-a5e489bdac3a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:52.721414 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3581/7089] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:36:52 2022] POST /identity/v3/roles => generated 240 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:52.723109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b2d27-538d-4f07-b2c4-74d45d490415 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:52.725167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6b7b2d27-538d-4f07-b2c4-74d45d490415 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:52.747557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b2d27-538d-4f07-b2c4-74d45d490415 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:52.753365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fa692-730d-4d44-8f02-3c2983fb5fe5 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:52.754145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fa692-730d-4d44-8f02-3c2983fb5fe5 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:52.754417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fa692-730d-4d44-8f02-3c2983fb5fe5 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:52.754698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fa692-730d-4d44-8f02-3c2983fb5fe5 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:52.755483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fa692-730d-4d44-8f02-3c2983fb5fe5 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:52.757625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fa692-730d-4d44-8f02-3c2983fb5fe5 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:52.915551 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3509/7090] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:36:52 2022] POST /identity/v3/projects => generated 409 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:36:52.919957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac8ed6-9796-427a-8651-a5e489bdac3a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:52.930720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac8ed6-9796-427a-8651-a5e489bdac3a tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:52.991734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7670c-13d7-44de-8d5a-672d9119d1bb tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:52.992605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7670c-13d7-44de-8d5a-672d9119d1bb tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:52.992896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7670c-13d7-44de-8d5a-672d9119d1bb tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:52.993179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7670c-13d7-44de-8d5a-672d9119d1bb tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/16f731aceef146eba1d4491450fb2cd7/users/09b34b305c4c4ada9d3fb396663f57aa/roles/66b6dcc563bf4a4d9606a3f14219dc29/inherited_to_projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:52.995443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7670c-13d7-44de-8d5a-672d9119d1bb tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=16f731aceef146eba1d4491450fb2cd7, user_id=09b34b305c4c4ada9d3fb396663f57aa, role_id=66b6dcc563bf4a4d9606a3f14219dc29)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:52.998153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7670c-13d7-44de-8d5a-672d9119d1bb tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:53.137529 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3582/7091] 10.222.0.16 () {60 vars in 1578 bytes} [Sat Jul 16 21:36:52 2022] PUT /identity/v3/OS-INHERIT/domains/16f731aceef146eba1d4491450fb2cd7/users/09b34b305c4c4ada9d3fb396663f57aa/roles/66b6dcc563bf4a4d9606a3f14219dc29/inherited_to_projects => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:36:53.141895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fa692-730d-4d44-8f02-3c2983fb5fe5 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:53.152835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fa692-730d-4d44-8f02-3c2983fb5fe5 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:53.237447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4795d-50af-49a5-afe9-3ebab26f8068 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:53.238762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4795d-50af-49a5-afe9-3ebab26f8068 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:53.239341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4795d-50af-49a5-afe9-3ebab26f8068 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:53.239852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4795d-50af-49a5-afe9-3ebab26f8068 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:53.240964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4795d-50af-49a5-afe9-3ebab26f8068 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Adding query filter params (scope.project.id=f8527b1823704a9da7ba970b33ba7dce, user.id=09b34b305c4c4ada9d3fb396663f57aa) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:36:53.241515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4795d-50af-49a5-afe9-3ebab26f8068 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:53.244663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4795d-50af-49a5-afe9-3ebab26f8068 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:53.307581 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3510/7092] 10.222.0.16 () {58 vars in 1355 bytes} [Sat Jul 16 21:36:53 2022] GET /identity/v3/role_assignments?scope.project.id=f8527b1823704a9da7ba970b33ba7dce&user.id=09b34b305c4c4ada9d3fb396663f57aa&effective => generated 648 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:36:53.312139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7670c-13d7-44de-8d5a-672d9119d1bb tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:53.323084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7670c-13d7-44de-8d5a-672d9119d1bb tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:53.327930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb8432-66fb-4371-9f8b-5244056859ea tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:53.328590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb8432-66fb-4371-9f8b-5244056859ea tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:53.328815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb8432-66fb-4371-9f8b-5244056859ea tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:53.329095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb8432-66fb-4371-9f8b-5244056859ea tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:53.329927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb8432-66fb-4371-9f8b-5244056859ea tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Adding query filter params (scope.project.id=404cc3ae6d4347c7abba41a57289cc15, user.id=09b34b305c4c4ada9d3fb396663f57aa) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:36:53.330246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb8432-66fb-4371-9f8b-5244056859ea tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:53.332429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb8432-66fb-4371-9f8b-5244056859ea tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:53.401102 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3583/7093] 10.222.0.16 () {58 vars in 1355 bytes} [Sat Jul 16 21:36:53 2022] GET /identity/v3/role_assignments?scope.project.id=404cc3ae6d4347c7abba41a57289cc15&user.id=09b34b305c4c4ada9d3fb396663f57aa&effective => generated 648 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:36:53.405550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4795d-50af-49a5-afe9-3ebab26f8068 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:53.417160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4795d-50af-49a5-afe9-3ebab26f8068 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:53.421907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06edaa7-9b30-413f-8523-2f4204fffd1b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:53.422757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06edaa7-9b30-413f-8523-2f4204fffd1b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:53.423149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06edaa7-9b30-413f-8523-2f4204fffd1b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:53.423556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06edaa7-9b30-413f-8523-2f4204fffd1b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/16f731aceef146eba1d4491450fb2cd7/users/09b34b305c4c4ada9d3fb396663f57aa/roles/66b6dcc563bf4a4d9606a3f14219dc29/inherited_to_projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:53.426951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06edaa7-9b30-413f-8523-2f4204fffd1b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=16f731aceef146eba1d4491450fb2cd7, user_id=09b34b305c4c4ada9d3fb396663f57aa, role_id=66b6dcc563bf4a4d9606a3f14219dc29)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:53.428784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06edaa7-9b30-413f-8523-2f4204fffd1b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:53.434419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b06edaa7-9b30-413f-8523-2f4204fffd1b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invalidating the token cache because role 66b6dcc563bf4a4d9606a3f14219dc29 was removed from user 09b34b305c4c4ada9d3fb396663f57aa on domain 16f731aceef146eba1d4491450fb2cd7. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:53.434789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b06edaa7-9b30-413f-8523-2f4204fffd1b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:53.435632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b06edaa7-9b30-413f-8523-2f4204fffd1b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:53.512556 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3511/7094] 10.222.0.16 () {58 vars in 1562 bytes} [Sat Jul 16 21:36:53 2022] DELETE /identity/v3/OS-INHERIT/domains/16f731aceef146eba1d4491450fb2cd7/users/09b34b305c4c4ada9d3fb396663f57aa/roles/66b6dcc563bf4a4d9606a3f14219dc29/inherited_to_projects => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:53.516814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb8432-66fb-4371-9f8b-5244056859ea tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:53.518917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-48bb8432-66fb-4371-9f8b-5244056859ea tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:53.533044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb8432-66fb-4371-9f8b-5244056859ea tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:53.600073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f84d0-633a-4c42-b639-f0c45a13cc1f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:53.600850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f84d0-633a-4c42-b639-f0c45a13cc1f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:53.601168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f84d0-633a-4c42-b639-f0c45a13cc1f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:53.601468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f84d0-633a-4c42-b639-f0c45a13cc1f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:53.603035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f84d0-633a-4c42-b639-f0c45a13cc1f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Adding query filter params (scope.project.id=f8527b1823704a9da7ba970b33ba7dce, user.id=09b34b305c4c4ada9d3fb396663f57aa) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:36:53.603454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f84d0-633a-4c42-b639-f0c45a13cc1f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:53.605359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f84d0-633a-4c42-b639-f0c45a13cc1f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:53.657934 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3584/7095] 10.222.0.16 () {58 vars in 1355 bytes} [Sat Jul 16 21:36:53 2022] GET /identity/v3/role_assignments?scope.project.id=f8527b1823704a9da7ba970b33ba7dce&user.id=09b34b305c4c4ada9d3fb396663f57aa&effective => generated 228 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:36:53.661972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06edaa7-9b30-413f-8523-2f4204fffd1b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:53.678157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06edaa7-9b30-413f-8523-2f4204fffd1b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:53.688994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:53.702336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0c803-9744-430c-b585-b0a734fd4214 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:53.703156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0c803-9744-430c-b585-b0a734fd4214 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:53.704072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0c803-9744-430c-b585-b0a734fd4214 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:53.704403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0c803-9744-430c-b585-b0a734fd4214 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:53.705961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0c803-9744-430c-b585-b0a734fd4214 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Adding query filter params (scope.project.id=404cc3ae6d4347c7abba41a57289cc15, user.id=09b34b305c4c4ada9d3fb396663f57aa) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:36:53.706385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0c803-9744-430c-b585-b0a734fd4214 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:53.710337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0c803-9744-430c-b585-b0a734fd4214 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:53.778371 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3512/7096] 10.222.0.16 () {58 vars in 1355 bytes} [Sat Jul 16 21:36:53 2022] GET /identity/v3/role_assignments?scope.project.id=404cc3ae6d4347c7abba41a57289cc15&user.id=09b34b305c4c4ada9d3fb396663f57aa&effective => generated 228 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:36:53.782742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f84d0-633a-4c42-b639-f0c45a13cc1f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:53.794234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f84d0-633a-4c42-b639-f0c45a13cc1f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:53.799084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34c438-d4ad-4f5d-95ad-15d19c890970 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:53.800081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34c438-d4ad-4f5d-95ad-15d19c890970 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:53.800534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34c438-d4ad-4f5d-95ad-15d19c890970 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:53.800807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34c438-d4ad-4f5d-95ad-15d19c890970 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/projects/404cc3ae6d4347c7abba41a57289cc15` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:53.803056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34c438-d4ad-4f5d-95ad-15d19c890970 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:delete_project(project_id=404cc3ae6d4347c7abba41a57289cc15)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:53.805117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34c438-d4ad-4f5d-95ad-15d19c890970 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:53.985025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3a34c438-d4ad-4f5d-95ad-15d19c890970 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '404cc3ae6d4347c7abba41a57289cc15', 'request_id': 'req-3a34c438-d4ad-4f5d-95ad-15d19c890970'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:53.993118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3a34c438-d4ad-4f5d-95ad-15d19c890970 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '404cc3ae6d4347c7abba41a57289cc15', 'request_id': 'req-3a34c438-d4ad-4f5d-95ad-15d19c890970'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:54.006763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3a34c438-d4ad-4f5d-95ad-15d19c890970 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '404cc3ae6d4347c7abba41a57289cc15', 'request_id': 'req-3a34c438-d4ad-4f5d-95ad-15d19c890970'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:54.026814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:54.094442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3a34c438-d4ad-4f5d-95ad-15d19c890970 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] The token cache is being invalidate because project 404cc3ae6d4347c7abba41a57289cc15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:54.094885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3a34c438-d4ad-4f5d-95ad-15d19c890970 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:54.095632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3a34c438-d4ad-4f5d-95ad-15d19c890970 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:54.097514 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3585/7097] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:36:53 2022] DELETE /identity/v3/projects/404cc3ae6d4347c7abba41a57289cc15 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:54.101578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0c803-9744-430c-b585-b0a734fd4214 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:54.103598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-faa0c803-9744-430c-b585-b0a734fd4214 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:54.119202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0c803-9744-430c-b585-b0a734fd4214 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:54.199419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52dadf7-256d-4f25-bb3c-b5d4d0644257 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:54.200315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dadf7-256d-4f25-bb3c-b5d4d0644257 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:54.200600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dadf7-256d-4f25-bb3c-b5d4d0644257 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:54.200880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dadf7-256d-4f25-bb3c-b5d4d0644257 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/roles/66b6dcc563bf4a4d9606a3f14219dc29` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:54.202388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52dadf7-256d-4f25-bb3c-b5d4d0644257 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:delete_role(role_id=66b6dcc563bf4a4d9606a3f14219dc29)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:54.204073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52dadf7-256d-4f25-bb3c-b5d4d0644257 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:54.300735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e52dadf7-256d-4f25-bb3c-b5d4d0644257 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invalidating the token cache because role 66b6dcc563bf4a4d9606a3f14219dc29 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:54.301032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e52dadf7-256d-4f25-bb3c-b5d4d0644257 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:54.306489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e52dadf7-256d-4f25-bb3c-b5d4d0644257 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:54.306489 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3513/7098] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:54 2022] DELETE /identity/v3/roles/66b6dcc563bf4a4d9606a3f14219dc29 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:54.310815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34c438-d4ad-4f5d-95ad-15d19c890970 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:54.323296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34c438-d4ad-4f5d-95ad-15d19c890970 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:54.382045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f032f-fcef-434d-9dde-02bca987b9c5 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:54.382726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f032f-fcef-434d-9dde-02bca987b9c5 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:54.383096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f032f-fcef-434d-9dde-02bca987b9c5 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:54.383318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f032f-fcef-434d-9dde-02bca987b9c5 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:54.384061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f032f-fcef-434d-9dde-02bca987b9c5 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:54.385791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f032f-fcef-434d-9dde-02bca987b9c5 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:54.465608 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3586/7099] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:36:54 2022] POST /identity/v3/roles => generated 239 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:36:54.466674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52dadf7-256d-4f25-bb3c-b5d4d0644257 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:54.468103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e52dadf7-256d-4f25-bb3c-b5d4d0644257 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:54.482285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52dadf7-256d-4f25-bb3c-b5d4d0644257 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:54.487217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d0e5d-5359-462b-bfd3-524aa276b933 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:54.487901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d0e5d-5359-462b-bfd3-524aa276b933 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:54.488202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d0e5d-5359-462b-bfd3-524aa276b933 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:54.488482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d0e5d-5359-462b-bfd3-524aa276b933 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:54.493208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d0e5d-5359-462b-bfd3-524aa276b933 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:54.493208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d0e5d-5359-462b-bfd3-524aa276b933 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:54.597572 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3514/7100] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:36:54 2022] POST /identity/v3/projects => generated 408 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:36:54.601802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f032f-fcef-434d-9dde-02bca987b9c5 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:54.613085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f032f-fcef-434d-9dde-02bca987b9c5 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:54.680195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17687698-be3d-4e8f-a4f4-782dd67a291f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:54.681044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17687698-be3d-4e8f-a4f4-782dd67a291f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:54.681327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17687698-be3d-4e8f-a4f4-782dd67a291f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:54.681604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17687698-be3d-4e8f-a4f4-782dd67a291f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f8527b1823704a9da7ba970b33ba7dce/users/09b34b305c4c4ada9d3fb396663f57aa/roles/64ebb46069c84b8eb3652cf523496ee3/inherited_to_projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:54.684067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17687698-be3d-4e8f-a4f4-782dd67a291f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f8527b1823704a9da7ba970b33ba7dce, user_id=09b34b305c4c4ada9d3fb396663f57aa, role_id=64ebb46069c84b8eb3652cf523496ee3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:54.686788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17687698-be3d-4e8f-a4f4-782dd67a291f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:54.804154 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3587/7101] 10.222.0.16 () {60 vars in 1581 bytes} [Sat Jul 16 21:36:54 2022] PUT /identity/v3/OS-INHERIT/projects/f8527b1823704a9da7ba970b33ba7dce/users/09b34b305c4c4ada9d3fb396663f57aa/roles/64ebb46069c84b8eb3652cf523496ee3/inherited_to_projects => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:54.808466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d0e5d-5359-462b-bfd3-524aa276b933 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:54.820283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d0e5d-5359-462b-bfd3-524aa276b933 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:54.889290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256001a-c6ef-4b3d-9782-e41ff22b630d tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:54.890017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256001a-c6ef-4b3d-9782-e41ff22b630d tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:54.890299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256001a-c6ef-4b3d-9782-e41ff22b630d tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:54.890645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256001a-c6ef-4b3d-9782-e41ff22b630d tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:54.891532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256001a-c6ef-4b3d-9782-e41ff22b630d tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Adding query filter params (scope.project.id=6be4229acf304ef1b414558847d9ddbd, user.id=09b34b305c4c4ada9d3fb396663f57aa) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:36:54.891845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256001a-c6ef-4b3d-9782-e41ff22b630d tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:54.893807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256001a-c6ef-4b3d-9782-e41ff22b630d tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:54.956305 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3515/7102] 10.222.0.16 () {58 vars in 1355 bytes} [Sat Jul 16 21:36:54 2022] GET /identity/v3/role_assignments?scope.project.id=6be4229acf304ef1b414558847d9ddbd&user.id=09b34b305c4c4ada9d3fb396663f57aa&effective => generated 649 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:36:54.957588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17687698-be3d-4e8f-a4f4-782dd67a291f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:54.969198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17687698-be3d-4e8f-a4f4-782dd67a291f tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:54.971787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:54.977497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0e841-85d7-4270-9f2f-f6487cd050f3 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:54.978412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0e841-85d7-4270-9f2f-f6487cd050f3 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:54.978726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0e841-85d7-4270-9f2f-f6487cd050f3 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:54.979110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0e841-85d7-4270-9f2f-f6487cd050f3 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f8527b1823704a9da7ba970b33ba7dce/users/09b34b305c4c4ada9d3fb396663f57aa/roles/64ebb46069c84b8eb3652cf523496ee3/inherited_to_projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:54.981691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0e841-85d7-4270-9f2f-f6487cd050f3 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=f8527b1823704a9da7ba970b33ba7dce, user_id=09b34b305c4c4ada9d3fb396663f57aa, role_id=64ebb46069c84b8eb3652cf523496ee3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:54.984549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0e841-85d7-4270-9f2f-f6487cd050f3 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:54.989885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0bc0e841-85d7-4270-9f2f-f6487cd050f3 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invalidating the token cache because role 64ebb46069c84b8eb3652cf523496ee3 was removed from user 09b34b305c4c4ada9d3fb396663f57aa on project f8527b1823704a9da7ba970b33ba7dce. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:54.990177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0bc0e841-85d7-4270-9f2f-f6487cd050f3 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:54.990900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0bc0e841-85d7-4270-9f2f-f6487cd050f3 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:55.089816 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3588/7103] 10.222.0.16 () {58 vars in 1565 bytes} [Sat Jul 16 21:36:54 2022] DELETE /identity/v3/OS-INHERIT/projects/f8527b1823704a9da7ba970b33ba7dce/users/09b34b305c4c4ada9d3fb396663f57aa/roles/64ebb46069c84b8eb3652cf523496ee3/inherited_to_projects => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:55.094075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256001a-c6ef-4b3d-9782-e41ff22b630d tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:55.095799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7256001a-c6ef-4b3d-9782-e41ff22b630d tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:55.108981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256001a-c6ef-4b3d-9782-e41ff22b630d tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:55.171581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb282b9-1fcc-4997-ae97-8a0a0225d4f6 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:55.172248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb282b9-1fcc-4997-ae97-8a0a0225d4f6 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:55.172592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb282b9-1fcc-4997-ae97-8a0a0225d4f6 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:55.173009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb282b9-1fcc-4997-ae97-8a0a0225d4f6 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:55.173966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb282b9-1fcc-4997-ae97-8a0a0225d4f6 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Adding query filter params (scope.project.id=6be4229acf304ef1b414558847d9ddbd, user.id=09b34b305c4c4ada9d3fb396663f57aa) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:36:55.174332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb282b9-1fcc-4997-ae97-8a0a0225d4f6 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:55.176371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb282b9-1fcc-4997-ae97-8a0a0225d4f6 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:55.228580 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3516/7104] 10.222.0.16 () {58 vars in 1355 bytes} [Sat Jul 16 21:36:55 2022] GET /identity/v3/role_assignments?scope.project.id=6be4229acf304ef1b414558847d9ddbd&user.id=09b34b305c4c4ada9d3fb396663f57aa&effective => generated 228 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:36:55.233108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0e841-85d7-4270-9f2f-f6487cd050f3 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:55.243469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0e841-85d7-4270-9f2f-f6487cd050f3 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:55.247992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88f295-bc48-4f9c-bc96-629c016bf459 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:55.248837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88f295-bc48-4f9c-bc96-629c016bf459 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:55.249120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88f295-bc48-4f9c-bc96-629c016bf459 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:55.249392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88f295-bc48-4f9c-bc96-629c016bf459 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/projects/6be4229acf304ef1b414558847d9ddbd` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:55.250574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88f295-bc48-4f9c-bc96-629c016bf459 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6be4229acf304ef1b414558847d9ddbd)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:55.252552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88f295-bc48-4f9c-bc96-629c016bf459 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:55.381542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ba88f295-bc48-4f9c-bc96-629c016bf459 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6be4229acf304ef1b414558847d9ddbd', 'request_id': 'req-ba88f295-bc48-4f9c-bc96-629c016bf459'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:55.388141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ba88f295-bc48-4f9c-bc96-629c016bf459 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6be4229acf304ef1b414558847d9ddbd', 'request_id': 'req-ba88f295-bc48-4f9c-bc96-629c016bf459'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:55.393756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ba88f295-bc48-4f9c-bc96-629c016bf459 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6be4229acf304ef1b414558847d9ddbd', 'request_id': 'req-ba88f295-bc48-4f9c-bc96-629c016bf459'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:55.497231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:55.500994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ba88f295-bc48-4f9c-bc96-629c016bf459 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] The token cache is being invalidate because project 6be4229acf304ef1b414558847d9ddbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:55.501291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ba88f295-bc48-4f9c-bc96-629c016bf459 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:55.501976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ba88f295-bc48-4f9c-bc96-629c016bf459 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:55.503596 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3589/7105] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:36:55 2022] DELETE /identity/v3/projects/6be4229acf304ef1b414558847d9ddbd => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:55.508258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb282b9-1fcc-4997-ae97-8a0a0225d4f6 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:55.510306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cfb282b9-1fcc-4997-ae97-8a0a0225d4f6 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:55.531069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb282b9-1fcc-4997-ae97-8a0a0225d4f6 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:55.579819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48734899-01d1-46dd-9c5d-4e1181267427 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:55.580685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48734899-01d1-46dd-9c5d-4e1181267427 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:55.580968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48734899-01d1-46dd-9c5d-4e1181267427 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:55.581243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48734899-01d1-46dd-9c5d-4e1181267427 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/roles/64ebb46069c84b8eb3652cf523496ee3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:55.582729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48734899-01d1-46dd-9c5d-4e1181267427 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:delete_role(role_id=64ebb46069c84b8eb3652cf523496ee3)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:55.584998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48734899-01d1-46dd-9c5d-4e1181267427 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:55.723001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-48734899-01d1-46dd-9c5d-4e1181267427 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invalidating the token cache because role 64ebb46069c84b8eb3652cf523496ee3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:55.723340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-48734899-01d1-46dd-9c5d-4e1181267427 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:55.723996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-48734899-01d1-46dd-9c5d-4e1181267427 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:55.727937 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3517/7106] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:55 2022] DELETE /identity/v3/roles/64ebb46069c84b8eb3652cf523496ee3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:36:55.741166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88f295-bc48-4f9c-bc96-629c016bf459 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:55.746060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88f295-bc48-4f9c-bc96-629c016bf459 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:55.806902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db345350-d368-404e-b909-20d9992d406b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:55.807922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db345350-d368-404e-b909-20d9992d406b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:55.808082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db345350-d368-404e-b909-20d9992d406b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:55.808367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db345350-d368-404e-b909-20d9992d406b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/users/09b34b305c4c4ada9d3fb396663f57aa` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:55.809744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db345350-d368-404e-b909-20d9992d406b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:delete_user(user_id=09b34b305c4c4ada9d3fb396663f57aa)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:55.811751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db345350-d368-404e-b909-20d9992d406b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:55.901783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-db345350-d368-404e-b909-20d9992d406b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b34b305c4c4ada9d3fb396663f57aa'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:55.908671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-db345350-d368-404e-b909-20d9992d406b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b34b305c4c4ada9d3fb396663f57aa'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:56.007659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-db345350-d368-404e-b909-20d9992d406b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b34b305c4c4ada9d3fb396663f57aa'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:56.008212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-db345350-d368-404e-b909-20d9992d406b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b34b305c4c4ada9d3fb396663f57aa'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:56.020465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-db345350-d368-404e-b909-20d9992d406b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b34b305c4c4ada9d3fb396663f57aa'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:56.027028 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3590/7107] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:55 2022] DELETE /identity/v3/users/09b34b305c4c4ada9d3fb396663f57aa => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:56.031169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48734899-01d1-46dd-9c5d-4e1181267427 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:56.032557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-48734899-01d1-46dd-9c5d-4e1181267427 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:56.044996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48734899-01d1-46dd-9c5d-4e1181267427 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:56.104895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6e711-edbc-4f1f-b687-06fed8917a24 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:56.105781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6e711-edbc-4f1f-b687-06fed8917a24 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:56.106322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6e711-edbc-4f1f-b687-06fed8917a24 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:56.108986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6e711-edbc-4f1f-b687-06fed8917a24 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/groups/92d9683ee8b14c039979bd552f45abd0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:56.108986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6e711-edbc-4f1f-b687-06fed8917a24 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:delete_group(group_id=92d9683ee8b14c039979bd552f45abd0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:56.109787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6e711-edbc-4f1f-b687-06fed8917a24 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:56.221402 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3518/7108] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Jul 16 21:36:56 2022] DELETE /identity/v3/groups/92d9683ee8b14c039979bd552f45abd0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:56.225896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db345350-d368-404e-b909-20d9992d406b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:56.227340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-db345350-d368-404e-b909-20d9992d406b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:56.241233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db345350-d368-404e-b909-20d9992d406b tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:56.296048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d62d0a-4871-458b-9ed9-4b48ae0d4845 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:56.296911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d62d0a-4871-458b-9ed9-4b48ae0d4845 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:56.297195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d62d0a-4871-458b-9ed9-4b48ae0d4845 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:56.297472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d62d0a-4871-458b-9ed9-4b48ae0d4845 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/projects/f8527b1823704a9da7ba970b33ba7dce` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:56.298643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d62d0a-4871-458b-9ed9-4b48ae0d4845 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f8527b1823704a9da7ba970b33ba7dce)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:56.300660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d62d0a-4871-458b-9ed9-4b48ae0d4845 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:56.420827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f9d62d0a-4871-458b-9ed9-4b48ae0d4845 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8527b1823704a9da7ba970b33ba7dce', 'request_id': 'req-f9d62d0a-4871-458b-9ed9-4b48ae0d4845'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:56.426939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f9d62d0a-4871-458b-9ed9-4b48ae0d4845 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8527b1823704a9da7ba970b33ba7dce', 'request_id': 'req-f9d62d0a-4871-458b-9ed9-4b48ae0d4845'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:56.433140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f9d62d0a-4871-458b-9ed9-4b48ae0d4845 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8527b1823704a9da7ba970b33ba7dce', 'request_id': 'req-f9d62d0a-4871-458b-9ed9-4b48ae0d4845'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:56.549903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f9d62d0a-4871-458b-9ed9-4b48ae0d4845 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] The token cache is being invalidate because project f8527b1823704a9da7ba970b33ba7dce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:56.550191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f9d62d0a-4871-458b-9ed9-4b48ae0d4845 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:56.550814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f9d62d0a-4871-458b-9ed9-4b48ae0d4845 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:56.553071 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3591/7109] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:36:56 2022] DELETE /identity/v3/projects/f8527b1823704a9da7ba970b33ba7dce => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:56.557221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6e711-edbc-4f1f-b687-06fed8917a24 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:56.565167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1cf6e711-edbc-4f1f-b687-06fed8917a24 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:56.573428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6e711-edbc-4f1f-b687-06fed8917a24 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:56.632297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfddeca-538e-4412-b28d-a3fc40fb23ca tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:56.633169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfddeca-538e-4412-b28d-a3fc40fb23ca tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:56.633456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfddeca-538e-4412-b28d-a3fc40fb23ca tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:56.633736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfddeca-538e-4412-b28d-a3fc40fb23ca tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/domains/16f731aceef146eba1d4491450fb2cd7` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:56.635163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfddeca-538e-4412-b28d-a3fc40fb23ca tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=16f731aceef146eba1d4491450fb2cd7)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:56.636799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfddeca-538e-4412-b28d-a3fc40fb23ca tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:56.657392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fbfddeca-538e-4412-b28d-a3fc40fb23ca tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '16f731aceef146eba1d4491450fb2cd7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:56.658117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fbfddeca-538e-4412-b28d-a3fc40fb23ca tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '16f731aceef146eba1d4491450fb2cd7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:56.675002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:56.739173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fbfddeca-538e-4412-b28d-a3fc40fb23ca tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '16f731aceef146eba1d4491450fb2cd7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:56.740491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fbfddeca-538e-4412-b28d-a3fc40fb23ca tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '16f731aceef146eba1d4491450fb2cd7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:56.743097 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3519/7110] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:36:56 2022] PATCH /identity/v3/domains/16f731aceef146eba1d4491450fb2cd7 => generated 278 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:36:56.747118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d62d0a-4871-458b-9ed9-4b48ae0d4845 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:56.757493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d62d0a-4871-458b-9ed9-4b48ae0d4845 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:56.820115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc639d5-c31b-461e-93d1-210b7a682342 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a7f3b5c24540238fce2e220d5a1dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aee0788a6dbb4ae3af92276367dda5eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:56.837273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc639d5-c31b-461e-93d1-210b7a682342 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:56.837273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc639d5-c31b-461e-93d1-210b7a682342 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:56.837273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc639d5-c31b-461e-93d1-210b7a682342 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] PATH_INFO: `/v3/domains/16f731aceef146eba1d4491450fb2cd7` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:56.837273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc639d5-c31b-461e-93d1-210b7a682342 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=16f731aceef146eba1d4491450fb2cd7)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:56.837694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc639d5-c31b-461e-93d1-210b7a682342 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:56.857002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2dc639d5-c31b-461e-93d1-210b7a682342 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '16f731aceef146eba1d4491450fb2cd7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:56.868957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2dc639d5-c31b-461e-93d1-210b7a682342 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '16f731aceef146eba1d4491450fb2cd7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:56.975105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:56.982787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2dc639d5-c31b-461e-93d1-210b7a682342 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16f731aceef146eba1d4491450fb2cd7', 'request_id': 'req-2dc639d5-c31b-461e-93d1-210b7a682342'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:56.989528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2dc639d5-c31b-461e-93d1-210b7a682342 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16f731aceef146eba1d4491450fb2cd7', 'request_id': 'req-2dc639d5-c31b-461e-93d1-210b7a682342'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:56.995285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2dc639d5-c31b-461e-93d1-210b7a682342 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16f731aceef146eba1d4491450fb2cd7', 'request_id': 'req-2dc639d5-c31b-461e-93d1-210b7a682342'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:57.054331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2dc639d5-c31b-461e-93d1-210b7a682342 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] The token cache is being invalidate because project 16f731aceef146eba1d4491450fb2cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:57.054656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2dc639d5-c31b-461e-93d1-210b7a682342 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:57.055320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2dc639d5-c31b-461e-93d1-210b7a682342 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:57.063624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2dc639d5-c31b-461e-93d1-210b7a682342 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '16f731aceef146eba1d4491450fb2cd7', 'request_id': 'req-2dc639d5-c31b-461e-93d1-210b7a682342'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:57.066854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2dc639d5-c31b-461e-93d1-210b7a682342 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '16f731aceef146eba1d4491450fb2cd7', 'request_id': 'req-2dc639d5-c31b-461e-93d1-210b7a682342'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:57.067537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2dc639d5-c31b-461e-93d1-210b7a682342 tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '16f731aceef146eba1d4491450fb2cd7', 'request_id': 'req-2dc639d5-c31b-461e-93d1-210b7a682342'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:57.073261 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3592/7111] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:36:56 2022] DELETE /identity/v3/domains/16f731aceef146eba1d4491450fb2cd7 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:57.077569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfddeca-538e-4412-b28d-a3fc40fb23ca tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:57.078964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fbfddeca-538e-4412-b28d-a3fc40fb23ca tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:57.148685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfddeca-538e-4412-b28d-a3fc40fb23ca tempest-InheritsV3TestJSON-1373381420 tempest-InheritsV3TestJSON-1373381420-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:57.209073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fb253-160c-4372-ac92-b2fd1dc6759c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:57.210488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fb253-160c-4372-ac92-b2fd1dc6759c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:57.210774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fb253-160c-4372-ac92-b2fd1dc6759c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:57.211084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fb253-160c-4372-ac92-b2fd1dc6759c admin admin] PATH_INFO: `/v3/users/878df121f92d4de0bfea3f6628f4eaf1` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:57.212417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fb253-160c-4372-ac92-b2fd1dc6759c admin admin] RBAC: Authorizing `identity:delete_user(user_id=878df121f92d4de0bfea3f6628f4eaf1)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:57.214389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fb253-160c-4372-ac92-b2fd1dc6759c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:57.408889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-112fb253-160c-4372-ac92-b2fd1dc6759c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '878df121f92d4de0bfea3f6628f4eaf1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:57.421115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-112fb253-160c-4372-ac92-b2fd1dc6759c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '878df121f92d4de0bfea3f6628f4eaf1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:57.540638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-112fb253-160c-4372-ac92-b2fd1dc6759c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '878df121f92d4de0bfea3f6628f4eaf1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:57.548144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-112fb253-160c-4372-ac92-b2fd1dc6759c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '878df121f92d4de0bfea3f6628f4eaf1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:57.548781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-112fb253-160c-4372-ac92-b2fd1dc6759c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '878df121f92d4de0bfea3f6628f4eaf1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:57.554698 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3520/7112] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:57 2022] DELETE /identity/v3/users/878df121f92d4de0bfea3f6628f4eaf1 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:57.559505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83bdce-bb93-43f0-8d5c-d07f56476f57 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:57.559791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83bdce-bb93-43f0-8d5c-d07f56476f57 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:57.560063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83bdce-bb93-43f0-8d5c-d07f56476f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:57.579703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ba83bdce-bb93-43f0-8d5c-d07f56476f57 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:57.580912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ba83bdce-bb93-43f0-8d5c-d07f56476f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:57.641369 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3593/7113] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:36:57.651992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fb253-160c-4372-ac92-b2fd1dc6759c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:57.653408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-112fb253-160c-4372-ac92-b2fd1dc6759c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:57.716237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fb253-160c-4372-ac92-b2fd1dc6759c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:57.719875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbcf98-6550-4ef8-aa65-1bb0963502a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:57.720523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbcf98-6550-4ef8-aa65-1bb0963502a5 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:57.720866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbcf98-6550-4ef8-aa65-1bb0963502a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:57.721178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbcf98-6550-4ef8-aa65-1bb0963502a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:57.730222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbcf98-6550-4ef8-aa65-1bb0963502a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:57.731933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbcf98-6550-4ef8-aa65-1bb0963502a5 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:57.741934 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3521/7114] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:36:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:36:57.750870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:57.993319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:58.187879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83bdce-bb93-43f0-8d5c-d07f56476f57 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:58.187879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ba83bdce-bb93-43f0-8d5c-d07f56476f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:58.200848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83bdce-bb93-43f0-8d5c-d07f56476f57 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:58.205862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb46a8-fd63-4b61-91d3-245d7db9eb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:58.206757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb46a8-fd63-4b61-91d3-245d7db9eb93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:58.207071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb46a8-fd63-4b61-91d3-245d7db9eb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:58.207351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb46a8-fd63-4b61-91d3-245d7db9eb93 admin admin] PATH_INFO: `/v3/projects/4212bc2a7e494090b096a7150b1bd7d1` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:58.208684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb46a8-fd63-4b61-91d3-245d7db9eb93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4212bc2a7e494090b096a7150b1bd7d1)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:58.210610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb46a8-fd63-4b61-91d3-245d7db9eb93 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:58.386589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-25fb46a8-fd63-4b61-91d3-245d7db9eb93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4212bc2a7e494090b096a7150b1bd7d1', 'request_id': 'req-25fb46a8-fd63-4b61-91d3-245d7db9eb93'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:58.394219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-25fb46a8-fd63-4b61-91d3-245d7db9eb93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4212bc2a7e494090b096a7150b1bd7d1', 'request_id': 'req-25fb46a8-fd63-4b61-91d3-245d7db9eb93'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:58.402165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-25fb46a8-fd63-4b61-91d3-245d7db9eb93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4212bc2a7e494090b096a7150b1bd7d1', 'request_id': 'req-25fb46a8-fd63-4b61-91d3-245d7db9eb93'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:58.563584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-25fb46a8-fd63-4b61-91d3-245d7db9eb93 admin admin] The token cache is being invalidate because project 4212bc2a7e494090b096a7150b1bd7d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:58.563876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-25fb46a8-fd63-4b61-91d3-245d7db9eb93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:58.564834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-25fb46a8-fd63-4b61-91d3-245d7db9eb93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:58.566374 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3594/7115] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:36:58 2022] DELETE /identity/v3/projects/4212bc2a7e494090b096a7150b1bd7d1 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:58.570462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbcf98-6550-4ef8-aa65-1bb0963502a5 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:58.580192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbcf98-6550-4ef8-aa65-1bb0963502a5 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:58.643072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400970a6-6f2b-4942-89c4-a8a9ee0e0cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:58.643970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400970a6-6f2b-4942-89c4-a8a9ee0e0cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:58.644276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400970a6-6f2b-4942-89c4-a8a9ee0e0cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:58.644549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400970a6-6f2b-4942-89c4-a8a9ee0e0cbd admin admin] PATH_INFO: `/v3/users/e5a7f3b5c24540238fce2e220d5a1dae` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:58.645763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400970a6-6f2b-4942-89c4-a8a9ee0e0cbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5a7f3b5c24540238fce2e220d5a1dae)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:58.651722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400970a6-6f2b-4942-89c4-a8a9ee0e0cbd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:58.836665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-400970a6-6f2b-4942-89c4-a8a9ee0e0cbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a7f3b5c24540238fce2e220d5a1dae'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:58.848821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-400970a6-6f2b-4942-89c4-a8a9ee0e0cbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a7f3b5c24540238fce2e220d5a1dae'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:58.886698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:58.906158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-400970a6-6f2b-4942-89c4-a8a9ee0e0cbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a7f3b5c24540238fce2e220d5a1dae'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:58.916148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-400970a6-6f2b-4942-89c4-a8a9ee0e0cbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a7f3b5c24540238fce2e220d5a1dae'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:58.916914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-400970a6-6f2b-4942-89c4-a8a9ee0e0cbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a7f3b5c24540238fce2e220d5a1dae'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:58.923851 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3522/7116] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:36:58 2022] DELETE /identity/v3/users/e5a7f3b5c24540238fce2e220d5a1dae => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:59.039801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:59.686199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb46a8-fd63-4b61-91d3-245d7db9eb93 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:36:59.688093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-25fb46a8-fd63-4b61-91d3-245d7db9eb93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:36:59.702873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb46a8-fd63-4b61-91d3-245d7db9eb93 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:36:59.768309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365087c-4170-42cc-b675-0dfa0d0212ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:36:59.769163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365087c-4170-42cc-b675-0dfa0d0212ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:59.769441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365087c-4170-42cc-b675-0dfa0d0212ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:59.769764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365087c-4170-42cc-b675-0dfa0d0212ec admin admin] PATH_INFO: `/v3/projects/aee0788a6dbb4ae3af92276367dda5eb` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:59.770985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365087c-4170-42cc-b675-0dfa0d0212ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=aee0788a6dbb4ae3af92276367dda5eb)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:36:59.773167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365087c-4170-42cc-b675-0dfa0d0212ec admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:36:59.877629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5365087c-4170-42cc-b675-0dfa0d0212ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee0788a6dbb4ae3af92276367dda5eb', 'request_id': 'req-5365087c-4170-42cc-b675-0dfa0d0212ec'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:59.884295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5365087c-4170-42cc-b675-0dfa0d0212ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee0788a6dbb4ae3af92276367dda5eb', 'request_id': 'req-5365087c-4170-42cc-b675-0dfa0d0212ec'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:59.890498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5365087c-4170-42cc-b675-0dfa0d0212ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee0788a6dbb4ae3af92276367dda5eb', 'request_id': 'req-5365087c-4170-42cc-b675-0dfa0d0212ec'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:59.944848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5365087c-4170-42cc-b675-0dfa0d0212ec admin admin] The token cache is being invalidate because project aee0788a6dbb4ae3af92276367dda5eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:36:59.945146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5365087c-4170-42cc-b675-0dfa0d0212ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:59.946377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5365087c-4170-42cc-b675-0dfa0d0212ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:36:59.947814 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3595/7117] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:36:59 2022] DELETE /identity/v3/projects/aee0788a6dbb4ae3af92276367dda5eb => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:36:59.955583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae39b0-f959-44be-adb7-0934f1686477 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:36:59.956151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae39b0-f959-44be-adb7-0934f1686477 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:36:59.956629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae39b0-f959-44be-adb7-0934f1686477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:36:59.959838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:59.975946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:36:59.982970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d3ae39b0-f959-44be-adb7-0934f1686477 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:36:59.984370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d3ae39b0-f959-44be-adb7-0934f1686477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:00.055495 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3523/7118] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:37:00.063982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180a6e2-acbe-4698-ac29-ceb9f445edc4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:00.064369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180a6e2-acbe-4698-ac29-ceb9f445edc4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:00.064545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180a6e2-acbe-4698-ac29-ceb9f445edc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:00.084473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c180a6e2-acbe-4698-ac29-ceb9f445edc4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:37:00.085750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c180a6e2-acbe-4698-ac29-ceb9f445edc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:00.094773 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3596/7119] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:37:00.099142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae39b0-f959-44be-adb7-0934f1686477 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:00.111301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae39b0-f959-44be-adb7-0934f1686477 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:00.120639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69756222-0233-4fa2-904a-25cb81ef2899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:00.121662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69756222-0233-4fa2-904a-25cb81ef2899 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:00.121984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69756222-0233-4fa2-904a-25cb81ef2899 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:00.122327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69756222-0233-4fa2-904a-25cb81ef2899 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:00.123102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69756222-0233-4fa2-904a-25cb81ef2899 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:37:00.123412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69756222-0233-4fa2-904a-25cb81ef2899 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:00.125031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69756222-0233-4fa2-904a-25cb81ef2899 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:00.138965 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3524/7120] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:37:00.143422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180a6e2-acbe-4698-ac29-ceb9f445edc4 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:00.153432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180a6e2-acbe-4698-ac29-ceb9f445edc4 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:00.163244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e26dd4-19e7-412b-b617-fafb7cda4577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:00.163244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e26dd4-19e7-412b-b617-fafb7cda4577 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:00.163244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e26dd4-19e7-412b-b617-fafb7cda4577 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:00.163244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e26dd4-19e7-412b-b617-fafb7cda4577 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:00.168241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e26dd4-19e7-412b-b617-fafb7cda4577 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:00.168241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e26dd4-19e7-412b-b617-fafb7cda4577 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:00.313095 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3597/7121] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:37:00 2022] POST /identity/v3/projects => generated 363 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:37:00.314509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69756222-0233-4fa2-904a-25cb81ef2899 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:00.327104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69756222-0233-4fa2-904a-25cb81ef2899 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:00.384022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a8bb3-35fa-4668-b7b8-684cd90c035e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:00.384684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a8bb3-35fa-4668-b7b8-684cd90c035e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:00.384967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a8bb3-35fa-4668-b7b8-684cd90c035e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:00.385242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a8bb3-35fa-4668-b7b8-684cd90c035e admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:00.385912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a8bb3-35fa-4668-b7b8-684cd90c035e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:00.387919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a8bb3-35fa-4668-b7b8-684cd90c035e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:00.536129 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3525/7122] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:37:00 2022] POST /identity/v3/users => generated 282 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:37:00.540674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e26dd4-19e7-412b-b617-fafb7cda4577 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:00.551834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e26dd4-19e7-412b-b617-fafb7cda4577 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:00.558548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70889c1e-0751-4d56-8b6e-c6b110f291bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:00.559264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70889c1e-0751-4d56-8b6e-c6b110f291bf admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:00.559544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70889c1e-0751-4d56-8b6e-c6b110f291bf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:00.559848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70889c1e-0751-4d56-8b6e-c6b110f291bf admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:00.560602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70889c1e-0751-4d56-8b6e-c6b110f291bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:00.563297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70889c1e-0751-4d56-8b6e-c6b110f291bf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:00.573271 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3598/7123] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:37:00.577435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a8bb3-35fa-4668-b7b8-684cd90c035e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:00.587679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a8bb3-35fa-4668-b7b8-684cd90c035e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:00.592632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5a8bd-31cb-4135-8bb7-e59b35a2a364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:00.593287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5a8bd-31cb-4135-8bb7-e59b35a2a364 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:00.593568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5a8bd-31cb-4135-8bb7-e59b35a2a364 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:00.593837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5a8bd-31cb-4135-8bb7-e59b35a2a364 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:00.594556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5a8bd-31cb-4135-8bb7-e59b35a2a364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:00.596357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5a8bd-31cb-4135-8bb7-e59b35a2a364 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:00.607297 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3526/7124] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:37:00.611386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70889c1e-0751-4d56-8b6e-c6b110f291bf admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:00.622076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70889c1e-0751-4d56-8b6e-c6b110f291bf admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:00.626801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052868b-4151-40b2-87c3-b368de41e8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:00.627882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052868b-4151-40b2-87c3-b368de41e8f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:00.628162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052868b-4151-40b2-87c3-b368de41e8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:00.628435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052868b-4151-40b2-87c3-b368de41e8f3 admin admin] PATH_INFO: `/v3/projects/4bd4c74666024f6da1975b393e5ef768/users/36ae845d63b8487da895ad50cb66ea6a/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:00.643874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052868b-4151-40b2-87c3-b368de41e8f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd4c74666024f6da1975b393e5ef768, user_id=36ae845d63b8487da895ad50cb66ea6a, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:00.646523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052868b-4151-40b2-87c3-b368de41e8f3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:00.730387 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3599/7125] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:37:00 2022] PUT /identity/v3/projects/4bd4c74666024f6da1975b393e5ef768/users/36ae845d63b8487da895ad50cb66ea6a/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:37:00.824878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d10de8-99f2-4dd2-8362-bf5ae5e68872 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:00.825091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d10de8-99f2-4dd2-8362-bf5ae5e68872 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:00.825355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d10de8-99f2-4dd2-8362-bf5ae5e68872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:00.854660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-75d10de8-99f2-4dd2-8362-bf5ae5e68872 None None] MFA Rules not processed for user `36ae845d63b8487da895ad50cb66ea6a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:37:00.856143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-75d10de8-99f2-4dd2-8362-bf5ae5e68872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:00.913076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:00.925679 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3527/7126] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:37:00 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:37:00.937122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052868b-4151-40b2-87c3-b368de41e8f3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:00.938874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1052868b-4151-40b2-87c3-b368de41e8f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:00.987274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:01.001001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052868b-4151-40b2-87c3-b368de41e8f3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:01.004589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba85ceb-644d-43b9-a053-4f5ea9b7e548 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:01.005230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba85ceb-644d-43b9-a053-4f5ea9b7e548 service glance] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:01.005512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba85ceb-644d-43b9-a053-4f5ea9b7e548 service glance] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:01.005786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba85ceb-644d-43b9-a053-4f5ea9b7e548 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:01.014966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba85ceb-644d-43b9-a053-4f5ea9b7e548 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:01.016437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba85ceb-644d-43b9-a053-4f5ea9b7e548 service glance] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:01.026057 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3600/7127] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:37:00 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:37:01.866631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d10de8-99f2-4dd2-8362-bf5ae5e68872 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:01.932686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d10de8-99f2-4dd2-8362-bf5ae5e68872 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:01.937143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dd6fe-95e7-412a-ab0e-2427d207fcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:01.938012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dd6fe-95e7-412a-ab0e-2427d207fcd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:01.938294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dd6fe-95e7-412a-ab0e-2427d207fcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:01.938570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dd6fe-95e7-412a-ab0e-2427d207fcd1 admin admin] PATH_INFO: `/v3/users/36ae845d63b8487da895ad50cb66ea6a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:01.939773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891dd6fe-95e7-412a-ab0e-2427d207fcd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ae845d63b8487da895ad50cb66ea6a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:01.941691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891dd6fe-95e7-412a-ab0e-2427d207fcd1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:01.955656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:02.019461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:02.150134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-891dd6fe-95e7-412a-ab0e-2427d207fcd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ae845d63b8487da895ad50cb66ea6a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:02.162424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-891dd6fe-95e7-412a-ab0e-2427d207fcd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ae845d63b8487da895ad50cb66ea6a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:02.226762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-891dd6fe-95e7-412a-ab0e-2427d207fcd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ae845d63b8487da895ad50cb66ea6a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:02.235984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-891dd6fe-95e7-412a-ab0e-2427d207fcd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ae845d63b8487da895ad50cb66ea6a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:02.236627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-891dd6fe-95e7-412a-ab0e-2427d207fcd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ae845d63b8487da895ad50cb66ea6a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:02.242795 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3528/7128] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:37:01 2022] DELETE /identity/v3/users/36ae845d63b8487da895ad50cb66ea6a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:37:02.247767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ddaf0-74c7-4455-a772-359862f4fe5d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:02.248080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ddaf0-74c7-4455-a772-359862f4fe5d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:02.248364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ddaf0-74c7-4455-a772-359862f4fe5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:02.266733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-265ddaf0-74c7-4455-a772-359862f4fe5d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:37:02.268175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-265ddaf0-74c7-4455-a772-359862f4fe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:02.329704 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3601/7129] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:37:02.340326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dd6fe-95e7-412a-ab0e-2427d207fcd1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:02.341749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-891dd6fe-95e7-412a-ab0e-2427d207fcd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:02.407395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dd6fe-95e7-412a-ab0e-2427d207fcd1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:02.411118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461074f6-6432-4eb3-a428-3a4e27d5b040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:02.411773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461074f6-6432-4eb3-a428-3a4e27d5b040 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:02.412057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461074f6-6432-4eb3-a428-3a4e27d5b040 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:02.412338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461074f6-6432-4eb3-a428-3a4e27d5b040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:02.423201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461074f6-6432-4eb3-a428-3a4e27d5b040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:02.425179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461074f6-6432-4eb3-a428-3a4e27d5b040 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:02.434923 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3529/7130] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:37:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:37:02.604380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:02.659530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:02.869215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ddaf0-74c7-4455-a772-359862f4fe5d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:02.871170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-265ddaf0-74c7-4455-a772-359862f4fe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:02.885303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ddaf0-74c7-4455-a772-359862f4fe5d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:02.891869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1bbd3-e05c-4dc1-8f57-f5f7c988bb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:02.892869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1bbd3-e05c-4dc1-8f57-f5f7c988bb26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:02.893284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1bbd3-e05c-4dc1-8f57-f5f7c988bb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:02.893630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1bbd3-e05c-4dc1-8f57-f5f7c988bb26 admin admin] PATH_INFO: `/v3/projects/4bd4c74666024f6da1975b393e5ef768` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:02.894846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1bbd3-e05c-4dc1-8f57-f5f7c988bb26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bd4c74666024f6da1975b393e5ef768)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:02.897028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1bbd3-e05c-4dc1-8f57-f5f7c988bb26 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:02.962517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:03.032717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-52a1bbd3-e05c-4dc1-8f57-f5f7c988bb26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd4c74666024f6da1975b393e5ef768', 'request_id': 'req-52a1bbd3-e05c-4dc1-8f57-f5f7c988bb26'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:03.039592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-52a1bbd3-e05c-4dc1-8f57-f5f7c988bb26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd4c74666024f6da1975b393e5ef768', 'request_id': 'req-52a1bbd3-e05c-4dc1-8f57-f5f7c988bb26'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:03.045861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-52a1bbd3-e05c-4dc1-8f57-f5f7c988bb26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd4c74666024f6da1975b393e5ef768', 'request_id': 'req-52a1bbd3-e05c-4dc1-8f57-f5f7c988bb26'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:03.126807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-52a1bbd3-e05c-4dc1-8f57-f5f7c988bb26 admin admin] The token cache is being invalidate because project 4bd4c74666024f6da1975b393e5ef768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:37:03.127039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-52a1bbd3-e05c-4dc1-8f57-f5f7c988bb26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:03.127677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-52a1bbd3-e05c-4dc1-8f57-f5f7c988bb26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:03.129422 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3602/7131] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:37:02 2022] DELETE /identity/v3/projects/4bd4c74666024f6da1975b393e5ef768 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:37:03.135650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b677a-2454-41ec-87ed-00b1a1725a5d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:03.135966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b677a-2454-41ec-87ed-00b1a1725a5d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:03.136242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b677a-2454-41ec-87ed-00b1a1725a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:03.154480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6b2b677a-2454-41ec-87ed-00b1a1725a5d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:37:03.155698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6b2b677a-2454-41ec-87ed-00b1a1725a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:03.219121 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3530/7132] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:37:03.226916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9faee-2ec4-40aa-96d3-3aa0ba6cdde3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:03.227238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9faee-2ec4-40aa-96d3-3aa0ba6cdde3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:03.228147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9faee-2ec4-40aa-96d3-3aa0ba6cdde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:03.247829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a3f9faee-2ec4-40aa-96d3-3aa0ba6cdde3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:37:03.249135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a3f9faee-2ec4-40aa-96d3-3aa0ba6cdde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:03.258270 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3603/7133] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:37:03.263288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b677a-2454-41ec-87ed-00b1a1725a5d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:03.273609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b677a-2454-41ec-87ed-00b1a1725a5d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:03.279663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c22ee-0448-4474-9469-96287d304529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:03.280327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c22ee-0448-4474-9469-96287d304529 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:03.280609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c22ee-0448-4474-9469-96287d304529 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:03.280882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c22ee-0448-4474-9469-96287d304529 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:03.281959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c22ee-0448-4474-9469-96287d304529 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:37:03.282422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c22ee-0448-4474-9469-96287d304529 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:03.283890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c22ee-0448-4474-9469-96287d304529 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:03.300747 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3531/7134] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:37:03.301959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9faee-2ec4-40aa-96d3-3aa0ba6cdde3 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:03.313491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9faee-2ec4-40aa-96d3-3aa0ba6cdde3 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:03.319615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b2b11-7457-454c-8264-601d80524d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:03.321574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b2b11-7457-454c-8264-601d80524d29 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:03.321574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b2b11-7457-454c-8264-601d80524d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:03.321574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b2b11-7457-454c-8264-601d80524d29 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:03.321574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b2b11-7457-454c-8264-601d80524d29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:03.324121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b2b11-7457-454c-8264-601d80524d29 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:03.489876 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3604/7135] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:37:03 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:37:03.494658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c22ee-0448-4474-9469-96287d304529 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:03.505179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c22ee-0448-4474-9469-96287d304529 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:03.570057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa379861-3408-4ea3-ac0a-e953c1d74e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:03.570744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa379861-3408-4ea3-ac0a-e953c1d74e5f admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:03.571150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa379861-3408-4ea3-ac0a-e953c1d74e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:03.571484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa379861-3408-4ea3-ac0a-e953c1d74e5f admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:03.572169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa379861-3408-4ea3-ac0a-e953c1d74e5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:03.574150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa379861-3408-4ea3-ac0a-e953c1d74e5f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:03.643650 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3532/7136] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:37:03 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:37:03.647683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b2b11-7457-454c-8264-601d80524d29 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:03.659985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b2b11-7457-454c-8264-601d80524d29 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:03.665661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ff4d2-117d-4aab-83d0-597c659ab023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:03.666741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ff4d2-117d-4aab-83d0-597c659ab023 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:03.667238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ff4d2-117d-4aab-83d0-597c659ab023 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:03.667690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ff4d2-117d-4aab-83d0-597c659ab023 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:03.668413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ff4d2-117d-4aab-83d0-597c659ab023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:03.670018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ff4d2-117d-4aab-83d0-597c659ab023 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:03.681506 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3605/7137] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:37:03.685563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa379861-3408-4ea3-ac0a-e953c1d74e5f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:03.697838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa379861-3408-4ea3-ac0a-e953c1d74e5f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:03.702923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be18bf1-294c-4804-b5aa-a462aa5d3f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:03.703390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be18bf1-294c-4804-b5aa-a462aa5d3f53 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:03.708030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be18bf1-294c-4804-b5aa-a462aa5d3f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:03.708368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be18bf1-294c-4804-b5aa-a462aa5d3f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:03.709167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be18bf1-294c-4804-b5aa-a462aa5d3f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:03.711266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be18bf1-294c-4804-b5aa-a462aa5d3f53 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:03.725833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:03.725833 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3533/7138] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:37:03.729447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ff4d2-117d-4aab-83d0-597c659ab023 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:03.742189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ff4d2-117d-4aab-83d0-597c659ab023 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:03.758792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b148b7f-3d8e-4ef8-b15f-a8265b987171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:03.760271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b148b7f-3d8e-4ef8-b15f-a8265b987171 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:03.760538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b148b7f-3d8e-4ef8-b15f-a8265b987171 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:03.760816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b148b7f-3d8e-4ef8-b15f-a8265b987171 admin admin] PATH_INFO: `/v3/projects/c34fb98fe7bd4b2e9587a9e5e705fb58/users/ab8273c35e0d42c480c899f24c08c898/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:03.779150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b148b7f-3d8e-4ef8-b15f-a8265b987171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34fb98fe7bd4b2e9587a9e5e705fb58, user_id=ab8273c35e0d42c480c899f24c08c898, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:03.781843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b148b7f-3d8e-4ef8-b15f-a8265b987171 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:03.875697 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3606/7139] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:37:03 2022] PUT /identity/v3/projects/c34fb98fe7bd4b2e9587a9e5e705fb58/users/ab8273c35e0d42c480c899f24c08c898/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:37:03.887881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1992043-b5fa-41b3-8502-b9f8dd6211b3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:03.888223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1992043-b5fa-41b3-8502-b9f8dd6211b3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:03.888537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1992043-b5fa-41b3-8502-b9f8dd6211b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:03.926063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a1992043-b5fa-41b3-8502-b9f8dd6211b3 None None] MFA Rules not processed for user `ab8273c35e0d42c480c899f24c08c898`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:37:03.927438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a1992043-b5fa-41b3-8502-b9f8dd6211b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:04.005140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:04.005732 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3534/7140] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:37:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:37:04.008431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b148b7f-3d8e-4ef8-b15f-a8265b987171 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:04.076387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b148b7f-3d8e-4ef8-b15f-a8265b987171 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:04.081444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec66dde-adba-4e3f-8d01-5bfe333702fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:04.082097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec66dde-adba-4e3f-8d01-5bfe333702fa admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:04.082374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec66dde-adba-4e3f-8d01-5bfe333702fa admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:04.082644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec66dde-adba-4e3f-8d01-5bfe333702fa admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:04.083368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec66dde-adba-4e3f-8d01-5bfe333702fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:04.085266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec66dde-adba-4e3f-8d01-5bfe333702fa admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:04.096791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:04.239624 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3607/7141] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:37:04 2022] POST /identity/v3/projects => generated 375 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:37:04.245375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1992043-b5fa-41b3-8502-b9f8dd6211b3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:04.261796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1992043-b5fa-41b3-8502-b9f8dd6211b3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:04.281330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:04.333037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e5e1b-0768-47bf-9380-48fb80a74f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:04.334140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e5e1b-0768-47bf-9380-48fb80a74f87 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:04.334421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e5e1b-0768-47bf-9380-48fb80a74f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:04.334693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e5e1b-0768-47bf-9380-48fb80a74f87 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:04.335413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e5e1b-0768-47bf-9380-48fb80a74f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:04.338208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e5e1b-0768-47bf-9380-48fb80a74f87 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:04.450006 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3535/7142] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:37:04 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:37:04.454007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec66dde-adba-4e3f-8d01-5bfe333702fa admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:04.465573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec66dde-adba-4e3f-8d01-5bfe333702fa admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:04.470177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37f3dc-4f02-44bb-8d52-3445cff3ae41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:04.470927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37f3dc-4f02-44bb-8d52-3445cff3ae41 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:04.471243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37f3dc-4f02-44bb-8d52-3445cff3ae41 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:04.471524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37f3dc-4f02-44bb-8d52-3445cff3ae41 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:04.472241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37f3dc-4f02-44bb-8d52-3445cff3ae41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:04.473843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37f3dc-4f02-44bb-8d52-3445cff3ae41 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:04.485523 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3608/7143] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:37:04.489732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e5e1b-0768-47bf-9380-48fb80a74f87 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:04.500267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e5e1b-0768-47bf-9380-48fb80a74f87 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:04.505142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad60a4-fdfc-413e-b9ce-602cc381baa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:04.506104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad60a4-fdfc-413e-b9ce-602cc381baa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:04.506389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad60a4-fdfc-413e-b9ce-602cc381baa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:04.506670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad60a4-fdfc-413e-b9ce-602cc381baa9 admin admin] PATH_INFO: `/v3/projects/5f3542b175b04a48be5b389396201530/users/5aebdd73fb494dca9f2ce7858ccb80df/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:04.523373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad60a4-fdfc-413e-b9ce-602cc381baa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3542b175b04a48be5b389396201530, user_id=5aebdd73fb494dca9f2ce7858ccb80df, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:04.526831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad60a4-fdfc-413e-b9ce-602cc381baa9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:04.602217 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3536/7144] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:37:04 2022] PUT /identity/v3/projects/5f3542b175b04a48be5b389396201530/users/5aebdd73fb494dca9f2ce7858ccb80df/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:37:04.607271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37f3dc-4f02-44bb-8d52-3445cff3ae41 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:04.618001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37f3dc-4f02-44bb-8d52-3445cff3ae41 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:04.620012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:04.677393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b654a8-6ceb-4b34-8258-d04778e7b0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:04.678053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b654a8-6ceb-4b34-8258-d04778e7b0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:04.678330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b654a8-6ceb-4b34-8258-d04778e7b0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:04.678617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b654a8-6ceb-4b34-8258-d04778e7b0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:04.679342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b654a8-6ceb-4b34-8258-d04778e7b0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:04.681621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b654a8-6ceb-4b34-8258-d04778e7b0b5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:04.691271 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3609/7145] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:37:04.695544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad60a4-fdfc-413e-b9ce-602cc381baa9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:04.713954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad60a4-fdfc-413e-b9ce-602cc381baa9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:04.719304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce9348-7a4d-4a31-8c55-2266fc0bee73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:04.720332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce9348-7a4d-4a31-8c55-2266fc0bee73 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:04.720621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce9348-7a4d-4a31-8c55-2266fc0bee73 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:04.720905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce9348-7a4d-4a31-8c55-2266fc0bee73 admin admin] PATH_INFO: `/v3/projects/5f3542b175b04a48be5b389396201530/users/5aebdd73fb494dca9f2ce7858ccb80df/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:04.723104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce9348-7a4d-4a31-8c55-2266fc0bee73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3542b175b04a48be5b389396201530, user_id=5aebdd73fb494dca9f2ce7858ccb80df, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:04.725769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce9348-7a4d-4a31-8c55-2266fc0bee73 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:04.737304 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3537/7146] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:37:04 2022] PUT /identity/v3/projects/5f3542b175b04a48be5b389396201530/users/5aebdd73fb494dca9f2ce7858ccb80df/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:37:04.749014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff55fee-eee3-4fb4-8f57-b80aa391b319 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:04.749316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff55fee-eee3-4fb4-8f57-b80aa391b319 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:04.749600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff55fee-eee3-4fb4-8f57-b80aa391b319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:04.779302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2ff55fee-eee3-4fb4-8f57-b80aa391b319 None None] MFA Rules not processed for user `5aebdd73fb494dca9f2ce7858ccb80df`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:37:04.780587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2ff55fee-eee3-4fb4-8f57-b80aa391b319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:04.853469 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3610/7147] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:37:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:37:04.866167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce9348-7a4d-4a31-8c55-2266fc0bee73 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:04.870679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e0ce9348-7a4d-4a31-8c55-2266fc0bee73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:04.942775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce9348-7a4d-4a31-8c55-2266fc0bee73 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:04.948039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc895b6-8f44-4073-ab68-fde47d5b9fc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:04.948682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc895b6-8f44-4073-ab68-fde47d5b9fc1 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:04.948959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc895b6-8f44-4073-ab68-fde47d5b9fc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:04.949265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc895b6-8f44-4073-ab68-fde47d5b9fc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:04.960024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc895b6-8f44-4073-ab68-fde47d5b9fc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:04.961483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc895b6-8f44-4073-ab68-fde47d5b9fc1 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:04.972410 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3538/7148] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:37:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:37:05.307498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:12.223539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff55fee-eee3-4fb4-8f57-b80aa391b319 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:12.225825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2ff55fee-eee3-4fb4-8f57-b80aa391b319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:12.313573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:12.319982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff55fee-eee3-4fb4-8f57-b80aa391b319 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:12.326164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0f567-4d0b-4465-ac05-5a3bb240afc3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:12.327094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0f567-4d0b-4465-ac05-5a3bb240afc3 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:12.327552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0f567-4d0b-4465-ac05-5a3bb240afc3 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:12.328185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0f567-4d0b-4465-ac05-5a3bb240afc3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:12.330261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-98b0f567-4d0b-4465-ac05-5a3bb240afc3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:12.347900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0f567-4d0b-4465-ac05-5a3bb240afc3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:12.349805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0f567-4d0b-4465-ac05-5a3bb240afc3 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:12.370090 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3611/7149] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:37:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:37:12.404241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc895b6-8f44-4073-ab68-fde47d5b9fc1 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:12.419635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc895b6-8f44-4073-ab68-fde47d5b9fc1 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:12.442121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049f1c4-cc20-462b-8fa2-197c7b073491 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aebdd73fb494dca9f2ce7858ccb80df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3542b175b04a48be5b389396201530', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:12.442121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049f1c4-cc20-462b-8fa2-197c7b073491 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:12.442121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049f1c4-cc20-462b-8fa2-197c7b073491 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:12.442399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049f1c4-cc20-462b-8fa2-197c7b073491 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:12.442743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049f1c4-cc20-462b-8fa2-197c7b073491 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:37:12.443799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049f1c4-cc20-462b-8fa2-197c7b073491 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:12.448536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049f1c4-cc20-462b-8fa2-197c7b073491 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:12.481385 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3539/7150] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:37:12.485678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0f567-4d0b-4465-ac05-5a3bb240afc3 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:12.506054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0f567-4d0b-4465-ac05-5a3bb240afc3 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:12.512289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d989f4-78e4-4afa-91dc-fb605fa3058a tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aebdd73fb494dca9f2ce7858ccb80df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3542b175b04a48be5b389396201530', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:12.512988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d989f4-78e4-4afa-91dc-fb605fa3058a tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:12.513270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d989f4-78e4-4afa-91dc-fb605fa3058a tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:12.513682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d989f4-78e4-4afa-91dc-fb605fa3058a tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:12.514337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d989f4-78e4-4afa-91dc-fb605fa3058a tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:12.517169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d989f4-78e4-4afa-91dc-fb605fa3058a tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:12.675442 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3612/7151] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:37:12 2022] POST /identity/v3/projects => generated 347 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:37:12.679366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049f1c4-cc20-462b-8fa2-197c7b073491 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:12.692237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049f1c4-cc20-462b-8fa2-197c7b073491 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:12.783588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac5ec5-d14d-4df8-a167-5ddb48c6b833 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aebdd73fb494dca9f2ce7858ccb80df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3542b175b04a48be5b389396201530', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:12.784636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac5ec5-d14d-4df8-a167-5ddb48c6b833 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:12.784928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac5ec5-d14d-4df8-a167-5ddb48c6b833 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:12.785213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac5ec5-d14d-4df8-a167-5ddb48c6b833 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:12.786107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac5ec5-d14d-4df8-a167-5ddb48c6b833 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:37:12.786427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac5ec5-d14d-4df8-a167-5ddb48c6b833 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:12.788065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac5ec5-d14d-4df8-a167-5ddb48c6b833 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:12.804786 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3540/7152] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:37:13.677088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d989f4-78e4-4afa-91dc-fb605fa3058a tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:13.688513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d989f4-78e4-4afa-91dc-fb605fa3058a tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:13.693980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a9bcd-bcac-4930-9b1f-7e45adff41c7 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aebdd73fb494dca9f2ce7858ccb80df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3542b175b04a48be5b389396201530', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:13.694335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a9bcd-bcac-4930-9b1f-7e45adff41c7 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:13.694624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a9bcd-bcac-4930-9b1f-7e45adff41c7 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:13.694901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a9bcd-bcac-4930-9b1f-7e45adff41c7 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] PATH_INFO: `/v3/projects/5f4755ac22944dda8604453f7b1416c6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:13.696133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a9bcd-bcac-4930-9b1f-7e45adff41c7 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5f4755ac22944dda8604453f7b1416c6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:13.698979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a9bcd-bcac-4930-9b1f-7e45adff41c7 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:13.822489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c79a9bcd-bcac-4930-9b1f-7e45adff41c7 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f4755ac22944dda8604453f7b1416c6', 'request_id': 'req-c79a9bcd-bcac-4930-9b1f-7e45adff41c7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:13.832871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c79a9bcd-bcac-4930-9b1f-7e45adff41c7 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f4755ac22944dda8604453f7b1416c6', 'request_id': 'req-c79a9bcd-bcac-4930-9b1f-7e45adff41c7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:13.839245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c79a9bcd-bcac-4930-9b1f-7e45adff41c7 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f4755ac22944dda8604453f7b1416c6', 'request_id': 'req-c79a9bcd-bcac-4930-9b1f-7e45adff41c7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:13.883659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c79a9bcd-bcac-4930-9b1f-7e45adff41c7 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] The token cache is being invalidate because project 5f4755ac22944dda8604453f7b1416c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:37:13.883853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c79a9bcd-bcac-4930-9b1f-7e45adff41c7 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:13.884682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c79a9bcd-bcac-4930-9b1f-7e45adff41c7 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:13.890646 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3613/7153] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:37:13 2022] DELETE /identity/v3/projects/5f4755ac22944dda8604453f7b1416c6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:37:13.897447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac5ec5-d14d-4df8-a167-5ddb48c6b833 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:13.900026 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-33ac5ec5-d14d-4df8-a167-5ddb48c6b833 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:13.964400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac5ec5-d14d-4df8-a167-5ddb48c6b833 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:13.976143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:14.015332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4935cae-997b-45ed-8cce-e956e7f1cddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:14.016362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4935cae-997b-45ed-8cce-e956e7f1cddb service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:14.016692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4935cae-997b-45ed-8cce-e956e7f1cddb service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:14.016975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4935cae-997b-45ed-8cce-e956e7f1cddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:14.018758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b4935cae-997b-45ed-8cce-e956e7f1cddb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:14.078208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4935cae-997b-45ed-8cce-e956e7f1cddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:14.079729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4935cae-997b-45ed-8cce-e956e7f1cddb service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:14.089949 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3541/7154] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:37:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:37:23.880224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=40,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:24.112617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=41 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:30.984587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a9bcd-bcac-4930-9b1f-7e45adff41c7 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:30.986131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c79a9bcd-bcac-4930-9b1f-7e45adff41c7 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:31.052306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a9bcd-bcac-4930-9b1f-7e45adff41c7 tempest-RoutersIpV6AdminTest-234969025 tempest-RoutersIpV6AdminTest-234969025-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:31.058102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382227f-bf5a-492a-9ea8-68bd961ab862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:31.059076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382227f-bf5a-492a-9ea8-68bd961ab862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:31.059516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382227f-bf5a-492a-9ea8-68bd961ab862 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:31.059795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382227f-bf5a-492a-9ea8-68bd961ab862 admin admin] PATH_INFO: `/v3/users/27dd59929c0e400983543373d4ba0a98` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:31.061017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382227f-bf5a-492a-9ea8-68bd961ab862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27dd59929c0e400983543373d4ba0a98)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:31.062931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382227f-bf5a-492a-9ea8-68bd961ab862 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:31.226187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b382227f-bf5a-492a-9ea8-68bd961ab862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27dd59929c0e400983543373d4ba0a98'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:31.236795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b382227f-bf5a-492a-9ea8-68bd961ab862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27dd59929c0e400983543373d4ba0a98'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:31.347220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b382227f-bf5a-492a-9ea8-68bd961ab862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27dd59929c0e400983543373d4ba0a98'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:31.347868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b382227f-bf5a-492a-9ea8-68bd961ab862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27dd59929c0e400983543373d4ba0a98'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:31.349741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4935cae-997b-45ed-8cce-e956e7f1cddb service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:31.351361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b4935cae-997b-45ed-8cce-e956e7f1cddb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:31.364887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b382227f-bf5a-492a-9ea8-68bd961ab862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27dd59929c0e400983543373d4ba0a98'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:31.372002 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3614/7155] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:37:30 2022] DELETE /identity/v3/users/27dd59929c0e400983543373d4ba0a98 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:37:31.376429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744f7f8-909d-453e-b7fd-1fb468cb6a56 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:31.376723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744f7f8-909d-453e-b7fd-1fb468cb6a56 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:31.377008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744f7f8-909d-453e-b7fd-1fb468cb6a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:31.400783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b744f7f8-909d-453e-b7fd-1fb468cb6a56 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:37:31.402047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b744f7f8-909d-453e-b7fd-1fb468cb6a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:31.466680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4935cae-997b-45ed-8cce-e956e7f1cddb service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:31.479534 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3615/7156] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:37:31.490085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744f7f8-909d-453e-b7fd-1fb468cb6a56 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:31.491512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b744f7f8-909d-453e-b7fd-1fb468cb6a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:31.518380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:31.553113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1558b09-ebe9-477e-a59e-199e4e409859 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:31.553941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1558b09-ebe9-477e-a59e-199e4e409859 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:31.554090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1558b09-ebe9-477e-a59e-199e4e409859 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:31.554327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1558b09-ebe9-477e-a59e-199e4e409859 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:31.556652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e1558b09-ebe9-477e-a59e-199e4e409859 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:31.597486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744f7f8-909d-453e-b7fd-1fb468cb6a56 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:31.605984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd76ad9-656c-4b14-aa97-61eec9143e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:31.606993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd76ad9-656c-4b14-aa97-61eec9143e8b service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:31.607308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd76ad9-656c-4b14-aa97-61eec9143e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:31.607621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd76ad9-656c-4b14-aa97-61eec9143e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:31.620553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd76ad9-656c-4b14-aa97-61eec9143e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:31.622095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd76ad9-656c-4b14-aa97-61eec9143e8b service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:31.636419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1558b09-ebe9-477e-a59e-199e4e409859 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:31.638031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1558b09-ebe9-477e-a59e-199e4e409859 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:31.652914 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3616/7157] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:37:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:37:31.662451 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3542/7158] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:37:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:37:32.249839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd76ad9-656c-4b14-aa97-61eec9143e8b service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:32.252020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1fd76ad9-656c-4b14-aa97-61eec9143e8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:32.280173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd76ad9-656c-4b14-aa97-61eec9143e8b service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:32.296249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1112a0d-18e5-422b-a81d-876a38080401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:32.296873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1112a0d-18e5-422b-a81d-876a38080401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:32.297202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1112a0d-18e5-422b-a81d-876a38080401 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:32.297408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1112a0d-18e5-422b-a81d-876a38080401 admin admin] PATH_INFO: `/v3/projects/fbb367bc7a20470f9af2e1387f654d99` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:32.299062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1112a0d-18e5-422b-a81d-876a38080401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbb367bc7a20470f9af2e1387f654d99)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:32.301281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1112a0d-18e5-422b-a81d-876a38080401 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:32.456043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e1112a0d-18e5-422b-a81d-876a38080401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbb367bc7a20470f9af2e1387f654d99', 'request_id': 'req-e1112a0d-18e5-422b-a81d-876a38080401'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:32.469690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e1112a0d-18e5-422b-a81d-876a38080401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbb367bc7a20470f9af2e1387f654d99', 'request_id': 'req-e1112a0d-18e5-422b-a81d-876a38080401'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:32.479638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e1112a0d-18e5-422b-a81d-876a38080401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbb367bc7a20470f9af2e1387f654d99', 'request_id': 'req-e1112a0d-18e5-422b-a81d-876a38080401'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:32.576058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e1112a0d-18e5-422b-a81d-876a38080401 admin admin] The token cache is being invalidate because project fbb367bc7a20470f9af2e1387f654d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:37:32.582118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e1112a0d-18e5-422b-a81d-876a38080401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:32.582118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e1112a0d-18e5-422b-a81d-876a38080401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:32.582118 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3617/7159] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:37:32 2022] DELETE /identity/v3/projects/fbb367bc7a20470f9af2e1387f654d99 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:37:32.583743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd25c01-dc03-4f17-b937-a7f0cccdf645 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:32.584230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd25c01-dc03-4f17-b937-a7f0cccdf645 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:32.584332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd25c01-dc03-4f17-b937-a7f0cccdf645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:32.605097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3dd25c01-dc03-4f17-b937-a7f0cccdf645 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:37:32.606637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3dd25c01-dc03-4f17-b937-a7f0cccdf645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:32.643976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:32.690028 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3543/7160] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:37:32.693900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20853adc-246d-4ad5-ab0f-94b5ae53dce5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:32.694197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20853adc-246d-4ad5-ab0f-94b5ae53dce5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:32.694479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20853adc-246d-4ad5-ab0f-94b5ae53dce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:32.714907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-20853adc-246d-4ad5-ab0f-94b5ae53dce5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:37:32.716335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-20853adc-246d-4ad5-ab0f-94b5ae53dce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:32.725491 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3618/7161] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:37:32.730156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd25c01-dc03-4f17-b937-a7f0cccdf645 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:32.740194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd25c01-dc03-4f17-b937-a7f0cccdf645 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:32.745008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3af63-0851-4ac5-9394-224c87804987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:32.745666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3af63-0851-4ac5-9394-224c87804987 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:32.745949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3af63-0851-4ac5-9394-224c87804987 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:32.746225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3af63-0851-4ac5-9394-224c87804987 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:32.746945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3af63-0851-4ac5-9394-224c87804987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:37:32.747307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3af63-0851-4ac5-9394-224c87804987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:32.748909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3af63-0851-4ac5-9394-224c87804987 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:32.762166 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3544/7162] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:37:32.766855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20853adc-246d-4ad5-ab0f-94b5ae53dce5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:32.777250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20853adc-246d-4ad5-ab0f-94b5ae53dce5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:32.788979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943e896-b2f9-42ac-a7cf-2fd4e1a18d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:32.789648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943e896-b2f9-42ac-a7cf-2fd4e1a18d1c admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:32.790105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943e896-b2f9-42ac-a7cf-2fd4e1a18d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:32.790463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943e896-b2f9-42ac-a7cf-2fd4e1a18d1c admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:32.791196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943e896-b2f9-42ac-a7cf-2fd4e1a18d1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:32.793338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943e896-b2f9-42ac-a7cf-2fd4e1a18d1c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:32.895491 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3619/7163] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:37:32 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:37:32.896427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3af63-0851-4ac5-9394-224c87804987 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:32.907676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3af63-0851-4ac5-9394-224c87804987 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:32.974085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8c01b-978f-4135-8551-a8406bce4f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:32.974767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8c01b-978f-4135-8551-a8406bce4f71 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:32.975076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8c01b-978f-4135-8551-a8406bce4f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:32.975349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8c01b-978f-4135-8551-a8406bce4f71 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:32.976033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8c01b-978f-4135-8551-a8406bce4f71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:32.978714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8c01b-978f-4135-8551-a8406bce4f71 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:33.056102 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3545/7164] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:37:32 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:37:33.060570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943e896-b2f9-42ac-a7cf-2fd4e1a18d1c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:33.072194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943e896-b2f9-42ac-a7cf-2fd4e1a18d1c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:33.076856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472be7ad-f467-4055-bc73-a17e3db4f1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:33.077512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be7ad-f467-4055-bc73-a17e3db4f1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:33.077795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be7ad-f467-4055-bc73-a17e3db4f1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:33.078097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be7ad-f467-4055-bc73-a17e3db4f1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:33.078814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472be7ad-f467-4055-bc73-a17e3db4f1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:33.080449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472be7ad-f467-4055-bc73-a17e3db4f1f8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:33.090925 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3620/7165] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:37:33.095056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8c01b-978f-4135-8551-a8406bce4f71 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:33.106106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8c01b-978f-4135-8551-a8406bce4f71 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:33.111518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844e22c-ab89-46fa-92c8-99bc1898b645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:33.112181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844e22c-ab89-46fa-92c8-99bc1898b645 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:33.115643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844e22c-ab89-46fa-92c8-99bc1898b645 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:33.115643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844e22c-ab89-46fa-92c8-99bc1898b645 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:33.115643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844e22c-ab89-46fa-92c8-99bc1898b645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:33.115643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844e22c-ab89-46fa-92c8-99bc1898b645 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:33.126475 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3546/7166] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:37:33.130390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472be7ad-f467-4055-bc73-a17e3db4f1f8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:33.141880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472be7ad-f467-4055-bc73-a17e3db4f1f8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:33.146780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3db9a4-3a8b-433d-a910-e90d69e92025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:33.147710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3db9a4-3a8b-433d-a910-e90d69e92025 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:33.147993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3db9a4-3a8b-433d-a910-e90d69e92025 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:33.148262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3db9a4-3a8b-433d-a910-e90d69e92025 admin admin] PATH_INFO: `/v3/projects/7a19b745575c4978b44313f03299150d/users/e4863e3d74a540519dc328f45c79519f/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:33.163840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3db9a4-3a8b-433d-a910-e90d69e92025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a19b745575c4978b44313f03299150d, user_id=e4863e3d74a540519dc328f45c79519f, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:33.169997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3db9a4-3a8b-433d-a910-e90d69e92025 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:33.263564 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3621/7167] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:37:33 2022] PUT /identity/v3/projects/7a19b745575c4978b44313f03299150d/users/e4863e3d74a540519dc328f45c79519f/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:37:33.271516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b1bc1-ca71-49e5-bf9c-b263487e2a8b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:33.271516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b1bc1-ca71-49e5-bf9c-b263487e2a8b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:33.271516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b1bc1-ca71-49e5-bf9c-b263487e2a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:33.295678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7f3b1bc1-ca71-49e5-bf9c-b263487e2a8b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:37:33.297056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7f3b1bc1-ca71-49e5-bf9c-b263487e2a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:33.380138 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3547/7168] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:37:33.387585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3db9a4-3a8b-433d-a910-e90d69e92025 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:33.389764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fd3db9a4-3a8b-433d-a910-e90d69e92025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:33.441895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:33.458004 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3db9a4-3a8b-433d-a910-e90d69e92025 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:33.461911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48014a24-5634-488b-a79b-1d3315600424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:33.462752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48014a24-5634-488b-a79b-1d3315600424 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:33.463062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48014a24-5634-488b-a79b-1d3315600424 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:33.463387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48014a24-5634-488b-a79b-1d3315600424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:33.474980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48014a24-5634-488b-a79b-1d3315600424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:33.476740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48014a24-5634-488b-a79b-1d3315600424 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:33.513048 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3622/7169] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:37:40.414648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b1bc1-ca71-49e5-bf9c-b263487e2a8b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:40.439764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b1bc1-ca71-49e5-bf9c-b263487e2a8b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:40.447626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09502162-26a2-4cf6-9d25-f5fd8429ce2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:40.448775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09502162-26a2-4cf6-9d25-f5fd8429ce2c service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:40.449051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09502162-26a2-4cf6-9d25-f5fd8429ce2c service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:40.449323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09502162-26a2-4cf6-9d25-f5fd8429ce2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:40.451654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-09502162-26a2-4cf6-9d25-f5fd8429ce2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:40.471113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09502162-26a2-4cf6-9d25-f5fd8429ce2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:40.471302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09502162-26a2-4cf6-9d25-f5fd8429ce2c service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:40.490414 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3548/7170] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:37:43.614459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:44.472141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d17b2-c24e-448d-8971-eb3742613349 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:44.472432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d17b2-c24e-448d-8971-eb3742613349 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:44.472734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d17b2-c24e-448d-8971-eb3742613349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:44.502340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5a2d17b2-c24e-448d-8971-eb3742613349 None None] MFA Rules not processed for user `e4863e3d74a540519dc328f45c79519f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:37:44.503657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5a2d17b2-c24e-448d-8971-eb3742613349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:44.598804 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3623/7171] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:37:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:37:44.603428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09502162-26a2-4cf6-9d25-f5fd8429ce2c service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:44.630428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09502162-26a2-4cf6-9d25-f5fd8429ce2c service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:44.673058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7735aed-87c7-475b-a02c-06e56c277112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:44.673744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7735aed-87c7-475b-a02c-06e56c277112 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:44.674027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7735aed-87c7-475b-a02c-06e56c277112 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:44.674301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7735aed-87c7-475b-a02c-06e56c277112 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:44.676441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7735aed-87c7-475b-a02c-06e56c277112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:44.688380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7735aed-87c7-475b-a02c-06e56c277112 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:44.811276 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3549/7172] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:37:44 2022] POST /identity/v3/projects => generated 379 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:37:44.816536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d17b2-c24e-448d-8971-eb3742613349 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:44.830411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d17b2-c24e-448d-8971-eb3742613349 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:44.902292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d48cde-85a5-4c70-811b-36b8cc4118ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:44.902951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d48cde-85a5-4c70-811b-36b8cc4118ef admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:44.903275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d48cde-85a5-4c70-811b-36b8cc4118ef admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:44.903558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d48cde-85a5-4c70-811b-36b8cc4118ef admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:44.904264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d48cde-85a5-4c70-811b-36b8cc4118ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:44.906551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d48cde-85a5-4c70-811b-36b8cc4118ef admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:45.027750 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3624/7173] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:37:44 2022] POST /identity/v3/users => generated 296 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:37:45.031502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7735aed-87c7-475b-a02c-06e56c277112 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:45.061509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7735aed-87c7-475b-a02c-06e56c277112 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:45.070502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be5730-ccf2-4227-8d0a-ada3c8ab23b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:45.072345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be5730-ccf2-4227-8d0a-ada3c8ab23b5 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:45.072789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be5730-ccf2-4227-8d0a-ada3c8ab23b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:45.073413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be5730-ccf2-4227-8d0a-ada3c8ab23b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:45.074724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be5730-ccf2-4227-8d0a-ada3c8ab23b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:45.078184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be5730-ccf2-4227-8d0a-ada3c8ab23b5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:45.081198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:45.096958 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3550/7174] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:37:45.101018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d48cde-85a5-4c70-811b-36b8cc4118ef admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:45.120560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d48cde-85a5-4c70-811b-36b8cc4118ef admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:45.157315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b33190-a696-4d60-af66-d84e78c00150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:45.159877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b33190-a696-4d60-af66-d84e78c00150 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:45.162344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b33190-a696-4d60-af66-d84e78c00150 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:45.162742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b33190-a696-4d60-af66-d84e78c00150 admin admin] PATH_INFO: `/v3/projects/315d04019957416a8d2c250e7200a419/users/662cd174483f4ecab4ab8b4b49936bb6/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:45.214418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b33190-a696-4d60-af66-d84e78c00150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=315d04019957416a8d2c250e7200a419, user_id=662cd174483f4ecab4ab8b4b49936bb6, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:45.217184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b33190-a696-4d60-af66-d84e78c00150 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:45.327671 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3625/7175] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:37:45 2022] PUT /identity/v3/projects/315d04019957416a8d2c250e7200a419/users/662cd174483f4ecab4ab8b4b49936bb6/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:37:45.331498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be5730-ccf2-4227-8d0a-ada3c8ab23b5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:45.342943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be5730-ccf2-4227-8d0a-ada3c8ab23b5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:45.439177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedea84-d079-4251-8d12-bf10841a0fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:45.440133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedea84-d079-4251-8d12-bf10841a0fdd admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:45.440603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedea84-d079-4251-8d12-bf10841a0fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:45.440972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedea84-d079-4251-8d12-bf10841a0fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:45.441801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedea84-d079-4251-8d12-bf10841a0fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:45.443833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedea84-d079-4251-8d12-bf10841a0fdd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:45.454747 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3551/7176] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:37:45.459092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b33190-a696-4d60-af66-d84e78c00150 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:45.470175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b33190-a696-4d60-af66-d84e78c00150 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:45.475067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72f098-b821-476b-8701-2961ddf4ae5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:45.475951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72f098-b821-476b-8701-2961ddf4ae5d admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:45.476310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72f098-b821-476b-8701-2961ddf4ae5d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:45.478035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72f098-b821-476b-8701-2961ddf4ae5d admin admin] PATH_INFO: `/v3/projects/315d04019957416a8d2c250e7200a419/users/662cd174483f4ecab4ab8b4b49936bb6/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:45.480497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72f098-b821-476b-8701-2961ddf4ae5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=315d04019957416a8d2c250e7200a419, user_id=662cd174483f4ecab4ab8b4b49936bb6, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:45.483503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72f098-b821-476b-8701-2961ddf4ae5d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:45.494899 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3626/7177] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:37:45 2022] PUT /identity/v3/projects/315d04019957416a8d2c250e7200a419/users/662cd174483f4ecab4ab8b4b49936bb6/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:37:45.529116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915bc1b-239d-4e80-86bc-4c0b300131ff None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:45.529448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915bc1b-239d-4e80-86bc-4c0b300131ff None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:45.529688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915bc1b-239d-4e80-86bc-4c0b300131ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:45.559104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2915bc1b-239d-4e80-86bc-4c0b300131ff None None] MFA Rules not processed for user `0ab8b3f06e994bbca5d6dd14109bfe50`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:37:45.560316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2915bc1b-239d-4e80-86bc-4c0b300131ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:45.656416 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3552/7178] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:37:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:37:47.406725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72f098-b821-476b-8701-2961ddf4ae5d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:47.409673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8b72f098-b821-476b-8701-2961ddf4ae5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:47.472227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:47.504953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72f098-b821-476b-8701-2961ddf4ae5d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:47.513385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fbf3b-1b78-48cb-ab05-4b5617299421 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:47.513977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fbf3b-1b78-48cb-ab05-4b5617299421 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:47.514334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fbf3b-1b78-48cb-ab05-4b5617299421 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:47.514686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fbf3b-1b78-48cb-ab05-4b5617299421 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:47.517141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ef6fbf3b-1b78-48cb-ab05-4b5617299421 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:47.536154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6fbf3b-1b78-48cb-ab05-4b5617299421 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:47.537975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6fbf3b-1b78-48cb-ab05-4b5617299421 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:47.560351 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3627/7179] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:37:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:37:55.150393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024e506-bb57-44e2-b8c8-e0b5621791a9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:55.163394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024e506-bb57-44e2-b8c8-e0b5621791a9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:55.163394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024e506-bb57-44e2-b8c8-e0b5621791a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:55.218176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d024e506-bb57-44e2-b8c8-e0b5621791a9 None None] MFA Rules not processed for user `662cd174483f4ecab4ab8b4b49936bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:37:55.221471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d024e506-bb57-44e2-b8c8-e0b5621791a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:55.340132 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3553/7180] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:37:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:37:55.351277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fbf3b-1b78-48cb-ab05-4b5617299421 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:55.353178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ef6fbf3b-1b78-48cb-ab05-4b5617299421 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:55.494425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fbf3b-1b78-48cb-ab05-4b5617299421 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:55.500647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e6d31-4e79-478c-a119-ee6c59d66761 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:55.501721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e6d31-4e79-478c-a119-ee6c59d66761 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:55.502234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e6d31-4e79-478c-a119-ee6c59d66761 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:55.502809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e6d31-4e79-478c-a119-ee6c59d66761 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:55.520300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e6d31-4e79-478c-a119-ee6c59d66761 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:55.522202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e6d31-4e79-478c-a119-ee6c59d66761 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:55.534628 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3628/7181] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:37:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:37:55.829941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024e506-bb57-44e2-b8c8-e0b5621791a9 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:55.831839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d024e506-bb57-44e2-b8c8-e0b5621791a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:55.875253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:55.936027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024e506-bb57-44e2-b8c8-e0b5621791a9 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:55.951283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7df848-8224-4f2d-bd4d-675c31050788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:55.952197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7df848-8224-4f2d-bd4d-675c31050788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:55.952485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7df848-8224-4f2d-bd4d-675c31050788 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:55.952767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7df848-8224-4f2d-bd4d-675c31050788 admin admin] PATH_INFO: `/v3/users/4fa446573f7d42de816280280c3dec19` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:55.954956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7df848-8224-4f2d-bd4d-675c31050788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa446573f7d42de816280280c3dec19)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:55.959419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7df848-8224-4f2d-bd4d-675c31050788 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:56.169227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e6d31-4e79-478c-a119-ee6c59d66761 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:56.181499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e6d31-4e79-478c-a119-ee6c59d66761 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:56.191429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548fd53-0f4a-41fa-b06e-d0ed3e3a8003 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:56.192122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548fd53-0f4a-41fa-b06e-d0ed3e3a8003 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:56.192493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548fd53-0f4a-41fa-b06e-d0ed3e3a8003 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:56.192622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548fd53-0f4a-41fa-b06e-d0ed3e3a8003 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:56.198133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d548fd53-0f4a-41fa-b06e-d0ed3e3a8003 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:56.222123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548fd53-0f4a-41fa-b06e-d0ed3e3a8003 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:56.224237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548fd53-0f4a-41fa-b06e-d0ed3e3a8003 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:56.250811 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3629/7182] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:37:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:37:56.263667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fa7df848-8224-4f2d-bd4d-675c31050788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa446573f7d42de816280280c3dec19'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:56.301294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fa7df848-8224-4f2d-bd4d-675c31050788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa446573f7d42de816280280c3dec19'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:56.428029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fa7df848-8224-4f2d-bd4d-675c31050788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa446573f7d42de816280280c3dec19'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:56.439310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fa7df848-8224-4f2d-bd4d-675c31050788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa446573f7d42de816280280c3dec19'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:56.440326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fa7df848-8224-4f2d-bd4d-675c31050788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa446573f7d42de816280280c3dec19'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:56.476340 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3554/7183] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:37:55 2022] DELETE /identity/v3/users/4fa446573f7d42de816280280c3dec19 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:37:56.997884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548fd53-0f4a-41fa-b06e-d0ed3e3a8003 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:56.999390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d548fd53-0f4a-41fa-b06e-d0ed3e3a8003 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:57.028415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548fd53-0f4a-41fa-b06e-d0ed3e3a8003 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:57.154306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56cc6d-e2fb-4aec-b36a-680c87726cff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:57.155425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56cc6d-e2fb-4aec-b36a-680c87726cff service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:57.155860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56cc6d-e2fb-4aec-b36a-680c87726cff service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:57.156291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56cc6d-e2fb-4aec-b36a-680c87726cff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:57.158774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cb56cc6d-e2fb-4aec-b36a-680c87726cff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:57.189277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56cc6d-e2fb-4aec-b36a-680c87726cff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:57.194545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56cc6d-e2fb-4aec-b36a-680c87726cff service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:57.214069 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3630/7184] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:37:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:37:57.681618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7df848-8224-4f2d-bd4d-675c31050788 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:57.684330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fa7df848-8224-4f2d-bd4d-675c31050788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:57.838322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7df848-8224-4f2d-bd4d-675c31050788 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:57.844394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801faa9-f1ef-4f3c-a775-8735468585a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:57.845299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801faa9-f1ef-4f3c-a775-8735468585a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:57.845588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801faa9-f1ef-4f3c-a775-8735468585a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:57.845867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801faa9-f1ef-4f3c-a775-8735468585a0 admin admin] PATH_INFO: `/v3/projects/ce30584a7dfa4ab19de73aa8b18b113b` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:57.847172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801faa9-f1ef-4f3c-a775-8735468585a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce30584a7dfa4ab19de73aa8b18b113b)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:57.850648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801faa9-f1ef-4f3c-a775-8735468585a0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:57.980041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:57.991829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9801faa9-f1ef-4f3c-a775-8735468585a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce30584a7dfa4ab19de73aa8b18b113b', 'request_id': 'req-9801faa9-f1ef-4f3c-a775-8735468585a0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:58.004663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9801faa9-f1ef-4f3c-a775-8735468585a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce30584a7dfa4ab19de73aa8b18b113b', 'request_id': 'req-9801faa9-f1ef-4f3c-a775-8735468585a0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:58.017242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9801faa9-f1ef-4f3c-a775-8735468585a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce30584a7dfa4ab19de73aa8b18b113b', 'request_id': 'req-9801faa9-f1ef-4f3c-a775-8735468585a0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:58.155621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9801faa9-f1ef-4f3c-a775-8735468585a0 admin admin] The token cache is being invalidate because project ce30584a7dfa4ab19de73aa8b18b113b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:37:58.156171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9801faa9-f1ef-4f3c-a775-8735468585a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:58.157072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9801faa9-f1ef-4f3c-a775-8735468585a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:58.162955 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3555/7185] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:37:57 2022] DELETE /identity/v3/projects/ce30584a7dfa4ab19de73aa8b18b113b => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:37:58.164091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56cc6d-e2fb-4aec-b36a-680c87726cff service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:58.182276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56cc6d-e2fb-4aec-b36a-680c87726cff service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:58.260946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:58.289713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7424d-d367-413a-a035-3856d09d03ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:58.290626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7424d-d367-413a-a035-3856d09d03ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:58.291000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7424d-d367-413a-a035-3856d09d03ef admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:58.291506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7424d-d367-413a-a035-3856d09d03ef admin admin] PATH_INFO: `/v3/users/fb1da7e5955443499f924292d85445fe` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:58.292860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7424d-d367-413a-a035-3856d09d03ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb1da7e5955443499f924292d85445fe)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:58.295405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7424d-d367-413a-a035-3856d09d03ef admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:58.547334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4cd7424d-d367-413a-a035-3856d09d03ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb1da7e5955443499f924292d85445fe'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:58.560978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4cd7424d-d367-413a-a035-3856d09d03ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb1da7e5955443499f924292d85445fe'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:58.668716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4cd7424d-d367-413a-a035-3856d09d03ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb1da7e5955443499f924292d85445fe'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:58.671695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4cd7424d-d367-413a-a035-3856d09d03ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb1da7e5955443499f924292d85445fe'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:58.687246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4cd7424d-d367-413a-a035-3856d09d03ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb1da7e5955443499f924292d85445fe'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:58.694781 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3631/7186] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:37:58 2022] DELETE /identity/v3/users/fb1da7e5955443499f924292d85445fe => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:37:59.037560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801faa9-f1ef-4f3c-a775-8735468585a0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:59.041538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9801faa9-f1ef-4f3c-a775-8735468585a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:59.074604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801faa9-f1ef-4f3c-a775-8735468585a0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:59.167846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34a98d-0527-4a76-9d95-fb80b98c1d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:59.169586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34a98d-0527-4a76-9d95-fb80b98c1d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:59.170064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34a98d-0527-4a76-9d95-fb80b98c1d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:59.170541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34a98d-0527-4a76-9d95-fb80b98c1d58 admin admin] PATH_INFO: `/v3/users/ab8273c35e0d42c480c899f24c08c898` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:59.172662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34a98d-0527-4a76-9d95-fb80b98c1d58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab8273c35e0d42c480c899f24c08c898)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:59.177556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34a98d-0527-4a76-9d95-fb80b98c1d58 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:59.224955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7424d-d367-413a-a035-3856d09d03ef admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:59.229058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4cd7424d-d367-413a-a035-3856d09d03ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:59.255824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7424d-d367-413a-a035-3856d09d03ef admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:59.272997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9185ae0-094e-41b5-a53d-ed63d6e839c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:59.274164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9185ae0-094e-41b5-a53d-ed63d6e839c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:59.274461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9185ae0-094e-41b5-a53d-ed63d6e839c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:59.274738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9185ae0-094e-41b5-a53d-ed63d6e839c5 admin admin] PATH_INFO: `/v3/projects/6cb863c3800a43239b21550bfdf9fc86` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:59.276029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9185ae0-094e-41b5-a53d-ed63d6e839c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cb863c3800a43239b21550bfdf9fc86)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:59.277979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9185ae0-094e-41b5-a53d-ed63d6e839c5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:59.451940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9f34a98d-0527-4a76-9d95-fb80b98c1d58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab8273c35e0d42c480c899f24c08c898'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:59.455604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f9185ae0-094e-41b5-a53d-ed63d6e839c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cb863c3800a43239b21550bfdf9fc86', 'request_id': 'req-f9185ae0-094e-41b5-a53d-ed63d6e839c5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:59.469548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f9185ae0-094e-41b5-a53d-ed63d6e839c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cb863c3800a43239b21550bfdf9fc86', 'request_id': 'req-f9185ae0-094e-41b5-a53d-ed63d6e839c5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:59.477665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9f34a98d-0527-4a76-9d95-fb80b98c1d58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab8273c35e0d42c480c899f24c08c898'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:59.485815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f9185ae0-094e-41b5-a53d-ed63d6e839c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cb863c3800a43239b21550bfdf9fc86', 'request_id': 'req-f9185ae0-094e-41b5-a53d-ed63d6e839c5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:59.558743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9f34a98d-0527-4a76-9d95-fb80b98c1d58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab8273c35e0d42c480c899f24c08c898'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:59.568356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9f34a98d-0527-4a76-9d95-fb80b98c1d58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab8273c35e0d42c480c899f24c08c898'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:59.569239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9f34a98d-0527-4a76-9d95-fb80b98c1d58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab8273c35e0d42c480c899f24c08c898'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:59.577101 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3556/7187] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:37:59 2022] DELETE /identity/v3/users/ab8273c35e0d42c480c899f24c08c898 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:37:59.581577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f34674-486a-4449-a9f3-63677a750564 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:59.582349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f34674-486a-4449-a9f3-63677a750564 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:59.582821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f34674-486a-4449-a9f3-63677a750564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:59.603442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-00f34674-486a-4449-a9f3-63677a750564 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:37:59.604939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-00f34674-486a-4449-a9f3-63677a750564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:59.627490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f9185ae0-094e-41b5-a53d-ed63d6e839c5 admin admin] The token cache is being invalidate because project 6cb863c3800a43239b21550bfdf9fc86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:37:59.627901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f9185ae0-094e-41b5-a53d-ed63d6e839c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:59.628789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f9185ae0-094e-41b5-a53d-ed63d6e839c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:37:59.635543 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3632/7188] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:37:59 2022] DELETE /identity/v3/projects/6cb863c3800a43239b21550bfdf9fc86 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:37:59.641331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef09a9c-9f72-43e7-865f-4618e2f8e45f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:59.641331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef09a9c-9f72-43e7-865f-4618e2f8e45f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:59.641331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef09a9c-9f72-43e7-865f-4618e2f8e45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:59.672043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9ef09a9c-9f72-43e7-865f-4618e2f8e45f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:37:59.672224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:59.672330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9ef09a9c-9f72-43e7-865f-4618e2f8e45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:59.685047 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3557/7189] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:37:59.699278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f34674-486a-4449-a9f3-63677a750564 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:59.701164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-00f34674-486a-4449-a9f3-63677a750564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:59.712457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:37:59.752925 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3633/7190] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:37:59.762849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f552f-00ba-4123-aaac-87654b3c14d3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:59.763230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f552f-00ba-4123-aaac-87654b3c14d3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:59.763682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f552f-00ba-4123-aaac-87654b3c14d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:59.792263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-106f552f-00ba-4123-aaac-87654b3c14d3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:37:59.795481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-106f552f-00ba-4123-aaac-87654b3c14d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:37:59.813060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f34674-486a-4449-a9f3-63677a750564 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:59.832102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b317a-20a7-49ed-8810-3d3e1c8cde86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:59.835912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b317a-20a7-49ed-8810-3d3e1c8cde86 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:59.837137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b317a-20a7-49ed-8810-3d3e1c8cde86 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:59.837747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b317a-20a7-49ed-8810-3d3e1c8cde86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:59.839888 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3634/7191] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:37:59.844343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f552f-00ba-4123-aaac-87654b3c14d3 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:59.853928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b317a-20a7-49ed-8810-3d3e1c8cde86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:59.859730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b317a-20a7-49ed-8810-3d3e1c8cde86 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:59.862442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f552f-00ba-4123-aaac-87654b3c14d3 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:37:59.887753 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3558/7192] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:37:59.898523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784b9d4-07fe-41b0-a891-5edd6444f8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:37:59.899346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784b9d4-07fe-41b0-a891-5edd6444f8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:37:59.901075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784b9d4-07fe-41b0-a891-5edd6444f8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:37:59.903072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784b9d4-07fe-41b0-a891-5edd6444f8f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:37:59.904089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784b9d4-07fe-41b0-a891-5edd6444f8f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:37:59.920786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784b9d4-07fe-41b0-a891-5edd6444f8f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:37:59.926803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784b9d4-07fe-41b0-a891-5edd6444f8f8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:37:59.954918 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3635/7193] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:37:59.961118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b317a-20a7-49ed-8810-3d3e1c8cde86 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:37:59.983703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b317a-20a7-49ed-8810-3d3e1c8cde86 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:00.002080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd64bc-80ea-4b91-afda-72d5e25b542d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:00.002757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd64bc-80ea-4b91-afda-72d5e25b542d admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:00.007116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd64bc-80ea-4b91-afda-72d5e25b542d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:00.007834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd64bc-80ea-4b91-afda-72d5e25b542d admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:00.009126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd64bc-80ea-4b91-afda-72d5e25b542d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:00.014402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd64bc-80ea-4b91-afda-72d5e25b542d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:00.161289 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3559/7194] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:37:59 2022] POST /identity/v3/projects => generated 365 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:38:00.165779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784b9d4-07fe-41b0-a891-5edd6444f8f8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:00.177865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784b9d4-07fe-41b0-a891-5edd6444f8f8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:00.311852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30af18-8250-4034-8b70-a06a36df9c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:00.312542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30af18-8250-4034-8b70-a06a36df9c61 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:00.312837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30af18-8250-4034-8b70-a06a36df9c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:00.313236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30af18-8250-4034-8b70-a06a36df9c61 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:00.313928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30af18-8250-4034-8b70-a06a36df9c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:00.316042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30af18-8250-4034-8b70-a06a36df9c61 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:00.445420 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3636/7195] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:38:00 2022] POST /identity/v3/users => generated 283 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:38:00.446738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd64bc-80ea-4b91-afda-72d5e25b542d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:00.473098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd64bc-80ea-4b91-afda-72d5e25b542d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:00.473098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d022fe7-90f4-402c-adad-89430e7b73e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:00.473098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d022fe7-90f4-402c-adad-89430e7b73e1 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:00.473098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d022fe7-90f4-402c-adad-89430e7b73e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:00.473650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d022fe7-90f4-402c-adad-89430e7b73e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:00.473650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d022fe7-90f4-402c-adad-89430e7b73e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:00.474401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d022fe7-90f4-402c-adad-89430e7b73e1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:00.494039 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3560/7196] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:38:00.498209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30af18-8250-4034-8b70-a06a36df9c61 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:00.510726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30af18-8250-4034-8b70-a06a36df9c61 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:00.517330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce8dbc-ba4f-4c2b-acbc-9392f1faee69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:00.518462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce8dbc-ba4f-4c2b-acbc-9392f1faee69 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:00.518860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce8dbc-ba4f-4c2b-acbc-9392f1faee69 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:00.519045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce8dbc-ba4f-4c2b-acbc-9392f1faee69 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:00.519782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce8dbc-ba4f-4c2b-acbc-9392f1faee69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:00.521396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce8dbc-ba4f-4c2b-acbc-9392f1faee69 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:00.545032 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3637/7197] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:00.552416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d022fe7-90f4-402c-adad-89430e7b73e1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:00.572192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d022fe7-90f4-402c-adad-89430e7b73e1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:00.580014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec7b8d-18d4-4e28-9fd5-0b326539388f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:00.582410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec7b8d-18d4-4e28-9fd5-0b326539388f admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:00.582410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec7b8d-18d4-4e28-9fd5-0b326539388f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:00.582970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec7b8d-18d4-4e28-9fd5-0b326539388f admin admin] PATH_INFO: `/v3/projects/c49966713115424c8b2590bc10ba1b0b/users/70b1a8f603244b3f89cd5fcd02239625/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:00.607535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec7b8d-18d4-4e28-9fd5-0b326539388f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c49966713115424c8b2590bc10ba1b0b, user_id=70b1a8f603244b3f89cd5fcd02239625, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:00.611301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec7b8d-18d4-4e28-9fd5-0b326539388f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:00.725416 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3561/7198] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:00 2022] PUT /identity/v3/projects/c49966713115424c8b2590bc10ba1b0b/users/70b1a8f603244b3f89cd5fcd02239625/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:38:00.731654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c27ac8-9ea3-432a-a027-42639ad25d55 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:00.731953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c27ac8-9ea3-432a-a027-42639ad25d55 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:00.732228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c27ac8-9ea3-432a-a027-42639ad25d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:00.756304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-59c27ac8-9ea3-432a-a027-42639ad25d55 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:00.757532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-59c27ac8-9ea3-432a-a027-42639ad25d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:00.789039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec7b8d-18d4-4e28-9fd5-0b326539388f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:00.792559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f9ec7b8d-18d4-4e28-9fd5-0b326539388f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:00.881075 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3638/7199] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:00.892727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c27ac8-9ea3-432a-a027-42639ad25d55 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:00.923873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec7b8d-18d4-4e28-9fd5-0b326539388f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:00.932749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a79c51-0a60-4350-b0bc-e20d004fe770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:00.933633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a79c51-0a60-4350-b0bc-e20d004fe770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:00.934052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a79c51-0a60-4350-b0bc-e20d004fe770 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:00.934348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a79c51-0a60-4350-b0bc-e20d004fe770 admin admin] PATH_INFO: `/v3/projects/c34fb98fe7bd4b2e9587a9e5e705fb58` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:00.935900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a79c51-0a60-4350-b0bc-e20d004fe770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34fb98fe7bd4b2e9587a9e5e705fb58)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:00.938083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a79c51-0a60-4350-b0bc-e20d004fe770 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:00.949850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:00.985089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c27ac8-9ea3-432a-a027-42639ad25d55 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:00.989406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319452cf-defd-4f36-a48c-92fcadb10558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:00.991897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319452cf-defd-4f36-a48c-92fcadb10558 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:00.994720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319452cf-defd-4f36-a48c-92fcadb10558 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:00.994720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319452cf-defd-4f36-a48c-92fcadb10558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:01.004801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319452cf-defd-4f36-a48c-92fcadb10558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:01.006292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319452cf-defd-4f36-a48c-92fcadb10558 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:01.016562 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3639/7200] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:38:01.078101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:01.083517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e5a79c51-0a60-4350-b0bc-e20d004fe770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34fb98fe7bd4b2e9587a9e5e705fb58', 'request_id': 'req-e5a79c51-0a60-4350-b0bc-e20d004fe770'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:01.096655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e5a79c51-0a60-4350-b0bc-e20d004fe770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34fb98fe7bd4b2e9587a9e5e705fb58', 'request_id': 'req-e5a79c51-0a60-4350-b0bc-e20d004fe770'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:01.106927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e5a79c51-0a60-4350-b0bc-e20d004fe770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34fb98fe7bd4b2e9587a9e5e705fb58', 'request_id': 'req-e5a79c51-0a60-4350-b0bc-e20d004fe770'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:01.199747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e5a79c51-0a60-4350-b0bc-e20d004fe770 admin admin] The token cache is being invalidate because project c34fb98fe7bd4b2e9587a9e5e705fb58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:38:01.201031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e5a79c51-0a60-4350-b0bc-e20d004fe770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:01.201908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e5a79c51-0a60-4350-b0bc-e20d004fe770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:01.204596 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3562/7201] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:38:00 2022] DELETE /identity/v3/projects/c34fb98fe7bd4b2e9587a9e5e705fb58 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:01.208838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319452cf-defd-4f36-a48c-92fcadb10558 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:01.226850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319452cf-defd-4f36-a48c-92fcadb10558 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:01.295112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c41b4-e7a0-483f-8431-59b51027caf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:01.295985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c41b4-e7a0-483f-8431-59b51027caf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:01.296630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c41b4-e7a0-483f-8431-59b51027caf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:01.298077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c41b4-e7a0-483f-8431-59b51027caf1 admin admin] PATH_INFO: `/v3/users/5aebdd73fb494dca9f2ce7858ccb80df` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:01.299407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c41b4-e7a0-483f-8431-59b51027caf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aebdd73fb494dca9f2ce7858ccb80df)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:01.302264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c41b4-e7a0-483f-8431-59b51027caf1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:01.605520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-652c41b4-e7a0-483f-8431-59b51027caf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aebdd73fb494dca9f2ce7858ccb80df'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:01.615219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-652c41b4-e7a0-483f-8431-59b51027caf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aebdd73fb494dca9f2ce7858ccb80df'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:01.728959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-652c41b4-e7a0-483f-8431-59b51027caf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aebdd73fb494dca9f2ce7858ccb80df'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:01.729596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-652c41b4-e7a0-483f-8431-59b51027caf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aebdd73fb494dca9f2ce7858ccb80df'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:01.747732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-652c41b4-e7a0-483f-8431-59b51027caf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aebdd73fb494dca9f2ce7858ccb80df'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:01.763897 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3640/7202] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:38:01 2022] DELETE /identity/v3/users/5aebdd73fb494dca9f2ce7858ccb80df => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:02.226618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a79c51-0a60-4350-b0bc-e20d004fe770 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:02.228842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e5a79c51-0a60-4350-b0bc-e20d004fe770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:02.260849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a79c51-0a60-4350-b0bc-e20d004fe770 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:02.361615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decae543-fbf4-4410-882a-036a7c6f15af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:02.363418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decae543-fbf4-4410-882a-036a7c6f15af admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:02.363955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decae543-fbf4-4410-882a-036a7c6f15af admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:02.364427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decae543-fbf4-4410-882a-036a7c6f15af admin admin] PATH_INFO: `/v3/projects/5f3542b175b04a48be5b389396201530` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:02.367477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decae543-fbf4-4410-882a-036a7c6f15af admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f3542b175b04a48be5b389396201530)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:02.370390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decae543-fbf4-4410-882a-036a7c6f15af admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:02.514166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-decae543-fbf4-4410-882a-036a7c6f15af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f3542b175b04a48be5b389396201530', 'request_id': 'req-decae543-fbf4-4410-882a-036a7c6f15af'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:02.521179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-decae543-fbf4-4410-882a-036a7c6f15af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f3542b175b04a48be5b389396201530', 'request_id': 'req-decae543-fbf4-4410-882a-036a7c6f15af'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:02.528948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-decae543-fbf4-4410-882a-036a7c6f15af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f3542b175b04a48be5b389396201530', 'request_id': 'req-decae543-fbf4-4410-882a-036a7c6f15af'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:02.636890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-decae543-fbf4-4410-882a-036a7c6f15af admin admin] The token cache is being invalidate because project 5f3542b175b04a48be5b389396201530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:38:02.637224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-decae543-fbf4-4410-882a-036a7c6f15af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:02.637987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-decae543-fbf4-4410-882a-036a7c6f15af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:02.646115 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3563/7203] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:38:02 2022] DELETE /identity/v3/projects/5f3542b175b04a48be5b389396201530 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:02.646417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c7526-c80e-4c19-89ba-ec9c566d3311 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:02.646417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c7526-c80e-4c19-89ba-ec9c566d3311 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:02.646417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c7526-c80e-4c19-89ba-ec9c566d3311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:02.684372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-422c7526-c80e-4c19-89ba-ec9c566d3311 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:02.687744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-422c7526-c80e-4c19-89ba-ec9c566d3311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:02.761134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:02.774451 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3641/7204] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:38:02.787190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e660597-877e-4d51-9ec8-a32f297ba658 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:02.787488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e660597-877e-4d51-9ec8-a32f297ba658 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:02.787768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e660597-877e-4d51-9ec8-a32f297ba658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:02.810761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6e660597-877e-4d51-9ec8-a32f297ba658 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:02.812022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6e660597-877e-4d51-9ec8-a32f297ba658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:02.822786 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3564/7205] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:02.827535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c7526-c80e-4c19-89ba-ec9c566d3311 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:02.842503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c7526-c80e-4c19-89ba-ec9c566d3311 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:02.850817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9daa5-400d-43ed-b143-a2341bf28a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:02.851556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9daa5-400d-43ed-b143-a2341bf28a57 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:02.851842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9daa5-400d-43ed-b143-a2341bf28a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:02.852171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9daa5-400d-43ed-b143-a2341bf28a57 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:02.854906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9daa5-400d-43ed-b143-a2341bf28a57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:38:02.854906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9daa5-400d-43ed-b143-a2341bf28a57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:02.855323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9daa5-400d-43ed-b143-a2341bf28a57 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:02.873486 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3642/7206] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:38:02.877823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e660597-877e-4d51-9ec8-a32f297ba658 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:02.890350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e660597-877e-4d51-9ec8-a32f297ba658 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:02.899710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9d664-ed5f-453c-a7d8-a5c5e48c1450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:02.900402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9d664-ed5f-453c-a7d8-a5c5e48c1450 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:02.900689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9d664-ed5f-453c-a7d8-a5c5e48c1450 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:02.900967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9d664-ed5f-453c-a7d8-a5c5e48c1450 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:02.901675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9d664-ed5f-453c-a7d8-a5c5e48c1450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:02.903815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9d664-ed5f-453c-a7d8-a5c5e48c1450 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:03.046544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9daa5-400d-43ed-b143-a2341bf28a57 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:03.048084 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3565/7207] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:38:02 2022] POST /identity/v3/projects => generated 393 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:38:03.074851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9daa5-400d-43ed-b143-a2341bf28a57 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:03.170458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21a20b-e7f2-4ec4-817a-206ad4c618c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:03.171770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21a20b-e7f2-4ec4-817a-206ad4c618c8 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:03.172243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21a20b-e7f2-4ec4-817a-206ad4c618c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:03.173096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21a20b-e7f2-4ec4-817a-206ad4c618c8 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:03.176710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21a20b-e7f2-4ec4-817a-206ad4c618c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:03.183269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21a20b-e7f2-4ec4-817a-206ad4c618c8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:03.284882 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3643/7208] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:38:03 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:38:03.289129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9d664-ed5f-453c-a7d8-a5c5e48c1450 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:03.302612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9d664-ed5f-453c-a7d8-a5c5e48c1450 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:03.327905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0196eab-d573-4d21-8cd1-5dfff41f0ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:03.328513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0196eab-d573-4d21-8cd1-5dfff41f0ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:03.328789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0196eab-d573-4d21-8cd1-5dfff41f0ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:03.329251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0196eab-d573-4d21-8cd1-5dfff41f0ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:03.330128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0196eab-d573-4d21-8cd1-5dfff41f0ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:03.335618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0196eab-d573-4d21-8cd1-5dfff41f0ca8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:03.363940 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3566/7209] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:03.369463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21a20b-e7f2-4ec4-817a-206ad4c618c8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:03.385575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21a20b-e7f2-4ec4-817a-206ad4c618c8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:03.392407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109e929-2c67-4aee-aa64-7e01bda7f543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:03.399808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109e929-2c67-4aee-aa64-7e01bda7f543 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:03.400496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109e929-2c67-4aee-aa64-7e01bda7f543 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:03.401155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109e929-2c67-4aee-aa64-7e01bda7f543 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:03.402140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109e929-2c67-4aee-aa64-7e01bda7f543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:03.406522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109e929-2c67-4aee-aa64-7e01bda7f543 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:03.426868 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3644/7210] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:38:03.432809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0196eab-d573-4d21-8cd1-5dfff41f0ca8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:03.452784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0196eab-d573-4d21-8cd1-5dfff41f0ca8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:03.468566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13041d7f-117d-46c0-bc4a-d99232fa566d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:03.469891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13041d7f-117d-46c0-bc4a-d99232fa566d admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:03.470181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13041d7f-117d-46c0-bc4a-d99232fa566d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:03.470460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13041d7f-117d-46c0-bc4a-d99232fa566d admin admin] PATH_INFO: `/v3/projects/650b5ccc06e54f7fac5fdb5d6d24fd15/users/bd6fa7d20f6444c88649f62dfc26ba54/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:03.507075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13041d7f-117d-46c0-bc4a-d99232fa566d admin admin] RBAC: Authorizing `identity:create_grant(project_id=650b5ccc06e54f7fac5fdb5d6d24fd15, user_id=bd6fa7d20f6444c88649f62dfc26ba54, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:03.511697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13041d7f-117d-46c0-bc4a-d99232fa566d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:03.514745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:03.651570 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3567/7211] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:03 2022] PUT /identity/v3/projects/650b5ccc06e54f7fac5fdb5d6d24fd15/users/bd6fa7d20f6444c88649f62dfc26ba54/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:38:03.661521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43da8ec-78bd-41be-bbe0-86eac1c1b6fb None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:03.662072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43da8ec-78bd-41be-bbe0-86eac1c1b6fb None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:03.662193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43da8ec-78bd-41be-bbe0-86eac1c1b6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:03.707326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a43da8ec-78bd-41be-bbe0-86eac1c1b6fb None None] MFA Rules not processed for user `bd6fa7d20f6444c88649f62dfc26ba54`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:03.708711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a43da8ec-78bd-41be-bbe0-86eac1c1b6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:03.817089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13041d7f-117d-46c0-bc4a-d99232fa566d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:03.827486 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3645/7212] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:03.917152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13041d7f-117d-46c0-bc4a-d99232fa566d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:03.923455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f9565-afec-4cb4-8724-6fec636f08b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:03.924725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f9565-afec-4cb4-8724-6fec636f08b8 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:03.925013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f9565-afec-4cb4-8724-6fec636f08b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:03.925291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f9565-afec-4cb4-8724-6fec636f08b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:03.926038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f9565-afec-4cb4-8724-6fec636f08b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:03.928273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f9565-afec-4cb4-8724-6fec636f08b8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:04.051781 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3568/7213] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:38:03 2022] POST /identity/v3/projects => generated 391 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:38:04.055739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43da8ec-78bd-41be-bbe0-86eac1c1b6fb None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:04.083352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43da8ec-78bd-41be-bbe0-86eac1c1b6fb None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:04.309235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f9565-afec-4cb4-8724-6fec636f08b8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:04.311814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4d7f9565-afec-4cb4-8724-6fec636f08b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:04.313057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db3e0f-2631-41e5-b967-35dd1307ec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:04.314023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db3e0f-2631-41e5-b967-35dd1307ec6e admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:04.316884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db3e0f-2631-41e5-b967-35dd1307ec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:04.326827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db3e0f-2631-41e5-b967-35dd1307ec6e admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:04.326827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db3e0f-2631-41e5-b967-35dd1307ec6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:04.326827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db3e0f-2631-41e5-b967-35dd1307ec6e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:04.340809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f9565-afec-4cb4-8724-6fec636f08b8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:04.357760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a10ce-3340-4b30-9a43-6cb21ce04b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:04.359516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a10ce-3340-4b30-9a43-6cb21ce04b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:04.359981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a10ce-3340-4b30-9a43-6cb21ce04b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:04.360440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a10ce-3340-4b30-9a43-6cb21ce04b4e admin admin] PATH_INFO: `/v3/users/8d681f1ba4214188a35667a47473633e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:04.366284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a10ce-3340-4b30-9a43-6cb21ce04b4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d681f1ba4214188a35667a47473633e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:04.370967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a10ce-3340-4b30-9a43-6cb21ce04b4e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:04.513080 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3646/7214] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:38:04 2022] POST /identity/v3/users => generated 302 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:38:04.517073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db3e0f-2631-41e5-b967-35dd1307ec6e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:04.542636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db3e0f-2631-41e5-b967-35dd1307ec6e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:04.557478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7264a-248f-4eca-b6b1-97cdc2b698b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:04.558392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7264a-248f-4eca-b6b1-97cdc2b698b1 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:04.558746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7264a-248f-4eca-b6b1-97cdc2b698b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:04.559202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7264a-248f-4eca-b6b1-97cdc2b698b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:04.560205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7264a-248f-4eca-b6b1-97cdc2b698b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:04.563237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7264a-248f-4eca-b6b1-97cdc2b698b1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:04.592516 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3647/7215] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:04.597384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7264a-248f-4eca-b6b1-97cdc2b698b1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:04.621543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7264a-248f-4eca-b6b1-97cdc2b698b1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:04.629098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e956e-8284-4b18-b144-c1fc2f394efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:04.630456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e956e-8284-4b18-b144-c1fc2f394efe admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:04.631689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e956e-8284-4b18-b144-c1fc2f394efe admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:04.632379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e956e-8284-4b18-b144-c1fc2f394efe admin admin] PATH_INFO: `/v3/projects/d73305c92d664df0a503292c51a6c0e8/users/8c593beaa7664b0d8006a8452a537c10/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:04.658749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e956e-8284-4b18-b144-c1fc2f394efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73305c92d664df0a503292c51a6c0e8, user_id=8c593beaa7664b0d8006a8452a537c10, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:04.663098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e956e-8284-4b18-b144-c1fc2f394efe admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:04.688199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-192a10ce-3340-4b30-9a43-6cb21ce04b4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d681f1ba4214188a35667a47473633e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:04.706142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-192a10ce-3340-4b30-9a43-6cb21ce04b4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d681f1ba4214188a35667a47473633e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:04.770747 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3648/7216] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:04 2022] PUT /identity/v3/projects/d73305c92d664df0a503292c51a6c0e8/users/8c593beaa7664b0d8006a8452a537c10/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:04.775448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e956e-8284-4b18-b144-c1fc2f394efe admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:04.791968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-192a10ce-3340-4b30-9a43-6cb21ce04b4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d681f1ba4214188a35667a47473633e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:04.803468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-192a10ce-3340-4b30-9a43-6cb21ce04b4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d681f1ba4214188a35667a47473633e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:04.804806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-192a10ce-3340-4b30-9a43-6cb21ce04b4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d681f1ba4214188a35667a47473633e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:04.815078 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3569/7217] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:38:04 2022] DELETE /identity/v3/users/8d681f1ba4214188a35667a47473633e => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:04.838464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f9951-633e-4f13-9e8d-e8f6fd3ad69f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:04.838755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f9951-633e-4f13-9e8d-e8f6fd3ad69f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:04.839066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f9951-633e-4f13-9e8d-e8f6fd3ad69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:04.901005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-723f9951-633e-4f13-9e8d-e8f6fd3ad69f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:04.902320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-723f9951-633e-4f13-9e8d-e8f6fd3ad69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:04.905621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:04.910824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e956e-8284-4b18-b144-c1fc2f394efe admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:04.996229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fda9d-a933-40fe-b8b4-907841bb5382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:04.997072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fda9d-a933-40fe-b8b4-907841bb5382 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:04.997419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fda9d-a933-40fe-b8b4-907841bb5382 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:04.997752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fda9d-a933-40fe-b8b4-907841bb5382 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:04.998548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fda9d-a933-40fe-b8b4-907841bb5382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:05.000652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fda9d-a933-40fe-b8b4-907841bb5382 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:05.015653 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3649/7218] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:05.019909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fda9d-a933-40fe-b8b4-907841bb5382 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:05.026537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a79fda9d-a933-40fe-b8b4-907841bb5382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:05.044536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fda9d-a933-40fe-b8b4-907841bb5382 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:05.053610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fe02f-7b91-4f4a-986c-1527f0a19a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:05.055052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fe02f-7b91-4f4a-986c-1527f0a19a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:05.056079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fe02f-7b91-4f4a-986c-1527f0a19a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:05.056561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fe02f-7b91-4f4a-986c-1527f0a19a46 admin admin] PATH_INFO: `/v3/projects/d73305c92d664df0a503292c51a6c0e8/users/8c593beaa7664b0d8006a8452a537c10/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:05.059477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fe02f-7b91-4f4a-986c-1527f0a19a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73305c92d664df0a503292c51a6c0e8, user_id=8c593beaa7664b0d8006a8452a537c10, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:05.064364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fe02f-7b91-4f4a-986c-1527f0a19a46 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:05.071164 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3570/7219] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:05.089335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f9951-633e-4f13-9e8d-e8f6fd3ad69f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:05.090978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-723f9951-633e-4f13-9e8d-e8f6fd3ad69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:05.094222 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3650/7220] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:05 2022] PUT /identity/v3/projects/d73305c92d664df0a503292c51a6c0e8/users/8c593beaa7664b0d8006a8452a537c10/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:38:05.107296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fe555-0224-4239-873b-32e7a82c9d0f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:05.107584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fe555-0224-4239-873b-32e7a82c9d0f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:05.107897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fe555-0224-4239-873b-32e7a82c9d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:05.173153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-313fe555-0224-4239-873b-32e7a82c9d0f None None] MFA Rules not processed for user `8c593beaa7664b0d8006a8452a537c10`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:05.173907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f9951-633e-4f13-9e8d-e8f6fd3ad69f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:05.174532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-313fe555-0224-4239-873b-32e7a82c9d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:05.244932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e904e0-fba2-497c-87d6-bd0114307184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:05.246687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e904e0-fba2-497c-87d6-bd0114307184 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:05.247202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e904e0-fba2-497c-87d6-bd0114307184 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:05.247513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e904e0-fba2-497c-87d6-bd0114307184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:05.310130 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3651/7221] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:38:05.324736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fe555-0224-4239-873b-32e7a82c9d0f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:05.327866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-313fe555-0224-4239-873b-32e7a82c9d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:05.348067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e904e0-fba2-497c-87d6-bd0114307184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:05.350327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e904e0-fba2-497c-87d6-bd0114307184 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:05.357173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fe555-0224-4239-873b-32e7a82c9d0f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:05.365505 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3571/7222] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:38:05.365810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877ada0-0313-491a-b56f-de22f718c576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:05.366541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877ada0-0313-491a-b56f-de22f718c576 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:05.368372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877ada0-0313-491a-b56f-de22f718c576 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:05.369737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877ada0-0313-491a-b56f-de22f718c576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:05.385493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877ada0-0313-491a-b56f-de22f718c576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:05.387185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877ada0-0313-491a-b56f-de22f718c576 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:05.400816 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3652/7223] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:38:05.730112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:06.137501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:06.707351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e904e0-fba2-497c-87d6-bd0114307184 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:06.708822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-26e904e0-fba2-497c-87d6-bd0114307184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:06.739722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e904e0-fba2-497c-87d6-bd0114307184 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:06.755227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae412bb2-e843-4f8d-b202-95c22b664cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:06.762543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae412bb2-e843-4f8d-b202-95c22b664cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:06.763106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae412bb2-e843-4f8d-b202-95c22b664cce admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:06.767042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae412bb2-e843-4f8d-b202-95c22b664cce admin admin] PATH_INFO: `/v3/projects/ed28a2c5cfd241d9ac065ed49746acef` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:06.770235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae412bb2-e843-4f8d-b202-95c22b664cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed28a2c5cfd241d9ac065ed49746acef)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:06.779130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae412bb2-e843-4f8d-b202-95c22b664cce admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:06.997371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ae412bb2-e843-4f8d-b202-95c22b664cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed28a2c5cfd241d9ac065ed49746acef', 'request_id': 'req-ae412bb2-e843-4f8d-b202-95c22b664cce'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:07.011569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ae412bb2-e843-4f8d-b202-95c22b664cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed28a2c5cfd241d9ac065ed49746acef', 'request_id': 'req-ae412bb2-e843-4f8d-b202-95c22b664cce'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:07.023035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ae412bb2-e843-4f8d-b202-95c22b664cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed28a2c5cfd241d9ac065ed49746acef', 'request_id': 'req-ae412bb2-e843-4f8d-b202-95c22b664cce'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:07.160644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ae412bb2-e843-4f8d-b202-95c22b664cce admin admin] The token cache is being invalidate because project ed28a2c5cfd241d9ac065ed49746acef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:38:07.161252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ae412bb2-e843-4f8d-b202-95c22b664cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:07.162236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ae412bb2-e843-4f8d-b202-95c22b664cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:07.164934 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3572/7224] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:38:06 2022] DELETE /identity/v3/projects/ed28a2c5cfd241d9ac065ed49746acef => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:07.168828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877ada0-0313-491a-b56f-de22f718c576 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:07.180848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877ada0-0313-491a-b56f-de22f718c576 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:07.310698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7eec3f-aacf-4c74-bad4-28352c548ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:07.311651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7eec3f-aacf-4c74-bad4-28352c548ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:07.311933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7eec3f-aacf-4c74-bad4-28352c548ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:07.312270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7eec3f-aacf-4c74-bad4-28352c548ad0 admin admin] PATH_INFO: `/v3/users/113ed3475ee84f08ad045c4e8645bbc3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:07.314469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7eec3f-aacf-4c74-bad4-28352c548ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=113ed3475ee84f08ad045c4e8645bbc3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:07.319258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7eec3f-aacf-4c74-bad4-28352c548ad0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:07.673720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:07.689317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0d7eec3f-aacf-4c74-bad4-28352c548ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '113ed3475ee84f08ad045c4e8645bbc3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:07.709346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0d7eec3f-aacf-4c74-bad4-28352c548ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '113ed3475ee84f08ad045c4e8645bbc3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:07.804373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0d7eec3f-aacf-4c74-bad4-28352c548ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '113ed3475ee84f08ad045c4e8645bbc3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:07.805972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0d7eec3f-aacf-4c74-bad4-28352c548ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '113ed3475ee84f08ad045c4e8645bbc3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:07.835986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0d7eec3f-aacf-4c74-bad4-28352c548ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '113ed3475ee84f08ad045c4e8645bbc3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:07.848737 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3653/7225] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:38:07 2022] DELETE /identity/v3/users/113ed3475ee84f08ad045c4e8645bbc3 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:09.324695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae412bb2-e843-4f8d-b202-95c22b664cce admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:09.326188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ae412bb2-e843-4f8d-b202-95c22b664cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:09.347394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae412bb2-e843-4f8d-b202-95c22b664cce admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:09.439483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581d3b8-4058-4f08-a24a-95eb4f0e033f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:09.440602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581d3b8-4058-4f08-a24a-95eb4f0e033f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:09.442257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581d3b8-4058-4f08-a24a-95eb4f0e033f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:09.472403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c563d-f1d0-48e8-a045-36c141e53563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:09.474818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c563d-f1d0-48e8-a045-36c141e53563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:09.476559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8581d3b8-4058-4f08-a24a-95eb4f0e033f None None] MFA Rules not processed for user `70b1a8f603244b3f89cd5fcd02239625`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:09.479891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8581d3b8-4058-4f08-a24a-95eb4f0e033f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:09.480118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c563d-f1d0-48e8-a045-36c141e53563 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:09.480428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c563d-f1d0-48e8-a045-36c141e53563 admin admin] PATH_INFO: `/v3/projects/e2bf985c7d224bfb911fc832c1033e5c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:09.482158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c563d-f1d0-48e8-a045-36c141e53563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2bf985c7d224bfb911fc832c1033e5c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:09.499392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c563d-f1d0-48e8-a045-36c141e53563 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:09.511400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:09.588170 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3654/7226] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:09.592627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581d3b8-4058-4f08-a24a-95eb4f0e033f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:09.594140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8581d3b8-4058-4f08-a24a-95eb4f0e033f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:09.616312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581d3b8-4058-4f08-a24a-95eb4f0e033f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:09.624352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6b85d-39cc-4912-8108-92667658d213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:09.624352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6b85d-39cc-4912-8108-92667658d213 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:09.624352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6b85d-39cc-4912-8108-92667658d213 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:09.624352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6b85d-39cc-4912-8108-92667658d213 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:09.624748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6b85d-39cc-4912-8108-92667658d213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:09.626934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6b85d-39cc-4912-8108-92667658d213 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:09.669171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-190c563d-f1d0-48e8-a045-36c141e53563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2bf985c7d224bfb911fc832c1033e5c', 'request_id': 'req-190c563d-f1d0-48e8-a045-36c141e53563'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:09.675380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-190c563d-f1d0-48e8-a045-36c141e53563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2bf985c7d224bfb911fc832c1033e5c', 'request_id': 'req-190c563d-f1d0-48e8-a045-36c141e53563'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:09.684113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-190c563d-f1d0-48e8-a045-36c141e53563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2bf985c7d224bfb911fc832c1033e5c', 'request_id': 'req-190c563d-f1d0-48e8-a045-36c141e53563'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:09.758717 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3655/7227] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:38:09 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:38:09.762661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6b85d-39cc-4912-8108-92667658d213 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:09.780268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6b85d-39cc-4912-8108-92667658d213 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:09.785660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-190c563d-f1d0-48e8-a045-36c141e53563 admin admin] The token cache is being invalidate because project e2bf985c7d224bfb911fc832c1033e5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:38:09.785660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-190c563d-f1d0-48e8-a045-36c141e53563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:09.785913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-190c563d-f1d0-48e8-a045-36c141e53563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:09.788710 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3573/7228] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:38:09 2022] DELETE /identity/v3/projects/e2bf985c7d224bfb911fc832c1033e5c => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:09.795178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee87eaa-e406-4bf5-9f97-22b353c665d8 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:09.795551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee87eaa-e406-4bf5-9f97-22b353c665d8 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:09.795902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee87eaa-e406-4bf5-9f97-22b353c665d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:09.845454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-fee87eaa-e406-4bf5-9f97-22b353c665d8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:09.846995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fee87eaa-e406-4bf5-9f97-22b353c665d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:09.904784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184023bb-5d58-4ba5-8a37-81f1602153d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:09.905497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184023bb-5d58-4ba5-8a37-81f1602153d5 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:09.906404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184023bb-5d58-4ba5-8a37-81f1602153d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:09.906776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184023bb-5d58-4ba5-8a37-81f1602153d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:09.908055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184023bb-5d58-4ba5-8a37-81f1602153d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:09.909773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184023bb-5d58-4ba5-8a37-81f1602153d5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:09.926243 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3656/7229] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:38:09.932857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184023bb-5d58-4ba5-8a37-81f1602153d5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:09.941040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-184023bb-5d58-4ba5-8a37-81f1602153d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:09.956127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184023bb-5d58-4ba5-8a37-81f1602153d5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:09.971888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd4208-7cd6-4a4b-a8e7-3000656700e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:09.972782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd4208-7cd6-4a4b-a8e7-3000656700e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:09.973235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd4208-7cd6-4a4b-a8e7-3000656700e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:09.973566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd4208-7cd6-4a4b-a8e7-3000656700e4 admin admin] PATH_INFO: `/v3/system/users/c9b76f095b464db6a7c79f06c6a73d62/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:09.993576 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3574/7230] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:10.004549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011cc86-cb69-47c0-b8ef-1b5d0ca6466c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:10.004965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011cc86-cb69-47c0-b8ef-1b5d0ca6466c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:10.005341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011cc86-cb69-47c0-b8ef-1b5d0ca6466c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:10.007516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd4208-7cd6-4a4b-a8e7-3000656700e4 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c9b76f095b464db6a7c79f06c6a73d62, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:10.011489 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-8dcd4208-7cd6-4a4b-a8e7-3000656700e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:38:10.011489 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:38:10.011489 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:38:10.015238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd4208-7cd6-4a4b-a8e7-3000656700e4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:10.034684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5011cc86-cb69-47c0-b8ef-1b5d0ca6466c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:10.036705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5011cc86-cb69-47c0-b8ef-1b5d0ca6466c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:10.060047 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3575/7231] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:10.062289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011cc86-cb69-47c0-b8ef-1b5d0ca6466c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:10.068862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:10.073613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011cc86-cb69-47c0-b8ef-1b5d0ca6466c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:10.081030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7eed82-13e2-4cfe-9522-de2b652e3091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:10.081614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eed82-13e2-4cfe-9522-de2b652e3091 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:10.082011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eed82-13e2-4cfe-9522-de2b652e3091 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:10.082238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eed82-13e2-4cfe-9522-de2b652e3091 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:10.083235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7eed82-13e2-4cfe-9522-de2b652e3091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:38:10.083442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7eed82-13e2-4cfe-9522-de2b652e3091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:10.085225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7eed82-13e2-4cfe-9522-de2b652e3091 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:10.105659 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3576/7232] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:38:10.108092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7eed82-13e2-4cfe-9522-de2b652e3091 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:10.116277 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3657/7233] 10.222.0.16 () {60 vars in 1377 bytes} [Sat Jul 16 21:38:09 2022] PUT /identity/v3/system/users/c9b76f095b464db6a7c79f06c6a73d62/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:38:10.128185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecd742-cea5-47c1-8535-73022dc73a01 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:10.128530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecd742-cea5-47c1-8535-73022dc73a01 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:10.129176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecd742-cea5-47c1-8535-73022dc73a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:10.133853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7eed82-13e2-4cfe-9522-de2b652e3091 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:10.145444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6c347-ec1d-4819-b0fb-f1f9f13ab9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:10.146121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6c347-ec1d-4819-b0fb-f1f9f13ab9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:10.146405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6c347-ec1d-4819-b0fb-f1f9f13ab9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:10.146679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6c347-ec1d-4819-b0fb-f1f9f13ab9d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:10.148301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6c347-ec1d-4819-b0fb-f1f9f13ab9d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:10.152852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6c347-ec1d-4819-b0fb-f1f9f13ab9d2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:10.167811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3eecd742-cea5-47c1-8535-73022dc73a01 None None] MFA Rules not processed for user `c9b76f095b464db6a7c79f06c6a73d62`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:10.169526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3eecd742-cea5-47c1-8535-73022dc73a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:10.316344 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3577/7234] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:38:10 2022] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:38:10.316770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6c347-ec1d-4819-b0fb-f1f9f13ab9d2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:10.329048 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3658/7235] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:10 2022] POST /identity/v3/auth/tokens => generated 2405 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 16 21:38:10.330326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecd742-cea5-47c1-8535-73022dc73a01 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:10.473286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6c347-ec1d-4819-b0fb-f1f9f13ab9d2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:10.485788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82a06b-d2cd-4bdf-98b3-75e8c1dd598c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:10.486744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82a06b-d2cd-4bdf-98b3-75e8c1dd598c admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:10.487817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82a06b-d2cd-4bdf-98b3-75e8c1dd598c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:10.494110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82a06b-d2cd-4bdf-98b3-75e8c1dd598c admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:10.494110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82a06b-d2cd-4bdf-98b3-75e8c1dd598c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:10.500319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82a06b-d2cd-4bdf-98b3-75e8c1dd598c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:10.564511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecd742-cea5-47c1-8535-73022dc73a01 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:10.626647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068f574-1692-44b5-ad79-0257e0ed83ef None tempest-ImageQuotaTest-1454715451-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b76f095b464db6a7c79f06c6a73d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:10.627363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068f574-1692-44b5-ad79-0257e0ed83ef None tempest-ImageQuotaTest-1454715451-system-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:10.631927 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3578/7236] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:38:10 2022] POST /identity/v3/users => generated 289 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:38:10.632103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068f574-1692-44b5-ad79-0257e0ed83ef None tempest-ImageQuotaTest-1454715451-system-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:10.632103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068f574-1692-44b5-ad79-0257e0ed83ef None tempest-ImageQuotaTest-1454715451-system-admin] PATH_INFO: `/v3/services` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:10.632103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068f574-1692-44b5-ad79-0257e0ed83ef None tempest-ImageQuotaTest-1454715451-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:10.635619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82a06b-d2cd-4bdf-98b3-75e8c1dd598c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:10.639664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068f574-1692-44b5-ad79-0257e0ed83ef None tempest-ImageQuotaTest-1454715451-system-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:10.656227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:10.676469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82a06b-d2cd-4bdf-98b3-75e8c1dd598c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:10.689104 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3659/7237] 10.222.0.16 () {58 vars in 1109 bytes} [Sat Jul 16 21:38:10 2022] GET /identity/v3/services => generated 2191 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:10.699328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068f574-1692-44b5-ad79-0257e0ed83ef None tempest-ImageQuotaTest-1454715451-system-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:10.722552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa6e61-abd4-4b10-9a42-4b19e0536506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:10.723329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa6e61-abd4-4b10-9a42-4b19e0536506 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:10.723553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa6e61-abd4-4b10-9a42-4b19e0536506 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:10.723832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa6e61-abd4-4b10-9a42-4b19e0536506 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:10.724571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa6e61-abd4-4b10-9a42-4b19e0536506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:10.736319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa6e61-abd4-4b10-9a42-4b19e0536506 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:10.772100 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3579/7238] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:10.773081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa6e61-abd4-4b10-9a42-4b19e0536506 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:10.779241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-85fa6e61-abd4-4b10-9a42-4b19e0536506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:10.835381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa6e61-abd4-4b10-9a42-4b19e0536506 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:10.842472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b78ba-8abd-43d3-a340-7ab9199c733e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:10.843727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b78ba-8abd-43d3-a340-7ab9199c733e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:10.844021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b78ba-8abd-43d3-a340-7ab9199c733e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:10.844305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b78ba-8abd-43d3-a340-7ab9199c733e admin admin] PATH_INFO: `/v3/users/bd6fa7d20f6444c88649f62dfc26ba54` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:10.846573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b78ba-8abd-43d3-a340-7ab9199c733e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd6fa7d20f6444c88649f62dfc26ba54)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:10.850047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b78ba-8abd-43d3-a340-7ab9199c733e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:10.933542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068f574-1692-44b5-ad79-0257e0ed83ef None tempest-ImageQuotaTest-1454715451-system-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:10.985349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf7a06-2a24-4967-ad9d-ad83b868266f None tempest-ImageQuotaTest-1454715451-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b76f095b464db6a7c79f06c6a73d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:10.986048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf7a06-2a24-4967-ad9d-ad83b868266f None tempest-ImageQuotaTest-1454715451-system-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:10.986673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf7a06-2a24-4967-ad9d-ad83b868266f None tempest-ImageQuotaTest-1454715451-system-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:10.986673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf7a06-2a24-4967-ad9d-ad83b868266f None tempest-ImageQuotaTest-1454715451-system-admin] PATH_INFO: `/v3/limits` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:10.987854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf7a06-2a24-4967-ad9d-ad83b868266f None tempest-ImageQuotaTest-1454715451-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:10.989169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf7a06-2a24-4967-ad9d-ad83b868266f None tempest-ImageQuotaTest-1454715451-system-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:11.053962 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-d6cf7a06-2a24-4967-ad9d-ad83b868266f None tempest-ImageQuotaTest-1454715451-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jul 16 21:38:11.053962 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:38:11.053962 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:38:11.053962 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:38:11.053962 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:38:11.053962 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:38:11.053962 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:38:11.053962 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:38:11.053962 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:38:11.053962 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:38:11.053962 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:38:11.053962 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:38:11.053962 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Jul 16 21:38:11.053962 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Jul 16 21:38:11.055095 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:38:11.055095 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:38:11.055095 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Jul 16 21:38:11.055095 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Jul 16 21:38:11.055095 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 16 21:38:11.055095 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 16 21:38:11.055095 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Jul 16 21:38:11.055095 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Jul 16 21:38:11.055095 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Jul 16 21:38:11.055095 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.NoLimitReference Jul 16 21:38:11.055095 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jul 16 21:38:11.055095 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:38:11.062617 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3660/7239] 10.222.0.16 () {60 vars in 1125 bytes} [Sat Jul 16 21:38:10 2022] POST /identity/v3/limits => generated 124 bytes in 357 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:38:11.062617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf7a06-2a24-4967-ad9d-ad83b868266f None tempest-ImageQuotaTest-1454715451-system-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:11.093934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf7a06-2a24-4967-ad9d-ad83b868266f None tempest-ImageQuotaTest-1454715451-system-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:11.100304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-529b78ba-8abd-43d3-a340-7ab9199c733e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd6fa7d20f6444c88649f62dfc26ba54'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:11.107739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bbce4-d16f-4e5c-ac3e-b58112c9a6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:11.108772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bbce4-d16f-4e5c-ac3e-b58112c9a6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:11.110222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bbce4-d16f-4e5c-ac3e-b58112c9a6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:11.111282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bbce4-d16f-4e5c-ac3e-b58112c9a6b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:11.112993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70bbce4-d16f-4e5c-ac3e-b58112c9a6b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:11.118807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70bbce4-d16f-4e5c-ac3e-b58112c9a6b0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:11.139832 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3661/7240] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:11.141993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bbce4-d16f-4e5c-ac3e-b58112c9a6b0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:11.148729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-529b78ba-8abd-43d3-a340-7ab9199c733e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd6fa7d20f6444c88649f62dfc26ba54'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:11.238636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-529b78ba-8abd-43d3-a340-7ab9199c733e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd6fa7d20f6444c88649f62dfc26ba54'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:11.251975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-529b78ba-8abd-43d3-a340-7ab9199c733e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd6fa7d20f6444c88649f62dfc26ba54'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:11.254166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-529b78ba-8abd-43d3-a340-7ab9199c733e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd6fa7d20f6444c88649f62dfc26ba54'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:11.273373 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3580/7241] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:38:10 2022] DELETE /identity/v3/users/bd6fa7d20f6444c88649f62dfc26ba54 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:11.277706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b78ba-8abd-43d3-a340-7ab9199c733e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:11.281197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-529b78ba-8abd-43d3-a340-7ab9199c733e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:11.346861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bbce4-d16f-4e5c-ac3e-b58112c9a6b0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:11.347734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:11.355903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:11.421869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f83073-124c-4b78-8085-17316ae44f8f None tempest-ImageQuotaTest-1454715451-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b76f095b464db6a7c79f06c6a73d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:11.422539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f83073-124c-4b78-8085-17316ae44f8f None tempest-ImageQuotaTest-1454715451-system-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:11.422825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f83073-124c-4b78-8085-17316ae44f8f None tempest-ImageQuotaTest-1454715451-system-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:11.423162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f83073-124c-4b78-8085-17316ae44f8f None tempest-ImageQuotaTest-1454715451-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:11.424432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f83073-124c-4b78-8085-17316ae44f8f None tempest-ImageQuotaTest-1454715451-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:11.426003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f83073-124c-4b78-8085-17316ae44f8f None tempest-ImageQuotaTest-1454715451-system-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:11.433288 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3662/7242] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Jul 16 21:38:11 2022] GET /identity/v3/registered_limits => generated 129 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:38:11.443792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64563496-8461-4aac-9369-f61d62a09cb0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:11.444083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64563496-8461-4aac-9369-f61d62a09cb0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:11.444365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64563496-8461-4aac-9369-f61d62a09cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:11.444686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b78ba-8abd-43d3-a340-7ab9199c733e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:11.451147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dbbcc-3c44-45de-baa5-7286df573412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:11.453257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dbbcc-3c44-45de-baa5-7286df573412 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:11.453257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dbbcc-3c44-45de-baa5-7286df573412 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:11.453257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dbbcc-3c44-45de-baa5-7286df573412 admin admin] PATH_INFO: `/v3/projects/0b43e48813b74d35901f0e017dda6dec/users/2fd88df1ee1e4c8eb30675f496cf92ee/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:11.477913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-64563496-8461-4aac-9369-f61d62a09cb0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:11.482107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-64563496-8461-4aac-9369-f61d62a09cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:11.491425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2dbbcc-3c44-45de-baa5-7286df573412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b43e48813b74d35901f0e017dda6dec, user_id=2fd88df1ee1e4c8eb30675f496cf92ee, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:11.495404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2dbbcc-3c44-45de-baa5-7286df573412 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:11.497058 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3663/7243] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:11.500282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64563496-8461-4aac-9369-f61d62a09cb0 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:11.507933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-64563496-8461-4aac-9369-f61d62a09cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:11.615222 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3581/7244] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:11 2022] PUT /identity/v3/projects/0b43e48813b74d35901f0e017dda6dec/users/2fd88df1ee1e4c8eb30675f496cf92ee/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:11.616603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dbbcc-3c44-45de-baa5-7286df573412 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:11.619700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0a2dbbcc-3c44-45de-baa5-7286df573412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:11.724647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dbbcc-3c44-45de-baa5-7286df573412 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:11.729086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca544b9-32ac-4cb3-9390-b5dc7d0cf426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:11.729759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca544b9-32ac-4cb3-9390-b5dc7d0cf426 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:11.730293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca544b9-32ac-4cb3-9390-b5dc7d0cf426 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:11.730595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca544b9-32ac-4cb3-9390-b5dc7d0cf426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:11.793981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:11.826488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64563496-8461-4aac-9369-f61d62a09cb0 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:11.850687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca544b9-32ac-4cb3-9390-b5dc7d0cf426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:11.852918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca544b9-32ac-4cb3-9390-b5dc7d0cf426 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:11.881596 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3582/7245] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:38:11.883800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e4fc3-2055-4fd4-af45-7d6428d0cd05 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:11.884169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e4fc3-2055-4fd4-af45-7d6428d0cd05 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:11.884606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e4fc3-2055-4fd4-af45-7d6428d0cd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:11.937410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357e2e3-1f4f-456a-9956-aa7409988b07 None tempest-ImageQuotaTest-1454715451-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b76f095b464db6a7c79f06c6a73d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:11.946676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357e2e3-1f4f-456a-9956-aa7409988b07 None tempest-ImageQuotaTest-1454715451-system-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:11.946676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357e2e3-1f4f-456a-9956-aa7409988b07 None tempest-ImageQuotaTest-1454715451-system-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:11.946676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357e2e3-1f4f-456a-9956-aa7409988b07 None tempest-ImageQuotaTest-1454715451-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:11.946676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357e2e3-1f4f-456a-9956-aa7409988b07 None tempest-ImageQuotaTest-1454715451-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:11.946676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357e2e3-1f4f-456a-9956-aa7409988b07 None tempest-ImageQuotaTest-1454715451-system-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:11.959758 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3664/7246] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Jul 16 21:38:11 2022] GET /identity/v3/registered_limits => generated 129 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:38:11.960905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357e2e3-1f4f-456a-9956-aa7409988b07 None tempest-ImageQuotaTest-1454715451-system-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:11.969060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5357e2e3-1f4f-456a-9956-aa7409988b07 None tempest-ImageQuotaTest-1454715451-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:11.973486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-441e4fc3-2055-4fd4-af45-7d6428d0cd05 None None] MFA Rules not processed for user `2fd88df1ee1e4c8eb30675f496cf92ee`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:11.980217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-441e4fc3-2055-4fd4-af45-7d6428d0cd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:12.029101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357e2e3-1f4f-456a-9956-aa7409988b07 None tempest-ImageQuotaTest-1454715451-system-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:12.044351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48f355-c081-46c1-84fa-9c149469bf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:12.045366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48f355-c081-46c1-84fa-9c149469bf87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:12.045649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48f355-c081-46c1-84fa-9c149469bf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:12.045928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48f355-c081-46c1-84fa-9c149469bf87 admin admin] PATH_INFO: `/v3/users/e4863e3d74a540519dc328f45c79519f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:12.050145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48f355-c081-46c1-84fa-9c149469bf87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4863e3d74a540519dc328f45c79519f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:12.055725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48f355-c081-46c1-84fa-9c149469bf87 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:12.146024 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3583/7247] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:12.160657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e4fc3-2055-4fd4-af45-7d6428d0cd05 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:12.162503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-441e4fc3-2055-4fd4-af45-7d6428d0cd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:12.253763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:12.295597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e4fc3-2055-4fd4-af45-7d6428d0cd05 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:12.311506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e46704-cb2f-4d1b-89d1-ab61b88843c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:12.316963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e46704-cb2f-4d1b-89d1-ab61b88843c3 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:12.317339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e46704-cb2f-4d1b-89d1-ab61b88843c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:12.319332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e46704-cb2f-4d1b-89d1-ab61b88843c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:12.338379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e46704-cb2f-4d1b-89d1-ab61b88843c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:12.340947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e46704-cb2f-4d1b-89d1-ab61b88843c3 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:12.355168 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3584/7248] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:38:12.390251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1c48f355-c081-46c1-84fa-9c149469bf87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4863e3d74a540519dc328f45c79519f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:12.408365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1c48f355-c081-46c1-84fa-9c149469bf87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4863e3d74a540519dc328f45c79519f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:12.525200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:12.553539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1c48f355-c081-46c1-84fa-9c149469bf87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4863e3d74a540519dc328f45c79519f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:12.554418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1c48f355-c081-46c1-84fa-9c149469bf87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4863e3d74a540519dc328f45c79519f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:12.573385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1c48f355-c081-46c1-84fa-9c149469bf87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4863e3d74a540519dc328f45c79519f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:12.582855 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3665/7249] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:38:11 2022] DELETE /identity/v3/users/e4863e3d74a540519dc328f45c79519f => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:13.209285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e46704-cb2f-4d1b-89d1-ab61b88843c3 service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:13.212562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d1e46704-cb2f-4d1b-89d1-ab61b88843c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:13.283358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e46704-cb2f-4d1b-89d1-ab61b88843c3 service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:13.464752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48f355-c081-46c1-84fa-9c149469bf87 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:13.467580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1c48f355-c081-46c1-84fa-9c149469bf87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:13.535120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a607bd9-a75a-45cc-a944-97ade116d688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:13.542323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a607bd9-a75a-45cc-a944-97ade116d688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:13.545302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a607bd9-a75a-45cc-a944-97ade116d688 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:13.546351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a607bd9-a75a-45cc-a944-97ade116d688 admin admin] PATH_INFO: `/v3/projects/650b5ccc06e54f7fac5fdb5d6d24fd15` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:13.548315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a607bd9-a75a-45cc-a944-97ade116d688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=650b5ccc06e54f7fac5fdb5d6d24fd15)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:13.556222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a607bd9-a75a-45cc-a944-97ade116d688 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:13.737879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48f355-c081-46c1-84fa-9c149469bf87 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:13.744288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b8575-4e63-41bd-896b-eafdc2893042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:13.745300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b8575-4e63-41bd-896b-eafdc2893042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:13.745693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b8575-4e63-41bd-896b-eafdc2893042 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:13.746043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b8575-4e63-41bd-896b-eafdc2893042 admin admin] PATH_INFO: `/v3/projects/7a19b745575c4978b44313f03299150d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:13.747421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b8575-4e63-41bd-896b-eafdc2893042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a19b745575c4978b44313f03299150d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:13.750730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b8575-4e63-41bd-896b-eafdc2893042 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:13.812521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7a607bd9-a75a-45cc-a944-97ade116d688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '650b5ccc06e54f7fac5fdb5d6d24fd15', 'request_id': 'req-7a607bd9-a75a-45cc-a944-97ade116d688'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:13.819142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7a607bd9-a75a-45cc-a944-97ade116d688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '650b5ccc06e54f7fac5fdb5d6d24fd15', 'request_id': 'req-7a607bd9-a75a-45cc-a944-97ade116d688'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:13.839691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7a607bd9-a75a-45cc-a944-97ade116d688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '650b5ccc06e54f7fac5fdb5d6d24fd15', 'request_id': 'req-7a607bd9-a75a-45cc-a944-97ade116d688'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:13.929309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-179b8575-4e63-41bd-896b-eafdc2893042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a19b745575c4978b44313f03299150d', 'request_id': 'req-179b8575-4e63-41bd-896b-eafdc2893042'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:13.942450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-179b8575-4e63-41bd-896b-eafdc2893042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a19b745575c4978b44313f03299150d', 'request_id': 'req-179b8575-4e63-41bd-896b-eafdc2893042'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:13.960473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-179b8575-4e63-41bd-896b-eafdc2893042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a19b745575c4978b44313f03299150d', 'request_id': 'req-179b8575-4e63-41bd-896b-eafdc2893042'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:13.963324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:14.012382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7a607bd9-a75a-45cc-a944-97ade116d688 admin admin] The token cache is being invalidate because project 650b5ccc06e54f7fac5fdb5d6d24fd15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:38:14.012382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7a607bd9-a75a-45cc-a944-97ade116d688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:14.014483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7a607bd9-a75a-45cc-a944-97ade116d688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:14.020611 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3585/7250] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:38:13 2022] DELETE /identity/v3/projects/650b5ccc06e54f7fac5fdb5d6d24fd15 => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:14.023292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176e865-a122-45c1-940b-40c9ed23b8fb None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:14.026027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176e865-a122-45c1-940b-40c9ed23b8fb None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:14.026459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176e865-a122-45c1-940b-40c9ed23b8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:14.058751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2176e865-a122-45c1-940b-40c9ed23b8fb None None] MFA Rules not processed for user `95cd6b54d8164de1a524b407a1852ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:14.061649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2176e865-a122-45c1-940b-40c9ed23b8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:14.077420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:14.114572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-179b8575-4e63-41bd-896b-eafdc2893042 admin admin] The token cache is being invalidate because project 7a19b745575c4978b44313f03299150d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:38:14.114865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-179b8575-4e63-41bd-896b-eafdc2893042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:14.116063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-179b8575-4e63-41bd-896b-eafdc2893042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:14.120505 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3666/7251] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:38:13 2022] DELETE /identity/v3/projects/7a19b745575c4978b44313f03299150d => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:38:14.122263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b8575-4e63-41bd-896b-eafdc2893042 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:14.126791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-179b8575-4e63-41bd-896b-eafdc2893042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:14.146646 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3586/7252] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:14.167718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176e865-a122-45c1-940b-40c9ed23b8fb None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:14.173737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2176e865-a122-45c1-940b-40c9ed23b8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:14.236722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b8575-4e63-41bd-896b-eafdc2893042 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:14.240745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbb30c-42b2-4487-a1db-b81d25a6424b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:14.241689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbb30c-42b2-4487-a1db-b81d25a6424b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:14.241990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbb30c-42b2-4487-a1db-b81d25a6424b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:14.242275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbb30c-42b2-4487-a1db-b81d25a6424b admin admin] PATH_INFO: `/v3/users/8c593beaa7664b0d8006a8452a537c10` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:14.245174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbb30c-42b2-4487-a1db-b81d25a6424b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c593beaa7664b0d8006a8452a537c10)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:14.248491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbb30c-42b2-4487-a1db-b81d25a6424b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:14.345000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176e865-a122-45c1-940b-40c9ed23b8fb None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:14.354250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f53b9-dcc1-4ef1-9c45-d5f2cfb6459f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:14.355492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f53b9-dcc1-4ef1-9c45-d5f2cfb6459f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:14.355921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f53b9-dcc1-4ef1-9c45-d5f2cfb6459f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:14.356601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f53b9-dcc1-4ef1-9c45-d5f2cfb6459f admin admin] PATH_INFO: `/v3/users/662cd174483f4ecab4ab8b4b49936bb6` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:14.359968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f53b9-dcc1-4ef1-9c45-d5f2cfb6459f admin admin] RBAC: Authorizing `identity:delete_user(user_id=662cd174483f4ecab4ab8b4b49936bb6)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:14.366618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f53b9-dcc1-4ef1-9c45-d5f2cfb6459f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:14.473257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c3dbb30c-42b2-4487-a1db-b81d25a6424b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c593beaa7664b0d8006a8452a537c10'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:14.483989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c3dbb30c-42b2-4487-a1db-b81d25a6424b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c593beaa7664b0d8006a8452a537c10'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:14.595574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c3dbb30c-42b2-4487-a1db-b81d25a6424b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c593beaa7664b0d8006a8452a537c10'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:14.596209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c3dbb30c-42b2-4487-a1db-b81d25a6424b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c593beaa7664b0d8006a8452a537c10'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:14.613804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4e1f53b9-dcc1-4ef1-9c45-d5f2cfb6459f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '662cd174483f4ecab4ab8b4b49936bb6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:14.622478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c3dbb30c-42b2-4487-a1db-b81d25a6424b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c593beaa7664b0d8006a8452a537c10'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:14.635618 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3667/7253] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:38:14 2022] DELETE /identity/v3/users/8c593beaa7664b0d8006a8452a537c10 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:14.640848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4e1f53b9-dcc1-4ef1-9c45-d5f2cfb6459f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '662cd174483f4ecab4ab8b4b49936bb6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:14.732670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4e1f53b9-dcc1-4ef1-9c45-d5f2cfb6459f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '662cd174483f4ecab4ab8b4b49936bb6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:14.742673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4e1f53b9-dcc1-4ef1-9c45-d5f2cfb6459f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '662cd174483f4ecab4ab8b4b49936bb6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:14.743887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4e1f53b9-dcc1-4ef1-9c45-d5f2cfb6459f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '662cd174483f4ecab4ab8b4b49936bb6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:14.752405 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3587/7254] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:38:14 2022] DELETE /identity/v3/users/662cd174483f4ecab4ab8b4b49936bb6 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:15.254824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbb30c-42b2-4487-a1db-b81d25a6424b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:15.257625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c3dbb30c-42b2-4487-a1db-b81d25a6424b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:15.358200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbb30c-42b2-4487-a1db-b81d25a6424b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:15.422266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a47ec3-8ac0-4289-ad51-aca5adc4dff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:15.423207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a47ec3-8ac0-4289-ad51-aca5adc4dff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:15.423493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a47ec3-8ac0-4289-ad51-aca5adc4dff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:15.423772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a47ec3-8ac0-4289-ad51-aca5adc4dff8 admin admin] PATH_INFO: `/v3/projects/d73305c92d664df0a503292c51a6c0e8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:15.425467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a47ec3-8ac0-4289-ad51-aca5adc4dff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d73305c92d664df0a503292c51a6c0e8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:15.430632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a47ec3-8ac0-4289-ad51-aca5adc4dff8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:15.466068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f53b9-dcc1-4ef1-9c45-d5f2cfb6459f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:15.468382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4e1f53b9-dcc1-4ef1-9c45-d5f2cfb6459f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:15.486267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f53b9-dcc1-4ef1-9c45-d5f2cfb6459f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:15.493647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada9e40-f8ec-497a-b1e8-dceb0eeabcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:15.494867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada9e40-f8ec-497a-b1e8-dceb0eeabcb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:15.499196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada9e40-f8ec-497a-b1e8-dceb0eeabcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:15.499196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada9e40-f8ec-497a-b1e8-dceb0eeabcb7 admin admin] PATH_INFO: `/v3/projects/315d04019957416a8d2c250e7200a419` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:15.499196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada9e40-f8ec-497a-b1e8-dceb0eeabcb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=315d04019957416a8d2c250e7200a419)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:15.501982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada9e40-f8ec-497a-b1e8-dceb0eeabcb7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:15.581557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-46a47ec3-8ac0-4289-ad51-aca5adc4dff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd73305c92d664df0a503292c51a6c0e8', 'request_id': 'req-46a47ec3-8ac0-4289-ad51-aca5adc4dff8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:15.594281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-46a47ec3-8ac0-4289-ad51-aca5adc4dff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd73305c92d664df0a503292c51a6c0e8', 'request_id': 'req-46a47ec3-8ac0-4289-ad51-aca5adc4dff8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:15.601150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-46a47ec3-8ac0-4289-ad51-aca5adc4dff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd73305c92d664df0a503292c51a6c0e8', 'request_id': 'req-46a47ec3-8ac0-4289-ad51-aca5adc4dff8'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:15.692058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-46a47ec3-8ac0-4289-ad51-aca5adc4dff8 admin admin] The token cache is being invalidate because project d73305c92d664df0a503292c51a6c0e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:38:15.692803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-46a47ec3-8ac0-4289-ad51-aca5adc4dff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:15.697939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-46a47ec3-8ac0-4289-ad51-aca5adc4dff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:15.708181 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3668/7255] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:38:15 2022] DELETE /identity/v3/projects/d73305c92d664df0a503292c51a6c0e8 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:15.711746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc55a07-0007-4c82-b6f9-259e5148424e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:15.712476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc55a07-0007-4c82-b6f9-259e5148424e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:15.713279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc55a07-0007-4c82-b6f9-259e5148424e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:15.730121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9ada9e40-f8ec-497a-b1e8-dceb0eeabcb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '315d04019957416a8d2c250e7200a419', 'request_id': 'req-9ada9e40-f8ec-497a-b1e8-dceb0eeabcb7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:15.743586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9ada9e40-f8ec-497a-b1e8-dceb0eeabcb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '315d04019957416a8d2c250e7200a419', 'request_id': 'req-9ada9e40-f8ec-497a-b1e8-dceb0eeabcb7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:15.748868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9ada9e40-f8ec-497a-b1e8-dceb0eeabcb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '315d04019957416a8d2c250e7200a419', 'request_id': 'req-9ada9e40-f8ec-497a-b1e8-dceb0eeabcb7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:15.772347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7fc55a07-0007-4c82-b6f9-259e5148424e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:15.773653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7fc55a07-0007-4c82-b6f9-259e5148424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:15.839639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9ada9e40-f8ec-497a-b1e8-dceb0eeabcb7 admin admin] The token cache is being invalidate because project 315d04019957416a8d2c250e7200a419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:38:15.840378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9ada9e40-f8ec-497a-b1e8-dceb0eeabcb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:15.843387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9ada9e40-f8ec-497a-b1e8-dceb0eeabcb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:15.844996 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3588/7256] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:38:15 2022] DELETE /identity/v3/projects/315d04019957416a8d2c250e7200a419 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:38:15.850667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb057-03a5-4bce-be7f-c94660369010 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:15.850667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb057-03a5-4bce-be7f-c94660369010 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:15.851072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb057-03a5-4bce-be7f-c94660369010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:15.872813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:15.876720 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3669/7257] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:15.884683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32297cb1-a442-4da6-94a3-40b1ee5cd2a0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:15.886871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32297cb1-a442-4da6-94a3-40b1ee5cd2a0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:15.886871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32297cb1-a442-4da6-94a3-40b1ee5cd2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:15.907044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2cabb057-03a5-4bce-be7f-c94660369010 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:15.908319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2cabb057-03a5-4bce-be7f-c94660369010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:15.911878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-32297cb1-a442-4da6-94a3-40b1ee5cd2a0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:15.913161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-32297cb1-a442-4da6-94a3-40b1ee5cd2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:15.923862 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3670/7258] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:38:15.927753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32297cb1-a442-4da6-94a3-40b1ee5cd2a0 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:15.938875 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3589/7259] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:38:15.943691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32297cb1-a442-4da6-94a3-40b1ee5cd2a0 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:15.957370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50291f09-8fb8-4ce1-9cc7-96b0b07efa2b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:15.957657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50291f09-8fb8-4ce1-9cc7-96b0b07efa2b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:15.957935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50291f09-8fb8-4ce1-9cc7-96b0b07efa2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:15.976672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4448de-6a48-4c23-8e2f-15a86dd53b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:15.980379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4448de-6a48-4c23-8e2f-15a86dd53b1a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:15.980669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4448de-6a48-4c23-8e2f-15a86dd53b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:15.984324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4448de-6a48-4c23-8e2f-15a86dd53b1a admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:15.984444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4448de-6a48-4c23-8e2f-15a86dd53b1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:38:15.984737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4448de-6a48-4c23-8e2f-15a86dd53b1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:16.003424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4448de-6a48-4c23-8e2f-15a86dd53b1a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:16.023487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-50291f09-8fb8-4ce1-9cc7-96b0b07efa2b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:16.025466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-50291f09-8fb8-4ce1-9cc7-96b0b07efa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:16.047785 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3671/7260] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:38:16.050661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4448de-6a48-4c23-8e2f-15a86dd53b1a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:16.057481 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3590/7261] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:16.060709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50291f09-8fb8-4ce1-9cc7-96b0b07efa2b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:16.075465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4448de-6a48-4c23-8e2f-15a86dd53b1a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:16.084946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50291f09-8fb8-4ce1-9cc7-96b0b07efa2b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:16.090440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dec4c-ddf4-4162-9fa0-b4653364e9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:16.091167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dec4c-ddf4-4162-9fa0-b4653364e9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:16.091476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dec4c-ddf4-4162-9fa0-b4653364e9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:16.091728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dec4c-ddf4-4162-9fa0-b4653364e9e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:16.099658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20805e07-7be6-404d-827b-dc8ad85f5ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:16.100313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20805e07-7be6-404d-827b-dc8ad85f5ffa admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:16.100602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20805e07-7be6-404d-827b-dc8ad85f5ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:16.100882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20805e07-7be6-404d-827b-dc8ad85f5ffa admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:16.101617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20805e07-7be6-404d-827b-dc8ad85f5ffa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:38:16.101970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20805e07-7be6-404d-827b-dc8ad85f5ffa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:16.104345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20805e07-7be6-404d-827b-dc8ad85f5ffa admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:16.105922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6dec4c-ddf4-4162-9fa0-b4653364e9e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:16.111876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6dec4c-ddf4-4162-9fa0-b4653364e9e6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:16.134746 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3591/7262] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:38:16.135998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20805e07-7be6-404d-827b-dc8ad85f5ffa admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:16.152809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20805e07-7be6-404d-827b-dc8ad85f5ffa admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:16.163791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7bfd6-5506-4bc5-ab6a-4904c97e51b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:16.164514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7bfd6-5506-4bc5-ab6a-4904c97e51b5 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:16.164801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7bfd6-5506-4bc5-ab6a-4904c97e51b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:16.165078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7bfd6-5506-4bc5-ab6a-4904c97e51b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:16.165876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7bfd6-5506-4bc5-ab6a-4904c97e51b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:16.168501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7bfd6-5506-4bc5-ab6a-4904c97e51b5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:16.212286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:16.279899 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3672/7263] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:38:16 2022] POST /identity/v3/projects => generated 379 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:38:16.284629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dec4c-ddf4-4162-9fa0-b4653364e9e6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:16.365126 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3592/7264] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:38:16 2022] POST /identity/v3/projects => generated 391 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:38:16.372451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7bfd6-5506-4bc5-ab6a-4904c97e51b5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:16.404017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dec4c-ddf4-4162-9fa0-b4653364e9e6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:16.522100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7bfd6-5506-4bc5-ab6a-4904c97e51b5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:16.535054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d3cf8-9377-487d-8fee-dfcb910a7486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:16.535054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d3cf8-9377-487d-8fee-dfcb910a7486 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:16.535054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d3cf8-9377-487d-8fee-dfcb910a7486 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:16.535054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d3cf8-9377-487d-8fee-dfcb910a7486 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:16.535459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d3cf8-9377-487d-8fee-dfcb910a7486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:16.536949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d3cf8-9377-487d-8fee-dfcb910a7486 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:16.544355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8472d-fc11-4c1a-b99b-fabfa64d8d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:16.547412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8472d-fc11-4c1a-b99b-fabfa64d8d7d admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:16.547699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8472d-fc11-4c1a-b99b-fabfa64d8d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:16.548079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8472d-fc11-4c1a-b99b-fabfa64d8d7d admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:16.548739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8472d-fc11-4c1a-b99b-fabfa64d8d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:16.557819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8472d-fc11-4c1a-b99b-fabfa64d8d7d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:16.639911 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3673/7265] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:38:16 2022] POST /identity/v3/users => generated 290 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:38:16.641484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8472d-fc11-4c1a-b99b-fabfa64d8d7d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:16.643753 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3593/7266] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:38:16 2022] POST /identity/v3/users => generated 296 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:38:16.645194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d3cf8-9377-487d-8fee-dfcb910a7486 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:16.654823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-02b8472d-fc11-4c1a-b99b-fabfa64d8d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:16.659181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d3cf8-9377-487d-8fee-dfcb910a7486 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:16.665991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ed3be-daec-407a-8e27-3fc1e3a03631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:16.667254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ed3be-daec-407a-8e27-3fc1e3a03631 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:16.667698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ed3be-daec-407a-8e27-3fc1e3a03631 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:16.668160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ed3be-daec-407a-8e27-3fc1e3a03631 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:16.669339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ed3be-daec-407a-8e27-3fc1e3a03631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:16.671977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ed3be-daec-407a-8e27-3fc1e3a03631 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:16.690051 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3594/7267] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:16.691267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ed3be-daec-407a-8e27-3fc1e3a03631 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:16.712895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ed3be-daec-407a-8e27-3fc1e3a03631 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:16.720270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bf442-9f73-4800-85b6-e063f5de1024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:16.721291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bf442-9f73-4800-85b6-e063f5de1024 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:16.721765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bf442-9f73-4800-85b6-e063f5de1024 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:16.722639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bf442-9f73-4800-85b6-e063f5de1024 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:16.723741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bf442-9f73-4800-85b6-e063f5de1024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:16.739645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bf442-9f73-4800-85b6-e063f5de1024 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:16.758884 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3595/7268] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:16.760090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bf442-9f73-4800-85b6-e063f5de1024 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:16.775477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bf442-9f73-4800-85b6-e063f5de1024 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:16.780615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69eea50-8551-40da-8843-1e3e1394c03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:16.781530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69eea50-8551-40da-8843-1e3e1394c03b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:16.781890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69eea50-8551-40da-8843-1e3e1394c03b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:16.782168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69eea50-8551-40da-8843-1e3e1394c03b admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:16.782640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8472d-fc11-4c1a-b99b-fabfa64d8d7d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:16.782893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69eea50-8551-40da-8843-1e3e1394c03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:16.784547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69eea50-8551-40da-8843-1e3e1394c03b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:16.786606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a153c-cb13-4bc8-a882-7812b73089f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:16.787306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a153c-cb13-4bc8-a882-7812b73089f7 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:16.787596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a153c-cb13-4bc8-a882-7812b73089f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:16.787838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a153c-cb13-4bc8-a882-7812b73089f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:16.790358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-de8a153c-cb13-4bc8-a882-7812b73089f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:16.795919 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3596/7269] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:16.796838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69eea50-8551-40da-8843-1e3e1394c03b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:16.815063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69eea50-8551-40da-8843-1e3e1394c03b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:16.819895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd20237-b13a-472e-86f5-0b0e4e8f7cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:16.820720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd20237-b13a-472e-86f5-0b0e4e8f7cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:16.820995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd20237-b13a-472e-86f5-0b0e4e8f7cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:16.821275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd20237-b13a-472e-86f5-0b0e4e8f7cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:16.822005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd20237-b13a-472e-86f5-0b0e4e8f7cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:16.823644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd20237-b13a-472e-86f5-0b0e4e8f7cd8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:16.834371 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3597/7270] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:16.834371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd20237-b13a-472e-86f5-0b0e4e8f7cd8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:16.847299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd20237-b13a-472e-86f5-0b0e4e8f7cd8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:16.853203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554c2f4-e0d1-42c7-bec0-aadaa17bf87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:16.854202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554c2f4-e0d1-42c7-bec0-aadaa17bf87a admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:16.854390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554c2f4-e0d1-42c7-bec0-aadaa17bf87a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:16.854640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554c2f4-e0d1-42c7-bec0-aadaa17bf87a admin admin] PATH_INFO: `/v3/projects/15357ecc81b2491c972e3944f2b3d56a/users/1df10b26222640d68bdaf9e8e88c456b/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:16.881541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554c2f4-e0d1-42c7-bec0-aadaa17bf87a admin admin] RBAC: Authorizing `identity:create_grant(project_id=15357ecc81b2491c972e3944f2b3d56a, user_id=1df10b26222640d68bdaf9e8e88c456b, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:16.885669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554c2f4-e0d1-42c7-bec0-aadaa17bf87a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:16.886949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a153c-cb13-4bc8-a882-7812b73089f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:16.890038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a153c-cb13-4bc8-a882-7812b73089f7 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:16.906442 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3674/7271] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:38:16.907205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a153c-cb13-4bc8-a882-7812b73089f7 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:16.919070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a153c-cb13-4bc8-a882-7812b73089f7 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:16.923943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9bbc3-4e9a-4ead-a47b-af76b7b9f1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:16.925035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9bbc3-4e9a-4ead-a47b-af76b7b9f1c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:16.925323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9bbc3-4e9a-4ead-a47b-af76b7b9f1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:16.925642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9bbc3-4e9a-4ead-a47b-af76b7b9f1c0 admin admin] PATH_INFO: `/v3/projects/77c9b7e351e24dc88207e9498f75f578/users/833136cbdeab4b9e8b6dd2d24c7c8753/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:16.947509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9bbc3-4e9a-4ead-a47b-af76b7b9f1c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77c9b7e351e24dc88207e9498f75f578, user_id=833136cbdeab4b9e8b6dd2d24c7c8753, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:16.950276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9bbc3-4e9a-4ead-a47b-af76b7b9f1c0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:17.012378 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3598/7272] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:16 2022] PUT /identity/v3/projects/15357ecc81b2491c972e3944f2b3d56a/users/1df10b26222640d68bdaf9e8e88c456b/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:17.023186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87950636-9ccd-4c83-a03d-ef39c588f62a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:17.024144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87950636-9ccd-4c83-a03d-ef39c588f62a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:17.024144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87950636-9ccd-4c83-a03d-ef39c588f62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:17.041022 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3675/7273] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:16 2022] PUT /identity/v3/projects/77c9b7e351e24dc88207e9498f75f578/users/833136cbdeab4b9e8b6dd2d24c7c8753/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:17.053007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c269338-b411-4679-8d0b-e90474949d67 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:17.053297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c269338-b411-4679-8d0b-e90474949d67 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:17.053575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c269338-b411-4679-8d0b-e90474949d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:17.069751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-87950636-9ccd-4c83-a03d-ef39c588f62a None None] MFA Rules not processed for user `1df10b26222640d68bdaf9e8e88c456b`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:17.083800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-87950636-9ccd-4c83-a03d-ef39c588f62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:17.093874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7c269338-b411-4679-8d0b-e90474949d67 None None] MFA Rules not processed for user `833136cbdeab4b9e8b6dd2d24c7c8753`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:17.095617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7c269338-b411-4679-8d0b-e90474949d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:17.198327 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3599/7274] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:17.208233 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3676/7275] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:17.209446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87950636-9ccd-4c83-a03d-ef39c588f62a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:17.219773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c269338-b411-4679-8d0b-e90474949d67 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:17.222714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7c269338-b411-4679-8d0b-e90474949d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:17.353194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87950636-9ccd-4c83-a03d-ef39c588f62a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:17.358072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c269338-b411-4679-8d0b-e90474949d67 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:17.360942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd532575-be12-442a-a67e-3c957b61b35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:17.362262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd532575-be12-442a-a67e-3c957b61b35b admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:17.362262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd532575-be12-442a-a67e-3c957b61b35b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:17.362262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd532575-be12-442a-a67e-3c957b61b35b admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:17.363132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd532575-be12-442a-a67e-3c957b61b35b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:17.364749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f0388-7616-48e8-b86f-88bc35b5c037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:17.365052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd532575-be12-442a-a67e-3c957b61b35b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:17.365896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f0388-7616-48e8-b86f-88bc35b5c037 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:17.366512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f0388-7616-48e8-b86f-88bc35b5c037 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:17.367504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f0388-7616-48e8-b86f-88bc35b5c037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:17.385765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f0388-7616-48e8-b86f-88bc35b5c037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:17.387563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f0388-7616-48e8-b86f-88bc35b5c037 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:17.400966 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3677/7276] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:38:17.428479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f0388-7616-48e8-b86f-88bc35b5c037 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:17.442868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f0388-7616-48e8-b86f-88bc35b5c037 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:17.452899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8813e25-ec90-4937-88a6-2181978a9bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:17.454172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8813e25-ec90-4937-88a6-2181978a9bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:17.455283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8813e25-ec90-4937-88a6-2181978a9bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:17.455798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8813e25-ec90-4937-88a6-2181978a9bb2 admin admin] PATH_INFO: `/v3/users/1df10b26222640d68bdaf9e8e88c456b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:17.457388 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3600/7277] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:38:17 2022] POST /identity/v3/projects => generated 391 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:38:17.458316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8813e25-ec90-4937-88a6-2181978a9bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1df10b26222640d68bdaf9e8e88c456b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:17.462112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8813e25-ec90-4937-88a6-2181978a9bb2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:17.462272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd532575-be12-442a-a67e-3c957b61b35b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:17.566138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd532575-be12-442a-a67e-3c957b61b35b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:17.573577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a97ec8-e6e7-4436-9118-9ea4dde7f18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:17.574572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a97ec8-e6e7-4436-9118-9ea4dde7f18e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:17.577589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a97ec8-e6e7-4436-9118-9ea4dde7f18e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:17.578117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a97ec8-e6e7-4436-9118-9ea4dde7f18e admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:17.579192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a97ec8-e6e7-4436-9118-9ea4dde7f18e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:17.588657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:17.591566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a97ec8-e6e7-4436-9118-9ea4dde7f18e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:17.690766 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3601/7278] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:38:17 2022] POST /identity/v3/users => generated 302 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:38:17.694334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a97ec8-e6e7-4436-9118-9ea4dde7f18e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:17.714574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a97ec8-e6e7-4436-9118-9ea4dde7f18e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:17.722508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b8813e25-ec90-4937-88a6-2181978a9bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1df10b26222640d68bdaf9e8e88c456b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:17.740518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b8813e25-ec90-4937-88a6-2181978a9bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1df10b26222640d68bdaf9e8e88c456b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:17.743687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74253de6-8b0d-43d6-9300-4c2887dec864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:17.744463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74253de6-8b0d-43d6-9300-4c2887dec864 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:17.744841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74253de6-8b0d-43d6-9300-4c2887dec864 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:17.745206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74253de6-8b0d-43d6-9300-4c2887dec864 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:17.749355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74253de6-8b0d-43d6-9300-4c2887dec864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:17.754243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74253de6-8b0d-43d6-9300-4c2887dec864 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:17.779350 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3602/7279] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:17.781138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74253de6-8b0d-43d6-9300-4c2887dec864 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:17.800645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74253de6-8b0d-43d6-9300-4c2887dec864 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:17.807787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42126f-97c9-482c-a3cb-6a304fbc6866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:17.808867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42126f-97c9-482c-a3cb-6a304fbc6866 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:17.809106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42126f-97c9-482c-a3cb-6a304fbc6866 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:17.809476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42126f-97c9-482c-a3cb-6a304fbc6866 admin admin] PATH_INFO: `/v3/projects/8736916be07c4e6886ed5280d4cce420/users/12b39cdbf0db4052b7197313efcc4d21/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:17.840739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42126f-97c9-482c-a3cb-6a304fbc6866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8736916be07c4e6886ed5280d4cce420, user_id=12b39cdbf0db4052b7197313efcc4d21, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:17.843627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42126f-97c9-482c-a3cb-6a304fbc6866 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:17.855638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b8813e25-ec90-4937-88a6-2181978a9bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1df10b26222640d68bdaf9e8e88c456b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:17.856297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b8813e25-ec90-4937-88a6-2181978a9bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1df10b26222640d68bdaf9e8e88c456b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:17.876948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b8813e25-ec90-4937-88a6-2181978a9bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1df10b26222640d68bdaf9e8e88c456b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:17.888739 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3678/7280] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:38:17 2022] DELETE /identity/v3/users/1df10b26222640d68bdaf9e8e88c456b => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:17.890627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e34ebc-fe3d-4341-a425-a78d0171516a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:17.890922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e34ebc-fe3d-4341-a425-a78d0171516a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:17.891277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e34ebc-fe3d-4341-a425-a78d0171516a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:17.911106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-61e34ebc-fe3d-4341-a425-a78d0171516a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:17.912825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-61e34ebc-fe3d-4341-a425-a78d0171516a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:17.978543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=5,keystone:SELECT=89,keystone:INSERT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:18.005477 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3603/7281] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:17 2022] PUT /identity/v3/projects/8736916be07c4e6886ed5280d4cce420/users/12b39cdbf0db4052b7197313efcc4d21/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:18.006718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42126f-97c9-482c-a3cb-6a304fbc6866 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:18.013392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8d42126f-97c9-482c-a3cb-6a304fbc6866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:18.061354 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3679/7282] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:18.120888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e34ebc-fe3d-4341-a425-a78d0171516a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:18.122520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-61e34ebc-fe3d-4341-a425-a78d0171516a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:18.179538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42126f-97c9-482c-a3cb-6a304fbc6866 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:18.188168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d8b56-c0f8-49cc-a8ec-65e50221444c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:18.189587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d8b56-c0f8-49cc-a8ec-65e50221444c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:18.189882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d8b56-c0f8-49cc-a8ec-65e50221444c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:18.190164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d8b56-c0f8-49cc-a8ec-65e50221444c admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:18.191152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d8b56-c0f8-49cc-a8ec-65e50221444c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:18.193476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d8b56-c0f8-49cc-a8ec-65e50221444c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:18.212710 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3604/7283] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:18.214165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d8b56-c0f8-49cc-a8ec-65e50221444c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:18.216827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-314d8b56-c0f8-49cc-a8ec-65e50221444c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:18.240152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e34ebc-fe3d-4341-a425-a78d0171516a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:18.337680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d8b56-c0f8-49cc-a8ec-65e50221444c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:18.344124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e3f06-e6c7-4b50-9168-6bd443b78cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:18.344124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e3f06-e6c7-4b50-9168-6bd443b78cab service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:18.344406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e3f06-e6c7-4b50-9168-6bd443b78cab service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:18.344683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e3f06-e6c7-4b50-9168-6bd443b78cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:18.346993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffce4c-7abc-4c0e-97aa-b7b5f52957d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:18.347698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffce4c-7abc-4c0e-97aa-b7b5f52957d4 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:18.348007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffce4c-7abc-4c0e-97aa-b7b5f52957d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:18.348287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffce4c-7abc-4c0e-97aa-b7b5f52957d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:18.369841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-caffce4c-7abc-4c0e-97aa-b7b5f52957d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:18.378204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e3f06-e6c7-4b50-9168-6bd443b78cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:18.380175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e3f06-e6c7-4b50-9168-6bd443b78cab service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:18.395314 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3680/7284] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:38:18.396664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e3f06-e6c7-4b50-9168-6bd443b78cab service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:18.418335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e3f06-e6c7-4b50-9168-6bd443b78cab service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:18.424692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7990f-c96f-43cc-b4d5-a6596720af64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:18.426780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7990f-c96f-43cc-b4d5-a6596720af64 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:18.427956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7990f-c96f-43cc-b4d5-a6596720af64 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:18.429324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7990f-c96f-43cc-b4d5-a6596720af64 admin admin] PATH_INFO: `/v3/projects/8736916be07c4e6886ed5280d4cce420/users/12b39cdbf0db4052b7197313efcc4d21/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:18.434488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7990f-c96f-43cc-b4d5-a6596720af64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8736916be07c4e6886ed5280d4cce420, user_id=12b39cdbf0db4052b7197313efcc4d21, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:18.439511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7990f-c96f-43cc-b4d5-a6596720af64 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:18.457983 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3681/7285] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:18 2022] PUT /identity/v3/projects/8736916be07c4e6886ed5280d4cce420/users/12b39cdbf0db4052b7197313efcc4d21/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:18.461343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7990f-c96f-43cc-b4d5-a6596720af64 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:18.476555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-46d7990f-c96f-43cc-b4d5-a6596720af64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:18.501710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffce4c-7abc-4c0e-97aa-b7b5f52957d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:18.503424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffce4c-7abc-4c0e-97aa-b7b5f52957d4 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:18.522597 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3605/7286] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:38:18.528562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85fa5b-6962-43d8-9fec-d2c280c7be1a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:18.528852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85fa5b-6962-43d8-9fec-d2c280c7be1a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:18.529348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85fa5b-6962-43d8-9fec-d2c280c7be1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:18.559594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ed85fa5b-6962-43d8-9fec-d2c280c7be1a None None] MFA Rules not processed for user `12b39cdbf0db4052b7197313efcc4d21`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:18.561164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ed85fa5b-6962-43d8-9fec-d2c280c7be1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:18.587409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7990f-c96f-43cc-b4d5-a6596720af64 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:18.592314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cea138-2dce-4412-9ef9-5b13a9a86c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:18.593293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cea138-2dce-4412-9ef9-5b13a9a86c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:18.593582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cea138-2dce-4412-9ef9-5b13a9a86c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:18.593889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cea138-2dce-4412-9ef9-5b13a9a86c41 admin admin] PATH_INFO: `/v3/users/70b1a8f603244b3f89cd5fcd02239625` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:18.595182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cea138-2dce-4412-9ef9-5b13a9a86c41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70b1a8f603244b3f89cd5fcd02239625)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:18.597282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cea138-2dce-4412-9ef9-5b13a9a86c41 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:18.640797 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3606/7287] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:18.655396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85fa5b-6962-43d8-9fec-d2c280c7be1a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:18.656815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ed85fa5b-6962-43d8-9fec-d2c280c7be1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:18.739840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85fa5b-6962-43d8-9fec-d2c280c7be1a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:18.746451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48361c5a-caed-4243-9127-c34b26f0730b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:18.747172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48361c5a-caed-4243-9127-c34b26f0730b service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:18.747457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48361c5a-caed-4243-9127-c34b26f0730b service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:18.747738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48361c5a-caed-4243-9127-c34b26f0730b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:18.749590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-48361c5a-caed-4243-9127-c34b26f0730b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:18.782653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6cea138-2dce-4412-9ef9-5b13a9a86c41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70b1a8f603244b3f89cd5fcd02239625'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:18.793484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6cea138-2dce-4412-9ef9-5b13a9a86c41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70b1a8f603244b3f89cd5fcd02239625'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:18.826962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48361c5a-caed-4243-9127-c34b26f0730b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:18.828604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48361c5a-caed-4243-9127-c34b26f0730b service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:18.838210 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3607/7288] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:38:18.862000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:18.871619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6cea138-2dce-4412-9ef9-5b13a9a86c41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70b1a8f603244b3f89cd5fcd02239625'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:18.871619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6cea138-2dce-4412-9ef9-5b13a9a86c41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70b1a8f603244b3f89cd5fcd02239625'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:18.882321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c6cea138-2dce-4412-9ef9-5b13a9a86c41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70b1a8f603244b3f89cd5fcd02239625'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:18.889150 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3682/7289] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:38:18 2022] DELETE /identity/v3/users/70b1a8f603244b3f89cd5fcd02239625 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:18.944232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48361c5a-caed-4243-9127-c34b26f0730b service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:18.947350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-48361c5a-caed-4243-9127-c34b26f0730b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:18.974294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48361c5a-caed-4243-9127-c34b26f0730b service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:19.059434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f55454-43c6-4fcf-ac15-08f033a5bf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:19.060457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f55454-43c6-4fcf-ac15-08f033a5bf13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:19.061070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f55454-43c6-4fcf-ac15-08f033a5bf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:19.061210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f55454-43c6-4fcf-ac15-08f033a5bf13 admin admin] PATH_INFO: `/v3/projects/15357ecc81b2491c972e3944f2b3d56a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:19.062859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f55454-43c6-4fcf-ac15-08f033a5bf13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15357ecc81b2491c972e3944f2b3d56a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:19.064940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f55454-43c6-4fcf-ac15-08f033a5bf13 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:19.220586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cea138-2dce-4412-9ef9-5b13a9a86c41 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:19.222140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c6cea138-2dce-4412-9ef9-5b13a9a86c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:19.244260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-82f55454-43c6-4fcf-ac15-08f033a5bf13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15357ecc81b2491c972e3944f2b3d56a', 'request_id': 'req-82f55454-43c6-4fcf-ac15-08f033a5bf13'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:19.247639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cea138-2dce-4412-9ef9-5b13a9a86c41 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:19.254359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-82f55454-43c6-4fcf-ac15-08f033a5bf13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15357ecc81b2491c972e3944f2b3d56a', 'request_id': 'req-82f55454-43c6-4fcf-ac15-08f033a5bf13'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:19.264080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-82f55454-43c6-4fcf-ac15-08f033a5bf13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15357ecc81b2491c972e3944f2b3d56a', 'request_id': 'req-82f55454-43c6-4fcf-ac15-08f033a5bf13'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:19.351661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea644331-a479-413e-8871-17bffb6d043f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:19.351661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea644331-a479-413e-8871-17bffb6d043f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:19.351661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea644331-a479-413e-8871-17bffb6d043f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:19.351661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea644331-a479-413e-8871-17bffb6d043f admin admin] PATH_INFO: `/v3/projects/c49966713115424c8b2590bc10ba1b0b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:19.352216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea644331-a479-413e-8871-17bffb6d043f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c49966713115424c8b2590bc10ba1b0b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:19.352216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea644331-a479-413e-8871-17bffb6d043f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:19.398372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-82f55454-43c6-4fcf-ac15-08f033a5bf13 admin admin] The token cache is being invalidate because project 15357ecc81b2491c972e3944f2b3d56a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:38:19.398899 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-82f55454-43c6-4fcf-ac15-08f033a5bf13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:19.399633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-82f55454-43c6-4fcf-ac15-08f033a5bf13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:19.401262 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3608/7290] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:38:18 2022] DELETE /identity/v3/projects/15357ecc81b2491c972e3944f2b3d56a => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:19.406000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee895b21-8d22-4873-8473-4fc4a7b0e086 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:19.406285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee895b21-8d22-4873-8473-4fc4a7b0e086 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:19.407070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee895b21-8d22-4873-8473-4fc4a7b0e086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:19.425162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ee895b21-8d22-4873-8473-4fc4a7b0e086 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:19.427740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:19.428405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ee895b21-8d22-4873-8473-4fc4a7b0e086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:19.437857 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3609/7291] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:38:19.447390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b800f36-48a1-4bd7-abbd-28f8ed85ad91 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:19.447680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b800f36-48a1-4bd7-abbd-28f8ed85ad91 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:19.447964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b800f36-48a1-4bd7-abbd-28f8ed85ad91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:19.467317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2b800f36-48a1-4bd7-abbd-28f8ed85ad91 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:19.468536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2b800f36-48a1-4bd7-abbd-28f8ed85ad91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:19.480699 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3610/7292] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:19.482155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b800f36-48a1-4bd7-abbd-28f8ed85ad91 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:19.491881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b800f36-48a1-4bd7-abbd-28f8ed85ad91 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:19.497494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31509ab-0d99-44fd-8056-dde2b1d53c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:19.498160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31509ab-0d99-44fd-8056-dde2b1d53c47 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:19.498621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31509ab-0d99-44fd-8056-dde2b1d53c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:19.498926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31509ab-0d99-44fd-8056-dde2b1d53c47 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:19.500098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31509ab-0d99-44fd-8056-dde2b1d53c47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:38:19.502362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31509ab-0d99-44fd-8056-dde2b1d53c47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:19.502362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31509ab-0d99-44fd-8056-dde2b1d53c47 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:19.515780 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3611/7293] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:38:19.519838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31509ab-0d99-44fd-8056-dde2b1d53c47 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:19.532344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31509ab-0d99-44fd-8056-dde2b1d53c47 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:19.547673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ea644331-a479-413e-8871-17bffb6d043f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c49966713115424c8b2590bc10ba1b0b', 'request_id': 'req-ea644331-a479-413e-8871-17bffb6d043f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:19.554709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ea644331-a479-413e-8871-17bffb6d043f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c49966713115424c8b2590bc10ba1b0b', 'request_id': 'req-ea644331-a479-413e-8871-17bffb6d043f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:19.562158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ea644331-a479-413e-8871-17bffb6d043f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c49966713115424c8b2590bc10ba1b0b', 'request_id': 'req-ea644331-a479-413e-8871-17bffb6d043f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:19.605898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36537332-ee01-4a98-88ac-29474d7081a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:19.606848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36537332-ee01-4a98-88ac-29474d7081a8 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:19.607159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36537332-ee01-4a98-88ac-29474d7081a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:19.607625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36537332-ee01-4a98-88ac-29474d7081a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:19.609333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36537332-ee01-4a98-88ac-29474d7081a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:19.611486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36537332-ee01-4a98-88ac-29474d7081a8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:19.672127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ea644331-a479-413e-8871-17bffb6d043f admin admin] The token cache is being invalidate because project c49966713115424c8b2590bc10ba1b0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:38:19.672600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ea644331-a479-413e-8871-17bffb6d043f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:19.673244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ea644331-a479-413e-8871-17bffb6d043f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:19.677877 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3683/7294] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:38:19 2022] DELETE /identity/v3/projects/c49966713115424c8b2590bc10ba1b0b => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:19.678911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea644331-a479-413e-8871-17bffb6d043f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:19.680364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ea644331-a479-413e-8871-17bffb6d043f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:19.698415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea644331-a479-413e-8871-17bffb6d043f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:19.702847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2e4a3-a07a-4e6f-a734-3eb188703110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:19.704123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2e4a3-a07a-4e6f-a734-3eb188703110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:19.704421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2e4a3-a07a-4e6f-a734-3eb188703110 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:19.704698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2e4a3-a07a-4e6f-a734-3eb188703110 admin admin] PATH_INFO: `/v3/users/c9b76f095b464db6a7c79f06c6a73d62` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:19.706018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2e4a3-a07a-4e6f-a734-3eb188703110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9b76f095b464db6a7c79f06c6a73d62)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:19.708817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2e4a3-a07a-4e6f-a734-3eb188703110 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:19.730696 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3612/7295] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:38:19 2022] POST /identity/v3/projects => generated 369 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:38:19.734815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36537332-ee01-4a98-88ac-29474d7081a8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:19.737192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-36537332-ee01-4a98-88ac-29474d7081a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:19.806914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36537332-ee01-4a98-88ac-29474d7081a8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:19.812116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473fe70-97ee-45df-b40a-6aade7023175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:19.812861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473fe70-97ee-45df-b40a-6aade7023175 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:19.813161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473fe70-97ee-45df-b40a-6aade7023175 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:19.813439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473fe70-97ee-45df-b40a-6aade7023175 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:19.814128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473fe70-97ee-45df-b40a-6aade7023175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:19.816338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473fe70-97ee-45df-b40a-6aade7023175 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:19.914837 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3613/7296] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:38:19 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:38:19.919379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473fe70-97ee-45df-b40a-6aade7023175 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:19.929573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473fe70-97ee-45df-b40a-6aade7023175 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:19.934402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c990f80-1982-486f-aa04-85dd2a9d92b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:19.935127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c990f80-1982-486f-aa04-85dd2a9d92b6 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:19.935412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c990f80-1982-486f-aa04-85dd2a9d92b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:19.935691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c990f80-1982-486f-aa04-85dd2a9d92b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:19.936411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c990f80-1982-486f-aa04-85dd2a9d92b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:19.938025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c990f80-1982-486f-aa04-85dd2a9d92b6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:19.948709 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3614/7297] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:38:19.958073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c990f80-1982-486f-aa04-85dd2a9d92b6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:19.968320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c990f80-1982-486f-aa04-85dd2a9d92b6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:19.973215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6502f-b981-4e82-b5ee-67513df46122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:19.973918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6502f-b981-4e82-b5ee-67513df46122 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:19.974712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6502f-b981-4e82-b5ee-67513df46122 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:19.974997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6502f-b981-4e82-b5ee-67513df46122 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:19.975737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6502f-b981-4e82-b5ee-67513df46122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:19.977468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6502f-b981-4e82-b5ee-67513df46122 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:19.987727 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3615/7298] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:38:19.991878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6502f-b981-4e82-b5ee-67513df46122 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:20.001571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6502f-b981-4e82-b5ee-67513df46122 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:20.006489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab93c0c-ffb9-46f0-822d-65b6692106e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:20.007388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab93c0c-ffb9-46f0-822d-65b6692106e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:20.007675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab93c0c-ffb9-46f0-822d-65b6692106e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:20.008508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab93c0c-ffb9-46f0-822d-65b6692106e5 admin admin] PATH_INFO: `/v3/projects/46ce65d7cc024ab1b40431ebdae953ee/users/ffa94d943bfb43e6808e8cbd9665ae66/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:20.023173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab93c0c-ffb9-46f0-822d-65b6692106e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ce65d7cc024ab1b40431ebdae953ee, user_id=ffa94d943bfb43e6808e8cbd9665ae66, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:20.026448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab93c0c-ffb9-46f0-822d-65b6692106e5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:20.058429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-22a2e4a3-a07a-4e6f-a734-3eb188703110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9b76f095b464db6a7c79f06c6a73d62'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:20.066456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-22a2e4a3-a07a-4e6f-a734-3eb188703110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9b76f095b464db6a7c79f06c6a73d62'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:20.108703 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3616/7299] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:19 2022] PUT /identity/v3/projects/46ce65d7cc024ab1b40431ebdae953ee/users/ffa94d943bfb43e6808e8cbd9665ae66/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:38:20.119366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f3338-70cb-411b-a86f-475206a12e58 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:20.121688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f3338-70cb-411b-a86f-475206a12e58 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:20.121994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f3338-70cb-411b-a86f-475206a12e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:20.125026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-22a2e4a3-a07a-4e6f-a734-3eb188703110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9b76f095b464db6a7c79f06c6a73d62'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:20.126478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-22a2e4a3-a07a-4e6f-a734-3eb188703110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9b76f095b464db6a7c79f06c6a73d62'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:20.142178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-22a2e4a3-a07a-4e6f-a734-3eb188703110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9b76f095b464db6a7c79f06c6a73d62'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:20.152456 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3684/7300] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:38:19 2022] DELETE /identity/v3/users/c9b76f095b464db6a7c79f06c6a73d62 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:20.160317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ec0f3338-70cb-411b-a86f-475206a12e58 None None] MFA Rules not processed for user `ffa94d943bfb43e6808e8cbd9665ae66`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:20.161540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ec0f3338-70cb-411b-a86f-475206a12e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:20.251534 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3617/7301] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:38:20.275036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2e4a3-a07a-4e6f-a734-3eb188703110 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:20.276917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-22a2e4a3-a07a-4e6f-a734-3eb188703110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:20.303802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:20.349811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2e4a3-a07a-4e6f-a734-3eb188703110 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:20.354886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d6c62-3cf8-4346-bb0f-473a997d258e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:20.355737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d6c62-3cf8-4346-bb0f-473a997d258e service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:20.356159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d6c62-3cf8-4346-bb0f-473a997d258e service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:20.357094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d6c62-3cf8-4346-bb0f-473a997d258e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:20.370227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d6c62-3cf8-4346-bb0f-473a997d258e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:20.372303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d6c62-3cf8-4346-bb0f-473a997d258e service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:20.385576 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3685/7302] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:20 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:38:21.031295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f3338-70cb-411b-a86f-475206a12e58 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:21.033013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ec0f3338-70cb-411b-a86f-475206a12e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:21.093141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:21.114809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f3338-70cb-411b-a86f-475206a12e58 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:21.119990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ec164-7552-4438-ae02-a4530ef73c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:21.120785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ec164-7552-4438-ae02-a4530ef73c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:21.121071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ec164-7552-4438-ae02-a4530ef73c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:21.121406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ec164-7552-4438-ae02-a4530ef73c56 admin admin] PATH_INFO: `/v3/projects/None` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:21.129333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ec164-7552-4438-ae02-a4530ef73c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:21.131245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ec164-7552-4438-ae02-a4530ef73c56 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:21.147319 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-fe7ec164-7552-4438-ae02-a4530ef73c56 admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Jul 16 21:38:21.147319 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:38:21.147319 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:38:21.147319 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:38:21.147319 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:38:21.147319 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:38:21.147319 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:38:21.147319 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:38:21.147319 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:38:21.147319 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:38:21.147319 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:38:21.147319 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:38:21.147319 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 16 21:38:21.147319 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 16 21:38:21.147319 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:38:21.147319 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:38:21.149163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 16 21:38:21.149163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 16 21:38:21.149163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 21:38:21.149163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 21:38:21.149163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 21:38:21.149163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 21:38:21.149163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Jul 16 21:38:21.149163 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:38:21.149163 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3618/7303] 10.222.0.16 () {58 vars in 1148 bytes} [Sat Jul 16 21:38:21 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 16 21:38:21.157446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189bed4-5208-456f-9835-c50b525dc442 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:21.161570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189bed4-5208-456f-9835-c50b525dc442 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:21.161570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189bed4-5208-456f-9835-c50b525dc442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:21.186192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a189bed4-5208-456f-9835-c50b525dc442 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:21.187504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a189bed4-5208-456f-9835-c50b525dc442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:21.197645 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3686/7304] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:38:21.206341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1068060-577d-46ce-8ef8-b236927262ce None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:21.207069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1068060-577d-46ce-8ef8-b236927262ce None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:21.207407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1068060-577d-46ce-8ef8-b236927262ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:21.228368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e1068060-577d-46ce-8ef8-b236927262ce None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:21.229748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e1068060-577d-46ce-8ef8-b236927262ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:21.240897 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3619/7305] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:21.246067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189bed4-5208-456f-9835-c50b525dc442 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:21.257563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189bed4-5208-456f-9835-c50b525dc442 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:21.267922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44b60e-5191-48d1-a80f-33423f0a89e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:21.267922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44b60e-5191-48d1-a80f-33423f0a89e2 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:21.267922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44b60e-5191-48d1-a80f-33423f0a89e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:21.267922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44b60e-5191-48d1-a80f-33423f0a89e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:21.268846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44b60e-5191-48d1-a80f-33423f0a89e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:38:21.268846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44b60e-5191-48d1-a80f-33423f0a89e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:21.268846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44b60e-5191-48d1-a80f-33423f0a89e2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:21.286811 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3687/7306] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:38:21.288012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1068060-577d-46ce-8ef8-b236927262ce None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:21.299917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1068060-577d-46ce-8ef8-b236927262ce None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:21.306095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde8176-a2c0-4b14-8dfb-2e95bf3e9a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:21.306833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde8176-a2c0-4b14-8dfb-2e95bf3e9a23 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:21.307236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde8176-a2c0-4b14-8dfb-2e95bf3e9a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:21.307605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde8176-a2c0-4b14-8dfb-2e95bf3e9a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:21.308395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde8176-a2c0-4b14-8dfb-2e95bf3e9a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:21.310581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde8176-a2c0-4b14-8dfb-2e95bf3e9a23 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:21.412373 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3620/7307] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:38:21 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:38:21.417756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44b60e-5191-48d1-a80f-33423f0a89e2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:21.434281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44b60e-5191-48d1-a80f-33423f0a89e2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:21.509717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b127e72-3308-4a71-b8f3-20b4bf5627ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:21.510415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b127e72-3308-4a71-b8f3-20b4bf5627ff admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:21.514809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b127e72-3308-4a71-b8f3-20b4bf5627ff admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:21.514809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b127e72-3308-4a71-b8f3-20b4bf5627ff admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:21.514809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b127e72-3308-4a71-b8f3-20b4bf5627ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:21.514809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b127e72-3308-4a71-b8f3-20b4bf5627ff admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:21.649772 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3688/7308] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:38:21 2022] POST /identity/v3/users => generated 290 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:38:21.651421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde8176-a2c0-4b14-8dfb-2e95bf3e9a23 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:21.665585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde8176-a2c0-4b14-8dfb-2e95bf3e9a23 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:21.670532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c045f6e-afa5-4705-ad94-00ba1b23900d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:21.671250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c045f6e-afa5-4705-ad94-00ba1b23900d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:21.671541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c045f6e-afa5-4705-ad94-00ba1b23900d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:21.671816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c045f6e-afa5-4705-ad94-00ba1b23900d admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:21.672548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c045f6e-afa5-4705-ad94-00ba1b23900d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:21.674201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c045f6e-afa5-4705-ad94-00ba1b23900d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:21.686674 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3621/7309] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:21.691190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b127e72-3308-4a71-b8f3-20b4bf5627ff admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:21.714380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b127e72-3308-4a71-b8f3-20b4bf5627ff admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:21.721852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37210592-077b-46f8-a372-952e4ec45fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:21.722747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37210592-077b-46f8-a372-952e4ec45fdf admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:21.723170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37210592-077b-46f8-a372-952e4ec45fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:21.723521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37210592-077b-46f8-a372-952e4ec45fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:21.724322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37210592-077b-46f8-a372-952e4ec45fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:21.726137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37210592-077b-46f8-a372-952e4ec45fdf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:21.739696 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3689/7310] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:21.745726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c045f6e-afa5-4705-ad94-00ba1b23900d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:21.755844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c045f6e-afa5-4705-ad94-00ba1b23900d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:21.760988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e86f2-884f-453b-91ff-4ec0dc231d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:21.762551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e86f2-884f-453b-91ff-4ec0dc231d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:21.762551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e86f2-884f-453b-91ff-4ec0dc231d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:21.762857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e86f2-884f-453b-91ff-4ec0dc231d5d admin admin] PATH_INFO: `/v3/projects/b533f85aeddf4d8db05f2c53a61befc3/users/62209b9802ab46c3b3d094d4d1ad86fe/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:21.779837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e86f2-884f-453b-91ff-4ec0dc231d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b533f85aeddf4d8db05f2c53a61befc3, user_id=62209b9802ab46c3b3d094d4d1ad86fe, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:21.785966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e86f2-884f-453b-91ff-4ec0dc231d5d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:21.871916 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3622/7311] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:21 2022] PUT /identity/v3/projects/b533f85aeddf4d8db05f2c53a61befc3/users/62209b9802ab46c3b3d094d4d1ad86fe/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:21.876789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598a367-ad8f-4ac5-aecd-a5bf8fbd507f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:21.877084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598a367-ad8f-4ac5-aecd-a5bf8fbd507f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:21.877369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598a367-ad8f-4ac5-aecd-a5bf8fbd507f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:21.897910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a598a367-ad8f-4ac5-aecd-a5bf8fbd507f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:21.900255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a598a367-ad8f-4ac5-aecd-a5bf8fbd507f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:21.936616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:21.974143 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3690/7312] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:21.990643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e86f2-884f-453b-91ff-4ec0dc231d5d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:22.015725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:22.065378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e86f2-884f-453b-91ff-4ec0dc231d5d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:22.072950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003776f-c430-4820-90fa-0a06ec04bc76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:22.072950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003776f-c430-4820-90fa-0a06ec04bc76 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:22.072950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003776f-c430-4820-90fa-0a06ec04bc76 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:22.072950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003776f-c430-4820-90fa-0a06ec04bc76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:22.085169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003776f-c430-4820-90fa-0a06ec04bc76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:22.087933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003776f-c430-4820-90fa-0a06ec04bc76 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:22.101753 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3623/7313] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:38:22.261024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:23.335891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:23.650777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:24.878097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:26.766024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598a367-ad8f-4ac5-aecd-a5bf8fbd507f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:26.811911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598a367-ad8f-4ac5-aecd-a5bf8fbd507f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:26.839612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc197f-2a0b-44fa-9c87-4a5cab43d164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:26.840754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc197f-2a0b-44fa-9c87-4a5cab43d164 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:26.841252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc197f-2a0b-44fa-9c87-4a5cab43d164 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:26.842569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc197f-2a0b-44fa-9c87-4a5cab43d164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:26.848688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a6cc197f-2a0b-44fa-9c87-4a5cab43d164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:27.011824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc197f-2a0b-44fa-9c87-4a5cab43d164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:27.015041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc197f-2a0b-44fa-9c87-4a5cab43d164 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:27.046942 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3691/7314] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:38:30.829756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a40e15-ae94-4569-b6c5-c0fa2aedcc63 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:30.830257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a40e15-ae94-4569-b6c5-c0fa2aedcc63 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:30.830468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a40e15-ae94-4569-b6c5-c0fa2aedcc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:30.898659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f9a40e15-ae94-4569-b6c5-c0fa2aedcc63 None None] MFA Rules not processed for user `62209b9802ab46c3b3d094d4d1ad86fe`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:30.900356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f9a40e15-ae94-4569-b6c5-c0fa2aedcc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:31.051202 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3624/7315] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:31.053120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc197f-2a0b-44fa-9c87-4a5cab43d164 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:31.083499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc197f-2a0b-44fa-9c87-4a5cab43d164 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:31.102761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d7602-16c2-486a-8535-b13b394802ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:31.104391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d7602-16c2-486a-8535-b13b394802ff admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:31.104834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d7602-16c2-486a-8535-b13b394802ff admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:31.105347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d7602-16c2-486a-8535-b13b394802ff admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:31.110682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d7602-16c2-486a-8535-b13b394802ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:31.120284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d7602-16c2-486a-8535-b13b394802ff admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:31.172026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:31.291611 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3692/7316] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:38:31 2022] POST /identity/v3/projects => generated 379 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:38:31.300035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a40e15-ae94-4569-b6c5-c0fa2aedcc63 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:31.347398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a40e15-ae94-4569-b6c5-c0fa2aedcc63 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:31.373785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:31.488132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbeb4d6-e714-4b8c-b712-66153650bc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:31.489279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbeb4d6-e714-4b8c-b712-66153650bc76 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:31.489441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbeb4d6-e714-4b8c-b712-66153650bc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:31.489726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbeb4d6-e714-4b8c-b712-66153650bc76 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:31.491126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbeb4d6-e714-4b8c-b712-66153650bc76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:31.494533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbeb4d6-e714-4b8c-b712-66153650bc76 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:31.634802 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3625/7317] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:38:31 2022] POST /identity/v3/users => generated 296 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:38:31.635431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d7602-16c2-486a-8535-b13b394802ff admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:31.656011 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d7602-16c2-486a-8535-b13b394802ff admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:31.668721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a37748-ae7d-46e6-b295-9e2c71f69901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:31.670030 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a37748-ae7d-46e6-b295-9e2c71f69901 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:31.670480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a37748-ae7d-46e6-b295-9e2c71f69901 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:31.670766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a37748-ae7d-46e6-b295-9e2c71f69901 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:31.671966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a37748-ae7d-46e6-b295-9e2c71f69901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:31.673662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a37748-ae7d-46e6-b295-9e2c71f69901 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:31.698520 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3693/7318] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:31.703208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbeb4d6-e714-4b8c-b712-66153650bc76 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:31.717420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbeb4d6-e714-4b8c-b712-66153650bc76 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:31.725341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c0055-9081-413e-92be-7d2cff9eca43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:31.727287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c0055-9081-413e-92be-7d2cff9eca43 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:31.727642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c0055-9081-413e-92be-7d2cff9eca43 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:31.728022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c0055-9081-413e-92be-7d2cff9eca43 admin admin] PATH_INFO: `/v3/projects/f3f556f434094840ac67dadfa648a6ec/users/88636030272f42c285464c3f9fc0af53/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:31.745942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c0055-9081-413e-92be-7d2cff9eca43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f556f434094840ac67dadfa648a6ec, user_id=88636030272f42c285464c3f9fc0af53, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:31.748823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c0055-9081-413e-92be-7d2cff9eca43 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:31.895977 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3626/7319] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:31 2022] PUT /identity/v3/projects/f3f556f434094840ac67dadfa648a6ec/users/88636030272f42c285464c3f9fc0af53/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:38:31.898085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a37748-ae7d-46e6-b295-9e2c71f69901 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:31.911356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a37748-ae7d-46e6-b295-9e2c71f69901 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:31.976349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3d53f-4eab-4f9d-a02a-307f7926bdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:31.977867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3d53f-4eab-4f9d-a02a-307f7926bdbf admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:31.978150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3d53f-4eab-4f9d-a02a-307f7926bdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:31.978424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3d53f-4eab-4f9d-a02a-307f7926bdbf admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:31.984454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3d53f-4eab-4f9d-a02a-307f7926bdbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:31.986757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3d53f-4eab-4f9d-a02a-307f7926bdbf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:32.005855 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3694/7320] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:32.006625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c0055-9081-413e-92be-7d2cff9eca43 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:32.020286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c0055-9081-413e-92be-7d2cff9eca43 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:32.026279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659aee9-fe0c-45f3-845c-166062f5cab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:32.027601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659aee9-fe0c-45f3-845c-166062f5cab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:32.028047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659aee9-fe0c-45f3-845c-166062f5cab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:32.028697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659aee9-fe0c-45f3-845c-166062f5cab5 admin admin] PATH_INFO: `/v3/projects/f3f556f434094840ac67dadfa648a6ec/users/88636030272f42c285464c3f9fc0af53/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:32.030864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659aee9-fe0c-45f3-845c-166062f5cab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f556f434094840ac67dadfa648a6ec, user_id=88636030272f42c285464c3f9fc0af53, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:32.033881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659aee9-fe0c-45f3-845c-166062f5cab5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:32.058875 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3627/7321] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:32 2022] PUT /identity/v3/projects/f3f556f434094840ac67dadfa648a6ec/users/88636030272f42c285464c3f9fc0af53/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:33.946053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f6ff8-661d-4fee-a44b-45cc6d3b2dab None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:33.946520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f6ff8-661d-4fee-a44b-45cc6d3b2dab None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:33.946983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f6ff8-661d-4fee-a44b-45cc6d3b2dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:33.985950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2a3f6ff8-661d-4fee-a44b-45cc6d3b2dab None None] MFA Rules not processed for user `833136cbdeab4b9e8b6dd2d24c7c8753`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:33.985950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2a3f6ff8-661d-4fee-a44b-45cc6d3b2dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:34.123107 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3695/7322] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:34.632062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659aee9-fe0c-45f3-845c-166062f5cab5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:34.732405 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659aee9-fe0c-45f3-845c-166062f5cab5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:34.736465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30586304-8a11-456a-b1e9-646dfeb06fc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:34.737319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30586304-8a11-456a-b1e9-646dfeb06fc1 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:34.737611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30586304-8a11-456a-b1e9-646dfeb06fc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:34.738120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30586304-8a11-456a-b1e9-646dfeb06fc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:34.740605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-30586304-8a11-456a-b1e9-646dfeb06fc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:34.762129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30586304-8a11-456a-b1e9-646dfeb06fc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:34.764818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30586304-8a11-456a-b1e9-646dfeb06fc1 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:34.795730 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3628/7323] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:38:39.484397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f6ff8-661d-4fee-a44b-45cc6d3b2dab None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:39.486548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2a3f6ff8-661d-4fee-a44b-45cc6d3b2dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:39.609197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f6ff8-661d-4fee-a44b-45cc6d3b2dab None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:39.615727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b5782-d020-4a6a-b274-96cc28a89299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:39.616601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b5782-d020-4a6a-b274-96cc28a89299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:39.617695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b5782-d020-4a6a-b274-96cc28a89299 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:39.618123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b5782-d020-4a6a-b274-96cc28a89299 admin admin] PATH_INFO: `/v3/users/2fd88df1ee1e4c8eb30675f496cf92ee` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:39.619553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b5782-d020-4a6a-b274-96cc28a89299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fd88df1ee1e4c8eb30675f496cf92ee)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:39.622388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b5782-d020-4a6a-b274-96cc28a89299 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:39.847392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:39.931702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b49b5782-d020-4a6a-b274-96cc28a89299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fd88df1ee1e4c8eb30675f496cf92ee'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:39.949309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b49b5782-d020-4a6a-b274-96cc28a89299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fd88df1ee1e4c8eb30675f496cf92ee'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:40.049999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b49b5782-d020-4a6a-b274-96cc28a89299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fd88df1ee1e4c8eb30675f496cf92ee'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:40.050684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b49b5782-d020-4a6a-b274-96cc28a89299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fd88df1ee1e4c8eb30675f496cf92ee'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:40.064509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b49b5782-d020-4a6a-b274-96cc28a89299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fd88df1ee1e4c8eb30675f496cf92ee'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:40.071258 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3696/7324] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:38:39 2022] DELETE /identity/v3/users/2fd88df1ee1e4c8eb30675f496cf92ee => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:40.075688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62567229-0f84-4405-8005-1a2185065801 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:40.076218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62567229-0f84-4405-8005-1a2185065801 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:40.076460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62567229-0f84-4405-8005-1a2185065801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:40.108671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-62567229-0f84-4405-8005-1a2185065801 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:40.110124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-62567229-0f84-4405-8005-1a2185065801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:40.227427 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3629/7325] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:40.238372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b5782-d020-4a6a-b274-96cc28a89299 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:40.240793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b49b5782-d020-4a6a-b274-96cc28a89299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:40.346336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b5782-d020-4a6a-b274-96cc28a89299 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:40.352272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0298b-187a-4b38-b34c-37401d553ec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:40.353045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0298b-187a-4b38-b34c-37401d553ec4 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:40.353330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0298b-187a-4b38-b34c-37401d553ec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:40.354278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0298b-187a-4b38-b34c-37401d553ec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:40.365935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0298b-187a-4b38-b34c-37401d553ec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:40.368191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0298b-187a-4b38-b34c-37401d553ec4 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:40.390391 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3697/7326] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:38:41.257594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62567229-0f84-4405-8005-1a2185065801 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:41.259812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-62567229-0f84-4405-8005-1a2185065801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:41.268869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:41.274994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62567229-0f84-4405-8005-1a2185065801 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:41.280476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f4a0a-bf3d-4869-8943-cbca2e0445b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:41.281724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f4a0a-bf3d-4869-8943-cbca2e0445b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:41.282079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f4a0a-bf3d-4869-8943-cbca2e0445b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:41.282428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f4a0a-bf3d-4869-8943-cbca2e0445b7 admin admin] PATH_INFO: `/v3/projects/0b43e48813b74d35901f0e017dda6dec` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:41.283759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f4a0a-bf3d-4869-8943-cbca2e0445b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b43e48813b74d35901f0e017dda6dec)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:41.286302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f4a0a-bf3d-4869-8943-cbca2e0445b7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:41.500765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-134f4a0a-bf3d-4869-8943-cbca2e0445b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b43e48813b74d35901f0e017dda6dec', 'request_id': 'req-134f4a0a-bf3d-4869-8943-cbca2e0445b7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:41.509358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-134f4a0a-bf3d-4869-8943-cbca2e0445b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b43e48813b74d35901f0e017dda6dec', 'request_id': 'req-134f4a0a-bf3d-4869-8943-cbca2e0445b7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:41.518904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-134f4a0a-bf3d-4869-8943-cbca2e0445b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b43e48813b74d35901f0e017dda6dec', 'request_id': 'req-134f4a0a-bf3d-4869-8943-cbca2e0445b7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:41.690685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-134f4a0a-bf3d-4869-8943-cbca2e0445b7 admin admin] The token cache is being invalidate because project 0b43e48813b74d35901f0e017dda6dec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:38:41.690985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-134f4a0a-bf3d-4869-8943-cbca2e0445b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:41.691716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-134f4a0a-bf3d-4869-8943-cbca2e0445b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:41.693693 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3630/7327] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:38:41 2022] DELETE /identity/v3/projects/0b43e48813b74d35901f0e017dda6dec => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:41.699158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985611ef-46d2-49d8-8439-b0d37130b082 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:41.700212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985611ef-46d2-49d8-8439-b0d37130b082 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:41.700650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985611ef-46d2-49d8-8439-b0d37130b082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:41.750550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-985611ef-46d2-49d8-8439-b0d37130b082 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:41.752668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-985611ef-46d2-49d8-8439-b0d37130b082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:41.846269 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3698/7328] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:41.854912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2557938-e7f9-4e78-b315-dd70d3d6db53 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:41.855512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2557938-e7f9-4e78-b315-dd70d3d6db53 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:41.855948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2557938-e7f9-4e78-b315-dd70d3d6db53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:41.909430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a2557938-e7f9-4e78-b315-dd70d3d6db53 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:41.913260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a2557938-e7f9-4e78-b315-dd70d3d6db53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:41.938192 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3631/7329] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:41.943640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985611ef-46d2-49d8-8439-b0d37130b082 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:41.962560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985611ef-46d2-49d8-8439-b0d37130b082 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:41.974422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdd70b-a630-48b1-90ef-9389b853584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:41.975139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdd70b-a630-48b1-90ef-9389b853584c admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:41.975426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdd70b-a630-48b1-90ef-9389b853584c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:41.975705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdd70b-a630-48b1-90ef-9389b853584c admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:41.979456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdd70b-a630-48b1-90ef-9389b853584c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:38:41.979784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdd70b-a630-48b1-90ef-9389b853584c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:41.982180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdd70b-a630-48b1-90ef-9389b853584c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:42.002081 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3699/7330] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:38:42.006411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2557938-e7f9-4e78-b315-dd70d3d6db53 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:42.024303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2557938-e7f9-4e78-b315-dd70d3d6db53 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:42.031761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c1bbc-efed-4727-9ac0-23dede9f366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:42.032734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c1bbc-efed-4727-9ac0-23dede9f366a admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:42.033165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c1bbc-efed-4727-9ac0-23dede9f366a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:42.033869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c1bbc-efed-4727-9ac0-23dede9f366a admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:42.034880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c1bbc-efed-4727-9ac0-23dede9f366a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:42.047436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c1bbc-efed-4727-9ac0-23dede9f366a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:42.187616 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3632/7331] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:38:42 2022] POST /identity/v3/projects => generated 399 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:38:42.193158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdd70b-a630-48b1-90ef-9389b853584c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:42.208355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdd70b-a630-48b1-90ef-9389b853584c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:42.250413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:42.290162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba4461-6602-4256-aade-26f094cac9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:42.291054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba4461-6602-4256-aade-26f094cac9a4 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:42.291415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba4461-6602-4256-aade-26f094cac9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:42.296624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba4461-6602-4256-aade-26f094cac9a4 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:42.296624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba4461-6602-4256-aade-26f094cac9a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:42.296624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba4461-6602-4256-aade-26f094cac9a4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:42.435208 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3700/7332] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:38:42 2022] POST /identity/v3/users => generated 300 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:38:42.437178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c1bbc-efed-4727-9ac0-23dede9f366a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:42.455347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c1bbc-efed-4727-9ac0-23dede9f366a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:42.461221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b394e-5432-45c6-8c24-8426e26c2255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:42.462938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b394e-5432-45c6-8c24-8426e26c2255 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:42.463616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b394e-5432-45c6-8c24-8426e26c2255 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:42.464018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b394e-5432-45c6-8c24-8426e26c2255 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:42.464873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b394e-5432-45c6-8c24-8426e26c2255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:42.467666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b394e-5432-45c6-8c24-8426e26c2255 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:42.480110 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3633/7333] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:42.484326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba4461-6602-4256-aade-26f094cac9a4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:42.500579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba4461-6602-4256-aade-26f094cac9a4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:42.513847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f4528-c64b-44ad-b3e5-a2a2de7dc9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:42.514581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f4528-c64b-44ad-b3e5-a2a2de7dc9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:42.514867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f4528-c64b-44ad-b3e5-a2a2de7dc9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:42.515186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f4528-c64b-44ad-b3e5-a2a2de7dc9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:42.515911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f4528-c64b-44ad-b3e5-a2a2de7dc9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:42.517758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f4528-c64b-44ad-b3e5-a2a2de7dc9c0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:42.529335 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3701/7334] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:42.533998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b394e-5432-45c6-8c24-8426e26c2255 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:42.550665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b394e-5432-45c6-8c24-8426e26c2255 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:42.559599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa686de-cafd-4606-87bb-e71428ce29a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:42.560791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa686de-cafd-4606-87bb-e71428ce29a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:42.561064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa686de-cafd-4606-87bb-e71428ce29a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:42.561546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa686de-cafd-4606-87bb-e71428ce29a0 admin admin] PATH_INFO: `/v3/projects/3a65db22ff1e4f57ad5fe34fb25c6c08/users/96313adfa10d47138aefbcd37b5b498d/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:42.581585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa686de-cafd-4606-87bb-e71428ce29a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a65db22ff1e4f57ad5fe34fb25c6c08, user_id=96313adfa10d47138aefbcd37b5b498d, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:42.584391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa686de-cafd-4606-87bb-e71428ce29a0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:42.725558 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3634/7335] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:42 2022] PUT /identity/v3/projects/3a65db22ff1e4f57ad5fe34fb25c6c08/users/96313adfa10d47138aefbcd37b5b498d/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:42.738667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16accb-6b85-41e1-ba67-6ec9e9f3691d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:42.739172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16accb-6b85-41e1-ba67-6ec9e9f3691d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:42.739319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16accb-6b85-41e1-ba67-6ec9e9f3691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:42.772645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3e16accb-6b85-41e1-ba67-6ec9e9f3691d None None] MFA Rules not processed for user `96313adfa10d47138aefbcd37b5b498d`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:42.775139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3e16accb-6b85-41e1-ba67-6ec9e9f3691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:42.885059 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3702/7336] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:42.896871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa686de-cafd-4606-87bb-e71428ce29a0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:42.899757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5aa686de-cafd-4606-87bb-e71428ce29a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:42.976166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa686de-cafd-4606-87bb-e71428ce29a0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:42.982479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72faf9d-35f2-462b-a878-b49242c1361b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:42.982479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72faf9d-35f2-462b-a878-b49242c1361b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:42.990610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef5b7b-514b-4157-970a-002d56c1eb26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:42.991342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef5b7b-514b-4157-970a-002d56c1eb26 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:42.991631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef5b7b-514b-4157-970a-002d56c1eb26 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:42.991912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef5b7b-514b-4157-970a-002d56c1eb26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:42.994181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72faf9d-35f2-462b-a878-b49242c1361b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:43.014475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef5b7b-514b-4157-970a-002d56c1eb26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:43.017606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef5b7b-514b-4157-970a-002d56c1eb26 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:43.042654 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3635/7337] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:38:43.072126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e72faf9d-35f2-462b-a878-b49242c1361b None None] MFA Rules not processed for user `88636030272f42c285464c3f9fc0af53`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:43.086187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e72faf9d-35f2-462b-a878-b49242c1361b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:43.277134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef5b7b-514b-4157-970a-002d56c1eb26 service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:43.286005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-53ef5b7b-514b-4157-970a-002d56c1eb26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:43.318517 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3703/7338] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:43.337737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72faf9d-35f2-462b-a878-b49242c1361b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:43.339963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e72faf9d-35f2-462b-a878-b49242c1361b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:43.360121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:43.432026 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef5b7b-514b-4157-970a-002d56c1eb26 service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:43.442321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbfbbc-e3ff-468d-9ea1-485f419682be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:43.443265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbfbbc-e3ff-468d-9ea1-485f419682be admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:43.447355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbfbbc-e3ff-468d-9ea1-485f419682be admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:43.447750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbfbbc-e3ff-468d-9ea1-485f419682be admin admin] PATH_INFO: `/v3/users/ffa94d943bfb43e6808e8cbd9665ae66` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:43.451176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbfbbc-e3ff-468d-9ea1-485f419682be admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffa94d943bfb43e6808e8cbd9665ae66)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:43.453792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbfbbc-e3ff-468d-9ea1-485f419682be admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:43.465382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72faf9d-35f2-462b-a878-b49242c1361b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:43.496264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effb373-95d6-4f6c-8ec1-b3a5a9b357e1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:43.496988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effb373-95d6-4f6c-8ec1-b3a5a9b357e1 service glance] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:43.497276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effb373-95d6-4f6c-8ec1-b3a5a9b357e1 service glance] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:43.497689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effb373-95d6-4f6c-8ec1-b3a5a9b357e1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:43.504175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1effb373-95d6-4f6c-8ec1-b3a5a9b357e1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:43.650388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effb373-95d6-4f6c-8ec1-b3a5a9b357e1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:43.653563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effb373-95d6-4f6c-8ec1-b3a5a9b357e1 service glance] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:43.686922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:43.705910 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3704/7339] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:38:43.708884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-57cbfbbc-e3ff-468d-9ea1-485f419682be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffa94d943bfb43e6808e8cbd9665ae66'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:43.765432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-57cbfbbc-e3ff-468d-9ea1-485f419682be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffa94d943bfb43e6808e8cbd9665ae66'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:43.857435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-57cbfbbc-e3ff-468d-9ea1-485f419682be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffa94d943bfb43e6808e8cbd9665ae66'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:43.875416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-57cbfbbc-e3ff-468d-9ea1-485f419682be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffa94d943bfb43e6808e8cbd9665ae66'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:43.876393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-57cbfbbc-e3ff-468d-9ea1-485f419682be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffa94d943bfb43e6808e8cbd9665ae66'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:43.884481 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3636/7340] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:38:43 2022] DELETE /identity/v3/users/ffa94d943bfb43e6808e8cbd9665ae66 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:38:43.889013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47371c2-e1e8-4506-9409-853150f11402 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:43.890145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47371c2-e1e8-4506-9409-853150f11402 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:43.894302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47371c2-e1e8-4506-9409-853150f11402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:43.912144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a47371c2-e1e8-4506-9409-853150f11402 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:43.913585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a47371c2-e1e8-4506-9409-853150f11402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:43.986460 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3705/7341] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:43.996714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbfbbc-e3ff-468d-9ea1-485f419682be admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:43.998999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-57cbfbbc-e3ff-468d-9ea1-485f419682be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:44.095574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbfbbc-e3ff-468d-9ea1-485f419682be admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:44.099788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d5f93-4e76-46c0-a9c8-efcc5cb8e8b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:44.103995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d5f93-4e76-46c0-a9c8-efcc5cb8e8b3 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:44.103995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d5f93-4e76-46c0-a9c8-efcc5cb8e8b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:44.103995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d5f93-4e76-46c0-a9c8-efcc5cb8e8b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:44.112298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d5f93-4e76-46c0-a9c8-efcc5cb8e8b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:44.113678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d5f93-4e76-46c0-a9c8-efcc5cb8e8b3 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:44.126077 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3637/7342] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:38:44.452607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47371c2-e1e8-4506-9409-853150f11402 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:44.454250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a47371c2-e1e8-4506-9409-853150f11402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:44.488687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47371c2-e1e8-4506-9409-853150f11402 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:44.512939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e05632-cb2b-4a65-a8bc-ba0f07f843eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:44.516837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e05632-cb2b-4a65-a8bc-ba0f07f843eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:44.517124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e05632-cb2b-4a65-a8bc-ba0f07f843eb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:44.517601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e05632-cb2b-4a65-a8bc-ba0f07f843eb admin admin] PATH_INFO: `/v3/projects/46ce65d7cc024ab1b40431ebdae953ee` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:44.520094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e05632-cb2b-4a65-a8bc-ba0f07f843eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ce65d7cc024ab1b40431ebdae953ee)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:44.527552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e05632-cb2b-4a65-a8bc-ba0f07f843eb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:44.713791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51e05632-cb2b-4a65-a8bc-ba0f07f843eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ce65d7cc024ab1b40431ebdae953ee', 'request_id': 'req-51e05632-cb2b-4a65-a8bc-ba0f07f843eb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:44.720825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51e05632-cb2b-4a65-a8bc-ba0f07f843eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ce65d7cc024ab1b40431ebdae953ee', 'request_id': 'req-51e05632-cb2b-4a65-a8bc-ba0f07f843eb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:44.726903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51e05632-cb2b-4a65-a8bc-ba0f07f843eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ce65d7cc024ab1b40431ebdae953ee', 'request_id': 'req-51e05632-cb2b-4a65-a8bc-ba0f07f843eb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:44.862325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51e05632-cb2b-4a65-a8bc-ba0f07f843eb admin admin] The token cache is being invalidate because project 46ce65d7cc024ab1b40431ebdae953ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:38:44.862742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51e05632-cb2b-4a65-a8bc-ba0f07f843eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:44.866560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51e05632-cb2b-4a65-a8bc-ba0f07f843eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:44.872904 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3706/7343] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:38:44 2022] DELETE /identity/v3/projects/46ce65d7cc024ab1b40431ebdae953ee => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:44.874434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e4354-3d85-4bdb-b698-1f7f18e052a4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:44.874840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e4354-3d85-4bdb-b698-1f7f18e052a4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:44.875027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e4354-3d85-4bdb-b698-1f7f18e052a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:44.897848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-be9e4354-3d85-4bdb-b698-1f7f18e052a4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:44.900162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-be9e4354-3d85-4bdb-b698-1f7f18e052a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:45.004929 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3638/7344] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:45.013849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979e355-4041-43b2-94c5-a8fe5c44f9e0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:45.015064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979e355-4041-43b2-94c5-a8fe5c44f9e0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:45.015431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979e355-4041-43b2-94c5-a8fe5c44f9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:45.080937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7979e355-4041-43b2-94c5-a8fe5c44f9e0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:45.080937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7979e355-4041-43b2-94c5-a8fe5c44f9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:45.110251 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3707/7345] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:45.115241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e4354-3d85-4bdb-b698-1f7f18e052a4 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:45.141807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e4354-3d85-4bdb-b698-1f7f18e052a4 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:45.142438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:45.146965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04f714-11ef-4be1-afcc-0881a5dc9af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:45.147598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04f714-11ef-4be1-afcc-0881a5dc9af3 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:45.148060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04f714-11ef-4be1-afcc-0881a5dc9af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:45.148578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04f714-11ef-4be1-afcc-0881a5dc9af3 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:45.149428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04f714-11ef-4be1-afcc-0881a5dc9af3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:38:45.149779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04f714-11ef-4be1-afcc-0881a5dc9af3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:45.151490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04f714-11ef-4be1-afcc-0881a5dc9af3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:45.172493 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3639/7346] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:38:45.173826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979e355-4041-43b2-94c5-a8fe5c44f9e0 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:45.184355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979e355-4041-43b2-94c5-a8fe5c44f9e0 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:45.189823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7d827-0772-47e7-aca6-f7020baf35b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:45.190550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7d827-0772-47e7-aca6-f7020baf35b6 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:45.190914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7d827-0772-47e7-aca6-f7020baf35b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:45.191339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7d827-0772-47e7-aca6-f7020baf35b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:45.192123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7d827-0772-47e7-aca6-f7020baf35b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:45.194089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7d827-0772-47e7-aca6-f7020baf35b6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:45.300152 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3708/7347] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:38:45 2022] POST /identity/v3/projects => generated 405 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:38:45.303926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04f714-11ef-4be1-afcc-0881a5dc9af3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:45.327103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04f714-11ef-4be1-afcc-0881a5dc9af3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:45.411888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:45.433866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272b91c-882e-4808-838d-2ae4b26d7606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:45.435074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272b91c-882e-4808-838d-2ae4b26d7606 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:45.435520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272b91c-882e-4808-838d-2ae4b26d7606 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:45.436005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272b91c-882e-4808-838d-2ae4b26d7606 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:45.436860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272b91c-882e-4808-838d-2ae4b26d7606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:45.439072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272b91c-882e-4808-838d-2ae4b26d7606 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:45.610489 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3640/7348] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:38:45 2022] POST /identity/v3/users => generated 303 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:38:45.614559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7d827-0772-47e7-aca6-f7020baf35b6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:45.625777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7d827-0772-47e7-aca6-f7020baf35b6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:45.631628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b079fa4-e94f-4ed8-afd1-b5e1d03e6faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:45.632527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b079fa4-e94f-4ed8-afd1-b5e1d03e6faa admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:45.633568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b079fa4-e94f-4ed8-afd1-b5e1d03e6faa admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:45.633862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b079fa4-e94f-4ed8-afd1-b5e1d03e6faa admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:45.634596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b079fa4-e94f-4ed8-afd1-b5e1d03e6faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:45.636341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b079fa4-e94f-4ed8-afd1-b5e1d03e6faa admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:45.646746 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3709/7349] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:45.657289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272b91c-882e-4808-838d-2ae4b26d7606 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:45.669544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272b91c-882e-4808-838d-2ae4b26d7606 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:45.675663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2db93-c24b-4039-98c1-45e25995d238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:45.676370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2db93-c24b-4039-98c1-45e25995d238 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:45.676659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2db93-c24b-4039-98c1-45e25995d238 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:45.676918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2db93-c24b-4039-98c1-45e25995d238 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:45.678194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2db93-c24b-4039-98c1-45e25995d238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:45.680023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2db93-c24b-4039-98c1-45e25995d238 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:45.709020 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3641/7350] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:45.713485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b079fa4-e94f-4ed8-afd1-b5e1d03e6faa admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:45.726237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b079fa4-e94f-4ed8-afd1-b5e1d03e6faa admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:45.731781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d151e3-9959-4a82-98ef-ac2635c7f32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:45.733197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d151e3-9959-4a82-98ef-ac2635c7f32e admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:45.733652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d151e3-9959-4a82-98ef-ac2635c7f32e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:45.734117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d151e3-9959-4a82-98ef-ac2635c7f32e admin admin] PATH_INFO: `/v3/projects/f30d854ada374ea386bec879f614de14/users/15287369c59b41da90e7b545b1e5a406/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:45.754481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d151e3-9959-4a82-98ef-ac2635c7f32e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f30d854ada374ea386bec879f614de14, user_id=15287369c59b41da90e7b545b1e5a406, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:45.757552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d151e3-9959-4a82-98ef-ac2635c7f32e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:45.921816 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3710/7351] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:45 2022] PUT /identity/v3/projects/f30d854ada374ea386bec879f614de14/users/15287369c59b41da90e7b545b1e5a406/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:45.937673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14262c7c-821a-4275-bb7c-516395ebda36 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:45.938159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14262c7c-821a-4275-bb7c-516395ebda36 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:45.938415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14262c7c-821a-4275-bb7c-516395ebda36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:46.005458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-14262c7c-821a-4275-bb7c-516395ebda36 None None] MFA Rules not processed for user `15287369c59b41da90e7b545b1e5a406`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:46.006689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-14262c7c-821a-4275-bb7c-516395ebda36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:46.116645 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3642/7352] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:46.121875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d151e3-9959-4a82-98ef-ac2635c7f32e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:46.208366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d151e3-9959-4a82-98ef-ac2635c7f32e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:46.214035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b219f1-297b-4db0-8c53-36d7dae0a5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:46.215038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b219f1-297b-4db0-8c53-36d7dae0a5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:46.215323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b219f1-297b-4db0-8c53-36d7dae0a5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:46.215625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b219f1-297b-4db0-8c53-36d7dae0a5e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:46.216313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b219f1-297b-4db0-8c53-36d7dae0a5e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:46.218451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b219f1-297b-4db0-8c53-36d7dae0a5e6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:46.430759 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3711/7353] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:38:46 2022] POST /identity/v3/projects => generated 405 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:38:46.434773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14262c7c-821a-4275-bb7c-516395ebda36 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:46.445612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14262c7c-821a-4275-bb7c-516395ebda36 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:46.521783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727a030-6228-4ed1-b3e1-2470723dbb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:46.522634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727a030-6228-4ed1-b3e1-2470723dbb2c admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:46.522987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727a030-6228-4ed1-b3e1-2470723dbb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:46.524304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727a030-6228-4ed1-b3e1-2470723dbb2c admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:46.525095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727a030-6228-4ed1-b3e1-2470723dbb2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:46.527171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727a030-6228-4ed1-b3e1-2470723dbb2c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:46.673702 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3643/7354] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:38:46 2022] POST /identity/v3/users => generated 309 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:38:46.677520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b219f1-297b-4db0-8c53-36d7dae0a5e6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:46.689643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b219f1-297b-4db0-8c53-36d7dae0a5e6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:46.696024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f364b81-3d40-4dee-b2ac-34b9022ac0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:46.696856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f364b81-3d40-4dee-b2ac-34b9022ac0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:46.697378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f364b81-3d40-4dee-b2ac-34b9022ac0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:46.697867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f364b81-3d40-4dee-b2ac-34b9022ac0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:46.698690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f364b81-3d40-4dee-b2ac-34b9022ac0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:46.700832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f364b81-3d40-4dee-b2ac-34b9022ac0c8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:46.719738 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3712/7355] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:46.720913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727a030-6228-4ed1-b3e1-2470723dbb2c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:46.733633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727a030-6228-4ed1-b3e1-2470723dbb2c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:46.740896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8a9a0-3597-4190-af27-d7ae3ddfe2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:46.741973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8a9a0-3597-4190-af27-d7ae3ddfe2d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:46.743267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8a9a0-3597-4190-af27-d7ae3ddfe2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:46.743267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8a9a0-3597-4190-af27-d7ae3ddfe2d6 admin admin] PATH_INFO: `/v3/projects/677480687a4d464cb3827526f6786eaf/users/a941ed60c4694567b5ddb2ddff360659/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:46.763166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8a9a0-3597-4190-af27-d7ae3ddfe2d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=677480687a4d464cb3827526f6786eaf, user_id=a941ed60c4694567b5ddb2ddff360659, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:46.767483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8a9a0-3597-4190-af27-d7ae3ddfe2d6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:46.909188 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3644/7356] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:46 2022] PUT /identity/v3/projects/677480687a4d464cb3827526f6786eaf/users/a941ed60c4694567b5ddb2ddff360659/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:46.913356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f364b81-3d40-4dee-b2ac-34b9022ac0c8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:46.923903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f364b81-3d40-4dee-b2ac-34b9022ac0c8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:46.994627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b630f97-9eb1-4d7b-8b8a-72d7ce4df11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:46.995271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b630f97-9eb1-4d7b-8b8a-72d7ce4df11a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:46.995555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b630f97-9eb1-4d7b-8b8a-72d7ce4df11a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:46.995831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b630f97-9eb1-4d7b-8b8a-72d7ce4df11a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:46.996612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b630f97-9eb1-4d7b-8b8a-72d7ce4df11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:47.004022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b630f97-9eb1-4d7b-8b8a-72d7ce4df11a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:47.017813 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3713/7357] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:47.033889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8a9a0-3597-4190-af27-d7ae3ddfe2d6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:47.048193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8a9a0-3597-4190-af27-d7ae3ddfe2d6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:47.051927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d901f-7ddd-4ab7-beff-62843ccc9756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:47.053088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d901f-7ddd-4ab7-beff-62843ccc9756 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:47.053940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d901f-7ddd-4ab7-beff-62843ccc9756 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:47.053940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d901f-7ddd-4ab7-beff-62843ccc9756 admin admin] PATH_INFO: `/v3/projects/677480687a4d464cb3827526f6786eaf/users/a941ed60c4694567b5ddb2ddff360659/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:47.056878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d901f-7ddd-4ab7-beff-62843ccc9756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=677480687a4d464cb3827526f6786eaf, user_id=a941ed60c4694567b5ddb2ddff360659, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:47.059891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d901f-7ddd-4ab7-beff-62843ccc9756 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:47.078583 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3645/7358] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:47 2022] PUT /identity/v3/projects/677480687a4d464cb3827526f6786eaf/users/a941ed60c4694567b5ddb2ddff360659/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:47.093194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a275465-6777-4e14-9949-1be3e109f1c1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:47.094505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a275465-6777-4e14-9949-1be3e109f1c1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:47.094948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a275465-6777-4e14-9949-1be3e109f1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:47.126381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5a275465-6777-4e14-9949-1be3e109f1c1 None None] MFA Rules not processed for user `a941ed60c4694567b5ddb2ddff360659`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:47.127730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5a275465-6777-4e14-9949-1be3e109f1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:47.213733 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3714/7359] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:47 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:47.224972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d901f-7ddd-4ab7-beff-62843ccc9756 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:47.226981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0b9d901f-7ddd-4ab7-beff-62843ccc9756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:47.298042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d901f-7ddd-4ab7-beff-62843ccc9756 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:47.302328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cfc07f-35c7-4fba-999d-5f2a6aa57065 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:47.303176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfc07f-35c7-4fba-999d-5f2a6aa57065 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:47.303728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfc07f-35c7-4fba-999d-5f2a6aa57065 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:47.303728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfc07f-35c7-4fba-999d-5f2a6aa57065 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:47.314860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cfc07f-35c7-4fba-999d-5f2a6aa57065 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:47.316860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cfc07f-35c7-4fba-999d-5f2a6aa57065 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:47.327998 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3646/7360] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:47 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:38:48.969937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:49.187464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:49.318789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a275465-6777-4e14-9949-1be3e109f1c1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:49.387035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a275465-6777-4e14-9949-1be3e109f1c1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:49.391904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c952ac-6be2-44a6-b0f4-611518321959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:49.392864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c952ac-6be2-44a6-b0f4-611518321959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:49.393146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c952ac-6be2-44a6-b0f4-611518321959 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:49.394971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c952ac-6be2-44a6-b0f4-611518321959 admin admin] PATH_INFO: `/v3/users/15287369c59b41da90e7b545b1e5a406` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:49.394971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c952ac-6be2-44a6-b0f4-611518321959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15287369c59b41da90e7b545b1e5a406)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:49.396719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c952ac-6be2-44a6-b0f4-611518321959 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:49.640362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-27c952ac-6be2-44a6-b0f4-611518321959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15287369c59b41da90e7b545b1e5a406'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:49.647416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-27c952ac-6be2-44a6-b0f4-611518321959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15287369c59b41da90e7b545b1e5a406'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:49.724139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-27c952ac-6be2-44a6-b0f4-611518321959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15287369c59b41da90e7b545b1e5a406'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:49.724745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-27c952ac-6be2-44a6-b0f4-611518321959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15287369c59b41da90e7b545b1e5a406'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:49.738345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-27c952ac-6be2-44a6-b0f4-611518321959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15287369c59b41da90e7b545b1e5a406'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:49.745489 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3715/7361] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:38:49 2022] DELETE /identity/v3/users/15287369c59b41da90e7b545b1e5a406 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:49.750112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce666d87-b892-4f8e-9cf9-11bf0eb4c4a3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:49.750394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce666d87-b892-4f8e-9cf9-11bf0eb4c4a3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:49.750883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce666d87-b892-4f8e-9cf9-11bf0eb4c4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:49.770249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ce666d87-b892-4f8e-9cf9-11bf0eb4c4a3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:49.771744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ce666d87-b892-4f8e-9cf9-11bf0eb4c4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:49.846348 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3647/7362] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:49.856831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c952ac-6be2-44a6-b0f4-611518321959 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:49.858245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-27c952ac-6be2-44a6-b0f4-611518321959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:49.920072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c952ac-6be2-44a6-b0f4-611518321959 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:49.924372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4d74d-a0e8-4a8b-8e84-5a9dcbaaaf6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:49.925019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4d74d-a0e8-4a8b-8e84-5a9dcbaaaf6b service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:49.925333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4d74d-a0e8-4a8b-8e84-5a9dcbaaaf6b service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:49.925610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4d74d-a0e8-4a8b-8e84-5a9dcbaaaf6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:49.934876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4d74d-a0e8-4a8b-8e84-5a9dcbaaaf6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:49.936357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4d74d-a0e8-4a8b-8e84-5a9dcbaaaf6b service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:49.947645 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3716/7363] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:38:50.405672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce666d87-b892-4f8e-9cf9-11bf0eb4c4a3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:50.407209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ce666d87-b892-4f8e-9cf9-11bf0eb4c4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:50.420637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce666d87-b892-4f8e-9cf9-11bf0eb4c4a3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:50.425225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33478b76-6ddf-42f0-bfad-b8c31c946550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:50.426099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33478b76-6ddf-42f0-bfad-b8c31c946550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:50.426381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33478b76-6ddf-42f0-bfad-b8c31c946550 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:50.426659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33478b76-6ddf-42f0-bfad-b8c31c946550 admin admin] PATH_INFO: `/v3/projects/f30d854ada374ea386bec879f614de14` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:50.427901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33478b76-6ddf-42f0-bfad-b8c31c946550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f30d854ada374ea386bec879f614de14)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:50.434027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33478b76-6ddf-42f0-bfad-b8c31c946550 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:50.605433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-33478b76-6ddf-42f0-bfad-b8c31c946550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f30d854ada374ea386bec879f614de14', 'request_id': 'req-33478b76-6ddf-42f0-bfad-b8c31c946550'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:50.611252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-33478b76-6ddf-42f0-bfad-b8c31c946550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f30d854ada374ea386bec879f614de14', 'request_id': 'req-33478b76-6ddf-42f0-bfad-b8c31c946550'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:50.618847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-33478b76-6ddf-42f0-bfad-b8c31c946550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f30d854ada374ea386bec879f614de14', 'request_id': 'req-33478b76-6ddf-42f0-bfad-b8c31c946550'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:50.724380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-33478b76-6ddf-42f0-bfad-b8c31c946550 admin admin] The token cache is being invalidate because project f30d854ada374ea386bec879f614de14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:38:50.724801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-33478b76-6ddf-42f0-bfad-b8c31c946550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:50.725374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-33478b76-6ddf-42f0-bfad-b8c31c946550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:50.732894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4d74d-a0e8-4a8b-8e84-5a9dcbaaaf6b service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:50.739643 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3648/7364] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:38:50 2022] DELETE /identity/v3/projects/f30d854ada374ea386bec879f614de14 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:50.746450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4d74d-a0e8-4a8b-8e84-5a9dcbaaaf6b service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:50.749443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:50.807405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126eb32-e7a3-491a-af2e-60f127fad676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:50.808289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126eb32-e7a3-491a-af2e-60f127fad676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:50.808580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126eb32-e7a3-491a-af2e-60f127fad676 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:50.808921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126eb32-e7a3-491a-af2e-60f127fad676 admin admin] PATH_INFO: `/v3/users/a941ed60c4694567b5ddb2ddff360659` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:50.810179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126eb32-e7a3-491a-af2e-60f127fad676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a941ed60c4694567b5ddb2ddff360659)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:50.812187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126eb32-e7a3-491a-af2e-60f127fad676 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:51.031796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a126eb32-e7a3-491a-af2e-60f127fad676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a941ed60c4694567b5ddb2ddff360659'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:51.039286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a126eb32-e7a3-491a-af2e-60f127fad676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a941ed60c4694567b5ddb2ddff360659'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:51.112439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:51.141328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a126eb32-e7a3-491a-af2e-60f127fad676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a941ed60c4694567b5ddb2ddff360659'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:51.141963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a126eb32-e7a3-491a-af2e-60f127fad676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a941ed60c4694567b5ddb2ddff360659'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:51.157271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a126eb32-e7a3-491a-af2e-60f127fad676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a941ed60c4694567b5ddb2ddff360659'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:51.163928 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3717/7365] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:38:50 2022] DELETE /identity/v3/users/a941ed60c4694567b5ddb2ddff360659 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:51.734625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33478b76-6ddf-42f0-bfad-b8c31c946550 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:51.736143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-33478b76-6ddf-42f0-bfad-b8c31c946550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:51.760222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33478b76-6ddf-42f0-bfad-b8c31c946550 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:51.822287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb896bf-8b1b-46b3-8ec3-ef5103ccae8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:51.823325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb896bf-8b1b-46b3-8ec3-ef5103ccae8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:51.823735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb896bf-8b1b-46b3-8ec3-ef5103ccae8c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:51.824144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb896bf-8b1b-46b3-8ec3-ef5103ccae8c admin admin] PATH_INFO: `/v3/projects/677480687a4d464cb3827526f6786eaf` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:51.825471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb896bf-8b1b-46b3-8ec3-ef5103ccae8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=677480687a4d464cb3827526f6786eaf)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:51.829937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb896bf-8b1b-46b3-8ec3-ef5103ccae8c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:51.961103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0bb896bf-8b1b-46b3-8ec3-ef5103ccae8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '677480687a4d464cb3827526f6786eaf', 'request_id': 'req-0bb896bf-8b1b-46b3-8ec3-ef5103ccae8c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:51.967275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0bb896bf-8b1b-46b3-8ec3-ef5103ccae8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '677480687a4d464cb3827526f6786eaf', 'request_id': 'req-0bb896bf-8b1b-46b3-8ec3-ef5103ccae8c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:51.973765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0bb896bf-8b1b-46b3-8ec3-ef5103ccae8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '677480687a4d464cb3827526f6786eaf', 'request_id': 'req-0bb896bf-8b1b-46b3-8ec3-ef5103ccae8c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:52.067448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0bb896bf-8b1b-46b3-8ec3-ef5103ccae8c admin admin] The token cache is being invalidate because project 677480687a4d464cb3827526f6786eaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:38:52.067448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0bb896bf-8b1b-46b3-8ec3-ef5103ccae8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:52.067448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0bb896bf-8b1b-46b3-8ec3-ef5103ccae8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:52.067448 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3649/7366] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:38:51 2022] DELETE /identity/v3/projects/677480687a4d464cb3827526f6786eaf => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:52.070628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ae2c5-a1ee-45f2-823a-43a06db3fd90 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:52.072275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ae2c5-a1ee-45f2-823a-43a06db3fd90 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:52.072712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ae2c5-a1ee-45f2-823a-43a06db3fd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:52.093301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c63ae2c5-a1ee-45f2-823a-43a06db3fd90 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:52.094880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c63ae2c5-a1ee-45f2-823a-43a06db3fd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:52.158442 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3718/7367] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:52.167438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6ce7b-9b94-4964-89f5-4ed8aba90a16 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:52.167813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6ce7b-9b94-4964-89f5-4ed8aba90a16 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:52.168239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6ce7b-9b94-4964-89f5-4ed8aba90a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:52.190599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a0f6ce7b-9b94-4964-89f5-4ed8aba90a16 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:52.191783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a0f6ce7b-9b94-4964-89f5-4ed8aba90a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:52.203249 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3650/7368] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:52.207210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ae2c5-a1ee-45f2-823a-43a06db3fd90 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:52.218172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ae2c5-a1ee-45f2-823a-43a06db3fd90 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:52.223461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f420dc3-e9ae-4c28-94f7-9c3cea20b142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:52.224126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f420dc3-e9ae-4c28-94f7-9c3cea20b142 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:52.224409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f420dc3-e9ae-4c28-94f7-9c3cea20b142 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:52.224684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f420dc3-e9ae-4c28-94f7-9c3cea20b142 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:52.225410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f420dc3-e9ae-4c28-94f7-9c3cea20b142 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:38:52.225717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f420dc3-e9ae-4c28-94f7-9c3cea20b142 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:52.228128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f420dc3-e9ae-4c28-94f7-9c3cea20b142 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:52.240596 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3719/7369] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:38:52.246216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6ce7b-9b94-4964-89f5-4ed8aba90a16 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:52.256734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6ce7b-9b94-4964-89f5-4ed8aba90a16 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:52.261755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caa0b7-b10d-4e2b-a8b5-11aa53ec9d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:52.262414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caa0b7-b10d-4e2b-a8b5-11aa53ec9d09 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:52.262704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caa0b7-b10d-4e2b-a8b5-11aa53ec9d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:52.263150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caa0b7-b10d-4e2b-a8b5-11aa53ec9d09 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:52.263847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5caa0b7-b10d-4e2b-a8b5-11aa53ec9d09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:52.266159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5caa0b7-b10d-4e2b-a8b5-11aa53ec9d09 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:52.345397 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3651/7370] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:38:52 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:38:52.349618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f420dc3-e9ae-4c28-94f7-9c3cea20b142 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:52.361378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f420dc3-e9ae-4c28-94f7-9c3cea20b142 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:52.419678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15e58e-df52-4a18-9e74-4ed7bd994120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:52.420344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15e58e-df52-4a18-9e74-4ed7bd994120 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:52.420657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15e58e-df52-4a18-9e74-4ed7bd994120 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:52.420937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15e58e-df52-4a18-9e74-4ed7bd994120 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:52.421629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15e58e-df52-4a18-9e74-4ed7bd994120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:52.423587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15e58e-df52-4a18-9e74-4ed7bd994120 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:52.564489 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3720/7371] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:38:52 2022] POST /identity/v3/users => generated 283 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:38:52.568658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caa0b7-b10d-4e2b-a8b5-11aa53ec9d09 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:52.579964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caa0b7-b10d-4e2b-a8b5-11aa53ec9d09 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:52.584639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b20be1-157e-4bc4-b818-bd7931e1b766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:52.585343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b20be1-157e-4bc4-b818-bd7931e1b766 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:52.585619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b20be1-157e-4bc4-b818-bd7931e1b766 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:52.585893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b20be1-157e-4bc4-b818-bd7931e1b766 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:52.586998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b20be1-157e-4bc4-b818-bd7931e1b766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:52.588765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b20be1-157e-4bc4-b818-bd7931e1b766 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:52.600164 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3652/7372] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:52.604158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15e58e-df52-4a18-9e74-4ed7bd994120 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:52.614418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15e58e-df52-4a18-9e74-4ed7bd994120 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:52.619626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf3a52-d957-4cbb-b7f9-8108594696d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:52.620278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf3a52-d957-4cbb-b7f9-8108594696d1 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:52.620557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf3a52-d957-4cbb-b7f9-8108594696d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:52.620829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf3a52-d957-4cbb-b7f9-8108594696d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:52.621540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf3a52-d957-4cbb-b7f9-8108594696d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:52.623238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf3a52-d957-4cbb-b7f9-8108594696d1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:52.636786 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3721/7373] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:52.642734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b20be1-157e-4bc4-b818-bd7931e1b766 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:52.651296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b20be1-157e-4bc4-b818-bd7931e1b766 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:52.655982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83a36c-1ee3-4297-bcd8-a60e36a7a784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:52.656856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83a36c-1ee3-4297-bcd8-a60e36a7a784 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:52.657134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83a36c-1ee3-4297-bcd8-a60e36a7a784 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:52.657408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83a36c-1ee3-4297-bcd8-a60e36a7a784 admin admin] PATH_INFO: `/v3/projects/4270649176e146a3a137d434176496c6/users/5fa954b7169540d58a8317a69665df3b/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:52.673006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83a36c-1ee3-4297-bcd8-a60e36a7a784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4270649176e146a3a137d434176496c6, user_id=5fa954b7169540d58a8317a69665df3b, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:52.675995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83a36c-1ee3-4297-bcd8-a60e36a7a784 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:52.782134 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3653/7374] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:52 2022] PUT /identity/v3/projects/4270649176e146a3a137d434176496c6/users/5fa954b7169540d58a8317a69665df3b/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:52.793018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea02f3c-9c60-4645-a406-4fc0d4d5b0c8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:52.793305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea02f3c-9c60-4645-a406-4fc0d4d5b0c8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:52.793655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea02f3c-9c60-4645-a406-4fc0d4d5b0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:52.822685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-dea02f3c-9c60-4645-a406-4fc0d4d5b0c8 None None] MFA Rules not processed for user `5fa954b7169540d58a8317a69665df3b`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:52.823955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dea02f3c-9c60-4645-a406-4fc0d4d5b0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:52.899941 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3722/7375] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:52.913838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83a36c-1ee3-4297-bcd8-a60e36a7a784 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:52.914097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:52.971233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83a36c-1ee3-4297-bcd8-a60e36a7a784 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:52.976533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbb18b-6b10-4f57-a4b7-34ad4a99a739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:52.977732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbb18b-6b10-4f57-a4b7-34ad4a99a739 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:52.978018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbb18b-6b10-4f57-a4b7-34ad4a99a739 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:52.978299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbb18b-6b10-4f57-a4b7-34ad4a99a739 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:52.978983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbb18b-6b10-4f57-a4b7-34ad4a99a739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:52.981110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbb18b-6b10-4f57-a4b7-34ad4a99a739 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:53.063053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:53.070862 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3654/7376] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:38:52 2022] POST /identity/v3/projects => generated 363 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:38:53.075875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea02f3c-9c60-4645-a406-4fc0d4d5b0c8 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:53.087970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea02f3c-9c60-4645-a406-4fc0d4d5b0c8 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:53.146064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8dca7-1ff0-4513-ac37-94b0a9cb8b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:53.146735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8dca7-1ff0-4513-ac37-94b0a9cb8b3c admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:53.147115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8dca7-1ff0-4513-ac37-94b0a9cb8b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:53.147327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8dca7-1ff0-4513-ac37-94b0a9cb8b3c admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:53.148015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8dca7-1ff0-4513-ac37-94b0a9cb8b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:53.150535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8dca7-1ff0-4513-ac37-94b0a9cb8b3c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:53.247797 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3723/7377] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:38:53 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:38:53.249147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbb18b-6b10-4f57-a4b7-34ad4a99a739 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:53.260579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbb18b-6b10-4f57-a4b7-34ad4a99a739 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:53.267305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc053cb4-4c10-4052-b73f-eb0be574d745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:53.268454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc053cb4-4c10-4052-b73f-eb0be574d745 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:53.268806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc053cb4-4c10-4052-b73f-eb0be574d745 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:53.269449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc053cb4-4c10-4052-b73f-eb0be574d745 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:53.270680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc053cb4-4c10-4052-b73f-eb0be574d745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:53.273225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc053cb4-4c10-4052-b73f-eb0be574d745 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:53.284777 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3655/7378] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:53.289272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8dca7-1ff0-4513-ac37-94b0a9cb8b3c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:53.301529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8dca7-1ff0-4513-ac37-94b0a9cb8b3c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:53.306556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccbde08-eb38-4375-be4c-788ecaa6adad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:53.307484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbde08-eb38-4375-be4c-788ecaa6adad admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:53.307769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbde08-eb38-4375-be4c-788ecaa6adad admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:53.308047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbde08-eb38-4375-be4c-788ecaa6adad admin admin] PATH_INFO: `/v3/projects/1743dc4923eb4eccb2f3097174676ead/users/b9a09126e5884dd4a50828c95d654e23/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:53.328765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccbde08-eb38-4375-be4c-788ecaa6adad admin admin] RBAC: Authorizing `identity:create_grant(project_id=1743dc4923eb4eccb2f3097174676ead, user_id=b9a09126e5884dd4a50828c95d654e23, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:53.331534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccbde08-eb38-4375-be4c-788ecaa6adad admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:53.448843 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3724/7379] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:53 2022] PUT /identity/v3/projects/1743dc4923eb4eccb2f3097174676ead/users/b9a09126e5884dd4a50828c95d654e23/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:53.450645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc053cb4-4c10-4052-b73f-eb0be574d745 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:53.467762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc053cb4-4c10-4052-b73f-eb0be574d745 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:53.533231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ca413-7d5b-409c-bcba-5cd67b60f94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:53.533990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ca413-7d5b-409c-bcba-5cd67b60f94a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:53.534363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ca413-7d5b-409c-bcba-5cd67b60f94a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:53.534709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ca413-7d5b-409c-bcba-5cd67b60f94a admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:53.535573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ca413-7d5b-409c-bcba-5cd67b60f94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:53.537294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ca413-7d5b-409c-bcba-5cd67b60f94a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:53.547768 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3656/7380] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:53.552312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccbde08-eb38-4375-be4c-788ecaa6adad admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:53.563141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccbde08-eb38-4375-be4c-788ecaa6adad admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:53.567837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc664fd0-c5ae-4e59-83fd-973d55d728e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:53.568780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc664fd0-c5ae-4e59-83fd-973d55d728e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:53.569114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc664fd0-c5ae-4e59-83fd-973d55d728e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:53.569366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc664fd0-c5ae-4e59-83fd-973d55d728e0 admin admin] PATH_INFO: `/v3/projects/1743dc4923eb4eccb2f3097174676ead/users/b9a09126e5884dd4a50828c95d654e23/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:53.572157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc664fd0-c5ae-4e59-83fd-973d55d728e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1743dc4923eb4eccb2f3097174676ead, user_id=b9a09126e5884dd4a50828c95d654e23, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:53.574805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc664fd0-c5ae-4e59-83fd-973d55d728e0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:53.585311 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3725/7381] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:53 2022] PUT /identity/v3/projects/1743dc4923eb4eccb2f3097174676ead/users/b9a09126e5884dd4a50828c95d654e23/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:53.596641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6025ce-1d66-4a39-b101-9db7043520ee None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:53.596991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6025ce-1d66-4a39-b101-9db7043520ee None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:53.597201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6025ce-1d66-4a39-b101-9db7043520ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:53.625062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7e6025ce-1d66-4a39-b101-9db7043520ee None None] MFA Rules not processed for user `b9a09126e5884dd4a50828c95d654e23`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:53.626322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7e6025ce-1d66-4a39-b101-9db7043520ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:53.713752 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3657/7382] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:53 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:53.728317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc664fd0-c5ae-4e59-83fd-973d55d728e0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:53.732039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cc664fd0-c5ae-4e59-83fd-973d55d728e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:53.796692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc664fd0-c5ae-4e59-83fd-973d55d728e0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:53.800526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e62bb8-95db-4a21-9dd3-9ad987f6232d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:53.801204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e62bb8-95db-4a21-9dd3-9ad987f6232d service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:53.801483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e62bb8-95db-4a21-9dd3-9ad987f6232d service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:53.801759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e62bb8-95db-4a21-9dd3-9ad987f6232d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:53.815556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e62bb8-95db-4a21-9dd3-9ad987f6232d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:53.816995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e62bb8-95db-4a21-9dd3-9ad987f6232d service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:53.828936 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3726/7383] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:53 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:38:54.090263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:54.338362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:54.808949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6025ce-1d66-4a39-b101-9db7043520ee None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:54.877854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6025ce-1d66-4a39-b101-9db7043520ee None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:54.882322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a5534-7c46-4208-8472-4cb32a5480b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:54.884864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a5534-7c46-4208-8472-4cb32a5480b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:54.884864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a5534-7c46-4208-8472-4cb32a5480b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:54.884864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a5534-7c46-4208-8472-4cb32a5480b4 admin admin] PATH_INFO: `/v3/users/5fa954b7169540d58a8317a69665df3b` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:54.885661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a5534-7c46-4208-8472-4cb32a5480b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa954b7169540d58a8317a69665df3b)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:54.887649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a5534-7c46-4208-8472-4cb32a5480b4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:55.074975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bf3a5534-7c46-4208-8472-4cb32a5480b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa954b7169540d58a8317a69665df3b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:55.087332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bf3a5534-7c46-4208-8472-4cb32a5480b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa954b7169540d58a8317a69665df3b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:55.164441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bf3a5534-7c46-4208-8472-4cb32a5480b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa954b7169540d58a8317a69665df3b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:55.172896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bf3a5534-7c46-4208-8472-4cb32a5480b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa954b7169540d58a8317a69665df3b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:55.173964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bf3a5534-7c46-4208-8472-4cb32a5480b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa954b7169540d58a8317a69665df3b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:55.181466 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3658/7384] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:38:54 2022] DELETE /identity/v3/users/5fa954b7169540d58a8317a69665df3b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:55.186215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f118a04-a87f-4827-9886-aedefd9487fa None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:55.186695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f118a04-a87f-4827-9886-aedefd9487fa None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:55.186820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f118a04-a87f-4827-9886-aedefd9487fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:55.206391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5f118a04-a87f-4827-9886-aedefd9487fa None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:55.207850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5f118a04-a87f-4827-9886-aedefd9487fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:55.269532 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3727/7385] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:55.281226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a5534-7c46-4208-8472-4cb32a5480b4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:55.283123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bf3a5534-7c46-4208-8472-4cb32a5480b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:55.351338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a5534-7c46-4208-8472-4cb32a5480b4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:55.355274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609aae3-e64c-4ac6-9840-e8cbc97f8fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:55.355945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609aae3-e64c-4ac6-9840-e8cbc97f8fef service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:55.356235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609aae3-e64c-4ac6-9840-e8cbc97f8fef service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:55.356784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609aae3-e64c-4ac6-9840-e8cbc97f8fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:55.366505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609aae3-e64c-4ac6-9840-e8cbc97f8fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:55.368546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609aae3-e64c-4ac6-9840-e8cbc97f8fef service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:55.378572 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3659/7386] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:38:56.007372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f118a04-a87f-4827-9886-aedefd9487fa None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:56.009787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5f118a04-a87f-4827-9886-aedefd9487fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:56.023582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f118a04-a87f-4827-9886-aedefd9487fa None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:56.029454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93e5a1-7cbe-4fb8-9797-6d857c7b0ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:56.030977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93e5a1-7cbe-4fb8-9797-6d857c7b0ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:56.031591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93e5a1-7cbe-4fb8-9797-6d857c7b0ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:56.032045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93e5a1-7cbe-4fb8-9797-6d857c7b0ef5 admin admin] PATH_INFO: `/v3/projects/4270649176e146a3a137d434176496c6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:56.034166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93e5a1-7cbe-4fb8-9797-6d857c7b0ef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4270649176e146a3a137d434176496c6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:56.036310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93e5a1-7cbe-4fb8-9797-6d857c7b0ef5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:56.206589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:56.230313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3a93e5a1-7cbe-4fb8-9797-6d857c7b0ef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4270649176e146a3a137d434176496c6', 'request_id': 'req-3a93e5a1-7cbe-4fb8-9797-6d857c7b0ef5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:56.237135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3a93e5a1-7cbe-4fb8-9797-6d857c7b0ef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4270649176e146a3a137d434176496c6', 'request_id': 'req-3a93e5a1-7cbe-4fb8-9797-6d857c7b0ef5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:56.243735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3a93e5a1-7cbe-4fb8-9797-6d857c7b0ef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4270649176e146a3a137d434176496c6', 'request_id': 'req-3a93e5a1-7cbe-4fb8-9797-6d857c7b0ef5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:56.358165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3a93e5a1-7cbe-4fb8-9797-6d857c7b0ef5 admin admin] The token cache is being invalidate because project 4270649176e146a3a137d434176496c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:38:56.358464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3a93e5a1-7cbe-4fb8-9797-6d857c7b0ef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:56.359193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3a93e5a1-7cbe-4fb8-9797-6d857c7b0ef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:56.363941 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3728/7387] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:38:56 2022] DELETE /identity/v3/projects/4270649176e146a3a137d434176496c6 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:56.365210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609aae3-e64c-4ac6-9840-e8cbc97f8fef service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:56.376216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609aae3-e64c-4ac6-9840-e8cbc97f8fef service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:56.380484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:56.457180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5106e76-d5ca-4018-95f9-bd1548ba18a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:56.458296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5106e76-d5ca-4018-95f9-bd1548ba18a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:56.459350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5106e76-d5ca-4018-95f9-bd1548ba18a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:56.460044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5106e76-d5ca-4018-95f9-bd1548ba18a2 admin admin] PATH_INFO: `/v3/users/b9a09126e5884dd4a50828c95d654e23` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:56.462689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5106e76-d5ca-4018-95f9-bd1548ba18a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9a09126e5884dd4a50828c95d654e23)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:56.465375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5106e76-d5ca-4018-95f9-bd1548ba18a2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:56.760929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c5106e76-d5ca-4018-95f9-bd1548ba18a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9a09126e5884dd4a50828c95d654e23'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:56.780592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c5106e76-d5ca-4018-95f9-bd1548ba18a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9a09126e5884dd4a50828c95d654e23'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:56.867334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c5106e76-d5ca-4018-95f9-bd1548ba18a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9a09126e5884dd4a50828c95d654e23'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:56.877592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c5106e76-d5ca-4018-95f9-bd1548ba18a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9a09126e5884dd4a50828c95d654e23'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:56.878634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c5106e76-d5ca-4018-95f9-bd1548ba18a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9a09126e5884dd4a50828c95d654e23'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:56.887759 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3660/7388] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:38:56 2022] DELETE /identity/v3/users/b9a09126e5884dd4a50828c95d654e23 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:57.347874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93e5a1-7cbe-4fb8-9797-6d857c7b0ef5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:57.349429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3a93e5a1-7cbe-4fb8-9797-6d857c7b0ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:57.365213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93e5a1-7cbe-4fb8-9797-6d857c7b0ef5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:57.426211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12348906-34e0-410f-9b76-b39d9c2798ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:57.427096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12348906-34e0-410f-9b76-b39d9c2798ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:57.427379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12348906-34e0-410f-9b76-b39d9c2798ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:57.427652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12348906-34e0-410f-9b76-b39d9c2798ec admin admin] PATH_INFO: `/v3/projects/1743dc4923eb4eccb2f3097174676ead` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:57.428837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12348906-34e0-410f-9b76-b39d9c2798ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=1743dc4923eb4eccb2f3097174676ead)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:57.430733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12348906-34e0-410f-9b76-b39d9c2798ec admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:57.535053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27057ab9-4f82-438e-83c1-173e14184f22 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:57.535567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27057ab9-4f82-438e-83c1-173e14184f22 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:57.535675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27057ab9-4f82-438e-83c1-173e14184f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:57.536548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-12348906-34e0-410f-9b76-b39d9c2798ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1743dc4923eb4eccb2f3097174676ead', 'request_id': 'req-12348906-34e0-410f-9b76-b39d9c2798ec'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:57.545786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-12348906-34e0-410f-9b76-b39d9c2798ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1743dc4923eb4eccb2f3097174676ead', 'request_id': 'req-12348906-34e0-410f-9b76-b39d9c2798ec'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:57.549635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-12348906-34e0-410f-9b76-b39d9c2798ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1743dc4923eb4eccb2f3097174676ead', 'request_id': 'req-12348906-34e0-410f-9b76-b39d9c2798ec'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:57.556173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-27057ab9-4f82-438e-83c1-173e14184f22 None None] MFA Rules not processed for user `62209b9802ab46c3b3d094d4d1ad86fe`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:57.557387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-27057ab9-4f82-438e-83c1-173e14184f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:57.612258 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3661/7389] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:38:57.638104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-12348906-34e0-410f-9b76-b39d9c2798ec admin admin] The token cache is being invalidate because project 1743dc4923eb4eccb2f3097174676ead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:38:57.638738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-12348906-34e0-410f-9b76-b39d9c2798ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:57.639327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-12348906-34e0-410f-9b76-b39d9c2798ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:38:57.642683 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3729/7390] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:38:57 2022] DELETE /identity/v3/projects/1743dc4923eb4eccb2f3097174676ead => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:57.648949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15eae8-28a9-40d7-98bd-1d97839fcb05 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:57.649916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15eae8-28a9-40d7-98bd-1d97839fcb05 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:57.650507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15eae8-28a9-40d7-98bd-1d97839fcb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:57.671576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3c15eae8-28a9-40d7-98bd-1d97839fcb05 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:57.671576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3c15eae8-28a9-40d7-98bd-1d97839fcb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:57.740734 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3662/7391] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:57.740884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e8780-5bcd-45fa-b066-b88d8d2bdde3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:57.740884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e8780-5bcd-45fa-b066-b88d8d2bdde3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:57.741054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e8780-5bcd-45fa-b066-b88d8d2bdde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:57.764236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-632e8780-5bcd-45fa-b066-b88d8d2bdde3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:57.764405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-632e8780-5bcd-45fa-b066-b88d8d2bdde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:57.772965 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3730/7392] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:57.778069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15eae8-28a9-40d7-98bd-1d97839fcb05 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:57.788707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15eae8-28a9-40d7-98bd-1d97839fcb05 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:57.797323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44dde3-729b-4018-adb1-f6a7f268be8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:57.798053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44dde3-729b-4018-adb1-f6a7f268be8a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:57.798341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44dde3-729b-4018-adb1-f6a7f268be8a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:57.798582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44dde3-729b-4018-adb1-f6a7f268be8a admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:57.799348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44dde3-729b-4018-adb1-f6a7f268be8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:38:57.799654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44dde3-729b-4018-adb1-f6a7f268be8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:57.801314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44dde3-729b-4018-adb1-f6a7f268be8a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:57.815316 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3663/7393] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:38:57.819665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e8780-5bcd-45fa-b066-b88d8d2bdde3 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:57.831397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e8780-5bcd-45fa-b066-b88d8d2bdde3 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:57.836144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1e010-d5b0-46b2-8bd6-5f87ea6c5d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:57.837451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1e010-d5b0-46b2-8bd6-5f87ea6c5d68 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:57.837906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1e010-d5b0-46b2-8bd6-5f87ea6c5d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:57.838192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1e010-d5b0-46b2-8bd6-5f87ea6c5d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:57.839828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1e010-d5b0-46b2-8bd6-5f87ea6c5d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:57.842128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1e010-d5b0-46b2-8bd6-5f87ea6c5d68 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:57.890528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:57.917803 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3731/7394] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:38:57 2022] POST /identity/v3/projects => generated 357 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:38:57.921890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44dde3-729b-4018-adb1-f6a7f268be8a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:57.933963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44dde3-729b-4018-adb1-f6a7f268be8a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:57.993015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d70093-4521-4c38-a636-c2587ffece1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:57.994077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d70093-4521-4c38-a636-c2587ffece1e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:57.994371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d70093-4521-4c38-a636-c2587ffece1e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:57.994653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d70093-4521-4c38-a636-c2587ffece1e admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:57.995409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d70093-4521-4c38-a636-c2587ffece1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:57.997752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d70093-4521-4c38-a636-c2587ffece1e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:58.097234 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3664/7395] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:38:57 2022] POST /identity/v3/users => generated 279 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:38:58.101327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1e010-d5b0-46b2-8bd6-5f87ea6c5d68 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:58.124546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1e010-d5b0-46b2-8bd6-5f87ea6c5d68 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:58.129472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab748f-b30f-441e-8fc4-35827576501b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:58.130121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab748f-b30f-441e-8fc4-35827576501b admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:58.130396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab748f-b30f-441e-8fc4-35827576501b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:58.130670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab748f-b30f-441e-8fc4-35827576501b admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:58.131432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab748f-b30f-441e-8fc4-35827576501b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:58.133034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab748f-b30f-441e-8fc4-35827576501b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:58.146819 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3732/7396] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:58.150543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d70093-4521-4c38-a636-c2587ffece1e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:58.162291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d70093-4521-4c38-a636-c2587ffece1e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:58.167413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c8bb0-574f-456e-b7ec-7d3640ea0f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:58.168193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c8bb0-574f-456e-b7ec-7d3640ea0f6d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:58.168354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c8bb0-574f-456e-b7ec-7d3640ea0f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:58.168622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c8bb0-574f-456e-b7ec-7d3640ea0f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:58.169339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c8bb0-574f-456e-b7ec-7d3640ea0f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:58.170933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c8bb0-574f-456e-b7ec-7d3640ea0f6d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:58.181538 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3665/7397] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:58.185926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab748f-b30f-441e-8fc4-35827576501b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:58.193844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:58.199450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab748f-b30f-441e-8fc4-35827576501b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:58.204762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918b33c-c2c8-4189-8554-20c06412623e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:58.205801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918b33c-c2c8-4189-8554-20c06412623e admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:58.206099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918b33c-c2c8-4189-8554-20c06412623e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:58.206371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918b33c-c2c8-4189-8554-20c06412623e admin admin] PATH_INFO: `/v3/projects/f540a96c981448af977daf185a8ae649/users/ef7c7dd60bf64735afc148cfced6eecc/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:58.222529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918b33c-c2c8-4189-8554-20c06412623e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f540a96c981448af977daf185a8ae649, user_id=ef7c7dd60bf64735afc148cfced6eecc, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:58.225306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918b33c-c2c8-4189-8554-20c06412623e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:58.313665 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3733/7398] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:58 2022] PUT /identity/v3/projects/f540a96c981448af977daf185a8ae649/users/ef7c7dd60bf64735afc148cfced6eecc/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:38:58.324753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f2dc0-8432-4014-b17b-d5614080d2f3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:58.325418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f2dc0-8432-4014-b17b-d5614080d2f3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:58.325418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f2dc0-8432-4014-b17b-d5614080d2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:58.351687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e09f2dc0-8432-4014-b17b-d5614080d2f3 None None] MFA Rules not processed for user `ef7c7dd60bf64735afc148cfced6eecc`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:58.353104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e09f2dc0-8432-4014-b17b-d5614080d2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:58.431271 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3666/7399] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:58 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:58.435853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918b33c-c2c8-4189-8554-20c06412623e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:58.510784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918b33c-c2c8-4189-8554-20c06412623e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:58.517282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671b494-3528-4c70-bba8-87ada7d14e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:58.517282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671b494-3528-4c70-bba8-87ada7d14e16 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:58.517282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671b494-3528-4c70-bba8-87ada7d14e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:58.517555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671b494-3528-4c70-bba8-87ada7d14e16 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:58.518218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671b494-3528-4c70-bba8-87ada7d14e16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:58.520053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671b494-3528-4c70-bba8-87ada7d14e16 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:58.628621 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3734/7400] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:38:58 2022] POST /identity/v3/projects => generated 357 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:38:58.632892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f2dc0-8432-4014-b17b-d5614080d2f3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:58.644489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f2dc0-8432-4014-b17b-d5614080d2f3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:58.672217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:58.705865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e39073-6bbb-469d-a87a-618a379f87ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:58.706706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e39073-6bbb-469d-a87a-618a379f87ca admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:58.706983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e39073-6bbb-469d-a87a-618a379f87ca admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:58.707296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e39073-6bbb-469d-a87a-618a379f87ca admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:58.707996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e39073-6bbb-469d-a87a-618a379f87ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:58.709922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e39073-6bbb-469d-a87a-618a379f87ca admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:58.804204 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3667/7401] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:38:58 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:38:58.809404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671b494-3528-4c70-bba8-87ada7d14e16 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:58.819903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671b494-3528-4c70-bba8-87ada7d14e16 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:58.825600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08376a9-2a9b-428d-818d-3b9921ae51a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:58.826260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08376a9-2a9b-428d-818d-3b9921ae51a8 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:58.826730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08376a9-2a9b-428d-818d-3b9921ae51a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:58.827031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08376a9-2a9b-428d-818d-3b9921ae51a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:58.827751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08376a9-2a9b-428d-818d-3b9921ae51a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:58.829369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08376a9-2a9b-428d-818d-3b9921ae51a8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:58.841360 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3735/7402] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:58.846224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e39073-6bbb-469d-a87a-618a379f87ca admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:58.857445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e39073-6bbb-469d-a87a-618a379f87ca admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:58.869793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddd5a9-d2d8-4da6-8218-445237c262fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:58.870704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddd5a9-d2d8-4da6-8218-445237c262fd admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:58.871072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddd5a9-d2d8-4da6-8218-445237c262fd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:58.871305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddd5a9-d2d8-4da6-8218-445237c262fd admin admin] PATH_INFO: `/v3/projects/e7daf20588004a67a35267a1ff25f898/users/b1a03725db7146c995d6fa2b1409ff9d/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:58.887056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddd5a9-d2d8-4da6-8218-445237c262fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7daf20588004a67a35267a1ff25f898, user_id=b1a03725db7146c995d6fa2b1409ff9d, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:58.889730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddd5a9-d2d8-4da6-8218-445237c262fd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:59.045824 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3668/7403] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:58 2022] PUT /identity/v3/projects/e7daf20588004a67a35267a1ff25f898/users/b1a03725db7146c995d6fa2b1409ff9d/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:38:59.049607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08376a9-2a9b-428d-818d-3b9921ae51a8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:59.060731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08376a9-2a9b-428d-818d-3b9921ae51a8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:59.137286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c342e-4030-4b1e-9fc6-74c82a2ac0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:59.138627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c342e-4030-4b1e-9fc6-74c82a2ac0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:59.139290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c342e-4030-4b1e-9fc6-74c82a2ac0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:59.139810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c342e-4030-4b1e-9fc6-74c82a2ac0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:59.140942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c342e-4030-4b1e-9fc6-74c82a2ac0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:59.143115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c342e-4030-4b1e-9fc6-74c82a2ac0b4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:59.155291 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3736/7404] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:38:59.159418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddd5a9-d2d8-4da6-8218-445237c262fd admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:59.170856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddd5a9-d2d8-4da6-8218-445237c262fd admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:59.175452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a97eef-3d3a-4039-9d6d-50f60ff0ceec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:59.176335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a97eef-3d3a-4039-9d6d-50f60ff0ceec admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:59.176623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a97eef-3d3a-4039-9d6d-50f60ff0ceec admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:59.176901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a97eef-3d3a-4039-9d6d-50f60ff0ceec admin admin] PATH_INFO: `/v3/projects/e7daf20588004a67a35267a1ff25f898/users/b1a03725db7146c995d6fa2b1409ff9d/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:59.178925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a97eef-3d3a-4039-9d6d-50f60ff0ceec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7daf20588004a67a35267a1ff25f898, user_id=b1a03725db7146c995d6fa2b1409ff9d, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:59.181787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a97eef-3d3a-4039-9d6d-50f60ff0ceec admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:59.192306 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3669/7405] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:38:59 2022] PUT /identity/v3/projects/e7daf20588004a67a35267a1ff25f898/users/b1a03725db7146c995d6fa2b1409ff9d/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:38:59.203943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f62ff-248b-4f70-b880-5a27615aeb1f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:59.204263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f62ff-248b-4f70-b880-5a27615aeb1f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:59.204544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f62ff-248b-4f70-b880-5a27615aeb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:59.233853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ee6f62ff-248b-4f70-b880-5a27615aeb1f None None] MFA Rules not processed for user `b1a03725db7146c995d6fa2b1409ff9d`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:38:59.235118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ee6f62ff-248b-4f70-b880-5a27615aeb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:59.276773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:38:59.308146 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3737/7406] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:38:59 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:38:59.320563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a97eef-3d3a-4039-9d6d-50f60ff0ceec admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:59.323576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-89a97eef-3d3a-4039-9d6d-50f60ff0ceec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:59.403698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a97eef-3d3a-4039-9d6d-50f60ff0ceec admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:59.407385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f222ab4-af2c-4b67-a2a2-7c46875e7dc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:59.408074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f222ab4-af2c-4b67-a2a2-7c46875e7dc7 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:59.408351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f222ab4-af2c-4b67-a2a2-7c46875e7dc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:59.408626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f222ab4-af2c-4b67-a2a2-7c46875e7dc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:59.418664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f222ab4-af2c-4b67-a2a2-7c46875e7dc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:59.420141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f222ab4-af2c-4b67-a2a2-7c46875e7dc7 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:59.429676 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3670/7407] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:59 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:38:59.706414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f62ff-248b-4f70-b880-5a27615aeb1f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:38:59.707906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ee6f62ff-248b-4f70-b880-5a27615aeb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:38:59.724151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f62ff-248b-4f70-b880-5a27615aeb1f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:38:59.728288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d889f-d8fc-4353-a873-d9aad79f572a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:38:59.728944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d889f-d8fc-4353-a873-d9aad79f572a service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:38:59.729257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d889f-d8fc-4353-a873-d9aad79f572a service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:38:59.729534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d889f-d8fc-4353-a873-d9aad79f572a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:38:59.796381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d889f-d8fc-4353-a873-d9aad79f572a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:38:59.797824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d889f-d8fc-4353-a873-d9aad79f572a service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:38:59.807658 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3738/7408] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:38:59 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:39:06.687024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f222ab4-af2c-4b67-a2a2-7c46875e7dc7 service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:06.689702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5f222ab4-af2c-4b67-a2a2-7c46875e7dc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:06.801422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f222ab4-af2c-4b67-a2a2-7c46875e7dc7 service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:06.806921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce47d1-9b54-4f4e-8aa3-2e2953629e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:06.807900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce47d1-9b54-4f4e-8aa3-2e2953629e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:06.808188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce47d1-9b54-4f4e-8aa3-2e2953629e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:06.808459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce47d1-9b54-4f4e-8aa3-2e2953629e04 admin admin] PATH_INFO: `/v3/users/96313adfa10d47138aefbcd37b5b498d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:06.810717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce47d1-9b54-4f4e-8aa3-2e2953629e04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96313adfa10d47138aefbcd37b5b498d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:06.812496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce47d1-9b54-4f4e-8aa3-2e2953629e04 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:06.843675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:07.052834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e5ce47d1-9b54-4f4e-8aa3-2e2953629e04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96313adfa10d47138aefbcd37b5b498d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:07.065595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e5ce47d1-9b54-4f4e-8aa3-2e2953629e04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96313adfa10d47138aefbcd37b5b498d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:07.163703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e5ce47d1-9b54-4f4e-8aa3-2e2953629e04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96313adfa10d47138aefbcd37b5b498d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:07.171200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e5ce47d1-9b54-4f4e-8aa3-2e2953629e04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96313adfa10d47138aefbcd37b5b498d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:07.171947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e5ce47d1-9b54-4f4e-8aa3-2e2953629e04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96313adfa10d47138aefbcd37b5b498d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:07.177946 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3671/7409] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:39:06 2022] DELETE /identity/v3/users/96313adfa10d47138aefbcd37b5b498d => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:39:07.182666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867d451-d578-42c8-abf8-dc4a07aa4dc9 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:07.183185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867d451-d578-42c8-abf8-dc4a07aa4dc9 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:07.183293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867d451-d578-42c8-abf8-dc4a07aa4dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:07.201337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4867d451-d578-42c8-abf8-dc4a07aa4dc9 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:39:07.202547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4867d451-d578-42c8-abf8-dc4a07aa4dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:07.274555 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3739/7410] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:39:07.286179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce47d1-9b54-4f4e-8aa3-2e2953629e04 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:07.287623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e5ce47d1-9b54-4f4e-8aa3-2e2953629e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:07.359135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce47d1-9b54-4f4e-8aa3-2e2953629e04 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:07.364525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684a2ac-9279-478b-bd2d-a3172eeb4335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:07.367615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684a2ac-9279-478b-bd2d-a3172eeb4335 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:07.367615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684a2ac-9279-478b-bd2d-a3172eeb4335 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:07.367615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684a2ac-9279-478b-bd2d-a3172eeb4335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:07.376934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684a2ac-9279-478b-bd2d-a3172eeb4335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:07.378361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684a2ac-9279-478b-bd2d-a3172eeb4335 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:07.389751 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3672/7411] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:39:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:39:07.812174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867d451-d578-42c8-abf8-dc4a07aa4dc9 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:07.813731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4867d451-d578-42c8-abf8-dc4a07aa4dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:07.830963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867d451-d578-42c8-abf8-dc4a07aa4dc9 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:07.836426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e552240-bfcd-41d2-b48d-db46c5f172a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:07.837424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e552240-bfcd-41d2-b48d-db46c5f172a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:07.837812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e552240-bfcd-41d2-b48d-db46c5f172a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:07.838190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e552240-bfcd-41d2-b48d-db46c5f172a9 admin admin] PATH_INFO: `/v3/projects/3a65db22ff1e4f57ad5fe34fb25c6c08` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:07.839582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e552240-bfcd-41d2-b48d-db46c5f172a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a65db22ff1e4f57ad5fe34fb25c6c08)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:07.842136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e552240-bfcd-41d2-b48d-db46c5f172a9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:07.972756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1e552240-bfcd-41d2-b48d-db46c5f172a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a65db22ff1e4f57ad5fe34fb25c6c08', 'request_id': 'req-1e552240-bfcd-41d2-b48d-db46c5f172a9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:07.980240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1e552240-bfcd-41d2-b48d-db46c5f172a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a65db22ff1e4f57ad5fe34fb25c6c08', 'request_id': 'req-1e552240-bfcd-41d2-b48d-db46c5f172a9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:07.986443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1e552240-bfcd-41d2-b48d-db46c5f172a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a65db22ff1e4f57ad5fe34fb25c6c08', 'request_id': 'req-1e552240-bfcd-41d2-b48d-db46c5f172a9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:08.050354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:08.058892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1e552240-bfcd-41d2-b48d-db46c5f172a9 admin admin] The token cache is being invalidate because project 3a65db22ff1e4f57ad5fe34fb25c6c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:39:08.058892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1e552240-bfcd-41d2-b48d-db46c5f172a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:08.058892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1e552240-bfcd-41d2-b48d-db46c5f172a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:08.058892 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3740/7412] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:39:07 2022] DELETE /identity/v3/projects/3a65db22ff1e4f57ad5fe34fb25c6c08 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:39:11.966324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684a2ac-9279-478b-bd2d-a3172eeb4335 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:11.967925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9684a2ac-9279-478b-bd2d-a3172eeb4335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:11.981913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684a2ac-9279-478b-bd2d-a3172eeb4335 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:12.032353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c80d21-5a80-4ae4-a2ad-87770f034de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:12.033245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c80d21-5a80-4ae4-a2ad-87770f034de8 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:12.033533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c80d21-5a80-4ae4-a2ad-87770f034de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:12.033836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c80d21-5a80-4ae4-a2ad-87770f034de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:12.035677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a5c80d21-5a80-4ae4-a2ad-87770f034de8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:12.048069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c80d21-5a80-4ae4-a2ad-87770f034de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:12.052865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c80d21-5a80-4ae4-a2ad-87770f034de8 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:12.060616 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3673/7413] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:39:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:39:14.634280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e552240-bfcd-41d2-b48d-db46c5f172a9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:14.634716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1e552240-bfcd-41d2-b48d-db46c5f172a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:14.651972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e552240-bfcd-41d2-b48d-db46c5f172a9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:14.656207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99afcd-b970-41db-ab94-f6127e165ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:14.656995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99afcd-b970-41db-ab94-f6127e165ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:14.657341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99afcd-b970-41db-ab94-f6127e165ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:14.657653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99afcd-b970-41db-ab94-f6127e165ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:14.660204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ee99afcd-b970-41db-ab94-f6127e165ba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:14.682180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99afcd-b970-41db-ab94-f6127e165ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:14.685198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99afcd-b970-41db-ab94-f6127e165ba8 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:14.698551 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3741/7414] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:39:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:39:22.054003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=72,keystone:DELETE=6,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:24.691560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:31.560784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3366e-d967-4f3e-a8de-477b1f6cd530 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:31.561286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3366e-d967-4f3e-a8de-477b1f6cd530 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:31.561391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3366e-d967-4f3e-a8de-477b1f6cd530 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:31.562969 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3674/7415] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:39:31.569979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce499712-1f52-488f-9d58-0aee1fadd2d0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:31.570443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce499712-1f52-488f-9d58-0aee1fadd2d0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:31.570583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce499712-1f52-488f-9d58-0aee1fadd2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:31.613326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ce499712-1f52-488f-9d58-0aee1fadd2d0 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:39:31.614587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ce499712-1f52-488f-9d58-0aee1fadd2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:31.687683 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3742/7416] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:39:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:39:31.714846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3366e-d967-4f3e-a8de-477b1f6cd530 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:31.717264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-85d3366e-d967-4f3e-a8de-477b1f6cd530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:31.739189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3366e-d967-4f3e-a8de-477b1f6cd530 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:31.744303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4813f-1bda-4f05-b350-dab3efda7674 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:31.744964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4813f-1bda-4f05-b350-dab3efda7674 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:31.745279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4813f-1bda-4f05-b350-dab3efda7674 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:31.745553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4813f-1bda-4f05-b350-dab3efda7674 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:31.754629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4813f-1bda-4f05-b350-dab3efda7674 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:31.760063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4813f-1bda-4f05-b350-dab3efda7674 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:31.766849 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3675/7417] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:39:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:39:32.277139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce499712-1f52-488f-9d58-0aee1fadd2d0 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:32.289496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce499712-1f52-488f-9d58-0aee1fadd2d0 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:32.293242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae86b90-515e-49d4-9364-126ec0f8c0ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:32.294050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae86b90-515e-49d4-9364-126ec0f8c0ed service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:32.294315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae86b90-515e-49d4-9364-126ec0f8c0ed service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:32.294594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae86b90-515e-49d4-9364-126ec0f8c0ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:32.296463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dae86b90-515e-49d4-9364-126ec0f8c0ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:32.308876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae86b90-515e-49d4-9364-126ec0f8c0ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:32.310292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae86b90-515e-49d4-9364-126ec0f8c0ed service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:32.320656 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3743/7418] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:39:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:39:32.497064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf99b93-76ab-41aa-a7ed-28d1586552b4 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:32.497270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf99b93-76ab-41aa-a7ed-28d1586552b4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:32.497560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf99b93-76ab-41aa-a7ed-28d1586552b4 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:32.498975 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3676/7419] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:39:32.503891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68de3b6-19b5-4d0a-9773-5ae5e3ec71e1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:32.504176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68de3b6-19b5-4d0a-9773-5ae5e3ec71e1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:32.504451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68de3b6-19b5-4d0a-9773-5ae5e3ec71e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:32.524337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c68de3b6-19b5-4d0a-9773-5ae5e3ec71e1 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:39:32.525537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c68de3b6-19b5-4d0a-9773-5ae5e3ec71e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:32.534857 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3744/7420] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:39:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:39:32.555672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf99b93-76ab-41aa-a7ed-28d1586552b4 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:32.571795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf99b93-76ab-41aa-a7ed-28d1586552b4 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:32.577089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03767b00-3849-4bed-ac06-8729d3498ae5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:32.577723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03767b00-3849-4bed-ac06-8729d3498ae5 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:32.578004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03767b00-3849-4bed-ac06-8729d3498ae5 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:32.578307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03767b00-3849-4bed-ac06-8729d3498ae5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:32.587632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03767b00-3849-4bed-ac06-8729d3498ae5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:32.592774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03767b00-3849-4bed-ac06-8729d3498ae5 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:32.601437 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3677/7421] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:39:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:39:35.436557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68de3b6-19b5-4d0a-9773-5ae5e3ec71e1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:35.437936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c68de3b6-19b5-4d0a-9773-5ae5e3ec71e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:35.504932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68de3b6-19b5-4d0a-9773-5ae5e3ec71e1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:35.509631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec925523-a51d-4339-980a-715eb24835c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:35.510495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec925523-a51d-4339-980a-715eb24835c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:35.510772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec925523-a51d-4339-980a-715eb24835c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:35.511108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec925523-a51d-4339-980a-715eb24835c6 admin admin] PATH_INFO: `/v3/users/ef7c7dd60bf64735afc148cfced6eecc` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:35.512343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec925523-a51d-4339-980a-715eb24835c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef7c7dd60bf64735afc148cfced6eecc)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:35.514313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec925523-a51d-4339-980a-715eb24835c6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:35.686912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ec925523-a51d-4339-980a-715eb24835c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef7c7dd60bf64735afc148cfced6eecc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:35.695137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ec925523-a51d-4339-980a-715eb24835c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef7c7dd60bf64735afc148cfced6eecc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:35.758979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ec925523-a51d-4339-980a-715eb24835c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef7c7dd60bf64735afc148cfced6eecc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:35.759787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ec925523-a51d-4339-980a-715eb24835c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef7c7dd60bf64735afc148cfced6eecc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:35.762417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:35.776682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ec925523-a51d-4339-980a-715eb24835c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef7c7dd60bf64735afc148cfced6eecc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:35.783556 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3745/7422] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:39:35 2022] DELETE /identity/v3/users/ef7c7dd60bf64735afc148cfced6eecc => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:39:35.788718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45517532-ca25-4360-a7a8-d03494b34e66 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:35.789193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45517532-ca25-4360-a7a8-d03494b34e66 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:35.789284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45517532-ca25-4360-a7a8-d03494b34e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:35.809868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-45517532-ca25-4360-a7a8-d03494b34e66 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:39:35.811320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-45517532-ca25-4360-a7a8-d03494b34e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:35.881223 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3678/7423] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:39:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:39:35.890785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec925523-a51d-4339-980a-715eb24835c6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:35.892321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ec925523-a51d-4339-980a-715eb24835c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:35.956975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec925523-a51d-4339-980a-715eb24835c6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:35.958563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c56716-4f9d-44d5-985a-48d05e548e5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:35.959247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c56716-4f9d-44d5-985a-48d05e548e5e service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:35.959530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c56716-4f9d-44d5-985a-48d05e548e5e service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:35.959808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c56716-4f9d-44d5-985a-48d05e548e5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:35.969340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c56716-4f9d-44d5-985a-48d05e548e5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:35.970779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c56716-4f9d-44d5-985a-48d05e548e5e service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:35.981139 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3746/7424] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:39:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:39:36.371857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45517532-ca25-4360-a7a8-d03494b34e66 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:36.373350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-45517532-ca25-4360-a7a8-d03494b34e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:36.386342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45517532-ca25-4360-a7a8-d03494b34e66 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:36.391139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e1ec8-d89a-4b42-9c03-3f6c302139c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:36.391932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e1ec8-d89a-4b42-9c03-3f6c302139c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:36.393139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e1ec8-d89a-4b42-9c03-3f6c302139c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:36.393139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e1ec8-d89a-4b42-9c03-3f6c302139c4 admin admin] PATH_INFO: `/v3/projects/f540a96c981448af977daf185a8ae649` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:36.394648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e1ec8-d89a-4b42-9c03-3f6c302139c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f540a96c981448af977daf185a8ae649)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:36.400542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e1ec8-d89a-4b42-9c03-3f6c302139c4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:36.513740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-be3e1ec8-d89a-4b42-9c03-3f6c302139c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f540a96c981448af977daf185a8ae649', 'request_id': 'req-be3e1ec8-d89a-4b42-9c03-3f6c302139c4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:36.519785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-be3e1ec8-d89a-4b42-9c03-3f6c302139c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f540a96c981448af977daf185a8ae649', 'request_id': 'req-be3e1ec8-d89a-4b42-9c03-3f6c302139c4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:36.526296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-be3e1ec8-d89a-4b42-9c03-3f6c302139c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f540a96c981448af977daf185a8ae649', 'request_id': 'req-be3e1ec8-d89a-4b42-9c03-3f6c302139c4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:36.591856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-be3e1ec8-d89a-4b42-9c03-3f6c302139c4 admin admin] The token cache is being invalidate because project f540a96c981448af977daf185a8ae649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:39:36.592144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-be3e1ec8-d89a-4b42-9c03-3f6c302139c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:36.592769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-be3e1ec8-d89a-4b42-9c03-3f6c302139c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:36.594341 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3679/7425] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:39:36 2022] DELETE /identity/v3/projects/f540a96c981448af977daf185a8ae649 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:39:36.599148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c56716-4f9d-44d5-985a-48d05e548e5e service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:36.609277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c56716-4f9d-44d5-985a-48d05e548e5e service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:36.668395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac4f01-57fd-4b96-b3d8-41ad91b43043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:36.669267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac4f01-57fd-4b96-b3d8-41ad91b43043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:36.669551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac4f01-57fd-4b96-b3d8-41ad91b43043 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:36.669823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac4f01-57fd-4b96-b3d8-41ad91b43043 admin admin] PATH_INFO: `/v3/users/b1a03725db7146c995d6fa2b1409ff9d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:36.671204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac4f01-57fd-4b96-b3d8-41ad91b43043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1a03725db7146c995d6fa2b1409ff9d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:36.673172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac4f01-57fd-4b96-b3d8-41ad91b43043 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:36.832719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bcac4f01-57fd-4b96-b3d8-41ad91b43043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1a03725db7146c995d6fa2b1409ff9d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:36.840502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bcac4f01-57fd-4b96-b3d8-41ad91b43043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1a03725db7146c995d6fa2b1409ff9d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:36.889748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bcac4f01-57fd-4b96-b3d8-41ad91b43043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1a03725db7146c995d6fa2b1409ff9d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:36.890476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bcac4f01-57fd-4b96-b3d8-41ad91b43043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1a03725db7146c995d6fa2b1409ff9d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:36.904942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-bcac4f01-57fd-4b96-b3d8-41ad91b43043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1a03725db7146c995d6fa2b1409ff9d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:36.911746 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3747/7426] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:39:36 2022] DELETE /identity/v3/users/b1a03725db7146c995d6fa2b1409ff9d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:39:37.428092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e1ec8-d89a-4b42-9c03-3f6c302139c4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:37.429705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-be3e1ec8-d89a-4b42-9c03-3f6c302139c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:37.444531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e1ec8-d89a-4b42-9c03-3f6c302139c4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:37.502805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:37.509198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a120dc5-6505-476a-8716-bf7b6d302e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:37.510130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a120dc5-6505-476a-8716-bf7b6d302e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:37.510410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a120dc5-6505-476a-8716-bf7b6d302e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:37.510683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a120dc5-6505-476a-8716-bf7b6d302e0a admin admin] PATH_INFO: `/v3/projects/e7daf20588004a67a35267a1ff25f898` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:37.511883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a120dc5-6505-476a-8716-bf7b6d302e0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7daf20588004a67a35267a1ff25f898)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:37.513809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a120dc5-6505-476a-8716-bf7b6d302e0a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:37.678916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7a120dc5-6505-476a-8716-bf7b6d302e0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7daf20588004a67a35267a1ff25f898', 'request_id': 'req-7a120dc5-6505-476a-8716-bf7b6d302e0a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:37.684831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7a120dc5-6505-476a-8716-bf7b6d302e0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7daf20588004a67a35267a1ff25f898', 'request_id': 'req-7a120dc5-6505-476a-8716-bf7b6d302e0a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:37.691843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7a120dc5-6505-476a-8716-bf7b6d302e0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7daf20588004a67a35267a1ff25f898', 'request_id': 'req-7a120dc5-6505-476a-8716-bf7b6d302e0a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:37.780754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7a120dc5-6505-476a-8716-bf7b6d302e0a admin admin] The token cache is being invalidate because project e7daf20588004a67a35267a1ff25f898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:39:37.781040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7a120dc5-6505-476a-8716-bf7b6d302e0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:37.781665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7a120dc5-6505-476a-8716-bf7b6d302e0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:37.783252 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3680/7427] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:39:37 2022] DELETE /identity/v3/projects/e7daf20588004a67a35267a1ff25f898 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:39:37.789620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf591b0-e2a9-402e-80b7-510cccc71c4e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:37.790103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf591b0-e2a9-402e-80b7-510cccc71c4e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:37.801049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf591b0-e2a9-402e-80b7-510cccc71c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:37.801049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:37.809031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6cf591b0-e2a9-402e-80b7-510cccc71c4e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:39:37.810244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6cf591b0-e2a9-402e-80b7-510cccc71c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:37.872230 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3748/7428] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:39:37.880966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c5680-8d5f-499e-a85c-5604785d29bb None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:37.881261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c5680-8d5f-499e-a85c-5604785d29bb None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:37.881547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c5680-8d5f-499e-a85c-5604785d29bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:37.901081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-364c5680-8d5f-499e-a85c-5604785d29bb None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:39:37.902294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-364c5680-8d5f-499e-a85c-5604785d29bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:37.910533 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3681/7429] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:39:37.918660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf591b0-e2a9-402e-80b7-510cccc71c4e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:37.929455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf591b0-e2a9-402e-80b7-510cccc71c4e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:37.933908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae2036-18bb-40b1-8288-69cc3f50bd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:37.938758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae2036-18bb-40b1-8288-69cc3f50bd12 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:37.938758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae2036-18bb-40b1-8288-69cc3f50bd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:37.938758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae2036-18bb-40b1-8288-69cc3f50bd12 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:37.938758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae2036-18bb-40b1-8288-69cc3f50bd12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:39:37.938758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae2036-18bb-40b1-8288-69cc3f50bd12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:37.938758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae2036-18bb-40b1-8288-69cc3f50bd12 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:37.950606 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3749/7430] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:39:37.954830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c5680-8d5f-499e-a85c-5604785d29bb None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:37.964840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c5680-8d5f-499e-a85c-5604785d29bb None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:37.969693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd94ab4-1902-4a8d-bf44-4c8eb8f6ea04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:37.970332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd94ab4-1902-4a8d-bf44-4c8eb8f6ea04 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:37.970617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd94ab4-1902-4a8d-bf44-4c8eb8f6ea04 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:37.970887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd94ab4-1902-4a8d-bf44-4c8eb8f6ea04 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:37.971608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd94ab4-1902-4a8d-bf44-4c8eb8f6ea04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:37.973990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd94ab4-1902-4a8d-bf44-4c8eb8f6ea04 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:38.079941 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3682/7431] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:39:37 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:39:38.084198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae2036-18bb-40b1-8288-69cc3f50bd12 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:38.094706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae2036-18bb-40b1-8288-69cc3f50bd12 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:38.155026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c151497-7dc8-4925-90bc-52d848bcf617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:38.155731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c151497-7dc8-4925-90bc-52d848bcf617 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:38.156016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c151497-7dc8-4925-90bc-52d848bcf617 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:38.156290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c151497-7dc8-4925-90bc-52d848bcf617 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:38.156989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c151497-7dc8-4925-90bc-52d848bcf617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:38.158924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c151497-7dc8-4925-90bc-52d848bcf617 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:38.256716 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3750/7432] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:39:38 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:39:38.260890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd94ab4-1902-4a8d-bf44-4c8eb8f6ea04 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:38.273841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd94ab4-1902-4a8d-bf44-4c8eb8f6ea04 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:38.278858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01303b02-0b8e-4318-a8bf-7f0ef475abcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:38.279600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01303b02-0b8e-4318-a8bf-7f0ef475abcb admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:38.279977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01303b02-0b8e-4318-a8bf-7f0ef475abcb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:38.280159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01303b02-0b8e-4318-a8bf-7f0ef475abcb admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:38.280885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01303b02-0b8e-4318-a8bf-7f0ef475abcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:38.282594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01303b02-0b8e-4318-a8bf-7f0ef475abcb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:38.295416 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3683/7433] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:39:38.304467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c151497-7dc8-4925-90bc-52d848bcf617 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:38.315359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c151497-7dc8-4925-90bc-52d848bcf617 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:38.320335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5053e-711e-4455-855a-003ca97f86ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:38.325221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5053e-711e-4455-855a-003ca97f86ad admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:38.325221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5053e-711e-4455-855a-003ca97f86ad admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:38.325221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5053e-711e-4455-855a-003ca97f86ad admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:38.325221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5053e-711e-4455-855a-003ca97f86ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:38.325221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5053e-711e-4455-855a-003ca97f86ad admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:38.334186 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3751/7434] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:39:38.338532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01303b02-0b8e-4318-a8bf-7f0ef475abcb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:38.349471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01303b02-0b8e-4318-a8bf-7f0ef475abcb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:38.354340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944d941-b2d3-4e0d-bc1b-49d832fb9c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:38.355255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944d941-b2d3-4e0d-bc1b-49d832fb9c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:38.355540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944d941-b2d3-4e0d-bc1b-49d832fb9c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:38.355818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944d941-b2d3-4e0d-bc1b-49d832fb9c44 admin admin] PATH_INFO: `/v3/projects/89e85b8789324a8a91a6aae30eefa54d/users/6d09783924f1447cb076f502ad7a2450/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:38.371391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944d941-b2d3-4e0d-bc1b-49d832fb9c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e85b8789324a8a91a6aae30eefa54d, user_id=6d09783924f1447cb076f502ad7a2450, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:38.374290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944d941-b2d3-4e0d-bc1b-49d832fb9c44 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:38.456672 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3684/7435] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:39:38 2022] PUT /identity/v3/projects/89e85b8789324a8a91a6aae30eefa54d/users/6d09783924f1447cb076f502ad7a2450/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:39:38.467547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982b3c4-520a-4a73-b497-e85a844fbeea None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:38.467845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982b3c4-520a-4a73-b497-e85a844fbeea None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:38.468127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982b3c4-520a-4a73-b497-e85a844fbeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:38.502531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c982b3c4-520a-4a73-b497-e85a844fbeea None None] MFA Rules not processed for user `6d09783924f1447cb076f502ad7a2450`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:39:38.503957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c982b3c4-520a-4a73-b497-e85a844fbeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:38.566876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:38.570417 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3752/7436] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:39:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:39:38.574969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944d941-b2d3-4e0d-bc1b-49d832fb9c44 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:38.640992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944d941-b2d3-4e0d-bc1b-49d832fb9c44 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:38.646562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04430d75-9a30-49ae-ae62-e413a689fbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:38.647263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04430d75-9a30-49ae-ae62-e413a689fbf4 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:38.647549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04430d75-9a30-49ae-ae62-e413a689fbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:38.647836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04430d75-9a30-49ae-ae62-e413a689fbf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:38.648666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04430d75-9a30-49ae-ae62-e413a689fbf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:38.650571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04430d75-9a30-49ae-ae62-e413a689fbf4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:38.738540 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3685/7437] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:39:38 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:39:38.742673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982b3c4-520a-4a73-b497-e85a844fbeea None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:38.753932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982b3c4-520a-4a73-b497-e85a844fbeea None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:38.817113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f512a23-65bc-4a67-a0db-778b53417465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:38.818044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f512a23-65bc-4a67-a0db-778b53417465 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:38.818330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f512a23-65bc-4a67-a0db-778b53417465 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:38.818605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f512a23-65bc-4a67-a0db-778b53417465 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:38.819357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f512a23-65bc-4a67-a0db-778b53417465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:38.821286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f512a23-65bc-4a67-a0db-778b53417465 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:38.902537 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3753/7438] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:39:38 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:39:38.906157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04430d75-9a30-49ae-ae62-e413a689fbf4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:38.918188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04430d75-9a30-49ae-ae62-e413a689fbf4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:38.923070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5950c91-7744-4b6c-97ef-68e5d75908c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:38.923737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5950c91-7744-4b6c-97ef-68e5d75908c7 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:38.924049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5950c91-7744-4b6c-97ef-68e5d75908c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:38.924343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5950c91-7744-4b6c-97ef-68e5d75908c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:38.925030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5950c91-7744-4b6c-97ef-68e5d75908c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:38.926713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5950c91-7744-4b6c-97ef-68e5d75908c7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:38.929126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:38.938312 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3686/7439] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:39:38.942876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f512a23-65bc-4a67-a0db-778b53417465 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:38.953760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f512a23-65bc-4a67-a0db-778b53417465 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:38.959493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b15a9-3c21-4aed-b5c2-dae0528f4b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:38.960224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b15a9-3c21-4aed-b5c2-dae0528f4b68 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:38.960530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b15a9-3c21-4aed-b5c2-dae0528f4b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:38.960809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b15a9-3c21-4aed-b5c2-dae0528f4b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:38.961563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b15a9-3c21-4aed-b5c2-dae0528f4b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:38.963251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b15a9-3c21-4aed-b5c2-dae0528f4b68 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:38.973933 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3754/7440] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:39:38.977848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5950c91-7744-4b6c-97ef-68e5d75908c7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:38.988260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5950c91-7744-4b6c-97ef-68e5d75908c7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:38.993244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8364d8a-758f-424f-a4ba-a3e32cb93195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:38.994057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8364d8a-758f-424f-a4ba-a3e32cb93195 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:38.994339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8364d8a-758f-424f-a4ba-a3e32cb93195 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:38.994613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8364d8a-758f-424f-a4ba-a3e32cb93195 admin admin] PATH_INFO: `/v3/projects/0ce73262a6cc43de81e0e3e18b2d41c7/users/affb2b01af5d47bb8adfaf42e41935f4/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:39.010997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8364d8a-758f-424f-a4ba-a3e32cb93195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce73262a6cc43de81e0e3e18b2d41c7, user_id=affb2b01af5d47bb8adfaf42e41935f4, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:39.013666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8364d8a-758f-424f-a4ba-a3e32cb93195 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:39.085624 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3687/7441] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:39:38 2022] PUT /identity/v3/projects/0ce73262a6cc43de81e0e3e18b2d41c7/users/affb2b01af5d47bb8adfaf42e41935f4/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:39:39.105729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338ebf1-be13-45a9-89b5-55ba9f60af22 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:39.106108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338ebf1-be13-45a9-89b5-55ba9f60af22 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:39.106698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338ebf1-be13-45a9-89b5-55ba9f60af22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:39.137281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1338ebf1-be13-45a9-89b5-55ba9f60af22 None None] MFA Rules not processed for user `affb2b01af5d47bb8adfaf42e41935f4`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:39:39.138519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1338ebf1-be13-45a9-89b5-55ba9f60af22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:39.211608 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3755/7442] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:39:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:39:39.216346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8364d8a-758f-424f-a4ba-a3e32cb93195 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:39.295069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8364d8a-758f-424f-a4ba-a3e32cb93195 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:39.300562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52164cff-323b-4911-a8ed-2f0776abc6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:39.301292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52164cff-323b-4911-a8ed-2f0776abc6fa admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:39.301578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52164cff-323b-4911-a8ed-2f0776abc6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:39.301856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52164cff-323b-4911-a8ed-2f0776abc6fa admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:39.302565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52164cff-323b-4911-a8ed-2f0776abc6fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:39.304524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52164cff-323b-4911-a8ed-2f0776abc6fa admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:39.392014 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3688/7443] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:39:39 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:39:39.393402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338ebf1-be13-45a9-89b5-55ba9f60af22 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:39.405613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338ebf1-be13-45a9-89b5-55ba9f60af22 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:39.464583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13285913-bfe6-41d6-a0a4-d352d2062ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:39.465340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13285913-bfe6-41d6-a0a4-d352d2062ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:39.465623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13285913-bfe6-41d6-a0a4-d352d2062ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:39.465929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13285913-bfe6-41d6-a0a4-d352d2062ef0 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:39.466610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13285913-bfe6-41d6-a0a4-d352d2062ef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:39.468586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13285913-bfe6-41d6-a0a4-d352d2062ef0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:39.564625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:39.571420 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3756/7444] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:39:39 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:39:39.575524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52164cff-323b-4911-a8ed-2f0776abc6fa admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:39.586534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52164cff-323b-4911-a8ed-2f0776abc6fa admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:39.591288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483afd4d-1f6d-498f-8615-cdeca9eb9e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:39.592025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483afd4d-1f6d-498f-8615-cdeca9eb9e42 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:39.592290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483afd4d-1f6d-498f-8615-cdeca9eb9e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:39.592570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483afd4d-1f6d-498f-8615-cdeca9eb9e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:39.593329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483afd4d-1f6d-498f-8615-cdeca9eb9e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:39.594921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483afd4d-1f6d-498f-8615-cdeca9eb9e42 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:39.606920 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3689/7445] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:39:39.611297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13285913-bfe6-41d6-a0a4-d352d2062ef0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:39.621878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13285913-bfe6-41d6-a0a4-d352d2062ef0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:39.626470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f0cc9-0a5e-4b06-bb77-bc999a263c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:39.627376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f0cc9-0a5e-4b06-bb77-bc999a263c32 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:39.627655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f0cc9-0a5e-4b06-bb77-bc999a263c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:39.627926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f0cc9-0a5e-4b06-bb77-bc999a263c32 admin admin] PATH_INFO: `/v3/projects/be96d84606d94b0bb6e4c8a489b78223/users/1f02c493b63d479cb32054e45856a5be/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:39.643448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f0cc9-0a5e-4b06-bb77-bc999a263c32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be96d84606d94b0bb6e4c8a489b78223, user_id=1f02c493b63d479cb32054e45856a5be, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:39.646641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f0cc9-0a5e-4b06-bb77-bc999a263c32 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:39.725679 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3757/7446] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:39:39 2022] PUT /identity/v3/projects/be96d84606d94b0bb6e4c8a489b78223/users/1f02c493b63d479cb32054e45856a5be/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:39:39.729816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483afd4d-1f6d-498f-8615-cdeca9eb9e42 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:39.740941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483afd4d-1f6d-498f-8615-cdeca9eb9e42 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:39.798137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23ac63-a6dd-4a92-9fff-9c315c6cd438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:39.798812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23ac63-a6dd-4a92-9fff-9c315c6cd438 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:39.799134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23ac63-a6dd-4a92-9fff-9c315c6cd438 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:39.799410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23ac63-a6dd-4a92-9fff-9c315c6cd438 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:39.800130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23ac63-a6dd-4a92-9fff-9c315c6cd438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:39.802210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23ac63-a6dd-4a92-9fff-9c315c6cd438 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:39.813241 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3690/7447] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:39:39.824644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f0cc9-0a5e-4b06-bb77-bc999a263c32 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:39.836381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f0cc9-0a5e-4b06-bb77-bc999a263c32 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:39.841163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060df77f-287c-4e06-b957-0b7e45abd62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:39.842105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060df77f-287c-4e06-b957-0b7e45abd62d admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:39.842419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060df77f-287c-4e06-b957-0b7e45abd62d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:39.842661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060df77f-287c-4e06-b957-0b7e45abd62d admin admin] PATH_INFO: `/v3/projects/be96d84606d94b0bb6e4c8a489b78223/users/1f02c493b63d479cb32054e45856a5be/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:39.844936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060df77f-287c-4e06-b957-0b7e45abd62d admin admin] RBAC: Authorizing `identity:create_grant(project_id=be96d84606d94b0bb6e4c8a489b78223, user_id=1f02c493b63d479cb32054e45856a5be, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:39.847629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060df77f-287c-4e06-b957-0b7e45abd62d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:39.858602 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3758/7448] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:39:39 2022] PUT /identity/v3/projects/be96d84606d94b0bb6e4c8a489b78223/users/1f02c493b63d479cb32054e45856a5be/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:39:39.874543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd2d2b-15e2-4209-9117-1685eb1d3088 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:39.874834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd2d2b-15e2-4209-9117-1685eb1d3088 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:39.875155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd2d2b-15e2-4209-9117-1685eb1d3088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:39.902903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4acd2d2b-15e2-4209-9117-1685eb1d3088 None None] MFA Rules not processed for user `1f02c493b63d479cb32054e45856a5be`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:39:39.904223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4acd2d2b-15e2-4209-9117-1685eb1d3088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:39.940002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:39.981172 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3691/7449] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:39:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:39:39.994481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060df77f-287c-4e06-b957-0b7e45abd62d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:39.996517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-060df77f-287c-4e06-b957-0b7e45abd62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:40.060631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060df77f-287c-4e06-b957-0b7e45abd62d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:40.064391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660b148-c3f4-4fc1-863e-7ad4b0d70530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:40.065028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660b148-c3f4-4fc1-863e-7ad4b0d70530 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:40.065307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660b148-c3f4-4fc1-863e-7ad4b0d70530 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:40.065578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660b148-c3f4-4fc1-863e-7ad4b0d70530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:40.074918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660b148-c3f4-4fc1-863e-7ad4b0d70530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:40.076361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660b148-c3f4-4fc1-863e-7ad4b0d70530 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:40.087069 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3759/7450] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:39:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:39:40.232147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd2d2b-15e2-4209-9117-1685eb1d3088 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:40.232147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4acd2d2b-15e2-4209-9117-1685eb1d3088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:40.244400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd2d2b-15e2-4209-9117-1685eb1d3088 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:40.248115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eacbe1-94fa-4b2f-acf2-52424f510328 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:40.248763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eacbe1-94fa-4b2f-acf2-52424f510328 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:40.249044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eacbe1-94fa-4b2f-acf2-52424f510328 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:40.249327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eacbe1-94fa-4b2f-acf2-52424f510328 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:40.310020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eacbe1-94fa-4b2f-acf2-52424f510328 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:40.311817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eacbe1-94fa-4b2f-acf2-52424f510328 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:40.321620 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3692/7451] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:39:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:39:46.216186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da9f08-136a-457c-81e5-abb207d9d76d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:46.216677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da9f08-136a-457c-81e5-abb207d9d76d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:46.216774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da9f08-136a-457c-81e5-abb207d9d76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:46.236812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c1da9f08-136a-457c-81e5-abb207d9d76d None None] MFA Rules not processed for user `62209b9802ab46c3b3d094d4d1ad86fe`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:39:46.238065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c1da9f08-136a-457c-81e5-abb207d9d76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:46.295818 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3760/7452] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:39:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:39:50.317462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=42 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:50.758639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eacbe1-94fa-4b2f-acf2-52424f510328 service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:50.844169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eacbe1-94fa-4b2f-acf2-52424f510328 service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:50.849043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec289445-f578-4a7e-98a4-9af65fc98beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:50.849923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec289445-f578-4a7e-98a4-9af65fc98beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:50.850207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec289445-f578-4a7e-98a4-9af65fc98beb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:50.850485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec289445-f578-4a7e-98a4-9af65fc98beb admin admin] PATH_INFO: `/v3/users/6d09783924f1447cb076f502ad7a2450` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:50.851699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec289445-f578-4a7e-98a4-9af65fc98beb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d09783924f1447cb076f502ad7a2450)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:50.853792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec289445-f578-4a7e-98a4-9af65fc98beb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:51.184755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ec289445-f578-4a7e-98a4-9af65fc98beb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d09783924f1447cb076f502ad7a2450'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:51.199906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ec289445-f578-4a7e-98a4-9af65fc98beb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d09783924f1447cb076f502ad7a2450'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:51.307716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ec289445-f578-4a7e-98a4-9af65fc98beb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d09783924f1447cb076f502ad7a2450'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:51.319876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ec289445-f578-4a7e-98a4-9af65fc98beb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d09783924f1447cb076f502ad7a2450'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:51.321294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ec289445-f578-4a7e-98a4-9af65fc98beb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d09783924f1447cb076f502ad7a2450'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:51.330744 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3693/7453] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:39:50 2022] DELETE /identity/v3/users/6d09783924f1447cb076f502ad7a2450 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:39:51.335983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8ecb3-0929-4922-a82a-8b6ebb0f513c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:51.336500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8ecb3-0929-4922-a82a-8b6ebb0f513c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:51.336581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8ecb3-0929-4922-a82a-8b6ebb0f513c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:51.359509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-96a8ecb3-0929-4922-a82a-8b6ebb0f513c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:39:51.360855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-96a8ecb3-0929-4922-a82a-8b6ebb0f513c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:51.431081 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3761/7454] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:39:51.441015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec289445-f578-4a7e-98a4-9af65fc98beb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:51.443504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ec289445-f578-4a7e-98a4-9af65fc98beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:51.513441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec289445-f578-4a7e-98a4-9af65fc98beb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:51.517425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111e493-1304-46c4-8d74-126c89075581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:51.518135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111e493-1304-46c4-8d74-126c89075581 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:51.518521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111e493-1304-46c4-8d74-126c89075581 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:51.518812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111e493-1304-46c4-8d74-126c89075581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:51.529005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111e493-1304-46c4-8d74-126c89075581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:51.530452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111e493-1304-46c4-8d74-126c89075581 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:51.541223 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3694/7455] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:39:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:39:52.045195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8ecb3-0929-4922-a82a-8b6ebb0f513c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:52.046620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-96a8ecb3-0929-4922-a82a-8b6ebb0f513c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:52.059601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8ecb3-0929-4922-a82a-8b6ebb0f513c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:52.064818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01787115-dafb-4e52-afb0-2396a67d4e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:52.065742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01787115-dafb-4e52-afb0-2396a67d4e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:52.066028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01787115-dafb-4e52-afb0-2396a67d4e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:52.066305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01787115-dafb-4e52-afb0-2396a67d4e3c admin admin] PATH_INFO: `/v3/projects/89e85b8789324a8a91a6aae30eefa54d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:52.067631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01787115-dafb-4e52-afb0-2396a67d4e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=89e85b8789324a8a91a6aae30eefa54d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:52.069621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01787115-dafb-4e52-afb0-2396a67d4e3c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:52.072777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:52.201519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-01787115-dafb-4e52-afb0-2396a67d4e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89e85b8789324a8a91a6aae30eefa54d', 'request_id': 'req-01787115-dafb-4e52-afb0-2396a67d4e3c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:52.208848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-01787115-dafb-4e52-afb0-2396a67d4e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89e85b8789324a8a91a6aae30eefa54d', 'request_id': 'req-01787115-dafb-4e52-afb0-2396a67d4e3c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:52.214648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-01787115-dafb-4e52-afb0-2396a67d4e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89e85b8789324a8a91a6aae30eefa54d', 'request_id': 'req-01787115-dafb-4e52-afb0-2396a67d4e3c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:52.301066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-01787115-dafb-4e52-afb0-2396a67d4e3c admin admin] The token cache is being invalidate because project 89e85b8789324a8a91a6aae30eefa54d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:39:52.301418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-01787115-dafb-4e52-afb0-2396a67d4e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:52.306360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-01787115-dafb-4e52-afb0-2396a67d4e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:52.306360 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3762/7456] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:39:52 2022] DELETE /identity/v3/projects/89e85b8789324a8a91a6aae30eefa54d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:39:52.309165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111e493-1304-46c4-8d74-126c89075581 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:52.319279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111e493-1304-46c4-8d74-126c89075581 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:52.338393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:52.377770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab4fd5-df0c-468a-aafc-4ff365a61056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:52.378663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab4fd5-df0c-468a-aafc-4ff365a61056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:52.378945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab4fd5-df0c-468a-aafc-4ff365a61056 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:52.379813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab4fd5-df0c-468a-aafc-4ff365a61056 admin admin] PATH_INFO: `/v3/users/affb2b01af5d47bb8adfaf42e41935f4` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:52.381020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab4fd5-df0c-468a-aafc-4ff365a61056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=affb2b01af5d47bb8adfaf42e41935f4)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:52.382934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab4fd5-df0c-468a-aafc-4ff365a61056 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:52.590492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ecab4fd5-df0c-468a-aafc-4ff365a61056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'affb2b01af5d47bb8adfaf42e41935f4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:52.609092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ecab4fd5-df0c-468a-aafc-4ff365a61056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'affb2b01af5d47bb8adfaf42e41935f4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:52.695403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ecab4fd5-df0c-468a-aafc-4ff365a61056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'affb2b01af5d47bb8adfaf42e41935f4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:52.704651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ecab4fd5-df0c-468a-aafc-4ff365a61056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'affb2b01af5d47bb8adfaf42e41935f4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:52.705341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ecab4fd5-df0c-468a-aafc-4ff365a61056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'affb2b01af5d47bb8adfaf42e41935f4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:52.713545 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3695/7457] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:39:52 2022] DELETE /identity/v3/users/affb2b01af5d47bb8adfaf42e41935f4 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:39:53.321233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01787115-dafb-4e52-afb0-2396a67d4e3c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:53.322913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-01787115-dafb-4e52-afb0-2396a67d4e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:53.338823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01787115-dafb-4e52-afb0-2396a67d4e3c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:53.415354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed57204-0b0e-4360-a12b-065277d861a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:53.416251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed57204-0b0e-4360-a12b-065277d861a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:53.416534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed57204-0b0e-4360-a12b-065277d861a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:53.417002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed57204-0b0e-4360-a12b-065277d861a6 admin admin] PATH_INFO: `/v3/projects/0ce73262a6cc43de81e0e3e18b2d41c7` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:53.418507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed57204-0b0e-4360-a12b-065277d861a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce73262a6cc43de81e0e3e18b2d41c7)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:53.420557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed57204-0b0e-4360-a12b-065277d861a6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:53.559493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5ed57204-0b0e-4360-a12b-065277d861a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce73262a6cc43de81e0e3e18b2d41c7', 'request_id': 'req-5ed57204-0b0e-4360-a12b-065277d861a6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:53.567110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5ed57204-0b0e-4360-a12b-065277d861a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce73262a6cc43de81e0e3e18b2d41c7', 'request_id': 'req-5ed57204-0b0e-4360-a12b-065277d861a6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:53.572876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5ed57204-0b0e-4360-a12b-065277d861a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce73262a6cc43de81e0e3e18b2d41c7', 'request_id': 'req-5ed57204-0b0e-4360-a12b-065277d861a6'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:53.638836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5ed57204-0b0e-4360-a12b-065277d861a6 admin admin] The token cache is being invalidate because project 0ce73262a6cc43de81e0e3e18b2d41c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:39:53.639258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5ed57204-0b0e-4360-a12b-065277d861a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:53.640007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5ed57204-0b0e-4360-a12b-065277d861a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:53.641610 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3763/7458] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:39:53 2022] DELETE /identity/v3/projects/0ce73262a6cc43de81e0e3e18b2d41c7 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:39:53.646170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab4fd5-df0c-468a-aafc-4ff365a61056 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:53.648085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ecab4fd5-df0c-468a-aafc-4ff365a61056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:53.665278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab4fd5-df0c-468a-aafc-4ff365a61056 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:53.762629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b4657-83cf-416c-80dd-1cff7f57276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:53.763896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b4657-83cf-416c-80dd-1cff7f57276a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:53.764395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b4657-83cf-416c-80dd-1cff7f57276a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:53.764674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b4657-83cf-416c-80dd-1cff7f57276a admin admin] PATH_INFO: `/v3/users/1f02c493b63d479cb32054e45856a5be` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:53.765932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b4657-83cf-416c-80dd-1cff7f57276a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f02c493b63d479cb32054e45856a5be)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:53.767908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b4657-83cf-416c-80dd-1cff7f57276a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:53.983457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:53.986000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-765b4657-83cf-416c-80dd-1cff7f57276a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f02c493b63d479cb32054e45856a5be'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:54.002690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-765b4657-83cf-416c-80dd-1cff7f57276a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f02c493b63d479cb32054e45856a5be'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:54.083837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-765b4657-83cf-416c-80dd-1cff7f57276a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f02c493b63d479cb32054e45856a5be'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:54.092367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-765b4657-83cf-416c-80dd-1cff7f57276a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f02c493b63d479cb32054e45856a5be'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:54.093044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-765b4657-83cf-416c-80dd-1cff7f57276a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f02c493b63d479cb32054e45856a5be'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:54.101793 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3696/7459] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:39:53 2022] DELETE /identity/v3/users/1f02c493b63d479cb32054e45856a5be => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:39:54.252182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed57204-0b0e-4360-a12b-065277d861a6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:54.253638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5ed57204-0b0e-4360-a12b-065277d861a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:54.283741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:54.341898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed57204-0b0e-4360-a12b-065277d861a6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:54.413772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb5ed5-6c9f-498f-9bc1-06eaf800c372 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:54.414553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb5ed5-6c9f-498f-9bc1-06eaf800c372 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:54.415198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb5ed5-6c9f-498f-9bc1-06eaf800c372 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:54.415545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb5ed5-6c9f-498f-9bc1-06eaf800c372 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:54.417533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a7cb5ed5-6c9f-498f-9bc1-06eaf800c372 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:54.434692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb5ed5-6c9f-498f-9bc1-06eaf800c372 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:54.437615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb5ed5-6c9f-498f-9bc1-06eaf800c372 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:54.455204 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3764/7460] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:39:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:39:54.826444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b4657-83cf-416c-80dd-1cff7f57276a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:54.827800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-765b4657-83cf-416c-80dd-1cff7f57276a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:54.919361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b4657-83cf-416c-80dd-1cff7f57276a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:54.924172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adb806-cafd-468d-b338-82b6290c41bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:54.925066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adb806-cafd-468d-b338-82b6290c41bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:54.925352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adb806-cafd-468d-b338-82b6290c41bc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:54.925628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adb806-cafd-468d-b338-82b6290c41bc admin admin] PATH_INFO: `/v3/projects/be96d84606d94b0bb6e4c8a489b78223` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:54.926980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adb806-cafd-468d-b338-82b6290c41bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=be96d84606d94b0bb6e4c8a489b78223)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:54.929134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adb806-cafd-468d-b338-82b6290c41bc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:55.045021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-66adb806-cafd-468d-b338-82b6290c41bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be96d84606d94b0bb6e4c8a489b78223', 'request_id': 'req-66adb806-cafd-468d-b338-82b6290c41bc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:55.052423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-66adb806-cafd-468d-b338-82b6290c41bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be96d84606d94b0bb6e4c8a489b78223', 'request_id': 'req-66adb806-cafd-468d-b338-82b6290c41bc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:55.062360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-66adb806-cafd-468d-b338-82b6290c41bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be96d84606d94b0bb6e4c8a489b78223', 'request_id': 'req-66adb806-cafd-468d-b338-82b6290c41bc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:55.154476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-66adb806-cafd-468d-b338-82b6290c41bc admin admin] The token cache is being invalidate because project be96d84606d94b0bb6e4c8a489b78223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:39:55.154830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-66adb806-cafd-468d-b338-82b6290c41bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:55.156197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-66adb806-cafd-468d-b338-82b6290c41bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:55.163171 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3697/7461] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:39:54 2022] DELETE /identity/v3/projects/be96d84606d94b0bb6e4c8a489b78223 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:39:55.165813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91f44f-d294-4043-bdf0-0cc0b99e0bdc None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:55.166354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91f44f-d294-4043-bdf0-0cc0b99e0bdc None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:55.166645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91f44f-d294-4043-bdf0-0cc0b99e0bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:55.190811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ce91f44f-d294-4043-bdf0-0cc0b99e0bdc None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:39:55.193160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ce91f44f-d294-4043-bdf0-0cc0b99e0bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:55.273506 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3765/7462] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:39:55.283104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf73ba-df92-43b0-bf43-f12751e58f14 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:55.283403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf73ba-df92-43b0-bf43-f12751e58f14 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:55.283688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf73ba-df92-43b0-bf43-f12751e58f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:55.303708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a9cf73ba-df92-43b0-bf43-f12751e58f14 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:39:55.304942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a9cf73ba-df92-43b0-bf43-f12751e58f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:55.313786 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3698/7463] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:39:55.319282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91f44f-d294-4043-bdf0-0cc0b99e0bdc None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:55.329674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91f44f-d294-4043-bdf0-0cc0b99e0bdc None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:55.335194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a361600-2157-4138-8758-52b8dbb338f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:55.335866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a361600-2157-4138-8758-52b8dbb338f5 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:55.336154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a361600-2157-4138-8758-52b8dbb338f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:55.336435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a361600-2157-4138-8758-52b8dbb338f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:55.337181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a361600-2157-4138-8758-52b8dbb338f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:39:55.337487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a361600-2157-4138-8758-52b8dbb338f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:55.339191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a361600-2157-4138-8758-52b8dbb338f5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:55.353366 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3766/7464] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:39:55.358175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf73ba-df92-43b0-bf43-f12751e58f14 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:55.369554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf73ba-df92-43b0-bf43-f12751e58f14 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:55.374398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c7e47-edc9-4b81-ad97-67c9e4c84c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:55.375130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c7e47-edc9-4b81-ad97-67c9e4c84c21 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:55.375418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c7e47-edc9-4b81-ad97-67c9e4c84c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:55.375751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c7e47-edc9-4b81-ad97-67c9e4c84c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:55.376457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c7e47-edc9-4b81-ad97-67c9e4c84c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:55.378363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c7e47-edc9-4b81-ad97-67c9e4c84c21 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:55.508886 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3699/7465] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:39:55 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:39:55.513207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a361600-2157-4138-8758-52b8dbb338f5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:55.524589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a361600-2157-4138-8758-52b8dbb338f5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:55.558748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:55.586121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c469d23-b80e-4b35-8171-cd3d6498b0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:55.587025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c469d23-b80e-4b35-8171-cd3d6498b0fa admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:55.587985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c469d23-b80e-4b35-8171-cd3d6498b0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:55.588262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c469d23-b80e-4b35-8171-cd3d6498b0fa admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:55.588962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c469d23-b80e-4b35-8171-cd3d6498b0fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:55.590995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c469d23-b80e-4b35-8171-cd3d6498b0fa admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:55.685309 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3767/7466] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:39:55 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:39:55.689224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c7e47-edc9-4b81-ad97-67c9e4c84c21 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:55.699989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c7e47-edc9-4b81-ad97-67c9e4c84c21 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:55.704635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39003f1c-b676-4c5f-a683-fb0455dbaf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:55.705383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39003f1c-b676-4c5f-a683-fb0455dbaf44 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:55.705669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39003f1c-b676-4c5f-a683-fb0455dbaf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:55.705951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39003f1c-b676-4c5f-a683-fb0455dbaf44 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:55.706697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39003f1c-b676-4c5f-a683-fb0455dbaf44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:55.708338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39003f1c-b676-4c5f-a683-fb0455dbaf44 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:55.719229 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3700/7467] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:39:55.723489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c469d23-b80e-4b35-8171-cd3d6498b0fa admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:55.734187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c469d23-b80e-4b35-8171-cd3d6498b0fa admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:55.739762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42130321-567d-46dd-aac9-95062b11acf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:55.743760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42130321-567d-46dd-aac9-95062b11acf3 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:55.743760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42130321-567d-46dd-aac9-95062b11acf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:55.743760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42130321-567d-46dd-aac9-95062b11acf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:55.743760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42130321-567d-46dd-aac9-95062b11acf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:55.743760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42130321-567d-46dd-aac9-95062b11acf3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:55.768399 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3768/7468] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:39:55.778154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39003f1c-b676-4c5f-a683-fb0455dbaf44 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:55.784181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39003f1c-b676-4c5f-a683-fb0455dbaf44 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:55.789884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f2676-6b5d-4003-989b-f2019bc03937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:55.790760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f2676-6b5d-4003-989b-f2019bc03937 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:55.791073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f2676-6b5d-4003-989b-f2019bc03937 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:55.791353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f2676-6b5d-4003-989b-f2019bc03937 admin admin] PATH_INFO: `/v3/projects/90a8665639fc40dbb6f9292e99c8d70c/users/4b2d44700e964095ab78858ebb28567e/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:55.799638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:55.806581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f2676-6b5d-4003-989b-f2019bc03937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a8665639fc40dbb6f9292e99c8d70c, user_id=4b2d44700e964095ab78858ebb28567e, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:55.809269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f2676-6b5d-4003-989b-f2019bc03937 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:55.941949 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3701/7469] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:39:55 2022] PUT /identity/v3/projects/90a8665639fc40dbb6f9292e99c8d70c/users/4b2d44700e964095ab78858ebb28567e/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:39:55.953659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87344acb-c575-4dcb-a302-320211b13903 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:55.953954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87344acb-c575-4dcb-a302-320211b13903 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:55.954251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87344acb-c575-4dcb-a302-320211b13903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:55.984710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-87344acb-c575-4dcb-a302-320211b13903 None None] MFA Rules not processed for user `4b2d44700e964095ab78858ebb28567e`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:39:55.985920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-87344acb-c575-4dcb-a302-320211b13903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:56.051703 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3769/7470] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:39:56.064870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f2676-6b5d-4003-989b-f2019bc03937 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:56.066796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-330f2676-6b5d-4003-989b-f2019bc03937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:56.129975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f2676-6b5d-4003-989b-f2019bc03937 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:56.133710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae36bd1-0ef8-4bdf-a22b-c522d1d69af0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:56.134382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae36bd1-0ef8-4bdf-a22b-c522d1d69af0 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:56.134668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae36bd1-0ef8-4bdf-a22b-c522d1d69af0 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:56.134949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae36bd1-0ef8-4bdf-a22b-c522d1d69af0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:56.143564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae36bd1-0ef8-4bdf-a22b-c522d1d69af0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:56.145630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae36bd1-0ef8-4bdf-a22b-c522d1d69af0 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:56.155080 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3702/7471] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:39:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:39:56.174793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87344acb-c575-4dcb-a302-320211b13903 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:56.236900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87344acb-c575-4dcb-a302-320211b13903 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:56.241667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b6b74-2663-4a8f-a772-bef84c3f6a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:56.242537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b6b74-2663-4a8f-a772-bef84c3f6a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:56.242818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b6b74-2663-4a8f-a772-bef84c3f6a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:56.243135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b6b74-2663-4a8f-a772-bef84c3f6a32 admin admin] PATH_INFO: `/v3/users/4b2d44700e964095ab78858ebb28567e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:56.244319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b6b74-2663-4a8f-a772-bef84c3f6a32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b2d44700e964095ab78858ebb28567e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:56.246252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b6b74-2663-4a8f-a772-bef84c3f6a32 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:56.405960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:56.408525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-263b6b74-2663-4a8f-a772-bef84c3f6a32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b2d44700e964095ab78858ebb28567e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:56.416453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-263b6b74-2663-4a8f-a772-bef84c3f6a32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b2d44700e964095ab78858ebb28567e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:56.512772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-263b6b74-2663-4a8f-a772-bef84c3f6a32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b2d44700e964095ab78858ebb28567e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:56.513334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-263b6b74-2663-4a8f-a772-bef84c3f6a32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b2d44700e964095ab78858ebb28567e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:56.527780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-263b6b74-2663-4a8f-a772-bef84c3f6a32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b2d44700e964095ab78858ebb28567e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:56.533930 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3770/7472] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:39:56 2022] DELETE /identity/v3/users/4b2d44700e964095ab78858ebb28567e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:39:56.539299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9b5bd-08e4-4a2d-a6e9-7767e5ee8f85 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:56.545456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9b5bd-08e4-4a2d-a6e9-7767e5ee8f85 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:56.545456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9b5bd-08e4-4a2d-a6e9-7767e5ee8f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:56.559161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9fa9b5bd-08e4-4a2d-a6e9-7767e5ee8f85 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:39:56.561425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9fa9b5bd-08e4-4a2d-a6e9-7767e5ee8f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:56.627903 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3703/7473] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:39:56.640149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b6b74-2663-4a8f-a772-bef84c3f6a32 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:56.641627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-263b6b74-2663-4a8f-a772-bef84c3f6a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:56.705715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b6b74-2663-4a8f-a772-bef84c3f6a32 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:56.710746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24405186-78bf-4fbe-9186-18b11f4f6978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:56.711432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24405186-78bf-4fbe-9186-18b11f4f6978 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:56.712198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24405186-78bf-4fbe-9186-18b11f4f6978 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:56.712489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24405186-78bf-4fbe-9186-18b11f4f6978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:56.722129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24405186-78bf-4fbe-9186-18b11f4f6978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:56.724522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24405186-78bf-4fbe-9186-18b11f4f6978 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:56.734379 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3771/7474] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:39:56.794966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9b5bd-08e4-4a2d-a6e9-7767e5ee8f85 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:56.798577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9fa9b5bd-08e4-4a2d-a6e9-7767e5ee8f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:56.907146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9b5bd-08e4-4a2d-a6e9-7767e5ee8f85 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:56.913717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fca84-fdc3-47b9-87bc-ebe4f75e4878 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:56.914378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fca84-fdc3-47b9-87bc-ebe4f75e4878 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:56.914666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fca84-fdc3-47b9-87bc-ebe4f75e4878 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:56.914948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fca84-fdc3-47b9-87bc-ebe4f75e4878 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:56.917157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-742fca84-fdc3-47b9-87bc-ebe4f75e4878 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:56.947132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:56.984137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742fca84-fdc3-47b9-87bc-ebe4f75e4878 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:56.986156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742fca84-fdc3-47b9-87bc-ebe4f75e4878 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:56.999608 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3704/7475] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:39:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:39:57.808505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24405186-78bf-4fbe-9186-18b11f4f6978 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:57.809985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-24405186-78bf-4fbe-9186-18b11f4f6978 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:57.839700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24405186-78bf-4fbe-9186-18b11f4f6978 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:57.847152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c3e9e-7ab0-40b1-b517-4c442c730f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:57.849058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c3e9e-7ab0-40b1-b517-4c442c730f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:57.849717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c3e9e-7ab0-40b1-b517-4c442c730f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:57.850299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c3e9e-7ab0-40b1-b517-4c442c730f22 admin admin] PATH_INFO: `/v3/projects/90a8665639fc40dbb6f9292e99c8d70c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:57.871042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c3e9e-7ab0-40b1-b517-4c442c730f22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a8665639fc40dbb6f9292e99c8d70c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:57.873081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c3e9e-7ab0-40b1-b517-4c442c730f22 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:58.012640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-482c3e9e-7ab0-40b1-b517-4c442c730f22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a8665639fc40dbb6f9292e99c8d70c', 'request_id': 'req-482c3e9e-7ab0-40b1-b517-4c442c730f22'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:58.020946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-482c3e9e-7ab0-40b1-b517-4c442c730f22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a8665639fc40dbb6f9292e99c8d70c', 'request_id': 'req-482c3e9e-7ab0-40b1-b517-4c442c730f22'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:58.029549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-482c3e9e-7ab0-40b1-b517-4c442c730f22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a8665639fc40dbb6f9292e99c8d70c', 'request_id': 'req-482c3e9e-7ab0-40b1-b517-4c442c730f22'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:58.107507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-482c3e9e-7ab0-40b1-b517-4c442c730f22 admin admin] The token cache is being invalidate because project 90a8665639fc40dbb6f9292e99c8d70c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:39:58.107796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-482c3e9e-7ab0-40b1-b517-4c442c730f22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:58.108489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-482c3e9e-7ab0-40b1-b517-4c442c730f22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:58.110071 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3772/7476] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:39:57 2022] DELETE /identity/v3/projects/90a8665639fc40dbb6f9292e99c8d70c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:39:58.115826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dd20c-3060-4eee-b304-d8141ee97f0c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:58.116323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dd20c-3060-4eee-b304-d8141ee97f0c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:58.116437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dd20c-3060-4eee-b304-d8141ee97f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:58.135215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-491dd20c-3060-4eee-b304-d8141ee97f0c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:39:58.140891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-491dd20c-3060-4eee-b304-d8141ee97f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:58.203220 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3705/7477] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:39:58.211262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7bd01-552f-4fc0-8d3b-8b7f31b86335 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:58.211645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7bd01-552f-4fc0-8d3b-8b7f31b86335 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:58.211982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7bd01-552f-4fc0-8d3b-8b7f31b86335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:58.232459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9df7bd01-552f-4fc0-8d3b-8b7f31b86335 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:39:58.233677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9df7bd01-552f-4fc0-8d3b-8b7f31b86335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:58.242907 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3773/7478] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:39:58.247267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dd20c-3060-4eee-b304-d8141ee97f0c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:58.258787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dd20c-3060-4eee-b304-d8141ee97f0c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:58.264783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6433c-377d-418e-8028-33f354b9c4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:58.265458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6433c-377d-418e-8028-33f354b9c4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:58.265742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6433c-377d-418e-8028-33f354b9c4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:58.266018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6433c-377d-418e-8028-33f354b9c4e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:58.266749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6433c-377d-418e-8028-33f354b9c4e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:39:58.267083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6433c-377d-418e-8028-33f354b9c4e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:58.268690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6433c-377d-418e-8028-33f354b9c4e2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:58.280922 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3706/7479] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:39:58.289851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7bd01-552f-4fc0-8d3b-8b7f31b86335 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:58.299239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7bd01-552f-4fc0-8d3b-8b7f31b86335 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:58.304514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70120c65-8bcc-47e8-8222-c1c496ad8f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:58.305333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70120c65-8bcc-47e8-8222-c1c496ad8f62 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:58.305754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70120c65-8bcc-47e8-8222-c1c496ad8f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:58.305916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70120c65-8bcc-47e8-8222-c1c496ad8f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:58.306617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70120c65-8bcc-47e8-8222-c1c496ad8f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:58.308584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70120c65-8bcc-47e8-8222-c1c496ad8f62 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:58.440176 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3774/7480] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:39:58 2022] POST /identity/v3/projects => generated 369 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:39:58.444299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6433c-377d-418e-8028-33f354b9c4e2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:58.454430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6433c-377d-418e-8028-33f354b9c4e2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:58.511222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44271671-89a6-4e32-9a1f-77dabf96ace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:58.511812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44271671-89a6-4e32-9a1f-77dabf96ace7 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:58.512095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44271671-89a6-4e32-9a1f-77dabf96ace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:58.512364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44271671-89a6-4e32-9a1f-77dabf96ace7 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:58.513034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44271671-89a6-4e32-9a1f-77dabf96ace7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:58.514931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44271671-89a6-4e32-9a1f-77dabf96ace7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:58.608663 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3707/7481] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:39:58 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:39:58.610284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70120c65-8bcc-47e8-8222-c1c496ad8f62 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:58.621946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70120c65-8bcc-47e8-8222-c1c496ad8f62 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:58.627580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696d313-af73-4dcf-b0ca-85ae1e065558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:58.628240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696d313-af73-4dcf-b0ca-85ae1e065558 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:58.628522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696d313-af73-4dcf-b0ca-85ae1e065558 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:58.628915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696d313-af73-4dcf-b0ca-85ae1e065558 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:58.629656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696d313-af73-4dcf-b0ca-85ae1e065558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:58.631334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696d313-af73-4dcf-b0ca-85ae1e065558 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:58.643522 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3775/7482] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:39:58.647686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44271671-89a6-4e32-9a1f-77dabf96ace7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:58.658205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44271671-89a6-4e32-9a1f-77dabf96ace7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:58.663782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d6c86-6d84-4652-865b-faa0e7fca5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:58.664446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d6c86-6d84-4652-865b-faa0e7fca5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:58.664730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d6c86-6d84-4652-865b-faa0e7fca5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:58.665007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d6c86-6d84-4652-865b-faa0e7fca5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:58.665761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d6c86-6d84-4652-865b-faa0e7fca5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:58.667418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d6c86-6d84-4652-865b-faa0e7fca5a9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:58.681707 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3708/7483] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:39:58.682659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696d313-af73-4dcf-b0ca-85ae1e065558 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:58.693044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696d313-af73-4dcf-b0ca-85ae1e065558 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:58.699661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cb95a-fc89-4a38-a77a-e2b1d97dcfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:58.700567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cb95a-fc89-4a38-a77a-e2b1d97dcfc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:58.700847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cb95a-fc89-4a38-a77a-e2b1d97dcfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:58.701565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cb95a-fc89-4a38-a77a-e2b1d97dcfc9 admin admin] PATH_INFO: `/v3/projects/61b5a663eab945588ccaa9427c2c83a3/users/6638a0da59f543709a702e99f1403bad/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:58.704061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:58.717288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cb95a-fc89-4a38-a77a-e2b1d97dcfc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b5a663eab945588ccaa9427c2c83a3, user_id=6638a0da59f543709a702e99f1403bad, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:58.720141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cb95a-fc89-4a38-a77a-e2b1d97dcfc9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:58.805711 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3776/7484] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:39:58 2022] PUT /identity/v3/projects/61b5a663eab945588ccaa9427c2c83a3/users/6638a0da59f543709a702e99f1403bad/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:39:58.817239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2a1ac-14ad-4e08-966e-a6d0f27c8e66 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:58.817541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2a1ac-14ad-4e08-966e-a6d0f27c8e66 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:58.817817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2a1ac-14ad-4e08-966e-a6d0f27c8e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:58.858116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-75b2a1ac-14ad-4e08-966e-a6d0f27c8e66 None None] MFA Rules not processed for user `6638a0da59f543709a702e99f1403bad`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:39:58.859388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-75b2a1ac-14ad-4e08-966e-a6d0f27c8e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:58.897334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:58.970927 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3709/7485] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:39:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:39:58.997801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cb95a-fc89-4a38-a77a-e2b1d97dcfc9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:59.006970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ef8cb95a-fc89-4a38-a77a-e2b1d97dcfc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:59.091394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cb95a-fc89-4a38-a77a-e2b1d97dcfc9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:59.096657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f6750-295f-4eb7-acd7-7e9f276e80e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:59.097320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f6750-295f-4eb7-acd7-7e9f276e80e0 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:59.097634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f6750-295f-4eb7-acd7-7e9f276e80e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:59.097906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f6750-295f-4eb7-acd7-7e9f276e80e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:59.108895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f6750-295f-4eb7-acd7-7e9f276e80e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:59.110343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f6750-295f-4eb7-acd7-7e9f276e80e0 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:59.121318 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3777/7486] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:39:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:39:59.144094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2a1ac-14ad-4e08-966e-a6d0f27c8e66 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:59.220291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2a1ac-14ad-4e08-966e-a6d0f27c8e66 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:59.226158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753b70f-91d2-4b61-9215-9567803f82fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:59.226654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753b70f-91d2-4b61-9215-9567803f82fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:59.227001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753b70f-91d2-4b61-9215-9567803f82fd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:59.227373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753b70f-91d2-4b61-9215-9567803f82fd admin admin] PATH_INFO: `/v3/users/6638a0da59f543709a702e99f1403bad` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:59.228660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753b70f-91d2-4b61-9215-9567803f82fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6638a0da59f543709a702e99f1403bad)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:59.230677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753b70f-91d2-4b61-9215-9567803f82fd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:59.464233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0753b70f-91d2-4b61-9215-9567803f82fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6638a0da59f543709a702e99f1403bad'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:59.478646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0753b70f-91d2-4b61-9215-9567803f82fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6638a0da59f543709a702e99f1403bad'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:59.546936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0753b70f-91d2-4b61-9215-9567803f82fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6638a0da59f543709a702e99f1403bad'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:59.564711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0753b70f-91d2-4b61-9215-9567803f82fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6638a0da59f543709a702e99f1403bad'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:59.565460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0753b70f-91d2-4b61-9215-9567803f82fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6638a0da59f543709a702e99f1403bad'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:39:59.571998 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3710/7487] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:39:59 2022] DELETE /identity/v3/users/6638a0da59f543709a702e99f1403bad => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:39:59.576848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1b37c-42ce-4983-abaa-d46f4d0697ae None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:59.576999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1b37c-42ce-4983-abaa-d46f4d0697ae None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:59.577287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1b37c-42ce-4983-abaa-d46f4d0697ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:59.596093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-36b1b37c-42ce-4983-abaa-d46f4d0697ae None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:39:59.597364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-36b1b37c-42ce-4983-abaa-d46f4d0697ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:59.669260 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3778/7488] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:39:59.679251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753b70f-91d2-4b61-9215-9567803f82fd admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:39:59.680973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0753b70f-91d2-4b61-9215-9567803f82fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:39:59.740472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:39:59.757183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753b70f-91d2-4b61-9215-9567803f82fd admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:39:59.761665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90fd51-5a71-48ed-9e2c-43c8e97123ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:39:59.762664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90fd51-5a71-48ed-9e2c-43c8e97123ad service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:39:59.762664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90fd51-5a71-48ed-9e2c-43c8e97123ad service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:39:59.762912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90fd51-5a71-48ed-9e2c-43c8e97123ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:39:59.776124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90fd51-5a71-48ed-9e2c-43c8e97123ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:39:59.777683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90fd51-5a71-48ed-9e2c-43c8e97123ad service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:39:59.790696 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3711/7489] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:40:00.280475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1b37c-42ce-4983-abaa-d46f4d0697ae None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:00.282160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-36b1b37c-42ce-4983-abaa-d46f4d0697ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:00.296829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1b37c-42ce-4983-abaa-d46f4d0697ae None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:00.314638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd17f1-52d2-482b-9e6d-836e6a478406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:00.314638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd17f1-52d2-482b-9e6d-836e6a478406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:00.314638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd17f1-52d2-482b-9e6d-836e6a478406 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:00.314638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd17f1-52d2-482b-9e6d-836e6a478406 admin admin] PATH_INFO: `/v3/projects/61b5a663eab945588ccaa9427c2c83a3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:00.315574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd17f1-52d2-482b-9e6d-836e6a478406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61b5a663eab945588ccaa9427c2c83a3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:00.315574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd17f1-52d2-482b-9e6d-836e6a478406 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:00.435545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-61cd17f1-52d2-482b-9e6d-836e6a478406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61b5a663eab945588ccaa9427c2c83a3', 'request_id': 'req-61cd17f1-52d2-482b-9e6d-836e6a478406'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:00.442861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-61cd17f1-52d2-482b-9e6d-836e6a478406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61b5a663eab945588ccaa9427c2c83a3', 'request_id': 'req-61cd17f1-52d2-482b-9e6d-836e6a478406'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:00.448866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-61cd17f1-52d2-482b-9e6d-836e6a478406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61b5a663eab945588ccaa9427c2c83a3', 'request_id': 'req-61cd17f1-52d2-482b-9e6d-836e6a478406'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:00.588800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-61cd17f1-52d2-482b-9e6d-836e6a478406 admin admin] The token cache is being invalidate because project 61b5a663eab945588ccaa9427c2c83a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:40:00.590457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-61cd17f1-52d2-482b-9e6d-836e6a478406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:00.590457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-61cd17f1-52d2-482b-9e6d-836e6a478406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:00.591924 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3779/7490] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:40:00 2022] DELETE /identity/v3/projects/61b5a663eab945588ccaa9427c2c83a3 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:40:00.596672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dde36-4892-4370-bc95-19ee62bbf5a9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:00.597179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dde36-4892-4370-bc95-19ee62bbf5a9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:00.597493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dde36-4892-4370-bc95-19ee62bbf5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:00.617064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-609dde36-4892-4370-bc95-19ee62bbf5a9 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:40:00.618273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-609dde36-4892-4370-bc95-19ee62bbf5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:00.683414 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3712/7491] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:40:00.690812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f3d62-f626-4353-abfc-6f10d260a766 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:00.691196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f3d62-f626-4353-abfc-6f10d260a766 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:00.691496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f3d62-f626-4353-abfc-6f10d260a766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:00.712630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-303f3d62-f626-4353-abfc-6f10d260a766 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:40:00.713879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-303f3d62-f626-4353-abfc-6f10d260a766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:00.724046 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3780/7492] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:40:00.728255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dde36-4892-4370-bc95-19ee62bbf5a9 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:00.744310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dde36-4892-4370-bc95-19ee62bbf5a9 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:00.750739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408d4af-1234-41fa-97cf-1cadf98f7610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:00.751999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408d4af-1234-41fa-97cf-1cadf98f7610 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:00.751999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408d4af-1234-41fa-97cf-1cadf98f7610 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:00.752201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408d4af-1234-41fa-97cf-1cadf98f7610 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:00.752948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408d4af-1234-41fa-97cf-1cadf98f7610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:40:00.753260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408d4af-1234-41fa-97cf-1cadf98f7610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:00.755213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408d4af-1234-41fa-97cf-1cadf98f7610 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:00.770799 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3713/7493] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:40:00.771801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f3d62-f626-4353-abfc-6f10d260a766 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:00.776458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:00.781947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f3d62-f626-4353-abfc-6f10d260a766 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:00.787666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24546bec-1360-4ba1-ba33-44bf53ed8298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:00.788432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24546bec-1360-4ba1-ba33-44bf53ed8298 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:00.788715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24546bec-1360-4ba1-ba33-44bf53ed8298 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:00.788991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24546bec-1360-4ba1-ba33-44bf53ed8298 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:00.789672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24546bec-1360-4ba1-ba33-44bf53ed8298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:00.791630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24546bec-1360-4ba1-ba33-44bf53ed8298 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:00.850320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408d4af-1234-41fa-97cf-1cadf98f7610 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:00.852142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8408d4af-1234-41fa-97cf-1cadf98f7610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:00.891374 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3781/7494] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:40:00 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:40:00.896225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24546bec-1360-4ba1-ba33-44bf53ed8298 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:00.940948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408d4af-1234-41fa-97cf-1cadf98f7610 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:00.985039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24546bec-1360-4ba1-ba33-44bf53ed8298 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:00.992074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce1ce1-37da-4c0a-88d1-81be631522e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:00.992882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce1ce1-37da-4c0a-88d1-81be631522e0 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:00.993248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce1ce1-37da-4c0a-88d1-81be631522e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:00.993588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce1ce1-37da-4c0a-88d1-81be631522e0 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:00.994714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce1ce1-37da-4c0a-88d1-81be631522e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:00.996552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce1ce1-37da-4c0a-88d1-81be631522e0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:01.023658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4f655-2e86-436e-bf10-1dad6fcc71c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:01.024320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4f655-2e86-436e-bf10-1dad6fcc71c8 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:01.024603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4f655-2e86-436e-bf10-1dad6fcc71c8 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:01.024887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4f655-2e86-436e-bf10-1dad6fcc71c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:01.026763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3ba4f655-2e86-436e-bf10-1dad6fcc71c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:01.037489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:01.043588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4f655-2e86-436e-bf10-1dad6fcc71c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:01.045538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4f655-2e86-436e-bf10-1dad6fcc71c8 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:01.062024 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3714/7495] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:40:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:40:01.168324 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3782/7496] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:40:00 2022] POST /identity/v3/users => generated 288 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:40:01.169755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4f655-2e86-436e-bf10-1dad6fcc71c8 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:01.181158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4f655-2e86-436e-bf10-1dad6fcc71c8 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:01.185957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c6fe3-60ab-4474-86c4-f42bd20b341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:01.186617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c6fe3-60ab-4474-86c4-f42bd20b341e admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:01.186905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c6fe3-60ab-4474-86c4-f42bd20b341e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:01.187228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c6fe3-60ab-4474-86c4-f42bd20b341e admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:01.187951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c6fe3-60ab-4474-86c4-f42bd20b341e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:01.189543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c6fe3-60ab-4474-86c4-f42bd20b341e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:01.200294 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3715/7497] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:40:01.204314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce1ce1-37da-4c0a-88d1-81be631522e0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:01.215161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce1ce1-37da-4c0a-88d1-81be631522e0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:01.219855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec25cc1-48a7-4f87-b960-8b76b7f3fa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:01.220505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec25cc1-48a7-4f87-b960-8b76b7f3fa53 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:01.220793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec25cc1-48a7-4f87-b960-8b76b7f3fa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:01.221083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec25cc1-48a7-4f87-b960-8b76b7f3fa53 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:01.221803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec25cc1-48a7-4f87-b960-8b76b7f3fa53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:01.223464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec25cc1-48a7-4f87-b960-8b76b7f3fa53 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:01.233881 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3783/7498] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:40:01.237918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c6fe3-60ab-4474-86c4-f42bd20b341e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:01.248657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c6fe3-60ab-4474-86c4-f42bd20b341e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:01.253784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5da004-3150-4fdf-840a-a89223b47fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:01.254727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5da004-3150-4fdf-840a-a89223b47fea admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:01.255698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5da004-3150-4fdf-840a-a89223b47fea admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:01.255977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5da004-3150-4fdf-840a-a89223b47fea admin admin] PATH_INFO: `/v3/projects/e042314a2f074bdf983537ed7c669463/users/e17d71be37154033ae1e0a8d8db8606e/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:01.271228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5da004-3150-4fdf-840a-a89223b47fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e042314a2f074bdf983537ed7c669463, user_id=e17d71be37154033ae1e0a8d8db8606e, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:01.277148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5da004-3150-4fdf-840a-a89223b47fea admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:01.363543 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3716/7499] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:40:01 2022] PUT /identity/v3/projects/e042314a2f074bdf983537ed7c669463/users/e17d71be37154033ae1e0a8d8db8606e/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:40:01.374101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675cf81-7179-4c91-8e30-b73a778e4b3f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:01.374943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675cf81-7179-4c91-8e30-b73a778e4b3f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:01.375458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675cf81-7179-4c91-8e30-b73a778e4b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:01.410103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6675cf81-7179-4c91-8e30-b73a778e4b3f None None] MFA Rules not processed for user `e17d71be37154033ae1e0a8d8db8606e`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:40:01.411960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6675cf81-7179-4c91-8e30-b73a778e4b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:01.480566 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3784/7500] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:40:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:40:01.493720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5da004-3150-4fdf-840a-a89223b47fea admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:01.498096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fb5da004-3150-4fdf-840a-a89223b47fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:01.560881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5da004-3150-4fdf-840a-a89223b47fea admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:01.564755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4de203-1f85-443d-8f27-cc009053d81a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:01.569175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4de203-1f85-443d-8f27-cc009053d81a service glance] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:01.569175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4de203-1f85-443d-8f27-cc009053d81a service glance] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:01.569175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4de203-1f85-443d-8f27-cc009053d81a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:01.574782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4de203-1f85-443d-8f27-cc009053d81a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:01.576263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4de203-1f85-443d-8f27-cc009053d81a service glance] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:01.587771 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3717/7501] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:40:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:40:07.600848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded52cc4-24ad-44c3-a700-6ccf10a23068 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:07.605019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded52cc4-24ad-44c3-a700-6ccf10a23068 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:07.605019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded52cc4-24ad-44c3-a700-6ccf10a23068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:07.654076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ded52cc4-24ad-44c3-a700-6ccf10a23068 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:40:07.655400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ded52cc4-24ad-44c3-a700-6ccf10a23068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:07.676260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:07.716128 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3785/7502] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:40:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:40:07.873714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4de203-1f85-443d-8f27-cc009053d81a service glance] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:07.875487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6a4de203-1f85-443d-8f27-cc009053d81a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:07.964047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4de203-1f85-443d-8f27-cc009053d81a service glance] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:07.969043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5caff-2152-40c3-a33b-b53eef8ce8cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:07.969682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5caff-2152-40c3-a33b-b53eef8ce8cc service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:07.969964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5caff-2152-40c3-a33b-b53eef8ce8cc service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:07.970236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5caff-2152-40c3-a33b-b53eef8ce8cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:07.979168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5caff-2152-40c3-a33b-b53eef8ce8cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:07.983500 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5caff-2152-40c3-a33b-b53eef8ce8cc service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:07.993179 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3718/7503] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:40:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:40:09.405157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c19533-35fa-487d-ad9c-508bf10439cc None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:09.405683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c19533-35fa-487d-ad9c-508bf10439cc None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:09.405791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c19533-35fa-487d-ad9c-508bf10439cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:09.424259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-63c19533-35fa-487d-ad9c-508bf10439cc None None] MFA Rules not processed for user `62209b9802ab46c3b3d094d4d1ad86fe`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:40:09.425468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-63c19533-35fa-487d-ad9c-508bf10439cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:09.487504 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3786/7504] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:40:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:40:17.727789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5caff-2152-40c3-a33b-b53eef8ce8cc service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:17.778686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:17.796575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5caff-2152-40c3-a33b-b53eef8ce8cc service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:17.802196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d56e7-0143-46c3-8b7b-7cc7c62ca777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:17.803120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d56e7-0143-46c3-8b7b-7cc7c62ca777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:17.803402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d56e7-0143-46c3-8b7b-7cc7c62ca777 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:17.803680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d56e7-0143-46c3-8b7b-7cc7c62ca777 admin admin] PATH_INFO: `/v3/users/e17d71be37154033ae1e0a8d8db8606e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:17.804861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d56e7-0143-46c3-8b7b-7cc7c62ca777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e17d71be37154033ae1e0a8d8db8606e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:17.806766 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d56e7-0143-46c3-8b7b-7cc7c62ca777 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:18.048890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2e8d56e7-0143-46c3-8b7b-7cc7c62ca777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e17d71be37154033ae1e0a8d8db8606e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:18.066200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2e8d56e7-0143-46c3-8b7b-7cc7c62ca777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e17d71be37154033ae1e0a8d8db8606e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:18.118521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2e8d56e7-0143-46c3-8b7b-7cc7c62ca777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e17d71be37154033ae1e0a8d8db8606e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:18.126466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2e8d56e7-0143-46c3-8b7b-7cc7c62ca777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e17d71be37154033ae1e0a8d8db8606e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:18.127210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2e8d56e7-0143-46c3-8b7b-7cc7c62ca777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e17d71be37154033ae1e0a8d8db8606e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:18.133288 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3719/7505] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:40:17 2022] DELETE /identity/v3/users/e17d71be37154033ae1e0a8d8db8606e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:40:18.138096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd492c-9d2e-4cfb-9b08-0451b230d41a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:18.138566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd492c-9d2e-4cfb-9b08-0451b230d41a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:18.138813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd492c-9d2e-4cfb-9b08-0451b230d41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:18.158771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ecfd492c-9d2e-4cfb-9b08-0451b230d41a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:40:18.160919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ecfd492c-9d2e-4cfb-9b08-0451b230d41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:18.229387 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3787/7506] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:40:18.240042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d56e7-0143-46c3-8b7b-7cc7c62ca777 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:18.241805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2e8d56e7-0143-46c3-8b7b-7cc7c62ca777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:18.305616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d56e7-0143-46c3-8b7b-7cc7c62ca777 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:18.309382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1d82e-fb4f-423c-8f10-74af8b40aacf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:18.310145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1d82e-fb4f-423c-8f10-74af8b40aacf service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:18.310426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1d82e-fb4f-423c-8f10-74af8b40aacf service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:18.310702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1d82e-fb4f-423c-8f10-74af8b40aacf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:18.320671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1d82e-fb4f-423c-8f10-74af8b40aacf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:18.322302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1d82e-fb4f-423c-8f10-74af8b40aacf service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:18.332625 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3720/7507] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:40:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:40:18.772035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd492c-9d2e-4cfb-9b08-0451b230d41a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:18.773870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ecfd492c-9d2e-4cfb-9b08-0451b230d41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:18.786102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd492c-9d2e-4cfb-9b08-0451b230d41a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:18.790829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ff3b7-99bb-41e8-9536-601d76e46a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:18.791730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ff3b7-99bb-41e8-9536-601d76e46a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:18.792019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ff3b7-99bb-41e8-9536-601d76e46a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:18.792298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ff3b7-99bb-41e8-9536-601d76e46a15 admin admin] PATH_INFO: `/v3/projects/e042314a2f074bdf983537ed7c669463` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:18.793488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ff3b7-99bb-41e8-9536-601d76e46a15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e042314a2f074bdf983537ed7c669463)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:18.795486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ff3b7-99bb-41e8-9536-601d76e46a15 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:18.878850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-943ff3b7-99bb-41e8-9536-601d76e46a15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e042314a2f074bdf983537ed7c669463', 'request_id': 'req-943ff3b7-99bb-41e8-9536-601d76e46a15'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:18.885264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-943ff3b7-99bb-41e8-9536-601d76e46a15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e042314a2f074bdf983537ed7c669463', 'request_id': 'req-943ff3b7-99bb-41e8-9536-601d76e46a15'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:18.890779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-943ff3b7-99bb-41e8-9536-601d76e46a15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e042314a2f074bdf983537ed7c669463', 'request_id': 'req-943ff3b7-99bb-41e8-9536-601d76e46a15'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:18.941925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:18.946635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-943ff3b7-99bb-41e8-9536-601d76e46a15 admin admin] The token cache is being invalidate because project e042314a2f074bdf983537ed7c669463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:40:18.946955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-943ff3b7-99bb-41e8-9536-601d76e46a15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:18.949133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-943ff3b7-99bb-41e8-9536-601d76e46a15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:18.956860 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3788/7508] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:40:18 2022] DELETE /identity/v3/projects/e042314a2f074bdf983537ed7c669463 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:40:18.956958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbb4f1-a801-42db-871c-dfd8cfb9d2ae None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:18.956958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbb4f1-a801-42db-871c-dfd8cfb9d2ae None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:18.957443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbb4f1-a801-42db-871c-dfd8cfb9d2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:18.977167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-80fbb4f1-a801-42db-871c-dfd8cfb9d2ae None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:40:18.988070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-80fbb4f1-a801-42db-871c-dfd8cfb9d2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:19.041720 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3721/7509] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:40:19.141192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e7ecc-f32a-438a-9d32-3c9b59a51797 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:19.141718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e7ecc-f32a-438a-9d32-3c9b59a51797 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:19.141718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e7ecc-f32a-438a-9d32-3c9b59a51797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:19.160221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2e4e7ecc-f32a-438a-9d32-3c9b59a51797 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:40:19.162168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2e4e7ecc-f32a-438a-9d32-3c9b59a51797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:19.169962 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3789/7510] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:40:19.174860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbb4f1-a801-42db-871c-dfd8cfb9d2ae None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:19.181106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:19.184852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbb4f1-a801-42db-871c-dfd8cfb9d2ae None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:19.190972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325a535-ed19-4e50-b145-a8c154beff84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:19.191664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325a535-ed19-4e50-b145-a8c154beff84 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:19.191946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325a535-ed19-4e50-b145-a8c154beff84 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:19.192224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325a535-ed19-4e50-b145-a8c154beff84 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:19.192951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325a535-ed19-4e50-b145-a8c154beff84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:40:19.193365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325a535-ed19-4e50-b145-a8c154beff84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:19.194837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325a535-ed19-4e50-b145-a8c154beff84 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:19.207405 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3722/7511] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:40:19.211752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e7ecc-f32a-438a-9d32-3c9b59a51797 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:19.222389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e7ecc-f32a-438a-9d32-3c9b59a51797 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:19.227432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14981c2-9dfa-4b46-97ba-3db64103c635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:19.228116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14981c2-9dfa-4b46-97ba-3db64103c635 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:19.228400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14981c2-9dfa-4b46-97ba-3db64103c635 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:19.228672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14981c2-9dfa-4b46-97ba-3db64103c635 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:19.229358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14981c2-9dfa-4b46-97ba-3db64103c635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:19.231708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14981c2-9dfa-4b46-97ba-3db64103c635 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:19.354282 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3790/7512] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:40:19 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:40:19.360830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325a535-ed19-4e50-b145-a8c154beff84 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:19.371297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325a535-ed19-4e50-b145-a8c154beff84 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:19.429193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c317d-0724-408a-9303-705060274940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:19.429782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c317d-0724-408a-9303-705060274940 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:19.430065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c317d-0724-408a-9303-705060274940 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:19.430343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c317d-0724-408a-9303-705060274940 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:19.431040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c317d-0724-408a-9303-705060274940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:19.432998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c317d-0724-408a-9303-705060274940 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:19.575925 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3723/7513] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:40:19 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:40:19.580471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14981c2-9dfa-4b46-97ba-3db64103c635 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:19.591379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14981c2-9dfa-4b46-97ba-3db64103c635 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:19.597809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083a427-3f68-46ed-83d3-03c17d72d05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:19.598543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083a427-3f68-46ed-83d3-03c17d72d05d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:19.598908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083a427-3f68-46ed-83d3-03c17d72d05d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:19.599236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083a427-3f68-46ed-83d3-03c17d72d05d admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:19.599970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083a427-3f68-46ed-83d3-03c17d72d05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:19.601570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083a427-3f68-46ed-83d3-03c17d72d05d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:19.613759 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3791/7514] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:40:19.617567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c317d-0724-408a-9303-705060274940 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:19.630930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c317d-0724-408a-9303-705060274940 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:19.635985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ecec1-5c83-45a7-8eac-fec2ccba5190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:19.636798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ecec1-5c83-45a7-8eac-fec2ccba5190 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:19.637086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ecec1-5c83-45a7-8eac-fec2ccba5190 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:19.637386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ecec1-5c83-45a7-8eac-fec2ccba5190 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:19.638084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ecec1-5c83-45a7-8eac-fec2ccba5190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:19.639734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ecec1-5c83-45a7-8eac-fec2ccba5190 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:19.655623 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3724/7515] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:40:19.657295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083a427-3f68-46ed-83d3-03c17d72d05d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:19.669133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083a427-3f68-46ed-83d3-03c17d72d05d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:19.675484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0236046-ac8c-442c-a726-c0c24b52c5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:19.676932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0236046-ac8c-442c-a726-c0c24b52c5ac admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:19.677246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0236046-ac8c-442c-a726-c0c24b52c5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:19.677521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0236046-ac8c-442c-a726-c0c24b52c5ac admin admin] PATH_INFO: `/v3/projects/b9bfdc91cc1b4319919e992561ef136e/users/054fa96e163d4cb0b04b343cff0645ad/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:19.695178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0236046-ac8c-442c-a726-c0c24b52c5ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9bfdc91cc1b4319919e992561ef136e, user_id=054fa96e163d4cb0b04b343cff0645ad, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:19.700667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0236046-ac8c-442c-a726-c0c24b52c5ac admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:19.775758 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3792/7516] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:40:19 2022] PUT /identity/v3/projects/b9bfdc91cc1b4319919e992561ef136e/users/054fa96e163d4cb0b04b343cff0645ad/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:40:19.786554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a421be-fa2e-45eb-ad1f-983b28dae23b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:19.786904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a421be-fa2e-45eb-ad1f-983b28dae23b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:19.787175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a421be-fa2e-45eb-ad1f-983b28dae23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:19.818748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-87a421be-fa2e-45eb-ad1f-983b28dae23b None None] MFA Rules not processed for user `054fa96e163d4cb0b04b343cff0645ad`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:40:19.828028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-87a421be-fa2e-45eb-ad1f-983b28dae23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:19.903601 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3725/7517] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:40:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:40:19.908711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0236046-ac8c-442c-a726-c0c24b52c5ac admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:19.974208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0236046-ac8c-442c-a726-c0c24b52c5ac admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:19.979127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645ecfd-017b-4c6d-9e6f-a87c2b87701d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:19.979810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645ecfd-017b-4c6d-9e6f-a87c2b87701d admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:19.980103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645ecfd-017b-4c6d-9e6f-a87c2b87701d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:19.980374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645ecfd-017b-4c6d-9e6f-a87c2b87701d admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:19.981072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645ecfd-017b-4c6d-9e6f-a87c2b87701d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:19.983976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645ecfd-017b-4c6d-9e6f-a87c2b87701d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:20.050654 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3793/7518] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:40:19 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:40:20.054804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a421be-fa2e-45eb-ad1f-983b28dae23b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:20.066059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a421be-fa2e-45eb-ad1f-983b28dae23b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:20.127516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89256483-00cc-4998-babb-7ac4763d270d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:20.128231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89256483-00cc-4998-babb-7ac4763d270d admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:20.128514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89256483-00cc-4998-babb-7ac4763d270d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:20.128787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89256483-00cc-4998-babb-7ac4763d270d admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:20.129483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89256483-00cc-4998-babb-7ac4763d270d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:20.131458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89256483-00cc-4998-babb-7ac4763d270d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:20.138624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:20.196281 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3726/7519] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:40:20 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:40:20.197534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645ecfd-017b-4c6d-9e6f-a87c2b87701d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:20.208772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645ecfd-017b-4c6d-9e6f-a87c2b87701d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:20.213586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae6c61-2115-4246-9552-73563764e6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:20.214412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae6c61-2115-4246-9552-73563764e6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:20.214690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae6c61-2115-4246-9552-73563764e6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:20.214961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae6c61-2115-4246-9552-73563764e6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:20.215703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae6c61-2115-4246-9552-73563764e6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:20.217309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae6c61-2115-4246-9552-73563764e6c6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:20.229315 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3794/7520] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:40:20.233397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89256483-00cc-4998-babb-7ac4763d270d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:20.244363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89256483-00cc-4998-babb-7ac4763d270d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:20.250650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9bc12-40d6-4b7f-87a3-83905a224cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:20.250650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9bc12-40d6-4b7f-87a3-83905a224cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:20.250650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9bc12-40d6-4b7f-87a3-83905a224cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:20.251203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9bc12-40d6-4b7f-87a3-83905a224cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:20.251718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9bc12-40d6-4b7f-87a3-83905a224cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:20.253309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9bc12-40d6-4b7f-87a3-83905a224cf3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:20.266855 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3727/7521] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:40:20.268138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae6c61-2115-4246-9552-73563764e6c6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:20.279977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae6c61-2115-4246-9552-73563764e6c6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:20.284539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48484ac2-69fa-4de2-904e-b720305dba48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:20.285532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48484ac2-69fa-4de2-904e-b720305dba48 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:20.285880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48484ac2-69fa-4de2-904e-b720305dba48 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:20.286163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48484ac2-69fa-4de2-904e-b720305dba48 admin admin] PATH_INFO: `/v3/projects/522f3dcd0f5d429b8c50c7d4d39bea56/users/60477a836ca845e88836b95d310dc5b7/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:20.301787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48484ac2-69fa-4de2-904e-b720305dba48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=522f3dcd0f5d429b8c50c7d4d39bea56, user_id=60477a836ca845e88836b95d310dc5b7, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:20.304626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48484ac2-69fa-4de2-904e-b720305dba48 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:20.352727 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3795/7522] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:40:20 2022] PUT /identity/v3/projects/522f3dcd0f5d429b8c50c7d4d39bea56/users/60477a836ca845e88836b95d310dc5b7/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:40:20.363176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe017f-4f84-47ac-b9cb-7f90d7fd774d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:20.363474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe017f-4f84-47ac-b9cb-7f90d7fd774d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:20.363765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe017f-4f84-47ac-b9cb-7f90d7fd774d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:20.392533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5cbe017f-4f84-47ac-b9cb-7f90d7fd774d None None] MFA Rules not processed for user `60477a836ca845e88836b95d310dc5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:40:20.393794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5cbe017f-4f84-47ac-b9cb-7f90d7fd774d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:20.461368 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3728/7523] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:40:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:40:20.466009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48484ac2-69fa-4de2-904e-b720305dba48 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:20.517189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:20.533289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48484ac2-69fa-4de2-904e-b720305dba48 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:20.538078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8951c-8472-4669-a586-c049d847171f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:20.540454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8951c-8472-4669-a586-c049d847171f admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:20.540454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8951c-8472-4669-a586-c049d847171f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:20.540454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8951c-8472-4669-a586-c049d847171f admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:20.540454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8951c-8472-4669-a586-c049d847171f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:20.541882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8951c-8472-4669-a586-c049d847171f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:20.634932 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3796/7524] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:40:20 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:40:20.639295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe017f-4f84-47ac-b9cb-7f90d7fd774d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:20.651876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe017f-4f84-47ac-b9cb-7f90d7fd774d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:20.708825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2382a95-499d-40f6-be08-40dd0b8c6f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:20.709491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2382a95-499d-40f6-be08-40dd0b8c6f10 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:20.709781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2382a95-499d-40f6-be08-40dd0b8c6f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:20.710058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2382a95-499d-40f6-be08-40dd0b8c6f10 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:20.710797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2382a95-499d-40f6-be08-40dd0b8c6f10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:20.712807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2382a95-499d-40f6-be08-40dd0b8c6f10 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:20.810896 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3729/7525] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:40:20 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:40:20.815802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8951c-8472-4669-a586-c049d847171f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:20.831784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8951c-8472-4669-a586-c049d847171f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:20.838573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61611ebb-dac1-4711-aedc-10957c724bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:20.840480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61611ebb-dac1-4711-aedc-10957c724bbc admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:20.840480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61611ebb-dac1-4711-aedc-10957c724bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:20.840480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61611ebb-dac1-4711-aedc-10957c724bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:20.840724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61611ebb-dac1-4711-aedc-10957c724bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:20.842437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61611ebb-dac1-4711-aedc-10957c724bbc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:20.855502 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3797/7526] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:40:20.860378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2382a95-499d-40f6-be08-40dd0b8c6f10 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:20.872200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2382a95-499d-40f6-be08-40dd0b8c6f10 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:20.878854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de134f-3225-4e3d-bd91-d488d9e94dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:20.879791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de134f-3225-4e3d-bd91-d488d9e94dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:20.884601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de134f-3225-4e3d-bd91-d488d9e94dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:20.884601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de134f-3225-4e3d-bd91-d488d9e94dc0 admin admin] PATH_INFO: `/v3/projects/c023e1b8aa064376978846597bbbcf55/users/90e0890775e947c5ae54048f393e657c/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:20.897659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de134f-3225-4e3d-bd91-d488d9e94dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c023e1b8aa064376978846597bbbcf55, user_id=90e0890775e947c5ae54048f393e657c, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:20.900570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de134f-3225-4e3d-bd91-d488d9e94dc0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:20.964260 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3730/7527] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:40:20 2022] PUT /identity/v3/projects/c023e1b8aa064376978846597bbbcf55/users/90e0890775e947c5ae54048f393e657c/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:40:20.968397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61611ebb-dac1-4711-aedc-10957c724bbc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:20.979771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61611ebb-dac1-4711-aedc-10957c724bbc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:21.038691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41db1f-4263-4d99-968d-4a6562310f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:21.039519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41db1f-4263-4d99-968d-4a6562310f47 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:21.040039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41db1f-4263-4d99-968d-4a6562310f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:21.040205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41db1f-4263-4d99-968d-4a6562310f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:21.040874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41db1f-4263-4d99-968d-4a6562310f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:21.042549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41db1f-4263-4d99-968d-4a6562310f47 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:21.056926 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3798/7528] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:40:21.058235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de134f-3225-4e3d-bd91-d488d9e94dc0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:21.070968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de134f-3225-4e3d-bd91-d488d9e94dc0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:21.076760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c078a2-5935-4c26-8bee-a659b0bc1d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:21.077744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c078a2-5935-4c26-8bee-a659b0bc1d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:21.078127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c078a2-5935-4c26-8bee-a659b0bc1d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:21.078714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c078a2-5935-4c26-8bee-a659b0bc1d19 admin admin] PATH_INFO: `/v3/projects/c023e1b8aa064376978846597bbbcf55/users/90e0890775e947c5ae54048f393e657c/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:21.081949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c078a2-5935-4c26-8bee-a659b0bc1d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c023e1b8aa064376978846597bbbcf55, user_id=90e0890775e947c5ae54048f393e657c, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:21.084731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c078a2-5935-4c26-8bee-a659b0bc1d19 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:21.102486 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3731/7529] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:40:21 2022] PUT /identity/v3/projects/c023e1b8aa064376978846597bbbcf55/users/90e0890775e947c5ae54048f393e657c/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:40:21.114877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30117455-c6a3-4b2d-bd40-1ec2a8d97199 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:21.115202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30117455-c6a3-4b2d-bd40-1ec2a8d97199 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:21.115678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30117455-c6a3-4b2d-bd40-1ec2a8d97199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:21.143682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-30117455-c6a3-4b2d-bd40-1ec2a8d97199 None None] MFA Rules not processed for user `90e0890775e947c5ae54048f393e657c`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:40:21.144895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-30117455-c6a3-4b2d-bd40-1ec2a8d97199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:21.218601 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3799/7530] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:40:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:40:21.230970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c078a2-5935-4c26-8bee-a659b0bc1d19 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:21.233219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c9c078a2-5935-4c26-8bee-a659b0bc1d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:21.257840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:21.294504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c078a2-5935-4c26-8bee-a659b0bc1d19 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:21.298878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0c6bb-f677-4898-b435-f8c854034744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:21.299727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0c6bb-f677-4898-b435-f8c854034744 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:21.299930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0c6bb-f677-4898-b435-f8c854034744 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:21.300323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0c6bb-f677-4898-b435-f8c854034744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:21.357452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0c6bb-f677-4898-b435-f8c854034744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:21.358881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0c6bb-f677-4898-b435-f8c854034744 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:21.369482 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3732/7531] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:40:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:40:24.366911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30117455-c6a3-4b2d-bd40-1ec2a8d97199 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:24.380076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30117455-c6a3-4b2d-bd40-1ec2a8d97199 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:24.383877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96b704-77bf-4847-90fa-3da369c18b89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:24.384528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96b704-77bf-4847-90fa-3da369c18b89 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:24.384868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96b704-77bf-4847-90fa-3da369c18b89 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:24.385200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96b704-77bf-4847-90fa-3da369c18b89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:24.428549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:24.448186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96b704-77bf-4847-90fa-3da369c18b89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:24.449693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96b704-77bf-4847-90fa-3da369c18b89 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:24.460463 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3800/7532] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:40:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:40:25.714000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0c6bb-f677-4898-b435-f8c854034744 service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:25.726513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0c6bb-f677-4898-b435-f8c854034744 service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:25.730356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ed291-a455-43e3-b27f-700c871f2a8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:25.730999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ed291-a455-43e3-b27f-700c871f2a8e service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:25.731353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ed291-a455-43e3-b27f-700c871f2a8e service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:25.731874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ed291-a455-43e3-b27f-700c871f2a8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:25.742607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ed291-a455-43e3-b27f-700c871f2a8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:25.744041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ed291-a455-43e3-b27f-700c871f2a8e service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:25.754172 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3733/7533] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:40:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:40:29.464087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96b704-77bf-4847-90fa-3da369c18b89 service cinder] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:29.465545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1c96b704-77bf-4847-90fa-3da369c18b89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:29.480098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96b704-77bf-4847-90fa-3da369c18b89 service cinder] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:29.486019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735af274-4155-4395-b71b-2ec6e770243d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:29.486019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735af274-4155-4395-b71b-2ec6e770243d service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:29.486019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735af274-4155-4395-b71b-2ec6e770243d service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:29.486330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735af274-4155-4395-b71b-2ec6e770243d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:29.488149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-735af274-4155-4395-b71b-2ec6e770243d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:29.548708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735af274-4155-4395-b71b-2ec6e770243d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:29.550227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735af274-4155-4395-b71b-2ec6e770243d service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:29.559762 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3801/7534] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:40:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:40:35.749346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=45 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:39.555271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=38 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:41.074346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ed291-a455-43e3-b27f-700c871f2a8e service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:41.178863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ed291-a455-43e3-b27f-700c871f2a8e service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:41.189134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb2831-4efe-4360-97a8-2b9284f70971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:41.190118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb2831-4efe-4360-97a8-2b9284f70971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:41.190564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb2831-4efe-4360-97a8-2b9284f70971 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:41.190791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb2831-4efe-4360-97a8-2b9284f70971 admin admin] PATH_INFO: `/v3/users/054fa96e163d4cb0b04b343cff0645ad` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:41.192183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb2831-4efe-4360-97a8-2b9284f70971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=054fa96e163d4cb0b04b343cff0645ad)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:41.194114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb2831-4efe-4360-97a8-2b9284f70971 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:41.441684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-92bb2831-4efe-4360-97a8-2b9284f70971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '054fa96e163d4cb0b04b343cff0645ad'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:41.457843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-92bb2831-4efe-4360-97a8-2b9284f70971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '054fa96e163d4cb0b04b343cff0645ad'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:41.564803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-92bb2831-4efe-4360-97a8-2b9284f70971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '054fa96e163d4cb0b04b343cff0645ad'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:41.573850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-92bb2831-4efe-4360-97a8-2b9284f70971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '054fa96e163d4cb0b04b343cff0645ad'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:41.574559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-92bb2831-4efe-4360-97a8-2b9284f70971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '054fa96e163d4cb0b04b343cff0645ad'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:41.581938 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3734/7535] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:40:41 2022] DELETE /identity/v3/users/054fa96e163d4cb0b04b343cff0645ad => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:40:41.586311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1666ee-fbfb-43d8-9ab3-d6cfa424bf15 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:41.586797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1666ee-fbfb-43d8-9ab3-d6cfa424bf15 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:41.586994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1666ee-fbfb-43d8-9ab3-d6cfa424bf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:41.604581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1e1666ee-fbfb-43d8-9ab3-d6cfa424bf15 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:40:41.605793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1e1666ee-fbfb-43d8-9ab3-d6cfa424bf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:41.667725 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3802/7536] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:40:41.678598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb2831-4efe-4360-97a8-2b9284f70971 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:41.680048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-92bb2831-4efe-4360-97a8-2b9284f70971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:41.763361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb2831-4efe-4360-97a8-2b9284f70971 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:41.767501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad47d2-41e1-4f77-b8a8-f1521934e922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:41.768161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad47d2-41e1-4f77-b8a8-f1521934e922 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:41.768474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad47d2-41e1-4f77-b8a8-f1521934e922 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:41.768777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad47d2-41e1-4f77-b8a8-f1521934e922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:41.783555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad47d2-41e1-4f77-b8a8-f1521934e922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:41.785905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad47d2-41e1-4f77-b8a8-f1521934e922 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:41.800484 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3735/7537] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:40:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:40:42.372781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1666ee-fbfb-43d8-9ab3-d6cfa424bf15 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:42.374472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1e1666ee-fbfb-43d8-9ab3-d6cfa424bf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:42.389092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1666ee-fbfb-43d8-9ab3-d6cfa424bf15 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:42.394421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5d3b9-579f-48b8-9260-1d7992b7296b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:42.395563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5d3b9-579f-48b8-9260-1d7992b7296b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:42.395848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5d3b9-579f-48b8-9260-1d7992b7296b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:42.396266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5d3b9-579f-48b8-9260-1d7992b7296b admin admin] PATH_INFO: `/v3/projects/b9bfdc91cc1b4319919e992561ef136e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:42.397429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5d3b9-579f-48b8-9260-1d7992b7296b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9bfdc91cc1b4319919e992561ef136e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:42.399390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5d3b9-579f-48b8-9260-1d7992b7296b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:42.542898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-dff5d3b9-579f-48b8-9260-1d7992b7296b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9bfdc91cc1b4319919e992561ef136e', 'request_id': 'req-dff5d3b9-579f-48b8-9260-1d7992b7296b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:42.550112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-dff5d3b9-579f-48b8-9260-1d7992b7296b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9bfdc91cc1b4319919e992561ef136e', 'request_id': 'req-dff5d3b9-579f-48b8-9260-1d7992b7296b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:42.556043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-dff5d3b9-579f-48b8-9260-1d7992b7296b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9bfdc91cc1b4319919e992561ef136e', 'request_id': 'req-dff5d3b9-579f-48b8-9260-1d7992b7296b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:42.650030 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-dff5d3b9-579f-48b8-9260-1d7992b7296b admin admin] The token cache is being invalidate because project b9bfdc91cc1b4319919e992561ef136e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:40:42.650707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-dff5d3b9-579f-48b8-9260-1d7992b7296b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:42.651183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-dff5d3b9-579f-48b8-9260-1d7992b7296b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:42.652934 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3803/7538] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:40:42 2022] DELETE /identity/v3/projects/b9bfdc91cc1b4319919e992561ef136e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:40:42.657933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad47d2-41e1-4f77-b8a8-f1521934e922 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:42.664208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:42.667897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad47d2-41e1-4f77-b8a8-f1521934e922 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:42.727811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23939a-12cc-42df-8a7a-cfb37b9e394f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:42.728899 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23939a-12cc-42df-8a7a-cfb37b9e394f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:42.729234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23939a-12cc-42df-8a7a-cfb37b9e394f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:42.729466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23939a-12cc-42df-8a7a-cfb37b9e394f admin admin] PATH_INFO: `/v3/users/60477a836ca845e88836b95d310dc5b7` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:42.730675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23939a-12cc-42df-8a7a-cfb37b9e394f admin admin] RBAC: Authorizing `identity:delete_user(user_id=60477a836ca845e88836b95d310dc5b7)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:42.732910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23939a-12cc-42df-8a7a-cfb37b9e394f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:42.954089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6d23939a-12cc-42df-8a7a-cfb37b9e394f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60477a836ca845e88836b95d310dc5b7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:42.969924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6d23939a-12cc-42df-8a7a-cfb37b9e394f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60477a836ca845e88836b95d310dc5b7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:43.049415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6d23939a-12cc-42df-8a7a-cfb37b9e394f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60477a836ca845e88836b95d310dc5b7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:43.057032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6d23939a-12cc-42df-8a7a-cfb37b9e394f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60477a836ca845e88836b95d310dc5b7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:43.057708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6d23939a-12cc-42df-8a7a-cfb37b9e394f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60477a836ca845e88836b95d310dc5b7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:43.063870 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3736/7539] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:40:42 2022] DELETE /identity/v3/users/60477a836ca845e88836b95d310dc5b7 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:40:43.594928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5d3b9-579f-48b8-9260-1d7992b7296b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:43.596215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dff5d3b9-579f-48b8-9260-1d7992b7296b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:43.611726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5d3b9-579f-48b8-9260-1d7992b7296b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:43.680314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c90be-3ad3-4293-95d8-966cd12c6fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:43.681177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c90be-3ad3-4293-95d8-966cd12c6fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:43.681459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c90be-3ad3-4293-95d8-966cd12c6fab admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:43.681735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c90be-3ad3-4293-95d8-966cd12c6fab admin admin] PATH_INFO: `/v3/projects/522f3dcd0f5d429b8c50c7d4d39bea56` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:43.683151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c90be-3ad3-4293-95d8-966cd12c6fab admin admin] RBAC: Authorizing `identity:delete_project(project_id=522f3dcd0f5d429b8c50c7d4d39bea56)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:43.685070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c90be-3ad3-4293-95d8-966cd12c6fab admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:43.805358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:43.824221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a71c90be-3ad3-4293-95d8-966cd12c6fab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '522f3dcd0f5d429b8c50c7d4d39bea56', 'request_id': 'req-a71c90be-3ad3-4293-95d8-966cd12c6fab'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:43.837670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a71c90be-3ad3-4293-95d8-966cd12c6fab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '522f3dcd0f5d429b8c50c7d4d39bea56', 'request_id': 'req-a71c90be-3ad3-4293-95d8-966cd12c6fab'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:43.844877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a71c90be-3ad3-4293-95d8-966cd12c6fab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '522f3dcd0f5d429b8c50c7d4d39bea56', 'request_id': 'req-a71c90be-3ad3-4293-95d8-966cd12c6fab'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:43.919158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a71c90be-3ad3-4293-95d8-966cd12c6fab admin admin] The token cache is being invalidate because project 522f3dcd0f5d429b8c50c7d4d39bea56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:40:43.920846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a71c90be-3ad3-4293-95d8-966cd12c6fab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:43.920846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a71c90be-3ad3-4293-95d8-966cd12c6fab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:43.921743 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3804/7540] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:40:43 2022] DELETE /identity/v3/projects/522f3dcd0f5d429b8c50c7d4d39bea56 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:40:43.925841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23939a-12cc-42df-8a7a-cfb37b9e394f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:43.927324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6d23939a-12cc-42df-8a7a-cfb37b9e394f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:43.940966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23939a-12cc-42df-8a7a-cfb37b9e394f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:43.998412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333307a6-53e3-4fcf-b28a-2fe3f51bfa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:43.999352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333307a6-53e3-4fcf-b28a-2fe3f51bfa04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:43.999640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333307a6-53e3-4fcf-b28a-2fe3f51bfa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:44.000539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333307a6-53e3-4fcf-b28a-2fe3f51bfa04 admin admin] PATH_INFO: `/v3/users/90e0890775e947c5ae54048f393e657c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:44.001919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333307a6-53e3-4fcf-b28a-2fe3f51bfa04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e0890775e947c5ae54048f393e657c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:44.003885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333307a6-53e3-4fcf-b28a-2fe3f51bfa04 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:44.108150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:44.200832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-333307a6-53e3-4fcf-b28a-2fe3f51bfa04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e0890775e947c5ae54048f393e657c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:44.213831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-333307a6-53e3-4fcf-b28a-2fe3f51bfa04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e0890775e947c5ae54048f393e657c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:44.318052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-333307a6-53e3-4fcf-b28a-2fe3f51bfa04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e0890775e947c5ae54048f393e657c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:44.325364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-333307a6-53e3-4fcf-b28a-2fe3f51bfa04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e0890775e947c5ae54048f393e657c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:44.325991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-333307a6-53e3-4fcf-b28a-2fe3f51bfa04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e0890775e947c5ae54048f393e657c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:44.332262 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3737/7541] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:40:43 2022] DELETE /identity/v3/users/90e0890775e947c5ae54048f393e657c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:40:44.994944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c90be-3ad3-4293-95d8-966cd12c6fab admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:44.996660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a71c90be-3ad3-4293-95d8-966cd12c6fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:45.011458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c90be-3ad3-4293-95d8-966cd12c6fab admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:45.080498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ee0d2-8614-436b-af3d-519db3eb6031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:45.081756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ee0d2-8614-436b-af3d-519db3eb6031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:45.082043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ee0d2-8614-436b-af3d-519db3eb6031 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:45.082318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ee0d2-8614-436b-af3d-519db3eb6031 admin admin] PATH_INFO: `/v3/projects/c023e1b8aa064376978846597bbbcf55` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:45.083560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ee0d2-8614-436b-af3d-519db3eb6031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c023e1b8aa064376978846597bbbcf55)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:45.085487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ee0d2-8614-436b-af3d-519db3eb6031 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:45.245226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b72ee0d2-8614-436b-af3d-519db3eb6031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c023e1b8aa064376978846597bbbcf55', 'request_id': 'req-b72ee0d2-8614-436b-af3d-519db3eb6031'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:45.251684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b72ee0d2-8614-436b-af3d-519db3eb6031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c023e1b8aa064376978846597bbbcf55', 'request_id': 'req-b72ee0d2-8614-436b-af3d-519db3eb6031'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:45.257326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b72ee0d2-8614-436b-af3d-519db3eb6031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c023e1b8aa064376978846597bbbcf55', 'request_id': 'req-b72ee0d2-8614-436b-af3d-519db3eb6031'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:45.346832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b72ee0d2-8614-436b-af3d-519db3eb6031 admin admin] The token cache is being invalidate because project c023e1b8aa064376978846597bbbcf55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:40:45.347267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b72ee0d2-8614-436b-af3d-519db3eb6031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:45.347935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b72ee0d2-8614-436b-af3d-519db3eb6031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:40:45.349539 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3805/7542] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:40:44 2022] DELETE /identity/v3/projects/c023e1b8aa064376978846597bbbcf55 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:40:45.354488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03029e-97db-48a3-a832-730ec0f4fd23 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:45.354959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03029e-97db-48a3-a832-730ec0f4fd23 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:45.355272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03029e-97db-48a3-a832-730ec0f4fd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:45.375047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3c03029e-97db-48a3-a832-730ec0f4fd23 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:40:45.378312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3c03029e-97db-48a3-a832-730ec0f4fd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:45.445553 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3738/7543] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:40:45.453663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adab7b3-a25f-4fc4-9aa4-366064814220 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:45.455177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adab7b3-a25f-4fc4-9aa4-366064814220 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:45.455537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adab7b3-a25f-4fc4-9aa4-366064814220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:45.475610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6adab7b3-a25f-4fc4-9aa4-366064814220 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:40:45.476965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6adab7b3-a25f-4fc4-9aa4-366064814220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:45.486525 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3806/7544] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:40:45.491558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03029e-97db-48a3-a832-730ec0f4fd23 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:45.509764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03029e-97db-48a3-a832-730ec0f4fd23 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:45.518000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ad730-c167-4824-9a2d-4caf8341fad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:45.518854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ad730-c167-4824-9a2d-4caf8341fad9 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:45.519177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ad730-c167-4824-9a2d-4caf8341fad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:45.519459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ad730-c167-4824-9a2d-4caf8341fad9 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:45.520271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ad730-c167-4824-9a2d-4caf8341fad9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:40:45.520585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ad730-c167-4824-9a2d-4caf8341fad9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:45.522253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ad730-c167-4824-9a2d-4caf8341fad9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:45.537297 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3739/7545] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:40:45.544689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adab7b3-a25f-4fc4-9aa4-366064814220 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:45.554374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adab7b3-a25f-4fc4-9aa4-366064814220 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:45.559212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a9b82-573d-48ab-86a9-e4482463a3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:45.559858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a9b82-573d-48ab-86a9-e4482463a3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:45.560142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a9b82-573d-48ab-86a9-e4482463a3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:45.560420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a9b82-573d-48ab-86a9-e4482463a3d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:45.561097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a9b82-573d-48ab-86a9-e4482463a3d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:45.563103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a9b82-573d-48ab-86a9-e4482463a3d0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:45.646437 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3807/7546] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:40:45 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:40:45.650784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ad730-c167-4824-9a2d-4caf8341fad9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:45.661398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ad730-c167-4824-9a2d-4caf8341fad9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:45.724616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e2aab-7232-4048-bf5c-73c1bafc4821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:45.726001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e2aab-7232-4048-bf5c-73c1bafc4821 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:45.726289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e2aab-7232-4048-bf5c-73c1bafc4821 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:45.726566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e2aab-7232-4048-bf5c-73c1bafc4821 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:45.727304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e2aab-7232-4048-bf5c-73c1bafc4821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:45.729340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e2aab-7232-4048-bf5c-73c1bafc4821 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:45.799953 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3740/7547] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:40:45 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:40:45.804189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a9b82-573d-48ab-86a9-e4482463a3d0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:45.815905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a9b82-573d-48ab-86a9-e4482463a3d0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:45.821028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949cd98-8ddd-44f0-9315-b52dd4de12e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:45.821723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949cd98-8ddd-44f0-9315-b52dd4de12e8 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:45.822005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949cd98-8ddd-44f0-9315-b52dd4de12e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:45.823139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949cd98-8ddd-44f0-9315-b52dd4de12e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:45.823139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949cd98-8ddd-44f0-9315-b52dd4de12e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:45.824665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949cd98-8ddd-44f0-9315-b52dd4de12e8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:45.836398 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3808/7548] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:40:45.840538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e2aab-7232-4048-bf5c-73c1bafc4821 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:45.851286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e2aab-7232-4048-bf5c-73c1bafc4821 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:45.855971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccdfe3-cb08-4431-8365-ae1aaf902f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:45.856888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccdfe3-cb08-4431-8365-ae1aaf902f41 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:45.857168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccdfe3-cb08-4431-8365-ae1aaf902f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:45.857681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccdfe3-cb08-4431-8365-ae1aaf902f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:45.858193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccdfe3-cb08-4431-8365-ae1aaf902f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:45.859891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccdfe3-cb08-4431-8365-ae1aaf902f41 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:45.871961 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3741/7549] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:40:45.877176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949cd98-8ddd-44f0-9315-b52dd4de12e8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:45.884614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:45.888321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949cd98-8ddd-44f0-9315-b52dd4de12e8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:45.893341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd386b3d-19a9-43a6-bbd2-dbe073ea649c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:45.894383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd386b3d-19a9-43a6-bbd2-dbe073ea649c admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:45.894752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd386b3d-19a9-43a6-bbd2-dbe073ea649c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:45.895060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd386b3d-19a9-43a6-bbd2-dbe073ea649c admin admin] PATH_INFO: `/v3/projects/bd61da83cb56412a8757633c22561495/users/f7948b58ee714cb1bfd4d8364dae19ee/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:45.911648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd386b3d-19a9-43a6-bbd2-dbe073ea649c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd61da83cb56412a8757633c22561495, user_id=f7948b58ee714cb1bfd4d8364dae19ee, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:45.914438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd386b3d-19a9-43a6-bbd2-dbe073ea649c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:46.062284 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3809/7550] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:40:45 2022] PUT /identity/v3/projects/bd61da83cb56412a8757633c22561495/users/f7948b58ee714cb1bfd4d8364dae19ee/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:40:46.068437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e1648-3372-4354-8b2f-de20c6b824d5 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:46.068730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e1648-3372-4354-8b2f-de20c6b824d5 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:46.069005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e1648-3372-4354-8b2f-de20c6b824d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:46.088300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-966e1648-3372-4354-8b2f-de20c6b824d5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:40:46.089585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-966e1648-3372-4354-8b2f-de20c6b824d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:46.094138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:46.155871 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3742/7551] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:40:46.166257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd386b3d-19a9-43a6-bbd2-dbe073ea649c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:46.168538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dd386b3d-19a9-43a6-bbd2-dbe073ea649c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:46.236658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd386b3d-19a9-43a6-bbd2-dbe073ea649c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:46.240429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc8e48-0c12-4695-b106-c38618dc424b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:46.241078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc8e48-0c12-4695-b106-c38618dc424b service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:46.241364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc8e48-0c12-4695-b106-c38618dc424b service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:46.241639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc8e48-0c12-4695-b106-c38618dc424b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:46.252694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc8e48-0c12-4695-b106-c38618dc424b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:46.254746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc8e48-0c12-4695-b106-c38618dc424b service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:46.264577 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3810/7552] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:40:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:40:47.690737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d248b90-0ba7-4a2c-b9fa-ebedc5ede5d6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:47.691301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d248b90-0ba7-4a2c-b9fa-ebedc5ede5d6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:47.691301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d248b90-0ba7-4a2c-b9fa-ebedc5ede5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:47.749710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2d248b90-0ba7-4a2c-b9fa-ebedc5ede5d6 None None] MFA Rules not processed for user `f7948b58ee714cb1bfd4d8364dae19ee`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:40:47.753337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2d248b90-0ba7-4a2c-b9fa-ebedc5ede5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:47.885611 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3743/7553] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:40:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:40:47.895339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc8e48-0c12-4695-b106-c38618dc424b service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:47.897546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-86bc8e48-0c12-4695-b106-c38618dc424b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:47.976358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc8e48-0c12-4695-b106-c38618dc424b service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:47.981595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34900d-f145-4f80-86c8-21267d4798a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:47.982541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34900d-f145-4f80-86c8-21267d4798a6 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:47.983032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34900d-f145-4f80-86c8-21267d4798a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:47.983763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34900d-f145-4f80-86c8-21267d4798a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:47.997675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34900d-f145-4f80-86c8-21267d4798a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:47.999533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34900d-f145-4f80-86c8-21267d4798a6 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:48.024087 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3811/7554] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:40:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:40:50.866823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3972643-a5d8-459e-92cd-84b38dc50cc5 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:50.867338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3972643-a5d8-459e-92cd-84b38dc50cc5 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:50.867435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3972643-a5d8-459e-92cd-84b38dc50cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:50.898625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a3972643-a5d8-459e-92cd-84b38dc50cc5 None None] MFA Rules not processed for user `833136cbdeab4b9e8b6dd2d24c7c8753`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:40:50.900556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a3972643-a5d8-459e-92cd-84b38dc50cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:50.966275 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3744/7555] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:40:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:40:51.096608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d95ade-163a-478a-a0c0-7d6a1349bf04 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:51.097360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d95ade-163a-478a-a0c0-7d6a1349bf04 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:51.097802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d95ade-163a-478a-a0c0-7d6a1349bf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:51.131993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-93d95ade-163a-478a-a0c0-7d6a1349bf04 None None] MFA Rules not processed for user `f7948b58ee714cb1bfd4d8364dae19ee`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:40:51.133778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-93d95ade-163a-478a-a0c0-7d6a1349bf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:51.147682 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3812/7556] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:40:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:40:51.532782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3972643-a5d8-459e-92cd-84b38dc50cc5 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:51.546649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3972643-a5d8-459e-92cd-84b38dc50cc5 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:51.551724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf72ab-f80a-4b19-bc96-52094203588c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:51.552143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf72ab-f80a-4b19-bc96-52094203588c service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:51.552496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf72ab-f80a-4b19-bc96-52094203588c service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:51.552982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf72ab-f80a-4b19-bc96-52094203588c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:51.554950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-dabf72ab-f80a-4b19-bc96-52094203588c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:51.569463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf72ab-f80a-4b19-bc96-52094203588c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:51.570940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf72ab-f80a-4b19-bc96-52094203588c service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:51.583114 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3745/7557] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:40:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:40:52.139136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d95ade-163a-478a-a0c0-7d6a1349bf04 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:40:52.140687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-93d95ade-163a-478a-a0c0-7d6a1349bf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:52.278867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d95ade-163a-478a-a0c0-7d6a1349bf04 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:40:52.285287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e161982-feab-4e18-9e32-43278b810915 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:40:52.288549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e161982-feab-4e18-9e32-43278b810915 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:52.288549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e161982-feab-4e18-9e32-43278b810915 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:52.288549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e161982-feab-4e18-9e32-43278b810915 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:52.289343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3e161982-feab-4e18-9e32-43278b810915 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:52.313545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e161982-feab-4e18-9e32-43278b810915 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:40:52.315330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e161982-feab-4e18-9e32-43278b810915 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:40:52.328899 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3813/7558] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:40:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:40:56.919645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cb595-ed0c-4d57-95f7-c0906a136dcb None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:40:56.920225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cb595-ed0c-4d57-95f7-c0906a136dcb None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:40:56.920225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cb595-ed0c-4d57-95f7-c0906a136dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:40:56.939977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c78cb595-ed0c-4d57-95f7-c0906a136dcb None None] MFA Rules not processed for user `95cd6b54d8164de1a524b407a1852ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:40:56.941656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c78cb595-ed0c-4d57-95f7-c0906a136dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:40:56.997742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:40:57.040308 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3746/7559] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:40:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:41:02.321787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:07.066548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=11 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:09.342905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e161982-feab-4e18-9e32-43278b810915 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:41:09.368177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e161982-feab-4e18-9e32-43278b810915 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:41:09.373362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ef7a1-4be0-44d3-bdf8-32ac9430b83f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:41:09.374049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ef7a1-4be0-44d3-bdf8-32ac9430b83f service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:41:09.374330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ef7a1-4be0-44d3-bdf8-32ac9430b83f service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:41:09.374609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ef7a1-4be0-44d3-bdf8-32ac9430b83f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:41:09.376483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-379ef7a1-4be0-44d3-bdf8-32ac9430b83f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:41:09.392899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ef7a1-4be0-44d3-bdf8-32ac9430b83f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:41:09.394566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ef7a1-4be0-44d3-bdf8-32ac9430b83f service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:41:09.408238 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3814/7560] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:41:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:41:13.172027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14482ef-172e-4449-bd40-fec956da88a0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:41:13.172520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14482ef-172e-4449-bd40-fec956da88a0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:41:13.172631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14482ef-172e-4449-bd40-fec956da88a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:41:13.192075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e14482ef-172e-4449-bd40-fec956da88a0 None None] MFA Rules not processed for user `f7948b58ee714cb1bfd4d8364dae19ee`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:41:13.193275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e14482ef-172e-4449-bd40-fec956da88a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:41:13.200408 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3747/7561] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:41:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:41:19.400725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=10 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:19.404179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ef7a1-4be0-44d3-bdf8-32ac9430b83f service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:41:19.417623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ef7a1-4be0-44d3-bdf8-32ac9430b83f service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:41:19.423038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab728723-1c90-4d4b-89ba-67c0ade3e180 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:41:19.423702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab728723-1c90-4d4b-89ba-67c0ade3e180 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:41:19.423989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab728723-1c90-4d4b-89ba-67c0ade3e180 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:41:19.424269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab728723-1c90-4d4b-89ba-67c0ade3e180 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:41:19.426613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ab728723-1c90-4d4b-89ba-67c0ade3e180 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:41:19.443402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab728723-1c90-4d4b-89ba-67c0ade3e180 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:41:19.444996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab728723-1c90-4d4b-89ba-67c0ade3e180 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:41:19.458476 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3815/7562] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:41:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:41:23.186504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:25.355817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14482ef-172e-4449-bd40-fec956da88a0 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:41:25.369454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14482ef-172e-4449-bd40-fec956da88a0 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:41:25.373308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f4da5-05f4-4cee-9ece-133d03042d1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:41:25.373967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f4da5-05f4-4cee-9ece-133d03042d1d service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:41:25.374254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f4da5-05f4-4cee-9ece-133d03042d1d service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:41:25.374535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f4da5-05f4-4cee-9ece-133d03042d1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:41:25.376445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-974f4da5-05f4-4cee-9ece-133d03042d1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:41:25.388338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f4da5-05f4-4cee-9ece-133d03042d1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:41:25.389790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f4da5-05f4-4cee-9ece-133d03042d1d service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:41:25.400521 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3748/7563] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:41:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:41:29.450959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:34.110842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c5bf3-827f-4c1a-9f80-cf77be52a87a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:41:34.116156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c5bf3-827f-4c1a-9f80-cf77be52a87a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:41:34.116156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c5bf3-827f-4c1a-9f80-cf77be52a87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:41:34.138088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-630c5bf3-827f-4c1a-9f80-cf77be52a87a None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:41:34.139601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-630c5bf3-827f-4c1a-9f80-cf77be52a87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:41:34.226763 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3816/7564] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:41:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:41:34.376698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f4da5-05f4-4cee-9ece-133d03042d1d service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:41:34.378247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-974f4da5-05f4-4cee-9ece-133d03042d1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:41:34.508590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f4da5-05f4-4cee-9ece-133d03042d1d service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:41:34.517313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7df0a-abf0-4298-acd3-8c1b0d62573f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:41:34.522028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7df0a-abf0-4298-acd3-8c1b0d62573f service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:41:34.522028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7df0a-abf0-4298-acd3-8c1b0d62573f service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:41:34.522028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7df0a-abf0-4298-acd3-8c1b0d62573f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:41:34.531591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7df0a-abf0-4298-acd3-8c1b0d62573f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:41:34.533896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7df0a-abf0-4298-acd3-8c1b0d62573f service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:41:34.545903 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3749/7565] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:41:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:41:34.887690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efb20e-aba1-4420-8c55-122108dd5486 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:41:34.888051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efb20e-aba1-4420-8c55-122108dd5486 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:41:34.888332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efb20e-aba1-4420-8c55-122108dd5486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:41:34.906512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-27efb20e-aba1-4420-8c55-122108dd5486 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:41:34.913122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-27efb20e-aba1-4420-8c55-122108dd5486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:41:34.915454 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3817/7566] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:41:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:41:34.928112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7df0a-abf0-4298-acd3-8c1b0d62573f service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:41:34.941253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7df0a-abf0-4298-acd3-8c1b0d62573f service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:41:34.947316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e057f4-a4f8-4ee1-9621-c0cda44648fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:41:34.948060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e057f4-a4f8-4ee1-9621-c0cda44648fe service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:41:34.948426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e057f4-a4f8-4ee1-9621-c0cda44648fe service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:41:34.949729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e057f4-a4f8-4ee1-9621-c0cda44648fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:41:34.960176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e057f4-a4f8-4ee1-9621-c0cda44648fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:41:34.961842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e057f4-a4f8-4ee1-9621-c0cda44648fe service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:41:34.971091 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3750/7567] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:41:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:41:39.479194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27efb20e-aba1-4420-8c55-122108dd5486 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:41:39.497995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27efb20e-aba1-4420-8c55-122108dd5486 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:41:39.507848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57a75e-187d-45ad-bbd7-53685c66515d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:41:39.509836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57a75e-187d-45ad-bbd7-53685c66515d service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:41:39.512097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57a75e-187d-45ad-bbd7-53685c66515d service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:41:39.513378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57a75e-187d-45ad-bbd7-53685c66515d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:41:39.521606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-eb57a75e-187d-45ad-bbd7-53685c66515d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:41:39.551207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57a75e-187d-45ad-bbd7-53685c66515d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:41:39.554848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57a75e-187d-45ad-bbd7-53685c66515d service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:41:39.575267 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3818/7568] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:41:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:41:39.774670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b055e-41b5-41b9-a8cd-3cd70de317c2 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:41:39.775324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b055e-41b5-41b9-a8cd-3cd70de317c2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:41:39.775524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b055e-41b5-41b9-a8cd-3cd70de317c2 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:41:39.777384 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3751/7569] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:41:39.782780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b9024-14b4-405c-b182-5bf2558c2d4f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:41:39.783526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b9024-14b4-405c-b182-5bf2558c2d4f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:41:39.783984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b9024-14b4-405c-b182-5bf2558c2d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:41:39.806066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b93b9024-14b4-405c-b182-5bf2558c2d4f None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:41:39.807381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b93b9024-14b4-405c-b182-5bf2558c2d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:41:39.817183 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3819/7570] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:41:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:41:39.844237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b055e-41b5-41b9-a8cd-3cd70de317c2 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:41:39.846275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-436b055e-41b5-41b9-a8cd-3cd70de317c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:41:39.872362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b055e-41b5-41b9-a8cd-3cd70de317c2 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:41:39.878671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182c5f4-29a2-4b28-a4a7-00235bf4e4b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:41:39.879494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182c5f4-29a2-4b28-a4a7-00235bf4e4b8 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:41:39.879849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182c5f4-29a2-4b28-a4a7-00235bf4e4b8 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:41:39.880197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182c5f4-29a2-4b28-a4a7-00235bf4e4b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:41:39.892750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182c5f4-29a2-4b28-a4a7-00235bf4e4b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:41:39.894588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182c5f4-29a2-4b28-a4a7-00235bf4e4b8 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:41:39.910869 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3752/7571] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:41:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:41:40.406938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b9024-14b4-405c-b182-5bf2558c2d4f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:41:40.408746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b93b9024-14b4-405c-b182-5bf2558c2d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:41:40.424563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b9024-14b4-405c-b182-5bf2558c2d4f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:41:40.429149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64923c7-8b36-46cf-b818-8922e5f75aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:41:40.429798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64923c7-8b36-46cf-b818-8922e5f75aff service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:41:40.430083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64923c7-8b36-46cf-b818-8922e5f75aff service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:41:40.430361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64923c7-8b36-46cf-b818-8922e5f75aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:41:40.432165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b64923c7-8b36-46cf-b818-8922e5f75aff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:41:40.516011 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64923c7-8b36-46cf-b818-8922e5f75aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:41:40.517477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64923c7-8b36-46cf-b818-8922e5f75aff service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:41:40.540672 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3820/7572] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:41:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:41:45.854034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a59df6-09dc-4c17-906d-c269ef235672 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:41:45.854619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a59df6-09dc-4c17-906d-c269ef235672 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:41:45.855159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a59df6-09dc-4c17-906d-c269ef235672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:41:45.898237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-99a59df6-09dc-4c17-906d-c269ef235672 None None] MFA Rules not processed for user `62209b9802ab46c3b3d094d4d1ad86fe`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:41:45.900208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-99a59df6-09dc-4c17-906d-c269ef235672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:41:45.999629 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3753/7573] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:41:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:41:50.537922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=79 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:55.991230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=79 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:41:57.837359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08232bb7-27b2-45ed-97d3-d5df938452c4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:41:57.837906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08232bb7-27b2-45ed-97d3-d5df938452c4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:41:57.837906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08232bb7-27b2-45ed-97d3-d5df938452c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:41:57.856597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-08232bb7-27b2-45ed-97d3-d5df938452c4 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:41:57.857820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-08232bb7-27b2-45ed-97d3-d5df938452c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:41:57.866367 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3821/7574] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:41:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:41:57.880610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a59df6-09dc-4c17-906d-c269ef235672 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:41:57.895686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a59df6-09dc-4c17-906d-c269ef235672 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:41:57.901489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef36a27-3042-47ad-9c20-b3605e5cf5ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:41:57.904568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef36a27-3042-47ad-9c20-b3605e5cf5ad service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:41:57.904568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef36a27-3042-47ad-9c20-b3605e5cf5ad service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:41:57.904568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef36a27-3042-47ad-9c20-b3605e5cf5ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:41:57.911758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef36a27-3042-47ad-9c20-b3605e5cf5ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:41:57.913553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef36a27-3042-47ad-9c20-b3605e5cf5ad service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:41:57.922268 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3754/7575] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:41:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:42:02.684123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08232bb7-27b2-45ed-97d3-d5df938452c4 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:02.697236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08232bb7-27b2-45ed-97d3-d5df938452c4 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:02.701745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eca55d-2b9e-4220-a8eb-83f5af9ef34d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:02.702614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eca55d-2b9e-4220-a8eb-83f5af9ef34d service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:02.702733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eca55d-2b9e-4220-a8eb-83f5af9ef34d service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:02.703036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eca55d-2b9e-4220-a8eb-83f5af9ef34d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:02.704838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-94eca55d-2b9e-4220-a8eb-83f5af9ef34d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:42:02.770313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eca55d-2b9e-4220-a8eb-83f5af9ef34d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:02.771877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eca55d-2b9e-4220-a8eb-83f5af9ef34d service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:02.783259 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3822/7576] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:42:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:42:05.240500 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef36a27-3042-47ad-9c20-b3605e5cf5ad service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:05.242112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9ef36a27-3042-47ad-9c20-b3605e5cf5ad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:42:05.261245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef36a27-3042-47ad-9c20-b3605e5cf5ad service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:05.267219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd652788-8850-4210-acac-00b7f2faaca8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:05.267874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd652788-8850-4210-acac-00b7f2faaca8 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:05.268158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd652788-8850-4210-acac-00b7f2faaca8 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:05.268431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd652788-8850-4210-acac-00b7f2faaca8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:05.270202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bd652788-8850-4210-acac-00b7f2faaca8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:42:05.285761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd652788-8850-4210-acac-00b7f2faaca8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:05.287390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd652788-8850-4210-acac-00b7f2faaca8 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:05.302147 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3755/7577] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:42:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:42:06.717495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eca55d-2b9e-4220-a8eb-83f5af9ef34d service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:06.731734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eca55d-2b9e-4220-a8eb-83f5af9ef34d service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:06.736858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59561745-92cc-4fbb-b8df-2f6fd6023948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:06.737896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59561745-92cc-4fbb-b8df-2f6fd6023948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:06.738181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59561745-92cc-4fbb-b8df-2f6fd6023948 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:06.738461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59561745-92cc-4fbb-b8df-2f6fd6023948 admin admin] PATH_INFO: `/v3/users/f7948b58ee714cb1bfd4d8364dae19ee` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:06.739758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59561745-92cc-4fbb-b8df-2f6fd6023948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7948b58ee714cb1bfd4d8364dae19ee)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:06.741685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59561745-92cc-4fbb-b8df-2f6fd6023948 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:06.995391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-59561745-92cc-4fbb-b8df-2f6fd6023948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7948b58ee714cb1bfd4d8364dae19ee'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:42:07.002446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-59561745-92cc-4fbb-b8df-2f6fd6023948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7948b58ee714cb1bfd4d8364dae19ee'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:42:07.112807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-59561745-92cc-4fbb-b8df-2f6fd6023948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7948b58ee714cb1bfd4d8364dae19ee'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:42:07.113544 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-59561745-92cc-4fbb-b8df-2f6fd6023948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7948b58ee714cb1bfd4d8364dae19ee'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:42:07.128051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-59561745-92cc-4fbb-b8df-2f6fd6023948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7948b58ee714cb1bfd4d8364dae19ee'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:42:07.134563 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3823/7578] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:42:06 2022] DELETE /identity/v3/users/f7948b58ee714cb1bfd4d8364dae19ee => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:42:07.382953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd652788-8850-4210-acac-00b7f2faaca8 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:07.399446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd652788-8850-4210-acac-00b7f2faaca8 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:07.476639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7a1b3-c42c-436f-b1f0-b0bf995f2a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:07.477902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7a1b3-c42c-436f-b1f0-b0bf995f2a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:07.478186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7a1b3-c42c-436f-b1f0-b0bf995f2a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:07.478455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7a1b3-c42c-436f-b1f0-b0bf995f2a99 admin admin] PATH_INFO: `/v3/projects/bd61da83cb56412a8757633c22561495` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:07.479680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7a1b3-c42c-436f-b1f0-b0bf995f2a99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd61da83cb56412a8757633c22561495)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:07.482038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7a1b3-c42c-436f-b1f0-b0bf995f2a99 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:07.656651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-20f7a1b3-c42c-436f-b1f0-b0bf995f2a99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd61da83cb56412a8757633c22561495', 'request_id': 'req-20f7a1b3-c42c-436f-b1f0-b0bf995f2a99'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:42:07.662941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-20f7a1b3-c42c-436f-b1f0-b0bf995f2a99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd61da83cb56412a8757633c22561495', 'request_id': 'req-20f7a1b3-c42c-436f-b1f0-b0bf995f2a99'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:42:07.669369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-20f7a1b3-c42c-436f-b1f0-b0bf995f2a99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd61da83cb56412a8757633c22561495', 'request_id': 'req-20f7a1b3-c42c-436f-b1f0-b0bf995f2a99'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:42:07.735428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-20f7a1b3-c42c-436f-b1f0-b0bf995f2a99 admin admin] The token cache is being invalidate because project bd61da83cb56412a8757633c22561495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:42:07.735723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-20f7a1b3-c42c-436f-b1f0-b0bf995f2a99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:42:07.740450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-20f7a1b3-c42c-436f-b1f0-b0bf995f2a99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:42:07.740450 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3756/7579] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:42:07 2022] DELETE /identity/v3/projects/bd61da83cb56412a8757633c22561495 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:42:07.743764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a95a35-0921-43bc-90fb-1b5869eb1b2c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:07.744310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a95a35-0921-43bc-90fb-1b5869eb1b2c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:07.744722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a95a35-0921-43bc-90fb-1b5869eb1b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:07.765972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-14a95a35-0921-43bc-90fb-1b5869eb1b2c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:42:07.767370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-14a95a35-0921-43bc-90fb-1b5869eb1b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:42:07.823210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:42:07.832532 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3824/7580] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:42:07.840194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8731f98-5dc9-4e9d-a9ee-0a183388ff41 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:07.840715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8731f98-5dc9-4e9d-a9ee-0a183388ff41 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:07.841007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8731f98-5dc9-4e9d-a9ee-0a183388ff41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:07.860009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f8731f98-5dc9-4e9d-a9ee-0a183388ff41 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:42:07.861105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f8731f98-5dc9-4e9d-a9ee-0a183388ff41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:42:07.869800 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3757/7581] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:42:07.874929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a95a35-0921-43bc-90fb-1b5869eb1b2c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:07.884919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a95a35-0921-43bc-90fb-1b5869eb1b2c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:07.890381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345337d4-2860-4bf3-b539-e4c4edbe9635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:07.891121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345337d4-2860-4bf3-b539-e4c4edbe9635 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:07.891358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345337d4-2860-4bf3-b539-e4c4edbe9635 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:07.891636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345337d4-2860-4bf3-b539-e4c4edbe9635 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:07.892442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345337d4-2860-4bf3-b539-e4c4edbe9635 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:42:07.892691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345337d4-2860-4bf3-b539-e4c4edbe9635 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:07.894315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345337d4-2860-4bf3-b539-e4c4edbe9635 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:07.906403 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3825/7582] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:42:07.910720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8731f98-5dc9-4e9d-a9ee-0a183388ff41 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:07.920162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8731f98-5dc9-4e9d-a9ee-0a183388ff41 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:07.925719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88440d-e575-4c44-88e5-1a7b062af53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:07.926362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88440d-e575-4c44-88e5-1a7b062af53d admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:07.926642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88440d-e575-4c44-88e5-1a7b062af53d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:07.926914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88440d-e575-4c44-88e5-1a7b062af53d admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:07.927712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88440d-e575-4c44-88e5-1a7b062af53d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:07.929963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88440d-e575-4c44-88e5-1a7b062af53d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:08.043133 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3758/7583] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:42:07 2022] POST /identity/v3/projects => generated 389 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:42:08.045362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345337d4-2860-4bf3-b539-e4c4edbe9635 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:08.055702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345337d4-2860-4bf3-b539-e4c4edbe9635 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:08.125689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2c60d-2c8e-47a5-8439-10b4183ef84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:08.126394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2c60d-2c8e-47a5-8439-10b4183ef84c admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:08.126645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2c60d-2c8e-47a5-8439-10b4183ef84c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:08.126920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2c60d-2c8e-47a5-8439-10b4183ef84c admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:08.127648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2c60d-2c8e-47a5-8439-10b4183ef84c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:08.129592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2c60d-2c8e-47a5-8439-10b4183ef84c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:08.226590 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3826/7584] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:42:08 2022] POST /identity/v3/users => generated 295 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:42:08.231186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88440d-e575-4c44-88e5-1a7b062af53d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:08.242232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88440d-e575-4c44-88e5-1a7b062af53d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:08.246895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd19b5d-87aa-4736-9dda-691fef2fd59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:08.247629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd19b5d-87aa-4736-9dda-691fef2fd59e admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:08.247935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd19b5d-87aa-4736-9dda-691fef2fd59e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:08.248202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd19b5d-87aa-4736-9dda-691fef2fd59e admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:08.248928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd19b5d-87aa-4736-9dda-691fef2fd59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:08.250810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd19b5d-87aa-4736-9dda-691fef2fd59e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:08.262631 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3759/7585] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:42:08.266398 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2c60d-2c8e-47a5-8439-10b4183ef84c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:08.277153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2c60d-2c8e-47a5-8439-10b4183ef84c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:08.282707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97452e44-6770-4e78-8423-c8a32c464b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:08.283522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97452e44-6770-4e78-8423-c8a32c464b3c admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:08.288804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97452e44-6770-4e78-8423-c8a32c464b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:08.288804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97452e44-6770-4e78-8423-c8a32c464b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:08.288804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97452e44-6770-4e78-8423-c8a32c464b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:08.288804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97452e44-6770-4e78-8423-c8a32c464b3c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:08.297834 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3827/7586] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:42:08.301800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd19b5d-87aa-4736-9dda-691fef2fd59e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:08.317386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd19b5d-87aa-4736-9dda-691fef2fd59e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:08.318596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f24ed1-c6b4-4ae5-9dfb-bd9f1b7e7447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:08.319627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f24ed1-c6b4-4ae5-9dfb-bd9f1b7e7447 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:08.319977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f24ed1-c6b4-4ae5-9dfb-bd9f1b7e7447 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:08.320321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f24ed1-c6b4-4ae5-9dfb-bd9f1b7e7447 admin admin] PATH_INFO: `/v3/projects/251f01f982aa43ad853d53fa06f99190/users/82819d3efcda4fe78e2b50bb7fab0a96/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:08.337127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f24ed1-c6b4-4ae5-9dfb-bd9f1b7e7447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=251f01f982aa43ad853d53fa06f99190, user_id=82819d3efcda4fe78e2b50bb7fab0a96, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:08.339923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f24ed1-c6b4-4ae5-9dfb-bd9f1b7e7447 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:08.433630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:42:08.439124 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3760/7587] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:42:08 2022] PUT /identity/v3/projects/251f01f982aa43ad853d53fa06f99190/users/82819d3efcda4fe78e2b50bb7fab0a96/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:42:08.450110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b573c0-2fdc-4cfa-a20b-b1ffa34f92ef None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:08.450491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b573c0-2fdc-4cfa-a20b-b1ffa34f92ef None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:08.450959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b573c0-2fdc-4cfa-a20b-b1ffa34f92ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:08.478379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-69b573c0-2fdc-4cfa-a20b-b1ffa34f92ef None None] MFA Rules not processed for user `82819d3efcda4fe78e2b50bb7fab0a96`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:42:08.479556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-69b573c0-2fdc-4cfa-a20b-b1ffa34f92ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:42:08.545817 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3828/7588] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:42:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:42:08.550201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f24ed1-c6b4-4ae5-9dfb-bd9f1b7e7447 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:08.614060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f24ed1-c6b4-4ae5-9dfb-bd9f1b7e7447 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:08.618836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc3be6-393c-49a8-9283-c80fe92420cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:08.619636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc3be6-393c-49a8-9283-c80fe92420cd admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:08.619921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc3be6-393c-49a8-9283-c80fe92420cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:08.620196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc3be6-393c-49a8-9283-c80fe92420cd admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:08.620873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc3be6-393c-49a8-9283-c80fe92420cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:08.623825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc3be6-393c-49a8-9283-c80fe92420cd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:08.713460 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3761/7589] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:42:08 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:42:08.717838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b573c0-2fdc-4cfa-a20b-b1ffa34f92ef None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:08.729447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b573c0-2fdc-4cfa-a20b-b1ffa34f92ef None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:08.780486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:42:08.787352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64cd31-ad0d-4409-a093-ff80ff03f85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:08.788012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64cd31-ad0d-4409-a093-ff80ff03f85a admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:08.788295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64cd31-ad0d-4409-a093-ff80ff03f85a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:08.788569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64cd31-ad0d-4409-a093-ff80ff03f85a admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:08.789276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64cd31-ad0d-4409-a093-ff80ff03f85a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:08.791276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64cd31-ad0d-4409-a093-ff80ff03f85a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:08.879392 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3829/7590] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:42:08 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:42:08.883338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc3be6-393c-49a8-9283-c80fe92420cd admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:08.893981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc3be6-393c-49a8-9283-c80fe92420cd admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:08.899635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4555594-81a8-4d51-9a25-e1966b4f813b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:08.900292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4555594-81a8-4d51-9a25-e1966b4f813b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:08.900577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4555594-81a8-4d51-9a25-e1966b4f813b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:08.900855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4555594-81a8-4d51-9a25-e1966b4f813b admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:08.901570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4555594-81a8-4d51-9a25-e1966b4f813b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:08.903239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4555594-81a8-4d51-9a25-e1966b4f813b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:08.913881 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3762/7591] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:42:08.917897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64cd31-ad0d-4409-a093-ff80ff03f85a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:08.928950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64cd31-ad0d-4409-a093-ff80ff03f85a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:08.933807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e87617-a875-4f5c-b68b-f3fe6cb4774e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:08.934967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e87617-a875-4f5c-b68b-f3fe6cb4774e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:08.935282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e87617-a875-4f5c-b68b-f3fe6cb4774e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:08.935561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e87617-a875-4f5c-b68b-f3fe6cb4774e admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:08.936316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e87617-a875-4f5c-b68b-f3fe6cb4774e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:08.937910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e87617-a875-4f5c-b68b-f3fe6cb4774e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:08.948017 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3830/7592] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:42:08.951952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4555594-81a8-4d51-9a25-e1966b4f813b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:08.962161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4555594-81a8-4d51-9a25-e1966b4f813b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:08.966933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0760fbc-89cf-496c-9b5a-bde201f39103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:08.967841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0760fbc-89cf-496c-9b5a-bde201f39103 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:08.968128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0760fbc-89cf-496c-9b5a-bde201f39103 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:08.968413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0760fbc-89cf-496c-9b5a-bde201f39103 admin admin] PATH_INFO: `/v3/projects/4aea7ae2d1b34650b825a381a21f5df1/users/7b742c8ba44b47dfa320fdbd501c4935/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:08.985430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0760fbc-89cf-496c-9b5a-bde201f39103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aea7ae2d1b34650b825a381a21f5df1, user_id=7b742c8ba44b47dfa320fdbd501c4935, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:08.986673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0760fbc-89cf-496c-9b5a-bde201f39103 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:09.074086 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3763/7593] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:42:08 2022] PUT /identity/v3/projects/4aea7ae2d1b34650b825a381a21f5df1/users/7b742c8ba44b47dfa320fdbd501c4935/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:42:09.085024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd49039-c65c-4c39-acb7-6d968f749d23 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:09.085320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd49039-c65c-4c39-acb7-6d968f749d23 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:09.085643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd49039-c65c-4c39-acb7-6d968f749d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:09.115687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2cd49039-c65c-4c39-acb7-6d968f749d23 None None] MFA Rules not processed for user `7b742c8ba44b47dfa320fdbd501c4935`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:42:09.116980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2cd49039-c65c-4c39-acb7-6d968f749d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:42:09.189586 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3831/7594] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:42:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:42:09.192428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0760fbc-89cf-496c-9b5a-bde201f39103 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:09.263536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0760fbc-89cf-496c-9b5a-bde201f39103 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:09.268666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c1f9c-c020-4650-a174-e664d43d14d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:09.269341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c1f9c-c020-4650-a174-e664d43d14d1 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:09.269631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c1f9c-c020-4650-a174-e664d43d14d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:09.269912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c1f9c-c020-4650-a174-e664d43d14d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:09.270827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c1f9c-c020-4650-a174-e664d43d14d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:09.272867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c1f9c-c020-4650-a174-e664d43d14d1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:09.370565 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3764/7595] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:42:09 2022] POST /identity/v3/projects => generated 389 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:42:09.374675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd49039-c65c-4c39-acb7-6d968f749d23 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:09.385541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd49039-c65c-4c39-acb7-6d968f749d23 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:09.443618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b57a5-614a-41ce-966d-1d7625d0f7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:09.444284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b57a5-614a-41ce-966d-1d7625d0f7ee admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:09.444567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b57a5-614a-41ce-966d-1d7625d0f7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:09.444840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b57a5-614a-41ce-966d-1d7625d0f7ee admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:09.445524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b57a5-614a-41ce-966d-1d7625d0f7ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:09.447475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b57a5-614a-41ce-966d-1d7625d0f7ee admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:09.565268 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3832/7596] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:42:09 2022] POST /identity/v3/users => generated 301 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:42:09.569415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c1f9c-c020-4650-a174-e664d43d14d1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:09.580200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c1f9c-c020-4650-a174-e664d43d14d1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:09.585005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6ba03-9c72-458b-aee9-6a6b7bf7a547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:09.585588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6ba03-9c72-458b-aee9-6a6b7bf7a547 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:09.585877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6ba03-9c72-458b-aee9-6a6b7bf7a547 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:09.586156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6ba03-9c72-458b-aee9-6a6b7bf7a547 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:09.586974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6ba03-9c72-458b-aee9-6a6b7bf7a547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:09.588518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6ba03-9c72-458b-aee9-6a6b7bf7a547 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:09.599733 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3765/7597] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:42:09.604072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b57a5-614a-41ce-966d-1d7625d0f7ee admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:09.615175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b57a5-614a-41ce-966d-1d7625d0f7ee admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:09.619829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0af08-fca1-4094-a02b-dcdaf5034477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:09.620706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0af08-fca1-4094-a02b-dcdaf5034477 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:09.620986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0af08-fca1-4094-a02b-dcdaf5034477 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:09.621260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0af08-fca1-4094-a02b-dcdaf5034477 admin admin] PATH_INFO: `/v3/projects/df8d0d9998e144efb2397e09f25c1fb9/users/18b4191f2f184c41825a2a387f47f0ad/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:09.638124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0af08-fca1-4094-a02b-dcdaf5034477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8d0d9998e144efb2397e09f25c1fb9, user_id=18b4191f2f184c41825a2a387f47f0ad, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:09.640859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0af08-fca1-4094-a02b-dcdaf5034477 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:09.729886 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3833/7598] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:42:09 2022] PUT /identity/v3/projects/df8d0d9998e144efb2397e09f25c1fb9/users/18b4191f2f184c41825a2a387f47f0ad/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:42:09.734470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6ba03-9c72-458b-aee9-6a6b7bf7a547 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:09.744746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6ba03-9c72-458b-aee9-6a6b7bf7a547 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:09.766505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:42:09.804784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0ed9e-593f-44aa-bc46-a8b79333af5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:09.805638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0ed9e-593f-44aa-bc46-a8b79333af5d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:09.806022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0ed9e-593f-44aa-bc46-a8b79333af5d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:09.806398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0ed9e-593f-44aa-bc46-a8b79333af5d admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:09.807298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0ed9e-593f-44aa-bc46-a8b79333af5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:09.810009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0ed9e-593f-44aa-bc46-a8b79333af5d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:09.824821 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3766/7599] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:42:09.825069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0af08-fca1-4094-a02b-dcdaf5034477 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:09.835935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0af08-fca1-4094-a02b-dcdaf5034477 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:09.841070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca524a-6eda-4a5e-96d6-3be4a108cbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:09.842035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca524a-6eda-4a5e-96d6-3be4a108cbdd admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:09.842369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca524a-6eda-4a5e-96d6-3be4a108cbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:09.842611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca524a-6eda-4a5e-96d6-3be4a108cbdd admin admin] PATH_INFO: `/v3/projects/df8d0d9998e144efb2397e09f25c1fb9/users/18b4191f2f184c41825a2a387f47f0ad/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:09.844677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca524a-6eda-4a5e-96d6-3be4a108cbdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8d0d9998e144efb2397e09f25c1fb9, user_id=18b4191f2f184c41825a2a387f47f0ad, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:09.847354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca524a-6eda-4a5e-96d6-3be4a108cbdd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:09.858539 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3834/7600] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:42:09 2022] PUT /identity/v3/projects/df8d0d9998e144efb2397e09f25c1fb9/users/18b4191f2f184c41825a2a387f47f0ad/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:42:09.868764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e3930-5c2b-4791-8372-8586fcb3c084 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:09.869060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e3930-5c2b-4791-8372-8586fcb3c084 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:09.869342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e3930-5c2b-4791-8372-8586fcb3c084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:09.898663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ce2e3930-5c2b-4791-8372-8586fcb3c084 None None] MFA Rules not processed for user `18b4191f2f184c41825a2a387f47f0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:42:09.899980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ce2e3930-5c2b-4791-8372-8586fcb3c084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:42:09.970027 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3767/7601] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:42:09 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:42:09.985848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca524a-6eda-4a5e-96d6-3be4a108cbdd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:09.987689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-68ca524a-6eda-4a5e-96d6-3be4a108cbdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:42:10.007395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:42:10.069683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca524a-6eda-4a5e-96d6-3be4a108cbdd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:10.076255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bd3b3-689c-44e5-9d17-35b52c6569ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:10.076815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bd3b3-689c-44e5-9d17-35b52c6569ed service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:10.077095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bd3b3-689c-44e5-9d17-35b52c6569ed service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:10.077368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bd3b3-689c-44e5-9d17-35b52c6569ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:10.134697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bd3b3-689c-44e5-9d17-35b52c6569ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:10.136330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bd3b3-689c-44e5-9d17-35b52c6569ed service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:10.148145 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3835/7602] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:42:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:42:13.083376 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e3930-5c2b-4791-8372-8586fcb3c084 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:13.086577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ce2e3930-5c2b-4791-8372-8586fcb3c084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:42:13.174756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e3930-5c2b-4791-8372-8586fcb3c084 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:13.179582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc97ba-8ea8-44c6-80a2-5eb85cd0aac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:13.180324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc97ba-8ea8-44c6-80a2-5eb85cd0aac8 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:13.180616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc97ba-8ea8-44c6-80a2-5eb85cd0aac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:13.180892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc97ba-8ea8-44c6-80a2-5eb85cd0aac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:13.193330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc97ba-8ea8-44c6-80a2-5eb85cd0aac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:13.195040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc97ba-8ea8-44c6-80a2-5eb85cd0aac8 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:13.208757 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3768/7603] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:42:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:42:18.588506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ebecb-9c0a-485f-ad7d-c57dcf0d1406 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:18.589052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ebecb-9c0a-485f-ad7d-c57dcf0d1406 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:18.591630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ebecb-9c0a-485f-ad7d-c57dcf0d1406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:18.607325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-042ebecb-9c0a-485f-ad7d-c57dcf0d1406 None None] MFA Rules not processed for user `82819d3efcda4fe78e2b50bb7fab0a96`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:42:18.608594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-042ebecb-9c0a-485f-ad7d-c57dcf0d1406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:42:18.615952 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3836/7604] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:42:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:42:23.201795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=78 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:42:28.601352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=52 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:42:55.529664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc97ba-8ea8-44c6-80a2-5eb85cd0aac8 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:42:55.531138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ccbc97ba-8ea8-44c6-80a2-5eb85cd0aac8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:42:55.657902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc97ba-8ea8-44c6-80a2-5eb85cd0aac8 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:42:55.668085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcb6e3-0383-45eb-84c4-d846ed348122 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:42:55.668085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcb6e3-0383-45eb-84c4-d846ed348122 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:42:55.668085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcb6e3-0383-45eb-84c4-d846ed348122 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:42:55.668085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcb6e3-0383-45eb-84c4-d846ed348122 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:42:55.668505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6fbcb6e3-0383-45eb-84c4-d846ed348122 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:42:55.685061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcb6e3-0383-45eb-84c4-d846ed348122 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:42:55.686748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcb6e3-0383-45eb-84c4-d846ed348122 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:42:55.705793 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3769/7605] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:42:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:43:04.884805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541b76f-07e4-42d9-b285-4c5abf45cc2c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:04.885360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541b76f-07e4-42d9-b285-4c5abf45cc2c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:04.885360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541b76f-07e4-42d9-b285-4c5abf45cc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:04.904545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d541b76f-07e4-42d9-b285-4c5abf45cc2c None None] MFA Rules not processed for user `833136cbdeab4b9e8b6dd2d24c7c8753`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:43:04.905732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d541b76f-07e4-42d9-b285-4c5abf45cc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:04.980619 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3837/7606] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:43:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:43:05.701156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=54 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:14.971232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=25 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:17.111873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcb6e3-0383-45eb-84c4-d846ed348122 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:43:17.115344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6fbcb6e3-0383-45eb-84c4-d846ed348122 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:17.185382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcb6e3-0383-45eb-84c4-d846ed348122 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:43:17.198813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a6286-df04-4bd2-8ef0-b6e139d10dc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:43:17.199519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a6286-df04-4bd2-8ef0-b6e139d10dc6 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:17.200938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a6286-df04-4bd2-8ef0-b6e139d10dc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:17.200938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a6286-df04-4bd2-8ef0-b6e139d10dc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:17.207374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c89a6286-df04-4bd2-8ef0-b6e139d10dc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:17.242088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a6286-df04-4bd2-8ef0-b6e139d10dc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:43:17.245808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a6286-df04-4bd2-8ef0-b6e139d10dc6 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:43:17.281778 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3770/7607] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:43:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:43:18.475618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541b76f-07e4-42d9-b285-4c5abf45cc2c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:43:18.479611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d541b76f-07e4-42d9-b285-4c5abf45cc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:18.508678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541b76f-07e4-42d9-b285-4c5abf45cc2c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:43:18.515327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24ed20-8882-4251-b959-e4e4b15d2e70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:43:18.516461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24ed20-8882-4251-b959-e4e4b15d2e70 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:18.516917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24ed20-8882-4251-b959-e4e4b15d2e70 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:18.517361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24ed20-8882-4251-b959-e4e4b15d2e70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:18.519455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2a24ed20-8882-4251-b959-e4e4b15d2e70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:18.536767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24ed20-8882-4251-b959-e4e4b15d2e70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:43:18.538686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24ed20-8882-4251-b959-e4e4b15d2e70 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:43:18.551661 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3838/7608] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:43:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:43:18.859254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caaa6c-c6e0-4017-933a-796f57608f03 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:18.859254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caaa6c-c6e0-4017-933a-796f57608f03 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:18.859254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caaa6c-c6e0-4017-933a-796f57608f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:18.903967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-30caaa6c-c6e0-4017-933a-796f57608f03 None None] MFA Rules not processed for user `82819d3efcda4fe78e2b50bb7fab0a96`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:43:18.906869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-30caaa6c-c6e0-4017-933a-796f57608f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:18.916828 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3771/7609] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:43:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:43:19.058348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24ed20-8882-4251-b959-e4e4b15d2e70 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:43:19.059871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2a24ed20-8882-4251-b959-e4e4b15d2e70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:19.255510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24ed20-8882-4251-b959-e4e4b15d2e70 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:43:19.271564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fee89-8531-4e6f-8ddf-2307c379b6da service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:43:19.272384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fee89-8531-4e6f-8ddf-2307c379b6da service glance] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:19.272915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fee89-8531-4e6f-8ddf-2307c379b6da service glance] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:19.273272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fee89-8531-4e6f-8ddf-2307c379b6da service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:19.275418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-581fee89-8531-4e6f-8ddf-2307c379b6da service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:19.303769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fee89-8531-4e6f-8ddf-2307c379b6da service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:43:19.305261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fee89-8531-4e6f-8ddf-2307c379b6da service glance] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:43:19.334385 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3839/7610] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:43:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:43:28.888149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=14 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:29.324469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=41 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:35.416106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caaa6c-c6e0-4017-933a-796f57608f03 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:43:35.432538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caaa6c-c6e0-4017-933a-796f57608f03 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:43:35.437868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf1033-dcd5-47c8-9c2a-21a095c28eef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:43:35.438622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf1033-dcd5-47c8-9c2a-21a095c28eef service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:35.438976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf1033-dcd5-47c8-9c2a-21a095c28eef service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:35.439363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf1033-dcd5-47c8-9c2a-21a095c28eef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:35.441119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c4bf1033-dcd5-47c8-9c2a-21a095c28eef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:35.456310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf1033-dcd5-47c8-9c2a-21a095c28eef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:43:35.457984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf1033-dcd5-47c8-9c2a-21a095c28eef service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:43:35.472061 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3772/7611] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:43:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:43:45.465069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:53.670475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fee89-8531-4e6f-8ddf-2307c379b6da service glance] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:43:53.742461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fee89-8531-4e6f-8ddf-2307c379b6da service glance] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:43:53.747140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894629f8-8d15-40b6-9eee-eed31026a361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:43:53.748006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894629f8-8d15-40b6-9eee-eed31026a361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:53.748306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894629f8-8d15-40b6-9eee-eed31026a361 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:53.748561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894629f8-8d15-40b6-9eee-eed31026a361 admin admin] PATH_INFO: `/v3/users/82819d3efcda4fe78e2b50bb7fab0a96` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:53.750569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894629f8-8d15-40b6-9eee-eed31026a361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82819d3efcda4fe78e2b50bb7fab0a96)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:43:53.752759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894629f8-8d15-40b6-9eee-eed31026a361 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:43:53.943251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-894629f8-8d15-40b6-9eee-eed31026a361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82819d3efcda4fe78e2b50bb7fab0a96'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:53.949973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-894629f8-8d15-40b6-9eee-eed31026a361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82819d3efcda4fe78e2b50bb7fab0a96'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:53.996172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-894629f8-8d15-40b6-9eee-eed31026a361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82819d3efcda4fe78e2b50bb7fab0a96'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:53.996799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-894629f8-8d15-40b6-9eee-eed31026a361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82819d3efcda4fe78e2b50bb7fab0a96'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:54.010433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-894629f8-8d15-40b6-9eee-eed31026a361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82819d3efcda4fe78e2b50bb7fab0a96'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:54.016659 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3840/7612] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:43:53 2022] DELETE /identity/v3/users/82819d3efcda4fe78e2b50bb7fab0a96 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:43:54.021336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cc1df-da2d-463d-b862-ecb7ecc08cca None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:54.022581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cc1df-da2d-463d-b862-ecb7ecc08cca None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:54.022581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cc1df-da2d-463d-b862-ecb7ecc08cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:54.064341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d29cc1df-da2d-463d-b862-ecb7ecc08cca None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:43:54.065594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d29cc1df-da2d-463d-b862-ecb7ecc08cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:54.125809 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3773/7613] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:43:54.135837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894629f8-8d15-40b6-9eee-eed31026a361 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:43:54.137400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-894629f8-8d15-40b6-9eee-eed31026a361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:54.201155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894629f8-8d15-40b6-9eee-eed31026a361 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:43:54.204551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c78593-6bf3-48eb-89f1-ed6b34c0b02a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:43:54.205208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c78593-6bf3-48eb-89f1-ed6b34c0b02a service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:54.205489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c78593-6bf3-48eb-89f1-ed6b34c0b02a service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:54.205764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c78593-6bf3-48eb-89f1-ed6b34c0b02a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:54.215889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c78593-6bf3-48eb-89f1-ed6b34c0b02a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:43:54.218663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c78593-6bf3-48eb-89f1-ed6b34c0b02a service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:43:54.231046 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3841/7614] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:43:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:43:54.535258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cc1df-da2d-463d-b862-ecb7ecc08cca None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:43:54.537041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d29cc1df-da2d-463d-b862-ecb7ecc08cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:54.554891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cc1df-da2d-463d-b862-ecb7ecc08cca None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:43:54.562551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b99885-800c-4cd4-a978-359f2f1eb0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:43:54.563513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b99885-800c-4cd4-a978-359f2f1eb0e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:54.563802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b99885-800c-4cd4-a978-359f2f1eb0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:54.564181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b99885-800c-4cd4-a978-359f2f1eb0e4 admin admin] PATH_INFO: `/v3/projects/251f01f982aa43ad853d53fa06f99190` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:54.565658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b99885-800c-4cd4-a978-359f2f1eb0e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=251f01f982aa43ad853d53fa06f99190)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:43:54.567891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b99885-800c-4cd4-a978-359f2f1eb0e4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:43:54.673624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-96b99885-800c-4cd4-a978-359f2f1eb0e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '251f01f982aa43ad853d53fa06f99190', 'request_id': 'req-96b99885-800c-4cd4-a978-359f2f1eb0e4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:54.679701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-96b99885-800c-4cd4-a978-359f2f1eb0e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '251f01f982aa43ad853d53fa06f99190', 'request_id': 'req-96b99885-800c-4cd4-a978-359f2f1eb0e4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:54.686015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-96b99885-800c-4cd4-a978-359f2f1eb0e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '251f01f982aa43ad853d53fa06f99190', 'request_id': 'req-96b99885-800c-4cd4-a978-359f2f1eb0e4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:54.740082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-96b99885-800c-4cd4-a978-359f2f1eb0e4 admin admin] The token cache is being invalidate because project 251f01f982aa43ad853d53fa06f99190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:43:54.740308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-96b99885-800c-4cd4-a978-359f2f1eb0e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:54.740918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-96b99885-800c-4cd4-a978-359f2f1eb0e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:54.742007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c78593-6bf3-48eb-89f1-ed6b34c0b02a service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:43:54.742591 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3774/7615] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:43:54 2022] DELETE /identity/v3/projects/251f01f982aa43ad853d53fa06f99190 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:43:54.743783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f1c78593-6bf3-48eb-89f1-ed6b34c0b02a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:54.747060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b99885-800c-4cd4-a978-359f2f1eb0e4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:43:54.748363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-96b99885-800c-4cd4-a978-359f2f1eb0e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:54.760226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:54.815665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b99885-800c-4cd4-a978-359f2f1eb0e4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:43:54.820481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a04d7-2940-42ba-81f0-9e0cf94c5b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:43:54.821362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a04d7-2940-42ba-81f0-9e0cf94c5b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:54.821650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a04d7-2940-42ba-81f0-9e0cf94c5b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:54.821924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a04d7-2940-42ba-81f0-9e0cf94c5b65 admin admin] PATH_INFO: `/v3/users/7b742c8ba44b47dfa320fdbd501c4935` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:54.823187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a04d7-2940-42ba-81f0-9e0cf94c5b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b742c8ba44b47dfa320fdbd501c4935)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:43:54.825124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a04d7-2940-42ba-81f0-9e0cf94c5b65 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:43:54.829377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c78593-6bf3-48eb-89f1-ed6b34c0b02a service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:43:54.831589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:54.894253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98249511-bd85-47fb-9109-0c9cd86ea27c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:43:54.894924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98249511-bd85-47fb-9109-0c9cd86ea27c service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:54.898289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98249511-bd85-47fb-9109-0c9cd86ea27c service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:54.898289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98249511-bd85-47fb-9109-0c9cd86ea27c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:54.898289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-98249511-bd85-47fb-9109-0c9cd86ea27c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:54.960709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98249511-bd85-47fb-9109-0c9cd86ea27c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:43:54.962414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98249511-bd85-47fb-9109-0c9cd86ea27c service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:43:54.972604 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3842/7616] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:43:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:43:55.040589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7d9a04d7-2940-42ba-81f0-9e0cf94c5b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b742c8ba44b47dfa320fdbd501c4935'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:55.052666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7d9a04d7-2940-42ba-81f0-9e0cf94c5b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b742c8ba44b47dfa320fdbd501c4935'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:55.106311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7d9a04d7-2940-42ba-81f0-9e0cf94c5b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b742c8ba44b47dfa320fdbd501c4935'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:55.121329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7d9a04d7-2940-42ba-81f0-9e0cf94c5b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b742c8ba44b47dfa320fdbd501c4935'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:55.122183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7d9a04d7-2940-42ba-81f0-9e0cf94c5b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b742c8ba44b47dfa320fdbd501c4935'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:55.129332 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3775/7617] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:43:54 2022] DELETE /identity/v3/users/7b742c8ba44b47dfa320fdbd501c4935 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:43:55.594205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98249511-bd85-47fb-9109-0c9cd86ea27c service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:43:55.605818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98249511-bd85-47fb-9109-0c9cd86ea27c service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:43:55.650934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:55.666523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cfd89-3e14-4a6a-ab71-5a262caa3036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:43:55.668447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cfd89-3e14-4a6a-ab71-5a262caa3036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:55.668447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cfd89-3e14-4a6a-ab71-5a262caa3036 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:55.668447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cfd89-3e14-4a6a-ab71-5a262caa3036 admin admin] PATH_INFO: `/v3/projects/4aea7ae2d1b34650b825a381a21f5df1` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:55.669317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cfd89-3e14-4a6a-ab71-5a262caa3036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aea7ae2d1b34650b825a381a21f5df1)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:43:55.671886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cfd89-3e14-4a6a-ab71-5a262caa3036 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:43:55.797763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e10083-6699-4204-b98c-9642df152247 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:55.797962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e10083-6699-4204-b98c-9642df152247 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:55.798241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e10083-6699-4204-b98c-9642df152247 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:55.799677 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3776/7618] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 16 21:43:55.804430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf1a6a-1f8d-4511-85e4-330df5461a06 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:55.804737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf1a6a-1f8d-4511-85e4-330df5461a06 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:55.805021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf1a6a-1f8d-4511-85e4-330df5461a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:55.846343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3edf1a6a-1f8d-4511-85e4-330df5461a06 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:43:55.847591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3edf1a6a-1f8d-4511-85e4-330df5461a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:55.857127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-827cfd89-3e14-4a6a-ab71-5a262caa3036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aea7ae2d1b34650b825a381a21f5df1', 'request_id': 'req-827cfd89-3e14-4a6a-ab71-5a262caa3036'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:55.864898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-827cfd89-3e14-4a6a-ab71-5a262caa3036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aea7ae2d1b34650b825a381a21f5df1', 'request_id': 'req-827cfd89-3e14-4a6a-ab71-5a262caa3036'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:55.871420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-827cfd89-3e14-4a6a-ab71-5a262caa3036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aea7ae2d1b34650b825a381a21f5df1', 'request_id': 'req-827cfd89-3e14-4a6a-ab71-5a262caa3036'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:55.919931 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3777/7619] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:43:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:43:55.942127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf1a6a-1f8d-4511-85e4-330df5461a06 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:43:55.943535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3edf1a6a-1f8d-4511-85e4-330df5461a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:55.959200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf1a6a-1f8d-4511-85e4-330df5461a06 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:43:55.963240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-827cfd89-3e14-4a6a-ab71-5a262caa3036 admin admin] The token cache is being invalidate because project 4aea7ae2d1b34650b825a381a21f5df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:43:55.968049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-827cfd89-3e14-4a6a-ab71-5a262caa3036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:55.968049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-827cfd89-3e14-4a6a-ab71-5a262caa3036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:55.968298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6ae0e-2252-4968-bd14-955e0891d019 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:43:55.968298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6ae0e-2252-4968-bd14-955e0891d019 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:55.968298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6ae0e-2252-4968-bd14-955e0891d019 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:55.968298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6ae0e-2252-4968-bd14-955e0891d019 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:55.968946 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3843/7620] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:43:55 2022] DELETE /identity/v3/projects/4aea7ae2d1b34650b825a381a21f5df1 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:43:55.969134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e9f6ae0e-2252-4968-bd14-955e0891d019 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:55.970278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cfd89-3e14-4a6a-ab71-5a262caa3036 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:43:55.971574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-827cfd89-3e14-4a6a-ab71-5a262caa3036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:55.979558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6ae0e-2252-4968-bd14-955e0891d019 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:43:55.981401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6ae0e-2252-4968-bd14-955e0891d019 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:43:55.991958 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3778/7621] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:43:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:43:56.041294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cfd89-3e14-4a6a-ab71-5a262caa3036 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:43:56.046022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c9d20-08f0-4e91-a434-6cb719f32ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:43:56.047837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c9d20-08f0-4e91-a434-6cb719f32ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:56.048182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c9d20-08f0-4e91-a434-6cb719f32ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:56.048464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c9d20-08f0-4e91-a434-6cb719f32ae0 admin admin] PATH_INFO: `/v3/users/18b4191f2f184c41825a2a387f47f0ad` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:56.049665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c9d20-08f0-4e91-a434-6cb719f32ae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18b4191f2f184c41825a2a387f47f0ad)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:43:56.051629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c9d20-08f0-4e91-a434-6cb719f32ae0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:43:56.244602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8e3c9d20-08f0-4e91-a434-6cb719f32ae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18b4191f2f184c41825a2a387f47f0ad'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:56.251747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8e3c9d20-08f0-4e91-a434-6cb719f32ae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18b4191f2f184c41825a2a387f47f0ad'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:56.306101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8e3c9d20-08f0-4e91-a434-6cb719f32ae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18b4191f2f184c41825a2a387f47f0ad'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:56.306769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8e3c9d20-08f0-4e91-a434-6cb719f32ae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18b4191f2f184c41825a2a387f47f0ad'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:56.319740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:56.322482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8e3c9d20-08f0-4e91-a434-6cb719f32ae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18b4191f2f184c41825a2a387f47f0ad'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:56.330960 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3844/7622] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:43:55 2022] DELETE /identity/v3/users/18b4191f2f184c41825a2a387f47f0ad => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:43:56.406013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6ae0e-2252-4968-bd14-955e0891d019 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:43:56.413205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e9f6ae0e-2252-4968-bd14-955e0891d019 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:56.477150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6ae0e-2252-4968-bd14-955e0891d019 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:43:56.481042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:56.527826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b9cd8-e290-4ce6-9c6f-1fa2afe85156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:43:56.528460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b9cd8-e290-4ce6-9c6f-1fa2afe85156 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:56.528745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b9cd8-e290-4ce6-9c6f-1fa2afe85156 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:56.529027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b9cd8-e290-4ce6-9c6f-1fa2afe85156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:56.531062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5b0b9cd8-e290-4ce6-9c6f-1fa2afe85156 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:56.603847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b9cd8-e290-4ce6-9c6f-1fa2afe85156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:43:56.605472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b9cd8-e290-4ce6-9c6f-1fa2afe85156 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:43:56.616926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c9d20-08f0-4e91-a434-6cb719f32ae0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:43:56.618515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8e3c9d20-08f0-4e91-a434-6cb719f32ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:56.619180 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3779/7623] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:43:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:43:56.693959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c9d20-08f0-4e91-a434-6cb719f32ae0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:43:56.698750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ed707-b23a-4c01-a9af-fa9c0191558a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:43:56.699580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ed707-b23a-4c01-a9af-fa9c0191558a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:56.699867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ed707-b23a-4c01-a9af-fa9c0191558a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:56.700147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ed707-b23a-4c01-a9af-fa9c0191558a admin admin] PATH_INFO: `/v3/projects/df8d0d9998e144efb2397e09f25c1fb9` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:56.701330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ed707-b23a-4c01-a9af-fa9c0191558a admin admin] RBAC: Authorizing `identity:delete_project(project_id=df8d0d9998e144efb2397e09f25c1fb9)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:43:56.703372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ed707-b23a-4c01-a9af-fa9c0191558a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:43:56.849528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c39ed707-b23a-4c01-a9af-fa9c0191558a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df8d0d9998e144efb2397e09f25c1fb9', 'request_id': 'req-c39ed707-b23a-4c01-a9af-fa9c0191558a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:56.859967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c39ed707-b23a-4c01-a9af-fa9c0191558a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df8d0d9998e144efb2397e09f25c1fb9', 'request_id': 'req-c39ed707-b23a-4c01-a9af-fa9c0191558a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:56.862532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c39ed707-b23a-4c01-a9af-fa9c0191558a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df8d0d9998e144efb2397e09f25c1fb9', 'request_id': 'req-c39ed707-b23a-4c01-a9af-fa9c0191558a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:56.974380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c39ed707-b23a-4c01-a9af-fa9c0191558a admin admin] The token cache is being invalidate because project df8d0d9998e144efb2397e09f25c1fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:43:56.974665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c39ed707-b23a-4c01-a9af-fa9c0191558a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:56.975332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c39ed707-b23a-4c01-a9af-fa9c0191558a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:43:56.976913 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3845/7624] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:43:56 2022] DELETE /identity/v3/projects/df8d0d9998e144efb2397e09f25c1fb9 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:43:56.982313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460781e-ec08-4e5d-9219-9eb4c0858511 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:56.982605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460781e-ec08-4e5d-9219-9eb4c0858511 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:56.982881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460781e-ec08-4e5d-9219-9eb4c0858511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:57.028004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8460781e-ec08-4e5d-9219-9eb4c0858511 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:43:57.029225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8460781e-ec08-4e5d-9219-9eb4c0858511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:57.092024 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3780/7625] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:43:57.100453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e61b1-878b-418d-9aaf-e6a8c977fb8e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:57.100764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e61b1-878b-418d-9aaf-e6a8c977fb8e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:57.101042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e61b1-878b-418d-9aaf-e6a8c977fb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:57.121128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1c3e61b1-878b-418d-9aaf-e6a8c977fb8e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:43:57.122250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1c3e61b1-878b-418d-9aaf-e6a8c977fb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:57.134793 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3846/7626] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:43:57.139792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460781e-ec08-4e5d-9219-9eb4c0858511 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:43:57.149950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460781e-ec08-4e5d-9219-9eb4c0858511 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:43:57.154849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e923e5-7cb0-4fc6-ba3b-3b9a5d31454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:43:57.156055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e923e5-7cb0-4fc6-ba3b-3b9a5d31454e admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:57.156343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e923e5-7cb0-4fc6-ba3b-3b9a5d31454e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:57.156621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e923e5-7cb0-4fc6-ba3b-3b9a5d31454e admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:57.157354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e923e5-7cb0-4fc6-ba3b-3b9a5d31454e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:43:57.157663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e923e5-7cb0-4fc6-ba3b-3b9a5d31454e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:43:57.159299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e923e5-7cb0-4fc6-ba3b-3b9a5d31454e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:43:57.172768 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3781/7627] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:43:57.177189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e61b1-878b-418d-9aaf-e6a8c977fb8e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:43:57.186718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e61b1-878b-418d-9aaf-e6a8c977fb8e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:43:57.191555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcf2ff-e8e2-4114-8bf4-0ff0ffc94cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:43:57.192204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcf2ff-e8e2-4114-8bf4-0ff0ffc94cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:57.192485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcf2ff-e8e2-4114-8bf4-0ff0ffc94cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:57.192760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcf2ff-e8e2-4114-8bf4-0ff0ffc94cf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:57.193455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcf2ff-e8e2-4114-8bf4-0ff0ffc94cf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:43:57.195399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcf2ff-e8e2-4114-8bf4-0ff0ffc94cf3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:43:57.285752 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3847/7628] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:43:57 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:43:57.289863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e923e5-7cb0-4fc6-ba3b-3b9a5d31454e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:43:57.300718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e923e5-7cb0-4fc6-ba3b-3b9a5d31454e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:43:57.318534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:57.357952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034f547-0d19-47c7-89c9-9f7b1bbfe1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:43:57.358634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034f547-0d19-47c7-89c9-9f7b1bbfe1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:57.358920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034f547-0d19-47c7-89c9-9f7b1bbfe1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:57.359232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034f547-0d19-47c7-89c9-9f7b1bbfe1f9 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:57.359973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034f547-0d19-47c7-89c9-9f7b1bbfe1f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:43:57.361955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034f547-0d19-47c7-89c9-9f7b1bbfe1f9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:43:57.439083 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3782/7629] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:43:57 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:43:57.443412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcf2ff-e8e2-4114-8bf4-0ff0ffc94cf3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:43:57.454023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcf2ff-e8e2-4114-8bf4-0ff0ffc94cf3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:43:57.460020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ceaf1d-7198-4927-b7ee-9230bb263467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:43:57.467468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ceaf1d-7198-4927-b7ee-9230bb263467 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:57.467468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ceaf1d-7198-4927-b7ee-9230bb263467 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:57.467468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ceaf1d-7198-4927-b7ee-9230bb263467 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:57.467468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ceaf1d-7198-4927-b7ee-9230bb263467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:43:57.467468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ceaf1d-7198-4927-b7ee-9230bb263467 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:43:57.474239 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3848/7630] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:43:57.478230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034f547-0d19-47c7-89c9-9f7b1bbfe1f9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:43:57.489732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034f547-0d19-47c7-89c9-9f7b1bbfe1f9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:43:57.494496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ba93b-d10a-45d9-a408-7b5e34495d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:43:57.495190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ba93b-d10a-45d9-a408-7b5e34495d38 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:57.495475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ba93b-d10a-45d9-a408-7b5e34495d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:57.495753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ba93b-d10a-45d9-a408-7b5e34495d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:57.496471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ba93b-d10a-45d9-a408-7b5e34495d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:43:57.498053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ba93b-d10a-45d9-a408-7b5e34495d38 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:43:57.515897 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3783/7631] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:43:57.517271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ceaf1d-7198-4927-b7ee-9230bb263467 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:43:57.527595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ceaf1d-7198-4927-b7ee-9230bb263467 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:43:57.532787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a8060-c1f8-4abf-a408-af6641003238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:43:57.533664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a8060-c1f8-4abf-a408-af6641003238 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:57.533963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a8060-c1f8-4abf-a408-af6641003238 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:57.534250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a8060-c1f8-4abf-a408-af6641003238 admin admin] PATH_INFO: `/v3/projects/8f296b14a61a4997bf411c9b0fdc39d5/users/001ed11a062a4cb08a52d1294ef5880b/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:57.550012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a8060-c1f8-4abf-a408-af6641003238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f296b14a61a4997bf411c9b0fdc39d5, user_id=001ed11a062a4cb08a52d1294ef5880b, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:43:57.553621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a8060-c1f8-4abf-a408-af6641003238 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:43:57.781704 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3849/7632] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:43:57 2022] PUT /identity/v3/projects/8f296b14a61a4997bf411c9b0fdc39d5/users/001ed11a062a4cb08a52d1294ef5880b/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:43:57.786879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29408b-f3bf-4c0b-be89-1e06cd802306 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:57.787199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29408b-f3bf-4c0b-be89-1e06cd802306 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:57.787476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29408b-f3bf-4c0b-be89-1e06cd802306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:57.808141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9b29408b-f3bf-4c0b-be89-1e06cd802306 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:43:57.809375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9b29408b-f3bf-4c0b-be89-1e06cd802306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:57.873845 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3784/7633] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:43:57.883938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a8060-c1f8-4abf-a408-af6641003238 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:43:57.885662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b56a8060-c1f8-4abf-a408-af6641003238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:57.901824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:43:57.955427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a8060-c1f8-4abf-a408-af6641003238 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:43:57.959313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e7538-9437-4e5d-baf6-9c1259853c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:43:57.964483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e7538-9437-4e5d-baf6-9c1259853c2c service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:57.964483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e7538-9437-4e5d-baf6-9c1259853c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:57.964483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e7538-9437-4e5d-baf6-9c1259853c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:57.971192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e7538-9437-4e5d-baf6-9c1259853c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:43:57.972739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e7538-9437-4e5d-baf6-9c1259853c2c service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:43:57.983540 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3850/7634] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:43:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:43:59.593372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29408b-f3bf-4c0b-be89-1e06cd802306 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:43:59.606928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29408b-f3bf-4c0b-be89-1e06cd802306 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:43:59.611134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adc105-74ba-4c0d-b398-222ebc50bbe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:43:59.611904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adc105-74ba-4c0d-b398-222ebc50bbe5 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:43:59.612304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adc105-74ba-4c0d-b398-222ebc50bbe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:43:59.612475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adc105-74ba-4c0d-b398-222ebc50bbe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:43:59.614259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-29adc105-74ba-4c0d-b398-222ebc50bbe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:43:59.628629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adc105-74ba-4c0d-b398-222ebc50bbe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:43:59.630303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adc105-74ba-4c0d-b398-222ebc50bbe5 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:43:59.644963 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3785/7635] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:43:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:44:07.237906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd0a23-e375-4fed-b20c-2004068e3942 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:07.238450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd0a23-e375-4fed-b20c-2004068e3942 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:07.238572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd0a23-e375-4fed-b20c-2004068e3942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:07.271362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ecbd0a23-e375-4fed-b20c-2004068e3942 None None] MFA Rules not processed for user `001ed11a062a4cb08a52d1294ef5880b`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:44:07.273537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ecbd0a23-e375-4fed-b20c-2004068e3942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:07.355782 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3851/7636] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:44:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:44:07.360281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adc105-74ba-4c0d-b398-222ebc50bbe5 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:07.375661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adc105-74ba-4c0d-b398-222ebc50bbe5 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:07.385301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db686f1a-d133-4de9-a8ad-19f64c519acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:07.386641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db686f1a-d133-4de9-a8ad-19f64c519acc admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:07.387555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db686f1a-d133-4de9-a8ad-19f64c519acc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:07.387940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db686f1a-d133-4de9-a8ad-19f64c519acc admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:07.388784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db686f1a-d133-4de9-a8ad-19f64c519acc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:07.391069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db686f1a-d133-4de9-a8ad-19f64c519acc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:07.571520 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3786/7637] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:44:07 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:44:07.575352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd0a23-e375-4fed-b20c-2004068e3942 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:07.592204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd0a23-e375-4fed-b20c-2004068e3942 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:07.683737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6382ef-54a0-4d95-8ba4-140b8544667a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:07.684769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6382ef-54a0-4d95-8ba4-140b8544667a admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:07.686738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6382ef-54a0-4d95-8ba4-140b8544667a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:07.687356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6382ef-54a0-4d95-8ba4-140b8544667a admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:07.688646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6382ef-54a0-4d95-8ba4-140b8544667a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:07.692287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6382ef-54a0-4d95-8ba4-140b8544667a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:07.836679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db686f1a-d133-4de9-a8ad-19f64c519acc admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:07.839853 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3852/7638] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:44:07 2022] POST /identity/v3/users => generated 298 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:44:07.849313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db686f1a-d133-4de9-a8ad-19f64c519acc admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:07.864994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf17527-897a-4cb4-a321-3363d640654a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:07.866207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf17527-897a-4cb4-a321-3363d640654a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:07.866731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf17527-897a-4cb4-a321-3363d640654a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:07.867439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf17527-897a-4cb4-a321-3363d640654a admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:07.874150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf17527-897a-4cb4-a321-3363d640654a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:07.879372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf17527-897a-4cb4-a321-3363d640654a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:07.909562 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3787/7639] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:44:07.909727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6382ef-54a0-4d95-8ba4-140b8544667a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:07.921080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6382ef-54a0-4d95-8ba4-140b8544667a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:07.927700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4ef58-6290-48a2-bd9d-c08a97e36ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:07.929140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4ef58-6290-48a2-bd9d-c08a97e36ca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:07.929420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4ef58-6290-48a2-bd9d-c08a97e36ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:07.929691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4ef58-6290-48a2-bd9d-c08a97e36ca1 admin admin] PATH_INFO: `/v3/projects/ab3f86df8ada4e308b248aa543a47a9b/users/cae2f313a57b4684a9330a80185cf651/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:07.950164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4ef58-6290-48a2-bd9d-c08a97e36ca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3f86df8ada4e308b248aa543a47a9b, user_id=cae2f313a57b4684a9330a80185cf651, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:07.952912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4ef58-6290-48a2-bd9d-c08a97e36ca1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:08.027211 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3853/7640] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:44:07 2022] PUT /identity/v3/projects/ab3f86df8ada4e308b248aa543a47a9b/users/cae2f313a57b4684a9330a80185cf651/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:44:08.031421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf17527-897a-4cb4-a321-3363d640654a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:08.043772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf17527-897a-4cb4-a321-3363d640654a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:08.124974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:08.135129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf17ed5-222c-44f4-9c42-7a8faf6adb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:08.135807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf17ed5-222c-44f4-9c42-7a8faf6adb20 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:08.136099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf17ed5-222c-44f4-9c42-7a8faf6adb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:08.136385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf17ed5-222c-44f4-9c42-7a8faf6adb20 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:08.137146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf17ed5-222c-44f4-9c42-7a8faf6adb20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:08.138874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf17ed5-222c-44f4-9c42-7a8faf6adb20 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:08.150178 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3788/7641] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:44:08.154726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4ef58-6290-48a2-bd9d-c08a97e36ca1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:08.166101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4ef58-6290-48a2-bd9d-c08a97e36ca1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:08.172345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951aa5c-8a64-44a2-8cb4-8b515983eabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:08.175426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951aa5c-8a64-44a2-8cb4-8b515983eabe admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:08.176049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951aa5c-8a64-44a2-8cb4-8b515983eabe admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:08.176471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951aa5c-8a64-44a2-8cb4-8b515983eabe admin admin] PATH_INFO: `/v3/projects/ab3f86df8ada4e308b248aa543a47a9b/users/cae2f313a57b4684a9330a80185cf651/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:08.178778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951aa5c-8a64-44a2-8cb4-8b515983eabe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3f86df8ada4e308b248aa543a47a9b, user_id=cae2f313a57b4684a9330a80185cf651, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:08.181533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951aa5c-8a64-44a2-8cb4-8b515983eabe admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:08.185089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:08.197898 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3854/7642] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:44:08 2022] PUT /identity/v3/projects/ab3f86df8ada4e308b248aa543a47a9b/users/cae2f313a57b4684a9330a80185cf651/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:44:12.911293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf17ed5-222c-44f4-9c42-7a8faf6adb20 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:12.913183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cbf17ed5-222c-44f4-9c42-7a8faf6adb20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:12.935702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf17ed5-222c-44f4-9c42-7a8faf6adb20 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:13.004367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8c57b-1f64-4a89-b855-9fa36ae12aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:13.005258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8c57b-1f64-4a89-b855-9fa36ae12aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:13.005536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8c57b-1f64-4a89-b855-9fa36ae12aad admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:13.005813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8c57b-1f64-4a89-b855-9fa36ae12aad admin admin] PATH_INFO: `/v3/users/726b46c54e9541fbb7825607bac3abe5` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:13.007124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8c57b-1f64-4a89-b855-9fa36ae12aad admin admin] RBAC: Authorizing `identity:delete_user(user_id=726b46c54e9541fbb7825607bac3abe5)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:13.009539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8c57b-1f64-4a89-b855-9fa36ae12aad admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:13.229011 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a2f8c57b-1f64-4a89-b855-9fa36ae12aad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '726b46c54e9541fbb7825607bac3abe5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:13.252370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a2f8c57b-1f64-4a89-b855-9fa36ae12aad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '726b46c54e9541fbb7825607bac3abe5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:13.362849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a2f8c57b-1f64-4a89-b855-9fa36ae12aad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '726b46c54e9541fbb7825607bac3abe5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:13.374064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a2f8c57b-1f64-4a89-b855-9fa36ae12aad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '726b46c54e9541fbb7825607bac3abe5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:13.375404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a2f8c57b-1f64-4a89-b855-9fa36ae12aad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '726b46c54e9541fbb7825607bac3abe5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:13.389197 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3789/7643] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:44:12 2022] DELETE /identity/v3/users/726b46c54e9541fbb7825607bac3abe5 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:44:13.823086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951aa5c-8a64-44a2-8cb4-8b515983eabe admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:13.825645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6951aa5c-8a64-44a2-8cb4-8b515983eabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:13.851414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951aa5c-8a64-44a2-8cb4-8b515983eabe admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:14.018473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135460e-2e98-40f1-aada-393c05d9be05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:14.018473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135460e-2e98-40f1-aada-393c05d9be05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:14.018473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135460e-2e98-40f1-aada-393c05d9be05 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:14.018473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135460e-2e98-40f1-aada-393c05d9be05 admin admin] PATH_INFO: `/v3/projects/0fd0ce287cb44cd59045868ce688909a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:14.019147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135460e-2e98-40f1-aada-393c05d9be05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd0ce287cb44cd59045868ce688909a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:14.021123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135460e-2e98-40f1-aada-393c05d9be05 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:14.148073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d135460e-2e98-40f1-aada-393c05d9be05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd0ce287cb44cd59045868ce688909a', 'request_id': 'req-d135460e-2e98-40f1-aada-393c05d9be05'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:14.154629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d135460e-2e98-40f1-aada-393c05d9be05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd0ce287cb44cd59045868ce688909a', 'request_id': 'req-d135460e-2e98-40f1-aada-393c05d9be05'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:14.161137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d135460e-2e98-40f1-aada-393c05d9be05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd0ce287cb44cd59045868ce688909a', 'request_id': 'req-d135460e-2e98-40f1-aada-393c05d9be05'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:14.261375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d135460e-2e98-40f1-aada-393c05d9be05 admin admin] The token cache is being invalidate because project 0fd0ce287cb44cd59045868ce688909a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:44:14.261631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d135460e-2e98-40f1-aada-393c05d9be05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:14.262304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d135460e-2e98-40f1-aada-393c05d9be05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:14.269974 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3855/7644] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:44:13 2022] DELETE /identity/v3/projects/0fd0ce287cb44cd59045868ce688909a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:44:14.270535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8c57b-1f64-4a89-b855-9fa36ae12aad admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:14.285740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8c57b-1f64-4a89-b855-9fa36ae12aad admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:14.370759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf95d3-90fc-41de-b268-3f5bad2c742b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:14.372104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf95d3-90fc-41de-b268-3f5bad2c742b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:14.372583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf95d3-90fc-41de-b268-3f5bad2c742b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:14.373944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf95d3-90fc-41de-b268-3f5bad2c742b admin admin] PATH_INFO: `/v3/users/0ba5f87a4b70404094fd8e8300b283c0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:14.375898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf95d3-90fc-41de-b268-3f5bad2c742b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba5f87a4b70404094fd8e8300b283c0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:14.380317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf95d3-90fc-41de-b268-3f5bad2c742b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:14.392497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:14.560083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-42cf95d3-90fc-41de-b268-3f5bad2c742b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba5f87a4b70404094fd8e8300b283c0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:14.574506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-42cf95d3-90fc-41de-b268-3f5bad2c742b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba5f87a4b70404094fd8e8300b283c0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:14.644544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-42cf95d3-90fc-41de-b268-3f5bad2c742b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba5f87a4b70404094fd8e8300b283c0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:14.655506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-42cf95d3-90fc-41de-b268-3f5bad2c742b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba5f87a4b70404094fd8e8300b283c0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:14.656695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-42cf95d3-90fc-41de-b268-3f5bad2c742b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba5f87a4b70404094fd8e8300b283c0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:14.665553 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3790/7645] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:44:14 2022] DELETE /identity/v3/users/0ba5f87a4b70404094fd8e8300b283c0 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:44:14.751272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135460e-2e98-40f1-aada-393c05d9be05 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:14.753495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d135460e-2e98-40f1-aada-393c05d9be05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:14.876426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135460e-2e98-40f1-aada-393c05d9be05 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:14.958866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:14.986796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2610966-fd8a-4286-9ece-42a11c794d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:14.990480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2610966-fd8a-4286-9ece-42a11c794d8b service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:14.990480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2610966-fd8a-4286-9ece-42a11c794d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:14.991197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2610966-fd8a-4286-9ece-42a11c794d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:14.993649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a2610966-fd8a-4286-9ece-42a11c794d8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:15.009636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2610966-fd8a-4286-9ece-42a11c794d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:15.011983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2610966-fd8a-4286-9ece-42a11c794d8b service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:15.027869 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3856/7646] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:44:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:44:15.074941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf95d3-90fc-41de-b268-3f5bad2c742b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:15.079459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-42cf95d3-90fc-41de-b268-3f5bad2c742b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:15.281228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf95d3-90fc-41de-b268-3f5bad2c742b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:15.294455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deee99c-74ff-491b-8151-7420f59f2296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:15.296250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deee99c-74ff-491b-8151-7420f59f2296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:15.300236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deee99c-74ff-491b-8151-7420f59f2296 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:15.300236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deee99c-74ff-491b-8151-7420f59f2296 admin admin] PATH_INFO: `/v3/projects/db5e06f3331c4c3bae79e05741e91534` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:15.300515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deee99c-74ff-491b-8151-7420f59f2296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db5e06f3331c4c3bae79e05741e91534)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:15.304543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deee99c-74ff-491b-8151-7420f59f2296 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:15.474963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6deee99c-74ff-491b-8151-7420f59f2296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db5e06f3331c4c3bae79e05741e91534', 'request_id': 'req-6deee99c-74ff-491b-8151-7420f59f2296'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:15.484149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6deee99c-74ff-491b-8151-7420f59f2296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db5e06f3331c4c3bae79e05741e91534', 'request_id': 'req-6deee99c-74ff-491b-8151-7420f59f2296'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:15.493575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6deee99c-74ff-491b-8151-7420f59f2296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db5e06f3331c4c3bae79e05741e91534', 'request_id': 'req-6deee99c-74ff-491b-8151-7420f59f2296'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:15.637129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6deee99c-74ff-491b-8151-7420f59f2296 admin admin] The token cache is being invalidate because project db5e06f3331c4c3bae79e05741e91534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:44:15.638330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6deee99c-74ff-491b-8151-7420f59f2296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:15.639123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6deee99c-74ff-491b-8151-7420f59f2296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:15.645623 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3791/7647] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:44:15 2022] DELETE /identity/v3/projects/db5e06f3331c4c3bae79e05741e91534 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:44:15.648434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2601370-4fd9-4b30-887b-30050da85082 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:15.648724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2601370-4fd9-4b30-887b-30050da85082 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:15.650180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2601370-4fd9-4b30-887b-30050da85082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:15.673154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e2601370-4fd9-4b30-887b-30050da85082 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:44:15.677455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e2601370-4fd9-4b30-887b-30050da85082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:15.821051 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3857/7648] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:44:15.828857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b88fde-f8e8-427b-af83-3d5e440dbe9a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:15.829202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b88fde-f8e8-427b-af83-3d5e440dbe9a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:15.829580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b88fde-f8e8-427b-af83-3d5e440dbe9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:15.872579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-35b88fde-f8e8-427b-af83-3d5e440dbe9a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:44:15.873816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-35b88fde-f8e8-427b-af83-3d5e440dbe9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:15.889193 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3792/7649] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:44:15.893999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2601370-4fd9-4b30-887b-30050da85082 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:15.910811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2601370-4fd9-4b30-887b-30050da85082 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:15.916863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b11de0-eefa-46fc-b5fd-85f2c7562ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:15.917401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b11de0-eefa-46fc-b5fd-85f2c7562ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:15.917899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b11de0-eefa-46fc-b5fd-85f2c7562ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:15.918239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b11de0-eefa-46fc-b5fd-85f2c7562ae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:15.919696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b11de0-eefa-46fc-b5fd-85f2c7562ae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:44:15.920142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b11de0-eefa-46fc-b5fd-85f2c7562ae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:15.922662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b11de0-eefa-46fc-b5fd-85f2c7562ae7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:15.942913 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3858/7650] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:44:15.943461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b88fde-f8e8-427b-af83-3d5e440dbe9a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:15.959627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b88fde-f8e8-427b-af83-3d5e440dbe9a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:15.967372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d8c7c-895b-48c1-ad09-27ff7e304c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:15.968400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d8c7c-895b-48c1-ad09-27ff7e304c09 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:15.968835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d8c7c-895b-48c1-ad09-27ff7e304c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:15.969216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d8c7c-895b-48c1-ad09-27ff7e304c09 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:15.970063 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d8c7c-895b-48c1-ad09-27ff7e304c09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:15.972747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d8c7c-895b-48c1-ad09-27ff7e304c09 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:15.984480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:16.073132 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3793/7651] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:44:15 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:44:16.077372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b11de0-eefa-46fc-b5fd-85f2c7562ae7 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:16.093092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b11de0-eefa-46fc-b5fd-85f2c7562ae7 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:16.163696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd70949-cd8d-4af4-85b0-d9bdb7296ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:16.164738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd70949-cd8d-4af4-85b0-d9bdb7296ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:16.165027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd70949-cd8d-4af4-85b0-d9bdb7296ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:16.165308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd70949-cd8d-4af4-85b0-d9bdb7296ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:16.166348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd70949-cd8d-4af4-85b0-d9bdb7296ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:16.168776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd70949-cd8d-4af4-85b0-d9bdb7296ce3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:16.263813 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3859/7652] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:44:16 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:44:16.268401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d8c7c-895b-48c1-ad09-27ff7e304c09 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:16.279182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d8c7c-895b-48c1-ad09-27ff7e304c09 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:16.285875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5da4cc-7528-4660-a50d-e9b8c2951a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:16.291230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5da4cc-7528-4660-a50d-e9b8c2951a33 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:16.291230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5da4cc-7528-4660-a50d-e9b8c2951a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:16.291230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5da4cc-7528-4660-a50d-e9b8c2951a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:16.291230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5da4cc-7528-4660-a50d-e9b8c2951a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:16.291230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5da4cc-7528-4660-a50d-e9b8c2951a33 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:16.302953 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3794/7653] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:44:16.307047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd70949-cd8d-4af4-85b0-d9bdb7296ce3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:16.318841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd70949-cd8d-4af4-85b0-d9bdb7296ce3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:16.326240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5900d-9686-494e-9437-0c78a3ac0645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:16.328539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5900d-9686-494e-9437-0c78a3ac0645 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:16.328539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5900d-9686-494e-9437-0c78a3ac0645 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:16.328539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5900d-9686-494e-9437-0c78a3ac0645 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:16.328539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5900d-9686-494e-9437-0c78a3ac0645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:16.330414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5900d-9686-494e-9437-0c78a3ac0645 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:16.347851 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3860/7654] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:44:16.349572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5da4cc-7528-4660-a50d-e9b8c2951a33 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:16.360875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5da4cc-7528-4660-a50d-e9b8c2951a33 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:16.366613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daafd81-ceee-4e60-ba8b-e98aa0dad4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:16.367864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daafd81-ceee-4e60-ba8b-e98aa0dad4e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:16.368333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daafd81-ceee-4e60-ba8b-e98aa0dad4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:16.368762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daafd81-ceee-4e60-ba8b-e98aa0dad4e9 admin admin] PATH_INFO: `/v3/projects/17459e07487944958c9c307e59e1c8dc/users/beae3bc561e141fc9229b40466840078/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:16.387611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daafd81-ceee-4e60-ba8b-e98aa0dad4e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17459e07487944958c9c307e59e1c8dc, user_id=beae3bc561e141fc9229b40466840078, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:16.390857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daafd81-ceee-4e60-ba8b-e98aa0dad4e9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:16.483181 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3795/7655] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:44:16 2022] PUT /identity/v3/projects/17459e07487944958c9c307e59e1c8dc/users/beae3bc561e141fc9229b40466840078/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:44:16.484763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec003c2f-9eee-421c-ad08-cffce82497b9 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:16.485156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec003c2f-9eee-421c-ad08-cffce82497b9 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:16.485532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec003c2f-9eee-421c-ad08-cffce82497b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:16.506014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ec003c2f-9eee-421c-ad08-cffce82497b9 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:44:16.507976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ec003c2f-9eee-421c-ad08-cffce82497b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:16.567749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:16.586868 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3861/7656] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:44:16.598057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daafd81-ceee-4e60-ba8b-e98aa0dad4e9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:16.600003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6daafd81-ceee-4e60-ba8b-e98aa0dad4e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:16.693866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daafd81-ceee-4e60-ba8b-e98aa0dad4e9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:16.698662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b041af-012c-4394-8102-646791a26193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:16.699519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b041af-012c-4394-8102-646791a26193 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:16.699889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b041af-012c-4394-8102-646791a26193 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:16.700251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b041af-012c-4394-8102-646791a26193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:16.712844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b041af-012c-4394-8102-646791a26193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:16.714413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b041af-012c-4394-8102-646791a26193 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:16.727055 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3796/7657] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:44:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:44:18.511317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587129e5-549a-4806-b2b2-139d17690fab None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:18.515037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587129e5-549a-4806-b2b2-139d17690fab None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:18.515037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587129e5-549a-4806-b2b2-139d17690fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:18.546569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-587129e5-549a-4806-b2b2-139d17690fab None None] MFA Rules not processed for user `cae2f313a57b4684a9330a80185cf651`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:44:18.547835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-587129e5-549a-4806-b2b2-139d17690fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:18.685017 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3862/7658] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:44:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:44:18.697549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b041af-012c-4394-8102-646791a26193 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:18.699309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-32b041af-012c-4394-8102-646791a26193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:18.778566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b041af-012c-4394-8102-646791a26193 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:18.782760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e89c34-065d-450c-a5f3-b064fef35378 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:18.784483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e89c34-065d-450c-a5f3-b064fef35378 service glance] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:18.784783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e89c34-065d-450c-a5f3-b064fef35378 service glance] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:18.785066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e89c34-065d-450c-a5f3-b064fef35378 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:18.787169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-70e89c34-065d-450c-a5f3-b064fef35378 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:18.876891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e89c34-065d-450c-a5f3-b064fef35378 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:18.878997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e89c34-065d-450c-a5f3-b064fef35378 service glance] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:18.892823 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3797/7659] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:44:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:44:23.730775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587129e5-549a-4806-b2b2-139d17690fab None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:23.754854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587129e5-549a-4806-b2b2-139d17690fab None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:23.761359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a09cc2-57ef-457a-b13a-40cbe540572a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:23.762069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a09cc2-57ef-457a-b13a-40cbe540572a service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:23.762354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a09cc2-57ef-457a-b13a-40cbe540572a service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:23.762626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a09cc2-57ef-457a-b13a-40cbe540572a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:23.769718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-68a09cc2-57ef-457a-b13a-40cbe540572a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:23.796452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a09cc2-57ef-457a-b13a-40cbe540572a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:23.798894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a09cc2-57ef-457a-b13a-40cbe540572a service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:23.827699 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3863/7660] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:44:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:44:25.890309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b159418-b8dc-4ecd-a1ed-f4c7c9588920 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:25.891788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b159418-b8dc-4ecd-a1ed-f4c7c9588920 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:25.892394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b159418-b8dc-4ecd-a1ed-f4c7c9588920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:25.918594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:25.938592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0b159418-b8dc-4ecd-a1ed-f4c7c9588920 None None] MFA Rules not processed for user `beae3bc561e141fc9229b40466840078`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:44:25.942110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0b159418-b8dc-4ecd-a1ed-f4c7c9588920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:26.039081 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3798/7661] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:44:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:44:26.052224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81007fb6-1131-45dc-be05-dcac7cfc32f5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:26.052715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81007fb6-1131-45dc-be05-dcac7cfc32f5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:26.052805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81007fb6-1131-45dc-be05-dcac7cfc32f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:26.080818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-81007fb6-1131-45dc-be05-dcac7cfc32f5 None None] MFA Rules not processed for user `beae3bc561e141fc9229b40466840078`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:44:26.082643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-81007fb6-1131-45dc-be05-dcac7cfc32f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:26.095261 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3864/7662] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:44:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:44:26.109397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b159418-b8dc-4ecd-a1ed-f4c7c9588920 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:26.111809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0b159418-b8dc-4ecd-a1ed-f4c7c9588920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:26.278698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b159418-b8dc-4ecd-a1ed-f4c7c9588920 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:26.285114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73553f1-2a0d-4f78-8c28-dbde0da9d5b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:26.285775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73553f1-2a0d-4f78-8c28-dbde0da9d5b1 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:26.286062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73553f1-2a0d-4f78-8c28-dbde0da9d5b1 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:26.286344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73553f1-2a0d-4f78-8c28-dbde0da9d5b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:26.294630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73553f1-2a0d-4f78-8c28-dbde0da9d5b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:26.296261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73553f1-2a0d-4f78-8c28-dbde0da9d5b1 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:26.306014 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3799/7663] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:44:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:44:26.569549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81007fb6-1131-45dc-be05-dcac7cfc32f5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:26.570989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-81007fb6-1131-45dc-be05-dcac7cfc32f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:26.587374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81007fb6-1131-45dc-be05-dcac7cfc32f5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:26.591286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1844b-b366-40e7-bb4c-2493f4d4bcca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:26.592176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1844b-b366-40e7-bb4c-2493f4d4bcca service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:26.592462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1844b-b366-40e7-bb4c-2493f4d4bcca service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:26.592742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1844b-b366-40e7-bb4c-2493f4d4bcca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:26.594561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0eb1844b-b366-40e7-bb4c-2493f4d4bcca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:26.609013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1844b-b366-40e7-bb4c-2493f4d4bcca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:26.610497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1844b-b366-40e7-bb4c-2493f4d4bcca service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:26.622701 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3865/7664] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:44:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:44:27.282353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73553f1-2a0d-4f78-8c28-dbde0da9d5b1 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:27.290785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73553f1-2a0d-4f78-8c28-dbde0da9d5b1 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:27.294592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dacfe-75b6-4f2b-abcf-7ed7164942ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:27.295344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dacfe-75b6-4f2b-abcf-7ed7164942ee service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:27.295832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dacfe-75b6-4f2b-abcf-7ed7164942ee service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:27.296116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dacfe-75b6-4f2b-abcf-7ed7164942ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:27.298486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-eb2dacfe-75b6-4f2b-abcf-7ed7164942ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:27.312389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2dacfe-75b6-4f2b-abcf-7ed7164942ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:27.315265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2dacfe-75b6-4f2b-abcf-7ed7164942ee service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:27.328436 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3800/7665] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:44:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:44:28.170540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1844b-b366-40e7-bb4c-2493f4d4bcca service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:28.172301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0eb1844b-b366-40e7-bb4c-2493f4d4bcca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:28.195611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1844b-b366-40e7-bb4c-2493f4d4bcca service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:28.202114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd1feb-c536-4a41-8e87-fafde49e7cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:28.207496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd1feb-c536-4a41-8e87-fafde49e7cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:28.207496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd1feb-c536-4a41-8e87-fafde49e7cae admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:28.207496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd1feb-c536-4a41-8e87-fafde49e7cae admin admin] PATH_INFO: `/v3/users/95cd6b54d8164de1a524b407a1852ebd` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:28.207969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd1feb-c536-4a41-8e87-fafde49e7cae admin admin] RBAC: Authorizing `identity:delete_user(user_id=95cd6b54d8164de1a524b407a1852ebd)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:28.209866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd1feb-c536-4a41-8e87-fafde49e7cae admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:28.698650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f7cd1feb-c536-4a41-8e87-fafde49e7cae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95cd6b54d8164de1a524b407a1852ebd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:28.708038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f7cd1feb-c536-4a41-8e87-fafde49e7cae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95cd6b54d8164de1a524b407a1852ebd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:28.837461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f7cd1feb-c536-4a41-8e87-fafde49e7cae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95cd6b54d8164de1a524b407a1852ebd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:28.838027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f7cd1feb-c536-4a41-8e87-fafde49e7cae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95cd6b54d8164de1a524b407a1852ebd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:28.853682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f7cd1feb-c536-4a41-8e87-fafde49e7cae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95cd6b54d8164de1a524b407a1852ebd'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:28.864029 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3866/7666] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:44:28 2022] DELETE /identity/v3/users/95cd6b54d8164de1a524b407a1852ebd => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:44:29.190164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dacfe-75b6-4f2b-abcf-7ed7164942ee service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:29.212113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dacfe-75b6-4f2b-abcf-7ed7164942ee service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:29.311517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd928c-f788-49b4-99ac-75a7b832740f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:29.312394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd928c-f788-49b4-99ac-75a7b832740f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:29.313024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd928c-f788-49b4-99ac-75a7b832740f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:29.313317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd928c-f788-49b4-99ac-75a7b832740f admin admin] PATH_INFO: `/v3/projects/56b8099d9406431284b4dd58b5c16359` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:29.315479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd928c-f788-49b4-99ac-75a7b832740f admin admin] RBAC: Authorizing `identity:delete_project(project_id=56b8099d9406431284b4dd58b5c16359)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:29.318018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd928c-f788-49b4-99ac-75a7b832740f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:29.350930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:29.491412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6fdd928c-f788-49b4-99ac-75a7b832740f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b8099d9406431284b4dd58b5c16359', 'request_id': 'req-6fdd928c-f788-49b4-99ac-75a7b832740f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:29.508483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6fdd928c-f788-49b4-99ac-75a7b832740f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b8099d9406431284b4dd58b5c16359', 'request_id': 'req-6fdd928c-f788-49b4-99ac-75a7b832740f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:29.525386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6fdd928c-f788-49b4-99ac-75a7b832740f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b8099d9406431284b4dd58b5c16359', 'request_id': 'req-6fdd928c-f788-49b4-99ac-75a7b832740f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:29.681603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6fdd928c-f788-49b4-99ac-75a7b832740f admin admin] The token cache is being invalidate because project 56b8099d9406431284b4dd58b5c16359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:44:29.688074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6fdd928c-f788-49b4-99ac-75a7b832740f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:29.688074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6fdd928c-f788-49b4-99ac-75a7b832740f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:29.688074 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3801/7667] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:44:29 2022] DELETE /identity/v3/projects/56b8099d9406431284b4dd58b5c16359 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:44:29.695308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbc309-8a9b-4ad4-9e7d-fc971a2c1fb5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:29.695308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbc309-8a9b-4ad4-9e7d-fc971a2c1fb5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:29.695924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbc309-8a9b-4ad4-9e7d-fc971a2c1fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:29.728205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-74fbc309-8a9b-4ad4-9e7d-fc971a2c1fb5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:44:29.729379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-74fbc309-8a9b-4ad4-9e7d-fc971a2c1fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:29.755786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:29.810724 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3867/7668] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:44:29.819607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddccc9-b0ec-435c-b401-bb6387582c1f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:29.820064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddccc9-b0ec-435c-b401-bb6387582c1f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:29.820444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddccc9-b0ec-435c-b401-bb6387582c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:29.842099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d3ddccc9-b0ec-435c-b401-bb6387582c1f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:44:29.843261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d3ddccc9-b0ec-435c-b401-bb6387582c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:29.854307 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3802/7669] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:44:29.858933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbc309-8a9b-4ad4-9e7d-fc971a2c1fb5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:29.878128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbc309-8a9b-4ad4-9e7d-fc971a2c1fb5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:29.887533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21413180-ddd1-4abc-bd2b-09acca1caf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:29.888406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21413180-ddd1-4abc-bd2b-09acca1caf40 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:29.889435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21413180-ddd1-4abc-bd2b-09acca1caf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:29.889822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21413180-ddd1-4abc-bd2b-09acca1caf40 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:29.890816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21413180-ddd1-4abc-bd2b-09acca1caf40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:44:29.891246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21413180-ddd1-4abc-bd2b-09acca1caf40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:29.893492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21413180-ddd1-4abc-bd2b-09acca1caf40 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:29.913594 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3868/7670] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:44:29.915731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddccc9-b0ec-435c-b401-bb6387582c1f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:29.929416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddccc9-b0ec-435c-b401-bb6387582c1f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:29.941921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7068930-df5f-455a-a63f-d3bae5bb55e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:29.943504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7068930-df5f-455a-a63f-d3bae5bb55e4 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:29.944642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7068930-df5f-455a-a63f-d3bae5bb55e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:29.945007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7068930-df5f-455a-a63f-d3bae5bb55e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:29.948434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7068930-df5f-455a-a63f-d3bae5bb55e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:29.951508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7068930-df5f-455a-a63f-d3bae5bb55e4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:30.072791 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3803/7671] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:44:29 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:44:30.077059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21413180-ddd1-4abc-bd2b-09acca1caf40 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:30.097485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21413180-ddd1-4abc-bd2b-09acca1caf40 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:30.231344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78de50-4764-4155-ac71-0771d28dd097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:30.233846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78de50-4764-4155-ac71-0771d28dd097 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:30.233846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78de50-4764-4155-ac71-0771d28dd097 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:30.233846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78de50-4764-4155-ac71-0771d28dd097 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:30.233846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78de50-4764-4155-ac71-0771d28dd097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:30.240256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78de50-4764-4155-ac71-0771d28dd097 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:30.349893 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3869/7672] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:44:30 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:44:30.353794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7068930-df5f-455a-a63f-d3bae5bb55e4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:30.365681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7068930-df5f-455a-a63f-d3bae5bb55e4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:30.372152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a063fb-bf3f-4a4b-a521-8ef05d5f7397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:30.373248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a063fb-bf3f-4a4b-a521-8ef05d5f7397 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:30.373612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a063fb-bf3f-4a4b-a521-8ef05d5f7397 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:30.374054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a063fb-bf3f-4a4b-a521-8ef05d5f7397 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:30.374799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a063fb-bf3f-4a4b-a521-8ef05d5f7397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:30.379428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a063fb-bf3f-4a4b-a521-8ef05d5f7397 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:30.392964 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3804/7673] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:44:30.394563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78de50-4764-4155-ac71-0771d28dd097 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:30.425416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78de50-4764-4155-ac71-0771d28dd097 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:30.437581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777d3aa-e520-47ee-bbb9-7bcfc5b2999c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:30.438366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777d3aa-e520-47ee-bbb9-7bcfc5b2999c admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:30.438739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777d3aa-e520-47ee-bbb9-7bcfc5b2999c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:30.439152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777d3aa-e520-47ee-bbb9-7bcfc5b2999c admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:30.439965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777d3aa-e520-47ee-bbb9-7bcfc5b2999c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:30.441738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777d3aa-e520-47ee-bbb9-7bcfc5b2999c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:30.477250 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3870/7674] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:44:30.477663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a063fb-bf3f-4a4b-a521-8ef05d5f7397 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:30.554245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a063fb-bf3f-4a4b-a521-8ef05d5f7397 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:30.572862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5026a2-5ff9-4eee-a8df-60e58418c252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:30.576914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5026a2-5ff9-4eee-a8df-60e58418c252 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:30.580418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5026a2-5ff9-4eee-a8df-60e58418c252 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:30.581218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5026a2-5ff9-4eee-a8df-60e58418c252 admin admin] PATH_INFO: `/v3/projects/66e868bfbef34f6da9a42f800ef955a4/users/227a4d3cbc8a4cfd8bde5f6a6b972d7d/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:30.647768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5026a2-5ff9-4eee-a8df-60e58418c252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e868bfbef34f6da9a42f800ef955a4, user_id=227a4d3cbc8a4cfd8bde5f6a6b972d7d, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:30.652685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5026a2-5ff9-4eee-a8df-60e58418c252 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:30.789328 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3805/7675] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:44:30 2022] PUT /identity/v3/projects/66e868bfbef34f6da9a42f800ef955a4/users/227a4d3cbc8a4cfd8bde5f6a6b972d7d/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:44:30.800325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c3da3-8107-480f-af32-d5d8a238839d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:30.800874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c3da3-8107-480f-af32-d5d8a238839d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:30.800874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c3da3-8107-480f-af32-d5d8a238839d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:30.878358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a98c3da3-8107-480f-af32-d5d8a238839d None None] MFA Rules not processed for user `227a4d3cbc8a4cfd8bde5f6a6b972d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:44:30.880222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a98c3da3-8107-480f-af32-d5d8a238839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:31.003664 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3871/7676] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:44:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:44:31.008297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5026a2-5ff9-4eee-a8df-60e58418c252 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:31.086083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5026a2-5ff9-4eee-a8df-60e58418c252 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:31.090827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063ae45-11a0-4752-8169-aa26773e9750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:31.091535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063ae45-11a0-4752-8169-aa26773e9750 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:31.091823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063ae45-11a0-4752-8169-aa26773e9750 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:31.092106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063ae45-11a0-4752-8169-aa26773e9750 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:31.092800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063ae45-11a0-4752-8169-aa26773e9750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:31.094742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063ae45-11a0-4752-8169-aa26773e9750 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:31.218496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c3da3-8107-480f-af32-d5d8a238839d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:31.225903 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3806/7677] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:44:31 2022] POST /identity/v3/projects => generated 387 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:44:31.241311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c3da3-8107-480f-af32-d5d8a238839d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:31.251899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:31.318392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49b444-11a9-418c-a88b-a66d8ad06892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:31.319154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49b444-11a9-418c-a88b-a66d8ad06892 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:31.319815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49b444-11a9-418c-a88b-a66d8ad06892 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:31.320101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49b444-11a9-418c-a88b-a66d8ad06892 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:31.320797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49b444-11a9-418c-a88b-a66d8ad06892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:31.322760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49b444-11a9-418c-a88b-a66d8ad06892 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:31.502917 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3872/7678] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:44:31 2022] POST /identity/v3/users => generated 301 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:44:31.506830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063ae45-11a0-4752-8169-aa26773e9750 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:31.524161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063ae45-11a0-4752-8169-aa26773e9750 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:31.531458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cac7cd-b62f-4bec-a9c6-6d035d457130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:31.532438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cac7cd-b62f-4bec-a9c6-6d035d457130 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:31.532768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cac7cd-b62f-4bec-a9c6-6d035d457130 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:31.533052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cac7cd-b62f-4bec-a9c6-6d035d457130 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:31.533879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cac7cd-b62f-4bec-a9c6-6d035d457130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:31.536301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cac7cd-b62f-4bec-a9c6-6d035d457130 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:31.554495 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3807/7679] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:44:31.556191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49b444-11a9-418c-a88b-a66d8ad06892 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:31.570553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49b444-11a9-418c-a88b-a66d8ad06892 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:31.575609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5131b-73de-4ad9-a9de-300df0f18b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:31.577413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5131b-73de-4ad9-a9de-300df0f18b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:31.577413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5131b-73de-4ad9-a9de-300df0f18b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:31.577413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5131b-73de-4ad9-a9de-300df0f18b01 admin admin] PATH_INFO: `/v3/projects/f2abc568c6ec46e5a74c0d86935a57f8/users/e6c566c1c8de4c20a9e7fda5f212f0d7/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:31.603135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5131b-73de-4ad9-a9de-300df0f18b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2abc568c6ec46e5a74c0d86935a57f8, user_id=e6c566c1c8de4c20a9e7fda5f212f0d7, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:31.606398 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5131b-73de-4ad9-a9de-300df0f18b01 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:31.677421 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3873/7680] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:44:31 2022] PUT /identity/v3/projects/f2abc568c6ec46e5a74c0d86935a57f8/users/e6c566c1c8de4c20a9e7fda5f212f0d7/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:44:31.687590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c0286-7751-412b-8668-496bc7a2359f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:31.688139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c0286-7751-412b-8668-496bc7a2359f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:31.688592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c0286-7751-412b-8668-496bc7a2359f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:31.718748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:31.724445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6e0c0286-7751-412b-8668-496bc7a2359f None None] MFA Rules not processed for user `e6c566c1c8de4c20a9e7fda5f212f0d7`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:44:31.724445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6e0c0286-7751-412b-8668-496bc7a2359f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:31.826651 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3808/7681] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:44:31 2022] POST /identity/v3/auth/tokens => generated 3261 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:44:31.859878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5131b-73de-4ad9-a9de-300df0f18b01 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:31.868049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1fb5131b-73de-4ad9-a9de-300df0f18b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:31.973466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5131b-73de-4ad9-a9de-300df0f18b01 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:31.982186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585975d-1b25-4783-b083-6df340933571 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:31.983203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585975d-1b25-4783-b083-6df340933571 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:31.983674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585975d-1b25-4783-b083-6df340933571 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:31.984119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585975d-1b25-4783-b083-6df340933571 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:32.000131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585975d-1b25-4783-b083-6df340933571 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:32.003138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585975d-1b25-4783-b083-6df340933571 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:32.041611 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3874/7682] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:44:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:44:35.331533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c0286-7751-412b-8668-496bc7a2359f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:35.478535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c0286-7751-412b-8668-496bc7a2359f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:35.484908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827c7ae-63d4-4cca-8792-b7211ec84716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:35.486112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827c7ae-63d4-4cca-8792-b7211ec84716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:35.486745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827c7ae-63d4-4cca-8792-b7211ec84716 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:35.487262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827c7ae-63d4-4cca-8792-b7211ec84716 admin admin] PATH_INFO: `/v3/users/227a4d3cbc8a4cfd8bde5f6a6b972d7d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:35.488991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827c7ae-63d4-4cca-8792-b7211ec84716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=227a4d3cbc8a4cfd8bde5f6a6b972d7d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:35.491362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827c7ae-63d4-4cca-8792-b7211ec84716 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:35.710189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a827c7ae-63d4-4cca-8792-b7211ec84716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '227a4d3cbc8a4cfd8bde5f6a6b972d7d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:35.745619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a827c7ae-63d4-4cca-8792-b7211ec84716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '227a4d3cbc8a4cfd8bde5f6a6b972d7d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:35.855177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a827c7ae-63d4-4cca-8792-b7211ec84716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '227a4d3cbc8a4cfd8bde5f6a6b972d7d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:35.874160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a827c7ae-63d4-4cca-8792-b7211ec84716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '227a4d3cbc8a4cfd8bde5f6a6b972d7d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:35.875048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a827c7ae-63d4-4cca-8792-b7211ec84716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '227a4d3cbc8a4cfd8bde5f6a6b972d7d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:35.882883 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3809/7683] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:44:35 2022] DELETE /identity/v3/users/227a4d3cbc8a4cfd8bde5f6a6b972d7d => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:44:35.888624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d4702-d1f7-4516-bc0c-f9dd7b5a7a29 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:35.889156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d4702-d1f7-4516-bc0c-f9dd7b5a7a29 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:35.889156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d4702-d1f7-4516-bc0c-f9dd7b5a7a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:35.908171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-595d4702-d1f7-4516-bc0c-f9dd7b5a7a29 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:44:35.909369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-595d4702-d1f7-4516-bc0c-f9dd7b5a7a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:36.029187 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3875/7684] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:44:36.041066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827c7ae-63d4-4cca-8792-b7211ec84716 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:36.044201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a827c7ae-63d4-4cca-8792-b7211ec84716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:36.097692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:36.166506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827c7ae-63d4-4cca-8792-b7211ec84716 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:36.172575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d303ce-308a-4758-9f7d-95e5722d1405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:36.173585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d303ce-308a-4758-9f7d-95e5722d1405 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:36.174042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d303ce-308a-4758-9f7d-95e5722d1405 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:36.174584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d303ce-308a-4758-9f7d-95e5722d1405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:36.185683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d303ce-308a-4758-9f7d-95e5722d1405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:36.187218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d303ce-308a-4758-9f7d-95e5722d1405 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:36.200500 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3810/7685] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:44:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:44:36.682256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d4702-d1f7-4516-bc0c-f9dd7b5a7a29 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:36.682734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-595d4702-d1f7-4516-bc0c-f9dd7b5a7a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:36.714778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d4702-d1f7-4516-bc0c-f9dd7b5a7a29 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:36.718920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a885c5b-d368-4f14-a989-4c104241cdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:36.720421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a885c5b-d368-4f14-a989-4c104241cdfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:36.720714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a885c5b-d368-4f14-a989-4c104241cdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:36.721325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a885c5b-d368-4f14-a989-4c104241cdfa admin admin] PATH_INFO: `/v3/projects/66e868bfbef34f6da9a42f800ef955a4` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:36.722149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a885c5b-d368-4f14-a989-4c104241cdfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e868bfbef34f6da9a42f800ef955a4)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:36.724151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a885c5b-d368-4f14-a989-4c104241cdfa admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:36.725890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:36.944438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8a885c5b-d368-4f14-a989-4c104241cdfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e868bfbef34f6da9a42f800ef955a4', 'request_id': 'req-8a885c5b-d368-4f14-a989-4c104241cdfa'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:36.968694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8a885c5b-d368-4f14-a989-4c104241cdfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e868bfbef34f6da9a42f800ef955a4', 'request_id': 'req-8a885c5b-d368-4f14-a989-4c104241cdfa'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:36.982766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8a885c5b-d368-4f14-a989-4c104241cdfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e868bfbef34f6da9a42f800ef955a4', 'request_id': 'req-8a885c5b-d368-4f14-a989-4c104241cdfa'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:37.059813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8a885c5b-d368-4f14-a989-4c104241cdfa admin admin] The token cache is being invalidate because project 66e868bfbef34f6da9a42f800ef955a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:44:37.060399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8a885c5b-d368-4f14-a989-4c104241cdfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:37.061230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8a885c5b-d368-4f14-a989-4c104241cdfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:37.063335 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3876/7686] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:44:36 2022] DELETE /identity/v3/projects/66e868bfbef34f6da9a42f800ef955a4 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:44:37.067190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d303ce-308a-4758-9f7d-95e5722d1405 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:37.081023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d303ce-308a-4758-9f7d-95e5722d1405 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:37.162839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2b7e9-dc80-4568-98bb-9ad08cd3f8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:37.162839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2b7e9-dc80-4568-98bb-9ad08cd3f8bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:37.162839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2b7e9-dc80-4568-98bb-9ad08cd3f8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:37.162839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2b7e9-dc80-4568-98bb-9ad08cd3f8bb admin admin] PATH_INFO: `/v3/users/e6c566c1c8de4c20a9e7fda5f212f0d7` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:37.163256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2b7e9-dc80-4568-98bb-9ad08cd3f8bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c566c1c8de4c20a9e7fda5f212f0d7)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:37.163256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2b7e9-dc80-4568-98bb-9ad08cd3f8bb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:37.380295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7cf2b7e9-dc80-4568-98bb-9ad08cd3f8bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c566c1c8de4c20a9e7fda5f212f0d7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:37.407098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7cf2b7e9-dc80-4568-98bb-9ad08cd3f8bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c566c1c8de4c20a9e7fda5f212f0d7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:37.457898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8259a9-7e26-4df1-8ee0-3d8cc797bd76 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:37.458236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8259a9-7e26-4df1-8ee0-3d8cc797bd76 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:37.458774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8259a9-7e26-4df1-8ee0-3d8cc797bd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:37.482846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7b8259a9-7e26-4df1-8ee0-3d8cc797bd76 None None] MFA Rules not processed for user `833136cbdeab4b9e8b6dd2d24c7c8753`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:44:37.487792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7b8259a9-7e26-4df1-8ee0-3d8cc797bd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:37.534717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7cf2b7e9-dc80-4568-98bb-9ad08cd3f8bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c566c1c8de4c20a9e7fda5f212f0d7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:37.545409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7cf2b7e9-dc80-4568-98bb-9ad08cd3f8bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c566c1c8de4c20a9e7fda5f212f0d7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:37.546984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7cf2b7e9-dc80-4568-98bb-9ad08cd3f8bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c566c1c8de4c20a9e7fda5f212f0d7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:37.561008 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3811/7687] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:44:37 2022] DELETE /identity/v3/users/e6c566c1c8de4c20a9e7fda5f212f0d7 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:44:37.568418 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3877/7688] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:44:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:44:38.668537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2b7e9-dc80-4568-98bb-9ad08cd3f8bb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:38.671361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7cf2b7e9-dc80-4568-98bb-9ad08cd3f8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:38.736121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:38.763151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2b7e9-dc80-4568-98bb-9ad08cd3f8bb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:38.769891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211cbd2-538b-41f0-8ba2-f7e7e592b6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:38.771156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211cbd2-538b-41f0-8ba2-f7e7e592b6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:38.771796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211cbd2-538b-41f0-8ba2-f7e7e592b6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:38.772270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211cbd2-538b-41f0-8ba2-f7e7e592b6f4 admin admin] PATH_INFO: `/v3/projects/f2abc568c6ec46e5a74c0d86935a57f8` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:38.775780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211cbd2-538b-41f0-8ba2-f7e7e592b6f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2abc568c6ec46e5a74c0d86935a57f8)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:38.778533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211cbd2-538b-41f0-8ba2-f7e7e592b6f4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:38.917741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9211cbd2-538b-41f0-8ba2-f7e7e592b6f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2abc568c6ec46e5a74c0d86935a57f8', 'request_id': 'req-9211cbd2-538b-41f0-8ba2-f7e7e592b6f4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:38.923956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9211cbd2-538b-41f0-8ba2-f7e7e592b6f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2abc568c6ec46e5a74c0d86935a57f8', 'request_id': 'req-9211cbd2-538b-41f0-8ba2-f7e7e592b6f4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:38.939796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9211cbd2-538b-41f0-8ba2-f7e7e592b6f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2abc568c6ec46e5a74c0d86935a57f8', 'request_id': 'req-9211cbd2-538b-41f0-8ba2-f7e7e592b6f4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:39.061034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9211cbd2-538b-41f0-8ba2-f7e7e592b6f4 admin admin] The token cache is being invalidate because project f2abc568c6ec46e5a74c0d86935a57f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:44:39.061466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9211cbd2-538b-41f0-8ba2-f7e7e592b6f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:39.065667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9211cbd2-538b-41f0-8ba2-f7e7e592b6f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:44:39.076337 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3812/7689] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:44:38 2022] DELETE /identity/v3/projects/f2abc568c6ec46e5a74c0d86935a57f8 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:44:39.081734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eac70-e2b3-4f9b-8e2a-0a8d49e2bf6a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:39.082205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eac70-e2b3-4f9b-8e2a-0a8d49e2bf6a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:39.082296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eac70-e2b3-4f9b-8e2a-0a8d49e2bf6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:39.132226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-791eac70-e2b3-4f9b-8e2a-0a8d49e2bf6a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:44:39.133433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-791eac70-e2b3-4f9b-8e2a-0a8d49e2bf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:39.232791 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3878/7690] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:44:39.242956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a657a-74ef-40cf-8300-ebcd700bdbca None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:39.243616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a657a-74ef-40cf-8300-ebcd700bdbca None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:39.244611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a657a-74ef-40cf-8300-ebcd700bdbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:39.275696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-fd8a657a-74ef-40cf-8300-ebcd700bdbca None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:44:39.277429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fd8a657a-74ef-40cf-8300-ebcd700bdbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:39.287621 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3813/7691] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:44:39.296401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791eac70-e2b3-4f9b-8e2a-0a8d49e2bf6a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:39.309481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791eac70-e2b3-4f9b-8e2a-0a8d49e2bf6a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:39.315330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317feb6-c6a2-429c-a08e-63b2afcd5ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:39.316128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317feb6-c6a2-429c-a08e-63b2afcd5ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:39.316265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317feb6-c6a2-429c-a08e-63b2afcd5ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:39.316568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317feb6-c6a2-429c-a08e-63b2afcd5ac1 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:39.317369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317feb6-c6a2-429c-a08e-63b2afcd5ac1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:44:39.317579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317feb6-c6a2-429c-a08e-63b2afcd5ac1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:39.319204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317feb6-c6a2-429c-a08e-63b2afcd5ac1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:39.338708 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3879/7692] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:44:39.340172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a657a-74ef-40cf-8300-ebcd700bdbca None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:39.350817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a657a-74ef-40cf-8300-ebcd700bdbca None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:39.356131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3fd50-89e1-4d04-8d1c-d10edd4cb7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:39.356820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3fd50-89e1-4d04-8d1c-d10edd4cb7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:39.357108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3fd50-89e1-4d04-8d1c-d10edd4cb7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:39.357394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3fd50-89e1-4d04-8d1c-d10edd4cb7c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:39.358101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3fd50-89e1-4d04-8d1c-d10edd4cb7c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:39.360102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3fd50-89e1-4d04-8d1c-d10edd4cb7c3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:39.456661 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3814/7693] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:44:39 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:44:39.461370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317feb6-c6a2-429c-a08e-63b2afcd5ac1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:39.479298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317feb6-c6a2-429c-a08e-63b2afcd5ac1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:39.504644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:39.562528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec937e3e-beb5-448c-8866-ed2d233210a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:39.564788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec937e3e-beb5-448c-8866-ed2d233210a9 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:39.564975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec937e3e-beb5-448c-8866-ed2d233210a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:39.565321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec937e3e-beb5-448c-8866-ed2d233210a9 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:39.566115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec937e3e-beb5-448c-8866-ed2d233210a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:39.568632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec937e3e-beb5-448c-8866-ed2d233210a9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:39.691722 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3880/7694] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:44:39 2022] POST /identity/v3/users => generated 288 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:44:39.695685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3fd50-89e1-4d04-8d1c-d10edd4cb7c3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:39.710919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3fd50-89e1-4d04-8d1c-d10edd4cb7c3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:39.717223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dad4a-26d4-4945-a469-585a7b1f55a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:39.718276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dad4a-26d4-4945-a469-585a7b1f55a0 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:39.718762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dad4a-26d4-4945-a469-585a7b1f55a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:39.719144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dad4a-26d4-4945-a469-585a7b1f55a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:39.721280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454dad4a-26d4-4945-a469-585a7b1f55a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:39.723149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454dad4a-26d4-4945-a469-585a7b1f55a0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:39.736707 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3815/7695] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:44:39.741130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec937e3e-beb5-448c-8866-ed2d233210a9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:39.752444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec937e3e-beb5-448c-8866-ed2d233210a9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:39.757811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815da04f-1651-4328-b7d4-ffa43e5137cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:39.758645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815da04f-1651-4328-b7d4-ffa43e5137cc admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:39.758994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815da04f-1651-4328-b7d4-ffa43e5137cc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:39.759292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815da04f-1651-4328-b7d4-ffa43e5137cc admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:39.760283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815da04f-1651-4328-b7d4-ffa43e5137cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:39.762097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815da04f-1651-4328-b7d4-ffa43e5137cc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:39.778995 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3881/7696] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:44:39.780610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dad4a-26d4-4945-a469-585a7b1f55a0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:39.804412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dad4a-26d4-4945-a469-585a7b1f55a0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:39.804412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc59f9-34aa-4314-a75f-8a984a41ce6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:39.804412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc59f9-34aa-4314-a75f-8a984a41ce6d admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:39.804412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc59f9-34aa-4314-a75f-8a984a41ce6d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:39.804747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc59f9-34aa-4314-a75f-8a984a41ce6d admin admin] PATH_INFO: `/v3/projects/68133056394c45b7b3166697a3cb0f37/users/5911af42fa4c4d7c81ac17f8a6595e3d/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:39.825126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc59f9-34aa-4314-a75f-8a984a41ce6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=68133056394c45b7b3166697a3cb0f37, user_id=5911af42fa4c4d7c81ac17f8a6595e3d, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:39.828030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc59f9-34aa-4314-a75f-8a984a41ce6d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:39.948285 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3816/7697] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:44:39 2022] PUT /identity/v3/projects/68133056394c45b7b3166697a3cb0f37/users/5911af42fa4c4d7c81ac17f8a6595e3d/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:44:39.954613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db40cb-5fba-4b3f-99ed-9ebe8d1392da None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:39.956436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db40cb-5fba-4b3f-99ed-9ebe8d1392da None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:39.956947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db40cb-5fba-4b3f-99ed-9ebe8d1392da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:39.983091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d0db40cb-5fba-4b3f-99ed-9ebe8d1392da None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:44:39.984601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d0db40cb-5fba-4b3f-99ed-9ebe8d1392da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:40.072171 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3882/7698] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:44:40.084023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc59f9-34aa-4314-a75f-8a984a41ce6d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:40.086015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-11bc59f9-34aa-4314-a75f-8a984a41ce6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:40.187616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc59f9-34aa-4314-a75f-8a984a41ce6d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:40.192384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6dbd4-bb1f-4284-816b-050971da1810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:40.193598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6dbd4-bb1f-4284-816b-050971da1810 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:40.193886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6dbd4-bb1f-4284-816b-050971da1810 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:40.194166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6dbd4-bb1f-4284-816b-050971da1810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:40.223321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6dbd4-bb1f-4284-816b-050971da1810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:40.224884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6dbd4-bb1f-4284-816b-050971da1810 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:40.236606 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3817/7699] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:44:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:44:48.468244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39e251-6d7d-4169-a9fe-98296742f546 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:48.470203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39e251-6d7d-4169-a9fe-98296742f546 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:48.470203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39e251-6d7d-4169-a9fe-98296742f546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:48.513145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6c39e251-6d7d-4169-a9fe-98296742f546 None None] MFA Rules not processed for user `5911af42fa4c4d7c81ac17f8a6595e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:44:48.514612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6c39e251-6d7d-4169-a9fe-98296742f546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:48.617401 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3883/7700] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:44:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:44:48.618566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6dbd4-bb1f-4284-816b-050971da1810 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:48.630806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6dbd4-bb1f-4284-816b-050971da1810 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:48.637395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f26983-090b-4cf8-97b6-307dae8bbc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:48.638182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f26983-090b-4cf8-97b6-307dae8bbc3c admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:48.638470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f26983-090b-4cf8-97b6-307dae8bbc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:48.639658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f26983-090b-4cf8-97b6-307dae8bbc3c admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:48.639658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f26983-090b-4cf8-97b6-307dae8bbc3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:48.641541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f26983-090b-4cf8-97b6-307dae8bbc3c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:48.652398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:48.763077 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3818/7701] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:44:48 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:44:48.771071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39e251-6d7d-4169-a9fe-98296742f546 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:48.790167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39e251-6d7d-4169-a9fe-98296742f546 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:48.834149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:44:48.888330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b1a2d-0d4a-416f-9954-dca12d0821f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:48.889098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b1a2d-0d4a-416f-9954-dca12d0821f8 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:48.889294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b1a2d-0d4a-416f-9954-dca12d0821f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:48.889576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b1a2d-0d4a-416f-9954-dca12d0821f8 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:48.891145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b1a2d-0d4a-416f-9954-dca12d0821f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:48.894732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b1a2d-0d4a-416f-9954-dca12d0821f8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:48.995753 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3884/7702] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:44:48 2022] POST /identity/v3/users => generated 294 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:44:48.999858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f26983-090b-4cf8-97b6-307dae8bbc3c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:49.027253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f26983-090b-4cf8-97b6-307dae8bbc3c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:49.045252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce728a0-1e4d-4483-9df0-35de1c7243cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:49.045252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce728a0-1e4d-4483-9df0-35de1c7243cd admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:49.045252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce728a0-1e4d-4483-9df0-35de1c7243cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:49.045252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce728a0-1e4d-4483-9df0-35de1c7243cd admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:49.045732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce728a0-1e4d-4483-9df0-35de1c7243cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:49.049028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce728a0-1e4d-4483-9df0-35de1c7243cd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:49.076109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b1a2d-0d4a-416f-9954-dca12d0821f8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:49.086121 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3819/7703] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:44:49.093179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b1a2d-0d4a-416f-9954-dca12d0821f8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:49.109332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002c081-b4dc-4fba-b360-c727e0eeeba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:49.111255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002c081-b4dc-4fba-b360-c727e0eeeba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:49.111643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002c081-b4dc-4fba-b360-c727e0eeeba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:49.115476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002c081-b4dc-4fba-b360-c727e0eeeba2 admin admin] PATH_INFO: `/v3/projects/b351f1a2d6434cd0b3b03628a0befe14/users/e32ea3fe570b40b59110b70fbb0c3caf/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:49.143390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002c081-b4dc-4fba-b360-c727e0eeeba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b351f1a2d6434cd0b3b03628a0befe14, user_id=e32ea3fe570b40b59110b70fbb0c3caf, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:49.147330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002c081-b4dc-4fba-b360-c727e0eeeba2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:49.245094 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3885/7704] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:44:49 2022] PUT /identity/v3/projects/b351f1a2d6434cd0b3b03628a0befe14/users/e32ea3fe570b40b59110b70fbb0c3caf/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:44:49.249101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce728a0-1e4d-4483-9df0-35de1c7243cd admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:49.260574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce728a0-1e4d-4483-9df0-35de1c7243cd admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:49.361643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b531f30-134f-4ecb-9316-e39b843c5c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:49.365938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b531f30-134f-4ecb-9316-e39b843c5c70 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:49.366231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b531f30-134f-4ecb-9316-e39b843c5c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:49.366514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b531f30-134f-4ecb-9316-e39b843c5c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:49.367284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b531f30-134f-4ecb-9316-e39b843c5c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:49.368919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b531f30-134f-4ecb-9316-e39b843c5c70 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:49.384514 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3820/7705] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:44:49.400009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002c081-b4dc-4fba-b360-c727e0eeeba2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:44:49.422108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002c081-b4dc-4fba-b360-c727e0eeeba2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:44:49.431429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5154b-6797-4c63-b9f2-688b683060b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:44:49.432562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5154b-6797-4c63-b9f2-688b683060b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:49.432848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5154b-6797-4c63-b9f2-688b683060b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:49.435076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5154b-6797-4c63-b9f2-688b683060b4 admin admin] PATH_INFO: `/v3/projects/b351f1a2d6434cd0b3b03628a0befe14/users/e32ea3fe570b40b59110b70fbb0c3caf/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:49.437593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5154b-6797-4c63-b9f2-688b683060b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b351f1a2d6434cd0b3b03628a0befe14, user_id=e32ea3fe570b40b59110b70fbb0c3caf, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:44:49.441323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5154b-6797-4c63-b9f2-688b683060b4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:44:49.479077 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3886/7706] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:44:49 2022] PUT /identity/v3/projects/b351f1a2d6434cd0b3b03628a0befe14/users/e32ea3fe570b40b59110b70fbb0c3caf/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:44:56.434064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79f142-c570-427f-8920-a41a82e4b61b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:44:56.434566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79f142-c570-427f-8920-a41a82e4b61b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:44:56.434685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79f142-c570-427f-8920-a41a82e4b61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:44:56.452952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8d79f142-c570-427f-8920-a41a82e4b61b None None] MFA Rules not processed for user `0ab8b3f06e994bbca5d6dd14109bfe50`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:44:56.454239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8d79f142-c570-427f-8920-a41a82e4b61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:44:56.550802 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3821/7707] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:44:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:44:59.467326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=30,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:00.619992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a833f-81ce-406d-8e09-21b716d28348 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:00.619992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a833f-81ce-406d-8e09-21b716d28348 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:00.619992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a833f-81ce-406d-8e09-21b716d28348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:00.715981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-459a833f-81ce-406d-8e09-21b716d28348 None None] MFA Rules not processed for user `e32ea3fe570b40b59110b70fbb0c3caf`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:45:00.715981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-459a833f-81ce-406d-8e09-21b716d28348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:00.892159 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3887/7708] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:45:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:45:00.901362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79f142-c570-427f-8920-a41a82e4b61b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:00.903243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8d79f142-c570-427f-8920-a41a82e4b61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:01.019640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79f142-c570-427f-8920-a41a82e4b61b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:01.025253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495f78e-e0b7-4ad8-a174-a5c7090598e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:01.025955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495f78e-e0b7-4ad8-a174-a5c7090598e3 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:01.026244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495f78e-e0b7-4ad8-a174-a5c7090598e3 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:01.026519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495f78e-e0b7-4ad8-a174-a5c7090598e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:01.037562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495f78e-e0b7-4ad8-a174-a5c7090598e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:01.039675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495f78e-e0b7-4ad8-a174-a5c7090598e3 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:01.053998 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3822/7709] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:45:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:45:01.105946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a155ce-88b1-4442-a47c-1161872407ef None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:01.106451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a155ce-88b1-4442-a47c-1161872407ef None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:01.106960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a155ce-88b1-4442-a47c-1161872407ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:01.162479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a4a155ce-88b1-4442-a47c-1161872407ef None None] MFA Rules not processed for user `5911af42fa4c4d7c81ac17f8a6595e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:45:01.167459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a4a155ce-88b1-4442-a47c-1161872407ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:01.277326 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3888/7710] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:45:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:45:03.070452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495f78e-e0b7-4ad8-a174-a5c7090598e3 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:03.072927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6495f78e-e0b7-4ad8-a174-a5c7090598e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:03.102365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:03.225521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495f78e-e0b7-4ad8-a174-a5c7090598e3 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:03.231995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3133657-0a6d-432e-b3f4-a21a577788d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:03.233137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3133657-0a6d-432e-b3f4-a21a577788d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:03.233621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3133657-0a6d-432e-b3f4-a21a577788d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:03.234076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3133657-0a6d-432e-b3f4-a21a577788d9 admin admin] PATH_INFO: `/v3/users/beae3bc561e141fc9229b40466840078` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:03.236365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3133657-0a6d-432e-b3f4-a21a577788d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beae3bc561e141fc9229b40466840078)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:03.238592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3133657-0a6d-432e-b3f4-a21a577788d9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:03.538965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b3133657-0a6d-432e-b3f4-a21a577788d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beae3bc561e141fc9229b40466840078'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:03.552113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b3133657-0a6d-432e-b3f4-a21a577788d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beae3bc561e141fc9229b40466840078'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:03.680197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b3133657-0a6d-432e-b3f4-a21a577788d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beae3bc561e141fc9229b40466840078'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:03.689343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b3133657-0a6d-432e-b3f4-a21a577788d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beae3bc561e141fc9229b40466840078'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:03.690475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b3133657-0a6d-432e-b3f4-a21a577788d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beae3bc561e141fc9229b40466840078'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:03.702646 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3823/7711] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:45:03 2022] DELETE /identity/v3/users/beae3bc561e141fc9229b40466840078 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:45:04.103071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a155ce-88b1-4442-a47c-1161872407ef None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:04.126638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a155ce-88b1-4442-a47c-1161872407ef None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:04.224312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d0737-479c-4bdd-8b8a-5681be8b7dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:04.225906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d0737-479c-4bdd-8b8a-5681be8b7dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:04.226424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d0737-479c-4bdd-8b8a-5681be8b7dce admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:04.226883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d0737-479c-4bdd-8b8a-5681be8b7dce admin admin] PATH_INFO: `/v3/projects/17459e07487944958c9c307e59e1c8dc` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:04.228458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d0737-479c-4bdd-8b8a-5681be8b7dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=17459e07487944958c9c307e59e1c8dc)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:04.231055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d0737-479c-4bdd-8b8a-5681be8b7dce admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:04.274209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3133657-0a6d-432e-b3f4-a21a577788d9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:04.276018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b3133657-0a6d-432e-b3f4-a21a577788d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:04.419600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:04.419829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3133657-0a6d-432e-b3f4-a21a577788d9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:04.437069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-867d0737-479c-4bdd-8b8a-5681be8b7dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17459e07487944958c9c307e59e1c8dc', 'request_id': 'req-867d0737-479c-4bdd-8b8a-5681be8b7dce'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:04.462860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-867d0737-479c-4bdd-8b8a-5681be8b7dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17459e07487944958c9c307e59e1c8dc', 'request_id': 'req-867d0737-479c-4bdd-8b8a-5681be8b7dce'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:04.467456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:04.476701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-867d0737-479c-4bdd-8b8a-5681be8b7dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17459e07487944958c9c307e59e1c8dc', 'request_id': 'req-867d0737-479c-4bdd-8b8a-5681be8b7dce'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:04.544150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c6439-4073-4317-94cd-83dd488b4b2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:04.545189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c6439-4073-4317-94cd-83dd488b4b2f service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:04.546942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c6439-4073-4317-94cd-83dd488b4b2f service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:04.547521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c6439-4073-4317-94cd-83dd488b4b2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:04.549646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9b8c6439-4073-4317-94cd-83dd488b4b2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:04.567612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c6439-4073-4317-94cd-83dd488b4b2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:04.570331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c6439-4073-4317-94cd-83dd488b4b2f service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:04.611224 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3824/7712] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:45:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:45:04.634786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-867d0737-479c-4bdd-8b8a-5681be8b7dce admin admin] The token cache is being invalidate because project 17459e07487944958c9c307e59e1c8dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:45:04.635571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-867d0737-479c-4bdd-8b8a-5681be8b7dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:04.636557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-867d0737-479c-4bdd-8b8a-5681be8b7dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:04.638473 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3889/7713] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:45:04 2022] DELETE /identity/v3/projects/17459e07487944958c9c307e59e1c8dc => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:45:04.644540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aebd87-e522-43b2-bdf7-74fceb977d70 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:04.644946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aebd87-e522-43b2-bdf7-74fceb977d70 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:04.645386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aebd87-e522-43b2-bdf7-74fceb977d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:04.664463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-78aebd87-e522-43b2-bdf7-74fceb977d70 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:45:04.670656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-78aebd87-e522-43b2-bdf7-74fceb977d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:04.756365 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3825/7714] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:45:04.767600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208402f-0309-41fb-b70f-89c6803041b7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:04.767600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208402f-0309-41fb-b70f-89c6803041b7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:04.767600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208402f-0309-41fb-b70f-89c6803041b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:04.790944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5208402f-0309-41fb-b70f-89c6803041b7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:45:04.790944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5208402f-0309-41fb-b70f-89c6803041b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:04.799167 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3890/7715] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:45:04.803755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aebd87-e522-43b2-bdf7-74fceb977d70 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:04.814822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aebd87-e522-43b2-bdf7-74fceb977d70 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:04.822286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da6609-2e10-4dcc-9a1b-24acc6b07052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:04.822286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da6609-2e10-4dcc-9a1b-24acc6b07052 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:04.822286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da6609-2e10-4dcc-9a1b-24acc6b07052 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:04.822286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da6609-2e10-4dcc-9a1b-24acc6b07052 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:04.822983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da6609-2e10-4dcc-9a1b-24acc6b07052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:45:04.822983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da6609-2e10-4dcc-9a1b-24acc6b07052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:04.823686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da6609-2e10-4dcc-9a1b-24acc6b07052 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:04.841014 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3826/7716] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:45:04.842424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208402f-0309-41fb-b70f-89c6803041b7 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:04.852225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208402f-0309-41fb-b70f-89c6803041b7 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:04.857918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c744b-095e-4069-9f9a-5b715035dfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:04.858568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c744b-095e-4069-9f9a-5b715035dfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:04.858850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c744b-095e-4069-9f9a-5b715035dfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:04.859164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c744b-095e-4069-9f9a-5b715035dfb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:04.861367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c744b-095e-4069-9f9a-5b715035dfb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:04.862434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c744b-095e-4069-9f9a-5b715035dfb3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:04.962844 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3891/7717] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:45:04 2022] POST /identity/v3/projects => generated 395 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:45:04.966990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da6609-2e10-4dcc-9a1b-24acc6b07052 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:04.977570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da6609-2e10-4dcc-9a1b-24acc6b07052 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:05.040050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfa1b5-4c27-4e7b-b614-caf1d273b6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:05.040728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfa1b5-4c27-4e7b-b614-caf1d273b6db admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:05.041043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfa1b5-4c27-4e7b-b614-caf1d273b6db admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:05.043163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfa1b5-4c27-4e7b-b614-caf1d273b6db admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:05.043948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcfa1b5-4c27-4e7b-b614-caf1d273b6db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:05.045931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcfa1b5-4c27-4e7b-b614-caf1d273b6db admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:05.152353 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3827/7718] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:45:04 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:45:05.153349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c744b-095e-4069-9f9a-5b715035dfb3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:05.160923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c744b-095e-4069-9f9a-5b715035dfb3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:05.165952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03a180-1536-4e85-9639-feaece111fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:05.166605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03a180-1536-4e85-9639-feaece111fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:05.166884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03a180-1536-4e85-9639-feaece111fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:05.167201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03a180-1536-4e85-9639-feaece111fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:05.167913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03a180-1536-4e85-9639-feaece111fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:05.169543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03a180-1536-4e85-9639-feaece111fb4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:05.182028 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3892/7719] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:45:05.186306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfa1b5-4c27-4e7b-b614-caf1d273b6db admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:05.197287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfa1b5-4c27-4e7b-b614-caf1d273b6db admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:05.202377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9701372-a0be-49c6-94d1-f4240cdb37dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:05.203118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9701372-a0be-49c6-94d1-f4240cdb37dc admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:05.203412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9701372-a0be-49c6-94d1-f4240cdb37dc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:05.203691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9701372-a0be-49c6-94d1-f4240cdb37dc admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:05.204477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9701372-a0be-49c6-94d1-f4240cdb37dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:05.206107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9701372-a0be-49c6-94d1-f4240cdb37dc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:05.216599 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3828/7720] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:45:05.221168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03a180-1536-4e85-9639-feaece111fb4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:05.232255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03a180-1536-4e85-9639-feaece111fb4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:05.237710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46031c5e-1d25-4eac-9cea-981df3167672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:05.238607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46031c5e-1d25-4eac-9cea-981df3167672 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:05.238884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46031c5e-1d25-4eac-9cea-981df3167672 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:05.239207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46031c5e-1d25-4eac-9cea-981df3167672 admin admin] PATH_INFO: `/v3/projects/fd2229fe58ec4362967b0bdda9101cef/users/62b825dcfc864969b2cae9308c975e6d/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:05.254477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46031c5e-1d25-4eac-9cea-981df3167672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2229fe58ec4362967b0bdda9101cef, user_id=62b825dcfc864969b2cae9308c975e6d, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:05.257339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46031c5e-1d25-4eac-9cea-981df3167672 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:05.346689 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3893/7721] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:45:05 2022] PUT /identity/v3/projects/fd2229fe58ec4362967b0bdda9101cef/users/62b825dcfc864969b2cae9308c975e6d/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:45:05.358088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad3384-85c1-4b00-9579-f3334f125931 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:05.358613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad3384-85c1-4b00-9579-f3334f125931 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:05.358726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad3384-85c1-4b00-9579-f3334f125931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:05.386082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-19ad3384-85c1-4b00-9579-f3334f125931 None None] MFA Rules not processed for user `62b825dcfc864969b2cae9308c975e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:45:05.387331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-19ad3384-85c1-4b00-9579-f3334f125931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:05.444259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:05.455599 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3829/7722] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:45:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:45:05.466106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeece6d-35c7-46ec-b220-1337c74655b9 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:05.466442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeece6d-35c7-46ec-b220-1337c74655b9 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:05.466999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeece6d-35c7-46ec-b220-1337c74655b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:05.487385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7aeece6d-35c7-46ec-b220-1337c74655b9 None None] MFA Rules not processed for user `62b825dcfc864969b2cae9308c975e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:45:05.488595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7aeece6d-35c7-46ec-b220-1337c74655b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:05.499438 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3894/7723] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:45:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:45:05.517365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad3384-85c1-4b00-9579-f3334f125931 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:05.518762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-19ad3384-85c1-4b00-9579-f3334f125931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:05.601415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad3384-85c1-4b00-9579-f3334f125931 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:05.607683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635e274-b7e9-41d3-9289-829199c21bff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:05.608335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635e274-b7e9-41d3-9289-829199c21bff service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:05.608618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635e274-b7e9-41d3-9289-829199c21bff service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:05.608889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635e274-b7e9-41d3-9289-829199c21bff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:05.618858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635e274-b7e9-41d3-9289-829199c21bff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:05.620487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635e274-b7e9-41d3-9289-829199c21bff service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:05.634371 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3830/7724] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:45:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:45:05.660882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e73af3-c7e3-4e1c-a84f-d0a5bdc80df7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:05.661172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e73af3-c7e3-4e1c-a84f-d0a5bdc80df7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:05.663115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e73af3-c7e3-4e1c-a84f-d0a5bdc80df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:05.681571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-95e73af3-c7e3-4e1c-a84f-d0a5bdc80df7 None None] MFA Rules not processed for user `62b825dcfc864969b2cae9308c975e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:45:05.682775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-95e73af3-c7e3-4e1c-a84f-d0a5bdc80df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:05.691650 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3895/7725] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:45:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:45:05.722187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2a999-49ac-44c8-8917-e3f6631c4a79 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:05.722479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2a999-49ac-44c8-8917-e3f6631c4a79 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:05.722758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2a999-49ac-44c8-8917-e3f6631c4a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:05.740358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-81d2a999-49ac-44c8-8917-e3f6631c4a79 None None] MFA Rules not processed for user `62b825dcfc864969b2cae9308c975e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:45:05.741611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-81d2a999-49ac-44c8-8917-e3f6631c4a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:05.749229 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3831/7726] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:45:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:45:05.774163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d7794-f171-41af-9d10-d606b5c70c32 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:05.774439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d7794-f171-41af-9d10-d606b5c70c32 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:05.774709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d7794-f171-41af-9d10-d606b5c70c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:05.796711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a07d7794-f171-41af-9d10-d606b5c70c32 None None] MFA Rules not processed for user `62b825dcfc864969b2cae9308c975e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:45:05.798491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a07d7794-f171-41af-9d10-d606b5c70c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:05.810422 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3896/7727] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:45:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:45:05.839473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7dad97-dfbf-470c-9262-dfbc931b5387 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:05.839761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7dad97-dfbf-470c-9262-dfbc931b5387 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:05.840037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7dad97-dfbf-470c-9262-dfbc931b5387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:05.861592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ba7dad97-dfbf-470c-9262-dfbc931b5387 None None] MFA Rules not processed for user `62b825dcfc864969b2cae9308c975e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:45:05.862798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ba7dad97-dfbf-470c-9262-dfbc931b5387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:05.870100 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3832/7728] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:45:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:45:05.894959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d7794-f171-41af-9d10-d606b5c70c32 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:05.959487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d7794-f171-41af-9d10-d606b5c70c32 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:05.964013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c46a2-22f5-4878-86e9-4eff9d33f39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:05.964881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c46a2-22f5-4878-86e9-4eff9d33f39c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:05.965162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c46a2-22f5-4878-86e9-4eff9d33f39c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:05.965432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c46a2-22f5-4878-86e9-4eff9d33f39c admin admin] PATH_INFO: `/v3/users/62b825dcfc864969b2cae9308c975e6d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:05.966623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c46a2-22f5-4878-86e9-4eff9d33f39c admin admin] RBAC: Authorizing `identity:delete_user(user_id=62b825dcfc864969b2cae9308c975e6d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:05.968589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c46a2-22f5-4878-86e9-4eff9d33f39c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:06.190665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:06.198704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fa9c46a2-22f5-4878-86e9-4eff9d33f39c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62b825dcfc864969b2cae9308c975e6d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:06.206988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fa9c46a2-22f5-4878-86e9-4eff9d33f39c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62b825dcfc864969b2cae9308c975e6d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:06.283457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fa9c46a2-22f5-4878-86e9-4eff9d33f39c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62b825dcfc864969b2cae9308c975e6d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:06.284099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fa9c46a2-22f5-4878-86e9-4eff9d33f39c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62b825dcfc864969b2cae9308c975e6d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:06.296916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-fa9c46a2-22f5-4878-86e9-4eff9d33f39c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62b825dcfc864969b2cae9308c975e6d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:06.304526 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3897/7729] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:45:05 2022] DELETE /identity/v3/users/62b825dcfc864969b2cae9308c975e6d => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:45:06.309173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2d69b-fcfe-4e02-9c67-60c5bb6dfe17 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:06.309466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2d69b-fcfe-4e02-9c67-60c5bb6dfe17 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:06.309745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2d69b-fcfe-4e02-9c67-60c5bb6dfe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:06.327212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-87f2d69b-fcfe-4e02-9c67-60c5bb6dfe17 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:45:06.329010 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-87f2d69b-fcfe-4e02-9c67-60c5bb6dfe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:06.391914 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3833/7730] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:45:06.402512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c46a2-22f5-4878-86e9-4eff9d33f39c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:06.403940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fa9c46a2-22f5-4878-86e9-4eff9d33f39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:06.485740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c46a2-22f5-4878-86e9-4eff9d33f39c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:06.490258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f47f2-0d11-4006-82b4-64fe75e4bfe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:06.490896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f47f2-0d11-4006-82b4-64fe75e4bfe9 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:06.491206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f47f2-0d11-4006-82b4-64fe75e4bfe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:06.491479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f47f2-0d11-4006-82b4-64fe75e4bfe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:06.505782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f47f2-0d11-4006-82b4-64fe75e4bfe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:06.507328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f47f2-0d11-4006-82b4-64fe75e4bfe9 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:06.522263 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3898/7731] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:45:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:45:07.051929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2d69b-fcfe-4e02-9c67-60c5bb6dfe17 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:07.053469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-87f2d69b-fcfe-4e02-9c67-60c5bb6dfe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:07.080807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2d69b-fcfe-4e02-9c67-60c5bb6dfe17 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:07.088057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f25be1-92be-463a-9f98-b09b8e5cffdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:07.088967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f25be1-92be-463a-9f98-b09b8e5cffdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:07.089259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f25be1-92be-463a-9f98-b09b8e5cffdf admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:07.089541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f25be1-92be-463a-9f98-b09b8e5cffdf admin admin] PATH_INFO: `/v3/projects/fd2229fe58ec4362967b0bdda9101cef` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:07.090857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f25be1-92be-463a-9f98-b09b8e5cffdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2229fe58ec4362967b0bdda9101cef)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:07.093133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f25be1-92be-463a-9f98-b09b8e5cffdf admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:07.107646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:07.234099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c5f25be1-92be-463a-9f98-b09b8e5cffdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2229fe58ec4362967b0bdda9101cef', 'request_id': 'req-c5f25be1-92be-463a-9f98-b09b8e5cffdf'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:07.242820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c5f25be1-92be-463a-9f98-b09b8e5cffdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2229fe58ec4362967b0bdda9101cef', 'request_id': 'req-c5f25be1-92be-463a-9f98-b09b8e5cffdf'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:07.251580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c5f25be1-92be-463a-9f98-b09b8e5cffdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2229fe58ec4362967b0bdda9101cef', 'request_id': 'req-c5f25be1-92be-463a-9f98-b09b8e5cffdf'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:07.362844 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c5f25be1-92be-463a-9f98-b09b8e5cffdf admin admin] The token cache is being invalidate because project fd2229fe58ec4362967b0bdda9101cef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:45:07.363160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c5f25be1-92be-463a-9f98-b09b8e5cffdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:07.363894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c5f25be1-92be-463a-9f98-b09b8e5cffdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:07.365610 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3834/7732] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:45:07 2022] DELETE /identity/v3/projects/fd2229fe58ec4362967b0bdda9101cef => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:45:07.376111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eec0d2-1662-440c-90f5-e13c53c343a0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:07.376614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eec0d2-1662-440c-90f5-e13c53c343a0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:07.376772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eec0d2-1662-440c-90f5-e13c53c343a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:07.394702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-90eec0d2-1662-440c-90f5-e13c53c343a0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:45:07.400273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-90eec0d2-1662-440c-90f5-e13c53c343a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:07.463417 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3899/7733] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:45:07.471604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88741742-8de3-4350-883b-f4f96306110e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:07.472194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88741742-8de3-4350-883b-f4f96306110e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:07.472312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88741742-8de3-4350-883b-f4f96306110e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:07.492253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-88741742-8de3-4350-883b-f4f96306110e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:45:07.493596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-88741742-8de3-4350-883b-f4f96306110e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:07.505618 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3835/7734] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:45:07.507582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eec0d2-1662-440c-90f5-e13c53c343a0 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:07.518649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eec0d2-1662-440c-90f5-e13c53c343a0 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:07.525181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cfb1c-cccf-4a29-9176-597ff8eb0f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:07.525896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cfb1c-cccf-4a29-9176-597ff8eb0f05 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:07.526186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cfb1c-cccf-4a29-9176-597ff8eb0f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:07.526991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cfb1c-cccf-4a29-9176-597ff8eb0f05 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:07.532278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55cfb1c-cccf-4a29-9176-597ff8eb0f05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:45:07.532278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55cfb1c-cccf-4a29-9176-597ff8eb0f05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:07.532278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55cfb1c-cccf-4a29-9176-597ff8eb0f05 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:07.546762 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3900/7735] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:45:07.548634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88741742-8de3-4350-883b-f4f96306110e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:07.558521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88741742-8de3-4350-883b-f4f96306110e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:07.565727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544ef5a-2826-4bf4-99d4-ebe48adf12b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:07.566409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544ef5a-2826-4bf4-99d4-ebe48adf12b2 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:07.566746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544ef5a-2826-4bf4-99d4-ebe48adf12b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:07.566997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544ef5a-2826-4bf4-99d4-ebe48adf12b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:07.567724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544ef5a-2826-4bf4-99d4-ebe48adf12b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:07.569712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544ef5a-2826-4bf4-99d4-ebe48adf12b2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:07.711046 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3836/7736] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:45:07 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:45:07.712758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cfb1c-cccf-4a29-9176-597ff8eb0f05 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:07.724525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cfb1c-cccf-4a29-9176-597ff8eb0f05 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:07.769397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:07.782258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068ddd3-4a40-46d3-8fa5-704aff3ce3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:07.782926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068ddd3-4a40-46d3-8fa5-704aff3ce3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:07.787849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068ddd3-4a40-46d3-8fa5-704aff3ce3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:07.787849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068ddd3-4a40-46d3-8fa5-704aff3ce3b8 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:07.787849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068ddd3-4a40-46d3-8fa5-704aff3ce3b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:07.787849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068ddd3-4a40-46d3-8fa5-704aff3ce3b8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:07.938176 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3901/7737] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:45:07 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:45:07.939420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544ef5a-2826-4bf4-99d4-ebe48adf12b2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:07.950062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544ef5a-2826-4bf4-99d4-ebe48adf12b2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:07.959133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1090f94-777a-44d9-8820-e664205790f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:07.959836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1090f94-777a-44d9-8820-e664205790f4 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:07.960115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1090f94-777a-44d9-8820-e664205790f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:07.960386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1090f94-777a-44d9-8820-e664205790f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:07.961127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1090f94-777a-44d9-8820-e664205790f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:07.963768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1090f94-777a-44d9-8820-e664205790f4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:07.976875 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3837/7738] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:45:07.980823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068ddd3-4a40-46d3-8fa5-704aff3ce3b8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:07.992130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068ddd3-4a40-46d3-8fa5-704aff3ce3b8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:07.997523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdbce4-d302-4197-a895-9982b3543117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:07.998552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdbce4-d302-4197-a895-9982b3543117 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:07.998844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdbce4-d302-4197-a895-9982b3543117 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:07.999188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdbce4-d302-4197-a895-9982b3543117 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:07.999924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fdbce4-d302-4197-a895-9982b3543117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:08.001644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fdbce4-d302-4197-a895-9982b3543117 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:08.013247 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3902/7739] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:45:08.018951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1090f94-777a-44d9-8820-e664205790f4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:08.030273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1090f94-777a-44d9-8820-e664205790f4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:08.036352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9e618-00c0-4fef-bd17-d4682caa01b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:08.037262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9e618-00c0-4fef-bd17-d4682caa01b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:08.037548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9e618-00c0-4fef-bd17-d4682caa01b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:08.037851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9e618-00c0-4fef-bd17-d4682caa01b9 admin admin] PATH_INFO: `/v3/projects/1e7cd69b8ddd4aceb45a4aaacdfccea7/users/cfe293b9ed3645229bed5ef8ce17cfec/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:08.056187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9e618-00c0-4fef-bd17-d4682caa01b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e7cd69b8ddd4aceb45a4aaacdfccea7, user_id=cfe293b9ed3645229bed5ef8ce17cfec, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:08.059097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9e618-00c0-4fef-bd17-d4682caa01b9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:08.122048 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3838/7740] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:45:08 2022] PUT /identity/v3/projects/1e7cd69b8ddd4aceb45a4aaacdfccea7/users/cfe293b9ed3645229bed5ef8ce17cfec/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:45:08.127918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d895f-8bfa-40f8-b929-a9c2dcd8f44b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:08.128354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d895f-8bfa-40f8-b929-a9c2dcd8f44b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:08.128732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d895f-8bfa-40f8-b929-a9c2dcd8f44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:08.149957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-164d895f-8bfa-40f8-b929-a9c2dcd8f44b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:45:08.151255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-164d895f-8bfa-40f8-b929-a9c2dcd8f44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:08.220487 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3903/7741] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:45:08.233950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9e618-00c0-4fef-bd17-d4682caa01b9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:08.236304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ddd9e618-00c0-4fef-bd17-d4682caa01b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:08.303606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9e618-00c0-4fef-bd17-d4682caa01b9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:08.307372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9704525-f383-4578-9df0-2e22ad4c47e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:08.308023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9704525-f383-4578-9df0-2e22ad4c47e6 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:08.308450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9704525-f383-4578-9df0-2e22ad4c47e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:08.308683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9704525-f383-4578-9df0-2e22ad4c47e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:08.338883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9704525-f383-4578-9df0-2e22ad4c47e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:08.341281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9704525-f383-4578-9df0-2e22ad4c47e6 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:08.356646 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3839/7742] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:45:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:45:10.719303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d895f-8bfa-40f8-b929-a9c2dcd8f44b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:10.721018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-164d895f-8bfa-40f8-b929-a9c2dcd8f44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:10.813552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d895f-8bfa-40f8-b929-a9c2dcd8f44b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:10.829907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ddcb5-0c76-4b50-ab17-98328e607e7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:10.829907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ddcb5-0c76-4b50-ab17-98328e607e7a service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:10.829907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ddcb5-0c76-4b50-ab17-98328e607e7a service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:10.829907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ddcb5-0c76-4b50-ab17-98328e607e7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:10.833018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b99ddcb5-0c76-4b50-ab17-98328e607e7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:10.854922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ddcb5-0c76-4b50-ab17-98328e607e7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:10.856757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ddcb5-0c76-4b50-ab17-98328e607e7a service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:10.872887 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3904/7743] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:45:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:45:14.790419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62186a-0422-46ac-85ea-eb9d7ff13387 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:14.790943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62186a-0422-46ac-85ea-eb9d7ff13387 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:14.791082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62186a-0422-46ac-85ea-eb9d7ff13387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:14.851509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-fa62186a-0422-46ac-85ea-eb9d7ff13387 None None] MFA Rules not processed for user `cfe293b9ed3645229bed5ef8ce17cfec`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:45:14.857206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fa62186a-0422-46ac-85ea-eb9d7ff13387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:14.948764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:14.998367 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3840/7744] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:45:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:45:15.014124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ddcb5-0c76-4b50-ab17-98328e607e7a service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:15.016739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b99ddcb5-0c76-4b50-ab17-98328e607e7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:15.073588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ddcb5-0c76-4b50-ab17-98328e607e7a service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:15.090063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ada663-0feb-4299-9b7f-55880ea7770c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:15.090766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ada663-0feb-4299-9b7f-55880ea7770c service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:15.093017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ada663-0feb-4299-9b7f-55880ea7770c service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:15.093308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ada663-0feb-4299-9b7f-55880ea7770c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:15.120755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ada663-0feb-4299-9b7f-55880ea7770c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:15.122773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ada663-0feb-4299-9b7f-55880ea7770c service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:15.135764 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3905/7745] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:45:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:45:18.291318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bb26e-b7fb-4ebe-8412-f5fd750fe95e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:18.291318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bb26e-b7fb-4ebe-8412-f5fd750fe95e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:18.291318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bb26e-b7fb-4ebe-8412-f5fd750fe95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:18.313771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-611bb26e-b7fb-4ebe-8412-f5fd750fe95e None None] MFA Rules not processed for user `cfe293b9ed3645229bed5ef8ce17cfec`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:45:18.315384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-611bb26e-b7fb-4ebe-8412-f5fd750fe95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:18.329086 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3841/7746] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:45:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:45:20.110615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4f1e9-6e0f-46e3-b4c1-f8a3d939fad7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:20.111182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4f1e9-6e0f-46e3-b4c1-f8a3d939fad7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:20.111612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4f1e9-6e0f-46e3-b4c1-f8a3d939fad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:20.133817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d8a4f1e9-6e0f-46e3-b4c1-f8a3d939fad7 None None] MFA Rules not processed for user `5911af42fa4c4d7c81ac17f8a6595e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:45:20.135184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d8a4f1e9-6e0f-46e3-b4c1-f8a3d939fad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:20.179295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:20.206526 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3906/7747] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:45:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:45:22.774490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611bb26e-b7fb-4ebe-8412-f5fd750fe95e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:22.791038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611bb26e-b7fb-4ebe-8412-f5fd750fe95e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:22.797409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea480be-6e36-414b-9869-e7935246e395 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:22.798597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea480be-6e36-414b-9869-e7935246e395 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:22.798884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea480be-6e36-414b-9869-e7935246e395 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:22.799212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea480be-6e36-414b-9869-e7935246e395 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:22.801224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bea480be-6e36-414b-9869-e7935246e395 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:22.867068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea480be-6e36-414b-9869-e7935246e395 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:22.868996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea480be-6e36-414b-9869-e7935246e395 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:22.880705 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3842/7748] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:45:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:45:30.716778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=8 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:32.875216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=45 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:44.019108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4f1e9-6e0f-46e3-b4c1-f8a3d939fad7 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:44.031847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4f1e9-6e0f-46e3-b4c1-f8a3d939fad7 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:44.035892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f46207-4bb1-4773-9161-99030318422a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:44.045358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f46207-4bb1-4773-9161-99030318422a service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:44.045358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f46207-4bb1-4773-9161-99030318422a service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:44.045358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f46207-4bb1-4773-9161-99030318422a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:44.045358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-73f46207-4bb1-4773-9161-99030318422a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:44.052427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f46207-4bb1-4773-9161-99030318422a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:44.053866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f46207-4bb1-4773-9161-99030318422a service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:44.064059 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3907/7749] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:45:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:45:51.099500 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea480be-6e36-414b-9869-e7935246e395 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:51.118857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea480be-6e36-414b-9869-e7935246e395 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:51.124099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88feb2c1-8aad-41f3-889b-4603c420245a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:51.125257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88feb2c1-8aad-41f3-889b-4603c420245a service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:51.125773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88feb2c1-8aad-41f3-889b-4603c420245a service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:51.126289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88feb2c1-8aad-41f3-889b-4603c420245a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:51.128289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-88feb2c1-8aad-41f3-889b-4603c420245a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:51.222112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88feb2c1-8aad-41f3-889b-4603c420245a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:51.224399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88feb2c1-8aad-41f3-889b-4603c420245a service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:51.246847 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3843/7750] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:45:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:45:53.202272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f46207-4bb1-4773-9161-99030318422a service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:53.204000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-73f46207-4bb1-4773-9161-99030318422a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:53.225780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f46207-4bb1-4773-9161-99030318422a service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:53.231410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31703c30-621d-4fc9-bdd4-0ad0cf0a4382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:53.232783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31703c30-621d-4fc9-bdd4-0ad0cf0a4382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:53.234263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31703c30-621d-4fc9-bdd4-0ad0cf0a4382 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:53.234263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31703c30-621d-4fc9-bdd4-0ad0cf0a4382 admin admin] PATH_INFO: `/v3/users/62209b9802ab46c3b3d094d4d1ad86fe` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:53.234852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31703c30-621d-4fc9-bdd4-0ad0cf0a4382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62209b9802ab46c3b3d094d4d1ad86fe)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:53.236858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31703c30-621d-4fc9-bdd4-0ad0cf0a4382 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:53.475670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-31703c30-621d-4fc9-bdd4-0ad0cf0a4382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62209b9802ab46c3b3d094d4d1ad86fe'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:53.485995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-31703c30-621d-4fc9-bdd4-0ad0cf0a4382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62209b9802ab46c3b3d094d4d1ad86fe'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:53.606589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-31703c30-621d-4fc9-bdd4-0ad0cf0a4382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62209b9802ab46c3b3d094d4d1ad86fe'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:53.607060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-31703c30-621d-4fc9-bdd4-0ad0cf0a4382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62209b9802ab46c3b3d094d4d1ad86fe'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:53.621805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-31703c30-621d-4fc9-bdd4-0ad0cf0a4382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62209b9802ab46c3b3d094d4d1ad86fe'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:53.627999 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3908/7751] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:45:53 2022] DELETE /identity/v3/users/62209b9802ab46c3b3d094d4d1ad86fe => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:45:53.906023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88feb2c1-8aad-41f3-889b-4603c420245a service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:53.922883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88feb2c1-8aad-41f3-889b-4603c420245a service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:53.993233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13429ccc-5efe-4a15-92e9-01cefcc67d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:53.994102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13429ccc-5efe-4a15-92e9-01cefcc67d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:53.994386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13429ccc-5efe-4a15-92e9-01cefcc67d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:53.994666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13429ccc-5efe-4a15-92e9-01cefcc67d7d admin admin] PATH_INFO: `/v3/projects/b533f85aeddf4d8db05f2c53a61befc3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:53.995910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13429ccc-5efe-4a15-92e9-01cefcc67d7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b533f85aeddf4d8db05f2c53a61befc3)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:53.997858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13429ccc-5efe-4a15-92e9-01cefcc67d7d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:54.135807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-13429ccc-5efe-4a15-92e9-01cefcc67d7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b533f85aeddf4d8db05f2c53a61befc3', 'request_id': 'req-13429ccc-5efe-4a15-92e9-01cefcc67d7d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:54.142459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-13429ccc-5efe-4a15-92e9-01cefcc67d7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b533f85aeddf4d8db05f2c53a61befc3', 'request_id': 'req-13429ccc-5efe-4a15-92e9-01cefcc67d7d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:54.149404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-13429ccc-5efe-4a15-92e9-01cefcc67d7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b533f85aeddf4d8db05f2c53a61befc3', 'request_id': 'req-13429ccc-5efe-4a15-92e9-01cefcc67d7d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:54.214030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:54.216826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-13429ccc-5efe-4a15-92e9-01cefcc67d7d admin admin] The token cache is being invalidate because project b533f85aeddf4d8db05f2c53a61befc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:45:54.217212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-13429ccc-5efe-4a15-92e9-01cefcc67d7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:54.218483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-13429ccc-5efe-4a15-92e9-01cefcc67d7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:54.225011 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3844/7752] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:45:53 2022] DELETE /identity/v3/projects/b533f85aeddf4d8db05f2c53a61befc3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:45:54.227902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31703c30-621d-4fc9-bdd4-0ad0cf0a4382 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:54.229759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-31703c30-621d-4fc9-bdd4-0ad0cf0a4382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:54.244333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31703c30-621d-4fc9-bdd4-0ad0cf0a4382 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:54.336282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0827247-1be8-4a48-8792-f6191a9b2ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:54.337454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0827247-1be8-4a48-8792-f6191a9b2ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:54.337741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0827247-1be8-4a48-8792-f6191a9b2ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:54.338019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0827247-1be8-4a48-8792-f6191a9b2ba5 admin admin] PATH_INFO: `/v3/users/88636030272f42c285464c3f9fc0af53` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:54.339321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0827247-1be8-4a48-8792-f6191a9b2ba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88636030272f42c285464c3f9fc0af53)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:54.341262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0827247-1be8-4a48-8792-f6191a9b2ba5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:54.600377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b0827247-1be8-4a48-8792-f6191a9b2ba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88636030272f42c285464c3f9fc0af53'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:54.616172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b0827247-1be8-4a48-8792-f6191a9b2ba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88636030272f42c285464c3f9fc0af53'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:54.630228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:54.706044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b0827247-1be8-4a48-8792-f6191a9b2ba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88636030272f42c285464c3f9fc0af53'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:54.706956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b0827247-1be8-4a48-8792-f6191a9b2ba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88636030272f42c285464c3f9fc0af53'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:54.726244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b0827247-1be8-4a48-8792-f6191a9b2ba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88636030272f42c285464c3f9fc0af53'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:54.732830 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3909/7753] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:45:54 2022] DELETE /identity/v3/users/88636030272f42c285464c3f9fc0af53 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:45:55.032892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13429ccc-5efe-4a15-92e9-01cefcc67d7d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:55.034564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-13429ccc-5efe-4a15-92e9-01cefcc67d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:55.073321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13429ccc-5efe-4a15-92e9-01cefcc67d7d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:55.156308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da9c2a-5755-42eb-98df-11ebe0675253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:55.157270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da9c2a-5755-42eb-98df-11ebe0675253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:55.157581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da9c2a-5755-42eb-98df-11ebe0675253 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:55.157866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da9c2a-5755-42eb-98df-11ebe0675253 admin admin] PATH_INFO: `/v3/projects/f3f556f434094840ac67dadfa648a6ec` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:55.159147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da9c2a-5755-42eb-98df-11ebe0675253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3f556f434094840ac67dadfa648a6ec)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:55.163593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da9c2a-5755-42eb-98df-11ebe0675253 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:55.238082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0827247-1be8-4a48-8792-f6191a9b2ba5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:55.240224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b0827247-1be8-4a48-8792-f6191a9b2ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:55.253218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0827247-1be8-4a48-8792-f6191a9b2ba5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:55.258314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7171b-a03d-4002-9466-715e2de2149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:55.259346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7171b-a03d-4002-9466-715e2de2149b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:55.259687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7171b-a03d-4002-9466-715e2de2149b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:55.268547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7171b-a03d-4002-9466-715e2de2149b admin admin] PATH_INFO: `/v3/users/5911af42fa4c4d7c81ac17f8a6595e3d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:55.268547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7171b-a03d-4002-9466-715e2de2149b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5911af42fa4c4d7c81ac17f8a6595e3d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:55.268547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7171b-a03d-4002-9466-715e2de2149b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:55.338523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-58da9c2a-5755-42eb-98df-11ebe0675253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3f556f434094840ac67dadfa648a6ec', 'request_id': 'req-58da9c2a-5755-42eb-98df-11ebe0675253'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:55.345022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-58da9c2a-5755-42eb-98df-11ebe0675253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3f556f434094840ac67dadfa648a6ec', 'request_id': 'req-58da9c2a-5755-42eb-98df-11ebe0675253'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:55.352591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-58da9c2a-5755-42eb-98df-11ebe0675253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3f556f434094840ac67dadfa648a6ec', 'request_id': 'req-58da9c2a-5755-42eb-98df-11ebe0675253'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:55.445223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-58da9c2a-5755-42eb-98df-11ebe0675253 admin admin] The token cache is being invalidate because project f3f556f434094840ac67dadfa648a6ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:45:55.445603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-58da9c2a-5755-42eb-98df-11ebe0675253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:55.446326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-58da9c2a-5755-42eb-98df-11ebe0675253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:55.448131 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3845/7754] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:45:55 2022] DELETE /identity/v3/projects/f3f556f434094840ac67dadfa648a6ec => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:45:55.481041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b2f7171b-a03d-4002-9466-715e2de2149b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5911af42fa4c4d7c81ac17f8a6595e3d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:55.501580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b2f7171b-a03d-4002-9466-715e2de2149b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5911af42fa4c4d7c81ac17f8a6595e3d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:55.574389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b2f7171b-a03d-4002-9466-715e2de2149b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5911af42fa4c4d7c81ac17f8a6595e3d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:55.575159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b2f7171b-a03d-4002-9466-715e2de2149b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5911af42fa4c4d7c81ac17f8a6595e3d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:55.592615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b2f7171b-a03d-4002-9466-715e2de2149b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5911af42fa4c4d7c81ac17f8a6595e3d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:55.600159 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3910/7755] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:45:55 2022] DELETE /identity/v3/users/5911af42fa4c4d7c81ac17f8a6595e3d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:45:55.902032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da9c2a-5755-42eb-98df-11ebe0675253 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:55.903593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-58da9c2a-5755-42eb-98df-11ebe0675253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:56.006040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da9c2a-5755-42eb-98df-11ebe0675253 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:56.040335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:56.063607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536f4b8-ecff-4233-b00c-43d6d8f27437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:56.064477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536f4b8-ecff-4233-b00c-43d6d8f27437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:56.064759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536f4b8-ecff-4233-b00c-43d6d8f27437 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:56.065039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536f4b8-ecff-4233-b00c-43d6d8f27437 admin admin] PATH_INFO: `/v3/projects/68133056394c45b7b3166697a3cb0f37` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:56.066356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536f4b8-ecff-4233-b00c-43d6d8f27437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68133056394c45b7b3166697a3cb0f37)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:56.068318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536f4b8-ecff-4233-b00c-43d6d8f27437 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:56.179192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2536f4b8-ecff-4233-b00c-43d6d8f27437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68133056394c45b7b3166697a3cb0f37', 'request_id': 'req-2536f4b8-ecff-4233-b00c-43d6d8f27437'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:56.185986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2536f4b8-ecff-4233-b00c-43d6d8f27437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68133056394c45b7b3166697a3cb0f37', 'request_id': 'req-2536f4b8-ecff-4233-b00c-43d6d8f27437'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:56.194440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2536f4b8-ecff-4233-b00c-43d6d8f27437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68133056394c45b7b3166697a3cb0f37', 'request_id': 'req-2536f4b8-ecff-4233-b00c-43d6d8f27437'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:56.265749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2536f4b8-ecff-4233-b00c-43d6d8f27437 admin admin] The token cache is being invalidate because project 68133056394c45b7b3166697a3cb0f37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:45:56.266117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2536f4b8-ecff-4233-b00c-43d6d8f27437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:56.266990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2536f4b8-ecff-4233-b00c-43d6d8f27437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:56.272766 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3846/7756] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:45:55 2022] DELETE /identity/v3/projects/68133056394c45b7b3166697a3cb0f37 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:45:56.274030 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7171b-a03d-4002-9466-715e2de2149b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:56.275595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b2f7171b-a03d-4002-9466-715e2de2149b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:56.290554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7171b-a03d-4002-9466-715e2de2149b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:56.352235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abc51b-cad2-40a8-a037-039204a59f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:56.353160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abc51b-cad2-40a8-a037-039204a59f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:56.353736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abc51b-cad2-40a8-a037-039204a59f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:56.354000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abc51b-cad2-40a8-a037-039204a59f25 admin admin] PATH_INFO: `/v3/users/e32ea3fe570b40b59110b70fbb0c3caf` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:56.355230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abc51b-cad2-40a8-a037-039204a59f25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e32ea3fe570b40b59110b70fbb0c3caf)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:56.357152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abc51b-cad2-40a8-a037-039204a59f25 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:56.637566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-53abc51b-cad2-40a8-a037-039204a59f25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e32ea3fe570b40b59110b70fbb0c3caf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:56.642113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:56.646150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-53abc51b-cad2-40a8-a037-039204a59f25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e32ea3fe570b40b59110b70fbb0c3caf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:56.732148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-53abc51b-cad2-40a8-a037-039204a59f25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e32ea3fe570b40b59110b70fbb0c3caf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:56.732785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-53abc51b-cad2-40a8-a037-039204a59f25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e32ea3fe570b40b59110b70fbb0c3caf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:56.745445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-53abc51b-cad2-40a8-a037-039204a59f25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e32ea3fe570b40b59110b70fbb0c3caf'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:56.751592 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3911/7757] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:45:56 2022] DELETE /identity/v3/users/e32ea3fe570b40b59110b70fbb0c3caf => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:45:57.076488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536f4b8-ecff-4233-b00c-43d6d8f27437 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:57.078067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2536f4b8-ecff-4233-b00c-43d6d8f27437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:57.092409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536f4b8-ecff-4233-b00c-43d6d8f27437 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:57.160712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bde221-22ba-4b14-b07a-256324f44b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:57.161576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bde221-22ba-4b14-b07a-256324f44b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:57.161860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bde221-22ba-4b14-b07a-256324f44b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:57.162135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bde221-22ba-4b14-b07a-256324f44b08 admin admin] PATH_INFO: `/v3/projects/b351f1a2d6434cd0b3b03628a0befe14` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:57.163353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bde221-22ba-4b14-b07a-256324f44b08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b351f1a2d6434cd0b3b03628a0befe14)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:57.165304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bde221-22ba-4b14-b07a-256324f44b08 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:57.301397 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-50bde221-22ba-4b14-b07a-256324f44b08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b351f1a2d6434cd0b3b03628a0befe14', 'request_id': 'req-50bde221-22ba-4b14-b07a-256324f44b08'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:57.307072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-50bde221-22ba-4b14-b07a-256324f44b08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b351f1a2d6434cd0b3b03628a0befe14', 'request_id': 'req-50bde221-22ba-4b14-b07a-256324f44b08'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:57.313310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-50bde221-22ba-4b14-b07a-256324f44b08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b351f1a2d6434cd0b3b03628a0befe14', 'request_id': 'req-50bde221-22ba-4b14-b07a-256324f44b08'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:57.378687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:45:57.388398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-50bde221-22ba-4b14-b07a-256324f44b08 admin admin] The token cache is being invalidate because project b351f1a2d6434cd0b3b03628a0befe14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:45:57.388398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-50bde221-22ba-4b14-b07a-256324f44b08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:57.388398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-50bde221-22ba-4b14-b07a-256324f44b08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:45:57.388398 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3847/7758] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:45:57 2022] DELETE /identity/v3/projects/b351f1a2d6434cd0b3b03628a0befe14 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:45:59.090131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c21bee-1e6a-40d6-9aa3-7d77e4bd8ad7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:59.090640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c21bee-1e6a-40d6-9aa3-7d77e4bd8ad7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:59.090747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c21bee-1e6a-40d6-9aa3-7d77e4bd8ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:59.109521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-74c21bee-1e6a-40d6-9aa3-7d77e4bd8ad7 None None] MFA Rules not processed for user `001ed11a062a4cb08a52d1294ef5880b`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:45:59.110760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-74c21bee-1e6a-40d6-9aa3-7d77e4bd8ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:59.166941 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3912/7759] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:45:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:45:59.487629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bde221-22ba-4b14-b07a-256324f44b08 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:45:59.489106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-50bde221-22ba-4b14-b07a-256324f44b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:59.551492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bde221-22ba-4b14-b07a-256324f44b08 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:45:59.555149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0ad58-de63-4a5f-a773-1047c7d0e32f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:45:59.555807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0ad58-de63-4a5f-a773-1047c7d0e32f service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:45:59.556087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0ad58-de63-4a5f-a773-1047c7d0e32f service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:45:59.556606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0ad58-de63-4a5f-a773-1047c7d0e32f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:45:59.558260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bba0ad58-de63-4a5f-a773-1047c7d0e32f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:45:59.573059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0ad58-de63-4a5f-a773-1047c7d0e32f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:45:59.574644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0ad58-de63-4a5f-a773-1047c7d0e32f service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:45:59.586510 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3848/7760] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:45:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:46:00.380545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c21bee-1e6a-40d6-9aa3-7d77e4bd8ad7 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:00.382081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-74c21bee-1e6a-40d6-9aa3-7d77e4bd8ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:00.456231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c21bee-1e6a-40d6-9aa3-7d77e4bd8ad7 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:00.461329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca699c-040f-4685-9f40-649311838d9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:00.461972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca699c-040f-4685-9f40-649311838d9f service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:00.462256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca699c-040f-4685-9f40-649311838d9f service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:00.462532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca699c-040f-4685-9f40-649311838d9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:00.464303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7eca699c-040f-4685-9f40-649311838d9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:00.478898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca699c-040f-4685-9f40-649311838d9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:00.480511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca699c-040f-4685-9f40-649311838d9f service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:00.493664 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3913/7761] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:46:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:46:09.579711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=27 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:10.486447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=67,keystone:INSERT=1,keystone:DELETE=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:14.314244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0ad58-de63-4a5f-a773-1047c7d0e32f service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:14.315727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bba0ad58-de63-4a5f-a773-1047c7d0e32f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:14.345331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0ad58-de63-4a5f-a773-1047c7d0e32f service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:14.350421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc2dd7-020b-40c0-853e-0a8ead473bf6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:14.351745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc2dd7-020b-40c0-853e-0a8ead473bf6 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:14.352561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc2dd7-020b-40c0-853e-0a8ead473bf6 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:14.352954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc2dd7-020b-40c0-853e-0a8ead473bf6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:14.355221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6dfc2dd7-020b-40c0-853e-0a8ead473bf6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:14.371246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc2dd7-020b-40c0-853e-0a8ead473bf6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:14.376625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc2dd7-020b-40c0-853e-0a8ead473bf6 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:14.386373 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3849/7762] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:46:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:46:17.259247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4af87f-dbf9-426b-bb97-b1217cba9a80 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:17.260402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4af87f-dbf9-426b-bb97-b1217cba9a80 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:17.260402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4af87f-dbf9-426b-bb97-b1217cba9a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:17.282848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-bb4af87f-dbf9-426b-bb97-b1217cba9a80 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:17.284169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bb4af87f-dbf9-426b-bb97-b1217cba9a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:17.346921 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3914/7763] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:46:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:17.436925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc2dd7-020b-40c0-853e-0a8ead473bf6 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:17.449325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc2dd7-020b-40c0-853e-0a8ead473bf6 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:17.452968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5762f-9702-4951-be25-3561b9ae20f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:17.453605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5762f-9702-4951-be25-3561b9ae20f8 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:17.453887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5762f-9702-4951-be25-3561b9ae20f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:17.454172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5762f-9702-4951-be25-3561b9ae20f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:17.456046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bcd5762f-9702-4951-be25-3561b9ae20f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:17.521568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5762f-9702-4951-be25-3561b9ae20f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:17.521727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4af87f-dbf9-426b-bb97-b1217cba9a80 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:17.522988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5762f-9702-4951-be25-3561b9ae20f8 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:17.525701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bb4af87f-dbf9-426b-bb97-b1217cba9a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:17.533006 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3850/7764] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:46:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:46:17.602947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4af87f-dbf9-426b-bb97-b1217cba9a80 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:17.608786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2460f3-3884-4a7c-9853-4d13e6b55867 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:17.609430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2460f3-3884-4a7c-9853-4d13e6b55867 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:17.609715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2460f3-3884-4a7c-9853-4d13e6b55867 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:17.609997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2460f3-3884-4a7c-9853-4d13e6b55867 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:17.618524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2460f3-3884-4a7c-9853-4d13e6b55867 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:17.620807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2460f3-3884-4a7c-9853-4d13e6b55867 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:17.629284 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3915/7765] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:46:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:46:19.184512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5762f-9702-4951-be25-3561b9ae20f8 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:19.186047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bcd5762f-9702-4951-be25-3561b9ae20f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:19.206174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5762f-9702-4951-be25-3561b9ae20f8 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:19.212641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d30581-cffd-4361-bd07-d03658e1c3ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:19.213679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d30581-cffd-4361-bd07-d03658e1c3ee service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:19.213976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d30581-cffd-4361-bd07-d03658e1c3ee service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:19.214260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d30581-cffd-4361-bd07-d03658e1c3ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:19.216990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b7d30581-cffd-4361-bd07-d03658e1c3ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:19.357772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d30581-cffd-4361-bd07-d03658e1c3ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:19.359275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d30581-cffd-4361-bd07-d03658e1c3ee service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:19.372925 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3851/7766] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:46:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:46:24.694002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2460f3-3884-4a7c-9853-4d13e6b55867 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:24.736209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2460f3-3884-4a7c-9853-4d13e6b55867 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:24.742844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866aecf-29c8-430e-8bb7-94c9c50addb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:24.745285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866aecf-29c8-430e-8bb7-94c9c50addb3 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:24.745814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866aecf-29c8-430e-8bb7-94c9c50addb3 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:24.746812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866aecf-29c8-430e-8bb7-94c9c50addb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:24.749277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e866aecf-29c8-430e-8bb7-94c9c50addb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:24.767276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866aecf-29c8-430e-8bb7-94c9c50addb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:24.769201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866aecf-29c8-430e-8bb7-94c9c50addb3 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:24.786189 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3916/7767] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:46:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:46:27.668096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d30581-cffd-4361-bd07-d03658e1c3ee service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:27.670056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b7d30581-cffd-4361-bd07-d03658e1c3ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:27.697015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d30581-cffd-4361-bd07-d03658e1c3ee service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:27.704683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d10aa8-4833-4cda-986e-98f60bd5563d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:27.706212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d10aa8-4833-4cda-986e-98f60bd5563d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:27.706617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d10aa8-4833-4cda-986e-98f60bd5563d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:27.707352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d10aa8-4833-4cda-986e-98f60bd5563d admin admin] PATH_INFO: `/v3/users/0ab8b3f06e994bbca5d6dd14109bfe50` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:27.709872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d10aa8-4833-4cda-986e-98f60bd5563d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab8b3f06e994bbca5d6dd14109bfe50)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:27.715066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d10aa8-4833-4cda-986e-98f60bd5563d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:27.989967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-71d10aa8-4833-4cda-986e-98f60bd5563d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab8b3f06e994bbca5d6dd14109bfe50'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:28.006281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:28.020556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-71d10aa8-4833-4cda-986e-98f60bd5563d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab8b3f06e994bbca5d6dd14109bfe50'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:28.105028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-71d10aa8-4833-4cda-986e-98f60bd5563d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab8b3f06e994bbca5d6dd14109bfe50'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:28.118101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-71d10aa8-4833-4cda-986e-98f60bd5563d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab8b3f06e994bbca5d6dd14109bfe50'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:28.119671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-71d10aa8-4833-4cda-986e-98f60bd5563d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab8b3f06e994bbca5d6dd14109bfe50'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:28.136441 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3852/7768] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:46:27 2022] DELETE /identity/v3/users/0ab8b3f06e994bbca5d6dd14109bfe50 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:28.538423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866aecf-29c8-430e-8bb7-94c9c50addb3 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:28.557309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866aecf-29c8-430e-8bb7-94c9c50addb3 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:28.722545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc2fec-eaf5-4e76-871e-e4ca4e4e41d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:28.725807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc2fec-eaf5-4e76-871e-e4ca4e4e41d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:28.726344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc2fec-eaf5-4e76-871e-e4ca4e4e41d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:28.727519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc2fec-eaf5-4e76-871e-e4ca4e4e41d4 admin admin] PATH_INFO: `/v3/projects/e60c0863dc6f4313bdc873fda27ae2fc` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:28.731943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc2fec-eaf5-4e76-871e-e4ca4e4e41d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e60c0863dc6f4313bdc873fda27ae2fc)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:28.737330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc2fec-eaf5-4e76-871e-e4ca4e4e41d4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:28.819685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:28.914684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9ddc2fec-eaf5-4e76-871e-e4ca4e4e41d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e60c0863dc6f4313bdc873fda27ae2fc', 'request_id': 'req-9ddc2fec-eaf5-4e76-871e-e4ca4e4e41d4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:28.935162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9ddc2fec-eaf5-4e76-871e-e4ca4e4e41d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e60c0863dc6f4313bdc873fda27ae2fc', 'request_id': 'req-9ddc2fec-eaf5-4e76-871e-e4ca4e4e41d4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:28.950756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9ddc2fec-eaf5-4e76-871e-e4ca4e4e41d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e60c0863dc6f4313bdc873fda27ae2fc', 'request_id': 'req-9ddc2fec-eaf5-4e76-871e-e4ca4e4e41d4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:29.053228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9ddc2fec-eaf5-4e76-871e-e4ca4e4e41d4 admin admin] The token cache is being invalidate because project e60c0863dc6f4313bdc873fda27ae2fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:46:29.053815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9ddc2fec-eaf5-4e76-871e-e4ca4e4e41d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:29.054781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-9ddc2fec-eaf5-4e76-871e-e4ca4e4e41d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:29.057070 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3917/7769] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:46:28 2022] DELETE /identity/v3/projects/e60c0863dc6f4313bdc873fda27ae2fc => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:29.062649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6495b-5de4-40d4-bb08-e5242d971d54 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:29.063756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6495b-5de4-40d4-bb08-e5242d971d54 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:29.064039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6495b-5de4-40d4-bb08-e5242d971d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:29.089781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f7b6495b-5de4-40d4-bb08-e5242d971d54 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:29.091365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f7b6495b-5de4-40d4-bb08-e5242d971d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:29.202295 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3853/7770] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:29.210885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef70ea4-646e-4f4a-8d18-93364bc23456 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:29.211517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef70ea4-646e-4f4a-8d18-93364bc23456 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:29.212019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef70ea4-646e-4f4a-8d18-93364bc23456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:29.270928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7ef70ea4-646e-4f4a-8d18-93364bc23456 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:29.272165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7ef70ea4-646e-4f4a-8d18-93364bc23456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:29.294291 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3918/7771] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:46:29.308499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6495b-5de4-40d4-bb08-e5242d971d54 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:29.325618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6495b-5de4-40d4-bb08-e5242d971d54 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:29.338154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8e55a-85f4-4535-bde3-51b38d951a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:29.338876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8e55a-85f4-4535-bde3-51b38d951a0b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:29.339257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8e55a-85f4-4535-bde3-51b38d951a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:29.339547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8e55a-85f4-4535-bde3-51b38d951a0b admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:29.340342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8e55a-85f4-4535-bde3-51b38d951a0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:46:29.340603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8e55a-85f4-4535-bde3-51b38d951a0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:29.342260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8e55a-85f4-4535-bde3-51b38d951a0b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:29.373440 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3854/7772] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:46:29.378182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef70ea4-646e-4f4a-8d18-93364bc23456 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:29.391257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef70ea4-646e-4f4a-8d18-93364bc23456 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:29.409090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9e70d-f82f-4b47-8c59-3c156d761fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:29.409774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9e70d-f82f-4b47-8c59-3c156d761fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:29.410078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9e70d-f82f-4b47-8c59-3c156d761fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:29.410493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9e70d-f82f-4b47-8c59-3c156d761fa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:29.411251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9e70d-f82f-4b47-8c59-3c156d761fa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:29.413619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9e70d-f82f-4b47-8c59-3c156d761fa4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:29.566457 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3919/7773] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:46:29 2022] POST /identity/v3/projects => generated 375 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:46:29.570946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8e55a-85f4-4535-bde3-51b38d951a0b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:29.600241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8e55a-85f4-4535-bde3-51b38d951a0b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:29.704827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f92eb-e6dc-4703-9b06-21f0482a040e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:29.705795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f92eb-e6dc-4703-9b06-21f0482a040e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:29.706648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f92eb-e6dc-4703-9b06-21f0482a040e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:29.706648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f92eb-e6dc-4703-9b06-21f0482a040e admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:29.708981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f92eb-e6dc-4703-9b06-21f0482a040e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:29.711583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f92eb-e6dc-4703-9b06-21f0482a040e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:29.855270 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3855/7774] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:46:29 2022] POST /identity/v3/users => generated 288 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:46:29.859600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9e70d-f82f-4b47-8c59-3c156d761fa4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:29.890306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9e70d-f82f-4b47-8c59-3c156d761fa4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:29.904010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660cd9f-edb7-4720-a9cc-a14b8701bb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:29.904979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660cd9f-edb7-4720-a9cc-a14b8701bb04 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:29.905464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660cd9f-edb7-4720-a9cc-a14b8701bb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:29.905905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660cd9f-edb7-4720-a9cc-a14b8701bb04 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:29.906864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660cd9f-edb7-4720-a9cc-a14b8701bb04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:29.908690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660cd9f-edb7-4720-a9cc-a14b8701bb04 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:29.931755 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3920/7775] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:46:29.935114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f92eb-e6dc-4703-9b06-21f0482a040e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:29.954358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f92eb-e6dc-4703-9b06-21f0482a040e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:29.967518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607d311-6cd8-4266-a5b4-19a67f4b293f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:29.971627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607d311-6cd8-4266-a5b4-19a67f4b293f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:29.971627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607d311-6cd8-4266-a5b4-19a67f4b293f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:29.971627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607d311-6cd8-4266-a5b4-19a67f4b293f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:29.971627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607d311-6cd8-4266-a5b4-19a67f4b293f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:29.971627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607d311-6cd8-4266-a5b4-19a67f4b293f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:29.986098 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3856/7776] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:46:29.990223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660cd9f-edb7-4720-a9cc-a14b8701bb04 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:30.002139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660cd9f-edb7-4720-a9cc-a14b8701bb04 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:30.010118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ba49e-2842-4ba5-8df2-a8315ab24580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:30.016194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ba49e-2842-4ba5-8df2-a8315ab24580 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:30.016194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ba49e-2842-4ba5-8df2-a8315ab24580 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:30.016194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ba49e-2842-4ba5-8df2-a8315ab24580 admin admin] PATH_INFO: `/v3/projects/f53d907060b14d649a9d0c7fd1393cfc/users/cb2c4e79c413487db2eb05986ae671c7/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:30.033501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ba49e-2842-4ba5-8df2-a8315ab24580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f53d907060b14d649a9d0c7fd1393cfc, user_id=cb2c4e79c413487db2eb05986ae671c7, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:30.053206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ba49e-2842-4ba5-8df2-a8315ab24580 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:30.135853 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3921/7777] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:46:29 2022] PUT /identity/v3/projects/f53d907060b14d649a9d0c7fd1393cfc/users/cb2c4e79c413487db2eb05986ae671c7/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:46:30.146892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2be053-8e15-428c-93d9-adae656503b3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:30.147945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2be053-8e15-428c-93d9-adae656503b3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:30.148448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2be053-8e15-428c-93d9-adae656503b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:30.194255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ee2be053-8e15-428c-93d9-adae656503b3 None None] MFA Rules not processed for user `cb2c4e79c413487db2eb05986ae671c7`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:30.196243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ee2be053-8e15-428c-93d9-adae656503b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:30.269576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:30.382884 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3857/7778] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:30.385786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ba49e-2842-4ba5-8df2-a8315ab24580 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:30.405808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ba49e-2842-4ba5-8df2-a8315ab24580 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:30.409493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc1873-3dc8-4435-b7a5-a35ae0d868c9 tempest-IdentityCatalogTest-1244316191 tempest-IdentityCatalogTest-1244316191-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb2c4e79c413487db2eb05986ae671c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53d907060b14d649a9d0c7fd1393cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:30.410407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc1873-3dc8-4435-b7a5-a35ae0d868c9 tempest-IdentityCatalogTest-1244316191 tempest-IdentityCatalogTest-1244316191-project] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:30.410786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc1873-3dc8-4435-b7a5-a35ae0d868c9 tempest-IdentityCatalogTest-1244316191 tempest-IdentityCatalogTest-1244316191-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:30.411216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc1873-3dc8-4435-b7a5-a35ae0d868c9 tempest-IdentityCatalogTest-1244316191 tempest-IdentityCatalogTest-1244316191-project] PATH_INFO: `/v3/auth/catalog` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:30.411967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc1873-3dc8-4435-b7a5-a35ae0d868c9 tempest-IdentityCatalogTest-1244316191 tempest-IdentityCatalogTest-1244316191-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:30.413153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc1873-3dc8-4435-b7a5-a35ae0d868c9 tempest-IdentityCatalogTest-1244316191 tempest-IdentityCatalogTest-1244316191-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:30.421645 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3922/7779] 10.222.0.16 () {58 vars in 1142 bytes} [Sat Jul 16 21:46:30 2022] GET /identity/v3/auth/catalog => generated 2648 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:46:30.422971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2be053-8e15-428c-93d9-adae656503b3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:30.553594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2be053-8e15-428c-93d9-adae656503b3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:30.559150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759c71f-6d15-4e1c-92ee-76545980e62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:30.561049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759c71f-6d15-4e1c-92ee-76545980e62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:30.561049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759c71f-6d15-4e1c-92ee-76545980e62f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:30.561049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759c71f-6d15-4e1c-92ee-76545980e62f admin admin] PATH_INFO: `/v3/users/cb2c4e79c413487db2eb05986ae671c7` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:30.562251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759c71f-6d15-4e1c-92ee-76545980e62f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb2c4e79c413487db2eb05986ae671c7)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:30.564444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759c71f-6d15-4e1c-92ee-76545980e62f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:30.871889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5759c71f-6d15-4e1c-92ee-76545980e62f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb2c4e79c413487db2eb05986ae671c7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:30.901090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5759c71f-6d15-4e1c-92ee-76545980e62f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb2c4e79c413487db2eb05986ae671c7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:30.970370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5759c71f-6d15-4e1c-92ee-76545980e62f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb2c4e79c413487db2eb05986ae671c7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:30.980145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5759c71f-6d15-4e1c-92ee-76545980e62f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb2c4e79c413487db2eb05986ae671c7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:30.980881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5759c71f-6d15-4e1c-92ee-76545980e62f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb2c4e79c413487db2eb05986ae671c7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:30.990161 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3858/7780] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:46:30 2022] DELETE /identity/v3/users/cb2c4e79c413487db2eb05986ae671c7 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:30.991858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40314626-16d4-4c79-835a-a12574500b11 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:30.992351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40314626-16d4-4c79-835a-a12574500b11 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:30.992488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40314626-16d4-4c79-835a-a12574500b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:31.011737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-40314626-16d4-4c79-835a-a12574500b11 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:31.013228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-40314626-16d4-4c79-835a-a12574500b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:31.087813 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3923/7781] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:31.098818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759c71f-6d15-4e1c-92ee-76545980e62f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:31.100290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5759c71f-6d15-4e1c-92ee-76545980e62f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:31.181649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759c71f-6d15-4e1c-92ee-76545980e62f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:31.187175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e90f50-069d-4261-a8db-871c89f4824f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:31.188511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e90f50-069d-4261-a8db-871c89f4824f service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:31.188978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e90f50-069d-4261-a8db-871c89f4824f service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:31.189258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e90f50-069d-4261-a8db-871c89f4824f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:31.196399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:31.202148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e90f50-069d-4261-a8db-871c89f4824f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:31.203891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e90f50-069d-4261-a8db-871c89f4824f service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:31.218982 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3859/7782] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:46:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:46:32.173224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40314626-16d4-4c79-835a-a12574500b11 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:32.174702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-40314626-16d4-4c79-835a-a12574500b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:32.180950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e90f50-069d-4261-a8db-871c89f4824f service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:32.220131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-87e90f50-069d-4261-a8db-871c89f4824f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:32.222005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40314626-16d4-4c79-835a-a12574500b11 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:32.222005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22eab04-3b81-4c4f-8569-aa864f05ee9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:32.222005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22eab04-3b81-4c4f-8569-aa864f05ee9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:32.222005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22eab04-3b81-4c4f-8569-aa864f05ee9b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:32.223125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22eab04-3b81-4c4f-8569-aa864f05ee9b admin admin] PATH_INFO: `/v3/users/833136cbdeab4b9e8b6dd2d24c7c8753` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:32.223125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22eab04-3b81-4c4f-8569-aa864f05ee9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=833136cbdeab4b9e8b6dd2d24c7c8753)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:32.223831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e90f50-069d-4261-a8db-871c89f4824f service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:32.224067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22eab04-3b81-4c4f-8569-aa864f05ee9b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:32.224176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95748ab9-8924-4985-a1cd-b2cf782b3bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:32.224176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95748ab9-8924-4985-a1cd-b2cf782b3bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:32.224176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95748ab9-8924-4985-a1cd-b2cf782b3bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:32.224176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95748ab9-8924-4985-a1cd-b2cf782b3bdc admin admin] PATH_INFO: `/v3/projects/f53d907060b14d649a9d0c7fd1393cfc` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:32.224812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95748ab9-8924-4985-a1cd-b2cf782b3bdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f53d907060b14d649a9d0c7fd1393cfc)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:32.224812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95748ab9-8924-4985-a1cd-b2cf782b3bdc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:32.480672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:32.492423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-95748ab9-8924-4985-a1cd-b2cf782b3bdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f53d907060b14d649a9d0c7fd1393cfc', 'request_id': 'req-95748ab9-8924-4985-a1cd-b2cf782b3bdc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:32.492999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f22eab04-3b81-4c4f-8569-aa864f05ee9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '833136cbdeab4b9e8b6dd2d24c7c8753'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:32.504075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-95748ab9-8924-4985-a1cd-b2cf782b3bdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f53d907060b14d649a9d0c7fd1393cfc', 'request_id': 'req-95748ab9-8924-4985-a1cd-b2cf782b3bdc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:32.506857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f22eab04-3b81-4c4f-8569-aa864f05ee9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '833136cbdeab4b9e8b6dd2d24c7c8753'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:32.515364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-95748ab9-8924-4985-a1cd-b2cf782b3bdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f53d907060b14d649a9d0c7fd1393cfc', 'request_id': 'req-95748ab9-8924-4985-a1cd-b2cf782b3bdc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:32.573362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f22eab04-3b81-4c4f-8569-aa864f05ee9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '833136cbdeab4b9e8b6dd2d24c7c8753'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:32.573996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f22eab04-3b81-4c4f-8569-aa864f05ee9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '833136cbdeab4b9e8b6dd2d24c7c8753'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:32.587748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f22eab04-3b81-4c4f-8569-aa864f05ee9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '833136cbdeab4b9e8b6dd2d24c7c8753'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:32.600458 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3924/7783] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:46:32 2022] DELETE /identity/v3/users/833136cbdeab4b9e8b6dd2d24c7c8753 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:32.605575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad12c6c-64c7-429d-bbe4-baf238a30694 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:32.605575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad12c6c-64c7-429d-bbe4-baf238a30694 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:32.605811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad12c6c-64c7-429d-bbe4-baf238a30694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:32.629725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-fad12c6c-64c7-429d-bbe4-baf238a30694 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:32.630502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-95748ab9-8924-4985-a1cd-b2cf782b3bdc admin admin] The token cache is being invalidate because project f53d907060b14d649a9d0c7fd1393cfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:46:32.630795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-95748ab9-8924-4985-a1cd-b2cf782b3bdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:32.630932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fad12c6c-64c7-429d-bbe4-baf238a30694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:32.631624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-95748ab9-8924-4985-a1cd-b2cf782b3bdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:32.633515 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3860/7784] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:46:32 2022] DELETE /identity/v3/projects/f53d907060b14d649a9d0c7fd1393cfc => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:46:32.643477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60638d48-4a49-4033-8386-1fd81c1a9eb2 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:32.645917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60638d48-4a49-4033-8386-1fd81c1a9eb2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:32.645917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60638d48-4a49-4033-8386-1fd81c1a9eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:32.667916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-60638d48-4a49-4033-8386-1fd81c1a9eb2 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:32.669288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-60638d48-4a49-4033-8386-1fd81c1a9eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:32.749379 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3925/7785] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:32.754523 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3861/7786] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:32.761330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad12c6c-64c7-429d-bbe4-baf238a30694 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:32.763967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fad12c6c-64c7-429d-bbe4-baf238a30694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:32.767328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1df748-8274-4a77-b392-30227be85514 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:32.767328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1df748-8274-4a77-b392-30227be85514 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:32.767328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1df748-8274-4a77-b392-30227be85514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:32.796144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ad1df748-8274-4a77-b392-30227be85514 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:32.798624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ad1df748-8274-4a77-b392-30227be85514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:32.809373 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3862/7787] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:32.813785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1df748-8274-4a77-b392-30227be85514 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:32.824056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1df748-8274-4a77-b392-30227be85514 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:32.829088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd610a8-a2a0-459f-af48-4df97d5935dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:32.829898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd610a8-a2a0-459f-af48-4df97d5935dd admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:32.830189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd610a8-a2a0-459f-af48-4df97d5935dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:32.830612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd610a8-a2a0-459f-af48-4df97d5935dd admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:32.831398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd610a8-a2a0-459f-af48-4df97d5935dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:46:32.831709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd610a8-a2a0-459f-af48-4df97d5935dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:32.835044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd610a8-a2a0-459f-af48-4df97d5935dd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:32.851593 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3863/7788] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:46:32.860578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd610a8-a2a0-459f-af48-4df97d5935dd admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:32.867842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad12c6c-64c7-429d-bbe4-baf238a30694 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:32.875185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc8cd4-08cb-4589-ad48-33bd4baff630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:32.875550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd610a8-a2a0-459f-af48-4df97d5935dd admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:32.876318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc8cd4-08cb-4589-ad48-33bd4baff630 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:32.876611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc8cd4-08cb-4589-ad48-33bd4baff630 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:32.877007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc8cd4-08cb-4589-ad48-33bd4baff630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:32.880979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7bb64-bf3b-476d-b21c-e737ce576e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:32.881685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7bb64-bf3b-476d-b21c-e737ce576e20 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:32.882067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7bb64-bf3b-476d-b21c-e737ce576e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:32.882434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7bb64-bf3b-476d-b21c-e737ce576e20 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:32.883270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7bb64-bf3b-476d-b21c-e737ce576e20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:32.885750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7bb64-bf3b-476d-b21c-e737ce576e20 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:32.889417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc8cd4-08cb-4589-ad48-33bd4baff630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:32.897492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc8cd4-08cb-4589-ad48-33bd4baff630 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:32.905695 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3926/7789] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:46:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:46:33.018592 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3864/7790] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:46:32 2022] POST /identity/v3/projects => generated 393 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:46:33.022725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc8cd4-08cb-4589-ad48-33bd4baff630 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:33.033409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc8cd4-08cb-4589-ad48-33bd4baff630 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:33.096638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050a6e2-73d7-4333-a6e0-af2d8aae0cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:33.097306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050a6e2-73d7-4333-a6e0-af2d8aae0cdd admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:33.097586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050a6e2-73d7-4333-a6e0-af2d8aae0cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:33.097862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050a6e2-73d7-4333-a6e0-af2d8aae0cdd admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:33.098542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050a6e2-73d7-4333-a6e0-af2d8aae0cdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:33.100480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050a6e2-73d7-4333-a6e0-af2d8aae0cdd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:33.107686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:33.164191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7bb64-bf3b-476d-b21c-e737ce576e20 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:33.166260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c5d7bb64-bf3b-476d-b21c-e737ce576e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:33.179657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7bb64-bf3b-476d-b21c-e737ce576e20 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:33.185835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2631e8-49bb-498f-b7ed-b3e004d075fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:33.188520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2631e8-49bb-498f-b7ed-b3e004d075fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:33.188520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2631e8-49bb-498f-b7ed-b3e004d075fd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:33.188520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2631e8-49bb-498f-b7ed-b3e004d075fd admin admin] PATH_INFO: `/v3/projects/77c9b7e351e24dc88207e9498f75f578` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:33.189483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2631e8-49bb-498f-b7ed-b3e004d075fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=77c9b7e351e24dc88207e9498f75f578)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:33.191478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2631e8-49bb-498f-b7ed-b3e004d075fd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:33.198845 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3927/7791] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:46:33 2022] POST /identity/v3/users => generated 303 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:46:33.200264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050a6e2-73d7-4333-a6e0-af2d8aae0cdd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:33.211031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050a6e2-73d7-4333-a6e0-af2d8aae0cdd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:33.216410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140d150-8995-4f11-825e-84f63cf5d005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:33.217066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140d150-8995-4f11-825e-84f63cf5d005 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:33.217350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140d150-8995-4f11-825e-84f63cf5d005 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:33.217707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140d150-8995-4f11-825e-84f63cf5d005 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:33.218435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140d150-8995-4f11-825e-84f63cf5d005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:33.220073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140d150-8995-4f11-825e-84f63cf5d005 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:33.233531 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3928/7792] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:46:33.237468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140d150-8995-4f11-825e-84f63cf5d005 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:33.248346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140d150-8995-4f11-825e-84f63cf5d005 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:33.253146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cda72-b9bb-4bbb-9402-d03469aec641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:33.260080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cda72-b9bb-4bbb-9402-d03469aec641 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:33.260080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cda72-b9bb-4bbb-9402-d03469aec641 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:33.260080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cda72-b9bb-4bbb-9402-d03469aec641 admin admin] PATH_INFO: `/v3/projects/9507fc9d428e4ad7a6bd4d64092ebc19/users/b348d36ab0ba42b8b4bc5557761b20a7/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:33.274245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366cda72-b9bb-4bbb-9402-d03469aec641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9507fc9d428e4ad7a6bd4d64092ebc19, user_id=b348d36ab0ba42b8b4bc5557761b20a7, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:33.277591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366cda72-b9bb-4bbb-9402-d03469aec641 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:33.343029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:33.351948 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3929/7793] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:46:33 2022] PUT /identity/v3/projects/9507fc9d428e4ad7a6bd4d64092ebc19/users/b348d36ab0ba42b8b4bc5557761b20a7/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:46:33.356152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cda72-b9bb-4bbb-9402-d03469aec641 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:33.356777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3f2631e8-49bb-498f-b7ed-b3e004d075fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77c9b7e351e24dc88207e9498f75f578', 'request_id': 'req-3f2631e8-49bb-498f-b7ed-b3e004d075fd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:33.362933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3f2631e8-49bb-498f-b7ed-b3e004d075fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77c9b7e351e24dc88207e9498f75f578', 'request_id': 'req-3f2631e8-49bb-498f-b7ed-b3e004d075fd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:33.370290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3f2631e8-49bb-498f-b7ed-b3e004d075fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77c9b7e351e24dc88207e9498f75f578', 'request_id': 'req-3f2631e8-49bb-498f-b7ed-b3e004d075fd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:33.424539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cda72-b9bb-4bbb-9402-d03469aec641 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:33.450350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3f2631e8-49bb-498f-b7ed-b3e004d075fd admin admin] The token cache is being invalidate because project 77c9b7e351e24dc88207e9498f75f578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:46:33.450940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3f2631e8-49bb-498f-b7ed-b3e004d075fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:33.451806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-3f2631e8-49bb-498f-b7ed-b3e004d075fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:33.453736 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3865/7794] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:46:33 2022] DELETE /identity/v3/projects/77c9b7e351e24dc88207e9498f75f578 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:46:33.458877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2631e8-49bb-498f-b7ed-b3e004d075fd admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:33.460648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3f2631e8-49bb-498f-b7ed-b3e004d075fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:33.485726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe527eb-7046-4813-a538-911de9a1dbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:33.485726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe527eb-7046-4813-a538-911de9a1dbff admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:33.485726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe527eb-7046-4813-a538-911de9a1dbff admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:33.486046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe527eb-7046-4813-a538-911de9a1dbff admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:33.486629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe527eb-7046-4813-a538-911de9a1dbff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:33.488339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe527eb-7046-4813-a538-911de9a1dbff admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:33.500957 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3930/7795] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:46:33.505155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe527eb-7046-4813-a538-911de9a1dbff admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:33.508423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6fe527eb-7046-4813-a538-911de9a1dbff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:33.521862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe527eb-7046-4813-a538-911de9a1dbff admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:33.527457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bfa65-f3fe-4104-af2f-46a4dbf1dda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:33.528342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bfa65-f3fe-4104-af2f-46a4dbf1dda6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:33.528619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bfa65-f3fe-4104-af2f-46a4dbf1dda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:33.528893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bfa65-f3fe-4104-af2f-46a4dbf1dda6 admin admin] PATH_INFO: `/v3/projects/9507fc9d428e4ad7a6bd4d64092ebc19/users/b348d36ab0ba42b8b4bc5557761b20a7/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:33.530898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320bfa65-f3fe-4104-af2f-46a4dbf1dda6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9507fc9d428e4ad7a6bd4d64092ebc19, user_id=b348d36ab0ba42b8b4bc5557761b20a7, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:33.535725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320bfa65-f3fe-4104-af2f-46a4dbf1dda6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:33.536442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2631e8-49bb-498f-b7ed-b3e004d075fd admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:33.541961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326e495-7e08-46ed-a186-9310b9a15b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:33.542841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326e495-7e08-46ed-a186-9310b9a15b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:33.543260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326e495-7e08-46ed-a186-9310b9a15b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:33.549920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326e495-7e08-46ed-a186-9310b9a15b60 admin admin] PATH_INFO: `/v3/users/12b39cdbf0db4052b7197313efcc4d21` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:33.549920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326e495-7e08-46ed-a186-9310b9a15b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12b39cdbf0db4052b7197313efcc4d21)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:33.549920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326e495-7e08-46ed-a186-9310b9a15b60 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:33.550241 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3931/7796] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:46:33 2022] PUT /identity/v3/projects/9507fc9d428e4ad7a6bd4d64092ebc19/users/b348d36ab0ba42b8b4bc5557761b20a7/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:33.560586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f7e2c-aaa3-4c92-8409-194d4d244d4e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:33.560882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f7e2c-aaa3-4c92-8409-194d4d244d4e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:33.561185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f7e2c-aaa3-4c92-8409-194d4d244d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:33.588071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-555f7e2c-aaa3-4c92-8409-194d4d244d4e None None] MFA Rules not processed for user `b348d36ab0ba42b8b4bc5557761b20a7`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:33.589284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-555f7e2c-aaa3-4c92-8409-194d4d244d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:33.622395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:33.657313 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3932/7797] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:46:33.661779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f7e2c-aaa3-4c92-8409-194d4d244d4e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:33.722804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f7e2c-aaa3-4c92-8409-194d4d244d4e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:33.728163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a89705-3131-4848-b8ec-f18b26fb21c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:33.728896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a89705-3131-4848-b8ec-f18b26fb21c5 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:33.729207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a89705-3131-4848-b8ec-f18b26fb21c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:33.729478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a89705-3131-4848-b8ec-f18b26fb21c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:33.730150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a89705-3131-4848-b8ec-f18b26fb21c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:33.732162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a89705-3131-4848-b8ec-f18b26fb21c5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:33.816683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f326e495-7e08-46ed-a186-9310b9a15b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12b39cdbf0db4052b7197313efcc4d21'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:33.829445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f326e495-7e08-46ed-a186-9310b9a15b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12b39cdbf0db4052b7197313efcc4d21'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:33.840394 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3933/7798] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:46:33 2022] POST /identity/v3/projects => generated 393 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:46:33.844239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a89705-3131-4848-b8ec-f18b26fb21c5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:33.905561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a89705-3131-4848-b8ec-f18b26fb21c5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:33.910309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7d9fd-0a17-4a7c-93ec-ca2bcb65e23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:33.910975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7d9fd-0a17-4a7c-93ec-ca2bcb65e23c admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:33.911351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7d9fd-0a17-4a7c-93ec-ca2bcb65e23c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:33.911662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7d9fd-0a17-4a7c-93ec-ca2bcb65e23c admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:33.912349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7d9fd-0a17-4a7c-93ec-ca2bcb65e23c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:33.914269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7d9fd-0a17-4a7c-93ec-ca2bcb65e23c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:33.950851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f326e495-7e08-46ed-a186-9310b9a15b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12b39cdbf0db4052b7197313efcc4d21'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:33.960862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f326e495-7e08-46ed-a186-9310b9a15b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12b39cdbf0db4052b7197313efcc4d21'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:33.960862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-f326e495-7e08-46ed-a186-9310b9a15b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12b39cdbf0db4052b7197313efcc4d21'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:33.965853 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3866/7799] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:46:33 2022] DELETE /identity/v3/users/12b39cdbf0db4052b7197313efcc4d21 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:34.021172 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3934/7800] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:46:33 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:46:34.022669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326e495-7e08-46ed-a186-9310b9a15b60 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:34.024592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f326e495-7e08-46ed-a186-9310b9a15b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:34.083518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:34.109660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326e495-7e08-46ed-a186-9310b9a15b60 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:34.117827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89120c25-38ed-46ef-b172-b01654326fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:34.119413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89120c25-38ed-46ef-b172-b01654326fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:34.121155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89120c25-38ed-46ef-b172-b01654326fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:34.121155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89120c25-38ed-46ef-b172-b01654326fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:34.121978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89120c25-38ed-46ef-b172-b01654326fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:34.124015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89120c25-38ed-46ef-b172-b01654326fe1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:34.137281 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3867/7801] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:46:34.141132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7d9fd-0a17-4a7c-93ec-ca2bcb65e23c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:34.163837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7d9fd-0a17-4a7c-93ec-ca2bcb65e23c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:34.169874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec4450-4789-4c05-a942-461028687368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:34.170741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec4450-4789-4c05-a942-461028687368 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:34.171132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec4450-4789-4c05-a942-461028687368 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:34.171491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec4450-4789-4c05-a942-461028687368 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:34.172534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec4450-4789-4c05-a942-461028687368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:34.174013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec4450-4789-4c05-a942-461028687368 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:34.187546 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3935/7802] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:46:34.190598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89120c25-38ed-46ef-b172-b01654326fe1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:34.201597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89120c25-38ed-46ef-b172-b01654326fe1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:34.206507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c21328-86da-4a15-901a-a56f2e3d0164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:34.207566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c21328-86da-4a15-901a-a56f2e3d0164 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:34.207947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c21328-86da-4a15-901a-a56f2e3d0164 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:34.208318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c21328-86da-4a15-901a-a56f2e3d0164 admin admin] PATH_INFO: `/v3/projects/5cd88d95d5044e61a7736b3809c0c230/users/373516f48f2d49fdadc9c7e6367b276c/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:34.224468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c21328-86da-4a15-901a-a56f2e3d0164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd88d95d5044e61a7736b3809c0c230, user_id=373516f48f2d49fdadc9c7e6367b276c, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:34.227280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c21328-86da-4a15-901a-a56f2e3d0164 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:34.307508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec4450-4789-4c05-a942-461028687368 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:34.309341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3bec4450-4789-4c05-a942-461028687368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:34.323807 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3868/7803] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:46:34 2022] PUT /identity/v3/projects/5cd88d95d5044e61a7736b3809c0c230/users/373516f48f2d49fdadc9c7e6367b276c/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:34.332997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec4450-4789-4c05-a942-461028687368 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:34.334381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a72e07-0b10-4854-a301-e38598250767 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:34.334748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a72e07-0b10-4854-a301-e38598250767 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:34.335191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a72e07-0b10-4854-a301-e38598250767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:34.376593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:34.381725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b5a72e07-0b10-4854-a301-e38598250767 None None] MFA Rules not processed for user `373516f48f2d49fdadc9c7e6367b276c`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:34.387218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b5a72e07-0b10-4854-a301-e38598250767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:34.407190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ecdc8-45d8-46a7-b36b-62db8bc7533e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:34.408063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ecdc8-45d8-46a7-b36b-62db8bc7533e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:34.408347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ecdc8-45d8-46a7-b36b-62db8bc7533e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:34.408621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ecdc8-45d8-46a7-b36b-62db8bc7533e admin admin] PATH_INFO: `/v3/projects/8736916be07c4e6886ed5280d4cce420` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:34.409823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ecdc8-45d8-46a7-b36b-62db8bc7533e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8736916be07c4e6886ed5280d4cce420)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:34.411771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ecdc8-45d8-46a7-b36b-62db8bc7533e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:34.454961 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3869/7804] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:34.467862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a72e07-0b10-4854-a301-e38598250767 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:34.469217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b5a72e07-0b10-4854-a301-e38598250767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:34.529249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a72e07-0b10-4854-a301-e38598250767 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:34.536301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9bf6a-0211-42cc-b720-c798ff9741e1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:34.537484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9bf6a-0211-42cc-b720-c798ff9741e1 service glance] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:34.537484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9bf6a-0211-42cc-b720-c798ff9741e1 service glance] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:34.537484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9bf6a-0211-42cc-b720-c798ff9741e1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:34.539735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c0c9bf6a-0211-42cc-b720-c798ff9741e1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:34.553526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa8ecdc8-45d8-46a7-b36b-62db8bc7533e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8736916be07c4e6886ed5280d4cce420', 'request_id': 'req-aa8ecdc8-45d8-46a7-b36b-62db8bc7533e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:34.560191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa8ecdc8-45d8-46a7-b36b-62db8bc7533e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8736916be07c4e6886ed5280d4cce420', 'request_id': 'req-aa8ecdc8-45d8-46a7-b36b-62db8bc7533e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:34.566089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa8ecdc8-45d8-46a7-b36b-62db8bc7533e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8736916be07c4e6886ed5280d4cce420', 'request_id': 'req-aa8ecdc8-45d8-46a7-b36b-62db8bc7533e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:34.593916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:34.606787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9bf6a-0211-42cc-b720-c798ff9741e1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:34.608335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9bf6a-0211-42cc-b720-c798ff9741e1 service glance] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:34.619219 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3870/7805] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:46:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:46:34.647604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa8ecdc8-45d8-46a7-b36b-62db8bc7533e admin admin] The token cache is being invalidate because project 8736916be07c4e6886ed5280d4cce420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:46:34.653321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa8ecdc8-45d8-46a7-b36b-62db8bc7533e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:34.653321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aa8ecdc8-45d8-46a7-b36b-62db8bc7533e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:34.653321 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3936/7806] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:46:34 2022] DELETE /identity/v3/projects/8736916be07c4e6886ed5280d4cce420 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:36.182320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9bf6a-0211-42cc-b720-c798ff9741e1 service glance] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:36.194048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9bf6a-0211-42cc-b720-c798ff9741e1 service glance] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:36.257212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32816d-eb51-49a5-93d8-89d2d9f2f791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:36.258153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32816d-eb51-49a5-93d8-89d2d9f2f791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:36.258454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32816d-eb51-49a5-93d8-89d2d9f2f791 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:36.258713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32816d-eb51-49a5-93d8-89d2d9f2f791 admin admin] PATH_INFO: `/v3/users/b348d36ab0ba42b8b4bc5557761b20a7` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:36.259962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32816d-eb51-49a5-93d8-89d2d9f2f791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b348d36ab0ba42b8b4bc5557761b20a7)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:36.262707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32816d-eb51-49a5-93d8-89d2d9f2f791 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:36.424969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6f32816d-eb51-49a5-93d8-89d2d9f2f791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b348d36ab0ba42b8b4bc5557761b20a7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:36.440058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6f32816d-eb51-49a5-93d8-89d2d9f2f791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b348d36ab0ba42b8b4bc5557761b20a7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:36.516823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6f32816d-eb51-49a5-93d8-89d2d9f2f791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b348d36ab0ba42b8b4bc5557761b20a7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:36.524549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6f32816d-eb51-49a5-93d8-89d2d9f2f791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b348d36ab0ba42b8b4bc5557761b20a7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:36.533393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6f32816d-eb51-49a5-93d8-89d2d9f2f791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b348d36ab0ba42b8b4bc5557761b20a7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:36.533393 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3871/7807] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:46:36 2022] DELETE /identity/v3/users/b348d36ab0ba42b8b4bc5557761b20a7 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:36.535947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ace733-59a0-4a19-a70b-51cc04218714 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:36.536426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ace733-59a0-4a19-a70b-51cc04218714 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:36.536531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ace733-59a0-4a19-a70b-51cc04218714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:36.554800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-75ace733-59a0-4a19-a70b-51cc04218714 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:36.556056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-75ace733-59a0-4a19-a70b-51cc04218714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:36.615295 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3937/7808] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:36.625868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32816d-eb51-49a5-93d8-89d2d9f2f791 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:36.627469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6f32816d-eb51-49a5-93d8-89d2d9f2f791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:36.690455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32816d-eb51-49a5-93d8-89d2d9f2f791 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:36.694213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb909f2-c5fe-4c5d-84d1-de6aaa83c92f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:36.694869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb909f2-c5fe-4c5d-84d1-de6aaa83c92f service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:36.695191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb909f2-c5fe-4c5d-84d1-de6aaa83c92f service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:36.695481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb909f2-c5fe-4c5d-84d1-de6aaa83c92f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:36.708285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb909f2-c5fe-4c5d-84d1-de6aaa83c92f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:36.709755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb909f2-c5fe-4c5d-84d1-de6aaa83c92f service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:36.720951 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3872/7809] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:46:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:46:37.144815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ace733-59a0-4a19-a70b-51cc04218714 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:37.146655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-75ace733-59a0-4a19-a70b-51cc04218714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:37.164458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ace733-59a0-4a19-a70b-51cc04218714 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:37.171184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f52b9-2882-4bec-b75e-29de7efcfe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:37.172325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f52b9-2882-4bec-b75e-29de7efcfe3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:37.172506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f52b9-2882-4bec-b75e-29de7efcfe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:37.172779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f52b9-2882-4bec-b75e-29de7efcfe3d admin admin] PATH_INFO: `/v3/projects/9507fc9d428e4ad7a6bd4d64092ebc19` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:37.174006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f52b9-2882-4bec-b75e-29de7efcfe3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9507fc9d428e4ad7a6bd4d64092ebc19)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:37.176226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f52b9-2882-4bec-b75e-29de7efcfe3d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:37.274792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6f6f52b9-2882-4bec-b75e-29de7efcfe3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9507fc9d428e4ad7a6bd4d64092ebc19', 'request_id': 'req-6f6f52b9-2882-4bec-b75e-29de7efcfe3d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:37.281690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6f6f52b9-2882-4bec-b75e-29de7efcfe3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9507fc9d428e4ad7a6bd4d64092ebc19', 'request_id': 'req-6f6f52b9-2882-4bec-b75e-29de7efcfe3d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:37.285563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:37.287980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6f6f52b9-2882-4bec-b75e-29de7efcfe3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9507fc9d428e4ad7a6bd4d64092ebc19', 'request_id': 'req-6f6f52b9-2882-4bec-b75e-29de7efcfe3d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:37.362484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6f6f52b9-2882-4bec-b75e-29de7efcfe3d admin admin] The token cache is being invalidate because project 9507fc9d428e4ad7a6bd4d64092ebc19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:46:37.362827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6f6f52b9-2882-4bec-b75e-29de7efcfe3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:37.363407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6f6f52b9-2882-4bec-b75e-29de7efcfe3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:37.365014 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3938/7810] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:46:37 2022] DELETE /identity/v3/projects/9507fc9d428e4ad7a6bd4d64092ebc19 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:37.369132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb909f2-c5fe-4c5d-84d1-de6aaa83c92f service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:37.379384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb909f2-c5fe-4c5d-84d1-de6aaa83c92f service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:37.387224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:37.438371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bb142-07a7-4d38-871f-8b057f152be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:37.439328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bb142-07a7-4d38-871f-8b057f152be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:37.439618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bb142-07a7-4d38-871f-8b057f152be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:37.439892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bb142-07a7-4d38-871f-8b057f152be3 admin admin] PATH_INFO: `/v3/users/373516f48f2d49fdadc9c7e6367b276c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:37.441154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bb142-07a7-4d38-871f-8b057f152be3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=373516f48f2d49fdadc9c7e6367b276c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:37.443242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bb142-07a7-4d38-871f-8b057f152be3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:37.672152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-447bb142-07a7-4d38-871f-8b057f152be3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '373516f48f2d49fdadc9c7e6367b276c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:37.683908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-447bb142-07a7-4d38-871f-8b057f152be3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '373516f48f2d49fdadc9c7e6367b276c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:37.759878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-447bb142-07a7-4d38-871f-8b057f152be3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '373516f48f2d49fdadc9c7e6367b276c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:37.767928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-447bb142-07a7-4d38-871f-8b057f152be3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '373516f48f2d49fdadc9c7e6367b276c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:37.768568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-447bb142-07a7-4d38-871f-8b057f152be3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '373516f48f2d49fdadc9c7e6367b276c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:37.774464 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3873/7811] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:46:37 2022] DELETE /identity/v3/users/373516f48f2d49fdadc9c7e6367b276c => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:38.225039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f52b9-2882-4bec-b75e-29de7efcfe3d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:38.230110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6f6f52b9-2882-4bec-b75e-29de7efcfe3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:38.242138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f52b9-2882-4bec-b75e-29de7efcfe3d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:38.301922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482d751-0f31-4da6-ad3f-bda3e1352e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:38.302804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482d751-0f31-4da6-ad3f-bda3e1352e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:38.303144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482d751-0f31-4da6-ad3f-bda3e1352e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:38.303422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482d751-0f31-4da6-ad3f-bda3e1352e69 admin admin] PATH_INFO: `/v3/projects/5cd88d95d5044e61a7736b3809c0c230` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:38.304604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482d751-0f31-4da6-ad3f-bda3e1352e69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd88d95d5044e61a7736b3809c0c230)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:38.306607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482d751-0f31-4da6-ad3f-bda3e1352e69 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:38.420710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f482d751-0f31-4da6-ad3f-bda3e1352e69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd88d95d5044e61a7736b3809c0c230', 'request_id': 'req-f482d751-0f31-4da6-ad3f-bda3e1352e69'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:38.428011 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f482d751-0f31-4da6-ad3f-bda3e1352e69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd88d95d5044e61a7736b3809c0c230', 'request_id': 'req-f482d751-0f31-4da6-ad3f-bda3e1352e69'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:38.434085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f482d751-0f31-4da6-ad3f-bda3e1352e69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd88d95d5044e61a7736b3809c0c230', 'request_id': 'req-f482d751-0f31-4da6-ad3f-bda3e1352e69'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:38.522225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f482d751-0f31-4da6-ad3f-bda3e1352e69 admin admin] The token cache is being invalidate because project 5cd88d95d5044e61a7736b3809c0c230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:46:38.522520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f482d751-0f31-4da6-ad3f-bda3e1352e69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:38.523199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f482d751-0f31-4da6-ad3f-bda3e1352e69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:38.524789 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3939/7812] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:46:38 2022] DELETE /identity/v3/projects/5cd88d95d5044e61a7736b3809c0c230 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:38.531357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fa123-f80c-4787-9216-5689846abd97 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:38.531825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fa123-f80c-4787-9216-5689846abd97 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:38.531947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fa123-f80c-4787-9216-5689846abd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:38.550738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-240fa123-f80c-4787-9216-5689846abd97 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:38.552086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-240fa123-f80c-4787-9216-5689846abd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:38.614475 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3874/7813] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:46:38.622323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4cb55-caaa-49d4-a050-3efa60ac55da None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:38.622674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4cb55-caaa-49d4-a050-3efa60ac55da None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:38.623246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4cb55-caaa-49d4-a050-3efa60ac55da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:38.642742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-51a4cb55-caaa-49d4-a050-3efa60ac55da None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:38.644063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-51a4cb55-caaa-49d4-a050-3efa60ac55da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:38.656195 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3940/7814] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:46:38.660599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fa123-f80c-4787-9216-5689846abd97 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:38.673082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fa123-f80c-4787-9216-5689846abd97 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:38.678133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d2ed8-7a59-4bb5-af39-176209be4abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:38.678807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d2ed8-7a59-4bb5-af39-176209be4abe admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:38.679130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d2ed8-7a59-4bb5-af39-176209be4abe admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:38.679418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d2ed8-7a59-4bb5-af39-176209be4abe admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:38.680151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d2ed8-7a59-4bb5-af39-176209be4abe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:46:38.680522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d2ed8-7a59-4bb5-af39-176209be4abe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:38.682293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d2ed8-7a59-4bb5-af39-176209be4abe admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:38.695575 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3875/7815] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:46:38.700089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4cb55-caaa-49d4-a050-3efa60ac55da None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:38.710284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4cb55-caaa-49d4-a050-3efa60ac55da None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:38.715771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568f90e-1168-47de-bd9e-160008a746cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:38.717310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568f90e-1168-47de-bd9e-160008a746cd admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:38.717710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568f90e-1168-47de-bd9e-160008a746cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:38.718062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568f90e-1168-47de-bd9e-160008a746cd admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:38.718821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568f90e-1168-47de-bd9e-160008a746cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:38.721225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568f90e-1168-47de-bd9e-160008a746cd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:38.819587 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3941/7816] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:46:38 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:46:38.824016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d2ed8-7a59-4bb5-af39-176209be4abe admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:38.835765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d2ed8-7a59-4bb5-af39-176209be4abe admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:38.849652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:38.898814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907da6f-6e4e-4200-96c9-93f51ff9beca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:38.899625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907da6f-6e4e-4200-96c9-93f51ff9beca admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:38.899907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907da6f-6e4e-4200-96c9-93f51ff9beca admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:38.900179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907da6f-6e4e-4200-96c9-93f51ff9beca admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:38.900867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907da6f-6e4e-4200-96c9-93f51ff9beca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:38.902807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907da6f-6e4e-4200-96c9-93f51ff9beca admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:39.009210 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3876/7817] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:46:38 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:46:39.014040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568f90e-1168-47de-bd9e-160008a746cd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:39.025502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568f90e-1168-47de-bd9e-160008a746cd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:39.030551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97848d7b-fe49-457d-afa0-51fa1117fcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:39.031277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97848d7b-fe49-457d-afa0-51fa1117fcd9 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:39.031730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97848d7b-fe49-457d-afa0-51fa1117fcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:39.032020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97848d7b-fe49-457d-afa0-51fa1117fcd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:39.032757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97848d7b-fe49-457d-afa0-51fa1117fcd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:39.034468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97848d7b-fe49-457d-afa0-51fa1117fcd9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:39.049843 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3942/7818] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:46:39.051564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907da6f-6e4e-4200-96c9-93f51ff9beca admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:39.063512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907da6f-6e4e-4200-96c9-93f51ff9beca admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:39.068365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b564b0c-64a5-4e9f-9e78-b936cd87d36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:39.073821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b564b0c-64a5-4e9f-9e78-b936cd87d36f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:39.073821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b564b0c-64a5-4e9f-9e78-b936cd87d36f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:39.073821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b564b0c-64a5-4e9f-9e78-b936cd87d36f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:39.073821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b564b0c-64a5-4e9f-9e78-b936cd87d36f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:39.073821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b564b0c-64a5-4e9f-9e78-b936cd87d36f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:39.083879 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3877/7819] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:46:39.088712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97848d7b-fe49-457d-afa0-51fa1117fcd9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:39.100668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97848d7b-fe49-457d-afa0-51fa1117fcd9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:39.107391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93896d-d59d-4395-89e5-e18563786398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:39.107738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93896d-d59d-4395-89e5-e18563786398 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:39.107971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93896d-d59d-4395-89e5-e18563786398 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:39.108377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93896d-d59d-4395-89e5-e18563786398 admin admin] PATH_INFO: `/v3/projects/a77bf64ddde34010b48a09769054c228/users/55bc22049ad849ca89e3a832884d9811/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:39.124123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0561739-56ca-4cde-a545-76a271a86074 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:39.127905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93896d-d59d-4395-89e5-e18563786398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a77bf64ddde34010b48a09769054c228, user_id=55bc22049ad849ca89e3a832884d9811, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:39.129664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0561739-56ca-4cde-a545-76a271a86074 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:39.130094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0561739-56ca-4cde-a545-76a271a86074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:39.131688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93896d-d59d-4395-89e5-e18563786398 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:39.152399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d0561739-56ca-4cde-a545-76a271a86074 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:39.153818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d0561739-56ca-4cde-a545-76a271a86074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:39.213946 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3878/7820] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:46:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:46:39.226563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0561739-56ca-4cde-a545-76a271a86074 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:39.228209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d0561739-56ca-4cde-a545-76a271a86074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:39.241450 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3943/7821] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:46:39 2022] PUT /identity/v3/projects/a77bf64ddde34010b48a09769054c228/users/55bc22049ad849ca89e3a832884d9811/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:39.253156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39148676-6b9c-45a3-88ed-86de76e70d25 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:39.254025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39148676-6b9c-45a3-88ed-86de76e70d25 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:39.254495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39148676-6b9c-45a3-88ed-86de76e70d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:39.288185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:39.291875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-39148676-6b9c-45a3-88ed-86de76e70d25 None None] MFA Rules not processed for user `55bc22049ad849ca89e3a832884d9811`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:39.293481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-39148676-6b9c-45a3-88ed-86de76e70d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:39.318086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0561739-56ca-4cde-a545-76a271a86074 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:39.361708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:39.362403 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3944/7822] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:46:39.374593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39148676-6b9c-45a3-88ed-86de76e70d25 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:39.375974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-39148676-6b9c-45a3-88ed-86de76e70d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:39.382418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e761eb9-b01d-4f9f-966f-105786507a4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:39.383109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e761eb9-b01d-4f9f-966f-105786507a4c service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:39.383393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e761eb9-b01d-4f9f-966f-105786507a4c service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:39.383669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e761eb9-b01d-4f9f-966f-105786507a4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:39.437581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39148676-6b9c-45a3-88ed-86de76e70d25 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:39.444711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd95c54-01f5-422b-b496-447bb2179cc9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:39.445445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd95c54-01f5-422b-b496-447bb2179cc9 service glance] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:39.445729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd95c54-01f5-422b-b496-447bb2179cc9 service glance] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:39.446006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd95c54-01f5-422b-b496-447bb2179cc9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:39.446288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e761eb9-b01d-4f9f-966f-105786507a4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:39.447972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e761eb9-b01d-4f9f-966f-105786507a4c service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:39.455296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd95c54-01f5-422b-b496-447bb2179cc9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:39.456745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd95c54-01f5-422b-b496-447bb2179cc9 service glance] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:39.457201 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3879/7823] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:46:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:46:39.467375 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3945/7824] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:46:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:46:39.573120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e761eb9-b01d-4f9f-966f-105786507a4c service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:39.636940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e761eb9-b01d-4f9f-966f-105786507a4c service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:39.641851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b5aa9-1112-49e1-9e6c-84f8c9d62e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:39.642706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b5aa9-1112-49e1-9e6c-84f8c9d62e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:39.642993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b5aa9-1112-49e1-9e6c-84f8c9d62e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:39.643303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b5aa9-1112-49e1-9e6c-84f8c9d62e04 admin admin] PATH_INFO: `/v3/users/55bc22049ad849ca89e3a832884d9811` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:39.644509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b5aa9-1112-49e1-9e6c-84f8c9d62e04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55bc22049ad849ca89e3a832884d9811)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:39.646483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b5aa9-1112-49e1-9e6c-84f8c9d62e04 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:39.871219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-977b5aa9-1112-49e1-9e6c-84f8c9d62e04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55bc22049ad849ca89e3a832884d9811'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:39.897807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-977b5aa9-1112-49e1-9e6c-84f8c9d62e04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55bc22049ad849ca89e3a832884d9811'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:40.034425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-977b5aa9-1112-49e1-9e6c-84f8c9d62e04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55bc22049ad849ca89e3a832884d9811'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:40.047663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-977b5aa9-1112-49e1-9e6c-84f8c9d62e04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55bc22049ad849ca89e3a832884d9811'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:40.048455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-977b5aa9-1112-49e1-9e6c-84f8c9d62e04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55bc22049ad849ca89e3a832884d9811'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:40.057321 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3880/7825] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:46:39 2022] DELETE /identity/v3/users/55bc22049ad849ca89e3a832884d9811 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:40.063127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1b40d-9bb8-4f64-8d3c-5706d0735141 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:40.063521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1b40d-9bb8-4f64-8d3c-5706d0735141 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:40.065592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1b40d-9bb8-4f64-8d3c-5706d0735141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:40.085630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-39f1b40d-9bb8-4f64-8d3c-5706d0735141 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:40.086989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-39f1b40d-9bb8-4f64-8d3c-5706d0735141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:40.172366 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3946/7826] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:40.181758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b5aa9-1112-49e1-9e6c-84f8c9d62e04 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:40.189771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-977b5aa9-1112-49e1-9e6c-84f8c9d62e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:40.197487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:40.271181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b5aa9-1112-49e1-9e6c-84f8c9d62e04 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:40.276293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0f063-617a-47a3-8458-0faa0120c0a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:40.277075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0f063-617a-47a3-8458-0faa0120c0a7 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:40.277449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0f063-617a-47a3-8458-0faa0120c0a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:40.277818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0f063-617a-47a3-8458-0faa0120c0a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:40.289070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0f063-617a-47a3-8458-0faa0120c0a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:40.290759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0f063-617a-47a3-8458-0faa0120c0a7 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:40.302185 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3881/7827] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:46:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:46:40.791608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1b40d-9bb8-4f64-8d3c-5706d0735141 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:40.792721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-39f1b40d-9bb8-4f64-8d3c-5706d0735141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:40.814733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1b40d-9bb8-4f64-8d3c-5706d0735141 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:40.815570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46631da5-5676-4ea5-88fa-9d2a279ceb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:40.816446 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46631da5-5676-4ea5-88fa-9d2a279ceb30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:40.817429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46631da5-5676-4ea5-88fa-9d2a279ceb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:40.817740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46631da5-5676-4ea5-88fa-9d2a279ceb30 admin admin] PATH_INFO: `/v3/projects/a77bf64ddde34010b48a09769054c228` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:40.829247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46631da5-5676-4ea5-88fa-9d2a279ceb30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a77bf64ddde34010b48a09769054c228)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:40.831292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46631da5-5676-4ea5-88fa-9d2a279ceb30 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:41.018493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:41.035227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-46631da5-5676-4ea5-88fa-9d2a279ceb30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a77bf64ddde34010b48a09769054c228', 'request_id': 'req-46631da5-5676-4ea5-88fa-9d2a279ceb30'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:41.046506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-46631da5-5676-4ea5-88fa-9d2a279ceb30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a77bf64ddde34010b48a09769054c228', 'request_id': 'req-46631da5-5676-4ea5-88fa-9d2a279ceb30'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:41.058442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-46631da5-5676-4ea5-88fa-9d2a279ceb30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a77bf64ddde34010b48a09769054c228', 'request_id': 'req-46631da5-5676-4ea5-88fa-9d2a279ceb30'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:41.168205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-46631da5-5676-4ea5-88fa-9d2a279ceb30 admin admin] The token cache is being invalidate because project a77bf64ddde34010b48a09769054c228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:46:41.168500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-46631da5-5676-4ea5-88fa-9d2a279ceb30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:41.169144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-46631da5-5676-4ea5-88fa-9d2a279ceb30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:41.179079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea671c-c678-4539-b5ac-55c5fe92f178 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:41.179624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea671c-c678-4539-b5ac-55c5fe92f178 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:41.179624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea671c-c678-4539-b5ac-55c5fe92f178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:41.181169 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3947/7828] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:46:40 2022] DELETE /identity/v3/projects/a77bf64ddde34010b48a09769054c228 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:41.202295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-52ea671c-c678-4539-b5ac-55c5fe92f178 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:41.203957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-52ea671c-c678-4539-b5ac-55c5fe92f178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:41.282131 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3882/7829] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:41.291736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e1dc1-80e5-4e1c-870e-ab7aecf9f2bc None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:41.291736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e1dc1-80e5-4e1c-870e-ab7aecf9f2bc None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:41.292803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e1dc1-80e5-4e1c-870e-ab7aecf9f2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:41.315420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-539e1dc1-80e5-4e1c-870e-ab7aecf9f2bc None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:41.316808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-539e1dc1-80e5-4e1c-870e-ab7aecf9f2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:41.330241 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3948/7830] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:41.331890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea671c-c678-4539-b5ac-55c5fe92f178 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:41.343253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea671c-c678-4539-b5ac-55c5fe92f178 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:41.348496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4147c-1972-4825-9edf-1bcdaeb9d265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:41.349352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4147c-1972-4825-9edf-1bcdaeb9d265 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:41.349833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4147c-1972-4825-9edf-1bcdaeb9d265 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:41.350122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4147c-1972-4825-9edf-1bcdaeb9d265 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:41.351239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4147c-1972-4825-9edf-1bcdaeb9d265 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:46:41.351556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4147c-1972-4825-9edf-1bcdaeb9d265 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:41.354876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4147c-1972-4825-9edf-1bcdaeb9d265 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:41.370417 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3883/7831] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:46:41.377114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e1dc1-80e5-4e1c-870e-ab7aecf9f2bc None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:41.386903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e1dc1-80e5-4e1c-870e-ab7aecf9f2bc None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:41.392744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8889e7-64de-4158-bfd0-61c7903b7dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:41.393426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8889e7-64de-4158-bfd0-61c7903b7dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:41.393773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8889e7-64de-4158-bfd0-61c7903b7dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:41.394039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8889e7-64de-4158-bfd0-61c7903b7dc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:41.394722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8889e7-64de-4158-bfd0-61c7903b7dc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:41.396738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8889e7-64de-4158-bfd0-61c7903b7dc1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:41.501591 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3949/7832] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:46:41 2022] POST /identity/v3/projects => generated 353 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:46:41.505910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4147c-1972-4825-9edf-1bcdaeb9d265 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:41.519668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4147c-1972-4825-9edf-1bcdaeb9d265 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:41.594897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ede94-c407-4429-a96e-667e86ea73bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:41.595606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ede94-c407-4429-a96e-667e86ea73bb admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:41.595892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ede94-c407-4429-a96e-667e86ea73bb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:41.596168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ede94-c407-4429-a96e-667e86ea73bb admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:41.596868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ede94-c407-4429-a96e-667e86ea73bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:41.598847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ede94-c407-4429-a96e-667e86ea73bb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:41.680141 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3884/7833] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:46:41 2022] POST /identity/v3/users => generated 277 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:46:41.684401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8889e7-64de-4158-bfd0-61c7903b7dc1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:41.696857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8889e7-64de-4158-bfd0-61c7903b7dc1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:41.702997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc5af0-0d53-40c5-a1c0-c45bb08d76a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:41.703822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc5af0-0d53-40c5-a1c0-c45bb08d76a6 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:41.704170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc5af0-0d53-40c5-a1c0-c45bb08d76a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:41.704524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc5af0-0d53-40c5-a1c0-c45bb08d76a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:41.705452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc5af0-0d53-40c5-a1c0-c45bb08d76a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:41.707189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc5af0-0d53-40c5-a1c0-c45bb08d76a6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:41.720903 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3950/7834] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:46:41.725019 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ede94-c407-4429-a96e-667e86ea73bb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:41.739729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ede94-c407-4429-a96e-667e86ea73bb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:41.745835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64698096-6dd9-4152-b56a-f159e6aa171a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:41.746841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64698096-6dd9-4152-b56a-f159e6aa171a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:41.747410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64698096-6dd9-4152-b56a-f159e6aa171a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:41.747786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64698096-6dd9-4152-b56a-f159e6aa171a admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:41.748896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64698096-6dd9-4152-b56a-f159e6aa171a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:41.750505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64698096-6dd9-4152-b56a-f159e6aa171a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:41.761717 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3885/7835] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:46:41.767674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc5af0-0d53-40c5-a1c0-c45bb08d76a6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:41.778630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc5af0-0d53-40c5-a1c0-c45bb08d76a6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:41.787908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ba6ae-5c89-4023-923a-8fc91caf3d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:41.788812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ba6ae-5c89-4023-923a-8fc91caf3d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:41.789237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ba6ae-5c89-4023-923a-8fc91caf3d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:41.789522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ba6ae-5c89-4023-923a-8fc91caf3d89 admin admin] PATH_INFO: `/v3/projects/b363af78683348de92af99df82861109/users/b0b9a2f1b1874c0c9cdbd119d1733449/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:41.810892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ba6ae-5c89-4023-923a-8fc91caf3d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b363af78683348de92af99df82861109, user_id=b0b9a2f1b1874c0c9cdbd119d1733449, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:41.814574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ba6ae-5c89-4023-923a-8fc91caf3d89 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:41.888263 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3951/7836] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:46:41 2022] PUT /identity/v3/projects/b363af78683348de92af99df82861109/users/b0b9a2f1b1874c0c9cdbd119d1733449/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:41.899491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fbed8-8ecc-40d8-bc66-d9ce0bf4421c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:41.899491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fbed8-8ecc-40d8-bc66-d9ce0bf4421c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:41.899491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fbed8-8ecc-40d8-bc66-d9ce0bf4421c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:41.927759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:41.930948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c01fbed8-8ecc-40d8-bc66-d9ce0bf4421c None None] MFA Rules not processed for user `b0b9a2f1b1874c0c9cdbd119d1733449`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:41.932207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c01fbed8-8ecc-40d8-bc66-d9ce0bf4421c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:42.019534 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3886/7837] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:41 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:42.023776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ba6ae-5c89-4023-923a-8fc91caf3d89 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:42.109858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ba6ae-5c89-4023-923a-8fc91caf3d89 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:42.118255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9cd59-b09f-4e64-b58b-fb82e81051c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:42.119183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9cd59-b09f-4e64-b58b-fb82e81051c5 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:42.119519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9cd59-b09f-4e64-b58b-fb82e81051c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:42.119884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9cd59-b09f-4e64-b58b-fb82e81051c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:42.120811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9cd59-b09f-4e64-b58b-fb82e81051c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:42.122873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9cd59-b09f-4e64-b58b-fb82e81051c5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:42.361033 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3952/7838] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:46:42 2022] POST /identity/v3/projects => generated 357 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:46:42.365395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fbed8-8ecc-40d8-bc66-d9ce0bf4421c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:42.378941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fbed8-8ecc-40d8-bc66-d9ce0bf4421c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:42.437667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27aa995-e6b5-4c67-874d-ad9706fe4cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:42.438665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27aa995-e6b5-4c67-874d-ad9706fe4cbe admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:42.438873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27aa995-e6b5-4c67-874d-ad9706fe4cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:42.439092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27aa995-e6b5-4c67-874d-ad9706fe4cbe admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:42.439740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27aa995-e6b5-4c67-874d-ad9706fe4cbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:42.441703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27aa995-e6b5-4c67-874d-ad9706fe4cbe admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:42.851772 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3887/7839] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:46:42 2022] POST /identity/v3/users => generated 285 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:46:42.851951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9cd59-b09f-4e64-b58b-fb82e81051c5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:42.856800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9cd59-b09f-4e64-b58b-fb82e81051c5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:42.862056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc009f-22b9-41f9-b0df-a9219a30b6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:42.862732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc009f-22b9-41f9-b0df-a9219a30b6ec admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:42.863040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc009f-22b9-41f9-b0df-a9219a30b6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:42.863336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc009f-22b9-41f9-b0df-a9219a30b6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:42.864076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc009f-22b9-41f9-b0df-a9219a30b6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:42.865720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc009f-22b9-41f9-b0df-a9219a30b6ec admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:42.884601 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3953/7840] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:46:42.884751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27aa995-e6b5-4c67-874d-ad9706fe4cbe admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:42.893893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27aa995-e6b5-4c67-874d-ad9706fe4cbe admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:42.898865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31ed77-89ff-41d4-b842-8d6469fde029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:42.899881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31ed77-89ff-41d4-b842-8d6469fde029 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:42.900230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31ed77-89ff-41d4-b842-8d6469fde029 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:42.900584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31ed77-89ff-41d4-b842-8d6469fde029 admin admin] PATH_INFO: `/v3/projects/4e8928f3975b47f4a220c22da1543e53/users/b52aa077f9b24738965fe0830b317994/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:42.922142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31ed77-89ff-41d4-b842-8d6469fde029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8928f3975b47f4a220c22da1543e53, user_id=b52aa077f9b24738965fe0830b317994, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:42.925041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31ed77-89ff-41d4-b842-8d6469fde029 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:43.023999 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3888/7841] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:46:42 2022] PUT /identity/v3/projects/4e8928f3975b47f4a220c22da1543e53/users/b52aa077f9b24738965fe0830b317994/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:46:43.029738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc009f-22b9-41f9-b0df-a9219a30b6ec admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:43.042331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc009f-22b9-41f9-b0df-a9219a30b6ec admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:43.104443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:43.127587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ed60b-4550-4fd9-8f01-b0481c3fdc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:43.128267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ed60b-4550-4fd9-8f01-b0481c3fdc22 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:43.128576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ed60b-4550-4fd9-8f01-b0481c3fdc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:43.128851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ed60b-4550-4fd9-8f01-b0481c3fdc22 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:43.129586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ed60b-4550-4fd9-8f01-b0481c3fdc22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:43.131241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ed60b-4550-4fd9-8f01-b0481c3fdc22 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:43.141398 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3954/7842] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:46:43.146295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31ed77-89ff-41d4-b842-8d6469fde029 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:43.156890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31ed77-89ff-41d4-b842-8d6469fde029 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:43.161511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d342d-1760-437f-afc9-d5a5926e87ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:43.162387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d342d-1760-437f-afc9-d5a5926e87ec admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:43.162682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d342d-1760-437f-afc9-d5a5926e87ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:43.162963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d342d-1760-437f-afc9-d5a5926e87ec admin admin] PATH_INFO: `/v3/projects/4e8928f3975b47f4a220c22da1543e53/users/b52aa077f9b24738965fe0830b317994/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:43.165018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d342d-1760-437f-afc9-d5a5926e87ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8928f3975b47f4a220c22da1543e53, user_id=b52aa077f9b24738965fe0830b317994, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:43.169949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d342d-1760-437f-afc9-d5a5926e87ec admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:43.182363 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3889/7843] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:46:43 2022] PUT /identity/v3/projects/4e8928f3975b47f4a220c22da1543e53/users/b52aa077f9b24738965fe0830b317994/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:43.193438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ef7af-0b73-4159-90c1-07680444cfb5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:43.193791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ef7af-0b73-4159-90c1-07680444cfb5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:43.194117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ef7af-0b73-4159-90c1-07680444cfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:43.223142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-933ef7af-0b73-4159-90c1-07680444cfb5 None None] MFA Rules not processed for user `b52aa077f9b24738965fe0830b317994`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:43.224408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-933ef7af-0b73-4159-90c1-07680444cfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:43.325350 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3955/7844] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:43 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:43.330861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d342d-1760-437f-afc9-d5a5926e87ec admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:43.342650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d342d-1760-437f-afc9-d5a5926e87ec admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:43.348290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1d46c-7280-4ff6-a1a0-9c3f158969b2 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52aa077f9b24738965fe0830b317994', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e8928f3975b47f4a220c22da1543e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:43.349050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1d46c-7280-4ff6-a1a0-9c3f158969b2 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:43.349377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1d46c-7280-4ff6-a1a0-9c3f158969b2 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:43.349658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1d46c-7280-4ff6-a1a0-9c3f158969b2 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:43.350452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1d46c-7280-4ff6-a1a0-9c3f158969b2 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:46:43.350762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1d46c-7280-4ff6-a1a0-9c3f158969b2 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:43.352396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1d46c-7280-4ff6-a1a0-9c3f158969b2 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:43.367058 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3890/7845] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:46:43.371205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ef7af-0b73-4159-90c1-07680444cfb5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:43.381698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ef7af-0b73-4159-90c1-07680444cfb5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:43.386439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613b946-0a53-4eb0-a805-2ebe9adfc271 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52aa077f9b24738965fe0830b317994', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e8928f3975b47f4a220c22da1543e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:43.387121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613b946-0a53-4eb0-a805-2ebe9adfc271 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:43.387412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613b946-0a53-4eb0-a805-2ebe9adfc271 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:43.387690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613b946-0a53-4eb0-a805-2ebe9adfc271 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:43.388547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f613b946-0a53-4eb0-a805-2ebe9adfc271 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:43.390596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f613b946-0a53-4eb0-a805-2ebe9adfc271 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:43.468030 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3956/7846] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:46:43 2022] POST /identity/v3/projects => generated 349 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:46:43.472391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1d46c-7280-4ff6-a1a0-9c3f158969b2 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:43.482847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1d46c-7280-4ff6-a1a0-9c3f158969b2 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:43.527270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:43.545000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850925b-d09f-4ab3-a302-b0a20818b878 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52aa077f9b24738965fe0830b317994', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e8928f3975b47f4a220c22da1543e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:43.550754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850925b-d09f-4ab3-a302-b0a20818b878 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:43.550754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850925b-d09f-4ab3-a302-b0a20818b878 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:43.550754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850925b-d09f-4ab3-a302-b0a20818b878 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:43.550754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850925b-d09f-4ab3-a302-b0a20818b878 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:46:43.550754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850925b-d09f-4ab3-a302-b0a20818b878 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:43.551328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850925b-d09f-4ab3-a302-b0a20818b878 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:43.565220 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3891/7847] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:46:43.576819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613b946-0a53-4eb0-a805-2ebe9adfc271 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:43.578759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f613b946-0a53-4eb0-a805-2ebe9adfc271 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:43.649880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613b946-0a53-4eb0-a805-2ebe9adfc271 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:43.655378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d42722-ea9b-4291-a764-e2b13ddec3ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:43.656186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d42722-ea9b-4291-a764-e2b13ddec3ad service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:43.657387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d42722-ea9b-4291-a764-e2b13ddec3ad service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:43.657741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d42722-ea9b-4291-a764-e2b13ddec3ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:43.668186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d42722-ea9b-4291-a764-e2b13ddec3ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:43.670414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d42722-ea9b-4291-a764-e2b13ddec3ad service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:43.681633 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3957/7848] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:46:43 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:46:44.086971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850925b-d09f-4ab3-a302-b0a20818b878 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:44.101184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850925b-d09f-4ab3-a302-b0a20818b878 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:44.107403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87c6bd-9665-4f8e-9863-1a5acdbb7571 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52aa077f9b24738965fe0830b317994', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e8928f3975b47f4a220c22da1543e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:44.108528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87c6bd-9665-4f8e-9863-1a5acdbb7571 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:44.108911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87c6bd-9665-4f8e-9863-1a5acdbb7571 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:44.109538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87c6bd-9665-4f8e-9863-1a5acdbb7571 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] PATH_INFO: `/v3/projects/f5935e8f558a4f74b993e7947f49d617` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:44.110835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87c6bd-9665-4f8e-9863-1a5acdbb7571 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f5935e8f558a4f74b993e7947f49d617)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:44.116033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87c6bd-9665-4f8e-9863-1a5acdbb7571 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:44.284030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bf87c6bd-9665-4f8e-9863-1a5acdbb7571 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5935e8f558a4f74b993e7947f49d617', 'request_id': 'req-bf87c6bd-9665-4f8e-9863-1a5acdbb7571'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:44.284030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bf87c6bd-9665-4f8e-9863-1a5acdbb7571 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5935e8f558a4f74b993e7947f49d617', 'request_id': 'req-bf87c6bd-9665-4f8e-9863-1a5acdbb7571'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:44.284030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bf87c6bd-9665-4f8e-9863-1a5acdbb7571 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5935e8f558a4f74b993e7947f49d617', 'request_id': 'req-bf87c6bd-9665-4f8e-9863-1a5acdbb7571'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:44.381853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bf87c6bd-9665-4f8e-9863-1a5acdbb7571 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] The token cache is being invalidate because project f5935e8f558a4f74b993e7947f49d617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:46:44.382578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bf87c6bd-9665-4f8e-9863-1a5acdbb7571 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:44.382891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bf87c6bd-9665-4f8e-9863-1a5acdbb7571 tempest-QuotasTest-1121351177 tempest-QuotasTest-1121351177-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:44.384889 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3892/7849] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:46:44 2022] DELETE /identity/v3/projects/f5935e8f558a4f74b993e7947f49d617 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:44.577059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d42722-ea9b-4291-a764-e2b13ddec3ad service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:44.637154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:44.658887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d42722-ea9b-4291-a764-e2b13ddec3ad service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:44.723202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b193240-52d1-457a-93c1-e8009a1e9c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:44.724089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b193240-52d1-457a-93c1-e8009a1e9c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:44.724374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b193240-52d1-457a-93c1-e8009a1e9c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:44.724650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b193240-52d1-457a-93c1-e8009a1e9c20 admin admin] PATH_INFO: `/v3/users/b0b9a2f1b1874c0c9cdbd119d1733449` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:44.725861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b193240-52d1-457a-93c1-e8009a1e9c20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0b9a2f1b1874c0c9cdbd119d1733449)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:44.728569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b193240-52d1-457a-93c1-e8009a1e9c20 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:44.948553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8b193240-52d1-457a-93c1-e8009a1e9c20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0b9a2f1b1874c0c9cdbd119d1733449'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:44.958350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8b193240-52d1-457a-93c1-e8009a1e9c20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0b9a2f1b1874c0c9cdbd119d1733449'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:45.029600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8b193240-52d1-457a-93c1-e8009a1e9c20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0b9a2f1b1874c0c9cdbd119d1733449'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:45.030529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8b193240-52d1-457a-93c1-e8009a1e9c20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0b9a2f1b1874c0c9cdbd119d1733449'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:45.048061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8b193240-52d1-457a-93c1-e8009a1e9c20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0b9a2f1b1874c0c9cdbd119d1733449'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:45.056089 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3958/7850] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:46:44 2022] DELETE /identity/v3/users/b0b9a2f1b1874c0c9cdbd119d1733449 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:45.061040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda95d92-69c8-4cd7-9f6e-f44181f71f00 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:45.061623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda95d92-69c8-4cd7-9f6e-f44181f71f00 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:45.062142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda95d92-69c8-4cd7-9f6e-f44181f71f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:45.083772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-bda95d92-69c8-4cd7-9f6e-f44181f71f00 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:45.085222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bda95d92-69c8-4cd7-9f6e-f44181f71f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:45.162915 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3893/7851] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:46:45.171242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b193240-52d1-457a-93c1-e8009a1e9c20 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:45.172743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8b193240-52d1-457a-93c1-e8009a1e9c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:45.251206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b193240-52d1-457a-93c1-e8009a1e9c20 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:45.256619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45ec2d-373b-408b-9751-5d60e4383bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:45.257573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45ec2d-373b-408b-9751-5d60e4383bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:45.257934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45ec2d-373b-408b-9751-5d60e4383bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:45.258216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45ec2d-373b-408b-9751-5d60e4383bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:45.268759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45ec2d-373b-408b-9751-5d60e4383bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:45.270216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45ec2d-373b-408b-9751-5d60e4383bb3 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:45.281703 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3959/7852] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:46:46.305186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda95d92-69c8-4cd7-9f6e-f44181f71f00 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:46.306659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bda95d92-69c8-4cd7-9f6e-f44181f71f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:46.324826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda95d92-69c8-4cd7-9f6e-f44181f71f00 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:46.335777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62431a-2a57-4388-907f-cce42e25151b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:46.336672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62431a-2a57-4388-907f-cce42e25151b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:46.336960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62431a-2a57-4388-907f-cce42e25151b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:46.337243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62431a-2a57-4388-907f-cce42e25151b admin admin] PATH_INFO: `/v3/projects/b363af78683348de92af99df82861109` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:46.338543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62431a-2a57-4388-907f-cce42e25151b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b363af78683348de92af99df82861109)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:46.340691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62431a-2a57-4388-907f-cce42e25151b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:46.881552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ff62431a-2a57-4388-907f-cce42e25151b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b363af78683348de92af99df82861109', 'request_id': 'req-ff62431a-2a57-4388-907f-cce42e25151b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:46.885466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:46.888440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ff62431a-2a57-4388-907f-cce42e25151b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b363af78683348de92af99df82861109', 'request_id': 'req-ff62431a-2a57-4388-907f-cce42e25151b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:46.894761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ff62431a-2a57-4388-907f-cce42e25151b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b363af78683348de92af99df82861109', 'request_id': 'req-ff62431a-2a57-4388-907f-cce42e25151b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:46.993156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ff62431a-2a57-4388-907f-cce42e25151b admin admin] The token cache is being invalidate because project b363af78683348de92af99df82861109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:46:46.995422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ff62431a-2a57-4388-907f-cce42e25151b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:46.995422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ff62431a-2a57-4388-907f-cce42e25151b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:46.996529 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3894/7853] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:46:46 2022] DELETE /identity/v3/projects/b363af78683348de92af99df82861109 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:47.001378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45ec2d-373b-408b-9751-5d60e4383bb3 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:47.015632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45ec2d-373b-408b-9751-5d60e4383bb3 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:47.028578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:47.091816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c5adf-44ce-4dbf-8523-9acad30d4468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:47.094230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c5adf-44ce-4dbf-8523-9acad30d4468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:47.095372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c5adf-44ce-4dbf-8523-9acad30d4468 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:47.096633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c5adf-44ce-4dbf-8523-9acad30d4468 admin admin] PATH_INFO: `/v3/users/b52aa077f9b24738965fe0830b317994` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:47.098373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c5adf-44ce-4dbf-8523-9acad30d4468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b52aa077f9b24738965fe0830b317994)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:47.100443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c5adf-44ce-4dbf-8523-9acad30d4468 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:47.266545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ad3c5adf-44ce-4dbf-8523-9acad30d4468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b52aa077f9b24738965fe0830b317994'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:47.274164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ad3c5adf-44ce-4dbf-8523-9acad30d4468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b52aa077f9b24738965fe0830b317994'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:47.354883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ad3c5adf-44ce-4dbf-8523-9acad30d4468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b52aa077f9b24738965fe0830b317994'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:47.355588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ad3c5adf-44ce-4dbf-8523-9acad30d4468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b52aa077f9b24738965fe0830b317994'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:47.373454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-ad3c5adf-44ce-4dbf-8523-9acad30d4468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b52aa077f9b24738965fe0830b317994'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:47.395929 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3960/7854] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:46:47 2022] DELETE /identity/v3/users/b52aa077f9b24738965fe0830b317994 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:47.884751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62431a-2a57-4388-907f-cce42e25151b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:47.886429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ff62431a-2a57-4388-907f-cce42e25151b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:47.909861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62431a-2a57-4388-907f-cce42e25151b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:47.989272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b60e7-e1f3-46d2-8ba4-991f978ab2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:47.990771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b60e7-e1f3-46d2-8ba4-991f978ab2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:47.991090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b60e7-e1f3-46d2-8ba4-991f978ab2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:47.991417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b60e7-e1f3-46d2-8ba4-991f978ab2a4 admin admin] PATH_INFO: `/v3/projects/4e8928f3975b47f4a220c22da1543e53` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:47.992764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b60e7-e1f3-46d2-8ba4-991f978ab2a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e8928f3975b47f4a220c22da1543e53)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:47.994754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b60e7-e1f3-46d2-8ba4-991f978ab2a4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:48.120346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-489b60e7-e1f3-46d2-8ba4-991f978ab2a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e8928f3975b47f4a220c22da1543e53', 'request_id': 'req-489b60e7-e1f3-46d2-8ba4-991f978ab2a4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:48.128205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-489b60e7-e1f3-46d2-8ba4-991f978ab2a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e8928f3975b47f4a220c22da1543e53', 'request_id': 'req-489b60e7-e1f3-46d2-8ba4-991f978ab2a4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:48.139894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-489b60e7-e1f3-46d2-8ba4-991f978ab2a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e8928f3975b47f4a220c22da1543e53', 'request_id': 'req-489b60e7-e1f3-46d2-8ba4-991f978ab2a4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:48.240112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-489b60e7-e1f3-46d2-8ba4-991f978ab2a4 admin admin] The token cache is being invalidate because project 4e8928f3975b47f4a220c22da1543e53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:46:48.240376 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-489b60e7-e1f3-46d2-8ba4-991f978ab2a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:48.240989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-489b60e7-e1f3-46d2-8ba4-991f978ab2a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:48.242837 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3895/7855] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:46:47 2022] DELETE /identity/v3/projects/4e8928f3975b47f4a220c22da1543e53 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:48.249163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c3144-76cd-420b-9096-da68ec7be022 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:48.249744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c3144-76cd-420b-9096-da68ec7be022 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:48.250354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c3144-76cd-420b-9096-da68ec7be022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:48.271127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4c4c3144-76cd-420b-9096-da68ec7be022 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:48.273878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4c4c3144-76cd-420b-9096-da68ec7be022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:48.358547 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3961/7856] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:48.465060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef1cc3-5e1a-439f-9905-8cd50dfdeba0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:48.465060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef1cc3-5e1a-439f-9905-8cd50dfdeba0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:48.465060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef1cc3-5e1a-439f-9905-8cd50dfdeba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:48.489920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e9ef1cc3-5e1a-439f-9905-8cd50dfdeba0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:48.491273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e9ef1cc3-5e1a-439f-9905-8cd50dfdeba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:48.500668 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3896/7857] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:48.506033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c3144-76cd-420b-9096-da68ec7be022 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:48.517889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c3144-76cd-420b-9096-da68ec7be022 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:48.523277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f6e3c-c29d-453d-bcab-6fbfa09e750b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:48.524615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f6e3c-c29d-453d-bcab-6fbfa09e750b admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:48.524902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f6e3c-c29d-453d-bcab-6fbfa09e750b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:48.525182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f6e3c-c29d-453d-bcab-6fbfa09e750b admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:48.525917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f6e3c-c29d-453d-bcab-6fbfa09e750b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:46:48.526322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f6e3c-c29d-453d-bcab-6fbfa09e750b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:48.527961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f6e3c-c29d-453d-bcab-6fbfa09e750b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:48.546069 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3962/7858] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:46:48.550606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef1cc3-5e1a-439f-9905-8cd50dfdeba0 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:48.564815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef1cc3-5e1a-439f-9905-8cd50dfdeba0 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:48.570153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42c68a-e206-4b55-b9d0-014101af6d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:48.570927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42c68a-e206-4b55-b9d0-014101af6d6d admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:48.571316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42c68a-e206-4b55-b9d0-014101af6d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:48.571671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42c68a-e206-4b55-b9d0-014101af6d6d admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:48.572435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42c68a-e206-4b55-b9d0-014101af6d6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:48.574428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42c68a-e206-4b55-b9d0-014101af6d6d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:48.692094 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3897/7859] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:46:48 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:46:48.696367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f6e3c-c29d-453d-bcab-6fbfa09e750b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:48.713688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f6e3c-c29d-453d-bcab-6fbfa09e750b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:48.729331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:48.790716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a1fa9-e125-4dd7-833e-06ae88bfc65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:48.792353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a1fa9-e125-4dd7-833e-06ae88bfc65e admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:48.792931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a1fa9-e125-4dd7-833e-06ae88bfc65e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:48.793336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a1fa9-e125-4dd7-833e-06ae88bfc65e admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:48.794414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a1fa9-e125-4dd7-833e-06ae88bfc65e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:48.796571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a1fa9-e125-4dd7-833e-06ae88bfc65e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:48.882188 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3963/7860] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:46:48 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:46:48.883448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42c68a-e206-4b55-b9d0-014101af6d6d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:48.896025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42c68a-e206-4b55-b9d0-014101af6d6d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:48.901727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f66083-0215-4717-919f-c283bad029fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:48.902406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f66083-0215-4717-919f-c283bad029fa admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:48.902695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f66083-0215-4717-919f-c283bad029fa admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:48.902978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f66083-0215-4717-919f-c283bad029fa admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:48.903792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f66083-0215-4717-919f-c283bad029fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:48.905646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f66083-0215-4717-919f-c283bad029fa admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:48.917975 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3898/7861] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:46:48.922053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a1fa9-e125-4dd7-833e-06ae88bfc65e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:48.933562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a1fa9-e125-4dd7-833e-06ae88bfc65e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:48.939471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bf104-0e17-42e6-ac7a-4adfd9aa0644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:48.940137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bf104-0e17-42e6-ac7a-4adfd9aa0644 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:48.940419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bf104-0e17-42e6-ac7a-4adfd9aa0644 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:48.940697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bf104-0e17-42e6-ac7a-4adfd9aa0644 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:48.941416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bf104-0e17-42e6-ac7a-4adfd9aa0644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:48.943094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bf104-0e17-42e6-ac7a-4adfd9aa0644 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:48.960148 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3964/7862] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:46:48.961372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f66083-0215-4717-919f-c283bad029fa admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:48.974646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f66083-0215-4717-919f-c283bad029fa admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:48.980145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c032c-786c-45be-b24d-97a13bf4a0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:48.980974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c032c-786c-45be-b24d-97a13bf4a0ec admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:48.981263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c032c-786c-45be-b24d-97a13bf4a0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:48.981580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c032c-786c-45be-b24d-97a13bf4a0ec admin admin] PATH_INFO: `/v3/projects/3b90c21c42374e79acb86119e2332ce2/users/2867fbbc440545c9b4944fcd76e28b4d/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:49.000631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c032c-786c-45be-b24d-97a13bf4a0ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b90c21c42374e79acb86119e2332ce2, user_id=2867fbbc440545c9b4944fcd76e28b4d, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:49.003553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c032c-786c-45be-b24d-97a13bf4a0ec admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:49.090333 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3899/7863] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:46:48 2022] PUT /identity/v3/projects/3b90c21c42374e79acb86119e2332ce2/users/2867fbbc440545c9b4944fcd76e28b4d/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:49.103247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe31384-464d-4e7c-9796-bb7467536bbe None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:49.103907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe31384-464d-4e7c-9796-bb7467536bbe None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:49.104477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe31384-464d-4e7c-9796-bb7467536bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:49.144468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-bfe31384-464d-4e7c-9796-bb7467536bbe None None] MFA Rules not processed for user `2867fbbc440545c9b4944fcd76e28b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:49.147876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bfe31384-464d-4e7c-9796-bb7467536bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:49.242288 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3965/7864] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:49.243456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c032c-786c-45be-b24d-97a13bf4a0ec admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:49.256711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:49.368223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c032c-786c-45be-b24d-97a13bf4a0ec admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:49.376908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c04a9b-2a1f-4005-b63f-3de7ffa316d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:49.377824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c04a9b-2a1f-4005-b63f-3de7ffa316d1 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:49.378159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c04a9b-2a1f-4005-b63f-3de7ffa316d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:49.378448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c04a9b-2a1f-4005-b63f-3de7ffa316d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:49.380316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c04a9b-2a1f-4005-b63f-3de7ffa316d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:49.382817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c04a9b-2a1f-4005-b63f-3de7ffa316d1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:49.540723 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3900/7865] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:46:49 2022] POST /identity/v3/projects => generated 385 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:46:49.544789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe31384-464d-4e7c-9796-bb7467536bbe None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:49.557386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe31384-464d-4e7c-9796-bb7467536bbe None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:49.623573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30897812-1fe6-4594-af4f-cd219a2b79e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:49.624257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30897812-1fe6-4594-af4f-cd219a2b79e5 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:49.624524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30897812-1fe6-4594-af4f-cd219a2b79e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:49.624802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30897812-1fe6-4594-af4f-cd219a2b79e5 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:49.625483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30897812-1fe6-4594-af4f-cd219a2b79e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:49.627458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30897812-1fe6-4594-af4f-cd219a2b79e5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:49.876907 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3966/7866] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:46:49 2022] POST /identity/v3/users => generated 299 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:46:49.880951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c04a9b-2a1f-4005-b63f-3de7ffa316d1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:49.893061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c04a9b-2a1f-4005-b63f-3de7ffa316d1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:49.897807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c69c7-267f-4b77-bd5b-f791828a264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:49.898622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c69c7-267f-4b77-bd5b-f791828a264a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:49.898909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c69c7-267f-4b77-bd5b-f791828a264a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:49.899216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c69c7-267f-4b77-bd5b-f791828a264a admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:49.899941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c69c7-267f-4b77-bd5b-f791828a264a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:49.901538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c69c7-267f-4b77-bd5b-f791828a264a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:49.913520 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3901/7867] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:46:49.917746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30897812-1fe6-4594-af4f-cd219a2b79e5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:49.929748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30897812-1fe6-4594-af4f-cd219a2b79e5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:49.934857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998e569-6bbd-438a-ac35-8709bf0d2c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:49.936504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998e569-6bbd-438a-ac35-8709bf0d2c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:49.936784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998e569-6bbd-438a-ac35-8709bf0d2c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:49.937060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998e569-6bbd-438a-ac35-8709bf0d2c58 admin admin] PATH_INFO: `/v3/projects/d62f2030890341c8a678485db119f547/users/5302afc8bc244a57acf55a83e7121295/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:49.958586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:49.962051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998e569-6bbd-438a-ac35-8709bf0d2c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d62f2030890341c8a678485db119f547, user_id=5302afc8bc244a57acf55a83e7121295, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:49.965068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998e569-6bbd-438a-ac35-8709bf0d2c58 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:50.071806 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3967/7868] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:46:49 2022] PUT /identity/v3/projects/d62f2030890341c8a678485db119f547/users/5302afc8bc244a57acf55a83e7121295/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:50.076594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c69c7-267f-4b77-bd5b-f791828a264a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:50.092506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c69c7-267f-4b77-bd5b-f791828a264a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:50.178999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf99a5-4c67-49f4-992c-ee272072801b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:50.180000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf99a5-4c67-49f4-992c-ee272072801b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:50.180294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf99a5-4c67-49f4-992c-ee272072801b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:50.180556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf99a5-4c67-49f4-992c-ee272072801b admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:50.181281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf99a5-4c67-49f4-992c-ee272072801b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:50.183188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf99a5-4c67-49f4-992c-ee272072801b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:50.199638 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3902/7869] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:46:50.201603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998e569-6bbd-438a-ac35-8709bf0d2c58 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:50.219235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998e569-6bbd-438a-ac35-8709bf0d2c58 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:50.225875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d680e-fd16-4faa-b5c8-a1e7bb4910c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:50.227201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d680e-fd16-4faa-b5c8-a1e7bb4910c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:50.227201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d680e-fd16-4faa-b5c8-a1e7bb4910c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:50.227990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d680e-fd16-4faa-b5c8-a1e7bb4910c7 admin admin] PATH_INFO: `/v3/projects/d62f2030890341c8a678485db119f547/users/5302afc8bc244a57acf55a83e7121295/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:50.230379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d680e-fd16-4faa-b5c8-a1e7bb4910c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d62f2030890341c8a678485db119f547, user_id=5302afc8bc244a57acf55a83e7121295, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:50.233953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d680e-fd16-4faa-b5c8-a1e7bb4910c7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:50.268174 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3968/7870] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:46:50 2022] PUT /identity/v3/projects/d62f2030890341c8a678485db119f547/users/5302afc8bc244a57acf55a83e7121295/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:46:50.271658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33aafc-11c5-4523-bc51-28c0993fd219 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:50.271949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33aafc-11c5-4523-bc51-28c0993fd219 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:50.275944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33aafc-11c5-4523-bc51-28c0993fd219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:50.303794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-be33aafc-11c5-4523-bc51-28c0993fd219 None None] MFA Rules not processed for user `5302afc8bc244a57acf55a83e7121295`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:50.305477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-be33aafc-11c5-4523-bc51-28c0993fd219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:50.401849 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3903/7871] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:50.413640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d680e-fd16-4faa-b5c8-a1e7bb4910c7 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:50.415706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-191d680e-fd16-4faa-b5c8-a1e7bb4910c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:50.482896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d680e-fd16-4faa-b5c8-a1e7bb4910c7 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:50.487000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb7b4d-15ac-46c7-a14d-40a798129528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:50.488043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb7b4d-15ac-46c7-a14d-40a798129528 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:50.488563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb7b4d-15ac-46c7-a14d-40a798129528 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:50.489066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb7b4d-15ac-46c7-a14d-40a798129528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:50.501034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb7b4d-15ac-46c7-a14d-40a798129528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:50.502987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb7b4d-15ac-46c7-a14d-40a798129528 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:50.527027 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3969/7872] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:46:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:46:53.815250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33aafc-11c5-4523-bc51-28c0993fd219 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:53.820923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:53.877929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33aafc-11c5-4523-bc51-28c0993fd219 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:53.882513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10256f0-e6de-440c-bcf5-934034931c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:53.883430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10256f0-e6de-440c-bcf5-934034931c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:53.884358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10256f0-e6de-440c-bcf5-934034931c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:53.884358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10256f0-e6de-440c-bcf5-934034931c55 admin admin] PATH_INFO: `/v3/users/2867fbbc440545c9b4944fcd76e28b4d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:53.885168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10256f0-e6de-440c-bcf5-934034931c55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2867fbbc440545c9b4944fcd76e28b4d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:53.887136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10256f0-e6de-440c-bcf5-934034931c55 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:54.050465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c10256f0-e6de-440c-bcf5-934034931c55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2867fbbc440545c9b4944fcd76e28b4d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:54.062626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c10256f0-e6de-440c-bcf5-934034931c55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2867fbbc440545c9b4944fcd76e28b4d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:54.127561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c10256f0-e6de-440c-bcf5-934034931c55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2867fbbc440545c9b4944fcd76e28b4d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:54.135447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c10256f0-e6de-440c-bcf5-934034931c55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2867fbbc440545c9b4944fcd76e28b4d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:54.136189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c10256f0-e6de-440c-bcf5-934034931c55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2867fbbc440545c9b4944fcd76e28b4d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:54.142451 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3904/7873] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:46:53 2022] DELETE /identity/v3/users/2867fbbc440545c9b4944fcd76e28b4d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:54.147049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dd7bf-464e-4eb0-bfd1-bdef3f6bdad3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:54.147556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dd7bf-464e-4eb0-bfd1-bdef3f6bdad3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:54.147691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dd7bf-464e-4eb0-bfd1-bdef3f6bdad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:54.166146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-fb6dd7bf-464e-4eb0-bfd1-bdef3f6bdad3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:54.167386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fb6dd7bf-464e-4eb0-bfd1-bdef3f6bdad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:54.226633 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3970/7874] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:54.237445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10256f0-e6de-440c-bcf5-934034931c55 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:54.238841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c10256f0-e6de-440c-bcf5-934034931c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:54.298248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10256f0-e6de-440c-bcf5-934034931c55 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:54.307490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa838d86-6cfd-478b-a958-70190b91df8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:54.307490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa838d86-6cfd-478b-a958-70190b91df8c service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:54.307490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa838d86-6cfd-478b-a958-70190b91df8c service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:54.307490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa838d86-6cfd-478b-a958-70190b91df8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:54.312263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa838d86-6cfd-478b-a958-70190b91df8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:54.313686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa838d86-6cfd-478b-a958-70190b91df8c service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:54.323271 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3905/7875] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:46:54.751519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dd7bf-464e-4eb0-bfd1-bdef3f6bdad3 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:54.753202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fb6dd7bf-464e-4eb0-bfd1-bdef3f6bdad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:54.767048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dd7bf-464e-4eb0-bfd1-bdef3f6bdad3 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:54.773733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043c593-3312-4714-a535-a11542ebf0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:54.774167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043c593-3312-4714-a535-a11542ebf0f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:54.774523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043c593-3312-4714-a535-a11542ebf0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:54.774806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043c593-3312-4714-a535-a11542ebf0f7 admin admin] PATH_INFO: `/v3/projects/3b90c21c42374e79acb86119e2332ce2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:54.776338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043c593-3312-4714-a535-a11542ebf0f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b90c21c42374e79acb86119e2332ce2)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:54.779714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043c593-3312-4714-a535-a11542ebf0f7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:54.986001 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a043c593-3312-4714-a535-a11542ebf0f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b90c21c42374e79acb86119e2332ce2', 'request_id': 'req-a043c593-3312-4714-a535-a11542ebf0f7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:54.992409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a043c593-3312-4714-a535-a11542ebf0f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b90c21c42374e79acb86119e2332ce2', 'request_id': 'req-a043c593-3312-4714-a535-a11542ebf0f7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:54.998835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a043c593-3312-4714-a535-a11542ebf0f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b90c21c42374e79acb86119e2332ce2', 'request_id': 'req-a043c593-3312-4714-a535-a11542ebf0f7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:55.093265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a043c593-3312-4714-a535-a11542ebf0f7 admin admin] The token cache is being invalidate because project 3b90c21c42374e79acb86119e2332ce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:46:55.093481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a043c593-3312-4714-a535-a11542ebf0f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:55.094107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a043c593-3312-4714-a535-a11542ebf0f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:55.095729 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3971/7876] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:46:54 2022] DELETE /identity/v3/projects/3b90c21c42374e79acb86119e2332ce2 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:55.099871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa838d86-6cfd-478b-a958-70190b91df8c service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:55.110665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa838d86-6cfd-478b-a958-70190b91df8c service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:55.134662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:55.167623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be264540-3e6c-4d93-a4b4-10f66d32c680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:55.168497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be264540-3e6c-4d93-a4b4-10f66d32c680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:55.168785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be264540-3e6c-4d93-a4b4-10f66d32c680 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:55.169563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be264540-3e6c-4d93-a4b4-10f66d32c680 admin admin] PATH_INFO: `/v3/users/5302afc8bc244a57acf55a83e7121295` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:55.170769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be264540-3e6c-4d93-a4b4-10f66d32c680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5302afc8bc244a57acf55a83e7121295)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:55.172734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be264540-3e6c-4d93-a4b4-10f66d32c680 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:55.388118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-be264540-3e6c-4d93-a4b4-10f66d32c680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5302afc8bc244a57acf55a83e7121295'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:55.400131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-be264540-3e6c-4d93-a4b4-10f66d32c680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5302afc8bc244a57acf55a83e7121295'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:55.470763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-be264540-3e6c-4d93-a4b4-10f66d32c680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5302afc8bc244a57acf55a83e7121295'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:55.478776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-be264540-3e6c-4d93-a4b4-10f66d32c680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5302afc8bc244a57acf55a83e7121295'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:55.479440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-be264540-3e6c-4d93-a4b4-10f66d32c680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5302afc8bc244a57acf55a83e7121295'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:55.486098 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3906/7877] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:46:55 2022] DELETE /identity/v3/users/5302afc8bc244a57acf55a83e7121295 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:46:55.705885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043c593-3312-4714-a535-a11542ebf0f7 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:55.706363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a043c593-3312-4714-a535-a11542ebf0f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:55.718391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:55.722954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043c593-3312-4714-a535-a11542ebf0f7 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:55.784215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4926d9c-501c-4634-bf73-187cf8d41c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:55.785134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926d9c-501c-4634-bf73-187cf8d41c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:55.785419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926d9c-501c-4634-bf73-187cf8d41c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:55.785697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926d9c-501c-4634-bf73-187cf8d41c7b admin admin] PATH_INFO: `/v3/projects/d62f2030890341c8a678485db119f547` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:55.786884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4926d9c-501c-4634-bf73-187cf8d41c7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d62f2030890341c8a678485db119f547)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:55.788955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4926d9c-501c-4634-bf73-187cf8d41c7b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:55.892696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d4926d9c-501c-4634-bf73-187cf8d41c7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd62f2030890341c8a678485db119f547', 'request_id': 'req-d4926d9c-501c-4634-bf73-187cf8d41c7b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:55.899230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d4926d9c-501c-4634-bf73-187cf8d41c7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd62f2030890341c8a678485db119f547', 'request_id': 'req-d4926d9c-501c-4634-bf73-187cf8d41c7b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:55.906565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d4926d9c-501c-4634-bf73-187cf8d41c7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd62f2030890341c8a678485db119f547', 'request_id': 'req-d4926d9c-501c-4634-bf73-187cf8d41c7b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:55.999000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d4926d9c-501c-4634-bf73-187cf8d41c7b admin admin] The token cache is being invalidate because project d62f2030890341c8a678485db119f547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:46:55.999317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d4926d9c-501c-4634-bf73-187cf8d41c7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:56.000029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d4926d9c-501c-4634-bf73-187cf8d41c7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:46:56.003938 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3972/7878] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:46:55 2022] DELETE /identity/v3/projects/d62f2030890341c8a678485db119f547 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:46:56.007640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a4976-472c-4ff4-ad5a-cf20e515a00a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:56.007929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a4976-472c-4ff4-ad5a-cf20e515a00a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:56.008207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a4976-472c-4ff4-ad5a-cf20e515a00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:56.026441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-904a4976-472c-4ff4-ad5a-cf20e515a00a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:56.027668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-904a4976-472c-4ff4-ad5a-cf20e515a00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:56.086413 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3907/7879] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:56.096192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462b46e-ef9f-4e7a-bb11-bdd31721c9d1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:56.096489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462b46e-ef9f-4e7a-bb11-bdd31721c9d1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:56.096777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462b46e-ef9f-4e7a-bb11-bdd31721c9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:56.115778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9462b46e-ef9f-4e7a-bb11-bdd31721c9d1 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:56.116992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9462b46e-ef9f-4e7a-bb11-bdd31721c9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:56.125459 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3973/7880] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:56.129838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a4976-472c-4ff4-ad5a-cf20e515a00a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:56.140372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a4976-472c-4ff4-ad5a-cf20e515a00a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:56.144982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ede4ab-d846-4651-863c-00b241a00bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:56.145629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ede4ab-d846-4651-863c-00b241a00bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:56.145910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ede4ab-d846-4651-863c-00b241a00bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:56.146185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ede4ab-d846-4651-863c-00b241a00bd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:56.146964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ede4ab-d846-4651-863c-00b241a00bd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:46:56.147311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ede4ab-d846-4651-863c-00b241a00bd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:56.148901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ede4ab-d846-4651-863c-00b241a00bd5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:56.161149 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3908/7881] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:46:56.174606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462b46e-ef9f-4e7a-bb11-bdd31721c9d1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:56.184256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462b46e-ef9f-4e7a-bb11-bdd31721c9d1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:56.189178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a4476-4bc1-4c1c-97f2-6c7e45c45627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:56.189828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a4476-4bc1-4c1c-97f2-6c7e45c45627 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:56.190112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a4476-4bc1-4c1c-97f2-6c7e45c45627 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:56.190390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a4476-4bc1-4c1c-97f2-6c7e45c45627 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:56.191115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a4476-4bc1-4c1c-97f2-6c7e45c45627 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:56.193030 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a4476-4bc1-4c1c-97f2-6c7e45c45627 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:56.295369 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3974/7882] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:46:56 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:46:56.299355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ede4ab-d846-4651-863c-00b241a00bd5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:56.311153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ede4ab-d846-4651-863c-00b241a00bd5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:56.343581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:56.369718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99d2ff-a4f8-4a93-89bb-f73a9c7b2477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:56.370382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99d2ff-a4f8-4a93-89bb-f73a9c7b2477 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:56.370669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99d2ff-a4f8-4a93-89bb-f73a9c7b2477 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:56.370947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99d2ff-a4f8-4a93-89bb-f73a9c7b2477 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:56.372797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99d2ff-a4f8-4a93-89bb-f73a9c7b2477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:56.374563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99d2ff-a4f8-4a93-89bb-f73a9c7b2477 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:56.470283 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3909/7883] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:46:56 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:46:56.474375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a4476-4bc1-4c1c-97f2-6c7e45c45627 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:56.485390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a4476-4bc1-4c1c-97f2-6c7e45c45627 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:56.490680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b286e3b-2b7b-409a-93a1-a35721ad4a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:56.492099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b286e3b-2b7b-409a-93a1-a35721ad4a10 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:56.492099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b286e3b-2b7b-409a-93a1-a35721ad4a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:56.492099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b286e3b-2b7b-409a-93a1-a35721ad4a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:56.492589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b286e3b-2b7b-409a-93a1-a35721ad4a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:56.494217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b286e3b-2b7b-409a-93a1-a35721ad4a10 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:56.505749 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3975/7884] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:46:56.509744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99d2ff-a4f8-4a93-89bb-f73a9c7b2477 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:56.520851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99d2ff-a4f8-4a93-89bb-f73a9c7b2477 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:56.526215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dffe24-09c0-4fd4-86a3-3da447fd88c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:56.526876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dffe24-09c0-4fd4-86a3-3da447fd88c7 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:56.527208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dffe24-09c0-4fd4-86a3-3da447fd88c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:56.527497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dffe24-09c0-4fd4-86a3-3da447fd88c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:56.528222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dffe24-09c0-4fd4-86a3-3da447fd88c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:56.529816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dffe24-09c0-4fd4-86a3-3da447fd88c7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:56.539804 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3910/7885] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:46:56.544203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b286e3b-2b7b-409a-93a1-a35721ad4a10 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:56.554547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b286e3b-2b7b-409a-93a1-a35721ad4a10 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:56.559517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6ffb2-58e8-4083-8a3f-37811c6bec69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:56.562937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6ffb2-58e8-4083-8a3f-37811c6bec69 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:56.562937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6ffb2-58e8-4083-8a3f-37811c6bec69 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:56.562937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6ffb2-58e8-4083-8a3f-37811c6bec69 admin admin] PATH_INFO: `/v3/projects/bea500ddac344c53bb6b47bf3e96b414/users/b88eb3fc7195418199e26cba1628fd75/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:56.577024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6ffb2-58e8-4083-8a3f-37811c6bec69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea500ddac344c53bb6b47bf3e96b414, user_id=b88eb3fc7195418199e26cba1628fd75, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:56.579892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6ffb2-58e8-4083-8a3f-37811c6bec69 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:56.639624 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3976/7886] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:46:56 2022] PUT /identity/v3/projects/bea500ddac344c53bb6b47bf3e96b414/users/b88eb3fc7195418199e26cba1628fd75/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:46:56.649788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608bfe1-7e88-47ca-8dac-973ed8fa0569 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:56.650086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608bfe1-7e88-47ca-8dac-973ed8fa0569 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:56.650654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608bfe1-7e88-47ca-8dac-973ed8fa0569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:56.677972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2608bfe1-7e88-47ca-8dac-973ed8fa0569 None None] MFA Rules not processed for user `b88eb3fc7195418199e26cba1628fd75`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:56.680237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2608bfe1-7e88-47ca-8dac-973ed8fa0569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:56.744633 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3911/7887] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:46:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:56.755814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6ffb2-58e8-4083-8a3f-37811c6bec69 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:56.757611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dcb6ffb2-58e8-4083-8a3f-37811c6bec69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:56.794842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:46:56.822969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6ffb2-58e8-4083-8a3f-37811c6bec69 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:56.827360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e23c95-ad5d-4ca8-93cb-2674fbc27fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:56.828197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e23c95-ad5d-4ca8-93cb-2674fbc27fdc service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:56.828482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e23c95-ad5d-4ca8-93cb-2674fbc27fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:56.828764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e23c95-ad5d-4ca8-93cb-2674fbc27fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:56.837780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e23c95-ad5d-4ca8-93cb-2674fbc27fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:56.839259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e23c95-ad5d-4ca8-93cb-2674fbc27fdc service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:56.849510 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3977/7888] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:46:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:46:57.778703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de5cc1-0aa3-4f48-b494-9b98a686b285 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:57.779235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de5cc1-0aa3-4f48-b494-9b98a686b285 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:57.779445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de5cc1-0aa3-4f48-b494-9b98a686b285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:57.798414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f2de5cc1-0aa3-4f48-b494-9b98a686b285 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:46:57.801833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f2de5cc1-0aa3-4f48-b494-9b98a686b285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:57.873011 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3912/7889] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:46:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:46:57.885605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e23c95-ad5d-4ca8-93cb-2674fbc27fdc service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:46:57.893776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-94e23c95-ad5d-4ca8-93cb-2674fbc27fdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:46:57.960051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e23c95-ad5d-4ca8-93cb-2674fbc27fdc service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:46:57.965264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1b80d-5862-4a13-8beb-f411ba3d7fd6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:46:57.965912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1b80d-5862-4a13-8beb-f411ba3d7fd6 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:46:57.966194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1b80d-5862-4a13-8beb-f411ba3d7fd6 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:46:57.966468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1b80d-5862-4a13-8beb-f411ba3d7fd6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:46:57.975442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1b80d-5862-4a13-8beb-f411ba3d7fd6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:46:57.981227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1b80d-5862-4a13-8beb-f411ba3d7fd6 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:46:57.986069 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3978/7890] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:46:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:47:07.866375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:47:07.982314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=44 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:47:10.621020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496a4b6-6d18-4a93-9bf7-177864920ec6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:10.621562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496a4b6-6d18-4a93-9bf7-177864920ec6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:10.621562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496a4b6-6d18-4a93-9bf7-177864920ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:10.640377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5496a4b6-6d18-4a93-9bf7-177864920ec6 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:47:10.641786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5496a4b6-6d18-4a93-9bf7-177864920ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:47:10.649573 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3913/7891] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:47:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:47:10.663950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1b80d-5862-4a13-8beb-f411ba3d7fd6 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:10.678154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1b80d-5862-4a13-8beb-f411ba3d7fd6 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:10.683650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fd0e2-de33-40e5-b1ff-3983ac26f9e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:10.684639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fd0e2-de33-40e5-b1ff-3983ac26f9e4 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:10.685150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fd0e2-de33-40e5-b1ff-3983ac26f9e4 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:10.685648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fd0e2-de33-40e5-b1ff-3983ac26f9e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:10.695419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7fd0e2-de33-40e5-b1ff-3983ac26f9e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:10.700092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7fd0e2-de33-40e5-b1ff-3983ac26f9e4 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:10.707528 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3979/7892] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:47:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:47:12.740564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb99f2-a792-4ae5-a11c-a643c1d47a61 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:12.741067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb99f2-a792-4ae5-a11c-a643c1d47a61 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:12.741290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb99f2-a792-4ae5-a11c-a643c1d47a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:12.763963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5fbb99f2-a792-4ae5-a11c-a643c1d47a61 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:47:12.765350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5fbb99f2-a792-4ae5-a11c-a643c1d47a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:47:12.774425 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3914/7893] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:47:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:47:12.787348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fd0e2-de33-40e5-b1ff-3983ac26f9e4 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:12.805302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fd0e2-de33-40e5-b1ff-3983ac26f9e4 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:12.811069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fb5ba-6f00-45ce-baea-c5d1f1b50d4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:12.811965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fb5ba-6f00-45ce-baea-c5d1f1b50d4b service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:12.812247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fb5ba-6f00-45ce-baea-c5d1f1b50d4b service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:12.812745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fb5ba-6f00-45ce-baea-c5d1f1b50d4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:12.822221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fb5ba-6f00-45ce-baea-c5d1f1b50d4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:12.827291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fb5ba-6f00-45ce-baea-c5d1f1b50d4b service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:12.833992 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3980/7894] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:47:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:47:13.566815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb99f2-a792-4ae5-a11c-a643c1d47a61 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:13.632051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb99f2-a792-4ae5-a11c-a643c1d47a61 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:13.636916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2a6d2-e0ac-42c2-929d-c85f7a37f726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:13.637776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2a6d2-e0ac-42c2-929d-c85f7a37f726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:13.638055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2a6d2-e0ac-42c2-929d-c85f7a37f726 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:13.638327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2a6d2-e0ac-42c2-929d-c85f7a37f726 admin admin] PATH_INFO: `/v3/users/b88eb3fc7195418199e26cba1628fd75` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:13.639676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2a6d2-e0ac-42c2-929d-c85f7a37f726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b88eb3fc7195418199e26cba1628fd75)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:13.642425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2a6d2-e0ac-42c2-929d-c85f7a37f726 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:13.842512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-edf2a6d2-e0ac-42c2-929d-c85f7a37f726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b88eb3fc7195418199e26cba1628fd75'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:47:13.854534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-edf2a6d2-e0ac-42c2-929d-c85f7a37f726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b88eb3fc7195418199e26cba1628fd75'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:47:13.919777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-edf2a6d2-e0ac-42c2-929d-c85f7a37f726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b88eb3fc7195418199e26cba1628fd75'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:47:13.928229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-edf2a6d2-e0ac-42c2-929d-c85f7a37f726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b88eb3fc7195418199e26cba1628fd75'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:47:13.928980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-edf2a6d2-e0ac-42c2-929d-c85f7a37f726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b88eb3fc7195418199e26cba1628fd75'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:47:13.935254 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3915/7895] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:47:13 2022] DELETE /identity/v3/users/b88eb3fc7195418199e26cba1628fd75 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:47:13.940610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d6a94-2b95-4761-9532-f540d134fd41 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:13.941111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d6a94-2b95-4761-9532-f540d134fd41 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:13.941212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d6a94-2b95-4761-9532-f540d134fd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:13.958870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-385d6a94-2b95-4761-9532-f540d134fd41 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:47:13.962572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-385d6a94-2b95-4761-9532-f540d134fd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:47:13.998427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61abd8-c11e-4ab5-9e12-a8dea6953dfc None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:13.998991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61abd8-c11e-4ab5-9e12-a8dea6953dfc None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:13.999971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61abd8-c11e-4ab5-9e12-a8dea6953dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:14.018638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-bc61abd8-c11e-4ab5-9e12-a8dea6953dfc None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:47:14.020039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bc61abd8-c11e-4ab5-9e12-a8dea6953dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:47:14.022393 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3981/7896] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:47:14.032111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d6a94-2b95-4761-9532-f540d134fd41 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:14.033454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-385d6a94-2b95-4761-9532-f540d134fd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:47:14.082022 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3916/7897] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:47:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:47:14.094951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61abd8-c11e-4ab5-9e12-a8dea6953dfc None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:14.095184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d6a94-2b95-4761-9532-f540d134fd41 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:14.096318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bc61abd8-c11e-4ab5-9e12-a8dea6953dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:47:14.099398 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cc5a8-c9d3-403b-9a3a-e84c9bc0cd9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:14.100061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cc5a8-c9d3-403b-9a3a-e84c9bc0cd9c service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:14.100486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cc5a8-c9d3-403b-9a3a-e84c9bc0cd9c service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:14.100775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cc5a8-c9d3-403b-9a3a-e84c9bc0cd9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:14.110446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:47:14.111649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cc5a8-c9d3-403b-9a3a-e84c9bc0cd9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:14.113097 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cc5a8-c9d3-403b-9a3a-e84c9bc0cd9c service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:14.123029 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3982/7898] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:47:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:47:14.175263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61abd8-c11e-4ab5-9e12-a8dea6953dfc None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:14.180408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702db12c-eecb-4711-827c-4e7d795ce2d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:14.181068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702db12c-eecb-4711-827c-4e7d795ce2d7 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:14.181358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702db12c-eecb-4711-827c-4e7d795ce2d7 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:14.181643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702db12c-eecb-4711-827c-4e7d795ce2d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:14.190982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702db12c-eecb-4711-827c-4e7d795ce2d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:14.192950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702db12c-eecb-4711-827c-4e7d795ce2d7 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:14.201869 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3917/7899] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:47:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:47:14.380053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cc5a8-c9d3-403b-9a3a-e84c9bc0cd9c service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:14.381601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1a7cc5a8-c9d3-403b-9a3a-e84c9bc0cd9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:47:14.395663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cc5a8-c9d3-403b-9a3a-e84c9bc0cd9c service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:14.400425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782dbaf8-a22d-4789-9008-3d07e679b4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:14.401315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dbaf8-a22d-4789-9008-3d07e679b4a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:14.401662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dbaf8-a22d-4789-9008-3d07e679b4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:14.401950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dbaf8-a22d-4789-9008-3d07e679b4a2 admin admin] PATH_INFO: `/v3/projects/bea500ddac344c53bb6b47bf3e96b414` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:14.404290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782dbaf8-a22d-4789-9008-3d07e679b4a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bea500ddac344c53bb6b47bf3e96b414)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:14.406835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782dbaf8-a22d-4789-9008-3d07e679b4a2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:14.555061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-782dbaf8-a22d-4789-9008-3d07e679b4a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bea500ddac344c53bb6b47bf3e96b414', 'request_id': 'req-782dbaf8-a22d-4789-9008-3d07e679b4a2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:47:14.561457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-782dbaf8-a22d-4789-9008-3d07e679b4a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bea500ddac344c53bb6b47bf3e96b414', 'request_id': 'req-782dbaf8-a22d-4789-9008-3d07e679b4a2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:47:14.567371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-782dbaf8-a22d-4789-9008-3d07e679b4a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bea500ddac344c53bb6b47bf3e96b414', 'request_id': 'req-782dbaf8-a22d-4789-9008-3d07e679b4a2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:47:14.646630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:47:14.653752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-782dbaf8-a22d-4789-9008-3d07e679b4a2 admin admin] The token cache is being invalidate because project bea500ddac344c53bb6b47bf3e96b414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:47:14.654237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-782dbaf8-a22d-4789-9008-3d07e679b4a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:47:14.655131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-782dbaf8-a22d-4789-9008-3d07e679b4a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:47:14.658087 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3983/7900] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:47:14 2022] DELETE /identity/v3/projects/bea500ddac344c53bb6b47bf3e96b414 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:47:14.662842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1c5ae-1ab9-4e65-a6c8-65c23f1adff6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:14.669907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1c5ae-1ab9-4e65-a6c8-65c23f1adff6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:14.669907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1c5ae-1ab9-4e65-a6c8-65c23f1adff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:14.682425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-96a1c5ae-1ab9-4e65-a6c8-65c23f1adff6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:47:14.683736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-96a1c5ae-1ab9-4e65-a6c8-65c23f1adff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:47:14.743424 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3918/7901] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:47:14.751487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a001aa-94f3-4a1f-9a23-3d8ec0ad3806 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:14.751809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a001aa-94f3-4a1f-9a23-3d8ec0ad3806 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:14.752088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a001aa-94f3-4a1f-9a23-3d8ec0ad3806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:14.771927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-02a001aa-94f3-4a1f-9a23-3d8ec0ad3806 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:47:14.773136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-02a001aa-94f3-4a1f-9a23-3d8ec0ad3806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:47:14.782041 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3984/7902] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:47:14.786182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1c5ae-1ab9-4e65-a6c8-65c23f1adff6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:14.798075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1c5ae-1ab9-4e65-a6c8-65c23f1adff6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:14.808354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44abcbe-2c75-4d84-af0e-8423c3bb0187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:14.808354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44abcbe-2c75-4d84-af0e-8423c3bb0187 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:14.808354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44abcbe-2c75-4d84-af0e-8423c3bb0187 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:14.808354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44abcbe-2c75-4d84-af0e-8423c3bb0187 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:14.808959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44abcbe-2c75-4d84-af0e-8423c3bb0187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:47:14.808959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44abcbe-2c75-4d84-af0e-8423c3bb0187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:14.808959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44abcbe-2c75-4d84-af0e-8423c3bb0187 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:14.822417 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3919/7903] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:47:14.826601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a001aa-94f3-4a1f-9a23-3d8ec0ad3806 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:14.836641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a001aa-94f3-4a1f-9a23-3d8ec0ad3806 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:14.841345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b120ebf-1cd6-4171-8972-5108f9e4c02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:14.841996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b120ebf-1cd6-4171-8972-5108f9e4c02c admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:14.842286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b120ebf-1cd6-4171-8972-5108f9e4c02c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:14.842563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b120ebf-1cd6-4171-8972-5108f9e4c02c admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:14.843862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b120ebf-1cd6-4171-8972-5108f9e4c02c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:14.845784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b120ebf-1cd6-4171-8972-5108f9e4c02c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:14.946768 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3985/7904] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:47:14 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:47:14.950839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44abcbe-2c75-4d84-af0e-8423c3bb0187 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:14.962404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44abcbe-2c75-4d84-af0e-8423c3bb0187 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:15.029745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62621f-7542-4225-aba6-d85285448e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:15.030461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62621f-7542-4225-aba6-d85285448e6f admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:15.030770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62621f-7542-4225-aba6-d85285448e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:15.031310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62621f-7542-4225-aba6-d85285448e6f admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:15.032081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62621f-7542-4225-aba6-d85285448e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:15.033996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62621f-7542-4225-aba6-d85285448e6f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:15.130009 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3920/7905] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:47:14 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:47:15.131558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b120ebf-1cd6-4171-8972-5108f9e4c02c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:15.142734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b120ebf-1cd6-4171-8972-5108f9e4c02c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:15.147476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cbd2e-2b16-4d59-bfa7-4476c0675acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:15.148139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cbd2e-2b16-4d59-bfa7-4476c0675acb admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:15.148430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cbd2e-2b16-4d59-bfa7-4476c0675acb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:15.148711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cbd2e-2b16-4d59-bfa7-4476c0675acb admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:15.149429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cbd2e-2b16-4d59-bfa7-4476c0675acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:15.151093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cbd2e-2b16-4d59-bfa7-4476c0675acb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:15.161782 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3986/7906] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:47:15.165921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62621f-7542-4225-aba6-d85285448e6f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:15.176436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62621f-7542-4225-aba6-d85285448e6f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:15.181565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f229cb1-546f-4845-8136-57d0a4a42105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:15.186135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f229cb1-546f-4845-8136-57d0a4a42105 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:15.186135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f229cb1-546f-4845-8136-57d0a4a42105 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:15.186135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f229cb1-546f-4845-8136-57d0a4a42105 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:15.186135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f229cb1-546f-4845-8136-57d0a4a42105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:15.186135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f229cb1-546f-4845-8136-57d0a4a42105 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:15.198210 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3921/7907] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:47:15.202129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cbd2e-2b16-4d59-bfa7-4476c0675acb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:15.213326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cbd2e-2b16-4d59-bfa7-4476c0675acb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:15.218234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56fe13-bc89-49b3-ad5d-06fb60237038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:15.219153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56fe13-bc89-49b3-ad5d-06fb60237038 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:15.219437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56fe13-bc89-49b3-ad5d-06fb60237038 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:15.219743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56fe13-bc89-49b3-ad5d-06fb60237038 admin admin] PATH_INFO: `/v3/projects/b88e752b04314fd8b9be7752bdb2b684/users/8f9e5f8e789440ff9a46e8c7f586373f/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:15.237053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56fe13-bc89-49b3-ad5d-06fb60237038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b88e752b04314fd8b9be7752bdb2b684, user_id=8f9e5f8e789440ff9a46e8c7f586373f, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:15.241061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56fe13-bc89-49b3-ad5d-06fb60237038 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:15.334127 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3987/7908] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:47:15 2022] PUT /identity/v3/projects/b88e752b04314fd8b9be7752bdb2b684/users/8f9e5f8e789440ff9a46e8c7f586373f/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:47:15.345621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9221d0-c285-4bf2-acff-33c1afce9ffb None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:15.345922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9221d0-c285-4bf2-acff-33c1afce9ffb None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:15.346207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9221d0-c285-4bf2-acff-33c1afce9ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:15.359877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:47:15.374912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9b9221d0-c285-4bf2-acff-33c1afce9ffb None None] MFA Rules not processed for user `8f9e5f8e789440ff9a46e8c7f586373f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:47:15.376814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9b9221d0-c285-4bf2-acff-33c1afce9ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:47:15.445322 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3922/7909] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:47:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:47:15.457057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56fe13-bc89-49b3-ad5d-06fb60237038 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:15.458186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dd56fe13-bc89-49b3-ad5d-06fb60237038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:47:15.523133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56fe13-bc89-49b3-ad5d-06fb60237038 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:15.526869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b969fe1-a318-467a-8d58-be122bdf4a64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:15.527645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b969fe1-a318-467a-8d58-be122bdf4a64 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:15.527925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b969fe1-a318-467a-8d58-be122bdf4a64 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:15.528228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b969fe1-a318-467a-8d58-be122bdf4a64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:15.538093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b969fe1-a318-467a-8d58-be122bdf4a64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:15.539595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b969fe1-a318-467a-8d58-be122bdf4a64 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:15.550163 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3988/7910] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:47:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:47:19.847022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a10aae-6452-42fa-bab2-72e09d2c2b3a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:19.847546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a10aae-6452-42fa-bab2-72e09d2c2b3a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:19.847784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a10aae-6452-42fa-bab2-72e09d2c2b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:19.866917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a0a10aae-6452-42fa-bab2-72e09d2c2b3a None None] MFA Rules not processed for user `cfe293b9ed3645229bed5ef8ce17cfec`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:47:19.868273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a0a10aae-6452-42fa-bab2-72e09d2c2b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:47:19.933169 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3923/7911] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:47:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:47:25.548440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=53,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:47:27.245997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b969fe1-a318-467a-8d58-be122bdf4a64 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:27.247678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2b969fe1-a318-467a-8d58-be122bdf4a64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:47:27.372200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b969fe1-a318-467a-8d58-be122bdf4a64 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:27.380186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5276272-3525-4354-a1dd-0619290b848d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:27.380961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5276272-3525-4354-a1dd-0619290b848d service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:27.381316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5276272-3525-4354-a1dd-0619290b848d service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:27.381670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5276272-3525-4354-a1dd-0619290b848d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:27.383646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f5276272-3525-4354-a1dd-0619290b848d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:47:27.403252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5276272-3525-4354-a1dd-0619290b848d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:27.407088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5276272-3525-4354-a1dd-0619290b848d service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:27.425004 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3989/7912] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:47:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:47:28.462315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a10aae-6452-42fa-bab2-72e09d2c2b3a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:28.531142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a10aae-6452-42fa-bab2-72e09d2c2b3a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:28.536247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8ef51-cc48-42a7-980c-2158a17aab77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:28.537251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8ef51-cc48-42a7-980c-2158a17aab77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:28.537464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8ef51-cc48-42a7-980c-2158a17aab77 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:28.537741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8ef51-cc48-42a7-980c-2158a17aab77 admin admin] PATH_INFO: `/v3/users/8f9e5f8e789440ff9a46e8c7f586373f` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:28.538943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8ef51-cc48-42a7-980c-2158a17aab77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9e5f8e789440ff9a46e8c7f586373f)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:28.541572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8ef51-cc48-42a7-980c-2158a17aab77 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:28.764181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:47:28.767451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-08e8ef51-cc48-42a7-980c-2158a17aab77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9e5f8e789440ff9a46e8c7f586373f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:47:28.780499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-08e8ef51-cc48-42a7-980c-2158a17aab77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9e5f8e789440ff9a46e8c7f586373f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:47:28.887747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-08e8ef51-cc48-42a7-980c-2158a17aab77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9e5f8e789440ff9a46e8c7f586373f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:47:28.901655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-08e8ef51-cc48-42a7-980c-2158a17aab77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9e5f8e789440ff9a46e8c7f586373f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:47:28.902234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-08e8ef51-cc48-42a7-980c-2158a17aab77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9e5f8e789440ff9a46e8c7f586373f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:47:28.917649 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3924/7913] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:47:28 2022] DELETE /identity/v3/users/8f9e5f8e789440ff9a46e8c7f586373f => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:47:28.919761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31283859-446d-4c7c-89b6-877f12352490 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:28.920227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31283859-446d-4c7c-89b6-877f12352490 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:28.920437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31283859-446d-4c7c-89b6-877f12352490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:28.945440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-31283859-446d-4c7c-89b6-877f12352490 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:47:28.947065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-31283859-446d-4c7c-89b6-877f12352490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:47:29.027234 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3990/7914] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:47:29.037624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8ef51-cc48-42a7-980c-2158a17aab77 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:29.039207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-08e8ef51-cc48-42a7-980c-2158a17aab77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:47:29.111285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8ef51-cc48-42a7-980c-2158a17aab77 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:29.116391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2c794-5254-4c09-9c03-5c0d7ea6a2ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:29.117058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2c794-5254-4c09-9c03-5c0d7ea6a2ff service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:29.117341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2c794-5254-4c09-9c03-5c0d7ea6a2ff service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:29.117615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2c794-5254-4c09-9c03-5c0d7ea6a2ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:29.134889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2c794-5254-4c09-9c03-5c0d7ea6a2ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:29.136390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2c794-5254-4c09-9c03-5c0d7ea6a2ff service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:29.148550 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3925/7915] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:47:29.429873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31283859-446d-4c7c-89b6-877f12352490 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:29.431574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-31283859-446d-4c7c-89b6-877f12352490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:47:29.450133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31283859-446d-4c7c-89b6-877f12352490 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:29.456964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9407c-50e3-4418-92f5-c0c310c51943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:29.457831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9407c-50e3-4418-92f5-c0c310c51943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:29.458145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9407c-50e3-4418-92f5-c0c310c51943 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:29.458370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9407c-50e3-4418-92f5-c0c310c51943 admin admin] PATH_INFO: `/v3/projects/b88e752b04314fd8b9be7752bdb2b684` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:29.459733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9407c-50e3-4418-92f5-c0c310c51943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b88e752b04314fd8b9be7752bdb2b684)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:29.461774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9407c-50e3-4418-92f5-c0c310c51943 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:29.579947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4eb9407c-50e3-4418-92f5-c0c310c51943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b88e752b04314fd8b9be7752bdb2b684', 'request_id': 'req-4eb9407c-50e3-4418-92f5-c0c310c51943'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:47:29.587138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4eb9407c-50e3-4418-92f5-c0c310c51943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b88e752b04314fd8b9be7752bdb2b684', 'request_id': 'req-4eb9407c-50e3-4418-92f5-c0c310c51943'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:47:29.592824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4eb9407c-50e3-4418-92f5-c0c310c51943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b88e752b04314fd8b9be7752bdb2b684', 'request_id': 'req-4eb9407c-50e3-4418-92f5-c0c310c51943'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:47:29.657231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:47:29.662802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4eb9407c-50e3-4418-92f5-c0c310c51943 admin admin] The token cache is being invalidate because project b88e752b04314fd8b9be7752bdb2b684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:47:29.663127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4eb9407c-50e3-4418-92f5-c0c310c51943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:47:29.663748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4eb9407c-50e3-4418-92f5-c0c310c51943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:47:29.665290 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3991/7916] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:47:29 2022] DELETE /identity/v3/projects/b88e752b04314fd8b9be7752bdb2b684 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:47:29.670190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b49f7-18da-4b60-af6a-609bf3a8fcc4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:29.670688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b49f7-18da-4b60-af6a-609bf3a8fcc4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:29.670794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b49f7-18da-4b60-af6a-609bf3a8fcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:29.688436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-760b49f7-18da-4b60-af6a-609bf3a8fcc4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:47:29.689621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-760b49f7-18da-4b60-af6a-609bf3a8fcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:47:29.749696 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3926/7917] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:47:29.758258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c2523-3d80-4037-8585-a7223108ade5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:29.758550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c2523-3d80-4037-8585-a7223108ade5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:29.758833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c2523-3d80-4037-8585-a7223108ade5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:29.778688 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-073c2523-3d80-4037-8585-a7223108ade5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:47:29.779925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-073c2523-3d80-4037-8585-a7223108ade5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:47:29.788835 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3992/7918] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:47:29.793240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b49f7-18da-4b60-af6a-609bf3a8fcc4 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:29.803234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b49f7-18da-4b60-af6a-609bf3a8fcc4 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:29.808193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92311f98-cbbd-451b-a510-72c76d030177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:29.808878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92311f98-cbbd-451b-a510-72c76d030177 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:29.809169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92311f98-cbbd-451b-a510-72c76d030177 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:29.809473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92311f98-cbbd-451b-a510-72c76d030177 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:29.810202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92311f98-cbbd-451b-a510-72c76d030177 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:47:29.810540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92311f98-cbbd-451b-a510-72c76d030177 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:29.812327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92311f98-cbbd-451b-a510-72c76d030177 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:29.824914 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3927/7919] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:47:29.829286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c2523-3d80-4037-8585-a7223108ade5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:29.839801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c2523-3d80-4037-8585-a7223108ade5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:29.844468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0ab12-3e22-40bf-9042-9e98eec7d0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:29.845155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0ab12-3e22-40bf-9042-9e98eec7d0f7 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:29.845439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0ab12-3e22-40bf-9042-9e98eec7d0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:29.845775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0ab12-3e22-40bf-9042-9e98eec7d0f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:29.846563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0ab12-3e22-40bf-9042-9e98eec7d0f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:29.848642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0ab12-3e22-40bf-9042-9e98eec7d0f7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:29.926758 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3993/7920] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:47:29 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:47:29.930990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92311f98-cbbd-451b-a510-72c76d030177 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:29.942250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92311f98-cbbd-451b-a510-72c76d030177 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:29.990923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:47:30.000659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fbc61-7881-4628-a9fb-406eee020539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:30.001331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fbc61-7881-4628-a9fb-406eee020539 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:30.001619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fbc61-7881-4628-a9fb-406eee020539 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:30.001900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fbc61-7881-4628-a9fb-406eee020539 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:30.003314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fbc61-7881-4628-a9fb-406eee020539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:30.005348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fbc61-7881-4628-a9fb-406eee020539 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:30.105642 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3928/7921] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:47:29 2022] POST /identity/v3/users => generated 284 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:47:30.109630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0ab12-3e22-40bf-9042-9e98eec7d0f7 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:30.120792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0ab12-3e22-40bf-9042-9e98eec7d0f7 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:30.125748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae5ca6-578b-46d9-a4c4-53d4379672be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:30.126428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae5ca6-578b-46d9-a4c4-53d4379672be admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:30.126708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae5ca6-578b-46d9-a4c4-53d4379672be admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:30.127660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae5ca6-578b-46d9-a4c4-53d4379672be admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:30.128616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae5ca6-578b-46d9-a4c4-53d4379672be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:30.130219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae5ca6-578b-46d9-a4c4-53d4379672be admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:30.141287 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3994/7922] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:47:30.145968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fbc61-7881-4628-a9fb-406eee020539 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:30.156419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fbc61-7881-4628-a9fb-406eee020539 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:30.162172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d022713-a193-4116-b5b7-1698745ebf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:30.162837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d022713-a193-4116-b5b7-1698745ebf3f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:30.163164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d022713-a193-4116-b5b7-1698745ebf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:30.163448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d022713-a193-4116-b5b7-1698745ebf3f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:30.164197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d022713-a193-4116-b5b7-1698745ebf3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:30.165832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d022713-a193-4116-b5b7-1698745ebf3f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:30.176991 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3929/7923] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:47:30.181182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae5ca6-578b-46d9-a4c4-53d4379672be admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:30.192211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae5ca6-578b-46d9-a4c4-53d4379672be admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:30.196934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24308c-1e6f-4d4d-8747-11cf7dd44c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:30.197816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24308c-1e6f-4d4d-8747-11cf7dd44c14 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:30.198101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24308c-1e6f-4d4d-8747-11cf7dd44c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:30.198378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24308c-1e6f-4d4d-8747-11cf7dd44c14 admin admin] PATH_INFO: `/v3/projects/1565c47afcce4074ae9a7305b8d7ef17/users/69ec3e1153a4450cb07f07549e0dba4f/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:30.214721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24308c-1e6f-4d4d-8747-11cf7dd44c14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1565c47afcce4074ae9a7305b8d7ef17, user_id=69ec3e1153a4450cb07f07549e0dba4f, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:30.217430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24308c-1e6f-4d4d-8747-11cf7dd44c14 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:30.327845 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3995/7924] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:47:30 2022] PUT /identity/v3/projects/1565c47afcce4074ae9a7305b8d7ef17/users/69ec3e1153a4450cb07f07549e0dba4f/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:47:30.338236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74320a50-671a-411b-a579-03099d5fa168 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:30.341185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74320a50-671a-411b-a579-03099d5fa168 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:30.341185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74320a50-671a-411b-a579-03099d5fa168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:30.366295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-74320a50-671a-411b-a579-03099d5fa168 None None] MFA Rules not processed for user `69ec3e1153a4450cb07f07549e0dba4f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:47:30.367487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-74320a50-671a-411b-a579-03099d5fa168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:47:30.431992 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3930/7925] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:47:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:47:30.442964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24308c-1e6f-4d4d-8747-11cf7dd44c14 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:47:30.444782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cd24308c-1e6f-4d4d-8747-11cf7dd44c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:47:30.509206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24308c-1e6f-4d4d-8747-11cf7dd44c14 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:47:30.513037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246c40b-ba7d-4f59-95f4-23d489a2f852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:47:30.513694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246c40b-ba7d-4f59-95f4-23d489a2f852 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:47:30.513978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246c40b-ba7d-4f59-95f4-23d489a2f852 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:47:30.514254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246c40b-ba7d-4f59-95f4-23d489a2f852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:47:30.523847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246c40b-ba7d-4f59-95f4-23d489a2f852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:47:30.525305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246c40b-ba7d-4f59-95f4-23d489a2f852 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:47:30.535696 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3996/7926] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:47:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:47:40.433419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=43,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:47:40.531249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:48:03.577585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e3f56-9cb8-4efd-b90a-97474fc96348 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:03.578120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e3f56-9cb8-4efd-b90a-97474fc96348 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:03.578120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e3f56-9cb8-4efd-b90a-97474fc96348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:03.597945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-765e3f56-9cb8-4efd-b90a-97474fc96348 None None] MFA Rules not processed for user `cfe293b9ed3645229bed5ef8ce17cfec`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:48:03.599487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-765e3f56-9cb8-4efd-b90a-97474fc96348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:48:03.666491 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3931/7927] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:48:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:48:05.844274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246c40b-ba7d-4f59-95f4-23d489a2f852 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:05.845691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6246c40b-ba7d-4f59-95f4-23d489a2f852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:48:05.937533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246c40b-ba7d-4f59-95f4-23d489a2f852 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:05.942893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7472b3-0114-4066-a4b7-81cebcc24e3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:05.943604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7472b3-0114-4066-a4b7-81cebcc24e3f service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:05.943891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7472b3-0114-4066-a4b7-81cebcc24e3f service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:05.944168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7472b3-0114-4066-a4b7-81cebcc24e3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:05.945980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2e7472b3-0114-4066-a4b7-81cebcc24e3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:48:05.961453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7472b3-0114-4066-a4b7-81cebcc24e3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:05.963103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7472b3-0114-4066-a4b7-81cebcc24e3f service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:05.976906 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3997/7928] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:48:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:48:07.343035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e3f56-9cb8-4efd-b90a-97474fc96348 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:07.418496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e3f56-9cb8-4efd-b90a-97474fc96348 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:07.423470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a2cda-da80-422a-9807-dc7ce7405e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:07.424404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a2cda-da80-422a-9807-dc7ce7405e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:07.424692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a2cda-da80-422a-9807-dc7ce7405e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:07.425004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a2cda-da80-422a-9807-dc7ce7405e4c admin admin] PATH_INFO: `/v3/users/69ec3e1153a4450cb07f07549e0dba4f` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:07.426871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a2cda-da80-422a-9807-dc7ce7405e4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=69ec3e1153a4450cb07f07549e0dba4f)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:07.434090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a2cda-da80-422a-9807-dc7ce7405e4c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:07.651600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a93a2cda-da80-422a-9807-dc7ce7405e4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69ec3e1153a4450cb07f07549e0dba4f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:48:07.665279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a93a2cda-da80-422a-9807-dc7ce7405e4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69ec3e1153a4450cb07f07549e0dba4f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:48:07.752937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a93a2cda-da80-422a-9807-dc7ce7405e4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69ec3e1153a4450cb07f07549e0dba4f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:48:07.761024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a93a2cda-da80-422a-9807-dc7ce7405e4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69ec3e1153a4450cb07f07549e0dba4f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:48:07.761687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a93a2cda-da80-422a-9807-dc7ce7405e4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69ec3e1153a4450cb07f07549e0dba4f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:48:07.767634 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3932/7929] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:48:07 2022] DELETE /identity/v3/users/69ec3e1153a4450cb07f07549e0dba4f => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:48:07.772686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57398b6-abfc-42d0-89ae-0fc806d2f949 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:07.773191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57398b6-abfc-42d0-89ae-0fc806d2f949 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:07.773312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57398b6-abfc-42d0-89ae-0fc806d2f949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:07.791610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e57398b6-abfc-42d0-89ae-0fc806d2f949 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:48:07.792818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e57398b6-abfc-42d0-89ae-0fc806d2f949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:48:07.878896 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3998/7930] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:48:07.886544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a2cda-da80-422a-9807-dc7ce7405e4c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:07.888734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a93a2cda-da80-422a-9807-dc7ce7405e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:48:07.928976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:48:07.989058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a2cda-da80-422a-9807-dc7ce7405e4c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:07.994178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a9777-0355-4ff8-aae9-37301abd7c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:07.994953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a9777-0355-4ff8-aae9-37301abd7c5f service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:07.995290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a9777-0355-4ff8-aae9-37301abd7c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:07.995624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a9777-0355-4ff8-aae9-37301abd7c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:08.012936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a9777-0355-4ff8-aae9-37301abd7c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:08.014898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a9777-0355-4ff8-aae9-37301abd7c5f service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:08.039734 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3933/7931] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:48:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:48:08.335791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57398b6-abfc-42d0-89ae-0fc806d2f949 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:08.337785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e57398b6-abfc-42d0-89ae-0fc806d2f949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:48:08.350355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57398b6-abfc-42d0-89ae-0fc806d2f949 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:08.355791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2913d49-e1ac-44ed-b0d3-b52c3f107e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:08.356660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2913d49-e1ac-44ed-b0d3-b52c3f107e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:08.356943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2913d49-e1ac-44ed-b0d3-b52c3f107e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:08.357221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2913d49-e1ac-44ed-b0d3-b52c3f107e7c admin admin] PATH_INFO: `/v3/projects/1565c47afcce4074ae9a7305b8d7ef17` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:08.358420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2913d49-e1ac-44ed-b0d3-b52c3f107e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1565c47afcce4074ae9a7305b8d7ef17)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:08.360392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2913d49-e1ac-44ed-b0d3-b52c3f107e7c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:08.516333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f2913d49-e1ac-44ed-b0d3-b52c3f107e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1565c47afcce4074ae9a7305b8d7ef17', 'request_id': 'req-f2913d49-e1ac-44ed-b0d3-b52c3f107e7c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:48:08.522784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f2913d49-e1ac-44ed-b0d3-b52c3f107e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1565c47afcce4074ae9a7305b8d7ef17', 'request_id': 'req-f2913d49-e1ac-44ed-b0d3-b52c3f107e7c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:48:08.528348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f2913d49-e1ac-44ed-b0d3-b52c3f107e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1565c47afcce4074ae9a7305b8d7ef17', 'request_id': 'req-f2913d49-e1ac-44ed-b0d3-b52c3f107e7c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:48:08.623401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f2913d49-e1ac-44ed-b0d3-b52c3f107e7c admin admin] The token cache is being invalidate because project 1565c47afcce4074ae9a7305b8d7ef17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:48:08.624027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f2913d49-e1ac-44ed-b0d3-b52c3f107e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:48:08.624905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f2913d49-e1ac-44ed-b0d3-b52c3f107e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:48:08.631197 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 3999/7932] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:48:08 2022] DELETE /identity/v3/projects/1565c47afcce4074ae9a7305b8d7ef17 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:48:08.632723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a144df2-2521-44b8-9c77-9fa351e63a2c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:08.633805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a144df2-2521-44b8-9c77-9fa351e63a2c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:08.634305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a144df2-2521-44b8-9c77-9fa351e63a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:08.663544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4a144df2-2521-44b8-9c77-9fa351e63a2c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:48:08.663544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4a144df2-2521-44b8-9c77-9fa351e63a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:48:08.735776 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3934/7933] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:48:08.745049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2736a1-4097-4e91-ae35-e420f2d001cf None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:08.748433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2736a1-4097-4e91-ae35-e420f2d001cf None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:08.748745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2736a1-4097-4e91-ae35-e420f2d001cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:08.770779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ac2736a1-4097-4e91-ae35-e420f2d001cf None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:48:08.772366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ac2736a1-4097-4e91-ae35-e420f2d001cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:48:08.781694 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4000/7934] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:48:08.787613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a144df2-2521-44b8-9c77-9fa351e63a2c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:08.799250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a144df2-2521-44b8-9c77-9fa351e63a2c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:08.806182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295be0d3-bdb7-4f8e-a10d-ae6631e987d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:08.807147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295be0d3-bdb7-4f8e-a10d-ae6631e987d8 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:08.807636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295be0d3-bdb7-4f8e-a10d-ae6631e987d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:08.808052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295be0d3-bdb7-4f8e-a10d-ae6631e987d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:08.809082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295be0d3-bdb7-4f8e-a10d-ae6631e987d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:48:08.809082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295be0d3-bdb7-4f8e-a10d-ae6631e987d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:08.810594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295be0d3-bdb7-4f8e-a10d-ae6631e987d8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:08.829020 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3935/7935] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:48:08.834236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2736a1-4097-4e91-ae35-e420f2d001cf None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:08.844103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2736a1-4097-4e91-ae35-e420f2d001cf None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:08.850068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daadaaf-4e49-49f1-8b3a-a2a2f34b2045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:08.850729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daadaaf-4e49-49f1-8b3a-a2a2f34b2045 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:08.851039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daadaaf-4e49-49f1-8b3a-a2a2f34b2045 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:08.851334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daadaaf-4e49-49f1-8b3a-a2a2f34b2045 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:08.852833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daadaaf-4e49-49f1-8b3a-a2a2f34b2045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:08.854827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daadaaf-4e49-49f1-8b3a-a2a2f34b2045 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:08.858292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:48:08.983154 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4001/7936] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:48:08 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:48:08.988093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295be0d3-bdb7-4f8e-a10d-ae6631e987d8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:09.006248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295be0d3-bdb7-4f8e-a10d-ae6631e987d8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:09.075359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790689e-7026-4a1a-81e6-51f73e32bb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:09.076148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790689e-7026-4a1a-81e6-51f73e32bb0a admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:09.076430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790689e-7026-4a1a-81e6-51f73e32bb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:09.076707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790689e-7026-4a1a-81e6-51f73e32bb0a admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:09.077391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790689e-7026-4a1a-81e6-51f73e32bb0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:09.079511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790689e-7026-4a1a-81e6-51f73e32bb0a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:09.188972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daadaaf-4e49-49f1-8b3a-a2a2f34b2045 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:09.189946 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3936/7937] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:48:08 2022] POST /identity/v3/users => generated 290 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:48:09.204562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daadaaf-4e49-49f1-8b3a-a2a2f34b2045 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:09.210487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc157b4-483b-4abb-a68e-5c901e4b36d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:09.211231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc157b4-483b-4abb-a68e-5c901e4b36d9 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:09.211523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc157b4-483b-4abb-a68e-5c901e4b36d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:09.211803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc157b4-483b-4abb-a68e-5c901e4b36d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:09.212540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc157b4-483b-4abb-a68e-5c901e4b36d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:09.214267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc157b4-483b-4abb-a68e-5c901e4b36d9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:09.228255 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4002/7938] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:48:09.232079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790689e-7026-4a1a-81e6-51f73e32bb0a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:09.243555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790689e-7026-4a1a-81e6-51f73e32bb0a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:09.248466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6de32-6942-410b-96d6-8a813671a435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:09.249265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6de32-6942-410b-96d6-8a813671a435 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:09.249774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6de32-6942-410b-96d6-8a813671a435 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:09.250153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6de32-6942-410b-96d6-8a813671a435 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:09.250944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6de32-6942-410b-96d6-8a813671a435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:09.252699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6de32-6942-410b-96d6-8a813671a435 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:09.264540 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3937/7939] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:48:09.269715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc157b4-483b-4abb-a68e-5c901e4b36d9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:09.283230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc157b4-483b-4abb-a68e-5c901e4b36d9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:09.289242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3980b-7b31-4954-a3e8-eb62f54aceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:09.289697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3980b-7b31-4954-a3e8-eb62f54aceb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:09.289983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3980b-7b31-4954-a3e8-eb62f54aceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:09.290265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3980b-7b31-4954-a3e8-eb62f54aceb0 admin admin] PATH_INFO: `/v3/projects/a3a0ab3a9f6c4a9186558dc3c1b1629a/users/8ea3cb9c20334400bbfb90dc62a5fb05/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:09.309480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3980b-7b31-4954-a3e8-eb62f54aceb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a0ab3a9f6c4a9186558dc3c1b1629a, user_id=8ea3cb9c20334400bbfb90dc62a5fb05, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:09.312430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3980b-7b31-4954-a3e8-eb62f54aceb0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:09.385349 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4003/7940] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:48:09 2022] PUT /identity/v3/projects/a3a0ab3a9f6c4a9186558dc3c1b1629a/users/8ea3cb9c20334400bbfb90dc62a5fb05/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:48:09.403485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70df0c-a1fd-4448-b09a-720d7541abb5 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:09.403485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70df0c-a1fd-4448-b09a-720d7541abb5 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:09.403485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70df0c-a1fd-4448-b09a-720d7541abb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:09.430840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9c70df0c-a1fd-4448-b09a-720d7541abb5 None None] MFA Rules not processed for user `8ea3cb9c20334400bbfb90dc62a5fb05`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:48:09.432349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9c70df0c-a1fd-4448-b09a-720d7541abb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:48:09.460578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:48:09.512877 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3938/7941] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:48:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:48:09.524113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3980b-7b31-4954-a3e8-eb62f54aceb0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:09.526020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ecd3980b-7b31-4954-a3e8-eb62f54aceb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:48:09.590857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3980b-7b31-4954-a3e8-eb62f54aceb0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:09.594977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b92c0f-dd89-4add-8d1f-0cc69edd8c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:09.595663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b92c0f-dd89-4add-8d1f-0cc69edd8c7e service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:09.595949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b92c0f-dd89-4add-8d1f-0cc69edd8c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:09.596228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b92c0f-dd89-4add-8d1f-0cc69edd8c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:09.606076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b92c0f-dd89-4add-8d1f-0cc69edd8c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:09.607597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b92c0f-dd89-4add-8d1f-0cc69edd8c7e service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:09.617072 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4004/7942] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:48:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:48:19.543840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=17 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:48:19.612618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:48:30.797758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70df0c-a1fd-4448-b09a-720d7541abb5 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:30.799495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9c70df0c-a1fd-4448-b09a-720d7541abb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:48:30.815138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70df0c-a1fd-4448-b09a-720d7541abb5 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:30.819527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720b96d-060a-4a93-ac70-ec6ebda361fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:30.820285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720b96d-060a-4a93-ac70-ec6ebda361fd service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:30.822259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720b96d-060a-4a93-ac70-ec6ebda361fd service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:30.822259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720b96d-060a-4a93-ac70-ec6ebda361fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:30.823475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b720b96d-060a-4a93-ac70-ec6ebda361fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:48:30.911034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720b96d-060a-4a93-ac70-ec6ebda361fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:30.913150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720b96d-060a-4a93-ac70-ec6ebda361fd service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:30.928280 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3939/7943] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:48:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:48:31.162294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b92c0f-dd89-4add-8d1f-0cc69edd8c7e service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:31.179362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b92c0f-dd89-4add-8d1f-0cc69edd8c7e service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:31.183421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640932e0-0a9e-4779-9a3b-c43e8280cb74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:31.183661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640932e0-0a9e-4779-9a3b-c43e8280cb74 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:31.183946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640932e0-0a9e-4779-9a3b-c43e8280cb74 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:31.184220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640932e0-0a9e-4779-9a3b-c43e8280cb74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:31.186002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-640932e0-0a9e-4779-9a3b-c43e8280cb74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:48:31.203336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640932e0-0a9e-4779-9a3b-c43e8280cb74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:31.204766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640932e0-0a9e-4779-9a3b-c43e8280cb74 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:31.218937 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4005/7944] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:48:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:48:34.029699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720b96d-060a-4a93-ac70-ec6ebda361fd service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:34.096497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720b96d-060a-4a93-ac70-ec6ebda361fd service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:34.102005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95670a61-4d10-435b-aed8-ce9c3fd397e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:34.102873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95670a61-4d10-435b-aed8-ce9c3fd397e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:34.103189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95670a61-4d10-435b-aed8-ce9c3fd397e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:34.103459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95670a61-4d10-435b-aed8-ce9c3fd397e8 admin admin] PATH_INFO: `/v3/users/8ea3cb9c20334400bbfb90dc62a5fb05` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:34.104650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95670a61-4d10-435b-aed8-ce9c3fd397e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ea3cb9c20334400bbfb90dc62a5fb05)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:34.106557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95670a61-4d10-435b-aed8-ce9c3fd397e8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:34.308672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-95670a61-4d10-435b-aed8-ce9c3fd397e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ea3cb9c20334400bbfb90dc62a5fb05'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:48:34.321554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-95670a61-4d10-435b-aed8-ce9c3fd397e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ea3cb9c20334400bbfb90dc62a5fb05'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:48:34.392014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-95670a61-4d10-435b-aed8-ce9c3fd397e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ea3cb9c20334400bbfb90dc62a5fb05'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:48:34.399918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-95670a61-4d10-435b-aed8-ce9c3fd397e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ea3cb9c20334400bbfb90dc62a5fb05'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:48:34.401396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-95670a61-4d10-435b-aed8-ce9c3fd397e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ea3cb9c20334400bbfb90dc62a5fb05'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:48:34.406620 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3940/7945] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:48:34 2022] DELETE /identity/v3/users/8ea3cb9c20334400bbfb90dc62a5fb05 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:48:34.411249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e78c1-f964-41f1-a1aa-a1e32747cb4e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:34.411742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e78c1-f964-41f1-a1aa-a1e32747cb4e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:34.411878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e78c1-f964-41f1-a1aa-a1e32747cb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:34.431478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5a2e78c1-f964-41f1-a1aa-a1e32747cb4e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:48:34.433080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5a2e78c1-f964-41f1-a1aa-a1e32747cb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:48:34.491702 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4006/7946] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:48:34.501377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95670a61-4d10-435b-aed8-ce9c3fd397e8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:34.502972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-95670a61-4d10-435b-aed8-ce9c3fd397e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:48:34.510167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:48:34.563678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95670a61-4d10-435b-aed8-ce9c3fd397e8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:34.567393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75eba7-d0e1-42f6-8231-43c2c6d22afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:34.570869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75eba7-d0e1-42f6-8231-43c2c6d22afe service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:34.570869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75eba7-d0e1-42f6-8231-43c2c6d22afe service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:34.570869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75eba7-d0e1-42f6-8231-43c2c6d22afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:34.578494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75eba7-d0e1-42f6-8231-43c2c6d22afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:34.579992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75eba7-d0e1-42f6-8231-43c2c6d22afe service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:34.591323 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3941/7947] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:48:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:48:34.846054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e78c1-f964-41f1-a1aa-a1e32747cb4e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:34.847539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5a2e78c1-f964-41f1-a1aa-a1e32747cb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:48:34.866414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e78c1-f964-41f1-a1aa-a1e32747cb4e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:34.875742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf394c-d749-4495-b921-96b7c3fdae64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:34.876880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf394c-d749-4495-b921-96b7c3fdae64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:34.877563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf394c-d749-4495-b921-96b7c3fdae64 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:34.877852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf394c-d749-4495-b921-96b7c3fdae64 admin admin] PATH_INFO: `/v3/projects/a3a0ab3a9f6c4a9186558dc3c1b1629a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:34.879717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf394c-d749-4495-b921-96b7c3fdae64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3a0ab3a9f6c4a9186558dc3c1b1629a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:34.883672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf394c-d749-4495-b921-96b7c3fdae64 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:35.010317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-61bf394c-d749-4495-b921-96b7c3fdae64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3a0ab3a9f6c4a9186558dc3c1b1629a', 'request_id': 'req-61bf394c-d749-4495-b921-96b7c3fdae64'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:48:35.016967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-61bf394c-d749-4495-b921-96b7c3fdae64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3a0ab3a9f6c4a9186558dc3c1b1629a', 'request_id': 'req-61bf394c-d749-4495-b921-96b7c3fdae64'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:48:35.022703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-61bf394c-d749-4495-b921-96b7c3fdae64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3a0ab3a9f6c4a9186558dc3c1b1629a', 'request_id': 'req-61bf394c-d749-4495-b921-96b7c3fdae64'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:48:35.086255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-61bf394c-d749-4495-b921-96b7c3fdae64 admin admin] The token cache is being invalidate because project a3a0ab3a9f6c4a9186558dc3c1b1629a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:48:35.086489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-61bf394c-d749-4495-b921-96b7c3fdae64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:48:35.087127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-61bf394c-d749-4495-b921-96b7c3fdae64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:48:35.088701 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4007/7948] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:48:34 2022] DELETE /identity/v3/projects/a3a0ab3a9f6c4a9186558dc3c1b1629a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:48:35.093533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb269a-d845-4c5c-8ba0-c8fb84af780c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:35.094023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb269a-d845-4c5c-8ba0-c8fb84af780c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:35.094129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb269a-d845-4c5c-8ba0-c8fb84af780c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:35.112399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d8fb269a-d845-4c5c-8ba0-c8fb84af780c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:48:35.113652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d8fb269a-d845-4c5c-8ba0-c8fb84af780c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:48:35.175833 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3942/7949] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:48:35.184573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3eb821-cadb-48bb-9b4a-dbd46442b7dc None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:35.184869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3eb821-cadb-48bb-9b4a-dbd46442b7dc None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:35.185202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3eb821-cadb-48bb-9b4a-dbd46442b7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:35.205187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9d3eb821-cadb-48bb-9b4a-dbd46442b7dc None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:48:35.206399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9d3eb821-cadb-48bb-9b4a-dbd46442b7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:48:35.214958 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4008/7950] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:48:35.231082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb269a-d845-4c5c-8ba0-c8fb84af780c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:35.242092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb269a-d845-4c5c-8ba0-c8fb84af780c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:35.246818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc6c98-5127-406a-bcb3-1d86092c2cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:35.251312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc6c98-5127-406a-bcb3-1d86092c2cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:35.251312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc6c98-5127-406a-bcb3-1d86092c2cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:35.251312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc6c98-5127-406a-bcb3-1d86092c2cc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:35.251312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc6c98-5127-406a-bcb3-1d86092c2cc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:48:35.251312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc6c98-5127-406a-bcb3-1d86092c2cc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:35.251312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc6c98-5127-406a-bcb3-1d86092c2cc1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:35.262323 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3943/7951] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:48:35.266935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3eb821-cadb-48bb-9b4a-dbd46442b7dc None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:35.276414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3eb821-cadb-48bb-9b4a-dbd46442b7dc None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:35.281093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7c18d-e545-4b91-a9b8-1ba454c938b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:35.281737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7c18d-e545-4b91-a9b8-1ba454c938b8 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:35.282020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7c18d-e545-4b91-a9b8-1ba454c938b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:35.282297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7c18d-e545-4b91-a9b8-1ba454c938b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:35.282979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7c18d-e545-4b91-a9b8-1ba454c938b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:35.284948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7c18d-e545-4b91-a9b8-1ba454c938b8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:35.352283 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4009/7952] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:48:35 2022] POST /identity/v3/projects => generated 359 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:48:35.356558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc6c98-5127-406a-bcb3-1d86092c2cc1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:35.366980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc6c98-5127-406a-bcb3-1d86092c2cc1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:35.424988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5f684-839f-4647-8557-6fd29a798813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:35.425653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5f684-839f-4647-8557-6fd29a798813 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:35.425965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5f684-839f-4647-8557-6fd29a798813 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:35.426242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5f684-839f-4647-8557-6fd29a798813 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:35.426962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5f684-839f-4647-8557-6fd29a798813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:35.433157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5f684-839f-4647-8557-6fd29a798813 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:35.532486 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3944/7953] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:48:35 2022] POST /identity/v3/users => generated 280 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:48:35.536848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7c18d-e545-4b91-a9b8-1ba454c938b8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:35.548458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7c18d-e545-4b91-a9b8-1ba454c938b8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:35.553157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d40d7a-a2a3-4e44-8057-7037ecb146df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:35.553857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d40d7a-a2a3-4e44-8057-7037ecb146df admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:35.554136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d40d7a-a2a3-4e44-8057-7037ecb146df admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:35.554417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d40d7a-a2a3-4e44-8057-7037ecb146df admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:35.555186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d40d7a-a2a3-4e44-8057-7037ecb146df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:35.556796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d40d7a-a2a3-4e44-8057-7037ecb146df admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:35.567486 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4010/7954] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:48:35.571622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5f684-839f-4647-8557-6fd29a798813 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:35.581806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5f684-839f-4647-8557-6fd29a798813 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:35.587031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c8b6e-53fe-4c8a-822d-e864562b1fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:35.587691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c8b6e-53fe-4c8a-822d-e864562b1fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:35.587974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c8b6e-53fe-4c8a-822d-e864562b1fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:35.588256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c8b6e-53fe-4c8a-822d-e864562b1fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:35.588977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c8b6e-53fe-4c8a-822d-e864562b1fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:35.590591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c8b6e-53fe-4c8a-822d-e864562b1fd4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:35.601491 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3945/7955] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:48:35.605633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d40d7a-a2a3-4e44-8057-7037ecb146df admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:35.615874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d40d7a-a2a3-4e44-8057-7037ecb146df admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:35.620442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e4ce5-c750-46f4-ae08-74c4456128d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:35.621315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e4ce5-c750-46f4-ae08-74c4456128d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:35.622722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e4ce5-c750-46f4-ae08-74c4456128d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:35.622722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e4ce5-c750-46f4-ae08-74c4456128d5 admin admin] PATH_INFO: `/v3/projects/88dc76df0e80478ab724a991b4a7a520/users/418ed10d9186454fa1f561446acf11dc/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:35.636673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e4ce5-c750-46f4-ae08-74c4456128d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88dc76df0e80478ab724a991b4a7a520, user_id=418ed10d9186454fa1f561446acf11dc, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:35.639367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e4ce5-c750-46f4-ae08-74c4456128d5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:35.703757 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4011/7956] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:48:35 2022] PUT /identity/v3/projects/88dc76df0e80478ab724a991b4a7a520/users/418ed10d9186454fa1f561446acf11dc/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:48:35.714398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff84717-98b6-413d-a327-47c070976fb4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:35.714689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff84717-98b6-413d-a327-47c070976fb4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:35.714968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff84717-98b6-413d-a327-47c070976fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:35.742536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:48:35.745532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-bff84717-98b6-413d-a327-47c070976fb4 None None] MFA Rules not processed for user `418ed10d9186454fa1f561446acf11dc`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:48:35.746740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bff84717-98b6-413d-a327-47c070976fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:48:35.810363 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3946/7957] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:48:35 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:48:35.821212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e4ce5-c750-46f4-ae08-74c4456128d5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:35.822933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0d2e4ce5-c750-46f4-ae08-74c4456128d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:48:35.833616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:48:35.884674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e4ce5-c750-46f4-ae08-74c4456128d5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:35.888306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada1abb-c56f-400d-b341-fe204bb0ea2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:35.888941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada1abb-c56f-400d-b341-fe204bb0ea2c service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:35.889225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada1abb-c56f-400d-b341-fe204bb0ea2c service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:35.889503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada1abb-c56f-400d-b341-fe204bb0ea2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:35.898484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada1abb-c56f-400d-b341-fe204bb0ea2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:35.899995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada1abb-c56f-400d-b341-fe204bb0ea2c service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:35.909295 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4012/7958] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:48:35 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:48:39.989543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff84717-98b6-413d-a327-47c070976fb4 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:48:39.989543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bff84717-98b6-413d-a327-47c070976fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:48:40.100407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff84717-98b6-413d-a327-47c070976fb4 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:48:40.107562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3505cd-0853-4a5a-aa6b-18772e309e3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:48:40.108201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3505cd-0853-4a5a-aa6b-18772e309e3a service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:48:40.108491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3505cd-0853-4a5a-aa6b-18772e309e3a service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:48:40.108773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3505cd-0853-4a5a-aa6b-18772e309e3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:48:40.110668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ab3505cd-0853-4a5a-aa6b-18772e309e3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:48:40.132675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3505cd-0853-4a5a-aa6b-18772e309e3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:48:40.138249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3505cd-0853-4a5a-aa6b-18772e309e3a service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:48:40.154593 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3947/7959] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:48:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:48:46.026454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=23 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:48:50.146444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=58 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:49:13.359965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada1abb-c56f-400d-b341-fe204bb0ea2c service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:49:13.427342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada1abb-c56f-400d-b341-fe204bb0ea2c service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:49:13.431802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d6d82-7025-4c37-ad52-13a992f65286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:49:13.432662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d6d82-7025-4c37-ad52-13a992f65286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:13.432939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d6d82-7025-4c37-ad52-13a992f65286 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:13.433205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d6d82-7025-4c37-ad52-13a992f65286 admin admin] PATH_INFO: `/v3/users/418ed10d9186454fa1f561446acf11dc` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:13.434384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d6d82-7025-4c37-ad52-13a992f65286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=418ed10d9186454fa1f561446acf11dc)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:49:13.436320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d6d82-7025-4c37-ad52-13a992f65286 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:49:13.626482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-998d6d82-7025-4c37-ad52-13a992f65286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '418ed10d9186454fa1f561446acf11dc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:49:13.634285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-998d6d82-7025-4c37-ad52-13a992f65286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '418ed10d9186454fa1f561446acf11dc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:49:13.714817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-998d6d82-7025-4c37-ad52-13a992f65286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '418ed10d9186454fa1f561446acf11dc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:49:13.715389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-998d6d82-7025-4c37-ad52-13a992f65286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '418ed10d9186454fa1f561446acf11dc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:49:13.728383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-998d6d82-7025-4c37-ad52-13a992f65286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '418ed10d9186454fa1f561446acf11dc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:49:13.734344 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4013/7960] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:49:13 2022] DELETE /identity/v3/users/418ed10d9186454fa1f561446acf11dc => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:49:13.739519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392b42c-9cb0-462d-9cba-3eb5eaed8b11 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:13.743864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392b42c-9cb0-462d-9cba-3eb5eaed8b11 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:13.743864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392b42c-9cb0-462d-9cba-3eb5eaed8b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:13.759144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d392b42c-9cb0-462d-9cba-3eb5eaed8b11 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:49:13.760349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d392b42c-9cb0-462d-9cba-3eb5eaed8b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:49:13.821006 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3948/7961] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:49:13.831909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d6d82-7025-4c37-ad52-13a992f65286 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:49:13.833496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-998d6d82-7025-4c37-ad52-13a992f65286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:49:13.895663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d6d82-7025-4c37-ad52-13a992f65286 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:49:13.899427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801d5dc-3483-413b-9f1f-6c2d98767c87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:49:13.900100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801d5dc-3483-413b-9f1f-6c2d98767c87 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:13.900404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801d5dc-3483-413b-9f1f-6c2d98767c87 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:13.900680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801d5dc-3483-413b-9f1f-6c2d98767c87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:13.909775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801d5dc-3483-413b-9f1f-6c2d98767c87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:49:13.911808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801d5dc-3483-413b-9f1f-6c2d98767c87 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:49:13.921351 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4014/7962] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:49:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:49:14.162966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392b42c-9cb0-462d-9cba-3eb5eaed8b11 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:49:14.166204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d392b42c-9cb0-462d-9cba-3eb5eaed8b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:49:14.181278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392b42c-9cb0-462d-9cba-3eb5eaed8b11 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:49:14.187254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206b197-76d0-4428-88c3-aa31a92a5679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:49:14.188122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206b197-76d0-4428-88c3-aa31a92a5679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:14.188531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206b197-76d0-4428-88c3-aa31a92a5679 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:14.188742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206b197-76d0-4428-88c3-aa31a92a5679 admin admin] PATH_INFO: `/v3/projects/88dc76df0e80478ab724a991b4a7a520` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:14.189898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206b197-76d0-4428-88c3-aa31a92a5679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88dc76df0e80478ab724a991b4a7a520)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:49:14.191839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206b197-76d0-4428-88c3-aa31a92a5679 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:49:14.306293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a206b197-76d0-4428-88c3-aa31a92a5679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88dc76df0e80478ab724a991b4a7a520', 'request_id': 'req-a206b197-76d0-4428-88c3-aa31a92a5679'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:49:14.311730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a206b197-76d0-4428-88c3-aa31a92a5679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88dc76df0e80478ab724a991b4a7a520', 'request_id': 'req-a206b197-76d0-4428-88c3-aa31a92a5679'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:49:14.317898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a206b197-76d0-4428-88c3-aa31a92a5679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88dc76df0e80478ab724a991b4a7a520', 'request_id': 'req-a206b197-76d0-4428-88c3-aa31a92a5679'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:49:14.397000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a206b197-76d0-4428-88c3-aa31a92a5679 admin admin] The token cache is being invalidate because project 88dc76df0e80478ab724a991b4a7a520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:49:14.401460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a206b197-76d0-4428-88c3-aa31a92a5679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:49:14.401460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a206b197-76d0-4428-88c3-aa31a92a5679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:49:14.401460 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3949/7963] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:49:14 2022] DELETE /identity/v3/projects/88dc76df0e80478ab724a991b4a7a520 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:49:14.404341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2d640-088e-43b6-8257-1fdab8401b4f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:14.404829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2d640-088e-43b6-8257-1fdab8401b4f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:14.404944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2d640-088e-43b6-8257-1fdab8401b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:14.425483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d1d2d640-088e-43b6-8257-1fdab8401b4f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:49:14.426923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d1d2d640-088e-43b6-8257-1fdab8401b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:49:14.444044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:49:14.487199 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4015/7964] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:49:14.494939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3d421-0b50-43cc-a4f9-cfeb78020e01 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:14.495269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3d421-0b50-43cc-a4f9-cfeb78020e01 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:14.499199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3d421-0b50-43cc-a4f9-cfeb78020e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:14.513870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-60c3d421-0b50-43cc-a4f9-cfeb78020e01 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:49:14.515197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-60c3d421-0b50-43cc-a4f9-cfeb78020e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:49:14.524344 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3950/7965] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:49:14.528524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2d640-088e-43b6-8257-1fdab8401b4f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:49:14.538795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2d640-088e-43b6-8257-1fdab8401b4f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:49:14.543969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458073af-b618-4d20-b3cb-7c19b07a2fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:49:14.550073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458073af-b618-4d20-b3cb-7c19b07a2fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:14.550073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458073af-b618-4d20-b3cb-7c19b07a2fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:14.550073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458073af-b618-4d20-b3cb-7c19b07a2fa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:14.550073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458073af-b618-4d20-b3cb-7c19b07a2fa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:49:14.550073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458073af-b618-4d20-b3cb-7c19b07a2fa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:49:14.550073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458073af-b618-4d20-b3cb-7c19b07a2fa3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:49:14.559420 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4016/7966] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:49:14.563633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3d421-0b50-43cc-a4f9-cfeb78020e01 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:49:14.573329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3d421-0b50-43cc-a4f9-cfeb78020e01 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:49:14.578178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c9212-34c8-4520-ba07-0ff36a973c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:49:14.578905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c9212-34c8-4520-ba07-0ff36a973c0a admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:14.579223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c9212-34c8-4520-ba07-0ff36a973c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:14.579548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c9212-34c8-4520-ba07-0ff36a973c0a admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:14.580248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c9212-34c8-4520-ba07-0ff36a973c0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:49:14.582194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c9212-34c8-4520-ba07-0ff36a973c0a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:49:14.668037 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3951/7967] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:49:14 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:49:14.672010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458073af-b618-4d20-b3cb-7c19b07a2fa3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:49:14.683864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458073af-b618-4d20-b3cb-7c19b07a2fa3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:49:14.744204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817859b-e6a3-4dbf-bfef-b9ce8583b362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:49:14.744862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817859b-e6a3-4dbf-bfef-b9ce8583b362 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:14.745196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817859b-e6a3-4dbf-bfef-b9ce8583b362 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:14.745450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817859b-e6a3-4dbf-bfef-b9ce8583b362 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:14.746161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a817859b-e6a3-4dbf-bfef-b9ce8583b362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:49:14.748216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a817859b-e6a3-4dbf-bfef-b9ce8583b362 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:49:14.826469 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4017/7968] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:49:14 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:49:14.828954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c9212-34c8-4520-ba07-0ff36a973c0a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:49:14.840418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c9212-34c8-4520-ba07-0ff36a973c0a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:49:14.849754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f227b0-f3c5-4567-aea1-14ec0df3c485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:49:14.849754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f227b0-f3c5-4567-aea1-14ec0df3c485 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:14.849754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f227b0-f3c5-4567-aea1-14ec0df3c485 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:14.849754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f227b0-f3c5-4567-aea1-14ec0df3c485 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:14.850199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f227b0-f3c5-4567-aea1-14ec0df3c485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:49:14.850199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f227b0-f3c5-4567-aea1-14ec0df3c485 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:49:14.859778 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3952/7969] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:49:14.863866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817859b-e6a3-4dbf-bfef-b9ce8583b362 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:49:14.874830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817859b-e6a3-4dbf-bfef-b9ce8583b362 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:49:14.880240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8e465-ac4d-4a9d-9c86-69b0c6de4c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:49:14.880899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8e465-ac4d-4a9d-9c86-69b0c6de4c68 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:14.881187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8e465-ac4d-4a9d-9c86-69b0c6de4c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:14.881465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8e465-ac4d-4a9d-9c86-69b0c6de4c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:14.882187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8e465-ac4d-4a9d-9c86-69b0c6de4c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:49:14.883889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8e465-ac4d-4a9d-9c86-69b0c6de4c68 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:49:14.893806 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4018/7970] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:49:14.898575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f227b0-f3c5-4567-aea1-14ec0df3c485 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:49:14.908818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f227b0-f3c5-4567-aea1-14ec0df3c485 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:49:14.913584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c2e7d-f9cf-4816-8b39-3566488312ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:49:14.914460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c2e7d-f9cf-4816-8b39-3566488312ec admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:14.914745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c2e7d-f9cf-4816-8b39-3566488312ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:14.915049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c2e7d-f9cf-4816-8b39-3566488312ec admin admin] PATH_INFO: `/v3/projects/0558852a9f564fb88c0341e8d1031799/users/8b7e6202be6b4d98a9c2e5e8abab065f/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:14.930124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c2e7d-f9cf-4816-8b39-3566488312ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=0558852a9f564fb88c0341e8d1031799, user_id=8b7e6202be6b4d98a9c2e5e8abab065f, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:49:14.932897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c2e7d-f9cf-4816-8b39-3566488312ec admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:49:15.029149 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3953/7971] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:49:14 2022] PUT /identity/v3/projects/0558852a9f564fb88c0341e8d1031799/users/8b7e6202be6b4d98a9c2e5e8abab065f/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:49:15.039224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011db8d-8dca-4c6f-8f78-ff1c8d916253 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:15.039522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011db8d-8dca-4c6f-8f78-ff1c8d916253 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:15.039803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011db8d-8dca-4c6f-8f78-ff1c8d916253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:15.066554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4011db8d-8dca-4c6f-8f78-ff1c8d916253 None None] MFA Rules not processed for user `8b7e6202be6b4d98a9c2e5e8abab065f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:49:15.068733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4011db8d-8dca-4c6f-8f78-ff1c8d916253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:49:15.133680 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4019/7972] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:49:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:49:15.144092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c2e7d-f9cf-4816-8b39-3566488312ec admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:49:15.146131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f64c2e7d-f9cf-4816-8b39-3566488312ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:49:15.168417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:49:15.206748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c2e7d-f9cf-4816-8b39-3566488312ec admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:49:15.210631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd067b5-bf91-424a-a383-1e220501ebca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:49:15.211319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd067b5-bf91-424a-a383-1e220501ebca service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:15.211603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd067b5-bf91-424a-a383-1e220501ebca service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:15.211880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd067b5-bf91-424a-a383-1e220501ebca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:15.220641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd067b5-bf91-424a-a383-1e220501ebca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:49:15.222140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd067b5-bf91-424a-a383-1e220501ebca service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:49:15.231842 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3954/7973] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:49:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:49:15.544311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011db8d-8dca-4c6f-8f78-ff1c8d916253 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:49:15.564361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:49:15.609426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011db8d-8dca-4c6f-8f78-ff1c8d916253 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:49:15.614999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243a51b-fbb7-4e07-9819-d7a8c3d7f324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:49:15.615922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243a51b-fbb7-4e07-9819-d7a8c3d7f324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:15.616202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243a51b-fbb7-4e07-9819-d7a8c3d7f324 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:15.616478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243a51b-fbb7-4e07-9819-d7a8c3d7f324 admin admin] PATH_INFO: `/v3/users/8b7e6202be6b4d98a9c2e5e8abab065f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:15.617672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243a51b-fbb7-4e07-9819-d7a8c3d7f324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b7e6202be6b4d98a9c2e5e8abab065f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:49:15.619767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243a51b-fbb7-4e07-9819-d7a8c3d7f324 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:49:15.834144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1243a51b-fbb7-4e07-9819-d7a8c3d7f324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b7e6202be6b4d98a9c2e5e8abab065f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:49:15.841301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1243a51b-fbb7-4e07-9819-d7a8c3d7f324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b7e6202be6b4d98a9c2e5e8abab065f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:49:15.903062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1243a51b-fbb7-4e07-9819-d7a8c3d7f324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b7e6202be6b4d98a9c2e5e8abab065f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:49:15.903689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1243a51b-fbb7-4e07-9819-d7a8c3d7f324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b7e6202be6b4d98a9c2e5e8abab065f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:49:15.917782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1243a51b-fbb7-4e07-9819-d7a8c3d7f324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b7e6202be6b4d98a9c2e5e8abab065f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:49:15.923769 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4020/7974] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:49:15 2022] DELETE /identity/v3/users/8b7e6202be6b4d98a9c2e5e8abab065f => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:49:15.929143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b7728-1fd8-4f49-aaed-c13764ab61ae None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:15.929653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b7728-1fd8-4f49-aaed-c13764ab61ae None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:15.929761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b7728-1fd8-4f49-aaed-c13764ab61ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:15.947816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8c6b7728-1fd8-4f49-aaed-c13764ab61ae None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:49:15.949018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8c6b7728-1fd8-4f49-aaed-c13764ab61ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:49:16.008704 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3955/7975] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:49:16.018534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243a51b-fbb7-4e07-9819-d7a8c3d7f324 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:49:16.019991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1243a51b-fbb7-4e07-9819-d7a8c3d7f324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:49:16.081837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243a51b-fbb7-4e07-9819-d7a8c3d7f324 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:49:16.086155 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845b584-eb57-474c-83e3-3725d476f85c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:49:16.086745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845b584-eb57-474c-83e3-3725d476f85c service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:16.087054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845b584-eb57-474c-83e3-3725d476f85c service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:16.087343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845b584-eb57-474c-83e3-3725d476f85c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:16.096905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845b584-eb57-474c-83e3-3725d476f85c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:49:16.098584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845b584-eb57-474c-83e3-3725d476f85c service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:49:16.108950 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4021/7976] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:49:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:49:16.564674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b7728-1fd8-4f49-aaed-c13764ab61ae None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:49:16.566147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8c6b7728-1fd8-4f49-aaed-c13764ab61ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:49:16.581391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b7728-1fd8-4f49-aaed-c13764ab61ae None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:49:16.586929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27f144-22a6-4e65-9c57-2e2954711e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:49:16.587846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27f144-22a6-4e65-9c57-2e2954711e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:16.588130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27f144-22a6-4e65-9c57-2e2954711e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:16.588444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27f144-22a6-4e65-9c57-2e2954711e9c admin admin] PATH_INFO: `/v3/projects/0558852a9f564fb88c0341e8d1031799` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:16.589647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27f144-22a6-4e65-9c57-2e2954711e9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0558852a9f564fb88c0341e8d1031799)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:49:16.591708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27f144-22a6-4e65-9c57-2e2954711e9c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:49:16.704294 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9c27f144-22a6-4e65-9c57-2e2954711e9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0558852a9f564fb88c0341e8d1031799', 'request_id': 'req-9c27f144-22a6-4e65-9c57-2e2954711e9c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:49:16.709805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9c27f144-22a6-4e65-9c57-2e2954711e9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0558852a9f564fb88c0341e8d1031799', 'request_id': 'req-9c27f144-22a6-4e65-9c57-2e2954711e9c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:49:16.716098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9c27f144-22a6-4e65-9c57-2e2954711e9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0558852a9f564fb88c0341e8d1031799', 'request_id': 'req-9c27f144-22a6-4e65-9c57-2e2954711e9c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:49:16.806276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9c27f144-22a6-4e65-9c57-2e2954711e9c admin admin] The token cache is being invalidate because project 0558852a9f564fb88c0341e8d1031799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:49:16.806568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9c27f144-22a6-4e65-9c57-2e2954711e9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:49:16.807266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9c27f144-22a6-4e65-9c57-2e2954711e9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:49:16.810805 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3956/7977] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:49:16 2022] DELETE /identity/v3/projects/0558852a9f564fb88c0341e8d1031799 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:49:16.813803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205f9ed-f95e-416d-81e1-fbb941170aa8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:16.814295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205f9ed-f95e-416d-81e1-fbb941170aa8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:16.814413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205f9ed-f95e-416d-81e1-fbb941170aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:16.833581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0205f9ed-f95e-416d-81e1-fbb941170aa8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:49:16.834953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0205f9ed-f95e-416d-81e1-fbb941170aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:49:16.870748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:49:16.896864 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4022/7978] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:49:16.905580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb1b54-667c-4714-bf39-12528f6104c5 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:16.905866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb1b54-667c-4714-bf39-12528f6104c5 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:16.906140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb1b54-667c-4714-bf39-12528f6104c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:16.927067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-51eb1b54-667c-4714-bf39-12528f6104c5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:49:16.928475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-51eb1b54-667c-4714-bf39-12528f6104c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:49:16.936559 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3957/7979] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:49:16.940769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205f9ed-f95e-416d-81e1-fbb941170aa8 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:49:16.950667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205f9ed-f95e-416d-81e1-fbb941170aa8 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:49:16.955935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5212b-37db-468c-8133-c73da9212a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:49:16.956538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5212b-37db-468c-8133-c73da9212a2e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:16.956814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5212b-37db-468c-8133-c73da9212a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:16.957099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5212b-37db-468c-8133-c73da9212a2e admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:16.957826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5212b-37db-468c-8133-c73da9212a2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:49:16.958124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5212b-37db-468c-8133-c73da9212a2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:49:16.959770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5212b-37db-468c-8133-c73da9212a2e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:49:16.971289 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4023/7980] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:49:16.980851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb1b54-667c-4714-bf39-12528f6104c5 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:49:16.991259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb1b54-667c-4714-bf39-12528f6104c5 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:49:16.995999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beef2ae-f9b2-4cb2-891b-2f128df1cb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:49:17.001115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beef2ae-f9b2-4cb2-891b-2f128df1cb54 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:17.001115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beef2ae-f9b2-4cb2-891b-2f128df1cb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:17.001115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beef2ae-f9b2-4cb2-891b-2f128df1cb54 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:17.001115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beef2ae-f9b2-4cb2-891b-2f128df1cb54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:49:17.001115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beef2ae-f9b2-4cb2-891b-2f128df1cb54 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:49:17.078680 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3958/7981] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:49:16 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:49:17.083159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5212b-37db-468c-8133-c73da9212a2e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:49:17.093288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5212b-37db-468c-8133-c73da9212a2e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:49:17.151183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fae7f1-cead-4ffb-afe4-ef583a174d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:49:17.151851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fae7f1-cead-4ffb-afe4-ef583a174d87 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:17.152135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fae7f1-cead-4ffb-afe4-ef583a174d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:17.152415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fae7f1-cead-4ffb-afe4-ef583a174d87 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:17.153103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fae7f1-cead-4ffb-afe4-ef583a174d87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:49:17.155051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fae7f1-cead-4ffb-afe4-ef583a174d87 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:49:17.229727 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4024/7982] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:49:17 2022] POST /identity/v3/users => generated 284 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:49:17.233760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beef2ae-f9b2-4cb2-891b-2f128df1cb54 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:49:17.244382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beef2ae-f9b2-4cb2-891b-2f128df1cb54 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:49:17.249154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cd4be-d860-40e2-a088-ff93d9625897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:49:17.249813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cd4be-d860-40e2-a088-ff93d9625897 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:17.250098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cd4be-d860-40e2-a088-ff93d9625897 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:17.250371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cd4be-d860-40e2-a088-ff93d9625897 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:17.251263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cd4be-d860-40e2-a088-ff93d9625897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:49:17.252900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cd4be-d860-40e2-a088-ff93d9625897 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:49:17.264000 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3959/7983] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:49:17.270769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fae7f1-cead-4ffb-afe4-ef583a174d87 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:49:17.281644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fae7f1-cead-4ffb-afe4-ef583a174d87 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:49:17.286378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fe66b-b36c-4df3-8697-444750ca846c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:49:17.287047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fe66b-b36c-4df3-8697-444750ca846c admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:17.287331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fe66b-b36c-4df3-8697-444750ca846c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:17.287629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fe66b-b36c-4df3-8697-444750ca846c admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:17.288364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862fe66b-b36c-4df3-8697-444750ca846c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:49:17.289958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862fe66b-b36c-4df3-8697-444750ca846c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:49:17.303156 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4025/7984] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:49:17.307323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cd4be-d860-40e2-a088-ff93d9625897 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:49:17.318329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cd4be-d860-40e2-a088-ff93d9625897 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:49:17.323097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73741d34-2145-4458-b5d8-c8269548150f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:49:17.323970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73741d34-2145-4458-b5d8-c8269548150f admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:17.324252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73741d34-2145-4458-b5d8-c8269548150f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:17.324532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73741d34-2145-4458-b5d8-c8269548150f admin admin] PATH_INFO: `/v3/projects/fd226cf29ce94156843dbd5bd7bdaadd/users/2a261fb830194aa3a1016f7b8612c9e2/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:17.326746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:49:17.339881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73741d34-2145-4458-b5d8-c8269548150f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd226cf29ce94156843dbd5bd7bdaadd, user_id=2a261fb830194aa3a1016f7b8612c9e2, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:49:17.342620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73741d34-2145-4458-b5d8-c8269548150f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:49:17.408935 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3960/7985] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:49:17 2022] PUT /identity/v3/projects/fd226cf29ce94156843dbd5bd7bdaadd/users/2a261fb830194aa3a1016f7b8612c9e2/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:49:17.419464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778951c-7658-4051-82ab-8039e5b7b288 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:17.419752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778951c-7658-4051-82ab-8039e5b7b288 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:17.420026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778951c-7658-4051-82ab-8039e5b7b288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:17.447541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4778951c-7658-4051-82ab-8039e5b7b288 None None] MFA Rules not processed for user `2a261fb830194aa3a1016f7b8612c9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:49:17.448743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4778951c-7658-4051-82ab-8039e5b7b288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:49:17.515171 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4026/7986] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:49:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:49:17.525920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73741d34-2145-4458-b5d8-c8269548150f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:49:17.527721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-73741d34-2145-4458-b5d8-c8269548150f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:49:17.594990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73741d34-2145-4458-b5d8-c8269548150f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:49:17.599261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f65182-6094-4d1f-b822-d14c4fc1cfcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:49:17.599919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f65182-6094-4d1f-b822-d14c4fc1cfcf service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:17.600458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f65182-6094-4d1f-b822-d14c4fc1cfcf service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:17.600749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f65182-6094-4d1f-b822-d14c4fc1cfcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:17.609240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f65182-6094-4d1f-b822-d14c4fc1cfcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:49:17.610705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f65182-6094-4d1f-b822-d14c4fc1cfcf service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:49:17.620455 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3961/7987] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:49:17 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:49:25.164359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778951c-7658-4051-82ab-8039e5b7b288 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:49:25.166899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4778951c-7658-4051-82ab-8039e5b7b288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:49:25.187371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778951c-7658-4051-82ab-8039e5b7b288 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:49:25.187371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366f8fc-334d-44ab-95a9-5b0286c53c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:49:25.187371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366f8fc-334d-44ab-95a9-5b0286c53c45 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:25.187371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366f8fc-334d-44ab-95a9-5b0286c53c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:25.187998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366f8fc-334d-44ab-95a9-5b0286c53c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:25.189470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b366f8fc-334d-44ab-95a9-5b0286c53c45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:49:25.203482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366f8fc-334d-44ab-95a9-5b0286c53c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:49:25.205208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366f8fc-334d-44ab-95a9-5b0286c53c45 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:49:25.217812 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4027/7988] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:49:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:49:26.001917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f65182-6094-4d1f-b822-d14c4fc1cfcf service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:49:26.014685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f65182-6094-4d1f-b822-d14c4fc1cfcf service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:49:26.020958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c2f18-72c0-41a1-b244-ed0e2483f868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:49:26.022132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c2f18-72c0-41a1-b244-ed0e2483f868 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:26.022283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c2f18-72c0-41a1-b244-ed0e2483f868 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:26.022465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c2f18-72c0-41a1-b244-ed0e2483f868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:26.024428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a21c2f18-72c0-41a1-b244-ed0e2483f868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:49:26.038641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c2f18-72c0-41a1-b244-ed0e2483f868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:49:26.040273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c2f18-72c0-41a1-b244-ed0e2483f868 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:49:26.053443 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3962/7989] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:49:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:49:35.211296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=87,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:49:36.047340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:49:55.439702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b27d64-195e-4f40-8c28-60786688501a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:49:55.440164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b27d64-195e-4f40-8c28-60786688501a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:49:55.440270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b27d64-195e-4f40-8c28-60786688501a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:49:55.459573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b7b27d64-195e-4f40-8c28-60786688501a None None] MFA Rules not processed for user `cfe293b9ed3645229bed5ef8ce17cfec`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:49:55.460868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b7b27d64-195e-4f40-8c28-60786688501a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:49:55.527904 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4028/7990] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:49:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:50:05.521639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=25 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:10.446595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c2f18-72c0-41a1-b244-ed0e2483f868 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:10.449916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a21c2f18-72c0-41a1-b244-ed0e2483f868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:10.606946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c2f18-72c0-41a1-b244-ed0e2483f868 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:10.614140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59329974-ad81-4560-82ad-0df130908ffe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:10.614932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329974-ad81-4560-82ad-0df130908ffe service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:10.615254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329974-ad81-4560-82ad-0df130908ffe service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:10.615535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329974-ad81-4560-82ad-0df130908ffe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:10.617399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-59329974-ad81-4560-82ad-0df130908ffe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:10.637917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59329974-ad81-4560-82ad-0df130908ffe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:10.639814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59329974-ad81-4560-82ad-0df130908ffe service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:10.658087 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3963/7991] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:50:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:50:14.389913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b27d64-195e-4f40-8c28-60786688501a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:14.413985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b27d64-195e-4f40-8c28-60786688501a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:14.421644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb205c6-b0d1-4499-9fcf-0dfd7631cf17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:14.424826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb205c6-b0d1-4499-9fcf-0dfd7631cf17 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:14.426013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb205c6-b0d1-4499-9fcf-0dfd7631cf17 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:14.426453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb205c6-b0d1-4499-9fcf-0dfd7631cf17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:14.446719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5cb205c6-b0d1-4499-9fcf-0dfd7631cf17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:14.456759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59329974-ad81-4560-82ad-0df130908ffe service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:14.473732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59329974-ad81-4560-82ad-0df130908ffe service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:14.478842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd747199-533e-48b7-832b-00cb05399857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:14.479787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd747199-533e-48b7-832b-00cb05399857 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:14.480223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd747199-533e-48b7-832b-00cb05399857 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:14.481329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd747199-533e-48b7-832b-00cb05399857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:14.483848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cd747199-533e-48b7-832b-00cb05399857 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:14.488844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb205c6-b0d1-4499-9fcf-0dfd7631cf17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:14.493858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb205c6-b0d1-4499-9fcf-0dfd7631cf17 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:14.505391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd747199-533e-48b7-832b-00cb05399857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:14.506850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd747199-533e-48b7-832b-00cb05399857 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:14.532318 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4029/7992] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:50:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:50:14.534699 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3964/7993] 10.222.0.16 () {60 vars in 1396 bytes} [Sat Jul 16 21:50:14 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3246 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:50:15.486853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16939a75-86ac-4ff0-a6dc-ac565f0e79cc None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:15.487390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16939a75-86ac-4ff0-a6dc-ac565f0e79cc None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:15.487536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16939a75-86ac-4ff0-a6dc-ac565f0e79cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:15.511995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-16939a75-86ac-4ff0-a6dc-ac565f0e79cc None None] MFA Rules not processed for user `cfe293b9ed3645229bed5ef8ce17cfec`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:50:15.513241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-16939a75-86ac-4ff0-a6dc-ac565f0e79cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:15.524051 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4030/7994] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:50:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:50:24.515870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=40 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:25.504272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=9 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:34.558263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd747199-533e-48b7-832b-00cb05399857 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:34.622330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd747199-533e-48b7-832b-00cb05399857 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:34.626975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf038533-042d-40ab-b632-af8769c4caae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:34.627822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf038533-042d-40ab-b632-af8769c4caae admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:34.628106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf038533-042d-40ab-b632-af8769c4caae admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:34.628409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf038533-042d-40ab-b632-af8769c4caae admin admin] PATH_INFO: `/v3/users/2a261fb830194aa3a1016f7b8612c9e2` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:34.629653 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf038533-042d-40ab-b632-af8769c4caae admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a261fb830194aa3a1016f7b8612c9e2)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:34.631608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf038533-042d-40ab-b632-af8769c4caae admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:34.835067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cf038533-042d-40ab-b632-af8769c4caae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a261fb830194aa3a1016f7b8612c9e2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:34.848546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cf038533-042d-40ab-b632-af8769c4caae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a261fb830194aa3a1016f7b8612c9e2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:34.913486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cf038533-042d-40ab-b632-af8769c4caae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a261fb830194aa3a1016f7b8612c9e2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:34.921501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cf038533-042d-40ab-b632-af8769c4caae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a261fb830194aa3a1016f7b8612c9e2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:34.922142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-cf038533-042d-40ab-b632-af8769c4caae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a261fb830194aa3a1016f7b8612c9e2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:34.929030 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3965/7995] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:50:34 2022] DELETE /identity/v3/users/2a261fb830194aa3a1016f7b8612c9e2 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:50:34.933485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e32969-8829-49e6-bc5b-28c3e32935ed None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:34.933946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e32969-8829-49e6-bc5b-28c3e32935ed None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:34.934042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e32969-8829-49e6-bc5b-28c3e32935ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:34.952477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c1e32969-8829-49e6-bc5b-28c3e32935ed None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:50:34.953665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c1e32969-8829-49e6-bc5b-28c3e32935ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:35.013044 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4031/7996] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:50:35.022995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf038533-042d-40ab-b632-af8769c4caae admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:35.024434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cf038533-042d-40ab-b632-af8769c4caae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:35.084894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf038533-042d-40ab-b632-af8769c4caae admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:35.088701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7e744-7a6f-48d5-a208-9af8009dea62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:35.089410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7e744-7a6f-48d5-a208-9af8009dea62 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:35.089698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7e744-7a6f-48d5-a208-9af8009dea62 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:35.089978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7e744-7a6f-48d5-a208-9af8009dea62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:35.100487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7e744-7a6f-48d5-a208-9af8009dea62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:35.101995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7e744-7a6f-48d5-a208-9af8009dea62 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:35.111954 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3966/7997] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:50:35.340466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e32969-8829-49e6-bc5b-28c3e32935ed None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:35.341927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c1e32969-8829-49e6-bc5b-28c3e32935ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:35.355948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e32969-8829-49e6-bc5b-28c3e32935ed None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:35.362027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71ced1-3c54-4863-ac0e-951f0b39b14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:35.365898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71ced1-3c54-4863-ac0e-951f0b39b14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:35.365898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71ced1-3c54-4863-ac0e-951f0b39b14b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:35.365898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71ced1-3c54-4863-ac0e-951f0b39b14b admin admin] PATH_INFO: `/v3/projects/fd226cf29ce94156843dbd5bd7bdaadd` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:35.365898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71ced1-3c54-4863-ac0e-951f0b39b14b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd226cf29ce94156843dbd5bd7bdaadd)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:35.367039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71ced1-3c54-4863-ac0e-951f0b39b14b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:35.492650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-be71ced1-3c54-4863-ac0e-951f0b39b14b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd226cf29ce94156843dbd5bd7bdaadd', 'request_id': 'req-be71ced1-3c54-4863-ac0e-951f0b39b14b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:35.499103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-be71ced1-3c54-4863-ac0e-951f0b39b14b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd226cf29ce94156843dbd5bd7bdaadd', 'request_id': 'req-be71ced1-3c54-4863-ac0e-951f0b39b14b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:35.505496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-be71ced1-3c54-4863-ac0e-951f0b39b14b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd226cf29ce94156843dbd5bd7bdaadd', 'request_id': 'req-be71ced1-3c54-4863-ac0e-951f0b39b14b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:35.581343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-be71ced1-3c54-4863-ac0e-951f0b39b14b admin admin] The token cache is being invalidate because project fd226cf29ce94156843dbd5bd7bdaadd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:50:35.581657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-be71ced1-3c54-4863-ac0e-951f0b39b14b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:35.582518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-be71ced1-3c54-4863-ac0e-951f0b39b14b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:35.584179 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4032/7998] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:50:35 2022] DELETE /identity/v3/projects/fd226cf29ce94156843dbd5bd7bdaadd => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:50:35.588972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20978d09-4da7-4055-a704-29bdc17eb867 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:35.589408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20978d09-4da7-4055-a704-29bdc17eb867 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:35.589523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20978d09-4da7-4055-a704-29bdc17eb867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:35.607894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-20978d09-4da7-4055-a704-29bdc17eb867 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:50:35.609089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-20978d09-4da7-4055-a704-29bdc17eb867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:35.627025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:35.669555 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3967/7999] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:50:35.679060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d8c7a-4dbb-4215-95e4-29d4258fcd00 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:35.679357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d8c7a-4dbb-4215-95e4-29d4258fcd00 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:35.679636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d8c7a-4dbb-4215-95e4-29d4258fcd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:35.698198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-931d8c7a-4dbb-4215-95e4-29d4258fcd00 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:50:35.699468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-931d8c7a-4dbb-4215-95e4-29d4258fcd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:35.707422 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4033/8000] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:50:35.711722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20978d09-4da7-4055-a704-29bdc17eb867 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:35.721573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20978d09-4da7-4055-a704-29bdc17eb867 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:35.727938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8856947-8cfd-4fd4-9304-80dff70708d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:35.728594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8856947-8cfd-4fd4-9304-80dff70708d5 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:35.728905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8856947-8cfd-4fd4-9304-80dff70708d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:35.729298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8856947-8cfd-4fd4-9304-80dff70708d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:35.732168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8856947-8cfd-4fd4-9304-80dff70708d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:50:35.732168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8856947-8cfd-4fd4-9304-80dff70708d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:35.732168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8856947-8cfd-4fd4-9304-80dff70708d5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:35.744768 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3968/8001] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:50:35.749261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d8c7a-4dbb-4215-95e4-29d4258fcd00 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:35.758755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d8c7a-4dbb-4215-95e4-29d4258fcd00 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:35.763460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd62c7a-8c2e-4431-98b9-c6e886ee836f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:35.764189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd62c7a-8c2e-4431-98b9-c6e886ee836f admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:35.764473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd62c7a-8c2e-4431-98b9-c6e886ee836f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:35.764748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd62c7a-8c2e-4431-98b9-c6e886ee836f admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:35.765451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd62c7a-8c2e-4431-98b9-c6e886ee836f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:35.767419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd62c7a-8c2e-4431-98b9-c6e886ee836f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:35.894310 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4034/8002] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:50:35 2022] POST /identity/v3/projects => generated 359 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:50:35.898781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8856947-8cfd-4fd4-9304-80dff70708d5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:35.911667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8856947-8cfd-4fd4-9304-80dff70708d5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:35.985292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e38458-2de1-4852-a3e3-52e4285210d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:35.985977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e38458-2de1-4852-a3e3-52e4285210d6 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:35.986262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e38458-2de1-4852-a3e3-52e4285210d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:35.986539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e38458-2de1-4852-a3e3-52e4285210d6 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:35.987408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e38458-2de1-4852-a3e3-52e4285210d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:35.989859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e38458-2de1-4852-a3e3-52e4285210d6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:36.077255 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3969/8003] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:50:35 2022] POST /identity/v3/users => generated 280 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:50:36.081153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd62c7a-8c2e-4431-98b9-c6e886ee836f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:36.095139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd62c7a-8c2e-4431-98b9-c6e886ee836f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:36.101233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a44026-86ff-46b1-8568-72c1bf56e634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:36.101908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a44026-86ff-46b1-8568-72c1bf56e634 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:36.102190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a44026-86ff-46b1-8568-72c1bf56e634 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:36.102471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a44026-86ff-46b1-8568-72c1bf56e634 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:36.103403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a44026-86ff-46b1-8568-72c1bf56e634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:36.105019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a44026-86ff-46b1-8568-72c1bf56e634 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:36.116699 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4035/8004] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:50:36.120914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e38458-2de1-4852-a3e3-52e4285210d6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:36.131877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e38458-2de1-4852-a3e3-52e4285210d6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:36.136778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acac8d-7e7e-4484-9649-5ec3b7541940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:36.137432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acac8d-7e7e-4484-9649-5ec3b7541940 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:36.137947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acac8d-7e7e-4484-9649-5ec3b7541940 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:36.138228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acac8d-7e7e-4484-9649-5ec3b7541940 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:36.138957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acac8d-7e7e-4484-9649-5ec3b7541940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:36.140588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acac8d-7e7e-4484-9649-5ec3b7541940 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:36.151046 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3970/8005] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:50:36.155400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a44026-86ff-46b1-8568-72c1bf56e634 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:36.166358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a44026-86ff-46b1-8568-72c1bf56e634 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:36.172847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3766483-b8f3-466f-9bdf-59de95dd61f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:36.172847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3766483-b8f3-466f-9bdf-59de95dd61f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:36.172847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3766483-b8f3-466f-9bdf-59de95dd61f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:36.172847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3766483-b8f3-466f-9bdf-59de95dd61f0 admin admin] PATH_INFO: `/v3/projects/6db5f9771b0b4f9baad414b76bc9ea19/users/03ccfc3c328c425db5af3e1a5dcddaae/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:36.188162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3766483-b8f3-466f-9bdf-59de95dd61f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db5f9771b0b4f9baad414b76bc9ea19, user_id=03ccfc3c328c425db5af3e1a5dcddaae, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:36.190882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3766483-b8f3-466f-9bdf-59de95dd61f0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:36.314528 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4036/8006] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:50:36 2022] PUT /identity/v3/projects/6db5f9771b0b4f9baad414b76bc9ea19/users/03ccfc3c328c425db5af3e1a5dcddaae/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:50:36.325733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc17cbb-a873-45a9-b21a-6fcf145da229 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:36.325733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc17cbb-a873-45a9-b21a-6fcf145da229 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:36.326030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc17cbb-a873-45a9-b21a-6fcf145da229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:36.355122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ffc17cbb-a873-45a9-b21a-6fcf145da229 None None] MFA Rules not processed for user `03ccfc3c328c425db5af3e1a5dcddaae`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:50:36.355894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ffc17cbb-a873-45a9-b21a-6fcf145da229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:36.424369 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3971/8007] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:50:36 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:50:36.436095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3766483-b8f3-466f-9bdf-59de95dd61f0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:36.438039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f3766483-b8f3-466f-9bdf-59de95dd61f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:36.462739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:36.504018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3766483-b8f3-466f-9bdf-59de95dd61f0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:36.507798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676d1d8-0299-4075-a4be-3f40abd6aa2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:36.508489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676d1d8-0299-4075-a4be-3f40abd6aa2c service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:36.508770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676d1d8-0299-4075-a4be-3f40abd6aa2c service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:36.509184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676d1d8-0299-4075-a4be-3f40abd6aa2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:36.519521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676d1d8-0299-4075-a4be-3f40abd6aa2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:36.520919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676d1d8-0299-4075-a4be-3f40abd6aa2c service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:36.530044 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4037/8008] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:50:36 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:50:36.705676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5d802-30db-47dd-926b-bf1361bfb919 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:36.706154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5d802-30db-47dd-926b-bf1361bfb919 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:36.706250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5d802-30db-47dd-926b-bf1361bfb919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:36.739785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:36.762135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-16c5d802-30db-47dd-926b-bf1361bfb919 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:50:36.763377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-16c5d802-30db-47dd-926b-bf1361bfb919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:36.828916 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3972/8009] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:50:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:50:37.015911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676d1d8-0299-4075-a4be-3f40abd6aa2c service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:37.015911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b676d1d8-0299-4075-a4be-3f40abd6aa2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:37.125786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676d1d8-0299-4075-a4be-3f40abd6aa2c service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:37.132293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752572ea-ac55-4f11-81c8-fcca9fc8c64b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:37.132946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752572ea-ac55-4f11-81c8-fcca9fc8c64b service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:37.133228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752572ea-ac55-4f11-81c8-fcca9fc8c64b service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:37.133504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752572ea-ac55-4f11-81c8-fcca9fc8c64b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:37.142360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752572ea-ac55-4f11-81c8-fcca9fc8c64b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:37.144181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752572ea-ac55-4f11-81c8-fcca9fc8c64b service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:37.153798 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4038/8010] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:50:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:50:46.870733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=28 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:47.150522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=54 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:52.102290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5d802-30db-47dd-926b-bf1361bfb919 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:52.197685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5d802-30db-47dd-926b-bf1361bfb919 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:52.202581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba484d0-2fb9-43d5-9110-0f250986f6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:52.203543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba484d0-2fb9-43d5-9110-0f250986f6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:52.203829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba484d0-2fb9-43d5-9110-0f250986f6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:52.204111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba484d0-2fb9-43d5-9110-0f250986f6a6 admin admin] PATH_INFO: `/v3/users/03ccfc3c328c425db5af3e1a5dcddaae` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:52.205329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba484d0-2fb9-43d5-9110-0f250986f6a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03ccfc3c328c425db5af3e1a5dcddaae)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:52.207290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba484d0-2fb9-43d5-9110-0f250986f6a6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:52.420194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6ba484d0-2fb9-43d5-9110-0f250986f6a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03ccfc3c328c425db5af3e1a5dcddaae'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:52.434157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6ba484d0-2fb9-43d5-9110-0f250986f6a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03ccfc3c328c425db5af3e1a5dcddaae'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:52.527316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6ba484d0-2fb9-43d5-9110-0f250986f6a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03ccfc3c328c425db5af3e1a5dcddaae'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:52.535511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6ba484d0-2fb9-43d5-9110-0f250986f6a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03ccfc3c328c425db5af3e1a5dcddaae'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:52.536973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6ba484d0-2fb9-43d5-9110-0f250986f6a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03ccfc3c328c425db5af3e1a5dcddaae'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:52.543722 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3973/8011] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:50:52 2022] DELETE /identity/v3/users/03ccfc3c328c425db5af3e1a5dcddaae => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:50:52.548522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cde74b-16f9-4286-985f-dc28968dbe00 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:52.549019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cde74b-16f9-4286-985f-dc28968dbe00 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:52.549260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cde74b-16f9-4286-985f-dc28968dbe00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:52.567973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b2cde74b-16f9-4286-985f-dc28968dbe00 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:50:52.569225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b2cde74b-16f9-4286-985f-dc28968dbe00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:52.632364 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4039/8012] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:50:52.656082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba484d0-2fb9-43d5-9110-0f250986f6a6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:52.657741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6ba484d0-2fb9-43d5-9110-0f250986f6a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:52.735323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba484d0-2fb9-43d5-9110-0f250986f6a6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:52.739144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752b664-ac2f-4334-a59a-91b959e59797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:52.740161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752b664-ac2f-4334-a59a-91b959e59797 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:52.740435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752b664-ac2f-4334-a59a-91b959e59797 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:52.740686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752b664-ac2f-4334-a59a-91b959e59797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:52.755070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752b664-ac2f-4334-a59a-91b959e59797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:52.756495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752b664-ac2f-4334-a59a-91b959e59797 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:52.766176 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3974/8013] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:50:53.038986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cde74b-16f9-4286-985f-dc28968dbe00 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:53.041350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b2cde74b-16f9-4286-985f-dc28968dbe00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:53.055208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cde74b-16f9-4286-985f-dc28968dbe00 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:53.062584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fc895-0c2f-4916-b970-a26e8082e3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:53.063450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fc895-0c2f-4916-b970-a26e8082e3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:53.063734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fc895-0c2f-4916-b970-a26e8082e3de admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:53.064036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fc895-0c2f-4916-b970-a26e8082e3de admin admin] PATH_INFO: `/v3/projects/6db5f9771b0b4f9baad414b76bc9ea19` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:53.065233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fc895-0c2f-4916-b970-a26e8082e3de admin admin] RBAC: Authorizing `identity:delete_project(project_id=6db5f9771b0b4f9baad414b76bc9ea19)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:53.067214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fc895-0c2f-4916-b970-a26e8082e3de admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:53.199331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0e1fc895-0c2f-4916-b970-a26e8082e3de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6db5f9771b0b4f9baad414b76bc9ea19', 'request_id': 'req-0e1fc895-0c2f-4916-b970-a26e8082e3de'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:53.205552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0e1fc895-0c2f-4916-b970-a26e8082e3de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6db5f9771b0b4f9baad414b76bc9ea19', 'request_id': 'req-0e1fc895-0c2f-4916-b970-a26e8082e3de'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:53.212119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0e1fc895-0c2f-4916-b970-a26e8082e3de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6db5f9771b0b4f9baad414b76bc9ea19', 'request_id': 'req-0e1fc895-0c2f-4916-b970-a26e8082e3de'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:53.278552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0e1fc895-0c2f-4916-b970-a26e8082e3de admin admin] The token cache is being invalidate because project 6db5f9771b0b4f9baad414b76bc9ea19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:50:53.278865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0e1fc895-0c2f-4916-b970-a26e8082e3de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:53.279524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0e1fc895-0c2f-4916-b970-a26e8082e3de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:53.281128 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4040/8014] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:50:53 2022] DELETE /identity/v3/projects/6db5f9771b0b4f9baad414b76bc9ea19 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:50:53.286944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bba01d-4e29-40b0-a55f-f461bac5b75c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:53.287560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bba01d-4e29-40b0-a55f-f461bac5b75c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:53.287560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bba01d-4e29-40b0-a55f-f461bac5b75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:53.294811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:53.305845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c7bba01d-4e29-40b0-a55f-f461bac5b75c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:50:53.307112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c7bba01d-4e29-40b0-a55f-f461bac5b75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:53.368392 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3975/8015] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:50:53.376352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a12f8-f046-468f-99c6-e1d67d224119 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:53.376749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a12f8-f046-468f-99c6-e1d67d224119 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:53.377046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a12f8-f046-468f-99c6-e1d67d224119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:53.396846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7b8a12f8-f046-468f-99c6-e1d67d224119 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:50:53.398037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7b8a12f8-f046-468f-99c6-e1d67d224119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:53.406313 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4041/8016] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:50:53.410352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bba01d-4e29-40b0-a55f-f461bac5b75c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:53.426007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bba01d-4e29-40b0-a55f-f461bac5b75c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:53.431675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c15e37-be32-42e3-b9e8-852c35053ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:53.432330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c15e37-be32-42e3-b9e8-852c35053ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:53.432611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c15e37-be32-42e3-b9e8-852c35053ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:53.432886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c15e37-be32-42e3-b9e8-852c35053ca2 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:53.433604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c15e37-be32-42e3-b9e8-852c35053ca2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:50:53.433904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c15e37-be32-42e3-b9e8-852c35053ca2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:53.435543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c15e37-be32-42e3-b9e8-852c35053ca2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:53.448052 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3976/8017] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:50:53.452666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a12f8-f046-468f-99c6-e1d67d224119 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:53.462954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a12f8-f046-468f-99c6-e1d67d224119 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:53.467980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73f373-6a23-4309-b291-e6667680affe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:53.468645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73f373-6a23-4309-b291-e6667680affe admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:53.468929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73f373-6a23-4309-b291-e6667680affe admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:53.469206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73f373-6a23-4309-b291-e6667680affe admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:53.469892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73f373-6a23-4309-b291-e6667680affe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:53.472131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73f373-6a23-4309-b291-e6667680affe admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:53.580089 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4042/8018] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:50:53 2022] POST /identity/v3/projects => generated 369 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:50:53.584723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c15e37-be32-42e3-b9e8-852c35053ca2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:53.595050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c15e37-be32-42e3-b9e8-852c35053ca2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:53.653830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f66e7-25ea-4cb1-a5c1-c1d224135559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:53.654429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f66e7-25ea-4cb1-a5c1-c1d224135559 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:53.654711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f66e7-25ea-4cb1-a5c1-c1d224135559 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:53.655073 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f66e7-25ea-4cb1-a5c1-c1d224135559 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:53.655790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f66e7-25ea-4cb1-a5c1-c1d224135559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:53.657700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f66e7-25ea-4cb1-a5c1-c1d224135559 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:53.735770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73f373-6a23-4309-b291-e6667680affe admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:53.737534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6e73f373-6a23-4309-b291-e6667680affe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:53.799282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73f373-6a23-4309-b291-e6667680affe admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:53.800011 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3977/8019] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:50:53 2022] POST /identity/v3/users => generated 285 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:50:53.804275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c300b97-d35b-4029-afba-78d32b40ee02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:53.804684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f66e7-25ea-4cb1-a5c1-c1d224135559 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:53.804962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c300b97-d35b-4029-afba-78d32b40ee02 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:53.805246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c300b97-d35b-4029-afba-78d32b40ee02 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:53.805526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c300b97-d35b-4029-afba-78d32b40ee02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:53.807451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0c300b97-d35b-4029-afba-78d32b40ee02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:53.814811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f66e7-25ea-4cb1-a5c1-c1d224135559 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:53.820952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:53.821203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dee26-27d3-47bc-9b7c-4f5d91883b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:53.821203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dee26-27d3-47bc-9b7c-4f5d91883b2c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:53.821203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dee26-27d3-47bc-9b7c-4f5d91883b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:53.821203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dee26-27d3-47bc-9b7c-4f5d91883b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:53.821774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23dee26-27d3-47bc-9b7c-4f5d91883b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:53.823429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23dee26-27d3-47bc-9b7c-4f5d91883b2c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:53.833918 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3978/8020] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:50:53.837788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dee26-27d3-47bc-9b7c-4f5d91883b2c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:53.847827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dee26-27d3-47bc-9b7c-4f5d91883b2c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:53.853239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddfbc7-b6a1-42ea-a682-be405c64ded5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:53.853888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddfbc7-b6a1-42ea-a682-be405c64ded5 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:53.854292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddfbc7-b6a1-42ea-a682-be405c64ded5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:53.854576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddfbc7-b6a1-42ea-a682-be405c64ded5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:53.855350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddfbc7-b6a1-42ea-a682-be405c64ded5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:53.857077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddfbc7-b6a1-42ea-a682-be405c64ded5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:53.869884 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3979/8021] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:50:53.873934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddfbc7-b6a1-42ea-a682-be405c64ded5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:53.882049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c300b97-d35b-4029-afba-78d32b40ee02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:53.883547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c300b97-d35b-4029-afba-78d32b40ee02 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:53.884481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddfbc7-b6a1-42ea-a682-be405c64ded5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:53.889460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f38de0-a657-49a5-a9a5-c516ac261335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:53.890361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f38de0-a657-49a5-a9a5-c516ac261335 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:53.890648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f38de0-a657-49a5-a9a5-c516ac261335 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:53.890928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f38de0-a657-49a5-a9a5-c516ac261335 admin admin] PATH_INFO: `/v3/projects/987f5f9c6a814759abdb763865be8cb4/users/f6158da7e5b44346999e9a626bda01e2/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:53.893321 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4043/8022] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:50:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:50:53.906532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f38de0-a657-49a5-a9a5-c516ac261335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=987f5f9c6a814759abdb763865be8cb4, user_id=f6158da7e5b44346999e9a626bda01e2, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:53.909187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f38de0-a657-49a5-a9a5-c516ac261335 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:53.991879 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3980/8023] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:50:53 2022] PUT /identity/v3/projects/987f5f9c6a814759abdb763865be8cb4/users/f6158da7e5b44346999e9a626bda01e2/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:50:54.003445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5430a08-a4f0-4226-baa2-df6366e99ee4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:54.003811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5430a08-a4f0-4226-baa2-df6366e99ee4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:54.004159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5430a08-a4f0-4226-baa2-df6366e99ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:54.032439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d5430a08-a4f0-4226-baa2-df6366e99ee4 None None] MFA Rules not processed for user `f6158da7e5b44346999e9a626bda01e2`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:50:54.033660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d5430a08-a4f0-4226-baa2-df6366e99ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:54.102349 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4044/8024] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:50:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:50:54.107085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f38de0-a657-49a5-a9a5-c516ac261335 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:54.150671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:54.177978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f38de0-a657-49a5-a9a5-c516ac261335 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:54.183280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01891ac-830e-4c83-907e-32ad4d479cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:54.184432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01891ac-830e-4c83-907e-32ad4d479cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:54.185295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01891ac-830e-4c83-907e-32ad4d479cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:54.185835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01891ac-830e-4c83-907e-32ad4d479cf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:54.186540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01891ac-830e-4c83-907e-32ad4d479cf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:54.188582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01891ac-830e-4c83-907e-32ad4d479cf7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:54.293246 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3981/8025] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:50:54 2022] POST /identity/v3/projects => generated 367 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:50:54.297496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5430a08-a4f0-4226-baa2-df6366e99ee4 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:54.313421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5430a08-a4f0-4226-baa2-df6366e99ee4 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:54.373554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5c773-d1b9-4dfc-b7bb-619ebd459afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:54.374247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5c773-d1b9-4dfc-b7bb-619ebd459afd admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:54.374521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5c773-d1b9-4dfc-b7bb-619ebd459afd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:54.374835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5c773-d1b9-4dfc-b7bb-619ebd459afd admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:54.375556 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5c773-d1b9-4dfc-b7bb-619ebd459afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:54.377581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5c773-d1b9-4dfc-b7bb-619ebd459afd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:54.476484 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4045/8026] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:50:54 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:50:54.480316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01891ac-830e-4c83-907e-32ad4d479cf7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:54.491406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01891ac-830e-4c83-907e-32ad4d479cf7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:54.496116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550476a-cba0-4012-9d52-9225e129d33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:54.496774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550476a-cba0-4012-9d52-9225e129d33b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:54.497061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550476a-cba0-4012-9d52-9225e129d33b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:54.497341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550476a-cba0-4012-9d52-9225e129d33b admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:54.498061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550476a-cba0-4012-9d52-9225e129d33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:54.499711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550476a-cba0-4012-9d52-9225e129d33b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:54.512389 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3982/8027] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:50:54.516617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5c773-d1b9-4dfc-b7bb-619ebd459afd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:54.527555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5c773-d1b9-4dfc-b7bb-619ebd459afd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:54.532324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabdfc7-a366-4bdc-974c-9f9dc6d55c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:54.533193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabdfc7-a366-4bdc-974c-9f9dc6d55c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:54.533472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabdfc7-a366-4bdc-974c-9f9dc6d55c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:54.533749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabdfc7-a366-4bdc-974c-9f9dc6d55c2c admin admin] PATH_INFO: `/v3/projects/bf2902a1e9434f00b9e3697b61387328/users/af54803dcfc9448db79db6efdcbadef5/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:54.549835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabdfc7-a366-4bdc-974c-9f9dc6d55c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2902a1e9434f00b9e3697b61387328, user_id=af54803dcfc9448db79db6efdcbadef5, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:54.553283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabdfc7-a366-4bdc-974c-9f9dc6d55c2c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:54.630429 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4046/8028] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:50:54 2022] PUT /identity/v3/projects/bf2902a1e9434f00b9e3697b61387328/users/af54803dcfc9448db79db6efdcbadef5/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:50:54.634952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550476a-cba0-4012-9d52-9225e129d33b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:54.648027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550476a-cba0-4012-9d52-9225e129d33b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:54.710449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260aa2a0-bd78-40de-af28-a019f6385270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:54.711219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aa2a0-bd78-40de-af28-a019f6385270 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:54.711506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aa2a0-bd78-40de-af28-a019f6385270 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:54.711789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aa2a0-bd78-40de-af28-a019f6385270 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:54.713467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260aa2a0-bd78-40de-af28-a019f6385270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:54.715094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260aa2a0-bd78-40de-af28-a019f6385270 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:54.726816 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3983/8029] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:50:54.730719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabdfc7-a366-4bdc-974c-9f9dc6d55c2c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:54.737451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:54.741484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabdfc7-a366-4bdc-974c-9f9dc6d55c2c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:54.746536 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66daab31-4fa7-4ee1-b4d4-811c66d81ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:54.747474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66daab31-4fa7-4ee1-b4d4-811c66d81ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:54.751057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66daab31-4fa7-4ee1-b4d4-811c66d81ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:54.751057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66daab31-4fa7-4ee1-b4d4-811c66d81ebb admin admin] PATH_INFO: `/v3/projects/bf2902a1e9434f00b9e3697b61387328/users/af54803dcfc9448db79db6efdcbadef5/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:54.751057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66daab31-4fa7-4ee1-b4d4-811c66d81ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2902a1e9434f00b9e3697b61387328, user_id=af54803dcfc9448db79db6efdcbadef5, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:54.752951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66daab31-4fa7-4ee1-b4d4-811c66d81ebb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:54.764045 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4047/8030] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:50:54 2022] PUT /identity/v3/projects/bf2902a1e9434f00b9e3697b61387328/users/af54803dcfc9448db79db6efdcbadef5/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:50:54.775095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554c417-ce12-4f61-8f64-bb473be41364 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:54.775389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554c417-ce12-4f61-8f64-bb473be41364 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:54.775665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554c417-ce12-4f61-8f64-bb473be41364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:54.803973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8554c417-ce12-4f61-8f64-bb473be41364 None None] MFA Rules not processed for user `af54803dcfc9448db79db6efdcbadef5`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:50:54.805112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8554c417-ce12-4f61-8f64-bb473be41364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:54.880059 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3984/8031] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:50:54 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:50:54.892038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66daab31-4fa7-4ee1-b4d4-811c66d81ebb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:54.893705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-66daab31-4fa7-4ee1-b4d4-811c66d81ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:54.982772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66daab31-4fa7-4ee1-b4d4-811c66d81ebb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:54.986662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bd9e1-98db-4924-add7-8b849184e301 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:54.987350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bd9e1-98db-4924-add7-8b849184e301 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:54.995403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bd9e1-98db-4924-add7-8b849184e301 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:54.995403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bd9e1-98db-4924-add7-8b849184e301 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:55.000032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370bd9e1-98db-4924-add7-8b849184e301 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:55.001491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370bd9e1-98db-4924-add7-8b849184e301 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:55.014584 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4048/8032] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:50:54 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:50:58.177786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554c417-ce12-4f61-8f64-bb473be41364 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:58.211152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:58.248591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554c417-ce12-4f61-8f64-bb473be41364 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:58.254710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f79d2-83e3-450f-b98d-8498a569aaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:58.257064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f79d2-83e3-450f-b98d-8498a569aaa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:58.257350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f79d2-83e3-450f-b98d-8498a569aaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:58.257679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f79d2-83e3-450f-b98d-8498a569aaa8 admin admin] PATH_INFO: `/v3/users/f6158da7e5b44346999e9a626bda01e2` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:58.260030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f79d2-83e3-450f-b98d-8498a569aaa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6158da7e5b44346999e9a626bda01e2)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:58.261321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f79d2-83e3-450f-b98d-8498a569aaa8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:58.476240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-638f79d2-83e3-450f-b98d-8498a569aaa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6158da7e5b44346999e9a626bda01e2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:58.491211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-638f79d2-83e3-450f-b98d-8498a569aaa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6158da7e5b44346999e9a626bda01e2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:58.591336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-638f79d2-83e3-450f-b98d-8498a569aaa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6158da7e5b44346999e9a626bda01e2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:58.599359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-638f79d2-83e3-450f-b98d-8498a569aaa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6158da7e5b44346999e9a626bda01e2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:58.600083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-638f79d2-83e3-450f-b98d-8498a569aaa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6158da7e5b44346999e9a626bda01e2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:58.606175 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3985/8033] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:50:58 2022] DELETE /identity/v3/users/f6158da7e5b44346999e9a626bda01e2 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:50:58.610991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182ceac-1075-4f8d-aaf1-78d7051ae2ab None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:58.618916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182ceac-1075-4f8d-aaf1-78d7051ae2ab None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:58.618916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182ceac-1075-4f8d-aaf1-78d7051ae2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:58.630747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2182ceac-1075-4f8d-aaf1-78d7051ae2ab None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:50:58.632012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2182ceac-1075-4f8d-aaf1-78d7051ae2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:58.692718 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4049/8034] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:50:58.702599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f79d2-83e3-450f-b98d-8498a569aaa8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:58.704117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-638f79d2-83e3-450f-b98d-8498a569aaa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:58.767584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f79d2-83e3-450f-b98d-8498a569aaa8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:58.771317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45110004-a78e-4cd4-8956-fe10f0c21fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:58.771973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45110004-a78e-4cd4-8956-fe10f0c21fdd service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:58.772261 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45110004-a78e-4cd4-8956-fe10f0c21fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:58.772538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45110004-a78e-4cd4-8956-fe10f0c21fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:58.781890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45110004-a78e-4cd4-8956-fe10f0c21fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:58.783394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45110004-a78e-4cd4-8956-fe10f0c21fdd service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:58.793290 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3986/8035] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:50:59.221167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182ceac-1075-4f8d-aaf1-78d7051ae2ab None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:59.224291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2182ceac-1075-4f8d-aaf1-78d7051ae2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:50:59.238405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182ceac-1075-4f8d-aaf1-78d7051ae2ab None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:59.243300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d229ca2-f644-4ee3-80de-26b4ce13628d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:59.244282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d229ca2-f644-4ee3-80de-26b4ce13628d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:59.244621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d229ca2-f644-4ee3-80de-26b4ce13628d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:59.245210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d229ca2-f644-4ee3-80de-26b4ce13628d admin admin] PATH_INFO: `/v3/projects/987f5f9c6a814759abdb763865be8cb4` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:59.246528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d229ca2-f644-4ee3-80de-26b4ce13628d admin admin] RBAC: Authorizing `identity:delete_project(project_id=987f5f9c6a814759abdb763865be8cb4)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:59.248633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d229ca2-f644-4ee3-80de-26b4ce13628d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:59.381740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0d229ca2-f644-4ee3-80de-26b4ce13628d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '987f5f9c6a814759abdb763865be8cb4', 'request_id': 'req-0d229ca2-f644-4ee3-80de-26b4ce13628d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:59.388269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0d229ca2-f644-4ee3-80de-26b4ce13628d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '987f5f9c6a814759abdb763865be8cb4', 'request_id': 'req-0d229ca2-f644-4ee3-80de-26b4ce13628d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:59.394222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0d229ca2-f644-4ee3-80de-26b4ce13628d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '987f5f9c6a814759abdb763865be8cb4', 'request_id': 'req-0d229ca2-f644-4ee3-80de-26b4ce13628d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:59.451288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:59.456137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0d229ca2-f644-4ee3-80de-26b4ce13628d admin admin] The token cache is being invalidate because project 987f5f9c6a814759abdb763865be8cb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:50:59.456430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0d229ca2-f644-4ee3-80de-26b4ce13628d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:59.457061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0d229ca2-f644-4ee3-80de-26b4ce13628d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:59.458729 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4050/8036] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:50:59 2022] DELETE /identity/v3/projects/987f5f9c6a814759abdb763865be8cb4 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:50:59.469807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45110004-a78e-4cd4-8956-fe10f0c21fdd service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:50:59.480298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45110004-a78e-4cd4-8956-fe10f0c21fdd service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:50:59.530127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:50:59.540087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5db444-2f8c-49df-adb3-f8251869c70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:50:59.540933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5db444-2f8c-49df-adb3-f8251869c70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:50:59.541216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5db444-2f8c-49df-adb3-f8251869c70c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:50:59.541494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5db444-2f8c-49df-adb3-f8251869c70c admin admin] PATH_INFO: `/v3/users/af54803dcfc9448db79db6efdcbadef5` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:50:59.542689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5db444-2f8c-49df-adb3-f8251869c70c admin admin] RBAC: Authorizing `identity:delete_user(user_id=af54803dcfc9448db79db6efdcbadef5)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:50:59.544651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5db444-2f8c-49df-adb3-f8251869c70c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:50:59.803454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fa5db444-2f8c-49df-adb3-f8251869c70c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af54803dcfc9448db79db6efdcbadef5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:59.814913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fa5db444-2f8c-49df-adb3-f8251869c70c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af54803dcfc9448db79db6efdcbadef5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:59.886742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fa5db444-2f8c-49df-adb3-f8251869c70c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af54803dcfc9448db79db6efdcbadef5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:59.895767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fa5db444-2f8c-49df-adb3-f8251869c70c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af54803dcfc9448db79db6efdcbadef5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:59.896436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-fa5db444-2f8c-49df-adb3-f8251869c70c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af54803dcfc9448db79db6efdcbadef5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:50:59.902698 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3987/8037] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:50:59 2022] DELETE /identity/v3/users/af54803dcfc9448db79db6efdcbadef5 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:51:00.338847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d229ca2-f644-4ee3-80de-26b4ce13628d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:00.340351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0d229ca2-f644-4ee3-80de-26b4ce13628d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:00.354124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d229ca2-f644-4ee3-80de-26b4ce13628d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:00.437044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58237c2-f1dd-4d63-8bc6-4464b66ad513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:00.437923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58237c2-f1dd-4d63-8bc6-4464b66ad513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:00.438480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58237c2-f1dd-4d63-8bc6-4464b66ad513 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:00.442599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58237c2-f1dd-4d63-8bc6-4464b66ad513 admin admin] PATH_INFO: `/v3/projects/bf2902a1e9434f00b9e3697b61387328` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:00.442599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58237c2-f1dd-4d63-8bc6-4464b66ad513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf2902a1e9434f00b9e3697b61387328)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:00.442599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58237c2-f1dd-4d63-8bc6-4464b66ad513 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:00.564043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d58237c2-f1dd-4d63-8bc6-4464b66ad513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf2902a1e9434f00b9e3697b61387328', 'request_id': 'req-d58237c2-f1dd-4d63-8bc6-4464b66ad513'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:00.571400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d58237c2-f1dd-4d63-8bc6-4464b66ad513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf2902a1e9434f00b9e3697b61387328', 'request_id': 'req-d58237c2-f1dd-4d63-8bc6-4464b66ad513'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:00.577014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d58237c2-f1dd-4d63-8bc6-4464b66ad513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf2902a1e9434f00b9e3697b61387328', 'request_id': 'req-d58237c2-f1dd-4d63-8bc6-4464b66ad513'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:00.715494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d58237c2-f1dd-4d63-8bc6-4464b66ad513 admin admin] The token cache is being invalidate because project bf2902a1e9434f00b9e3697b61387328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:51:00.715781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d58237c2-f1dd-4d63-8bc6-4464b66ad513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:00.716395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d58237c2-f1dd-4d63-8bc6-4464b66ad513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:00.717958 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4051/8038] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:51:00 2022] DELETE /identity/v3/projects/bf2902a1e9434f00b9e3697b61387328 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:51:00.722936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83415c7e-a4e1-4cd5-8f7e-cda6c8d3e037 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:00.723773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83415c7e-a4e1-4cd5-8f7e-cda6c8d3e037 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:00.724149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83415c7e-a4e1-4cd5-8f7e-cda6c8d3e037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:00.742429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-83415c7e-a4e1-4cd5-8f7e-cda6c8d3e037 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:00.743707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-83415c7e-a4e1-4cd5-8f7e-cda6c8d3e037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:00.803747 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3988/8039] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:51:00.811985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7d1a8-b4f3-4893-9eae-48689f64e164 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:00.812483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7d1a8-b4f3-4893-9eae-48689f64e164 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:00.813135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7d1a8-b4f3-4893-9eae-48689f64e164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:00.834896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-88d7d1a8-b4f3-4893-9eae-48689f64e164 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:00.836177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-88d7d1a8-b4f3-4893-9eae-48689f64e164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:00.844482 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4052/8040] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:51:00.850329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83415c7e-a4e1-4cd5-8f7e-cda6c8d3e037 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:00.860555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83415c7e-a4e1-4cd5-8f7e-cda6c8d3e037 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:00.866069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8e468-8437-45e3-ba2d-9bce0a6506fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:00.867117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8e468-8437-45e3-ba2d-9bce0a6506fa admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:00.867321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8e468-8437-45e3-ba2d-9bce0a6506fa admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:00.867595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8e468-8437-45e3-ba2d-9bce0a6506fa admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:00.868366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8e468-8437-45e3-ba2d-9bce0a6506fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:51:00.868674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8e468-8437-45e3-ba2d-9bce0a6506fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:00.870270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8e468-8437-45e3-ba2d-9bce0a6506fa admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:00.882689 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3989/8041] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:51:00.887151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7d1a8-b4f3-4893-9eae-48689f64e164 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:00.897271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7d1a8-b4f3-4893-9eae-48689f64e164 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:00.901906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0c88c-9702-485b-9911-01f6b8972385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:00.902539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0c88c-9702-485b-9911-01f6b8972385 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:00.902825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0c88c-9702-485b-9911-01f6b8972385 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:00.903141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0c88c-9702-485b-9911-01f6b8972385 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:00.903831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0c88c-9702-485b-9911-01f6b8972385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:00.905769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0c88c-9702-485b-9911-01f6b8972385 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:01.031080 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4053/8042] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:51:00 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:51:01.035371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8e468-8437-45e3-ba2d-9bce0a6506fa admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:01.045954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8e468-8437-45e3-ba2d-9bce0a6506fa admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:01.114688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85503bb-3985-46bc-9b6c-d435d9342341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:01.115476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85503bb-3985-46bc-9b6c-d435d9342341 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:01.115765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85503bb-3985-46bc-9b6c-d435d9342341 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:01.116044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85503bb-3985-46bc-9b6c-d435d9342341 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:01.116777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85503bb-3985-46bc-9b6c-d435d9342341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:01.118722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85503bb-3985-46bc-9b6c-d435d9342341 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:01.125455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:01.205987 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3990/8043] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:51:01 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:51:01.212741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0c88c-9702-485b-9911-01f6b8972385 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:01.225696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0c88c-9702-485b-9911-01f6b8972385 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:01.231278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a1c6b-239a-43c6-b1ff-32f751938a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:01.231952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a1c6b-239a-43c6-b1ff-32f751938a77 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:01.232265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a1c6b-239a-43c6-b1ff-32f751938a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:01.232956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a1c6b-239a-43c6-b1ff-32f751938a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:01.233318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a1c6b-239a-43c6-b1ff-32f751938a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:01.234973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a1c6b-239a-43c6-b1ff-32f751938a77 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:01.246620 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4054/8044] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:51:01.250921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85503bb-3985-46bc-9b6c-d435d9342341 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:01.266681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85503bb-3985-46bc-9b6c-d435d9342341 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:01.266681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa12a0-2170-4ecf-8b07-47525c8e3f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:01.267033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa12a0-2170-4ecf-8b07-47525c8e3f87 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:01.267335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa12a0-2170-4ecf-8b07-47525c8e3f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:01.267621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa12a0-2170-4ecf-8b07-47525c8e3f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:01.268344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa12a0-2170-4ecf-8b07-47525c8e3f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:01.270030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa12a0-2170-4ecf-8b07-47525c8e3f87 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:01.280738 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3991/8045] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:51:01.284818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a1c6b-239a-43c6-b1ff-32f751938a77 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:01.295815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a1c6b-239a-43c6-b1ff-32f751938a77 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:01.300586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6f080-866e-49c6-8ada-58ca711a5471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:01.302067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6f080-866e-49c6-8ada-58ca711a5471 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:01.302411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6f080-866e-49c6-8ada-58ca711a5471 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:01.303230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6f080-866e-49c6-8ada-58ca711a5471 admin admin] PATH_INFO: `/v3/projects/5796a2bbfe294f219152381b3d3e98f6/users/11b7995709444537bc26f9feed8e1288/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:01.317469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6f080-866e-49c6-8ada-58ca711a5471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5796a2bbfe294f219152381b3d3e98f6, user_id=11b7995709444537bc26f9feed8e1288, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:01.320417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6f080-866e-49c6-8ada-58ca711a5471 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:01.431186 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4055/8046] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:51:01 2022] PUT /identity/v3/projects/5796a2bbfe294f219152381b3d3e98f6/users/11b7995709444537bc26f9feed8e1288/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:51:01.442501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007ea08-4471-4911-a847-f5cac5c82bfc None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:01.442831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007ea08-4471-4911-a847-f5cac5c82bfc None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:01.443107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007ea08-4471-4911-a847-f5cac5c82bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:01.472511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6007ea08-4471-4911-a847-f5cac5c82bfc None None] MFA Rules not processed for user `11b7995709444537bc26f9feed8e1288`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:01.474465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6007ea08-4471-4911-a847-f5cac5c82bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:01.540449 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3992/8047] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:51:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:51:01.547671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6f080-866e-49c6-8ada-58ca711a5471 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:01.571731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:01.611168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6f080-866e-49c6-8ada-58ca711a5471 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:01.616568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d220366-848e-48f8-85d4-2429b9651ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:01.617304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d220366-848e-48f8-85d4-2429b9651ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:01.617595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d220366-848e-48f8-85d4-2429b9651ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:01.617877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d220366-848e-48f8-85d4-2429b9651ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:01.618562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d220366-848e-48f8-85d4-2429b9651ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:01.620718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d220366-848e-48f8-85d4-2429b9651ed5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:01.734160 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4056/8048] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:51:01 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:51:01.738274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007ea08-4471-4911-a847-f5cac5c82bfc None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:01.750964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007ea08-4471-4911-a847-f5cac5c82bfc None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:01.808764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b0b72-0857-4c0e-bd7a-23e26fcddf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:01.809428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b0b72-0857-4c0e-bd7a-23e26fcddf64 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:01.809707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b0b72-0857-4c0e-bd7a-23e26fcddf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:01.810009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b0b72-0857-4c0e-bd7a-23e26fcddf64 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:01.810719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b0b72-0857-4c0e-bd7a-23e26fcddf64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:01.812676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b0b72-0857-4c0e-bd7a-23e26fcddf64 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:01.914597 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3993/8049] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:51:01 2022] POST /identity/v3/users => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:51:01.918824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d220366-848e-48f8-85d4-2429b9651ed5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:01.930198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d220366-848e-48f8-85d4-2429b9651ed5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:01.934829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7b2c4-ce31-46b8-a3f2-8e1258d0dbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:01.935528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7b2c4-ce31-46b8-a3f2-8e1258d0dbf9 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:01.935793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7b2c4-ce31-46b8-a3f2-8e1258d0dbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:01.936070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7b2c4-ce31-46b8-a3f2-8e1258d0dbf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:01.936780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7b2c4-ce31-46b8-a3f2-8e1258d0dbf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:01.938384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7b2c4-ce31-46b8-a3f2-8e1258d0dbf9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:01.949201 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4057/8050] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:51:01.953422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b0b72-0857-4c0e-bd7a-23e26fcddf64 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:01.964878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b0b72-0857-4c0e-bd7a-23e26fcddf64 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:01.969470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df7919-a53e-4cc0-87d1-181d59638565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:01.970348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df7919-a53e-4cc0-87d1-181d59638565 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:01.970628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df7919-a53e-4cc0-87d1-181d59638565 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:01.970902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df7919-a53e-4cc0-87d1-181d59638565 admin admin] PATH_INFO: `/v3/projects/c3634ca9f05f49a7ab05286b923c4a02/users/73651d06f7a84fb1af56b0da49992932/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:01.986553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df7919-a53e-4cc0-87d1-181d59638565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3634ca9f05f49a7ab05286b923c4a02, user_id=73651d06f7a84fb1af56b0da49992932, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:01.990220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df7919-a53e-4cc0-87d1-181d59638565 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:02.085458 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3994/8051] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:51:01 2022] PUT /identity/v3/projects/c3634ca9f05f49a7ab05286b923c4a02/users/73651d06f7a84fb1af56b0da49992932/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:51:02.089489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7b2c4-ce31-46b8-a3f2-8e1258d0dbf9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:02.101525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7b2c4-ce31-46b8-a3f2-8e1258d0dbf9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:02.159398 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e1df5-7acd-4457-912e-8048452f0218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:02.160060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e1df5-7acd-4457-912e-8048452f0218 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:02.160349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e1df5-7acd-4457-912e-8048452f0218 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:02.161176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e1df5-7acd-4457-912e-8048452f0218 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:02.161890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e1df5-7acd-4457-912e-8048452f0218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:02.163559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e1df5-7acd-4457-912e-8048452f0218 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:02.173613 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4058/8052] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:51:02.178516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df7919-a53e-4cc0-87d1-181d59638565 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:02.189150 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df7919-a53e-4cc0-87d1-181d59638565 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:02.194269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fc111-80a2-456f-adb6-5ec5c43db828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:02.195199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fc111-80a2-456f-adb6-5ec5c43db828 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:02.195485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fc111-80a2-456f-adb6-5ec5c43db828 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:02.195761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fc111-80a2-456f-adb6-5ec5c43db828 admin admin] PATH_INFO: `/v3/projects/c3634ca9f05f49a7ab05286b923c4a02/users/73651d06f7a84fb1af56b0da49992932/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:02.197781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fc111-80a2-456f-adb6-5ec5c43db828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3634ca9f05f49a7ab05286b923c4a02, user_id=73651d06f7a84fb1af56b0da49992932, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:02.200528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fc111-80a2-456f-adb6-5ec5c43db828 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:02.211844 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3995/8053] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:51:02 2022] PUT /identity/v3/projects/c3634ca9f05f49a7ab05286b923c4a02/users/73651d06f7a84fb1af56b0da49992932/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:51:02.221453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484aa83-82c6-42c8-990f-5bdf1782dd0b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:02.221749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484aa83-82c6-42c8-990f-5bdf1782dd0b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:02.222035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484aa83-82c6-42c8-990f-5bdf1782dd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:02.251468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9484aa83-82c6-42c8-990f-5bdf1782dd0b None None] MFA Rules not processed for user `73651d06f7a84fb1af56b0da49992932`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:02.252625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9484aa83-82c6-42c8-990f-5bdf1782dd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:02.322255 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4059/8054] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:51:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:51:02.333988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fc111-80a2-456f-adb6-5ec5c43db828 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:02.335691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6e4fc111-80a2-456f-adb6-5ec5c43db828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:02.358778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:02.397280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fc111-80a2-456f-adb6-5ec5c43db828 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:02.401882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5eedd2-9618-40fe-830b-c1b11dd5ff30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:02.402637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5eedd2-9618-40fe-830b-c1b11dd5ff30 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:02.402846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5eedd2-9618-40fe-830b-c1b11dd5ff30 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:02.403160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5eedd2-9618-40fe-830b-c1b11dd5ff30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:02.460439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5eedd2-9618-40fe-830b-c1b11dd5ff30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:02.461886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5eedd2-9618-40fe-830b-c1b11dd5ff30 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:02.471279 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3996/8055] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:51:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:51:12.319818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:12.467749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=39 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:12.618302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98d3b3-142c-45b1-bd93-7e1828b0a924 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:12.618595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98d3b3-142c-45b1-bd93-7e1828b0a924 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:12.618903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98d3b3-142c-45b1-bd93-7e1828b0a924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:12.638389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0d98d3b3-142c-45b1-bd93-7e1828b0a924 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:12.639619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0d98d3b3-142c-45b1-bd93-7e1828b0a924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:12.702617 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4060/8056] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:51:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:51:12.715511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5eedd2-9618-40fe-830b-c1b11dd5ff30 service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:12.716962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ca5eedd2-9618-40fe-830b-c1b11dd5ff30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:12.790382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5eedd2-9618-40fe-830b-c1b11dd5ff30 service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:12.795962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70142511-cf79-4c87-aa95-a5634f4c42fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:12.796618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70142511-cf79-4c87-aa95-a5634f4c42fc service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:12.796906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70142511-cf79-4c87-aa95-a5634f4c42fc service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:12.797186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70142511-cf79-4c87-aa95-a5634f4c42fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:12.806919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70142511-cf79-4c87-aa95-a5634f4c42fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:12.809616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70142511-cf79-4c87-aa95-a5634f4c42fc service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:12.820198 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3997/8057] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:51:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:51:12.906419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98d3b3-142c-45b1-bd93-7e1828b0a924 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:12.908402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0d98d3b3-142c-45b1-bd93-7e1828b0a924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:12.922022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98d3b3-142c-45b1-bd93-7e1828b0a924 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:12.925587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0ca88-73af-4004-a537-24b53bc75915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:12.926220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0ca88-73af-4004-a537-24b53bc75915 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:12.926504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0ca88-73af-4004-a537-24b53bc75915 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:12.926802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0ca88-73af-4004-a537-24b53bc75915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:12.938443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0ca88-73af-4004-a537-24b53bc75915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:12.940058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0ca88-73af-4004-a537-24b53bc75915 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:12.951196 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4061/8058] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:51:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:51:14.949661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70142511-cf79-4c87-aa95-a5634f4c42fc service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:14.951065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-70142511-cf79-4c87-aa95-a5634f4c42fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:15.034943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70142511-cf79-4c87-aa95-a5634f4c42fc service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:15.040731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a1de7-7c9c-459c-8aa1-8194bdd44b86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:15.041390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a1de7-7c9c-459c-8aa1-8194bdd44b86 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:15.041678 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a1de7-7c9c-459c-8aa1-8194bdd44b86 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:15.041963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a1de7-7c9c-459c-8aa1-8194bdd44b86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:15.043893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-871a1de7-7c9c-459c-8aa1-8194bdd44b86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:15.058795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a1de7-7c9c-459c-8aa1-8194bdd44b86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:15.060438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a1de7-7c9c-459c-8aa1-8194bdd44b86 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:15.073641 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3998/8059] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:51:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:51:15.185976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0ca88-73af-4004-a537-24b53bc75915 service cinder] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:15.187418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-94a0ca88-73af-4004-a537-24b53bc75915 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:15.248862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0ca88-73af-4004-a537-24b53bc75915 service cinder] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:15.252528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c542313-7fb7-4abc-b5b4-61aee73f01f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:15.253166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c542313-7fb7-4abc-b5b4-61aee73f01f0 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:15.253452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c542313-7fb7-4abc-b5b4-61aee73f01f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:15.253732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c542313-7fb7-4abc-b5b4-61aee73f01f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:15.255554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5c542313-7fb7-4abc-b5b4-61aee73f01f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:15.320760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c542313-7fb7-4abc-b5b4-61aee73f01f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:15.322205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c542313-7fb7-4abc-b5b4-61aee73f01f0 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:15.332585 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4062/8060] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:51:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:51:22.312521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a1de7-7c9c-459c-8aa1-8194bdd44b86 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:22.332969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a1de7-7c9c-459c-8aa1-8194bdd44b86 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:22.340622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659b83e-2f97-4fdc-b8ec-88f4ac957b9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:22.341540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659b83e-2f97-4fdc-b8ec-88f4ac957b9e service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:22.343129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659b83e-2f97-4fdc-b8ec-88f4ac957b9e service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:22.343612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659b83e-2f97-4fdc-b8ec-88f4ac957b9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:22.345764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d659b83e-2f97-4fdc-b8ec-88f4ac957b9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:22.369615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659b83e-2f97-4fdc-b8ec-88f4ac957b9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:22.376124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659b83e-2f97-4fdc-b8ec-88f4ac957b9e service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:22.388887 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 3999/8061] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:51:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:51:24.125430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c542313-7fb7-4abc-b5b4-61aee73f01f0 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:24.126985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5c542313-7fb7-4abc-b5b4-61aee73f01f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:24.140843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c542313-7fb7-4abc-b5b4-61aee73f01f0 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:24.145819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bf51a-d051-4e18-b0a0-45270f0285e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:24.146602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bf51a-d051-4e18-b0a0-45270f0285e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:24.146883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bf51a-d051-4e18-b0a0-45270f0285e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:24.147222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bf51a-d051-4e18-b0a0-45270f0285e2 admin admin] PATH_INFO: `/v3/users/001ed11a062a4cb08a52d1294ef5880b` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:24.148647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bf51a-d051-4e18-b0a0-45270f0285e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=001ed11a062a4cb08a52d1294ef5880b)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:24.152678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bf51a-d051-4e18-b0a0-45270f0285e2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:24.348319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:24.356706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-455bf51a-d051-4e18-b0a0-45270f0285e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '001ed11a062a4cb08a52d1294ef5880b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:24.363576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-455bf51a-d051-4e18-b0a0-45270f0285e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '001ed11a062a4cb08a52d1294ef5880b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:24.438716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-455bf51a-d051-4e18-b0a0-45270f0285e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '001ed11a062a4cb08a52d1294ef5880b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:24.439297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-455bf51a-d051-4e18-b0a0-45270f0285e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '001ed11a062a4cb08a52d1294ef5880b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:24.453483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-455bf51a-d051-4e18-b0a0-45270f0285e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '001ed11a062a4cb08a52d1294ef5880b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:24.459644 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4063/8062] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:51:24 2022] DELETE /identity/v3/users/001ed11a062a4cb08a52d1294ef5880b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:51:24.757343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659b83e-2f97-4fdc-b8ec-88f4ac957b9e service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:24.769608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659b83e-2f97-4fdc-b8ec-88f4ac957b9e service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:24.828600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:24.834554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f8c65-21f4-4414-bee7-0640299fc479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:24.835797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f8c65-21f4-4414-bee7-0640299fc479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:24.836128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f8c65-21f4-4414-bee7-0640299fc479 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:24.836409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f8c65-21f4-4414-bee7-0640299fc479 admin admin] PATH_INFO: `/v3/projects/8f296b14a61a4997bf411c9b0fdc39d5` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:24.837615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f8c65-21f4-4414-bee7-0640299fc479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f296b14a61a4997bf411c9b0fdc39d5)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:24.839562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f8c65-21f4-4414-bee7-0640299fc479 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:24.932252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6e3f8c65-21f4-4414-bee7-0640299fc479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f296b14a61a4997bf411c9b0fdc39d5', 'request_id': 'req-6e3f8c65-21f4-4414-bee7-0640299fc479'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:24.937856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6e3f8c65-21f4-4414-bee7-0640299fc479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f296b14a61a4997bf411c9b0fdc39d5', 'request_id': 'req-6e3f8c65-21f4-4414-bee7-0640299fc479'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:24.944971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6e3f8c65-21f4-4414-bee7-0640299fc479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f296b14a61a4997bf411c9b0fdc39d5', 'request_id': 'req-6e3f8c65-21f4-4414-bee7-0640299fc479'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:25.022426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6e3f8c65-21f4-4414-bee7-0640299fc479 admin admin] The token cache is being invalidate because project 8f296b14a61a4997bf411c9b0fdc39d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:51:25.022758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6e3f8c65-21f4-4414-bee7-0640299fc479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:25.023454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6e3f8c65-21f4-4414-bee7-0640299fc479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:25.028032 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4000/8063] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:51:24 2022] DELETE /identity/v3/projects/8f296b14a61a4997bf411c9b0fdc39d5 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:51:25.029163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bf51a-d051-4e18-b0a0-45270f0285e2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:25.030575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-455bf51a-d051-4e18-b0a0-45270f0285e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:25.044710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bf51a-d051-4e18-b0a0-45270f0285e2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:25.100141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1daa9a-5acb-46a3-beba-e0139309cbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:25.101637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1daa9a-5acb-46a3-beba-e0139309cbc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:25.101922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1daa9a-5acb-46a3-beba-e0139309cbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:25.102199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1daa9a-5acb-46a3-beba-e0139309cbc3 admin admin] PATH_INFO: `/v3/users/cae2f313a57b4684a9330a80185cf651` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:25.103431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1daa9a-5acb-46a3-beba-e0139309cbc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cae2f313a57b4684a9330a80185cf651)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:25.105362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1daa9a-5acb-46a3-beba-e0139309cbc3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:25.356612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5f1daa9a-5acb-46a3-beba-e0139309cbc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cae2f313a57b4684a9330a80185cf651'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:25.364331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5f1daa9a-5acb-46a3-beba-e0139309cbc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cae2f313a57b4684a9330a80185cf651'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:25.451128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5f1daa9a-5acb-46a3-beba-e0139309cbc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cae2f313a57b4684a9330a80185cf651'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:25.451945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5f1daa9a-5acb-46a3-beba-e0139309cbc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cae2f313a57b4684a9330a80185cf651'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:25.468560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5f1daa9a-5acb-46a3-beba-e0139309cbc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cae2f313a57b4684a9330a80185cf651'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:25.476666 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4064/8064] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:51:25 2022] DELETE /identity/v3/users/cae2f313a57b4684a9330a80185cf651 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:51:25.761323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f8c65-21f4-4414-bee7-0640299fc479 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:25.763072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6e3f8c65-21f4-4414-bee7-0640299fc479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:25.784260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f8c65-21f4-4414-bee7-0640299fc479 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:25.852360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9285a-17d2-4ad5-b42d-1c8f31cbad9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:25.853222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9285a-17d2-4ad5-b42d-1c8f31cbad9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:25.853506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9285a-17d2-4ad5-b42d-1c8f31cbad9e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:25.853785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9285a-17d2-4ad5-b42d-1c8f31cbad9e admin admin] PATH_INFO: `/v3/projects/ab3f86df8ada4e308b248aa543a47a9b` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:25.854962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9285a-17d2-4ad5-b42d-1c8f31cbad9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab3f86df8ada4e308b248aa543a47a9b)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:25.856892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9285a-17d2-4ad5-b42d-1c8f31cbad9e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:25.984317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7ab9285a-17d2-4ad5-b42d-1c8f31cbad9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab3f86df8ada4e308b248aa543a47a9b', 'request_id': 'req-7ab9285a-17d2-4ad5-b42d-1c8f31cbad9e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:25.992076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7ab9285a-17d2-4ad5-b42d-1c8f31cbad9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab3f86df8ada4e308b248aa543a47a9b', 'request_id': 'req-7ab9285a-17d2-4ad5-b42d-1c8f31cbad9e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:25.999335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7ab9285a-17d2-4ad5-b42d-1c8f31cbad9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab3f86df8ada4e308b248aa543a47a9b', 'request_id': 'req-7ab9285a-17d2-4ad5-b42d-1c8f31cbad9e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:26.092689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7ab9285a-17d2-4ad5-b42d-1c8f31cbad9e admin admin] The token cache is being invalidate because project ab3f86df8ada4e308b248aa543a47a9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:51:26.092992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7ab9285a-17d2-4ad5-b42d-1c8f31cbad9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:26.093667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7ab9285a-17d2-4ad5-b42d-1c8f31cbad9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:26.095444 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4001/8065] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:51:25 2022] DELETE /identity/v3/projects/ab3f86df8ada4e308b248aa543a47a9b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:51:26.494791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1daa9a-5acb-46a3-beba-e0139309cbc3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:26.496749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5f1daa9a-5acb-46a3-beba-e0139309cbc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:26.540301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:26.581486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1daa9a-5acb-46a3-beba-e0139309cbc3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:26.653267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a841acb-a294-4774-8d0f-1470cf4cb2e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:26.653952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a841acb-a294-4774-8d0f-1470cf4cb2e1 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:26.654234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a841acb-a294-4774-8d0f-1470cf4cb2e1 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:26.654511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a841acb-a294-4774-8d0f-1470cf4cb2e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:26.656360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1a841acb-a294-4774-8d0f-1470cf4cb2e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:26.670796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a841acb-a294-4774-8d0f-1470cf4cb2e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:26.672412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a841acb-a294-4774-8d0f-1470cf4cb2e1 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:26.685430 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4065/8066] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:51:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:51:30.673005 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9285a-17d2-4ad5-b42d-1c8f31cbad9e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:30.674434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7ab9285a-17d2-4ad5-b42d-1c8f31cbad9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:30.694864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:30.740512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9285a-17d2-4ad5-b42d-1c8f31cbad9e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:30.746079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda9649-30aa-4961-ae85-93b266d88a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:30.746962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda9649-30aa-4961-ae85-93b266d88a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:30.747271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda9649-30aa-4961-ae85-93b266d88a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:30.747549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda9649-30aa-4961-ae85-93b266d88a75 admin admin] PATH_INFO: `/v3/users/11b7995709444537bc26f9feed8e1288` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:30.748756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda9649-30aa-4961-ae85-93b266d88a75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11b7995709444537bc26f9feed8e1288)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:30.750734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda9649-30aa-4961-ae85-93b266d88a75 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:30.928543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bcda9649-30aa-4961-ae85-93b266d88a75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11b7995709444537bc26f9feed8e1288'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:30.945021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bcda9649-30aa-4961-ae85-93b266d88a75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11b7995709444537bc26f9feed8e1288'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:31.035365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bcda9649-30aa-4961-ae85-93b266d88a75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11b7995709444537bc26f9feed8e1288'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:31.043906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bcda9649-30aa-4961-ae85-93b266d88a75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11b7995709444537bc26f9feed8e1288'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:31.044620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bcda9649-30aa-4961-ae85-93b266d88a75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11b7995709444537bc26f9feed8e1288'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:31.051491 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4002/8067] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:51:30 2022] DELETE /identity/v3/users/11b7995709444537bc26f9feed8e1288 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:51:31.056241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570ae88-8d46-4d11-81cc-8b969a1df0c0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:31.056719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570ae88-8d46-4d11-81cc-8b969a1df0c0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:31.060471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570ae88-8d46-4d11-81cc-8b969a1df0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:31.075662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6570ae88-8d46-4d11-81cc-8b969a1df0c0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:31.077006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6570ae88-8d46-4d11-81cc-8b969a1df0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:31.138422 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4066/8068] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:51:31.149094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda9649-30aa-4961-ae85-93b266d88a75 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:31.150535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bcda9649-30aa-4961-ae85-93b266d88a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:31.210546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda9649-30aa-4961-ae85-93b266d88a75 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:31.214325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff6397-b9dd-4aab-9e91-99a3fdc5ae56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:31.214988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff6397-b9dd-4aab-9e91-99a3fdc5ae56 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:31.215342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff6397-b9dd-4aab-9e91-99a3fdc5ae56 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:31.215628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff6397-b9dd-4aab-9e91-99a3fdc5ae56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:31.225897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff6397-b9dd-4aab-9e91-99a3fdc5ae56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:31.227538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff6397-b9dd-4aab-9e91-99a3fdc5ae56 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:31.237749 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4003/8069] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:51:31.704884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570ae88-8d46-4d11-81cc-8b969a1df0c0 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:31.707241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6570ae88-8d46-4d11-81cc-8b969a1df0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:31.725166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570ae88-8d46-4d11-81cc-8b969a1df0c0 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:31.731264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d584c1-4a72-4b28-9059-5cd4594f69d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:31.732147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d584c1-4a72-4b28-9059-5cd4594f69d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:31.732673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d584c1-4a72-4b28-9059-5cd4594f69d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:31.733064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d584c1-4a72-4b28-9059-5cd4594f69d4 admin admin] PATH_INFO: `/v3/projects/5796a2bbfe294f219152381b3d3e98f6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:31.734461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d584c1-4a72-4b28-9059-5cd4594f69d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5796a2bbfe294f219152381b3d3e98f6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:31.736609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d584c1-4a72-4b28-9059-5cd4594f69d4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:31.884720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f6d584c1-4a72-4b28-9059-5cd4594f69d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5796a2bbfe294f219152381b3d3e98f6', 'request_id': 'req-f6d584c1-4a72-4b28-9059-5cd4594f69d4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:31.895826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f6d584c1-4a72-4b28-9059-5cd4594f69d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5796a2bbfe294f219152381b3d3e98f6', 'request_id': 'req-f6d584c1-4a72-4b28-9059-5cd4594f69d4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:31.902714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:31.904220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f6d584c1-4a72-4b28-9059-5cd4594f69d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5796a2bbfe294f219152381b3d3e98f6', 'request_id': 'req-f6d584c1-4a72-4b28-9059-5cd4594f69d4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:31.970884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f6d584c1-4a72-4b28-9059-5cd4594f69d4 admin admin] The token cache is being invalidate because project 5796a2bbfe294f219152381b3d3e98f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:51:31.971444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f6d584c1-4a72-4b28-9059-5cd4594f69d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:31.972235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f6d584c1-4a72-4b28-9059-5cd4594f69d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:31.974965 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4067/8070] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:51:31 2022] DELETE /identity/v3/projects/5796a2bbfe294f219152381b3d3e98f6 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:51:31.978988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff6397-b9dd-4aab-9e91-99a3fdc5ae56 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:31.990434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff6397-b9dd-4aab-9e91-99a3fdc5ae56 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:32.032422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:32.050723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7871826-1834-4990-8ea4-fa971145a9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:32.051668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7871826-1834-4990-8ea4-fa971145a9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:32.051954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7871826-1834-4990-8ea4-fa971145a9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:32.053525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7871826-1834-4990-8ea4-fa971145a9e8 admin admin] PATH_INFO: `/v3/users/73651d06f7a84fb1af56b0da49992932` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:32.053525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7871826-1834-4990-8ea4-fa971145a9e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73651d06f7a84fb1af56b0da49992932)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:32.055612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7871826-1834-4990-8ea4-fa971145a9e8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:32.285432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e7871826-1834-4990-8ea4-fa971145a9e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73651d06f7a84fb1af56b0da49992932'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:32.299041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e7871826-1834-4990-8ea4-fa971145a9e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73651d06f7a84fb1af56b0da49992932'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:32.387111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e7871826-1834-4990-8ea4-fa971145a9e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73651d06f7a84fb1af56b0da49992932'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:32.397311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e7871826-1834-4990-8ea4-fa971145a9e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73651d06f7a84fb1af56b0da49992932'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:32.403529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e7871826-1834-4990-8ea4-fa971145a9e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73651d06f7a84fb1af56b0da49992932'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:32.411387 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4004/8071] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:51:31 2022] DELETE /identity/v3/users/73651d06f7a84fb1af56b0da49992932 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:51:32.881391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d584c1-4a72-4b28-9059-5cd4594f69d4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:32.882991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f6d584c1-4a72-4b28-9059-5cd4594f69d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:32.906600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d584c1-4a72-4b28-9059-5cd4594f69d4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:32.970750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544a6b7-20cf-4276-8863-b63615a45425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:32.971724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544a6b7-20cf-4276-8863-b63615a45425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:32.972081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544a6b7-20cf-4276-8863-b63615a45425 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:32.972426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544a6b7-20cf-4276-8863-b63615a45425 admin admin] PATH_INFO: `/v3/projects/c3634ca9f05f49a7ab05286b923c4a02` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:32.973956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544a6b7-20cf-4276-8863-b63615a45425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3634ca9f05f49a7ab05286b923c4a02)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:32.976782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544a6b7-20cf-4276-8863-b63615a45425 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:33.110487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a544a6b7-20cf-4276-8863-b63615a45425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3634ca9f05f49a7ab05286b923c4a02', 'request_id': 'req-a544a6b7-20cf-4276-8863-b63615a45425'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:33.116890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a544a6b7-20cf-4276-8863-b63615a45425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3634ca9f05f49a7ab05286b923c4a02', 'request_id': 'req-a544a6b7-20cf-4276-8863-b63615a45425'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:33.122864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a544a6b7-20cf-4276-8863-b63615a45425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3634ca9f05f49a7ab05286b923c4a02', 'request_id': 'req-a544a6b7-20cf-4276-8863-b63615a45425'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:33.223360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a544a6b7-20cf-4276-8863-b63615a45425 admin admin] The token cache is being invalidate because project c3634ca9f05f49a7ab05286b923c4a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:51:33.223897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a544a6b7-20cf-4276-8863-b63615a45425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:33.224553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a544a6b7-20cf-4276-8863-b63615a45425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:33.227196 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4068/8072] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:51:32 2022] DELETE /identity/v3/projects/c3634ca9f05f49a7ab05286b923c4a02 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:51:33.233300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8fc7d-addf-47db-abc6-5a2d45182889 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:33.233786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8fc7d-addf-47db-abc6-5a2d45182889 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:33.234026 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8fc7d-addf-47db-abc6-5a2d45182889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:33.252394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ebc8fc7d-addf-47db-abc6-5a2d45182889 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:33.253992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ebc8fc7d-addf-47db-abc6-5a2d45182889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:33.327921 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4005/8073] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:51:33.338676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b022e-23fa-4901-ae51-602cf49dcd53 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:33.339253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b022e-23fa-4901-ae51-602cf49dcd53 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:33.339533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b022e-23fa-4901-ae51-602cf49dcd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:33.359229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7b4b022e-23fa-4901-ae51-602cf49dcd53 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:33.360503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7b4b022e-23fa-4901-ae51-602cf49dcd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:33.368689 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4069/8074] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:51:33.373263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8fc7d-addf-47db-abc6-5a2d45182889 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:33.385306 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8fc7d-addf-47db-abc6-5a2d45182889 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:33.390596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c73ea4-aabe-4988-982e-0f90a1cecd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:33.391316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c73ea4-aabe-4988-982e-0f90a1cecd57 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:33.391596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c73ea4-aabe-4988-982e-0f90a1cecd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:33.392002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c73ea4-aabe-4988-982e-0f90a1cecd57 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:33.392702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c73ea4-aabe-4988-982e-0f90a1cecd57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:51:33.393107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c73ea4-aabe-4988-982e-0f90a1cecd57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:33.394739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c73ea4-aabe-4988-982e-0f90a1cecd57 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:33.411791 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4006/8075] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:51:33.413108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b022e-23fa-4901-ae51-602cf49dcd53 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:33.423131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b022e-23fa-4901-ae51-602cf49dcd53 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:33.427942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26734f0d-3f91-4a89-b4d1-d6bdff6c9185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:33.428857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26734f0d-3f91-4a89-b4d1-d6bdff6c9185 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:33.429214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26734f0d-3f91-4a89-b4d1-d6bdff6c9185 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:33.429561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26734f0d-3f91-4a89-b4d1-d6bdff6c9185 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:33.430361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26734f0d-3f91-4a89-b4d1-d6bdff6c9185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:33.432435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26734f0d-3f91-4a89-b4d1-d6bdff6c9185 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:33.501843 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4070/8076] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:51:33 2022] POST /identity/v3/projects => generated 377 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:51:33.506328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c73ea4-aabe-4988-982e-0f90a1cecd57 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:33.518835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c73ea4-aabe-4988-982e-0f90a1cecd57 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:33.571768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:33.591824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656af8b-af80-405d-a309-c0943a6cecce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:33.592505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656af8b-af80-405d-a309-c0943a6cecce admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:33.592815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656af8b-af80-405d-a309-c0943a6cecce admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:33.593095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656af8b-af80-405d-a309-c0943a6cecce admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:33.593838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656af8b-af80-405d-a309-c0943a6cecce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:33.595917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656af8b-af80-405d-a309-c0943a6cecce admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:33.674414 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4007/8077] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:51:33 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:51:33.679299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26734f0d-3f91-4a89-b4d1-d6bdff6c9185 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:33.690712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26734f0d-3f91-4a89-b4d1-d6bdff6c9185 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:33.699661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bab66c-1bf0-40ea-bc5c-151624be36cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:33.707807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bab66c-1bf0-40ea-bc5c-151624be36cd admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:33.707807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bab66c-1bf0-40ea-bc5c-151624be36cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:33.707807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bab66c-1bf0-40ea-bc5c-151624be36cd admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:33.707807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bab66c-1bf0-40ea-bc5c-151624be36cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:33.707807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bab66c-1bf0-40ea-bc5c-151624be36cd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:33.708228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656af8b-af80-405d-a309-c0943a6cecce admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:33.708228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1656af8b-af80-405d-a309-c0943a6cecce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:33.716430 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4071/8078] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:51:33.720600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bab66c-1bf0-40ea-bc5c-151624be36cd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:33.731927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bab66c-1bf0-40ea-bc5c-151624be36cd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:33.737161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34de21b-ba7c-4847-9d86-d46de244357a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:33.737926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34de21b-ba7c-4847-9d86-d46de244357a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:33.738280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34de21b-ba7c-4847-9d86-d46de244357a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:33.738618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34de21b-ba7c-4847-9d86-d46de244357a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:33.740407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34de21b-ba7c-4847-9d86-d46de244357a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:33.741745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34de21b-ba7c-4847-9d86-d46de244357a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:33.757454 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4072/8079] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:51:33.758663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34de21b-ba7c-4847-9d86-d46de244357a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:33.775589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34de21b-ba7c-4847-9d86-d46de244357a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:33.779562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656af8b-af80-405d-a309-c0943a6cecce admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:33.781368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab85a1-b1b4-42da-af51-3b9855d9bc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:33.782505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab85a1-b1b4-42da-af51-3b9855d9bc53 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:33.782794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab85a1-b1b4-42da-af51-3b9855d9bc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:33.783098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab85a1-b1b4-42da-af51-3b9855d9bc53 admin admin] PATH_INFO: `/v3/projects/aa3a23b299de4c0184811e7e28976390/users/48cd7a9abfbc4849ba4ac5fe581b5ec5/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:33.784254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849afb15-bc6c-4709-aeb2-57ac184ea46c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:33.784904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849afb15-bc6c-4709-aeb2-57ac184ea46c service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:33.785190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849afb15-bc6c-4709-aeb2-57ac184ea46c service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:33.785476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849afb15-bc6c-4709-aeb2-57ac184ea46c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:33.787363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-849afb15-bc6c-4709-aeb2-57ac184ea46c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:33.800068 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab85a1-b1b4-42da-af51-3b9855d9bc53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3a23b299de4c0184811e7e28976390, user_id=48cd7a9abfbc4849ba4ac5fe581b5ec5, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:33.800497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849afb15-bc6c-4709-aeb2-57ac184ea46c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:33.801922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849afb15-bc6c-4709-aeb2-57ac184ea46c service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:33.802835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab85a1-b1b4-42da-af51-3b9855d9bc53 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:33.812893 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4008/8080] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:51:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:51:33.876384 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4073/8081] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:51:33 2022] PUT /identity/v3/projects/aa3a23b299de4c0184811e7e28976390/users/48cd7a9abfbc4849ba4ac5fe581b5ec5/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:51:33.892047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a8f81-ad15-4739-ad27-357f2cfed782 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:33.892535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a8f81-ad15-4739-ad27-357f2cfed782 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:33.892829 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a8f81-ad15-4739-ad27-357f2cfed782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:33.922663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b86a8f81-ad15-4739-ad27-357f2cfed782 None None] MFA Rules not processed for user `48cd7a9abfbc4849ba4ac5fe581b5ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:33.924361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b86a8f81-ad15-4739-ad27-357f2cfed782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:34.004208 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4009/8082] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:51:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:51:34.018856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab85a1-b1b4-42da-af51-3b9855d9bc53 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:34.020736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8aab85a1-b1b4-42da-af51-3b9855d9bc53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:34.028940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:34.099497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab85a1-b1b4-42da-af51-3b9855d9bc53 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:34.104489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a21e5-4ff5-45a2-995c-e9f1607e6d88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:34.105157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a21e5-4ff5-45a2-995c-e9f1607e6d88 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:34.105437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a21e5-4ff5-45a2-995c-e9f1607e6d88 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:34.105714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a21e5-4ff5-45a2-995c-e9f1607e6d88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:34.117064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a21e5-4ff5-45a2-995c-e9f1607e6d88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:34.118564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a21e5-4ff5-45a2-995c-e9f1607e6d88 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:34.130543 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4074/8083] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:51:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:51:37.790404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a8f81-ad15-4739-ad27-357f2cfed782 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:37.792697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b86a8f81-ad15-4739-ad27-357f2cfed782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:37.863287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a8f81-ad15-4739-ad27-357f2cfed782 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:37.868296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e1b8c-25a6-4004-bee1-61e9580c9c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:37.869160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e1b8c-25a6-4004-bee1-61e9580c9c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:37.869439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e1b8c-25a6-4004-bee1-61e9580c9c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:37.869712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e1b8c-25a6-4004-bee1-61e9580c9c3a admin admin] PATH_INFO: `/v3/users/cfe293b9ed3645229bed5ef8ce17cfec` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:37.870918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e1b8c-25a6-4004-bee1-61e9580c9c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe293b9ed3645229bed5ef8ce17cfec)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:37.873013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e1b8c-25a6-4004-bee1-61e9580c9c3a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:37.884462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:38.095827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-325e1b8c-25a6-4004-bee1-61e9580c9c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe293b9ed3645229bed5ef8ce17cfec'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:38.108271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-325e1b8c-25a6-4004-bee1-61e9580c9c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe293b9ed3645229bed5ef8ce17cfec'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:38.200475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-325e1b8c-25a6-4004-bee1-61e9580c9c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe293b9ed3645229bed5ef8ce17cfec'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:38.207964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-325e1b8c-25a6-4004-bee1-61e9580c9c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe293b9ed3645229bed5ef8ce17cfec'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:38.208601 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-325e1b8c-25a6-4004-bee1-61e9580c9c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe293b9ed3645229bed5ef8ce17cfec'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:38.215464 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4010/8084] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:51:37 2022] DELETE /identity/v3/users/cfe293b9ed3645229bed5ef8ce17cfec => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:51:38.438346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a21e5-4ff5-45a2-995c-e9f1607e6d88 service cinder] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:38.457792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a21e5-4ff5-45a2-995c-e9f1607e6d88 service cinder] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:38.525479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d369f2a-1f53-490a-9d19-88da4d8029ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:38.526471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d369f2a-1f53-490a-9d19-88da4d8029ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:38.526761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d369f2a-1f53-490a-9d19-88da4d8029ab admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:38.527175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d369f2a-1f53-490a-9d19-88da4d8029ab admin admin] PATH_INFO: `/v3/projects/1e7cd69b8ddd4aceb45a4aaacdfccea7` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:38.529723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d369f2a-1f53-490a-9d19-88da4d8029ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e7cd69b8ddd4aceb45a4aaacdfccea7)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:38.531942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d369f2a-1f53-490a-9d19-88da4d8029ab admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:38.668197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d369f2a-1f53-490a-9d19-88da4d8029ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e7cd69b8ddd4aceb45a4aaacdfccea7', 'request_id': 'req-3d369f2a-1f53-490a-9d19-88da4d8029ab'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:38.675101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d369f2a-1f53-490a-9d19-88da4d8029ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e7cd69b8ddd4aceb45a4aaacdfccea7', 'request_id': 'req-3d369f2a-1f53-490a-9d19-88da4d8029ab'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:38.680952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d369f2a-1f53-490a-9d19-88da4d8029ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e7cd69b8ddd4aceb45a4aaacdfccea7', 'request_id': 'req-3d369f2a-1f53-490a-9d19-88da4d8029ab'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:38.769715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d369f2a-1f53-490a-9d19-88da4d8029ab admin admin] The token cache is being invalidate because project 1e7cd69b8ddd4aceb45a4aaacdfccea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:51:38.770007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d369f2a-1f53-490a-9d19-88da4d8029ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:38.770647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3d369f2a-1f53-490a-9d19-88da4d8029ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:38.773128 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4075/8085] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:51:38 2022] DELETE /identity/v3/projects/1e7cd69b8ddd4aceb45a4aaacdfccea7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:51:38.778280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9176a57-f819-4961-ba08-a5e4f24c950e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:38.778574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9176a57-f819-4961-ba08-a5e4f24c950e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:38.778880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9176a57-f819-4961-ba08-a5e4f24c950e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:38.797437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e9176a57-f819-4961-ba08-a5e4f24c950e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:38.798663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e9176a57-f819-4961-ba08-a5e4f24c950e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:38.861812 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4011/8086] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:51:38.870151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81862897-c11a-4a1e-80e9-63ea2a39c891 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:38.870475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81862897-c11a-4a1e-80e9-63ea2a39c891 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:38.870759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81862897-c11a-4a1e-80e9-63ea2a39c891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:38.889785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-81862897-c11a-4a1e-80e9-63ea2a39c891 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:38.890982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-81862897-c11a-4a1e-80e9-63ea2a39c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:38.899476 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4076/8087] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:51:38.904002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9176a57-f819-4961-ba08-a5e4f24c950e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:38.914833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9176a57-f819-4961-ba08-a5e4f24c950e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:38.920869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa393bf1-857e-4485-ba09-2934eddef9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:38.920869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa393bf1-857e-4485-ba09-2934eddef9da admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:38.920869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa393bf1-857e-4485-ba09-2934eddef9da admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:38.920869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa393bf1-857e-4485-ba09-2934eddef9da admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:38.921711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa393bf1-857e-4485-ba09-2934eddef9da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:51:38.922024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa393bf1-857e-4485-ba09-2934eddef9da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:38.923648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa393bf1-857e-4485-ba09-2934eddef9da admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:38.938925 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4012/8088] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:51:38.940140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81862897-c11a-4a1e-80e9-63ea2a39c891 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:38.950019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81862897-c11a-4a1e-80e9-63ea2a39c891 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:38.954778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd81b19-61af-457a-ac0d-ba6fab4c960b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:38.955451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd81b19-61af-457a-ac0d-ba6fab4c960b admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:38.955792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd81b19-61af-457a-ac0d-ba6fab4c960b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:38.956076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd81b19-61af-457a-ac0d-ba6fab4c960b admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:38.956765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd81b19-61af-457a-ac0d-ba6fab4c960b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:38.958678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd81b19-61af-457a-ac0d-ba6fab4c960b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:39.300750 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4077/8089] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:51:38 2022] POST /identity/v3/projects => generated 397 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:51:39.300881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa393bf1-857e-4485-ba09-2934eddef9da admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:39.300881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa393bf1-857e-4485-ba09-2934eddef9da admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:39.300881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8806f4b-320f-4efe-97a2-5f6a8f444b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:39.300881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8806f4b-320f-4efe-97a2-5f6a8f444b13 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:39.301215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8806f4b-320f-4efe-97a2-5f6a8f444b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:39.301215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8806f4b-320f-4efe-97a2-5f6a8f444b13 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:39.301215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8806f4b-320f-4efe-97a2-5f6a8f444b13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:39.301215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8806f4b-320f-4efe-97a2-5f6a8f444b13 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:39.376776 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4013/8090] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:51:39 2022] POST /identity/v3/users => generated 299 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:51:39.401098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd81b19-61af-457a-ac0d-ba6fab4c960b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:39.412625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd81b19-61af-457a-ac0d-ba6fab4c960b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:39.417520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05af8b-e48b-4b90-9705-237f19631230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:39.418170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05af8b-e48b-4b90-9705-237f19631230 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:39.418519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05af8b-e48b-4b90-9705-237f19631230 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:39.418792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05af8b-e48b-4b90-9705-237f19631230 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:39.419634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05af8b-e48b-4b90-9705-237f19631230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:39.421297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05af8b-e48b-4b90-9705-237f19631230 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:39.423437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:39.432655 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4078/8091] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:51:39.436881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8806f4b-320f-4efe-97a2-5f6a8f444b13 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:39.444423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:39.448841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8806f4b-320f-4efe-97a2-5f6a8f444b13 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:39.453692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049749bc-52ba-4dc5-802e-631a6e5c7a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:39.454357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049749bc-52ba-4dc5-802e-631a6e5c7a37 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:39.454645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049749bc-52ba-4dc5-802e-631a6e5c7a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:39.454928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049749bc-52ba-4dc5-802e-631a6e5c7a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:39.455690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049749bc-52ba-4dc5-802e-631a6e5c7a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:39.457291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049749bc-52ba-4dc5-802e-631a6e5c7a37 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:39.468624 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4014/8092] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:51:39.473147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05af8b-e48b-4b90-9705-237f19631230 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:39.483575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05af8b-e48b-4b90-9705-237f19631230 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:39.488390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb119907-cdb1-4f32-bc29-56c0d91a0554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:39.489268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb119907-cdb1-4f32-bc29-56c0d91a0554 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:39.489552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb119907-cdb1-4f32-bc29-56c0d91a0554 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:39.489827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb119907-cdb1-4f32-bc29-56c0d91a0554 admin admin] PATH_INFO: `/v3/projects/ecb79581f83f46f6a02fba932e20f3fe/users/8d3cada15a55453faaf23a147c44afcf/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:39.504501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb119907-cdb1-4f32-bc29-56c0d91a0554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb79581f83f46f6a02fba932e20f3fe, user_id=8d3cada15a55453faaf23a147c44afcf, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:39.507803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb119907-cdb1-4f32-bc29-56c0d91a0554 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:39.595382 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4079/8093] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:51:39 2022] PUT /identity/v3/projects/ecb79581f83f46f6a02fba932e20f3fe/users/8d3cada15a55453faaf23a147c44afcf/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:51:39.601324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f6802-fd91-4db9-82c0-eb8d5ed42d23 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:39.601557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f6802-fd91-4db9-82c0-eb8d5ed42d23 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:39.601837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f6802-fd91-4db9-82c0-eb8d5ed42d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:39.620389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ae3f6802-fd91-4db9-82c0-eb8d5ed42d23 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:39.621605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ae3f6802-fd91-4db9-82c0-eb8d5ed42d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:39.681376 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4015/8094] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:51:39.691308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb119907-cdb1-4f32-bc29-56c0d91a0554 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:39.693034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fb119907-cdb1-4f32-bc29-56c0d91a0554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:39.754895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb119907-cdb1-4f32-bc29-56c0d91a0554 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:39.762156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54ce98-c509-4d0b-9ae0-b9c14d12c81c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:39.762816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54ce98-c509-4d0b-9ae0-b9c14d12c81c service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:39.763128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54ce98-c509-4d0b-9ae0-b9c14d12c81c service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:39.763469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54ce98-c509-4d0b-9ae0-b9c14d12c81c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:39.774162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54ce98-c509-4d0b-9ae0-b9c14d12c81c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:39.775806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54ce98-c509-4d0b-9ae0-b9c14d12c81c service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:39.785537 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4080/8095] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:51:45.366159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d81c3-d88a-47ee-a1bd-9932d8b75d43 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:45.366159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d81c3-d88a-47ee-a1bd-9932d8b75d43 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:45.366159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d81c3-d88a-47ee-a1bd-9932d8b75d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:45.392994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5a2d81c3-d88a-47ee-a1bd-9932d8b75d43 None None] MFA Rules not processed for user `8d3cada15a55453faaf23a147c44afcf`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:45.394840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5a2d81c3-d88a-47ee-a1bd-9932d8b75d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:45.473158 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4016/8096] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:51:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:51:45.487092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ac08e-8b4b-4b24-9f02-f96053211bfe None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:45.487634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ac08e-8b4b-4b24-9f02-f96053211bfe None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:45.488050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ac08e-8b4b-4b24-9f02-f96053211bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:45.515058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-045ac08e-8b4b-4b24-9f02-f96053211bfe None None] MFA Rules not processed for user `8d3cada15a55453faaf23a147c44afcf`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:45.516289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-045ac08e-8b4b-4b24-9f02-f96053211bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:45.524367 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4081/8097] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:51:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:51:45.538713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d81c3-d88a-47ee-a1bd-9932d8b75d43 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:45.540173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5a2d81c3-d88a-47ee-a1bd-9932d8b75d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:45.644160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d81c3-d88a-47ee-a1bd-9932d8b75d43 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:45.651316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f38ef0-5c70-44d7-a489-a3726327b9a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:45.652034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f38ef0-5c70-44d7-a489-a3726327b9a4 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:45.652321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f38ef0-5c70-44d7-a489-a3726327b9a4 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:45.653808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f38ef0-5c70-44d7-a489-a3726327b9a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:45.661092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f38ef0-5c70-44d7-a489-a3726327b9a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:45.663542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f38ef0-5c70-44d7-a489-a3726327b9a4 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:45.668241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:45.674033 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4017/8098] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:51:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:51:45.957028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ac08e-8b4b-4b24-9f02-f96053211bfe None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:45.958591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-045ac08e-8b4b-4b24-9f02-f96053211bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:45.975598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ac08e-8b4b-4b24-9f02-f96053211bfe None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:45.979290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c67fca-20e7-4039-b593-51e566322267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:45.980274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c67fca-20e7-4039-b593-51e566322267 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:45.980400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c67fca-20e7-4039-b593-51e566322267 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:45.980576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c67fca-20e7-4039-b593-51e566322267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:45.982391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-18c67fca-20e7-4039-b593-51e566322267 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:45.996126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c67fca-20e7-4039-b593-51e566322267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:45.998031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c67fca-20e7-4039-b593-51e566322267 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:46.009996 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4082/8099] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:51:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:51:46.478396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f38ef0-5c70-44d7-a489-a3726327b9a4 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:46.480240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c8f38ef0-5c70-44d7-a489-a3726327b9a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:46.575252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f38ef0-5c70-44d7-a489-a3726327b9a4 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:46.580719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb655f2a-eec2-4ae5-a111-65654b416bf8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:46.581381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb655f2a-eec2-4ae5-a111-65654b416bf8 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:46.581669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb655f2a-eec2-4ae5-a111-65654b416bf8 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:46.581969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb655f2a-eec2-4ae5-a111-65654b416bf8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:46.583795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bb655f2a-eec2-4ae5-a111-65654b416bf8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:46.599435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb655f2a-eec2-4ae5-a111-65654b416bf8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:46.601197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb655f2a-eec2-4ae5-a111-65654b416bf8 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:46.614936 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4018/8100] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:51:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:51:54.906675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c67fca-20e7-4039-b593-51e566322267 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:54.908105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-18c67fca-20e7-4039-b593-51e566322267 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:54.922899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c67fca-20e7-4039-b593-51e566322267 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:54.927677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b59dbd-c3cf-4e95-869a-aa0ced5b170d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:54.928533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b59dbd-c3cf-4e95-869a-aa0ced5b170d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:54.928821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b59dbd-c3cf-4e95-869a-aa0ced5b170d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:54.929175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b59dbd-c3cf-4e95-869a-aa0ced5b170d admin admin] PATH_INFO: `/v3/users/48cd7a9abfbc4849ba4ac5fe581b5ec5` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:54.930441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b59dbd-c3cf-4e95-869a-aa0ced5b170d admin admin] RBAC: Authorizing `identity:delete_user(user_id=48cd7a9abfbc4849ba4ac5fe581b5ec5)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:54.932407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b59dbd-c3cf-4e95-869a-aa0ced5b170d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:55.110644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51b59dbd-c3cf-4e95-869a-aa0ced5b170d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48cd7a9abfbc4849ba4ac5fe581b5ec5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:55.117757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51b59dbd-c3cf-4e95-869a-aa0ced5b170d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48cd7a9abfbc4849ba4ac5fe581b5ec5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:55.199964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51b59dbd-c3cf-4e95-869a-aa0ced5b170d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48cd7a9abfbc4849ba4ac5fe581b5ec5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:55.200588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51b59dbd-c3cf-4e95-869a-aa0ced5b170d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48cd7a9abfbc4849ba4ac5fe581b5ec5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:55.213925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51b59dbd-c3cf-4e95-869a-aa0ced5b170d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48cd7a9abfbc4849ba4ac5fe581b5ec5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:55.220065 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4083/8101] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:51:54 2022] DELETE /identity/v3/users/48cd7a9abfbc4849ba4ac5fe581b5ec5 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:51:55.224834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc669b25-4ad3-453b-abbb-8c5615a510db None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:55.225342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc669b25-4ad3-453b-abbb-8c5615a510db None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:55.225448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc669b25-4ad3-453b-abbb-8c5615a510db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:55.242693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-fc669b25-4ad3-453b-abbb-8c5615a510db None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:55.244057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fc669b25-4ad3-453b-abbb-8c5615a510db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:55.305602 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4019/8102] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:51:55.315724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b59dbd-c3cf-4e95-869a-aa0ced5b170d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:55.317107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-51b59dbd-c3cf-4e95-869a-aa0ced5b170d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:55.353231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:55.381268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b59dbd-c3cf-4e95-869a-aa0ced5b170d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:55.385879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863884c6-f9c5-4ac4-853a-fcda143ce76f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:55.386518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863884c6-f9c5-4ac4-853a-fcda143ce76f service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:55.386797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863884c6-f9c5-4ac4-853a-fcda143ce76f service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:55.388983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863884c6-f9c5-4ac4-853a-fcda143ce76f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:55.396346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863884c6-f9c5-4ac4-853a-fcda143ce76f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:55.398391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863884c6-f9c5-4ac4-853a-fcda143ce76f service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:55.408659 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4084/8103] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:51:55.848380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc669b25-4ad3-453b-abbb-8c5615a510db None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:55.858761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fc669b25-4ad3-453b-abbb-8c5615a510db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:55.869786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc669b25-4ad3-453b-abbb-8c5615a510db None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:55.874673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f624636-4b39-4147-9ade-e26fc26b6b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:55.875575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f624636-4b39-4147-9ade-e26fc26b6b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:55.875860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f624636-4b39-4147-9ade-e26fc26b6b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:55.876197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f624636-4b39-4147-9ade-e26fc26b6b1a admin admin] PATH_INFO: `/v3/projects/aa3a23b299de4c0184811e7e28976390` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:55.877484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f624636-4b39-4147-9ade-e26fc26b6b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa3a23b299de4c0184811e7e28976390)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:55.879461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f624636-4b39-4147-9ade-e26fc26b6b1a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:55.989429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8f624636-4b39-4147-9ade-e26fc26b6b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa3a23b299de4c0184811e7e28976390', 'request_id': 'req-8f624636-4b39-4147-9ade-e26fc26b6b1a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:55.995687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8f624636-4b39-4147-9ade-e26fc26b6b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa3a23b299de4c0184811e7e28976390', 'request_id': 'req-8f624636-4b39-4147-9ade-e26fc26b6b1a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:56.001933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8f624636-4b39-4147-9ade-e26fc26b6b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa3a23b299de4c0184811e7e28976390', 'request_id': 'req-8f624636-4b39-4147-9ade-e26fc26b6b1a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:56.065957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8f624636-4b39-4147-9ade-e26fc26b6b1a admin admin] The token cache is being invalidate because project aa3a23b299de4c0184811e7e28976390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:51:56.066249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8f624636-4b39-4147-9ade-e26fc26b6b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:56.066889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8f624636-4b39-4147-9ade-e26fc26b6b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:51:56.068490 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4020/8104] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:51:55 2022] DELETE /identity/v3/projects/aa3a23b299de4c0184811e7e28976390 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:51:56.073882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646893c-efd7-4f03-b181-432e824cc042 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:56.075899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646893c-efd7-4f03-b181-432e824cc042 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:56.075899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646893c-efd7-4f03-b181-432e824cc042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:56.093086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5646893c-efd7-4f03-b181-432e824cc042 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:56.094362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5646893c-efd7-4f03-b181-432e824cc042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:56.155833 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4085/8105] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:51:56.165423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb84df-7162-447c-87c2-f9aa58390c92 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:56.165713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb84df-7162-447c-87c2-f9aa58390c92 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:56.165990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb84df-7162-447c-87c2-f9aa58390c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:56.184575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-08eb84df-7162-447c-87c2-f9aa58390c92 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:56.185810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-08eb84df-7162-447c-87c2-f9aa58390c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:56.194354 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4021/8106] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:51:56.198797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646893c-efd7-4f03-b181-432e824cc042 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:56.209110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646893c-efd7-4f03-b181-432e824cc042 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:56.214402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74687d88-5786-4c9a-b80f-4b37b03d5094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:56.215146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74687d88-5786-4c9a-b80f-4b37b03d5094 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:56.215435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74687d88-5786-4c9a-b80f-4b37b03d5094 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:56.219255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74687d88-5786-4c9a-b80f-4b37b03d5094 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:56.219255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74687d88-5786-4c9a-b80f-4b37b03d5094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:51:56.219255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74687d88-5786-4c9a-b80f-4b37b03d5094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:56.219255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74687d88-5786-4c9a-b80f-4b37b03d5094 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:56.231776 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4086/8107] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:51:56.236282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb84df-7162-447c-87c2-f9aa58390c92 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:56.246160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb84df-7162-447c-87c2-f9aa58390c92 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:56.251223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18445e8-e195-450a-a1bc-7a554bbe58c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:56.251881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18445e8-e195-450a-a1bc-7a554bbe58c4 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:56.252182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18445e8-e195-450a-a1bc-7a554bbe58c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:56.252474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18445e8-e195-450a-a1bc-7a554bbe58c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:56.253189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18445e8-e195-450a-a1bc-7a554bbe58c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:56.255134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18445e8-e195-450a-a1bc-7a554bbe58c4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:56.258681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:56.403570 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4022/8108] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:51:56 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:51:56.405016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74687d88-5786-4c9a-b80f-4b37b03d5094 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:56.419822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74687d88-5786-4c9a-b80f-4b37b03d5094 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:56.487770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fa20f-9897-4be4-9685-fd0ea1eee8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:56.488704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fa20f-9897-4be4-9685-fd0ea1eee8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:56.489053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fa20f-9897-4be4-9685-fd0ea1eee8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:56.489343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fa20f-9897-4be4-9685-fd0ea1eee8b7 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:56.490044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fa20f-9897-4be4-9685-fd0ea1eee8b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:56.492183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fa20f-9897-4be4-9685-fd0ea1eee8b7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:56.594580 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4087/8109] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:51:56 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:51:56.599403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18445e8-e195-450a-a1bc-7a554bbe58c4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:56.609771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18445e8-e195-450a-a1bc-7a554bbe58c4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:56.614331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f24f3-2019-488d-a2cc-2558c7d92a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:56.614986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f24f3-2019-488d-a2cc-2558c7d92a3b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:56.615297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f24f3-2019-488d-a2cc-2558c7d92a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:56.615625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f24f3-2019-488d-a2cc-2558c7d92a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:56.616342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f24f3-2019-488d-a2cc-2558c7d92a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:56.617927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f24f3-2019-488d-a2cc-2558c7d92a3b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:56.627851 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4023/8110] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:51:56.632669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fa20f-9897-4be4-9685-fd0ea1eee8b7 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:56.643230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fa20f-9897-4be4-9685-fd0ea1eee8b7 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:56.648607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1eda3-f962-40fd-9f51-e702980c5ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:56.649294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1eda3-f962-40fd-9f51-e702980c5ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:56.649603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1eda3-f962-40fd-9f51-e702980c5ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:56.649880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1eda3-f962-40fd-9f51-e702980c5ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:56.650615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1eda3-f962-40fd-9f51-e702980c5ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:56.652311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1eda3-f962-40fd-9f51-e702980c5ed1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:56.662635 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4088/8111] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:51:56.666917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f24f3-2019-488d-a2cc-2558c7d92a3b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:56.676996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f24f3-2019-488d-a2cc-2558c7d92a3b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:56.681935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff351e2c-ffcb-40af-90fa-d048f7a3182f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:56.682807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff351e2c-ffcb-40af-90fa-d048f7a3182f admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:56.683132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff351e2c-ffcb-40af-90fa-d048f7a3182f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:56.683417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff351e2c-ffcb-40af-90fa-d048f7a3182f admin admin] PATH_INFO: `/v3/projects/cfcc318e041846c88bc6a62219974f28/users/b600e015a56e4daca812af298a194616/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:56.699700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff351e2c-ffcb-40af-90fa-d048f7a3182f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfcc318e041846c88bc6a62219974f28, user_id=b600e015a56e4daca812af298a194616, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:56.702426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff351e2c-ffcb-40af-90fa-d048f7a3182f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:56.789074 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4024/8112] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:51:56 2022] PUT /identity/v3/projects/cfcc318e041846c88bc6a62219974f28/users/b600e015a56e4daca812af298a194616/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:51:56.799680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57db57d-99e6-4d2a-b480-b85c82fb3fc0 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:56.799976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57db57d-99e6-4d2a-b480-b85c82fb3fc0 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:56.800257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57db57d-99e6-4d2a-b480-b85c82fb3fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:56.831708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a57db57d-99e6-4d2a-b480-b85c82fb3fc0 None None] MFA Rules not processed for user `b600e015a56e4daca812af298a194616`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:56.832948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a57db57d-99e6-4d2a-b480-b85c82fb3fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:56.859434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:51:56.905862 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4089/8113] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:51:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:51:56.917773 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff351e2c-ffcb-40af-90fa-d048f7a3182f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:51:56.919934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ff351e2c-ffcb-40af-90fa-d048f7a3182f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:56.982456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff351e2c-ffcb-40af-90fa-d048f7a3182f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:51:56.986297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d2b51-fa18-4732-829d-0302adf7f3bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:51:56.986970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d2b51-fa18-4732-829d-0302adf7f3bf service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:56.987283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d2b51-fa18-4732-829d-0302adf7f3bf service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:56.987560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d2b51-fa18-4732-829d-0302adf7f3bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:56.997243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d2b51-fa18-4732-829d-0302adf7f3bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:51:56.998695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d2b51-fa18-4732-829d-0302adf7f3bf service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:51:57.009322 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4025/8114] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:51:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:51:58.232620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690667c-b603-4067-9f7f-d6df215b9f54 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:58.233145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690667c-b603-4067-9f7f-d6df215b9f54 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:58.233145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690667c-b603-4067-9f7f-d6df215b9f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:58.252274 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1690667c-b603-4067-9f7f-d6df215b9f54 None None] MFA Rules not processed for user `8d3cada15a55453faaf23a147c44afcf`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:58.253463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1690667c-b603-4067-9f7f-d6df215b9f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:58.310088 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4090/8115] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:51:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:51:58.358112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b3943-7533-4f89-9088-15c383bc302f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:58.358599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b3943-7533-4f89-9088-15c383bc302f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:58.358714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b3943-7533-4f89-9088-15c383bc302f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:58.376265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-489b3943-7533-4f89-9088-15c383bc302f None None] MFA Rules not processed for user `8d3cada15a55453faaf23a147c44afcf`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:58.377475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-489b3943-7533-4f89-9088-15c383bc302f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:58.384591 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4026/8116] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:51:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:51:58.411320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27212da8-4676-4471-8439-bcb0ad28eed8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:58.411635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27212da8-4676-4471-8439-bcb0ad28eed8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:58.411935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27212da8-4676-4471-8439-bcb0ad28eed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:58.430070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-27212da8-4676-4471-8439-bcb0ad28eed8 None None] MFA Rules not processed for user `8d3cada15a55453faaf23a147c44afcf`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:58.431287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-27212da8-4676-4471-8439-bcb0ad28eed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:58.439302 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4091/8117] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:51:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:51:58.469900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ba5dd-4040-44f8-b91c-607acabecd30 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:58.470191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ba5dd-4040-44f8-b91c-607acabecd30 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:58.470467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ba5dd-4040-44f8-b91c-607acabecd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:58.489386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6b1ba5dd-4040-44f8-b91c-607acabecd30 None None] MFA Rules not processed for user `8d3cada15a55453faaf23a147c44afcf`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:58.490624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6b1ba5dd-4040-44f8-b91c-607acabecd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:58.498192 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4027/8118] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:51:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:51:58.521797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0025c94-03e5-412a-8d9a-3618816048a1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:51:58.522087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0025c94-03e5-412a-8d9a-3618816048a1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:51:58.522360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0025c94-03e5-412a-8d9a-3618816048a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:51:58.540080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c0025c94-03e5-412a-8d9a-3618816048a1 None None] MFA Rules not processed for user `8d3cada15a55453faaf23a147c44afcf`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:51:58.541259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c0025c94-03e5-412a-8d9a-3618816048a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:51:58.548428 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4092/8119] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:51:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:52:02.283843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ba5dd-4040-44f8-b91c-607acabecd30 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:02.345998 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ba5dd-4040-44f8-b91c-607acabecd30 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:02.350729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac37e3-7678-4881-9b2b-94baf87b4077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:02.351621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac37e3-7678-4881-9b2b-94baf87b4077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:02.351903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac37e3-7678-4881-9b2b-94baf87b4077 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:02.352179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac37e3-7678-4881-9b2b-94baf87b4077 admin admin] PATH_INFO: `/v3/users/b600e015a56e4daca812af298a194616` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:02.353354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac37e3-7678-4881-9b2b-94baf87b4077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b600e015a56e4daca812af298a194616)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:02.356278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac37e3-7678-4881-9b2b-94baf87b4077 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:02.568427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:02.574117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9fac37e3-7678-4881-9b2b-94baf87b4077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b600e015a56e4daca812af298a194616'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:02.587229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9fac37e3-7678-4881-9b2b-94baf87b4077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b600e015a56e4daca812af298a194616'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:02.679768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9fac37e3-7678-4881-9b2b-94baf87b4077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b600e015a56e4daca812af298a194616'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:02.687771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9fac37e3-7678-4881-9b2b-94baf87b4077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b600e015a56e4daca812af298a194616'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:02.688451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9fac37e3-7678-4881-9b2b-94baf87b4077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b600e015a56e4daca812af298a194616'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:02.694507 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4028/8120] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:52:02 2022] DELETE /identity/v3/users/b600e015a56e4daca812af298a194616 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:02.699750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09680a-77b2-4ab2-b672-f45ddbf5d45b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:02.700234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09680a-77b2-4ab2-b672-f45ddbf5d45b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:02.700326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09680a-77b2-4ab2-b672-f45ddbf5d45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:02.719848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ee09680a-77b2-4ab2-b672-f45ddbf5d45b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:02.721163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ee09680a-77b2-4ab2-b672-f45ddbf5d45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:02.785919 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4093/8121] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:02.796906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac37e3-7678-4881-9b2b-94baf87b4077 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:02.803066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9fac37e3-7678-4881-9b2b-94baf87b4077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:02.878541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac37e3-7678-4881-9b2b-94baf87b4077 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:02.882138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6864f29-2aaf-4614-be33-2c2ad8b30912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:02.882818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6864f29-2aaf-4614-be33-2c2ad8b30912 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:02.883126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6864f29-2aaf-4614-be33-2c2ad8b30912 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:02.883404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6864f29-2aaf-4614-be33-2c2ad8b30912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:02.892753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6864f29-2aaf-4614-be33-2c2ad8b30912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:02.894182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6864f29-2aaf-4614-be33-2c2ad8b30912 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:02.904560 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4029/8122] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:52:03.328140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09680a-77b2-4ab2-b672-f45ddbf5d45b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:03.329612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ee09680a-77b2-4ab2-b672-f45ddbf5d45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:03.342966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09680a-77b2-4ab2-b672-f45ddbf5d45b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:03.346928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d6820-0f59-458d-a4b9-c74ac44ba66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:03.348065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d6820-0f59-458d-a4b9-c74ac44ba66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:03.348341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d6820-0f59-458d-a4b9-c74ac44ba66d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:03.348608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d6820-0f59-458d-a4b9-c74ac44ba66d admin admin] PATH_INFO: `/v3/projects/cfcc318e041846c88bc6a62219974f28` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:03.349786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d6820-0f59-458d-a4b9-c74ac44ba66d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfcc318e041846c88bc6a62219974f28)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:03.351743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d6820-0f59-458d-a4b9-c74ac44ba66d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:03.476502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6e6d6820-0f59-458d-a4b9-c74ac44ba66d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfcc318e041846c88bc6a62219974f28', 'request_id': 'req-6e6d6820-0f59-458d-a4b9-c74ac44ba66d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:03.483803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6e6d6820-0f59-458d-a4b9-c74ac44ba66d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfcc318e041846c88bc6a62219974f28', 'request_id': 'req-6e6d6820-0f59-458d-a4b9-c74ac44ba66d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:03.485052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:03.490228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6e6d6820-0f59-458d-a4b9-c74ac44ba66d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfcc318e041846c88bc6a62219974f28', 'request_id': 'req-6e6d6820-0f59-458d-a4b9-c74ac44ba66d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:03.583729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6e6d6820-0f59-458d-a4b9-c74ac44ba66d admin admin] The token cache is being invalidate because project cfcc318e041846c88bc6a62219974f28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:03.584245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6e6d6820-0f59-458d-a4b9-c74ac44ba66d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:03.585056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6e6d6820-0f59-458d-a4b9-c74ac44ba66d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:03.599312 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4094/8123] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:03 2022] DELETE /identity/v3/projects/cfcc318e041846c88bc6a62219974f28 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:06.419250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6864f29-2aaf-4614-be33-2c2ad8b30912 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:06.420806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e6864f29-2aaf-4614-be33-2c2ad8b30912 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:06.434636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6864f29-2aaf-4614-be33-2c2ad8b30912 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:06.492385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bdefb2-2e80-4e3f-ad7d-37354d53aed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:06.493265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdefb2-2e80-4e3f-ad7d-37354d53aed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:06.493596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdefb2-2e80-4e3f-ad7d-37354d53aed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:06.493858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdefb2-2e80-4e3f-ad7d-37354d53aed1 admin admin] PATH_INFO: `/v3/users/8d3cada15a55453faaf23a147c44afcf` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:06.495694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bdefb2-2e80-4e3f-ad7d-37354d53aed1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d3cada15a55453faaf23a147c44afcf)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:06.497617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bdefb2-2e80-4e3f-ad7d-37354d53aed1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:06.733712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-45bdefb2-2e80-4e3f-ad7d-37354d53aed1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d3cada15a55453faaf23a147c44afcf'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:06.744599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:06.746774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-45bdefb2-2e80-4e3f-ad7d-37354d53aed1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d3cada15a55453faaf23a147c44afcf'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:06.832383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-45bdefb2-2e80-4e3f-ad7d-37354d53aed1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d3cada15a55453faaf23a147c44afcf'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:06.839946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-45bdefb2-2e80-4e3f-ad7d-37354d53aed1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d3cada15a55453faaf23a147c44afcf'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:06.840604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-45bdefb2-2e80-4e3f-ad7d-37354d53aed1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d3cada15a55453faaf23a147c44afcf'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:06.846608 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4030/8124] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:52:06 2022] DELETE /identity/v3/users/8d3cada15a55453faaf23a147c44afcf => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:07.115903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d6820-0f59-458d-a4b9-c74ac44ba66d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:07.117481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6e6d6820-0f59-458d-a4b9-c74ac44ba66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:07.133575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d6820-0f59-458d-a4b9-c74ac44ba66d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:07.191076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7a97a-87ef-444e-bfd6-77b5aabf2037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:07.191932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7a97a-87ef-444e-bfd6-77b5aabf2037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:07.192218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7a97a-87ef-444e-bfd6-77b5aabf2037 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:07.192497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7a97a-87ef-444e-bfd6-77b5aabf2037 admin admin] PATH_INFO: `/v3/projects/ecb79581f83f46f6a02fba932e20f3fe` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:07.193683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7a97a-87ef-444e-bfd6-77b5aabf2037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecb79581f83f46f6a02fba932e20f3fe)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:07.195657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7a97a-87ef-444e-bfd6-77b5aabf2037 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:07.331621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-10b7a97a-87ef-444e-bfd6-77b5aabf2037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecb79581f83f46f6a02fba932e20f3fe', 'request_id': 'req-10b7a97a-87ef-444e-bfd6-77b5aabf2037'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:07.337790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-10b7a97a-87ef-444e-bfd6-77b5aabf2037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecb79581f83f46f6a02fba932e20f3fe', 'request_id': 'req-10b7a97a-87ef-444e-bfd6-77b5aabf2037'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:07.343974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-10b7a97a-87ef-444e-bfd6-77b5aabf2037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecb79581f83f46f6a02fba932e20f3fe', 'request_id': 'req-10b7a97a-87ef-444e-bfd6-77b5aabf2037'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:07.410599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-10b7a97a-87ef-444e-bfd6-77b5aabf2037 admin admin] The token cache is being invalidate because project ecb79581f83f46f6a02fba932e20f3fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:07.410815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-10b7a97a-87ef-444e-bfd6-77b5aabf2037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:07.411482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-10b7a97a-87ef-444e-bfd6-77b5aabf2037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:07.413046 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4095/8125] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:07 2022] DELETE /identity/v3/projects/ecb79581f83f46f6a02fba932e20f3fe => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:07.420775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f0b67-5e1e-401e-8591-b8a5ab00896a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:07.421240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f0b67-5e1e-401e-8591-b8a5ab00896a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:07.421240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f0b67-5e1e-401e-8591-b8a5ab00896a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:07.439789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-529f0b67-5e1e-401e-8591-b8a5ab00896a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:07.440974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-529f0b67-5e1e-401e-8591-b8a5ab00896a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:07.501542 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4031/8126] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:52:07.510007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aabe0-9972-49f1-966b-51a877a9d871 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:07.510301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aabe0-9972-49f1-966b-51a877a9d871 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:07.510582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aabe0-9972-49f1-966b-51a877a9d871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:07.530534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-796aabe0-9972-49f1-966b-51a877a9d871 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:07.531784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-796aabe0-9972-49f1-966b-51a877a9d871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:07.539939 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4096/8127] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:07.544301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f0b67-5e1e-401e-8591-b8a5ab00896a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:07.554979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f0b67-5e1e-401e-8591-b8a5ab00896a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:07.560071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5e080-5d34-445f-a660-91daac62153b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:07.560726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5e080-5d34-445f-a660-91daac62153b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:07.561007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5e080-5d34-445f-a660-91daac62153b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:07.561280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5e080-5d34-445f-a660-91daac62153b admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:07.561999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5e080-5d34-445f-a660-91daac62153b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:52:07.562293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5e080-5d34-445f-a660-91daac62153b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:07.563956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5e080-5d34-445f-a660-91daac62153b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:07.576833 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4032/8128] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:07.585187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796aabe0-9972-49f1-966b-51a877a9d871 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:07.595130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796aabe0-9972-49f1-966b-51a877a9d871 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:07.600460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fd79d-7f97-4460-8a8f-9981e78eea78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:07.601119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fd79d-7f97-4460-8a8f-9981e78eea78 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:07.601533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fd79d-7f97-4460-8a8f-9981e78eea78 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:07.601818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fd79d-7f97-4460-8a8f-9981e78eea78 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:07.604537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44fd79d-7f97-4460-8a8f-9981e78eea78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:07.604537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44fd79d-7f97-4460-8a8f-9981e78eea78 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:07.739193 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4097/8129] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:07 2022] POST /identity/v3/projects => generated 401 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:07.743121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5e080-5d34-445f-a660-91daac62153b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:07.753826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5e080-5d34-445f-a660-91daac62153b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:07.811645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299abee-581c-4998-b224-ebc0f809e374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:07.812309 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299abee-581c-4998-b224-ebc0f809e374 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:07.812590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299abee-581c-4998-b224-ebc0f809e374 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:07.812862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299abee-581c-4998-b224-ebc0f809e374 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:07.813545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299abee-581c-4998-b224-ebc0f809e374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:07.815520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299abee-581c-4998-b224-ebc0f809e374 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:07.897360 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4033/8130] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:52:07 2022] POST /identity/v3/users => generated 301 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:52:07.901378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fd79d-7f97-4460-8a8f-9981e78eea78 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:07.912403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fd79d-7f97-4460-8a8f-9981e78eea78 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:07.917060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480d495-ebad-4b94-be65-5055abde1914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:07.918768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480d495-ebad-4b94-be65-5055abde1914 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:07.919131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480d495-ebad-4b94-be65-5055abde1914 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:07.919410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480d495-ebad-4b94-be65-5055abde1914 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:07.920124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480d495-ebad-4b94-be65-5055abde1914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:07.921715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480d495-ebad-4b94-be65-5055abde1914 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:07.932411 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4098/8131] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:07.937639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299abee-581c-4998-b224-ebc0f809e374 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:07.947884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299abee-581c-4998-b224-ebc0f809e374 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:07.952688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49df5a-ffa3-4671-89bf-844a90bd0c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:07.953343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49df5a-ffa3-4671-89bf-844a90bd0c58 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:07.953628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49df5a-ffa3-4671-89bf-844a90bd0c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:07.953907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49df5a-ffa3-4671-89bf-844a90bd0c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:07.954639 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49df5a-ffa3-4671-89bf-844a90bd0c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:07.956262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49df5a-ffa3-4671-89bf-844a90bd0c58 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:07.968695 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4034/8132] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:07.973308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480d495-ebad-4b94-be65-5055abde1914 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:07.984132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480d495-ebad-4b94-be65-5055abde1914 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:07.988779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d47eb-952d-4616-89c7-cc76e7b4cdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:07.989701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d47eb-952d-4616-89c7-cc76e7b4cdf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:07.989930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d47eb-952d-4616-89c7-cc76e7b4cdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:07.990203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d47eb-952d-4616-89c7-cc76e7b4cdf6 admin admin] PATH_INFO: `/v3/projects/8517411cd5ae4cb995724cdc92ff22e2/users/1903ae0c6b484c3281d40efa89f5d75d/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:08.005421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d47eb-952d-4616-89c7-cc76e7b4cdf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8517411cd5ae4cb995724cdc92ff22e2, user_id=1903ae0c6b484c3281d40efa89f5d75d, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:08.008170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d47eb-952d-4616-89c7-cc76e7b4cdf6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:08.098232 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4099/8133] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:52:07 2022] PUT /identity/v3/projects/8517411cd5ae4cb995724cdc92ff22e2/users/1903ae0c6b484c3281d40efa89f5d75d/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:08.110806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7979630-e258-4a8c-901a-b9df1a478693 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:08.111142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7979630-e258-4a8c-901a-b9df1a478693 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:08.111419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7979630-e258-4a8c-901a-b9df1a478693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:08.138866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d7979630-e258-4a8c-901a-b9df1a478693 None None] MFA Rules not processed for user `1903ae0c6b484c3281d40efa89f5d75d`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:08.140111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d7979630-e258-4a8c-901a-b9df1a478693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:08.173626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:08.203888 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4035/8134] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:08.208404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d47eb-952d-4616-89c7-cc76e7b4cdf6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:08.219378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:08.271519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d47eb-952d-4616-89c7-cc76e7b4cdf6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:08.276306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c616102-8fc1-457b-be6d-96d9757a13a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:08.277985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c616102-8fc1-457b-be6d-96d9757a13a8 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:08.277985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c616102-8fc1-457b-be6d-96d9757a13a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:08.278217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c616102-8fc1-457b-be6d-96d9757a13a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:08.278756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c616102-8fc1-457b-be6d-96d9757a13a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:08.280729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c616102-8fc1-457b-be6d-96d9757a13a8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:08.383936 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4100/8135] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:08 2022] POST /identity/v3/projects => generated 401 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:08.388925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7979630-e258-4a8c-901a-b9df1a478693 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:08.400071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7979630-e258-4a8c-901a-b9df1a478693 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:08.457464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139fff8-2de0-4022-91bd-20cab49f6900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:08.458129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139fff8-2de0-4022-91bd-20cab49f6900 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:08.458412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139fff8-2de0-4022-91bd-20cab49f6900 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:08.458694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139fff8-2de0-4022-91bd-20cab49f6900 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:08.459508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139fff8-2de0-4022-91bd-20cab49f6900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:08.461323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139fff8-2de0-4022-91bd-20cab49f6900 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:08.558717 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4036/8136] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:52:08 2022] POST /identity/v3/users => generated 307 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:08.562505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c616102-8fc1-457b-be6d-96d9757a13a8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:08.573368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c616102-8fc1-457b-be6d-96d9757a13a8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:08.578562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afe652-7b00-4ef1-93ab-c7a8e42f1779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:08.579276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afe652-7b00-4ef1-93ab-c7a8e42f1779 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:08.579561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afe652-7b00-4ef1-93ab-c7a8e42f1779 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:08.579838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afe652-7b00-4ef1-93ab-c7a8e42f1779 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:08.580557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afe652-7b00-4ef1-93ab-c7a8e42f1779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:08.582174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afe652-7b00-4ef1-93ab-c7a8e42f1779 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:08.593577 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4101/8137] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:08.597976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139fff8-2de0-4022-91bd-20cab49f6900 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:08.608162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139fff8-2de0-4022-91bd-20cab49f6900 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:08.612966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1da852-6a3c-4e45-b38c-368cc727e405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:08.613839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1da852-6a3c-4e45-b38c-368cc727e405 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:08.614119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1da852-6a3c-4e45-b38c-368cc727e405 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:08.614396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1da852-6a3c-4e45-b38c-368cc727e405 admin admin] PATH_INFO: `/v3/projects/a4aad885bac24754b7afc9f8824327f2/users/15ec94d37b174ab5a5a585b2fadd3b40/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:08.628850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1da852-6a3c-4e45-b38c-368cc727e405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4aad885bac24754b7afc9f8824327f2, user_id=15ec94d37b174ab5a5a585b2fadd3b40, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:08.631538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1da852-6a3c-4e45-b38c-368cc727e405 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:08.701845 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4037/8138] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:52:08 2022] PUT /identity/v3/projects/a4aad885bac24754b7afc9f8824327f2/users/15ec94d37b174ab5a5a585b2fadd3b40/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:52:08.705846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afe652-7b00-4ef1-93ab-c7a8e42f1779 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:08.717343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afe652-7b00-4ef1-93ab-c7a8e42f1779 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:08.774380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54116c4c-02c2-4c0e-88a5-c71efc1c8f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:08.775062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54116c4c-02c2-4c0e-88a5-c71efc1c8f2a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:08.775351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54116c4c-02c2-4c0e-88a5-c71efc1c8f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:08.775627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54116c4c-02c2-4c0e-88a5-c71efc1c8f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:08.776366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54116c4c-02c2-4c0e-88a5-c71efc1c8f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:08.778187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54116c4c-02c2-4c0e-88a5-c71efc1c8f2a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:08.788007 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4102/8139] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:08.792200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1da852-6a3c-4e45-b38c-368cc727e405 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:08.802659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1da852-6a3c-4e45-b38c-368cc727e405 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:08.807408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fead0c-8b9b-490c-b2c0-cdb6837d6b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:08.808842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fead0c-8b9b-490c-b2c0-cdb6837d6b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:08.809059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fead0c-8b9b-490c-b2c0-cdb6837d6b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:08.809337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fead0c-8b9b-490c-b2c0-cdb6837d6b4b admin admin] PATH_INFO: `/v3/projects/a4aad885bac24754b7afc9f8824327f2/users/15ec94d37b174ab5a5a585b2fadd3b40/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:08.811421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fead0c-8b9b-490c-b2c0-cdb6837d6b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4aad885bac24754b7afc9f8824327f2, user_id=15ec94d37b174ab5a5a585b2fadd3b40, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:08.814060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fead0c-8b9b-490c-b2c0-cdb6837d6b4b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:08.825531 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4038/8140] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:52:08 2022] PUT /identity/v3/projects/a4aad885bac24754b7afc9f8824327f2/users/15ec94d37b174ab5a5a585b2fadd3b40/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:08.835728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f5843-8393-49dd-8b40-6597a3eaa547 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:08.836020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f5843-8393-49dd-8b40-6597a3eaa547 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:08.836302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f5843-8393-49dd-8b40-6597a3eaa547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:08.862720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2e1f5843-8393-49dd-8b40-6597a3eaa547 None None] MFA Rules not processed for user `15ec94d37b174ab5a5a585b2fadd3b40`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:08.863965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2e1f5843-8393-49dd-8b40-6597a3eaa547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:08.933025 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4103/8141] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:08 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:08.938224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fead0c-8b9b-490c-b2c0-cdb6837d6b4b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:08.949525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fead0c-8b9b-490c-b2c0-cdb6837d6b4b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:08.954301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7d00e-f638-46a0-b61f-c03512048cce tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ec94d37b174ab5a5a585b2fadd3b40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4aad885bac24754b7afc9f8824327f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:08.954957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7d00e-f638-46a0-b61f-c03512048cce tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:08.955279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7d00e-f638-46a0-b61f-c03512048cce tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:08.955563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7d00e-f638-46a0-b61f-c03512048cce tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:08.956296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7d00e-f638-46a0-b61f-c03512048cce tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:08.958049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7d00e-f638-46a0-b61f-c03512048cce tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:09.040806 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4039/8142] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Jul 16 21:52:08 2022] POST /identity/v3/roles => generated 239 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:09.045613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f5843-8393-49dd-8b40-6597a3eaa547 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:09.051640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:09.055466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f5843-8393-49dd-8b40-6597a3eaa547 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:09.060405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c98602-5f2c-47a5-9a7d-b9bd663ca528 tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ec94d37b174ab5a5a585b2fadd3b40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4aad885bac24754b7afc9f8824327f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:09.061210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c98602-5f2c-47a5-9a7d-b9bd663ca528 tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:09.061491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c98602-5f2c-47a5-9a7d-b9bd663ca528 tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:09.061768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c98602-5f2c-47a5-9a7d-b9bd663ca528 tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] PATH_INFO: `/v3/projects/8517411cd5ae4cb995724cdc92ff22e2/users/1903ae0c6b484c3281d40efa89f5d75d/roles/ee4a841d6d8a4fa1a2e1454fbdb6cb2c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:09.064136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c98602-5f2c-47a5-9a7d-b9bd663ca528 tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8517411cd5ae4cb995724cdc92ff22e2, user_id=1903ae0c6b484c3281d40efa89f5d75d, role_id=ee4a841d6d8a4fa1a2e1454fbdb6cb2c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:09.066814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c98602-5f2c-47a5-9a7d-b9bd663ca528 tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:09.165322 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4104/8143] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:52:09 2022] PUT /identity/v3/projects/8517411cd5ae4cb995724cdc92ff22e2/users/1903ae0c6b484c3281d40efa89f5d75d/roles/ee4a841d6d8a4fa1a2e1454fbdb6cb2c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:09.169661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7d00e-f638-46a0-b61f-c03512048cce tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:09.231891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7d00e-f638-46a0-b61f-c03512048cce tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:09.248901 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:09.287115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443e4c2-642d-437c-8564-8067356bdd20 tempest-ApplicationCredentialsV3AdminTest-637748936 tempest-ApplicationCredentialsV3AdminTest-637748936-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1903ae0c6b484c3281d40efa89f5d75d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8517411cd5ae4cb995724cdc92ff22e2', 'project_domain_id': 'default', 'roles': ['tempest-test_role-278545767', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:09.287981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443e4c2-642d-437c-8564-8067356bdd20 tempest-ApplicationCredentialsV3AdminTest-637748936 tempest-ApplicationCredentialsV3AdminTest-637748936-project] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:09.288265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443e4c2-642d-437c-8564-8067356bdd20 tempest-ApplicationCredentialsV3AdminTest-637748936 tempest-ApplicationCredentialsV3AdminTest-637748936-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:09.288542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443e4c2-642d-437c-8564-8067356bdd20 tempest-ApplicationCredentialsV3AdminTest-637748936 tempest-ApplicationCredentialsV3AdminTest-637748936-project] PATH_INFO: `/v3/users/1903ae0c6b484c3281d40efa89f5d75d/application_credentials` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:09.289546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443e4c2-642d-437c-8564-8067356bdd20 tempest-ApplicationCredentialsV3AdminTest-637748936 tempest-ApplicationCredentialsV3AdminTest-637748936-project] RBAC: Authorizing `identity:create_application_credential(user_id=1903ae0c6b484c3281d40efa89f5d75d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:09.290690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443e4c2-642d-437c-8564-8067356bdd20 tempest-ApplicationCredentialsV3AdminTest-637748936 tempest-ApplicationCredentialsV3AdminTest-637748936-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:09.434491 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4040/8144] 10.222.0.16 () {60 vars in 1314 bytes} [Sat Jul 16 21:52:09 2022] POST /identity/v3/users/1903ae0c6b484c3281d40efa89f5d75d/application_credentials => generated 659 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:09.438987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb36b4-9be6-4130-a610-b5fdce2f104f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:09.439461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb36b4-9be6-4130-a610-b5fdce2f104f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:09.439559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb36b4-9be6-4130-a610-b5fdce2f104f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:09.460967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9abb36b4-9be6-4130-a610-b5fdce2f104f None None] MFA Rules not processed for user `1903ae0c6b484c3281d40efa89f5d75d`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:09.462190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9abb36b4-9be6-4130-a610-b5fdce2f104f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:09.569523 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4105/8145] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:09 2022] POST /identity/v3/auth/tokens => generated 3384 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 16 21:52:09.574634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443e4c2-642d-437c-8564-8067356bdd20 tempest-ApplicationCredentialsV3AdminTest-637748936 tempest-ApplicationCredentialsV3AdminTest-637748936-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:09.584700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443e4c2-642d-437c-8564-8067356bdd20 tempest-ApplicationCredentialsV3AdminTest-637748936 tempest-ApplicationCredentialsV3AdminTest-637748936-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:09.589518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab1de6-d200-4dd9-9c3e-cfb2f5432bf0 tempest-ApplicationCredentialsV3AdminTest-637748936 tempest-ApplicationCredentialsV3AdminTest-637748936-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1903ae0c6b484c3281d40efa89f5d75d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8517411cd5ae4cb995724cdc92ff22e2', 'project_domain_id': 'default', 'roles': ['tempest-test_role-278545767', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:09.590452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab1de6-d200-4dd9-9c3e-cfb2f5432bf0 tempest-ApplicationCredentialsV3AdminTest-637748936 tempest-ApplicationCredentialsV3AdminTest-637748936-project] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:09.590738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab1de6-d200-4dd9-9c3e-cfb2f5432bf0 tempest-ApplicationCredentialsV3AdminTest-637748936 tempest-ApplicationCredentialsV3AdminTest-637748936-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:09.591037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab1de6-d200-4dd9-9c3e-cfb2f5432bf0 tempest-ApplicationCredentialsV3AdminTest-637748936 tempest-ApplicationCredentialsV3AdminTest-637748936-project] PATH_INFO: `/v3/users/1903ae0c6b484c3281d40efa89f5d75d/application_credentials/3a6608a9d60a42d9a61197ba5b48cb52` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:09.592320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab1de6-d200-4dd9-9c3e-cfb2f5432bf0 tempest-ApplicationCredentialsV3AdminTest-637748936 tempest-ApplicationCredentialsV3AdminTest-637748936-project] RBAC: Authorizing `identity:delete_application_credential(user_id=1903ae0c6b484c3281d40efa89f5d75d, application_credential_id=3a6608a9d60a42d9a61197ba5b48cb52)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:09.593809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab1de6-d200-4dd9-9c3e-cfb2f5432bf0 tempest-ApplicationCredentialsV3AdminTest-637748936 tempest-ApplicationCredentialsV3AdminTest-637748936-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:09.690640 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4041/8146] 10.222.0.16 () {58 vars in 1394 bytes} [Sat Jul 16 21:52:09 2022] DELETE /identity/v3/users/1903ae0c6b484c3281d40efa89f5d75d/application_credentials/3a6608a9d60a42d9a61197ba5b48cb52 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:09.694746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb36b4-9be6-4130-a610-b5fdce2f104f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:09.757861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb36b4-9be6-4130-a610-b5fdce2f104f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:09.763275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69fc74-0991-43e1-ada2-3b2860f7857f tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ec94d37b174ab5a5a585b2fadd3b40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4aad885bac24754b7afc9f8824327f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:09.764130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69fc74-0991-43e1-ada2-3b2860f7857f tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:09.764413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69fc74-0991-43e1-ada2-3b2860f7857f tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:09.764689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69fc74-0991-43e1-ada2-3b2860f7857f tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] PATH_INFO: `/v3/roles/ee4a841d6d8a4fa1a2e1454fbdb6cb2c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:09.766211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69fc74-0991-43e1-ada2-3b2860f7857f tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ee4a841d6d8a4fa1a2e1454fbdb6cb2c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:09.767870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69fc74-0991-43e1-ada2-3b2860f7857f tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:09.846861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:09.945981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1d69fc74-0991-43e1-ada2-3b2860f7857f tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] Invalidating the token cache because role ee4a841d6d8a4fa1a2e1454fbdb6cb2c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:09.946208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1d69fc74-0991-43e1-ada2-3b2860f7857f tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:09.946883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1d69fc74-0991-43e1-ada2-3b2860f7857f tempest-ApplicationCredentialsV3AdminTest-380650989 tempest-ApplicationCredentialsV3AdminTest-380650989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:09.948887 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4106/8147] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:52:09 2022] DELETE /identity/v3/roles/ee4a841d6d8a4fa1a2e1454fbdb6cb2c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:09.954097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab1de6-d200-4dd9-9c3e-cfb2f5432bf0 tempest-ApplicationCredentialsV3AdminTest-637748936 tempest-ApplicationCredentialsV3AdminTest-637748936-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:09.955825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-23ab1de6-d200-4dd9-9c3e-cfb2f5432bf0 tempest-ApplicationCredentialsV3AdminTest-637748936 tempest-ApplicationCredentialsV3AdminTest-637748936-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:10.020583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab1de6-d200-4dd9-9c3e-cfb2f5432bf0 tempest-ApplicationCredentialsV3AdminTest-637748936 tempest-ApplicationCredentialsV3AdminTest-637748936-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:10.063738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:10.076033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d684e85-f9a6-4188-b6ca-412be94bdcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:10.076910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d684e85-f9a6-4188-b6ca-412be94bdcb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:10.077189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d684e85-f9a6-4188-b6ca-412be94bdcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:10.077466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d684e85-f9a6-4188-b6ca-412be94bdcb2 admin admin] PATH_INFO: `/v3/users/1903ae0c6b484c3281d40efa89f5d75d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:10.078660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d684e85-f9a6-4188-b6ca-412be94bdcb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1903ae0c6b484c3281d40efa89f5d75d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:10.080612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d684e85-f9a6-4188-b6ca-412be94bdcb2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:10.425287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7d684e85-f9a6-4188-b6ca-412be94bdcb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1903ae0c6b484c3281d40efa89f5d75d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:10.437104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7d684e85-f9a6-4188-b6ca-412be94bdcb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1903ae0c6b484c3281d40efa89f5d75d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:10.518255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7d684e85-f9a6-4188-b6ca-412be94bdcb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1903ae0c6b484c3281d40efa89f5d75d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:10.525912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7d684e85-f9a6-4188-b6ca-412be94bdcb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1903ae0c6b484c3281d40efa89f5d75d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:10.526548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7d684e85-f9a6-4188-b6ca-412be94bdcb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1903ae0c6b484c3281d40efa89f5d75d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:10.533164 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4042/8148] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:52:09 2022] DELETE /identity/v3/users/1903ae0c6b484c3281d40efa89f5d75d => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:10.537738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994c352-a499-49bc-8a91-5a15c6c1133e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:10.538228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994c352-a499-49bc-8a91-5a15c6c1133e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:10.538334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994c352-a499-49bc-8a91-5a15c6c1133e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:10.556707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9994c352-a499-49bc-8a91-5a15c6c1133e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:10.557904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9994c352-a499-49bc-8a91-5a15c6c1133e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:10.617808 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4107/8149] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:10.627737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d684e85-f9a6-4188-b6ca-412be94bdcb2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:10.629368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7d684e85-f9a6-4188-b6ca-412be94bdcb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:10.691208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d684e85-f9a6-4188-b6ca-412be94bdcb2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:10.694836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f09341-3868-4e86-8920-c017c4e1154f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:10.695605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f09341-3868-4e86-8920-c017c4e1154f service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:10.695884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f09341-3868-4e86-8920-c017c4e1154f service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:10.696163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f09341-3868-4e86-8920-c017c4e1154f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:10.706377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f09341-3868-4e86-8920-c017c4e1154f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:10.707932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f09341-3868-4e86-8920-c017c4e1154f service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:10.718716 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4043/8150] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:52:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:52:11.149837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994c352-a499-49bc-8a91-5a15c6c1133e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:11.151479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9994c352-a499-49bc-8a91-5a15c6c1133e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:11.166364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994c352-a499-49bc-8a91-5a15c6c1133e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:11.173005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da550b-b2bb-4902-b7e8-e58d9a79a1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:11.173893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da550b-b2bb-4902-b7e8-e58d9a79a1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:11.174166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da550b-b2bb-4902-b7e8-e58d9a79a1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:11.174455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da550b-b2bb-4902-b7e8-e58d9a79a1dc admin admin] PATH_INFO: `/v3/projects/8517411cd5ae4cb995724cdc92ff22e2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:11.175736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da550b-b2bb-4902-b7e8-e58d9a79a1dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8517411cd5ae4cb995724cdc92ff22e2)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:11.177851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da550b-b2bb-4902-b7e8-e58d9a79a1dc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:11.296630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-24da550b-b2bb-4902-b7e8-e58d9a79a1dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8517411cd5ae4cb995724cdc92ff22e2', 'request_id': 'req-24da550b-b2bb-4902-b7e8-e58d9a79a1dc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:11.302862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-24da550b-b2bb-4902-b7e8-e58d9a79a1dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8517411cd5ae4cb995724cdc92ff22e2', 'request_id': 'req-24da550b-b2bb-4902-b7e8-e58d9a79a1dc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:11.309087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-24da550b-b2bb-4902-b7e8-e58d9a79a1dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8517411cd5ae4cb995724cdc92ff22e2', 'request_id': 'req-24da550b-b2bb-4902-b7e8-e58d9a79a1dc'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:11.387294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-24da550b-b2bb-4902-b7e8-e58d9a79a1dc admin admin] The token cache is being invalidate because project 8517411cd5ae4cb995724cdc92ff22e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:11.387585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-24da550b-b2bb-4902-b7e8-e58d9a79a1dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:11.388217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-24da550b-b2bb-4902-b7e8-e58d9a79a1dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:11.389824 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4108/8151] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:11 2022] DELETE /identity/v3/projects/8517411cd5ae4cb995724cdc92ff22e2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:11.393910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f09341-3868-4e86-8920-c017c4e1154f service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:11.403702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f09341-3868-4e86-8920-c017c4e1154f service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:11.462077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b09b50-b8ee-4e9c-b39d-1dc5c3e6a34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:11.463062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b09b50-b8ee-4e9c-b39d-1dc5c3e6a34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:11.463354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b09b50-b8ee-4e9c-b39d-1dc5c3e6a34f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:11.463648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b09b50-b8ee-4e9c-b39d-1dc5c3e6a34f admin admin] PATH_INFO: `/v3/users/15ec94d37b174ab5a5a585b2fadd3b40` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:11.465390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b09b50-b8ee-4e9c-b39d-1dc5c3e6a34f admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ec94d37b174ab5a5a585b2fadd3b40)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:11.467417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b09b50-b8ee-4e9c-b39d-1dc5c3e6a34f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:11.477680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:11.674801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-14b09b50-b8ee-4e9c-b39d-1dc5c3e6a34f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ec94d37b174ab5a5a585b2fadd3b40'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:11.687898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-14b09b50-b8ee-4e9c-b39d-1dc5c3e6a34f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ec94d37b174ab5a5a585b2fadd3b40'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:11.758091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-14b09b50-b8ee-4e9c-b39d-1dc5c3e6a34f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ec94d37b174ab5a5a585b2fadd3b40'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:11.765741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-14b09b50-b8ee-4e9c-b39d-1dc5c3e6a34f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ec94d37b174ab5a5a585b2fadd3b40'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:11.766413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-14b09b50-b8ee-4e9c-b39d-1dc5c3e6a34f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ec94d37b174ab5a5a585b2fadd3b40'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:11.772503 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4044/8152] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:52:11 2022] DELETE /identity/v3/users/15ec94d37b174ab5a5a585b2fadd3b40 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:12.172809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da550b-b2bb-4902-b7e8-e58d9a79a1dc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:12.174386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-24da550b-b2bb-4902-b7e8-e58d9a79a1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:12.192309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da550b-b2bb-4902-b7e8-e58d9a79a1dc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:12.252190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08035f-9f5d-4b2f-a6de-2714d02ff6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:12.252976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08035f-9f5d-4b2f-a6de-2714d02ff6da admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:12.253355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08035f-9f5d-4b2f-a6de-2714d02ff6da admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:12.253639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08035f-9f5d-4b2f-a6de-2714d02ff6da admin admin] PATH_INFO: `/v3/projects/a4aad885bac24754b7afc9f8824327f2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:12.254827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08035f-9f5d-4b2f-a6de-2714d02ff6da admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4aad885bac24754b7afc9f8824327f2)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:12.256800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08035f-9f5d-4b2f-a6de-2714d02ff6da admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:12.279458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:12.387432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2a08035f-9f5d-4b2f-a6de-2714d02ff6da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4aad885bac24754b7afc9f8824327f2', 'request_id': 'req-2a08035f-9f5d-4b2f-a6de-2714d02ff6da'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:12.393678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2a08035f-9f5d-4b2f-a6de-2714d02ff6da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4aad885bac24754b7afc9f8824327f2', 'request_id': 'req-2a08035f-9f5d-4b2f-a6de-2714d02ff6da'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:12.399469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2a08035f-9f5d-4b2f-a6de-2714d02ff6da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4aad885bac24754b7afc9f8824327f2', 'request_id': 'req-2a08035f-9f5d-4b2f-a6de-2714d02ff6da'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:12.505870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2a08035f-9f5d-4b2f-a6de-2714d02ff6da admin admin] The token cache is being invalidate because project a4aad885bac24754b7afc9f8824327f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:12.506094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2a08035f-9f5d-4b2f-a6de-2714d02ff6da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:12.506734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-2a08035f-9f5d-4b2f-a6de-2714d02ff6da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:12.508320 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4109/8153] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:12 2022] DELETE /identity/v3/projects/a4aad885bac24754b7afc9f8824327f2 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:12.514231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c050f79-d181-43d0-81f0-68a29c3a2895 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:12.514525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c050f79-d181-43d0-81f0-68a29c3a2895 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:12.514808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c050f79-d181-43d0-81f0-68a29c3a2895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:12.532349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1c050f79-d181-43d0-81f0-68a29c3a2895 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:12.533612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1c050f79-d181-43d0-81f0-68a29c3a2895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:12.594584 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4045/8154] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:12.602658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652193f-9f65-4998-afcd-fb5feb622639 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:12.603268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652193f-9f65-4998-afcd-fb5feb622639 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:12.603739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652193f-9f65-4998-afcd-fb5feb622639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:12.623087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2652193f-9f65-4998-afcd-fb5feb622639 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:12.624288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2652193f-9f65-4998-afcd-fb5feb622639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:12.634666 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4110/8155] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:12.637465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c050f79-d181-43d0-81f0-68a29c3a2895 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:12.647400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c050f79-d181-43d0-81f0-68a29c3a2895 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:12.652289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955121c-1f40-48e9-92d2-1b0b51b11015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:12.652963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955121c-1f40-48e9-92d2-1b0b51b11015 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:12.653248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955121c-1f40-48e9-92d2-1b0b51b11015 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:12.653529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955121c-1f40-48e9-92d2-1b0b51b11015 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:12.654258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955121c-1f40-48e9-92d2-1b0b51b11015 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:52:12.654569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955121c-1f40-48e9-92d2-1b0b51b11015 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:12.656325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955121c-1f40-48e9-92d2-1b0b51b11015 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:12.668070 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4046/8156] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:12.672631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652193f-9f65-4998-afcd-fb5feb622639 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:12.682220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652193f-9f65-4998-afcd-fb5feb622639 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:12.687763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97f91d-a859-4b9d-ab70-8a1bee90ec32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:12.688437 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97f91d-a859-4b9d-ab70-8a1bee90ec32 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:12.688717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97f91d-a859-4b9d-ab70-8a1bee90ec32 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:12.688989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97f91d-a859-4b9d-ab70-8a1bee90ec32 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:12.689673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97f91d-a859-4b9d-ab70-8a1bee90ec32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:12.691633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97f91d-a859-4b9d-ab70-8a1bee90ec32 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:12.782018 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4111/8157] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:12 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:52:12.786289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955121c-1f40-48e9-92d2-1b0b51b11015 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:12.796737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955121c-1f40-48e9-92d2-1b0b51b11015 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:12.852992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc6109-9783-4ee4-8abb-2028a8133080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:12.853659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc6109-9783-4ee4-8abb-2028a8133080 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:12.853944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc6109-9783-4ee4-8abb-2028a8133080 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:12.854223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc6109-9783-4ee4-8abb-2028a8133080 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:12.855757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc6109-9783-4ee4-8abb-2028a8133080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:12.857505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc6109-9783-4ee4-8abb-2028a8133080 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:12.958288 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4047/8158] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:52:12 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:12.962345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97f91d-a859-4b9d-ab70-8a1bee90ec32 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:12.973221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97f91d-a859-4b9d-ab70-8a1bee90ec32 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:12.977964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69884c-3724-4683-858e-92ae6d503603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:12.978671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69884c-3724-4683-858e-92ae6d503603 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:12.978963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69884c-3724-4683-858e-92ae6d503603 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:12.979329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69884c-3724-4683-858e-92ae6d503603 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:12.980640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69884c-3724-4683-858e-92ae6d503603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:12.982292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69884c-3724-4683-858e-92ae6d503603 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:12.993693 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4112/8159] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:12.998070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc6109-9783-4ee4-8abb-2028a8133080 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:13.004704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:13.008503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc6109-9783-4ee4-8abb-2028a8133080 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:13.013263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b9909-dbf0-437e-882e-57845217ef41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:13.018186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b9909-dbf0-437e-882e-57845217ef41 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:13.018186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b9909-dbf0-437e-882e-57845217ef41 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:13.018186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b9909-dbf0-437e-882e-57845217ef41 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:13.018186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b9909-dbf0-437e-882e-57845217ef41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:13.018186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b9909-dbf0-437e-882e-57845217ef41 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:13.027416 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4048/8160] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:13.031497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69884c-3724-4683-858e-92ae6d503603 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:13.041898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69884c-3724-4683-858e-92ae6d503603 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:13.047102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b088a67-677e-49d3-bb05-30d32d60b519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:13.048008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b088a67-677e-49d3-bb05-30d32d60b519 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:13.048286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b088a67-677e-49d3-bb05-30d32d60b519 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:13.048558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b088a67-677e-49d3-bb05-30d32d60b519 admin admin] PATH_INFO: `/v3/projects/61ab7742263b475d9c2de57ac3c1b470/users/0519b0f69bb1434db9060fedb76a1fe7/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:13.063742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b088a67-677e-49d3-bb05-30d32d60b519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ab7742263b475d9c2de57ac3c1b470, user_id=0519b0f69bb1434db9060fedb76a1fe7, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:13.066408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b088a67-677e-49d3-bb05-30d32d60b519 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:13.120195 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4113/8161] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:52:13 2022] PUT /identity/v3/projects/61ab7742263b475d9c2de57ac3c1b470/users/0519b0f69bb1434db9060fedb76a1fe7/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:13.132337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb629ee6-847c-4860-8288-c454bcb4d274 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:13.132943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb629ee6-847c-4860-8288-c454bcb4d274 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:13.133227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb629ee6-847c-4860-8288-c454bcb4d274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:13.159478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-eb629ee6-847c-4860-8288-c454bcb4d274 None None] MFA Rules not processed for user `0519b0f69bb1434db9060fedb76a1fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:13.160687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-eb629ee6-847c-4860-8288-c454bcb4d274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:13.224996 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4049/8162] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:13.229587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b088a67-677e-49d3-bb05-30d32d60b519 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:13.292340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b088a67-677e-49d3-bb05-30d32d60b519 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:13.297416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03112aba-b712-497b-b2ec-b0d5877d4b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:13.298070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03112aba-b712-497b-b2ec-b0d5877d4b13 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:13.298353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03112aba-b712-497b-b2ec-b0d5877d4b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:13.298631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03112aba-b712-497b-b2ec-b0d5877d4b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:13.299355 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03112aba-b712-497b-b2ec-b0d5877d4b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:13.301270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03112aba-b712-497b-b2ec-b0d5877d4b13 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:13.366464 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4114/8163] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:13 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:13.370585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb629ee6-847c-4860-8288-c454bcb4d274 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:13.381419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb629ee6-847c-4860-8288-c454bcb4d274 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:13.438655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4b05b-def5-4260-a8c1-96d8666fcd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:13.439384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4b05b-def5-4260-a8c1-96d8666fcd6d admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:13.439670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4b05b-def5-4260-a8c1-96d8666fcd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:13.439946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4b05b-def5-4260-a8c1-96d8666fcd6d admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:13.440634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4b05b-def5-4260-a8c1-96d8666fcd6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:13.442612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4b05b-def5-4260-a8c1-96d8666fcd6d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:13.535435 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4050/8164] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:52:13 2022] POST /identity/v3/users => generated 300 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:13.539059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03112aba-b712-497b-b2ec-b0d5877d4b13 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:13.551120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03112aba-b712-497b-b2ec-b0d5877d4b13 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:13.555773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffb4df-b017-4c0a-8ddf-194f692d9975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:13.556494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffb4df-b017-4c0a-8ddf-194f692d9975 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:13.556779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffb4df-b017-4c0a-8ddf-194f692d9975 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:13.557061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffb4df-b017-4c0a-8ddf-194f692d9975 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:13.557791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffb4df-b017-4c0a-8ddf-194f692d9975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:13.559840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffb4df-b017-4c0a-8ddf-194f692d9975 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:13.572204 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4115/8165] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:13.576994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4b05b-def5-4260-a8c1-96d8666fcd6d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:13.587403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4b05b-def5-4260-a8c1-96d8666fcd6d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:13.593443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da241002-3e01-45ac-8877-678378f30047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:13.594338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da241002-3e01-45ac-8877-678378f30047 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:13.594602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da241002-3e01-45ac-8877-678378f30047 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:13.594880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da241002-3e01-45ac-8877-678378f30047 admin admin] PATH_INFO: `/v3/projects/d4a64e7079b2409189bb16e4de4178a8/users/74e5497113a64e458d21cdae3144ceba/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:13.610893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da241002-3e01-45ac-8877-678378f30047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a64e7079b2409189bb16e4de4178a8, user_id=74e5497113a64e458d21cdae3144ceba, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:13.613686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da241002-3e01-45ac-8877-678378f30047 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:13.706928 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4051/8166] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:52:13 2022] PUT /identity/v3/projects/d4a64e7079b2409189bb16e4de4178a8/users/74e5497113a64e458d21cdae3144ceba/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:13.711151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffb4df-b017-4c0a-8ddf-194f692d9975 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:13.722538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffb4df-b017-4c0a-8ddf-194f692d9975 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:13.734998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:13.779354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb39f2e-29bd-4333-99fe-f61ac2b2ee51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:13.780053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb39f2e-29bd-4333-99fe-f61ac2b2ee51 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:13.780343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb39f2e-29bd-4333-99fe-f61ac2b2ee51 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:13.780620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb39f2e-29bd-4333-99fe-f61ac2b2ee51 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:13.781335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb39f2e-29bd-4333-99fe-f61ac2b2ee51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:13.782941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb39f2e-29bd-4333-99fe-f61ac2b2ee51 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:13.793349 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4116/8167] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:13.797620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da241002-3e01-45ac-8877-678378f30047 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:13.808833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da241002-3e01-45ac-8877-678378f30047 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:13.813529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7bede-4eed-4d25-8630-8950de1bed6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:13.814453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7bede-4eed-4d25-8630-8950de1bed6a admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:13.814741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7bede-4eed-4d25-8630-8950de1bed6a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:13.815045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7bede-4eed-4d25-8630-8950de1bed6a admin admin] PATH_INFO: `/v3/projects/d4a64e7079b2409189bb16e4de4178a8/users/74e5497113a64e458d21cdae3144ceba/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:13.817082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7bede-4eed-4d25-8630-8950de1bed6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a64e7079b2409189bb16e4de4178a8, user_id=74e5497113a64e458d21cdae3144ceba, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:13.819821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7bede-4eed-4d25-8630-8950de1bed6a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:13.831936 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4052/8168] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:52:13 2022] PUT /identity/v3/projects/d4a64e7079b2409189bb16e4de4178a8/users/74e5497113a64e458d21cdae3144ceba/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:52:13.843147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6062c5-497d-42be-aa10-d7a4b2d49d0a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:13.843682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6062c5-497d-42be-aa10-d7a4b2d49d0a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:13.844022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6062c5-497d-42be-aa10-d7a4b2d49d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:13.871233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3b6062c5-497d-42be-aa10-d7a4b2d49d0a None None] MFA Rules not processed for user `74e5497113a64e458d21cdae3144ceba`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:13.872447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3b6062c5-497d-42be-aa10-d7a4b2d49d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:13.939657 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4117/8169] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:13.950696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7bede-4eed-4d25-8630-8950de1bed6a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:13.961462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7bede-4eed-4d25-8630-8950de1bed6a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:13.967021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844169ac-3e26-457c-b0ce-b0c82864a5a6 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e5497113a64e458d21cdae3144ceba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4a64e7079b2409189bb16e4de4178a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:13.967698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844169ac-3e26-457c-b0ce-b0c82864a5a6 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:13.968018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844169ac-3e26-457c-b0ce-b0c82864a5a6 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:13.968299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844169ac-3e26-457c-b0ce-b0c82864a5a6 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] PATH_INFO: `/v3/services` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:13.969028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844169ac-3e26-457c-b0ce-b0c82864a5a6 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:13.970689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844169ac-3e26-457c-b0ce-b0c82864a5a6 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:14.046718 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4053/8170] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:13 2022] POST /identity/v3/services => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:14.051710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6062c5-497d-42be-aa10-d7a4b2d49d0a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:14.062011 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6062c5-497d-42be-aa10-d7a4b2d49d0a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:14.077394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be186943-9aab-4737-989e-8ff2bc9aacf8 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e5497113a64e458d21cdae3144ceba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4a64e7079b2409189bb16e4de4178a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:14.078083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be186943-9aab-4737-989e-8ff2bc9aacf8 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:14.078370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be186943-9aab-4737-989e-8ff2bc9aacf8 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:14.078648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be186943-9aab-4737-989e-8ff2bc9aacf8 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:14.079431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be186943-9aab-4737-989e-8ff2bc9aacf8 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:14.081033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be186943-9aab-4737-989e-8ff2bc9aacf8 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-be186943-9aab-4737-989e-8ff2bc9aacf8 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: Failed validating 'type' in schema['properties']['enabled']: Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: {'enum': [True, False, None], 'type': 'boolean'} Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: On instance['enabled']: Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: Failed validating 'type' in schema['properties']['enabled']: Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: {'enum': [True, False, None], 'type': 'boolean'} Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: On instance['enabled']: Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: 'False' Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise error Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application On instance['enabled']: Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application 'False' Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:52:14.087048 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:52:14.088562 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:52:14.088562 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:52:14.088562 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:52:14.088562 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:52:14.088562 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:52:14.088562 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:52:14.088562 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:52:14.088562 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:52:14.088562 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:52:14.088562 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:52:14.088562 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:52:14.088562 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:52:14.088562 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jul 16 21:52:14.088562 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jul 16 21:52:14.088562 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 16 21:52:14.088562 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 16 21:52:14.088562 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 16 21:52:14.090088 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 16 21:52:14.090088 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 16 21:52:14.090088 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:52:14.090088 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 16 21:52:14.090088 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 16 21:52:14.090088 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:52:14.090088 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application On instance['enabled']: Jul 16 21:52:14.090088 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application 'False' Jul 16 21:52:14.090088 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:52:14.090088 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4118/8171] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Jul 16 21:52:14 2022] POST /identity/v3/endpoints => generated 283 bytes in 37 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 16 21:52:14.093934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844169ac-3e26-457c-b0ce-b0c82864a5a6 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:14.105199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844169ac-3e26-457c-b0ce-b0c82864a5a6 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:14.109926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41692b41-0b3d-4d91-ab3a-59384c171562 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e5497113a64e458d21cdae3144ceba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4a64e7079b2409189bb16e4de4178a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:14.110563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41692b41-0b3d-4d91-ab3a-59384c171562 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:14.110873 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41692b41-0b3d-4d91-ab3a-59384c171562 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:14.111191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41692b41-0b3d-4d91-ab3a-59384c171562 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:14.111981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41692b41-0b3d-4d91-ab3a-59384c171562 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:14.113550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41692b41-0b3d-4d91-ab3a-59384c171562 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-41692b41-0b3d-4d91-ab3a-59384c171562 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: Failed validating 'type' in schema['properties']['enabled']: Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: {'enum': [True, False, None], 'type': 'boolean'} Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: On instance['enabled']: Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: Failed validating 'type' in schema['properties']['enabled']: Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: {'enum': [True, False, None], 'type': 'boolean'} Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: On instance['enabled']: Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: 'True' Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise error Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application On instance['enabled']: Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application 'True' Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:52:14.125493 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:52:14.126949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:52:14.126949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:52:14.126949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:52:14.126949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:52:14.126949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:52:14.126949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:52:14.126949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:52:14.126949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:52:14.126949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:52:14.126949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:52:14.126949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:52:14.126949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:52:14.126949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jul 16 21:52:14.126949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jul 16 21:52:14.126949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 16 21:52:14.126949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 16 21:52:14.126949 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 16 21:52:14.127937 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 16 21:52:14.127937 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 16 21:52:14.127937 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:52:14.127937 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 16 21:52:14.127937 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 16 21:52:14.127937 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:52:14.127937 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application On instance['enabled']: Jul 16 21:52:14.127937 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application 'True' Jul 16 21:52:14.127937 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:52:14.127937 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4054/8172] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Jul 16 21:52:14 2022] POST /identity/v3/endpoints => generated 281 bytes in 33 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 16 21:52:14.131514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be186943-9aab-4737-989e-8ff2bc9aacf8 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:14.142336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be186943-9aab-4737-989e-8ff2bc9aacf8 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:14.146970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1699f1-5f79-472b-bf91-541bb3f9329f tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e5497113a64e458d21cdae3144ceba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4a64e7079b2409189bb16e4de4178a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:14.147634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1699f1-5f79-472b-bf91-541bb3f9329f tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:14.147922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1699f1-5f79-472b-bf91-541bb3f9329f tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:14.148202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1699f1-5f79-472b-bf91-541bb3f9329f tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:14.148923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1699f1-5f79-472b-bf91-541bb3f9329f tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:14.150942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1699f1-5f79-472b-bf91-541bb3f9329f tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:14.216540 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-4a1699f1-5f79-472b-bf91-541bb3f9329f tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1041426422. To ensure interoperability, identifiers should be a valid uuid. Jul 16 21:52:14.216540 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 16 21:52:14.216540 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:52:14.302429 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4119/8173] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Jul 16 21:52:14 2022] POST /identity/v3/endpoints => generated 359 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:14.306587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41692b41-0b3d-4d91-ab3a-59384c171562 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:14.317271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41692b41-0b3d-4d91-ab3a-59384c171562 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:14.334252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d269f-ee66-42e0-9460-99d08750b680 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e5497113a64e458d21cdae3144ceba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4a64e7079b2409189bb16e4de4178a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:14.335107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d269f-ee66-42e0-9460-99d08750b680 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:14.335390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d269f-ee66-42e0-9460-99d08750b680 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:14.335690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d269f-ee66-42e0-9460-99d08750b680 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] PATH_INFO: `/v3/regions/tempest-region-1041426422` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:14.336317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d269f-ee66-42e0-9460-99d08750b680 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1041426422)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:14.337382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d269f-ee66-42e0-9460-99d08750b680 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:14.339372 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4055/8174] 10.222.0.16 () {58 vars in 1205 bytes} [Sat Jul 16 21:52:14 2022] GET /identity/v3/regions/tempest-region-1041426422 => generated 180 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:14.343631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1699f1-5f79-472b-bf91-541bb3f9329f tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:14.354603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1699f1-5f79-472b-bf91-541bb3f9329f tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:14.360336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c2ffb-0f52-4f1c-a810-c51952125e27 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e5497113a64e458d21cdae3144ceba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4a64e7079b2409189bb16e4de4178a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:14.361189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c2ffb-0f52-4f1c-a810-c51952125e27 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:14.361478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c2ffb-0f52-4f1c-a810-c51952125e27 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:14.361759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c2ffb-0f52-4f1c-a810-c51952125e27 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] PATH_INFO: `/v3/endpoints/cfb363cadd054c72945b7744a07fb134` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:14.367106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c2ffb-0f52-4f1c-a810-c51952125e27 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=cfb363cadd054c72945b7744a07fb134)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:14.368721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c2ffb-0f52-4f1c-a810-c51952125e27 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-d38c2ffb-0f52-4f1c-a810-c51952125e27 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: Failed validating 'type' in schema['properties']['enabled']: Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: {'enum': [True, False, None], 'type': 'boolean'} Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: On instance['enabled']: Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: Failed validating 'type' in schema['properties']['enabled']: Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: {'enum': [True, False, None], 'type': 'boolean'} Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: On instance['enabled']: Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: 'False' Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise error Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application On instance['enabled']: Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application 'False' Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:52:14.380163 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:52:14.381866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:52:14.381866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:52:14.381866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:52:14.381866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:52:14.381866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:52:14.381866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:52:14.381866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:52:14.381866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:52:14.381866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:52:14.381866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:52:14.381866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:52:14.381866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:52:14.381866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jul 16 21:52:14.381866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jul 16 21:52:14.381866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 16 21:52:14.381866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 16 21:52:14.381866 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 16 21:52:14.383136 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 16 21:52:14.383136 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 16 21:52:14.383136 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:52:14.383136 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 16 21:52:14.383136 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 16 21:52:14.383136 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:52:14.383136 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application On instance['enabled']: Jul 16 21:52:14.383136 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application 'False' Jul 16 21:52:14.383136 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:52:14.383136 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4120/8175] 10.222.0.16 () {60 vars in 1254 bytes} [Sat Jul 16 21:52:14 2022] PATCH /identity/v3/endpoints/cfb363cadd054c72945b7744a07fb134 => generated 283 bytes in 38 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 16 21:52:14.385503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d269f-ee66-42e0-9460-99d08750b680 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:14.392217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:14.395922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d269f-ee66-42e0-9460-99d08750b680 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:14.400543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941fb2c-718e-48d5-97de-31e31b976afc tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e5497113a64e458d21cdae3144ceba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4a64e7079b2409189bb16e4de4178a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:14.401374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941fb2c-718e-48d5-97de-31e31b976afc tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:14.401691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941fb2c-718e-48d5-97de-31e31b976afc tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:14.401965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941fb2c-718e-48d5-97de-31e31b976afc tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] PATH_INFO: `/v3/endpoints/cfb363cadd054c72945b7744a07fb134` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:14.403332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941fb2c-718e-48d5-97de-31e31b976afc tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=cfb363cadd054c72945b7744a07fb134)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:14.413852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941fb2c-718e-48d5-97de-31e31b976afc tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:14.517428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4941fb2c-718e-48d5-97de-31e31b976afc tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'cfb363cadd054c72945b7744a07fb134', 'request_id': 'req-4941fb2c-718e-48d5-97de-31e31b976afc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:14.527725 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4056/8176] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jul 16 21:52:14 2022] DELETE /identity/v3/endpoints/cfb363cadd054c72945b7744a07fb134 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:52:14.531910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c2ffb-0f52-4f1c-a810-c51952125e27 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:14.542777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c2ffb-0f52-4f1c-a810-c51952125e27 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:14.558817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be1ae2-f4cc-4b99-bc28-65ee7f5ca893 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e5497113a64e458d21cdae3144ceba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4a64e7079b2409189bb16e4de4178a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:14.560292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be1ae2-f4cc-4b99-bc28-65ee7f5ca893 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:14.560292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be1ae2-f4cc-4b99-bc28-65ee7f5ca893 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:14.560292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be1ae2-f4cc-4b99-bc28-65ee7f5ca893 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] PATH_INFO: `/v3/regions/tempest-region-1041426422` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:14.560927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be1ae2-f4cc-4b99-bc28-65ee7f5ca893 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1041426422)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:14.562528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be1ae2-f4cc-4b99-bc28-65ee7f5ca893 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:14.663040 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4121/8177] 10.222.0.16 () {58 vars in 1208 bytes} [Sat Jul 16 21:52:14 2022] DELETE /identity/v3/regions/tempest-region-1041426422 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:14.670169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941fb2c-718e-48d5-97de-31e31b976afc tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:14.680655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941fb2c-718e-48d5-97de-31e31b976afc tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:14.695769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd819de2-fd8d-47bf-876b-44465183c9ce tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e5497113a64e458d21cdae3144ceba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4a64e7079b2409189bb16e4de4178a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:14.696412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd819de2-fd8d-47bf-876b-44465183c9ce tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:14.696702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd819de2-fd8d-47bf-876b-44465183c9ce tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:14.696974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd819de2-fd8d-47bf-876b-44465183c9ce tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:14.697690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd819de2-fd8d-47bf-876b-44465183c9ce tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:14.699611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd819de2-fd8d-47bf-876b-44465183c9ce tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:14.763227 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-dd819de2-fd8d-47bf-876b-44465183c9ce tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1195396933. To ensure interoperability, identifiers should be a valid uuid. Jul 16 21:52:14.763227 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 16 21:52:14.763227 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:52:14.857057 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4057/8178] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Jul 16 21:52:14 2022] POST /identity/v3/endpoints => generated 361 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:14.860743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be1ae2-f4cc-4b99-bc28-65ee7f5ca893 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:14.872349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be1ae2-f4cc-4b99-bc28-65ee7f5ca893 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:14.877650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:14.887540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222bd21-b23d-4f3e-bb06-4877f0da73f7 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e5497113a64e458d21cdae3144ceba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4a64e7079b2409189bb16e4de4178a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:14.888376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222bd21-b23d-4f3e-bb06-4877f0da73f7 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:14.888662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222bd21-b23d-4f3e-bb06-4877f0da73f7 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:14.888966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222bd21-b23d-4f3e-bb06-4877f0da73f7 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] PATH_INFO: `/v3/regions/tempest-region-1195396933` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:14.889613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222bd21-b23d-4f3e-bb06-4877f0da73f7 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1195396933)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:14.890691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222bd21-b23d-4f3e-bb06-4877f0da73f7 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:14.892614 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4122/8179] 10.222.0.16 () {58 vars in 1205 bytes} [Sat Jul 16 21:52:14 2022] GET /identity/v3/regions/tempest-region-1195396933 => generated 180 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:14.896805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd819de2-fd8d-47bf-876b-44465183c9ce tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:14.908013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd819de2-fd8d-47bf-876b-44465183c9ce tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:14.912681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22846e-c91d-4b01-a6ac-685b487dec0b tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e5497113a64e458d21cdae3144ceba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4a64e7079b2409189bb16e4de4178a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:14.913615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22846e-c91d-4b01-a6ac-685b487dec0b tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:14.913980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22846e-c91d-4b01-a6ac-685b487dec0b tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:14.914229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22846e-c91d-4b01-a6ac-685b487dec0b tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] PATH_INFO: `/v3/endpoints/d3c53bf212ec42d1bb42516a90526143` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:14.920351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22846e-c91d-4b01-a6ac-685b487dec0b tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=d3c53bf212ec42d1bb42516a90526143)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:14.921368 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-6b22846e-c91d-4b01-a6ac-685b487dec0b tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:52:14.921368 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:52:14.921368 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:52:14.922280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22846e-c91d-4b01-a6ac-685b487dec0b tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-6b22846e-c91d-4b01-a6ac-685b487dec0b tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: Failed validating 'type' in schema['properties']['enabled']: Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: {'enum': [True, False, None], 'type': 'boolean'} Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: On instance['enabled']: Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: Failed validating 'type' in schema['properties']['enabled']: Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: {'enum': [True, False, None], 'type': 'boolean'} Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: On instance['enabled']: Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: 'True' Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise error Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application On instance['enabled']: Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application 'True' Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:52:14.932726 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:52:14.934160 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:52:14.934160 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:52:14.934160 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:52:14.934160 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:52:14.934160 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:52:14.934160 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:52:14.934160 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:52:14.934160 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:52:14.934160 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:52:14.934160 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:52:14.934160 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:52:14.934160 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:52:14.934160 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jul 16 21:52:14.934160 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jul 16 21:52:14.934160 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 16 21:52:14.934160 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 16 21:52:14.934160 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 16 21:52:14.935045 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 16 21:52:14.935045 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 16 21:52:14.935045 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:52:14.935045 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 16 21:52:14.935045 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 16 21:52:14.935045 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:52:14.935045 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application On instance['enabled']: Jul 16 21:52:14.935045 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application 'True' Jul 16 21:52:14.935045 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:52:14.935045 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4058/8180] 10.222.0.16 () {60 vars in 1254 bytes} [Sat Jul 16 21:52:14 2022] PATCH /identity/v3/endpoints/d3c53bf212ec42d1bb42516a90526143 => generated 281 bytes in 38 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jul 16 21:52:14.938304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222bd21-b23d-4f3e-bb06-4877f0da73f7 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:14.948592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222bd21-b23d-4f3e-bb06-4877f0da73f7 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:14.953348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b239b-fe8f-4b6b-986c-b08b8f849a89 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e5497113a64e458d21cdae3144ceba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4a64e7079b2409189bb16e4de4178a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:14.954171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b239b-fe8f-4b6b-986c-b08b8f849a89 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:14.957188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b239b-fe8f-4b6b-986c-b08b8f849a89 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:14.957188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b239b-fe8f-4b6b-986c-b08b8f849a89 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] PATH_INFO: `/v3/endpoints/d3c53bf212ec42d1bb42516a90526143` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:14.957188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b239b-fe8f-4b6b-986c-b08b8f849a89 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=d3c53bf212ec42d1bb42516a90526143)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:14.957695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b239b-fe8f-4b6b-986c-b08b8f849a89 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:15.021597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-967b239b-fe8f-4b6b-986c-b08b8f849a89 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'd3c53bf212ec42d1bb42516a90526143', 'request_id': 'req-967b239b-fe8f-4b6b-986c-b08b8f849a89'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:15.031827 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4123/8181] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Jul 16 21:52:14 2022] DELETE /identity/v3/endpoints/d3c53bf212ec42d1bb42516a90526143 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:15.036032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22846e-c91d-4b01-a6ac-685b487dec0b tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:15.047701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22846e-c91d-4b01-a6ac-685b487dec0b tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:15.062547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14570750-9ac8-4b3d-8b48-ae2a93619bde tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e5497113a64e458d21cdae3144ceba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4a64e7079b2409189bb16e4de4178a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:15.063412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14570750-9ac8-4b3d-8b48-ae2a93619bde tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:15.063703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14570750-9ac8-4b3d-8b48-ae2a93619bde tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:15.064012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14570750-9ac8-4b3d-8b48-ae2a93619bde tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] PATH_INFO: `/v3/regions/tempest-region-1195396933` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:15.064661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14570750-9ac8-4b3d-8b48-ae2a93619bde tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1195396933)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:15.066258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14570750-9ac8-4b3d-8b48-ae2a93619bde tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:15.148927 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4059/8182] 10.222.0.16 () {58 vars in 1208 bytes} [Sat Jul 16 21:52:15 2022] DELETE /identity/v3/regions/tempest-region-1195396933 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:15.154580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b239b-fe8f-4b6b-986c-b08b8f849a89 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:15.165484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b239b-fe8f-4b6b-986c-b08b8f849a89 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:15.180235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9876a-bc87-43fc-80a4-13517f9b3cb0 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e5497113a64e458d21cdae3144ceba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4a64e7079b2409189bb16e4de4178a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:15.181075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9876a-bc87-43fc-80a4-13517f9b3cb0 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:15.181357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9876a-bc87-43fc-80a4-13517f9b3cb0 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:15.181630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9876a-bc87-43fc-80a4-13517f9b3cb0 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] PATH_INFO: `/v3/services/774f530ca0db479b816b1b009e536227` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:15.182277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9876a-bc87-43fc-80a4-13517f9b3cb0 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorizing `identity:delete_service(service_id=774f530ca0db479b816b1b009e536227)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:15.184079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9876a-bc87-43fc-80a4-13517f9b3cb0 tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:15.257163 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4124/8183] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:15 2022] DELETE /identity/v3/services/774f530ca0db479b816b1b009e536227 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:15.266401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14570750-9ac8-4b3d-8b48-ae2a93619bde tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:15.337980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14570750-9ac8-4b3d-8b48-ae2a93619bde tempest-EndpointsNegativeTestJSON-1861496816 tempest-EndpointsNegativeTestJSON-1861496816-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:15.353268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63a0dc-1d9b-45c1-9746-abf179b6af11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:15.354135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63a0dc-1d9b-45c1-9746-abf179b6af11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:15.354414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63a0dc-1d9b-45c1-9746-abf179b6af11 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:15.354712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63a0dc-1d9b-45c1-9746-abf179b6af11 admin admin] PATH_INFO: `/v3/users/0519b0f69bb1434db9060fedb76a1fe7` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:15.356181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63a0dc-1d9b-45c1-9746-abf179b6af11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0519b0f69bb1434db9060fedb76a1fe7)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:15.358095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63a0dc-1d9b-45c1-9746-abf179b6af11 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:15.552987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:15.554600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ba63a0dc-1d9b-45c1-9746-abf179b6af11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0519b0f69bb1434db9060fedb76a1fe7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:15.566947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ba63a0dc-1d9b-45c1-9746-abf179b6af11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0519b0f69bb1434db9060fedb76a1fe7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:15.655195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ba63a0dc-1d9b-45c1-9746-abf179b6af11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0519b0f69bb1434db9060fedb76a1fe7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:15.662414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ba63a0dc-1d9b-45c1-9746-abf179b6af11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0519b0f69bb1434db9060fedb76a1fe7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:15.663133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ba63a0dc-1d9b-45c1-9746-abf179b6af11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0519b0f69bb1434db9060fedb76a1fe7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:15.669180 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4060/8184] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:52:15 2022] DELETE /identity/v3/users/0519b0f69bb1434db9060fedb76a1fe7 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:15.673704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ccf13-7ec2-4ff3-85dc-5cc27d90e8af None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:15.674163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ccf13-7ec2-4ff3-85dc-5cc27d90e8af None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:15.674269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ccf13-7ec2-4ff3-85dc-5cc27d90e8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:15.692332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-669ccf13-7ec2-4ff3-85dc-5cc27d90e8af None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:15.693542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-669ccf13-7ec2-4ff3-85dc-5cc27d90e8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:15.752242 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4125/8185] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:15.763301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63a0dc-1d9b-45c1-9746-abf179b6af11 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:15.764680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ba63a0dc-1d9b-45c1-9746-abf179b6af11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:15.834504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63a0dc-1d9b-45c1-9746-abf179b6af11 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:15.838132 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2621d6-acdd-4770-b59d-66992ffab0d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:15.838784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2621d6-acdd-4770-b59d-66992ffab0d9 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:15.839148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2621d6-acdd-4770-b59d-66992ffab0d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:15.839423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2621d6-acdd-4770-b59d-66992ffab0d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:15.848850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2621d6-acdd-4770-b59d-66992ffab0d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:15.850342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2621d6-acdd-4770-b59d-66992ffab0d9 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:15.861036 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4061/8186] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:52:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:52:16.314182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ccf13-7ec2-4ff3-85dc-5cc27d90e8af None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:16.315642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-669ccf13-7ec2-4ff3-85dc-5cc27d90e8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:16.330713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ccf13-7ec2-4ff3-85dc-5cc27d90e8af None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:16.335651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e02e5-db62-4096-87d0-c297000463c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:16.336555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e02e5-db62-4096-87d0-c297000463c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:16.336838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e02e5-db62-4096-87d0-c297000463c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:16.337358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e02e5-db62-4096-87d0-c297000463c4 admin admin] PATH_INFO: `/v3/projects/61ab7742263b475d9c2de57ac3c1b470` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:16.338617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e02e5-db62-4096-87d0-c297000463c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61ab7742263b475d9c2de57ac3c1b470)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:16.341488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e02e5-db62-4096-87d0-c297000463c4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:16.455768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-709e02e5-db62-4096-87d0-c297000463c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61ab7742263b475d9c2de57ac3c1b470', 'request_id': 'req-709e02e5-db62-4096-87d0-c297000463c4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:16.462028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-709e02e5-db62-4096-87d0-c297000463c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61ab7742263b475d9c2de57ac3c1b470', 'request_id': 'req-709e02e5-db62-4096-87d0-c297000463c4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:16.468653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-709e02e5-db62-4096-87d0-c297000463c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61ab7742263b475d9c2de57ac3c1b470', 'request_id': 'req-709e02e5-db62-4096-87d0-c297000463c4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:16.546342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-709e02e5-db62-4096-87d0-c297000463c4 admin admin] The token cache is being invalidate because project 61ab7742263b475d9c2de57ac3c1b470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:16.546631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-709e02e5-db62-4096-87d0-c297000463c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:16.547281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-709e02e5-db62-4096-87d0-c297000463c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:16.548831 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4126/8187] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:16 2022] DELETE /identity/v3/projects/61ab7742263b475d9c2de57ac3c1b470 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:16.552991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2621d6-acdd-4770-b59d-66992ffab0d9 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:16.563089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2621d6-acdd-4770-b59d-66992ffab0d9 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:16.620787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6d8e9-b507-4797-b66a-206fce5e8a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:16.621619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6d8e9-b507-4797-b66a-206fce5e8a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:16.621903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6d8e9-b507-4797-b66a-206fce5e8a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:16.622181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6d8e9-b507-4797-b66a-206fce5e8a02 admin admin] PATH_INFO: `/v3/users/74e5497113a64e458d21cdae3144ceba` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:16.623413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6d8e9-b507-4797-b66a-206fce5e8a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e5497113a64e458d21cdae3144ceba)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:16.625341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6d8e9-b507-4797-b66a-206fce5e8a02 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:16.824908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0a6d8e9-b507-4797-b66a-206fce5e8a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e5497113a64e458d21cdae3144ceba'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:16.832913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:16.837812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0a6d8e9-b507-4797-b66a-206fce5e8a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e5497113a64e458d21cdae3144ceba'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:16.963333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0a6d8e9-b507-4797-b66a-206fce5e8a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e5497113a64e458d21cdae3144ceba'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:16.971347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0a6d8e9-b507-4797-b66a-206fce5e8a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e5497113a64e458d21cdae3144ceba'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:16.972291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b0a6d8e9-b507-4797-b66a-206fce5e8a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e5497113a64e458d21cdae3144ceba'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:16.978171 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4062/8188] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:52:16 2022] DELETE /identity/v3/users/74e5497113a64e458d21cdae3144ceba => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:17.371607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e02e5-db62-4096-87d0-c297000463c4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:17.377422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-709e02e5-db62-4096-87d0-c297000463c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:17.389169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e02e5-db62-4096-87d0-c297000463c4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:17.410940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:17.450048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bf4a0-7bf8-4ebf-af8b-cfdc722e5986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:17.450904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bf4a0-7bf8-4ebf-af8b-cfdc722e5986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:17.451256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bf4a0-7bf8-4ebf-af8b-cfdc722e5986 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:17.451531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bf4a0-7bf8-4ebf-af8b-cfdc722e5986 admin admin] PATH_INFO: `/v3/projects/d4a64e7079b2409189bb16e4de4178a8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:17.452721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bf4a0-7bf8-4ebf-af8b-cfdc722e5986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4a64e7079b2409189bb16e4de4178a8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:17.454677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bf4a0-7bf8-4ebf-af8b-cfdc722e5986 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:17.548698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-514bf4a0-7bf8-4ebf-af8b-cfdc722e5986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4a64e7079b2409189bb16e4de4178a8', 'request_id': 'req-514bf4a0-7bf8-4ebf-af8b-cfdc722e5986'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:17.554855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-514bf4a0-7bf8-4ebf-af8b-cfdc722e5986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4a64e7079b2409189bb16e4de4178a8', 'request_id': 'req-514bf4a0-7bf8-4ebf-af8b-cfdc722e5986'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:17.561044 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-514bf4a0-7bf8-4ebf-af8b-cfdc722e5986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4a64e7079b2409189bb16e4de4178a8', 'request_id': 'req-514bf4a0-7bf8-4ebf-af8b-cfdc722e5986'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:17.613809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-514bf4a0-7bf8-4ebf-af8b-cfdc722e5986 admin admin] The token cache is being invalidate because project d4a64e7079b2409189bb16e4de4178a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:17.614093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-514bf4a0-7bf8-4ebf-af8b-cfdc722e5986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:17.614722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-514bf4a0-7bf8-4ebf-af8b-cfdc722e5986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:17.616336 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4127/8189] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:17 2022] DELETE /identity/v3/projects/d4a64e7079b2409189bb16e4de4178a8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:17.621900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6248f3-88b3-4bcb-bb82-139528b68852 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:17.622196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6248f3-88b3-4bcb-bb82-139528b68852 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:17.622477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6248f3-88b3-4bcb-bb82-139528b68852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:17.640226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ae6248f3-88b3-4bcb-bb82-139528b68852 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:17.641566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ae6248f3-88b3-4bcb-bb82-139528b68852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:17.701113 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4063/8190] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:17.708922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c42d6c-11b3-4598-9a13-3bad662a2135 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:17.709215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c42d6c-11b3-4598-9a13-3bad662a2135 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:17.709498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c42d6c-11b3-4598-9a13-3bad662a2135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:17.728174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-19c42d6c-11b3-4598-9a13-3bad662a2135 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:17.729370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-19c42d6c-11b3-4598-9a13-3bad662a2135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:17.737862 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4128/8191] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:17.741952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6248f3-88b3-4bcb-bb82-139528b68852 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:17.752365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6248f3-88b3-4bcb-bb82-139528b68852 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:17.756981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf43d6-37a6-408d-a463-5ab09b9585e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:17.757634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf43d6-37a6-408d-a463-5ab09b9585e6 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:17.757921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf43d6-37a6-408d-a463-5ab09b9585e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:17.758199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf43d6-37a6-408d-a463-5ab09b9585e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:17.758922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf43d6-37a6-408d-a463-5ab09b9585e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:52:17.759283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf43d6-37a6-408d-a463-5ab09b9585e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:17.760929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf43d6-37a6-408d-a463-5ab09b9585e6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:17.772409 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4064/8192] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:52:17.776955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c42d6c-11b3-4598-9a13-3bad662a2135 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:17.786642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c42d6c-11b3-4598-9a13-3bad662a2135 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:17.791311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75da4c9-ae5d-4202-a900-d9084a6d0dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:17.791958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75da4c9-ae5d-4202-a900-d9084a6d0dec admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:17.792805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75da4c9-ae5d-4202-a900-d9084a6d0dec admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:17.793153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75da4c9-ae5d-4202-a900-d9084a6d0dec admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:17.793774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75da4c9-ae5d-4202-a900-d9084a6d0dec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:17.795717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75da4c9-ae5d-4202-a900-d9084a6d0dec admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:17.910962 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4129/8193] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:17 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:17.915168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf43d6-37a6-408d-a463-5ab09b9585e6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:17.926444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf43d6-37a6-408d-a463-5ab09b9585e6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:17.983221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32087c41-1b3f-4857-9bfb-eec4228cb84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:17.983964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32087c41-1b3f-4857-9bfb-eec4228cb84a admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:17.984155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32087c41-1b3f-4857-9bfb-eec4228cb84a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:17.984428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32087c41-1b3f-4857-9bfb-eec4228cb84a admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:17.985103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32087c41-1b3f-4857-9bfb-eec4228cb84a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:17.987039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32087c41-1b3f-4857-9bfb-eec4228cb84a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:18.079520 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4065/8194] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:52:17 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:18.083588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75da4c9-ae5d-4202-a900-d9084a6d0dec admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:18.094749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75da4c9-ae5d-4202-a900-d9084a6d0dec admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:18.099700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e971c7-edba-4199-a74a-276a30d8c1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:18.100348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e971c7-edba-4199-a74a-276a30d8c1ef admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:18.101181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e971c7-edba-4199-a74a-276a30d8c1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:18.101181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e971c7-edba-4199-a74a-276a30d8c1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:18.101771 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e971c7-edba-4199-a74a-276a30d8c1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:18.103403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e971c7-edba-4199-a74a-276a30d8c1ef admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:18.115722 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4130/8195] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:18.119775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32087c41-1b3f-4857-9bfb-eec4228cb84a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:18.130095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32087c41-1b3f-4857-9bfb-eec4228cb84a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:18.134826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cd4fa-290e-4afd-8af1-ecfd52b5423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:18.135513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cd4fa-290e-4afd-8af1-ecfd52b5423b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:18.136293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cd4fa-290e-4afd-8af1-ecfd52b5423b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:18.136789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cd4fa-290e-4afd-8af1-ecfd52b5423b admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:18.137545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cd4fa-290e-4afd-8af1-ecfd52b5423b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:18.139193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cd4fa-290e-4afd-8af1-ecfd52b5423b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:18.149190 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4066/8196] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:18.154445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e971c7-edba-4199-a74a-276a30d8c1ef admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:18.164381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e971c7-edba-4199-a74a-276a30d8c1ef admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:18.169261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841eb85-5d3a-4d94-a5be-ff660eb14d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:18.170135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841eb85-5d3a-4d94-a5be-ff660eb14d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:18.170402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841eb85-5d3a-4d94-a5be-ff660eb14d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:18.170676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841eb85-5d3a-4d94-a5be-ff660eb14d08 admin admin] PATH_INFO: `/v3/projects/0a625e98cbc142ff998d94ef965bd851/users/0527f827d68d437d90848343599b9627/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:18.185020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841eb85-5d3a-4d94-a5be-ff660eb14d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a625e98cbc142ff998d94ef965bd851, user_id=0527f827d68d437d90848343599b9627, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:18.187707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841eb85-5d3a-4d94-a5be-ff660eb14d08 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:18.267246 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4131/8197] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:52:18 2022] PUT /identity/v3/projects/0a625e98cbc142ff998d94ef965bd851/users/0527f827d68d437d90848343599b9627/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:18.279121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c565d-e8aa-4730-a5ce-7467f3fb4f33 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:18.279406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c565d-e8aa-4730-a5ce-7467f3fb4f33 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:18.279693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c565d-e8aa-4730-a5ce-7467f3fb4f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:18.306323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b44c565d-e8aa-4730-a5ce-7467f3fb4f33 None None] MFA Rules not processed for user `0527f827d68d437d90848343599b9627`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:18.309635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b44c565d-e8aa-4730-a5ce-7467f3fb4f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:18.338354 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:18.372861 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4067/8198] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:18.377408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841eb85-5d3a-4d94-a5be-ff660eb14d08 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:18.429010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:18.440629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841eb85-5d3a-4d94-a5be-ff660eb14d08 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:18.445589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa52033-816c-48d9-8e0e-746993db53a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:18.446275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa52033-816c-48d9-8e0e-746993db53a6 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:18.446565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa52033-816c-48d9-8e0e-746993db53a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:18.446843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa52033-816c-48d9-8e0e-746993db53a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:18.447573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa52033-816c-48d9-8e0e-746993db53a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:18.450300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa52033-816c-48d9-8e0e-746993db53a6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:18.554989 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4132/8199] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:18 2022] POST /identity/v3/projects => generated 375 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:18.559881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c565d-e8aa-4730-a5ce-7467f3fb4f33 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:18.570792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c565d-e8aa-4730-a5ce-7467f3fb4f33 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:18.628287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8365b-3c4a-4774-ac6b-0197d13e92ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:18.628913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8365b-3c4a-4774-ac6b-0197d13e92ee admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:18.629195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8365b-3c4a-4774-ac6b-0197d13e92ee admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:18.629472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8365b-3c4a-4774-ac6b-0197d13e92ee admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:18.630168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8365b-3c4a-4774-ac6b-0197d13e92ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:18.632158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8365b-3c4a-4774-ac6b-0197d13e92ee admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:18.703266 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4068/8200] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:52:18 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:52:18.707334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa52033-816c-48d9-8e0e-746993db53a6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:18.718017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa52033-816c-48d9-8e0e-746993db53a6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:18.722899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9b815-a580-46f4-95e8-395ae3bd8841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:18.723580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9b815-a580-46f4-95e8-395ae3bd8841 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:18.723858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9b815-a580-46f4-95e8-395ae3bd8841 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:18.724171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9b815-a580-46f4-95e8-395ae3bd8841 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:18.724886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9b815-a580-46f4-95e8-395ae3bd8841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:18.726855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9b815-a580-46f4-95e8-395ae3bd8841 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:18.737668 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4133/8201] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:18.741834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8365b-3c4a-4774-ac6b-0197d13e92ee admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:18.752485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8365b-3c4a-4774-ac6b-0197d13e92ee admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:18.757149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27227a6-0127-40e8-8545-a110d4d2d12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:18.758019 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27227a6-0127-40e8-8545-a110d4d2d12e admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:18.758302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27227a6-0127-40e8-8545-a110d4d2d12e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:18.758614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27227a6-0127-40e8-8545-a110d4d2d12e admin admin] PATH_INFO: `/v3/projects/ccb0e6f05a984ae4974bbbf6dff92758/users/214c215431bc4984968d29ed2a349d15/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:18.775611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27227a6-0127-40e8-8545-a110d4d2d12e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb0e6f05a984ae4974bbbf6dff92758, user_id=214c215431bc4984968d29ed2a349d15, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:18.778668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27227a6-0127-40e8-8545-a110d4d2d12e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:18.822141 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4069/8202] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:52:18 2022] PUT /identity/v3/projects/ccb0e6f05a984ae4974bbbf6dff92758/users/214c215431bc4984968d29ed2a349d15/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:18.826921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9b815-a580-46f4-95e8-395ae3bd8841 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:18.837361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9b815-a580-46f4-95e8-395ae3bd8841 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:18.893969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93710a38-45b8-40f4-a716-7e6f570c1d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:18.894632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93710a38-45b8-40f4-a716-7e6f570c1d01 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:18.894912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93710a38-45b8-40f4-a716-7e6f570c1d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:18.895215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93710a38-45b8-40f4-a716-7e6f570c1d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:18.895932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93710a38-45b8-40f4-a716-7e6f570c1d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:18.897528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93710a38-45b8-40f4-a716-7e6f570c1d01 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:18.907181 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4134/8203] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:18.911342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27227a6-0127-40e8-8545-a110d4d2d12e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:18.922287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27227a6-0127-40e8-8545-a110d4d2d12e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:18.926885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1778a3-cdd1-4c74-8978-51f1234de28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:18.927793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1778a3-cdd1-4c74-8978-51f1234de28b admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:18.928067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1778a3-cdd1-4c74-8978-51f1234de28b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:18.928336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1778a3-cdd1-4c74-8978-51f1234de28b admin admin] PATH_INFO: `/v3/projects/ccb0e6f05a984ae4974bbbf6dff92758/users/214c215431bc4984968d29ed2a349d15/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:18.930304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1778a3-cdd1-4c74-8978-51f1234de28b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb0e6f05a984ae4974bbbf6dff92758, user_id=214c215431bc4984968d29ed2a349d15, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:18.933852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1778a3-cdd1-4c74-8978-51f1234de28b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:18.944018 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4070/8204] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:52:18 2022] PUT /identity/v3/projects/ccb0e6f05a984ae4974bbbf6dff92758/users/214c215431bc4984968d29ed2a349d15/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:18.954430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3ddf1-19a6-4f5e-a845-42a35ab2c1ba None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:18.954656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3ddf1-19a6-4f5e-a845-42a35ab2c1ba None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:18.954931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3ddf1-19a6-4f5e-a845-42a35ab2c1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:18.982050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c1f3ddf1-19a6-4f5e-a845-42a35ab2c1ba None None] MFA Rules not processed for user `214c215431bc4984968d29ed2a349d15`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:18.983293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c1f3ddf1-19a6-4f5e-a845-42a35ab2c1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:19.049219 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4135/8205] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:52:19.055513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1778a3-cdd1-4c74-8978-51f1234de28b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:19.067126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1778a3-cdd1-4c74-8978-51f1234de28b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:19.071758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7ee69-f600-4d20-b1bb-f5a741d57d98 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214c215431bc4984968d29ed2a349d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccb0e6f05a984ae4974bbbf6dff92758', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:19.072424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7ee69-f600-4d20-b1bb-f5a741d57d98 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:19.072709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7ee69-f600-4d20-b1bb-f5a741d57d98 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:19.072989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7ee69-f600-4d20-b1bb-f5a741d57d98 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:19.073758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7ee69-f600-4d20-b1bb-f5a741d57d98 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:19.075675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7ee69-f600-4d20-b1bb-f5a741d57d98 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:19.143199 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4071/8206] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:19 2022] POST /identity/v3/projects => generated 333 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:52:19.147175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3ddf1-19a6-4f5e-a845-42a35ab2c1ba None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:19.156815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3ddf1-19a6-4f5e-a845-42a35ab2c1ba None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:19.202636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:19.215896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acf867-b743-4487-86be-b031ac6fcb42 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214c215431bc4984968d29ed2a349d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccb0e6f05a984ae4974bbbf6dff92758', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:19.216494 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acf867-b743-4487-86be-b031ac6fcb42 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:19.216783 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acf867-b743-4487-86be-b031ac6fcb42 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:19.217066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acf867-b743-4487-86be-b031ac6fcb42 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:19.217732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acf867-b743-4487-86be-b031ac6fcb42 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:19.219713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acf867-b743-4487-86be-b031ac6fcb42 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:19.311236 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4136/8207] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Jul 16 21:52:19 2022] POST /identity/v3/projects => generated 332 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:19.315253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7ee69-f600-4d20-b1bb-f5a741d57d98 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:19.325618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7ee69-f600-4d20-b1bb-f5a741d57d98 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:19.382461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea41384-428a-4380-9d8e-f05d438b19df tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214c215431bc4984968d29ed2a349d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccb0e6f05a984ae4974bbbf6dff92758', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:19.383155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea41384-428a-4380-9d8e-f05d438b19df tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:19.383445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea41384-428a-4380-9d8e-f05d438b19df tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:19.383728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea41384-428a-4380-9d8e-f05d438b19df tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:19.384411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea41384-428a-4380-9d8e-f05d438b19df tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:19.386598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea41384-428a-4380-9d8e-f05d438b19df tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:19.391378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:19.511452 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4072/8208] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:19 2022] POST /identity/v3/projects => generated 357 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:52:19.516006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acf867-b743-4487-86be-b031ac6fcb42 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:19.527768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acf867-b743-4487-86be-b031ac6fcb42 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:19.585003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43bbb1-fe71-4f08-a428-301e22cdfd89 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214c215431bc4984968d29ed2a349d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccb0e6f05a984ae4974bbbf6dff92758', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:19.585679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43bbb1-fe71-4f08-a428-301e22cdfd89 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:19.585955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43bbb1-fe71-4f08-a428-301e22cdfd89 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:19.586233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43bbb1-fe71-4f08-a428-301e22cdfd89 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:19.586992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43bbb1-fe71-4f08-a428-301e22cdfd89 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:19.590125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43bbb1-fe71-4f08-a428-301e22cdfd89 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:19.607686 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4137/8209] 10.222.0.16 () {58 vars in 1130 bytes} [Sat Jul 16 21:52:19 2022] GET /identity/v3/projects => generated 4261 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:19.612778 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea41384-428a-4380-9d8e-f05d438b19df tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:19.623518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea41384-428a-4380-9d8e-f05d438b19df tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:19.628153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581c264-30b5-4b3e-81fd-23fa833bbb86 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214c215431bc4984968d29ed2a349d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccb0e6f05a984ae4974bbbf6dff92758', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:19.628799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581c264-30b5-4b3e-81fd-23fa833bbb86 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:19.629081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581c264-30b5-4b3e-81fd-23fa833bbb86 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:19.629358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581c264-30b5-4b3e-81fd-23fa833bbb86 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:19.630108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581c264-30b5-4b3e-81fd-23fa833bbb86 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:52:19.630421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581c264-30b5-4b3e-81fd-23fa833bbb86 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:19.631636 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-0581c264-30b5-4b3e-81fd-23fa833bbb86 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:52:19.631636 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:52:19.631636 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:52:19.632770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581c264-30b5-4b3e-81fd-23fa833bbb86 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:19.651170 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4073/8210] 10.222.0.16 () {58 vars in 1157 bytes} [Sat Jul 16 21:52:19 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:19.656907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43bbb1-fe71-4f08-a428-301e22cdfd89 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:19.667106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43bbb1-fe71-4f08-a428-301e22cdfd89 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:19.671963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395fe3a-f614-4122-85c8-c674bd2073b7 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214c215431bc4984968d29ed2a349d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccb0e6f05a984ae4974bbbf6dff92758', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:19.672621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395fe3a-f614-4122-85c8-c674bd2073b7 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:19.672894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395fe3a-f614-4122-85c8-c674bd2073b7 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:19.673199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395fe3a-f614-4122-85c8-c674bd2073b7 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:19.673952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395fe3a-f614-4122-85c8-c674bd2073b7 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: Adding query filter params (parent_id=4bfa1ea6c7134e7cb312aad24a9dbba7) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:52:19.674267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395fe3a-f614-4122-85c8-c674bd2073b7 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:19.676168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395fe3a-f614-4122-85c8-c674bd2073b7 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:19.694252 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4138/8211] 10.222.0.16 () {58 vars in 1215 bytes} [Sat Jul 16 21:52:19 2022] GET /identity/v3/projects?parent_id=4bfa1ea6c7134e7cb312aad24a9dbba7 => generated 497 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:19.699938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581c264-30b5-4b3e-81fd-23fa833bbb86 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:19.709978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581c264-30b5-4b3e-81fd-23fa833bbb86 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:19.715381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067585f2-9a00-44e6-a499-a40efaf861e6 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214c215431bc4984968d29ed2a349d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccb0e6f05a984ae4974bbbf6dff92758', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:19.716223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067585f2-9a00-44e6-a499-a40efaf861e6 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:19.716513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067585f2-9a00-44e6-a499-a40efaf861e6 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:19.716793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067585f2-9a00-44e6-a499-a40efaf861e6 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] PATH_INFO: `/v3/projects/4c35421dc6164207944319f3264b916b` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:19.717987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067585f2-9a00-44e6-a499-a40efaf861e6 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4c35421dc6164207944319f3264b916b)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:19.719949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067585f2-9a00-44e6-a499-a40efaf861e6 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:19.852214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-067585f2-9a00-44e6-a499-a40efaf861e6 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c35421dc6164207944319f3264b916b', 'request_id': 'req-067585f2-9a00-44e6-a499-a40efaf861e6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:19.857748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-067585f2-9a00-44e6-a499-a40efaf861e6 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c35421dc6164207944319f3264b916b', 'request_id': 'req-067585f2-9a00-44e6-a499-a40efaf861e6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:19.864134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-067585f2-9a00-44e6-a499-a40efaf861e6 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c35421dc6164207944319f3264b916b', 'request_id': 'req-067585f2-9a00-44e6-a499-a40efaf861e6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:19.941591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-067585f2-9a00-44e6-a499-a40efaf861e6 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] The token cache is being invalidate because project 4c35421dc6164207944319f3264b916b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:19.941887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-067585f2-9a00-44e6-a499-a40efaf861e6 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:19.942649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-067585f2-9a00-44e6-a499-a40efaf861e6 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:19.944344 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4074/8212] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:19 2022] DELETE /identity/v3/projects/4c35421dc6164207944319f3264b916b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:19.948931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395fe3a-f614-4122-85c8-c674bd2073b7 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:19.950946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d395fe3a-f614-4122-85c8-c674bd2073b7 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:19.964803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395fe3a-f614-4122-85c8-c674bd2073b7 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:20.021305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799d5ae-4693-4878-a0d6-20a50ff12341 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214c215431bc4984968d29ed2a349d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccb0e6f05a984ae4974bbbf6dff92758', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:20.022157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799d5ae-4693-4878-a0d6-20a50ff12341 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:20.022444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799d5ae-4693-4878-a0d6-20a50ff12341 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:20.022722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799d5ae-4693-4878-a0d6-20a50ff12341 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] PATH_INFO: `/v3/projects/4bfa1ea6c7134e7cb312aad24a9dbba7` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:20.023956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799d5ae-4693-4878-a0d6-20a50ff12341 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4bfa1ea6c7134e7cb312aad24a9dbba7)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:20.025880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799d5ae-4693-4878-a0d6-20a50ff12341 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:20.137632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b799d5ae-4693-4878-a0d6-20a50ff12341 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bfa1ea6c7134e7cb312aad24a9dbba7', 'request_id': 'req-b799d5ae-4693-4878-a0d6-20a50ff12341'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:20.143759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b799d5ae-4693-4878-a0d6-20a50ff12341 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bfa1ea6c7134e7cb312aad24a9dbba7', 'request_id': 'req-b799d5ae-4693-4878-a0d6-20a50ff12341'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:20.144985 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:20.149780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b799d5ae-4693-4878-a0d6-20a50ff12341 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bfa1ea6c7134e7cb312aad24a9dbba7', 'request_id': 'req-b799d5ae-4693-4878-a0d6-20a50ff12341'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:20.221173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b799d5ae-4693-4878-a0d6-20a50ff12341 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] The token cache is being invalidate because project 4bfa1ea6c7134e7cb312aad24a9dbba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:20.221462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b799d5ae-4693-4878-a0d6-20a50ff12341 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:20.222428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b799d5ae-4693-4878-a0d6-20a50ff12341 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:20.224266 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4139/8213] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:19 2022] DELETE /identity/v3/projects/4bfa1ea6c7134e7cb312aad24a9dbba7 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:20.228348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067585f2-9a00-44e6-a499-a40efaf861e6 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:20.240072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067585f2-9a00-44e6-a499-a40efaf861e6 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:20.298308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47adbf6-25fc-4911-87ae-ce8da1192cbc tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214c215431bc4984968d29ed2a349d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccb0e6f05a984ae4974bbbf6dff92758', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:20.299211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47adbf6-25fc-4911-87ae-ce8da1192cbc tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:20.299499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47adbf6-25fc-4911-87ae-ce8da1192cbc tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:20.299774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47adbf6-25fc-4911-87ae-ce8da1192cbc tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] PATH_INFO: `/v3/projects/d1b778053ad04597a8ea3cd7f4fc45d4` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:20.300952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47adbf6-25fc-4911-87ae-ce8da1192cbc tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d1b778053ad04597a8ea3cd7f4fc45d4)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:20.302857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47adbf6-25fc-4911-87ae-ce8da1192cbc tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:20.415084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d47adbf6-25fc-4911-87ae-ce8da1192cbc tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b778053ad04597a8ea3cd7f4fc45d4', 'request_id': 'req-d47adbf6-25fc-4911-87ae-ce8da1192cbc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:20.416938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:20.421078 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d47adbf6-25fc-4911-87ae-ce8da1192cbc tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b778053ad04597a8ea3cd7f4fc45d4', 'request_id': 'req-d47adbf6-25fc-4911-87ae-ce8da1192cbc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:20.427114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d47adbf6-25fc-4911-87ae-ce8da1192cbc tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b778053ad04597a8ea3cd7f4fc45d4', 'request_id': 'req-d47adbf6-25fc-4911-87ae-ce8da1192cbc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:20.505565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d47adbf6-25fc-4911-87ae-ce8da1192cbc tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] The token cache is being invalidate because project d1b778053ad04597a8ea3cd7f4fc45d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:20.505872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d47adbf6-25fc-4911-87ae-ce8da1192cbc tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:20.506520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d47adbf6-25fc-4911-87ae-ce8da1192cbc tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:20.508179 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4075/8214] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:20 2022] DELETE /identity/v3/projects/d1b778053ad04597a8ea3cd7f4fc45d4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:20.512903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799d5ae-4693-4878-a0d6-20a50ff12341 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:20.514388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b799d5ae-4693-4878-a0d6-20a50ff12341 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:20.580006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799d5ae-4693-4878-a0d6-20a50ff12341 tempest-ListProjectsTestJSON-998438919 tempest-ListProjectsTestJSON-998438919-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:20.635368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d78a29-ff93-4fb6-85a6-1d7a2a3f1f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:20.636740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d78a29-ff93-4fb6-85a6-1d7a2a3f1f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:20.637017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d78a29-ff93-4fb6-85a6-1d7a2a3f1f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:20.637289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d78a29-ff93-4fb6-85a6-1d7a2a3f1f2e admin admin] PATH_INFO: `/v3/users/0527f827d68d437d90848343599b9627` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:20.638484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d78a29-ff93-4fb6-85a6-1d7a2a3f1f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0527f827d68d437d90848343599b9627)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:20.640433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d78a29-ff93-4fb6-85a6-1d7a2a3f1f2e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:20.829998 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b6d78a29-ff93-4fb6-85a6-1d7a2a3f1f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0527f827d68d437d90848343599b9627'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:20.836936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b6d78a29-ff93-4fb6-85a6-1d7a2a3f1f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0527f827d68d437d90848343599b9627'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:20.907663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b6d78a29-ff93-4fb6-85a6-1d7a2a3f1f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0527f827d68d437d90848343599b9627'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:20.908334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b6d78a29-ff93-4fb6-85a6-1d7a2a3f1f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0527f827d68d437d90848343599b9627'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:20.921592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b6d78a29-ff93-4fb6-85a6-1d7a2a3f1f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0527f827d68d437d90848343599b9627'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:20.927595 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4140/8215] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:52:20 2022] DELETE /identity/v3/users/0527f827d68d437d90848343599b9627 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:20.932334 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20490e72-db5c-438b-8495-270e4709e10a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:20.933114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20490e72-db5c-438b-8495-270e4709e10a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:20.933539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20490e72-db5c-438b-8495-270e4709e10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:20.951820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-20490e72-db5c-438b-8495-270e4709e10a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:20.953274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-20490e72-db5c-438b-8495-270e4709e10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:21.012510 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4076/8216] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:52:21.022087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d78a29-ff93-4fb6-85a6-1d7a2a3f1f2e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:21.023528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b6d78a29-ff93-4fb6-85a6-1d7a2a3f1f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:21.034757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:21.083523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d78a29-ff93-4fb6-85a6-1d7a2a3f1f2e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:21.087116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc8043-0df1-4a06-814d-b8520fdd0847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:21.087756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc8043-0df1-4a06-814d-b8520fdd0847 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:21.088040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc8043-0df1-4a06-814d-b8520fdd0847 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:21.088317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc8043-0df1-4a06-814d-b8520fdd0847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:21.097977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc8043-0df1-4a06-814d-b8520fdd0847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:21.099457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc8043-0df1-4a06-814d-b8520fdd0847 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:21.109636 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4141/8217] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:52:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:52:21.482165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20490e72-db5c-438b-8495-270e4709e10a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:21.483643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-20490e72-db5c-438b-8495-270e4709e10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:21.496554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20490e72-db5c-438b-8495-270e4709e10a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:21.501257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5061c99-0e65-4263-a69f-d82a41b255b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:21.502126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5061c99-0e65-4263-a69f-d82a41b255b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:21.502473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5061c99-0e65-4263-a69f-d82a41b255b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:21.502718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5061c99-0e65-4263-a69f-d82a41b255b4 admin admin] PATH_INFO: `/v3/projects/0a625e98cbc142ff998d94ef965bd851` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:21.503964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5061c99-0e65-4263-a69f-d82a41b255b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a625e98cbc142ff998d94ef965bd851)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:21.505900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5061c99-0e65-4263-a69f-d82a41b255b4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:21.606863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a5061c99-0e65-4263-a69f-d82a41b255b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a625e98cbc142ff998d94ef965bd851', 'request_id': 'req-a5061c99-0e65-4263-a69f-d82a41b255b4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:21.612240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a5061c99-0e65-4263-a69f-d82a41b255b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a625e98cbc142ff998d94ef965bd851', 'request_id': 'req-a5061c99-0e65-4263-a69f-d82a41b255b4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:21.618288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a5061c99-0e65-4263-a69f-d82a41b255b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a625e98cbc142ff998d94ef965bd851', 'request_id': 'req-a5061c99-0e65-4263-a69f-d82a41b255b4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:21.667689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a5061c99-0e65-4263-a69f-d82a41b255b4 admin admin] The token cache is being invalidate because project 0a625e98cbc142ff998d94ef965bd851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:21.667984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a5061c99-0e65-4263-a69f-d82a41b255b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:21.668616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a5061c99-0e65-4263-a69f-d82a41b255b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:21.670210 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4077/8218] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:21 2022] DELETE /identity/v3/projects/0a625e98cbc142ff998d94ef965bd851 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:21.674317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc8043-0df1-4a06-814d-b8520fdd0847 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:21.684641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc8043-0df1-4a06-814d-b8520fdd0847 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:21.740782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfcb35-895e-461c-b4f6-0d7678697c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:21.741644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfcb35-895e-461c-b4f6-0d7678697c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:21.741924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfcb35-895e-461c-b4f6-0d7678697c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:21.742196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfcb35-895e-461c-b4f6-0d7678697c56 admin admin] PATH_INFO: `/v3/users/214c215431bc4984968d29ed2a349d15` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:21.743409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfcb35-895e-461c-b4f6-0d7678697c56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=214c215431bc4984968d29ed2a349d15)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:21.745375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfcb35-895e-461c-b4f6-0d7678697c56 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:21.917072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-94cfcb35-895e-461c-b4f6-0d7678697c56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '214c215431bc4984968d29ed2a349d15'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:21.925102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-94cfcb35-895e-461c-b4f6-0d7678697c56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '214c215431bc4984968d29ed2a349d15'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:21.999230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-94cfcb35-895e-461c-b4f6-0d7678697c56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '214c215431bc4984968d29ed2a349d15'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:21.999848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-94cfcb35-895e-461c-b4f6-0d7678697c56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '214c215431bc4984968d29ed2a349d15'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:22.012661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-94cfcb35-895e-461c-b4f6-0d7678697c56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '214c215431bc4984968d29ed2a349d15'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:22.018936 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4142/8219] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:52:21 2022] DELETE /identity/v3/users/214c215431bc4984968d29ed2a349d15 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:22.452837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5061c99-0e65-4263-a69f-d82a41b255b4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:22.454326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a5061c99-0e65-4263-a69f-d82a41b255b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:22.468770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5061c99-0e65-4263-a69f-d82a41b255b4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:22.527852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ae67b-9c03-408f-b44c-a199cc539bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:22.528722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ae67b-9c03-408f-b44c-a199cc539bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:22.529007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ae67b-9c03-408f-b44c-a199cc539bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:22.529286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ae67b-9c03-408f-b44c-a199cc539bf1 admin admin] PATH_INFO: `/v3/projects/ccb0e6f05a984ae4974bbbf6dff92758` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:22.530476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ae67b-9c03-408f-b44c-a199cc539bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccb0e6f05a984ae4974bbbf6dff92758)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:22.532423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ae67b-9c03-408f-b44c-a199cc539bf1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:22.538707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:22.674364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-974ae67b-9c03-408f-b44c-a199cc539bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccb0e6f05a984ae4974bbbf6dff92758', 'request_id': 'req-974ae67b-9c03-408f-b44c-a199cc539bf1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:22.679693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-974ae67b-9c03-408f-b44c-a199cc539bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccb0e6f05a984ae4974bbbf6dff92758', 'request_id': 'req-974ae67b-9c03-408f-b44c-a199cc539bf1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:22.686593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-974ae67b-9c03-408f-b44c-a199cc539bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccb0e6f05a984ae4974bbbf6dff92758', 'request_id': 'req-974ae67b-9c03-408f-b44c-a199cc539bf1'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:22.775984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-974ae67b-9c03-408f-b44c-a199cc539bf1 admin admin] The token cache is being invalidate because project ccb0e6f05a984ae4974bbbf6dff92758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:22.776201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-974ae67b-9c03-408f-b44c-a199cc539bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:22.776825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-974ae67b-9c03-408f-b44c-a199cc539bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:22.778671 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4078/8220] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:22 2022] DELETE /identity/v3/projects/ccb0e6f05a984ae4974bbbf6dff92758 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:22.783984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd37363-02ac-4deb-b643-c242a3307366 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:22.784445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd37363-02ac-4deb-b643-c242a3307366 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:22.784567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd37363-02ac-4deb-b643-c242a3307366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:22.804520 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3bd37363-02ac-4deb-b643-c242a3307366 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:22.805706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3bd37363-02ac-4deb-b643-c242a3307366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:22.833779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:22.868395 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4143/8221] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:22.877230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7017407-93bc-4094-9828-66742c6cdfd2 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:22.877528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7017407-93bc-4094-9828-66742c6cdfd2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:22.877814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7017407-93bc-4094-9828-66742c6cdfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:22.897903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e7017407-93bc-4094-9828-66742c6cdfd2 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:22.899090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e7017407-93bc-4094-9828-66742c6cdfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:22.907704 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4079/8222] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:22.912165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd37363-02ac-4deb-b643-c242a3307366 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:22.922763 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd37363-02ac-4deb-b643-c242a3307366 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:22.928162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ab47b-eb50-4a98-bbc1-0238dad33783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:22.928841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ab47b-eb50-4a98-bbc1-0238dad33783 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:22.929129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ab47b-eb50-4a98-bbc1-0238dad33783 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:22.929407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ab47b-eb50-4a98-bbc1-0238dad33783 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:22.930134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ab47b-eb50-4a98-bbc1-0238dad33783 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:52:22.930443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ab47b-eb50-4a98-bbc1-0238dad33783 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:22.932089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ab47b-eb50-4a98-bbc1-0238dad33783 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:22.944423 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4144/8223] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:22.948734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7017407-93bc-4094-9828-66742c6cdfd2 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:22.958157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7017407-93bc-4094-9828-66742c6cdfd2 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:22.962865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77475ce6-12a3-4f93-9a97-1dd9ad06feeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:22.963565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77475ce6-12a3-4f93-9a97-1dd9ad06feeb admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:22.963836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77475ce6-12a3-4f93-9a97-1dd9ad06feeb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:22.964115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77475ce6-12a3-4f93-9a97-1dd9ad06feeb admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:22.965320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77475ce6-12a3-4f93-9a97-1dd9ad06feeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:22.967391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77475ce6-12a3-4f93-9a97-1dd9ad06feeb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:23.052712 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4080/8224] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:22 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:23.056629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ab47b-eb50-4a98-bbc1-0238dad33783 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:23.066801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ab47b-eb50-4a98-bbc1-0238dad33783 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:23.124114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5605e-9ae1-4ccc-a3c2-dc29b18527fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:23.124782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5605e-9ae1-4ccc-a3c2-dc29b18527fe admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:23.125070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5605e-9ae1-4ccc-a3c2-dc29b18527fe admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:23.125353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5605e-9ae1-4ccc-a3c2-dc29b18527fe admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:23.126149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5605e-9ae1-4ccc-a3c2-dc29b18527fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:23.128156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5605e-9ae1-4ccc-a3c2-dc29b18527fe admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:23.215978 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4145/8225] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:52:23 2022] POST /identity/v3/users => generated 284 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:23.220129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77475ce6-12a3-4f93-9a97-1dd9ad06feeb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:23.231965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77475ce6-12a3-4f93-9a97-1dd9ad06feeb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:23.237626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4772bd-08af-4655-a53f-05ec092a6b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:23.238336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4772bd-08af-4655-a53f-05ec092a6b01 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:23.238619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4772bd-08af-4655-a53f-05ec092a6b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:23.238897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4772bd-08af-4655-a53f-05ec092a6b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:23.240247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4772bd-08af-4655-a53f-05ec092a6b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:23.242055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4772bd-08af-4655-a53f-05ec092a6b01 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:23.253734 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4081/8226] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:23.257793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5605e-9ae1-4ccc-a3c2-dc29b18527fe admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:23.268487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5605e-9ae1-4ccc-a3c2-dc29b18527fe admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:23.273369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72518198-659c-4489-bfc4-f09fe47c9743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:23.274024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72518198-659c-4489-bfc4-f09fe47c9743 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:23.274305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72518198-659c-4489-bfc4-f09fe47c9743 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:23.274582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72518198-659c-4489-bfc4-f09fe47c9743 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:23.275343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72518198-659c-4489-bfc4-f09fe47c9743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:23.276935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72518198-659c-4489-bfc4-f09fe47c9743 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:23.288395 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4146/8227] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:23.292442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4772bd-08af-4655-a53f-05ec092a6b01 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:23.303570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4772bd-08af-4655-a53f-05ec092a6b01 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:23.308219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c93699-e68b-40bf-990d-079ac4a2048d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:23.309414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c93699-e68b-40bf-990d-079ac4a2048d admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:23.309651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c93699-e68b-40bf-990d-079ac4a2048d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:23.309900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c93699-e68b-40bf-990d-079ac4a2048d admin admin] PATH_INFO: `/v3/projects/8028bd47ba5a4e54b15e062544aeb77f/users/df71ad9b1f7d4cc7bdaae9a17d75d808/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:23.326122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c93699-e68b-40bf-990d-079ac4a2048d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8028bd47ba5a4e54b15e062544aeb77f, user_id=df71ad9b1f7d4cc7bdaae9a17d75d808, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:23.328853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c93699-e68b-40bf-990d-079ac4a2048d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:23.410790 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4082/8228] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:52:23 2022] PUT /identity/v3/projects/8028bd47ba5a4e54b15e062544aeb77f/users/df71ad9b1f7d4cc7bdaae9a17d75d808/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:23.422727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bfb5e-41aa-4d8d-9c43-410497650173 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:23.423048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bfb5e-41aa-4d8d-9c43-410497650173 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:23.423421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bfb5e-41aa-4d8d-9c43-410497650173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:23.451855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c14bfb5e-41aa-4d8d-9c43-410497650173 None None] MFA Rules not processed for user `df71ad9b1f7d4cc7bdaae9a17d75d808`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:23.452888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c14bfb5e-41aa-4d8d-9c43-410497650173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:23.519968 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4147/8229] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:23.524605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c93699-e68b-40bf-990d-079ac4a2048d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:23.588868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c93699-e68b-40bf-990d-079ac4a2048d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:23.594044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324469b-e9a3-425d-9289-893fbd4e60ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:23.594699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324469b-e9a3-425d-9289-893fbd4e60ae admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:23.594980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324469b-e9a3-425d-9289-893fbd4e60ae admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:23.595296 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324469b-e9a3-425d-9289-893fbd4e60ae admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:23.595986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324469b-e9a3-425d-9289-893fbd4e60ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:23.598139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324469b-e9a3-425d-9289-893fbd4e60ae admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:23.691740 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4083/8230] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:23 2022] POST /identity/v3/projects => generated 367 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:23.701515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bfb5e-41aa-4d8d-9c43-410497650173 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:23.712595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bfb5e-41aa-4d8d-9c43-410497650173 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:23.739318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:23.772153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db6acb-221d-4a72-811e-bcc9d4828746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:23.772882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db6acb-221d-4a72-811e-bcc9d4828746 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:23.773163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db6acb-221d-4a72-811e-bcc9d4828746 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:23.773435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db6acb-221d-4a72-811e-bcc9d4828746 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:23.774108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db6acb-221d-4a72-811e-bcc9d4828746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:23.776053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db6acb-221d-4a72-811e-bcc9d4828746 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:23.864470 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4148/8231] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:52:23 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:23.865713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324469b-e9a3-425d-9289-893fbd4e60ae admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:23.876877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324469b-e9a3-425d-9289-893fbd4e60ae admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:23.881517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a83083-6359-4afd-a9fc-48b78ec6de43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:23.882238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a83083-6359-4afd-a9fc-48b78ec6de43 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:23.882518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a83083-6359-4afd-a9fc-48b78ec6de43 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:23.882795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a83083-6359-4afd-a9fc-48b78ec6de43 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:23.883549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a83083-6359-4afd-a9fc-48b78ec6de43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:23.885143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a83083-6359-4afd-a9fc-48b78ec6de43 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:23.896594 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4084/8232] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:52:23.900774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db6acb-221d-4a72-811e-bcc9d4828746 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:23.911354 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db6acb-221d-4a72-811e-bcc9d4828746 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:23.916018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe06276-65a1-4252-885b-6df4d96288d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:23.917020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe06276-65a1-4252-885b-6df4d96288d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:23.917305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe06276-65a1-4252-885b-6df4d96288d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:23.917585 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe06276-65a1-4252-885b-6df4d96288d1 admin admin] PATH_INFO: `/v3/projects/ea2d7f0994494eda89a4d86c46996a29/users/68f8be781ca54b9e9232ab8a5a42dff4/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:23.932811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe06276-65a1-4252-885b-6df4d96288d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea2d7f0994494eda89a4d86c46996a29, user_id=68f8be781ca54b9e9232ab8a5a42dff4, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:23.936288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe06276-65a1-4252-885b-6df4d96288d1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:24.032855 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4149/8233] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:52:23 2022] PUT /identity/v3/projects/ea2d7f0994494eda89a4d86c46996a29/users/68f8be781ca54b9e9232ab8a5a42dff4/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:24.036857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a83083-6359-4afd-a9fc-48b78ec6de43 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:24.044051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:24.047852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a83083-6359-4afd-a9fc-48b78ec6de43 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:24.106006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf7d02-91f4-43e4-bdf6-bbce0e29ba8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:24.106820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf7d02-91f4-43e4-bdf6-bbce0e29ba8e admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:24.107140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf7d02-91f4-43e4-bdf6-bbce0e29ba8e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:24.107419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf7d02-91f4-43e4-bdf6-bbce0e29ba8e admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:24.108143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf7d02-91f4-43e4-bdf6-bbce0e29ba8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:24.109732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf7d02-91f4-43e4-bdf6-bbce0e29ba8e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:24.119941 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4085/8234] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:52:24.124846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe06276-65a1-4252-885b-6df4d96288d1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:24.135595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe06276-65a1-4252-885b-6df4d96288d1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:24.140600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0156364-26ed-432d-a0f2-84aca0b9ba86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:24.141485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0156364-26ed-432d-a0f2-84aca0b9ba86 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:24.141767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0156364-26ed-432d-a0f2-84aca0b9ba86 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:24.142046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0156364-26ed-432d-a0f2-84aca0b9ba86 admin admin] PATH_INFO: `/v3/projects/ea2d7f0994494eda89a4d86c46996a29/users/68f8be781ca54b9e9232ab8a5a42dff4/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:24.144130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0156364-26ed-432d-a0f2-84aca0b9ba86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea2d7f0994494eda89a4d86c46996a29, user_id=68f8be781ca54b9e9232ab8a5a42dff4, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:24.146821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0156364-26ed-432d-a0f2-84aca0b9ba86 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:24.157489 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4150/8235] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:52:24 2022] PUT /identity/v3/projects/ea2d7f0994494eda89a4d86c46996a29/users/68f8be781ca54b9e9232ab8a5a42dff4/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:24.167854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c8618-9298-4491-b62e-1c89a5686710 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:24.168793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c8618-9298-4491-b62e-1c89a5686710 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:24.169094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c8618-9298-4491-b62e-1c89a5686710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:24.196068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-010c8618-9298-4491-b62e-1c89a5686710 None None] MFA Rules not processed for user `68f8be781ca54b9e9232ab8a5a42dff4`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:24.197277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-010c8618-9298-4491-b62e-1c89a5686710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:24.267426 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4086/8236] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:24 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:24.272498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0156364-26ed-432d-a0f2-84aca0b9ba86 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:24.283876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0156364-26ed-432d-a0f2-84aca0b9ba86 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:24.288512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fe166-f796-4f34-ab86-f32a87db8db2 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:24.289156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fe166-f796-4f34-ab86-f32a87db8db2 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:24.289443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fe166-f796-4f34-ab86-f32a87db8db2 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:24.289721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fe166-f796-4f34-ab86-f32a87db8db2 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:24.290402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56fe166-f796-4f34-ab86-f32a87db8db2 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:24.292294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56fe166-f796-4f34-ab86-f32a87db8db2 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:24.404708 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4151/8237] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:24 2022] POST /identity/v3/projects => generated 358 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:24.408619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c8618-9298-4491-b62e-1c89a5686710 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:24.418614 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c8618-9298-4491-b62e-1c89a5686710 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:24.475905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db7cd8-eae1-4386-98a5-b3e38d462a7c tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:24.476574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db7cd8-eae1-4386-98a5-b3e38d462a7c tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:24.476866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db7cd8-eae1-4386-98a5-b3e38d462a7c tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:24.477154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db7cd8-eae1-4386-98a5-b3e38d462a7c tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:24.477864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db7cd8-eae1-4386-98a5-b3e38d462a7c tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:24.479770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db7cd8-eae1-4386-98a5-b3e38d462a7c tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:24.561563 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4087/8238] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:52:24 2022] POST /identity/v3/users => generated 413 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:52:24.565880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fe166-f796-4f34-ab86-f32a87db8db2 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:24.577262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fe166-f796-4f34-ab86-f32a87db8db2 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:24.581960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fb81a-b25f-485a-bde3-e3591400a650 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:24.582816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fb81a-b25f-485a-bde3-e3591400a650 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:24.587169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fb81a-b25f-485a-bde3-e3591400a650 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:24.587169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fb81a-b25f-485a-bde3-e3591400a650 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/users/be4ba291d2064a73b78f452054fc3a92` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:24.598453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fb81a-b25f-485a-bde3-e3591400a650 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:get_user(user_id=be4ba291d2064a73b78f452054fc3a92)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:24.600760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fb81a-b25f-485a-bde3-e3591400a650 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:24.602465 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4152/8239] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Jul 16 21:52:24 2022] GET /identity/v3/users/be4ba291d2064a73b78f452054fc3a92 => generated 413 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:24.608981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db7cd8-eae1-4386-98a5-b3e38d462a7c tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:24.619539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db7cd8-eae1-4386-98a5-b3e38d462a7c tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:24.624711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81aad3-ecff-45fe-b9b0-3d585d7679a0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:24.625564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81aad3-ecff-45fe-b9b0-3d585d7679a0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:24.625848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81aad3-ecff-45fe-b9b0-3d585d7679a0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:24.626130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81aad3-ecff-45fe-b9b0-3d585d7679a0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/users/be4ba291d2064a73b78f452054fc3a92` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:24.627384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81aad3-ecff-45fe-b9b0-3d585d7679a0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:delete_user(user_id=be4ba291d2064a73b78f452054fc3a92)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:24.629433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81aad3-ecff-45fe-b9b0-3d585d7679a0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:24.640650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:24.726028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ac81aad3-ecff-45fe-b9b0-3d585d7679a0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be4ba291d2064a73b78f452054fc3a92'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:24.738621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ac81aad3-ecff-45fe-b9b0-3d585d7679a0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be4ba291d2064a73b78f452054fc3a92'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:24.804760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ac81aad3-ecff-45fe-b9b0-3d585d7679a0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be4ba291d2064a73b78f452054fc3a92'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:24.811956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ac81aad3-ecff-45fe-b9b0-3d585d7679a0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be4ba291d2064a73b78f452054fc3a92'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:24.812688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ac81aad3-ecff-45fe-b9b0-3d585d7679a0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be4ba291d2064a73b78f452054fc3a92'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:24.818738 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4088/8240] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:52:24 2022] DELETE /identity/v3/users/be4ba291d2064a73b78f452054fc3a92 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:24.822953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fb81a-b25f-485a-bde3-e3591400a650 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:24.824868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-786fb81a-b25f-485a-bde3-e3591400a650 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:24.838455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fb81a-b25f-485a-bde3-e3591400a650 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:24.895342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949f990-45ca-4d4c-b486-3e61784d0b07 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:24.896237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949f990-45ca-4d4c-b486-3e61784d0b07 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:24.896527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949f990-45ca-4d4c-b486-3e61784d0b07 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:24.896807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949f990-45ca-4d4c-b486-3e61784d0b07 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/7838e3af38aa4429ad3dd73ae43905d2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:24.898008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949f990-45ca-4d4c-b486-3e61784d0b07 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7838e3af38aa4429ad3dd73ae43905d2)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:24.900035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949f990-45ca-4d4c-b486-3e61784d0b07 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:25.013313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:25.016926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5949f990-45ca-4d4c-b486-3e61784d0b07 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7838e3af38aa4429ad3dd73ae43905d2', 'request_id': 'req-5949f990-45ca-4d4c-b486-3e61784d0b07'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:25.023216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5949f990-45ca-4d4c-b486-3e61784d0b07 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7838e3af38aa4429ad3dd73ae43905d2', 'request_id': 'req-5949f990-45ca-4d4c-b486-3e61784d0b07'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:25.029376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5949f990-45ca-4d4c-b486-3e61784d0b07 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7838e3af38aa4429ad3dd73ae43905d2', 'request_id': 'req-5949f990-45ca-4d4c-b486-3e61784d0b07'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:25.084080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5949f990-45ca-4d4c-b486-3e61784d0b07 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] The token cache is being invalidate because project 7838e3af38aa4429ad3dd73ae43905d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:25.084381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5949f990-45ca-4d4c-b486-3e61784d0b07 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:25.085075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5949f990-45ca-4d4c-b486-3e61784d0b07 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:25.086711 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4153/8241] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:24 2022] DELETE /identity/v3/projects/7838e3af38aa4429ad3dd73ae43905d2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:25.092934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81aad3-ecff-45fe-b9b0-3d585d7679a0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:25.103153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81aad3-ecff-45fe-b9b0-3d585d7679a0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:25.160532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081ff1d-3b54-4246-8251-ab549863cc08 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:25.161186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081ff1d-3b54-4246-8251-ab549863cc08 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:25.161469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081ff1d-3b54-4246-8251-ab549863cc08 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:25.161744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081ff1d-3b54-4246-8251-ab549863cc08 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:25.162424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081ff1d-3b54-4246-8251-ab549863cc08 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:25.164136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081ff1d-3b54-4246-8251-ab549863cc08 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:25.231059 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4089/8242] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:25 2022] POST /identity/v3/projects => generated 347 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:25.232650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949f990-45ca-4d4c-b486-3e61784d0b07 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:25.234033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5949f990-45ca-4d4c-b486-3e61784d0b07 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:25.246886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949f990-45ca-4d4c-b486-3e61784d0b07 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:25.303428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b74ec-fe7b-4a21-ad65-a9eda87343ab tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:25.304090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b74ec-fe7b-4a21-ad65-a9eda87343ab tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:25.304376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b74ec-fe7b-4a21-ad65-a9eda87343ab tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:25.304655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b74ec-fe7b-4a21-ad65-a9eda87343ab tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:25.305405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b74ec-fe7b-4a21-ad65-a9eda87343ab tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:52:25.305720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b74ec-fe7b-4a21-ad65-a9eda87343ab tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:25.307631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b74ec-fe7b-4a21-ad65-a9eda87343ab tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:25.320234 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4154/8243] 10.222.0.16 () {58 vars in 1159 bytes} [Sat Jul 16 21:52:25 2022] GET /identity/v3/projects?is_domain=True => generated 1019 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:25.324584 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081ff1d-3b54-4246-8251-ab549863cc08 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:25.335706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081ff1d-3b54-4246-8251-ab549863cc08 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:25.340342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ac355-fbcb-4fcb-baee-ec6b471431e9 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:25.341253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ac355-fbcb-4fcb-baee-ec6b471431e9 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:25.341606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ac355-fbcb-4fcb-baee-ec6b471431e9 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:25.341895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ac355-fbcb-4fcb-baee-ec6b471431e9 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:25.342598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ac355-fbcb-4fcb-baee-ec6b471431e9 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:25.344234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ac355-fbcb-4fcb-baee-ec6b471431e9 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:25.356648 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4090/8244] 10.222.0.16 () {58 vars in 1127 bytes} [Sat Jul 16 21:52:25 2022] GET /identity/v3/domains => generated 828 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:25.360700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b74ec-fe7b-4a21-ad65-a9eda87343ab tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:25.370698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b74ec-fe7b-4a21-ad65-a9eda87343ab tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:25.375940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be99d1a-b94e-44c2-85bd-4e484b0830dd tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:25.376809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be99d1a-b94e-44c2-85bd-4e484b0830dd tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:25.377098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be99d1a-b94e-44c2-85bd-4e484b0830dd tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:25.377376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be99d1a-b94e-44c2-85bd-4e484b0830dd tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/1a82efe4ce91470c9ea52a312d67017d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:25.378624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be99d1a-b94e-44c2-85bd-4e484b0830dd tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:update_project(project_id=1a82efe4ce91470c9ea52a312d67017d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:25.379683 ncdv-master-1 devstack@keystone.service[98196]: WARNING py.warnings [None req-0be99d1a-b94e-44c2-85bd-4e484b0830dd tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:52:25.379683 ncdv-master-1 devstack@keystone.service[98196]: warnings.warn(msg) Jul 16 21:52:25.379683 ncdv-master-1 devstack@keystone.service[98196]: Jul 16 21:52:25.380715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be99d1a-b94e-44c2-85bd-4e484b0830dd tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:25.392215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0be99d1a-b94e-44c2-85bd-4e484b0830dd tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1a82efe4ce91470c9ea52a312d67017d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:25.392894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0be99d1a-b94e-44c2-85bd-4e484b0830dd tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1a82efe4ce91470c9ea52a312d67017d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:25.507628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0be99d1a-b94e-44c2-85bd-4e484b0830dd tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1a82efe4ce91470c9ea52a312d67017d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:25.508270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0be99d1a-b94e-44c2-85bd-4e484b0830dd tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1a82efe4ce91470c9ea52a312d67017d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:25.510738 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4155/8245] 10.222.0.16 () {60 vars in 1251 bytes} [Sat Jul 16 21:52:25 2022] PATCH /identity/v3/projects/1a82efe4ce91470c9ea52a312d67017d => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:25.516056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ac355-fbcb-4fcb-baee-ec6b471431e9 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:25.518109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c03ac355-fbcb-4fcb-baee-ec6b471431e9 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:25.531668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ac355-fbcb-4fcb-baee-ec6b471431e9 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:25.589252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92780ac7-077b-4ae8-9e20-f17540908ffa tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:25.591956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92780ac7-077b-4ae8-9e20-f17540908ffa tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:25.591956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92780ac7-077b-4ae8-9e20-f17540908ffa tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:25.591956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92780ac7-077b-4ae8-9e20-f17540908ffa tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/1a82efe4ce91470c9ea52a312d67017d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:25.601698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92780ac7-077b-4ae8-9e20-f17540908ffa tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1a82efe4ce91470c9ea52a312d67017d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:25.603452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92780ac7-077b-4ae8-9e20-f17540908ffa tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:25.604833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:25.628027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-92780ac7-077b-4ae8-9e20-f17540908ffa tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1a82efe4ce91470c9ea52a312d67017d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:25.637365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-92780ac7-077b-4ae8-9e20-f17540908ffa tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1a82efe4ce91470c9ea52a312d67017d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:25.735958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-92780ac7-077b-4ae8-9e20-f17540908ffa tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a82efe4ce91470c9ea52a312d67017d', 'request_id': 'req-92780ac7-077b-4ae8-9e20-f17540908ffa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:25.741293 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-92780ac7-077b-4ae8-9e20-f17540908ffa tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a82efe4ce91470c9ea52a312d67017d', 'request_id': 'req-92780ac7-077b-4ae8-9e20-f17540908ffa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:25.748609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-92780ac7-077b-4ae8-9e20-f17540908ffa tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a82efe4ce91470c9ea52a312d67017d', 'request_id': 'req-92780ac7-077b-4ae8-9e20-f17540908ffa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:25.814377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-92780ac7-077b-4ae8-9e20-f17540908ffa tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] The token cache is being invalidate because project 1a82efe4ce91470c9ea52a312d67017d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:25.814664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-92780ac7-077b-4ae8-9e20-f17540908ffa tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:25.815324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-92780ac7-077b-4ae8-9e20-f17540908ffa tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:25.824859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-92780ac7-077b-4ae8-9e20-f17540908ffa tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1a82efe4ce91470c9ea52a312d67017d', 'request_id': 'req-92780ac7-077b-4ae8-9e20-f17540908ffa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:25.824859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-92780ac7-077b-4ae8-9e20-f17540908ffa tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1a82efe4ce91470c9ea52a312d67017d', 'request_id': 'req-92780ac7-077b-4ae8-9e20-f17540908ffa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:25.824859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-92780ac7-077b-4ae8-9e20-f17540908ffa tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1a82efe4ce91470c9ea52a312d67017d', 'request_id': 'req-92780ac7-077b-4ae8-9e20-f17540908ffa'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:25.833000 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4091/8246] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:25 2022] DELETE /identity/v3/projects/1a82efe4ce91470c9ea52a312d67017d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:25.838223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be99d1a-b94e-44c2-85bd-4e484b0830dd tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:25.848858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be99d1a-b94e-44c2-85bd-4e484b0830dd tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:25.906701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826dbc71-b91b-4e31-ae42-4cb267b4546e tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:25.907402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826dbc71-b91b-4e31-ae42-4cb267b4546e tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:25.907687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826dbc71-b91b-4e31-ae42-4cb267b4546e tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:25.907970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826dbc71-b91b-4e31-ae42-4cb267b4546e tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:25.908648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826dbc71-b91b-4e31-ae42-4cb267b4546e tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:25.910534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826dbc71-b91b-4e31-ae42-4cb267b4546e tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:25.987951 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4156/8247] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:25 2022] POST /identity/v3/projects => generated 359 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:25.992095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92780ac7-077b-4ae8-9e20-f17540908ffa tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:25.993509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-92780ac7-077b-4ae8-9e20-f17540908ffa tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:26.006201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92780ac7-077b-4ae8-9e20-f17540908ffa tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:26.063211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9b9f4-fbae-44a8-9667-988e837b1b88 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:26.064081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9b9f4-fbae-44a8-9667-988e837b1b88 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:26.064401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9b9f4-fbae-44a8-9667-988e837b1b88 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:26.064647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9b9f4-fbae-44a8-9667-988e837b1b88 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/091cc249b2a047f6abaf3936bbe9203e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:26.065853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9b9f4-fbae-44a8-9667-988e837b1b88 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:get_project(project_id=091cc249b2a047f6abaf3936bbe9203e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:26.068087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9b9f4-fbae-44a8-9667-988e837b1b88 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:26.069813 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4092/8248] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:52:25 2022] GET /identity/v3/projects/091cc249b2a047f6abaf3936bbe9203e => generated 359 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:26.074144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826dbc71-b91b-4e31-ae42-4cb267b4546e tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:26.085698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826dbc71-b91b-4e31-ae42-4cb267b4546e tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:26.090337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc6b8c-406d-4fdc-9d28-4a51157fe5e1 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:26.091948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc6b8c-406d-4fdc-9d28-4a51157fe5e1 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:26.092235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc6b8c-406d-4fdc-9d28-4a51157fe5e1 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:26.092517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc6b8c-406d-4fdc-9d28-4a51157fe5e1 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/091cc249b2a047f6abaf3936bbe9203e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:26.093729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc6b8c-406d-4fdc-9d28-4a51157fe5e1 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:delete_project(project_id=091cc249b2a047f6abaf3936bbe9203e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:26.095840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc6b8c-406d-4fdc-9d28-4a51157fe5e1 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:26.109256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:26.210471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-12bc6b8c-406d-4fdc-9d28-4a51157fe5e1 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '091cc249b2a047f6abaf3936bbe9203e', 'request_id': 'req-12bc6b8c-406d-4fdc-9d28-4a51157fe5e1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:26.217729 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-12bc6b8c-406d-4fdc-9d28-4a51157fe5e1 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '091cc249b2a047f6abaf3936bbe9203e', 'request_id': 'req-12bc6b8c-406d-4fdc-9d28-4a51157fe5e1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:26.224020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-12bc6b8c-406d-4fdc-9d28-4a51157fe5e1 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '091cc249b2a047f6abaf3936bbe9203e', 'request_id': 'req-12bc6b8c-406d-4fdc-9d28-4a51157fe5e1'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:26.301272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-12bc6b8c-406d-4fdc-9d28-4a51157fe5e1 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] The token cache is being invalidate because project 091cc249b2a047f6abaf3936bbe9203e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:26.301562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-12bc6b8c-406d-4fdc-9d28-4a51157fe5e1 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:26.302310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-12bc6b8c-406d-4fdc-9d28-4a51157fe5e1 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:26.303983 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4157/8249] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:26 2022] DELETE /identity/v3/projects/091cc249b2a047f6abaf3936bbe9203e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:26.309095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9b9f4-fbae-44a8-9667-988e837b1b88 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:26.310891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-86e9b9f4-fbae-44a8-9667-988e837b1b88 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:26.323548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9b9f4-fbae-44a8-9667-988e837b1b88 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:26.368169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:26.379567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74429661-5631-4ce4-a295-6f62d80c5eba tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:26.380220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74429661-5631-4ce4-a295-6f62d80c5eba tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:26.380505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74429661-5631-4ce4-a295-6f62d80c5eba tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:26.380783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74429661-5631-4ce4-a295-6f62d80c5eba tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:26.381459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74429661-5631-4ce4-a295-6f62d80c5eba tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:26.383408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74429661-5631-4ce4-a295-6f62d80c5eba tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:26.478386 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4093/8250] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:26 2022] POST /identity/v3/projects => generated 360 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:26.482607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc6b8c-406d-4fdc-9d28-4a51157fe5e1 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:26.492890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc6b8c-406d-4fdc-9d28-4a51157fe5e1 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:26.550776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d306126-b905-4e26-8eb4-d2281660ce29 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:26.551668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d306126-b905-4e26-8eb4-d2281660ce29 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:26.551958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d306126-b905-4e26-8eb4-d2281660ce29 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:26.552236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d306126-b905-4e26-8eb4-d2281660ce29 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/40f70f247a99490898be73bb7bb0c8a3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:26.553422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d306126-b905-4e26-8eb4-d2281660ce29 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:get_project(project_id=40f70f247a99490898be73bb7bb0c8a3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:26.555538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d306126-b905-4e26-8eb4-d2281660ce29 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:26.557245 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4158/8251] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:52:26 2022] GET /identity/v3/projects/40f70f247a99490898be73bb7bb0c8a3 => generated 360 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:26.561716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74429661-5631-4ce4-a295-6f62d80c5eba tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:26.572540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74429661-5631-4ce4-a295-6f62d80c5eba tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:26.578290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90113f6-cd66-4c7c-9fec-8ec225fff924 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:26.579168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90113f6-cd66-4c7c-9fec-8ec225fff924 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:26.579463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90113f6-cd66-4c7c-9fec-8ec225fff924 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:26.579742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90113f6-cd66-4c7c-9fec-8ec225fff924 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/40f70f247a99490898be73bb7bb0c8a3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:26.581004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90113f6-cd66-4c7c-9fec-8ec225fff924 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:delete_project(project_id=40f70f247a99490898be73bb7bb0c8a3)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:26.583108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90113f6-cd66-4c7c-9fec-8ec225fff924 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:26.691896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a90113f6-cd66-4c7c-9fec-8ec225fff924 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40f70f247a99490898be73bb7bb0c8a3', 'request_id': 'req-a90113f6-cd66-4c7c-9fec-8ec225fff924'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:26.697290 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a90113f6-cd66-4c7c-9fec-8ec225fff924 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40f70f247a99490898be73bb7bb0c8a3', 'request_id': 'req-a90113f6-cd66-4c7c-9fec-8ec225fff924'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:26.704934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a90113f6-cd66-4c7c-9fec-8ec225fff924 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40f70f247a99490898be73bb7bb0c8a3', 'request_id': 'req-a90113f6-cd66-4c7c-9fec-8ec225fff924'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:26.821681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a90113f6-cd66-4c7c-9fec-8ec225fff924 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] The token cache is being invalidate because project 40f70f247a99490898be73bb7bb0c8a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:26.821969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a90113f6-cd66-4c7c-9fec-8ec225fff924 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:26.822725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a90113f6-cd66-4c7c-9fec-8ec225fff924 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:26.824409 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4094/8252] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:26 2022] DELETE /identity/v3/projects/40f70f247a99490898be73bb7bb0c8a3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:26.829938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d306126-b905-4e26-8eb4-d2281660ce29 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:26.831923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3d306126-b905-4e26-8eb4-d2281660ce29 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:26.845197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d306126-b905-4e26-8eb4-d2281660ce29 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:26.904394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d00e0c-cf08-4234-98d9-120055a1e292 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:26.905077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d00e0c-cf08-4234-98d9-120055a1e292 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:26.905363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d00e0c-cf08-4234-98d9-120055a1e292 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:26.905643 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d00e0c-cf08-4234-98d9-120055a1e292 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:26.906326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d00e0c-cf08-4234-98d9-120055a1e292 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:26.908259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d00e0c-cf08-4234-98d9-120055a1e292 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:27.018213 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4159/8253] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Jul 16 21:52:26 2022] POST /identity/v3/projects => generated 347 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:27.022192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90113f6-cd66-4c7c-9fec-8ec225fff924 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:27.032696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90113f6-cd66-4c7c-9fec-8ec225fff924 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:27.088731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79727c47-a35f-44d4-8719-67d6b4988100 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:27.089587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79727c47-a35f-44d4-8719-67d6b4988100 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:27.089867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79727c47-a35f-44d4-8719-67d6b4988100 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:27.090142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79727c47-a35f-44d4-8719-67d6b4988100 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/698b761319074c6c852f59d8985957b8` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:27.091379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79727c47-a35f-44d4-8719-67d6b4988100 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:get_project(project_id=698b761319074c6c852f59d8985957b8)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:27.093417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79727c47-a35f-44d4-8719-67d6b4988100 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:27.095131 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4095/8254] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:52:27 2022] GET /identity/v3/projects/698b761319074c6c852f59d8985957b8 => generated 347 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:27.099652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d00e0c-cf08-4234-98d9-120055a1e292 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:27.111075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d00e0c-cf08-4234-98d9-120055a1e292 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:27.115854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaa26b-4391-4a4e-ae1e-6cd48a781110 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:27.116713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaa26b-4391-4a4e-ae1e-6cd48a781110 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:27.117004 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaa26b-4391-4a4e-ae1e-6cd48a781110 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:27.117286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaa26b-4391-4a4e-ae1e-6cd48a781110 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/698b761319074c6c852f59d8985957b8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:27.118480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecaa26b-4391-4a4e-ae1e-6cd48a781110 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:delete_project(project_id=698b761319074c6c852f59d8985957b8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:27.120702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecaa26b-4391-4a4e-ae1e-6cd48a781110 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:27.146977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:27.251711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aecaa26b-4391-4a4e-ae1e-6cd48a781110 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698b761319074c6c852f59d8985957b8', 'request_id': 'req-aecaa26b-4391-4a4e-ae1e-6cd48a781110'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:27.258454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aecaa26b-4391-4a4e-ae1e-6cd48a781110 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698b761319074c6c852f59d8985957b8', 'request_id': 'req-aecaa26b-4391-4a4e-ae1e-6cd48a781110'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:27.264268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aecaa26b-4391-4a4e-ae1e-6cd48a781110 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698b761319074c6c852f59d8985957b8', 'request_id': 'req-aecaa26b-4391-4a4e-ae1e-6cd48a781110'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:27.323656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aecaa26b-4391-4a4e-ae1e-6cd48a781110 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] The token cache is being invalidate because project 698b761319074c6c852f59d8985957b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:27.323945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aecaa26b-4391-4a4e-ae1e-6cd48a781110 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:27.324670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-aecaa26b-4391-4a4e-ae1e-6cd48a781110 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:27.326321 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4160/8255] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:27 2022] DELETE /identity/v3/projects/698b761319074c6c852f59d8985957b8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:27.331365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79727c47-a35f-44d4-8719-67d6b4988100 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:27.333215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-79727c47-a35f-44d4-8719-67d6b4988100 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:27.346402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79727c47-a35f-44d4-8719-67d6b4988100 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:27.402641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbf713-3ae1-45f0-8f80-bfae51b6761e tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:27.403407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbf713-3ae1-45f0-8f80-bfae51b6761e tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:27.403786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbf713-3ae1-45f0-8f80-bfae51b6761e tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:27.404074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbf713-3ae1-45f0-8f80-bfae51b6761e tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:27.404804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbf713-3ae1-45f0-8f80-bfae51b6761e tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:27.406461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbf713-3ae1-45f0-8f80-bfae51b6761e tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:27.409059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:27.498352 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4096/8256] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:52:27 2022] POST /identity/v3/domains => generated 277 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:27.502475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaa26b-4391-4a4e-ae1e-6cd48a781110 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:27.513173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaa26b-4391-4a4e-ae1e-6cd48a781110 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:27.570276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62d17a-1586-439b-ad3f-850565c5e3bc tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:27.570932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62d17a-1586-439b-ad3f-850565c5e3bc tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:27.571248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62d17a-1586-439b-ad3f-850565c5e3bc tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:27.571529 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62d17a-1586-439b-ad3f-850565c5e3bc tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:27.572187 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62d17a-1586-439b-ad3f-850565c5e3bc tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:27.574138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62d17a-1586-439b-ad3f-850565c5e3bc tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:27.676457 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4161/8257] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:27 2022] POST /identity/v3/projects => generated 404 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:27.680683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbf713-3ae1-45f0-8f80-bfae51b6761e tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:27.691462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbf713-3ae1-45f0-8f80-bfae51b6761e tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:27.749230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928154e-9d2d-4068-84ed-814056932b1d tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:27.750096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928154e-9d2d-4068-84ed-814056932b1d tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:27.750394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928154e-9d2d-4068-84ed-814056932b1d tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:27.750676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928154e-9d2d-4068-84ed-814056932b1d tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/a6a76d56e1104bab8447e45fb5224370` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:27.751921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928154e-9d2d-4068-84ed-814056932b1d tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:get_project(project_id=a6a76d56e1104bab8447e45fb5224370)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:27.753976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928154e-9d2d-4068-84ed-814056932b1d tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:27.755762 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4097/8258] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:52:27 2022] GET /identity/v3/projects/a6a76d56e1104bab8447e45fb5224370 => generated 404 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:27.759860 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62d17a-1586-439b-ad3f-850565c5e3bc tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:27.770351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62d17a-1586-439b-ad3f-850565c5e3bc tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:27.774959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2e974-34e0-4ebf-b92a-a782ddba301a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:27.775838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2e974-34e0-4ebf-b92a-a782ddba301a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:27.776120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2e974-34e0-4ebf-b92a-a782ddba301a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:27.776395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2e974-34e0-4ebf-b92a-a782ddba301a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/a6a76d56e1104bab8447e45fb5224370` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:27.777856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2e974-34e0-4ebf-b92a-a782ddba301a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a6a76d56e1104bab8447e45fb5224370)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:27.780539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2e974-34e0-4ebf-b92a-a782ddba301a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:27.883889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d8f2e974-34e0-4ebf-b92a-a782ddba301a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6a76d56e1104bab8447e45fb5224370', 'request_id': 'req-d8f2e974-34e0-4ebf-b92a-a782ddba301a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:27.890864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d8f2e974-34e0-4ebf-b92a-a782ddba301a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6a76d56e1104bab8447e45fb5224370', 'request_id': 'req-d8f2e974-34e0-4ebf-b92a-a782ddba301a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:27.896539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d8f2e974-34e0-4ebf-b92a-a782ddba301a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6a76d56e1104bab8447e45fb5224370', 'request_id': 'req-d8f2e974-34e0-4ebf-b92a-a782ddba301a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:27.974624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d8f2e974-34e0-4ebf-b92a-a782ddba301a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] The token cache is being invalidate because project a6a76d56e1104bab8447e45fb5224370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:27.975288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d8f2e974-34e0-4ebf-b92a-a782ddba301a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:27.975637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d8f2e974-34e0-4ebf-b92a-a782ddba301a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:27.977208 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4162/8259] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:27 2022] DELETE /identity/v3/projects/a6a76d56e1104bab8447e45fb5224370 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:27.981368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928154e-9d2d-4068-84ed-814056932b1d tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:27.984714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0928154e-9d2d-4068-84ed-814056932b1d tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:27.996128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928154e-9d2d-4068-84ed-814056932b1d tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:28.052096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c461c4-cce3-438b-a64e-9916aee30810 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:28.052962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c461c4-cce3-438b-a64e-9916aee30810 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:28.053251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c461c4-cce3-438b-a64e-9916aee30810 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:28.053534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c461c4-cce3-438b-a64e-9916aee30810 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/domains/c759082c4d2641f0a3d2ac1543307595` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:28.054856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c461c4-cce3-438b-a64e-9916aee30810 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c759082c4d2641f0a3d2ac1543307595)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:28.056499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c461c4-cce3-438b-a64e-9916aee30810 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:28.076152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-40c461c4-cce3-438b-a64e-9916aee30810 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c759082c4d2641f0a3d2ac1543307595'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:28.076874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-40c461c4-cce3-438b-a64e-9916aee30810 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c759082c4d2641f0a3d2ac1543307595'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:28.187954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-40c461c4-cce3-438b-a64e-9916aee30810 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c759082c4d2641f0a3d2ac1543307595'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:28.188503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-40c461c4-cce3-438b-a64e-9916aee30810 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c759082c4d2641f0a3d2ac1543307595'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:28.191377 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4098/8260] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:52:27 2022] PATCH /identity/v3/domains/c759082c4d2641f0a3d2ac1543307595 => generated 278 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:28.195416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2e974-34e0-4ebf-b92a-a782ddba301a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:28.206920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2e974-34e0-4ebf-b92a-a782ddba301a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:28.214793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:28.264468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc71aec-7b6c-4f41-ab13-b68b400231b0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:28.265330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc71aec-7b6c-4f41-ab13-b68b400231b0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:28.265619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc71aec-7b6c-4f41-ab13-b68b400231b0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:28.265907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc71aec-7b6c-4f41-ab13-b68b400231b0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/domains/c759082c4d2641f0a3d2ac1543307595` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:28.278046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc71aec-7b6c-4f41-ab13-b68b400231b0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c759082c4d2641f0a3d2ac1543307595)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:28.280255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc71aec-7b6c-4f41-ab13-b68b400231b0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:28.302931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-abc71aec-7b6c-4f41-ab13-b68b400231b0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c759082c4d2641f0a3d2ac1543307595'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:28.313614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-abc71aec-7b6c-4f41-ab13-b68b400231b0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c759082c4d2641f0a3d2ac1543307595'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:28.405659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-abc71aec-7b6c-4f41-ab13-b68b400231b0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c759082c4d2641f0a3d2ac1543307595', 'request_id': 'req-abc71aec-7b6c-4f41-ab13-b68b400231b0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:28.413132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-abc71aec-7b6c-4f41-ab13-b68b400231b0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c759082c4d2641f0a3d2ac1543307595', 'request_id': 'req-abc71aec-7b6c-4f41-ab13-b68b400231b0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:28.418565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-abc71aec-7b6c-4f41-ab13-b68b400231b0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c759082c4d2641f0a3d2ac1543307595', 'request_id': 'req-abc71aec-7b6c-4f41-ab13-b68b400231b0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:28.483413 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-abc71aec-7b6c-4f41-ab13-b68b400231b0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] The token cache is being invalidate because project c759082c4d2641f0a3d2ac1543307595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:28.483592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-abc71aec-7b6c-4f41-ab13-b68b400231b0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:28.484191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-abc71aec-7b6c-4f41-ab13-b68b400231b0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:28.491610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-abc71aec-7b6c-4f41-ab13-b68b400231b0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c759082c4d2641f0a3d2ac1543307595', 'request_id': 'req-abc71aec-7b6c-4f41-ab13-b68b400231b0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:28.494942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-abc71aec-7b6c-4f41-ab13-b68b400231b0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c759082c4d2641f0a3d2ac1543307595', 'request_id': 'req-abc71aec-7b6c-4f41-ab13-b68b400231b0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:28.495610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-abc71aec-7b6c-4f41-ab13-b68b400231b0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c759082c4d2641f0a3d2ac1543307595', 'request_id': 'req-abc71aec-7b6c-4f41-ab13-b68b400231b0'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:28.501249 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4163/8261] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:52:28 2022] DELETE /identity/v3/domains/c759082c4d2641f0a3d2ac1543307595 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:28.506248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c461c4-cce3-438b-a64e-9916aee30810 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:28.507693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-40c461c4-cce3-438b-a64e-9916aee30810 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:28.521032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c461c4-cce3-438b-a64e-9916aee30810 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:28.579392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d816e5b-5bd0-44e9-b632-0bf9570a9bf0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:28.580054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d816e5b-5bd0-44e9-b632-0bf9570a9bf0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:28.580343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d816e5b-5bd0-44e9-b632-0bf9570a9bf0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:28.580624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d816e5b-5bd0-44e9-b632-0bf9570a9bf0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:28.581360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d816e5b-5bd0-44e9-b632-0bf9570a9bf0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:28.582946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d816e5b-5bd0-44e9-b632-0bf9570a9bf0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:28.586110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:INSERT=2,keystone:SELECT=97,keystone:UPDATE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:28.669543 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4099/8262] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Jul 16 21:52:28 2022] POST /identity/v3/domains => generated 276 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:52:28.673616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc71aec-7b6c-4f41-ab13-b68b400231b0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:28.675260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-abc71aec-7b6c-4f41-ab13-b68b400231b0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:28.688951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc71aec-7b6c-4f41-ab13-b68b400231b0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:28.734551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:28.746084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff297a03-c4ca-455e-8043-feade80e715b tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:28.746743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff297a03-c4ca-455e-8043-feade80e715b tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:28.747062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff297a03-c4ca-455e-8043-feade80e715b tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:28.747345 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff297a03-c4ca-455e-8043-feade80e715b tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:28.748034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff297a03-c4ca-455e-8043-feade80e715b tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:28.749969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff297a03-c4ca-455e-8043-feade80e715b tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:28.852448 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4164/8263] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:28 2022] POST /identity/v3/projects => generated 409 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:28.857246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d816e5b-5bd0-44e9-b632-0bf9570a9bf0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:28.868745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d816e5b-5bd0-44e9-b632-0bf9570a9bf0 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:28.926170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afbf45-14f0-4753-8489-ffc9b352abc4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:28.926833 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afbf45-14f0-4753-8489-ffc9b352abc4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:28.927153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afbf45-14f0-4753-8489-ffc9b352abc4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:28.927441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afbf45-14f0-4753-8489-ffc9b352abc4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:28.928146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afbf45-14f0-4753-8489-ffc9b352abc4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:28.930098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afbf45-14f0-4753-8489-ffc9b352abc4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:29.052504 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4100/8264] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:28 2022] POST /identity/v3/projects => generated 403 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:52:29.056816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff297a03-c4ca-455e-8043-feade80e715b tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:29.067810 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff297a03-c4ca-455e-8043-feade80e715b tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:29.128329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea5722-306d-4f44-8af0-cdaeb39fa789 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:29.129206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea5722-306d-4f44-8af0-cdaeb39fa789 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:29.129491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea5722-306d-4f44-8af0-cdaeb39fa789 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:29.129770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea5722-306d-4f44-8af0-cdaeb39fa789 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/3f8d7ba3a00643f9a6a87a71cb0f709e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:29.130954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea5722-306d-4f44-8af0-cdaeb39fa789 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3f8d7ba3a00643f9a6a87a71cb0f709e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:29.132905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea5722-306d-4f44-8af0-cdaeb39fa789 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:29.244497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1aea5722-306d-4f44-8af0-cdaeb39fa789 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f8d7ba3a00643f9a6a87a71cb0f709e', 'request_id': 'req-1aea5722-306d-4f44-8af0-cdaeb39fa789'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:29.251447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1aea5722-306d-4f44-8af0-cdaeb39fa789 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f8d7ba3a00643f9a6a87a71cb0f709e', 'request_id': 'req-1aea5722-306d-4f44-8af0-cdaeb39fa789'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:29.257127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1aea5722-306d-4f44-8af0-cdaeb39fa789 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f8d7ba3a00643f9a6a87a71cb0f709e', 'request_id': 'req-1aea5722-306d-4f44-8af0-cdaeb39fa789'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:29.324223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1aea5722-306d-4f44-8af0-cdaeb39fa789 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] The token cache is being invalidate because project 3f8d7ba3a00643f9a6a87a71cb0f709e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:29.324442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1aea5722-306d-4f44-8af0-cdaeb39fa789 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:29.325072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1aea5722-306d-4f44-8af0-cdaeb39fa789 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:29.328044 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4165/8265] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:29 2022] DELETE /identity/v3/projects/3f8d7ba3a00643f9a6a87a71cb0f709e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:29.332996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afbf45-14f0-4753-8489-ffc9b352abc4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:29.334830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-40afbf45-14f0-4753-8489-ffc9b352abc4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:29.348899 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afbf45-14f0-4753-8489-ffc9b352abc4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:29.409194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8791bfe-d581-464b-a078-baf676cdd4de tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:29.410059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8791bfe-d581-464b-a078-baf676cdd4de tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:29.410349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8791bfe-d581-464b-a078-baf676cdd4de tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:29.410630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8791bfe-d581-464b-a078-baf676cdd4de tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/6f7f3002226a4417841732dc4e3ef8b4` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:29.411859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8791bfe-d581-464b-a078-baf676cdd4de tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6f7f3002226a4417841732dc4e3ef8b4)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:29.413897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8791bfe-d581-464b-a078-baf676cdd4de tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:29.570762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e8791bfe-d581-464b-a078-baf676cdd4de tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f7f3002226a4417841732dc4e3ef8b4', 'request_id': 'req-e8791bfe-d581-464b-a078-baf676cdd4de'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:29.576478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e8791bfe-d581-464b-a078-baf676cdd4de tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f7f3002226a4417841732dc4e3ef8b4', 'request_id': 'req-e8791bfe-d581-464b-a078-baf676cdd4de'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:29.582691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e8791bfe-d581-464b-a078-baf676cdd4de tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f7f3002226a4417841732dc4e3ef8b4', 'request_id': 'req-e8791bfe-d581-464b-a078-baf676cdd4de'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:29.713097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e8791bfe-d581-464b-a078-baf676cdd4de tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] The token cache is being invalidate because project 6f7f3002226a4417841732dc4e3ef8b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:29.713386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e8791bfe-d581-464b-a078-baf676cdd4de tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:29.714012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e8791bfe-d581-464b-a078-baf676cdd4de tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:29.715665 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4101/8266] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:29 2022] DELETE /identity/v3/projects/6f7f3002226a4417841732dc4e3ef8b4 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:29.720398 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea5722-306d-4f44-8af0-cdaeb39fa789 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:29.730736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea5722-306d-4f44-8af0-cdaeb39fa789 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:29.779901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:29.786652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d649fc-4182-4cf0-9375-356e2cd68b38 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:29.789352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d649fc-4182-4cf0-9375-356e2cd68b38 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:29.789352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d649fc-4182-4cf0-9375-356e2cd68b38 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:29.789352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d649fc-4182-4cf0-9375-356e2cd68b38 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/domains/eaa667ddacc645b3b80ffee46569bf82` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:29.789352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d649fc-4182-4cf0-9375-356e2cd68b38 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=eaa667ddacc645b3b80ffee46569bf82)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:29.790978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d649fc-4182-4cf0-9375-356e2cd68b38 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:29.811736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-87d649fc-4182-4cf0-9375-356e2cd68b38 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'eaa667ddacc645b3b80ffee46569bf82'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:29.812420 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-87d649fc-4182-4cf0-9375-356e2cd68b38 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'eaa667ddacc645b3b80ffee46569bf82'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:29.923229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-87d649fc-4182-4cf0-9375-356e2cd68b38 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'eaa667ddacc645b3b80ffee46569bf82'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:29.923826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-87d649fc-4182-4cf0-9375-356e2cd68b38 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'eaa667ddacc645b3b80ffee46569bf82'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:29.926875 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4166/8267] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:52:29 2022] PATCH /identity/v3/domains/eaa667ddacc645b3b80ffee46569bf82 => generated 277 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:29.930455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8791bfe-d581-464b-a078-baf676cdd4de tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:29.931975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e8791bfe-d581-464b-a078-baf676cdd4de tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:29.942497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:29.946427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8791bfe-d581-464b-a078-baf676cdd4de tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:30.002810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c10c6-554b-4879-941d-168dc4940c7a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:30.003706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c10c6-554b-4879-941d-168dc4940c7a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:30.003988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c10c6-554b-4879-941d-168dc4940c7a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:30.004263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c10c6-554b-4879-941d-168dc4940c7a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/domains/eaa667ddacc645b3b80ffee46569bf82` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:30.014627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c10c6-554b-4879-941d-168dc4940c7a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=eaa667ddacc645b3b80ffee46569bf82)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:30.016266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c10c6-554b-4879-941d-168dc4940c7a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:30.038988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ee4c10c6-554b-4879-941d-168dc4940c7a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'eaa667ddacc645b3b80ffee46569bf82'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:30.048913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ee4c10c6-554b-4879-941d-168dc4940c7a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'eaa667ddacc645b3b80ffee46569bf82'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:30.130423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ee4c10c6-554b-4879-941d-168dc4940c7a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa667ddacc645b3b80ffee46569bf82', 'request_id': 'req-ee4c10c6-554b-4879-941d-168dc4940c7a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:30.136144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ee4c10c6-554b-4879-941d-168dc4940c7a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa667ddacc645b3b80ffee46569bf82', 'request_id': 'req-ee4c10c6-554b-4879-941d-168dc4940c7a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:30.143458 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ee4c10c6-554b-4879-941d-168dc4940c7a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa667ddacc645b3b80ffee46569bf82', 'request_id': 'req-ee4c10c6-554b-4879-941d-168dc4940c7a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:30.214288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ee4c10c6-554b-4879-941d-168dc4940c7a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] The token cache is being invalidate because project eaa667ddacc645b3b80ffee46569bf82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:30.214577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ee4c10c6-554b-4879-941d-168dc4940c7a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:30.215236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ee4c10c6-554b-4879-941d-168dc4940c7a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:30.223701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ee4c10c6-554b-4879-941d-168dc4940c7a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'eaa667ddacc645b3b80ffee46569bf82', 'request_id': 'req-ee4c10c6-554b-4879-941d-168dc4940c7a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:30.224340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ee4c10c6-554b-4879-941d-168dc4940c7a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'eaa667ddacc645b3b80ffee46569bf82', 'request_id': 'req-ee4c10c6-554b-4879-941d-168dc4940c7a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:30.225007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ee4c10c6-554b-4879-941d-168dc4940c7a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'eaa667ddacc645b3b80ffee46569bf82', 'request_id': 'req-ee4c10c6-554b-4879-941d-168dc4940c7a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:30.233672 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4102/8268] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:52:29 2022] DELETE /identity/v3/domains/eaa667ddacc645b3b80ffee46569bf82 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:30.243895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d649fc-4182-4cf0-9375-356e2cd68b38 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:30.245317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-87d649fc-4182-4cf0-9375-356e2cd68b38 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:30.258072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d649fc-4182-4cf0-9375-356e2cd68b38 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:30.316551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100df676-c8e8-45f2-a016-452256e90266 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:30.317212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100df676-c8e8-45f2-a016-452256e90266 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:30.317502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100df676-c8e8-45f2-a016-452256e90266 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:30.317798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100df676-c8e8-45f2-a016-452256e90266 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:30.318476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100df676-c8e8-45f2-a016-452256e90266 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:30.320378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100df676-c8e8-45f2-a016-452256e90266 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:30.421342 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4167/8269] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:30 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:30.425243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c10c6-554b-4879-941d-168dc4940c7a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:30.426771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ee4c10c6-554b-4879-941d-168dc4940c7a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:30.439931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c10c6-554b-4879-941d-168dc4940c7a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:30.480327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:30.496355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abdae0-a91d-4652-b503-07499e6e23ee tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:30.497215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abdae0-a91d-4652-b503-07499e6e23ee tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:30.497992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abdae0-a91d-4652-b503-07499e6e23ee tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:30.498268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abdae0-a91d-4652-b503-07499e6e23ee tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/6aec52574e5f4047a607ed2daabe5799` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:30.499512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abdae0-a91d-4652-b503-07499e6e23ee tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:get_project(project_id=6aec52574e5f4047a607ed2daabe5799)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:30.501563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abdae0-a91d-4652-b503-07499e6e23ee tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:30.503323 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4103/8270] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:52:30 2022] GET /identity/v3/projects/6aec52574e5f4047a607ed2daabe5799 => generated 377 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:30.507477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100df676-c8e8-45f2-a016-452256e90266 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:30.519098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100df676-c8e8-45f2-a016-452256e90266 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:30.523898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f450a-729e-46f5-9256-7c4909db04f8 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:30.524559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f450a-729e-46f5-9256-7c4909db04f8 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:30.524843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f450a-729e-46f5-9256-7c4909db04f8 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:30.525122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f450a-729e-46f5-9256-7c4909db04f8 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:30.525853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f450a-729e-46f5-9256-7c4909db04f8 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:30.527984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f450a-729e-46f5-9256-7c4909db04f8 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:30.544166 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4168/8271] 10.222.0.16 () {58 vars in 1130 bytes} [Sat Jul 16 21:52:30 2022] GET /identity/v3/projects => generated 3628 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:30.549016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abdae0-a91d-4652-b503-07499e6e23ee tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:30.559312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abdae0-a91d-4652-b503-07499e6e23ee tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:30.564515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db626d-4519-480f-9436-163856a7d50f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:30.565365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db626d-4519-480f-9436-163856a7d50f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:30.565650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db626d-4519-480f-9436-163856a7d50f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:30.565928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db626d-4519-480f-9436-163856a7d50f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/6aec52574e5f4047a607ed2daabe5799` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:30.567145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db626d-4519-480f-9436-163856a7d50f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6aec52574e5f4047a607ed2daabe5799)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:30.569094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db626d-4519-480f-9436-163856a7d50f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:30.725194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-88db626d-4519-480f-9436-163856a7d50f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aec52574e5f4047a607ed2daabe5799', 'request_id': 'req-88db626d-4519-480f-9436-163856a7d50f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:30.730543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-88db626d-4519-480f-9436-163856a7d50f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aec52574e5f4047a607ed2daabe5799', 'request_id': 'req-88db626d-4519-480f-9436-163856a7d50f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:30.737671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-88db626d-4519-480f-9436-163856a7d50f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aec52574e5f4047a607ed2daabe5799', 'request_id': 'req-88db626d-4519-480f-9436-163856a7d50f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:30.815924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-88db626d-4519-480f-9436-163856a7d50f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] The token cache is being invalidate because project 6aec52574e5f4047a607ed2daabe5799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:30.816217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-88db626d-4519-480f-9436-163856a7d50f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:30.816894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-88db626d-4519-480f-9436-163856a7d50f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:30.818503 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4104/8272] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:30 2022] DELETE /identity/v3/projects/6aec52574e5f4047a607ed2daabe5799 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:30.823683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f450a-729e-46f5-9256-7c4909db04f8 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:30.825646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-598f450a-729e-46f5-9256-7c4909db04f8 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:30.838858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f450a-729e-46f5-9256-7c4909db04f8 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:30.895621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1421c4-26d9-4c90-a3b9-21242b24f212 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:30.896276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1421c4-26d9-4c90-a3b9-21242b24f212 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:30.896566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1421c4-26d9-4c90-a3b9-21242b24f212 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:30.896844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1421c4-26d9-4c90-a3b9-21242b24f212 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:30.897517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1421c4-26d9-4c90-a3b9-21242b24f212 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:30.899410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1421c4-26d9-4c90-a3b9-21242b24f212 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:30.975723 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4169/8273] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Jul 16 21:52:30 2022] POST /identity/v3/projects => generated 346 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:30.979869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db626d-4519-480f-9436-163856a7d50f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:30.990616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db626d-4519-480f-9436-163856a7d50f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:31.047852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb271e4c-26e3-4d83-9d0c-5e87ff582df8 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:31.048706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb271e4c-26e3-4d83-9d0c-5e87ff582df8 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:31.048994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb271e4c-26e3-4d83-9d0c-5e87ff582df8 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:31.049275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb271e4c-26e3-4d83-9d0c-5e87ff582df8 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/6f2793ad9cd8455e8d8608c1935be03a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:31.050541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb271e4c-26e3-4d83-9d0c-5e87ff582df8 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:update_project(project_id=6f2793ad9cd8455e8d8608c1935be03a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:31.051621 ncdv-master-1 devstack@keystone.service[98195]: WARNING py.warnings [None req-cb271e4c-26e3-4d83-9d0c-5e87ff582df8 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 16 21:52:31.051621 ncdv-master-1 devstack@keystone.service[98195]: warnings.warn(msg) Jul 16 21:52:31.051621 ncdv-master-1 devstack@keystone.service[98195]: Jul 16 21:52:31.052807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb271e4c-26e3-4d83-9d0c-5e87ff582df8 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:31.142730 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4105/8274] 10.222.0.16 () {60 vars in 1251 bytes} [Sat Jul 16 21:52:30 2022] PATCH /identity/v3/projects/6f2793ad9cd8455e8d8608c1935be03a => generated 360 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:52:31.147062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1421c4-26d9-4c90-a3b9-21242b24f212 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:31.158684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1421c4-26d9-4c90-a3b9-21242b24f212 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:31.163356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b7f37-23a1-4a18-adc4-b258e76dbf15 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:31.164207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b7f37-23a1-4a18-adc4-b258e76dbf15 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:31.164487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b7f37-23a1-4a18-adc4-b258e76dbf15 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:31.164764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b7f37-23a1-4a18-adc4-b258e76dbf15 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/6f2793ad9cd8455e8d8608c1935be03a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:31.177073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b7f37-23a1-4a18-adc4-b258e76dbf15 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:get_project(project_id=6f2793ad9cd8455e8d8608c1935be03a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:31.179289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b7f37-23a1-4a18-adc4-b258e76dbf15 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:31.180993 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4170/8275] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:52:31 2022] GET /identity/v3/projects/6f2793ad9cd8455e8d8608c1935be03a => generated 347 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:31.185288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb271e4c-26e3-4d83-9d0c-5e87ff582df8 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:31.195801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb271e4c-26e3-4d83-9d0c-5e87ff582df8 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:31.200477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04e8d0-8bac-45f0-8ab6-9a79aeae7ab4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:31.201329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04e8d0-8bac-45f0-8ab6-9a79aeae7ab4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:31.201620 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04e8d0-8bac-45f0-8ab6-9a79aeae7ab4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:31.201908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04e8d0-8bac-45f0-8ab6-9a79aeae7ab4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/6f2793ad9cd8455e8d8608c1935be03a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:31.203141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04e8d0-8bac-45f0-8ab6-9a79aeae7ab4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6f2793ad9cd8455e8d8608c1935be03a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:31.205046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04e8d0-8bac-45f0-8ab6-9a79aeae7ab4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:31.296286 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:31.302880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2b04e8d0-8bac-45f0-8ab6-9a79aeae7ab4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f2793ad9cd8455e8d8608c1935be03a', 'request_id': 'req-2b04e8d0-8bac-45f0-8ab6-9a79aeae7ab4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:31.308481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2b04e8d0-8bac-45f0-8ab6-9a79aeae7ab4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f2793ad9cd8455e8d8608c1935be03a', 'request_id': 'req-2b04e8d0-8bac-45f0-8ab6-9a79aeae7ab4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:31.314772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2b04e8d0-8bac-45f0-8ab6-9a79aeae7ab4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f2793ad9cd8455e8d8608c1935be03a', 'request_id': 'req-2b04e8d0-8bac-45f0-8ab6-9a79aeae7ab4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:31.392795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2b04e8d0-8bac-45f0-8ab6-9a79aeae7ab4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] The token cache is being invalidate because project 6f2793ad9cd8455e8d8608c1935be03a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:31.393086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2b04e8d0-8bac-45f0-8ab6-9a79aeae7ab4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:31.393728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2b04e8d0-8bac-45f0-8ab6-9a79aeae7ab4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:31.395331 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4106/8276] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:31 2022] DELETE /identity/v3/projects/6f2793ad9cd8455e8d8608c1935be03a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:31.400614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b7f37-23a1-4a18-adc4-b258e76dbf15 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:31.402588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0b7b7f37-23a1-4a18-adc4-b258e76dbf15 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:31.411623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:31.416942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b7f37-23a1-4a18-adc4-b258e76dbf15 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:31.473483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc38dd1-ed72-4da0-9cd2-b8d4dae84db9 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:31.474178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc38dd1-ed72-4da0-9cd2-b8d4dae84db9 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:31.474665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc38dd1-ed72-4da0-9cd2-b8d4dae84db9 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:31.475347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc38dd1-ed72-4da0-9cd2-b8d4dae84db9 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:31.479740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc38dd1-ed72-4da0-9cd2-b8d4dae84db9 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:31.479740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc38dd1-ed72-4da0-9cd2-b8d4dae84db9 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:31.558903 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4171/8277] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:31 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:31.562943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04e8d0-8bac-45f0-8ab6-9a79aeae7ab4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:31.573660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04e8d0-8bac-45f0-8ab6-9a79aeae7ab4 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:31.631058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747fe259-9a41-460e-b796-3d5f30f14e33 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:31.631993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fe259-9a41-460e-b796-3d5f30f14e33 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:31.632281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fe259-9a41-460e-b796-3d5f30f14e33 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:31.632563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fe259-9a41-460e-b796-3d5f30f14e33 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/55d0144365d84b6cbdc3c05475567ee1` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:31.633828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747fe259-9a41-460e-b796-3d5f30f14e33 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:update_project(project_id=55d0144365d84b6cbdc3c05475567ee1)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:31.635784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747fe259-9a41-460e-b796-3d5f30f14e33 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:31.742482 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4107/8278] 10.222.0.16 () {60 vars in 1251 bytes} [Sat Jul 16 21:52:31 2022] PATCH /identity/v3/projects/55d0144365d84b6cbdc3c05475567ee1 => generated 373 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:31.746787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc38dd1-ed72-4da0-9cd2-b8d4dae84db9 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:31.757756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc38dd1-ed72-4da0-9cd2-b8d4dae84db9 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:31.762630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3dab1-4ede-44b1-8c75-7f23a52f1584 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:31.764080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3dab1-4ede-44b1-8c75-7f23a52f1584 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:31.764407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3dab1-4ede-44b1-8c75-7f23a52f1584 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:31.764773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3dab1-4ede-44b1-8c75-7f23a52f1584 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/55d0144365d84b6cbdc3c05475567ee1` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:31.776323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3dab1-4ede-44b1-8c75-7f23a52f1584 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:get_project(project_id=55d0144365d84b6cbdc3c05475567ee1)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:31.778526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3dab1-4ede-44b1-8c75-7f23a52f1584 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:31.780991 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4172/8279] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:52:31 2022] GET /identity/v3/projects/55d0144365d84b6cbdc3c05475567ee1 => generated 360 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:31.785135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747fe259-9a41-460e-b796-3d5f30f14e33 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:31.795264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747fe259-9a41-460e-b796-3d5f30f14e33 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:31.800003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55a39c-bc40-4b1d-9e77-82f79e25384f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:31.800852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55a39c-bc40-4b1d-9e77-82f79e25384f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:31.801139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55a39c-bc40-4b1d-9e77-82f79e25384f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:31.801431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55a39c-bc40-4b1d-9e77-82f79e25384f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/55d0144365d84b6cbdc3c05475567ee1` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:31.802634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55a39c-bc40-4b1d-9e77-82f79e25384f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:delete_project(project_id=55d0144365d84b6cbdc3c05475567ee1)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:31.804571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55a39c-bc40-4b1d-9e77-82f79e25384f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:31.944775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-af55a39c-bc40-4b1d-9e77-82f79e25384f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d0144365d84b6cbdc3c05475567ee1', 'request_id': 'req-af55a39c-bc40-4b1d-9e77-82f79e25384f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:31.950377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-af55a39c-bc40-4b1d-9e77-82f79e25384f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d0144365d84b6cbdc3c05475567ee1', 'request_id': 'req-af55a39c-bc40-4b1d-9e77-82f79e25384f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:31.957600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-af55a39c-bc40-4b1d-9e77-82f79e25384f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d0144365d84b6cbdc3c05475567ee1', 'request_id': 'req-af55a39c-bc40-4b1d-9e77-82f79e25384f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:32.066886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-af55a39c-bc40-4b1d-9e77-82f79e25384f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] The token cache is being invalidate because project 55d0144365d84b6cbdc3c05475567ee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:32.067634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-af55a39c-bc40-4b1d-9e77-82f79e25384f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:32.067915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-af55a39c-bc40-4b1d-9e77-82f79e25384f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:32.069480 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4108/8280] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:31 2022] DELETE /identity/v3/projects/55d0144365d84b6cbdc3c05475567ee1 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:32.074679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3dab1-4ede-44b1-8c75-7f23a52f1584 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:32.076621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b1f3dab1-4ede-44b1-8c75-7f23a52f1584 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:32.090674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3dab1-4ede-44b1-8c75-7f23a52f1584 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:32.149136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a047f-cb10-487f-9e83-966831e171f5 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:32.149750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a047f-cb10-487f-9e83-966831e171f5 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:32.150059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a047f-cb10-487f-9e83-966831e171f5 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:32.150342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a047f-cb10-487f-9e83-966831e171f5 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:32.151063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a047f-cb10-487f-9e83-966831e171f5 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:32.153029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a047f-cb10-487f-9e83-966831e171f5 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:32.266537 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4173/8281] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:32 2022] POST /identity/v3/projects => generated 354 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:32.270683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55a39c-bc40-4b1d-9e77-82f79e25384f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:32.281497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55a39c-bc40-4b1d-9e77-82f79e25384f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:32.290259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:32.338379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfe156-a804-42b3-a29c-b74e8d82447a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:32.339280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfe156-a804-42b3-a29c-b74e8d82447a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:32.339838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfe156-a804-42b3-a29c-b74e8d82447a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:32.339838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfe156-a804-42b3-a29c-b74e8d82447a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/d7cd8f92366e42f18b3f4c65d131a2d8` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:32.341082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfe156-a804-42b3-a29c-b74e8d82447a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:update_project(project_id=d7cd8f92366e42f18b3f4c65d131a2d8)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:32.343925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfe156-a804-42b3-a29c-b74e8d82447a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:32.440737 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4109/8282] 10.222.0.16 () {60 vars in 1251 bytes} [Sat Jul 16 21:52:32 2022] PATCH /identity/v3/projects/d7cd8f92366e42f18b3f4c65d131a2d8 => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:32.444901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a047f-cb10-487f-9e83-966831e171f5 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:32.457019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a047f-cb10-487f-9e83-966831e171f5 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:32.461885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d0cd8-b42f-4c8c-bf72-3828ca81678f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:32.462742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d0cd8-b42f-4c8c-bf72-3828ca81678f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:32.466303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d0cd8-b42f-4c8c-bf72-3828ca81678f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:32.466303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d0cd8-b42f-4c8c-bf72-3828ca81678f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/d7cd8f92366e42f18b3f4c65d131a2d8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:32.476071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d0cd8-b42f-4c8c-bf72-3828ca81678f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:get_project(project_id=d7cd8f92366e42f18b3f4c65d131a2d8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:32.478299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d0cd8-b42f-4c8c-bf72-3828ca81678f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:32.480094 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4174/8283] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Jul 16 21:52:32 2022] GET /identity/v3/projects/d7cd8f92366e42f18b3f4c65d131a2d8 => generated 355 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:32.484131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfe156-a804-42b3-a29c-b74e8d82447a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:32.493987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfe156-a804-42b3-a29c-b74e8d82447a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:32.498562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55671f5e-0eda-4cc0-9e76-de9d5b6255f6 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:32.499613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55671f5e-0eda-4cc0-9e76-de9d5b6255f6 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:32.499951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55671f5e-0eda-4cc0-9e76-de9d5b6255f6 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:32.500230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55671f5e-0eda-4cc0-9e76-de9d5b6255f6 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/projects/d7cd8f92366e42f18b3f4c65d131a2d8` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:32.501418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55671f5e-0eda-4cc0-9e76-de9d5b6255f6 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d7cd8f92366e42f18b3f4c65d131a2d8)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:32.503353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55671f5e-0eda-4cc0-9e76-de9d5b6255f6 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:32.634510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-55671f5e-0eda-4cc0-9e76-de9d5b6255f6 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7cd8f92366e42f18b3f4c65d131a2d8', 'request_id': 'req-55671f5e-0eda-4cc0-9e76-de9d5b6255f6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:32.640991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-55671f5e-0eda-4cc0-9e76-de9d5b6255f6 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7cd8f92366e42f18b3f4c65d131a2d8', 'request_id': 'req-55671f5e-0eda-4cc0-9e76-de9d5b6255f6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:32.647209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-55671f5e-0eda-4cc0-9e76-de9d5b6255f6 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7cd8f92366e42f18b3f4c65d131a2d8', 'request_id': 'req-55671f5e-0eda-4cc0-9e76-de9d5b6255f6'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:32.741776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-55671f5e-0eda-4cc0-9e76-de9d5b6255f6 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] The token cache is being invalidate because project d7cd8f92366e42f18b3f4c65d131a2d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:32.741983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-55671f5e-0eda-4cc0-9e76-de9d5b6255f6 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:32.742633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-55671f5e-0eda-4cc0-9e76-de9d5b6255f6 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:32.744240 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4110/8284] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:32 2022] DELETE /identity/v3/projects/d7cd8f92366e42f18b3f4c65d131a2d8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:32.750185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d0cd8-b42f-4c8c-bf72-3828ca81678f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:32.752242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d66d0cd8-b42f-4c8c-bf72-3828ca81678f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:32.766250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d0cd8-b42f-4c8c-bf72-3828ca81678f tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:32.812567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:32.829450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b4151-5005-4fd0-a1a7-6fc0c3e0ec1a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:32.830314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b4151-5005-4fd0-a1a7-6fc0c3e0ec1a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:32.830599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b4151-5005-4fd0-a1a7-6fc0c3e0ec1a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:32.830874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b4151-5005-4fd0-a1a7-6fc0c3e0ec1a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/domains/eaa667ddacc645b3b80ffee46569bf82` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:32.838066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b4151-5005-4fd0-a1a7-6fc0c3e0ec1a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 21:52:32.848456 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application [None req-e19b4151-5005-4fd0-a1a7-6fc0c3e0ec1a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Could not find domain: eaa667ddacc645b3b80ffee46569bf82.: keystone.exception.DomainNotFound: Could not find domain: eaa667ddacc645b3b80ffee46569bf82. Jul 16 21:52:32.848456 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:52:32.848456 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 16 21:52:32.848456 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 16 21:52:32.848456 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 21:52:32.848456 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 21:52:32.848456 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 21:52:32.848456 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 21:52:32.848456 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: eaa667ddacc645b3b80ffee46569bf82. Jul 16 21:52:32.848456 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:52:32.848456 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:52:32.848456 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:52:32.848456 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:52:32.848456 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:52:32.848456 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:52:32.848456 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:52:32.849734 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:52:32.849734 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:52:32.849734 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:52:32.849734 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:52:32.849734 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:52:32.849734 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:52:32.849734 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:52:32.849734 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 16 21:52:32.849734 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 16 21:52:32.849734 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 21:52:32.849734 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 21:52:32.849734 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 21:52:32.849734 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 21:52:32.849734 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:52:32.849734 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:52:32.849734 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:52:32.850702 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:52:32.850702 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:52:32.850702 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:52:32.850702 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:52:32.850702 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application with Lock( Jul 16 21:52:32.850702 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:52:32.850702 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:52:32.850702 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:52:32.850702 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:52:32.850702 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:52:32.850702 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:52:32.850702 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:52:32.850702 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:52:32.850702 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 16 21:52:32.850702 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 21:52:32.850702 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: eaa667ddacc645b3b80ffee46569bf82. Jul 16 21:52:32.850702 ncdv-master-1 devstack@keystone.service[98196]: ERROR keystone.server.flask.application Jul 16 21:52:32.852038 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4175/8285] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:52:32 2022] PATCH /identity/v3/domains/eaa667ddacc645b3b80ffee46569bf82 => generated 112 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:52:32.853980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55671f5e-0eda-4cc0-9e76-de9d5b6255f6 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:32.864694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55671f5e-0eda-4cc0-9e76-de9d5b6255f6 tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:32.869549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5e1e5-6a43-4f2d-aeda-55acaf7ce97b tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f8be781ca54b9e9232ab8a5a42dff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea2d7f0994494eda89a4d86c46996a29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:32.870409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5e1e5-6a43-4f2d-aeda-55acaf7ce97b tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] REQUEST_METHOD: `PATCH` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:32.870697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5e1e5-6a43-4f2d-aeda-55acaf7ce97b tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:32.870973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5e1e5-6a43-4f2d-aeda-55acaf7ce97b tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] PATH_INFO: `/v3/domains/c759082c4d2641f0a3d2ac1543307595` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:32.879555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5e1e5-6a43-4f2d-aeda-55acaf7ce97b tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 16 21:52:32.890316 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application [None req-0bf5e1e5-6a43-4f2d-aeda-55acaf7ce97b tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Could not find domain: c759082c4d2641f0a3d2ac1543307595.: keystone.exception.DomainNotFound: Could not find domain: c759082c4d2641f0a3d2ac1543307595. Jul 16 21:52:32.890316 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:52:32.890316 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 16 21:52:32.890316 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 16 21:52:32.890316 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 16 21:52:32.890316 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 16 21:52:32.890316 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 16 21:52:32.890316 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 16 21:52:32.890316 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c759082c4d2641f0a3d2ac1543307595. Jul 16 21:52:32.890316 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:52:32.890316 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 16 21:52:32.890316 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:52:32.890316 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 16 21:52:32.890316 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 16 21:52:32.890316 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 16 21:52:32.890316 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 16 21:52:32.891332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 16 21:52:32.891332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 16 21:52:32.891332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 16 21:52:32.891332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 16 21:52:32.891332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 16 21:52:32.891332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 16 21:52:32.891332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 16 21:52:32.891332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 16 21:52:32.891332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 16 21:52:32.891332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 16 21:52:32.891332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 16 21:52:32.891332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 16 21:52:32.891332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 16 21:52:32.891332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 16 21:52:32.891332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 16 21:52:32.891332 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 16 21:52:32.892233 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 16 21:52:32.892233 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 16 21:52:32.892233 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.get_or_create( Jul 16 21:52:32.892233 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 16 21:52:32.892233 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application with Lock( Jul 16 21:52:32.892233 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 16 21:52:32.892233 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self._enter() Jul 16 21:52:32.892233 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 16 21:52:32.892233 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 16 21:52:32.892233 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 16 21:52:32.892233 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application return self.creator() Jul 16 21:52:32.892233 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 16 21:52:32.892233 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application created_value = creator( Jul 16 21:52:32.892233 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 16 21:52:32.892233 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 16 21:52:32.892233 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c759082c4d2641f0a3d2ac1543307595. Jul 16 21:52:32.892233 ncdv-master-1 devstack@keystone.service[98195]: ERROR keystone.server.flask.application Jul 16 21:52:32.893416 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4111/8286] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Jul 16 21:52:32 2022] PATCH /identity/v3/domains/c759082c4d2641f0a3d2ac1543307595 => generated 112 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 16 21:52:32.895577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b4151-5005-4fd0-a1a7-6fc0c3e0ec1a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:32.897289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e19b4151-5005-4fd0-a1a7-6fc0c3e0ec1a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:32.961469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b4151-5005-4fd0-a1a7-6fc0c3e0ec1a tempest-ProjectsTestJSON-691057595 tempest-ProjectsTestJSON-691057595-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:32.966645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce321f-31ea-48d4-81b8-cc0cc5ec3e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:32.967550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce321f-31ea-48d4-81b8-cc0cc5ec3e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:32.967870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce321f-31ea-48d4-81b8-cc0cc5ec3e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:32.968197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce321f-31ea-48d4-81b8-cc0cc5ec3e8c admin admin] PATH_INFO: `/v3/users/df71ad9b1f7d4cc7bdaae9a17d75d808` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:32.974453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce321f-31ea-48d4-81b8-cc0cc5ec3e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=df71ad9b1f7d4cc7bdaae9a17d75d808)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:32.974453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce321f-31ea-48d4-81b8-cc0cc5ec3e8c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:33.137986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7fce321f-31ea-48d4-81b8-cc0cc5ec3e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df71ad9b1f7d4cc7bdaae9a17d75d808'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:33.145387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7fce321f-31ea-48d4-81b8-cc0cc5ec3e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df71ad9b1f7d4cc7bdaae9a17d75d808'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:33.233232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7fce321f-31ea-48d4-81b8-cc0cc5ec3e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df71ad9b1f7d4cc7bdaae9a17d75d808'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:33.234557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7fce321f-31ea-48d4-81b8-cc0cc5ec3e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df71ad9b1f7d4cc7bdaae9a17d75d808'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:33.248231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7fce321f-31ea-48d4-81b8-cc0cc5ec3e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df71ad9b1f7d4cc7bdaae9a17d75d808'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:33.254969 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4176/8287] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:52:32 2022] DELETE /identity/v3/users/df71ad9b1f7d4cc7bdaae9a17d75d808 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:33.259656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8327f-0ba6-4a16-b32f-b1ebf2a6d5a6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:33.260128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8327f-0ba6-4a16-b32f-b1ebf2a6d5a6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:33.261347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8327f-0ba6-4a16-b32f-b1ebf2a6d5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:33.281089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-17c8327f-0ba6-4a16-b32f-b1ebf2a6d5a6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:33.282287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-17c8327f-0ba6-4a16-b32f-b1ebf2a6d5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:33.343914 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4112/8288] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:52:33.353755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce321f-31ea-48d4-81b8-cc0cc5ec3e8c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:33.355173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7fce321f-31ea-48d4-81b8-cc0cc5ec3e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:33.415186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce321f-31ea-48d4-81b8-cc0cc5ec3e8c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:33.418819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80503586-968e-430c-8e5d-d43b08fb2efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:33.419499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80503586-968e-430c-8e5d-d43b08fb2efa service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:33.429697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80503586-968e-430c-8e5d-d43b08fb2efa service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:33.429697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80503586-968e-430c-8e5d-d43b08fb2efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:33.430016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80503586-968e-430c-8e5d-d43b08fb2efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:33.431257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80503586-968e-430c-8e5d-d43b08fb2efa service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:33.441255 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4177/8289] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:52:33.828693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8327f-0ba6-4a16-b32f-b1ebf2a6d5a6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:33.830127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-17c8327f-0ba6-4a16-b32f-b1ebf2a6d5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:33.843576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8327f-0ba6-4a16-b32f-b1ebf2a6d5a6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:33.849502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61946c-f645-44cc-84c9-83b90b6147f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:33.850727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61946c-f645-44cc-84c9-83b90b6147f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:33.851035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61946c-f645-44cc-84c9-83b90b6147f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:33.851320 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61946c-f645-44cc-84c9-83b90b6147f8 admin admin] PATH_INFO: `/v3/projects/8028bd47ba5a4e54b15e062544aeb77f` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:33.852570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61946c-f645-44cc-84c9-83b90b6147f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8028bd47ba5a4e54b15e062544aeb77f)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:33.855762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61946c-f645-44cc-84c9-83b90b6147f8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:33.857420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:34.016816 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6a61946c-f645-44cc-84c9-83b90b6147f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8028bd47ba5a4e54b15e062544aeb77f', 'request_id': 'req-6a61946c-f645-44cc-84c9-83b90b6147f8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:34.022501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6a61946c-f645-44cc-84c9-83b90b6147f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8028bd47ba5a4e54b15e062544aeb77f', 'request_id': 'req-6a61946c-f645-44cc-84c9-83b90b6147f8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:34.031084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6a61946c-f645-44cc-84c9-83b90b6147f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8028bd47ba5a4e54b15e062544aeb77f', 'request_id': 'req-6a61946c-f645-44cc-84c9-83b90b6147f8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:34.095821 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6a61946c-f645-44cc-84c9-83b90b6147f8 admin admin] The token cache is being invalidate because project 8028bd47ba5a4e54b15e062544aeb77f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:34.096116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6a61946c-f645-44cc-84c9-83b90b6147f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:34.096999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6a61946c-f645-44cc-84c9-83b90b6147f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:34.098597 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4113/8290] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:33 2022] DELETE /identity/v3/projects/8028bd47ba5a4e54b15e062544aeb77f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:34.102717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80503586-968e-430c-8e5d-d43b08fb2efa service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:34.113323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80503586-968e-430c-8e5d-d43b08fb2efa service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:34.117060 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:34.172268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17fbe0-30a2-40a3-976b-a6934e29f2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:34.173132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17fbe0-30a2-40a3-976b-a6934e29f2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:34.173414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17fbe0-30a2-40a3-976b-a6934e29f2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:34.173689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17fbe0-30a2-40a3-976b-a6934e29f2bc admin admin] PATH_INFO: `/v3/users/68f8be781ca54b9e9232ab8a5a42dff4` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:34.174871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17fbe0-30a2-40a3-976b-a6934e29f2bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=68f8be781ca54b9e9232ab8a5a42dff4)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:34.176945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17fbe0-30a2-40a3-976b-a6934e29f2bc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:34.342385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4e17fbe0-30a2-40a3-976b-a6934e29f2bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68f8be781ca54b9e9232ab8a5a42dff4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:34.350612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4e17fbe0-30a2-40a3-976b-a6934e29f2bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68f8be781ca54b9e9232ab8a5a42dff4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:34.420468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4e17fbe0-30a2-40a3-976b-a6934e29f2bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68f8be781ca54b9e9232ab8a5a42dff4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:34.421882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4e17fbe0-30a2-40a3-976b-a6934e29f2bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68f8be781ca54b9e9232ab8a5a42dff4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:34.434488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4e17fbe0-30a2-40a3-976b-a6934e29f2bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68f8be781ca54b9e9232ab8a5a42dff4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:34.440558 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4178/8291] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:52:34 2022] DELETE /identity/v3/users/68f8be781ca54b9e9232ab8a5a42dff4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:34.830008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61946c-f645-44cc-84c9-83b90b6147f8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:34.831628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6a61946c-f645-44cc-84c9-83b90b6147f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:34.846898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61946c-f645-44cc-84c9-83b90b6147f8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:34.905224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834abeb-61f0-4415-8c8e-362b87738d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:34.906088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834abeb-61f0-4415-8c8e-362b87738d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:34.906481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834abeb-61f0-4415-8c8e-362b87738d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:34.906760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834abeb-61f0-4415-8c8e-362b87738d85 admin admin] PATH_INFO: `/v3/projects/ea2d7f0994494eda89a4d86c46996a29` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:34.907980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834abeb-61f0-4415-8c8e-362b87738d85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea2d7f0994494eda89a4d86c46996a29)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:34.909925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834abeb-61f0-4415-8c8e-362b87738d85 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:35.054943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6834abeb-61f0-4415-8c8e-362b87738d85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea2d7f0994494eda89a4d86c46996a29', 'request_id': 'req-6834abeb-61f0-4415-8c8e-362b87738d85'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:35.060446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6834abeb-61f0-4415-8c8e-362b87738d85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea2d7f0994494eda89a4d86c46996a29', 'request_id': 'req-6834abeb-61f0-4415-8c8e-362b87738d85'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:35.067496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6834abeb-61f0-4415-8c8e-362b87738d85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea2d7f0994494eda89a4d86c46996a29', 'request_id': 'req-6834abeb-61f0-4415-8c8e-362b87738d85'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:35.146581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6834abeb-61f0-4415-8c8e-362b87738d85 admin admin] The token cache is being invalidate because project ea2d7f0994494eda89a4d86c46996a29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:35.146786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6834abeb-61f0-4415-8c8e-362b87738d85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:35.147430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6834abeb-61f0-4415-8c8e-362b87738d85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:35.148998 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4114/8292] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:34 2022] DELETE /identity/v3/projects/ea2d7f0994494eda89a4d86c46996a29 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:35.154854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec1257-8fd9-43bf-b9c3-9130daa6afab None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:35.155507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec1257-8fd9-43bf-b9c3-9130daa6afab None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:35.155507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec1257-8fd9-43bf-b9c3-9130daa6afab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:35.174108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8cec1257-8fd9-43bf-b9c3-9130daa6afab None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:35.175328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8cec1257-8fd9-43bf-b9c3-9130daa6afab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:35.234972 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4179/8293] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:35.243664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae8a82-b552-4382-a5b4-3f7a7b6964b0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:35.243960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae8a82-b552-4382-a5b4-3f7a7b6964b0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:35.244243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae8a82-b552-4382-a5b4-3f7a7b6964b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:35.267852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-16ae8a82-b552-4382-a5b4-3f7a7b6964b0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:35.269081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-16ae8a82-b552-4382-a5b4-3f7a7b6964b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:35.277183 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4115/8294] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:35.281675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec1257-8fd9-43bf-b9c3-9130daa6afab None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:35.291672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec1257-8fd9-43bf-b9c3-9130daa6afab None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:35.297235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fbed3-6dae-4672-b63b-9a5eb62126d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:35.297888 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fbed3-6dae-4672-b63b-9a5eb62126d6 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:35.298174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fbed3-6dae-4672-b63b-9a5eb62126d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:35.298451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fbed3-6dae-4672-b63b-9a5eb62126d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:35.299221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874fbed3-6dae-4672-b63b-9a5eb62126d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:52:35.299533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874fbed3-6dae-4672-b63b-9a5eb62126d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:35.301144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874fbed3-6dae-4672-b63b-9a5eb62126d6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:35.313506 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4180/8295] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:35.317817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae8a82-b552-4382-a5b4-3f7a7b6964b0 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:35.327298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae8a82-b552-4382-a5b4-3f7a7b6964b0 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:35.331969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba783bd-a789-4126-8127-dbf615d79aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:35.332621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba783bd-a789-4126-8127-dbf615d79aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:35.332884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba783bd-a789-4126-8127-dbf615d79aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:35.333157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba783bd-a789-4126-8127-dbf615d79aa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:35.333845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba783bd-a789-4126-8127-dbf615d79aa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:35.335758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba783bd-a789-4126-8127-dbf615d79aa9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:35.345510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:35.434228 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4116/8296] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:35 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:52:35.439549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fbed3-6dae-4672-b63b-9a5eb62126d6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:35.450197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fbed3-6dae-4672-b63b-9a5eb62126d6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:35.461527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:35.514924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4582a60-1f41-413e-a535-b40938cb2d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:35.515635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4582a60-1f41-413e-a535-b40938cb2d54 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:35.515924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4582a60-1f41-413e-a535-b40938cb2d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:35.516205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4582a60-1f41-413e-a535-b40938cb2d54 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:35.516895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4582a60-1f41-413e-a535-b40938cb2d54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:35.518825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4582a60-1f41-413e-a535-b40938cb2d54 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:35.620977 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4181/8297] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:52:35 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:35.625989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba783bd-a789-4126-8127-dbf615d79aa9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:35.638129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba783bd-a789-4126-8127-dbf615d79aa9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:35.643780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e306c9-e053-45dd-9537-65c9b74271cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:35.644455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e306c9-e053-45dd-9537-65c9b74271cb admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:35.644749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e306c9-e053-45dd-9537-65c9b74271cb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:35.645003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e306c9-e053-45dd-9537-65c9b74271cb admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:35.645726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e306c9-e053-45dd-9537-65c9b74271cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:35.647364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e306c9-e053-45dd-9537-65c9b74271cb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:35.660655 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4117/8298] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:52:35.664751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4582a60-1f41-413e-a535-b40938cb2d54 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:35.676664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4582a60-1f41-413e-a535-b40938cb2d54 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:35.682477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea38537-8608-4f55-a1ec-604777e82b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:35.683188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea38537-8608-4f55-a1ec-604777e82b06 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:35.683466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea38537-8608-4f55-a1ec-604777e82b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:35.683744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea38537-8608-4f55-a1ec-604777e82b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:35.684521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea38537-8608-4f55-a1ec-604777e82b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:35.686070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea38537-8608-4f55-a1ec-604777e82b06 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:35.698514 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4182/8299] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:35.702970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e306c9-e053-45dd-9537-65c9b74271cb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:35.715075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e306c9-e053-45dd-9537-65c9b74271cb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:35.720755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1cefd-bc45-439b-bd32-39d4dd4929a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:35.721909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1cefd-bc45-439b-bd32-39d4dd4929a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:35.722189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1cefd-bc45-439b-bd32-39d4dd4929a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:35.722465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1cefd-bc45-439b-bd32-39d4dd4929a8 admin admin] PATH_INFO: `/v3/projects/caad227eb4ec4b49a96ac36ddf773208/users/3e711040268e4c608129707c279ea0d8/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:35.738460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1cefd-bc45-439b-bd32-39d4dd4929a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caad227eb4ec4b49a96ac36ddf773208, user_id=3e711040268e4c608129707c279ea0d8, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:35.741186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1cefd-bc45-439b-bd32-39d4dd4929a8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:35.822199 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4118/8300] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:52:35 2022] PUT /identity/v3/projects/caad227eb4ec4b49a96ac36ddf773208/users/3e711040268e4c608129707c279ea0d8/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:52:35.834550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e511bf6-3371-454d-939a-fa3dfe8e0d48 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:35.834844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e511bf6-3371-454d-939a-fa3dfe8e0d48 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:35.835168 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e511bf6-3371-454d-939a-fa3dfe8e0d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:35.864881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5e511bf6-3371-454d-939a-fa3dfe8e0d48 None None] MFA Rules not processed for user `3e711040268e4c608129707c279ea0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:35.866196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5e511bf6-3371-454d-939a-fa3dfe8e0d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:35.942279 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4183/8301] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:35.947252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1cefd-bc45-439b-bd32-39d4dd4929a8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:35.957907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1cefd-bc45-439b-bd32-39d4dd4929a8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:35.962847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6005182-15ee-4084-bf19-012316883e45 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e711040268e4c608129707c279ea0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caad227eb4ec4b49a96ac36ddf773208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:35.963872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6005182-15ee-4084-bf19-012316883e45 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:35.964165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6005182-15ee-4084-bf19-012316883e45 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:35.964450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6005182-15ee-4084-bf19-012316883e45 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] PATH_INFO: `/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:35.965217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6005182-15ee-4084-bf19-012316883e45 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorizing `identity:create_application_credential(user_id=3e711040268e4c608129707c279ea0d8)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:35.966720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6005182-15ee-4084-bf19-012316883e45 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:36.165995 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4119/8302] 10.222.0.16 () {60 vars in 1313 bytes} [Sat Jul 16 21:52:35 2022] POST /identity/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials => generated 789 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:36.170316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e511bf6-3371-454d-939a-fa3dfe8e0d48 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:36.179127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e511bf6-3371-454d-939a-fa3dfe8e0d48 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:36.183294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e00e4-055a-448d-ae79-14702814d900 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e711040268e4c608129707c279ea0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caad227eb4ec4b49a96ac36ddf773208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:36.184221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e00e4-055a-448d-ae79-14702814d900 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:36.184502 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e00e4-055a-448d-ae79-14702814d900 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:36.184777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e00e4-055a-448d-ae79-14702814d900 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] PATH_INFO: `/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials/897a136aabd847e4b9e4ef7ba9e395e2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:36.197352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e00e4-055a-448d-ae79-14702814d900 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorizing `identity:get_application_credential(user_id=3e711040268e4c608129707c279ea0d8, application_credential_id=897a136aabd847e4b9e4ef7ba9e395e2)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:36.197352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e00e4-055a-448d-ae79-14702814d900 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:36.197352 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4184/8303] 10.222.0.16 () {58 vars in 1391 bytes} [Sat Jul 16 21:52:36 2022] GET /identity/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials/897a136aabd847e4b9e4ef7ba9e395e2 => generated 689 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:36.201211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17abc89-c05b-4d98-a4ec-78f1baec61d9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:36.201507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17abc89-c05b-4d98-a4ec-78f1baec61d9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:36.201791 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17abc89-c05b-4d98-a4ec-78f1baec61d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:36.215647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d17abc89-c05b-4d98-a4ec-78f1baec61d9 None None] MFA Rules not processed for user `3e711040268e4c608129707c279ea0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:36.216863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d17abc89-c05b-4d98-a4ec-78f1baec61d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:36.316242 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4120/8304] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:36 2022] POST /identity/v3/auth/tokens => generated 3417 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 16 21:52:36.320699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e00e4-055a-448d-ae79-14702814d900 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:36.331190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e00e4-055a-448d-ae79-14702814d900 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:36.337051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfa9f1-efe4-44fd-b070-48a7d64417a2 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e711040268e4c608129707c279ea0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caad227eb4ec4b49a96ac36ddf773208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:36.337979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfa9f1-efe4-44fd-b070-48a7d64417a2 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:36.338259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfa9f1-efe4-44fd-b070-48a7d64417a2 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:36.338535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfa9f1-efe4-44fd-b070-48a7d64417a2 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] PATH_INFO: `/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials/897a136aabd847e4b9e4ef7ba9e395e2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:36.339764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfa9f1-efe4-44fd-b070-48a7d64417a2 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorizing `identity:delete_application_credential(user_id=3e711040268e4c608129707c279ea0d8, application_credential_id=897a136aabd847e4b9e4ef7ba9e395e2)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:36.341256 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfa9f1-efe4-44fd-b070-48a7d64417a2 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:36.456443 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4185/8305] 10.222.0.16 () {58 vars in 1394 bytes} [Sat Jul 16 21:52:36 2022] DELETE /identity/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials/897a136aabd847e4b9e4ef7ba9e395e2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:36.461795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17abc89-c05b-4d98-a4ec-78f1baec61d9 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:36.472199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17abc89-c05b-4d98-a4ec-78f1baec61d9 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:36.476345 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e7394-b8a3-4c33-ad04-776905e46af8 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e711040268e4c608129707c279ea0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caad227eb4ec4b49a96ac36ddf773208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:36.477213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e7394-b8a3-4c33-ad04-776905e46af8 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:36.477566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e7394-b8a3-4c33-ad04-776905e46af8 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:36.477842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e7394-b8a3-4c33-ad04-776905e46af8 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] PATH_INFO: `/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:36.482824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e7394-b8a3-4c33-ad04-776905e46af8 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorizing `identity:create_application_credential(user_id=3e711040268e4c608129707c279ea0d8)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:36.482824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e7394-b8a3-4c33-ad04-776905e46af8 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:36.483928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:36.617023 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4121/8306] 10.222.0.16 () {60 vars in 1314 bytes} [Sat Jul 16 21:52:36 2022] POST /identity/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials => generated 920 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:36.621315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfa9f1-efe4-44fd-b070-48a7d64417a2 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:36.631492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfa9f1-efe4-44fd-b070-48a7d64417a2 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:36.635598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a69caf-342c-4717-9663-f5f883637568 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e711040268e4c608129707c279ea0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caad227eb4ec4b49a96ac36ddf773208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:36.636519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a69caf-342c-4717-9663-f5f883637568 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:36.636818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a69caf-342c-4717-9663-f5f883637568 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:36.637086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a69caf-342c-4717-9663-f5f883637568 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] PATH_INFO: `/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials/53bcbd416caf4588be4a89cd474f140d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:36.648101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a69caf-342c-4717-9663-f5f883637568 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorizing `identity:delete_application_credential(user_id=3e711040268e4c608129707c279ea0d8, application_credential_id=53bcbd416caf4588be4a89cd474f140d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:36.649612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a69caf-342c-4717-9663-f5f883637568 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:36.725216 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4186/8307] 10.222.0.16 () {58 vars in 1394 bytes} [Sat Jul 16 21:52:36 2022] DELETE /identity/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials/53bcbd416caf4588be4a89cd474f140d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:36.730189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e7394-b8a3-4c33-ad04-776905e46af8 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:36.739938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e7394-b8a3-4c33-ad04-776905e46af8 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:36.744486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3992505-fd51-4d2b-93d8-f0769b0d29a7 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e711040268e4c608129707c279ea0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caad227eb4ec4b49a96ac36ddf773208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:36.745356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3992505-fd51-4d2b-93d8-f0769b0d29a7 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:36.745640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3992505-fd51-4d2b-93d8-f0769b0d29a7 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:36.745925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3992505-fd51-4d2b-93d8-f0769b0d29a7 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] PATH_INFO: `/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:36.746692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3992505-fd51-4d2b-93d8-f0769b0d29a7 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorizing `identity:create_application_credential(user_id=3e711040268e4c608129707c279ea0d8)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:36.747893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3992505-fd51-4d2b-93d8-f0769b0d29a7 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:36.866580 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4122/8308] 10.222.0.16 () {60 vars in 1314 bytes} [Sat Jul 16 21:52:36 2022] POST /identity/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials => generated 812 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:36.867807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a69caf-342c-4717-9663-f5f883637568 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:36.878412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a69caf-342c-4717-9663-f5f883637568 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:36.883215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6001b29-ed5c-4cca-9c1d-18a13658b053 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e711040268e4c608129707c279ea0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caad227eb4ec4b49a96ac36ddf773208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:36.883640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6001b29-ed5c-4cca-9c1d-18a13658b053 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:36.883908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6001b29-ed5c-4cca-9c1d-18a13658b053 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:36.884184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6001b29-ed5c-4cca-9c1d-18a13658b053 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] PATH_INFO: `/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials/83e42b17222e43a3a71d333303b5cc60` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:36.888879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:36.893894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6001b29-ed5c-4cca-9c1d-18a13658b053 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorizing `identity:delete_application_credential(user_id=3e711040268e4c608129707c279ea0d8, application_credential_id=83e42b17222e43a3a71d333303b5cc60)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:36.895511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6001b29-ed5c-4cca-9c1d-18a13658b053 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:36.976632 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4187/8309] 10.222.0.16 () {58 vars in 1394 bytes} [Sat Jul 16 21:52:36 2022] DELETE /identity/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials/83e42b17222e43a3a71d333303b5cc60 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:36.981699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3992505-fd51-4d2b-93d8-f0769b0d29a7 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:36.991951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3992505-fd51-4d2b-93d8-f0769b0d29a7 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:36.996097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c50d01-d7d9-4ec7-a29e-39395a942f7b tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e711040268e4c608129707c279ea0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caad227eb4ec4b49a96ac36ddf773208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:36.997044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c50d01-d7d9-4ec7-a29e-39395a942f7b tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:36.997337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c50d01-d7d9-4ec7-a29e-39395a942f7b tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:36.997623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c50d01-d7d9-4ec7-a29e-39395a942f7b tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] PATH_INFO: `/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:36.998350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c50d01-d7d9-4ec7-a29e-39395a942f7b tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorizing `identity:create_application_credential(user_id=3e711040268e4c608129707c279ea0d8)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:36.999872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c50d01-d7d9-4ec7-a29e-39395a942f7b tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:37.147668 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4123/8310] 10.222.0.16 () {60 vars in 1313 bytes} [Sat Jul 16 21:52:36 2022] POST /identity/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials => generated 789 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:37.151922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6001b29-ed5c-4cca-9c1d-18a13658b053 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:37.161350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6001b29-ed5c-4cca-9c1d-18a13658b053 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:37.165427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b6211-7f1d-4c94-be09-ac88a37615a7 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e711040268e4c608129707c279ea0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caad227eb4ec4b49a96ac36ddf773208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:37.166306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b6211-7f1d-4c94-be09-ac88a37615a7 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:37.166682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b6211-7f1d-4c94-be09-ac88a37615a7 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:37.166963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b6211-7f1d-4c94-be09-ac88a37615a7 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] PATH_INFO: `/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:37.167720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b6211-7f1d-4c94-be09-ac88a37615a7 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorizing `identity:create_application_credential(user_id=3e711040268e4c608129707c279ea0d8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:37.168859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b6211-7f1d-4c94-be09-ac88a37615a7 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:37.323829 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4188/8311] 10.222.0.16 () {60 vars in 1313 bytes} [Sat Jul 16 21:52:37 2022] POST /identity/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials => generated 789 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:52:37.328776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c50d01-d7d9-4ec7-a29e-39395a942f7b tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:37.338388 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c50d01-d7d9-4ec7-a29e-39395a942f7b tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:37.342528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec814457-0735-499b-a850-f3297c9d0b06 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e711040268e4c608129707c279ea0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caad227eb4ec4b49a96ac36ddf773208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:37.343491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec814457-0735-499b-a850-f3297c9d0b06 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:37.343770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec814457-0735-499b-a850-f3297c9d0b06 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:37.344046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec814457-0735-499b-a850-f3297c9d0b06 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] PATH_INFO: `/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:37.344801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec814457-0735-499b-a850-f3297c9d0b06 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorizing `identity:list_application_credentials(user_id=3e711040268e4c608129707c279ea0d8)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:37.346714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec814457-0735-499b-a850-f3297c9d0b06 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:37.358385 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4124/8312] 10.222.0.16 () {58 vars in 1292 bytes} [Sat Jul 16 21:52:37 2022] GET /identity/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials => generated 1502 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:37.362507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b6211-7f1d-4c94-be09-ac88a37615a7 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:37.372018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b6211-7f1d-4c94-be09-ac88a37615a7 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:37.376686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c23a3-79b8-46a7-a2f4-7582828343cd tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e711040268e4c608129707c279ea0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caad227eb4ec4b49a96ac36ddf773208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:37.377606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c23a3-79b8-46a7-a2f4-7582828343cd tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:37.377887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c23a3-79b8-46a7-a2f4-7582828343cd tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:37.378247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c23a3-79b8-46a7-a2f4-7582828343cd tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] PATH_INFO: `/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials/61e4a218cdf44fa2a66fa251435c165e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:37.386844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c23a3-79b8-46a7-a2f4-7582828343cd tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorizing `identity:delete_application_credential(user_id=3e711040268e4c608129707c279ea0d8, application_credential_id=61e4a218cdf44fa2a66fa251435c165e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:37.388379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c23a3-79b8-46a7-a2f4-7582828343cd tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:37.456601 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4189/8313] 10.222.0.16 () {58 vars in 1394 bytes} [Sat Jul 16 21:52:37 2022] DELETE /identity/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials/61e4a218cdf44fa2a66fa251435c165e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:52:37.460952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec814457-0735-499b-a850-f3297c9d0b06 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:37.471259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec814457-0735-499b-a850-f3297c9d0b06 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:37.476097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1913d-03d2-4376-8334-a6bde000355e tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e711040268e4c608129707c279ea0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caad227eb4ec4b49a96ac36ddf773208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:37.477043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1913d-03d2-4376-8334-a6bde000355e tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:37.477325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1913d-03d2-4376-8334-a6bde000355e tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:37.477822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1913d-03d2-4376-8334-a6bde000355e tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] PATH_INFO: `/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials/8a682ffe47574be6a1456fc99032ce11` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:37.480145 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:37.487815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1913d-03d2-4376-8334-a6bde000355e tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorizing `identity:delete_application_credential(user_id=3e711040268e4c608129707c279ea0d8, application_credential_id=8a682ffe47574be6a1456fc99032ce11)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:37.489707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1913d-03d2-4376-8334-a6bde000355e tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:37.588771 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4125/8314] 10.222.0.16 () {58 vars in 1394 bytes} [Sat Jul 16 21:52:37 2022] DELETE /identity/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials/8a682ffe47574be6a1456fc99032ce11 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:37.594209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c23a3-79b8-46a7-a2f4-7582828343cd tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:37.604278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c23a3-79b8-46a7-a2f4-7582828343cd tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:37.609098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e420b6-7075-47af-9d61-eee11a04313a tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e711040268e4c608129707c279ea0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caad227eb4ec4b49a96ac36ddf773208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:37.610021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e420b6-7075-47af-9d61-eee11a04313a tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:37.610252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e420b6-7075-47af-9d61-eee11a04313a tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:37.610625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e420b6-7075-47af-9d61-eee11a04313a tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] PATH_INFO: `/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:37.611393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e420b6-7075-47af-9d61-eee11a04313a tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorizing `identity:create_application_credential(user_id=3e711040268e4c608129707c279ea0d8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:37.612558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e420b6-7075-47af-9d61-eee11a04313a tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:37.737493 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4190/8315] 10.222.0.16 () {60 vars in 1313 bytes} [Sat Jul 16 21:52:37 2022] POST /identity/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials => generated 789 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:52:37.741539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1913d-03d2-4376-8334-a6bde000355e tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:37.752153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1913d-03d2-4376-8334-a6bde000355e tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:37.756393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509eab7-8ae9-4fc5-9f50-b713a97b0f23 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e711040268e4c608129707c279ea0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caad227eb4ec4b49a96ac36ddf773208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:37.757289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509eab7-8ae9-4fc5-9f50-b713a97b0f23 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:37.757651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509eab7-8ae9-4fc5-9f50-b713a97b0f23 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:37.757987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509eab7-8ae9-4fc5-9f50-b713a97b0f23 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] PATH_INFO: `/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:37.758709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509eab7-8ae9-4fc5-9f50-b713a97b0f23 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorizing `identity:create_application_credential(user_id=3e711040268e4c608129707c279ea0d8)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:37.759881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509eab7-8ae9-4fc5-9f50-b713a97b0f23 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:37.868626 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4126/8316] 10.222.0.16 () {60 vars in 1313 bytes} [Sat Jul 16 21:52:37 2022] POST /identity/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials => generated 789 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:52:37.872859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e420b6-7075-47af-9d61-eee11a04313a tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:37.883409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e420b6-7075-47af-9d61-eee11a04313a tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:37.887507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd21d7d-b7c0-4bfd-bc51-a101f36296df tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e711040268e4c608129707c279ea0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caad227eb4ec4b49a96ac36ddf773208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:37.888374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd21d7d-b7c0-4bfd-bc51-a101f36296df tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:37.888666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd21d7d-b7c0-4bfd-bc51-a101f36296df tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:37.888945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd21d7d-b7c0-4bfd-bc51-a101f36296df tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] PATH_INFO: `/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:37.889672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd21d7d-b7c0-4bfd-bc51-a101f36296df tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Adding query filter params (name=tempest-application_credential-1590957118) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:52:37.890010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd21d7d-b7c0-4bfd-bc51-a101f36296df tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorizing `identity:list_application_credentials(user_id=3e711040268e4c608129707c279ea0d8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:37.891644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd21d7d-b7c0-4bfd-bc51-a101f36296df tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:37.901704 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4191/8317] 10.222.0.16 () {58 vars in 1385 bytes} [Sat Jul 16 21:52:37 2022] GET /identity/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials?name=tempest-application_credential-1590957118 => generated 887 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:37.906408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509eab7-8ae9-4fc5-9f50-b713a97b0f23 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:37.915743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509eab7-8ae9-4fc5-9f50-b713a97b0f23 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:37.919808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee8bb2-066b-4c1f-9050-d1d673edd605 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e711040268e4c608129707c279ea0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caad227eb4ec4b49a96ac36ddf773208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:37.921368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee8bb2-066b-4c1f-9050-d1d673edd605 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:37.921650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee8bb2-066b-4c1f-9050-d1d673edd605 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:37.921925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee8bb2-066b-4c1f-9050-d1d673edd605 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] PATH_INFO: `/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials/7cad3a0ddec3413eb98e24d5f0e99ab4` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:37.930531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee8bb2-066b-4c1f-9050-d1d673edd605 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorizing `identity:delete_application_credential(user_id=3e711040268e4c608129707c279ea0d8, application_credential_id=7cad3a0ddec3413eb98e24d5f0e99ab4)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:37.932051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee8bb2-066b-4c1f-9050-d1d673edd605 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:38.003620 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4127/8318] 10.222.0.16 () {58 vars in 1394 bytes} [Sat Jul 16 21:52:37 2022] DELETE /identity/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials/7cad3a0ddec3413eb98e24d5f0e99ab4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:38.008125 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd21d7d-b7c0-4bfd-bc51-a101f36296df tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:38.017831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd21d7d-b7c0-4bfd-bc51-a101f36296df tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:38.022021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddea86-7b38-4b10-b57a-84e98678864a tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e711040268e4c608129707c279ea0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caad227eb4ec4b49a96ac36ddf773208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:38.022950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddea86-7b38-4b10-b57a-84e98678864a tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:38.023270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddea86-7b38-4b10-b57a-84e98678864a tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:38.023553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddea86-7b38-4b10-b57a-84e98678864a tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] PATH_INFO: `/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials/d0b55a4f2ae04f8cab24320ebf68e71f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:38.033107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddea86-7b38-4b10-b57a-84e98678864a tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorizing `identity:delete_application_credential(user_id=3e711040268e4c608129707c279ea0d8, application_credential_id=d0b55a4f2ae04f8cab24320ebf68e71f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:38.034664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddea86-7b38-4b10-b57a-84e98678864a tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:38.125938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:38.131496 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4192/8319] 10.222.0.16 () {58 vars in 1394 bytes} [Sat Jul 16 21:52:38 2022] DELETE /identity/v3/users/3e711040268e4c608129707c279ea0d8/application_credentials/d0b55a4f2ae04f8cab24320ebf68e71f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:38.136557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee8bb2-066b-4c1f-9050-d1d673edd605 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:38.200587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee8bb2-066b-4c1f-9050-d1d673edd605 tempest-ApplicationCredentialsV3Test-1471429741 tempest-ApplicationCredentialsV3Test-1471429741-project] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:38.205590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383e54d-a998-4588-8455-e100749ea35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:38.206488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383e54d-a998-4588-8455-e100749ea35f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:38.206772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383e54d-a998-4588-8455-e100749ea35f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:38.207083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383e54d-a998-4588-8455-e100749ea35f admin admin] PATH_INFO: `/v3/users/3e711040268e4c608129707c279ea0d8` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:38.208298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383e54d-a998-4588-8455-e100749ea35f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e711040268e4c608129707c279ea0d8)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:38.210221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383e54d-a998-4588-8455-e100749ea35f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:38.422268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:38.424970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b383e54d-a998-4588-8455-e100749ea35f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e711040268e4c608129707c279ea0d8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:38.539280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b383e54d-a998-4588-8455-e100749ea35f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e711040268e4c608129707c279ea0d8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:38.631433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b383e54d-a998-4588-8455-e100749ea35f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e711040268e4c608129707c279ea0d8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:38.638417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b383e54d-a998-4588-8455-e100749ea35f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e711040268e4c608129707c279ea0d8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:38.639092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b383e54d-a998-4588-8455-e100749ea35f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e711040268e4c608129707c279ea0d8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:38.646550 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4128/8320] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:52:38 2022] DELETE /identity/v3/users/3e711040268e4c608129707c279ea0d8 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:38.651231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df92ce-bfab-4201-883e-40a54a5f730e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:38.651684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df92ce-bfab-4201-883e-40a54a5f730e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:38.651773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df92ce-bfab-4201-883e-40a54a5f730e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:38.670122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-24df92ce-bfab-4201-883e-40a54a5f730e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:38.671435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-24df92ce-bfab-4201-883e-40a54a5f730e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:38.730850 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4193/8321] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:38.741046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383e54d-a998-4588-8455-e100749ea35f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:38.742483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b383e54d-a998-4588-8455-e100749ea35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:38.801818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383e54d-a998-4588-8455-e100749ea35f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:38.805481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8aa42-291d-4d57-ada1-e9907a63266d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:38.806127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8aa42-291d-4d57-ada1-e9907a63266d service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:38.806416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8aa42-291d-4d57-ada1-e9907a63266d service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:38.806697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8aa42-291d-4d57-ada1-e9907a63266d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:38.816531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8aa42-291d-4d57-ada1-e9907a63266d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:38.817972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8aa42-291d-4d57-ada1-e9907a63266d service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:38.828722 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4129/8322] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:52:39.251651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df92ce-bfab-4201-883e-40a54a5f730e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:39.253016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-24df92ce-bfab-4201-883e-40a54a5f730e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:39.268889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df92ce-bfab-4201-883e-40a54a5f730e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:39.273741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c51c5-d1d9-44e8-a1b4-f74b4aec7eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:39.274616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c51c5-d1d9-44e8-a1b4-f74b4aec7eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:39.274924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c51c5-d1d9-44e8-a1b4-f74b4aec7eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:39.275281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c51c5-d1d9-44e8-a1b4-f74b4aec7eb7 admin admin] PATH_INFO: `/v3/projects/caad227eb4ec4b49a96ac36ddf773208` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:39.276392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c51c5-d1d9-44e8-a1b4-f74b4aec7eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caad227eb4ec4b49a96ac36ddf773208)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:39.278424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c51c5-d1d9-44e8-a1b4-f74b4aec7eb7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:39.376511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d46c51c5-d1d9-44e8-a1b4-f74b4aec7eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caad227eb4ec4b49a96ac36ddf773208', 'request_id': 'req-d46c51c5-d1d9-44e8-a1b4-f74b4aec7eb7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:39.382687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d46c51c5-d1d9-44e8-a1b4-f74b4aec7eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caad227eb4ec4b49a96ac36ddf773208', 'request_id': 'req-d46c51c5-d1d9-44e8-a1b4-f74b4aec7eb7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:39.388428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d46c51c5-d1d9-44e8-a1b4-f74b4aec7eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caad227eb4ec4b49a96ac36ddf773208', 'request_id': 'req-d46c51c5-d1d9-44e8-a1b4-f74b4aec7eb7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:39.461075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d46c51c5-d1d9-44e8-a1b4-f74b4aec7eb7 admin admin] The token cache is being invalidate because project caad227eb4ec4b49a96ac36ddf773208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:39.461364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d46c51c5-d1d9-44e8-a1b4-f74b4aec7eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:39.462008 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d46c51c5-d1d9-44e8-a1b4-f74b4aec7eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:39.463654 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4194/8323] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:39 2022] DELETE /identity/v3/projects/caad227eb4ec4b49a96ac36ddf773208 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:39.472868 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a7def-a6bc-462a-8d85-ef1a88245fb4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:39.473533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a7def-a6bc-462a-8d85-ef1a88245fb4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:39.473533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a7def-a6bc-462a-8d85-ef1a88245fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:39.491892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-aa6a7def-a6bc-462a-8d85-ef1a88245fb4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:39.493076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-aa6a7def-a6bc-462a-8d85-ef1a88245fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:39.551582 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4130/8324] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:39.559380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c4626-7fb2-47f5-9f35-41ffa2fdb207 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:39.559673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c4626-7fb2-47f5-9f35-41ffa2fdb207 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:39.559980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c4626-7fb2-47f5-9f35-41ffa2fdb207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:39.578248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3a1c4626-7fb2-47f5-9f35-41ffa2fdb207 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:39.579551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3a1c4626-7fb2-47f5-9f35-41ffa2fdb207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:39.587483 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4195/8325] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:39.591540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a7def-a6bc-462a-8d85-ef1a88245fb4 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:39.601990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a7def-a6bc-462a-8d85-ef1a88245fb4 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:39.606524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47c621-1c4f-45ff-b90c-c19f6fbc26d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:39.607211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47c621-1c4f-45ff-b90c-c19f6fbc26d7 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:39.607492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47c621-1c4f-45ff-b90c-c19f6fbc26d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:39.607764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47c621-1c4f-45ff-b90c-c19f6fbc26d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:39.609151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47c621-1c4f-45ff-b90c-c19f6fbc26d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:52:39.609450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47c621-1c4f-45ff-b90c-c19f6fbc26d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:39.611054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47c621-1c4f-45ff-b90c-c19f6fbc26d7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:39.622984 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4131/8326] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:52:39.627181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c4626-7fb2-47f5-9f35-41ffa2fdb207 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:39.636417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c4626-7fb2-47f5-9f35-41ffa2fdb207 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:39.641277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee49a6f-f473-4aa9-8ffc-b22f8d39cc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:39.641918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee49a6f-f473-4aa9-8ffc-b22f8d39cc13 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:39.642201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee49a6f-f473-4aa9-8ffc-b22f8d39cc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:39.642477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee49a6f-f473-4aa9-8ffc-b22f8d39cc13 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:39.643208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee49a6f-f473-4aa9-8ffc-b22f8d39cc13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:39.645107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee49a6f-f473-4aa9-8ffc-b22f8d39cc13 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:39.721052 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4196/8327] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:39 2022] POST /identity/v3/projects => generated 397 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:39.725415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47c621-1c4f-45ff-b90c-c19f6fbc26d7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:39.736605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47c621-1c4f-45ff-b90c-c19f6fbc26d7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:39.781066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:39.793330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237ac82-0846-4b76-80bd-13d56d24f36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:39.793989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237ac82-0846-4b76-80bd-13d56d24f36a admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:39.794270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237ac82-0846-4b76-80bd-13d56d24f36a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:39.794541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237ac82-0846-4b76-80bd-13d56d24f36a admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:39.795282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237ac82-0846-4b76-80bd-13d56d24f36a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:39.797572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237ac82-0846-4b76-80bd-13d56d24f36a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:39.862720 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4132/8328] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:52:39 2022] POST /identity/v3/users => generated 305 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:39.867089 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee49a6f-f473-4aa9-8ffc-b22f8d39cc13 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:39.877745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee49a6f-f473-4aa9-8ffc-b22f8d39cc13 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:39.882559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1bc16-6473-4b5b-b758-6d4a4b2e0d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:39.883255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1bc16-6473-4b5b-b758-6d4a4b2e0d22 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:39.883542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1bc16-6473-4b5b-b758-6d4a4b2e0d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:39.883825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1bc16-6473-4b5b-b758-6d4a4b2e0d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:39.884550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1bc16-6473-4b5b-b758-6d4a4b2e0d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:39.886154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1bc16-6473-4b5b-b758-6d4a4b2e0d22 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:39.897204 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4197/8329] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:39.901448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237ac82-0846-4b76-80bd-13d56d24f36a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:39.912326 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237ac82-0846-4b76-80bd-13d56d24f36a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:39.917508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320ef79-f87e-468e-aeea-46951d7061af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:39.918461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320ef79-f87e-468e-aeea-46951d7061af admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:39.918808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320ef79-f87e-468e-aeea-46951d7061af admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:39.919114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320ef79-f87e-468e-aeea-46951d7061af admin admin] PATH_INFO: `/v3/projects/7d769e3a08f142b5bc7337425d163298/users/11d85ffbda6f4bc49301db512cf3c227/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:39.934043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320ef79-f87e-468e-aeea-46951d7061af admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d769e3a08f142b5bc7337425d163298, user_id=11d85ffbda6f4bc49301db512cf3c227, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:39.936803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320ef79-f87e-468e-aeea-46951d7061af admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:40.005131 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4133/8330] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:52:39 2022] PUT /identity/v3/projects/7d769e3a08f142b5bc7337425d163298/users/11d85ffbda6f4bc49301db512cf3c227/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:40.009176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1bc16-6473-4b5b-b758-6d4a4b2e0d22 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:40.020273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1bc16-6473-4b5b-b758-6d4a4b2e0d22 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:40.059823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:40.075662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e78590-bf9d-46f9-b12d-c5e6cc83bf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:40.076380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e78590-bf9d-46f9-b12d-c5e6cc83bf1e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:40.076663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e78590-bf9d-46f9-b12d-c5e6cc83bf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:40.077461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e78590-bf9d-46f9-b12d-c5e6cc83bf1e admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:40.078438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e78590-bf9d-46f9-b12d-c5e6cc83bf1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:40.080081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e78590-bf9d-46f9-b12d-c5e6cc83bf1e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:40.089983 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4198/8331] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:40.094761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320ef79-f87e-468e-aeea-46951d7061af admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:40.105787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320ef79-f87e-468e-aeea-46951d7061af admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:40.110662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c79747-2dee-4595-8bb1-7ea15a3a933f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:40.111598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c79747-2dee-4595-8bb1-7ea15a3a933f admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:40.111888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c79747-2dee-4595-8bb1-7ea15a3a933f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:40.112160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c79747-2dee-4595-8bb1-7ea15a3a933f admin admin] PATH_INFO: `/v3/projects/7d769e3a08f142b5bc7337425d163298/users/11d85ffbda6f4bc49301db512cf3c227/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:40.114179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c79747-2dee-4595-8bb1-7ea15a3a933f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d769e3a08f142b5bc7337425d163298, user_id=11d85ffbda6f4bc49301db512cf3c227, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:40.118008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c79747-2dee-4595-8bb1-7ea15a3a933f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:40.131215 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4134/8332] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:52:40 2022] PUT /identity/v3/projects/7d769e3a08f142b5bc7337425d163298/users/11d85ffbda6f4bc49301db512cf3c227/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:40.143712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765dce0-cc31-4ea1-bd6f-1a2b8d3d4180 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:40.144000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765dce0-cc31-4ea1-bd6f-1a2b8d3d4180 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:40.144278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765dce0-cc31-4ea1-bd6f-1a2b8d3d4180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:40.171276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e765dce0-cc31-4ea1-bd6f-1a2b8d3d4180 None None] MFA Rules not processed for user `11d85ffbda6f4bc49301db512cf3c227`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:40.172517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e765dce0-cc31-4ea1-bd6f-1a2b8d3d4180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:40.242191 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4199/8333] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:40.246825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c79747-2dee-4595-8bb1-7ea15a3a933f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:40.310169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c79747-2dee-4595-8bb1-7ea15a3a933f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:40.315606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e7360-89b5-4e1e-a1e5-497e1e439c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:40.316335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e7360-89b5-4e1e-a1e5-497e1e439c17 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:40.316619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e7360-89b5-4e1e-a1e5-497e1e439c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:40.316894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e7360-89b5-4e1e-a1e5-497e1e439c17 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:40.317610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e7360-89b5-4e1e-a1e5-497e1e439c17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:40.319550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e7360-89b5-4e1e-a1e5-497e1e439c17 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:40.434561 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4135/8334] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:40 2022] POST /identity/v3/projects => generated 397 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:52:40.439110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765dce0-cc31-4ea1-bd6f-1a2b8d3d4180 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:40.449534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765dce0-cc31-4ea1-bd6f-1a2b8d3d4180 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:40.505821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a6b8d-8be5-4854-bcbc-6732dc2a2e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:40.506485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a6b8d-8be5-4854-bcbc-6732dc2a2e6b admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:40.506768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a6b8d-8be5-4854-bcbc-6732dc2a2e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:40.507070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a6b8d-8be5-4854-bcbc-6732dc2a2e6b admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:40.507743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a6b8d-8be5-4854-bcbc-6732dc2a2e6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:40.509701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a6b8d-8be5-4854-bcbc-6732dc2a2e6b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:40.615585 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4200/8335] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:52:40 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:40.619698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e7360-89b5-4e1e-a1e5-497e1e439c17 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:40.631103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e7360-89b5-4e1e-a1e5-497e1e439c17 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:40.635781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd9d5d-a3dd-4241-91cc-6d5709ffe7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:40.636434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd9d5d-a3dd-4241-91cc-6d5709ffe7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:40.636718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd9d5d-a3dd-4241-91cc-6d5709ffe7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:40.636996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd9d5d-a3dd-4241-91cc-6d5709ffe7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:40.637785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd9d5d-a3dd-4241-91cc-6d5709ffe7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:40.639426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd9d5d-a3dd-4241-91cc-6d5709ffe7d5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:40.649590 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4136/8336] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:40.653555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a6b8d-8be5-4854-bcbc-6732dc2a2e6b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:40.664099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a6b8d-8be5-4854-bcbc-6732dc2a2e6b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:40.669018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b5ed9-66a6-47d9-925a-55ad2d891699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:40.669673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b5ed9-66a6-47d9-925a-55ad2d891699 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:40.669961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b5ed9-66a6-47d9-925a-55ad2d891699 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:40.670241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b5ed9-66a6-47d9-925a-55ad2d891699 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:40.671565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b5ed9-66a6-47d9-925a-55ad2d891699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:40.673372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b5ed9-66a6-47d9-925a-55ad2d891699 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:40.683474 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4201/8337] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:40.690129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd9d5d-a3dd-4241-91cc-6d5709ffe7d5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:40.698302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd9d5d-a3dd-4241-91cc-6d5709ffe7d5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:40.703000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8ec30-20c1-4358-9b9f-6368c28a65ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:40.703911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8ec30-20c1-4358-9b9f-6368c28a65ef admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:40.704193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8ec30-20c1-4358-9b9f-6368c28a65ef admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:40.704469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8ec30-20c1-4358-9b9f-6368c28a65ef admin admin] PATH_INFO: `/v3/projects/ea2b369c8fa04144a11d75620898138c/users/ac19a44f4a324e328ded131533ac2d5a/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:40.718900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8ec30-20c1-4358-9b9f-6368c28a65ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea2b369c8fa04144a11d75620898138c, user_id=ac19a44f4a324e328ded131533ac2d5a, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:40.721907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8ec30-20c1-4358-9b9f-6368c28a65ef admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:40.793030 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4137/8338] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:52:40 2022] PUT /identity/v3/projects/ea2b369c8fa04144a11d75620898138c/users/ac19a44f4a324e328ded131533ac2d5a/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:40.879942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcbc7b-4197-44a2-9ca8-85bbc3eadf3d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:40.880506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcbc7b-4197-44a2-9ca8-85bbc3eadf3d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:40.880506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcbc7b-4197-44a2-9ca8-85bbc3eadf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:40.907129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1afcbc7b-4197-44a2-9ca8-85bbc3eadf3d None None] MFA Rules not processed for user `ac19a44f4a324e328ded131533ac2d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:40.908326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1afcbc7b-4197-44a2-9ca8-85bbc3eadf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:40.940321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:40.974902 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4202/8339] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:40.987027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8ec30-20c1-4358-9b9f-6368c28a65ef admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:40.988825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-68e8ec30-20c1-4358-9b9f-6368c28a65ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:41.041315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:41.057188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8ec30-20c1-4358-9b9f-6368c28a65ef admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:41.060961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14399ce7-d07e-4afc-8100-37c603f8a3b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:41.061701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14399ce7-d07e-4afc-8100-37c603f8a3b0 service glance] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:41.061995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14399ce7-d07e-4afc-8100-37c603f8a3b0 service glance] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:41.062272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14399ce7-d07e-4afc-8100-37c603f8a3b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:41.125590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14399ce7-d07e-4afc-8100-37c603f8a3b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:41.127191 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14399ce7-d07e-4afc-8100-37c603f8a3b0 service glance] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:41.138159 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4138/8340] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:52:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:52:41.834689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcbc7b-4197-44a2-9ca8-85bbc3eadf3d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:41.900877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcbc7b-4197-44a2-9ca8-85bbc3eadf3d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:41.905422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf6d28-af35-48a9-b5c7-c4680caff2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:41.906426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf6d28-af35-48a9-b5c7-c4680caff2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:41.906811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf6d28-af35-48a9-b5c7-c4680caff2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:41.907126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf6d28-af35-48a9-b5c7-c4680caff2cb admin admin] PATH_INFO: `/v3/users/11d85ffbda6f4bc49301db512cf3c227` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:41.908318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf6d28-af35-48a9-b5c7-c4680caff2cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=11d85ffbda6f4bc49301db512cf3c227)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:41.910241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf6d28-af35-48a9-b5c7-c4680caff2cb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:42.097348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-37bf6d28-af35-48a9-b5c7-c4680caff2cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11d85ffbda6f4bc49301db512cf3c227'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:42.104260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-37bf6d28-af35-48a9-b5c7-c4680caff2cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11d85ffbda6f4bc49301db512cf3c227'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:42.187650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-37bf6d28-af35-48a9-b5c7-c4680caff2cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11d85ffbda6f4bc49301db512cf3c227'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:42.188388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-37bf6d28-af35-48a9-b5c7-c4680caff2cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11d85ffbda6f4bc49301db512cf3c227'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:42.201517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-37bf6d28-af35-48a9-b5c7-c4680caff2cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11d85ffbda6f4bc49301db512cf3c227'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:42.207535 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4203/8341] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:52:41 2022] DELETE /identity/v3/users/11d85ffbda6f4bc49301db512cf3c227 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:42.212244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3b4cd-b127-4f88-883a-8910fc34736a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:42.212723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3b4cd-b127-4f88-883a-8910fc34736a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:42.212835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3b4cd-b127-4f88-883a-8910fc34736a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:42.230531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8eb3b4cd-b127-4f88-883a-8910fc34736a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:42.231774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8eb3b4cd-b127-4f88-883a-8910fc34736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:42.293325 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4139/8342] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:42.304032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf6d28-af35-48a9-b5c7-c4680caff2cb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:42.305418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-37bf6d28-af35-48a9-b5c7-c4680caff2cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:42.368539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf6d28-af35-48a9-b5c7-c4680caff2cb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:42.372165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc093d-dc9c-4b39-ae58-a36ed0933c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:42.372806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc093d-dc9c-4b39-ae58-a36ed0933c6f service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:42.373093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc093d-dc9c-4b39-ae58-a36ed0933c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:42.373375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc093d-dc9c-4b39-ae58-a36ed0933c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:42.379514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:42.383247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc093d-dc9c-4b39-ae58-a36ed0933c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:42.384704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc093d-dc9c-4b39-ae58-a36ed0933c6f service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:42.395647 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4204/8343] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:52:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:52:42.783650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3b4cd-b127-4f88-883a-8910fc34736a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:42.785762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8eb3b4cd-b127-4f88-883a-8910fc34736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:42.806058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3b4cd-b127-4f88-883a-8910fc34736a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:42.813954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27194db5-abd7-4ddb-9aef-12f2ed062217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:42.816125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27194db5-abd7-4ddb-9aef-12f2ed062217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:42.816485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27194db5-abd7-4ddb-9aef-12f2ed062217 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:42.816951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27194db5-abd7-4ddb-9aef-12f2ed062217 admin admin] PATH_INFO: `/v3/projects/7d769e3a08f142b5bc7337425d163298` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:42.818357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27194db5-abd7-4ddb-9aef-12f2ed062217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d769e3a08f142b5bc7337425d163298)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:42.826565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27194db5-abd7-4ddb-9aef-12f2ed062217 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:42.944331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-27194db5-abd7-4ddb-9aef-12f2ed062217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d769e3a08f142b5bc7337425d163298', 'request_id': 'req-27194db5-abd7-4ddb-9aef-12f2ed062217'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:42.949914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-27194db5-abd7-4ddb-9aef-12f2ed062217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d769e3a08f142b5bc7337425d163298', 'request_id': 'req-27194db5-abd7-4ddb-9aef-12f2ed062217'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:42.956867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-27194db5-abd7-4ddb-9aef-12f2ed062217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d769e3a08f142b5bc7337425d163298', 'request_id': 'req-27194db5-abd7-4ddb-9aef-12f2ed062217'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:43.032403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-27194db5-abd7-4ddb-9aef-12f2ed062217 admin admin] The token cache is being invalidate because project 7d769e3a08f142b5bc7337425d163298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:43.032689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-27194db5-abd7-4ddb-9aef-12f2ed062217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:43.033304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-27194db5-abd7-4ddb-9aef-12f2ed062217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:43.035113 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4140/8344] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:42 2022] DELETE /identity/v3/projects/7d769e3a08f142b5bc7337425d163298 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:52:43.039195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc093d-dc9c-4b39-ae58-a36ed0933c6f service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:43.049031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc093d-dc9c-4b39-ae58-a36ed0933c6f service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:43.107202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b23c4c-b75f-4578-90b2-82527aada28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:43.108075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b23c4c-b75f-4578-90b2-82527aada28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:43.108358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b23c4c-b75f-4578-90b2-82527aada28f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:43.108636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b23c4c-b75f-4578-90b2-82527aada28f admin admin] PATH_INFO: `/v3/users/ac19a44f4a324e328ded131533ac2d5a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:43.109849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b23c4c-b75f-4578-90b2-82527aada28f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac19a44f4a324e328ded131533ac2d5a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:43.111824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b23c4c-b75f-4578-90b2-82527aada28f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:43.326214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-87b23c4c-b75f-4578-90b2-82527aada28f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac19a44f4a324e328ded131533ac2d5a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:43.333661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-87b23c4c-b75f-4578-90b2-82527aada28f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac19a44f4a324e328ded131533ac2d5a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:43.403239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-87b23c4c-b75f-4578-90b2-82527aada28f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac19a44f4a324e328ded131533ac2d5a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:43.403863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-87b23c4c-b75f-4578-90b2-82527aada28f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac19a44f4a324e328ded131533ac2d5a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:43.416257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-87b23c4c-b75f-4578-90b2-82527aada28f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac19a44f4a324e328ded131533ac2d5a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:43.422175 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4205/8345] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:52:43 2022] DELETE /identity/v3/users/ac19a44f4a324e328ded131533ac2d5a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:43.863789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27194db5-abd7-4ddb-9aef-12f2ed062217 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:43.865254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-27194db5-abd7-4ddb-9aef-12f2ed062217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:43.884204 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27194db5-abd7-4ddb-9aef-12f2ed062217 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:43.894455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:43.943149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2f348-411f-4662-b6cf-25c7a308ac6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:43.944289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2f348-411f-4662-b6cf-25c7a308ac6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:43.944573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2f348-411f-4662-b6cf-25c7a308ac6c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:43.944850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2f348-411f-4662-b6cf-25c7a308ac6c admin admin] PATH_INFO: `/v3/projects/ea2b369c8fa04144a11d75620898138c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:43.946080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2f348-411f-4662-b6cf-25c7a308ac6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea2b369c8fa04144a11d75620898138c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:43.948043 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2f348-411f-4662-b6cf-25c7a308ac6c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:44.050876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c8c2f348-411f-4662-b6cf-25c7a308ac6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea2b369c8fa04144a11d75620898138c', 'request_id': 'req-c8c2f348-411f-4662-b6cf-25c7a308ac6c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:44.057270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c8c2f348-411f-4662-b6cf-25c7a308ac6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea2b369c8fa04144a11d75620898138c', 'request_id': 'req-c8c2f348-411f-4662-b6cf-25c7a308ac6c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:44.063349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c8c2f348-411f-4662-b6cf-25c7a308ac6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea2b369c8fa04144a11d75620898138c', 'request_id': 'req-c8c2f348-411f-4662-b6cf-25c7a308ac6c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:44.135466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c8c2f348-411f-4662-b6cf-25c7a308ac6c admin admin] The token cache is being invalidate because project ea2b369c8fa04144a11d75620898138c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:44.135662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c8c2f348-411f-4662-b6cf-25c7a308ac6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:44.136303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c8c2f348-411f-4662-b6cf-25c7a308ac6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:44.137888 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4141/8346] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:43 2022] DELETE /identity/v3/projects/ea2b369c8fa04144a11d75620898138c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:44.142942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf91b6-9905-4867-8223-1a0d0abff5de None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:44.144085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf91b6-9905-4867-8223-1a0d0abff5de None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:44.144085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf91b6-9905-4867-8223-1a0d0abff5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:44.163487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5ecf91b6-9905-4867-8223-1a0d0abff5de None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:44.164720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5ecf91b6-9905-4867-8223-1a0d0abff5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:44.224317 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4206/8347] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:44.232055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55088143-55e5-44de-aafe-de365732a9b6 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:44.232378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55088143-55e5-44de-aafe-de365732a9b6 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:44.232659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55088143-55e5-44de-aafe-de365732a9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:44.251732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-55088143-55e5-44de-aafe-de365732a9b6 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:44.252934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-55088143-55e5-44de-aafe-de365732a9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:44.261214 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4142/8348] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:44.265407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf91b6-9905-4867-8223-1a0d0abff5de None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:44.276717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf91b6-9905-4867-8223-1a0d0abff5de None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:44.281310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29ed31-22a7-4596-8908-4b845b626650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:44.281988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29ed31-22a7-4596-8908-4b845b626650 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:44.282272 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29ed31-22a7-4596-8908-4b845b626650 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:44.282552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29ed31-22a7-4596-8908-4b845b626650 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:44.283352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29ed31-22a7-4596-8908-4b845b626650 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:52:44.283667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29ed31-22a7-4596-8908-4b845b626650 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:44.285951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29ed31-22a7-4596-8908-4b845b626650 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:44.294531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:44.297946 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4207/8349] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:44.302961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55088143-55e5-44de-aafe-de365732a9b6 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:44.312318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55088143-55e5-44de-aafe-de365732a9b6 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:44.317130 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137758f7-417c-4176-be62-63e76d499a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:44.317770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137758f7-417c-4176-be62-63e76d499a46 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:44.318053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137758f7-417c-4176-be62-63e76d499a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:44.318329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137758f7-417c-4176-be62-63e76d499a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:44.319085 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137758f7-417c-4176-be62-63e76d499a46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:44.320967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137758f7-417c-4176-be62-63e76d499a46 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:44.401004 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4143/8350] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:44 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:44.405018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29ed31-22a7-4596-8908-4b845b626650 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:44.416108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29ed31-22a7-4596-8908-4b845b626650 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:44.473654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64415360-dfb2-4e05-89ba-289014dd8287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:44.474307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64415360-dfb2-4e05-89ba-289014dd8287 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:44.474589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64415360-dfb2-4e05-89ba-289014dd8287 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:44.474865 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64415360-dfb2-4e05-89ba-289014dd8287 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:44.475584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64415360-dfb2-4e05-89ba-289014dd8287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:44.477501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64415360-dfb2-4e05-89ba-289014dd8287 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:44.557303 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4208/8351] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:52:44 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:52:44.561404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137758f7-417c-4176-be62-63e76d499a46 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:44.571887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137758f7-417c-4176-be62-63e76d499a46 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:44.576704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583e0f5-002e-493c-b97c-a639a733ba6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:44.577361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583e0f5-002e-493c-b97c-a639a733ba6d admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:44.577644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583e0f5-002e-493c-b97c-a639a733ba6d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:44.577928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583e0f5-002e-493c-b97c-a639a733ba6d admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:44.578641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583e0f5-002e-493c-b97c-a639a733ba6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:44.580384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583e0f5-002e-493c-b97c-a639a733ba6d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:44.591432 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4144/8352] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:44.595349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64415360-dfb2-4e05-89ba-289014dd8287 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:44.607615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64415360-dfb2-4e05-89ba-289014dd8287 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:44.612500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804236d-a415-4c7a-86d1-353d8e0e6144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:44.613149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804236d-a415-4c7a-86d1-353d8e0e6144 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:44.613432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804236d-a415-4c7a-86d1-353d8e0e6144 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:44.613709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804236d-a415-4c7a-86d1-353d8e0e6144 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:44.614431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804236d-a415-4c7a-86d1-353d8e0e6144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:44.616077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804236d-a415-4c7a-86d1-353d8e0e6144 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:44.627292 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4209/8353] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:44.630001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583e0f5-002e-493c-b97c-a639a733ba6d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:44.639918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583e0f5-002e-493c-b97c-a639a733ba6d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:44.645082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cacdf-78b3-48b4-93b8-40cb8cdce18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:44.645949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cacdf-78b3-48b4-93b8-40cb8cdce18e admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:44.646235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cacdf-78b3-48b4-93b8-40cb8cdce18e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:44.646510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cacdf-78b3-48b4-93b8-40cb8cdce18e admin admin] PATH_INFO: `/v3/projects/df792143c4ed4a8bb1e1b8a111cf738a/users/5bcb2e51202948ce9d5fbf07f4f995f3/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:44.661737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99cacdf-78b3-48b4-93b8-40cb8cdce18e admin admin] RBAC: Authorizing `identity:create_grant(project_id=df792143c4ed4a8bb1e1b8a111cf738a, user_id=5bcb2e51202948ce9d5fbf07f4f995f3, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:44.664356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99cacdf-78b3-48b4-93b8-40cb8cdce18e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:44.769567 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4145/8354] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:52:44 2022] PUT /identity/v3/projects/df792143c4ed4a8bb1e1b8a111cf738a/users/5bcb2e51202948ce9d5fbf07f4f995f3/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:44.781171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41b1fc-b69d-407b-a1dd-71320f21f6e8 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:44.781468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41b1fc-b69d-407b-a1dd-71320f21f6e8 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:44.781756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41b1fc-b69d-407b-a1dd-71320f21f6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:44.808923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5f41b1fc-b69d-407b-a1dd-71320f21f6e8 None None] MFA Rules not processed for user `5bcb2e51202948ce9d5fbf07f4f995f3`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:44.810118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5f41b1fc-b69d-407b-a1dd-71320f21f6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:44.875262 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4210/8355] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:44.879898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cacdf-78b3-48b4-93b8-40cb8cdce18e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:44.923629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:44.943540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cacdf-78b3-48b4-93b8-40cb8cdce18e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:44.948350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24988022-e47d-416c-9e9f-cf038f5f6446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:44.949017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24988022-e47d-416c-9e9f-cf038f5f6446 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:44.949303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24988022-e47d-416c-9e9f-cf038f5f6446 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:44.949582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24988022-e47d-416c-9e9f-cf038f5f6446 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:44.950271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24988022-e47d-416c-9e9f-cf038f5f6446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:44.952210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24988022-e47d-416c-9e9f-cf038f5f6446 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:45.051994 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4146/8356] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:44 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:45.055897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41b1fc-b69d-407b-a1dd-71320f21f6e8 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:45.067701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41b1fc-b69d-407b-a1dd-71320f21f6e8 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:45.124583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc260ba-fe2a-4554-8aec-b188355e167d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:45.125243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc260ba-fe2a-4554-8aec-b188355e167d admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:45.125524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc260ba-fe2a-4554-8aec-b188355e167d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:45.125796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc260ba-fe2a-4554-8aec-b188355e167d admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:45.126499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc260ba-fe2a-4554-8aec-b188355e167d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:45.129419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc260ba-fe2a-4554-8aec-b188355e167d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:45.211138 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:45.217118 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4211/8357] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:52:45 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:45.221818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24988022-e47d-416c-9e9f-cf038f5f6446 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:45.232618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24988022-e47d-416c-9e9f-cf038f5f6446 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:45.237675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bacdc4-e918-4fc2-b78c-54e086b17bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:45.238395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bacdc4-e918-4fc2-b78c-54e086b17bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:45.238688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bacdc4-e918-4fc2-b78c-54e086b17bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:45.238972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bacdc4-e918-4fc2-b78c-54e086b17bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:45.239734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bacdc4-e918-4fc2-b78c-54e086b17bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:45.241349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bacdc4-e918-4fc2-b78c-54e086b17bf4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:45.252109 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4147/8358] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:45.257287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc260ba-fe2a-4554-8aec-b188355e167d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:45.267194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc260ba-fe2a-4554-8aec-b188355e167d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:45.272774 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7883357-938e-498d-a3d6-6fea0c965e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:45.273418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7883357-938e-498d-a3d6-6fea0c965e15 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:45.273700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7883357-938e-498d-a3d6-6fea0c965e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:45.273980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7883357-938e-498d-a3d6-6fea0c965e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:45.274696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7883357-938e-498d-a3d6-6fea0c965e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:45.276330 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7883357-938e-498d-a3d6-6fea0c965e15 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:45.286355 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4212/8359] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:45.290466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bacdc4-e918-4fc2-b78c-54e086b17bf4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:45.301253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bacdc4-e918-4fc2-b78c-54e086b17bf4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:45.305993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611aa65-07d1-428e-b159-54fc4bdc2d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:45.306878 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611aa65-07d1-428e-b159-54fc4bdc2d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:45.307189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611aa65-07d1-428e-b159-54fc4bdc2d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:45.307467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611aa65-07d1-428e-b159-54fc4bdc2d1a admin admin] PATH_INFO: `/v3/projects/60c2115573524f6286d0f8337885e485/users/6ff418cb7a5c43919be808399dfd8168/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:45.323001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611aa65-07d1-428e-b159-54fc4bdc2d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c2115573524f6286d0f8337885e485, user_id=6ff418cb7a5c43919be808399dfd8168, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:45.325677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611aa65-07d1-428e-b159-54fc4bdc2d1a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:45.426880 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4148/8360] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:52:45 2022] PUT /identity/v3/projects/60c2115573524f6286d0f8337885e485/users/6ff418cb7a5c43919be808399dfd8168/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:45.437106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9393e38-2615-4acf-8980-6c9a9ff04d04 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:45.437393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9393e38-2615-4acf-8980-6c9a9ff04d04 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:45.437667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9393e38-2615-4acf-8980-6c9a9ff04d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:45.465566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a9393e38-2615-4acf-8980-6c9a9ff04d04 None None] MFA Rules not processed for user `6ff418cb7a5c43919be808399dfd8168`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:45.466682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a9393e38-2615-4acf-8980-6c9a9ff04d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:45.530784 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4213/8361] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:45.547279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611aa65-07d1-428e-b159-54fc4bdc2d1a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:45.548982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5611aa65-07d1-428e-b159-54fc4bdc2d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:45.607578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611aa65-07d1-428e-b159-54fc4bdc2d1a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:45.611213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10a1c6-da16-4085-a25b-19c4e2ad1fe6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:45.611852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10a1c6-da16-4085-a25b-19c4e2ad1fe6 service glance] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:45.612135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10a1c6-da16-4085-a25b-19c4e2ad1fe6 service glance] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:45.612410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10a1c6-da16-4085-a25b-19c4e2ad1fe6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:45.671201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10a1c6-da16-4085-a25b-19c4e2ad1fe6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:45.672700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10a1c6-da16-4085-a25b-19c4e2ad1fe6 service glance] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:45.682760 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4149/8362] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:52:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:52:45.899794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f780a7-49c8-44b9-b6e2-3e894936baba None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:45.900091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f780a7-49c8-44b9-b6e2-3e894936baba None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:45.900391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f780a7-49c8-44b9-b6e2-3e894936baba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:45.918652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-71f780a7-49c8-44b9-b6e2-3e894936baba None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:45.919918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-71f780a7-49c8-44b9-b6e2-3e894936baba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:45.985799 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4214/8363] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:52:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:46.138153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10a1c6-da16-4085-a25b-19c4e2ad1fe6 service glance] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:46.139638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ee10a1c6-da16-4085-a25b-19c4e2ad1fe6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:46.186808 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:46.222390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10a1c6-da16-4085-a25b-19c4e2ad1fe6 service glance] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:46.228210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ab878-2eb0-43f4-b3dc-bb4003ee08f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:46.228855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ab878-2eb0-43f4-b3dc-bb4003ee08f1 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:46.229139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ab878-2eb0-43f4-b3dc-bb4003ee08f1 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:46.229418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ab878-2eb0-43f4-b3dc-bb4003ee08f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:46.237655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ab878-2eb0-43f4-b3dc-bb4003ee08f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:46.239372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ab878-2eb0-43f4-b3dc-bb4003ee08f1 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:46.247497 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4150/8364] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:52:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:52:46.641218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f780a7-49c8-44b9-b6e2-3e894936baba None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:46.642586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-71f780a7-49c8-44b9-b6e2-3e894936baba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:46.657483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f780a7-49c8-44b9-b6e2-3e894936baba None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:46.661203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919904b-dad7-436e-8cb8-29cd021010d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:46.661834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919904b-dad7-436e-8cb8-29cd021010d6 service glance] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:46.662114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919904b-dad7-436e-8cb8-29cd021010d6 service glance] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:46.662391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919904b-dad7-436e-8cb8-29cd021010d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:46.670673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919904b-dad7-436e-8cb8-29cd021010d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:46.672241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919904b-dad7-436e-8cb8-29cd021010d6 service glance] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:46.681483 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4215/8365] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:52:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:52:46.761175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5628d-d35a-4244-8bb7-dd1f2aa4b957 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:46.761466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5628d-d35a-4244-8bb7-dd1f2aa4b957 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:46.761745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5628d-d35a-4244-8bb7-dd1f2aa4b957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:46.779273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4dc5628d-d35a-4244-8bb7-dd1f2aa4b957 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:46.780460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4dc5628d-d35a-4244-8bb7-dd1f2aa4b957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:46.788263 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4151/8366] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:52:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:46.800167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919904b-dad7-436e-8cb8-29cd021010d6 service glance] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:46.814917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919904b-dad7-436e-8cb8-29cd021010d6 service glance] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:46.820712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160fd28-1d18-432b-a9e5-5ccbfde880e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:46.821380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160fd28-1d18-432b-a9e5-5ccbfde880e4 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:46.821665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160fd28-1d18-432b-a9e5-5ccbfde880e4 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:46.821940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160fd28-1d18-432b-a9e5-5ccbfde880e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:46.830455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160fd28-1d18-432b-a9e5-5ccbfde880e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:46.832134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160fd28-1d18-432b-a9e5-5ccbfde880e4 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:46.841148 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4216/8367] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:52:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:52:47.220157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5628d-d35a-4244-8bb7-dd1f2aa4b957 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:47.282922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5628d-d35a-4244-8bb7-dd1f2aa4b957 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:47.287911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9978f-be41-40ca-b109-d791510db7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:47.288815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9978f-be41-40ca-b109-d791510db7d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:47.289114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9978f-be41-40ca-b109-d791510db7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:47.289411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9978f-be41-40ca-b109-d791510db7d1 admin admin] PATH_INFO: `/v3/users/5bcb2e51202948ce9d5fbf07f4f995f3` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:47.290603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9978f-be41-40ca-b109-d791510db7d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bcb2e51202948ce9d5fbf07f4f995f3)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:47.292572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9978f-be41-40ca-b109-d791510db7d1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:47.452237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0bb9978f-be41-40ca-b109-d791510db7d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bcb2e51202948ce9d5fbf07f4f995f3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:47.464887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0bb9978f-be41-40ca-b109-d791510db7d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bcb2e51202948ce9d5fbf07f4f995f3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:47.535803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0bb9978f-be41-40ca-b109-d791510db7d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bcb2e51202948ce9d5fbf07f4f995f3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:47.542782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0bb9978f-be41-40ca-b109-d791510db7d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bcb2e51202948ce9d5fbf07f4f995f3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:47.543437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-0bb9978f-be41-40ca-b109-d791510db7d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bcb2e51202948ce9d5fbf07f4f995f3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:47.549514 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4152/8368] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:52:47 2022] DELETE /identity/v3/users/5bcb2e51202948ce9d5fbf07f4f995f3 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:47.554811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ca234-5db0-4eef-94b6-81dd0e752240 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:47.569126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ca234-5db0-4eef-94b6-81dd0e752240 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:47.569126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ca234-5db0-4eef-94b6-81dd0e752240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:47.574099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3a5ca234-5db0-4eef-94b6-81dd0e752240 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:47.575657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3a5ca234-5db0-4eef-94b6-81dd0e752240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:47.618192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:47.637045 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4217/8369] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:47.646991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9978f-be41-40ca-b109-d791510db7d1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:47.648417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0bb9978f-be41-40ca-b109-d791510db7d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:47.690907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:47.709100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9978f-be41-40ca-b109-d791510db7d1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:47.712789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c4a1a-75b7-47a5-9f43-6983732a6402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:47.713440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c4a1a-75b7-47a5-9f43-6983732a6402 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:47.713723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c4a1a-75b7-47a5-9f43-6983732a6402 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:47.713999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c4a1a-75b7-47a5-9f43-6983732a6402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:47.725272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c4a1a-75b7-47a5-9f43-6983732a6402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:47.727212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c4a1a-75b7-47a5-9f43-6983732a6402 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:47.737030 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4153/8370] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:52:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:52:48.137551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ca234-5db0-4eef-94b6-81dd0e752240 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:48.139034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3a5ca234-5db0-4eef-94b6-81dd0e752240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:48.154765 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ca234-5db0-4eef-94b6-81dd0e752240 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:48.157984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc9c70-af9d-4970-a167-cb80db921a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:48.158856 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc9c70-af9d-4970-a167-cb80db921a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:48.159181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc9c70-af9d-4970-a167-cb80db921a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:48.159464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc9c70-af9d-4970-a167-cb80db921a05 admin admin] PATH_INFO: `/v3/projects/df792143c4ed4a8bb1e1b8a111cf738a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:48.161489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc9c70-af9d-4970-a167-cb80db921a05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df792143c4ed4a8bb1e1b8a111cf738a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:48.163656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc9c70-af9d-4970-a167-cb80db921a05 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:48.251408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-90fc9c70-af9d-4970-a167-cb80db921a05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df792143c4ed4a8bb1e1b8a111cf738a', 'request_id': 'req-90fc9c70-af9d-4970-a167-cb80db921a05'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:48.257832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-90fc9c70-af9d-4970-a167-cb80db921a05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df792143c4ed4a8bb1e1b8a111cf738a', 'request_id': 'req-90fc9c70-af9d-4970-a167-cb80db921a05'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:48.263836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-90fc9c70-af9d-4970-a167-cb80db921a05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df792143c4ed4a8bb1e1b8a111cf738a', 'request_id': 'req-90fc9c70-af9d-4970-a167-cb80db921a05'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:48.353781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-90fc9c70-af9d-4970-a167-cb80db921a05 admin admin] The token cache is being invalidate because project df792143c4ed4a8bb1e1b8a111cf738a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:48.354072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-90fc9c70-af9d-4970-a167-cb80db921a05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:48.354713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-90fc9c70-af9d-4970-a167-cb80db921a05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:48.356433 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4218/8371] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:48 2022] DELETE /identity/v3/projects/df792143c4ed4a8bb1e1b8a111cf738a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:48.360607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c4a1a-75b7-47a5-9f43-6983732a6402 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:48.370846 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c4a1a-75b7-47a5-9f43-6983732a6402 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:48.427888 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468021b-7458-4c7c-8e18-2f220b9589b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:48.428776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468021b-7458-4c7c-8e18-2f220b9589b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:48.429061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468021b-7458-4c7c-8e18-2f220b9589b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:48.429342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468021b-7458-4c7c-8e18-2f220b9589b1 admin admin] PATH_INFO: `/v3/users/6ff418cb7a5c43919be808399dfd8168` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:48.430610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468021b-7458-4c7c-8e18-2f220b9589b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ff418cb7a5c43919be808399dfd8168)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:48.433790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468021b-7458-4c7c-8e18-2f220b9589b1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:48.664162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9468021b-7458-4c7c-8e18-2f220b9589b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ff418cb7a5c43919be808399dfd8168'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:48.678528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9468021b-7458-4c7c-8e18-2f220b9589b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ff418cb7a5c43919be808399dfd8168'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:48.753239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9468021b-7458-4c7c-8e18-2f220b9589b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ff418cb7a5c43919be808399dfd8168'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:48.761024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9468021b-7458-4c7c-8e18-2f220b9589b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ff418cb7a5c43919be808399dfd8168'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:48.761783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9468021b-7458-4c7c-8e18-2f220b9589b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ff418cb7a5c43919be808399dfd8168'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:48.767962 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4154/8372] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:52:48 2022] DELETE /identity/v3/users/6ff418cb7a5c43919be808399dfd8168 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:49.224299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc9c70-af9d-4970-a167-cb80db921a05 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:49.225925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-90fc9c70-af9d-4970-a167-cb80db921a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:49.239429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc9c70-af9d-4970-a167-cb80db921a05 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:49.297235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2ace1-b668-4106-b81d-a7c171236634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:49.298096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2ace1-b668-4106-b81d-a7c171236634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:49.298377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2ace1-b668-4106-b81d-a7c171236634 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:49.298658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2ace1-b668-4106-b81d-a7c171236634 admin admin] PATH_INFO: `/v3/projects/60c2115573524f6286d0f8337885e485` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:49.299898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2ace1-b668-4106-b81d-a7c171236634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60c2115573524f6286d0f8337885e485)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:49.301837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2ace1-b668-4106-b81d-a7c171236634 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:49.404428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51f2ace1-b668-4106-b81d-a7c171236634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60c2115573524f6286d0f8337885e485', 'request_id': 'req-51f2ace1-b668-4106-b81d-a7c171236634'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:49.411328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51f2ace1-b668-4106-b81d-a7c171236634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60c2115573524f6286d0f8337885e485', 'request_id': 'req-51f2ace1-b668-4106-b81d-a7c171236634'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:49.416863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51f2ace1-b668-4106-b81d-a7c171236634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60c2115573524f6286d0f8337885e485', 'request_id': 'req-51f2ace1-b668-4106-b81d-a7c171236634'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:49.513408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:49.517242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51f2ace1-b668-4106-b81d-a7c171236634 admin admin] The token cache is being invalidate because project 60c2115573524f6286d0f8337885e485 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:52:49.517533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51f2ace1-b668-4106-b81d-a7c171236634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:49.518201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-51f2ace1-b668-4106-b81d-a7c171236634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:49.520511 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4219/8373] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:52:49 2022] DELETE /identity/v3/projects/60c2115573524f6286d0f8337885e485 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:49.526608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc1be9-0112-4012-90f2-f29178003574 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:49.527086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc1be9-0112-4012-90f2-f29178003574 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:49.527202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc1be9-0112-4012-90f2-f29178003574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:49.544717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-eefc1be9-0112-4012-90f2-f29178003574 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:49.550249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-eefc1be9-0112-4012-90f2-f29178003574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:49.599330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:49.607981 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4155/8374] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:49.616597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6503647-b3a2-43df-b86f-0d5dc9bd69aa None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:49.617059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6503647-b3a2-43df-b86f-0d5dc9bd69aa None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:49.617732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6503647-b3a2-43df-b86f-0d5dc9bd69aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:49.637481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c6503647-b3a2-43df-b86f-0d5dc9bd69aa None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:49.642143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c6503647-b3a2-43df-b86f-0d5dc9bd69aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:49.647930 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4220/8375] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:49.652291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc1be9-0112-4012-90f2-f29178003574 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:49.662503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc1be9-0112-4012-90f2-f29178003574 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:49.667850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc41675-0890-4777-ab7a-459f3a1692eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:49.668508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc41675-0890-4777-ab7a-459f3a1692eb admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:49.668790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc41675-0890-4777-ab7a-459f3a1692eb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:49.669064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc41675-0890-4777-ab7a-459f3a1692eb admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:49.669783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc41675-0890-4777-ab7a-459f3a1692eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:52:49.670125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc41675-0890-4777-ab7a-459f3a1692eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:49.671866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc41675-0890-4777-ab7a-459f3a1692eb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:49.683662 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4156/8376] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:52:49.688142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6503647-b3a2-43df-b86f-0d5dc9bd69aa None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:49.698644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6503647-b3a2-43df-b86f-0d5dc9bd69aa None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:49.703489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe32b38-e1e1-4da7-8685-f7be46197ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:49.704129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe32b38-e1e1-4da7-8685-f7be46197ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:49.704408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe32b38-e1e1-4da7-8685-f7be46197ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:49.704682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe32b38-e1e1-4da7-8685-f7be46197ad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:49.705352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe32b38-e1e1-4da7-8685-f7be46197ad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:49.708441 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe32b38-e1e1-4da7-8685-f7be46197ad7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:49.827060 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4221/8377] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:52:49 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:49.828219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc41675-0890-4777-ab7a-459f3a1692eb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:49.838625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc41675-0890-4777-ab7a-459f3a1692eb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:49.896757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ecf5b-2e85-48c9-b836-180800e170c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:49.897454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ecf5b-2e85-48c9-b836-180800e170c7 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:49.897737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ecf5b-2e85-48c9-b836-180800e170c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:49.898016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ecf5b-2e85-48c9-b836-180800e170c7 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:49.898690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ecf5b-2e85-48c9-b836-180800e170c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:49.900745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ecf5b-2e85-48c9-b836-180800e170c7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:49.977955 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4157/8378] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:52:49 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:52:49.981233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe32b38-e1e1-4da7-8685-f7be46197ad7 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:49.992336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe32b38-e1e1-4da7-8685-f7be46197ad7 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:49.998205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b676163-f640-4464-a760-69db126a1e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:49.998205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b676163-f640-4464-a760-69db126a1e19 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:49.998205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b676163-f640-4464-a760-69db126a1e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:49.998205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b676163-f640-4464-a760-69db126a1e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:49.998915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b676163-f640-4464-a760-69db126a1e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:50.000560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b676163-f640-4464-a760-69db126a1e19 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:50.011718 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4222/8379] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:50.015667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ecf5b-2e85-48c9-b836-180800e170c7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:50.025939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ecf5b-2e85-48c9-b836-180800e170c7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:50.030492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92b979-e165-4bdc-8e0d-d90a63237b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:50.031170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92b979-e165-4bdc-8e0d-d90a63237b08 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:50.031460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92b979-e165-4bdc-8e0d-d90a63237b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:50.031739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92b979-e165-4bdc-8e0d-d90a63237b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:50.032451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92b979-e165-4bdc-8e0d-d90a63237b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:50.034021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92b979-e165-4bdc-8e0d-d90a63237b08 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:50.043721 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4158/8380] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:52:50.047716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b676163-f640-4464-a760-69db126a1e19 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:50.058305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b676163-f640-4464-a760-69db126a1e19 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:50.062989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506377c-39b7-4e1a-b639-5023344e0294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:50.063887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506377c-39b7-4e1a-b639-5023344e0294 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:50.064171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506377c-39b7-4e1a-b639-5023344e0294 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:50.064452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506377c-39b7-4e1a-b639-5023344e0294 admin admin] PATH_INFO: `/v3/projects/1fd71e9f20934ad985959913a6ba56a5/users/29cec3c016f6425b92c1b0d636c14cdd/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:50.079775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506377c-39b7-4e1a-b639-5023344e0294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd71e9f20934ad985959913a6ba56a5, user_id=29cec3c016f6425b92c1b0d636c14cdd, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:50.082485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506377c-39b7-4e1a-b639-5023344e0294 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:50.153627 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4223/8381] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:52:50 2022] PUT /identity/v3/projects/1fd71e9f20934ad985959913a6ba56a5/users/29cec3c016f6425b92c1b0d636c14cdd/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:50.166390 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12cdd5-ebfd-489f-a4dd-a6dd58f4ab84 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:50.166685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12cdd5-ebfd-489f-a4dd-a6dd58f4ab84 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:50.166965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12cdd5-ebfd-489f-a4dd-a6dd58f4ab84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:50.194479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4a12cdd5-ebfd-489f-a4dd-a6dd58f4ab84 None None] MFA Rules not processed for user `29cec3c016f6425b92c1b0d636c14cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:50.195737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4a12cdd5-ebfd-489f-a4dd-a6dd58f4ab84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:50.261373 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4159/8382] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:50.279748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506377c-39b7-4e1a-b639-5023344e0294 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:50.281448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6506377c-39b7-4e1a-b639-5023344e0294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:50.343399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506377c-39b7-4e1a-b639-5023344e0294 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:50.347490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5234f-ff0f-4273-be0d-243b77dd7e91 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:50.348618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5234f-ff0f-4273-be0d-243b77dd7e91 service glance] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:50.348891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5234f-ff0f-4273-be0d-243b77dd7e91 service glance] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:50.349163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5234f-ff0f-4273-be0d-243b77dd7e91 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:50.357448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5234f-ff0f-4273-be0d-243b77dd7e91 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:50.358867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5234f-ff0f-4273-be0d-243b77dd7e91 service glance] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:50.368211 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4224/8383] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:52:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:52:50.741228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3365be-64ac-481d-a027-41608afa82b0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:50.741716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3365be-64ac-481d-a027-41608afa82b0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:50.741807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3365be-64ac-481d-a027-41608afa82b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:50.759436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-df3365be-64ac-481d-a027-41608afa82b0 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:50.760622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-df3365be-64ac-481d-a027-41608afa82b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:50.810789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:50.818560 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4160/8384] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:52:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:50.830911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5234f-ff0f-4273-be0d-243b77dd7e91 service glance] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:50.833163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6aa5234f-ff0f-4273-be0d-243b77dd7e91 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:50.905894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5234f-ff0f-4273-be0d-243b77dd7e91 service glance] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:50.911662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88297a6-6872-40ca-a748-1cf61fb3a5b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:50.912300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88297a6-6872-40ca-a748-1cf61fb3a5b6 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:50.912580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88297a6-6872-40ca-a748-1cf61fb3a5b6 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:50.912853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88297a6-6872-40ca-a748-1cf61fb3a5b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:50.920857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88297a6-6872-40ca-a748-1cf61fb3a5b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:50.922467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88297a6-6872-40ca-a748-1cf61fb3a5b6 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:50.930909 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4225/8385] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:52:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:52:51.638313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5584a3-56b8-4be2-93ed-0d4ba81cfc92 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:51.638603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5584a3-56b8-4be2-93ed-0d4ba81cfc92 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:51.639160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5584a3-56b8-4be2-93ed-0d4ba81cfc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:51.656865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8b5584a3-56b8-4be2-93ed-0d4ba81cfc92 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:51.658064 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8b5584a3-56b8-4be2-93ed-0d4ba81cfc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:51.666200 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4161/8386] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:52:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:51.679058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88297a6-6872-40ca-a748-1cf61fb3a5b6 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:51.692640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88297a6-6872-40ca-a748-1cf61fb3a5b6 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:51.697911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502fd37-8161-46fc-bc7b-98f6bb2dd426 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:51.698549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502fd37-8161-46fc-bc7b-98f6bb2dd426 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:51.698830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502fd37-8161-46fc-bc7b-98f6bb2dd426 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:51.699135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502fd37-8161-46fc-bc7b-98f6bb2dd426 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:51.707496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502fd37-8161-46fc-bc7b-98f6bb2dd426 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:51.709176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502fd37-8161-46fc-bc7b-98f6bb2dd426 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:51.717194 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4226/8387] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:52:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:52:52.553194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f225c0-fc2f-4b51-a7e3-b297f0193e53 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:52.553683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f225c0-fc2f-4b51-a7e3-b297f0193e53 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:52.553777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f225c0-fc2f-4b51-a7e3-b297f0193e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:52.571928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-40f225c0-fc2f-4b51-a7e3-b297f0193e53 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:52.573149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-40f225c0-fc2f-4b51-a7e3-b297f0193e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:52.583169 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4162/8388] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:52:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:52.594822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502fd37-8161-46fc-bc7b-98f6bb2dd426 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:52.608326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502fd37-8161-46fc-bc7b-98f6bb2dd426 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:52.613540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e17fa-a48a-438b-bb52-6af7b11e2e23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:52.614457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e17fa-a48a-438b-bb52-6af7b11e2e23 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:52.614739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e17fa-a48a-438b-bb52-6af7b11e2e23 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:52.615039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e17fa-a48a-438b-bb52-6af7b11e2e23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:52.623157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e17fa-a48a-438b-bb52-6af7b11e2e23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:52.624733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e17fa-a48a-438b-bb52-6af7b11e2e23 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:52.633640 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4227/8389] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:52:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:52:53.357399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8047317-c905-4f5e-b035-48ece73f6314 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:53.359867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8047317-c905-4f5e-b035-48ece73f6314 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:53.359867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8047317-c905-4f5e-b035-48ece73f6314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:53.376338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a8047317-c905-4f5e-b035-48ece73f6314 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:53.380361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a8047317-c905-4f5e-b035-48ece73f6314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:53.385603 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4163/8390] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:52:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:53.398291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e17fa-a48a-438b-bb52-6af7b11e2e23 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:53.403626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:53.411777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e17fa-a48a-438b-bb52-6af7b11e2e23 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:53.420488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4adc1b-157b-45f1-88a0-61e3f31ec2c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:53.420488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4adc1b-157b-45f1-88a0-61e3f31ec2c9 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:53.420488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4adc1b-157b-45f1-88a0-61e3f31ec2c9 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:53.420488 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4adc1b-157b-45f1-88a0-61e3f31ec2c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:53.426478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4adc1b-157b-45f1-88a0-61e3f31ec2c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:53.428110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4adc1b-157b-45f1-88a0-61e3f31ec2c9 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:53.436807 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4228/8391] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:52:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:52:54.156445 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc5b6c-d9c8-488f-bc10-bd069cc62e34 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:54.156920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc5b6c-d9c8-488f-bc10-bd069cc62e34 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:54.157009 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc5b6c-d9c8-488f-bc10-bd069cc62e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:54.176342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-80fc5b6c-d9c8-488f-bc10-bd069cc62e34 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:54.182322 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-80fc5b6c-d9c8-488f-bc10-bd069cc62e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:54.185339 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4164/8392] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:52:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:54.197325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4adc1b-157b-45f1-88a0-61e3f31ec2c9 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:54.210633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4adc1b-157b-45f1-88a0-61e3f31ec2c9 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:54.215709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea4cc8-1e6c-4821-b0ef-a31bf4667aef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:54.216341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea4cc8-1e6c-4821-b0ef-a31bf4667aef service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:54.216624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea4cc8-1e6c-4821-b0ef-a31bf4667aef service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:54.216899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea4cc8-1e6c-4821-b0ef-a31bf4667aef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:54.226022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea4cc8-1e6c-4821-b0ef-a31bf4667aef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:54.227651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea4cc8-1e6c-4821-b0ef-a31bf4667aef service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:54.235791 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4229/8393] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:52:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:52:55.053845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a39fa-99c7-42ed-8423-772a9079ca49 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:55.054138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a39fa-99c7-42ed-8423-772a9079ca49 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:55.054420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a39fa-99c7-42ed-8423-772a9079ca49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:55.072915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-085a39fa-99c7-42ed-8423-772a9079ca49 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:55.074113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-085a39fa-99c7-42ed-8423-772a9079ca49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:55.081490 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4165/8394] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 21:52:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:55.093485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea4cc8-1e6c-4821-b0ef-a31bf4667aef service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:55.107460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea4cc8-1e6c-4821-b0ef-a31bf4667aef service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:55.112621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cc7ed-eb5f-4dd5-b3c8-4ce18fd636ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:55.113249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cc7ed-eb5f-4dd5-b3c8-4ce18fd636ee service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:55.114721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cc7ed-eb5f-4dd5-b3c8-4ce18fd636ee service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:55.115021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cc7ed-eb5f-4dd5-b3c8-4ce18fd636ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:55.123218 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277cc7ed-eb5f-4dd5-b3c8-4ce18fd636ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:55.124727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277cc7ed-eb5f-4dd5-b3c8-4ce18fd636ee service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:55.133690 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4230/8395] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:52:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:52:56.288069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae5446-8bb2-4866-a822-b3db2b4a2069 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:56.288552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae5446-8bb2-4866-a822-b3db2b4a2069 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:56.288646 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae5446-8bb2-4866-a822-b3db2b4a2069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:56.315954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-baae5446-8bb2-4866-a822-b3db2b4a2069 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:56.317396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-baae5446-8bb2-4866-a822-b3db2b4a2069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:56.342988 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4166/8396] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:52:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:56.356071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cc7ed-eb5f-4dd5-b3c8-4ce18fd636ee service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:56.399239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cc7ed-eb5f-4dd5-b3c8-4ce18fd636ee service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:56.404457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c7509-7d36-472b-8b4e-5b91f3bee2a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:56.405091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c7509-7d36-472b-8b4e-5b91f3bee2a4 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:56.405371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c7509-7d36-472b-8b4e-5b91f3bee2a4 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:56.405646 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c7509-7d36-472b-8b4e-5b91f3bee2a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:56.414419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c7509-7d36-472b-8b4e-5b91f3bee2a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:56.416056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c7509-7d36-472b-8b4e-5b91f3bee2a4 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:56.424014 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4231/8397] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:52:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:52:56.852757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05797101-6b74-48c9-aead-31d95b5e4981 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:56.853052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05797101-6b74-48c9-aead-31d95b5e4981 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:56.853337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05797101-6b74-48c9-aead-31d95b5e4981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:56.873007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-05797101-6b74-48c9-aead-31d95b5e4981 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:56.874217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-05797101-6b74-48c9-aead-31d95b5e4981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:56.882223 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4167/8398] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:52:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:52:56.894506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c7509-7d36-472b-8b4e-5b91f3bee2a4 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:56.908166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c7509-7d36-472b-8b4e-5b91f3bee2a4 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:56.913417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded9745-f6a1-404e-8983-8406d7a8df13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:56.914040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded9745-f6a1-404e-8983-8406d7a8df13 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:56.914320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded9745-f6a1-404e-8983-8406d7a8df13 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:56.914592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded9745-f6a1-404e-8983-8406d7a8df13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:56.922680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded9745-f6a1-404e-8983-8406d7a8df13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:56.924286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded9745-f6a1-404e-8983-8406d7a8df13 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:56.932295 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4232/8399] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:52:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:52:57.331592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c7683-58a1-4c77-b970-817406c19e82 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:57.332068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c7683-58a1-4c77-b970-817406c19e82 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:57.334889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c7683-58a1-4c77-b970-817406c19e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:57.350018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-524c7683-58a1-4c77-b970-817406c19e82 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:57.351246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-524c7683-58a1-4c77-b970-817406c19e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:57.358330 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4168/8400] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:52:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:57.370724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded9745-f6a1-404e-8983-8406d7a8df13 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:57.384687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded9745-f6a1-404e-8983-8406d7a8df13 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:57.389736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf07c19-baab-4a5a-b46f-30ff47dcf65b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:57.390361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf07c19-baab-4a5a-b46f-30ff47dcf65b service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:57.390639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf07c19-baab-4a5a-b46f-30ff47dcf65b service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:57.390910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf07c19-baab-4a5a-b46f-30ff47dcf65b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:57.399368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf07c19-baab-4a5a-b46f-30ff47dcf65b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:57.400935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf07c19-baab-4a5a-b46f-30ff47dcf65b service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:57.408914 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4233/8401] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:52:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:52:57.775300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0abcc-a07b-4924-b729-7b4104cac1c4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:57.775617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0abcc-a07b-4924-b729-7b4104cac1c4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:57.775902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0abcc-a07b-4924-b729-7b4104cac1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:57.794798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-62c0abcc-a07b-4924-b729-7b4104cac1c4 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:57.796054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-62c0abcc-a07b-4924-b729-7b4104cac1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:57.803896 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4169/8402] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:52:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:57.815894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf07c19-baab-4a5a-b46f-30ff47dcf65b service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:57.829932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf07c19-baab-4a5a-b46f-30ff47dcf65b service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:57.835649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb4509-612d-4489-bdb1-c0b30ee865cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:57.836281 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb4509-612d-4489-bdb1-c0b30ee865cd service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:57.836561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb4509-612d-4489-bdb1-c0b30ee865cd service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:57.836831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb4509-612d-4489-bdb1-c0b30ee865cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:57.844967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb4509-612d-4489-bdb1-c0b30ee865cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:57.846824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb4509-612d-4489-bdb1-c0b30ee865cd service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:57.855977 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4234/8403] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:52:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:52:58.248398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49d012-a2f8-4858-a9db-9b03934723af None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:58.248695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49d012-a2f8-4858-a9db-9b03934723af None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:58.248982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49d012-a2f8-4858-a9db-9b03934723af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:58.266691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ba49d012-a2f8-4858-a9db-9b03934723af None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:58.267931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ba49d012-a2f8-4858-a9db-9b03934723af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:58.275721 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4170/8404] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:52:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:58.288353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb4509-612d-4489-bdb1-c0b30ee865cd service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:58.301609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb4509-612d-4489-bdb1-c0b30ee865cd service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:58.307197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec16f2-80bf-474e-b8bc-d55ddef10165 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:58.307836 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec16f2-80bf-474e-b8bc-d55ddef10165 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:58.308118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec16f2-80bf-474e-b8bc-d55ddef10165 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:58.308399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec16f2-80bf-474e-b8bc-d55ddef10165 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:58.316904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec16f2-80bf-474e-b8bc-d55ddef10165 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:58.318657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec16f2-80bf-474e-b8bc-d55ddef10165 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:58.327096 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4235/8405] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:52:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 21:52:58.697531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df8c29-934d-4980-ae51-c0e0e9ef5440 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:58.697982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df8c29-934d-4980-ae51-c0e0e9ef5440 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:58.698128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df8c29-934d-4980-ae51-c0e0e9ef5440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:58.716578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-93df8c29-934d-4980-ae51-c0e0e9ef5440 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:58.717758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-93df8c29-934d-4980-ae51-c0e0e9ef5440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:58.725754 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4171/8406] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 21:52:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:58.737532 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec16f2-80bf-474e-b8bc-d55ddef10165 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:58.751033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec16f2-80bf-474e-b8bc-d55ddef10165 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:58.757058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09a4af-07b6-47c1-abb8-3e6ae43b7afb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:58.757684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09a4af-07b6-47c1-abb8-3e6ae43b7afb service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:58.757964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09a4af-07b6-47c1-abb8-3e6ae43b7afb service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:58.758234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09a4af-07b6-47c1-abb8-3e6ae43b7afb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:58.766268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09a4af-07b6-47c1-abb8-3e6ae43b7afb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:58.767879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09a4af-07b6-47c1-abb8-3e6ae43b7afb service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:58.776959 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4236/8407] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 21:52:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 21:52:59.152577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df8c29-934d-4980-ae51-c0e0e9ef5440 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:59.217955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df8c29-934d-4980-ae51-c0e0e9ef5440 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:59.222875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f08e0a-f8a8-4721-b39a-48aa1fb10e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:59.224279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f08e0a-f8a8-4721-b39a-48aa1fb10e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:59.224548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f08e0a-f8a8-4721-b39a-48aa1fb10e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:59.224904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f08e0a-f8a8-4721-b39a-48aa1fb10e26 admin admin] PATH_INFO: `/v3/users/29cec3c016f6425b92c1b0d636c14cdd` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:59.226103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f08e0a-f8a8-4721-b39a-48aa1fb10e26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29cec3c016f6425b92c1b0d636c14cdd)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:59.228212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f08e0a-f8a8-4721-b39a-48aa1fb10e26 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:59.451867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-66f08e0a-f8a8-4721-b39a-48aa1fb10e26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29cec3c016f6425b92c1b0d636c14cdd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:59.461727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:52:59.463944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-66f08e0a-f8a8-4721-b39a-48aa1fb10e26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29cec3c016f6425b92c1b0d636c14cdd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:59.586982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-66f08e0a-f8a8-4721-b39a-48aa1fb10e26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29cec3c016f6425b92c1b0d636c14cdd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:59.594425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-66f08e0a-f8a8-4721-b39a-48aa1fb10e26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29cec3c016f6425b92c1b0d636c14cdd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:59.595117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-66f08e0a-f8a8-4721-b39a-48aa1fb10e26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29cec3c016f6425b92c1b0d636c14cdd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:52:59.602105 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4172/8408] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:52:59 2022] DELETE /identity/v3/users/29cec3c016f6425b92c1b0d636c14cdd => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:52:59.606714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6c611-62ca-4a0b-a7c9-e4a836bf1d58 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:59.607020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6c611-62ca-4a0b-a7c9-e4a836bf1d58 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:59.607331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6c611-62ca-4a0b-a7c9-e4a836bf1d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:59.624933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f8d6c611-62ca-4a0b-a7c9-e4a836bf1d58 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:52:59.626203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f8d6c611-62ca-4a0b-a7c9-e4a836bf1d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:59.687092 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4237/8409] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:52:59.697568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f08e0a-f8a8-4721-b39a-48aa1fb10e26 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:52:59.699030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-66f08e0a-f8a8-4721-b39a-48aa1fb10e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:52:59.759328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f08e0a-f8a8-4721-b39a-48aa1fb10e26 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:52:59.762937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b789e9c-12da-4c5e-8957-b33b0ab24317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:52:59.763619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b789e9c-12da-4c5e-8957-b33b0ab24317 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:52:59.763907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b789e9c-12da-4c5e-8957-b33b0ab24317 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:52:59.764189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b789e9c-12da-4c5e-8957-b33b0ab24317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:52:59.773795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b789e9c-12da-4c5e-8957-b33b0ab24317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:52:59.775267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b789e9c-12da-4c5e-8957-b33b0ab24317 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:52:59.784980 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4173/8410] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:52:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:53:00.188606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6c611-62ca-4a0b-a7c9-e4a836bf1d58 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:00.190055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f8d6c611-62ca-4a0b-a7c9-e4a836bf1d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:00.205102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6c611-62ca-4a0b-a7c9-e4a836bf1d58 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:00.211958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1633aab-b968-482f-a779-8e42f834245a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:00.212838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1633aab-b968-482f-a779-8e42f834245a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:00.213124 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1633aab-b968-482f-a779-8e42f834245a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:00.213402 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1633aab-b968-482f-a779-8e42f834245a admin admin] PATH_INFO: `/v3/projects/1fd71e9f20934ad985959913a6ba56a5` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:00.214618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1633aab-b968-482f-a779-8e42f834245a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fd71e9f20934ad985959913a6ba56a5)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:00.220978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1633aab-b968-482f-a779-8e42f834245a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:00.226728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:00.329102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d1633aab-b968-482f-a779-8e42f834245a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fd71e9f20934ad985959913a6ba56a5', 'request_id': 'req-d1633aab-b968-482f-a779-8e42f834245a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:00.336276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d1633aab-b968-482f-a779-8e42f834245a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fd71e9f20934ad985959913a6ba56a5', 'request_id': 'req-d1633aab-b968-482f-a779-8e42f834245a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:00.341897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d1633aab-b968-482f-a779-8e42f834245a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fd71e9f20934ad985959913a6ba56a5', 'request_id': 'req-d1633aab-b968-482f-a779-8e42f834245a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:00.443676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d1633aab-b968-482f-a779-8e42f834245a admin admin] The token cache is being invalidate because project 1fd71e9f20934ad985959913a6ba56a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:53:00.443964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d1633aab-b968-482f-a779-8e42f834245a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:00.444591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d1633aab-b968-482f-a779-8e42f834245a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:00.446123 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4238/8411] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:53:00 2022] DELETE /identity/v3/projects/1fd71e9f20934ad985959913a6ba56a5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:53:00.451167 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f2c46-dd40-49e8-82fc-a2ed15a27df9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:00.451465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f2c46-dd40-49e8-82fc-a2ed15a27df9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:00.451771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f2c46-dd40-49e8-82fc-a2ed15a27df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:00.470552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-866f2c46-dd40-49e8-82fc-a2ed15a27df9 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:53:00.472143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-866f2c46-dd40-49e8-82fc-a2ed15a27df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:00.534609 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4174/8412] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:53:00.543306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bf596-fa69-4eba-bbb9-ad39bc171582 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:00.543621 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bf596-fa69-4eba-bbb9-ad39bc171582 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:00.543898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bf596-fa69-4eba-bbb9-ad39bc171582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:00.562150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9e5bf596-fa69-4eba-bbb9-ad39bc171582 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:53:00.563397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9e5bf596-fa69-4eba-bbb9-ad39bc171582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:00.571348 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4239/8413] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:53:00.575603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f2c46-dd40-49e8-82fc-a2ed15a27df9 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:00.586114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f2c46-dd40-49e8-82fc-a2ed15a27df9 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:00.590617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60d182-9692-463d-9061-824734af45a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:00.591370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60d182-9692-463d-9061-824734af45a1 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:00.591660 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60d182-9692-463d-9061-824734af45a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:00.591948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60d182-9692-463d-9061-824734af45a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:00.592670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60d182-9692-463d-9061-824734af45a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:53:00.597355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60d182-9692-463d-9061-824734af45a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:00.597355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60d182-9692-463d-9061-824734af45a1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:00.607313 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4175/8414] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:53:00.611602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bf596-fa69-4eba-bbb9-ad39bc171582 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:00.621278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bf596-fa69-4eba-bbb9-ad39bc171582 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:00.626123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f247d-225f-430b-93a5-5059d09cfa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:00.626762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f247d-225f-430b-93a5-5059d09cfa67 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:00.627077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f247d-225f-430b-93a5-5059d09cfa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:00.627375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f247d-225f-430b-93a5-5059d09cfa67 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:00.628076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f247d-225f-430b-93a5-5059d09cfa67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:00.630572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f247d-225f-430b-93a5-5059d09cfa67 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:00.737046 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4240/8415] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:53:00 2022] POST /identity/v3/projects => generated 407 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:53:00.741248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60d182-9692-463d-9061-824734af45a1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:00.751662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60d182-9692-463d-9061-824734af45a1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:00.807561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356793e-1803-478a-a76c-357cb858e306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:00.808218 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356793e-1803-478a-a76c-357cb858e306 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:00.808499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356793e-1803-478a-a76c-357cb858e306 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:00.808800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356793e-1803-478a-a76c-357cb858e306 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:00.809496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356793e-1803-478a-a76c-357cb858e306 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:00.811473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356793e-1803-478a-a76c-357cb858e306 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:00.901686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:00.907760 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4176/8416] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:53:00 2022] POST /identity/v3/users => generated 304 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:53:00.912613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f247d-225f-430b-93a5-5059d09cfa67 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:00.923271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f247d-225f-430b-93a5-5059d09cfa67 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:00.928912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27affd89-7406-4376-9cbf-c23824a55c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:00.929567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27affd89-7406-4376-9cbf-c23824a55c02 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:00.929873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27affd89-7406-4376-9cbf-c23824a55c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:00.930144 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27affd89-7406-4376-9cbf-c23824a55c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:00.930918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27affd89-7406-4376-9cbf-c23824a55c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:00.932547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27affd89-7406-4376-9cbf-c23824a55c02 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:00.943589 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4241/8417] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:53:00.947689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356793e-1803-478a-a76c-357cb858e306 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:00.957869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356793e-1803-478a-a76c-357cb858e306 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:00.962530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf86add-6349-4fcb-847a-02b34c176d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:00.963262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf86add-6349-4fcb-847a-02b34c176d7f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:00.963561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf86add-6349-4fcb-847a-02b34c176d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:00.963820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf86add-6349-4fcb-847a-02b34c176d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:00.964537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf86add-6349-4fcb-847a-02b34c176d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:00.966198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf86add-6349-4fcb-847a-02b34c176d7f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:00.978793 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4177/8418] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:53:00.982899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27affd89-7406-4376-9cbf-c23824a55c02 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:00.993954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27affd89-7406-4376-9cbf-c23824a55c02 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:00.998510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9bc93-29e0-4f15-90f4-5e45c0ffe920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:00.999406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9bc93-29e0-4f15-90f4-5e45c0ffe920 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:00.999689 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9bc93-29e0-4f15-90f4-5e45c0ffe920 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:00.999961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9bc93-29e0-4f15-90f4-5e45c0ffe920 admin admin] PATH_INFO: `/v3/projects/9bbcb21c2057463783464c7aad57f111/users/bb8a43bdc7f645079f738d62825dd75d/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:01.014733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9bc93-29e0-4f15-90f4-5e45c0ffe920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bbcb21c2057463783464c7aad57f111, user_id=bb8a43bdc7f645079f738d62825dd75d, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:01.017423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9bc93-29e0-4f15-90f4-5e45c0ffe920 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:01.072841 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4242/8419] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:53:00 2022] PUT /identity/v3/projects/9bbcb21c2057463783464c7aad57f111/users/bb8a43bdc7f645079f738d62825dd75d/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:53:01.083469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40991629-f029-4c87-a50e-e74392736949 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:01.083781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40991629-f029-4c87-a50e-e74392736949 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:01.084114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40991629-f029-4c87-a50e-e74392736949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:01.111266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-40991629-f029-4c87-a50e-e74392736949 None None] MFA Rules not processed for user `bb8a43bdc7f645079f738d62825dd75d`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:53:01.112468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-40991629-f029-4c87-a50e-e74392736949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:01.176576 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4178/8420] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:53:01 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:53:01.181326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9bc93-29e0-4f15-90f4-5e45c0ffe920 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:01.241940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9bc93-29e0-4f15-90f4-5e45c0ffe920 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:01.246676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff411b4-4743-4609-b376-d3766277500e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:01.247363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff411b4-4743-4609-b376-d3766277500e admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:01.247653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff411b4-4743-4609-b376-d3766277500e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:01.247950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff411b4-4743-4609-b376-d3766277500e admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:01.248625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff411b4-4743-4609-b376-d3766277500e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:01.250541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff411b4-4743-4609-b376-d3766277500e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:01.348596 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4243/8421] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:53:01 2022] POST /identity/v3/projects => generated 407 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:53:01.352834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40991629-f029-4c87-a50e-e74392736949 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:01.364208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40991629-f029-4c87-a50e-e74392736949 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:01.419886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22776b64-6dfc-4874-865c-a432a76ee1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:01.420555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22776b64-6dfc-4874-865c-a432a76ee1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:01.420842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22776b64-6dfc-4874-865c-a432a76ee1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:01.421121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22776b64-6dfc-4874-865c-a432a76ee1f9 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:01.421799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22776b64-6dfc-4874-865c-a432a76ee1f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:01.423762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22776b64-6dfc-4874-865c-a432a76ee1f9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:01.496283 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4179/8422] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:53:01 2022] POST /identity/v3/users => generated 310 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:53:01.500282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff411b4-4743-4609-b376-d3766277500e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:01.510938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff411b4-4743-4609-b376-d3766277500e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:01.516490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a629bf0-ef66-44ea-b486-169362f7ad7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:01.517150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a629bf0-ef66-44ea-b486-169362f7ad7f admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:01.517430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a629bf0-ef66-44ea-b486-169362f7ad7f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:01.517769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a629bf0-ef66-44ea-b486-169362f7ad7f admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:01.518528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a629bf0-ef66-44ea-b486-169362f7ad7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:01.520907 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a629bf0-ef66-44ea-b486-169362f7ad7f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:01.532439 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4244/8423] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:53:01.537812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22776b64-6dfc-4874-865c-a432a76ee1f9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:01.548021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22776b64-6dfc-4874-865c-a432a76ee1f9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:01.553690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfc4dc-d658-4e5d-bead-1591aa30de32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:01.554571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfc4dc-d658-4e5d-bead-1591aa30de32 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:01.557013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfc4dc-d658-4e5d-bead-1591aa30de32 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:01.557013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfc4dc-d658-4e5d-bead-1591aa30de32 admin admin] PATH_INFO: `/v3/projects/e8cdd970d1374f40a56a4f4328a3ba08/users/dc6d17dd3d5b41bf94048be888cdb617/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:01.570737 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfc4dc-d658-4e5d-bead-1591aa30de32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8cdd970d1374f40a56a4f4328a3ba08, user_id=dc6d17dd3d5b41bf94048be888cdb617, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:01.573608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfc4dc-d658-4e5d-bead-1591aa30de32 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:01.717830 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4180/8424] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:53:01 2022] PUT /identity/v3/projects/e8cdd970d1374f40a56a4f4328a3ba08/users/dc6d17dd3d5b41bf94048be888cdb617/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:53:01.722104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a629bf0-ef66-44ea-b486-169362f7ad7f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:01.732900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a629bf0-ef66-44ea-b486-169362f7ad7f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:01.736561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:01.789815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28511c-ffc3-4d93-a6e2-435ae864ec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:01.790411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28511c-ffc3-4d93-a6e2-435ae864ec29 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:01.790695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28511c-ffc3-4d93-a6e2-435ae864ec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:01.790968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28511c-ffc3-4d93-a6e2-435ae864ec29 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:01.791793 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28511c-ffc3-4d93-a6e2-435ae864ec29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:01.793466 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28511c-ffc3-4d93-a6e2-435ae864ec29 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:01.803683 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4245/8425] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:53:01.807699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfc4dc-d658-4e5d-bead-1591aa30de32 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:01.818447 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfc4dc-d658-4e5d-bead-1591aa30de32 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:01.823567 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a2cc1-8e74-4705-b317-7f4269920d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:01.824479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a2cc1-8e74-4705-b317-7f4269920d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:01.824760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a2cc1-8e74-4705-b317-7f4269920d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:01.825033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a2cc1-8e74-4705-b317-7f4269920d08 admin admin] PATH_INFO: `/v3/projects/e8cdd970d1374f40a56a4f4328a3ba08/users/dc6d17dd3d5b41bf94048be888cdb617/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:01.827201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a2cc1-8e74-4705-b317-7f4269920d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8cdd970d1374f40a56a4f4328a3ba08, user_id=dc6d17dd3d5b41bf94048be888cdb617, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:01.829881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a2cc1-8e74-4705-b317-7f4269920d08 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:01.841084 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4181/8426] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:53:01 2022] PUT /identity/v3/projects/e8cdd970d1374f40a56a4f4328a3ba08/users/dc6d17dd3d5b41bf94048be888cdb617/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:53:01.853239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f28f7e-da37-41cc-a536-fa5237651967 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:01.853779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f28f7e-da37-41cc-a536-fa5237651967 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:01.854241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f28f7e-da37-41cc-a536-fa5237651967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:01.883148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-10f28f7e-da37-41cc-a536-fa5237651967 None None] MFA Rules not processed for user `dc6d17dd3d5b41bf94048be888cdb617`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:53:01.884445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-10f28f7e-da37-41cc-a536-fa5237651967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:01.955878 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4246/8427] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:53:01 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:53:01.966724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a2cc1-8e74-4705-b317-7f4269920d08 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:01.968459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1c2a2cc1-8e74-4705-b317-7f4269920d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:02.001035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:02.029971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a2cc1-8e74-4705-b317-7f4269920d08 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:02.033756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d9db6-a60c-4a05-b047-37899f9a5cbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:02.034406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d9db6-a60c-4a05-b047-37899f9a5cbc service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:02.034695 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d9db6-a60c-4a05-b047-37899f9a5cbc service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:02.034980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d9db6-a60c-4a05-b047-37899f9a5cbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:02.093440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d9db6-a60c-4a05-b047-37899f9a5cbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:02.094880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d9db6-a60c-4a05-b047-37899f9a5cbc service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:02.105001 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4182/8428] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:53:01 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:53:02.620318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f28f7e-da37-41cc-a536-fa5237651967 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:02.621764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-10f28f7e-da37-41cc-a536-fa5237651967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:02.710255 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f28f7e-da37-41cc-a536-fa5237651967 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:02.716552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279ce3d-4e1a-482c-99e4-eb0d933e41ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:02.717349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279ce3d-4e1a-482c-99e4-eb0d933e41ca service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:02.717631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279ce3d-4e1a-482c-99e4-eb0d933e41ca service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:02.717905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279ce3d-4e1a-482c-99e4-eb0d933e41ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:02.727816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279ce3d-4e1a-482c-99e4-eb0d933e41ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:02.729459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279ce3d-4e1a-482c-99e4-eb0d933e41ca service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:02.740442 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4247/8429] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:53:02 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:53:09.475196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d9db6-a60c-4a05-b047-37899f9a5cbc service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:09.539857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d9db6-a60c-4a05-b047-37899f9a5cbc service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:09.544545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e002163-9401-4b8a-917c-0a9823905762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:09.545418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e002163-9401-4b8a-917c-0a9823905762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:09.545702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e002163-9401-4b8a-917c-0a9823905762 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:09.545978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e002163-9401-4b8a-917c-0a9823905762 admin admin] PATH_INFO: `/v3/users/bb8a43bdc7f645079f738d62825dd75d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:09.547208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e002163-9401-4b8a-917c-0a9823905762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb8a43bdc7f645079f738d62825dd75d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:09.549120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e002163-9401-4b8a-917c-0a9823905762 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:09.720187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2e002163-9401-4b8a-917c-0a9823905762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb8a43bdc7f645079f738d62825dd75d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:09.732956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2e002163-9401-4b8a-917c-0a9823905762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb8a43bdc7f645079f738d62825dd75d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:09.809931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2e002163-9401-4b8a-917c-0a9823905762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb8a43bdc7f645079f738d62825dd75d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:09.817682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2e002163-9401-4b8a-917c-0a9823905762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb8a43bdc7f645079f738d62825dd75d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:09.818594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2e002163-9401-4b8a-917c-0a9823905762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb8a43bdc7f645079f738d62825dd75d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:09.827855 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4183/8430] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:53:09 2022] DELETE /identity/v3/users/bb8a43bdc7f645079f738d62825dd75d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:53:09.832374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911f63c-f947-4c0d-ac31-6e5e8c2a6078 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:09.832821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911f63c-f947-4c0d-ac31-6e5e8c2a6078 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:09.832912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911f63c-f947-4c0d-ac31-6e5e8c2a6078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:09.839921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:09.851428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f911f63c-f947-4c0d-ac31-6e5e8c2a6078 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:53:09.852625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f911f63c-f947-4c0d-ac31-6e5e8c2a6078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:09.912395 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4248/8431] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:53:09.922128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e002163-9401-4b8a-917c-0a9823905762 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:09.923637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2e002163-9401-4b8a-917c-0a9823905762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:09.929699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:09.985089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e002163-9401-4b8a-917c-0a9823905762 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:09.988796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead012f5-ad9a-4118-99bb-2c4c061ea8e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:09.989474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead012f5-ad9a-4118-99bb-2c4c061ea8e2 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:09.989796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead012f5-ad9a-4118-99bb-2c4c061ea8e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:09.990101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead012f5-ad9a-4118-99bb-2c4c061ea8e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:09.999414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead012f5-ad9a-4118-99bb-2c4c061ea8e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:10.000855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead012f5-ad9a-4118-99bb-2c4c061ea8e2 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:10.010612 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4184/8432] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:53:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:53:10.257268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911f63c-f947-4c0d-ac31-6e5e8c2a6078 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:10.258929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f911f63c-f947-4c0d-ac31-6e5e8c2a6078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:10.272884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911f63c-f947-4c0d-ac31-6e5e8c2a6078 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:10.280133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126d38d-467e-44ea-a952-753b4db09cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:10.280133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126d38d-467e-44ea-a952-753b4db09cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:10.280133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126d38d-467e-44ea-a952-753b4db09cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:10.280133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126d38d-467e-44ea-a952-753b4db09cd9 admin admin] PATH_INFO: `/v3/projects/9bbcb21c2057463783464c7aad57f111` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:10.280962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126d38d-467e-44ea-a952-753b4db09cd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bbcb21c2057463783464c7aad57f111)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:10.282028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126d38d-467e-44ea-a952-753b4db09cd9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:10.404817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5126d38d-467e-44ea-a952-753b4db09cd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bbcb21c2057463783464c7aad57f111', 'request_id': 'req-5126d38d-467e-44ea-a952-753b4db09cd9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:10.410846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5126d38d-467e-44ea-a952-753b4db09cd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bbcb21c2057463783464c7aad57f111', 'request_id': 'req-5126d38d-467e-44ea-a952-753b4db09cd9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:10.416885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5126d38d-467e-44ea-a952-753b4db09cd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bbcb21c2057463783464c7aad57f111', 'request_id': 'req-5126d38d-467e-44ea-a952-753b4db09cd9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:10.507671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5126d38d-467e-44ea-a952-753b4db09cd9 admin admin] The token cache is being invalidate because project 9bbcb21c2057463783464c7aad57f111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:53:10.508036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5126d38d-467e-44ea-a952-753b4db09cd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:10.508815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5126d38d-467e-44ea-a952-753b4db09cd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:10.510587 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4249/8433] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:53:10 2022] DELETE /identity/v3/projects/9bbcb21c2057463783464c7aad57f111 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:53:10.515144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead012f5-ad9a-4118-99bb-2c4c061ea8e2 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:10.525666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead012f5-ad9a-4118-99bb-2c4c061ea8e2 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:10.580683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc2b7d-25a6-4489-9ba9-89261e8fd18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:10.581551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc2b7d-25a6-4489-9ba9-89261e8fd18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:10.581836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc2b7d-25a6-4489-9ba9-89261e8fd18a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:10.582110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc2b7d-25a6-4489-9ba9-89261e8fd18a admin admin] PATH_INFO: `/v3/users/dc6d17dd3d5b41bf94048be888cdb617` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:10.584079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc2b7d-25a6-4489-9ba9-89261e8fd18a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc6d17dd3d5b41bf94048be888cdb617)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:10.586310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc2b7d-25a6-4489-9ba9-89261e8fd18a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:10.771630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-31fc2b7d-25a6-4489-9ba9-89261e8fd18a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc6d17dd3d5b41bf94048be888cdb617'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:10.783059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-31fc2b7d-25a6-4489-9ba9-89261e8fd18a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc6d17dd3d5b41bf94048be888cdb617'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:10.848654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-31fc2b7d-25a6-4489-9ba9-89261e8fd18a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc6d17dd3d5b41bf94048be888cdb617'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:10.856031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-31fc2b7d-25a6-4489-9ba9-89261e8fd18a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc6d17dd3d5b41bf94048be888cdb617'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:10.856666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-31fc2b7d-25a6-4489-9ba9-89261e8fd18a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc6d17dd3d5b41bf94048be888cdb617'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:10.862667 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4185/8434] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:53:10 2022] DELETE /identity/v3/users/dc6d17dd3d5b41bf94048be888cdb617 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:53:11.090739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126d38d-467e-44ea-a952-753b4db09cd9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:11.092280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5126d38d-467e-44ea-a952-753b4db09cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:11.106659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126d38d-467e-44ea-a952-753b4db09cd9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:11.164212 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add71b51-cf47-4701-88bb-984d84f7e425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:11.165061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add71b51-cf47-4701-88bb-984d84f7e425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:11.165347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add71b51-cf47-4701-88bb-984d84f7e425 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:11.165620 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add71b51-cf47-4701-88bb-984d84f7e425 admin admin] PATH_INFO: `/v3/projects/e8cdd970d1374f40a56a4f4328a3ba08` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:11.166802 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add71b51-cf47-4701-88bb-984d84f7e425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8cdd970d1374f40a56a4f4328a3ba08)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:11.168787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add71b51-cf47-4701-88bb-984d84f7e425 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:11.259759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:11.272850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-add71b51-cf47-4701-88bb-984d84f7e425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8cdd970d1374f40a56a4f4328a3ba08', 'request_id': 'req-add71b51-cf47-4701-88bb-984d84f7e425'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:11.278911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-add71b51-cf47-4701-88bb-984d84f7e425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8cdd970d1374f40a56a4f4328a3ba08', 'request_id': 'req-add71b51-cf47-4701-88bb-984d84f7e425'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:11.284414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-add71b51-cf47-4701-88bb-984d84f7e425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8cdd970d1374f40a56a4f4328a3ba08', 'request_id': 'req-add71b51-cf47-4701-88bb-984d84f7e425'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:11.352795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-add71b51-cf47-4701-88bb-984d84f7e425 admin admin] The token cache is being invalidate because project e8cdd970d1374f40a56a4f4328a3ba08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:53:11.353021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-add71b51-cf47-4701-88bb-984d84f7e425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:11.353653 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-add71b51-cf47-4701-88bb-984d84f7e425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:11.355289 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4250/8435] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:53:11 2022] DELETE /identity/v3/projects/e8cdd970d1374f40a56a4f4328a3ba08 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:53:11.360239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32c835-df3d-4817-b622-3e47b4653b2d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:11.360532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32c835-df3d-4817-b622-3e47b4653b2d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:11.360815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32c835-df3d-4817-b622-3e47b4653b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:11.378741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8d32c835-df3d-4817-b622-3e47b4653b2d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:53:11.380090 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8d32c835-df3d-4817-b622-3e47b4653b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:11.399138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:11.440023 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4186/8436] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:53:11.448110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f04100-f979-44bc-ae26-01c1a52e3eb7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:11.448401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f04100-f979-44bc-ae26-01c1a52e3eb7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:11.448683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f04100-f979-44bc-ae26-01c1a52e3eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:11.467595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b4f04100-f979-44bc-ae26-01c1a52e3eb7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:53:11.468787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b4f04100-f979-44bc-ae26-01c1a52e3eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:11.477650 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4251/8437] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:53:11.482092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32c835-df3d-4817-b622-3e47b4653b2d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:11.492366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32c835-df3d-4817-b622-3e47b4653b2d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:11.496887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dacb1-cb0d-4278-a59a-4fde7b60d2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:11.497528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dacb1-cb0d-4278-a59a-4fde7b60d2eb admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:11.497813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dacb1-cb0d-4278-a59a-4fde7b60d2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:11.498088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dacb1-cb0d-4278-a59a-4fde7b60d2eb admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:11.498803 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1dacb1-cb0d-4278-a59a-4fde7b60d2eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:53:11.499149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1dacb1-cb0d-4278-a59a-4fde7b60d2eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:11.500738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1dacb1-cb0d-4278-a59a-4fde7b60d2eb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:11.512876 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4187/8438] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:53:11.516267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f04100-f979-44bc-ae26-01c1a52e3eb7 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:11.526490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f04100-f979-44bc-ae26-01c1a52e3eb7 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:11.531215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d9408-79c6-4bd5-bf65-55a52fae8480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:11.531992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d9408-79c6-4bd5-bf65-55a52fae8480 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:11.532305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d9408-79c6-4bd5-bf65-55a52fae8480 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:11.532584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d9408-79c6-4bd5-bf65-55a52fae8480 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:11.533283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d9408-79c6-4bd5-bf65-55a52fae8480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:11.535210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d9408-79c6-4bd5-bf65-55a52fae8480 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:11.691520 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4252/8439] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:53:11 2022] POST /identity/v3/projects => generated 389 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:53:11.696077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dacb1-cb0d-4278-a59a-4fde7b60d2eb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:11.706307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dacb1-cb0d-4278-a59a-4fde7b60d2eb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:11.763706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb1933-4b7b-4626-a691-0227a1eed6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:11.764381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb1933-4b7b-4626-a691-0227a1eed6ff admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:11.764667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb1933-4b7b-4626-a691-0227a1eed6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:11.764941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb1933-4b7b-4626-a691-0227a1eed6ff admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:11.765655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb1933-4b7b-4626-a691-0227a1eed6ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:11.767730 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb1933-4b7b-4626-a691-0227a1eed6ff admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:12.050481 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4188/8440] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:53:11 2022] POST /identity/v3/users => generated 295 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:53:12.054857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d9408-79c6-4bd5-bf65-55a52fae8480 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:12.065322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d9408-79c6-4bd5-bf65-55a52fae8480 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:12.076057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfad9ce-00d9-485e-b1e5-689d62642479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:12.076057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfad9ce-00d9-485e-b1e5-689d62642479 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:12.076057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfad9ce-00d9-485e-b1e5-689d62642479 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:12.076057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfad9ce-00d9-485e-b1e5-689d62642479 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:12.076430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfad9ce-00d9-485e-b1e5-689d62642479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:12.076430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfad9ce-00d9-485e-b1e5-689d62642479 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:12.085661 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4253/8441] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:53:12.089907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb1933-4b7b-4626-a691-0227a1eed6ff admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:12.100512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb1933-4b7b-4626-a691-0227a1eed6ff admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:12.105098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fda6a-a7d0-43e4-8050-fe31d7322f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:12.110441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fda6a-a7d0-43e4-8050-fe31d7322f34 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:12.110441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fda6a-a7d0-43e4-8050-fe31d7322f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:12.110441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fda6a-a7d0-43e4-8050-fe31d7322f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:12.110441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fda6a-a7d0-43e4-8050-fe31d7322f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:12.110441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fda6a-a7d0-43e4-8050-fe31d7322f34 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:12.118965 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4189/8442] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:53:12.123310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfad9ce-00d9-485e-b1e5-689d62642479 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:12.134801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfad9ce-00d9-485e-b1e5-689d62642479 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:12.139560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63586c41-7c15-4953-86f4-54d54a5329dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:12.140440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63586c41-7c15-4953-86f4-54d54a5329dd admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:12.140728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63586c41-7c15-4953-86f4-54d54a5329dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:12.141006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63586c41-7c15-4953-86f4-54d54a5329dd admin admin] PATH_INFO: `/v3/projects/32ae377f2f094ddd9de97f5af20a03ef/users/29c71605a15540e9814e2497766c895a/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:12.157019 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63586c41-7c15-4953-86f4-54d54a5329dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ae377f2f094ddd9de97f5af20a03ef, user_id=29c71605a15540e9814e2497766c895a, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:12.159762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63586c41-7c15-4953-86f4-54d54a5329dd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:12.238608 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4254/8443] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:53:12 2022] PUT /identity/v3/projects/32ae377f2f094ddd9de97f5af20a03ef/users/29c71605a15540e9814e2497766c895a/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:53:12.256864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca06b31-cc1f-4163-b2a6-b269e280b82c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:12.257154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca06b31-cc1f-4163-b2a6-b269e280b82c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:12.257468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca06b31-cc1f-4163-b2a6-b269e280b82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:12.283871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3ca06b31-cc1f-4163-b2a6-b269e280b82c None None] MFA Rules not processed for user `29c71605a15540e9814e2497766c895a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:53:12.285074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3ca06b31-cc1f-4163-b2a6-b269e280b82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:12.348643 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4190/8444] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:53:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:53:12.359130 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63586c41-7c15-4953-86f4-54d54a5329dd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:12.360824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-63586c41-7c15-4953-86f4-54d54a5329dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:12.420775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63586c41-7c15-4953-86f4-54d54a5329dd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:12.424566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99808f9d-5295-4e69-a48f-5a9a8127d31b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:12.425166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99808f9d-5295-4e69-a48f-5a9a8127d31b service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:12.425450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99808f9d-5295-4e69-a48f-5a9a8127d31b service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:12.425731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99808f9d-5295-4e69-a48f-5a9a8127d31b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:12.435396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99808f9d-5295-4e69-a48f-5a9a8127d31b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:12.436875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99808f9d-5295-4e69-a48f-5a9a8127d31b service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:12.446881 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4255/8445] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:53:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:53:12.481624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca06b31-cc1f-4163-b2a6-b269e280b82c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:12.503072 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:12.546346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca06b31-cc1f-4163-b2a6-b269e280b82c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:12.551269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d24f6-655f-405c-976e-8e88f3534168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:12.552732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d24f6-655f-405c-976e-8e88f3534168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:12.553016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d24f6-655f-405c-976e-8e88f3534168 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:12.553295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d24f6-655f-405c-976e-8e88f3534168 admin admin] PATH_INFO: `/v3/users/29c71605a15540e9814e2497766c895a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:12.554511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d24f6-655f-405c-976e-8e88f3534168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29c71605a15540e9814e2497766c895a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:12.556497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d24f6-655f-405c-976e-8e88f3534168 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:12.756023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8e4d24f6-655f-405c-976e-8e88f3534168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29c71605a15540e9814e2497766c895a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:12.767733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8e4d24f6-655f-405c-976e-8e88f3534168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29c71605a15540e9814e2497766c895a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:12.832867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8e4d24f6-655f-405c-976e-8e88f3534168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29c71605a15540e9814e2497766c895a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:12.840514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8e4d24f6-655f-405c-976e-8e88f3534168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29c71605a15540e9814e2497766c895a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:12.841176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8e4d24f6-655f-405c-976e-8e88f3534168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29c71605a15540e9814e2497766c895a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:12.847679 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4191/8446] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:53:12 2022] DELETE /identity/v3/users/29c71605a15540e9814e2497766c895a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:53:12.852731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf61573-d955-4a78-b5ce-d4934326e5e1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:12.853017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf61573-d955-4a78-b5ce-d4934326e5e1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:12.853317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf61573-d955-4a78-b5ce-d4934326e5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:12.873072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-bdf61573-d955-4a78-b5ce-d4934326e5e1 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:53:12.874309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bdf61573-d955-4a78-b5ce-d4934326e5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:12.923744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:12.933988 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4256/8447] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:53:12.943883 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d24f6-655f-405c-976e-8e88f3534168 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:12.945307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8e4d24f6-655f-405c-976e-8e88f3534168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:13.008514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d24f6-655f-405c-976e-8e88f3534168 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:13.012205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3682af-6750-4114-8aff-325dded612f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:13.012898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3682af-6750-4114-8aff-325dded612f8 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:13.013178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3682af-6750-4114-8aff-325dded612f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:13.013455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3682af-6750-4114-8aff-325dded612f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:13.022489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3682af-6750-4114-8aff-325dded612f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:13.023952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3682af-6750-4114-8aff-325dded612f8 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:13.033405 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4192/8448] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:53:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:53:13.417059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf61573-d955-4a78-b5ce-d4934326e5e1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:13.418572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bdf61573-d955-4a78-b5ce-d4934326e5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:13.431246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf61573-d955-4a78-b5ce-d4934326e5e1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:13.436237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10a052-ef65-445c-9316-bffaf4bf907a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:13.437140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10a052-ef65-445c-9316-bffaf4bf907a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:13.437501 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10a052-ef65-445c-9316-bffaf4bf907a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:13.437845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10a052-ef65-445c-9316-bffaf4bf907a admin admin] PATH_INFO: `/v3/projects/32ae377f2f094ddd9de97f5af20a03ef` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:13.439099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10a052-ef65-445c-9316-bffaf4bf907a admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ae377f2f094ddd9de97f5af20a03ef)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:13.441038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10a052-ef65-445c-9316-bffaf4bf907a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:13.570971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0c10a052-ef65-445c-9316-bffaf4bf907a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ae377f2f094ddd9de97f5af20a03ef', 'request_id': 'req-0c10a052-ef65-445c-9316-bffaf4bf907a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:13.577401 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0c10a052-ef65-445c-9316-bffaf4bf907a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ae377f2f094ddd9de97f5af20a03ef', 'request_id': 'req-0c10a052-ef65-445c-9316-bffaf4bf907a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:13.582972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0c10a052-ef65-445c-9316-bffaf4bf907a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ae377f2f094ddd9de97f5af20a03ef', 'request_id': 'req-0c10a052-ef65-445c-9316-bffaf4bf907a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:13.666504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0c10a052-ef65-445c-9316-bffaf4bf907a admin admin] The token cache is being invalidate because project 32ae377f2f094ddd9de97f5af20a03ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:53:13.666804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0c10a052-ef65-445c-9316-bffaf4bf907a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:13.667482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-0c10a052-ef65-445c-9316-bffaf4bf907a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:13.669064 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4257/8449] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:53:13 2022] DELETE /identity/v3/projects/32ae377f2f094ddd9de97f5af20a03ef => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:53:13.675671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3666a-99a6-491d-8181-d7a837b39aab None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:13.675962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3666a-99a6-491d-8181-d7a837b39aab None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:13.676244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3666a-99a6-491d-8181-d7a837b39aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:13.695364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-fef3666a-99a6-491d-8181-d7a837b39aab None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:53:13.696527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fef3666a-99a6-491d-8181-d7a837b39aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:13.735724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:13.758050 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4193/8450] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:53:13.764898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ee8f3-080e-4918-ae38-febae99192f1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:13.771392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ee8f3-080e-4918-ae38-febae99192f1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:13.771392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ee8f3-080e-4918-ae38-febae99192f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:13.784303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-373ee8f3-080e-4918-ae38-febae99192f1 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:53:13.785511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-373ee8f3-080e-4918-ae38-febae99192f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:13.793764 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4258/8451] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:53:13.798287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3666a-99a6-491d-8181-d7a837b39aab None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:13.808837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3666a-99a6-491d-8181-d7a837b39aab None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:13.813549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a5746-1306-4c52-a240-89f43dc5841c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:13.814201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a5746-1306-4c52-a240-89f43dc5841c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:13.814487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a5746-1306-4c52-a240-89f43dc5841c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:13.814765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a5746-1306-4c52-a240-89f43dc5841c admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:13.815520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a5746-1306-4c52-a240-89f43dc5841c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:53:13.815834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a5746-1306-4c52-a240-89f43dc5841c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:13.817435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a5746-1306-4c52-a240-89f43dc5841c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:13.829704 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4194/8452] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:53:13.834063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ee8f3-080e-4918-ae38-febae99192f1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:13.844084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ee8f3-080e-4918-ae38-febae99192f1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:13.848992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cf1a9-f897-4e1b-a41b-153f7b0a88b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:13.849641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cf1a9-f897-4e1b-a41b-153f7b0a88b4 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:13.849923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cf1a9-f897-4e1b-a41b-153f7b0a88b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:13.850202 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cf1a9-f897-4e1b-a41b-153f7b0a88b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:13.850903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cf1a9-f897-4e1b-a41b-153f7b0a88b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:13.852839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cf1a9-f897-4e1b-a41b-153f7b0a88b4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:13.964449 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4259/8453] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:53:13 2022] POST /identity/v3/projects => generated 397 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:53:13.968479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a5746-1306-4c52-a240-89f43dc5841c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:13.978845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a5746-1306-4c52-a240-89f43dc5841c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:14.033676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fe4cb-cc28-4a9b-a967-32dc6eb9cfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:14.034336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fe4cb-cc28-4a9b-a967-32dc6eb9cfb6 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:14.034621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fe4cb-cc28-4a9b-a967-32dc6eb9cfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:14.034890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fe4cb-cc28-4a9b-a967-32dc6eb9cfb6 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:14.035602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5fe4cb-cc28-4a9b-a967-32dc6eb9cfb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:14.037489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5fe4cb-cc28-4a9b-a967-32dc6eb9cfb6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:14.118999 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4195/8454] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:53:13 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:53:14.123625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cf1a9-f897-4e1b-a41b-153f7b0a88b4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:14.134142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cf1a9-f897-4e1b-a41b-153f7b0a88b4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:14.138903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a3d2a-1fe1-4bdd-9105-4184514226f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:14.143754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a3d2a-1fe1-4bdd-9105-4184514226f3 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:14.143754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a3d2a-1fe1-4bdd-9105-4184514226f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:14.143754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a3d2a-1fe1-4bdd-9105-4184514226f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:14.143754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a3d2a-1fe1-4bdd-9105-4184514226f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:14.143754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a3d2a-1fe1-4bdd-9105-4184514226f3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:14.152945 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4260/8455] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:53:14.156995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fe4cb-cc28-4a9b-a967-32dc6eb9cfb6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:14.167930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fe4cb-cc28-4a9b-a967-32dc6eb9cfb6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:14.173185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1500a1-895c-4fa8-964f-fda29e860ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:14.173853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1500a1-895c-4fa8-964f-fda29e860ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:14.174139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1500a1-895c-4fa8-964f-fda29e860ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:14.174417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1500a1-895c-4fa8-964f-fda29e860ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:14.175187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1500a1-895c-4fa8-964f-fda29e860ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:14.176872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1500a1-895c-4fa8-964f-fda29e860ed9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:14.187647 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4196/8456] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:53:14.191791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a3d2a-1fe1-4bdd-9105-4184514226f3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:14.201866 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a3d2a-1fe1-4bdd-9105-4184514226f3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:14.206780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26b5b5-0c8d-4c6e-af22-47b88981e1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:14.207822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26b5b5-0c8d-4c6e-af22-47b88981e1ea admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:14.208109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26b5b5-0c8d-4c6e-af22-47b88981e1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:14.208382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26b5b5-0c8d-4c6e-af22-47b88981e1ea admin admin] PATH_INFO: `/v3/projects/175a3f3d5e0d4d08aa9d4969d519a837/users/19e6e7fae24f4ba79a26d269c60c1d94/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:14.228295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26b5b5-0c8d-4c6e-af22-47b88981e1ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=175a3f3d5e0d4d08aa9d4969d519a837, user_id=19e6e7fae24f4ba79a26d269c60c1d94, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:14.228295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26b5b5-0c8d-4c6e-af22-47b88981e1ea admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:14.307579 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4261/8457] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:53:14 2022] PUT /identity/v3/projects/175a3f3d5e0d4d08aa9d4969d519a837/users/19e6e7fae24f4ba79a26d269c60c1d94/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:53:14.317948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7147e-19fd-4eaa-88e7-fd60ad308555 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:14.318311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7147e-19fd-4eaa-88e7-fd60ad308555 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:14.318600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7147e-19fd-4eaa-88e7-fd60ad308555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:14.344825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-17d7147e-19fd-4eaa-88e7-fd60ad308555 None None] MFA Rules not processed for user `19e6e7fae24f4ba79a26d269c60c1d94`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:53:14.346284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-17d7147e-19fd-4eaa-88e7-fd60ad308555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:14.411764 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4197/8458] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:53:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:53:14.422359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26b5b5-0c8d-4c6e-af22-47b88981e1ea admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:14.424550 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2d26b5b5-0c8d-4c6e-af22-47b88981e1ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:14.516347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26b5b5-0c8d-4c6e-af22-47b88981e1ea admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:14.519972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc9d0e-b5b2-417d-b090-3a42aa41201d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:14.520617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc9d0e-b5b2-417d-b090-3a42aa41201d service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:14.520903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc9d0e-b5b2-417d-b090-3a42aa41201d service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:14.521183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc9d0e-b5b2-417d-b090-3a42aa41201d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:14.530309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc9d0e-b5b2-417d-b090-3a42aa41201d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:14.531798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc9d0e-b5b2-417d-b090-3a42aa41201d service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:14.541334 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4262/8459] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:53:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:53:24.408759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=80,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:24.536710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:26.847896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7147e-19fd-4eaa-88e7-fd60ad308555 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:26.911672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7147e-19fd-4eaa-88e7-fd60ad308555 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:26.916935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e524c2-9e57-496e-8e56-bf71825eca76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:26.917834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e524c2-9e57-496e-8e56-bf71825eca76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:26.923426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e524c2-9e57-496e-8e56-bf71825eca76 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:26.923426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e524c2-9e57-496e-8e56-bf71825eca76 admin admin] PATH_INFO: `/v3/users/19e6e7fae24f4ba79a26d269c60c1d94` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:26.923426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e524c2-9e57-496e-8e56-bf71825eca76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e6e7fae24f4ba79a26d269c60c1d94)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:26.923426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e524c2-9e57-496e-8e56-bf71825eca76 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:27.052122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d8e524c2-9e57-496e-8e56-bf71825eca76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e6e7fae24f4ba79a26d269c60c1d94'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:27.064989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d8e524c2-9e57-496e-8e56-bf71825eca76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e6e7fae24f4ba79a26d269c60c1d94'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:27.118493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d8e524c2-9e57-496e-8e56-bf71825eca76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e6e7fae24f4ba79a26d269c60c1d94'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:27.126905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d8e524c2-9e57-496e-8e56-bf71825eca76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e6e7fae24f4ba79a26d269c60c1d94'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:27.127659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d8e524c2-9e57-496e-8e56-bf71825eca76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e6e7fae24f4ba79a26d269c60c1d94'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:27.133896 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4198/8460] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:53:26 2022] DELETE /identity/v3/users/19e6e7fae24f4ba79a26d269c60c1d94 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:53:27.138558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabb6ad-6829-42b2-86dd-9ebb5b9891ef None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:27.139042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabb6ad-6829-42b2-86dd-9ebb5b9891ef None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:27.139306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabb6ad-6829-42b2-86dd-9ebb5b9891ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:27.157523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-cbabb6ad-6829-42b2-86dd-9ebb5b9891ef None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:53:27.158715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cbabb6ad-6829-42b2-86dd-9ebb5b9891ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:27.217064 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4263/8461] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:53:27.227520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e524c2-9e57-496e-8e56-bf71825eca76 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:27.228958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d8e524c2-9e57-496e-8e56-bf71825eca76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:27.299959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e524c2-9e57-496e-8e56-bf71825eca76 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:27.304021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae9d41-16b9-4cc9-860b-5916ca80b64b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:27.304672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae9d41-16b9-4cc9-860b-5916ca80b64b service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:27.304987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae9d41-16b9-4cc9-860b-5916ca80b64b service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:27.305270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae9d41-16b9-4cc9-860b-5916ca80b64b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:27.314249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae9d41-16b9-4cc9-860b-5916ca80b64b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:27.315769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae9d41-16b9-4cc9-860b-5916ca80b64b service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:27.325363 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4199/8462] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:53:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:53:27.577293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabb6ad-6829-42b2-86dd-9ebb5b9891ef None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:27.578756 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cbabb6ad-6829-42b2-86dd-9ebb5b9891ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:27.592029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabb6ad-6829-42b2-86dd-9ebb5b9891ef None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:27.597363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8f87f-0982-476a-982d-10b64efb08c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:27.598527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8f87f-0982-476a-982d-10b64efb08c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:27.598936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8f87f-0982-476a-982d-10b64efb08c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:27.600118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8f87f-0982-476a-982d-10b64efb08c9 admin admin] PATH_INFO: `/v3/projects/175a3f3d5e0d4d08aa9d4969d519a837` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:27.601203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8f87f-0982-476a-982d-10b64efb08c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=175a3f3d5e0d4d08aa9d4969d519a837)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:27.603711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8f87f-0982-476a-982d-10b64efb08c9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:27.714549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-dec8f87f-0982-476a-982d-10b64efb08c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '175a3f3d5e0d4d08aa9d4969d519a837', 'request_id': 'req-dec8f87f-0982-476a-982d-10b64efb08c9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:27.721072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-dec8f87f-0982-476a-982d-10b64efb08c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '175a3f3d5e0d4d08aa9d4969d519a837', 'request_id': 'req-dec8f87f-0982-476a-982d-10b64efb08c9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:27.726647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-dec8f87f-0982-476a-982d-10b64efb08c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '175a3f3d5e0d4d08aa9d4969d519a837', 'request_id': 'req-dec8f87f-0982-476a-982d-10b64efb08c9'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:27.781013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-dec8f87f-0982-476a-982d-10b64efb08c9 admin admin] The token cache is being invalidate because project 175a3f3d5e0d4d08aa9d4969d519a837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:53:27.781304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-dec8f87f-0982-476a-982d-10b64efb08c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:27.781962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-dec8f87f-0982-476a-982d-10b64efb08c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:27.783593 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4264/8463] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:53:27 2022] DELETE /identity/v3/projects/175a3f3d5e0d4d08aa9d4969d519a837 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:53:27.788735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd04662-5439-4753-b453-64be1e72dfbf None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:27.789025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd04662-5439-4753-b453-64be1e72dfbf None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:27.789760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd04662-5439-4753-b453-64be1e72dfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:27.807399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-afd04662-5439-4753-b453-64be1e72dfbf None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:53:27.808596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-afd04662-5439-4753-b453-64be1e72dfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:27.813985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:27.869525 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4200/8464] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:53:27.877366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d05cf-f514-4804-9439-5a76ffa2e83c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:27.877658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d05cf-f514-4804-9439-5a76ffa2e83c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:27.877939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d05cf-f514-4804-9439-5a76ffa2e83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:27.897319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b35d05cf-f514-4804-9439-5a76ffa2e83c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:53:27.898562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b35d05cf-f514-4804-9439-5a76ffa2e83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:27.907475 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4265/8465] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:53:27.911711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd04662-5439-4753-b453-64be1e72dfbf None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:27.921709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd04662-5439-4753-b453-64be1e72dfbf None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:27.926444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c573db1-935d-4b77-aa22-497a3081af69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:27.927139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c573db1-935d-4b77-aa22-497a3081af69 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:27.927429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c573db1-935d-4b77-aa22-497a3081af69 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:27.927711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c573db1-935d-4b77-aa22-497a3081af69 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:27.928454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c573db1-935d-4b77-aa22-497a3081af69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:53:27.928764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c573db1-935d-4b77-aa22-497a3081af69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:27.931360 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c573db1-935d-4b77-aa22-497a3081af69 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:27.942973 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4201/8466] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:53:27.948176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d05cf-f514-4804-9439-5a76ffa2e83c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:27.957887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d05cf-f514-4804-9439-5a76ffa2e83c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:27.963279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020beb5a-f289-4bd8-a784-a81cf874785d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:27.963984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020beb5a-f289-4bd8-a784-a81cf874785d admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:27.964270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020beb5a-f289-4bd8-a784-a81cf874785d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:27.964562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020beb5a-f289-4bd8-a784-a81cf874785d admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:27.965316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020beb5a-f289-4bd8-a784-a81cf874785d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:27.967332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020beb5a-f289-4bd8-a784-a81cf874785d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:28.039092 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4266/8467] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:53:27 2022] POST /identity/v3/projects => generated 389 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:53:28.043303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c573db1-935d-4b77-aa22-497a3081af69 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:28.053683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c573db1-935d-4b77-aa22-497a3081af69 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:28.111178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b408c-1301-4bd2-8bde-8d1f025fe23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:28.111852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b408c-1301-4bd2-8bde-8d1f025fe23b admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:28.112140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b408c-1301-4bd2-8bde-8d1f025fe23b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:28.112418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b408c-1301-4bd2-8bde-8d1f025fe23b admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:28.113110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b408c-1301-4bd2-8bde-8d1f025fe23b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:28.115048 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b408c-1301-4bd2-8bde-8d1f025fe23b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:28.190447 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4202/8468] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:53:28 2022] POST /identity/v3/users => generated 295 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:53:28.191824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020beb5a-f289-4bd8-a784-a81cf874785d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:28.203868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020beb5a-f289-4bd8-a784-a81cf874785d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:28.208521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4627a6-1104-4bee-b8ea-54b10c3d908d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:28.209185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4627a6-1104-4bee-b8ea-54b10c3d908d admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:28.209468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4627a6-1104-4bee-b8ea-54b10c3d908d admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:28.209745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4627a6-1104-4bee-b8ea-54b10c3d908d admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:28.210514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4627a6-1104-4bee-b8ea-54b10c3d908d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:28.212271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4627a6-1104-4bee-b8ea-54b10c3d908d admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:28.223564 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4267/8469] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:53:28.227987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b408c-1301-4bd2-8bde-8d1f025fe23b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:28.238269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b408c-1301-4bd2-8bde-8d1f025fe23b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:28.243545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ea629-1fc5-46d4-a128-33dd42b8593c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:28.244195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ea629-1fc5-46d4-a128-33dd42b8593c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:28.244482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ea629-1fc5-46d4-a128-33dd42b8593c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:28.244762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ea629-1fc5-46d4-a128-33dd42b8593c admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:28.245477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ea629-1fc5-46d4-a128-33dd42b8593c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:28.247109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ea629-1fc5-46d4-a128-33dd42b8593c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:28.257596 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4203/8470] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:53:28.264006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4627a6-1104-4bee-b8ea-54b10c3d908d admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:28.274375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4627a6-1104-4bee-b8ea-54b10c3d908d admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:28.279029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be967b6-6246-40ed-87df-9c7ebca1d61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:28.279906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be967b6-6246-40ed-87df-9c7ebca1d61b admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:28.280188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be967b6-6246-40ed-87df-9c7ebca1d61b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:28.280465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be967b6-6246-40ed-87df-9c7ebca1d61b admin admin] PATH_INFO: `/v3/projects/ce32ee91f1c74ac68bd1e1bf8569efec/users/0d43850bd04e451caf9e840d23fecb3a/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:28.296919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be967b6-6246-40ed-87df-9c7ebca1d61b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce32ee91f1c74ac68bd1e1bf8569efec, user_id=0d43850bd04e451caf9e840d23fecb3a, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:28.299635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be967b6-6246-40ed-87df-9c7ebca1d61b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:28.370560 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4268/8471] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:53:28 2022] PUT /identity/v3/projects/ce32ee91f1c74ac68bd1e1bf8569efec/users/0d43850bd04e451caf9e840d23fecb3a/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:53:28.380932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a56c4-9c82-4dab-a76a-35f3e426a900 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:28.381221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a56c4-9c82-4dab-a76a-35f3e426a900 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:28.381500 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a56c4-9c82-4dab-a76a-35f3e426a900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:28.409232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6a7a56c4-9c82-4dab-a76a-35f3e426a900 None None] MFA Rules not processed for user `0d43850bd04e451caf9e840d23fecb3a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:53:28.410438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6a7a56c4-9c82-4dab-a76a-35f3e426a900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:28.474887 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4204/8472] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:53:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:53:28.485504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be967b6-6246-40ed-87df-9c7ebca1d61b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:28.487241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9be967b6-6246-40ed-87df-9c7ebca1d61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:28.509549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:28.547292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be967b6-6246-40ed-87df-9c7ebca1d61b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:28.550982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b30e6-929a-4d7f-a5b3-d2a51b2e4595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:28.551645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b30e6-929a-4d7f-a5b3-d2a51b2e4595 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:28.551927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b30e6-929a-4d7f-a5b3-d2a51b2e4595 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:28.552196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b30e6-929a-4d7f-a5b3-d2a51b2e4595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:28.561815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b30e6-929a-4d7f-a5b3-d2a51b2e4595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:28.563267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b30e6-929a-4d7f-a5b3-d2a51b2e4595 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:28.572673 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4269/8473] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:53:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:53:38.472928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:38.683447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=17 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:40.240922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a56c4-9c82-4dab-a76a-35f3e426a900 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:40.305061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a56c4-9c82-4dab-a76a-35f3e426a900 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:40.310528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae9f5b-7cb9-4ca8-bf85-1f313aecdb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:40.311426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae9f5b-7cb9-4ca8-bf85-1f313aecdb27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:40.311704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae9f5b-7cb9-4ca8-bf85-1f313aecdb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:40.311977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae9f5b-7cb9-4ca8-bf85-1f313aecdb27 admin admin] PATH_INFO: `/v3/users/0d43850bd04e451caf9e840d23fecb3a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:40.313163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae9f5b-7cb9-4ca8-bf85-1f313aecdb27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d43850bd04e451caf9e840d23fecb3a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:40.315105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae9f5b-7cb9-4ca8-bf85-1f313aecdb27 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:40.501978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-22ae9f5b-7cb9-4ca8-bf85-1f313aecdb27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d43850bd04e451caf9e840d23fecb3a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:40.514723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-22ae9f5b-7cb9-4ca8-bf85-1f313aecdb27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d43850bd04e451caf9e840d23fecb3a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:40.591015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-22ae9f5b-7cb9-4ca8-bf85-1f313aecdb27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d43850bd04e451caf9e840d23fecb3a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:40.598757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-22ae9f5b-7cb9-4ca8-bf85-1f313aecdb27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d43850bd04e451caf9e840d23fecb3a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:40.599402 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-22ae9f5b-7cb9-4ca8-bf85-1f313aecdb27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d43850bd04e451caf9e840d23fecb3a'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:40.606230 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4205/8474] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:53:40 2022] DELETE /identity/v3/users/0d43850bd04e451caf9e840d23fecb3a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:53:40.610791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeec0fb-932f-4170-9239-aafcdbf4c18e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:40.611276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeec0fb-932f-4170-9239-aafcdbf4c18e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:40.611387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeec0fb-932f-4170-9239-aafcdbf4c18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:40.629209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4aeec0fb-932f-4170-9239-aafcdbf4c18e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:53:40.630425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4aeec0fb-932f-4170-9239-aafcdbf4c18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:40.689026 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4270/8475] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:53:40.698648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae9f5b-7cb9-4ca8-bf85-1f313aecdb27 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:40.700070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-22ae9f5b-7cb9-4ca8-bf85-1f313aecdb27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:40.761176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae9f5b-7cb9-4ca8-bf85-1f313aecdb27 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:40.764802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b62ed-12c5-4923-9497-17a20344d73c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:40.765449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b62ed-12c5-4923-9497-17a20344d73c service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:40.765735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b62ed-12c5-4923-9497-17a20344d73c service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:40.766014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b62ed-12c5-4923-9497-17a20344d73c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:40.775062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b62ed-12c5-4923-9497-17a20344d73c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:40.776536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b62ed-12c5-4923-9497-17a20344d73c service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:40.786038 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4206/8476] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:53:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:53:41.038259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeec0fb-932f-4170-9239-aafcdbf4c18e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:41.039706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4aeec0fb-932f-4170-9239-aafcdbf4c18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:41.053289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeec0fb-932f-4170-9239-aafcdbf4c18e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:41.058311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3516ed-d79e-4acd-89c5-b7bb761d8ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:41.062986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3516ed-d79e-4acd-89c5-b7bb761d8ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:41.062986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3516ed-d79e-4acd-89c5-b7bb761d8ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:41.062986 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3516ed-d79e-4acd-89c5-b7bb761d8ca7 admin admin] PATH_INFO: `/v3/projects/ce32ee91f1c74ac68bd1e1bf8569efec` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:41.063737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3516ed-d79e-4acd-89c5-b7bb761d8ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce32ee91f1c74ac68bd1e1bf8569efec)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:41.065686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3516ed-d79e-4acd-89c5-b7bb761d8ca7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:41.196564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7f3516ed-d79e-4acd-89c5-b7bb761d8ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce32ee91f1c74ac68bd1e1bf8569efec', 'request_id': 'req-7f3516ed-d79e-4acd-89c5-b7bb761d8ca7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:41.203207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7f3516ed-d79e-4acd-89c5-b7bb761d8ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce32ee91f1c74ac68bd1e1bf8569efec', 'request_id': 'req-7f3516ed-d79e-4acd-89c5-b7bb761d8ca7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:41.209095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7f3516ed-d79e-4acd-89c5-b7bb761d8ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce32ee91f1c74ac68bd1e1bf8569efec', 'request_id': 'req-7f3516ed-d79e-4acd-89c5-b7bb761d8ca7'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:41.287487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7f3516ed-d79e-4acd-89c5-b7bb761d8ca7 admin admin] The token cache is being invalidate because project ce32ee91f1c74ac68bd1e1bf8569efec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:53:41.287735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7f3516ed-d79e-4acd-89c5-b7bb761d8ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:41.288368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-7f3516ed-d79e-4acd-89c5-b7bb761d8ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:53:41.289975 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4271/8477] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:53:41 2022] DELETE /identity/v3/projects/ce32ee91f1c74ac68bd1e1bf8569efec => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:53:41.295659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a752f47-61b0-4a82-8f4a-9d17c601b448 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:41.296127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a752f47-61b0-4a82-8f4a-9d17c601b448 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:41.296217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a752f47-61b0-4a82-8f4a-9d17c601b448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:41.313794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1a752f47-61b0-4a82-8f4a-9d17c601b448 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:53:41.314999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1a752f47-61b0-4a82-8f4a-9d17c601b448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:41.331831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:41.374582 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4207/8478] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:53:41.382474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7db4f5-cb89-4226-b00e-75a4b5c1f93b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:41.382764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7db4f5-cb89-4226-b00e-75a4b5c1f93b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:41.383077 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7db4f5-cb89-4226-b00e-75a4b5c1f93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:41.402753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7a7db4f5-cb89-4226-b00e-75a4b5c1f93b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:53:41.404024 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7a7db4f5-cb89-4226-b00e-75a4b5c1f93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:41.412198 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4272/8479] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:53:41.416357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a752f47-61b0-4a82-8f4a-9d17c601b448 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:41.426358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a752f47-61b0-4a82-8f4a-9d17c601b448 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:41.431522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b8eb0-b502-4f9b-ba22-5d8a35619744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:41.432175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b8eb0-b502-4f9b-ba22-5d8a35619744 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:41.432456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b8eb0-b502-4f9b-ba22-5d8a35619744 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:41.432959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b8eb0-b502-4f9b-ba22-5d8a35619744 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:41.433764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b8eb0-b502-4f9b-ba22-5d8a35619744 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:53:41.434069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b8eb0-b502-4f9b-ba22-5d8a35619744 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:41.435675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b8eb0-b502-4f9b-ba22-5d8a35619744 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:41.447313 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4208/8480] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:53:41.453031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7db4f5-cb89-4226-b00e-75a4b5c1f93b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:41.461893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7db4f5-cb89-4226-b00e-75a4b5c1f93b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:41.468206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c9895-9488-418c-9087-cbc98df210ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:41.468851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c9895-9488-418c-9087-cbc98df210ba admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:41.469131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c9895-9488-418c-9087-cbc98df210ba admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:41.469405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c9895-9488-418c-9087-cbc98df210ba admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:41.470122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c9895-9488-418c-9087-cbc98df210ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:41.472419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c9895-9488-418c-9087-cbc98df210ba admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:41.547542 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4273/8481] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:53:41 2022] POST /identity/v3/projects => generated 359 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:53:41.551977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b8eb0-b502-4f9b-ba22-5d8a35619744 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:41.562426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b8eb0-b502-4f9b-ba22-5d8a35619744 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:41.623148 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8652b7a-4dc7-4238-b81c-a3d4f36568e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:41.623824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8652b7a-4dc7-4238-b81c-a3d4f36568e2 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:41.624108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8652b7a-4dc7-4238-b81c-a3d4f36568e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:41.624385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8652b7a-4dc7-4238-b81c-a3d4f36568e2 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:41.625134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8652b7a-4dc7-4238-b81c-a3d4f36568e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:41.627117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8652b7a-4dc7-4238-b81c-a3d4f36568e2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:41.729502 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4209/8482] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:53:41 2022] POST /identity/v3/users => generated 280 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:53:41.733764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c9895-9488-418c-9087-cbc98df210ba admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:41.744513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c9895-9488-418c-9087-cbc98df210ba admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:41.749816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbb55c-9e2b-401b-a646-3f9b7ff8ef5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:41.750464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbb55c-9e2b-401b-a646-3f9b7ff8ef5a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:41.750745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbb55c-9e2b-401b-a646-3f9b7ff8ef5a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:41.751034 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbb55c-9e2b-401b-a646-3f9b7ff8ef5a admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:41.751767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbb55c-9e2b-401b-a646-3f9b7ff8ef5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:41.753358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbb55c-9e2b-401b-a646-3f9b7ff8ef5a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:41.764595 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4274/8483] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:53:41.768623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8652b7a-4dc7-4238-b81c-a3d4f36568e2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:41.779525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8652b7a-4dc7-4238-b81c-a3d4f36568e2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:41.784266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a8b33-3676-43bd-8111-c772df0aedf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:41.784963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a8b33-3676-43bd-8111-c772df0aedf7 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:41.785254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a8b33-3676-43bd-8111-c772df0aedf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:41.785535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a8b33-3676-43bd-8111-c772df0aedf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:41.786298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a8b33-3676-43bd-8111-c772df0aedf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:41.787930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a8b33-3676-43bd-8111-c772df0aedf7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:41.798798 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4210/8484] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:53:41.802852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbb55c-9e2b-401b-a646-3f9b7ff8ef5a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:41.813403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbb55c-9e2b-401b-a646-3f9b7ff8ef5a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:41.818016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b39a0d-a294-4a52-bef1-1ca0c647fc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:41.820607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b39a0d-a294-4a52-bef1-1ca0c647fc9e admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:41.820607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b39a0d-a294-4a52-bef1-1ca0c647fc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:41.820607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b39a0d-a294-4a52-bef1-1ca0c647fc9e admin admin] PATH_INFO: `/v3/projects/80262b5bd3ee481888bd1815a20858d6/users/70fbdfbc11834d6690646d313d48c72c/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:41.837409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b39a0d-a294-4a52-bef1-1ca0c647fc9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=80262b5bd3ee481888bd1815a20858d6, user_id=70fbdfbc11834d6690646d313d48c72c, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:41.840703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b39a0d-a294-4a52-bef1-1ca0c647fc9e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:41.888895 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4275/8485] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:53:41 2022] PUT /identity/v3/projects/80262b5bd3ee481888bd1815a20858d6/users/70fbdfbc11834d6690646d313d48c72c/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:53:41.900271 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb279bfb-0bae-4c8e-830f-617640fefa24 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:41.900556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb279bfb-0bae-4c8e-830f-617640fefa24 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:41.900835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb279bfb-0bae-4c8e-830f-617640fefa24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:41.929560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-cb279bfb-0bae-4c8e-830f-617640fefa24 None None] MFA Rules not processed for user `70fbdfbc11834d6690646d313d48c72c`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:53:41.930782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cb279bfb-0bae-4c8e-830f-617640fefa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:41.996746 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4211/8486] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:53:41 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:53:42.007329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b39a0d-a294-4a52-bef1-1ca0c647fc9e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:42.009032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-13b39a0d-a294-4a52-bef1-1ca0c647fc9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:42.031667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:42.069859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b39a0d-a294-4a52-bef1-1ca0c647fc9e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:42.073528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50109bd2-3d2e-45ea-ad4a-654c89d50fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:42.074169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50109bd2-3d2e-45ea-ad4a-654c89d50fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:42.074710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50109bd2-3d2e-45ea-ad4a-654c89d50fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:42.074989 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50109bd2-3d2e-45ea-ad4a-654c89d50fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:42.084482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50109bd2-3d2e-45ea-ad4a-654c89d50fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:42.085952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50109bd2-3d2e-45ea-ad4a-654c89d50fb4 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:42.095925 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4276/8487] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:53:42 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:53:51.993696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:52.140104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=17 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:53:53.794896 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb279bfb-0bae-4c8e-830f-617640fefa24 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:53.796414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cb279bfb-0bae-4c8e-830f-617640fefa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:53.883498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb279bfb-0bae-4c8e-830f-617640fefa24 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:53.889479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a89eb1-0437-44e5-b9cc-681e83624796 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:53.890211 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a89eb1-0437-44e5-b9cc-681e83624796 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:53.890618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a89eb1-0437-44e5-b9cc-681e83624796 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:53.890965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a89eb1-0437-44e5-b9cc-681e83624796 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:53.892968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-83a89eb1-0437-44e5-b9cc-681e83624796 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:53.923673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a89eb1-0437-44e5-b9cc-681e83624796 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:53.926993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a89eb1-0437-44e5-b9cc-681e83624796 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:53.949581 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4212/8488] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:53:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:53:54.321861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50109bd2-3d2e-45ea-ad4a-654c89d50fb4 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:53:54.337930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50109bd2-3d2e-45ea-ad4a-654c89d50fb4 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:53:54.343301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215805b-b01f-41fe-b986-21cf21485d8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:53:54.343948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215805b-b01f-41fe-b986-21cf21485d8e service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:53:54.344231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215805b-b01f-41fe-b986-21cf21485d8e service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:53:54.344596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215805b-b01f-41fe-b986-21cf21485d8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:53:54.346603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e215805b-b01f-41fe-b986-21cf21485d8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:53:54.361579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215805b-b01f-41fe-b986-21cf21485d8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:53:54.363285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215805b-b01f-41fe-b986-21cf21485d8e service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:53:54.376716 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4277/8489] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:53:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:54:03.936111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=36 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:54:04.369239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:54:51.326430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a89eb1-0437-44e5-b9cc-681e83624796 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:54:51.397060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a89eb1-0437-44e5-b9cc-681e83624796 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:54:51.401689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a11627-de78-4247-b323-81170e41ef65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:54:51.402500 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a11627-de78-4247-b323-81170e41ef65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:54:51.402785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a11627-de78-4247-b323-81170e41ef65 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:54:51.403091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a11627-de78-4247-b323-81170e41ef65 admin admin] PATH_INFO: `/v3/users/70fbdfbc11834d6690646d313d48c72c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:54:51.404763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a11627-de78-4247-b323-81170e41ef65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70fbdfbc11834d6690646d313d48c72c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:54:51.406726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a11627-de78-4247-b323-81170e41ef65 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:54:51.608711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e5a11627-de78-4247-b323-81170e41ef65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70fbdfbc11834d6690646d313d48c72c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:54:51.620348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e5a11627-de78-4247-b323-81170e41ef65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70fbdfbc11834d6690646d313d48c72c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:54:51.687908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e5a11627-de78-4247-b323-81170e41ef65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70fbdfbc11834d6690646d313d48c72c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:54:51.695228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e5a11627-de78-4247-b323-81170e41ef65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70fbdfbc11834d6690646d313d48c72c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:54:51.698958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e5a11627-de78-4247-b323-81170e41ef65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70fbdfbc11834d6690646d313d48c72c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:54:51.701775 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4213/8490] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:54:51 2022] DELETE /identity/v3/users/70fbdfbc11834d6690646d313d48c72c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:54:51.706433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4614904-c678-4875-b01f-26e3197d8088 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:54:51.706955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4614904-c678-4875-b01f-26e3197d8088 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:54:51.707114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4614904-c678-4875-b01f-26e3197d8088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:54:51.746166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f4614904-c678-4875-b01f-26e3197d8088 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:54:51.747407 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f4614904-c678-4875-b01f-26e3197d8088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:54:51.807350 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4278/8491] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:54:51.817931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a11627-de78-4247-b323-81170e41ef65 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:54:51.819383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e5a11627-de78-4247-b323-81170e41ef65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:54:51.883210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a11627-de78-4247-b323-81170e41ef65 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:54:51.886784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe47fb-d101-4c4b-9867-ead08e06d37a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:54:51.887535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe47fb-d101-4c4b-9867-ead08e06d37a service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:54:51.887820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe47fb-d101-4c4b-9867-ead08e06d37a service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:54:51.888096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe47fb-d101-4c4b-9867-ead08e06d37a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:54:51.897299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe47fb-d101-4c4b-9867-ead08e06d37a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:54:51.898719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe47fb-d101-4c4b-9867-ead08e06d37a service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:54:51.909134 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4214/8492] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:54:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:54:52.128902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4614904-c678-4875-b01f-26e3197d8088 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:54:52.130339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f4614904-c678-4875-b01f-26e3197d8088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:54:52.149629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4614904-c678-4875-b01f-26e3197d8088 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:54:52.155920 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88884e6-bb87-456d-bbae-bc99a136bc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:54:52.157131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88884e6-bb87-456d-bbae-bc99a136bc4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:54:52.157487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88884e6-bb87-456d-bbae-bc99a136bc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:54:52.157773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88884e6-bb87-456d-bbae-bc99a136bc4e admin admin] PATH_INFO: `/v3/projects/80262b5bd3ee481888bd1815a20858d6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:54:52.158975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88884e6-bb87-456d-bbae-bc99a136bc4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=80262b5bd3ee481888bd1815a20858d6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:54:52.160930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88884e6-bb87-456d-bbae-bc99a136bc4e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:54:52.265412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b88884e6-bb87-456d-bbae-bc99a136bc4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80262b5bd3ee481888bd1815a20858d6', 'request_id': 'req-b88884e6-bb87-456d-bbae-bc99a136bc4e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:54:52.271655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b88884e6-bb87-456d-bbae-bc99a136bc4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80262b5bd3ee481888bd1815a20858d6', 'request_id': 'req-b88884e6-bb87-456d-bbae-bc99a136bc4e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:54:52.277832 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b88884e6-bb87-456d-bbae-bc99a136bc4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80262b5bd3ee481888bd1815a20858d6', 'request_id': 'req-b88884e6-bb87-456d-bbae-bc99a136bc4e'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:54:52.349822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b88884e6-bb87-456d-bbae-bc99a136bc4e admin admin] The token cache is being invalidate because project 80262b5bd3ee481888bd1815a20858d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:54:52.350113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b88884e6-bb87-456d-bbae-bc99a136bc4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:54:52.350766 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b88884e6-bb87-456d-bbae-bc99a136bc4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:54:52.352340 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4279/8493] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:54:52 2022] DELETE /identity/v3/projects/80262b5bd3ee481888bd1815a20858d6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:54:52.357321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8459d-fc1b-4290-9f09-fe9d87c7642a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:54:52.358371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8459d-fc1b-4290-9f09-fe9d87c7642a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:54:52.358371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8459d-fc1b-4290-9f09-fe9d87c7642a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:54:52.372938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:54:52.406532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3db8459d-fc1b-4290-9f09-fe9d87c7642a None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:54:52.407810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3db8459d-fc1b-4290-9f09-fe9d87c7642a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:54:52.468449 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4215/8494] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:54:52.476618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd089628-a740-498d-a1ce-033949c96753 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:54:52.476916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd089628-a740-498d-a1ce-033949c96753 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:54:52.477199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd089628-a740-498d-a1ce-033949c96753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:54:52.495554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-bd089628-a740-498d-a1ce-033949c96753 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:54:52.496795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bd089628-a740-498d-a1ce-033949c96753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:54:52.504844 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4280/8495] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:54:52.509021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8459d-fc1b-4290-9f09-fe9d87c7642a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:54:52.519541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8459d-fc1b-4290-9f09-fe9d87c7642a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:54:52.524171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31fccc-1399-4719-8597-2208f13defe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:54:52.524824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31fccc-1399-4719-8597-2208f13defe5 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:54:52.525112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31fccc-1399-4719-8597-2208f13defe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:54:52.525393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31fccc-1399-4719-8597-2208f13defe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:54:52.526114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31fccc-1399-4719-8597-2208f13defe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:54:52.526423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31fccc-1399-4719-8597-2208f13defe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:54:52.528133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31fccc-1399-4719-8597-2208f13defe5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:54:52.540174 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4216/8496] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:54:52.544337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd089628-a740-498d-a1ce-033949c96753 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:54:52.553750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd089628-a740-498d-a1ce-033949c96753 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:54:52.558366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979abe6-5d7a-4eca-b387-c9451f173e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:54:52.559028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979abe6-5d7a-4eca-b387-c9451f173e64 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:54:52.559318 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979abe6-5d7a-4eca-b387-c9451f173e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:54:52.559599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979abe6-5d7a-4eca-b387-c9451f173e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:54:52.560289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979abe6-5d7a-4eca-b387-c9451f173e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:54:52.562710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979abe6-5d7a-4eca-b387-c9451f173e64 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:54:52.648771 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4281/8497] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:54:52 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:54:52.652811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31fccc-1399-4719-8597-2208f13defe5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:54:52.663152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31fccc-1399-4719-8597-2208f13defe5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:54:52.720058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca5a4b-b280-48a5-8dc6-baa740a4e13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:54:52.720721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca5a4b-b280-48a5-8dc6-baa740a4e13c admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:54:52.721004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca5a4b-b280-48a5-8dc6-baa740a4e13c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:54:52.721281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca5a4b-b280-48a5-8dc6-baa740a4e13c admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:54:52.721964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca5a4b-b280-48a5-8dc6-baa740a4e13c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:54:52.723926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca5a4b-b280-48a5-8dc6-baa740a4e13c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:54:52.819427 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4217/8498] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:54:52 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:54:52.823449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979abe6-5d7a-4eca-b387-c9451f173e64 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:54:52.834933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979abe6-5d7a-4eca-b387-c9451f173e64 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:54:52.839584 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e35074-073a-49e9-941f-63ef7c53e77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:54:52.840241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e35074-073a-49e9-941f-63ef7c53e77e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:54:52.840576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e35074-073a-49e9-941f-63ef7c53e77e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:54:52.840854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e35074-073a-49e9-941f-63ef7c53e77e admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:54:52.841568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e35074-073a-49e9-941f-63ef7c53e77e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:54:52.843323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e35074-073a-49e9-941f-63ef7c53e77e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:54:52.853586 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4282/8499] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:54:52.857767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca5a4b-b280-48a5-8dc6-baa740a4e13c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:54:52.868155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca5a4b-b280-48a5-8dc6-baa740a4e13c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:54:52.872839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30544657-db15-40a7-9c2d-156560bcfbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:54:52.873991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30544657-db15-40a7-9c2d-156560bcfbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:54:52.874273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30544657-db15-40a7-9c2d-156560bcfbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:54:52.874690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30544657-db15-40a7-9c2d-156560bcfbd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:54:52.875457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30544657-db15-40a7-9c2d-156560bcfbd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:54:52.877069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30544657-db15-40a7-9c2d-156560bcfbd1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:54:52.887703 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4218/8500] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:54:52.892555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e35074-073a-49e9-941f-63ef7c53e77e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:54:52.902791 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e35074-073a-49e9-941f-63ef7c53e77e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:54:52.908012 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebd765-9e81-475b-bc93-8042b2553663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:54:52.912408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebd765-9e81-475b-bc93-8042b2553663 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:54:52.912408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebd765-9e81-475b-bc93-8042b2553663 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:54:52.912408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebd765-9e81-475b-bc93-8042b2553663 admin admin] PATH_INFO: `/v3/projects/c2d9d178c5b3458a8ea08593cd7dce2d/users/7ea34d037bc44786afada1d2a272efa4/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:54:52.925098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebd765-9e81-475b-bc93-8042b2553663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d9d178c5b3458a8ea08593cd7dce2d, user_id=7ea34d037bc44786afada1d2a272efa4, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:54:52.927813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebd765-9e81-475b-bc93-8042b2553663 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:54:52.930162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:54:52.984971 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4283/8501] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:54:52 2022] PUT /identity/v3/projects/c2d9d178c5b3458a8ea08593cd7dce2d/users/7ea34d037bc44786afada1d2a272efa4/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:54:52.995611 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4ef63-58b5-4342-9241-9709c69022d5 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:54:52.995903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4ef63-58b5-4342-9241-9709c69022d5 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:54:52.996188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4ef63-58b5-4342-9241-9709c69022d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:54:53.023745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-edd4ef63-58b5-4342-9241-9709c69022d5 None None] MFA Rules not processed for user `7ea34d037bc44786afada1d2a272efa4`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:54:53.024957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-edd4ef63-58b5-4342-9241-9709c69022d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:54:53.068391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:54:53.088884 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4219/8502] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:54:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:54:53.099875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebd765-9e81-475b-bc93-8042b2553663 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:54:53.101704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9eebd765-9e81-475b-bc93-8042b2553663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:54:53.162153 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebd765-9e81-475b-bc93-8042b2553663 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:54:53.168471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17afc13-cce4-4ac9-b276-1ef0b6dacd70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:54:53.169129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17afc13-cce4-4ac9-b276-1ef0b6dacd70 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:54:53.169417 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17afc13-cce4-4ac9-b276-1ef0b6dacd70 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:54:53.169700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17afc13-cce4-4ac9-b276-1ef0b6dacd70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:54:53.179610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17afc13-cce4-4ac9-b276-1ef0b6dacd70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:54:53.181064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17afc13-cce4-4ac9-b276-1ef0b6dacd70 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:54:53.190940 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4284/8503] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:54:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:55:00.672528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4ef63-58b5-4342-9241-9709c69022d5 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:00.734363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4ef63-58b5-4342-9241-9709c69022d5 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:00.738992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0001de-d899-4d13-8d22-f7067d8e6d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:00.739891 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0001de-d899-4d13-8d22-f7067d8e6d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:00.740174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0001de-d899-4d13-8d22-f7067d8e6d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:00.740455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0001de-d899-4d13-8d22-f7067d8e6d3b admin admin] PATH_INFO: `/v3/users/7ea34d037bc44786afada1d2a272efa4` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:00.741626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0001de-d899-4d13-8d22-f7067d8e6d3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea34d037bc44786afada1d2a272efa4)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:00.743582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0001de-d899-4d13-8d22-f7067d8e6d3b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:00.900569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5f0001de-d899-4d13-8d22-f7067d8e6d3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea34d037bc44786afada1d2a272efa4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:00.913056 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5f0001de-d899-4d13-8d22-f7067d8e6d3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea34d037bc44786afada1d2a272efa4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:00.961452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5f0001de-d899-4d13-8d22-f7067d8e6d3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea34d037bc44786afada1d2a272efa4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:00.969153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5f0001de-d899-4d13-8d22-f7067d8e6d3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea34d037bc44786afada1d2a272efa4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:00.972197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5f0001de-d899-4d13-8d22-f7067d8e6d3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea34d037bc44786afada1d2a272efa4'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:00.976525 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4220/8504] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:55:00 2022] DELETE /identity/v3/users/7ea34d037bc44786afada1d2a272efa4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:00.981231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1706d-83bb-4acb-8bd5-4597d2746a39 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:00.981694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1706d-83bb-4acb-8bd5-4597d2746a39 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:00.981894 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1706d-83bb-4acb-8bd5-4597d2746a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:00.999842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-edf1706d-83bb-4acb-8bd5-4597d2746a39 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:01.001030 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-edf1706d-83bb-4acb-8bd5-4597d2746a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:01.061050 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4285/8505] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:01.070768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0001de-d899-4d13-8d22-f7067d8e6d3b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:01.072200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5f0001de-d899-4d13-8d22-f7067d8e6d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:01.132871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0001de-d899-4d13-8d22-f7067d8e6d3b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:01.136494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c172738-d063-4ad2-b7f9-a8902f079d36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:01.137160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c172738-d063-4ad2-b7f9-a8902f079d36 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:01.137440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c172738-d063-4ad2-b7f9-a8902f079d36 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:01.137715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c172738-d063-4ad2-b7f9-a8902f079d36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:01.146774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c172738-d063-4ad2-b7f9-a8902f079d36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:01.148231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c172738-d063-4ad2-b7f9-a8902f079d36 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:01.157632 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4221/8506] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:55:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:55:01.374727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1706d-83bb-4acb-8bd5-4597d2746a39 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:01.376264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-edf1706d-83bb-4acb-8bd5-4597d2746a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:01.390297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1706d-83bb-4acb-8bd5-4597d2746a39 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:01.395259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ce04b-5bea-4a60-a38d-e706360e9f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:01.396158 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce04b-5bea-4a60-a38d-e706360e9f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:01.396443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce04b-5bea-4a60-a38d-e706360e9f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:01.396748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce04b-5bea-4a60-a38d-e706360e9f99 admin admin] PATH_INFO: `/v3/projects/c2d9d178c5b3458a8ea08593cd7dce2d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:01.397929 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ce04b-5bea-4a60-a38d-e706360e9f99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2d9d178c5b3458a8ea08593cd7dce2d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:01.399914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ce04b-5bea-4a60-a38d-e706360e9f99 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:01.540131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-977ce04b-5bea-4a60-a38d-e706360e9f99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2d9d178c5b3458a8ea08593cd7dce2d', 'request_id': 'req-977ce04b-5bea-4a60-a38d-e706360e9f99'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:01.546551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-977ce04b-5bea-4a60-a38d-e706360e9f99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2d9d178c5b3458a8ea08593cd7dce2d', 'request_id': 'req-977ce04b-5bea-4a60-a38d-e706360e9f99'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:01.553045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-977ce04b-5bea-4a60-a38d-e706360e9f99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2d9d178c5b3458a8ea08593cd7dce2d', 'request_id': 'req-977ce04b-5bea-4a60-a38d-e706360e9f99'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:01.623815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-977ce04b-5bea-4a60-a38d-e706360e9f99 admin admin] The token cache is being invalidate because project c2d9d178c5b3458a8ea08593cd7dce2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:55:01.624107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-977ce04b-5bea-4a60-a38d-e706360e9f99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:01.624744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-977ce04b-5bea-4a60-a38d-e706360e9f99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:01.626464 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4286/8507] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:55:01 2022] DELETE /identity/v3/projects/c2d9d178c5b3458a8ea08593cd7dce2d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:01.631564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dd317-faa6-4e84-a8c8-6a6584480a7c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:01.631856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dd317-faa6-4e84-a8c8-6a6584480a7c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:01.632133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dd317-faa6-4e84-a8c8-6a6584480a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:01.645282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:01.652220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b31dd317-faa6-4e84-a8c8-6a6584480a7c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:01.653495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b31dd317-faa6-4e84-a8c8-6a6584480a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:01.713439 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4222/8508] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:01.722231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62ae2f-9031-40e2-bf10-7644ef673fd4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:01.722667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62ae2f-9031-40e2-bf10-7644ef673fd4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:01.722963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62ae2f-9031-40e2-bf10-7644ef673fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:01.742033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9f62ae2f-9031-40e2-bf10-7644ef673fd4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:01.743341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9f62ae2f-9031-40e2-bf10-7644ef673fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:01.751730 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4287/8509] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:55:01.756178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dd317-faa6-4e84-a8c8-6a6584480a7c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:01.765761 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dd317-faa6-4e84-a8c8-6a6584480a7c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:01.770399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060d822-0f6d-4278-acd9-2c5a53918f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:01.771076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060d822-0f6d-4278-acd9-2c5a53918f5c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:01.771365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060d822-0f6d-4278-acd9-2c5a53918f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:01.771644 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060d822-0f6d-4278-acd9-2c5a53918f5c admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:01.772367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060d822-0f6d-4278-acd9-2c5a53918f5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:55:01.772699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060d822-0f6d-4278-acd9-2c5a53918f5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:01.774297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060d822-0f6d-4278-acd9-2c5a53918f5c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:01.787470 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4223/8510] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:55:01.791838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62ae2f-9031-40e2-bf10-7644ef673fd4 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:01.801980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62ae2f-9031-40e2-bf10-7644ef673fd4 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:01.806693 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03927e-f2e6-4316-9364-21176afe2ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:01.807376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03927e-f2e6-4316-9364-21176afe2ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:01.807664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03927e-f2e6-4316-9364-21176afe2ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:01.807941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03927e-f2e6-4316-9364-21176afe2ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:01.808637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03927e-f2e6-4316-9364-21176afe2ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:01.810537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03927e-f2e6-4316-9364-21176afe2ae7 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:01.820376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:01.913228 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4288/8511] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:55:01 2022] POST /identity/v3/projects => generated 351 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:55:01.917521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060d822-0f6d-4278-acd9-2c5a53918f5c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:01.928586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060d822-0f6d-4278-acd9-2c5a53918f5c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:01.984989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b89dc1-452f-4465-ab96-18733d2dca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:01.985648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b89dc1-452f-4465-ab96-18733d2dca8c admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:01.985929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b89dc1-452f-4465-ab96-18733d2dca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:01.986205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b89dc1-452f-4465-ab96-18733d2dca8c admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:01.986936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b89dc1-452f-4465-ab96-18733d2dca8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:01.990035 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b89dc1-452f-4465-ab96-18733d2dca8c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:02.076434 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4224/8512] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:55:01 2022] POST /identity/v3/users => generated 276 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:55:02.080661 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03927e-f2e6-4316-9364-21176afe2ae7 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:02.091813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03927e-f2e6-4316-9364-21176afe2ae7 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:02.097172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc54660-1a62-4c9a-b23a-34462a68c6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:02.097913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc54660-1a62-4c9a-b23a-34462a68c6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:02.098225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc54660-1a62-4c9a-b23a-34462a68c6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:02.098497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc54660-1a62-4c9a-b23a-34462a68c6f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:02.099242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc54660-1a62-4c9a-b23a-34462a68c6f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:02.100841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc54660-1a62-4c9a-b23a-34462a68c6f2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:02.111231 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4289/8513] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:55:02.115350 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b89dc1-452f-4465-ab96-18733d2dca8c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:02.125438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b89dc1-452f-4465-ab96-18733d2dca8c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:02.130198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89fecd-3e63-4acb-a042-96b945c5c60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:02.130843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89fecd-3e63-4acb-a042-96b945c5c60c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:02.131171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89fecd-3e63-4acb-a042-96b945c5c60c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:02.131452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89fecd-3e63-4acb-a042-96b945c5c60c admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:02.132172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89fecd-3e63-4acb-a042-96b945c5c60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:02.133788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89fecd-3e63-4acb-a042-96b945c5c60c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:02.146123 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4225/8514] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:55:02.150348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc54660-1a62-4c9a-b23a-34462a68c6f2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:02.161315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc54660-1a62-4c9a-b23a-34462a68c6f2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:02.166038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bafca-d218-4dbc-8fd5-90b38f626158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:02.166880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bafca-d218-4dbc-8fd5-90b38f626158 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:02.167194 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bafca-d218-4dbc-8fd5-90b38f626158 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:02.167467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bafca-d218-4dbc-8fd5-90b38f626158 admin admin] PATH_INFO: `/v3/projects/9d448b089b604e7c9714fc480b826cb5/users/438febb1f65c43578011f4bcd08d72ce/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:02.181861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bafca-d218-4dbc-8fd5-90b38f626158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d448b089b604e7c9714fc480b826cb5, user_id=438febb1f65c43578011f4bcd08d72ce, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:02.184552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bafca-d218-4dbc-8fd5-90b38f626158 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:02.254478 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4290/8515] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:55:02 2022] PUT /identity/v3/projects/9d448b089b604e7c9714fc480b826cb5/users/438febb1f65c43578011f4bcd08d72ce/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:02.264771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb31ab-2739-4050-a54c-359262af9239 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:02.265066 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb31ab-2739-4050-a54c-359262af9239 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:02.265343 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb31ab-2739-4050-a54c-359262af9239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:02.291316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-55bb31ab-2739-4050-a54c-359262af9239 None None] MFA Rules not processed for user `438febb1f65c43578011f4bcd08d72ce`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:02.292541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-55bb31ab-2739-4050-a54c-359262af9239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:02.355922 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4226/8516] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:02 2022] POST /identity/v3/auth/tokens => generated 3218 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:02.365913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bafca-d218-4dbc-8fd5-90b38f626158 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:02.367658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-522bafca-d218-4dbc-8fd5-90b38f626158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:02.427674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bafca-d218-4dbc-8fd5-90b38f626158 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:02.431284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170c751-5488-4172-9df3-57dc6645034c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:02.431919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170c751-5488-4172-9df3-57dc6645034c service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:02.437659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170c751-5488-4172-9df3-57dc6645034c service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:02.437659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170c751-5488-4172-9df3-57dc6645034c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:02.441913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170c751-5488-4172-9df3-57dc6645034c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:02.443367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170c751-5488-4172-9df3-57dc6645034c service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:02.452571 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4291/8517] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:55:02 2022] GET /identity/v3/auth/tokens => generated 3218 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:55:04.464872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb31ab-2739-4050-a54c-359262af9239 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:04.469609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:04.529712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb31ab-2739-4050-a54c-359262af9239 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:04.534287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7168c7-d4a6-4d2e-8398-e89e7732474a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:04.536249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7168c7-d4a6-4d2e-8398-e89e7732474a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:04.536535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7168c7-d4a6-4d2e-8398-e89e7732474a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:04.536809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7168c7-d4a6-4d2e-8398-e89e7732474a admin admin] PATH_INFO: `/v3/users/438febb1f65c43578011f4bcd08d72ce` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:04.538161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7168c7-d4a6-4d2e-8398-e89e7732474a admin admin] RBAC: Authorizing `identity:delete_user(user_id=438febb1f65c43578011f4bcd08d72ce)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:04.540138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7168c7-d4a6-4d2e-8398-e89e7732474a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:04.654540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7c7168c7-d4a6-4d2e-8398-e89e7732474a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '438febb1f65c43578011f4bcd08d72ce'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:04.666741 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7c7168c7-d4a6-4d2e-8398-e89e7732474a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '438febb1f65c43578011f4bcd08d72ce'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:04.715762 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7c7168c7-d4a6-4d2e-8398-e89e7732474a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '438febb1f65c43578011f4bcd08d72ce'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:04.723615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7c7168c7-d4a6-4d2e-8398-e89e7732474a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '438febb1f65c43578011f4bcd08d72ce'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:04.724254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7c7168c7-d4a6-4d2e-8398-e89e7732474a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '438febb1f65c43578011f4bcd08d72ce'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:04.730301 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4227/8518] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:55:04 2022] DELETE /identity/v3/users/438febb1f65c43578011f4bcd08d72ce => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:04.734917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277dc11-68d8-46ed-b6e9-b626c17a3c83 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:04.735511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277dc11-68d8-46ed-b6e9-b626c17a3c83 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:04.735511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277dc11-68d8-46ed-b6e9-b626c17a3c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:04.753433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8277dc11-68d8-46ed-b6e9-b626c17a3c83 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:04.754933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8277dc11-68d8-46ed-b6e9-b626c17a3c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:04.814462 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4292/8519] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:04.824501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7168c7-d4a6-4d2e-8398-e89e7732474a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:04.825922 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7c7168c7-d4a6-4d2e-8398-e89e7732474a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:04.886964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7168c7-d4a6-4d2e-8398-e89e7732474a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:04.890949 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bd83c-fcf4-4d91-a292-0309a9aeae8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:04.891627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bd83c-fcf4-4d91-a292-0309a9aeae8e service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:04.891912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bd83c-fcf4-4d91-a292-0309a9aeae8e service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:04.892186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bd83c-fcf4-4d91-a292-0309a9aeae8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:04.902249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bd83c-fcf4-4d91-a292-0309a9aeae8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:04.903720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bd83c-fcf4-4d91-a292-0309a9aeae8e service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:04.914178 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4228/8520] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:55:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:55:05.163910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277dc11-68d8-46ed-b6e9-b626c17a3c83 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:05.165346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8277dc11-68d8-46ed-b6e9-b626c17a3c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:05.178268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277dc11-68d8-46ed-b6e9-b626c17a3c83 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:05.183329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6b33c-e0b8-471d-8ed2-5bc55401916a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:05.184193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6b33c-e0b8-471d-8ed2-5bc55401916a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:05.186853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6b33c-e0b8-471d-8ed2-5bc55401916a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:05.186853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6b33c-e0b8-471d-8ed2-5bc55401916a admin admin] PATH_INFO: `/v3/projects/9d448b089b604e7c9714fc480b826cb5` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:05.186853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6b33c-e0b8-471d-8ed2-5bc55401916a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d448b089b604e7c9714fc480b826cb5)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:05.187978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6b33c-e0b8-471d-8ed2-5bc55401916a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:05.298979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6fb6b33c-e0b8-471d-8ed2-5bc55401916a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d448b089b604e7c9714fc480b826cb5', 'request_id': 'req-6fb6b33c-e0b8-471d-8ed2-5bc55401916a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:05.305340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6fb6b33c-e0b8-471d-8ed2-5bc55401916a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d448b089b604e7c9714fc480b826cb5', 'request_id': 'req-6fb6b33c-e0b8-471d-8ed2-5bc55401916a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:05.306637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:05.311549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6fb6b33c-e0b8-471d-8ed2-5bc55401916a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d448b089b604e7c9714fc480b826cb5', 'request_id': 'req-6fb6b33c-e0b8-471d-8ed2-5bc55401916a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:05.366530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6fb6b33c-e0b8-471d-8ed2-5bc55401916a admin admin] The token cache is being invalidate because project 9d448b089b604e7c9714fc480b826cb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:55:05.366821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6fb6b33c-e0b8-471d-8ed2-5bc55401916a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:05.367500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-6fb6b33c-e0b8-471d-8ed2-5bc55401916a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:05.369088 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4293/8521] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:55:05 2022] DELETE /identity/v3/projects/9d448b089b604e7c9714fc480b826cb5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:05.374141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a792c3b-b96f-4d0b-8565-1a381a70cf5d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:05.374470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a792c3b-b96f-4d0b-8565-1a381a70cf5d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:05.374747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a792c3b-b96f-4d0b-8565-1a381a70cf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:05.392786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6a792c3b-b96f-4d0b-8565-1a381a70cf5d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:05.393986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6a792c3b-b96f-4d0b-8565-1a381a70cf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:05.413515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:05.453941 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4229/8522] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:05.463869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4cb1f-8140-4820-8545-a44f97338b58 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:05.464183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4cb1f-8140-4820-8545-a44f97338b58 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:05.464447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4cb1f-8140-4820-8545-a44f97338b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:05.483244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-dcd4cb1f-8140-4820-8545-a44f97338b58 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:05.484449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-dcd4cb1f-8140-4820-8545-a44f97338b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:05.492692 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4294/8523] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:05.496970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a792c3b-b96f-4d0b-8565-1a381a70cf5d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:05.507547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a792c3b-b96f-4d0b-8565-1a381a70cf5d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:05.512317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d0bad-ce72-48ce-bd63-d5eb35d0fe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:05.512993 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d0bad-ce72-48ce-bd63-d5eb35d0fe96 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:05.513280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d0bad-ce72-48ce-bd63-d5eb35d0fe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:05.513560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d0bad-ce72-48ce-bd63-d5eb35d0fe96 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:05.514308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d0bad-ce72-48ce-bd63-d5eb35d0fe96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:55:05.514621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d0bad-ce72-48ce-bd63-d5eb35d0fe96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:05.516289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d0bad-ce72-48ce-bd63-d5eb35d0fe96 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:05.529621 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4230/8524] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:55:05.534070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4cb1f-8140-4820-8545-a44f97338b58 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:05.543710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4cb1f-8140-4820-8545-a44f97338b58 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:05.548456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b18538-3462-4079-8ffb-a0047afb311e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:05.549166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b18538-3462-4079-8ffb-a0047afb311e admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:05.549396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b18538-3462-4079-8ffb-a0047afb311e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:05.549676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b18538-3462-4079-8ffb-a0047afb311e admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:05.550394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b18538-3462-4079-8ffb-a0047afb311e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:05.552899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b18538-3462-4079-8ffb-a0047afb311e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:05.678739 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4295/8525] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:55:05 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:55:05.683092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d0bad-ce72-48ce-bd63-d5eb35d0fe96 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:05.693768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d0bad-ce72-48ce-bd63-d5eb35d0fe96 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:05.750855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920cc45-cdb1-4372-8995-6fb00408633b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:05.751570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920cc45-cdb1-4372-8995-6fb00408633b admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:05.751858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920cc45-cdb1-4372-8995-6fb00408633b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:05.752136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920cc45-cdb1-4372-8995-6fb00408633b admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:05.752864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920cc45-cdb1-4372-8995-6fb00408633b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:05.755507 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920cc45-cdb1-4372-8995-6fb00408633b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:05.841843 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4231/8526] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:55:05 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:55:05.846166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b18538-3462-4079-8ffb-a0047afb311e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:05.856779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b18538-3462-4079-8ffb-a0047afb311e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:05.861506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d9cf8-f1d7-4c13-ad1d-96325ada99d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:05.862165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d9cf8-f1d7-4c13-ad1d-96325ada99d5 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:05.862447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d9cf8-f1d7-4c13-ad1d-96325ada99d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:05.862725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d9cf8-f1d7-4c13-ad1d-96325ada99d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:05.863993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d9cf8-f1d7-4c13-ad1d-96325ada99d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:05.865599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d9cf8-f1d7-4c13-ad1d-96325ada99d5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:05.877446 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4296/8527] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:55:05.882242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920cc45-cdb1-4372-8995-6fb00408633b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:05.892811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920cc45-cdb1-4372-8995-6fb00408633b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:05.897959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb77919-fa53-4f48-b0df-33c6b3d32f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:05.898616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb77919-fa53-4f48-b0df-33c6b3d32f70 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:05.898903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb77919-fa53-4f48-b0df-33c6b3d32f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:05.899221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb77919-fa53-4f48-b0df-33c6b3d32f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:05.899947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb77919-fa53-4f48-b0df-33c6b3d32f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:05.901545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb77919-fa53-4f48-b0df-33c6b3d32f70 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:05.912602 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4232/8528] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:55:05.916915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d9cf8-f1d7-4c13-ad1d-96325ada99d5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:05.928195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d9cf8-f1d7-4c13-ad1d-96325ada99d5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:05.932789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfada3-32a4-4032-919a-0b3833593107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:05.933678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfada3-32a4-4032-919a-0b3833593107 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:05.933959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfada3-32a4-4032-919a-0b3833593107 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:05.934229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfada3-32a4-4032-919a-0b3833593107 admin admin] PATH_INFO: `/v3/projects/f4cd6d2f67f14e0fa5dcf165eba316b5/users/5a88e6f315a441b893ea06dd9a217f6f/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:05.949572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfada3-32a4-4032-919a-0b3833593107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4cd6d2f67f14e0fa5dcf165eba316b5, user_id=5a88e6f315a441b893ea06dd9a217f6f, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:05.952294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfada3-32a4-4032-919a-0b3833593107 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:06.019029 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4297/8529] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:55:05 2022] PUT /identity/v3/projects/f4cd6d2f67f14e0fa5dcf165eba316b5/users/5a88e6f315a441b893ea06dd9a217f6f/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:55:06.029407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a484732-347f-434d-8e0f-fe4eb60ed95b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:06.029701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a484732-347f-434d-8e0f-fe4eb60ed95b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:06.029981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a484732-347f-434d-8e0f-fe4eb60ed95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:06.057784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7a484732-347f-434d-8e0f-fe4eb60ed95b None None] MFA Rules not processed for user `5a88e6f315a441b893ea06dd9a217f6f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:06.058985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7a484732-347f-434d-8e0f-fe4eb60ed95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:06.122924 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4233/8530] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:06.127362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfada3-32a4-4032-919a-0b3833593107 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:06.190425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfada3-32a4-4032-919a-0b3833593107 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:06.195540 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b3964-e711-4674-9a6a-3b05124e4eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:06.196198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b3964-e711-4674-9a6a-3b05124e4eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:06.196479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b3964-e711-4674-9a6a-3b05124e4eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:06.196755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b3964-e711-4674-9a6a-3b05124e4eb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:06.197440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b3964-e711-4674-9a6a-3b05124e4eb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:06.199410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b3964-e711-4674-9a6a-3b05124e4eb8 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:06.266128 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4298/8531] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:55:06 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:55:06.271023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a484732-347f-434d-8e0f-fe4eb60ed95b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:06.281777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a484732-347f-434d-8e0f-fe4eb60ed95b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:06.298649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:06.337763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549c333-2422-4ccb-8689-2340d949bd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:06.338426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549c333-2422-4ccb-8689-2340d949bd32 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:06.338712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549c333-2422-4ccb-8689-2340d949bd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:06.338991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549c333-2422-4ccb-8689-2340d949bd32 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:06.339696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549c333-2422-4ccb-8689-2340d949bd32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:06.341631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549c333-2422-4ccb-8689-2340d949bd32 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:06.419118 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4234/8532] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:55:06 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:55:06.422303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b3964-e711-4674-9a6a-3b05124e4eb8 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:06.432996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b3964-e711-4674-9a6a-3b05124e4eb8 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:06.437973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cee8cb-e0db-4cf3-9b7a-6289cc5b2b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:06.438637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cee8cb-e0db-4cf3-9b7a-6289cc5b2b90 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:06.438926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cee8cb-e0db-4cf3-9b7a-6289cc5b2b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:06.439257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cee8cb-e0db-4cf3-9b7a-6289cc5b2b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:06.440099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cee8cb-e0db-4cf3-9b7a-6289cc5b2b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:06.441737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cee8cb-e0db-4cf3-9b7a-6289cc5b2b90 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:06.452807 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4299/8533] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:55:06.457472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549c333-2422-4ccb-8689-2340d949bd32 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:06.468661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549c333-2422-4ccb-8689-2340d949bd32 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:06.474205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc43dde-7621-4bd4-bd6e-b7d7d328ca9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:06.475205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc43dde-7621-4bd4-bd6e-b7d7d328ca9e admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:06.475478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc43dde-7621-4bd4-bd6e-b7d7d328ca9e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:06.475787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc43dde-7621-4bd4-bd6e-b7d7d328ca9e admin admin] PATH_INFO: `/v3/projects/750905216f7743d2967040f25dee80f8/users/d1f0b3ee9b4546e7a6e0447296729a7d/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:06.490727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc43dde-7621-4bd4-bd6e-b7d7d328ca9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=750905216f7743d2967040f25dee80f8, user_id=d1f0b3ee9b4546e7a6e0447296729a7d, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:06.493425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc43dde-7621-4bd4-bd6e-b7d7d328ca9e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:06.561048 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4235/8534] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:55:06 2022] PUT /identity/v3/projects/750905216f7743d2967040f25dee80f8/users/d1f0b3ee9b4546e7a6e0447296729a7d/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:55:06.565117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cee8cb-e0db-4cf3-9b7a-6289cc5b2b90 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:06.575433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cee8cb-e0db-4cf3-9b7a-6289cc5b2b90 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:06.622965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:06.631992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b22ce-5897-4514-b1a6-dc7f2abc0d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:06.632658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b22ce-5897-4514-b1a6-dc7f2abc0d47 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:06.632943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b22ce-5897-4514-b1a6-dc7f2abc0d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:06.633220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b22ce-5897-4514-b1a6-dc7f2abc0d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:06.633938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b22ce-5897-4514-b1a6-dc7f2abc0d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:06.635645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b22ce-5897-4514-b1a6-dc7f2abc0d47 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:06.646092 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4300/8535] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:55:06.650061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc43dde-7621-4bd4-bd6e-b7d7d328ca9e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:06.661463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc43dde-7621-4bd4-bd6e-b7d7d328ca9e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:06.666057 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd3ed1-493e-4f0f-b0a3-360b34d8c643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:06.666947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd3ed1-493e-4f0f-b0a3-360b34d8c643 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:06.667269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd3ed1-493e-4f0f-b0a3-360b34d8c643 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:06.667542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd3ed1-493e-4f0f-b0a3-360b34d8c643 admin admin] PATH_INFO: `/v3/projects/750905216f7743d2967040f25dee80f8/users/d1f0b3ee9b4546e7a6e0447296729a7d/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:06.669617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd3ed1-493e-4f0f-b0a3-360b34d8c643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=750905216f7743d2967040f25dee80f8, user_id=d1f0b3ee9b4546e7a6e0447296729a7d, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:06.672226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd3ed1-493e-4f0f-b0a3-360b34d8c643 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:06.682639 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4236/8536] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:55:06 2022] PUT /identity/v3/projects/750905216f7743d2967040f25dee80f8/users/d1f0b3ee9b4546e7a6e0447296729a7d/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:55:06.693829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74f60a-38bb-4489-9974-38e253a27aa7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:06.694127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74f60a-38bb-4489-9974-38e253a27aa7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:06.694642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74f60a-38bb-4489-9974-38e253a27aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:06.722817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2d74f60a-38bb-4489-9974-38e253a27aa7 None None] MFA Rules not processed for user `d1f0b3ee9b4546e7a6e0447296729a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:06.724063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2d74f60a-38bb-4489-9974-38e253a27aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:06.791951 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4301/8537] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:06.804245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd3ed1-493e-4f0f-b0a3-360b34d8c643 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:06.805930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-01dd3ed1-493e-4f0f-b0a3-360b34d8c643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:06.876947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd3ed1-493e-4f0f-b0a3-360b34d8c643 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:06.881459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ec081-2918-4aab-9ca8-c3f8d49bb168 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:06.882098 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ec081-2918-4aab-9ca8-c3f8d49bb168 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:06.882377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ec081-2918-4aab-9ca8-c3f8d49bb168 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:06.882649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ec081-2918-4aab-9ca8-c3f8d49bb168 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:06.891977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ec081-2918-4aab-9ca8-c3f8d49bb168 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:06.893870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ec081-2918-4aab-9ca8-c3f8d49bb168 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:06.904595 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4237/8538] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:55:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:55:07.715812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74f60a-38bb-4489-9974-38e253a27aa7 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:07.779619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74f60a-38bb-4489-9974-38e253a27aa7 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:07.784419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a0d5a-729f-42c4-9e4e-3b476b2feafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:07.785313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a0d5a-729f-42c4-9e4e-3b476b2feafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:07.786246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a0d5a-729f-42c4-9e4e-3b476b2feafc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:07.786561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a0d5a-729f-42c4-9e4e-3b476b2feafc admin admin] PATH_INFO: `/v3/users/5a88e6f315a441b893ea06dd9a217f6f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:07.787901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a0d5a-729f-42c4-9e4e-3b476b2feafc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a88e6f315a441b893ea06dd9a217f6f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:07.789829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a0d5a-729f-42c4-9e4e-3b476b2feafc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:07.924384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5b0a0d5a-729f-42c4-9e4e-3b476b2feafc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a88e6f315a441b893ea06dd9a217f6f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:07.931871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5b0a0d5a-729f-42c4-9e4e-3b476b2feafc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a88e6f315a441b893ea06dd9a217f6f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:07.978622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5b0a0d5a-729f-42c4-9e4e-3b476b2feafc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a88e6f315a441b893ea06dd9a217f6f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:07.979284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5b0a0d5a-729f-42c4-9e4e-3b476b2feafc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a88e6f315a441b893ea06dd9a217f6f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:07.989658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:07.991854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-5b0a0d5a-729f-42c4-9e4e-3b476b2feafc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a88e6f315a441b893ea06dd9a217f6f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:07.997798 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4302/8539] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:55:07 2022] DELETE /identity/v3/users/5a88e6f315a441b893ea06dd9a217f6f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:08.002520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16523bc8-1143-4c53-8b77-8cb1baac8750 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:08.002977 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16523bc8-1143-4c53-8b77-8cb1baac8750 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:08.003297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16523bc8-1143-4c53-8b77-8cb1baac8750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:08.021909 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-16523bc8-1143-4c53-8b77-8cb1baac8750 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:08.023129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-16523bc8-1143-4c53-8b77-8cb1baac8750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:08.081272 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4238/8540] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:08.091209 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed34f7-277a-4d90-ac09-24635c6f8ed9 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:08.091530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed34f7-277a-4d90-ac09-24635c6f8ed9 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:08.091809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed34f7-277a-4d90-ac09-24635c6f8ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:08.138508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8aed34f7-277a-4d90-ac09-24635c6f8ed9 None None] MFA Rules not processed for user `fbd858f3e6ba4523b056bbdc2af427b0`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:08.139644 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8aed34f7-277a-4d90-ac09-24635c6f8ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:08.191105 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4303/8541] 10.222.0.16 () {58 vars in 1062 bytes} [Sat Jul 16 21:55:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:08.197976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16523bc8-1143-4c53-8b77-8cb1baac8750 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:08.208276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16523bc8-1143-4c53-8b77-8cb1baac8750 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:08.211967 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea85791-0705-45f6-9ee3-d7f959aabd40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:08.212608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea85791-0705-45f6-9ee3-d7f959aabd40 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:08.212894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea85791-0705-45f6-9ee3-d7f959aabd40 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:08.213173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea85791-0705-45f6-9ee3-d7f959aabd40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:08.219379 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:08.223002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea85791-0705-45f6-9ee3-d7f959aabd40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:08.224460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea85791-0705-45f6-9ee3-d7f959aabd40 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:08.234064 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4239/8542] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:55:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:55:08.597601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed34f7-277a-4d90-ac09-24635c6f8ed9 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:08.599474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8aed34f7-277a-4d90-ac09-24635c6f8ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:08.615133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed34f7-277a-4d90-ac09-24635c6f8ed9 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:08.619764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2ff70-84c1-4eae-b44c-a8d2ec9e107f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:08.620631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2ff70-84c1-4eae-b44c-a8d2ec9e107f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:08.620916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2ff70-84c1-4eae-b44c-a8d2ec9e107f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:08.621320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2ff70-84c1-4eae-b44c-a8d2ec9e107f admin admin] PATH_INFO: `/v3/projects/f4cd6d2f67f14e0fa5dcf165eba316b5` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:08.622397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2ff70-84c1-4eae-b44c-a8d2ec9e107f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4cd6d2f67f14e0fa5dcf165eba316b5)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:08.624357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2ff70-84c1-4eae-b44c-a8d2ec9e107f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:08.738183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eef2ff70-84c1-4eae-b44c-a8d2ec9e107f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4cd6d2f67f14e0fa5dcf165eba316b5', 'request_id': 'req-eef2ff70-84c1-4eae-b44c-a8d2ec9e107f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:08.745069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eef2ff70-84c1-4eae-b44c-a8d2ec9e107f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4cd6d2f67f14e0fa5dcf165eba316b5', 'request_id': 'req-eef2ff70-84c1-4eae-b44c-a8d2ec9e107f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:08.750601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eef2ff70-84c1-4eae-b44c-a8d2ec9e107f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4cd6d2f67f14e0fa5dcf165eba316b5', 'request_id': 'req-eef2ff70-84c1-4eae-b44c-a8d2ec9e107f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:08.817818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eef2ff70-84c1-4eae-b44c-a8d2ec9e107f admin admin] The token cache is being invalidate because project f4cd6d2f67f14e0fa5dcf165eba316b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:55:08.818116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eef2ff70-84c1-4eae-b44c-a8d2ec9e107f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:08.818775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eef2ff70-84c1-4eae-b44c-a8d2ec9e107f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:08.820642 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4304/8543] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:55:08 2022] DELETE /identity/v3/projects/f4cd6d2f67f14e0fa5dcf165eba316b5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:08.824459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea85791-0705-45f6-9ee3-d7f959aabd40 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:08.834415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea85791-0705-45f6-9ee3-d7f959aabd40 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:08.894289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa7f70-9219-4329-aa57-92732aa35f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:08.895236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa7f70-9219-4329-aa57-92732aa35f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:08.895515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa7f70-9219-4329-aa57-92732aa35f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:08.895795 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa7f70-9219-4329-aa57-92732aa35f0f admin admin] PATH_INFO: `/v3/users/d1f0b3ee9b4546e7a6e0447296729a7d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:08.896980 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa7f70-9219-4329-aa57-92732aa35f0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f0b3ee9b4546e7a6e0447296729a7d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:08.898935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa7f70-9219-4329-aa57-92732aa35f0f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:09.053413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c3aa7f70-9219-4329-aa57-92732aa35f0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f0b3ee9b4546e7a6e0447296729a7d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:09.065652 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c3aa7f70-9219-4329-aa57-92732aa35f0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f0b3ee9b4546e7a6e0447296729a7d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:09.109571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c3aa7f70-9219-4329-aa57-92732aa35f0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f0b3ee9b4546e7a6e0447296729a7d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:09.117327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c3aa7f70-9219-4329-aa57-92732aa35f0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f0b3ee9b4546e7a6e0447296729a7d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:09.117964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c3aa7f70-9219-4329-aa57-92732aa35f0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f0b3ee9b4546e7a6e0447296729a7d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:09.123951 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4240/8544] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:55:08 2022] DELETE /identity/v3/users/d1f0b3ee9b4546e7a6e0447296729a7d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:09.545725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2ff70-84c1-4eae-b44c-a8d2ec9e107f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:09.547203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-eef2ff70-84c1-4eae-b44c-a8d2ec9e107f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:09.562261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2ff70-84c1-4eae-b44c-a8d2ec9e107f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:09.623679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96741665-e804-44ac-9818-01d5f34efef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:09.624545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96741665-e804-44ac-9818-01d5f34efef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:09.624848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96741665-e804-44ac-9818-01d5f34efef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:09.625107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96741665-e804-44ac-9818-01d5f34efef2 admin admin] PATH_INFO: `/v3/projects/750905216f7743d2967040f25dee80f8` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:09.626282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96741665-e804-44ac-9818-01d5f34efef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=750905216f7743d2967040f25dee80f8)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:09.628264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96741665-e804-44ac-9818-01d5f34efef2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:09.634993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:09.733734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-96741665-e804-44ac-9818-01d5f34efef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '750905216f7743d2967040f25dee80f8', 'request_id': 'req-96741665-e804-44ac-9818-01d5f34efef2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:09.740131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-96741665-e804-44ac-9818-01d5f34efef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '750905216f7743d2967040f25dee80f8', 'request_id': 'req-96741665-e804-44ac-9818-01d5f34efef2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:09.745588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-96741665-e804-44ac-9818-01d5f34efef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '750905216f7743d2967040f25dee80f8', 'request_id': 'req-96741665-e804-44ac-9818-01d5f34efef2'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:09.823589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-96741665-e804-44ac-9818-01d5f34efef2 admin admin] The token cache is being invalidate because project 750905216f7743d2967040f25dee80f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:55:09.823881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-96741665-e804-44ac-9818-01d5f34efef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:09.824604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-96741665-e804-44ac-9818-01d5f34efef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:09.826155 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4305/8545] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:55:09 2022] DELETE /identity/v3/projects/750905216f7743d2967040f25dee80f8 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:09.833830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff923f-dfff-406e-909b-5909020313a0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:09.834149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff923f-dfff-406e-909b-5909020313a0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:09.834431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff923f-dfff-406e-909b-5909020313a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:09.852518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d9ff923f-dfff-406e-909b-5909020313a0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:09.853738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d9ff923f-dfff-406e-909b-5909020313a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:09.913300 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4241/8546] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:09.922527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd23f0-c73f-4c84-90a4-14230d4733db None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:09.922821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd23f0-c73f-4c84-90a4-14230d4733db None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:09.923148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd23f0-c73f-4c84-90a4-14230d4733db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:09.942134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-21fd23f0-c73f-4c84-90a4-14230d4733db None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:09.943516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-21fd23f0-c73f-4c84-90a4-14230d4733db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:09.951731 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4306/8547] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:09.956068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff923f-dfff-406e-909b-5909020313a0 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:09.966763 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff923f-dfff-406e-909b-5909020313a0 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:09.971929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec088ea-5112-4ff8-bb10-35863c7dbc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:09.972588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec088ea-5112-4ff8-bb10-35863c7dbc06 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:09.972959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec088ea-5112-4ff8-bb10-35863c7dbc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:09.973259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec088ea-5112-4ff8-bb10-35863c7dbc06 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:09.974079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec088ea-5112-4ff8-bb10-35863c7dbc06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:55:09.974385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec088ea-5112-4ff8-bb10-35863c7dbc06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:09.976033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec088ea-5112-4ff8-bb10-35863c7dbc06 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:09.984832 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:09.988089 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4242/8548] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:55:09.992814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd23f0-c73f-4c84-90a4-14230d4733db None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:10.002363 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd23f0-c73f-4c84-90a4-14230d4733db None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:10.007664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e0e1f-6f1d-43ef-8894-f7edc97d8444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:10.008316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0e1f-6f1d-43ef-8894-f7edc97d8444 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:10.008604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0e1f-6f1d-43ef-8894-f7edc97d8444 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:10.008885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0e1f-6f1d-43ef-8894-f7edc97d8444 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:10.009573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e0e1f-6f1d-43ef-8894-f7edc97d8444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:10.011513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e0e1f-6f1d-43ef-8894-f7edc97d8444 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:10.123711 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4307/8549] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:55:09 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:55:10.127757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec088ea-5112-4ff8-bb10-35863c7dbc06 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:10.138604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec088ea-5112-4ff8-bb10-35863c7dbc06 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:10.196513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad9d64-1cd4-433f-b46a-9c2d0490ad25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:10.197180 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad9d64-1cd4-433f-b46a-9c2d0490ad25 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:10.197471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad9d64-1cd4-433f-b46a-9c2d0490ad25 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:10.197754 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad9d64-1cd4-433f-b46a-9c2d0490ad25 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:10.198483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad9d64-1cd4-433f-b46a-9c2d0490ad25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:10.200474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad9d64-1cd4-433f-b46a-9c2d0490ad25 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:10.276658 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4243/8550] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:55:10 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:55:10.280152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e0e1f-6f1d-43ef-8894-f7edc97d8444 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:10.290768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e0e1f-6f1d-43ef-8894-f7edc97d8444 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:10.296192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce27bc6-8e42-4edf-96fc-3ec1edaf3227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:10.296861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce27bc6-8e42-4edf-96fc-3ec1edaf3227 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:10.297147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce27bc6-8e42-4edf-96fc-3ec1edaf3227 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:10.297427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce27bc6-8e42-4edf-96fc-3ec1edaf3227 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:10.298184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce27bc6-8e42-4edf-96fc-3ec1edaf3227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:10.299988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce27bc6-8e42-4edf-96fc-3ec1edaf3227 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:10.311240 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4308/8551] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:55:10.315250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad9d64-1cd4-433f-b46a-9c2d0490ad25 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:10.325970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad9d64-1cd4-433f-b46a-9c2d0490ad25 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:10.343172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f7d1a-7244-4873-86e4-1837057c4427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:10.343172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f7d1a-7244-4873-86e4-1837057c4427 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:10.343172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f7d1a-7244-4873-86e4-1837057c4427 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:10.343172 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f7d1a-7244-4873-86e4-1837057c4427 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:10.343753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f7d1a-7244-4873-86e4-1837057c4427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:10.343753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f7d1a-7244-4873-86e4-1837057c4427 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:10.344276 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4244/8552] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:55:10.348439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce27bc6-8e42-4edf-96fc-3ec1edaf3227 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:10.358563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce27bc6-8e42-4edf-96fc-3ec1edaf3227 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:10.363243 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50443e-22ed-4c02-b44b-9fd4754a714a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:10.364623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50443e-22ed-4c02-b44b-9fd4754a714a admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:10.364902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50443e-22ed-4c02-b44b-9fd4754a714a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:10.365179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50443e-22ed-4c02-b44b-9fd4754a714a admin admin] PATH_INFO: `/v3/projects/7b9c27e50cc847c19a66003bcc034d2e/users/047e1d0d57b84834a05b6e64330a52e9/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:10.380369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50443e-22ed-4c02-b44b-9fd4754a714a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9c27e50cc847c19a66003bcc034d2e, user_id=047e1d0d57b84834a05b6e64330a52e9, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:10.383045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50443e-22ed-4c02-b44b-9fd4754a714a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:10.441080 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4309/8553] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:55:10 2022] PUT /identity/v3/projects/7b9c27e50cc847c19a66003bcc034d2e/users/047e1d0d57b84834a05b6e64330a52e9/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:10.451877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa91a6-6598-4f53-be27-fcdc839d4b8c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:10.452193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa91a6-6598-4f53-be27-fcdc839d4b8c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:10.452499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa91a6-6598-4f53-be27-fcdc839d4b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:10.479596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b6fa91a6-6598-4f53-be27-fcdc839d4b8c None None] MFA Rules not processed for user `047e1d0d57b84834a05b6e64330a52e9`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:10.480783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b6fa91a6-6598-4f53-be27-fcdc839d4b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:10.544074 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4245/8554] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:10.548562 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50443e-22ed-4c02-b44b-9fd4754a714a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:10.613273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50443e-22ed-4c02-b44b-9fd4754a714a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:10.619418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920f687-0a3f-4dd1-b2eb-459835cf30c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:10.620095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920f687-0a3f-4dd1-b2eb-459835cf30c3 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:10.620376 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920f687-0a3f-4dd1-b2eb-459835cf30c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:10.620654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920f687-0a3f-4dd1-b2eb-459835cf30c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:10.621328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920f687-0a3f-4dd1-b2eb-459835cf30c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:10.623265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920f687-0a3f-4dd1-b2eb-459835cf30c3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:10.684995 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4310/8555] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:55:10 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:55:10.687480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa91a6-6598-4f53-be27-fcdc839d4b8c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:10.698464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa91a6-6598-4f53-be27-fcdc839d4b8c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:10.755065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1407c6-d645-4d90-9bfc-1f1bc84f664f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:10.755767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1407c6-d645-4d90-9bfc-1f1bc84f664f admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:10.756052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1407c6-d645-4d90-9bfc-1f1bc84f664f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:10.756328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1407c6-d645-4d90-9bfc-1f1bc84f664f admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:10.757018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1407c6-d645-4d90-9bfc-1f1bc84f664f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:10.758929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1407c6-d645-4d90-9bfc-1f1bc84f664f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:10.835523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:10.841453 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4246/8556] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:55:10 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:55:10.845709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920f687-0a3f-4dd1-b2eb-459835cf30c3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:10.856891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920f687-0a3f-4dd1-b2eb-459835cf30c3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:10.861527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63574406-3015-417f-9464-611436c05bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:10.862184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63574406-3015-417f-9464-611436c05bbb admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:10.862609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63574406-3015-417f-9464-611436c05bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:10.862877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63574406-3015-417f-9464-611436c05bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:10.863563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63574406-3015-417f-9464-611436c05bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:10.865169 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63574406-3015-417f-9464-611436c05bbb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:10.876393 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4311/8557] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:55:10.880930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1407c6-d645-4d90-9bfc-1f1bc84f664f admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:10.890965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1407c6-d645-4d90-9bfc-1f1bc84f664f admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:10.896955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3576bd-c3bd-4b43-91e5-820921e30721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:10.897826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3576bd-c3bd-4b43-91e5-820921e30721 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:10.898109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3576bd-c3bd-4b43-91e5-820921e30721 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:10.898385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3576bd-c3bd-4b43-91e5-820921e30721 admin admin] PATH_INFO: `/v3/projects/20b08a76472842399df7d380cd1fa920/users/8129351c2df8448fb5d85218ba18827d/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:10.913571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3576bd-c3bd-4b43-91e5-820921e30721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b08a76472842399df7d380cd1fa920, user_id=8129351c2df8448fb5d85218ba18827d, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:10.916267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3576bd-c3bd-4b43-91e5-820921e30721 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:10.984378 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4247/8558] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:55:10 2022] PUT /identity/v3/projects/20b08a76472842399df7d380cd1fa920/users/8129351c2df8448fb5d85218ba18827d/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:10.988547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63574406-3015-417f-9464-611436c05bbb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:10.995033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:10.999057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63574406-3015-417f-9464-611436c05bbb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:11.056561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502b6ee-af34-486d-b86a-9507e7ced02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:11.057228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502b6ee-af34-486d-b86a-9507e7ced02f admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:11.057511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502b6ee-af34-486d-b86a-9507e7ced02f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:11.057788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502b6ee-af34-486d-b86a-9507e7ced02f admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:11.058499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502b6ee-af34-486d-b86a-9507e7ced02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:11.060147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502b6ee-af34-486d-b86a-9507e7ced02f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:11.069914 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4312/8559] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:55:11.074071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3576bd-c3bd-4b43-91e5-820921e30721 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:11.085448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3576bd-c3bd-4b43-91e5-820921e30721 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:11.090058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a085de6-429b-490f-8b3f-bea29581a624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:11.096441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a085de6-429b-490f-8b3f-bea29581a624 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:11.096441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a085de6-429b-490f-8b3f-bea29581a624 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:11.096441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a085de6-429b-490f-8b3f-bea29581a624 admin admin] PATH_INFO: `/v3/projects/20b08a76472842399df7d380cd1fa920/users/8129351c2df8448fb5d85218ba18827d/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:11.096441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a085de6-429b-490f-8b3f-bea29581a624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b08a76472842399df7d380cd1fa920, user_id=8129351c2df8448fb5d85218ba18827d, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:11.096441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a085de6-429b-490f-8b3f-bea29581a624 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:11.107288 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4248/8560] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:55:11 2022] PUT /identity/v3/projects/20b08a76472842399df7d380cd1fa920/users/8129351c2df8448fb5d85218ba18827d/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:11.117654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d727803-3cbd-42e9-8dee-5fde8a6e52ce None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:11.117951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d727803-3cbd-42e9-8dee-5fde8a6e52ce None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:11.118235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d727803-3cbd-42e9-8dee-5fde8a6e52ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:11.144467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0d727803-3cbd-42e9-8dee-5fde8a6e52ce None None] MFA Rules not processed for user `8129351c2df8448fb5d85218ba18827d`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:11.146225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0d727803-3cbd-42e9-8dee-5fde8a6e52ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:11.213590 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4313/8561] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:11.224571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a085de6-429b-490f-8b3f-bea29581a624 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:11.226298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5a085de6-429b-490f-8b3f-bea29581a624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:11.285429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a085de6-429b-490f-8b3f-bea29581a624 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:11.289319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ea9b4-e512-4ba3-9e8e-b27f04d0117e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:11.289976 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ea9b4-e512-4ba3-9e8e-b27f04d0117e service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:11.290267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ea9b4-e512-4ba3-9e8e-b27f04d0117e service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:11.290548 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ea9b4-e512-4ba3-9e8e-b27f04d0117e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:11.299877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ea9b4-e512-4ba3-9e8e-b27f04d0117e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:11.301503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ea9b4-e512-4ba3-9e8e-b27f04d0117e service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:11.311025 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4249/8562] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:55:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:55:11.415385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d727803-3cbd-42e9-8dee-5fde8a6e52ce None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:11.427898 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d727803-3cbd-42e9-8dee-5fde8a6e52ce None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:11.431522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc97e0f-e46b-4fda-bbbf-e1392d84cd0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:11.432292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc97e0f-e46b-4fda-bbbf-e1392d84cd0e service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:11.438118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc97e0f-e46b-4fda-bbbf-e1392d84cd0e service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:11.438118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc97e0f-e46b-4fda-bbbf-e1392d84cd0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:11.491628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc97e0f-e46b-4fda-bbbf-e1392d84cd0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:11.493073 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc97e0f-e46b-4fda-bbbf-e1392d84cd0e service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:11.502144 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4314/8563] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:55:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:55:16.610585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ea9b4-e512-4ba3-9e8e-b27f04d0117e service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:16.673478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ea9b4-e512-4ba3-9e8e-b27f04d0117e service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:16.678013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7d41b-be1d-4bf9-bfda-b7ed5a1edd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:16.678872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7d41b-be1d-4bf9-bfda-b7ed5a1edd2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:16.679190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7d41b-be1d-4bf9-bfda-b7ed5a1edd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:16.679468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7d41b-be1d-4bf9-bfda-b7ed5a1edd2c admin admin] PATH_INFO: `/v3/users/047e1d0d57b84834a05b6e64330a52e9` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:16.680810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7d41b-be1d-4bf9-bfda-b7ed5a1edd2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=047e1d0d57b84834a05b6e64330a52e9)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:16.682716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7d41b-be1d-4bf9-bfda-b7ed5a1edd2c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:16.860707 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7ed7d41b-be1d-4bf9-bfda-b7ed5a1edd2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047e1d0d57b84834a05b6e64330a52e9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:16.872691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7ed7d41b-be1d-4bf9-bfda-b7ed5a1edd2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047e1d0d57b84834a05b6e64330a52e9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:16.874486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:16.960935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7ed7d41b-be1d-4bf9-bfda-b7ed5a1edd2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047e1d0d57b84834a05b6e64330a52e9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:16.968921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7ed7d41b-be1d-4bf9-bfda-b7ed5a1edd2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047e1d0d57b84834a05b6e64330a52e9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:16.969598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-7ed7d41b-be1d-4bf9-bfda-b7ed5a1edd2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047e1d0d57b84834a05b6e64330a52e9'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:16.976149 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4250/8564] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:55:16 2022] DELETE /identity/v3/users/047e1d0d57b84834a05b6e64330a52e9 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:16.981478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa2048-a733-4ffc-a2f8-e4fa5d0a581f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:16.981982 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa2048-a733-4ffc-a2f8-e4fa5d0a581f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:16.982100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa2048-a733-4ffc-a2f8-e4fa5d0a581f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:16.998979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5eaa2048-a733-4ffc-a2f8-e4fa5d0a581f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:17.000206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5eaa2048-a733-4ffc-a2f8-e4fa5d0a581f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:17.019313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=100 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:17.059547 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4315/8565] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:17.069674 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7d41b-be1d-4bf9-bfda-b7ed5a1edd2c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:17.071728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7ed7d41b-be1d-4bf9-bfda-b7ed5a1edd2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:17.130583 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7d41b-be1d-4bf9-bfda-b7ed5a1edd2c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:17.134752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96549d16-75b6-447c-b540-9e160efa120c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:17.135418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96549d16-75b6-447c-b540-9e160efa120c service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:17.135699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96549d16-75b6-447c-b540-9e160efa120c service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:17.135970 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96549d16-75b6-447c-b540-9e160efa120c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:17.144937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96549d16-75b6-447c-b540-9e160efa120c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:17.146351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96549d16-75b6-447c-b540-9e160efa120c service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:17.156420 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4251/8566] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:55:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:55:17.500655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa2048-a733-4ffc-a2f8-e4fa5d0a581f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:17.502244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5eaa2048-a733-4ffc-a2f8-e4fa5d0a581f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:17.516690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa2048-a733-4ffc-a2f8-e4fa5d0a581f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:17.521346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdf1e9-c141-4496-8341-d596db37f34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:17.522288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdf1e9-c141-4496-8341-d596db37f34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:17.522624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdf1e9-c141-4496-8341-d596db37f34c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:17.522905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdf1e9-c141-4496-8341-d596db37f34c admin admin] PATH_INFO: `/v3/projects/7b9c27e50cc847c19a66003bcc034d2e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:17.524524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afdf1e9-c141-4496-8341-d596db37f34c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9c27e50cc847c19a66003bcc034d2e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:17.526456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afdf1e9-c141-4496-8341-d596db37f34c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:17.624696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4afdf1e9-c141-4496-8341-d596db37f34c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9c27e50cc847c19a66003bcc034d2e', 'request_id': 'req-4afdf1e9-c141-4496-8341-d596db37f34c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:17.631116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4afdf1e9-c141-4496-8341-d596db37f34c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9c27e50cc847c19a66003bcc034d2e', 'request_id': 'req-4afdf1e9-c141-4496-8341-d596db37f34c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:17.637459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4afdf1e9-c141-4496-8341-d596db37f34c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9c27e50cc847c19a66003bcc034d2e', 'request_id': 'req-4afdf1e9-c141-4496-8341-d596db37f34c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:17.744191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4afdf1e9-c141-4496-8341-d596db37f34c admin admin] The token cache is being invalidate because project 7b9c27e50cc847c19a66003bcc034d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:55:17.744490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4afdf1e9-c141-4496-8341-d596db37f34c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:17.745112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-4afdf1e9-c141-4496-8341-d596db37f34c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:17.746736 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4316/8567] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:55:17 2022] DELETE /identity/v3/projects/7b9c27e50cc847c19a66003bcc034d2e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:17.750699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96549d16-75b6-447c-b540-9e160efa120c service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:17.761574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96549d16-75b6-447c-b540-9e160efa120c service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:17.825233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0240eaa-16ab-4875-95d8-1989ed8da633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:17.826110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0240eaa-16ab-4875-95d8-1989ed8da633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:17.826394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0240eaa-16ab-4875-95d8-1989ed8da633 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:17.826668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0240eaa-16ab-4875-95d8-1989ed8da633 admin admin] PATH_INFO: `/v3/users/8129351c2df8448fb5d85218ba18827d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:17.827899 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0240eaa-16ab-4875-95d8-1989ed8da633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8129351c2df8448fb5d85218ba18827d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:17.829824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0240eaa-16ab-4875-95d8-1989ed8da633 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:18.026412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a0240eaa-16ab-4875-95d8-1989ed8da633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8129351c2df8448fb5d85218ba18827d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:18.038133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a0240eaa-16ab-4875-95d8-1989ed8da633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8129351c2df8448fb5d85218ba18827d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:18.104176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a0240eaa-16ab-4875-95d8-1989ed8da633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8129351c2df8448fb5d85218ba18827d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:18.112476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a0240eaa-16ab-4875-95d8-1989ed8da633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8129351c2df8448fb5d85218ba18827d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:18.118570 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-a0240eaa-16ab-4875-95d8-1989ed8da633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8129351c2df8448fb5d85218ba18827d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:18.120723 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4252/8568] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:55:17 2022] DELETE /identity/v3/users/8129351c2df8448fb5d85218ba18827d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:18.506027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdf1e9-c141-4496-8341-d596db37f34c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:18.507605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4afdf1e9-c141-4496-8341-d596db37f34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:18.521539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdf1e9-c141-4496-8341-d596db37f34c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:18.583580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af265637-ae24-4cf3-81ac-57a13909dfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:18.584524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af265637-ae24-4cf3-81ac-57a13909dfed admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:18.584806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af265637-ae24-4cf3-81ac-57a13909dfed admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:18.585108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af265637-ae24-4cf3-81ac-57a13909dfed admin admin] PATH_INFO: `/v3/projects/20b08a76472842399df7d380cd1fa920` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:18.586451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af265637-ae24-4cf3-81ac-57a13909dfed admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b08a76472842399df7d380cd1fa920)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:18.588433 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af265637-ae24-4cf3-81ac-57a13909dfed admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:18.676151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-af265637-ae24-4cf3-81ac-57a13909dfed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b08a76472842399df7d380cd1fa920', 'request_id': 'req-af265637-ae24-4cf3-81ac-57a13909dfed'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:18.677286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:18.683645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-af265637-ae24-4cf3-81ac-57a13909dfed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b08a76472842399df7d380cd1fa920', 'request_id': 'req-af265637-ae24-4cf3-81ac-57a13909dfed'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:18.689035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-af265637-ae24-4cf3-81ac-57a13909dfed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b08a76472842399df7d380cd1fa920', 'request_id': 'req-af265637-ae24-4cf3-81ac-57a13909dfed'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:18.737160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-af265637-ae24-4cf3-81ac-57a13909dfed admin admin] The token cache is being invalidate because project 20b08a76472842399df7d380cd1fa920 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:55:18.737443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-af265637-ae24-4cf3-81ac-57a13909dfed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:18.738076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-af265637-ae24-4cf3-81ac-57a13909dfed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:18.739688 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4317/8569] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:55:18 2022] DELETE /identity/v3/projects/20b08a76472842399df7d380cd1fa920 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:18.745295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a16af-c9e0-4df8-ad44-3023a51d649e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:18.745593 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a16af-c9e0-4df8-ad44-3023a51d649e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:18.745879 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a16af-c9e0-4df8-ad44-3023a51d649e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:18.753410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:18.764550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b76a16af-c9e0-4df8-ad44-3023a51d649e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:18.765807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b76a16af-c9e0-4df8-ad44-3023a51d649e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:18.826786 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4253/8570] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:18.834726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c7a5e-44f5-4dcd-91ee-4f811d06c5f7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:18.835041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c7a5e-44f5-4dcd-91ee-4f811d06c5f7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:18.835312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c7a5e-44f5-4dcd-91ee-4f811d06c5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:18.854366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1e8c7a5e-44f5-4dcd-91ee-4f811d06c5f7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:18.855588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1e8c7a5e-44f5-4dcd-91ee-4f811d06c5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:18.863701 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4318/8571] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:55:18.868786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a16af-c9e0-4df8-ad44-3023a51d649e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:18.879106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a16af-c9e0-4df8-ad44-3023a51d649e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:18.883809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040d9bf-127e-4025-a449-89f4b3d507b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:18.884460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040d9bf-127e-4025-a449-89f4b3d507b3 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:18.884742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040d9bf-127e-4025-a449-89f4b3d507b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:18.885020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040d9bf-127e-4025-a449-89f4b3d507b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:18.885742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040d9bf-127e-4025-a449-89f4b3d507b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:55:18.886049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040d9bf-127e-4025-a449-89f4b3d507b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:18.887692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040d9bf-127e-4025-a449-89f4b3d507b3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:18.899565 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4254/8572] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:55:18.904040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c7a5e-44f5-4dcd-91ee-4f811d06c5f7 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:18.913475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c7a5e-44f5-4dcd-91ee-4f811d06c5f7 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:18.919164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b1af2-6eb9-4d74-b24d-3ce1d1b4324c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:18.919807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b1af2-6eb9-4d74-b24d-3ce1d1b4324c admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:18.920087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b1af2-6eb9-4d74-b24d-3ce1d1b4324c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:18.920367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b1af2-6eb9-4d74-b24d-3ce1d1b4324c admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:18.921280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b1af2-6eb9-4d74-b24d-3ce1d1b4324c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:18.923115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b1af2-6eb9-4d74-b24d-3ce1d1b4324c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:19.049388 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4319/8573] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:55:18 2022] POST /identity/v3/projects => generated 389 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:55:19.053718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040d9bf-127e-4025-a449-89f4b3d507b3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:19.063969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040d9bf-127e-4025-a449-89f4b3d507b3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:19.120501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8be101-63e9-4039-93e2-9c59ab4a9bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:19.121084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8be101-63e9-4039-93e2-9c59ab4a9bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:19.121389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8be101-63e9-4039-93e2-9c59ab4a9bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:19.121664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8be101-63e9-4039-93e2-9c59ab4a9bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:19.122342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8be101-63e9-4039-93e2-9c59ab4a9bf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:19.124504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8be101-63e9-4039-93e2-9c59ab4a9bf5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:19.201837 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4255/8574] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:55:19 2022] POST /identity/v3/users => generated 295 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:55:19.206045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b1af2-6eb9-4d74-b24d-3ce1d1b4324c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:19.217855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b1af2-6eb9-4d74-b24d-3ce1d1b4324c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:19.222977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469bf53-4945-4821-83e0-ef8545c567a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:19.223665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469bf53-4945-4821-83e0-ef8545c567a4 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:19.223977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469bf53-4945-4821-83e0-ef8545c567a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:19.224257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469bf53-4945-4821-83e0-ef8545c567a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:19.224981 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469bf53-4945-4821-83e0-ef8545c567a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:19.226591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469bf53-4945-4821-83e0-ef8545c567a4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:19.237910 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4320/8575] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:55:19.241850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8be101-63e9-4039-93e2-9c59ab4a9bf5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:19.251997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8be101-63e9-4039-93e2-9c59ab4a9bf5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:19.256559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2ef66-1ae2-466d-a3a6-7fdbc9f3e8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:19.257198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2ef66-1ae2-466d-a3a6-7fdbc9f3e8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:19.257478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2ef66-1ae2-466d-a3a6-7fdbc9f3e8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:19.257755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2ef66-1ae2-466d-a3a6-7fdbc9f3e8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:19.258627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2ef66-1ae2-466d-a3a6-7fdbc9f3e8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:19.260277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2ef66-1ae2-466d-a3a6-7fdbc9f3e8c1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:19.269948 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4256/8576] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:55:19.274389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469bf53-4945-4821-83e0-ef8545c567a4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:19.284551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469bf53-4945-4821-83e0-ef8545c567a4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:19.289233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b67c79-92b2-417a-b947-1bc005ef6966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:19.290857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b67c79-92b2-417a-b947-1bc005ef6966 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:19.291171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b67c79-92b2-417a-b947-1bc005ef6966 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:19.291452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b67c79-92b2-417a-b947-1bc005ef6966 admin admin] PATH_INFO: `/v3/projects/102d5643ef0e4b62bbd3757bdd7e88fe/users/beef2660896a42f5a16f00b24997300a/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:19.306264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b67c79-92b2-417a-b947-1bc005ef6966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=102d5643ef0e4b62bbd3757bdd7e88fe, user_id=beef2660896a42f5a16f00b24997300a, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:19.308962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b67c79-92b2-417a-b947-1bc005ef6966 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:19.401018 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4321/8577] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:55:19 2022] PUT /identity/v3/projects/102d5643ef0e4b62bbd3757bdd7e88fe/users/beef2660896a42f5a16f00b24997300a/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:55:19.411558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1e732-03fe-4b00-9cb3-80dff24e3e15 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:19.411856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1e732-03fe-4b00-9cb3-80dff24e3e15 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:19.412144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1e732-03fe-4b00-9cb3-80dff24e3e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:19.438669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-fdf1e732-03fe-4b00-9cb3-80dff24e3e15 None None] MFA Rules not processed for user `beef2660896a42f5a16f00b24997300a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:19.439940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fdf1e732-03fe-4b00-9cb3-80dff24e3e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:19.501270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:19.504942 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4257/8578] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:55:19.510257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b67c79-92b2-417a-b947-1bc005ef6966 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:19.573027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b67c79-92b2-417a-b947-1bc005ef6966 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:19.577808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a105c8-45d3-4420-bb7a-4687657b149f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:19.578451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a105c8-45d3-4420-bb7a-4687657b149f admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:19.578738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a105c8-45d3-4420-bb7a-4687657b149f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:19.579039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a105c8-45d3-4420-bb7a-4687657b149f admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:19.579738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a105c8-45d3-4420-bb7a-4687657b149f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:19.581669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a105c8-45d3-4420-bb7a-4687657b149f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:19.665413 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4322/8579] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:55:19 2022] POST /identity/v3/projects => generated 389 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:55:19.669682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1e732-03fe-4b00-9cb3-80dff24e3e15 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:19.681117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1e732-03fe-4b00-9cb3-80dff24e3e15 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:19.736431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea6ca4-48be-428d-b83e-2e68c493f2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:19.737096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea6ca4-48be-428d-b83e-2e68c493f2cb admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:19.737380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea6ca4-48be-428d-b83e-2e68c493f2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:19.737659 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea6ca4-48be-428d-b83e-2e68c493f2cb admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:19.738344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea6ca4-48be-428d-b83e-2e68c493f2cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:19.740280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea6ca4-48be-428d-b83e-2e68c493f2cb admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:19.835855 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4258/8580] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:55:19 2022] POST /identity/v3/users => generated 301 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:55:19.840241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a105c8-45d3-4420-bb7a-4687657b149f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:19.850927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a105c8-45d3-4420-bb7a-4687657b149f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:19.855817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92f5f6-c87c-43e0-b23b-188caa633e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:19.858049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92f5f6-c87c-43e0-b23b-188caa633e67 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:19.858049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92f5f6-c87c-43e0-b23b-188caa633e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:19.858049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92f5f6-c87c-43e0-b23b-188caa633e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:19.858049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92f5f6-c87c-43e0-b23b-188caa633e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:19.859304 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92f5f6-c87c-43e0-b23b-188caa633e67 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:19.870605 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4323/8581] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:55:19.874785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea6ca4-48be-428d-b83e-2e68c493f2cb admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:19.885838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea6ca4-48be-428d-b83e-2e68c493f2cb admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:19.890525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624db55-73fc-47b2-bb67-b229617230ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:19.891464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624db55-73fc-47b2-bb67-b229617230ba admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:19.891748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624db55-73fc-47b2-bb67-b229617230ba admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:19.892032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624db55-73fc-47b2-bb67-b229617230ba admin admin] PATH_INFO: `/v3/projects/83d7bf9a47e041728930300018ce95d2/users/cb2d625eff3d45678ccfd1f950a7b104/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:19.906710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624db55-73fc-47b2-bb67-b229617230ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d7bf9a47e041728930300018ce95d2, user_id=cb2d625eff3d45678ccfd1f950a7b104, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:19.909476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624db55-73fc-47b2-bb67-b229617230ba admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:19.966904 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4259/8582] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:55:19 2022] PUT /identity/v3/projects/83d7bf9a47e041728930300018ce95d2/users/cb2d625eff3d45678ccfd1f950a7b104/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:19.971128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92f5f6-c87c-43e0-b23b-188caa633e67 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:19.981714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92f5f6-c87c-43e0-b23b-188caa633e67 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:20.028521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:20.041315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f8147-5698-4497-8ec8-18279474a844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:20.042010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f8147-5698-4497-8ec8-18279474a844 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:20.042294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f8147-5698-4497-8ec8-18279474a844 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:20.042601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f8147-5698-4497-8ec8-18279474a844 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:20.043351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f8147-5698-4497-8ec8-18279474a844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:20.044996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f8147-5698-4497-8ec8-18279474a844 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:20.054946 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4324/8583] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:55:20.061437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624db55-73fc-47b2-bb67-b229617230ba admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:20.072096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624db55-73fc-47b2-bb67-b229617230ba admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:20.076784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd1627-5395-4166-98e6-d1fc2a0bd3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:20.077662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd1627-5395-4166-98e6-d1fc2a0bd3d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:20.077947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd1627-5395-4166-98e6-d1fc2a0bd3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:20.078221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd1627-5395-4166-98e6-d1fc2a0bd3d2 admin admin] PATH_INFO: `/v3/projects/83d7bf9a47e041728930300018ce95d2/users/cb2d625eff3d45678ccfd1f950a7b104/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:20.080330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd1627-5395-4166-98e6-d1fc2a0bd3d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d7bf9a47e041728930300018ce95d2, user_id=cb2d625eff3d45678ccfd1f950a7b104, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:20.083099 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd1627-5395-4166-98e6-d1fc2a0bd3d2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:20.094732 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4260/8584] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:55:20 2022] PUT /identity/v3/projects/83d7bf9a47e041728930300018ce95d2/users/cb2d625eff3d45678ccfd1f950a7b104/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:55:20.196463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f37b2-8058-44da-9fe5-d41fb72ae222 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:20.196695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f37b2-8058-44da-9fe5-d41fb72ae222 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:20.196964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f37b2-8058-44da-9fe5-d41fb72ae222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:20.225050 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-262f37b2-8058-44da-9fe5-d41fb72ae222 None None] MFA Rules not processed for user `cb2d625eff3d45678ccfd1f950a7b104`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:20.226285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-262f37b2-8058-44da-9fe5-d41fb72ae222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:20.295677 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4325/8585] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:20.306828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd1627-5395-4166-98e6-d1fc2a0bd3d2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:20.308746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-60fd1627-5395-4166-98e6-d1fc2a0bd3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:20.371188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd1627-5395-4166-98e6-d1fc2a0bd3d2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:20.374775 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba5787-de72-4f31-8bb0-ae2e3a711145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:20.375450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba5787-de72-4f31-8bb0-ae2e3a711145 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:20.375738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba5787-de72-4f31-8bb0-ae2e3a711145 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:20.376018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba5787-de72-4f31-8bb0-ae2e3a711145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:20.385577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba5787-de72-4f31-8bb0-ae2e3a711145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:20.390071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba5787-de72-4f31-8bb0-ae2e3a711145 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:20.396785 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4261/8586] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:55:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:55:20.527767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f37b2-8058-44da-9fe5-d41fb72ae222 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:20.590569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f37b2-8058-44da-9fe5-d41fb72ae222 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:20.595426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cbf7f-5258-4f45-87d5-fa05646a65b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:20.596295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cbf7f-5258-4f45-87d5-fa05646a65b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:20.596580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cbf7f-5258-4f45-87d5-fa05646a65b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:20.596858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cbf7f-5258-4f45-87d5-fa05646a65b9 admin admin] PATH_INFO: `/v3/users/beef2660896a42f5a16f00b24997300a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:20.598041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76cbf7f-5258-4f45-87d5-fa05646a65b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beef2660896a42f5a16f00b24997300a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:20.600006 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76cbf7f-5258-4f45-87d5-fa05646a65b9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:20.808030 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c76cbf7f-5258-4f45-87d5-fa05646a65b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beef2660896a42f5a16f00b24997300a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:20.815157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c76cbf7f-5258-4f45-87d5-fa05646a65b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beef2660896a42f5a16f00b24997300a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:20.886828 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c76cbf7f-5258-4f45-87d5-fa05646a65b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beef2660896a42f5a16f00b24997300a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:20.887486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c76cbf7f-5258-4f45-87d5-fa05646a65b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beef2660896a42f5a16f00b24997300a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:20.895170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:20.901776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c76cbf7f-5258-4f45-87d5-fa05646a65b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beef2660896a42f5a16f00b24997300a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:20.907633 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4326/8587] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:55:20 2022] DELETE /identity/v3/users/beef2660896a42f5a16f00b24997300a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:20.912217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03310d-a2c5-48a1-94cd-5f613868e8c2 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:20.912667 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03310d-a2c5-48a1-94cd-5f613868e8c2 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:20.912782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03310d-a2c5-48a1-94cd-5f613868e8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:20.931691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-df03310d-a2c5-48a1-94cd-5f613868e8c2 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:20.932863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-df03310d-a2c5-48a1-94cd-5f613868e8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:20.981498 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:20.992804 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4262/8588] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:21.002472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cbf7f-5258-4f45-87d5-fa05646a65b9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:21.003943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c76cbf7f-5258-4f45-87d5-fa05646a65b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:21.062203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cbf7f-5258-4f45-87d5-fa05646a65b9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:21.066103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09507a-ac75-4c18-9a44-664acac9855b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:21.066742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09507a-ac75-4c18-9a44-664acac9855b service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:21.067046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09507a-ac75-4c18-9a44-664acac9855b service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:21.067338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09507a-ac75-4c18-9a44-664acac9855b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:21.077213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09507a-ac75-4c18-9a44-664acac9855b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:21.078683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09507a-ac75-4c18-9a44-664acac9855b service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:21.088945 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4327/8589] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:55:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:55:21.501116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03310d-a2c5-48a1-94cd-5f613868e8c2 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:21.501533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-df03310d-a2c5-48a1-94cd-5f613868e8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:21.515626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03310d-a2c5-48a1-94cd-5f613868e8c2 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:21.520616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd24590-0252-49d1-8005-75a2aaa5efac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:21.521485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd24590-0252-49d1-8005-75a2aaa5efac admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:21.521771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd24590-0252-49d1-8005-75a2aaa5efac admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:21.522082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd24590-0252-49d1-8005-75a2aaa5efac admin admin] PATH_INFO: `/v3/projects/102d5643ef0e4b62bbd3757bdd7e88fe` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:21.523307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd24590-0252-49d1-8005-75a2aaa5efac admin admin] RBAC: Authorizing `identity:delete_project(project_id=102d5643ef0e4b62bbd3757bdd7e88fe)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:21.525921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd24590-0252-49d1-8005-75a2aaa5efac admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:21.667942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6cd24590-0252-49d1-8005-75a2aaa5efac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '102d5643ef0e4b62bbd3757bdd7e88fe', 'request_id': 'req-6cd24590-0252-49d1-8005-75a2aaa5efac'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:21.673542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6cd24590-0252-49d1-8005-75a2aaa5efac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '102d5643ef0e4b62bbd3757bdd7e88fe', 'request_id': 'req-6cd24590-0252-49d1-8005-75a2aaa5efac'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:21.679858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6cd24590-0252-49d1-8005-75a2aaa5efac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '102d5643ef0e4b62bbd3757bdd7e88fe', 'request_id': 'req-6cd24590-0252-49d1-8005-75a2aaa5efac'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:21.732500 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6cd24590-0252-49d1-8005-75a2aaa5efac admin admin] The token cache is being invalidate because project 102d5643ef0e4b62bbd3757bdd7e88fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:55:21.732790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6cd24590-0252-49d1-8005-75a2aaa5efac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:21.733410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-6cd24590-0252-49d1-8005-75a2aaa5efac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:21.734968 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4263/8590] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:55:21 2022] DELETE /identity/v3/projects/102d5643ef0e4b62bbd3757bdd7e88fe => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:21.739055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09507a-ac75-4c18-9a44-664acac9855b service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:21.749035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09507a-ac75-4c18-9a44-664acac9855b service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:21.805767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a7538-9b81-4d62-a5c2-777b00cfe422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:21.806629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a7538-9b81-4d62-a5c2-777b00cfe422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:21.806911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a7538-9b81-4d62-a5c2-777b00cfe422 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:21.807286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a7538-9b81-4d62-a5c2-777b00cfe422 admin admin] PATH_INFO: `/v3/users/cb2d625eff3d45678ccfd1f950a7b104` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:21.808460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a7538-9b81-4d62-a5c2-777b00cfe422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb2d625eff3d45678ccfd1f950a7b104)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:21.810426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a7538-9b81-4d62-a5c2-777b00cfe422 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:21.957190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-989a7538-9b81-4d62-a5c2-777b00cfe422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb2d625eff3d45678ccfd1f950a7b104'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:21.964409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-989a7538-9b81-4d62-a5c2-777b00cfe422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb2d625eff3d45678ccfd1f950a7b104'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:22.029695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-989a7538-9b81-4d62-a5c2-777b00cfe422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb2d625eff3d45678ccfd1f950a7b104'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:22.030326 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-989a7538-9b81-4d62-a5c2-777b00cfe422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb2d625eff3d45678ccfd1f950a7b104'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:22.043439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-989a7538-9b81-4d62-a5c2-777b00cfe422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb2d625eff3d45678ccfd1f950a7b104'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:22.049438 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4328/8591] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:55:21 2022] DELETE /identity/v3/users/cb2d625eff3d45678ccfd1f950a7b104 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:22.488948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd24590-0252-49d1-8005-75a2aaa5efac admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:22.490438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6cd24590-0252-49d1-8005-75a2aaa5efac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:22.504694 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd24590-0252-49d1-8005-75a2aaa5efac admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:22.561760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7d0ad-1780-4999-8441-7a3bbd4c0acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:22.562623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7d0ad-1780-4999-8441-7a3bbd4c0acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:22.562905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7d0ad-1780-4999-8441-7a3bbd4c0acc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:22.563214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7d0ad-1780-4999-8441-7a3bbd4c0acc admin admin] PATH_INFO: `/v3/projects/83d7bf9a47e041728930300018ce95d2` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:22.564385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7d0ad-1780-4999-8441-7a3bbd4c0acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=83d7bf9a47e041728930300018ce95d2)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:22.566272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7d0ad-1780-4999-8441-7a3bbd4c0acc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:22.670720 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dfc7d0ad-1780-4999-8441-7a3bbd4c0acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83d7bf9a47e041728930300018ce95d2', 'request_id': 'req-dfc7d0ad-1780-4999-8441-7a3bbd4c0acc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:22.676276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dfc7d0ad-1780-4999-8441-7a3bbd4c0acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83d7bf9a47e041728930300018ce95d2', 'request_id': 'req-dfc7d0ad-1780-4999-8441-7a3bbd4c0acc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:22.682566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dfc7d0ad-1780-4999-8441-7a3bbd4c0acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83d7bf9a47e041728930300018ce95d2', 'request_id': 'req-dfc7d0ad-1780-4999-8441-7a3bbd4c0acc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:22.811806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dfc7d0ad-1780-4999-8441-7a3bbd4c0acc admin admin] The token cache is being invalidate because project 83d7bf9a47e041728930300018ce95d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:55:22.812093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dfc7d0ad-1780-4999-8441-7a3bbd4c0acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:22.812812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dfc7d0ad-1780-4999-8441-7a3bbd4c0acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:22.814371 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4264/8592] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:55:22 2022] DELETE /identity/v3/projects/83d7bf9a47e041728930300018ce95d2 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:22.819495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e48302-1b80-4ca8-865d-4f88a7e1d310 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:22.819995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e48302-1b80-4ca8-865d-4f88a7e1d310 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:22.820094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e48302-1b80-4ca8-865d-4f88a7e1d310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:22.839136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-00e48302-1b80-4ca8-865d-4f88a7e1d310 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:22.844677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-00e48302-1b80-4ca8-865d-4f88a7e1d310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:22.846220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:22.899923 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4329/8593] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:22.908408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7072a3-6c8f-4fab-bc85-bee41837eb58 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:22.908702 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7072a3-6c8f-4fab-bc85-bee41837eb58 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:22.908982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7072a3-6c8f-4fab-bc85-bee41837eb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:22.928276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ff7072a3-6c8f-4fab-bc85-bee41837eb58 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:22.929562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ff7072a3-6c8f-4fab-bc85-bee41837eb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:22.938054 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4265/8594] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:22.943391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e48302-1b80-4ca8-865d-4f88a7e1d310 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:22.952705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e48302-1b80-4ca8-865d-4f88a7e1d310 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:22.957346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcbb8e-a88e-47f9-97ac-b1418d0c65cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:22.957991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcbb8e-a88e-47f9-97ac-b1418d0c65cc admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:22.958301 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcbb8e-a88e-47f9-97ac-b1418d0c65cc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:22.958573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcbb8e-a88e-47f9-97ac-b1418d0c65cc admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:22.959322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fcbb8e-a88e-47f9-97ac-b1418d0c65cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:55:22.959685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fcbb8e-a88e-47f9-97ac-b1418d0c65cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:22.961312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fcbb8e-a88e-47f9-97ac-b1418d0c65cc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:22.973558 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4330/8595] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:55:22.978076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7072a3-6c8f-4fab-bc85-bee41837eb58 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:22.983685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:22.988928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7072a3-6c8f-4fab-bc85-bee41837eb58 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:22.994804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf109d1-8fab-490a-bb00-521942db52da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:22.995506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf109d1-8fab-490a-bb00-521942db52da admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:22.995786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf109d1-8fab-490a-bb00-521942db52da admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:22.996062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf109d1-8fab-490a-bb00-521942db52da admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:22.996756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf109d1-8fab-490a-bb00-521942db52da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:22.998680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf109d1-8fab-490a-bb00-521942db52da admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:23.111498 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4266/8596] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:55:22 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:55:23.115768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcbb8e-a88e-47f9-97ac-b1418d0c65cc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:23.125816 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcbb8e-a88e-47f9-97ac-b1418d0c65cc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:23.182090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bd520-02e7-45bc-9f41-bcc436b80ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:23.182779 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bd520-02e7-45bc-9f41-bcc436b80ede admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:23.183170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bd520-02e7-45bc-9f41-bcc436b80ede admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:23.183452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bd520-02e7-45bc-9f41-bcc436b80ede admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:23.184129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691bd520-02e7-45bc-9f41-bcc436b80ede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:23.186049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691bd520-02e7-45bc-9f41-bcc436b80ede admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:23.275244 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4331/8597] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:55:23 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:55:23.283811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf109d1-8fab-490a-bb00-521942db52da admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:23.294699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf109d1-8fab-490a-bb00-521942db52da admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:23.299377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c92db-93c4-4921-9e11-aabe84faaa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:23.300025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c92db-93c4-4921-9e11-aabe84faaa6b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:23.300303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c92db-93c4-4921-9e11-aabe84faaa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:23.300575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c92db-93c4-4921-9e11-aabe84faaa6b admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:23.301284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c92db-93c4-4921-9e11-aabe84faaa6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:23.302851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c92db-93c4-4921-9e11-aabe84faaa6b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:23.313316 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4267/8598] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:55:23.317121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bd520-02e7-45bc-9f41-bcc436b80ede admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:23.327708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bd520-02e7-45bc-9f41-bcc436b80ede admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:23.332309 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256ed72-d807-4daa-b3f1-041a04560aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:23.332958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256ed72-d807-4daa-b3f1-041a04560aca admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:23.333244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256ed72-d807-4daa-b3f1-041a04560aca admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:23.333523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256ed72-d807-4daa-b3f1-041a04560aca admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:23.334244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256ed72-d807-4daa-b3f1-041a04560aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:23.335874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256ed72-d807-4daa-b3f1-041a04560aca admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:23.346562 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4332/8599] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:55:23.350675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c92db-93c4-4921-9e11-aabe84faaa6b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:23.360848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c92db-93c4-4921-9e11-aabe84faaa6b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:23.365462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e2108-b9a2-4347-b18e-912ac5097936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:23.366275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e2108-b9a2-4347-b18e-912ac5097936 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:23.366562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e2108-b9a2-4347-b18e-912ac5097936 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:23.366839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e2108-b9a2-4347-b18e-912ac5097936 admin admin] PATH_INFO: `/v3/projects/1e97b8311758477b8b861366535cb6e3/users/a0ff1b55e7774316a47e4d669e98e480/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:23.381682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e2108-b9a2-4347-b18e-912ac5097936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e97b8311758477b8b861366535cb6e3, user_id=a0ff1b55e7774316a47e4d669e98e480, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:23.384367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e2108-b9a2-4347-b18e-912ac5097936 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:23.453205 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4268/8600] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:55:23 2022] PUT /identity/v3/projects/1e97b8311758477b8b861366535cb6e3/users/a0ff1b55e7774316a47e4d669e98e480/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:23.467051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34554813-0454-4972-b142-4b6b9aa1da4e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:23.467347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34554813-0454-4972-b142-4b6b9aa1da4e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:23.467628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34554813-0454-4972-b142-4b6b9aa1da4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:23.494313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-34554813-0454-4972-b142-4b6b9aa1da4e None None] MFA Rules not processed for user `a0ff1b55e7774316a47e4d669e98e480`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:23.496043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-34554813-0454-4972-b142-4b6b9aa1da4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:23.560355 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4333/8601] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:23.565262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e2108-b9a2-4347-b18e-912ac5097936 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:23.626580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e2108-b9a2-4347-b18e-912ac5097936 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:23.631198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b4def-aebc-42b0-b27f-ac521245d00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:23.631853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b4def-aebc-42b0-b27f-ac521245d00e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:23.632137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b4def-aebc-42b0-b27f-ac521245d00e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:23.632418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b4def-aebc-42b0-b27f-ac521245d00e admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:23.633106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b4def-aebc-42b0-b27f-ac521245d00e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:23.635039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b4def-aebc-42b0-b27f-ac521245d00e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:23.723128 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4269/8602] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:55:23 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:55:23.727297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34554813-0454-4972-b142-4b6b9aa1da4e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:23.738797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34554813-0454-4972-b142-4b6b9aa1da4e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:23.742408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:23.795335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74cdb3-8a5b-46a5-b55e-2da285050ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:23.796005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74cdb3-8a5b-46a5-b55e-2da285050ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:23.796464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74cdb3-8a5b-46a5-b55e-2da285050ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:23.797122 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74cdb3-8a5b-46a5-b55e-2da285050ff4 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:23.797835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74cdb3-8a5b-46a5-b55e-2da285050ff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:23.799804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74cdb3-8a5b-46a5-b55e-2da285050ff4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:23.893945 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4334/8603] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:55:23 2022] POST /identity/v3/users => generated 295 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:55:23.897987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b4def-aebc-42b0-b27f-ac521245d00e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:23.909543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b4def-aebc-42b0-b27f-ac521245d00e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:23.914262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e777c8-ee62-42f4-8464-05e003e45090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:23.914918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e777c8-ee62-42f4-8464-05e003e45090 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:23.915238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e777c8-ee62-42f4-8464-05e003e45090 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:23.915519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e777c8-ee62-42f4-8464-05e003e45090 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:23.916243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e777c8-ee62-42f4-8464-05e003e45090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:23.917974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e777c8-ee62-42f4-8464-05e003e45090 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:23.928596 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4270/8604] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:55:23.933276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74cdb3-8a5b-46a5-b55e-2da285050ff4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:23.943481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74cdb3-8a5b-46a5-b55e-2da285050ff4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:23.949027 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0a415-e5f5-4d12-966a-ce18fa899a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:23.949884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0a415-e5f5-4d12-966a-ce18fa899a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:23.950162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0a415-e5f5-4d12-966a-ce18fa899a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:23.950434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0a415-e5f5-4d12-966a-ce18fa899a6e admin admin] PATH_INFO: `/v3/projects/4cfb1673fa5647acb201220a86daab2e/users/7cac5741266444efb208a4db1a22ffe8/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:23.966685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0a415-e5f5-4d12-966a-ce18fa899a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cfb1673fa5647acb201220a86daab2e, user_id=7cac5741266444efb208a4db1a22ffe8, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:23.969722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0a415-e5f5-4d12-966a-ce18fa899a6e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:24.058883 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4335/8605] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:55:23 2022] PUT /identity/v3/projects/4cfb1673fa5647acb201220a86daab2e/users/7cac5741266444efb208a4db1a22ffe8/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:55:24.062948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e777c8-ee62-42f4-8464-05e003e45090 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:24.073676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e777c8-ee62-42f4-8464-05e003e45090 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:24.129999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758d6f9-a4ab-4b46-9e77-ae9a3bd6dce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:24.130687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758d6f9-a4ab-4b46-9e77-ae9a3bd6dce1 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:24.130969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758d6f9-a4ab-4b46-9e77-ae9a3bd6dce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:24.131278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758d6f9-a4ab-4b46-9e77-ae9a3bd6dce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:24.132118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758d6f9-a4ab-4b46-9e77-ae9a3bd6dce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:24.133700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758d6f9-a4ab-4b46-9e77-ae9a3bd6dce1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:24.144732 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4271/8606] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:55:24.149071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0a415-e5f5-4d12-966a-ce18fa899a6e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:24.159639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0a415-e5f5-4d12-966a-ce18fa899a6e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:24.173983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79771369-656d-44b8-9ec7-905a4da8b3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:24.173983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79771369-656d-44b8-9ec7-905a4da8b3ac admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:24.173983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79771369-656d-44b8-9ec7-905a4da8b3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:24.173983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79771369-656d-44b8-9ec7-905a4da8b3ac admin admin] PATH_INFO: `/v3/projects/4cfb1673fa5647acb201220a86daab2e/users/7cac5741266444efb208a4db1a22ffe8/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:24.174405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79771369-656d-44b8-9ec7-905a4da8b3ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cfb1673fa5647acb201220a86daab2e, user_id=7cac5741266444efb208a4db1a22ffe8, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:24.174405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79771369-656d-44b8-9ec7-905a4da8b3ac admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:24.181253 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4336/8607] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:55:24 2022] PUT /identity/v3/projects/4cfb1673fa5647acb201220a86daab2e/users/7cac5741266444efb208a4db1a22ffe8/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:55:24.193368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a011ac-6289-43bf-bb9a-e3b3f34f1c35 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:24.193657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a011ac-6289-43bf-bb9a-e3b3f34f1c35 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:24.193935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a011ac-6289-43bf-bb9a-e3b3f34f1c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:24.222560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d5a011ac-6289-43bf-bb9a-e3b3f34f1c35 None None] MFA Rules not processed for user `7cac5741266444efb208a4db1a22ffe8`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:24.223809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d5a011ac-6289-43bf-bb9a-e3b3f34f1c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:24.227685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:24.292010 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4272/8608] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:24.303380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79771369-656d-44b8-9ec7-905a4da8b3ac admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:24.305065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-79771369-656d-44b8-9ec7-905a4da8b3ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:24.367610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79771369-656d-44b8-9ec7-905a4da8b3ac admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:24.371405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54ed27-5bd3-4161-85f0-8914c8dc8d8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:24.372045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54ed27-5bd3-4161-85f0-8914c8dc8d8c service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:24.372329 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54ed27-5bd3-4161-85f0-8914c8dc8d8c service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:24.372609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54ed27-5bd3-4161-85f0-8914c8dc8d8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:24.381775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54ed27-5bd3-4161-85f0-8914c8dc8d8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:24.383249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54ed27-5bd3-4161-85f0-8914c8dc8d8c service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:24.392809 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4337/8609] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:55:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:55:24.879321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a011ac-6289-43bf-bb9a-e3b3f34f1c35 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:24.941187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a011ac-6289-43bf-bb9a-e3b3f34f1c35 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:24.946273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5181e-aa4a-4e7e-bfbe-f507cf3362ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:24.947187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5181e-aa4a-4e7e-bfbe-f507cf3362ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:24.947475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5181e-aa4a-4e7e-bfbe-f507cf3362ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:24.947889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5181e-aa4a-4e7e-bfbe-f507cf3362ec admin admin] PATH_INFO: `/v3/users/a0ff1b55e7774316a47e4d669e98e480` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:24.949185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5181e-aa4a-4e7e-bfbe-f507cf3362ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ff1b55e7774316a47e4d669e98e480)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:24.951151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5181e-aa4a-4e7e-bfbe-f507cf3362ec admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:25.089166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-34d5181e-aa4a-4e7e-bfbe-f507cf3362ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ff1b55e7774316a47e4d669e98e480'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:25.101585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-34d5181e-aa4a-4e7e-bfbe-f507cf3362ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ff1b55e7774316a47e4d669e98e480'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:25.149501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-34d5181e-aa4a-4e7e-bfbe-f507cf3362ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ff1b55e7774316a47e4d669e98e480'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:25.157718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-34d5181e-aa4a-4e7e-bfbe-f507cf3362ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ff1b55e7774316a47e4d669e98e480'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:25.158382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-34d5181e-aa4a-4e7e-bfbe-f507cf3362ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ff1b55e7774316a47e4d669e98e480'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:25.164315 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4273/8610] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:55:24 2022] DELETE /identity/v3/users/a0ff1b55e7774316a47e4d669e98e480 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:25.170178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bab5f2-266c-498d-9e0f-27b3c7fb18f2 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:25.170667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bab5f2-266c-498d-9e0f-27b3c7fb18f2 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:25.170814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bab5f2-266c-498d-9e0f-27b3c7fb18f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:25.187846 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-c9bab5f2-266c-498d-9e0f-27b3c7fb18f2 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:25.196053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c9bab5f2-266c-498d-9e0f-27b3c7fb18f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:25.249167 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4338/8611] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:25.259259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5181e-aa4a-4e7e-bfbe-f507cf3362ec admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:25.261750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-34d5181e-aa4a-4e7e-bfbe-f507cf3362ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:25.285400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:25.321013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5181e-aa4a-4e7e-bfbe-f507cf3362ec admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:25.325760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ef01b-b8fc-4983-a802-da5cc35ec601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:25.326407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ef01b-b8fc-4983-a802-da5cc35ec601 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:25.326686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ef01b-b8fc-4983-a802-da5cc35ec601 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:25.326957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ef01b-b8fc-4983-a802-da5cc35ec601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:25.336117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ef01b-b8fc-4983-a802-da5cc35ec601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:25.337576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ef01b-b8fc-4983-a802-da5cc35ec601 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:25.348783 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4274/8612] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:55:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:55:25.780863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bab5f2-266c-498d-9e0f-27b3c7fb18f2 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:25.782372 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c9bab5f2-266c-498d-9e0f-27b3c7fb18f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:25.790185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:25.796366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bab5f2-266c-498d-9e0f-27b3c7fb18f2 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:25.801094 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be9a1b-c480-452f-afff-baed6a18f5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:25.801958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be9a1b-c480-452f-afff-baed6a18f5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:25.802244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be9a1b-c480-452f-afff-baed6a18f5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:25.802521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be9a1b-c480-452f-afff-baed6a18f5ee admin admin] PATH_INFO: `/v3/projects/1e97b8311758477b8b861366535cb6e3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:25.803731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be9a1b-c480-452f-afff-baed6a18f5ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e97b8311758477b8b861366535cb6e3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:25.805768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be9a1b-c480-452f-afff-baed6a18f5ee admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:25.899386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e1be9a1b-c480-452f-afff-baed6a18f5ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e97b8311758477b8b861366535cb6e3', 'request_id': 'req-e1be9a1b-c480-452f-afff-baed6a18f5ee'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:25.906193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e1be9a1b-c480-452f-afff-baed6a18f5ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e97b8311758477b8b861366535cb6e3', 'request_id': 'req-e1be9a1b-c480-452f-afff-baed6a18f5ee'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:25.911994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e1be9a1b-c480-452f-afff-baed6a18f5ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e97b8311758477b8b861366535cb6e3', 'request_id': 'req-e1be9a1b-c480-452f-afff-baed6a18f5ee'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:25.972091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e1be9a1b-c480-452f-afff-baed6a18f5ee admin admin] The token cache is being invalidate because project 1e97b8311758477b8b861366535cb6e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:55:25.972384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e1be9a1b-c480-452f-afff-baed6a18f5ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:25.973007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e1be9a1b-c480-452f-afff-baed6a18f5ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:25.974561 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4339/8613] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:55:25 2022] DELETE /identity/v3/projects/1e97b8311758477b8b861366535cb6e3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:25.978640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ef01b-b8fc-4983-a802-da5cc35ec601 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:25.989920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ef01b-b8fc-4983-a802-da5cc35ec601 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:26.047797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed375b9c-de2f-4cc4-8ac6-735318662561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:26.048635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed375b9c-de2f-4cc4-8ac6-735318662561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:26.048920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed375b9c-de2f-4cc4-8ac6-735318662561 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:26.049197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed375b9c-de2f-4cc4-8ac6-735318662561 admin admin] PATH_INFO: `/v3/users/7cac5741266444efb208a4db1a22ffe8` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:26.050395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed375b9c-de2f-4cc4-8ac6-735318662561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cac5741266444efb208a4db1a22ffe8)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:26.052430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed375b9c-de2f-4cc4-8ac6-735318662561 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:26.185255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ed375b9c-de2f-4cc4-8ac6-735318662561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cac5741266444efb208a4db1a22ffe8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:26.196866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ed375b9c-de2f-4cc4-8ac6-735318662561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cac5741266444efb208a4db1a22ffe8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:26.235203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ed375b9c-de2f-4cc4-8ac6-735318662561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cac5741266444efb208a4db1a22ffe8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:26.242228 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ed375b9c-de2f-4cc4-8ac6-735318662561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cac5741266444efb208a4db1a22ffe8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:26.242854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ed375b9c-de2f-4cc4-8ac6-735318662561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cac5741266444efb208a4db1a22ffe8'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:26.249166 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4275/8614] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:55:25 2022] DELETE /identity/v3/users/7cac5741266444efb208a4db1a22ffe8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:55:26.637485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be9a1b-c480-452f-afff-baed6a18f5ee admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:26.638935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e1be9a1b-c480-452f-afff-baed6a18f5ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:26.653098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be9a1b-c480-452f-afff-baed6a18f5ee admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:26.711931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb8c4e-40b7-4b69-9f8a-261d066bfcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:26.712798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb8c4e-40b7-4b69-9f8a-261d066bfcda admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:26.713098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb8c4e-40b7-4b69-9f8a-261d066bfcda admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:26.713549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb8c4e-40b7-4b69-9f8a-261d066bfcda admin admin] PATH_INFO: `/v3/projects/4cfb1673fa5647acb201220a86daab2e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:26.715503 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb8c4e-40b7-4b69-9f8a-261d066bfcda admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cfb1673fa5647acb201220a86daab2e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:26.718271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb8c4e-40b7-4b69-9f8a-261d066bfcda admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:26.818942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f8eb8c4e-40b7-4b69-9f8a-261d066bfcda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cfb1673fa5647acb201220a86daab2e', 'request_id': 'req-f8eb8c4e-40b7-4b69-9f8a-261d066bfcda'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:26.827823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f8eb8c4e-40b7-4b69-9f8a-261d066bfcda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cfb1673fa5647acb201220a86daab2e', 'request_id': 'req-f8eb8c4e-40b7-4b69-9f8a-261d066bfcda'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:26.833375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f8eb8c4e-40b7-4b69-9f8a-261d066bfcda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cfb1673fa5647acb201220a86daab2e', 'request_id': 'req-f8eb8c4e-40b7-4b69-9f8a-261d066bfcda'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:26.883956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f8eb8c4e-40b7-4b69-9f8a-261d066bfcda admin admin] The token cache is being invalidate because project 4cfb1673fa5647acb201220a86daab2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:55:26.883956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f8eb8c4e-40b7-4b69-9f8a-261d066bfcda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:26.883956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f8eb8c4e-40b7-4b69-9f8a-261d066bfcda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:55:26.883956 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4340/8615] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:55:26 2022] DELETE /identity/v3/projects/4cfb1673fa5647acb201220a86daab2e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:26.888260 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91091f8-099b-4f1b-9087-3286f0d3764c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:26.888556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91091f8-099b-4f1b-9087-3286f0d3764c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:26.888840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91091f8-099b-4f1b-9087-3286f0d3764c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:26.907331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e91091f8-099b-4f1b-9087-3286f0d3764c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:26.908564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e91091f8-099b-4f1b-9087-3286f0d3764c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:26.946198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:26.968774 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4276/8616] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:26.976652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc9778-12df-4e5d-88dd-7f04c0bf1284 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:26.976938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc9778-12df-4e5d-88dd-7f04c0bf1284 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:26.977214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc9778-12df-4e5d-88dd-7f04c0bf1284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:26.996974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4ecc9778-12df-4e5d-88dd-7f04c0bf1284 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:26.998633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4ecc9778-12df-4e5d-88dd-7f04c0bf1284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:27.006145 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4341/8617] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:27.010969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91091f8-099b-4f1b-9087-3286f0d3764c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:27.021247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91091f8-099b-4f1b-9087-3286f0d3764c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:27.026591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd19182-f5f1-4142-9e34-90f14287c21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:27.027315 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd19182-f5f1-4142-9e34-90f14287c21a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:27.027690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd19182-f5f1-4142-9e34-90f14287c21a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:27.027973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd19182-f5f1-4142-9e34-90f14287c21a admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:27.028708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd19182-f5f1-4142-9e34-90f14287c21a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:55:27.029016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd19182-f5f1-4142-9e34-90f14287c21a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:27.030645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd19182-f5f1-4142-9e34-90f14287c21a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:27.042481 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4277/8618] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:55:27.046909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc9778-12df-4e5d-88dd-7f04c0bf1284 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:27.056198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc9778-12df-4e5d-88dd-7f04c0bf1284 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:27.061177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55103648-8475-40c3-bc05-3a724b2e6eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:27.061822 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55103648-8475-40c3-bc05-3a724b2e6eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:27.062106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55103648-8475-40c3-bc05-3a724b2e6eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:27.062377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55103648-8475-40c3-bc05-3a724b2e6eb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:27.063076 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55103648-8475-40c3-bc05-3a724b2e6eb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:27.064994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55103648-8475-40c3-bc05-3a724b2e6eb0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:27.068988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:27.156624 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4342/8619] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:55:27 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:55:27.160855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd19182-f5f1-4142-9e34-90f14287c21a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:27.171175 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd19182-f5f1-4142-9e34-90f14287c21a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:27.229341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7fa40-edca-405c-b0eb-98b79f981d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:27.230004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7fa40-edca-405c-b0eb-98b79f981d69 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:27.230425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7fa40-edca-405c-b0eb-98b79f981d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:27.230716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7fa40-edca-405c-b0eb-98b79f981d69 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:27.231436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7fa40-edca-405c-b0eb-98b79f981d69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:27.233356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7fa40-edca-405c-b0eb-98b79f981d69 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:27.337904 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4278/8620] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:55:27 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:55:27.342197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55103648-8475-40c3-bc05-3a724b2e6eb0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:27.353056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55103648-8475-40c3-bc05-3a724b2e6eb0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:27.358285 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc93b77-d2a7-4471-988c-a74fff30ab6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:27.358935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc93b77-d2a7-4471-988c-a74fff30ab6e admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:27.359288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc93b77-d2a7-4471-988c-a74fff30ab6e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:27.359564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc93b77-d2a7-4471-988c-a74fff30ab6e admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:27.360282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc93b77-d2a7-4471-988c-a74fff30ab6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:27.361862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc93b77-d2a7-4471-988c-a74fff30ab6e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:27.371558 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4343/8621] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:55:27.376003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7fa40-edca-405c-b0eb-98b79f981d69 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:27.385966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7fa40-edca-405c-b0eb-98b79f981d69 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:27.391281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be55f4-c46a-4a5b-a26a-0f0321c98452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:27.391923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be55f4-c46a-4a5b-a26a-0f0321c98452 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:27.392205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be55f4-c46a-4a5b-a26a-0f0321c98452 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:27.392482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be55f4-c46a-4a5b-a26a-0f0321c98452 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:27.393219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be55f4-c46a-4a5b-a26a-0f0321c98452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:27.394805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be55f4-c46a-4a5b-a26a-0f0321c98452 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:27.404633 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4279/8622] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:55:27.408591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc93b77-d2a7-4471-988c-a74fff30ab6e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:27.418369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc93b77-d2a7-4471-988c-a74fff30ab6e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:27.424056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e6ddd-6458-46d6-9296-61618916d8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:27.424917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e6ddd-6458-46d6-9296-61618916d8b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:27.425197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e6ddd-6458-46d6-9296-61618916d8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:27.425468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e6ddd-6458-46d6-9296-61618916d8b0 admin admin] PATH_INFO: `/v3/projects/13ce121469a145a4b00edd3a082413a4/users/2331af9efc5e4af7a901621b7590e80a/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:27.441100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e6ddd-6458-46d6-9296-61618916d8b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ce121469a145a4b00edd3a082413a4, user_id=2331af9efc5e4af7a901621b7590e80a, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:27.443768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e6ddd-6458-46d6-9296-61618916d8b0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:27.538329 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4344/8623] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:55:27 2022] PUT /identity/v3/projects/13ce121469a145a4b00edd3a082413a4/users/2331af9efc5e4af7a901621b7590e80a/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:27.543615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fb07c-807b-4e0e-ac9b-0623c9160502 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:27.543914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fb07c-807b-4e0e-ac9b-0623c9160502 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:27.544719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fb07c-807b-4e0e-ac9b-0623c9160502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:27.563058 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-446fb07c-807b-4e0e-ac9b-0623c9160502 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:27.564263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-446fb07c-807b-4e0e-ac9b-0623c9160502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:27.623826 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4280/8624] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:27.633552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e6ddd-6458-46d6-9296-61618916d8b0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:27.635409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-094e6ddd-6458-46d6-9296-61618916d8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:27.693119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e6ddd-6458-46d6-9296-61618916d8b0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:27.698045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541787f-36da-4b0e-bd5e-845109ff6030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:27.698695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541787f-36da-4b0e-bd5e-845109ff6030 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:27.698977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541787f-36da-4b0e-bd5e-845109ff6030 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:27.699288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541787f-36da-4b0e-bd5e-845109ff6030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:27.708403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541787f-36da-4b0e-bd5e-845109ff6030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:27.709838 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541787f-36da-4b0e-bd5e-845109ff6030 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:27.719720 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4345/8625] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:55:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:55:28.814839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec42ef6-65de-4957-9312-e51f26148ac7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:28.815391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec42ef6-65de-4957-9312-e51f26148ac7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:28.815514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec42ef6-65de-4957-9312-e51f26148ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:28.844016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-eec42ef6-65de-4957-9312-e51f26148ac7 None None] MFA Rules not processed for user `2331af9efc5e4af7a901621b7590e80a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:28.845232 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-eec42ef6-65de-4957-9312-e51f26148ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:28.890822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:28.925306 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4281/8626] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:28.929892 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541787f-36da-4b0e-bd5e-845109ff6030 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:28.940921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541787f-36da-4b0e-bd5e-845109ff6030 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:28.945991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7448df6-8e58-462c-aae5-649c8fcc6079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:28.946752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7448df6-8e58-462c-aae5-649c8fcc6079 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:28.947079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7448df6-8e58-462c-aae5-649c8fcc6079 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:28.947360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7448df6-8e58-462c-aae5-649c8fcc6079 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:28.948045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7448df6-8e58-462c-aae5-649c8fcc6079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:28.950079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7448df6-8e58-462c-aae5-649c8fcc6079 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:29.037228 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4346/8627] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:55:28 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:55:29.041430 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec42ef6-65de-4957-9312-e51f26148ac7 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:29.055531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec42ef6-65de-4957-9312-e51f26148ac7 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:29.109459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83f034-f128-4488-a4f1-b990591d1a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:29.110134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83f034-f128-4488-a4f1-b990591d1a17 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:29.110420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83f034-f128-4488-a4f1-b990591d1a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:29.110691 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83f034-f128-4488-a4f1-b990591d1a17 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:29.111411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83f034-f128-4488-a4f1-b990591d1a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:29.113310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83f034-f128-4488-a4f1-b990591d1a17 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:29.195780 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4282/8628] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:55:29 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:55:29.199918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7448df6-8e58-462c-aae5-649c8fcc6079 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:29.211572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7448df6-8e58-462c-aae5-649c8fcc6079 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:29.216251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f6c56-05b2-4f70-9344-64c25240b944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:29.216921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f6c56-05b2-4f70-9344-64c25240b944 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:29.217198 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f6c56-05b2-4f70-9344-64c25240b944 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:29.217471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f6c56-05b2-4f70-9344-64c25240b944 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:29.218442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f6c56-05b2-4f70-9344-64c25240b944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:29.220075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f6c56-05b2-4f70-9344-64c25240b944 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:29.230672 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4347/8629] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:55:29.235974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83f034-f128-4488-a4f1-b990591d1a17 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:29.246263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83f034-f128-4488-a4f1-b990591d1a17 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:29.252042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff303e5-1e56-4f50-9953-4d5245539832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:29.252912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff303e5-1e56-4f50-9953-4d5245539832 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:29.253196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff303e5-1e56-4f50-9953-4d5245539832 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:29.253470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff303e5-1e56-4f50-9953-4d5245539832 admin admin] PATH_INFO: `/v3/projects/3e480a4acef142b696233badbd38c366/users/e612c8202e534785bbc5fad11e2d6c37/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:29.268361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff303e5-1e56-4f50-9953-4d5245539832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e480a4acef142b696233badbd38c366, user_id=e612c8202e534785bbc5fad11e2d6c37, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:29.271071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff303e5-1e56-4f50-9953-4d5245539832 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:29.361373 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4283/8630] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:55:29 2022] PUT /identity/v3/projects/3e480a4acef142b696233badbd38c366/users/e612c8202e534785bbc5fad11e2d6c37/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:29.365457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f6c56-05b2-4f70-9344-64c25240b944 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:29.375746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f6c56-05b2-4f70-9344-64c25240b944 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:29.431701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32132d4e-407d-40b7-98fa-34a6c226f64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:29.432353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32132d4e-407d-40b7-98fa-34a6c226f64b admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:29.432660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32132d4e-407d-40b7-98fa-34a6c226f64b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:29.432933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32132d4e-407d-40b7-98fa-34a6c226f64b admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:29.433638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32132d4e-407d-40b7-98fa-34a6c226f64b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:29.435438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32132d4e-407d-40b7-98fa-34a6c226f64b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:29.445395 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4348/8631] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:55:29.449551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff303e5-1e56-4f50-9953-4d5245539832 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:29.460420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff303e5-1e56-4f50-9953-4d5245539832 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:29.465176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7195fc1-80d2-4a0c-94f6-42dcc39ae5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:29.466594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7195fc1-80d2-4a0c-94f6-42dcc39ae5ae admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:29.467060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7195fc1-80d2-4a0c-94f6-42dcc39ae5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:29.467347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7195fc1-80d2-4a0c-94f6-42dcc39ae5ae admin admin] PATH_INFO: `/v3/projects/3e480a4acef142b696233badbd38c366/users/e612c8202e534785bbc5fad11e2d6c37/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:29.469635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7195fc1-80d2-4a0c-94f6-42dcc39ae5ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e480a4acef142b696233badbd38c366, user_id=e612c8202e534785bbc5fad11e2d6c37, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:29.472333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7195fc1-80d2-4a0c-94f6-42dcc39ae5ae admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:29.483751 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4284/8632] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:55:29 2022] PUT /identity/v3/projects/3e480a4acef142b696233badbd38c366/users/e612c8202e534785bbc5fad11e2d6c37/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:55:30.653551 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916dc78-7541-4ee3-9967-39a76d001cd7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:30.654084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916dc78-7541-4ee3-9967-39a76d001cd7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:30.654084 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916dc78-7541-4ee3-9967-39a76d001cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:30.683191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2916dc78-7541-4ee3-9967-39a76d001cd7 None None] MFA Rules not processed for user `e612c8202e534785bbc5fad11e2d6c37`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:30.684410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2916dc78-7541-4ee3-9967-39a76d001cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:30.690885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:30.757716 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4349/8633] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:30.768687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0949a7-80a5-454f-b4fa-c93bba6a9e9a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:30.769160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0949a7-80a5-454f-b4fa-c93bba6a9e9a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:30.769253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0949a7-80a5-454f-b4fa-c93bba6a9e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:30.787488 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ec0949a7-80a5-454f-b4fa-c93bba6a9e9a None None] MFA Rules not processed for user `2331af9efc5e4af7a901621b7590e80a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:30.788692 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ec0949a7-80a5-454f-b4fa-c93bba6a9e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:30.844304 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4285/8634] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:55:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:30.860588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916dc78-7541-4ee3-9967-39a76d001cd7 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:30.862003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2916dc78-7541-4ee3-9967-39a76d001cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:30.940199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916dc78-7541-4ee3-9967-39a76d001cd7 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:30.945745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db592c-bf51-47e4-8d3f-c43e40033263 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:30.946375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db592c-bf51-47e4-8d3f-c43e40033263 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:30.946658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db592c-bf51-47e4-8d3f-c43e40033263 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:30.946937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db592c-bf51-47e4-8d3f-c43e40033263 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:30.955877 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db592c-bf51-47e4-8d3f-c43e40033263 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:30.957489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db592c-bf51-47e4-8d3f-c43e40033263 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:30.966480 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4350/8635] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:55:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:55:30.998339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0949a7-80a5-454f-b4fa-c93bba6a9e9a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:31.000776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ec0949a7-80a5-454f-b4fa-c93bba6a9e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:31.041394 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:31.073330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0949a7-80a5-454f-b4fa-c93bba6a9e9a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:31.077465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c9508-3ba3-44d5-97a1-b026fd7379fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:31.078442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c9508-3ba3-44d5-97a1-b026fd7379fa service glance] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:31.078727 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c9508-3ba3-44d5-97a1-b026fd7379fa service glance] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:31.079016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c9508-3ba3-44d5-97a1-b026fd7379fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:31.080913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6c5c9508-3ba3-44d5-97a1-b026fd7379fa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:31.097376 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c9508-3ba3-44d5-97a1-b026fd7379fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:31.098740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c9508-3ba3-44d5-97a1-b026fd7379fa service glance] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:31.112406 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4286/8636] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:55:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:55:31.736761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db592c-bf51-47e4-8d3f-c43e40033263 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:31.797321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db592c-bf51-47e4-8d3f-c43e40033263 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:31.801103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846d7f0-cdc4-46c5-b61e-53ddbac87cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:31.801754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846d7f0-cdc4-46c5-b61e-53ddbac87cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:31.802037 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846d7f0-cdc4-46c5-b61e-53ddbac87cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:31.802385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846d7f0-cdc4-46c5-b61e-53ddbac87cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:31.804112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8846d7f0-cdc4-46c5-b61e-53ddbac87cb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:31.820889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846d7f0-cdc4-46c5-b61e-53ddbac87cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:31.822357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846d7f0-cdc4-46c5-b61e-53ddbac87cb1 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:31.837373 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4351/8637] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:55:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:55:34.598733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5acc0-ab45-434b-8187-546d3eafb41b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:34.599272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5acc0-ab45-434b-8187-546d3eafb41b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:34.599370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5acc0-ab45-434b-8187-546d3eafb41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:34.618060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-05b5acc0-ab45-434b-8187-546d3eafb41b None None] MFA Rules not processed for user `fbd858f3e6ba4523b056bbdc2af427b0`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:55:34.619292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-05b5acc0-ab45-434b-8187-546d3eafb41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:34.625840 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4287/8638] 10.222.0.16 () {58 vars in 1062 bytes} [Sat Jul 16 21:55:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:55:34.631687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846d7f0-cdc4-46c5-b61e-53ddbac87cb1 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:34.640694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846d7f0-cdc4-46c5-b61e-53ddbac87cb1 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:34.644325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e001b4-6eaf-4bc6-91be-914220fecb67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:34.644952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e001b4-6eaf-4bc6-91be-914220fecb67 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:34.645233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e001b4-6eaf-4bc6-91be-914220fecb67 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:34.645507 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e001b4-6eaf-4bc6-91be-914220fecb67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:34.647276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a8e001b4-6eaf-4bc6-91be-914220fecb67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:34.659577 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e001b4-6eaf-4bc6-91be-914220fecb67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:34.661114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e001b4-6eaf-4bc6-91be-914220fecb67 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:34.672727 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4352/8639] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:55:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:55:35.448503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5acc0-ab45-434b-8187-546d3eafb41b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:35.450100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-05b5acc0-ab45-434b-8187-546d3eafb41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:35.470629 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5acc0-ab45-434b-8187-546d3eafb41b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:35.476307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e87fd-f64b-4862-b98f-0ffd77d3f32d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:35.476957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e87fd-f64b-4862-b98f-0ffd77d3f32d service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:35.477241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e87fd-f64b-4862-b98f-0ffd77d3f32d service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:35.477525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e87fd-f64b-4862-b98f-0ffd77d3f32d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:35.479321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1a9e87fd-f64b-4862-b98f-0ffd77d3f32d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:35.494186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e87fd-f64b-4862-b98f-0ffd77d3f32d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:35.495810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e87fd-f64b-4862-b98f-0ffd77d3f32d service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:35.509833 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4288/8640] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:55:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:55:41.239236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e001b4-6eaf-4bc6-91be-914220fecb67 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:41.255905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e001b4-6eaf-4bc6-91be-914220fecb67 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:41.261537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec52e0-0b29-4694-947e-a9501452f888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:41.262192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec52e0-0b29-4694-947e-a9501452f888 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:41.262479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec52e0-0b29-4694-947e-a9501452f888 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:41.262760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec52e0-0b29-4694-947e-a9501452f888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:41.265406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f2ec52e0-0b29-4694-947e-a9501452f888 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:41.280230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec52e0-0b29-4694-947e-a9501452f888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:41.281902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec52e0-0b29-4694-947e-a9501452f888 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:41.295964 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4353/8641] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:55:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:55:45.502490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=24 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:45.598041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e87fd-f64b-4862-b98f-0ffd77d3f32d service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:55:45.599456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1a9e87fd-f64b-4862-b98f-0ffd77d3f32d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:55:45.750889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e87fd-f64b-4862-b98f-0ffd77d3f32d service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:55:45.750889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea7082-3001-44b2-bd72-8bda3048d2b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:55:45.750889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea7082-3001-44b2-bd72-8bda3048d2b6 service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:55:45.750889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea7082-3001-44b2-bd72-8bda3048d2b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:55:45.752823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea7082-3001-44b2-bd72-8bda3048d2b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:55:45.752823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea7082-3001-44b2-bd72-8bda3048d2b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:55:45.752823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea7082-3001-44b2-bd72-8bda3048d2b6 service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:55:45.752823 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4289/8642] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:55:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:55:51.288263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=98 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:55:55.683224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=26 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:56:19.877295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec52e0-0b29-4694-947e-a9501452f888 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:19.951900 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec52e0-0b29-4694-947e-a9501452f888 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:19.956483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7d4e9-c33f-4685-943a-5765bfa8f8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:19.957360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7d4e9-c33f-4685-943a-5765bfa8f8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:19.957638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7d4e9-c33f-4685-943a-5765bfa8f8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:19.957941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7d4e9-c33f-4685-943a-5765bfa8f8eb admin admin] PATH_INFO: `/v3/users/2331af9efc5e4af7a901621b7590e80a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:19.959167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7d4e9-c33f-4685-943a-5765bfa8f8eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2331af9efc5e4af7a901621b7590e80a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:19.961469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7d4e9-c33f-4685-943a-5765bfa8f8eb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:20.197334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d4a7d4e9-c33f-4685-943a-5765bfa8f8eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2331af9efc5e4af7a901621b7590e80a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:20.204383 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d4a7d4e9-c33f-4685-943a-5765bfa8f8eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2331af9efc5e4af7a901621b7590e80a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:20.274397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d4a7d4e9-c33f-4685-943a-5765bfa8f8eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2331af9efc5e4af7a901621b7590e80a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:20.275208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d4a7d4e9-c33f-4685-943a-5765bfa8f8eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2331af9efc5e4af7a901621b7590e80a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:20.288237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d4a7d4e9-c33f-4685-943a-5765bfa8f8eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2331af9efc5e4af7a901621b7590e80a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:20.294495 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4354/8643] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:56:19 2022] DELETE /identity/v3/users/2331af9efc5e4af7a901621b7590e80a => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:56:20.545574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea7082-3001-44b2-bd72-8bda3048d2b6 service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:20.559708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea7082-3001-44b2-bd72-8bda3048d2b6 service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:20.624331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c7aff-2b7d-4770-bded-84e2f7ec51d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:20.625205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c7aff-2b7d-4770-bded-84e2f7ec51d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:20.625657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c7aff-2b7d-4770-bded-84e2f7ec51d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:20.625935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c7aff-2b7d-4770-bded-84e2f7ec51d7 admin admin] PATH_INFO: `/v3/projects/13ce121469a145a4b00edd3a082413a4` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:20.627214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c7aff-2b7d-4770-bded-84e2f7ec51d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ce121469a145a4b00edd3a082413a4)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:20.629141 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c7aff-2b7d-4770-bded-84e2f7ec51d7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:20.728031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9f8c7aff-2b7d-4770-bded-84e2f7ec51d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ce121469a145a4b00edd3a082413a4', 'request_id': 'req-9f8c7aff-2b7d-4770-bded-84e2f7ec51d7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:20.733596 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9f8c7aff-2b7d-4770-bded-84e2f7ec51d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ce121469a145a4b00edd3a082413a4', 'request_id': 'req-9f8c7aff-2b7d-4770-bded-84e2f7ec51d7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:20.739932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9f8c7aff-2b7d-4770-bded-84e2f7ec51d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ce121469a145a4b00edd3a082413a4', 'request_id': 'req-9f8c7aff-2b7d-4770-bded-84e2f7ec51d7'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:20.799367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9f8c7aff-2b7d-4770-bded-84e2f7ec51d7 admin admin] The token cache is being invalidate because project 13ce121469a145a4b00edd3a082413a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:56:20.799661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9f8c7aff-2b7d-4770-bded-84e2f7ec51d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:20.800324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-9f8c7aff-2b7d-4770-bded-84e2f7ec51d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:20.801887 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4290/8644] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:56:20 2022] DELETE /identity/v3/projects/13ce121469a145a4b00edd3a082413a4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:56:20.806609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7d4e9-c33f-4685-943a-5765bfa8f8eb admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:20.808031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d4a7d4e9-c33f-4685-943a-5765bfa8f8eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:20.821596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7d4e9-c33f-4685-943a-5765bfa8f8eb admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:20.879379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e1dfc-0489-40e5-85a4-a57705c64cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:20.880248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e1dfc-0489-40e5-85a4-a57705c64cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:20.880526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e1dfc-0489-40e5-85a4-a57705c64cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:20.880795 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e1dfc-0489-40e5-85a4-a57705c64cbf admin admin] PATH_INFO: `/v3/users/e612c8202e534785bbc5fad11e2d6c37` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:20.882031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e1dfc-0489-40e5-85a4-a57705c64cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e612c8202e534785bbc5fad11e2d6c37)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:20.884045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e1dfc-0489-40e5-85a4-a57705c64cbf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:20.906177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:56:21.127726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-410e1dfc-0489-40e5-85a4-a57705c64cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e612c8202e534785bbc5fad11e2d6c37'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:21.135156 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-410e1dfc-0489-40e5-85a4-a57705c64cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e612c8202e534785bbc5fad11e2d6c37'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:21.205063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-410e1dfc-0489-40e5-85a4-a57705c64cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e612c8202e534785bbc5fad11e2d6c37'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:21.205685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-410e1dfc-0489-40e5-85a4-a57705c64cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e612c8202e534785bbc5fad11e2d6c37'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:21.218847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-410e1dfc-0489-40e5-85a4-a57705c64cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e612c8202e534785bbc5fad11e2d6c37'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:21.225122 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4355/8645] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:56:20 2022] DELETE /identity/v3/users/e612c8202e534785bbc5fad11e2d6c37 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:56:21.493640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c7aff-2b7d-4770-bded-84e2f7ec51d7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:21.495184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9f8c7aff-2b7d-4770-bded-84e2f7ec51d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:21.509088 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c7aff-2b7d-4770-bded-84e2f7ec51d7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:21.568476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7bae2-5f58-45e1-bed0-6980f848e0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:21.569566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7bae2-5f58-45e1-bed0-6980f848e0dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:21.569855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7bae2-5f58-45e1-bed0-6980f848e0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:21.570135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7bae2-5f58-45e1-bed0-6980f848e0dd admin admin] PATH_INFO: `/v3/projects/3e480a4acef142b696233badbd38c366` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:21.571369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7bae2-5f58-45e1-bed0-6980f848e0dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e480a4acef142b696233badbd38c366)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:21.573314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7bae2-5f58-45e1-bed0-6980f848e0dd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:21.639396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:56:21.651571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e4d7bae2-5f58-45e1-bed0-6980f848e0dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e480a4acef142b696233badbd38c366', 'request_id': 'req-e4d7bae2-5f58-45e1-bed0-6980f848e0dd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:21.656889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e4d7bae2-5f58-45e1-bed0-6980f848e0dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e480a4acef142b696233badbd38c366', 'request_id': 'req-e4d7bae2-5f58-45e1-bed0-6980f848e0dd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:21.663768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e4d7bae2-5f58-45e1-bed0-6980f848e0dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e480a4acef142b696233badbd38c366', 'request_id': 'req-e4d7bae2-5f58-45e1-bed0-6980f848e0dd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:21.718838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e4d7bae2-5f58-45e1-bed0-6980f848e0dd admin admin] The token cache is being invalidate because project 3e480a4acef142b696233badbd38c366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:56:21.719482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e4d7bae2-5f58-45e1-bed0-6980f848e0dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:21.720470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-e4d7bae2-5f58-45e1-bed0-6980f848e0dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:21.722404 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4291/8646] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:56:21 2022] DELETE /identity/v3/projects/3e480a4acef142b696233badbd38c366 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:56:21.728017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6a35a-52b6-4c27-a2aa-0cd168707df2 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:21.728349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6a35a-52b6-4c27-a2aa-0cd168707df2 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:21.728654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6a35a-52b6-4c27-a2aa-0cd168707df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:21.746973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-e9a6a35a-52b6-4c27-a2aa-0cd168707df2 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:56:21.748126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e9a6a35a-52b6-4c27-a2aa-0cd168707df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:21.808254 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4356/8647] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:56:21.816023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9f867-65ba-4d1d-bfbe-b64aa34770a4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:21.816317 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9f867-65ba-4d1d-bfbe-b64aa34770a4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:21.816600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9f867-65ba-4d1d-bfbe-b64aa34770a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:21.837123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-40d9f867-65ba-4d1d-bfbe-b64aa34770a4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:56:21.839438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-40d9f867-65ba-4d1d-bfbe-b64aa34770a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:21.847704 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4292/8648] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:56:21.852943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6a35a-52b6-4c27-a2aa-0cd168707df2 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:21.863100 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6a35a-52b6-4c27-a2aa-0cd168707df2 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:21.867934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61643575-3448-4146-9b84-3c5e730ede37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:21.868590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61643575-3448-4146-9b84-3c5e730ede37 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:21.868870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61643575-3448-4146-9b84-3c5e730ede37 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:21.869142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61643575-3448-4146-9b84-3c5e730ede37 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:21.869864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61643575-3448-4146-9b84-3c5e730ede37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:56:21.870214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61643575-3448-4146-9b84-3c5e730ede37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:21.871850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61643575-3448-4146-9b84-3c5e730ede37 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:21.884491 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4357/8649] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:56:21.888302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9f867-65ba-4d1d-bfbe-b64aa34770a4 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:21.898428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9f867-65ba-4d1d-bfbe-b64aa34770a4 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:21.903267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20260a0f-3a59-4415-abe1-bef05d761c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:21.903913 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20260a0f-3a59-4415-abe1-bef05d761c8b admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:21.904196 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20260a0f-3a59-4415-abe1-bef05d761c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:21.904472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20260a0f-3a59-4415-abe1-bef05d761c8b admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:21.905197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20260a0f-3a59-4415-abe1-bef05d761c8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:21.907156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20260a0f-3a59-4415-abe1-bef05d761c8b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:22.002427 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4293/8650] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:56:21 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:56:22.005642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61643575-3448-4146-9b84-3c5e730ede37 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:22.016035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61643575-3448-4146-9b84-3c5e730ede37 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:22.071956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e3d91-6e27-44f7-996d-65901e731281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:22.072617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e3d91-6e27-44f7-996d-65901e731281 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:22.072899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e3d91-6e27-44f7-996d-65901e731281 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:22.073172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e3d91-6e27-44f7-996d-65901e731281 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:22.073858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e3d91-6e27-44f7-996d-65901e731281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:22.075830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e3d91-6e27-44f7-996d-65901e731281 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:22.143654 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4358/8651] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:56:22 2022] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:56:22.147642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20260a0f-3a59-4415-abe1-bef05d761c8b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:22.158280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20260a0f-3a59-4415-abe1-bef05d761c8b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:22.163780 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984241ff-6f57-4c0d-936a-513a2b09932b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:22.164573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984241ff-6f57-4c0d-936a-513a2b09932b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:22.164859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984241ff-6f57-4c0d-936a-513a2b09932b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:22.165136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984241ff-6f57-4c0d-936a-513a2b09932b admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:22.165858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984241ff-6f57-4c0d-936a-513a2b09932b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:22.167479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984241ff-6f57-4c0d-936a-513a2b09932b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:22.179343 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4294/8652] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:56:22.183432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e3d91-6e27-44f7-996d-65901e731281 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:22.194148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e3d91-6e27-44f7-996d-65901e731281 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:22.198839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123a1a4-9739-4673-9b6e-575a9b7120e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:22.199523 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123a1a4-9739-4673-9b6e-575a9b7120e3 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:22.199814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123a1a4-9739-4673-9b6e-575a9b7120e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:22.200093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123a1a4-9739-4673-9b6e-575a9b7120e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:22.200812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123a1a4-9739-4673-9b6e-575a9b7120e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:22.202412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123a1a4-9739-4673-9b6e-575a9b7120e3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:22.213098 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4359/8653] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:56:22.217679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984241ff-6f57-4c0d-936a-513a2b09932b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:22.229174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984241ff-6f57-4c0d-936a-513a2b09932b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:22.234144 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c1d06-5b90-49cd-b923-b70cb3859caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:22.235113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c1d06-5b90-49cd-b923-b70cb3859caa admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:22.235420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c1d06-5b90-49cd-b923-b70cb3859caa admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:22.235731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c1d06-5b90-49cd-b923-b70cb3859caa admin admin] PATH_INFO: `/v3/projects/a9f2097315dd4040b0b28dc8be492447/users/f1beaafe410448dc8e79b533e76073a0/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:22.251811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c1d06-5b90-49cd-b923-b70cb3859caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9f2097315dd4040b0b28dc8be492447, user_id=f1beaafe410448dc8e79b533e76073a0, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:22.254886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c1d06-5b90-49cd-b923-b70cb3859caa admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:22.325533 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4295/8654] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:56:22 2022] PUT /identity/v3/projects/a9f2097315dd4040b0b28dc8be492447/users/f1beaafe410448dc8e79b533e76073a0/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:56:22.336432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02824d6e-45d0-4f78-95c3-150ca10873f5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:22.336721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02824d6e-45d0-4f78-95c3-150ca10873f5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:22.337003 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02824d6e-45d0-4f78-95c3-150ca10873f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:22.344058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:56:22.364188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-02824d6e-45d0-4f78-95c3-150ca10873f5 None None] MFA Rules not processed for user `f1beaafe410448dc8e79b533e76073a0`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:56:22.365391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-02824d6e-45d0-4f78-95c3-150ca10873f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:22.430089 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4360/8655] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:56:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:56:22.434572 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c1d06-5b90-49cd-b923-b70cb3859caa admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:22.497690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c1d06-5b90-49cd-b923-b70cb3859caa admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:22.502513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e134a9-e004-4c69-b6d9-e19d69f7d29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:22.503203 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e134a9-e004-4c69-b6d9-e19d69f7d29c admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:22.503494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e134a9-e004-4c69-b6d9-e19d69f7d29c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:22.503774 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e134a9-e004-4c69-b6d9-e19d69f7d29c admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:22.504464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e134a9-e004-4c69-b6d9-e19d69f7d29c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:22.506882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e134a9-e004-4c69-b6d9-e19d69f7d29c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:22.601737 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4296/8656] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:56:22 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:56:22.605917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02824d6e-45d0-4f78-95c3-150ca10873f5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:22.617563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02824d6e-45d0-4f78-95c3-150ca10873f5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:22.675622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e95b3b-3766-4c96-8c12-ed708bdf6b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:22.676286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e95b3b-3766-4c96-8c12-ed708bdf6b0c admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:22.676563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e95b3b-3766-4c96-8c12-ed708bdf6b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:22.676835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e95b3b-3766-4c96-8c12-ed708bdf6b0c admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:22.677515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e95b3b-3766-4c96-8c12-ed708bdf6b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:22.679883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e95b3b-3766-4c96-8c12-ed708bdf6b0c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:22.760204 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4361/8657] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:56:22 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:56:22.764111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e134a9-e004-4c69-b6d9-e19d69f7d29c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:22.775863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e134a9-e004-4c69-b6d9-e19d69f7d29c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:22.780545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03824e9-df79-430f-8e85-dbf541f3c03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:22.781313 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03824e9-df79-430f-8e85-dbf541f3c03a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:22.781609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03824e9-df79-430f-8e85-dbf541f3c03a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:22.781890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03824e9-df79-430f-8e85-dbf541f3c03a admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:22.782610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03824e9-df79-430f-8e85-dbf541f3c03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:22.784239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03824e9-df79-430f-8e85-dbf541f3c03a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:22.795223 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4297/8658] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:56:22.799101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e95b3b-3766-4c96-8c12-ed708bdf6b0c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:22.809606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e95b3b-3766-4c96-8c12-ed708bdf6b0c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:22.814426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6c534-abf0-4bab-9ccb-6cf5e09cbd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:22.815102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6c534-abf0-4bab-9ccb-6cf5e09cbd8f admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:22.815390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6c534-abf0-4bab-9ccb-6cf5e09cbd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:22.815707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6c534-abf0-4bab-9ccb-6cf5e09cbd8f admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:22.816453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6c534-abf0-4bab-9ccb-6cf5e09cbd8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:22.818049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6c534-abf0-4bab-9ccb-6cf5e09cbd8f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:22.829184 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4362/8659] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:56:22.833504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03824e9-df79-430f-8e85-dbf541f3c03a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:22.844597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03824e9-df79-430f-8e85-dbf541f3c03a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:22.849510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897cb0d-59d2-4bee-8593-cecaca6e6e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:22.850779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897cb0d-59d2-4bee-8593-cecaca6e6e0c admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:22.851101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897cb0d-59d2-4bee-8593-cecaca6e6e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:22.851384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897cb0d-59d2-4bee-8593-cecaca6e6e0c admin admin] PATH_INFO: `/v3/projects/52cd577da12e4d7f8aeb2767cc4f9584/users/44ba7606896a469485f967528080ed1f/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:22.866111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897cb0d-59d2-4bee-8593-cecaca6e6e0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=52cd577da12e4d7f8aeb2767cc4f9584, user_id=44ba7606896a469485f967528080ed1f, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:22.868933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897cb0d-59d2-4bee-8593-cecaca6e6e0c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:22.959787 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4298/8660] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:56:22 2022] PUT /identity/v3/projects/52cd577da12e4d7f8aeb2767cc4f9584/users/44ba7606896a469485f967528080ed1f/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:56:22.971343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0f7d3-b256-4abc-a600-0bb431ef96a1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:22.971831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0f7d3-b256-4abc-a600-0bb431ef96a1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:22.971947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0f7d3-b256-4abc-a600-0bb431ef96a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:23.000707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-48a0f7d3-b256-4abc-a600-0bb431ef96a1 None None] MFA Rules not processed for user `44ba7606896a469485f967528080ed1f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:56:23.001960 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-48a0f7d3-b256-4abc-a600-0bb431ef96a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:23.067924 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4363/8661] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:56:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:56:23.072804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897cb0d-59d2-4bee-8593-cecaca6e6e0c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:23.081965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:56:23.134514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897cb0d-59d2-4bee-8593-cecaca6e6e0c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:23.139438 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126e455-01de-4d61-a2dd-aebc71d80fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:23.140118 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126e455-01de-4d61-a2dd-aebc71d80fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:23.140559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126e455-01de-4d61-a2dd-aebc71d80fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:23.140845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126e455-01de-4d61-a2dd-aebc71d80fe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:23.141538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126e455-01de-4d61-a2dd-aebc71d80fe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:23.143491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126e455-01de-4d61-a2dd-aebc71d80fe5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:23.254542 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4299/8662] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:56:23 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:56:23.258038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0f7d3-b256-4abc-a600-0bb431ef96a1 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:23.263657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:56:23.269459 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0f7d3-b256-4abc-a600-0bb431ef96a1 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:23.326910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbeb78-0345-4079-91db-0a02a9b715a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:23.327543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbeb78-0345-4079-91db-0a02a9b715a3 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:23.327806 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbeb78-0345-4079-91db-0a02a9b715a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:23.328081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbeb78-0345-4079-91db-0a02a9b715a3 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:23.328753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffbeb78-0345-4079-91db-0a02a9b715a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:23.330705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffbeb78-0345-4079-91db-0a02a9b715a3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:23.405708 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4364/8663] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:56:23 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:56:23.409557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126e455-01de-4d61-a2dd-aebc71d80fe5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:23.421297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126e455-01de-4d61-a2dd-aebc71d80fe5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:23.426065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f214f-1a5a-4335-b7c4-84a984ab0a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:23.426724 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f214f-1a5a-4335-b7c4-84a984ab0a55 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:23.441021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f214f-1a5a-4335-b7c4-84a984ab0a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:23.441021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f214f-1a5a-4335-b7c4-84a984ab0a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:23.441021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f214f-1a5a-4335-b7c4-84a984ab0a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:23.441021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f214f-1a5a-4335-b7c4-84a984ab0a55 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:23.441021 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4300/8664] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:56:23.445311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbeb78-0345-4079-91db-0a02a9b715a3 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:23.455639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbeb78-0345-4079-91db-0a02a9b715a3 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:23.460927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6372e00-d100-44ec-8062-26da51429864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:23.461798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6372e00-d100-44ec-8062-26da51429864 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:23.462078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6372e00-d100-44ec-8062-26da51429864 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:23.462353 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6372e00-d100-44ec-8062-26da51429864 admin admin] PATH_INFO: `/v3/projects/f4775d6336394d3e87ab52e18bf27ee6/users/ebf31c4f74404fa28a7b83d3debaf96c/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:23.477761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6372e00-d100-44ec-8062-26da51429864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4775d6336394d3e87ab52e18bf27ee6, user_id=ebf31c4f74404fa28a7b83d3debaf96c, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:23.480472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6372e00-d100-44ec-8062-26da51429864 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:23.525711 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4365/8665] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:56:23 2022] PUT /identity/v3/projects/f4775d6336394d3e87ab52e18bf27ee6/users/ebf31c4f74404fa28a7b83d3debaf96c/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:56:23.529785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f214f-1a5a-4335-b7c4-84a984ab0a55 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:23.540466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f214f-1a5a-4335-b7c4-84a984ab0a55 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:23.598108 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263f4a0-5a70-41fe-a2bf-84388dc3cabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:23.598654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f4a0-5a70-41fe-a2bf-84388dc3cabd admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:23.598965 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f4a0-5a70-41fe-a2bf-84388dc3cabd admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:23.599285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f4a0-5a70-41fe-a2bf-84388dc3cabd admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:23.600037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263f4a0-5a70-41fe-a2bf-84388dc3cabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:23.601671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263f4a0-5a70-41fe-a2bf-84388dc3cabd admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:23.611398 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4301/8666] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:56:23.615994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6372e00-d100-44ec-8062-26da51429864 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:23.626306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6372e00-d100-44ec-8062-26da51429864 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:23.630886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d37a41-cc10-4b4b-b547-0f0da80d5d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:23.632743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d37a41-cc10-4b4b-b547-0f0da80d5d85 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:23.633023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d37a41-cc10-4b4b-b547-0f0da80d5d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:23.633296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d37a41-cc10-4b4b-b547-0f0da80d5d85 admin admin] PATH_INFO: `/v3/projects/f4775d6336394d3e87ab52e18bf27ee6/users/ebf31c4f74404fa28a7b83d3debaf96c/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:23.635334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d37a41-cc10-4b4b-b547-0f0da80d5d85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4775d6336394d3e87ab52e18bf27ee6, user_id=ebf31c4f74404fa28a7b83d3debaf96c, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:23.638026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d37a41-cc10-4b4b-b547-0f0da80d5d85 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:23.648948 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4366/8667] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:56:23 2022] PUT /identity/v3/projects/f4775d6336394d3e87ab52e18bf27ee6/users/ebf31c4f74404fa28a7b83d3debaf96c/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:56:23.659368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42fcbd-2463-47f4-8648-e0d4d64ff7d8 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:23.659662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42fcbd-2463-47f4-8648-e0d4d64ff7d8 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:23.659944 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42fcbd-2463-47f4-8648-e0d4d64ff7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:23.685917 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1b42fcbd-2463-47f4-8648-e0d4d64ff7d8 None None] MFA Rules not processed for user `ebf31c4f74404fa28a7b83d3debaf96c`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:56:23.687159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1b42fcbd-2463-47f4-8648-e0d4d64ff7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:23.755411 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4302/8668] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:56:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:56:23.766709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bad18d-69d4-499d-a992-4beecca30ff4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:23.767028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bad18d-69d4-499d-a992-4beecca30ff4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:23.767314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bad18d-69d4-499d-a992-4beecca30ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:23.803657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-f2bad18d-69d4-499d-a992-4beecca30ff4 None None] MFA Rules not processed for user `6dcc74f579e447938a2477e253e5d36e`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:56:23.804875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f2bad18d-69d4-499d-a992-4beecca30ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:23.857537 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4367/8669] 10.222.0.16 () {58 vars in 1061 bytes} [Sat Jul 16 21:56:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:56:23.863392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42fcbd-2463-47f4-8648-e0d4d64ff7d8 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:23.868640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:56:23.873801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42fcbd-2463-47f4-8648-e0d4d64ff7d8 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:23.877391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ceef4-c7dd-4807-8de7-8e7a10e812cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:23.878024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ceef4-c7dd-4807-8de7-8e7a10e812cd service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:23.878307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ceef4-c7dd-4807-8de7-8e7a10e812cd service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:23.878588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ceef4-c7dd-4807-8de7-8e7a10e812cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:23.934662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ceef4-c7dd-4807-8de7-8e7a10e812cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:23.936157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ceef4-c7dd-4807-8de7-8e7a10e812cd service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:23.946414 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4303/8670] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:56:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:56:25.877115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bad18d-69d4-499d-a992-4beecca30ff4 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:25.879031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f2bad18d-69d4-499d-a992-4beecca30ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:25.893482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bad18d-69d4-499d-a992-4beecca30ff4 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:25.897955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb9e3b-ce42-43d7-895a-074a724ccdb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:25.898596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb9e3b-ce42-43d7-895a-074a724ccdb6 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:25.898880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb9e3b-ce42-43d7-895a-074a724ccdb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:25.899204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb9e3b-ce42-43d7-895a-074a724ccdb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:25.947490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:56:25.956963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb9e3b-ce42-43d7-895a-074a724ccdb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:25.958421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb9e3b-ce42-43d7-895a-074a724ccdb6 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:25.967588 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4368/8671] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:56:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:56:27.272545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ceef4-c7dd-4807-8de7-8e7a10e812cd service cinder] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:27.274045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-761ceef4-c7dd-4807-8de7-8e7a10e812cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:27.308844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb9e3b-ce42-43d7-895a-074a724ccdb6 service cinder] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:27.320072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb9e3b-ce42-43d7-895a-074a724ccdb6 service cinder] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:27.323835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b82c45-7381-4871-8de4-0300f81d46b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:27.324518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b82c45-7381-4871-8de4-0300f81d46b9 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:27.324843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b82c45-7381-4871-8de4-0300f81d46b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:27.325129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b82c45-7381-4871-8de4-0300f81d46b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:27.335908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b82c45-7381-4871-8de4-0300f81d46b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:27.337352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b82c45-7381-4871-8de4-0300f81d46b9 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:27.347540 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4369/8672] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:56:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:56:27.363226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ceef4-c7dd-4807-8de7-8e7a10e812cd service cinder] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:27.369015 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9783d1b-0829-4f6b-8f55-b29202ec9e34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:27.369664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9783d1b-0829-4f6b-8f55-b29202ec9e34 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:27.369952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9783d1b-0829-4f6b-8f55-b29202ec9e34 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:27.370216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9783d1b-0829-4f6b-8f55-b29202ec9e34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:27.372008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a9783d1b-0829-4f6b-8f55-b29202ec9e34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:27.386195 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9783d1b-0829-4f6b-8f55-b29202ec9e34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:27.392940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9783d1b-0829-4f6b-8f55-b29202ec9e34 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:27.400519 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4304/8673] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:56:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:56:34.389223 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b82c45-7381-4871-8de4-0300f81d46b9 service cinder] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:34.390635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-77b82c45-7381-4871-8de4-0300f81d46b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:34.407997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b82c45-7381-4871-8de4-0300f81d46b9 service cinder] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:34.413387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b9b3f-0a3b-4c7c-a2e7-6f16457b5030 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:34.414066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b9b3f-0a3b-4c7c-a2e7-6f16457b5030 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:34.414346 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b9b3f-0a3b-4c7c-a2e7-6f16457b5030 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:34.414615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b9b3f-0a3b-4c7c-a2e7-6f16457b5030 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:34.416416 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-326b9b3f-0a3b-4c7c-a2e7-6f16457b5030 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:34.431134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b9b3f-0a3b-4c7c-a2e7-6f16457b5030 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:34.432700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b9b3f-0a3b-4c7c-a2e7-6f16457b5030 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:34.446160 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4370/8674] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:56:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:56:35.080645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9783d1b-0829-4f6b-8f55-b29202ec9e34 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:35.144093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9783d1b-0829-4f6b-8f55-b29202ec9e34 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:35.149231 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28774c6a-ab51-498c-9375-a7cb34b1f205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:35.150104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28774c6a-ab51-498c-9375-a7cb34b1f205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:35.150387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28774c6a-ab51-498c-9375-a7cb34b1f205 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:35.150666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28774c6a-ab51-498c-9375-a7cb34b1f205 admin admin] PATH_INFO: `/v3/users/f1beaafe410448dc8e79b533e76073a0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:35.151953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28774c6a-ab51-498c-9375-a7cb34b1f205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1beaafe410448dc8e79b533e76073a0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:35.153865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28774c6a-ab51-498c-9375-a7cb34b1f205 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:35.176027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:56:35.339321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-28774c6a-ab51-498c-9375-a7cb34b1f205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1beaafe410448dc8e79b533e76073a0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:35.352734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-28774c6a-ab51-498c-9375-a7cb34b1f205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1beaafe410448dc8e79b533e76073a0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:35.416645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-28774c6a-ab51-498c-9375-a7cb34b1f205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1beaafe410448dc8e79b533e76073a0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:35.423855 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-28774c6a-ab51-498c-9375-a7cb34b1f205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1beaafe410448dc8e79b533e76073a0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:35.424534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-28774c6a-ab51-498c-9375-a7cb34b1f205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1beaafe410448dc8e79b533e76073a0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:35.430895 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4305/8675] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:56:35 2022] DELETE /identity/v3/users/f1beaafe410448dc8e79b533e76073a0 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:56:35.435597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765e515-0567-4069-8888-56f46f009d20 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:35.436112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765e515-0567-4069-8888-56f46f009d20 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:35.436217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765e515-0567-4069-8888-56f46f009d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:35.454788 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0765e515-0567-4069-8888-56f46f009d20 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:56:35.456016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0765e515-0567-4069-8888-56f46f009d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:35.516172 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4371/8676] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:56:35.526680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28774c6a-ab51-498c-9375-a7cb34b1f205 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:35.528097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-28774c6a-ab51-498c-9375-a7cb34b1f205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:35.585918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28774c6a-ab51-498c-9375-a7cb34b1f205 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:35.589681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3ed1d-7bef-4d29-87c5-7003eb92f946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:35.590357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3ed1d-7bef-4d29-87c5-7003eb92f946 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:35.590640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3ed1d-7bef-4d29-87c5-7003eb92f946 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:35.590920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3ed1d-7bef-4d29-87c5-7003eb92f946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:35.600869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a3ed1d-7bef-4d29-87c5-7003eb92f946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:35.602302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a3ed1d-7bef-4d29-87c5-7003eb92f946 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:35.611886 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4306/8677] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:56:35.968011 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765e515-0567-4069-8888-56f46f009d20 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:35.972323 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0765e515-0567-4069-8888-56f46f009d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:35.983393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765e515-0567-4069-8888-56f46f009d20 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:35.988099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d27fcf-bfef-4f61-90ba-e2d86841b1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:35.988958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d27fcf-bfef-4f61-90ba-e2d86841b1f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:35.989236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d27fcf-bfef-4f61-90ba-e2d86841b1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:35.989510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d27fcf-bfef-4f61-90ba-e2d86841b1f4 admin admin] PATH_INFO: `/v3/projects/a9f2097315dd4040b0b28dc8be492447` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:35.990781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d27fcf-bfef-4f61-90ba-e2d86841b1f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9f2097315dd4040b0b28dc8be492447)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:35.993448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d27fcf-bfef-4f61-90ba-e2d86841b1f4 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:36.077051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4d27fcf-bfef-4f61-90ba-e2d86841b1f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9f2097315dd4040b0b28dc8be492447', 'request_id': 'req-c4d27fcf-bfef-4f61-90ba-e2d86841b1f4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:36.083881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4d27fcf-bfef-4f61-90ba-e2d86841b1f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9f2097315dd4040b0b28dc8be492447', 'request_id': 'req-c4d27fcf-bfef-4f61-90ba-e2d86841b1f4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:36.090134 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4d27fcf-bfef-4f61-90ba-e2d86841b1f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9f2097315dd4040b0b28dc8be492447', 'request_id': 'req-c4d27fcf-bfef-4f61-90ba-e2d86841b1f4'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:36.148380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4d27fcf-bfef-4f61-90ba-e2d86841b1f4 admin admin] The token cache is being invalidate because project a9f2097315dd4040b0b28dc8be492447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:56:36.148777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4d27fcf-bfef-4f61-90ba-e2d86841b1f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:36.149369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4d27fcf-bfef-4f61-90ba-e2d86841b1f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:36.151055 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4372/8678] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:56:35 2022] DELETE /identity/v3/projects/a9f2097315dd4040b0b28dc8be492447 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:56:36.155212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3ed1d-7bef-4d29-87c5-7003eb92f946 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:36.165847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3ed1d-7bef-4d29-87c5-7003eb92f946 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:36.222843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840a64b-f803-4186-bdd5-1364cf556bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:36.223669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840a64b-f803-4186-bdd5-1364cf556bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:36.223952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840a64b-f803-4186-bdd5-1364cf556bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:36.224230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840a64b-f803-4186-bdd5-1364cf556bd6 admin admin] PATH_INFO: `/v3/users/44ba7606896a469485f967528080ed1f` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:36.225589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840a64b-f803-4186-bdd5-1364cf556bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ba7606896a469485f967528080ed1f)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:36.227856 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840a64b-f803-4186-bdd5-1364cf556bd6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:36.370181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:56:36.372514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4840a64b-f803-4186-bdd5-1364cf556bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ba7606896a469485f967528080ed1f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:36.384613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4840a64b-f803-4186-bdd5-1364cf556bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ba7606896a469485f967528080ed1f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:36.456409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4840a64b-f803-4186-bdd5-1364cf556bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ba7606896a469485f967528080ed1f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:36.464586 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4840a64b-f803-4186-bdd5-1364cf556bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ba7606896a469485f967528080ed1f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:36.467252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-4840a64b-f803-4186-bdd5-1364cf556bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ba7606896a469485f967528080ed1f'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:36.472185 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4307/8679] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:56:36 2022] DELETE /identity/v3/users/44ba7606896a469485f967528080ed1f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:56:36.904369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d27fcf-bfef-4f61-90ba-e2d86841b1f4 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:36.905855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c4d27fcf-bfef-4f61-90ba-e2d86841b1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:36.920903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d27fcf-bfef-4f61-90ba-e2d86841b1f4 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:36.968573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:56:36.982062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9e726-9401-4829-9370-50a1ee132169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:36.982916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9e726-9401-4829-9370-50a1ee132169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:36.983236 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9e726-9401-4829-9370-50a1ee132169 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:36.983516 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9e726-9401-4829-9370-50a1ee132169 admin admin] PATH_INFO: `/v3/projects/52cd577da12e4d7f8aeb2767cc4f9584` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:36.984711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9e726-9401-4829-9370-50a1ee132169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52cd577da12e4d7f8aeb2767cc4f9584)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:36.986650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9e726-9401-4829-9370-50a1ee132169 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:37.085759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f4a9e726-9401-4829-9370-50a1ee132169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52cd577da12e4d7f8aeb2767cc4f9584', 'request_id': 'req-f4a9e726-9401-4829-9370-50a1ee132169'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:37.092559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f4a9e726-9401-4829-9370-50a1ee132169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52cd577da12e4d7f8aeb2767cc4f9584', 'request_id': 'req-f4a9e726-9401-4829-9370-50a1ee132169'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:37.098199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f4a9e726-9401-4829-9370-50a1ee132169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52cd577da12e4d7f8aeb2767cc4f9584', 'request_id': 'req-f4a9e726-9401-4829-9370-50a1ee132169'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:37.170716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f4a9e726-9401-4829-9370-50a1ee132169 admin admin] The token cache is being invalidate because project 52cd577da12e4d7f8aeb2767cc4f9584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:56:37.171036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f4a9e726-9401-4829-9370-50a1ee132169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:37.171673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f4a9e726-9401-4829-9370-50a1ee132169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:37.173228 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4373/8680] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:56:36 2022] DELETE /identity/v3/projects/52cd577da12e4d7f8aeb2767cc4f9584 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:56:37.177352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840a64b-f803-4186-bdd5-1364cf556bd6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:37.178786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4840a64b-f803-4186-bdd5-1364cf556bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:37.192504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840a64b-f803-4186-bdd5-1364cf556bd6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:37.249301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6ac4f-ce85-4e5a-98dd-25f0f36de87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:37.250173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6ac4f-ce85-4e5a-98dd-25f0f36de87a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:37.250457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6ac4f-ce85-4e5a-98dd-25f0f36de87a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:37.250738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6ac4f-ce85-4e5a-98dd-25f0f36de87a admin admin] PATH_INFO: `/v3/users/ebf31c4f74404fa28a7b83d3debaf96c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:37.251945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6ac4f-ce85-4e5a-98dd-25f0f36de87a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf31c4f74404fa28a7b83d3debaf96c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:37.253849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6ac4f-ce85-4e5a-98dd-25f0f36de87a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:37.489863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d7a6ac4f-ce85-4e5a-98dd-25f0f36de87a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf31c4f74404fa28a7b83d3debaf96c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:37.505272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d7a6ac4f-ce85-4e5a-98dd-25f0f36de87a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf31c4f74404fa28a7b83d3debaf96c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:37.559792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d7a6ac4f-ce85-4e5a-98dd-25f0f36de87a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf31c4f74404fa28a7b83d3debaf96c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:37.568535 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d7a6ac4f-ce85-4e5a-98dd-25f0f36de87a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf31c4f74404fa28a7b83d3debaf96c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:37.569358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-d7a6ac4f-ce85-4e5a-98dd-25f0f36de87a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf31c4f74404fa28a7b83d3debaf96c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:37.577382 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4308/8681] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:56:37 2022] DELETE /identity/v3/users/ebf31c4f74404fa28a7b83d3debaf96c => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:56:37.975091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9e726-9401-4829-9370-50a1ee132169 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:37.976864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f4a9e726-9401-4829-9370-50a1ee132169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:37.992978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9e726-9401-4829-9370-50a1ee132169 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:38.061031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49a14d-551b-4878-a127-d57ceb9e17d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:38.061908 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49a14d-551b-4878-a127-d57ceb9e17d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:38.062193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49a14d-551b-4878-a127-d57ceb9e17d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:38.062470 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49a14d-551b-4878-a127-d57ceb9e17d3 admin admin] PATH_INFO: `/v3/projects/f4775d6336394d3e87ab52e18bf27ee6` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:38.063807 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f49a14d-551b-4878-a127-d57ceb9e17d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4775d6336394d3e87ab52e18bf27ee6)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:38.065772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f49a14d-551b-4878-a127-d57ceb9e17d3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:38.202427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3f49a14d-551b-4878-a127-d57ceb9e17d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4775d6336394d3e87ab52e18bf27ee6', 'request_id': 'req-3f49a14d-551b-4878-a127-d57ceb9e17d3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:38.209126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3f49a14d-551b-4878-a127-d57ceb9e17d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4775d6336394d3e87ab52e18bf27ee6', 'request_id': 'req-3f49a14d-551b-4878-a127-d57ceb9e17d3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:38.215751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3f49a14d-551b-4878-a127-d57ceb9e17d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4775d6336394d3e87ab52e18bf27ee6', 'request_id': 'req-3f49a14d-551b-4878-a127-d57ceb9e17d3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:38.313098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3f49a14d-551b-4878-a127-d57ceb9e17d3 admin admin] The token cache is being invalidate because project f4775d6336394d3e87ab52e18bf27ee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:56:38.313316 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3f49a14d-551b-4878-a127-d57ceb9e17d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:38.313940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-3f49a14d-551b-4878-a127-d57ceb9e17d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:56:38.315558 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4374/8682] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:56:37 2022] DELETE /identity/v3/projects/f4775d6336394d3e87ab52e18bf27ee6 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:56:38.321017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fa665-6fa8-423e-b5ed-9530484bd574 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:38.321485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fa665-6fa8-423e-b5ed-9530484bd574 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:38.321747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fa665-6fa8-423e-b5ed-9530484bd574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:38.339824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-aa6fa665-6fa8-423e-b5ed-9530484bd574 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:56:38.341010 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-aa6fa665-6fa8-423e-b5ed-9530484bd574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:38.375931 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:56:38.402032 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4309/8683] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:56:38.409868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b4bb1-5969-49d7-9dc2-e8413cea66ac None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:38.414513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b4bb1-5969-49d7-9dc2-e8413cea66ac None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:38.414513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b4bb1-5969-49d7-9dc2-e8413cea66ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:38.426199 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:56:38.433049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-bb8b4bb1-5969-49d7-9dc2-e8413cea66ac None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:56:38.434395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-bb8b4bb1-5969-49d7-9dc2-e8413cea66ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:38.443454 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4375/8684] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:56:38.448603 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fa665-6fa8-423e-b5ed-9530484bd574 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:38.459302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fa665-6fa8-423e-b5ed-9530484bd574 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:38.465147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28779d-c28b-4293-95a0-3e0b5f2fa5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:38.471677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28779d-c28b-4293-95a0-3e0b5f2fa5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:38.471677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28779d-c28b-4293-95a0-3e0b5f2fa5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:38.471677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28779d-c28b-4293-95a0-3e0b5f2fa5e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:38.471677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28779d-c28b-4293-95a0-3e0b5f2fa5e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:56:38.471677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28779d-c28b-4293-95a0-3e0b5f2fa5e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:38.471677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28779d-c28b-4293-95a0-3e0b5f2fa5e8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:38.488331 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4310/8685] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:56:38.489956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b4bb1-5969-49d7-9dc2-e8413cea66ac None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:38.500931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b4bb1-5969-49d7-9dc2-e8413cea66ac None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:38.505660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db9f6d-6d6c-44db-80da-9d8f465defa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:38.506630 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db9f6d-6d6c-44db-80da-9d8f465defa0 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:38.506918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db9f6d-6d6c-44db-80da-9d8f465defa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:38.507224 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db9f6d-6d6c-44db-80da-9d8f465defa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:38.508048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db9f6d-6d6c-44db-80da-9d8f465defa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:38.509969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db9f6d-6d6c-44db-80da-9d8f465defa0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:38.648017 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4376/8686] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:56:38 2022] POST /identity/v3/projects => generated 365 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:56:38.652558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28779d-c28b-4293-95a0-3e0b5f2fa5e8 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:38.663415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28779d-c28b-4293-95a0-3e0b5f2fa5e8 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:38.723477 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc7ee0-ccb2-4304-ac02-c335ff1c1cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:38.724154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc7ee0-ccb2-4304-ac02-c335ff1c1cdf admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:38.724441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc7ee0-ccb2-4304-ac02-c335ff1c1cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:38.724723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc7ee0-ccb2-4304-ac02-c335ff1c1cdf admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:38.725410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc7ee0-ccb2-4304-ac02-c335ff1c1cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:38.727859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc7ee0-ccb2-4304-ac02-c335ff1c1cdf admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:38.828845 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4311/8687] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:56:38 2022] POST /identity/v3/users => generated 283 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:56:38.832993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db9f6d-6d6c-44db-80da-9d8f465defa0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:38.844493 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db9f6d-6d6c-44db-80da-9d8f465defa0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:38.849231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa0b95-6ce1-4d8c-804d-8b36fc703ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:38.849890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa0b95-6ce1-4d8c-804d-8b36fc703ccf admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:38.850179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa0b95-6ce1-4d8c-804d-8b36fc703ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:38.850475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa0b95-6ce1-4d8c-804d-8b36fc703ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:38.851248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa0b95-6ce1-4d8c-804d-8b36fc703ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:38.853419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa0b95-6ce1-4d8c-804d-8b36fc703ccf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:38.864218 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4377/8688] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:56:38.871410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc7ee0-ccb2-4304-ac02-c335ff1c1cdf admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:38.881825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc7ee0-ccb2-4304-ac02-c335ff1c1cdf admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:38.886543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c057026-8793-4709-be99-9d84734154e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:38.887227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c057026-8793-4709-be99-9d84734154e4 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:38.887516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c057026-8793-4709-be99-9d84734154e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:38.887798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c057026-8793-4709-be99-9d84734154e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:38.888553 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c057026-8793-4709-be99-9d84734154e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:38.890146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c057026-8793-4709-be99-9d84734154e4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:38.900942 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4312/8689] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:56:38.904993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa0b95-6ce1-4d8c-804d-8b36fc703ccf admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:38.916032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa0b95-6ce1-4d8c-804d-8b36fc703ccf admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:38.920918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d996d-6e01-4244-a57b-a83b3ae7302b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:38.921821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d996d-6e01-4244-a57b-a83b3ae7302b admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:38.922110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d996d-6e01-4244-a57b-a83b3ae7302b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:38.922388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d996d-6e01-4244-a57b-a83b3ae7302b admin admin] PATH_INFO: `/v3/projects/8b7e87a189654e559ead7f80ac37a90e/users/1e94e88f6c7c425aa1cae382f638ea96/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:38.937159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d996d-6e01-4244-a57b-a83b3ae7302b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b7e87a189654e559ead7f80ac37a90e, user_id=1e94e88f6c7c425aa1cae382f638ea96, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:38.939879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d996d-6e01-4244-a57b-a83b3ae7302b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:39.012124 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4378/8690] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:56:38 2022] PUT /identity/v3/projects/8b7e87a189654e559ead7f80ac37a90e/users/1e94e88f6c7c425aa1cae382f638ea96/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:56:39.023910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c46df-5f24-4bb2-86b3-017fa15b3525 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:39.024206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c46df-5f24-4bb2-86b3-017fa15b3525 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:39.024492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c46df-5f24-4bb2-86b3-017fa15b3525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:39.051341 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-db5c46df-5f24-4bb2-86b3-017fa15b3525 None None] MFA Rules not processed for user `1e94e88f6c7c425aa1cae382f638ea96`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:56:39.052563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-db5c46df-5f24-4bb2-86b3-017fa15b3525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:39.118833 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4313/8691] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:56:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:56:39.129891 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d996d-6e01-4244-a57b-a83b3ae7302b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:56:39.131792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-269d996d-6e01-4244-a57b-a83b3ae7302b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:56:39.191612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d996d-6e01-4244-a57b-a83b3ae7302b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:56:39.195849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f28389-c4de-4803-a7b5-a1aa6743dca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:56:39.196679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f28389-c4de-4803-a7b5-a1aa6743dca4 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:56:39.196962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f28389-c4de-4803-a7b5-a1aa6743dca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:56:39.197248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f28389-c4de-4803-a7b5-a1aa6743dca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:56:39.205546 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f28389-c4de-4803-a7b5-a1aa6743dca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:56:39.206972 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f28389-c4de-4803-a7b5-a1aa6743dca4 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:56:39.216996 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4379/8692] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:56:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:56:49.115801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:56:49.212776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:57:21.418223 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c46df-5f24-4bb2-86b3-017fa15b3525 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:21.622278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c46df-5f24-4bb2-86b3-017fa15b3525 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:21.626819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ccf413-d22a-481d-aeee-84b231aa93d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:21.627753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccf413-d22a-481d-aeee-84b231aa93d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:21.628041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccf413-d22a-481d-aeee-84b231aa93d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:21.628319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccf413-d22a-481d-aeee-84b231aa93d2 admin admin] PATH_INFO: `/v3/users/1e94e88f6c7c425aa1cae382f638ea96` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:21.629506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ccf413-d22a-481d-aeee-84b231aa93d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e94e88f6c7c425aa1cae382f638ea96)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:21.631448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ccf413-d22a-481d-aeee-84b231aa93d2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:21.783374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c7ccf413-d22a-481d-aeee-84b231aa93d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e94e88f6c7c425aa1cae382f638ea96'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:21.795018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c7ccf413-d22a-481d-aeee-84b231aa93d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e94e88f6c7c425aa1cae382f638ea96'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:21.901985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c7ccf413-d22a-481d-aeee-84b231aa93d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e94e88f6c7c425aa1cae382f638ea96'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:21.910131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c7ccf413-d22a-481d-aeee-84b231aa93d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e94e88f6c7c425aa1cae382f638ea96'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:21.910817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c7ccf413-d22a-481d-aeee-84b231aa93d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e94e88f6c7c425aa1cae382f638ea96'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:21.916838 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4314/8693] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:57:21 2022] DELETE /identity/v3/users/1e94e88f6c7c425aa1cae382f638ea96 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:57:21.921378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184fb78-1d56-4d36-978b-c00db8b389c7 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:21.921859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184fb78-1d56-4d36-978b-c00db8b389c7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:21.921973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184fb78-1d56-4d36-978b-c00db8b389c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:21.938947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8184fb78-1d56-4d36-978b-c00db8b389c7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:57:21.940695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8184fb78-1d56-4d36-978b-c00db8b389c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:21.998526 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4380/8694] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:57:22.008688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ccf413-d22a-481d-aeee-84b231aa93d2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:22.010076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c7ccf413-d22a-481d-aeee-84b231aa93d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:22.068083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ccf413-d22a-481d-aeee-84b231aa93d2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:22.071929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a779006-05f9-4555-968d-4abad1fe535e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:22.072642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a779006-05f9-4555-968d-4abad1fe535e service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:22.072929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a779006-05f9-4555-968d-4abad1fe535e service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:22.073207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a779006-05f9-4555-968d-4abad1fe535e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:22.082414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a779006-05f9-4555-968d-4abad1fe535e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:22.083876 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a779006-05f9-4555-968d-4abad1fe535e service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:22.093582 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4315/8695] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:57:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:57:22.514343 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184fb78-1d56-4d36-978b-c00db8b389c7 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:22.515861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8184fb78-1d56-4d36-978b-c00db8b389c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:22.528307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184fb78-1d56-4d36-978b-c00db8b389c7 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:22.535545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea30ca-7820-4ca2-8d4e-1ed349882d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:22.536603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea30ca-7820-4ca2-8d4e-1ed349882d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:22.536968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea30ca-7820-4ca2-8d4e-1ed349882d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:22.537204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea30ca-7820-4ca2-8d4e-1ed349882d75 admin admin] PATH_INFO: `/v3/projects/8b7e87a189654e559ead7f80ac37a90e` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:22.539245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea30ca-7820-4ca2-8d4e-1ed349882d75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b7e87a189654e559ead7f80ac37a90e)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:22.541633 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea30ca-7820-4ca2-8d4e-1ed349882d75 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:22.645844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-73ea30ca-7820-4ca2-8d4e-1ed349882d75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b7e87a189654e559ead7f80ac37a90e', 'request_id': 'req-73ea30ca-7820-4ca2-8d4e-1ed349882d75'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:22.652403 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-73ea30ca-7820-4ca2-8d4e-1ed349882d75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b7e87a189654e559ead7f80ac37a90e', 'request_id': 'req-73ea30ca-7820-4ca2-8d4e-1ed349882d75'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:22.657974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-73ea30ca-7820-4ca2-8d4e-1ed349882d75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b7e87a189654e559ead7f80ac37a90e', 'request_id': 'req-73ea30ca-7820-4ca2-8d4e-1ed349882d75'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:22.724480 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-73ea30ca-7820-4ca2-8d4e-1ed349882d75 admin admin] The token cache is being invalidate because project 8b7e87a189654e559ead7f80ac37a90e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:57:22.724780 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-73ea30ca-7820-4ca2-8d4e-1ed349882d75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:22.725382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-73ea30ca-7820-4ca2-8d4e-1ed349882d75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:22.726951 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4381/8696] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:57:22 2022] DELETE /identity/v3/projects/8b7e87a189654e559ead7f80ac37a90e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:57:22.732135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b028aef-7182-4e2d-9214-930c8b3331ca None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:22.732631 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b028aef-7182-4e2d-9214-930c8b3331ca None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:22.732736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b028aef-7182-4e2d-9214-930c8b3331ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:22.751732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6b028aef-7182-4e2d-9214-930c8b3331ca None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:57:22.753431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6b028aef-7182-4e2d-9214-930c8b3331ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:22.770299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:57:22.812514 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4316/8697] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:57:22.820445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbc285-6dab-4a12-95c3-53c4d89c1211 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:22.820746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbc285-6dab-4a12-95c3-53c4d89c1211 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:22.821026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbc285-6dab-4a12-95c3-53c4d89c1211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:22.839936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ebfbc285-6dab-4a12-95c3-53c4d89c1211 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:57:22.841405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ebfbc285-6dab-4a12-95c3-53c4d89c1211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:22.850340 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4382/8698] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:57:22.854682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b028aef-7182-4e2d-9214-930c8b3331ca None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:22.865210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b028aef-7182-4e2d-9214-930c8b3331ca None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:22.870670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131604e-4f5b-4c39-866a-02a5ff59dbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:22.871378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131604e-4f5b-4c39-866a-02a5ff59dbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:22.871663 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131604e-4f5b-4c39-866a-02a5ff59dbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:22.871940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131604e-4f5b-4c39-866a-02a5ff59dbd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:22.872662 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131604e-4f5b-4c39-866a-02a5ff59dbd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:57:22.872968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131604e-4f5b-4c39-866a-02a5ff59dbd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:22.874579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131604e-4f5b-4c39-866a-02a5ff59dbd6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:22.886330 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4317/8699] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:57:22.890679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbc285-6dab-4a12-95c3-53c4d89c1211 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:22.900796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbc285-6dab-4a12-95c3-53c4d89c1211 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:22.905558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3c103-72f4-4a25-bb13-5681baba6204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:22.906205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3c103-72f4-4a25-bb13-5681baba6204 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:22.906490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3c103-72f4-4a25-bb13-5681baba6204 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:22.906768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3c103-72f4-4a25-bb13-5681baba6204 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:22.907485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3c103-72f4-4a25-bb13-5681baba6204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:22.910062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3c103-72f4-4a25-bb13-5681baba6204 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:22.994544 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4383/8700] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:57:22 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:57:22.998575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131604e-4f5b-4c39-866a-02a5ff59dbd6 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:23.009131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131604e-4f5b-4c39-866a-02a5ff59dbd6 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:23.067563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b4adb-573e-4d63-ae82-037170215acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:23.068155 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b4adb-573e-4d63-ae82-037170215acc admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:23.068441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b4adb-573e-4d63-ae82-037170215acc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:23.068719 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b4adb-573e-4d63-ae82-037170215acc admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:23.069416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b4adb-573e-4d63-ae82-037170215acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:23.071348 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b4adb-573e-4d63-ae82-037170215acc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:23.159861 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4318/8701] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:57:22 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:57:23.164102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3c103-72f4-4a25-bb13-5681baba6204 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:23.174719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3c103-72f4-4a25-bb13-5681baba6204 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:23.179580 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898f1ec-0df5-4cb9-85f0-18d22b0c7ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:23.180238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898f1ec-0df5-4cb9-85f0-18d22b0c7ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:23.180524 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898f1ec-0df5-4cb9-85f0-18d22b0c7ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:23.180805 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898f1ec-0df5-4cb9-85f0-18d22b0c7ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:23.181527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898f1ec-0df5-4cb9-85f0-18d22b0c7ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:23.183164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898f1ec-0df5-4cb9-85f0-18d22b0c7ff2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:23.194610 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4384/8702] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:57:23.198836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b4adb-573e-4d63-ae82-037170215acc admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:23.209849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b4adb-573e-4d63-ae82-037170215acc admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:23.214793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec94ff-99e5-4423-9e38-cb2c549eac47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:23.215748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec94ff-99e5-4423-9e38-cb2c549eac47 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:23.216034 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec94ff-99e5-4423-9e38-cb2c549eac47 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:23.216312 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec94ff-99e5-4423-9e38-cb2c549eac47 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:23.217039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec94ff-99e5-4423-9e38-cb2c549eac47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:23.218770 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec94ff-99e5-4423-9e38-cb2c549eac47 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:23.229631 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4319/8703] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:57:23.233775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898f1ec-0df5-4cb9-85f0-18d22b0c7ff2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:23.244607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898f1ec-0df5-4cb9-85f0-18d22b0c7ff2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:23.249276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aab50-156b-4e65-a412-502c702f6276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:23.250152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aab50-156b-4e65-a412-502c702f6276 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:23.250435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aab50-156b-4e65-a412-502c702f6276 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:23.250713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aab50-156b-4e65-a412-502c702f6276 admin admin] PATH_INFO: `/v3/projects/75bd5212259b4488bee2bd9d5b431e2f/users/1ca3d30cd5c342a5a0118e6553b92c87/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:23.266979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1aab50-156b-4e65-a412-502c702f6276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75bd5212259b4488bee2bd9d5b431e2f, user_id=1ca3d30cd5c342a5a0118e6553b92c87, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:23.270333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1aab50-156b-4e65-a412-502c702f6276 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:23.359754 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4385/8704] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:57:23 2022] PUT /identity/v3/projects/75bd5212259b4488bee2bd9d5b431e2f/users/1ca3d30cd5c342a5a0118e6553b92c87/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:57:23.371466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839f27a-b65c-4f81-a910-98c36d80a5a3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:23.371839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839f27a-b65c-4f81-a910-98c36d80a5a3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:23.372183 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839f27a-b65c-4f81-a910-98c36d80a5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:23.398866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c839f27a-b65c-4f81-a910-98c36d80a5a3 None None] MFA Rules not processed for user `1ca3d30cd5c342a5a0118e6553b92c87`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:57:23.400120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c839f27a-b65c-4f81-a910-98c36d80a5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:23.463151 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4320/8705] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:57:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:57:23.474851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aab50-156b-4e65-a412-502c702f6276 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:23.476574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9d1aab50-156b-4e65-a412-502c702f6276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:23.499370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:57:23.536418 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aab50-156b-4e65-a412-502c702f6276 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:23.540240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3408a9d-0642-439d-b754-5e522c95599c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:23.541128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3408a9d-0642-439d-b754-5e522c95599c service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:23.541432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3408a9d-0642-439d-b754-5e522c95599c service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:23.541881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3408a9d-0642-439d-b754-5e522c95599c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:23.552066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3408a9d-0642-439d-b754-5e522c95599c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:23.554206 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3408a9d-0642-439d-b754-5e522c95599c service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:23.562621 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4386/8706] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:57:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:57:23.588328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839f27a-b65c-4f81-a910-98c36d80a5a3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:23.607656 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:57:23.651992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839f27a-b65c-4f81-a910-98c36d80a5a3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:23.656712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdade0-a52b-4898-99c9-bde6236461fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:23.657578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdade0-a52b-4898-99c9-bde6236461fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:23.657867 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdade0-a52b-4898-99c9-bde6236461fe admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:23.658143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdade0-a52b-4898-99c9-bde6236461fe admin admin] PATH_INFO: `/v3/users/1ca3d30cd5c342a5a0118e6553b92c87` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:23.659408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdade0-a52b-4898-99c9-bde6236461fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ca3d30cd5c342a5a0118e6553b92c87)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:23.661400 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdade0-a52b-4898-99c9-bde6236461fe admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:23.834880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-54bdade0-a52b-4898-99c9-bde6236461fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ca3d30cd5c342a5a0118e6553b92c87'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:23.847918 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-54bdade0-a52b-4898-99c9-bde6236461fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ca3d30cd5c342a5a0118e6553b92c87'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:23.901545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-54bdade0-a52b-4898-99c9-bde6236461fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ca3d30cd5c342a5a0118e6553b92c87'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:23.911470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-54bdade0-a52b-4898-99c9-bde6236461fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ca3d30cd5c342a5a0118e6553b92c87'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:23.911470 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-54bdade0-a52b-4898-99c9-bde6236461fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ca3d30cd5c342a5a0118e6553b92c87'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:23.916674 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4321/8707] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:57:23 2022] DELETE /identity/v3/users/1ca3d30cd5c342a5a0118e6553b92c87 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:57:23.921200 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e4dbc-f58c-48ef-84d0-f979245e841b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:23.921491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e4dbc-f58c-48ef-84d0-f979245e841b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:23.921792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e4dbc-f58c-48ef-84d0-f979245e841b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:23.939561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7c0e4dbc-f58c-48ef-84d0-f979245e841b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:57:23.940819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7c0e4dbc-f58c-48ef-84d0-f979245e841b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:24.001128 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4387/8708] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:57:24.011241 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdade0-a52b-4898-99c9-bde6236461fe admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:24.013163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-54bdade0-a52b-4898-99c9-bde6236461fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:24.071225 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdade0-a52b-4898-99c9-bde6236461fe admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:24.074934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb25d39-9f95-410f-a633-563bf4b8a8bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:24.075613 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb25d39-9f95-410f-a633-563bf4b8a8bc service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:24.075892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb25d39-9f95-410f-a633-563bf4b8a8bc service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:24.076162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb25d39-9f95-410f-a633-563bf4b8a8bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:24.085281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb25d39-9f95-410f-a633-563bf4b8a8bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:24.086729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb25d39-9f95-410f-a633-563bf4b8a8bc service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:24.097976 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4322/8709] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:57:24.463919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e4dbc-f58c-48ef-84d0-f979245e841b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:24.465666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7c0e4dbc-f58c-48ef-84d0-f979245e841b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:24.482930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e4dbc-f58c-48ef-84d0-f979245e841b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:24.487995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f489b96-d1b0-4716-bc47-46bc897a1471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:24.488870 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f489b96-d1b0-4716-bc47-46bc897a1471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:24.489287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f489b96-d1b0-4716-bc47-46bc897a1471 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:24.489514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f489b96-d1b0-4716-bc47-46bc897a1471 admin admin] PATH_INFO: `/v3/projects/75bd5212259b4488bee2bd9d5b431e2f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:24.491090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f489b96-d1b0-4716-bc47-46bc897a1471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75bd5212259b4488bee2bd9d5b431e2f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:24.492932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f489b96-d1b0-4716-bc47-46bc897a1471 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:24.581935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f489b96-d1b0-4716-bc47-46bc897a1471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75bd5212259b4488bee2bd9d5b431e2f', 'request_id': 'req-1f489b96-d1b0-4716-bc47-46bc897a1471'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:24.589161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f489b96-d1b0-4716-bc47-46bc897a1471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75bd5212259b4488bee2bd9d5b431e2f', 'request_id': 'req-1f489b96-d1b0-4716-bc47-46bc897a1471'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:24.595185 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f489b96-d1b0-4716-bc47-46bc897a1471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75bd5212259b4488bee2bd9d5b431e2f', 'request_id': 'req-1f489b96-d1b0-4716-bc47-46bc897a1471'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:24.643458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f489b96-d1b0-4716-bc47-46bc897a1471 admin admin] The token cache is being invalidate because project 75bd5212259b4488bee2bd9d5b431e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:57:24.643754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f489b96-d1b0-4716-bc47-46bc897a1471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:24.644385 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f489b96-d1b0-4716-bc47-46bc897a1471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:24.646824 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4388/8710] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:57:24 2022] DELETE /identity/v3/projects/75bd5212259b4488bee2bd9d5b431e2f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:57:34.092355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:57:34.640337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:57:35.126994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429e646-f5ef-45c4-8f50-66cd054a56c4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:35.127552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429e646-f5ef-45c4-8f50-66cd054a56c4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:35.127552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429e646-f5ef-45c4-8f50-66cd054a56c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:35.146149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8429e646-f5ef-45c4-8f50-66cd054a56c4 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:57:35.147373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8429e646-f5ef-45c4-8f50-66cd054a56c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:35.205753 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4323/8711] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:57:35.216038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6fff2-57cf-4700-b97a-90a956c336e2 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:35.216335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6fff2-57cf-4700-b97a-90a956c336e2 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:35.216612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6fff2-57cf-4700-b97a-90a956c336e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:35.236312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d5b6fff2-57cf-4700-b97a-90a956c336e2 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:57:35.237571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d5b6fff2-57cf-4700-b97a-90a956c336e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:35.246418 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4389/8712] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:57:35.251280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429e646-f5ef-45c4-8f50-66cd054a56c4 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:35.261760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429e646-f5ef-45c4-8f50-66cd054a56c4 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:35.266347 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253558cb-3d64-43d5-80a6-875022681844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:35.267039 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253558cb-3d64-43d5-80a6-875022681844 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:35.267440 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253558cb-3d64-43d5-80a6-875022681844 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:35.267716 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253558cb-3d64-43d5-80a6-875022681844 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:35.268437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253558cb-3d64-43d5-80a6-875022681844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:57:35.268739 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253558cb-3d64-43d5-80a6-875022681844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:35.270628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253558cb-3d64-43d5-80a6-875022681844 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:35.282228 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4324/8713] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:57:35.291744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6fff2-57cf-4700-b97a-90a956c336e2 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:35.301906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6fff2-57cf-4700-b97a-90a956c336e2 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:35.307176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be2cf5-156f-4732-8f0b-4a8c132b625e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:35.307308 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be2cf5-156f-4732-8f0b-4a8c132b625e admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:35.307559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be2cf5-156f-4732-8f0b-4a8c132b625e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:35.307837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be2cf5-156f-4732-8f0b-4a8c132b625e admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:35.308518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be2cf5-156f-4732-8f0b-4a8c132b625e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:35.310428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be2cf5-156f-4732-8f0b-4a8c132b625e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:35.382373 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4390/8714] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:57:35 2022] POST /identity/v3/projects => generated 391 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:57:35.386675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253558cb-3d64-43d5-80a6-875022681844 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:35.397045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253558cb-3d64-43d5-80a6-875022681844 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:35.452423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911c395-4daa-4384-b580-426985e847a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:35.453079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911c395-4daa-4384-b580-426985e847a9 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:35.453358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911c395-4daa-4384-b580-426985e847a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:35.453630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911c395-4daa-4384-b580-426985e847a9 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:35.454297 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911c395-4daa-4384-b580-426985e847a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:35.456227 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911c395-4daa-4384-b580-426985e847a9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:35.518343 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4325/8715] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:57:35 2022] POST /identity/v3/users => generated 296 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:57:35.523099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be2cf5-156f-4732-8f0b-4a8c132b625e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:35.533602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be2cf5-156f-4732-8f0b-4a8c132b625e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:35.539400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe40c98-0d21-4105-a8bc-a9f089342540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:35.540085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe40c98-0d21-4105-a8bc-a9f089342540 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:35.540366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe40c98-0d21-4105-a8bc-a9f089342540 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:35.540638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe40c98-0d21-4105-a8bc-a9f089342540 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:35.541351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe40c98-0d21-4105-a8bc-a9f089342540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:35.542938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe40c98-0d21-4105-a8bc-a9f089342540 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:35.553568 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4391/8716] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:57:35.557550 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911c395-4daa-4384-b580-426985e847a9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:35.567721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911c395-4daa-4384-b580-426985e847a9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:35.572494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f371d1-8f7a-44e7-9e05-34103b85cb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:35.573107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f371d1-8f7a-44e7-9e05-34103b85cb39 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:35.573393 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f371d1-8f7a-44e7-9e05-34103b85cb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:35.573679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f371d1-8f7a-44e7-9e05-34103b85cb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:35.574399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f371d1-8f7a-44e7-9e05-34103b85cb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:35.576026 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f371d1-8f7a-44e7-9e05-34103b85cb39 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:35.587515 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4326/8717] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:57:35.591823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe40c98-0d21-4105-a8bc-a9f089342540 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:35.603154 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe40c98-0d21-4105-a8bc-a9f089342540 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:35.607735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a4b47-0442-4a4f-965b-a818d13a31bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:35.608588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a4b47-0442-4a4f-965b-a818d13a31bf admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:35.608863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a4b47-0442-4a4f-965b-a818d13a31bf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:35.609133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a4b47-0442-4a4f-965b-a818d13a31bf admin admin] PATH_INFO: `/v3/projects/46b1acf286d840738d93acc4ee506029/users/92d1d7ddc009428bb340e9c6f20aa7f3/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:35.623734 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a4b47-0442-4a4f-965b-a818d13a31bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b1acf286d840738d93acc4ee506029, user_id=92d1d7ddc009428bb340e9c6f20aa7f3, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:35.626381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a4b47-0442-4a4f-965b-a818d13a31bf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:35.701323 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4392/8718] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:57:35 2022] PUT /identity/v3/projects/46b1acf286d840738d93acc4ee506029/users/92d1d7ddc009428bb340e9c6f20aa7f3/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 21:57:35.715305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e696b4b-9faa-478c-a726-30b94584ad45 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:35.715610 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e696b4b-9faa-478c-a726-30b94584ad45 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:35.715907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e696b4b-9faa-478c-a726-30b94584ad45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:35.742848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0e696b4b-9faa-478c-a726-30b94584ad45 None None] MFA Rules not processed for user `92d1d7ddc009428bb340e9c6f20aa7f3`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:57:35.744121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0e696b4b-9faa-478c-a726-30b94584ad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:35.799608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:57:35.808580 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4327/8719] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:57:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:57:35.813268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a4b47-0442-4a4f-965b-a818d13a31bf admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:35.876739 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a4b47-0442-4a4f-965b-a818d13a31bf admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:35.881946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb3645-03ca-4521-b6bf-b61817e0b61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:35.882593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb3645-03ca-4521-b6bf-b61817e0b61b admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:35.882873 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb3645-03ca-4521-b6bf-b61817e0b61b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:35.883180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb3645-03ca-4521-b6bf-b61817e0b61b admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:35.883980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb3645-03ca-4521-b6bf-b61817e0b61b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:35.885942 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb3645-03ca-4521-b6bf-b61817e0b61b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:35.982994 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4393/8720] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:57:35 2022] POST /identity/v3/projects => generated 393 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:57:35.987140 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e696b4b-9faa-478c-a726-30b94584ad45 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:35.998127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e696b4b-9faa-478c-a726-30b94584ad45 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:36.055942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d1a1e-de46-447f-85f7-bc3c8472d0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:36.056617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d1a1e-de46-447f-85f7-bc3c8472d0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:36.056898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d1a1e-de46-447f-85f7-bc3c8472d0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:36.057170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d1a1e-de46-447f-85f7-bc3c8472d0c1 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:36.057860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d1a1e-de46-447f-85f7-bc3c8472d0c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:36.059872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d1a1e-de46-447f-85f7-bc3c8472d0c1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:36.141892 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4328/8721] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:57:35 2022] POST /identity/v3/users => generated 303 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:57:36.146310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb3645-03ca-4521-b6bf-b61817e0b61b admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:36.156737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb3645-03ca-4521-b6bf-b61817e0b61b admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:36.161467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba6ce6-3837-493c-a467-628016a10945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:36.162051 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba6ce6-3837-493c-a467-628016a10945 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:36.162331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba6ce6-3837-493c-a467-628016a10945 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:36.162604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba6ce6-3837-493c-a467-628016a10945 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:36.163360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba6ce6-3837-493c-a467-628016a10945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:36.164957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba6ce6-3837-493c-a467-628016a10945 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:36.175597 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4394/8722] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:57:36.179982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d1a1e-de46-447f-85f7-bc3c8472d0c1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:36.190551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d1a1e-de46-447f-85f7-bc3c8472d0c1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:36.196104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5bfd63-a73f-463c-bea8-9a4518f3e1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:36.197136 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bfd63-a73f-463c-bea8-9a4518f3e1ec admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:36.197413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bfd63-a73f-463c-bea8-9a4518f3e1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:36.197689 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bfd63-a73f-463c-bea8-9a4518f3e1ec admin admin] PATH_INFO: `/v3/projects/1ffacafb54b044fb8e92ffb08136d1d2/users/2b7eba2f41e342d39333caabc176932c/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:36.213353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5bfd63-a73f-463c-bea8-9a4518f3e1ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ffacafb54b044fb8e92ffb08136d1d2, user_id=2b7eba2f41e342d39333caabc176932c, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:36.216335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5bfd63-a73f-463c-bea8-9a4518f3e1ec admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:36.290299 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4329/8723] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:57:36 2022] PUT /identity/v3/projects/1ffacafb54b044fb8e92ffb08136d1d2/users/2b7eba2f41e342d39333caabc176932c/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:57:36.294342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba6ce6-3837-493c-a467-628016a10945 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:36.305445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba6ce6-3837-493c-a467-628016a10945 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:36.365465 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f96588-5b95-4e87-aec0-531018b4a042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:36.366120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f96588-5b95-4e87-aec0-531018b4a042 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:36.366404 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f96588-5b95-4e87-aec0-531018b4a042 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:36.366682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f96588-5b95-4e87-aec0-531018b4a042 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:36.367528 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f96588-5b95-4e87-aec0-531018b4a042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:36.369191 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f96588-5b95-4e87-aec0-531018b4a042 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:36.383387 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4395/8724] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:57:36.384638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5bfd63-a73f-463c-bea8-9a4518f3e1ec admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:36.395169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5bfd63-a73f-463c-bea8-9a4518f3e1ec admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:36.399809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be9b7c-1a6b-47c2-a7f9-2ae953598f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:36.400715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be9b7c-1a6b-47c2-a7f9-2ae953598f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:36.401070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be9b7c-1a6b-47c2-a7f9-2ae953598f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:36.401399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be9b7c-1a6b-47c2-a7f9-2ae953598f55 admin admin] PATH_INFO: `/v3/projects/1ffacafb54b044fb8e92ffb08136d1d2/users/2b7eba2f41e342d39333caabc176932c/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:36.403435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be9b7c-1a6b-47c2-a7f9-2ae953598f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ffacafb54b044fb8e92ffb08136d1d2, user_id=2b7eba2f41e342d39333caabc176932c, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:36.406096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be9b7c-1a6b-47c2-a7f9-2ae953598f55 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:36.416726 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4330/8725] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:57:36 2022] PUT /identity/v3/projects/1ffacafb54b044fb8e92ffb08136d1d2/users/2b7eba2f41e342d39333caabc176932c/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:57:36.434190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11080e-bd91-4061-82f3-4fc7e7b2051b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:36.434486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11080e-bd91-4061-82f3-4fc7e7b2051b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:36.434767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11080e-bd91-4061-82f3-4fc7e7b2051b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:36.448176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:57:36.462305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5a11080e-bd91-4061-82f3-4fc7e7b2051b None None] MFA Rules not processed for user `2b7eba2f41e342d39333caabc176932c`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:57:36.465548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5a11080e-bd91-4061-82f3-4fc7e7b2051b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:36.532418 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4396/8726] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:57:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:57:36.549627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8137c6b-42bc-4399-bfb4-4c48f6eacb36 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:36.549854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8137c6b-42bc-4399-bfb4-4c48f6eacb36 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:36.550134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8137c6b-42bc-4399-bfb4-4c48f6eacb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:36.568703 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e8137c6b-42bc-4399-bfb4-4c48f6eacb36 None None] MFA Rules not processed for user `92d1d7ddc009428bb340e9c6f20aa7f3`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:57:36.569890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e8137c6b-42bc-4399-bfb4-4c48f6eacb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:36.624377 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4331/8727] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:57:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:57:36.639567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11080e-bd91-4061-82f3-4fc7e7b2051b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:36.644456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5a11080e-bd91-4061-82f3-4fc7e7b2051b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:36.739161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11080e-bd91-4061-82f3-4fc7e7b2051b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:36.745061 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfc5c8-e0be-4c9a-b8e5-ebb207b35f28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:36.745738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfc5c8-e0be-4c9a-b8e5-ebb207b35f28 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:36.746020 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfc5c8-e0be-4c9a-b8e5-ebb207b35f28 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:36.746298 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfc5c8-e0be-4c9a-b8e5-ebb207b35f28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:36.754663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfc5c8-e0be-4c9a-b8e5-ebb207b35f28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:36.756320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfc5c8-e0be-4c9a-b8e5-ebb207b35f28 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:36.765190 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4397/8728] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:57:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:57:38.346607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be53c38-79d9-4558-9e44-a63113da9f2b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:38.347080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be53c38-79d9-4558-9e44-a63113da9f2b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:38.347186 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be53c38-79d9-4558-9e44-a63113da9f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:38.384434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5be53c38-79d9-4558-9e44-a63113da9f2b None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:57:38.386749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5be53c38-79d9-4558-9e44-a63113da9f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:38.421065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:57:38.453325 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4332/8729] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:57:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:57:38.467291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfc5c8-e0be-4c9a-b8e5-ebb207b35f28 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:38.468745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d5bfc5c8-e0be-4c9a-b8e5-ebb207b35f28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:38.487425 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfc5c8-e0be-4c9a-b8e5-ebb207b35f28 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:38.492687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179a98a-9aa4-420c-b3b8-3d63d4e9543b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:38.493333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179a98a-9aa4-420c-b3b8-3d63d4e9543b service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:38.493607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179a98a-9aa4-420c-b3b8-3d63d4e9543b service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:38.493889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179a98a-9aa4-420c-b3b8-3d63d4e9543b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:38.503517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179a98a-9aa4-420c-b3b8-3d63d4e9543b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:38.506126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179a98a-9aa4-420c-b3b8-3d63d4e9543b service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:38.520414 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4398/8730] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:57:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:57:48.515826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=79 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:57:48.523975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=11 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:57:50.081880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be53c38-79d9-4558-9e44-a63113da9f2b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:50.083992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5be53c38-79d9-4558-9e44-a63113da9f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:50.102564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be53c38-79d9-4558-9e44-a63113da9f2b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:50.108202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcd755-4588-4ef3-bef6-09470f47ad50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:50.108850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcd755-4588-4ef3-bef6-09470f47ad50 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:50.109134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcd755-4588-4ef3-bef6-09470f47ad50 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:50.109414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcd755-4588-4ef3-bef6-09470f47ad50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:50.118188 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcd755-4588-4ef3-bef6-09470f47ad50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:50.119812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcd755-4588-4ef3-bef6-09470f47ad50 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:50.130048 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4333/8731] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:57:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:57:50.143713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d7d7d-a48f-461b-808a-86d5eb0f2129 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:50.149195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d7d7d-a48f-461b-808a-86d5eb0f2129 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:50.149195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d7d7d-a48f-461b-808a-86d5eb0f2129 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:50.149195 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4399/8732] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:57:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:57:50.151157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcd755-4588-4ef3-bef6-09470f47ad50 service nova] Authenticating service token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:57:50.164932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcd755-4588-4ef3-bef6-09470f47ad50 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:50.173497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcd755-4588-4ef3-bef6-09470f47ad50 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:50.178316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e7362-9cc0-4f97-a2b3-1f3f2a95a97b tempest-ServersAdminNegativeTestJSON-1082789623 tempest-ServersAdminNegativeTestJSON-1082789623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b7eba2f41e342d39333caabc176932c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ffacafb54b044fb8e92ffb08136d1d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:50.179212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e7362-9cc0-4f97-a2b3-1f3f2a95a97b tempest-ServersAdminNegativeTestJSON-1082789623 tempest-ServersAdminNegativeTestJSON-1082789623-project-admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:50.179504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e7362-9cc0-4f97-a2b3-1f3f2a95a97b tempest-ServersAdminNegativeTestJSON-1082789623 tempest-ServersAdminNegativeTestJSON-1082789623-project-admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:50.179786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e7362-9cc0-4f97-a2b3-1f3f2a95a97b tempest-ServersAdminNegativeTestJSON-1082789623 tempest-ServersAdminNegativeTestJSON-1082789623-project-admin] PATH_INFO: `/v3/projects/1ffacafb54b044fb8e92ffb08136d1d2` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:50.180992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e7362-9cc0-4f97-a2b3-1f3f2a95a97b tempest-ServersAdminNegativeTestJSON-1082789623 tempest-ServersAdminNegativeTestJSON-1082789623-project-admin] RBAC: Authorizing `identity:get_project(project_id=1ffacafb54b044fb8e92ffb08136d1d2)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:50.182790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e7362-9cc0-4f97-a2b3-1f3f2a95a97b tempest-ServersAdminNegativeTestJSON-1082789623 tempest-ServersAdminNegativeTestJSON-1082789623-project-admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:50.184537 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4334/8733] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:57:50 2022] GET /identity/v3/projects/1ffacafb54b044fb8e92ffb08136d1d2 => generated 393 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 21:57:50.421789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d7d7d-a48f-461b-808a-86d5eb0f2129 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:50.423514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f86d7d7d-a48f-461b-808a-86d5eb0f2129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:50.483262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d7d7d-a48f-461b-808a-86d5eb0f2129 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:50.486776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303c872-f046-4023-ab3c-8d248e0fc702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:50.487440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303c872-f046-4023-ab3c-8d248e0fc702 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:50.487720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303c872-f046-4023-ab3c-8d248e0fc702 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:50.487991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303c872-f046-4023-ab3c-8d248e0fc702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:50.490762 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a303c872-f046-4023-ab3c-8d248e0fc702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:50.502740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303c872-f046-4023-ab3c-8d248e0fc702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:50.504188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303c872-f046-4023-ab3c-8d248e0fc702 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:50.514411 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4400/8734] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:57:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:57:50.734288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225ff3e-616d-48a2-aa7a-3ffee027be6d None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:50.734606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225ff3e-616d-48a2-aa7a-3ffee027be6d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:50.734884 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225ff3e-616d-48a2-aa7a-3ffee027be6d None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:50.736363 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4335/8735] 10.222.0.16 () {54 vars in 912 bytes} [Sat Jul 16 21:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:57:50.741121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303c872-f046-4023-ab3c-8d248e0fc702 service neutron] Authenticating service token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 16 21:57:50.756738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303c872-f046-4023-ab3c-8d248e0fc702 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:50.766054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303c872-f046-4023-ab3c-8d248e0fc702 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:50.771162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d065b-5d05-487c-9b11-973d89b81e0d tempest-ServersAdminNegativeTestJSON-1082789623 tempest-ServersAdminNegativeTestJSON-1082789623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b7eba2f41e342d39333caabc176932c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ffacafb54b044fb8e92ffb08136d1d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:50.772005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d065b-5d05-487c-9b11-973d89b81e0d tempest-ServersAdminNegativeTestJSON-1082789623 tempest-ServersAdminNegativeTestJSON-1082789623-project-admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:50.772292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d065b-5d05-487c-9b11-973d89b81e0d tempest-ServersAdminNegativeTestJSON-1082789623 tempest-ServersAdminNegativeTestJSON-1082789623-project-admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:50.772569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d065b-5d05-487c-9b11-973d89b81e0d tempest-ServersAdminNegativeTestJSON-1082789623 tempest-ServersAdminNegativeTestJSON-1082789623-project-admin] PATH_INFO: `/v3/projects/1ffacafb54b044fb8e92ffb08136d1d2` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:50.773758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d065b-5d05-487c-9b11-973d89b81e0d tempest-ServersAdminNegativeTestJSON-1082789623 tempest-ServersAdminNegativeTestJSON-1082789623-project-admin] RBAC: Authorizing `identity:get_project(project_id=1ffacafb54b044fb8e92ffb08136d1d2)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:50.775586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d065b-5d05-487c-9b11-973d89b81e0d tempest-ServersAdminNegativeTestJSON-1082789623 tempest-ServersAdminNegativeTestJSON-1082789623-project-admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:50.777280 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4401/8736] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Jul 16 21:57:50 2022] GET /identity/v3/projects/1ffacafb54b044fb8e92ffb08136d1d2 => generated 393 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:57:50.980060 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225ff3e-616d-48a2-aa7a-3ffee027be6d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:50.991111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225ff3e-616d-48a2-aa7a-3ffee027be6d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:50.994582 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fe389-b250-4fed-83eb-b4407e957cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:50.995266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fe389-b250-4fed-83eb-b4407e957cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:50.995580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fe389-b250-4fed-83eb-b4407e957cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:50.995851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fe389-b250-4fed-83eb-b4407e957cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:50.997605 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6d5fe389-b250-4fed-83eb-b4407e957cf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:51.010127 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fe389-b250-4fed-83eb-b4407e957cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:51.011587 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fe389-b250-4fed-83eb-b4407e957cf1 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:51.022536 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4336/8737] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:57:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:57:54.985921 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d065b-5d05-487c-9b11-973d89b81e0d tempest-ServersAdminNegativeTestJSON-1082789623 tempest-ServersAdminNegativeTestJSON-1082789623-project-admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:55.048391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d065b-5d05-487c-9b11-973d89b81e0d tempest-ServersAdminNegativeTestJSON-1082789623 tempest-ServersAdminNegativeTestJSON-1082789623-project-admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:55.053179 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0cd17-7d79-4d8c-a776-bdf49ff3f799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:55.054036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0cd17-7d79-4d8c-a776-bdf49ff3f799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:55.054319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0cd17-7d79-4d8c-a776-bdf49ff3f799 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:55.054593 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0cd17-7d79-4d8c-a776-bdf49ff3f799 admin admin] PATH_INFO: `/v3/users/92d1d7ddc009428bb340e9c6f20aa7f3` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:55.055862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0cd17-7d79-4d8c-a776-bdf49ff3f799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92d1d7ddc009428bb340e9c6f20aa7f3)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:55.057830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0cd17-7d79-4d8c-a776-bdf49ff3f799 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:55.234510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eef0cd17-7d79-4d8c-a776-bdf49ff3f799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92d1d7ddc009428bb340e9c6f20aa7f3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:55.241443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eef0cd17-7d79-4d8c-a776-bdf49ff3f799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92d1d7ddc009428bb340e9c6f20aa7f3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:55.306517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eef0cd17-7d79-4d8c-a776-bdf49ff3f799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92d1d7ddc009428bb340e9c6f20aa7f3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:55.307225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eef0cd17-7d79-4d8c-a776-bdf49ff3f799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92d1d7ddc009428bb340e9c6f20aa7f3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:55.320464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-eef0cd17-7d79-4d8c-a776-bdf49ff3f799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92d1d7ddc009428bb340e9c6f20aa7f3'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:55.326375 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4402/8738] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:57:54 2022] DELETE /identity/v3/users/92d1d7ddc009428bb340e9c6f20aa7f3 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:57:55.331001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efcfb3-a4e6-491a-a207-6be48601d00e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:55.331486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efcfb3-a4e6-491a-a207-6be48601d00e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:55.331608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efcfb3-a4e6-491a-a207-6be48601d00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:55.350076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d2efcfb3-a4e6-491a-a207-6be48601d00e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:57:55.351308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d2efcfb3-a4e6-491a-a207-6be48601d00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:55.414085 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4337/8739] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:57:55.423837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0cd17-7d79-4d8c-a776-bdf49ff3f799 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:55.425263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-eef0cd17-7d79-4d8c-a776-bdf49ff3f799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:55.440039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:57:55.483706 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0cd17-7d79-4d8c-a776-bdf49ff3f799 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:55.487471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c910309-2d42-47a9-bc65-04d636dcfb97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:55.488058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c910309-2d42-47a9-bc65-04d636dcfb97 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:55.488338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c910309-2d42-47a9-bc65-04d636dcfb97 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:55.488614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c910309-2d42-47a9-bc65-04d636dcfb97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:55.498605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c910309-2d42-47a9-bc65-04d636dcfb97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:55.500093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c910309-2d42-47a9-bc65-04d636dcfb97 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:55.510632 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4403/8740] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 21:57:55.743303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efcfb3-a4e6-491a-a207-6be48601d00e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:55.744732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d2efcfb3-a4e6-491a-a207-6be48601d00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:55.757871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efcfb3-a4e6-491a-a207-6be48601d00e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:55.762641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa3e0f-fcc3-45b7-b9a5-0b4e169227b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:55.763536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa3e0f-fcc3-45b7-b9a5-0b4e169227b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:55.763813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa3e0f-fcc3-45b7-b9a5-0b4e169227b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:55.764083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa3e0f-fcc3-45b7-b9a5-0b4e169227b2 admin admin] PATH_INFO: `/v3/projects/46b1acf286d840738d93acc4ee506029` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:55.765287 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa3e0f-fcc3-45b7-b9a5-0b4e169227b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46b1acf286d840738d93acc4ee506029)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:55.767235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa3e0f-fcc3-45b7-b9a5-0b4e169227b2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:55.861907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-33fa3e0f-fcc3-45b7-b9a5-0b4e169227b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46b1acf286d840738d93acc4ee506029', 'request_id': 'req-33fa3e0f-fcc3-45b7-b9a5-0b4e169227b2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:55.868627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-33fa3e0f-fcc3-45b7-b9a5-0b4e169227b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46b1acf286d840738d93acc4ee506029', 'request_id': 'req-33fa3e0f-fcc3-45b7-b9a5-0b4e169227b2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:55.875162 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-33fa3e0f-fcc3-45b7-b9a5-0b4e169227b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46b1acf286d840738d93acc4ee506029', 'request_id': 'req-33fa3e0f-fcc3-45b7-b9a5-0b4e169227b2'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:55.929302 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-33fa3e0f-fcc3-45b7-b9a5-0b4e169227b2 admin admin] The token cache is being invalidate because project 46b1acf286d840738d93acc4ee506029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:57:55.929590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-33fa3e0f-fcc3-45b7-b9a5-0b4e169227b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:55.930245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-33fa3e0f-fcc3-45b7-b9a5-0b4e169227b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:55.931971 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4338/8741] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:57:55 2022] DELETE /identity/v3/projects/46b1acf286d840738d93acc4ee506029 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:57:55.936112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c910309-2d42-47a9-bc65-04d636dcfb97 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:55.946176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c910309-2d42-47a9-bc65-04d636dcfb97 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:56.002549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7cbd4-cd3a-45ec-a644-47011aa8de75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:56.003384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7cbd4-cd3a-45ec-a644-47011aa8de75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:56.003670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7cbd4-cd3a-45ec-a644-47011aa8de75 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:56.003949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7cbd4-cd3a-45ec-a644-47011aa8de75 admin admin] PATH_INFO: `/v3/users/2b7eba2f41e342d39333caabc176932c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:56.005347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7cbd4-cd3a-45ec-a644-47011aa8de75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b7eba2f41e342d39333caabc176932c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:56.007322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7cbd4-cd3a-45ec-a644-47011aa8de75 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:56.136881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-22f7cbd4-cd3a-45ec-a644-47011aa8de75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b7eba2f41e342d39333caabc176932c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:56.144382 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-22f7cbd4-cd3a-45ec-a644-47011aa8de75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b7eba2f41e342d39333caabc176932c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:56.186344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-22f7cbd4-cd3a-45ec-a644-47011aa8de75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b7eba2f41e342d39333caabc176932c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:56.186977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-22f7cbd4-cd3a-45ec-a644-47011aa8de75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b7eba2f41e342d39333caabc176932c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:56.199029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-22f7cbd4-cd3a-45ec-a644-47011aa8de75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b7eba2f41e342d39333caabc176932c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:56.205009 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4404/8742] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:57:55 2022] DELETE /identity/v3/users/2b7eba2f41e342d39333caabc176932c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:57:56.634412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa3e0f-fcc3-45b7-b9a5-0b4e169227b2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:56.635903 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-33fa3e0f-fcc3-45b7-b9a5-0b4e169227b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:56.650485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa3e0f-fcc3-45b7-b9a5-0b4e169227b2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:56.695927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:57:56.707407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959de4a4-d227-4bc8-932f-81f8d3ce641c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:56.708946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959de4a4-d227-4bc8-932f-81f8d3ce641c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:56.709238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959de4a4-d227-4bc8-932f-81f8d3ce641c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:56.709517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959de4a4-d227-4bc8-932f-81f8d3ce641c admin admin] PATH_INFO: `/v3/projects/1ffacafb54b044fb8e92ffb08136d1d2` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:56.710722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959de4a4-d227-4bc8-932f-81f8d3ce641c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ffacafb54b044fb8e92ffb08136d1d2)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:56.712706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959de4a4-d227-4bc8-932f-81f8d3ce641c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:56.808323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-959de4a4-d227-4bc8-932f-81f8d3ce641c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ffacafb54b044fb8e92ffb08136d1d2', 'request_id': 'req-959de4a4-d227-4bc8-932f-81f8d3ce641c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:56.813981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-959de4a4-d227-4bc8-932f-81f8d3ce641c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ffacafb54b044fb8e92ffb08136d1d2', 'request_id': 'req-959de4a4-d227-4bc8-932f-81f8d3ce641c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:56.821062 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-959de4a4-d227-4bc8-932f-81f8d3ce641c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ffacafb54b044fb8e92ffb08136d1d2', 'request_id': 'req-959de4a4-d227-4bc8-932f-81f8d3ce641c'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:56.866403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-959de4a4-d227-4bc8-932f-81f8d3ce641c admin admin] The token cache is being invalidate because project 1ffacafb54b044fb8e92ffb08136d1d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:57:56.866673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-959de4a4-d227-4bc8-932f-81f8d3ce641c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:56.867565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-959de4a4-d227-4bc8-932f-81f8d3ce641c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:57:56.868859 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4339/8743] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:57:56 2022] DELETE /identity/v3/projects/1ffacafb54b044fb8e92ffb08136d1d2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:57:56.874760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598c131-b110-43d0-b4cd-b263363e8489 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:56.875080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598c131-b110-43d0-b4cd-b263363e8489 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:56.875366 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598c131-b110-43d0-b4cd-b263363e8489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:56.894121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8598c131-b110-43d0-b4cd-b263363e8489 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:57:56.895322 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8598c131-b110-43d0-b4cd-b263363e8489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:56.924768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:57:56.954983 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4405/8744] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:57:56.963389 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07548a-ef70-40c0-9e59-83e2c9d7739e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:56.963671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07548a-ef70-40c0-9e59-83e2c9d7739e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:56.963954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07548a-ef70-40c0-9e59-83e2c9d7739e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:56.982533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8e07548a-ef70-40c0-9e59-83e2c9d7739e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:57:56.983768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8e07548a-ef70-40c0-9e59-83e2c9d7739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:56.992298 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4340/8745] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:57:56.996594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598c131-b110-43d0-b4cd-b263363e8489 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:57.006887 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598c131-b110-43d0-b4cd-b263363e8489 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:57.011748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb34deb-4a34-4bfb-8d03-d65b63c5393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:57.012410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb34deb-4a34-4bfb-8d03-d65b63c5393a admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:57.012700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb34deb-4a34-4bfb-8d03-d65b63c5393a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:57.012987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb34deb-4a34-4bfb-8d03-d65b63c5393a admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:57.013740 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb34deb-4a34-4bfb-8d03-d65b63c5393a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:57:57.014053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb34deb-4a34-4bfb-8d03-d65b63c5393a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:57.015709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb34deb-4a34-4bfb-8d03-d65b63c5393a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:57.027459 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4406/8746] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:57:57.031738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07548a-ef70-40c0-9e59-83e2c9d7739e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:57.041518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07548a-ef70-40c0-9e59-83e2c9d7739e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:57.046230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a738e0-61e1-4cb3-9590-52ea571cba74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:57.046874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a738e0-61e1-4cb3-9590-52ea571cba74 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:57.047212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a738e0-61e1-4cb3-9590-52ea571cba74 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:57.047492 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a738e0-61e1-4cb3-9590-52ea571cba74 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:57.048182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a738e0-61e1-4cb3-9590-52ea571cba74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:57.050070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a738e0-61e1-4cb3-9590-52ea571cba74 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:57.188710 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4341/8747] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:57:57 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:57:57.193649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb34deb-4a34-4bfb-8d03-d65b63c5393a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:57.203950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb34deb-4a34-4bfb-8d03-d65b63c5393a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:57.260686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5e588-3dde-46ea-b528-3d10433f8530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:57.261337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5e588-3dde-46ea-b528-3d10433f8530 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:57.261616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5e588-3dde-46ea-b528-3d10433f8530 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:57.261890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5e588-3dde-46ea-b528-3d10433f8530 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:57.262569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5e588-3dde-46ea-b528-3d10433f8530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:57.264575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5e588-3dde-46ea-b528-3d10433f8530 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:57.329374 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4407/8748] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:57:57 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:57:57.333624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a738e0-61e1-4cb3-9590-52ea571cba74 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:57.344536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a738e0-61e1-4cb3-9590-52ea571cba74 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:57.349802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c99811-391a-46a0-abf8-ca83f8bc082c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:57.350519 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c99811-391a-46a0-abf8-ca83f8bc082c admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:57.350802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c99811-391a-46a0-abf8-ca83f8bc082c admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:57.351114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c99811-391a-46a0-abf8-ca83f8bc082c admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:57.351841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c99811-391a-46a0-abf8-ca83f8bc082c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:57.353433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c99811-391a-46a0-abf8-ca83f8bc082c admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:57.363658 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4342/8749] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:57:57.368205 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5e588-3dde-46ea-b528-3d10433f8530 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:57.378315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5e588-3dde-46ea-b528-3d10433f8530 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:57.383083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a649e7-4fa2-44f2-96df-6eb08e7287c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:57.383735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a649e7-4fa2-44f2-96df-6eb08e7287c0 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:57.384021 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a649e7-4fa2-44f2-96df-6eb08e7287c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:57.384300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a649e7-4fa2-44f2-96df-6eb08e7287c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:57.385009 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a649e7-4fa2-44f2-96df-6eb08e7287c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:57.386624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a649e7-4fa2-44f2-96df-6eb08e7287c0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:57.397240 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4408/8750] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 21:57:57.401589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c99811-391a-46a0-abf8-ca83f8bc082c admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:57.411760 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c99811-391a-46a0-abf8-ca83f8bc082c admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:57.417165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5683ed-fae4-4304-90cd-7335a85eac3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:57.418032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5683ed-fae4-4304-90cd-7335a85eac3e admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:57.418311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5683ed-fae4-4304-90cd-7335a85eac3e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:57.418585 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5683ed-fae4-4304-90cd-7335a85eac3e admin admin] PATH_INFO: `/v3/projects/8849a8b6fc0648ed817530d7b57fe09a/users/303ba697a1f94661b93254ac0f198670/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:57.433768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5683ed-fae4-4304-90cd-7335a85eac3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8849a8b6fc0648ed817530d7b57fe09a, user_id=303ba697a1f94661b93254ac0f198670, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:57.436417 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5683ed-fae4-4304-90cd-7335a85eac3e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:57.488974 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4343/8751] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:57:57 2022] PUT /identity/v3/projects/8849a8b6fc0648ed817530d7b57fe09a/users/303ba697a1f94661b93254ac0f198670/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:57:57.494612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7ec47-1063-49a8-92d3-693598339c72 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:57.494896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7ec47-1063-49a8-92d3-693598339c72 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:57.495195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7ec47-1063-49a8-92d3-693598339c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:57.512196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-3be7ec47-1063-49a8-92d3-693598339c72 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:57:57.513374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3be7ec47-1063-49a8-92d3-693598339c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:57.571164 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4409/8752] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:57:57.581008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5683ed-fae4-4304-90cd-7335a85eac3e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:57:57.582701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0f5683ed-fae4-4304-90cd-7335a85eac3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:57:57.640038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5683ed-fae4-4304-90cd-7335a85eac3e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:57:57.643809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d878bb6-f7ca-437e-9038-5971ee697d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:57:57.644455 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d878bb6-f7ca-437e-9038-5971ee697d6f service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:57:57.644742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d878bb6-f7ca-437e-9038-5971ee697d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:57:57.645023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d878bb6-f7ca-437e-9038-5971ee697d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:57:57.654945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d878bb6-f7ca-437e-9038-5971ee697d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:57:57.656407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d878bb6-f7ca-437e-9038-5971ee697d6f service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:57:57.666949 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4344/8753] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:57:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:58:02.836707 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc3753-106b-4db0-8877-43c2c9bbf13d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:58:02.837226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc3753-106b-4db0-8877-43c2c9bbf13d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:58:02.837390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc3753-106b-4db0-8877-43c2c9bbf13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:58:02.868052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-26fc3753-106b-4db0-8877-43c2c9bbf13d None None] MFA Rules not processed for user `303ba697a1f94661b93254ac0f198670`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:58:02.869237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-26fc3753-106b-4db0-8877-43c2c9bbf13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:58:02.908098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:58:02.976739 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4410/8754] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:58:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:58:02.987966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d805b1d-c764-4db3-a42f-540c13ac16c4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:58:02.988508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d805b1d-c764-4db3-a42f-540c13ac16c4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:58:02.988508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d805b1d-c764-4db3-a42f-540c13ac16c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:58:03.008192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8d805b1d-c764-4db3-a42f-540c13ac16c4 None None] MFA Rules not processed for user `303ba697a1f94661b93254ac0f198670`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:58:03.009436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8d805b1d-c764-4db3-a42f-540c13ac16c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:58:03.016856 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4345/8755] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:58:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 21:58:03.030926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc3753-106b-4db0-8877-43c2c9bbf13d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:58:03.032565 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-26fc3753-106b-4db0-8877-43c2c9bbf13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:58:03.117692 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc3753-106b-4db0-8877-43c2c9bbf13d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:58:03.123397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6cd7f-07b1-4e85-a097-ac07136b45a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:58:03.124056 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6cd7f-07b1-4e85-a097-ac07136b45a4 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:58:03.124337 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6cd7f-07b1-4e85-a097-ac07136b45a4 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:58:03.124608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6cd7f-07b1-4e85-a097-ac07136b45a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:58:03.134295 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6cd7f-07b1-4e85-a097-ac07136b45a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:58:03.135995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6cd7f-07b1-4e85-a097-ac07136b45a4 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:58:03.146400 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4411/8756] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:58:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:58:03.839236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992952d-6bfa-448b-a11d-520ba2317820 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:58:03.842022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992952d-6bfa-448b-a11d-520ba2317820 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:58:03.842022 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992952d-6bfa-448b-a11d-520ba2317820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:58:03.870632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b992952d-6bfa-448b-a11d-520ba2317820 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:58:03.871817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b992952d-6bfa-448b-a11d-520ba2317820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:58:03.882864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:58:03.956673 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4346/8757] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:58:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:58:03.969741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6cd7f-07b1-4e85-a097-ac07136b45a4 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:58:03.971310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ffa6cd7f-07b1-4e85-a097-ac07136b45a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:58:03.992979 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6cd7f-07b1-4e85-a097-ac07136b45a4 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:58:03.999521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f45f92-e7b7-43fe-8efb-d19bb02e8ac9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:58:03.999743 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f45f92-e7b7-43fe-8efb-d19bb02e8ac9 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:58:03.999945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f45f92-e7b7-43fe-8efb-d19bb02e8ac9 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:58:04.000225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f45f92-e7b7-43fe-8efb-d19bb02e8ac9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:58:04.010728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f45f92-e7b7-43fe-8efb-d19bb02e8ac9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:58:04.012350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f45f92-e7b7-43fe-8efb-d19bb02e8ac9 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:58:04.024149 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4412/8758] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:58:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:58:14.018798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=53 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:58:14.147106 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=24 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:58:16.088310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992952d-6bfa-448b-a11d-520ba2317820 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:58:16.098361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992952d-6bfa-448b-a11d-520ba2317820 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:58:16.102853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb091be6-9b23-4da6-8e09-9e40f23c5e00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:58:16.103764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb091be6-9b23-4da6-8e09-9e40f23c5e00 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:58:16.104054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb091be6-9b23-4da6-8e09-9e40f23c5e00 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:58:16.104336 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb091be6-9b23-4da6-8e09-9e40f23c5e00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:58:16.106450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bb091be6-9b23-4da6-8e09-9e40f23c5e00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:58:16.119578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb091be6-9b23-4da6-8e09-9e40f23c5e00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:58:16.121013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb091be6-9b23-4da6-8e09-9e40f23c5e00 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:58:16.131946 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4347/8759] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:58:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:58:16.301271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e902a-d9a7-4b07-818a-6db11046456a None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:58:16.301808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e902a-d9a7-4b07-818a-6db11046456a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:58:16.301808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e902a-d9a7-4b07-818a-6db11046456a None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:58:16.303234 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4413/8760] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:58:16.308782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb06b6-cea8-46a4-ad55-9e96b6d19a7f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:58:16.309071 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb06b6-cea8-46a4-ad55-9e96b6d19a7f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:58:16.309344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb06b6-cea8-46a4-ad55-9e96b6d19a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:58:16.328112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a2bb06b6-cea8-46a4-ad55-9e96b6d19a7f None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:58:16.329298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a2bb06b6-cea8-46a4-ad55-9e96b6d19a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:58:16.338670 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4348/8761] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:58:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:58:16.359671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e902a-d9a7-4b07-818a-6db11046456a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:58:16.361339 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a00e902a-d9a7-4b07-818a-6db11046456a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:58:16.380448 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e902a-d9a7-4b07-818a-6db11046456a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:58:16.385755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f0678-b0a2-4279-8366-27a98cef7b9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:58:16.386394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f0678-b0a2-4279-8366-27a98cef7b9c service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:58:16.386675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f0678-b0a2-4279-8366-27a98cef7b9c service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:58:16.386980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f0678-b0a2-4279-8366-27a98cef7b9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:58:16.395554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f0678-b0a2-4279-8366-27a98cef7b9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:58:16.397132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f0678-b0a2-4279-8366-27a98cef7b9c service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:58:16.407481 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4414/8762] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:58:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:58:16.708156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb06b6-cea8-46a4-ad55-9e96b6d19a7f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:58:16.709563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a2bb06b6-cea8-46a4-ad55-9e96b6d19a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:58:16.722526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb06b6-cea8-46a4-ad55-9e96b6d19a7f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:58:16.726023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9147fd-2a2c-4371-b0ff-30a72f41b4c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:58:16.727670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9147fd-2a2c-4371-b0ff-30a72f41b4c6 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:58:16.727960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9147fd-2a2c-4371-b0ff-30a72f41b4c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:58:16.728245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9147fd-2a2c-4371-b0ff-30a72f41b4c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:58:16.730054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ff9147fd-2a2c-4371-b0ff-30a72f41b4c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:58:16.746163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9147fd-2a2c-4371-b0ff-30a72f41b4c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:58:16.747627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9147fd-2a2c-4371-b0ff-30a72f41b4c6 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:58:16.761741 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4349/8763] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:58:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:58:26.403349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:58:26.753819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=15 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:58:46.616773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f0678-b0a2-4279-8366-27a98cef7b9c service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:58:46.626651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f0678-b0a2-4279-8366-27a98cef7b9c service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:58:46.630306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e0713-e3b0-474d-bc14-ea3ce74a8fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:58:46.630941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e0713-e3b0-474d-bc14-ea3ce74a8fdf service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:58:46.631254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e0713-e3b0-474d-bc14-ea3ce74a8fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:58:46.631554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e0713-e3b0-474d-bc14-ea3ce74a8fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:58:46.633328 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-145e0713-e3b0-474d-bc14-ea3ce74a8fdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:58:46.647159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e0713-e3b0-474d-bc14-ea3ce74a8fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:58:46.648629 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e0713-e3b0-474d-bc14-ea3ce74a8fdf service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:58:46.660686 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4415/8764] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:58:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:58:47.163524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9147fd-2a2c-4371-b0ff-30a72f41b4c6 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:58:47.176735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9147fd-2a2c-4371-b0ff-30a72f41b4c6 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:58:47.182185 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41c44a-83ae-42f6-afa7-22de82eba31d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:58:47.182822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41c44a-83ae-42f6-afa7-22de82eba31d service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:58:47.183137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41c44a-83ae-42f6-afa7-22de82eba31d service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:58:47.183941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41c44a-83ae-42f6-afa7-22de82eba31d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:58:47.185921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7d41c44a-83ae-42f6-afa7-22de82eba31d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:58:47.201373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41c44a-83ae-42f6-afa7-22de82eba31d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:58:47.202941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41c44a-83ae-42f6-afa7-22de82eba31d service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:58:47.217241 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4350/8765] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:58:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:58:56.654170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:58:57.209384 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:59:00.722315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e0713-e3b0-474d-bc14-ea3ce74a8fdf service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:59:00.737458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e0713-e3b0-474d-bc14-ea3ce74a8fdf service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:59:00.742570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fccce2-95ad-48be-968a-6e2d296f4a08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:59:00.743222 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fccce2-95ad-48be-968a-6e2d296f4a08 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:59:00.743508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fccce2-95ad-48be-968a-6e2d296f4a08 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:59:00.743784 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fccce2-95ad-48be-968a-6e2d296f4a08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:59:00.746221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-49fccce2-95ad-48be-968a-6e2d296f4a08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:59:00.762452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fccce2-95ad-48be-968a-6e2d296f4a08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:59:00.764260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fccce2-95ad-48be-968a-6e2d296f4a08 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:59:00.782303 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4416/8766] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:59:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:59:00.849882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41c44a-83ae-42f6-afa7-22de82eba31d service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:59:00.863599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41c44a-83ae-42f6-afa7-22de82eba31d service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:59:00.868171 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67c712-ee3a-4073-80fd-cca9c992b9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:59:00.869104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67c712-ee3a-4073-80fd-cca9c992b9e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:59:00.869428 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67c712-ee3a-4073-80fd-cca9c992b9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:59:00.869669 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67c712-ee3a-4073-80fd-cca9c992b9e6 admin admin] PATH_INFO: `/v3/users/303ba697a1f94661b93254ac0f198670` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:59:00.871787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67c712-ee3a-4073-80fd-cca9c992b9e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=303ba697a1f94661b93254ac0f198670)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:59:00.873510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67c712-ee3a-4073-80fd-cca9c992b9e6 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:59:01.063105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ed67c712-ee3a-4073-80fd-cca9c992b9e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '303ba697a1f94661b93254ac0f198670'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:59:01.075236 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ed67c712-ee3a-4073-80fd-cca9c992b9e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '303ba697a1f94661b93254ac0f198670'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:59:01.139568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ed67c712-ee3a-4073-80fd-cca9c992b9e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '303ba697a1f94661b93254ac0f198670'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:59:01.146843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ed67c712-ee3a-4073-80fd-cca9c992b9e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '303ba697a1f94661b93254ac0f198670'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:59:01.147516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-ed67c712-ee3a-4073-80fd-cca9c992b9e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '303ba697a1f94661b93254ac0f198670'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:59:01.154065 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4351/8767] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 21:59:00 2022] DELETE /identity/v3/users/303ba697a1f94661b93254ac0f198670 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:59:01.411471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fccce2-95ad-48be-968a-6e2d296f4a08 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:59:01.423723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fccce2-95ad-48be-968a-6e2d296f4a08 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:59:01.484288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664a548-70af-4791-b827-b984471d0298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:59:01.485142 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664a548-70af-4791-b827-b984471d0298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:59:01.485429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664a548-70af-4791-b827-b984471d0298 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:59:01.485702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664a548-70af-4791-b827-b984471d0298 admin admin] PATH_INFO: `/v3/projects/8849a8b6fc0648ed817530d7b57fe09a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:59:01.486879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664a548-70af-4791-b827-b984471d0298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8849a8b6fc0648ed817530d7b57fe09a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:59:01.488862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664a548-70af-4791-b827-b984471d0298 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:59:01.586849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b664a548-70af-4791-b827-b984471d0298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8849a8b6fc0648ed817530d7b57fe09a', 'request_id': 'req-b664a548-70af-4791-b827-b984471d0298'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:59:01.594093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b664a548-70af-4791-b827-b984471d0298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8849a8b6fc0648ed817530d7b57fe09a', 'request_id': 'req-b664a548-70af-4791-b827-b984471d0298'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:59:01.599666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b664a548-70af-4791-b827-b984471d0298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8849a8b6fc0648ed817530d7b57fe09a', 'request_id': 'req-b664a548-70af-4791-b827-b984471d0298'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:59:01.699574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b664a548-70af-4791-b827-b984471d0298 admin admin] The token cache is being invalidate because project 8849a8b6fc0648ed817530d7b57fe09a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 21:59:01.702845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b664a548-70af-4791-b827-b984471d0298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:59:01.702845 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-b664a548-70af-4791-b827-b984471d0298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 21:59:01.702845 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4417/8768] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 21:59:01 2022] DELETE /identity/v3/projects/8849a8b6fc0648ed817530d7b57fe09a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:59:01.707516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49228bfb-dd85-442f-a355-51ac174a31a7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:59:01.707813 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49228bfb-dd85-442f-a355-51ac174a31a7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:59:01.708096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49228bfb-dd85-442f-a355-51ac174a31a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:59:01.728329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-49228bfb-dd85-442f-a355-51ac174a31a7 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:59:01.729680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-49228bfb-dd85-442f-a355-51ac174a31a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:59:01.790430 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4352/8769] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:59:01.798429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152d4cb-6227-472e-bfe8-419d9faa5b0f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:59:01.798928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152d4cb-6227-472e-bfe8-419d9faa5b0f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:59:01.799091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152d4cb-6227-472e-bfe8-419d9faa5b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:59:01.817997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5152d4cb-6227-472e-bfe8-419d9faa5b0f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:59:01.819371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5152d4cb-6227-472e-bfe8-419d9faa5b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:59:01.832271 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4418/8770] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:59:01.836632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49228bfb-dd85-442f-a355-51ac174a31a7 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:59:01.847588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49228bfb-dd85-442f-a355-51ac174a31a7 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:59:01.852353 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ac442-9e3d-47a6-8d32-d279701f794a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:59:01.853318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ac442-9e3d-47a6-8d32-d279701f794a admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:59:01.855432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ac442-9e3d-47a6-8d32-d279701f794a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:59:01.855726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ac442-9e3d-47a6-8d32-d279701f794a admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:59:01.856468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ac442-9e3d-47a6-8d32-d279701f794a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 21:59:01.856776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ac442-9e3d-47a6-8d32-d279701f794a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:59:01.858624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ac442-9e3d-47a6-8d32-d279701f794a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:59:01.871600 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4353/8771] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 21:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 21:59:01.876640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152d4cb-6227-472e-bfe8-419d9faa5b0f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:59:01.886639 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152d4cb-6227-472e-bfe8-419d9faa5b0f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:59:01.891853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffaeac6-7285-431e-ad37-a1de8326a8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:59:01.892608 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffaeac6-7285-431e-ad37-a1de8326a8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:59:01.892889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffaeac6-7285-431e-ad37-a1de8326a8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:59:01.893164 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffaeac6-7285-431e-ad37-a1de8326a8d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:59:01.893875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffaeac6-7285-431e-ad37-a1de8326a8d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:59:01.895825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffaeac6-7285-431e-ad37-a1de8326a8d1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:59:01.992728 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4419/8772] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 21:59:01 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 21:59:02.004469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ac442-9e3d-47a6-8d32-d279701f794a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:59:02.015686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ac442-9e3d-47a6-8d32-d279701f794a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:59:02.069921 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc8fae-0e45-45ad-9199-dd556cf6b802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:59:02.070612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc8fae-0e45-45ad-9199-dd556cf6b802 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:59:02.070894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc8fae-0e45-45ad-9199-dd556cf6b802 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:59:02.071215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc8fae-0e45-45ad-9199-dd556cf6b802 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:59:02.071889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc8fae-0e45-45ad-9199-dd556cf6b802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:59:02.074503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc8fae-0e45-45ad-9199-dd556cf6b802 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:59:02.081134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:59:02.156799 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4354/8773] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 21:59:02 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 21:59:02.160902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffaeac6-7285-431e-ad37-a1de8326a8d1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:59:02.171690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffaeac6-7285-431e-ad37-a1de8326a8d1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:59:02.176268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe5a97-f71f-40c1-910f-0c37ea3a81b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:59:02.176924 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe5a97-f71f-40c1-910f-0c37ea3a81b9 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:59:02.177207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe5a97-f71f-40c1-910f-0c37ea3a81b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:59:02.177485 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe5a97-f71f-40c1-910f-0c37ea3a81b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:59:02.178288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe5a97-f71f-40c1-910f-0c37ea3a81b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:59:02.179933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe5a97-f71f-40c1-910f-0c37ea3a81b9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:59:02.190879 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4420/8774] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:59:02.194862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc8fae-0e45-45ad-9199-dd556cf6b802 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:59:02.205776 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc8fae-0e45-45ad-9199-dd556cf6b802 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:59:02.211368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805ffc7-0664-4e1c-b963-7d9fa94e0cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:59:02.211368 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805ffc7-0664-4e1c-b963-7d9fa94e0cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:59:02.211599 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805ffc7-0664-4e1c-b963-7d9fa94e0cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:59:02.211819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805ffc7-0664-4e1c-b963-7d9fa94e0cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:59:02.212539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805ffc7-0664-4e1c-b963-7d9fa94e0cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:59:02.214409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805ffc7-0664-4e1c-b963-7d9fa94e0cf7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:59:02.225217 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4355/8775] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 21:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 21:59:02.229731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe5a97-f71f-40c1-910f-0c37ea3a81b9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:59:02.240509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe5a97-f71f-40c1-910f-0c37ea3a81b9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:59:02.245819 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6171318-0708-46e9-ba3b-7fe2840962b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:59:02.246952 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6171318-0708-46e9-ba3b-7fe2840962b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:59:02.247387 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6171318-0708-46e9-ba3b-7fe2840962b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:59:02.247668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6171318-0708-46e9-ba3b-7fe2840962b5 admin admin] PATH_INFO: `/v3/projects/9934bd813edb4e55a2d7c61207a9c46d/users/d980641608134eadb72afa6fddb6adeb/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:59:02.263572 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6171318-0708-46e9-ba3b-7fe2840962b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9934bd813edb4e55a2d7c61207a9c46d, user_id=d980641608134eadb72afa6fddb6adeb, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:59:02.266286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6171318-0708-46e9-ba3b-7fe2840962b5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:59:02.357698 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4421/8776] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 21:59:02 2022] PUT /identity/v3/projects/9934bd813edb4e55a2d7c61207a9c46d/users/d980641608134eadb72afa6fddb6adeb/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 21:59:02.363149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991aa51-7396-434e-bd77-8836e273df52 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:59:02.363444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991aa51-7396-434e-bd77-8836e273df52 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:59:02.363726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991aa51-7396-434e-bd77-8836e273df52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:59:02.381871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-5991aa51-7396-434e-bd77-8836e273df52 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:59:02.383881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5991aa51-7396-434e-bd77-8836e273df52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:59:02.443125 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4356/8777] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:59:02.452977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6171318-0708-46e9-ba3b-7fe2840962b5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:59:02.454804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c6171318-0708-46e9-ba3b-7fe2840962b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:59:02.469623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:59:02.514079 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6171318-0708-46e9-ba3b-7fe2840962b5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:59:02.517721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac2be4-1831-4c1e-8164-cab654472e58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:59:02.518359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac2be4-1831-4c1e-8164-cab654472e58 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:59:02.518642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac2be4-1831-4c1e-8164-cab654472e58 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:59:02.518919 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac2be4-1831-4c1e-8164-cab654472e58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:59:02.528350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac2be4-1831-4c1e-8164-cab654472e58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:59:02.529811 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac2be4-1831-4c1e-8164-cab654472e58 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:59:02.539690 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4422/8778] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:59:07.976356 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611cf09-def9-4e50-8764-d9273450a0e9 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:59:07.977300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611cf09-def9-4e50-8764-d9273450a0e9 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:59:07.977609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611cf09-def9-4e50-8764-d9273450a0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:59:08.010355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e611cf09-def9-4e50-8764-d9273450a0e9 None None] MFA Rules not processed for user `d980641608134eadb72afa6fddb6adeb`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:59:08.011885 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e611cf09-def9-4e50-8764-d9273450a0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:59:08.097011 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4357/8779] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:59:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:59:08.107995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662b8db-e914-4e5e-9817-5c8f15895a9a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:59:08.108522 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662b8db-e914-4e5e-9817-5c8f15895a9a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:59:08.108809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662b8db-e914-4e5e-9817-5c8f15895a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:59:08.127140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1662b8db-e914-4e5e-9817-5c8f15895a9a None None] MFA Rules not processed for user `d980641608134eadb72afa6fddb6adeb`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:59:08.128578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1662b8db-e914-4e5e-9817-5c8f15895a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:59:08.135773 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4423/8780] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 21:59:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:59:08.150410 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611cf09-def9-4e50-8764-d9273450a0e9 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:59:08.151857 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e611cf09-def9-4e50-8764-d9273450a0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:59:08.240210 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611cf09-def9-4e50-8764-d9273450a0e9 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:59:08.249332 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b12869-c19f-4edc-94b9-b10929cefbb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:59:08.250154 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b12869-c19f-4edc-94b9-b10929cefbb2 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:59:08.250460 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b12869-c19f-4edc-94b9-b10929cefbb2 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:59:08.250748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b12869-c19f-4edc-94b9-b10929cefbb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:59:08.257923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:59:08.263266 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b12869-c19f-4edc-94b9-b10929cefbb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:59:08.263381 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b12869-c19f-4edc-94b9-b10929cefbb2 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:59:08.273005 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4358/8781] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:59:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:59:18.121778 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=23 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:59:18.481936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:59:22.357937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef9936-686a-4959-9fb9-9778022b6e86 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:59:22.358539 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef9936-686a-4959-9fb9-9778022b6e86 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:59:22.359041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef9936-686a-4959-9fb9-9778022b6e86 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:59:22.360718 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4424/8782] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 21:59:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 21:59:22.365666 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1baad46-3893-45d7-8104-94843dbbdbae None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:59:22.368187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1baad46-3893-45d7-8104-94843dbbdbae None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:59:22.368187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1baad46-3893-45d7-8104-94843dbbdbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:59:22.385055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d1baad46-3893-45d7-8104-94843dbbdbae None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 21:59:22.387617 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d1baad46-3893-45d7-8104-94843dbbdbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:59:22.448678 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4359/8783] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 21:59:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 21:59:22.471367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef9936-686a-4959-9fb9-9778022b6e86 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 21:59:22.473055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-39ef9936-686a-4959-9fb9-9778022b6e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 21:59:22.492049 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef9936-686a-4959-9fb9-9778022b6e86 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 21:59:22.497064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34763889-c29c-4a0f-ab5e-d43cd5039ba7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 21:59:22.497691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34763889-c29c-4a0f-ab5e-d43cd5039ba7 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 21:59:22.497973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34763889-c29c-4a0f-ab5e-d43cd5039ba7 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 21:59:22.498278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34763889-c29c-4a0f-ab5e-d43cd5039ba7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 21:59:22.506631 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34763889-c29c-4a0f-ab5e-d43cd5039ba7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 21:59:22.508251 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34763889-c29c-4a0f-ab5e-d43cd5039ba7 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 21:59:22.518569 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4425/8784] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 21:59:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 21:59:32.440112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=29 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 21:59:32.515053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:00:03.317097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d86ab3-563f-415f-9ce9-03000e237276 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:00:03.317726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d86ab3-563f-415f-9ce9-03000e237276 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:00:03.317726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d86ab3-563f-415f-9ce9-03000e237276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:00:03.336045 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-60d86ab3-563f-415f-9ce9-03000e237276 None None] MFA Rules not processed for user `d980641608134eadb72afa6fddb6adeb`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:00:03.337534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-60d86ab3-563f-415f-9ce9-03000e237276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:00:03.344675 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4360/8785] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:00:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:00:13.330787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:00:17.865543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ce84b-77a0-43ed-a691-04633a863ad7 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:00:17.866116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ce84b-77a0-43ed-a691-04633a863ad7 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:00:17.866116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ce84b-77a0-43ed-a691-04633a863ad7 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:00:17.867508 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4426/8786] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 22:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 22:00:17.872323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8c71a-97fc-4fd7-b1fc-2424c520bf0a None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:00:17.872734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8c71a-97fc-4fd7-b1fc-2424c520bf0a None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:00:17.872874 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8c71a-97fc-4fd7-b1fc-2424c520bf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:00:17.890713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-9ff8c71a-97fc-4fd7-b1fc-2424c520bf0a None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:00:17.892002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9ff8c71a-97fc-4fd7-b1fc-2424c520bf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:00:17.901328 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4361/8787] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 22:00:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:00:17.922949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ce84b-77a0-43ed-a691-04633a863ad7 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:00:17.924641 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-df7ce84b-77a0-43ed-a691-04633a863ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:00:17.943971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ce84b-77a0-43ed-a691-04633a863ad7 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:00:17.948945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05531926-c022-4836-adf0-16c8d8564d43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:00:17.949573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05531926-c022-4836-adf0-16c8d8564d43 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:00:17.949855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05531926-c022-4836-adf0-16c8d8564d43 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:00:17.950132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05531926-c022-4836-adf0-16c8d8564d43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:00:17.959364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05531926-c022-4836-adf0-16c8d8564d43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:00:17.960950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05531926-c022-4836-adf0-16c8d8564d43 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:00:17.971361 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4427/8788] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:00:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:00:27.885645 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:00:27.967259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:00:32.788509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8c71a-97fc-4fd7-b1fc-2424c520bf0a None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:00:32.789948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9ff8c71a-97fc-4fd7-b1fc-2424c520bf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:00:32.801217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8c71a-97fc-4fd7-b1fc-2424c520bf0a None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:00:32.805014 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd2a12-052d-4db8-8908-7ebfcc0170e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:00:32.805682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd2a12-052d-4db8-8908-7ebfcc0170e0 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:00:32.805968 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd2a12-052d-4db8-8908-7ebfcc0170e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:00:32.806255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd2a12-052d-4db8-8908-7ebfcc0170e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:00:32.808001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-50bd2a12-052d-4db8-8908-7ebfcc0170e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:00:32.824588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd2a12-052d-4db8-8908-7ebfcc0170e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:00:32.826016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd2a12-052d-4db8-8908-7ebfcc0170e0 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:00:32.840622 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4362/8789] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:00:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:00:34.015435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05531926-c022-4836-adf0-16c8d8564d43 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:00:34.025182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05531926-c022-4836-adf0-16c8d8564d43 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:00:34.028804 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328c180-85d2-49fa-881e-f6d9afd9cee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:00:34.029438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328c180-85d2-49fa-881e-f6d9afd9cee5 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:00:34.029718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328c180-85d2-49fa-881e-f6d9afd9cee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:00:34.029995 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328c180-85d2-49fa-881e-f6d9afd9cee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:00:34.031821 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4328c180-85d2-49fa-881e-f6d9afd9cee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:00:34.048696 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328c180-85d2-49fa-881e-f6d9afd9cee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:00:34.050126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328c180-85d2-49fa-881e-f6d9afd9cee5 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:00:34.064289 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4428/8790] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:00:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:00:35.178999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd2a12-052d-4db8-8908-7ebfcc0170e0 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:00:35.187861 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd2a12-052d-4db8-8908-7ebfcc0170e0 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:00:35.191524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c1347-d406-41eb-b225-c34be4b4b3a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:00:35.192166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c1347-d406-41eb-b225-c34be4b4b3a1 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:00:35.192452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c1347-d406-41eb-b225-c34be4b4b3a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:00:35.192729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c1347-d406-41eb-b225-c34be4b4b3a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:00:35.194732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-557c1347-d406-41eb-b225-c34be4b4b3a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:00:35.207676 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c1347-d406-41eb-b225-c34be4b4b3a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:00:35.209124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c1347-d406-41eb-b225-c34be4b4b3a1 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:00:35.221622 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4363/8791] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:00:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:00:44.056954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:00:45.215207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=12 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:00:59.038341 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328c180-85d2-49fa-881e-f6d9afd9cee5 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:00:59.039814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4328c180-85d2-49fa-881e-f6d9afd9cee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:00:59.057107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328c180-85d2-49fa-881e-f6d9afd9cee5 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:00:59.062610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbc360-dfda-4168-9142-a5812404827b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:00:59.069941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbc360-dfda-4168-9142-a5812404827b service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:00:59.069941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbc360-dfda-4168-9142-a5812404827b service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:00:59.069941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbc360-dfda-4168-9142-a5812404827b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:00:59.069941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-36dbc360-dfda-4168-9142-a5812404827b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:00:59.080333 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbc360-dfda-4168-9142-a5812404827b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:00:59.082384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbc360-dfda-4168-9142-a5812404827b service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:00:59.096958 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4429/8792] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:00:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:01:09.089748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:01:09.183705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c1347-d406-41eb-b225-c34be4b4b3a1 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:01:09.199682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c1347-d406-41eb-b225-c34be4b4b3a1 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:01:09.204955 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57039333-7bbc-4959-8cd7-13b0bd3ce52c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:01:09.214395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57039333-7bbc-4959-8cd7-13b0bd3ce52c service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:01:09.214395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57039333-7bbc-4959-8cd7-13b0bd3ce52c service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:01:09.214395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57039333-7bbc-4959-8cd7-13b0bd3ce52c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:01:09.214395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-57039333-7bbc-4959-8cd7-13b0bd3ce52c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:01:09.224485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57039333-7bbc-4959-8cd7-13b0bd3ce52c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:01:09.226082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57039333-7bbc-4959-8cd7-13b0bd3ce52c service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:01:09.239396 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4364/8793] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:01:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:01:09.310017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbc360-dfda-4168-9142-a5812404827b service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:01:09.322207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbc360-dfda-4168-9142-a5812404827b service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:01:09.326906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4745b3b-5032-4511-aa6b-445484a7e109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:01:09.327824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4745b3b-5032-4511-aa6b-445484a7e109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:01:09.328105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4745b3b-5032-4511-aa6b-445484a7e109 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:01:09.328378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4745b3b-5032-4511-aa6b-445484a7e109 admin admin] PATH_INFO: `/v3/users/d980641608134eadb72afa6fddb6adeb` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:01:09.329559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4745b3b-5032-4511-aa6b-445484a7e109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d980641608134eadb72afa6fddb6adeb)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:01:09.331538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4745b3b-5032-4511-aa6b-445484a7e109 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:01:09.498242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4745b3b-5032-4511-aa6b-445484a7e109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd980641608134eadb72afa6fddb6adeb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:01:09.505071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4745b3b-5032-4511-aa6b-445484a7e109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd980641608134eadb72afa6fddb6adeb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:01:09.565757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4745b3b-5032-4511-aa6b-445484a7e109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd980641608134eadb72afa6fddb6adeb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:01:09.566332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4745b3b-5032-4511-aa6b-445484a7e109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd980641608134eadb72afa6fddb6adeb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:01:09.579313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-c4745b3b-5032-4511-aa6b-445484a7e109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd980641608134eadb72afa6fddb6adeb'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:01:09.585964 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4430/8794] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 22:01:09 2022] DELETE /identity/v3/users/d980641608134eadb72afa6fddb6adeb => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:01:09.830450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57039333-7bbc-4959-8cd7-13b0bd3ce52c service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:01:09.843642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57039333-7bbc-4959-8cd7-13b0bd3ce52c service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:01:09.911524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde118b8-80d3-4c12-8292-0972d25651b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:01:09.912398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde118b8-80d3-4c12-8292-0972d25651b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:01:09.912757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde118b8-80d3-4c12-8292-0972d25651b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:01:09.913542 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde118b8-80d3-4c12-8292-0972d25651b3 admin admin] PATH_INFO: `/v3/projects/9934bd813edb4e55a2d7c61207a9c46d` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:01:09.914807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde118b8-80d3-4c12-8292-0972d25651b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9934bd813edb4e55a2d7c61207a9c46d)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:01:09.916750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde118b8-80d3-4c12-8292-0972d25651b3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:01:10.024915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bde118b8-80d3-4c12-8292-0972d25651b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9934bd813edb4e55a2d7c61207a9c46d', 'request_id': 'req-bde118b8-80d3-4c12-8292-0972d25651b3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:01:10.030466 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bde118b8-80d3-4c12-8292-0972d25651b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9934bd813edb4e55a2d7c61207a9c46d', 'request_id': 'req-bde118b8-80d3-4c12-8292-0972d25651b3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:01:10.036721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bde118b8-80d3-4c12-8292-0972d25651b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9934bd813edb4e55a2d7c61207a9c46d', 'request_id': 'req-bde118b8-80d3-4c12-8292-0972d25651b3'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:01:10.119569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bde118b8-80d3-4c12-8292-0972d25651b3 admin admin] The token cache is being invalidate because project 9934bd813edb4e55a2d7c61207a9c46d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 22:01:10.119793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bde118b8-80d3-4c12-8292-0972d25651b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:01:10.120450 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bde118b8-80d3-4c12-8292-0972d25651b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:01:10.122025 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4365/8795] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 22:01:09 2022] DELETE /identity/v3/projects/9934bd813edb4e55a2d7c61207a9c46d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:01:10.127135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd34df-27a5-49cd-9ada-d350fe710825 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:01:10.127623 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd34df-27a5-49cd-9ada-d350fe710825 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:01:10.127733 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd34df-27a5-49cd-9ada-d350fe710825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:01:10.145745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9ffd34df-27a5-49cd-9ada-d350fe710825 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:01:10.147188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9ffd34df-27a5-49cd-9ada-d350fe710825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:01:10.206483 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4431/8796] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:01:10.215511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2a896-f277-45d9-9f8d-f24c9cbbea0e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:01:10.216010 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2a896-f277-45d9-9f8d-f24c9cbbea0e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:01:10.216129 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2a896-f277-45d9-9f8d-f24c9cbbea0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:01:10.234522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-0bc2a896-f277-45d9-9f8d-f24c9cbbea0e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:01:10.235765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-0bc2a896-f277-45d9-9f8d-f24c9cbbea0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:01:10.244011 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4366/8797] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:01:10.248350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd34df-27a5-49cd-9ada-d350fe710825 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:01:10.258932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd34df-27a5-49cd-9ada-d350fe710825 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:01:10.263569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f415a95-7a72-48cc-9932-00c34c26255f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:01:10.264280 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f415a95-7a72-48cc-9932-00c34c26255f admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:01:10.267599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f415a95-7a72-48cc-9932-00c34c26255f admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:01:10.267599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f415a95-7a72-48cc-9932-00c34c26255f admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:01:10.267599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f415a95-7a72-48cc-9932-00c34c26255f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 22:01:10.267599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f415a95-7a72-48cc-9932-00c34c26255f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:01:10.267599 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f415a95-7a72-48cc-9932-00c34c26255f admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:01:10.279823 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4432/8798] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 22:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 22:01:10.284084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2a896-f277-45d9-9f8d-f24c9cbbea0e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:01:10.293522 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2a896-f277-45d9-9f8d-f24c9cbbea0e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:01:10.298401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc24b5-4333-4e53-a60f-8e6a2d887ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:01:10.299089 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc24b5-4333-4e53-a60f-8e6a2d887ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:01:10.299374 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc24b5-4333-4e53-a60f-8e6a2d887ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:01:10.299649 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc24b5-4333-4e53-a60f-8e6a2d887ac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:01:10.300337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc24b5-4333-4e53-a60f-8e6a2d887ac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:01:10.302239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc24b5-4333-4e53-a60f-8e6a2d887ac9 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:01:10.377027 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4367/8799] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 22:01:10 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 22:01:10.381115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f415a95-7a72-48cc-9932-00c34c26255f admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:01:10.391820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f415a95-7a72-48cc-9932-00c34c26255f admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:01:10.450324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9a67c-6ef5-4453-a577-74a231eecaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:01:10.450992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9a67c-6ef5-4453-a577-74a231eecaed admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:01:10.451313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9a67c-6ef5-4453-a577-74a231eecaed admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:01:10.451594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9a67c-6ef5-4453-a577-74a231eecaed admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:01:10.452286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9a67c-6ef5-4453-a577-74a231eecaed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:01:10.454217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9a67c-6ef5-4453-a577-74a231eecaed admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:01:10.461695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:01:10.543650 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4433/8800] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 22:01:10 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 22:01:10.547827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc24b5-4333-4e53-a60f-8e6a2d887ac9 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:01:10.559133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc24b5-4333-4e53-a60f-8e6a2d887ac9 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:01:10.563839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe4205-8026-45e2-84c8-61667f97bd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:01:10.564490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe4205-8026-45e2-84c8-61667f97bd36 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:01:10.564822 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe4205-8026-45e2-84c8-61667f97bd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:01:10.565100 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe4205-8026-45e2-84c8-61667f97bd36 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:01:10.565807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe4205-8026-45e2-84c8-61667f97bd36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:01:10.567419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe4205-8026-45e2-84c8-61667f97bd36 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:01:10.578478 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4368/8801] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 22:01:10.582510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9a67c-6ef5-4453-a577-74a231eecaed admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:01:10.593683 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9a67c-6ef5-4453-a577-74a231eecaed admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:01:10.598476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac5074-6cd9-42de-a9aa-50598c4bd436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:01:10.599175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac5074-6cd9-42de-a9aa-50598c4bd436 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:01:10.599458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac5074-6cd9-42de-a9aa-50598c4bd436 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:01:10.599730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac5074-6cd9-42de-a9aa-50598c4bd436 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:01:10.600468 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac5074-6cd9-42de-a9aa-50598c4bd436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:01:10.602102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac5074-6cd9-42de-a9aa-50598c4bd436 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:01:10.612391 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4434/8802] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 22:01:10.616496 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe4205-8026-45e2-84c8-61667f97bd36 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:01:10.627288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe4205-8026-45e2-84c8-61667f97bd36 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:01:10.631925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fcca2-5d32-404d-9553-bc64890f7923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:01:10.633427 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fcca2-5d32-404d-9553-bc64890f7923 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:01:10.633726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fcca2-5d32-404d-9553-bc64890f7923 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:01:10.634030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fcca2-5d32-404d-9553-bc64890f7923 admin admin] PATH_INFO: `/v3/projects/fd21231d9af34d9aa4f9e03229b49a30/users/718f6de3b1a1453d9579d421a574691e/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:01:10.648543 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fcca2-5d32-404d-9553-bc64890f7923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd21231d9af34d9aa4f9e03229b49a30, user_id=718f6de3b1a1453d9579d421a574691e, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:01:10.651234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fcca2-5d32-404d-9553-bc64890f7923 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:01:10.743593 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4369/8803] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 22:01:10 2022] PUT /identity/v3/projects/fd21231d9af34d9aa4f9e03229b49a30/users/718f6de3b1a1453d9579d421a574691e/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:01:10.748855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b55a1-8bff-4219-aaee-b698c607852e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:01:10.749261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b55a1-8bff-4219-aaee-b698c607852e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:01:10.749498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b55a1-8bff-4219-aaee-b698c607852e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:01:10.768675 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-d98b55a1-8bff-4219-aaee-b698c607852e None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:01:10.769917 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d98b55a1-8bff-4219-aaee-b698c607852e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:01:10.829786 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4435/8804] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:01:10.840075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fcca2-5d32-404d-9553-bc64890f7923 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:01:10.841743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b48fcca2-5d32-404d-9553-bc64890f7923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:01:10.856337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:01:10.900575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fcca2-5d32-404d-9553-bc64890f7923 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:01:10.904206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbe290-3114-4504-a161-4756a011ee68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:01:10.904854 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbe290-3114-4504-a161-4756a011ee68 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:01:10.905138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbe290-3114-4504-a161-4756a011ee68 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:01:10.905415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbe290-3114-4504-a161-4756a011ee68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:01:10.915189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbe290-3114-4504-a161-4756a011ee68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:01:10.916618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbe290-3114-4504-a161-4756a011ee68 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:01:10.926215 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4370/8805] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:01:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:01:16.090386 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e22912-c0ed-46d8-9e58-c65f2058ea38 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:01:16.090902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e22912-c0ed-46d8-9e58-c65f2058ea38 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:01:16.091066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e22912-c0ed-46d8-9e58-c65f2058ea38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:01:16.124239 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-38e22912-c0ed-46d8-9e58-c65f2058ea38 None None] MFA Rules not processed for user `718f6de3b1a1453d9579d421a574691e`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:01:16.125458 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-38e22912-c0ed-46d8-9e58-c65f2058ea38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:01:16.200226 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4436/8806] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:01:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:01:16.218303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbe290-3114-4504-a161-4756a011ee68 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:01:16.220002 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-03cbe290-3114-4504-a161-4756a011ee68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:01:16.302905 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbe290-3114-4504-a161-4756a011ee68 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:01:16.309335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8fc15-62c5-427e-b9d2-c658ec8a572c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:01:16.309999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8fc15-62c5-427e-b9d2-c658ec8a572c service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:01:16.310277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8fc15-62c5-427e-b9d2-c658ec8a572c service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:01:16.310602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8fc15-62c5-427e-b9d2-c658ec8a572c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:01:16.319366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8fc15-62c5-427e-b9d2-c658ec8a572c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:01:16.320971 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8fc15-62c5-427e-b9d2-c658ec8a572c service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:01:16.331632 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4371/8807] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:01:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:01:19.723731 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b56fc-d362-412b-87c6-25846746995a None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:01:19.724265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b56fc-d362-412b-87c6-25846746995a None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:01:19.724265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b56fc-d362-412b-87c6-25846746995a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:01:19.744568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a62b56fc-d362-412b-87c6-25846746995a None None] MFA Rules not processed for user `718f6de3b1a1453d9579d421a574691e`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:01:19.745932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a62b56fc-d362-412b-87c6-25846746995a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:01:19.753658 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4437/8808] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:01:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:01:26.327412 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=54 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:01:29.737674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:01:33.205927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8fc15-62c5-427e-b9d2-c658ec8a572c service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:01:33.207357 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f1e8fc15-62c5-427e-b9d2-c658ec8a572c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:01:33.281597 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8fc15-62c5-427e-b9d2-c658ec8a572c service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:01:33.286924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dde2e-cf84-4335-83b7-77f84d1c69f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:01:33.287616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dde2e-cf84-4335-83b7-77f84d1c69f8 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:01:33.287902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dde2e-cf84-4335-83b7-77f84d1c69f8 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:01:33.288177 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dde2e-cf84-4335-83b7-77f84d1c69f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:01:33.290092 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-943dde2e-cf84-4335-83b7-77f84d1c69f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:01:33.306068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943dde2e-cf84-4335-83b7-77f84d1c69f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:01:33.307711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943dde2e-cf84-4335-83b7-77f84d1c69f8 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:01:33.322498 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4372/8809] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:01:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:01:40.343221 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b56fc-d362-412b-87c6-25846746995a None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:01:40.344759 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a62b56fc-d362-412b-87c6-25846746995a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:01:40.362904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b56fc-d362-412b-87c6-25846746995a None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:01:40.368041 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a67a5-4791-4434-bcdf-eff113e62a99 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:01:40.368684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a67a5-4791-4434-bcdf-eff113e62a99 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:01:40.368970 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a67a5-4791-4434-bcdf-eff113e62a99 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:01:40.369248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a67a5-4791-4434-bcdf-eff113e62a99 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:01:40.370987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9a5a67a5-4791-4434-bcdf-eff113e62a99 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:01:40.385719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a67a5-4791-4434-bcdf-eff113e62a99 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:01:40.387344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a67a5-4791-4434-bcdf-eff113e62a99 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:01:40.399951 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4438/8810] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:01:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:01:43.316735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=32 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:01:50.393121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:02:11.886409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854703d-4ddb-4b40-8543-75a471ddbc6f None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:02:11.886936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854703d-4ddb-4b40-8543-75a471ddbc6f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:02:11.886936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854703d-4ddb-4b40-8543-75a471ddbc6f None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:02:11.888552 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4373/8811] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 22:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 22:02:11.894149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506072d8-e2de-4915-85ad-8fc331e64858 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:02:11.894619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506072d8-e2de-4915-85ad-8fc331e64858 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:02:11.894744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506072d8-e2de-4915-85ad-8fc331e64858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:02:11.912652 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-506072d8-e2de-4915-85ad-8fc331e64858 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:02:11.913850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-506072d8-e2de-4915-85ad-8fc331e64858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:02:11.922667 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4439/8812] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 22:02:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:02:11.944030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854703d-4ddb-4b40-8543-75a471ddbc6f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:02:11.961589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854703d-4ddb-4b40-8543-75a471ddbc6f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:02:11.966516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fed0e-a44c-4e3a-97e5-7d7bc0c65e76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:02:11.967189 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fed0e-a44c-4e3a-97e5-7d7bc0c65e76 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:02:11.967476 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fed0e-a44c-4e3a-97e5-7d7bc0c65e76 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:02:11.967752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fed0e-a44c-4e3a-97e5-7d7bc0c65e76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:02:11.976469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6fed0e-a44c-4e3a-97e5-7d7bc0c65e76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:02:11.978051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6fed0e-a44c-4e3a-97e5-7d7bc0c65e76 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:02:11.987997 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4374/8813] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:02:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:02:21.907397 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:02:21.983792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:02:32.777711 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506072d8-e2de-4915-85ad-8fc331e64858 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:02:32.779180 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-506072d8-e2de-4915-85ad-8fc331e64858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:02:32.798065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506072d8-e2de-4915-85ad-8fc331e64858 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:02:32.804515 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41855e6e-1c6e-4dee-8dd9-834ea795d367 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:02:32.805173 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41855e6e-1c6e-4dee-8dd9-834ea795d367 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:02:32.805462 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41855e6e-1c6e-4dee-8dd9-834ea795d367 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:02:32.805744 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41855e6e-1c6e-4dee-8dd9-834ea795d367 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:02:32.807651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-41855e6e-1c6e-4dee-8dd9-834ea795d367 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:02:32.823910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41855e6e-1c6e-4dee-8dd9-834ea795d367 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:02:32.825581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41855e6e-1c6e-4dee-8dd9-834ea795d367 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:02:32.840055 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4440/8814] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:02:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:02:42.832483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:02:44.799469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c3e0b-558a-4800-bb36-22eefa60cdee None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:02:44.804340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c3e0b-558a-4800-bb36-22eefa60cdee None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:02:44.804340 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c3e0b-558a-4800-bb36-22eefa60cdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:02:44.817781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-307c3e0b-558a-4800-bb36-22eefa60cdee None None] MFA Rules not processed for user `718f6de3b1a1453d9579d421a574691e`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:02:44.818985 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-307c3e0b-558a-4800-bb36-22eefa60cdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:02:44.826178 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4375/8815] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:02:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:02:54.812124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:03:41.391296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164a062-d6b9-4707-8bba-6d590488232f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:03:41.391918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164a062-d6b9-4707-8bba-6d590488232f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:03:41.391918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164a062-d6b9-4707-8bba-6d590488232f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:03:41.420768 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5164a062-d6b9-4707-8bba-6d590488232f None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:03:41.421948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5164a062-d6b9-4707-8bba-6d590488232f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:03:41.472859 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4441/8816] 10.222.0.30 () {58 vars in 1015 bytes} [Sat Jul 16 22:03:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:03:41.507487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c3e0b-558a-4800-bb36-22eefa60cdee None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:03:41.540030 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c3e0b-558a-4800-bb36-22eefa60cdee None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:03:41.545119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708147a1-60a5-4f1a-a634-feefb7d355c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:03:41.545765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708147a1-60a5-4f1a-a634-feefb7d355c1 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:03:41.546050 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708147a1-60a5-4f1a-a634-feefb7d355c1 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:03:41.546331 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708147a1-60a5-4f1a-a634-feefb7d355c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:03:41.554999 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708147a1-60a5-4f1a-a634-feefb7d355c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:03:41.556616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708147a1-60a5-4f1a-a634-feefb7d355c1 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:03:41.566661 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4376/8817] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:03:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:03:43.807999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164a062-d6b9-4707-8bba-6d590488232f None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:03:43.809625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5164a062-d6b9-4707-8bba-6d590488232f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:03:43.846587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164a062-d6b9-4707-8bba-6d590488232f None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:03:43.850132 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea4b27-b6f6-4792-9706-4db4ef35c1ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:03:43.850772 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea4b27-b6f6-4792-9706-4db4ef35c1ef service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:03:43.851080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea4b27-b6f6-4792-9706-4db4ef35c1ef service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:03:43.851356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea4b27-b6f6-4792-9706-4db4ef35c1ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:03:43.853093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0fea4b27-b6f6-4792-9706-4db4ef35c1ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:03:43.866040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea4b27-b6f6-4792-9706-4db4ef35c1ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:03:43.870419 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea4b27-b6f6-4792-9706-4db4ef35c1ef service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:03:43.879691 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4442/8818] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:03:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:03:44.027238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68a9bd-225b-4f05-bdc1-8425af368a04 None None] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:03:44.027782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68a9bd-225b-4f05-bdc1-8425af368a04 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:03:44.027782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68a9bd-225b-4f05-bdc1-8425af368a04 None None] PATH_INFO: `/` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:03:44.029179 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4377/8819] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 22:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 22:03:44.033955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ab2fd-82bc-4a69-9460-c6e3902b0b84 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:03:44.034389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ab2fd-82bc-4a69-9460-c6e3902b0b84 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:03:44.034737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ab2fd-82bc-4a69-9460-c6e3902b0b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:03:44.053824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-fc7ab2fd-82bc-4a69-9460-c6e3902b0b84 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:03:44.055042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fc7ab2fd-82bc-4a69-9460-c6e3902b0b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:03:44.064334 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4443/8820] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 22:03:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:03:44.085275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd935d96-5d7f-4cdc-b001-4b5fce572467 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:03:44.085563 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd935d96-5d7f-4cdc-b001-4b5fce572467 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:03:44.085882 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd935d96-5d7f-4cdc-b001-4b5fce572467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:03:44.104779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-cd935d96-5d7f-4cdc-b001-4b5fce572467 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:03:44.105895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-cd935d96-5d7f-4cdc-b001-4b5fce572467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:03:44.114788 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4378/8821] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Jul 16 22:03:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:03:44.120600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ab2fd-82bc-4a69-9460-c6e3902b0b84 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:03:44.131746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ab2fd-82bc-4a69-9460-c6e3902b0b84 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:03:44.136961 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4976c0a-a506-4c2c-9c9e-be8df51a1efe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:03:44.137600 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4976c0a-a506-4c2c-9c9e-be8df51a1efe service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:03:44.137881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4976c0a-a506-4c2c-9c9e-be8df51a1efe service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:03:44.138157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4976c0a-a506-4c2c-9c9e-be8df51a1efe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:03:44.147563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4976c0a-a506-4c2c-9c9e-be8df51a1efe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:03:44.149147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4976c0a-a506-4c2c-9c9e-be8df51a1efe service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:03:44.159438 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4444/8822] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:03:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:03:44.480568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd935d96-5d7f-4cdc-b001-4b5fce572467 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:03:44.490616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd935d96-5d7f-4cdc-b001-4b5fce572467 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:03:44.494215 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e14fc4-a19a-49ae-90c9-31fcc213f97f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:03:44.498276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e14fc4-a19a-49ae-90c9-31fcc213f97f service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:03:44.498276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e14fc4-a19a-49ae-90c9-31fcc213f97f service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:03:44.498276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e14fc4-a19a-49ae-90c9-31fcc213f97f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:03:44.498276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-01e14fc4-a19a-49ae-90c9-31fcc213f97f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:03:44.513826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e14fc4-a19a-49ae-90c9-31fcc213f97f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:03:44.515280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e14fc4-a19a-49ae-90c9-31fcc213f97f service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:03:44.537787 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4379/8823] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:03:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:03:44.598414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4976c0a-a506-4c2c-9c9e-be8df51a1efe service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:03:44.608990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4976c0a-a506-4c2c-9c9e-be8df51a1efe service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:03:44.614615 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce4617-c251-4e66-aad9-c1e3d4e3f1c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:03:44.615290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce4617-c251-4e66-aad9-c1e3d4e3f1c8 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:03:44.615579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce4617-c251-4e66-aad9-c1e3d4e3f1c8 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:03:44.615858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce4617-c251-4e66-aad9-c1e3d4e3f1c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:03:44.617594 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-c6ce4617-c251-4e66-aad9-c1e3d4e3f1c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:03:44.629881 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce4617-c251-4e66-aad9-c1e3d4e3f1c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:03:44.631450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce4617-c251-4e66-aad9-c1e3d4e3f1c8 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:03:44.641373 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4445/8824] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:03:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:03:45.326328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6094bb4-044f-454f-ae6f-cfaa63e15e0f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:03:45.326929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6094bb4-044f-454f-ae6f-cfaa63e15e0f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:03:45.326929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6094bb4-044f-454f-ae6f-cfaa63e15e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:03:45.347159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-c6094bb4-044f-454f-ae6f-cfaa63e15e0f None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:03:45.348367 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c6094bb4-044f-454f-ae6f-cfaa63e15e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:03:45.357032 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4380/8825] 10.222.0.17 () {58 vars in 1015 bytes} [Sat Jul 16 22:03:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:03:45.375663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce4617-c251-4e66-aad9-c1e3d4e3f1c8 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:03:45.389609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce4617-c251-4e66-aad9-c1e3d4e3f1c8 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:03:45.395347 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2805cb-93d3-4b24-bbbc-88473218b9a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:03:45.396043 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2805cb-93d3-4b24-bbbc-88473218b9a2 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:03:45.396348 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2805cb-93d3-4b24-bbbc-88473218b9a2 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:03:45.396573 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2805cb-93d3-4b24-bbbc-88473218b9a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:03:45.404980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2805cb-93d3-4b24-bbbc-88473218b9a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:03:45.407238 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2805cb-93d3-4b24-bbbc-88473218b9a2 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:03:45.417120 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4446/8826] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:03:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:03:49.140547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6094bb4-044f-454f-ae6f-cfaa63e15e0f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:03:49.149947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6094bb4-044f-454f-ae6f-cfaa63e15e0f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:03:49.153478 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de6520-ca81-444d-9395-600894976146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:03:49.154115 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de6520-ca81-444d-9395-600894976146 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:03:49.154391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de6520-ca81-444d-9395-600894976146 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:03:49.154664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de6520-ca81-444d-9395-600894976146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:03:49.156422 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b1de6520-ca81-444d-9395-600894976146 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:03:49.169044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de6520-ca81-444d-9395-600894976146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:03:49.170480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de6520-ca81-444d-9395-600894976146 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:03:49.181423 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4381/8827] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:03:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:03:55.413067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=61 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:03:59.175436 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=36 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:04:02.670667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd652d9-09f4-4a7d-bae2-ff682b9a892d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:04:02.672843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd652d9-09f4-4a7d-bae2-ff682b9a892d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:04:02.672843 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd652d9-09f4-4a7d-bae2-ff682b9a892d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:04:02.690435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ddd652d9-09f4-4a7d-bae2-ff682b9a892d None None] MFA Rules not processed for user `718f6de3b1a1453d9579d421a574691e`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:04:02.691680 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ddd652d9-09f4-4a7d-bae2-ff682b9a892d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:04:02.701921 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4447/8828] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:04:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:04:03.006709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de6520-ca81-444d-9395-600894976146 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:04:03.015423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de6520-ca81-444d-9395-600894976146 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:04:03.019028 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb0c53-479c-4fc0-8e92-e3391fd54f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:04:03.019668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb0c53-479c-4fc0-8e92-e3391fd54f53 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:04:03.019953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb0c53-479c-4fc0-8e92-e3391fd54f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:04:03.020811 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb0c53-479c-4fc0-8e92-e3391fd54f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:04:03.022779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-26cb0c53-479c-4fc0-8e92-e3391fd54f53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:04:03.034580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb0c53-479c-4fc0-8e92-e3391fd54f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:04:03.036616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb0c53-479c-4fc0-8e92-e3391fd54f53 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:04:03.046897 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4382/8829] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:04:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:04:03.452225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd652d9-09f4-4a7d-bae2-ff682b9a892d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:04:03.477271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd652d9-09f4-4a7d-bae2-ff682b9a892d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:04:03.482447 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dd911-e3da-440e-b063-c5e4f5895122 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:04:03.483128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dd911-e3da-440e-b063-c5e4f5895122 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:04:03.483414 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dd911-e3da-440e-b063-c5e4f5895122 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:04:03.483687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dd911-e3da-440e-b063-c5e4f5895122 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:04:03.485486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e53dd911-e3da-440e-b063-c5e4f5895122 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:04:03.499912 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53dd911-e3da-440e-b063-c5e4f5895122 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:04:03.501603 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53dd911-e3da-440e-b063-c5e4f5895122 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:04:03.512618 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4448/8830] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:04:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 22:04:13.040973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:04:13.508342 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=13 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:04:17.673429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb0c53-479c-4fc0-8e92-e3391fd54f53 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:04:17.689817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb0c53-479c-4fc0-8e92-e3391fd54f53 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:04:17.695429 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e7f0e-722d-4679-9161-2d8bd15bd381 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:04:17.696075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e7f0e-722d-4679-9161-2d8bd15bd381 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:04:17.696362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e7f0e-722d-4679-9161-2d8bd15bd381 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:04:17.696638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e7f0e-722d-4679-9161-2d8bd15bd381 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:04:17.698565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-fd7e7f0e-722d-4679-9161-2d8bd15bd381 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:04:17.714299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e7f0e-722d-4679-9161-2d8bd15bd381 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:04:17.715900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e7f0e-722d-4679-9161-2d8bd15bd381 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:04:17.730168 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4383/8831] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:04:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 22:04:27.722526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:04:51.163443 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85228bf-0315-4525-a353-af21a8f09052 None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:04:51.164031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85228bf-0315-4525-a353-af21a8f09052 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:04:51.164031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85228bf-0315-4525-a353-af21a8f09052 None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:04:51.165368 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4449/8832] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 22:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 22:04:51.170437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361158b7-4891-479e-9f22-1c10cea181cd None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:04:51.170877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361158b7-4891-479e-9f22-1c10cea181cd None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:04:51.170983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361158b7-4891-479e-9f22-1c10cea181cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:04:51.189615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-361158b7-4891-479e-9f22-1c10cea181cd None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:04:51.190810 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-361158b7-4891-479e-9f22-1c10cea181cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:04:51.204672 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4384/8833] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 22:04:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:04:51.226484 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9506d-bd5b-498b-8cd4-c057cbc0468e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:04:51.226978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9506d-bd5b-498b-8cd4-c057cbc0468e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:04:51.227514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9506d-bd5b-498b-8cd4-c057cbc0468e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:04:51.250188 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-75c9506d-bd5b-498b-8cd4-c057cbc0468e None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:04:51.252069 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-75c9506d-bd5b-498b-8cd4-c057cbc0468e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:04:51.266095 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4450/8834] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Jul 16 22:04:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:04:51.272927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361158b7-4891-479e-9f22-1c10cea181cd None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:04:51.284134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361158b7-4891-479e-9f22-1c10cea181cd None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:04:51.289208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bca32-0609-4850-9b00-415e405e878c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:04:51.289834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bca32-0609-4850-9b00-415e405e878c service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:04:51.290117 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bca32-0609-4850-9b00-415e405e878c service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:04:51.290420 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bca32-0609-4850-9b00-415e405e878c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:04:51.298734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bca32-0609-4850-9b00-415e405e878c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:04:51.300338 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bca32-0609-4850-9b00-415e405e878c service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:04:51.310633 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4385/8835] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:04:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:05:01.243776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:05:01.306911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=9 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:05:27.538063 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e2334-18a6-44f0-93d8-464a7bda85a6 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:05:27.538558 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e2334-18a6-44f0-93d8-464a7bda85a6 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:05:27.538670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e2334-18a6-44f0-93d8-464a7bda85a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:05:27.558477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-238e2334-18a6-44f0-93d8-464a7bda85a6 None None] MFA Rules not processed for user `718f6de3b1a1453d9579d421a574691e`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:05:27.559746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-238e2334-18a6-44f0-93d8-464a7bda85a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:05:27.567076 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4451/8836] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:05:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:05:27.875933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bca32-0609-4850-9b00-415e405e878c service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:05:27.885577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bca32-0609-4850-9b00-415e405e878c service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:05:27.891594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2debb-425c-4b57-b6dd-f8139b4df0dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:05:27.891594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2debb-425c-4b57-b6dd-f8139b4df0dd service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:05:27.891594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2debb-425c-4b57-b6dd-f8139b4df0dd service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:05:27.891594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2debb-425c-4b57-b6dd-f8139b4df0dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:05:27.892664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bcc2debb-425c-4b57-b6dd-f8139b4df0dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:05:27.904680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2debb-425c-4b57-b6dd-f8139b4df0dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:05:27.906097 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2debb-425c-4b57-b6dd-f8139b4df0dd service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:05:27.917436 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4386/8837] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:05:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:05:33.995428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e2334-18a6-44f0-93d8-464a7bda85a6 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:05:34.005946 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e2334-18a6-44f0-93d8-464a7bda85a6 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:05:34.009925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be2eb8-175a-487f-afa3-2259b38a18c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:05:34.010649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be2eb8-175a-487f-afa3-2259b38a18c7 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:05:34.010932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be2eb8-175a-487f-afa3-2259b38a18c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:05:34.011246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be2eb8-175a-487f-afa3-2259b38a18c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:05:34.012993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d4be2eb8-175a-487f-afa3-2259b38a18c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:05:34.029277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be2eb8-175a-487f-afa3-2259b38a18c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:05:34.030708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be2eb8-175a-487f-afa3-2259b38a18c7 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:05:34.044718 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4452/8838] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:05:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:05:35.221295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2debb-425c-4b57-b6dd-f8139b4df0dd service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:05:35.230672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2debb-425c-4b57-b6dd-f8139b4df0dd service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:05:35.235404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120e3c9-7c04-42f7-b1eb-c6dc120403c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:05:35.241753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120e3c9-7c04-42f7-b1eb-c6dc120403c5 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:05:35.241753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120e3c9-7c04-42f7-b1eb-c6dc120403c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:05:35.241753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120e3c9-7c04-42f7-b1eb-c6dc120403c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:05:35.241753 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1120e3c9-7c04-42f7-b1eb-c6dc120403c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:05:35.256516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120e3c9-7c04-42f7-b1eb-c6dc120403c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:05:35.258024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120e3c9-7c04-42f7-b1eb-c6dc120403c5 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:05:35.271716 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4387/8839] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:05:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:05:38.446225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be2eb8-175a-487f-afa3-2259b38a18c7 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:05:38.456172 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be2eb8-175a-487f-afa3-2259b38a18c7 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:05:38.459988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d825526-e396-4bbc-a448-1921e0125d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:05:38.460642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d825526-e396-4bbc-a448-1921e0125d57 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:05:38.460925 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d825526-e396-4bbc-a448-1921e0125d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:05:38.461204 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d825526-e396-4bbc-a448-1921e0125d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:05:38.463099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0d825526-e396-4bbc-a448-1921e0125d57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:05:38.478481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d825526-e396-4bbc-a448-1921e0125d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:05:38.479988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d825526-e396-4bbc-a448-1921e0125d57 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:05:38.493647 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4453/8840] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:05:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:05:45.264300 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=12 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:05:48.485035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=15 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:06:15.857229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c102f-dc3f-40d3-8445-545d66f64bb4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:06:15.857801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c102f-dc3f-40d3-8445-545d66f64bb4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:06:15.857801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c102f-dc3f-40d3-8445-545d66f64bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:06:15.916687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e40c102f-dc3f-40d3-8445-545d66f64bb4 None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:06:15.917892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e40c102f-dc3f-40d3-8445-545d66f64bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:06:15.927812 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4388/8841] 10.222.0.16 () {58 vars in 1059 bytes} [Sat Jul 16 22:06:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:06:15.933926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62c0bf-10cb-48a9-9056-e9150a0c1fe2 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:06:15.935219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62c0bf-10cb-48a9-9056-e9150a0c1fe2 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:06:15.935219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62c0bf-10cb-48a9-9056-e9150a0c1fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:06:15.952451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-cd62c0bf-10cb-48a9-9056-e9150a0c1fe2 None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:06:15.953963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-cd62c0bf-10cb-48a9-9056-e9150a0c1fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:06:15.963861 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4454/8842] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 22:06:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:06:15.976147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c102f-dc3f-40d3-8445-545d66f64bb4 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:06:15.984579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c102f-dc3f-40d3-8445-545d66f64bb4 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:06:15.988276 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c596829-a5d2-4396-a385-7a58b087c8dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:06:15.988911 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c596829-a5d2-4396-a385-7a58b087c8dd service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:06:15.989193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c596829-a5d2-4396-a385-7a58b087c8dd service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:06:15.989469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c596829-a5d2-4396-a385-7a58b087c8dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:06:15.999836 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c596829-a5d2-4396-a385-7a58b087c8dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:06:16.001257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c596829-a5d2-4396-a385-7a58b087c8dd service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:06:16.012724 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4389/8843] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:06:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:06:16.185065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e108fde-6aff-4e8d-afd2-0f92d9edeb62 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:06:16.185349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e108fde-6aff-4e8d-afd2-0f92d9edeb62 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:06:16.185626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e108fde-6aff-4e8d-afd2-0f92d9edeb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:06:16.204557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-4e108fde-6aff-4e8d-afd2-0f92d9edeb62 None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:06:16.206340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4e108fde-6aff-4e8d-afd2-0f92d9edeb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:06:16.215653 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4455/8844] 10.222.0.16 () {58 vars in 1059 bytes} [Sat Jul 16 22:06:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:06:16.221503 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16e221-9736-4601-9612-1c239c81291f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:06:16.222017 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16e221-9736-4601-9612-1c239c81291f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:06:16.222295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16e221-9736-4601-9612-1c239c81291f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:06:16.239994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8f16e221-9736-4601-9612-1c239c81291f None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:06:16.241246 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8f16e221-9736-4601-9612-1c239c81291f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:06:16.250443 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4390/8845] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 22:06:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:06:16.263500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e108fde-6aff-4e8d-afd2-0f92d9edeb62 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:06:16.264859 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4e108fde-6aff-4e8d-afd2-0f92d9edeb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:06:16.341247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e108fde-6aff-4e8d-afd2-0f92d9edeb62 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:06:16.344797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c58a33-e638-4425-b379-cd4eac6a89e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:06:16.345432 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c58a33-e638-4425-b379-cd4eac6a89e0 service cinder] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:06:16.345713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c58a33-e638-4425-b379-cd4eac6a89e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:06:16.345987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c58a33-e638-4425-b379-cd4eac6a89e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:06:16.356253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c58a33-e638-4425-b379-cd4eac6a89e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:06:16.357671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c58a33-e638-4425-b379-cd4eac6a89e0 service cinder] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:06:16.368484 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4456/8846] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:06:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:06:16.375541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16e221-9736-4601-9612-1c239c81291f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:06:16.385075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16e221-9736-4601-9612-1c239c81291f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:06:16.388626 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ead5b-6ce3-463c-b0f7-74b527b0039f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcc74f579e447938a2477e253e5d36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:06:16.389256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ead5b-6ce3-463c-b0f7-74b527b0039f service cinder] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:06:16.389534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ead5b-6ce3-463c-b0f7-74b527b0039f service cinder] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:06:16.389804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ead5b-6ce3-463c-b0f7-74b527b0039f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:06:16.398683 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ead5b-6ce3-463c-b0f7-74b527b0039f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:06:16.400131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ead5b-6ce3-463c-b0f7-74b527b0039f service cinder] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:06:16.408775 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4391/8847] 10.222.0.16 () {60 vars in 1396 bytes} [Sat Jul 16 22:06:16 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3244 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:06:22.252686 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaebca6-b70c-4e40-80a3-96bf2620953b None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:06:22.253254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaebca6-b70c-4e40-80a3-96bf2620953b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:06:22.253254 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaebca6-b70c-4e40-80a3-96bf2620953b None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:06:22.254706 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4457/8848] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 22:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 22:06:22.259734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814e344-c63b-429b-8465-35002ae6b3b0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:06:22.260169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814e344-c63b-429b-8465-35002ae6b3b0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:06:22.260295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814e344-c63b-429b-8465-35002ae6b3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:06:22.277953 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e814e344-c63b-429b-8465-35002ae6b3b0 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:06:22.283159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e814e344-c63b-429b-8465-35002ae6b3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:06:22.288550 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4392/8849] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 22:06:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:06:22.310314 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaebca6-b70c-4e40-80a3-96bf2620953b None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:06:22.324310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaebca6-b70c-4e40-80a3-96bf2620953b None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:06:22.330338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89af462-65b1-4a46-ad85-7804cb2e2e59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:06:22.330984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89af462-65b1-4a46-ad85-7804cb2e2e59 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:06:22.331293 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89af462-65b1-4a46-ad85-7804cb2e2e59 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:06:22.331611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89af462-65b1-4a46-ad85-7804cb2e2e59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:06:22.340307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89af462-65b1-4a46-ad85-7804cb2e2e59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:06:22.344014 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89af462-65b1-4a46-ad85-7804cb2e2e59 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:06:22.352595 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4458/8850] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:06:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:06:24.233021 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5c68b-68e8-441c-892c-5c2dea6066f7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:06:24.233559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5c68b-68e8-441c-892c-5c2dea6066f7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:06:24.233559 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5c68b-68e8-441c-892c-5c2dea6066f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:06:24.269446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-6bd5c68b-68e8-441c-892c-5c2dea6066f7 None None] MFA Rules not processed for user `fbd858f3e6ba4523b056bbdc2af427b0`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:06:24.270636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-6bd5c68b-68e8-441c-892c-5c2dea6066f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:06:24.277310 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4393/8851] 10.222.0.30 () {58 vars in 1015 bytes} [Sat Jul 16 22:06:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:06:24.289905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89af462-65b1-4a46-ad85-7804cb2e2e59 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:06:24.299474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89af462-65b1-4a46-ad85-7804cb2e2e59 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:06:24.303941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5d96b-d272-4610-8e81-37fa4a988cb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:06:24.304586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5d96b-d272-4610-8e81-37fa4a988cb4 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:06:24.304867 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5d96b-d272-4610-8e81-37fa4a988cb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:06:24.305140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5d96b-d272-4610-8e81-37fa4a988cb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:06:24.313616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5d96b-d272-4610-8e81-37fa4a988cb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:06:24.315325 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5d96b-d272-4610-8e81-37fa4a988cb4 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:06:24.323530 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4459/8852] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:06:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:06:34.266589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=44 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:06:34.319897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=53 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:06:48.549627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb88d8c-1706-418c-88ed-bc058de1b107 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:06:48.550194 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb88d8c-1706-418c-88ed-bc058de1b107 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:06:48.550680 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb88d8c-1706-418c-88ed-bc058de1b107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:06:48.573007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ddb88d8c-1706-418c-88ed-bc058de1b107 None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:06:48.574525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ddb88d8c-1706-418c-88ed-bc058de1b107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:06:48.584404 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4394/8853] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 22:06:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:06:48.599166 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5d96b-d272-4610-8e81-37fa4a988cb4 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:06:48.613949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5d96b-d272-4610-8e81-37fa4a988cb4 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:06:48.620266 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6acff6-7f45-423e-aca3-2231b34e6386 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:06:48.620911 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6acff6-7f45-423e-aca3-2231b34e6386 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:06:48.621197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6acff6-7f45-423e-aca3-2231b34e6386 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:06:48.621474 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6acff6-7f45-423e-aca3-2231b34e6386 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:06:48.633800 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6acff6-7f45-423e-aca3-2231b34e6386 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:06:48.635504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6acff6-7f45-423e-aca3-2231b34e6386 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:06:48.646795 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4460/8854] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:06:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:06:54.721894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93211da9-796a-433e-9c4e-601b82b3653d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:06:54.722898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93211da9-796a-433e-9c4e-601b82b3653d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:06:54.723212 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93211da9-796a-433e-9c4e-601b82b3653d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:06:54.743409 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-93211da9-796a-433e-9c4e-601b82b3653d None None] MFA Rules not processed for user `fbd858f3e6ba4523b056bbdc2af427b0`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:06:54.744682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-93211da9-796a-433e-9c4e-601b82b3653d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:06:54.751625 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4395/8855] 10.222.0.17 () {58 vars in 1015 bytes} [Sat Jul 16 22:06:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 22:06:54.765296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6acff6-7f45-423e-aca3-2231b34e6386 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:06:54.775767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6acff6-7f45-423e-aca3-2231b34e6386 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:06:54.779514 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfca318-b590-4372-8009-68a67bb0dc53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:06:54.780886 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfca318-b590-4372-8009-68a67bb0dc53 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:06:54.781262 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfca318-b590-4372-8009-68a67bb0dc53 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:06:54.781612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfca318-b590-4372-8009-68a67bb0dc53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:06:54.790317 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfca318-b590-4372-8009-68a67bb0dc53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:06:54.791871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfca318-b590-4372-8009-68a67bb0dc53 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:06:54.800329 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4461/8856] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:06:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:07:04.737726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:07:04.796506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=12 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:07:07.471751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93211da9-796a-433e-9c4e-601b82b3653d None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:07.480920 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93211da9-796a-433e-9c4e-601b82b3653d None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:07.484576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0e1f3-2ac7-4a8a-9d8d-a1dcc584724a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:07.485220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0e1f3-2ac7-4a8a-9d8d-a1dcc584724a service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:07.485505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0e1f3-2ac7-4a8a-9d8d-a1dcc584724a service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:07.485782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0e1f3-2ac7-4a8a-9d8d-a1dcc584724a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:07.494830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0e1f3-2ac7-4a8a-9d8d-a1dcc584724a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:07.496323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0e1f3-2ac7-4a8a-9d8d-a1dcc584724a service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:07.523541 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4396/8857] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:07:10.809046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfca318-b590-4372-8009-68a67bb0dc53 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:10.822234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfca318-b590-4372-8009-68a67bb0dc53 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:10.827895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c1bcd-dc9c-40ef-8f0d-eaa952684488 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:10.828602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c1bcd-dc9c-40ef-8f0d-eaa952684488 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:10.831146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c1bcd-dc9c-40ef-8f0d-eaa952684488 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:10.831146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c1bcd-dc9c-40ef-8f0d-eaa952684488 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:10.831146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a76c1bcd-dc9c-40ef-8f0d-eaa952684488 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:07:10.861691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c1bcd-dc9c-40ef-8f0d-eaa952684488 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:10.863282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c1bcd-dc9c-40ef-8f0d-eaa952684488 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:10.878015 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4462/8858] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:07:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:07:10.954243 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0e1f3-2ac7-4a8a-9d8d-a1dcc584724a service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:10.965252 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0e1f3-2ac7-4a8a-9d8d-a1dcc584724a service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:10.970273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70ec9a-9fe8-4894-bab0-daf400febdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:10.971192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70ec9a-9fe8-4894-bab0-daf400febdce admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:10.971479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70ec9a-9fe8-4894-bab0-daf400febdce admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:10.971759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70ec9a-9fe8-4894-bab0-daf400febdce admin admin] PATH_INFO: `/v3/users/718f6de3b1a1453d9579d421a574691e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:10.972966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70ec9a-9fe8-4894-bab0-daf400febdce admin admin] RBAC: Authorizing `identity:delete_user(user_id=718f6de3b1a1453d9579d421a574691e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:10.975081 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70ec9a-9fe8-4894-bab0-daf400febdce admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:11.145119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2a70ec9a-9fe8-4894-bab0-daf400febdce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '718f6de3b1a1453d9579d421a574691e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:07:11.156907 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2a70ec9a-9fe8-4894-bab0-daf400febdce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '718f6de3b1a1453d9579d421a574691e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:07:11.218170 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2a70ec9a-9fe8-4894-bab0-daf400febdce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '718f6de3b1a1453d9579d421a574691e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:07:11.225607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2a70ec9a-9fe8-4894-bab0-daf400febdce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '718f6de3b1a1453d9579d421a574691e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:07:11.226240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-2a70ec9a-9fe8-4894-bab0-daf400febdce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '718f6de3b1a1453d9579d421a574691e'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:07:11.232393 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4397/8859] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 22:07:10 2022] DELETE /identity/v3/users/718f6de3b1a1453d9579d421a574691e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:07:11.471760 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c1bcd-dc9c-40ef-8f0d-eaa952684488 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:11.483798 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c1bcd-dc9c-40ef-8f0d-eaa952684488 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:11.542108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b9a20-5569-4f12-bb20-f27534a607ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:11.543053 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b9a20-5569-4f12-bb20-f27534a607ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:11.543336 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b9a20-5569-4f12-bb20-f27534a607ac admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:11.543607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b9a20-5569-4f12-bb20-f27534a607ac admin admin] PATH_INFO: `/v3/projects/fd21231d9af34d9aa4f9e03229b49a30` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:11.544770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b9a20-5569-4f12-bb20-f27534a607ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd21231d9af34d9aa4f9e03229b49a30)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:11.546732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b9a20-5569-4f12-bb20-f27534a607ac admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:11.640915 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-201b9a20-5569-4f12-bb20-f27534a607ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd21231d9af34d9aa4f9e03229b49a30', 'request_id': 'req-201b9a20-5569-4f12-bb20-f27534a607ac'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:07:11.647095 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-201b9a20-5569-4f12-bb20-f27534a607ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd21231d9af34d9aa4f9e03229b49a30', 'request_id': 'req-201b9a20-5569-4f12-bb20-f27534a607ac'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:07:11.652747 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-201b9a20-5569-4f12-bb20-f27534a607ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd21231d9af34d9aa4f9e03229b49a30', 'request_id': 'req-201b9a20-5569-4f12-bb20-f27534a607ac'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:07:11.744697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-201b9a20-5569-4f12-bb20-f27534a607ac admin admin] The token cache is being invalidate because project fd21231d9af34d9aa4f9e03229b49a30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 22:07:11.744913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-201b9a20-5569-4f12-bb20-f27534a607ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:07:11.745595 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-201b9a20-5569-4f12-bb20-f27534a607ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:07:11.747379 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4463/8860] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 22:07:11 2022] DELETE /identity/v3/projects/fd21231d9af34d9aa4f9e03229b49a30 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:07:11.752324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a6d0b-c9fd-4971-b774-1fafde9d989b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:11.752612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a6d0b-c9fd-4971-b774-1fafde9d989b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:11.752890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a6d0b-c9fd-4971-b774-1fafde9d989b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:11.799670 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-547a6d0b-c9fd-4971-b774-1fafde9d989b None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:07:11.800952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-547a6d0b-c9fd-4971-b774-1fafde9d989b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:07:11.860238 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4398/8861] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:07:11.868476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f36a33-e1ad-4550-aab5-6ec52cc1c442 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:11.868896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f36a33-e1ad-4550-aab5-6ec52cc1c442 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:11.869035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f36a33-e1ad-4550-aab5-6ec52cc1c442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:11.886935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-20f36a33-e1ad-4550-aab5-6ec52cc1c442 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:07:11.888178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-20f36a33-e1ad-4550-aab5-6ec52cc1c442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:07:11.896211 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4464/8862] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:07:11.901013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a6d0b-c9fd-4971-b774-1fafde9d989b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:11.910812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a6d0b-c9fd-4971-b774-1fafde9d989b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:11.916027 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf1765-45f8-4a78-951e-548f8b4654ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:11.916677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf1765-45f8-4a78-951e-548f8b4654ba admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:11.916994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf1765-45f8-4a78-951e-548f8b4654ba admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:11.917282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf1765-45f8-4a78-951e-548f8b4654ba admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:11.918036 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf1765-45f8-4a78-951e-548f8b4654ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 22:07:11.918344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf1765-45f8-4a78-951e-548f8b4654ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:11.919973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf1765-45f8-4a78-951e-548f8b4654ba admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:11.931518 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4399/8863] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 22:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 22:07:11.938048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f36a33-e1ad-4550-aab5-6ec52cc1c442 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:11.945351 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f36a33-e1ad-4550-aab5-6ec52cc1c442 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:11.950436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5f397-4cec-4cfa-819e-f774d9ae8eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:11.951181 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5f397-4cec-4cfa-819e-f774d9ae8eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:11.951722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5f397-4cec-4cfa-819e-f774d9ae8eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:11.951996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5f397-4cec-4cfa-819e-f774d9ae8eb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:11.952673 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5f397-4cec-4cfa-819e-f774d9ae8eb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:11.954622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5f397-4cec-4cfa-819e-f774d9ae8eb0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:12.039111 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4465/8864] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 22:07:11 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 22:07:12.042546 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf1765-45f8-4a78-951e-548f8b4654ba admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:12.053722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf1765-45f8-4a78-951e-548f8b4654ba admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:12.059079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:07:12.112941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f3da7-3d53-4912-8853-866c3e922645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:12.113842 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f3da7-3d53-4912-8853-866c3e922645 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:12.114370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f3da7-3d53-4912-8853-866c3e922645 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:12.115096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f3da7-3d53-4912-8853-866c3e922645 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:12.115956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f3da7-3d53-4912-8853-866c3e922645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:12.118446 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f3da7-3d53-4912-8853-866c3e922645 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:12.202767 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4400/8865] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 22:07:12 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 22:07:12.206884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5f397-4cec-4cfa-819e-f774d9ae8eb0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:12.218350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5f397-4cec-4cfa-819e-f774d9ae8eb0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:12.223101 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee7572-203c-40f9-b6fe-57dcb53aa8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:12.227141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee7572-203c-40f9-b6fe-57dcb53aa8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:12.227141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee7572-203c-40f9-b6fe-57dcb53aa8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:12.227141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee7572-203c-40f9-b6fe-57dcb53aa8c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:12.227141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee7572-203c-40f9-b6fe-57dcb53aa8c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:12.227141 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee7572-203c-40f9-b6fe-57dcb53aa8c9 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:12.236958 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4466/8866] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 22:07:12.241037 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f3da7-3d53-4912-8853-866c3e922645 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:12.251787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f3da7-3d53-4912-8853-866c3e922645 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:12.256748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5a973-948c-4907-9588-fc5d0586c094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:12.257518 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5a973-948c-4907-9588-fc5d0586c094 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:12.257800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5a973-948c-4907-9588-fc5d0586c094 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:12.258575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5a973-948c-4907-9588-fc5d0586c094 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:12.259324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5a973-948c-4907-9588-fc5d0586c094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:12.260915 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5a973-948c-4907-9588-fc5d0586c094 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:12.271078 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4401/8867] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 22:07:12.276090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee7572-203c-40f9-b6fe-57dcb53aa8c9 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:12.286029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee7572-203c-40f9-b6fe-57dcb53aa8c9 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:12.290619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c84fb7-90b8-4962-8a1f-ff7dbe291222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:12.291527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c84fb7-90b8-4962-8a1f-ff7dbe291222 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:12.291801 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c84fb7-90b8-4962-8a1f-ff7dbe291222 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:12.292071 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c84fb7-90b8-4962-8a1f-ff7dbe291222 admin admin] PATH_INFO: `/v3/projects/1617cbc6e7cf4eed8d2f8968da996b9c/users/b91f7cf2a74f45858448608b096b0c31/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:12.294431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:07:12.308276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c84fb7-90b8-4962-8a1f-ff7dbe291222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1617cbc6e7cf4eed8d2f8968da996b9c, user_id=b91f7cf2a74f45858448608b096b0c31, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:12.311105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c84fb7-90b8-4962-8a1f-ff7dbe291222 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:12.393601 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4467/8868] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 22:07:12 2022] PUT /identity/v3/projects/1617cbc6e7cf4eed8d2f8968da996b9c/users/b91f7cf2a74f45858448608b096b0c31/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:07:12.399434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18401198-7ac9-4838-80fb-7de2d185938d None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:12.399757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18401198-7ac9-4838-80fb-7de2d185938d None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:12.400040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18401198-7ac9-4838-80fb-7de2d185938d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:12.418671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-18401198-7ac9-4838-80fb-7de2d185938d None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:07:12.419886 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-18401198-7ac9-4838-80fb-7de2d185938d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:07:12.478369 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4402/8869] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:07:12.488171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c84fb7-90b8-4962-8a1f-ff7dbe291222 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:12.489878 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-36c84fb7-90b8-4962-8a1f-ff7dbe291222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:07:12.548936 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c84fb7-90b8-4962-8a1f-ff7dbe291222 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:12.552492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fea0e-9ae6-4e5f-ab0d-d2f5048dd094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:12.553128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fea0e-9ae6-4e5f-ab0d-d2f5048dd094 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:12.553412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fea0e-9ae6-4e5f-ab0d-d2f5048dd094 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:12.553690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fea0e-9ae6-4e5f-ab0d-d2f5048dd094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:12.563220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fea0e-9ae6-4e5f-ab0d-d2f5048dd094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:12.564657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fea0e-9ae6-4e5f-ab0d-d2f5048dd094 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:12.575134 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4468/8870] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:07:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:07:18.042768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1a5f0-615a-4c32-b705-93e9e6386568 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:18.043285 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1a5f0-615a-4c32-b705-93e9e6386568 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:18.043414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1a5f0-615a-4c32-b705-93e9e6386568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:18.075799 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-b3e1a5f0-615a-4c32-b705-93e9e6386568 None None] MFA Rules not processed for user `b91f7cf2a74f45858448608b096b0c31`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:07:18.077595 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b3e1a5f0-615a-4c32-b705-93e9e6386568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:07:18.151341 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4403/8871] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:07:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:07:18.161700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c1ba9-ddd8-4b49-a4e4-6f8a3be5c5fd None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:18.162257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c1ba9-ddd8-4b49-a4e4-6f8a3be5c5fd None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:18.162257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c1ba9-ddd8-4b49-a4e4-6f8a3be5c5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:18.182067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ea4c1ba9-ddd8-4b49-a4e4-6f8a3be5c5fd None None] MFA Rules not processed for user `b91f7cf2a74f45858448608b096b0c31`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:07:18.183606 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ea4c1ba9-ddd8-4b49-a4e4-6f8a3be5c5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:07:18.191129 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4469/8872] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:07:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:07:18.205912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1a5f0-615a-4c32-b705-93e9e6386568 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:18.207504 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-b3e1a5f0-615a-4c32-b705-93e9e6386568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:07:18.229972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:07:18.293633 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1a5f0-615a-4c32-b705-93e9e6386568 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:18.299411 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e4dd2-8111-4c35-af64-d42080d6e7d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:18.300102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e4dd2-8111-4c35-af64-d42080d6e7d3 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:18.300391 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e4dd2-8111-4c35-af64-d42080d6e7d3 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:18.300671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e4dd2-8111-4c35-af64-d42080d6e7d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:18.309128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e4dd2-8111-4c35-af64-d42080d6e7d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:18.310722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e4dd2-8111-4c35-af64-d42080d6e7d3 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:18.320926 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4404/8873] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:07:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:07:18.593350 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227496f3-9e13-4b76-a1ef-6b546582019b None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:18.593651 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227496f3-9e13-4b76-a1ef-6b546582019b None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:18.593940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227496f3-9e13-4b76-a1ef-6b546582019b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:18.612429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-227496f3-9e13-4b76-a1ef-6b546582019b None None] MFA Rules not processed for user `fbd858f3e6ba4523b056bbdc2af427b0`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:07:18.613616 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-227496f3-9e13-4b76-a1ef-6b546582019b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:07:18.620741 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4470/8874] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 22:07:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:07:18.632451 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e4dd2-8111-4c35-af64-d42080d6e7d3 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:18.634630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1e4e4dd2-8111-4c35-af64-d42080d6e7d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:07:18.646722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e4dd2-8111-4c35-af64-d42080d6e7d3 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:18.650615 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29942a2a-ceb1-45d0-ba11-4a22e099fd86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:18.651289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29942a2a-ceb1-45d0-ba11-4a22e099fd86 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:18.651574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29942a2a-ceb1-45d0-ba11-4a22e099fd86 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:18.651853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29942a2a-ceb1-45d0-ba11-4a22e099fd86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:18.658974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29942a2a-ceb1-45d0-ba11-4a22e099fd86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:18.660425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29942a2a-ceb1-45d0-ba11-4a22e099fd86 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:18.668511 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4405/8875] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:07:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 22:07:23.156450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f03f2b-d664-4b99-8450-a938c819f71d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:23.156968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f03f2b-d664-4b99-8450-a938c819f71d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:23.157242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f03f2b-d664-4b99-8450-a938c819f71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:23.188834 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-59f03f2b-d664-4b99-8450-a938c819f71d None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:07:23.190065 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-59f03f2b-d664-4b99-8450-a938c819f71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:07:23.202002 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4471/8876] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 22:07:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:07:23.216382 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29942a2a-ceb1-45d0-ba11-4a22e099fd86 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:23.217995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-29942a2a-ceb1-45d0-ba11-4a22e099fd86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:07:23.243517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29942a2a-ceb1-45d0-ba11-4a22e099fd86 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:23.253425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66e4ce-a7d3-4aec-a688-932d012ab65c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:23.254095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66e4ce-a7d3-4aec-a688-932d012ab65c service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:23.254373 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66e4ce-a7d3-4aec-a688-932d012ab65c service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:23.254712 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66e4ce-a7d3-4aec-a688-932d012ab65c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:23.265912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66e4ce-a7d3-4aec-a688-932d012ab65c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:23.267549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66e4ce-a7d3-4aec-a688-932d012ab65c service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:23.285544 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4406/8877] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:07:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:07:31.310054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf496d-b7ff-4f57-9004-b475106189de None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:31.310553 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf496d-b7ff-4f57-9004-b475106189de None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:31.310650 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf496d-b7ff-4f57-9004-b475106189de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:31.328994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-7adf496d-b7ff-4f57-9004-b475106189de None None] MFA Rules not processed for user `b91f7cf2a74f45858448608b096b0c31`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:07:31.330189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-7adf496d-b7ff-4f57-9004-b475106189de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:07:31.337067 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4472/8878] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:07:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:07:33.278723 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=38 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:07:35.701288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee244887-07a9-4d53-bfaa-2411aead9567 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:35.703612 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee244887-07a9-4d53-bfaa-2411aead9567 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:35.704122 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee244887-07a9-4d53-bfaa-2411aead9567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:35.726116 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ee244887-07a9-4d53-bfaa-2411aead9567 None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:07:35.728008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ee244887-07a9-4d53-bfaa-2411aead9567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:07:35.739389 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4407/8879] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 22:07:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:07:35.755213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf496d-b7ff-4f57-9004-b475106189de None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:35.772463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf496d-b7ff-4f57-9004-b475106189de None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:35.778310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813bc47-b4e0-4aaa-8f1e-94b9db0c8860 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:35.779260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813bc47-b4e0-4aaa-8f1e-94b9db0c8860 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:35.779548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813bc47-b4e0-4aaa-8f1e-94b9db0c8860 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:35.779825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813bc47-b4e0-4aaa-8f1e-94b9db0c8860 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:35.789589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813bc47-b4e0-4aaa-8f1e-94b9db0c8860 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:35.791184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813bc47-b4e0-4aaa-8f1e-94b9db0c8860 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:35.803652 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4473/8880] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:07:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:07:45.720537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:07:45.798220 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=51,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:07:54.788160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee244887-07a9-4d53-bfaa-2411aead9567 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:54.789600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ee244887-07a9-4d53-bfaa-2411aead9567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:07:54.865705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee244887-07a9-4d53-bfaa-2411aead9567 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:54.870765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7634e-d1f7-4ba0-931a-d0ab7f46c298 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:54.871871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7634e-d1f7-4ba0-931a-d0ab7f46c298 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:54.874415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7634e-d1f7-4ba0-931a-d0ab7f46c298 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:54.874415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7634e-d1f7-4ba0-931a-d0ab7f46c298 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:54.874415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ecf7634e-d1f7-4ba0-931a-d0ab7f46c298 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:07:54.890041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7634e-d1f7-4ba0-931a-d0ab7f46c298 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:54.892040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7634e-d1f7-4ba0-931a-d0ab7f46c298 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:54.900088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813bc47-b4e0-4aaa-8f1e-94b9db0c8860 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:54.910239 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4408/8881] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:07:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:07:54.915575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813bc47-b4e0-4aaa-8f1e-94b9db0c8860 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:54.920440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6ab5d-b80e-4553-a8be-78e571ea8cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:54.921303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6ab5d-b80e-4553-a8be-78e571ea8cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:54.921587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6ab5d-b80e-4553-a8be-78e571ea8cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:54.922377 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6ab5d-b80e-4553-a8be-78e571ea8cdb admin admin] PATH_INFO: `/v3/users/b91f7cf2a74f45858448608b096b0c31` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:54.924072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6ab5d-b80e-4553-a8be-78e571ea8cdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b91f7cf2a74f45858448608b096b0c31)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:54.926192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6ab5d-b80e-4553-a8be-78e571ea8cdb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:55.132499 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8bf6ab5d-b80e-4553-a8be-78e571ea8cdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b91f7cf2a74f45858448608b096b0c31'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:07:55.139598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8bf6ab5d-b80e-4553-a8be-78e571ea8cdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b91f7cf2a74f45858448608b096b0c31'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:07:55.192716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8bf6ab5d-b80e-4553-a8be-78e571ea8cdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b91f7cf2a74f45858448608b096b0c31'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:07:55.193371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8bf6ab5d-b80e-4553-a8be-78e571ea8cdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b91f7cf2a74f45858448608b096b0c31'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:07:55.206635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-8bf6ab5d-b80e-4553-a8be-78e571ea8cdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b91f7cf2a74f45858448608b096b0c31'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:07:55.214770 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4474/8882] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 22:07:54 2022] DELETE /identity/v3/users/b91f7cf2a74f45858448608b096b0c31 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 22:07:55.453366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7634e-d1f7-4ba0-931a-d0ab7f46c298 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:55.464608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7634e-d1f7-4ba0-931a-d0ab7f46c298 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:55.523847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b4bd1-d246-45f5-ba04-ca2fdbcf5f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:55.524704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b4bd1-d246-45f5-ba04-ca2fdbcf5f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:55.524988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b4bd1-d246-45f5-ba04-ca2fdbcf5f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:55.525262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b4bd1-d246-45f5-ba04-ca2fdbcf5f2d admin admin] PATH_INFO: `/v3/projects/1617cbc6e7cf4eed8d2f8968da996b9c` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:55.526431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b4bd1-d246-45f5-ba04-ca2fdbcf5f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1617cbc6e7cf4eed8d2f8968da996b9c)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:55.528369 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b4bd1-d246-45f5-ba04-ca2fdbcf5f2d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:55.651744 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-164b4bd1-d246-45f5-ba04-ca2fdbcf5f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1617cbc6e7cf4eed8d2f8968da996b9c', 'request_id': 'req-164b4bd1-d246-45f5-ba04-ca2fdbcf5f2d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:07:55.657577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-164b4bd1-d246-45f5-ba04-ca2fdbcf5f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1617cbc6e7cf4eed8d2f8968da996b9c', 'request_id': 'req-164b4bd1-d246-45f5-ba04-ca2fdbcf5f2d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:07:55.663747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-164b4bd1-d246-45f5-ba04-ca2fdbcf5f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1617cbc6e7cf4eed8d2f8968da996b9c', 'request_id': 'req-164b4bd1-d246-45f5-ba04-ca2fdbcf5f2d'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:07:55.737511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-164b4bd1-d246-45f5-ba04-ca2fdbcf5f2d admin admin] The token cache is being invalidate because project 1617cbc6e7cf4eed8d2f8968da996b9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 22:07:55.737731 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-164b4bd1-d246-45f5-ba04-ca2fdbcf5f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:07:55.738358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-164b4bd1-d246-45f5-ba04-ca2fdbcf5f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:07:55.739965 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4409/8883] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 22:07:55 2022] DELETE /identity/v3/projects/1617cbc6e7cf4eed8d2f8968da996b9c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:07:55.744996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f4375-5668-46ac-b4b0-4352d8af2df3 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:55.745288 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f4375-5668-46ac-b4b0-4352d8af2df3 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:55.745569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f4375-5668-46ac-b4b0-4352d8af2df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:55.764647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ff8f4375-5668-46ac-b4b0-4352d8af2df3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:07:55.766270 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ff8f4375-5668-46ac-b4b0-4352d8af2df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:07:55.826177 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4475/8884] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:07:55.833946 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61830a-130b-44d9-8247-410455d49db0 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:55.834408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61830a-130b-44d9-8247-410455d49db0 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:55.835979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61830a-130b-44d9-8247-410455d49db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:55.853465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-3a61830a-130b-44d9-8247-410455d49db0 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:07:55.854679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3a61830a-130b-44d9-8247-410455d49db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:07:55.864678 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4410/8885] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:07:55.868994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f4375-5668-46ac-b4b0-4352d8af2df3 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:55.879105 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f4375-5668-46ac-b4b0-4352d8af2df3 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:55.883671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a2613-216b-47b5-bb75-4eba105ae8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:55.884311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a2613-216b-47b5-bb75-4eba105ae8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:55.884590 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a2613-216b-47b5-bb75-4eba105ae8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:55.884861 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a2613-216b-47b5-bb75-4eba105ae8a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:55.885582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a2613-216b-47b5-bb75-4eba105ae8a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 22:07:55.885884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a2613-216b-47b5-bb75-4eba105ae8a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:55.887506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a2613-216b-47b5-bb75-4eba105ae8a1 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:55.899118 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4476/8886] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 22:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 22:07:55.903493 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61830a-130b-44d9-8247-410455d49db0 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:55.913323 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61830a-130b-44d9-8247-410455d49db0 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:55.917973 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ed64b-98c3-44c7-8048-5666d840eaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:55.918607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ed64b-98c3-44c7-8048-5666d840eaa7 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:55.918895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ed64b-98c3-44c7-8048-5666d840eaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:55.919205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ed64b-98c3-44c7-8048-5666d840eaa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:55.919897 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ed64b-98c3-44c7-8048-5666d840eaa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:55.922457 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ed64b-98c3-44c7-8048-5666d840eaa7 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:55.932123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:07:56.000351 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4411/8887] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 22:07:55 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 22:07:56.004455 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a2613-216b-47b5-bb75-4eba105ae8a1 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:56.015271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a2613-216b-47b5-bb75-4eba105ae8a1 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:56.074695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49f67b-b43b-4aa3-aeb3-07d00088c93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:56.075670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49f67b-b43b-4aa3-aeb3-07d00088c93a admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:56.076360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49f67b-b43b-4aa3-aeb3-07d00088c93a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:56.076617 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49f67b-b43b-4aa3-aeb3-07d00088c93a admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:56.077364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49f67b-b43b-4aa3-aeb3-07d00088c93a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:56.079586 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49f67b-b43b-4aa3-aeb3-07d00088c93a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:56.086509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:07:56.170289 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4477/8888] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 22:07:56 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 22:07:56.175425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ed64b-98c3-44c7-8048-5666d840eaa7 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:56.186046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ed64b-98c3-44c7-8048-5666d840eaa7 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:56.190969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f43d1-d14d-45cc-9b90-6a58dfd76e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:56.193935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f43d1-d14d-45cc-9b90-6a58dfd76e05 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:56.193935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f43d1-d14d-45cc-9b90-6a58dfd76e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:56.193935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f43d1-d14d-45cc-9b90-6a58dfd76e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:56.193935 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f43d1-d14d-45cc-9b90-6a58dfd76e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:56.194482 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f43d1-d14d-45cc-9b90-6a58dfd76e05 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:56.206132 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4412/8889] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 22:07:56.210170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49f67b-b43b-4aa3-aeb3-07d00088c93a admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:56.221082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49f67b-b43b-4aa3-aeb3-07d00088c93a admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:56.225839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd3829-9a7c-4149-9604-6be02435a504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:56.226495 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd3829-9a7c-4149-9604-6be02435a504 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:56.226777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd3829-9a7c-4149-9604-6be02435a504 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:56.227167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd3829-9a7c-4149-9604-6be02435a504 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:56.227852 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd3829-9a7c-4149-9604-6be02435a504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:56.229519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd3829-9a7c-4149-9604-6be02435a504 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:56.240711 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4478/8890] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 22:07:56.244830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f43d1-d14d-45cc-9b90-6a58dfd76e05 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:56.255817 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f43d1-d14d-45cc-9b90-6a58dfd76e05 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:56.260433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25a73f-40ec-417b-bb15-a492922b82cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:56.261366 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25a73f-40ec-417b-bb15-a492922b82cc admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:56.261668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25a73f-40ec-417b-bb15-a492922b82cc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:56.261936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25a73f-40ec-417b-bb15-a492922b82cc admin admin] PATH_INFO: `/v3/projects/87fc85d7bfe748c69f3d86561d3c6c1a/users/453078121e1c4190bcff819439dce518/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:56.276963 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25a73f-40ec-417b-bb15-a492922b82cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=87fc85d7bfe748c69f3d86561d3c6c1a, user_id=453078121e1c4190bcff819439dce518, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:56.279636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25a73f-40ec-417b-bb15-a492922b82cc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:56.324960 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4413/8891] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 22:07:56 2022] PUT /identity/v3/projects/87fc85d7bfe748c69f3d86561d3c6c1a/users/453078121e1c4190bcff819439dce518/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 22:07:56.346240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e215279-2ecd-4db7-9b2c-bbeed03c8ae4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:56.346527 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e215279-2ecd-4db7-9b2c-bbeed03c8ae4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:56.346803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e215279-2ecd-4db7-9b2c-bbeed03c8ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:56.372940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-8e215279-2ecd-4db7-9b2c-bbeed03c8ae4 None None] MFA Rules not processed for user `453078121e1c4190bcff819439dce518`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:07:56.374162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8e215279-2ecd-4db7-9b2c-bbeed03c8ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:07:56.439177 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4479/8892] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:07:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:07:56.449221 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25a73f-40ec-417b-bb15-a492922b82cc admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:07:56.451282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ef25a73f-40ec-417b-bb15-a492922b82cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:07:56.507767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25a73f-40ec-417b-bb15-a492922b82cc admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:07:56.511432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94654dd8-3170-45ac-922c-be6f982e2e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:07:56.512075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94654dd8-3170-45ac-922c-be6f982e2e08 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:07:56.512359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94654dd8-3170-45ac-922c-be6f982e2e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:07:56.512635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94654dd8-3170-45ac-922c-be6f982e2e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:07:56.521661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94654dd8-3170-45ac-922c-be6f982e2e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:07:56.523121 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94654dd8-3170-45ac-922c-be6f982e2e08 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:07:56.532871 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4414/8893] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:07:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:08:06.370405 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d671a65-6481-4fea-9432-e3f3f460fc6c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:06.375352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d671a65-6481-4fea-9432-e3f3f460fc6c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:06.375352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d671a65-6481-4fea-9432-e3f3f460fc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:06.423175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2d671a65-6481-4fea-9432-e3f3f460fc6c None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:08:06.426851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2d671a65-6481-4fea-9432-e3f3f460fc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:06.499740 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4480/8894] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 22:08:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:08:06.511156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94654dd8-3170-45ac-922c-be6f982e2e08 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:06.512699 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-94654dd8-3170-45ac-922c-be6f982e2e08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:06.527573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94654dd8-3170-45ac-922c-be6f982e2e08 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:06.533462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ccbe2-03cd-43f8-aee3-bc637fbb8244 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:06.534201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ccbe2-03cd-43f8-aee3-bc637fbb8244 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:06.538184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ccbe2-03cd-43f8-aee3-bc637fbb8244 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:06.538184 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ccbe2-03cd-43f8-aee3-bc637fbb8244 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:06.543355 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ccbe2-03cd-43f8-aee3-bc637fbb8244 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:06.544934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ccbe2-03cd-43f8-aee3-bc637fbb8244 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:06.556852 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4415/8895] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:08:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:08:15.025048 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d671a65-6481-4fea-9432-e3f3f460fc6c None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:15.078284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:08:15.090331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d671a65-6481-4fea-9432-e3f3f460fc6c None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:15.095147 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584c49f-283f-4b87-9575-80d5a8d8d999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:15.096013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584c49f-283f-4b87-9575-80d5a8d8d999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:15.096291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584c49f-283f-4b87-9575-80d5a8d8d999 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:15.096559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584c49f-283f-4b87-9575-80d5a8d8d999 admin admin] PATH_INFO: `/v3/users/453078121e1c4190bcff819439dce518` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:15.097736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584c49f-283f-4b87-9575-80d5a8d8d999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=453078121e1c4190bcff819439dce518)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:15.100454 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584c49f-283f-4b87-9575-80d5a8d8d999 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:15.311250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d584c49f-283f-4b87-9575-80d5a8d8d999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453078121e1c4190bcff819439dce518'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:08:15.319569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d584c49f-283f-4b87-9575-80d5a8d8d999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453078121e1c4190bcff819439dce518'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:08:15.428025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d584c49f-283f-4b87-9575-80d5a8d8d999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453078121e1c4190bcff819439dce518'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:08:15.428575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d584c49f-283f-4b87-9575-80d5a8d8d999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453078121e1c4190bcff819439dce518'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:08:15.441099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-d584c49f-283f-4b87-9575-80d5a8d8d999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453078121e1c4190bcff819439dce518'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:08:15.447137 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4481/8896] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 22:08:15 2022] DELETE /identity/v3/users/453078121e1c4190bcff819439dce518 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:08:15.451859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f040c1-952d-445d-bdbd-075fcd947d32 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:15.452321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f040c1-952d-445d-bdbd-075fcd947d32 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:15.453004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f040c1-952d-445d-bdbd-075fcd947d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:15.471267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f1f040c1-952d-445d-bdbd-075fcd947d32 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:08:15.472472 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f1f040c1-952d-445d-bdbd-075fcd947d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:15.533554 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4416/8897] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:08:15.543278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584c49f-283f-4b87-9575-80d5a8d8d999 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:15.544803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d584c49f-283f-4b87-9575-80d5a8d8d999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:15.603115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584c49f-283f-4b87-9575-80d5a8d8d999 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:15.606667 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bd573-c282-4eda-b334-ca926db4d386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:15.607344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bd573-c282-4eda-b334-ca926db4d386 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:15.607622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bd573-c282-4eda-b334-ca926db4d386 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:15.607893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bd573-c282-4eda-b334-ca926db4d386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:15.618052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bd573-c282-4eda-b334-ca926db4d386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:15.619518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bd573-c282-4eda-b334-ca926db4d386 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:15.629558 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4482/8898] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:08:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:08:15.872914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f040c1-952d-445d-bdbd-075fcd947d32 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:15.874994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f1f040c1-952d-445d-bdbd-075fcd947d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:15.888636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f040c1-952d-445d-bdbd-075fcd947d32 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:15.899059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34a4e9-0e61-415d-8657-b98b71359d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:15.899059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34a4e9-0e61-415d-8657-b98b71359d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:15.899059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34a4e9-0e61-415d-8657-b98b71359d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:15.899059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34a4e9-0e61-415d-8657-b98b71359d1b admin admin] PATH_INFO: `/v3/projects/87fc85d7bfe748c69f3d86561d3c6c1a` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:15.899718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34a4e9-0e61-415d-8657-b98b71359d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=87fc85d7bfe748c69f3d86561d3c6c1a)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:15.899718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34a4e9-0e61-415d-8657-b98b71359d1b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:16.029333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:08:16.036658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8f34a4e9-0e61-415d-8657-b98b71359d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87fc85d7bfe748c69f3d86561d3c6c1a', 'request_id': 'req-8f34a4e9-0e61-415d-8657-b98b71359d1b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:08:16.042120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8f34a4e9-0e61-415d-8657-b98b71359d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87fc85d7bfe748c69f3d86561d3c6c1a', 'request_id': 'req-8f34a4e9-0e61-415d-8657-b98b71359d1b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:08:16.050487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8f34a4e9-0e61-415d-8657-b98b71359d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87fc85d7bfe748c69f3d86561d3c6c1a', 'request_id': 'req-8f34a4e9-0e61-415d-8657-b98b71359d1b'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:08:16.160534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8f34a4e9-0e61-415d-8657-b98b71359d1b admin admin] The token cache is being invalidate because project 87fc85d7bfe748c69f3d86561d3c6c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 22:08:16.164738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8f34a4e9-0e61-415d-8657-b98b71359d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:08:16.164738 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8f34a4e9-0e61-415d-8657-b98b71359d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:08:16.164738 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4417/8899] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 22:08:15 2022] DELETE /identity/v3/projects/87fc85d7bfe748c69f3d86561d3c6c1a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:08:16.168193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d875e1c-a988-4cbc-84d9-f5ec7a8ad803 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:16.168656 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d875e1c-a988-4cbc-84d9-f5ec7a8ad803 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:16.168752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d875e1c-a988-4cbc-84d9-f5ec7a8ad803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:16.186559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6d875e1c-a988-4cbc-84d9-f5ec7a8ad803 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:08:16.188702 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6d875e1c-a988-4cbc-84d9-f5ec7a8ad803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:16.248301 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4483/8900] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:08:16.256755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155ac5d-c6c5-4232-a3ec-b56e52081bc3 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:16.257038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155ac5d-c6c5-4232-a3ec-b56e52081bc3 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:16.257310 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155ac5d-c6c5-4232-a3ec-b56e52081bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:16.276086 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e155ac5d-c6c5-4232-a3ec-b56e52081bc3 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:08:16.277270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e155ac5d-c6c5-4232-a3ec-b56e52081bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:16.285423 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4418/8901] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:08:16.289431 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d875e1c-a988-4cbc-84d9-f5ec7a8ad803 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:16.299695 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d875e1c-a988-4cbc-84d9-f5ec7a8ad803 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:16.304315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30baa1ed-cfef-47fb-bf09-a248099384fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:16.304959 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baa1ed-cfef-47fb-bf09-a248099384fc admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:16.305247 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baa1ed-cfef-47fb-bf09-a248099384fc admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:16.305525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baa1ed-cfef-47fb-bf09-a248099384fc admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:16.306237 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30baa1ed-cfef-47fb-bf09-a248099384fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 22:08:16.306542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30baa1ed-cfef-47fb-bf09-a248099384fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:16.308193 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30baa1ed-cfef-47fb-bf09-a248099384fc admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:16.317545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:08:16.320776 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4484/8902] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 22:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 22:08:16.325387 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155ac5d-c6c5-4232-a3ec-b56e52081bc3 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:16.335465 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155ac5d-c6c5-4232-a3ec-b56e52081bc3 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:16.340549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151a2e1-27c0-4758-a1aa-b9c6b681c61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:16.341226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151a2e1-27c0-4758-a1aa-b9c6b681c61e admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:16.341516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151a2e1-27c0-4758-a1aa-b9c6b681c61e admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:16.341796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151a2e1-27c0-4758-a1aa-b9c6b681c61e admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:16.342494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151a2e1-27c0-4758-a1aa-b9c6b681c61e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:16.344562 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151a2e1-27c0-4758-a1aa-b9c6b681c61e admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:16.412574 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4419/8903] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 22:08:16 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 22:08:16.416940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30baa1ed-cfef-47fb-bf09-a248099384fc admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:16.427815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30baa1ed-cfef-47fb-bf09-a248099384fc admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:16.483357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efae7d-ca1e-4e46-bb73-e8b0d3200bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:16.484017 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efae7d-ca1e-4e46-bb73-e8b0d3200bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:16.484302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efae7d-ca1e-4e46-bb73-e8b0d3200bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:16.484576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efae7d-ca1e-4e46-bb73-e8b0d3200bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:16.485818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efae7d-ca1e-4e46-bb73-e8b0d3200bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:16.487782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efae7d-ca1e-4e46-bb73-e8b0d3200bf0 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:16.577395 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4485/8904] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 22:08:16 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 22:08:16.581820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151a2e1-27c0-4758-a1aa-b9c6b681c61e admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:16.592273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151a2e1-27c0-4758-a1aa-b9c6b681c61e admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:16.597102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632061e-46f7-44ae-8123-e611592d6ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:16.597735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632061e-46f7-44ae-8123-e611592d6ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:16.598018 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632061e-46f7-44ae-8123-e611592d6ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:16.598291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632061e-46f7-44ae-8123-e611592d6ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:16.599042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632061e-46f7-44ae-8123-e611592d6ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:16.600635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632061e-46f7-44ae-8123-e611592d6ad2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:16.611738 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4420/8905] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 22:08:16.615895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efae7d-ca1e-4e46-bb73-e8b0d3200bf0 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:16.626719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efae7d-ca1e-4e46-bb73-e8b0d3200bf0 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:16.631362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed704b-699b-4f0f-88e2-f7091e7a45eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:16.632011 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed704b-699b-4f0f-88e2-f7091e7a45eb admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:16.632291 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed704b-699b-4f0f-88e2-f7091e7a45eb admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:16.632564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed704b-699b-4f0f-88e2-f7091e7a45eb admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:16.633275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed704b-699b-4f0f-88e2-f7091e7a45eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:16.634853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed704b-699b-4f0f-88e2-f7091e7a45eb admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:16.644748 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4486/8906] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 22:08:16.648904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632061e-46f7-44ae-8123-e611592d6ad2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:16.659042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632061e-46f7-44ae-8123-e611592d6ad2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:16.663838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec5535-568d-481a-992d-c8011efdae8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:16.664704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec5535-568d-481a-992d-c8011efdae8d admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:16.664986 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec5535-568d-481a-992d-c8011efdae8d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:16.665263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec5535-568d-481a-992d-c8011efdae8d admin admin] PATH_INFO: `/v3/projects/f9b41f76908745648538605bcf6e6217/users/eba2245c1c71416991fd1789fbc2be0a/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:16.680107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec5535-568d-481a-992d-c8011efdae8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b41f76908745648538605bcf6e6217, user_id=eba2245c1c71416991fd1789fbc2be0a, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:16.682790 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec5535-568d-481a-992d-c8011efdae8d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:16.776786 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4421/8907] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 22:08:16 2022] PUT /identity/v3/projects/f9b41f76908745648538605bcf6e6217/users/eba2245c1c71416991fd1789fbc2be0a/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 22:08:16.788119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a1df9-9634-4b6f-a88a-049379ed511e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:16.788409 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a1df9-9634-4b6f-a88a-049379ed511e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:16.788682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a1df9-9634-4b6f-a88a-049379ed511e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:16.816245 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6d2a1df9-9634-4b6f-a88a-049379ed511e None None] MFA Rules not processed for user `eba2245c1c71416991fd1789fbc2be0a`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:08:16.817435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6d2a1df9-9634-4b6f-a88a-049379ed511e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:16.882427 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4487/8908] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:08:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:08:16.892461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec5535-568d-481a-992d-c8011efdae8d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:16.894133 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ceec5535-568d-481a-992d-c8011efdae8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:16.950622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec5535-568d-481a-992d-c8011efdae8d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:16.954337 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb9344-b9d9-424f-915f-40f72aa6ffef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:16.955033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb9344-b9d9-424f-915f-40f72aa6ffef service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:16.955329 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb9344-b9d9-424f-915f-40f72aa6ffef service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:16.955607 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb9344-b9d9-424f-915f-40f72aa6ffef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:16.963966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb9344-b9d9-424f-915f-40f72aa6ffef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:16.965510 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb9344-b9d9-424f-915f-40f72aa6ffef service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:16.975284 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4422/8909] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:08:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:08:22.930360 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a1df9-9634-4b6f-a88a-049379ed511e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:22.994307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a1df9-9634-4b6f-a88a-049379ed511e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:22.998837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b1860-e05c-40f8-b022-bedc8f4b5192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:22.999752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b1860-e05c-40f8-b022-bedc8f4b5192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:23.000560 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b1860-e05c-40f8-b022-bedc8f4b5192 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:23.001390 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b1860-e05c-40f8-b022-bedc8f4b5192 admin admin] PATH_INFO: `/v3/users/eba2245c1c71416991fd1789fbc2be0a` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:23.002578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b1860-e05c-40f8-b022-bedc8f4b5192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eba2245c1c71416991fd1789fbc2be0a)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:23.004742 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b1860-e05c-40f8-b022-bedc8f4b5192 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:23.015564 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:08:23.229244 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-083b1860-e05c-40f8-b022-bedc8f4b5192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eba2245c1c71416991fd1789fbc2be0a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:08:23.237151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-083b1860-e05c-40f8-b022-bedc8f4b5192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eba2245c1c71416991fd1789fbc2be0a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:08:23.314327 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-083b1860-e05c-40f8-b022-bedc8f4b5192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eba2245c1c71416991fd1789fbc2be0a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:08:23.314997 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-083b1860-e05c-40f8-b022-bedc8f4b5192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eba2245c1c71416991fd1789fbc2be0a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:08:23.329607 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-083b1860-e05c-40f8-b022-bedc8f4b5192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eba2245c1c71416991fd1789fbc2be0a'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:08:23.336117 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4488/8910] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 22:08:22 2022] DELETE /identity/v3/users/eba2245c1c71416991fd1789fbc2be0a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:08:23.340847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635e6ce-6047-407c-aa79-df6cb31462e5 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:23.341304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635e6ce-6047-407c-aa79-df6cb31462e5 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:23.341515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635e6ce-6047-407c-aa79-df6cb31462e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:23.361710 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d635e6ce-6047-407c-aa79-df6cb31462e5 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:08:23.362941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d635e6ce-6047-407c-aa79-df6cb31462e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:23.420572 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4423/8911] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:08:23.430882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b1860-e05c-40f8-b022-bedc8f4b5192 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:23.432313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-083b1860-e05c-40f8-b022-bedc8f4b5192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:23.489851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b1860-e05c-40f8-b022-bedc8f4b5192 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:23.493373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e320b-b956-4f51-9fb3-1507b3d77781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:23.494015 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e320b-b956-4f51-9fb3-1507b3d77781 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:23.494302 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e320b-b956-4f51-9fb3-1507b3d77781 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:23.494579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e320b-b956-4f51-9fb3-1507b3d77781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:23.504467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e320b-b956-4f51-9fb3-1507b3d77781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:23.505954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e320b-b956-4f51-9fb3-1507b3d77781 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:23.515748 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4489/8912] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:08:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:08:23.743000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635e6ce-6047-407c-aa79-df6cb31462e5 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:23.744423 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d635e6ce-6047-407c-aa79-df6cb31462e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:23.756863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635e6ce-6047-407c-aa79-df6cb31462e5 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:23.761647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a986b2d-79d9-45bc-91f2-4274c68f8db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:23.764906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a986b2d-79d9-45bc-91f2-4274c68f8db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:23.764906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a986b2d-79d9-45bc-91f2-4274c68f8db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:23.764906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a986b2d-79d9-45bc-91f2-4274c68f8db0 admin admin] PATH_INFO: `/v3/projects/f9b41f76908745648538605bcf6e6217` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:23.764906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a986b2d-79d9-45bc-91f2-4274c68f8db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9b41f76908745648538605bcf6e6217)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:23.766530 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a986b2d-79d9-45bc-91f2-4274c68f8db0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:23.769424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:08:23.908690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5a986b2d-79d9-45bc-91f2-4274c68f8db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9b41f76908745648538605bcf6e6217', 'request_id': 'req-5a986b2d-79d9-45bc-91f2-4274c68f8db0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:08:23.914437 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5a986b2d-79d9-45bc-91f2-4274c68f8db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9b41f76908745648538605bcf6e6217', 'request_id': 'req-5a986b2d-79d9-45bc-91f2-4274c68f8db0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:08:23.920673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5a986b2d-79d9-45bc-91f2-4274c68f8db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9b41f76908745648538605bcf6e6217', 'request_id': 'req-5a986b2d-79d9-45bc-91f2-4274c68f8db0'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:08:24.016087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5a986b2d-79d9-45bc-91f2-4274c68f8db0 admin admin] The token cache is being invalidate because project f9b41f76908745648538605bcf6e6217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 22:08:24.016281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5a986b2d-79d9-45bc-91f2-4274c68f8db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:08:24.016942 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-5a986b2d-79d9-45bc-91f2-4274c68f8db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:08:24.018587 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4424/8913] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 22:08:23 2022] DELETE /identity/v3/projects/f9b41f76908745648538605bcf6e6217 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:08:24.024835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149bfc7-a441-4dca-8e79-17c4ae670e49 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:24.025374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149bfc7-a441-4dca-8e79-17c4ae670e49 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:24.025478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149bfc7-a441-4dca-8e79-17c4ae670e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:24.044543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-2149bfc7-a441-4dca-8e79-17c4ae670e49 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:08:24.045773 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2149bfc7-a441-4dca-8e79-17c4ae670e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:24.108104 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4490/8914] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 22:08:24.116153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcbe4b-d0cd-4f44-9563-155f561fed5f None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:24.116448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcbe4b-d0cd-4f44-9563-155f561fed5f None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:24.116742 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcbe4b-d0cd-4f44-9563-155f561fed5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:24.135372 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-52fcbe4b-d0cd-4f44-9563-155f561fed5f None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:08:24.136598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-52fcbe4b-d0cd-4f44-9563-155f561fed5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:24.145665 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4425/8915] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:08:24.149842 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149bfc7-a441-4dca-8e79-17c4ae670e49 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:24.160196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149bfc7-a441-4dca-8e79-17c4ae670e49 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:24.164750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ca71f-6259-46d3-bd92-85a627834fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:24.165393 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ca71f-6259-46d3-bd92-85a627834fbd admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:24.165671 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ca71f-6259-46d3-bd92-85a627834fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:24.165945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ca71f-6259-46d3-bd92-85a627834fbd admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:24.166657 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ca71f-6259-46d3-bd92-85a627834fbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 22:08:24.166958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ca71f-6259-46d3-bd92-85a627834fbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:24.168655 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ca71f-6259-46d3-bd92-85a627834fbd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:24.180061 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4491/8916] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 22:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 22:08:24.184461 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcbe4b-d0cd-4f44-9563-155f561fed5f None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:24.194216 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcbe4b-d0cd-4f44-9563-155f561fed5f None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:24.198826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c36d1-560d-405b-9b8f-13849e2d4199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:24.199501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c36d1-560d-405b-9b8f-13849e2d4199 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:24.200033 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c36d1-560d-405b-9b8f-13849e2d4199 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:24.200308 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c36d1-560d-405b-9b8f-13849e2d4199 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:24.200989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c36d1-560d-405b-9b8f-13849e2d4199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:24.202865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c36d1-560d-405b-9b8f-13849e2d4199 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:24.309872 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4426/8917] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 22:08:24 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 22:08:24.315146 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ca71f-6259-46d3-bd92-85a627834fbd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:24.325825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ca71f-6259-46d3-bd92-85a627834fbd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:24.338789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:08:24.382189 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e0e81-47ed-4a5a-baab-22c440b1bd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:24.382850 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e0e81-47ed-4a5a-baab-22c440b1bd51 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:24.383159 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e0e81-47ed-4a5a-baab-22c440b1bd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:24.383444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e0e81-47ed-4a5a-baab-22c440b1bd51 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:24.384128 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e0e81-47ed-4a5a-baab-22c440b1bd51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:24.386074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e0e81-47ed-4a5a-baab-22c440b1bd51 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:24.503707 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4492/8918] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 22:08:24 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 22:08:24.507904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c36d1-560d-405b-9b8f-13849e2d4199 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:24.519324 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c36d1-560d-405b-9b8f-13849e2d4199 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:24.523961 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8352216-ce4c-4d59-b6a5-15d88efc1745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:24.524625 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8352216-ce4c-4d59-b6a5-15d88efc1745 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:24.529820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8352216-ce4c-4d59-b6a5-15d88efc1745 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:24.529820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8352216-ce4c-4d59-b6a5-15d88efc1745 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:24.529820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8352216-ce4c-4d59-b6a5-15d88efc1745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:24.529820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8352216-ce4c-4d59-b6a5-15d88efc1745 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:24.538199 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4427/8919] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 22:08:24.542253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e0e81-47ed-4a5a-baab-22c440b1bd51 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:24.552563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e0e81-47ed-4a5a-baab-22c440b1bd51 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:24.557526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18e990-0987-403e-a3f3-be47d42750d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:24.558249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18e990-0987-403e-a3f3-be47d42750d3 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:24.558537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18e990-0987-403e-a3f3-be47d42750d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:24.558841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18e990-0987-403e-a3f3-be47d42750d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:24.559660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18e990-0987-403e-a3f3-be47d42750d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:24.561307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18e990-0987-403e-a3f3-be47d42750d3 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:24.573049 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4493/8920] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 22:08:24.577797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8352216-ce4c-4d59-b6a5-15d88efc1745 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:24.589257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8352216-ce4c-4d59-b6a5-15d88efc1745 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:24.594038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca85f7-3824-4b23-a011-d38598653af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:24.595095 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca85f7-3824-4b23-a011-d38598653af4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:24.595407 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca85f7-3824-4b23-a011-d38598653af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:24.595681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca85f7-3824-4b23-a011-d38598653af4 admin admin] PATH_INFO: `/v3/projects/deb1e913bedd4fb5b286e21c60e27a41/users/d749cd77cf5c489e8c4e57e02ce768fd/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:24.610528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca85f7-3824-4b23-a011-d38598653af4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb1e913bedd4fb5b286e21c60e27a41, user_id=d749cd77cf5c489e8c4e57e02ce768fd, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:24.613217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca85f7-3824-4b23-a011-d38598653af4 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:24.672858 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4428/8921] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 22:08:24 2022] PUT /identity/v3/projects/deb1e913bedd4fb5b286e21c60e27a41/users/d749cd77cf5c489e8c4e57e02ce768fd/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:08:24.678451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83197ff8-465b-4b4c-9a1d-6fa2571b2bad None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:24.678741 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83197ff8-465b-4b4c-9a1d-6fa2571b2bad None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:24.679136 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83197ff8-465b-4b4c-9a1d-6fa2571b2bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:24.696964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-83197ff8-465b-4b4c-9a1d-6fa2571b2bad None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:08:24.698150 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-83197ff8-465b-4b4c-9a1d-6fa2571b2bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:24.757493 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4494/8922] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:08:24.767314 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca85f7-3824-4b23-a011-d38598653af4 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:24.769038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a7ca85f7-3824-4b23-a011-d38598653af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:24.826263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca85f7-3824-4b23-a011-d38598653af4 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:24.830025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ebab3-3396-484d-aeae-4ac2f6882bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:24.830672 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ebab3-3396-484d-aeae-4ac2f6882bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:24.830958 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ebab3-3396-484d-aeae-4ac2f6882bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:24.831277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ebab3-3396-484d-aeae-4ac2f6882bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:24.840501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ebab3-3396-484d-aeae-4ac2f6882bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:24.841933 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ebab3-3396-484d-aeae-4ac2f6882bc3 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:24.851831 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4429/8923] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:08:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:08:30.334357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a6373-bc7b-476b-be1d-36ff583e621e None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:30.334928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a6373-bc7b-476b-be1d-36ff583e621e None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:30.335064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a6373-bc7b-476b-be1d-36ff583e621e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:30.367575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-1a7a6373-bc7b-476b-be1d-36ff583e621e None None] MFA Rules not processed for user `d749cd77cf5c489e8c4e57e02ce768fd`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:08:30.368932 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1a7a6373-bc7b-476b-be1d-36ff583e621e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:30.443721 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4495/8924] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:08:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:08:30.448486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ebab3-3396-484d-aeae-4ac2f6882bc3 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:30.460497 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ebab3-3396-484d-aeae-4ac2f6882bc3 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:30.465371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8a04d-3f74-4ba9-9f9f-1c71b36e0dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:30.466303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8a04d-3f74-4ba9-9f9f-1c71b36e0dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:30.466635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8a04d-3f74-4ba9-9f9f-1c71b36e0dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:30.466912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8a04d-3f74-4ba9-9f9f-1c71b36e0dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:30.468020 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8a04d-3f74-4ba9-9f9f-1c71b36e0dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:30.470468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8a04d-3f74-4ba9-9f9f-1c71b36e0dd3 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:30.567213 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4430/8925] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 22:08:30 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 22:08:30.571279 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a6373-bc7b-476b-be1d-36ff583e621e None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:30.583722 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a6373-bc7b-476b-be1d-36ff583e621e None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:30.611090 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:08:30.644829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b6616-7f07-4eb0-ab1f-2be6809f30db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:30.645512 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b6616-7f07-4eb0-ab1f-2be6809f30db admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:30.645790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b6616-7f07-4eb0-ab1f-2be6809f30db admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:30.646062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b6616-7f07-4eb0-ab1f-2be6809f30db admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:30.646745 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b6616-7f07-4eb0-ab1f-2be6809f30db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:30.648709 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b6616-7f07-4eb0-ab1f-2be6809f30db admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:30.765750 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4496/8926] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 22:08:30 2022] POST /identity/v3/users => generated 299 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 22:08:30.769974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8a04d-3f74-4ba9-9f9f-1c71b36e0dd3 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:30.781176 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8a04d-3f74-4ba9-9f9f-1c71b36e0dd3 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:30.786135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105114d0-ab20-466e-8554-af310679b654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:30.786688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105114d0-ab20-466e-8554-af310679b654 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:30.786972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105114d0-ab20-466e-8554-af310679b654 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:30.787305 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105114d0-ab20-466e-8554-af310679b654 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:30.788032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105114d0-ab20-466e-8554-af310679b654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:30.792467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105114d0-ab20-466e-8554-af310679b654 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:30.792467 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:08:30.803753 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4431/8927] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 22:08:30.808000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b6616-7f07-4eb0-ab1f-2be6809f30db admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:30.820215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b6616-7f07-4eb0-ab1f-2be6809f30db admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:30.825557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182c131-c683-4701-8314-bcd8536b2892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:30.826513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182c131-c683-4701-8314-bcd8536b2892 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:30.826797 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182c131-c683-4701-8314-bcd8536b2892 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:30.827110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182c131-c683-4701-8314-bcd8536b2892 admin admin] PATH_INFO: `/v3/projects/d4a763eb710c4b2f8b67eab19d6d74d1/users/a522917d3e0041fdabff543aaa658d68/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:30.844225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d182c131-c683-4701-8314-bcd8536b2892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a763eb710c4b2f8b67eab19d6d74d1, user_id=a522917d3e0041fdabff543aaa658d68, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:30.847112 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d182c131-c683-4701-8314-bcd8536b2892 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:30.942023 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4497/8928] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 22:08:30 2022] PUT /identity/v3/projects/d4a763eb710c4b2f8b67eab19d6d74d1/users/a522917d3e0041fdabff543aaa658d68/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:08:30.946131 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105114d0-ab20-466e-8554-af310679b654 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:30.960065 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105114d0-ab20-466e-8554-af310679b654 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:31.026513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17880509-57c0-490d-b55f-ca30b36e475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:31.027235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17880509-57c0-490d-b55f-ca30b36e475f admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:31.027521 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17880509-57c0-490d-b55f-ca30b36e475f admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:31.027796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17880509-57c0-490d-b55f-ca30b36e475f admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:31.028532 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17880509-57c0-490d-b55f-ca30b36e475f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:31.030149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17880509-57c0-490d-b55f-ca30b36e475f admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:31.041602 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4432/8929] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 22:08:31.045782 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182c131-c683-4701-8314-bcd8536b2892 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:31.056752 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182c131-c683-4701-8314-bcd8536b2892 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:31.061994 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e5ad3-6631-4cba-a9d1-cc209b6bc838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:31.063545 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e5ad3-6631-4cba-a9d1-cc209b6bc838 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:31.063939 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e5ad3-6631-4cba-a9d1-cc209b6bc838 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:31.064622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e5ad3-6631-4cba-a9d1-cc209b6bc838 admin admin] PATH_INFO: `/v3/projects/d4a763eb710c4b2f8b67eab19d6d74d1/users/a522917d3e0041fdabff543aaa658d68/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:31.066957 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e5ad3-6631-4cba-a9d1-cc209b6bc838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a763eb710c4b2f8b67eab19d6d74d1, user_id=a522917d3e0041fdabff543aaa658d68, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:31.069913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e5ad3-6631-4cba-a9d1-cc209b6bc838 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:31.082710 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4498/8930] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 22:08:31 2022] PUT /identity/v3/projects/d4a763eb710c4b2f8b67eab19d6d74d1/users/a522917d3e0041fdabff543aaa658d68/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:08:36.635187 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e662f-59e0-4677-bb66-c6723998f5cc None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:36.635711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e662f-59e0-4677-bb66-c6723998f5cc None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:36.635711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e662f-59e0-4677-bb66-c6723998f5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:36.665238 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-335e662f-59e0-4677-bb66-c6723998f5cc None None] MFA Rules not processed for user `a522917d3e0041fdabff543aaa658d68`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:08:36.666425 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-335e662f-59e0-4677-bb66-c6723998f5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:36.746661 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4433/8931] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:08:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:08:36.791217 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3407f-8422-443e-959c-f38ec0471f32 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:36.791719 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3407f-8422-443e-959c-f38ec0471f32 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:36.791831 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3407f-8422-443e-959c-f38ec0471f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:36.853754 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-fda3407f-8422-443e-959c-f38ec0471f32 None None] MFA Rules not processed for user `78ec461b4719448597c99fd9368fa740`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:08:36.855028 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fda3407f-8422-443e-959c-f38ec0471f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:36.925288 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4499/8932] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Jul 16 22:08:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:08:36.931475 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e662f-59e0-4677-bb66-c6723998f5cc None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:36.941969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e662f-59e0-4677-bb66-c6723998f5cc None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:36.945701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07c943-ce3f-41d5-b886-9f6b3aa774a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:36.946383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07c943-ce3f-41d5-b886-9f6b3aa774a7 service glance] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:36.946665 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07c943-ce3f-41d5-b886-9f6b3aa774a7 service glance] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:36.946940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07c943-ce3f-41d5-b886-9f6b3aa774a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:37.010280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07c943-ce3f-41d5-b886-9f6b3aa774a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:37.011850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07c943-ce3f-41d5-b886-9f6b3aa774a7 service glance] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:37.022217 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4434/8933] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:08:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:08:37.315876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45af9a-f352-424f-8260-5fa6c7d69045 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:37.316290 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45af9a-f352-424f-8260-5fa6c7d69045 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:37.316674 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45af9a-f352-424f-8260-5fa6c7d69045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:37.374576 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-df45af9a-f352-424f-8260-5fa6c7d69045 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:08:37.375967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-df45af9a-f352-424f-8260-5fa6c7d69045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:37.406901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:08:37.457652 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4500/8934] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 22:08:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:08:37.608557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff5150-5811-4365-ad8b-44d39653d8ad None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:37.608852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff5150-5811-4365-ad8b-44d39653d8ad None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:37.609137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff5150-5811-4365-ad8b-44d39653d8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:37.637025 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:08:37.663771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-08ff5150-5811-4365-ad8b-44d39653d8ad None None] MFA Rules not processed for user `9a66df01ea414b34a8842488b145974f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:08:37.664983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-08ff5150-5811-4365-ad8b-44d39653d8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:37.743840 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4435/8935] 10.222.0.16 () {58 vars in 1040 bytes} [Sat Jul 16 22:08:37 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:08:37.750685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45af9a-f352-424f-8260-5fa6c7d69045 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:37.762973 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45af9a-f352-424f-8260-5fa6c7d69045 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:37.768216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998aa56-a093-47e2-aa7c-b4a5dc88429c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:37.768923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998aa56-a093-47e2-aa7c-b4a5dc88429c service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:37.769203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998aa56-a093-47e2-aa7c-b4a5dc88429c service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:37.769481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998aa56-a093-47e2-aa7c-b4a5dc88429c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:37.778510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998aa56-a093-47e2-aa7c-b4a5dc88429c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:37.780183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998aa56-a093-47e2-aa7c-b4a5dc88429c service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:37.791974 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4501/8936] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 22:08:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 16 22:08:46.369994 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff5150-5811-4365-ad8b-44d39653d8ad None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:46.380912 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-08ff5150-5811-4365-ad8b-44d39653d8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:46.468480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff5150-5811-4365-ad8b-44d39653d8ad None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:46.476414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f299270-0f16-4064-aeb2-6121320be9f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:46.477571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f299270-0f16-4064-aeb2-6121320be9f4 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:46.477849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f299270-0f16-4064-aeb2-6121320be9f4 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:46.478269 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f299270-0f16-4064-aeb2-6121320be9f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:46.480499 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1f299270-0f16-4064-aeb2-6121320be9f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:46.496736 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f299270-0f16-4064-aeb2-6121320be9f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:46.498552 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f299270-0f16-4064-aeb2-6121320be9f4 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:46.518870 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4436/8937] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:08:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:08:47.630755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df677236-deea-4614-841d-356a8088db69 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:47.631349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df677236-deea-4614-841d-356a8088db69 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:47.631476 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df677236-deea-4614-841d-356a8088db69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:47.649660 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-df677236-deea-4614-841d-356a8088db69 None None] MFA Rules not processed for user `d749cd77cf5c489e8c4e57e02ce768fd`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:08:47.650871 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-df677236-deea-4614-841d-356a8088db69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:47.657952 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4502/8938] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:08:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:08:47.912647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a5744-5c15-42a0-bab7-5c871f6a3562 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:47.913190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a5744-5c15-42a0-bab7-5c871f6a3562 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:47.913190 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a5744-5c15-42a0-bab7-5c871f6a3562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:47.931578 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-e58a5744-5c15-42a0-bab7-5c871f6a3562 None None] MFA Rules not processed for user `fbd858f3e6ba4523b056bbdc2af427b0`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:08:47.932705 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-e58a5744-5c15-42a0-bab7-5c871f6a3562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:47.982513 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4437/8939] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 22:08:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 22:08:47.995072 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df677236-deea-4614-841d-356a8088db69 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:47.996530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-df677236-deea-4614-841d-356a8088db69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:48.009057 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df677236-deea-4614-841d-356a8088db69 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:48.012637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f910748-db8e-4d42-a38a-11665b28a71f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:48.013269 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f910748-db8e-4d42-a38a-11665b28a71f service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:48.013552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f910748-db8e-4d42-a38a-11665b28a71f service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:48.013827 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f910748-db8e-4d42-a38a-11665b28a71f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:48.020914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f910748-db8e-4d42-a38a-11665b28a71f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:48.023029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f910748-db8e-4d42-a38a-11665b28a71f service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:48.030918 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4503/8940] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:08:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:08:50.831399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e921f6-2d42-4b7d-b4f6-30b2f4d2d350 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:50.833964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e921f6-2d42-4b7d-b4f6-30b2f4d2d350 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:50.833964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e921f6-2d42-4b7d-b4f6-30b2f4d2d350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:50.852979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-48e921f6-2d42-4b7d-b4f6-30b2f4d2d350 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:08:50.854464 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-48e921f6-2d42-4b7d-b4f6-30b2f4d2d350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:08:50.864133 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4438/8941] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:08:50.877931 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f910748-db8e-4d42-a38a-11665b28a71f service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:08:50.892182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f910748-db8e-4d42-a38a-11665b28a71f service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:08:50.897435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b50a04-116e-44b9-be6b-b3fb8b9de5a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:08:50.898151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b50a04-116e-44b9-be6b-b3fb8b9de5a0 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:08:50.898439 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b50a04-116e-44b9-be6b-b3fb8b9de5a0 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:08:50.898715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b50a04-116e-44b9-be6b-b3fb8b9de5a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:08:50.908074 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b50a04-116e-44b9-be6b-b3fb8b9de5a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:08:50.909668 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b50a04-116e-44b9-be6b-b3fb8b9de5a0 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:08:50.918500 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4504/8942] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 22:08:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 22:09:00.846651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=94 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:09:00.915492 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=39 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:09:16.262984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e921f6-2d42-4b7d-b4f6-30b2f4d2d350 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:09:16.273008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e921f6-2d42-4b7d-b4f6-30b2f4d2d350 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:09:16.277866 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b6ca4-480a-4029-95a0-e37c7a1a805a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:09:16.278520 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b6ca4-480a-4029-95a0-e37c7a1a805a service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:09:16.278805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b6ca4-480a-4029-95a0-e37c7a1a805a service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:09:16.279120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b6ca4-480a-4029-95a0-e37c7a1a805a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:09:16.288930 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b6ca4-480a-4029-95a0-e37c7a1a805a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:09:16.290359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b6ca4-480a-4029-95a0-e37c7a1a805a service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:09:16.299919 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4439/8943] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:09:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:09:26.295673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:09:46.223035 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b50a04-116e-44b9-be6b-b3fb8b9de5a0 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:09:46.234081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f3b50a04-116e-44b9-be6b-b3fb8b9de5a0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:09:46.249033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b50a04-116e-44b9-be6b-b3fb8b9de5a0 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:09:46.254004 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30a3b4-13f3-49b9-84ac-1e33e7b82d97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:09:46.254672 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a3b4-13f3-49b9-84ac-1e33e7b82d97 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:09:46.254958 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a3b4-13f3-49b9-84ac-1e33e7b82d97 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:09:46.255267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a3b4-13f3-49b9-84ac-1e33e7b82d97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:09:46.256971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-4e30a3b4-13f3-49b9-84ac-1e33e7b82d97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:09:46.268195 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30a3b4-13f3-49b9-84ac-1e33e7b82d97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:09:46.269818 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30a3b4-13f3-49b9-84ac-1e33e7b82d97 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:09:46.280211 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4505/8944] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:09:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:09:56.275436 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:11:32.646206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b6ca4-480a-4029-95a0-e37c7a1a805a service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:11:32.654600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b6ca4-480a-4029-95a0-e37c7a1a805a service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:11:32.659104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae015221-cee3-44cc-afb9-560504297d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:11:32.659729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae015221-cee3-44cc-afb9-560504297d8b service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:11:32.660010 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae015221-cee3-44cc-afb9-560504297d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:11:32.660284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae015221-cee3-44cc-afb9-560504297d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:11:32.662004 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ae015221-cee3-44cc-afb9-560504297d8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:11:32.712519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30a3b4-13f3-49b9-84ac-1e33e7b82d97 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:11:32.722489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30a3b4-13f3-49b9-84ac-1e33e7b82d97 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:11:32.726103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651c9bb-850c-4e60-8e92-4e37d0644d7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:11:32.729375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651c9bb-850c-4e60-8e92-4e37d0644d7a service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:11:32.729375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651c9bb-850c-4e60-8e92-4e37d0644d7a service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:11:32.729375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651c9bb-850c-4e60-8e92-4e37d0644d7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:11:32.729375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a651c9bb-850c-4e60-8e92-4e37d0644d7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:11:32.739479 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651c9bb-850c-4e60-8e92-4e37d0644d7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:11:32.740971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651c9bb-850c-4e60-8e92-4e37d0644d7a service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:11:32.749734 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4506/8945] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:11:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 22:11:32.750746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae015221-cee3-44cc-afb9-560504297d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:11:32.752304 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae015221-cee3-44cc-afb9-560504297d8b service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:11:32.763880 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4440/8946] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:11:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:11:33.981642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651c9bb-850c-4e60-8e92-4e37d0644d7a service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:11:33.990885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651c9bb-850c-4e60-8e92-4e37d0644d7a service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:11:33.998234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d718ed-85b1-4ad1-b5f3-04583acfdba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:11:33.998234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d718ed-85b1-4ad1-b5f3-04583acfdba7 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:11:33.998234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d718ed-85b1-4ad1-b5f3-04583acfdba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:11:33.998234 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d718ed-85b1-4ad1-b5f3-04583acfdba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:11:33.998736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-03d718ed-85b1-4ad1-b5f3-04583acfdba7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:11:34.011978 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d718ed-85b1-4ad1-b5f3-04583acfdba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:11:34.013399 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d718ed-85b1-4ad1-b5f3-04583acfdba7 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:11:34.025388 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4507/8947] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:11:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:11:42.758715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=39 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:11:44.020559 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=12 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:12:47.987443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae015221-cee3-44cc-afb9-560504297d8b service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:12:47.992697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ae015221-cee3-44cc-afb9-560504297d8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:12:48.003788 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae015221-cee3-44cc-afb9-560504297d8b service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:12:48.015408 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3102e-065e-4224-ade5-6120188e8b07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:12:48.024549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3102e-065e-4224-ade5-6120188e8b07 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:12:48.024549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3102e-065e-4224-ade5-6120188e8b07 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:12:48.024549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3102e-065e-4224-ade5-6120188e8b07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:12:48.032146 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-49c3102e-065e-4224-ade5-6120188e8b07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:12:48.060527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3102e-065e-4224-ade5-6120188e8b07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:12:48.062173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3102e-065e-4224-ade5-6120188e8b07 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:12:48.089163 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4441/8948] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:12:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:12:56.762263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d718ed-85b1-4ad1-b5f3-04583acfdba7 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:12:56.763930 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-03d718ed-85b1-4ad1-b5f3-04583acfdba7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:12:56.778914 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d718ed-85b1-4ad1-b5f3-04583acfdba7 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:12:56.784535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ba35f-ca7c-4f62-9b80-befe12718178 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:12:56.785283 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ba35f-ca7c-4f62-9b80-befe12718178 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:12:56.785475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ba35f-ca7c-4f62-9b80-befe12718178 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:12:56.785751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ba35f-ca7c-4f62-9b80-befe12718178 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:12:56.788165 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-750ba35f-ca7c-4f62-9b80-befe12718178 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:12:56.800207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ba35f-ca7c-4f62-9b80-befe12718178 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:12:56.801792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ba35f-ca7c-4f62-9b80-befe12718178 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:12:56.812344 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4508/8949] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:12:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:12:58.078250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:12:59.359650 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958632de-623a-47c4-b562-5397a1b4d14c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:12:59.360257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958632de-623a-47c4-b562-5397a1b4d14c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:12:59.360257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958632de-623a-47c4-b562-5397a1b4d14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:12:59.381721 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-958632de-623a-47c4-b562-5397a1b4d14c None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:12:59.383038 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-958632de-623a-47c4-b562-5397a1b4d14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:12:59.394226 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4442/8950] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 22:12:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:12:59.438855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ba35f-ca7c-4f62-9b80-befe12718178 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:12:59.451210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ba35f-ca7c-4f62-9b80-befe12718178 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:12:59.456211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd70d6-43a3-4f4d-b2fd-f7e9c3b9eb84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:12:59.456854 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd70d6-43a3-4f4d-b2fd-f7e9c3b9eb84 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:12:59.457135 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd70d6-43a3-4f4d-b2fd-f7e9c3b9eb84 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:12:59.457487 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd70d6-43a3-4f4d-b2fd-f7e9c3b9eb84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:12:59.466334 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd70d6-43a3-4f4d-b2fd-f7e9c3b9eb84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:12:59.468047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd70d6-43a3-4f4d-b2fd-f7e9c3b9eb84 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:12:59.477028 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4509/8951] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 22:12:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 22:13:00.564468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bc101-852f-4d99-9c54-34a9c7756c45 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:13:00.564947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bc101-852f-4d99-9c54-34a9c7756c45 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:13:00.565053 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bc101-852f-4d99-9c54-34a9c7756c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:13:00.583959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-539bc101-852f-4d99-9c54-34a9c7756c45 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:13:00.585359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-539bc101-852f-4d99-9c54-34a9c7756c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:13:00.594111 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4443/8952] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 22:13:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:13:00.606277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd70d6-43a3-4f4d-b2fd-f7e9c3b9eb84 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:13:00.617517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd70d6-43a3-4f4d-b2fd-f7e9c3b9eb84 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:13:00.623000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedce70d-7d51-4ac3-9e7f-d3caf7ef491e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:13:00.623713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedce70d-7d51-4ac3-9e7f-d3caf7ef491e service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:13:00.623993 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedce70d-7d51-4ac3-9e7f-d3caf7ef491e service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:13:00.624362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedce70d-7d51-4ac3-9e7f-d3caf7ef491e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:13:00.633525 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedce70d-7d51-4ac3-9e7f-d3caf7ef491e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:13:00.635119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedce70d-7d51-4ac3-9e7f-d3caf7ef491e service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:13:00.643545 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4510/8953] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 22:13:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 22:13:10.578859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:13:10.640016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=18 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:13:10.641815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294aedae-b7e0-4b86-b262-85f551eadd46 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:13:10.642192 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294aedae-b7e0-4b86-b262-85f551eadd46 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:13:10.642485 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294aedae-b7e0-4b86-b262-85f551eadd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:13:10.660377 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-294aedae-b7e0-4b86-b262-85f551eadd46 None None] MFA Rules not processed for user `d749cd77cf5c489e8c4e57e02ce768fd`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:13:10.665556 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-294aedae-b7e0-4b86-b262-85f551eadd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:13:10.668729 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4444/8954] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:13:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:13:11.301889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedce70d-7d51-4ac3-9e7f-d3caf7ef491e service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:13:11.314275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedce70d-7d51-4ac3-9e7f-d3caf7ef491e service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:13:11.319858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f957e-321c-4550-9122-3aa757100127 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:13:11.320682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f957e-321c-4550-9122-3aa757100127 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:13:11.320971 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f957e-321c-4550-9122-3aa757100127 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:13:11.321253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f957e-321c-4550-9122-3aa757100127 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:13:11.323093 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-129f957e-321c-4550-9122-3aa757100127 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:13:11.335120 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f957e-321c-4550-9122-3aa757100127 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:13:11.336698 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f957e-321c-4550-9122-3aa757100127 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:13:11.347164 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4511/8955] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:13:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:13:13.398984 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5ad1f-aa8c-4f52-a6b9-431891e023d5 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:13:13.399514 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5ad1f-aa8c-4f52-a6b9-431891e023d5 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:13:13.399627 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5ad1f-aa8c-4f52-a6b9-431891e023d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:13:13.417272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1be5ad1f-aa8c-4f52-a6b9-431891e023d5 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:13:13.418687 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1be5ad1f-aa8c-4f52-a6b9-431891e023d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:13:13.426128 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4445/8956] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 22:13:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:13:13.438999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f957e-321c-4550-9122-3aa757100127 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:13:13.451685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f957e-321c-4550-9122-3aa757100127 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:13:13.456781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71fbce-a539-4a67-b090-142e17ac1f0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:13:13.459064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71fbce-a539-4a67-b090-142e17ac1f0d service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:13:13.459064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71fbce-a539-4a67-b090-142e17ac1f0d service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:13:13.459064 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71fbce-a539-4a67-b090-142e17ac1f0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:13:13.469434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71fbce-a539-4a67-b090-142e17ac1f0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:13:13.470229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71fbce-a539-4a67-b090-142e17ac1f0d service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:13:13.479914 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4512/8957] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 22:13:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 22:13:23.411728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:13:23.475534 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=12 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:13:27.118142 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5ad1f-aa8c-4f52-a6b9-431891e023d5 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:13:27.131877 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5ad1f-aa8c-4f52-a6b9-431891e023d5 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:13:27.137581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dda49-dbad-40cb-8d87-42430a06cb99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:13:27.138230 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dda49-dbad-40cb-8d87-42430a06cb99 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:13:27.138513 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dda49-dbad-40cb-8d87-42430a06cb99 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:13:27.138794 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dda49-dbad-40cb-8d87-42430a06cb99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:13:27.140634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-691dda49-dbad-40cb-8d87-42430a06cb99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:13:27.153395 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691dda49-dbad-40cb-8d87-42430a06cb99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:13:27.154981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691dda49-dbad-40cb-8d87-42430a06cb99 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:13:27.165587 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4446/8958] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:13:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:13:37.105902 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71fbce-a539-4a67-b090-142e17ac1f0d service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:13:37.116632 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71fbce-a539-4a67-b090-142e17ac1f0d service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:13:37.120496 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4585f0-174e-4a6d-a284-6cd82d026796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:13:37.121477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4585f0-174e-4a6d-a284-6cd82d026796 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:13:37.121769 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4585f0-174e-4a6d-a284-6cd82d026796 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:13:37.122149 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4585f0-174e-4a6d-a284-6cd82d026796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:13:37.132123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4585f0-174e-4a6d-a284-6cd82d026796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:13:37.133787 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4585f0-174e-4a6d-a284-6cd82d026796 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:13:37.144962 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4513/8959] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:13:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:13:37.161169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:13:47.140311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:13:48.352431 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dda49-dbad-40cb-8d87-42430a06cb99 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:13:48.395551 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dda49-dbad-40cb-8d87-42430a06cb99 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:13:48.400673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf039a0-ab00-4bd5-9039-aa276f2e99cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:13:48.401316 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf039a0-ab00-4bd5-9039-aa276f2e99cf service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:13:48.401635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf039a0-ab00-4bd5-9039-aa276f2e99cf service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:13:48.401910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf039a0-ab00-4bd5-9039-aa276f2e99cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:13:48.411256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf039a0-ab00-4bd5-9039-aa276f2e99cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:13:48.412881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf039a0-ab00-4bd5-9039-aa276f2e99cf service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:13:48.423170 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4447/8960] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:13:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:13:58.418516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=20 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:14:52.220161 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4585f0-174e-4a6d-a284-6cd82d026796 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:14:52.419991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4585f0-174e-4a6d-a284-6cd82d026796 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:14:52.425654 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac14b2-075d-4f00-8e88-b6cfbbf38f34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:14:52.426349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac14b2-075d-4f00-8e88-b6cfbbf38f34 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:14:52.426627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac14b2-075d-4f00-8e88-b6cfbbf38f34 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:14:52.426904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac14b2-075d-4f00-8e88-b6cfbbf38f34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:14:52.435364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac14b2-075d-4f00-8e88-b6cfbbf38f34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:14:52.437721 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac14b2-075d-4f00-8e88-b6cfbbf38f34 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:14:52.447820 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4514/8961] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:14:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:14:58.168484 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1590a-cdad-41f1-af05-4826319665cf None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:14:58.168997 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1590a-cdad-41f1-af05-4826319665cf None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:14:58.169105 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1590a-cdad-41f1-af05-4826319665cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:14:58.197352 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7ba1590a-cdad-41f1-af05-4826319665cf None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:14:58.198547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7ba1590a-cdad-41f1-af05-4826319665cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:14:58.205995 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4448/8962] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 22:14:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 22:14:58.246456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac14b2-075d-4f00-8e88-b6cfbbf38f34 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:14:58.258530 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac14b2-075d-4f00-8e88-b6cfbbf38f34 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:14:58.263461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeab3f1-6bcb-4ba9-8414-ab4f2b5140b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:14:58.264091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeab3f1-6bcb-4ba9-8414-ab4f2b5140b4 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:14:58.264373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeab3f1-6bcb-4ba9-8414-ab4f2b5140b4 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:14:58.264649 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeab3f1-6bcb-4ba9-8414-ab4f2b5140b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:14:58.274367 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeab3f1-6bcb-4ba9-8414-ab4f2b5140b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:14:58.276078 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeab3f1-6bcb-4ba9-8414-ab4f2b5140b4 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:14:58.293949 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4515/8963] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 22:14:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 22:14:59.286258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1590a-cdad-41f1-af05-4826319665cf None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:14:59.306178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1590a-cdad-41f1-af05-4826319665cf None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:14:59.309950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681da847-4dda-4437-8d5d-af9d8f612a8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:14:59.310622 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681da847-4dda-4437-8d5d-af9d8f612a8c service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:14:59.310904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681da847-4dda-4437-8d5d-af9d8f612a8c service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:14:59.311219 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681da847-4dda-4437-8d5d-af9d8f612a8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:14:59.372468 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681da847-4dda-4437-8d5d-af9d8f612a8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:14:59.373818 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681da847-4dda-4437-8d5d-af9d8f612a8c service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:14:59.386248 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4449/8964] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:14:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:15:03.004574 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeab3f1-6bcb-4ba9-8414-ab4f2b5140b4 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:15:03.018381 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeab3f1-6bcb-4ba9-8414-ab4f2b5140b4 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:15:03.023449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b53a00-c979-406a-a0a9-9034446a5056 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:15:03.024461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b53a00-c979-406a-a0a9-9034446a5056 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:03.024753 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b53a00-c979-406a-a0a9-9034446a5056 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:03.025032 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b53a00-c979-406a-a0a9-9034446a5056 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:03.027000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-29b53a00-c979-406a-a0a9-9034446a5056 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:15:03.040083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b53a00-c979-406a-a0a9-9034446a5056 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:15:03.041300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b53a00-c979-406a-a0a9-9034446a5056 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:15:03.053047 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4516/8965] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:15:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:15:06.866289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681da847-4dda-4437-8d5d-af9d8f612a8c service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:15:06.878916 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681da847-4dda-4437-8d5d-af9d8f612a8c service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:15:06.883661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c6ad8-484c-4702-8cf5-3764e1a30d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:15:06.884528 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c6ad8-484c-4702-8cf5-3764e1a30d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:06.884809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c6ad8-484c-4702-8cf5-3764e1a30d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:06.885083 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c6ad8-484c-4702-8cf5-3764e1a30d87 admin admin] PATH_INFO: `/v3/users/d749cd77cf5c489e8c4e57e02ce768fd` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:06.886253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c6ad8-484c-4702-8cf5-3764e1a30d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d749cd77cf5c489e8c4e57e02ce768fd)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:15:06.888207 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c6ad8-484c-4702-8cf5-3764e1a30d87 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:15:07.101385 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-589c6ad8-484c-4702-8cf5-3764e1a30d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd749cd77cf5c489e8c4e57e02ce768fd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:15:07.113658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-589c6ad8-484c-4702-8cf5-3764e1a30d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd749cd77cf5c489e8c4e57e02ce768fd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:15:07.195471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-589c6ad8-484c-4702-8cf5-3764e1a30d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd749cd77cf5c489e8c4e57e02ce768fd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:15:07.202654 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-589c6ad8-484c-4702-8cf5-3764e1a30d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd749cd77cf5c489e8c4e57e02ce768fd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:15:07.203426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-589c6ad8-484c-4702-8cf5-3764e1a30d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd749cd77cf5c489e8c4e57e02ce768fd'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:15:07.209308 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4450/8966] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 22:15:06 2022] DELETE /identity/v3/users/d749cd77cf5c489e8c4e57e02ce768fd => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 22:15:07.472033 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b53a00-c979-406a-a0a9-9034446a5056 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:15:07.486066 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b53a00-c979-406a-a0a9-9034446a5056 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:15:07.545140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df719508-dc67-450e-be02-290ae8f4cc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:15:07.545992 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df719508-dc67-450e-be02-290ae8f4cc39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:07.546276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df719508-dc67-450e-be02-290ae8f4cc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:07.547214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df719508-dc67-450e-be02-290ae8f4cc39 admin admin] PATH_INFO: `/v3/projects/deb1e913bedd4fb5b286e21c60e27a41` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:07.548394 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df719508-dc67-450e-be02-290ae8f4cc39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb1e913bedd4fb5b286e21c60e27a41)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:15:07.550289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df719508-dc67-450e-be02-290ae8f4cc39 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:15:07.642151 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-df719508-dc67-450e-be02-290ae8f4cc39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb1e913bedd4fb5b286e21c60e27a41', 'request_id': 'req-df719508-dc67-450e-be02-290ae8f4cc39'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:15:07.648839 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-df719508-dc67-450e-be02-290ae8f4cc39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb1e913bedd4fb5b286e21c60e27a41', 'request_id': 'req-df719508-dc67-450e-be02-290ae8f4cc39'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:15:07.654228 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-df719508-dc67-450e-be02-290ae8f4cc39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb1e913bedd4fb5b286e21c60e27a41', 'request_id': 'req-df719508-dc67-450e-be02-290ae8f4cc39'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:15:07.726848 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-df719508-dc67-450e-be02-290ae8f4cc39 admin admin] The token cache is being invalidate because project deb1e913bedd4fb5b286e21c60e27a41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 22:15:07.727099 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-df719508-dc67-450e-be02-290ae8f4cc39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:15:07.727714 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-df719508-dc67-450e-be02-290ae8f4cc39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:15:07.729277 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4517/8967] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 22:15:07 2022] DELETE /identity/v3/projects/deb1e913bedd4fb5b286e21c60e27a41 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:15:07.733463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c6ad8-484c-4702-8cf5-3764e1a30d87 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:15:07.734875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-589c6ad8-484c-4702-8cf5-3764e1a30d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:15:07.748007 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c6ad8-484c-4702-8cf5-3764e1a30d87 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:15:07.788609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:15:07.804701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c514df-fdc2-49c3-8950-cf9f7c7bbdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:15:07.805604 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c514df-fdc2-49c3-8950-cf9f7c7bbdc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:07.805924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c514df-fdc2-49c3-8950-cf9f7c7bbdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:07.806398 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c514df-fdc2-49c3-8950-cf9f7c7bbdc8 admin admin] PATH_INFO: `/v3/users/a522917d3e0041fdabff543aaa658d68` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:07.808181 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c514df-fdc2-49c3-8950-cf9f7c7bbdc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a522917d3e0041fdabff543aaa658d68)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:15:07.810527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c514df-fdc2-49c3-8950-cf9f7c7bbdc8 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:15:07.997940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c9c514df-fdc2-49c3-8950-cf9f7c7bbdc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a522917d3e0041fdabff543aaa658d68'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:15:08.012311 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c9c514df-fdc2-49c3-8950-cf9f7c7bbdc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a522917d3e0041fdabff543aaa658d68'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:15:08.058745 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c9c514df-fdc2-49c3-8950-cf9f7c7bbdc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a522917d3e0041fdabff543aaa658d68'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:15:08.066786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c9c514df-fdc2-49c3-8950-cf9f7c7bbdc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a522917d3e0041fdabff543aaa658d68'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:15:08.067453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-c9c514df-fdc2-49c3-8950-cf9f7c7bbdc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a522917d3e0041fdabff543aaa658d68'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:15:08.073496 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4451/8968] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 22:15:07 2022] DELETE /identity/v3/users/a522917d3e0041fdabff543aaa658d68 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:15:08.289109 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df719508-dc67-450e-be02-290ae8f4cc39 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:15:08.290517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-df719508-dc67-450e-be02-290ae8f4cc39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:15:08.306614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df719508-dc67-450e-be02-290ae8f4cc39 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:15:08.317619 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:15:08.367537 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76139047-c60f-4546-b9a4-319a70de1e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:15:08.368391 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76139047-c60f-4546-b9a4-319a70de1e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:08.368670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76139047-c60f-4546-b9a4-319a70de1e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:08.368938 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76139047-c60f-4546-b9a4-319a70de1e0b admin admin] PATH_INFO: `/v3/projects/d4a763eb710c4b2f8b67eab19d6d74d1` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:08.370102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76139047-c60f-4546-b9a4-319a70de1e0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4a763eb710c4b2f8b67eab19d6d74d1)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:15:08.372042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76139047-c60f-4546-b9a4-319a70de1e0b admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:15:08.464235 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-76139047-c60f-4546-b9a4-319a70de1e0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4a763eb710c4b2f8b67eab19d6d74d1', 'request_id': 'req-76139047-c60f-4546-b9a4-319a70de1e0b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:15:08.470349 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-76139047-c60f-4546-b9a4-319a70de1e0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4a763eb710c4b2f8b67eab19d6d74d1', 'request_id': 'req-76139047-c60f-4546-b9a4-319a70de1e0b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:15:08.476321 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-76139047-c60f-4546-b9a4-319a70de1e0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4a763eb710c4b2f8b67eab19d6d74d1', 'request_id': 'req-76139047-c60f-4546-b9a4-319a70de1e0b'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:15:08.560538 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-76139047-c60f-4546-b9a4-319a70de1e0b admin admin] The token cache is being invalidate because project d4a763eb710c4b2f8b67eab19d6d74d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98196) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 22:15:08.560829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-76139047-c60f-4546-b9a4-319a70de1e0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:15:08.561489 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-76139047-c60f-4546-b9a4-319a70de1e0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:15:08.563648 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4518/8969] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 22:15:08 2022] DELETE /identity/v3/projects/d4a763eb710c4b2f8b67eab19d6d74d1 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:15:08.569361 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2261d-1818-41a2-9e71-493122f63ab8 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:08.569677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2261d-1818-41a2-9e71-493122f63ab8 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:08.569956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2261d-1818-41a2-9e71-493122f63ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:08.588661 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1ad2261d-1818-41a2-9e71-493122f63ab8 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:15:08.589906 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1ad2261d-1818-41a2-9e71-493122f63ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:15:08.648483 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4452/8970] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:15:08.657755 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf01b8-55ad-4123-a9b7-d72fb8432fca None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:08.658588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf01b8-55ad-4123-a9b7-d72fb8432fca None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:08.658588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf01b8-55ad-4123-a9b7-d72fb8432fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:08.677276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0baf01b8-55ad-4123-a9b7-d72fb8432fca None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:15:08.678472 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0baf01b8-55ad-4123-a9b7-d72fb8432fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:15:08.686375 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4519/8971] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:15:08.690898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2261d-1818-41a2-9e71-493122f63ab8 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:15:08.700758 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2261d-1818-41a2-9e71-493122f63ab8 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:15:08.705424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c240c-1d22-431b-82d8-7f7db132e9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:15:08.706077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c240c-1d22-431b-82d8-7f7db132e9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:08.706359 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c240c-1d22-431b-82d8-7f7db132e9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:08.706634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c240c-1d22-431b-82d8-7f7db132e9b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:08.707396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c240c-1d22-431b-82d8-7f7db132e9b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98195) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 22:15:08.707701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c240c-1d22-431b-82d8-7f7db132e9b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:15:08.709288 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c240c-1d22-431b-82d8-7f7db132e9b1 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:15:08.721227 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4453/8972] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 22:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 16 22:15:08.725541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf01b8-55ad-4123-a9b7-d72fb8432fca None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:15:08.735392 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf01b8-55ad-4123-a9b7-d72fb8432fca None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:15:08.740036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3fe86-b660-45e3-8f34-fceb14946867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:15:08.740677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3fe86-b660-45e3-8f34-fceb14946867 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:08.740956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3fe86-b660-45e3-8f34-fceb14946867 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:08.741229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3fe86-b660-45e3-8f34-fceb14946867 admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:08.741903 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3fe86-b660-45e3-8f34-fceb14946867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:15:08.744131 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3fe86-b660-45e3-8f34-fceb14946867 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:15:08.861089 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4520/8973] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 22:15:08 2022] POST /identity/v3/projects => generated 391 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 22:15:08.865134 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c240c-1d22-431b-82d8-7f7db132e9b1 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:15:08.875581 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c240c-1d22-431b-82d8-7f7db132e9b1 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:15:08.921032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:15:08.933272 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913aa21-3e6d-4185-bc67-c7d469adce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:15:08.933940 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913aa21-3e6d-4185-bc67-c7d469adce5a admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:08.934226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913aa21-3e6d-4185-bc67-c7d469adce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:08.934505 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913aa21-3e6d-4185-bc67-c7d469adce5a admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:08.935346 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913aa21-3e6d-4185-bc67-c7d469adce5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:15:08.937249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913aa21-3e6d-4185-bc67-c7d469adce5a admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:15:09.024239 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4454/8974] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 22:15:08 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 22:15:09.028570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3fe86-b660-45e3-8f34-fceb14946867 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:15:09.040460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3fe86-b660-45e3-8f34-fceb14946867 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:15:09.045286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8d78b-0131-4398-b435-08e3804105cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:15:09.046184 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8d78b-0131-4398-b435-08e3804105cf admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:09.047267 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8d78b-0131-4398-b435-08e3804105cf admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:09.047535 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8d78b-0131-4398-b435-08e3804105cf admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:09.048249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8d78b-0131-4398-b435-08e3804105cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:15:09.049857 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8d78b-0131-4398-b435-08e3804105cf admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:15:09.060889 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4521/8975] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 22:15:09.065608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913aa21-3e6d-4185-bc67-c7d469adce5a admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:15:09.077031 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913aa21-3e6d-4185-bc67-c7d469adce5a admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:15:09.082902 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b67cc-7fb0-466c-88f8-329a5564e38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:15:09.083590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b67cc-7fb0-466c-88f8-329a5564e38b admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:09.083872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b67cc-7fb0-466c-88f8-329a5564e38b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:09.084160 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b67cc-7fb0-466c-88f8-329a5564e38b admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:09.084929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b67cc-7fb0-466c-88f8-329a5564e38b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:15:09.086576 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b67cc-7fb0-466c-88f8-329a5564e38b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:15:09.097403 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4455/8976] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 16 22:15:09.101817 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8d78b-0131-4398-b435-08e3804105cf admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:15:09.112359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8d78b-0131-4398-b435-08e3804105cf admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:15:09.116996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b0091-3ffd-48ad-a1c4-b996801a7a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:15:09.117868 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b0091-3ffd-48ad-a1c4-b996801a7a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:09.118148 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b0091-3ffd-48ad-a1c4-b996801a7a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:09.118424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b0091-3ffd-48ad-a1c4-b996801a7a0e admin admin] PATH_INFO: `/v3/projects/a45a8ce6687c427d8f76e4205a076a93/users/4b8c7ad3cc6240c096c2c7cf31d8f74f/roles/c352110df5bc449b9134928abd20c032` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:09.132875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b0091-3ffd-48ad-a1c4-b996801a7a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45a8ce6687c427d8f76e4205a076a93, user_id=4b8c7ad3cc6240c096c2c7cf31d8f74f, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:15:09.135567 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b0091-3ffd-48ad-a1c4-b996801a7a0e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:15:09.201075 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4522/8977] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 22:15:09 2022] PUT /identity/v3/projects/a45a8ce6687c427d8f76e4205a076a93/users/4b8c7ad3cc6240c096c2c7cf31d8f74f/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:15:09.211839 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296d0e0-1ed4-415f-bda4-0395c7f15a5b None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:09.212128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296d0e0-1ed4-415f-bda4-0395c7f15a5b None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:09.212401 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296d0e0-1ed4-415f-bda4-0395c7f15a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:09.239740 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8296d0e0-1ed4-415f-bda4-0395c7f15a5b None None] MFA Rules not processed for user `4b8c7ad3cc6240c096c2c7cf31d8f74f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:15:09.240972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8296d0e0-1ed4-415f-bda4-0395c7f15a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:15:09.304989 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4456/8978] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:15:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:15:09.309605 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b0091-3ffd-48ad-a1c4-b996801a7a0e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:15:09.352634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:15:09.373359 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b0091-3ffd-48ad-a1c4-b996801a7a0e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:15:09.378408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9baaa-6993-43ef-8ebb-37d5c0a50b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:15:09.379082 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9baaa-6993-43ef-8ebb-37d5c0a50b5e admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:09.379370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9baaa-6993-43ef-8ebb-37d5c0a50b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:09.379648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9baaa-6993-43ef-8ebb-37d5c0a50b5e admin admin] PATH_INFO: `/v3/projects` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:09.380313 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9baaa-6993-43ef-8ebb-37d5c0a50b5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:15:09.382203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9baaa-6993-43ef-8ebb-37d5c0a50b5e admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:15:09.493561 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4523/8979] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 22:15:09 2022] POST /identity/v3/projects => generated 393 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 22:15:09.497054 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296d0e0-1ed4-415f-bda4-0395c7f15a5b None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:15:09.509012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296d0e0-1ed4-415f-bda4-0395c7f15a5b None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:15:09.564718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c4d66-51a4-46d1-a7f3-8f33f72b6e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:15:09.565380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c4d66-51a4-46d1-a7f3-8f33f72b6e33 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:09.565657 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c4d66-51a4-46d1-a7f3-8f33f72b6e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:09.565928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c4d66-51a4-46d1-a7f3-8f33f72b6e33 admin admin] PATH_INFO: `/v3/users` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:09.566594 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c4d66-51a4-46d1-a7f3-8f33f72b6e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:15:09.568523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c4d66-51a4-46d1-a7f3-8f33f72b6e33 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:15:09.676351 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4457/8980] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 22:15:09 2022] POST /identity/v3/users => generated 303 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 22:15:09.680618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9baaa-6993-43ef-8ebb-37d5c0a50b5e admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:15:09.691969 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9baaa-6993-43ef-8ebb-37d5c0a50b5e admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:15:09.696691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff8f63-2c0b-49e0-b1ef-3e3ab86f4599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:15:09.697384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff8f63-2c0b-49e0-b1ef-3e3ab86f4599 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:09.697658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff8f63-2c0b-49e0-b1ef-3e3ab86f4599 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:09.697933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff8f63-2c0b-49e0-b1ef-3e3ab86f4599 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:09.698647 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff8f63-2c0b-49e0-b1ef-3e3ab86f4599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:15:09.700261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff8f63-2c0b-49e0-b1ef-3e3ab86f4599 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:15:09.711557 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4524/8981] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 22:15:09.715759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c4d66-51a4-46d1-a7f3-8f33f72b6e33 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:15:09.726641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c4d66-51a4-46d1-a7f3-8f33f72b6e33 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:15:09.731432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699ee7f-c8c2-4d7f-baaf-5bc0bc8503e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:15:09.732299 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699ee7f-c8c2-4d7f-baaf-5bc0bc8503e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:09.732575 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699ee7f-c8c2-4d7f-baaf-5bc0bc8503e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:09.732978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699ee7f-c8c2-4d7f-baaf-5bc0bc8503e2 admin admin] PATH_INFO: `/v3/projects/0381aafd4c354dffb9380df5fce38059/users/fc376aa1d00a4db889c32f2989d75fa5/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:09.747972 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699ee7f-c8c2-4d7f-baaf-5bc0bc8503e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0381aafd4c354dffb9380df5fce38059, user_id=fc376aa1d00a4db889c32f2989d75fa5, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:15:09.751255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699ee7f-c8c2-4d7f-baaf-5bc0bc8503e2 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:15:09.836024 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4458/8982] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 22:15:09 2022] PUT /identity/v3/projects/0381aafd4c354dffb9380df5fce38059/users/fc376aa1d00a4db889c32f2989d75fa5/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:15:09.840029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff8f63-2c0b-49e0-b1ef-3e3ab86f4599 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:15:09.850477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff8f63-2c0b-49e0-b1ef-3e3ab86f4599 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:15:09.909356 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01699e9c-4641-4433-a324-a72092afc165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:15:09.910016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01699e9c-4641-4433-a324-a72092afc165 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:09.910299 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01699e9c-4641-4433-a324-a72092afc165 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:09.910575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01699e9c-4641-4433-a324-a72092afc165 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:09.911338 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01699e9c-4641-4433-a324-a72092afc165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:15:09.912947 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01699e9c-4641-4433-a324-a72092afc165 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:15:09.923402 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4525/8983] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 22:15:09.927696 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699ee7f-c8c2-4d7f-baaf-5bc0bc8503e2 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:15:09.938591 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699ee7f-c8c2-4d7f-baaf-5bc0bc8503e2 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:15:09.943733 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdcef1-74b5-4969-8b54-92755665eebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:15:09.948747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdcef1-74b5-4969-8b54-92755665eebe admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:09.948747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdcef1-74b5-4969-8b54-92755665eebe admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:09.948747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdcef1-74b5-4969-8b54-92755665eebe admin admin] PATH_INFO: `/v3/projects/0381aafd4c354dffb9380df5fce38059/users/fc376aa1d00a4db889c32f2989d75fa5/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:09.948747 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdcef1-74b5-4969-8b54-92755665eebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0381aafd4c354dffb9380df5fce38059, user_id=fc376aa1d00a4db889c32f2989d75fa5, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:15:09.949789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdcef1-74b5-4969-8b54-92755665eebe admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:15:09.960247 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4459/8984] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 22:15:09 2022] PUT /identity/v3/projects/0381aafd4c354dffb9380df5fce38059/users/fc376aa1d00a4db889c32f2989d75fa5/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 22:15:09.970114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e41f67-f5f5-4a1d-9ff6-1b090b859081 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:09.970406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e41f67-f5f5-4a1d-9ff6-1b090b859081 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:09.971730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e41f67-f5f5-4a1d-9ff6-1b090b859081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:09.998423 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-63e41f67-f5f5-4a1d-9ff6-1b090b859081 None None] MFA Rules not processed for user `fc376aa1d00a4db889c32f2989d75fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:15:10.000275 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-63e41f67-f5f5-4a1d-9ff6-1b090b859081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:15:10.069197 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4526/8985] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:15:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:15:10.086860 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdcef1-74b5-4969-8b54-92755665eebe admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:15:10.088609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-90bdcef1-74b5-4969-8b54-92755665eebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:15:10.099947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:15:10.173220 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdcef1-74b5-4969-8b54-92755665eebe admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:15:10.179566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10dbc06-94c2-442b-8d8f-11bc283d506b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:15:10.180152 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dbc06-94c2-442b-8d8f-11bc283d506b service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:10.180433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dbc06-94c2-442b-8d8f-11bc283d506b service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:10.180711 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dbc06-94c2-442b-8d8f-11bc283d506b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:10.236549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10dbc06-94c2-442b-8d8f-11bc283d506b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:15:10.238209 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10dbc06-94c2-442b-8d8f-11bc283d506b service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:15:10.247479 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4460/8986] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:15:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:15:15.094177 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e41f67-f5f5-4a1d-9ff6-1b090b859081 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:15:15.095968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-63e41f67-f5f5-4a1d-9ff6-1b090b859081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:15:15.137923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:15:15.169975 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e41f67-f5f5-4a1d-9ff6-1b090b859081 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:15:15.174475 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9179d-118a-482d-bd75-ada2716298b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:15:15.175157 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9179d-118a-482d-bd75-ada2716298b0 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:15.175440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9179d-118a-482d-bd75-ada2716298b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:15.175718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9179d-118a-482d-bd75-ada2716298b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:15.185229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9179d-118a-482d-bd75-ada2716298b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:15:15.187167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9179d-118a-482d-bd75-ada2716298b0 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:15:15.197404 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4527/8987] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:15:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:15:18.319094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65af54-ff8b-4ab0-ad06-3ee5fddabe03 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:18.319568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65af54-ff8b-4ab0-ad06-3ee5fddabe03 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:18.319568 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65af54-ff8b-4ab0-ad06-3ee5fddabe03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:18.342449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ad65af54-ff8b-4ab0-ad06-3ee5fddabe03 None None] MFA Rules not processed for user `4b8c7ad3cc6240c096c2c7cf31d8f74f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:15:18.345251 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ad65af54-ff8b-4ab0-ad06-3ee5fddabe03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:15:18.361837 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4461/8988] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:15:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:15:18.738597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9179d-118a-482d-bd75-ada2716298b0 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:15:18.748602 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9179d-118a-482d-bd75-ada2716298b0 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:15:18.753945 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8ba58-f63a-4129-8007-78dbaff77073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:15:18.754717 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8ba58-f63a-4129-8007-78dbaff77073 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:18.755103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8ba58-f63a-4129-8007-78dbaff77073 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:18.755451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8ba58-f63a-4129-8007-78dbaff77073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:18.757444 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b7f8ba58-f63a-4129-8007-78dbaff77073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:15:18.769201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8ba58-f63a-4129-8007-78dbaff77073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:15:18.770775 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8ba58-f63a-4129-8007-78dbaff77073 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:15:18.779601 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4528/8989] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:15:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:15:19.270743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65af54-ff8b-4ab0-ad06-3ee5fddabe03 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:15:19.272415 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ad65af54-ff8b-4ab0-ad06-3ee5fddabe03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:15:19.356074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65af54-ff8b-4ab0-ad06-3ee5fddabe03 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:15:19.362494 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fd564-9a51-467a-88c4-97accccef307 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:15:19.363275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fd564-9a51-467a-88c4-97accccef307 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:15:19.363636 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fd564-9a51-467a-88c4-97accccef307 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:15:19.363929 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fd564-9a51-467a-88c4-97accccef307 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:15:19.367358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f79fd564-9a51-467a-88c4-97accccef307 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:15:19.381964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fd564-9a51-467a-88c4-97accccef307 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:15:19.384040 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fd564-9a51-467a-88c4-97accccef307 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:15:19.396215 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4462/8990] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:15:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:15:28.775789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=22 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:15:29.391068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=91 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:16:20.877320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30319548-aa7a-4e83-a02b-c2b503eff681 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:16:20.877320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30319548-aa7a-4e83-a02b-c2b503eff681 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:16:20.877320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30319548-aa7a-4e83-a02b-c2b503eff681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:16:20.919518 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-30319548-aa7a-4e83-a02b-c2b503eff681 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:16:20.920799 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-30319548-aa7a-4e83-a02b-c2b503eff681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:16:20.929836 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4529/8991] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 22:16:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:16:20.941628 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fd564-9a51-467a-88c4-97accccef307 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:16:20.946893 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f79fd564-9a51-467a-88c4-97accccef307 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:16:20.956534 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fd564-9a51-467a-88c4-97accccef307 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:16:20.961524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7059320-fbc0-4e2c-94e5-57b329db28c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:16:20.962161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7059320-fbc0-4e2c-94e5-57b329db28c4 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:16:20.962448 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7059320-fbc0-4e2c-94e5-57b329db28c4 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:16:20.962726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7059320-fbc0-4e2c-94e5-57b329db28c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:16:20.971244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7059320-fbc0-4e2c-94e5-57b329db28c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:16:20.972806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7059320-fbc0-4e2c-94e5-57b329db28c4 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:16:20.982609 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4463/8992] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:16:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:16:29.465557 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b801e95-5eda-45e3-8118-15166ce411f5 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:16:29.466127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b801e95-5eda-45e3-8118-15166ce411f5 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:16:29.466127 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b801e95-5eda-45e3-8118-15166ce411f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:16:29.486570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-6b801e95-5eda-45e3-8118-15166ce411f5 None None] MFA Rules not processed for user `4b8c7ad3cc6240c096c2c7cf31d8f74f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:16:29.487814 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6b801e95-5eda-45e3-8118-15166ce411f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:16:29.496387 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4530/8993] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:16:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:16:29.861245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7059320-fbc0-4e2c-94e5-57b329db28c4 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:16:29.873469 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7059320-fbc0-4e2c-94e5-57b329db28c4 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:16:29.878673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b9f3d-a7f1-4118-bf09-bc171d0e15e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:16:29.883957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b9f3d-a7f1-4118-bf09-bc171d0e15e2 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:16:29.883957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b9f3d-a7f1-4118-bf09-bc171d0e15e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:16:29.883957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b9f3d-a7f1-4118-bf09-bc171d0e15e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:16:29.883957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9d3b9f3d-a7f1-4118-bf09-bc171d0e15e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:16:29.894273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b9f3d-a7f1-4118-bf09-bc171d0e15e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:16:29.896103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b9f3d-a7f1-4118-bf09-bc171d0e15e2 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:16:29.905294 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4464/8994] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:16:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:16:33.250167 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b801e95-5eda-45e3-8118-15166ce411f5 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:16:33.251678 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6b801e95-5eda-45e3-8118-15166ce411f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:16:33.266934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b801e95-5eda-45e3-8118-15166ce411f5 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:16:33.268452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57ed5b-23ec-4baa-8ead-bf8a3f0d69a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:16:33.269113 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57ed5b-23ec-4baa-8ead-bf8a3f0d69a6 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:16:33.269395 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57ed5b-23ec-4baa-8ead-bf8a3f0d69a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:16:33.269669 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57ed5b-23ec-4baa-8ead-bf8a3f0d69a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:16:33.271622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fc57ed5b-23ec-4baa-8ead-bf8a3f0d69a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:16:33.282549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57ed5b-23ec-4baa-8ead-bf8a3f0d69a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:16:33.284201 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57ed5b-23ec-4baa-8ead-bf8a3f0d69a6 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:16:33.298146 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4531/8995] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:16:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:16:33.714012 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b9f3d-a7f1-4118-bf09-bc171d0e15e2 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:16:33.723193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b9f3d-a7f1-4118-bf09-bc171d0e15e2 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:16:33.727609 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07732b6-ed9d-4df3-b5fe-123fa412aed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:16:33.728258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07732b6-ed9d-4df3-b5fe-123fa412aed7 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:16:33.728545 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07732b6-ed9d-4df3-b5fe-123fa412aed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:16:33.728825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07732b6-ed9d-4df3-b5fe-123fa412aed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:16:33.730632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c07732b6-ed9d-4df3-b5fe-123fa412aed7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:16:33.744123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07732b6-ed9d-4df3-b5fe-123fa412aed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:16:33.745619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07732b6-ed9d-4df3-b5fe-123fa412aed7 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:16:33.758207 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4465/8996] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:16:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:16:36.134315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57ed5b-23ec-4baa-8ead-bf8a3f0d69a6 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:16:36.144320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57ed5b-23ec-4baa-8ead-bf8a3f0d69a6 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:16:36.148106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d170146-60c6-4b84-8b68-0dbf439a94d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:16:36.148777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d170146-60c6-4b84-8b68-0dbf439a94d3 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:16:36.149062 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d170146-60c6-4b84-8b68-0dbf439a94d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:16:36.149340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d170146-60c6-4b84-8b68-0dbf439a94d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:16:36.151115 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3d170146-60c6-4b84-8b68-0dbf439a94d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:16:36.164491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d170146-60c6-4b84-8b68-0dbf439a94d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:16:36.165913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d170146-60c6-4b84-8b68-0dbf439a94d3 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:16:36.177020 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4532/8997] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:16:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:16:43.752957 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=18 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:16:46.172129 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=26 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:18:06.646178 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07732b6-ed9d-4df3-b5fe-123fa412aed7 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:18:06.661143 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07732b6-ed9d-4df3-b5fe-123fa412aed7 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:18:06.667789 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68b6c1-b469-4d08-9c36-57e313c7b97d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:18:06.668463 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68b6c1-b469-4d08-9c36-57e313c7b97d service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:18:06.668750 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68b6c1-b469-4d08-9c36-57e313c7b97d service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:18:06.669032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68b6c1-b469-4d08-9c36-57e313c7b97d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:18:06.671082 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5a68b6c1-b469-4d08-9c36-57e313c7b97d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:18:06.685456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68b6c1-b469-4d08-9c36-57e313c7b97d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:18:06.687114 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68b6c1-b469-4d08-9c36-57e313c7b97d service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:18:06.700478 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4466/8998] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:18:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:18:08.952055 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d170146-60c6-4b84-8b68-0dbf439a94d3 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:18:08.964091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d170146-60c6-4b84-8b68-0dbf439a94d3 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:18:08.969626 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da439a5-0328-4acb-8ca9-7f6623da4518 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:18:08.970260 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da439a5-0328-4acb-8ca9-7f6623da4518 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:18:08.970541 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da439a5-0328-4acb-8ca9-7f6623da4518 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:18:08.970812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da439a5-0328-4acb-8ca9-7f6623da4518 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:18:08.972601 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3da439a5-0328-4acb-8ca9-7f6623da4518 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:18:08.985005 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da439a5-0328-4acb-8ca9-7f6623da4518 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:18:08.986597 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da439a5-0328-4acb-8ca9-7f6623da4518 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:18:08.997572 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4533/8999] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:18:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 22:18:16.694938 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:18:18.993137 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:18:22.905779 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfde6be-debf-4ed2-b252-250a7d104d6c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:18:22.906283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfde6be-debf-4ed2-b252-250a7d104d6c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:18:22.906406 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfde6be-debf-4ed2-b252-250a7d104d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:18:22.935785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-1bfde6be-debf-4ed2-b252-250a7d104d6c None None] MFA Rules not processed for user `4b8c7ad3cc6240c096c2c7cf31d8f74f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:18:22.937029 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1bfde6be-debf-4ed2-b252-250a7d104d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:18:22.946143 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4467/9000] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:18:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:18:32.924103 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:18:34.352751 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da439a5-0328-4acb-8ca9-7f6623da4518 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:18:34.364145 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da439a5-0328-4acb-8ca9-7f6623da4518 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:18:34.370242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4701f-96f2-4d30-a7fd-c75fa74d093d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:18:34.379926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4701f-96f2-4d30-a7fd-c75fa74d093d service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:18:34.379926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4701f-96f2-4d30-a7fd-c75fa74d093d service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:18:34.379926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4701f-96f2-4d30-a7fd-c75fa74d093d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:18:34.379926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-12e4701f-96f2-4d30-a7fd-c75fa74d093d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:18:34.386000 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4701f-96f2-4d30-a7fd-c75fa74d093d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:18:34.387682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4701f-96f2-4d30-a7fd-c75fa74d093d service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:18:34.399586 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4534/9001] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:18:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:18:44.393792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:18:54.343161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfde6be-debf-4ed2-b252-250a7d104d6c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:18:54.355872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfde6be-debf-4ed2-b252-250a7d104d6c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:18:54.360847 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91717313-ebac-4c9c-9780-3e822ba6addf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:18:54.361490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91717313-ebac-4c9c-9780-3e822ba6addf service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:18:54.361769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91717313-ebac-4c9c-9780-3e822ba6addf service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:18:54.362044 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91717313-ebac-4c9c-9780-3e822ba6addf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:18:54.363823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-91717313-ebac-4c9c-9780-3e822ba6addf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:18:54.387704 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91717313-ebac-4c9c-9780-3e822ba6addf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:18:54.389268 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91717313-ebac-4c9c-9780-3e822ba6addf service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:18:54.399771 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4468/9002] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:18:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:19:04.394865 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=11 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:19:07.985451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc264598-eeb4-4e6b-ad57-ab49d2235e6c None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:19:07.986039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc264598-eeb4-4e6b-ad57-ab49d2235e6c None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:19:07.986039 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc264598-eeb4-4e6b-ad57-ab49d2235e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:19:08.024249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-fc264598-eeb4-4e6b-ad57-ab49d2235e6c None None] MFA Rules not processed for user `fbd858f3e6ba4523b056bbdc2af427b0`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:19:08.025460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fc264598-eeb4-4e6b-ad57-ab49d2235e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:19:08.032102 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4535/9003] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 22:19:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:19:08.043282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91717313-ebac-4c9c-9780-3e822ba6addf service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:19:08.052990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91717313-ebac-4c9c-9780-3e822ba6addf service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:19:08.056729 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689d171-2f3f-44ae-8b2e-3769506ad222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:19:08.057392 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689d171-2f3f-44ae-8b2e-3769506ad222 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:19:08.057671 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689d171-2f3f-44ae-8b2e-3769506ad222 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:19:08.057943 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689d171-2f3f-44ae-8b2e-3769506ad222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:19:08.065157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689d171-2f3f-44ae-8b2e-3769506ad222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:19:08.066571 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689d171-2f3f-44ae-8b2e-3769506ad222 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:19:08.074807 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4469/9004] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:19:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 22:19:08.300481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9a67b-909e-4f8b-9f6f-372f1e0053cb None None] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:19:08.300776 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9a67b-909e-4f8b-9f6f-372f1e0053cb None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:19:08.301058 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9a67b-909e-4f8b-9f6f-372f1e0053cb None None] PATH_INFO: `/` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:19:08.302451 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4536/9005] 10.222.0.16 () {54 vars in 921 bytes} [Sat Jul 16 22:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 16 22:19:08.307783 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da772eba-51b6-4087-95c4-b85572e0acf4 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:19:08.309732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da772eba-51b6-4087-95c4-b85572e0acf4 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:19:08.309732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da772eba-51b6-4087-95c4-b85572e0acf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:19:08.344370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-da772eba-51b6-4087-95c4-b85572e0acf4 None None] MFA Rules not processed for user `2054690a99c843aaaf19d8193510fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:19:08.345573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-da772eba-51b6-4087-95c4-b85572e0acf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:19:08.354653 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4470/9006] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 22:19:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:19:08.375918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9a67b-909e-4f8b-9f6f-372f1e0053cb None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:19:08.391103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9a67b-909e-4f8b-9f6f-372f1e0053cb None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:19:08.396176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4aeeed-ac09-4178-a96b-950a80e5efee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:19:08.397426 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aeeed-ac09-4178-a96b-950a80e5efee service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:19:08.397710 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aeeed-ac09-4178-a96b-950a80e5efee service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:19:08.397987 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aeeed-ac09-4178-a96b-950a80e5efee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:19:08.407517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4aeeed-ac09-4178-a96b-950a80e5efee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:19:08.409121 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4aeeed-ac09-4178-a96b-950a80e5efee service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:19:08.419532 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4537/9007] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:19:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:19:08.712254 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53078ca-c7d3-434a-92cd-54bc86f52da7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:19:08.712539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53078ca-c7d3-434a-92cd-54bc86f52da7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:19:08.712815 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53078ca-c7d3-434a-92cd-54bc86f52da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:19:08.750365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-a53078ca-c7d3-434a-92cd-54bc86f52da7 None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:19:08.751602 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-a53078ca-c7d3-434a-92cd-54bc86f52da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:19:08.768445 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4471/9008] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 22:19:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:19:08.778628 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4aeeed-ac09-4178-a96b-950a80e5efee service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:19:08.789075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4aeeed-ac09-4178-a96b-950a80e5efee service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:19:08.792677 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255a2b7-4945-434b-86c2-27b152d3f27e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:19:08.793307 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255a2b7-4945-434b-86c2-27b152d3f27e service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:19:08.793588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255a2b7-4945-434b-86c2-27b152d3f27e service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:19:08.793862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255a2b7-4945-434b-86c2-27b152d3f27e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:19:08.805278 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255a2b7-4945-434b-86c2-27b152d3f27e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:19:08.806699 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255a2b7-4945-434b-86c2-27b152d3f27e service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:19:08.817556 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4538/9009] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:19:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:19:08.879102 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53078ca-c7d3-434a-92cd-54bc86f52da7 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:19:08.890483 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53078ca-c7d3-434a-92cd-54bc86f52da7 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:19:08.895914 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c20ce-5e49-4c27-b298-2b70c123ba4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:19:08.896825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c20ce-5e49-4c27-b298-2b70c123ba4c service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:19:08.896966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c20ce-5e49-4c27-b298-2b70c123ba4c service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:19:08.897169 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c20ce-5e49-4c27-b298-2b70c123ba4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:19:08.898927 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-1a8c20ce-5e49-4c27-b298-2b70c123ba4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:19:08.910174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c20ce-5e49-4c27-b298-2b70c123ba4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:19:08.911851 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c20ce-5e49-4c27-b298-2b70c123ba4c service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:19:08.922153 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4472/9010] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:19:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:19:18.812937 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=21 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:19:18.917937 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=33 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:19:23.359812 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255a2b7-4945-434b-86c2-27b152d3f27e service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:19:23.369682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255a2b7-4945-434b-86c2-27b152d3f27e service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:19:23.373589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d6de2-654d-47ac-9679-49da55be1881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:19:23.374227 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d6de2-654d-47ac-9679-49da55be1881 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:19:23.374510 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d6de2-654d-47ac-9679-49da55be1881 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:19:23.374786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d6de2-654d-47ac-9679-49da55be1881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:19:23.376578 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e75d6de2-654d-47ac-9679-49da55be1881 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:19:23.386825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d6de2-654d-47ac-9679-49da55be1881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:19:23.388289 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d6de2-654d-47ac-9679-49da55be1881 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:19:23.396140 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4539/9011] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:19:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 22:19:33.392679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:19:56.224623 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c20ce-5e49-4c27-b298-2b70c123ba4c service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:19:56.235158 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c20ce-5e49-4c27-b298-2b70c123ba4c service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:19:56.240151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b92a9a-28b2-473b-bb70-2542d0361ff3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:19:56.240781 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b92a9a-28b2-473b-bb70-2542d0361ff3 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:19:56.241061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b92a9a-28b2-473b-bb70-2542d0361ff3 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:19:56.241335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b92a9a-28b2-473b-bb70-2542d0361ff3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:19:56.243111 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-90b92a9a-28b2-473b-bb70-2542d0361ff3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:19:56.254947 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b92a9a-28b2-473b-bb70-2542d0361ff3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:19:56.256533 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b92a9a-28b2-473b-bb70-2542d0361ff3 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:19:56.266765 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4473/9012] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:19:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:20:06.262163 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:20:09.876568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d6de2-654d-47ac-9679-49da55be1881 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:20:09.886588 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d6de2-654d-47ac-9679-49da55be1881 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:20:09.890287 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b4660-ef3e-44a8-94e9-4afc89e79201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:20:09.890906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b4660-ef3e-44a8-94e9-4afc89e79201 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:20:09.891215 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b4660-ef3e-44a8-94e9-4afc89e79201 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:20:09.891481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b4660-ef3e-44a8-94e9-4afc89e79201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:20:09.901018 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b4660-ef3e-44a8-94e9-4afc89e79201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:20:09.902486 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b4660-ef3e-44a8-94e9-4afc89e79201 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:20:09.912149 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4540/9013] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:20:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:20:15.425541 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b92a9a-28b2-473b-bb70-2542d0361ff3 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:20:15.435291 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b92a9a-28b2-473b-bb70-2542d0361ff3 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:20:15.438928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709a5ff-8d2d-4f36-b28f-3f9c1dd32c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:20:15.439598 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709a5ff-8d2d-4f36-b28f-3f9c1dd32c7d service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:20:15.439880 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709a5ff-8d2d-4f36-b28f-3f9c1dd32c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:20:15.440648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709a5ff-8d2d-4f36-b28f-3f9c1dd32c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:20:15.450112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709a5ff-8d2d-4f36-b28f-3f9c1dd32c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:20:15.451588 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709a5ff-8d2d-4f36-b28f-3f9c1dd32c7d service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:20:15.462173 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4474/9014] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:20:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:20:18.915622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef215a2-e702-4b4e-9d1c-1db52c8c7f5d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:20:18.916108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef215a2-e702-4b4e-9d1c-1db52c8c7f5d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:20:18.916211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef215a2-e702-4b4e-9d1c-1db52c8c7f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:20:18.935406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0ef215a2-e702-4b4e-9d1c-1db52c8c7f5d None None] MFA Rules not processed for user `4b8c7ad3cc6240c096c2c7cf31d8f74f`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:20:18.936885 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0ef215a2-e702-4b4e-9d1c-1db52c8c7f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:20:18.945914 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4541/9015] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:20:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:20:19.314051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709a5ff-8d2d-4f36-b28f-3f9c1dd32c7d service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:20:19.324107 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709a5ff-8d2d-4f36-b28f-3f9c1dd32c7d service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:20:19.329827 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24ec28-6f03-4bd7-a314-65a639a6fd6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:20:19.330516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24ec28-6f03-4bd7-a314-65a639a6fd6b service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:20:19.331358 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24ec28-6f03-4bd7-a314-65a639a6fd6b service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:20:19.331638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24ec28-6f03-4bd7-a314-65a639a6fd6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:20:19.339677 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24ec28-6f03-4bd7-a314-65a639a6fd6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:20:19.341112 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24ec28-6f03-4bd7-a314-65a639a6fd6b service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:20:19.349448 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4475/9016] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:20:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:20:19.759589 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef215a2-e702-4b4e-9d1c-1db52c8c7f5d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:20:19.774927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef215a2-e702-4b4e-9d1c-1db52c8c7f5d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:20:19.780955 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851a762-8d91-4580-9d08-60923a7d784a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:20:19.781889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851a762-8d91-4580-9d08-60923a7d784a service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:20:19.782362 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851a762-8d91-4580-9d08-60923a7d784a service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:20:19.782847 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851a762-8d91-4580-9d08-60923a7d784a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:20:19.794727 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851a762-8d91-4580-9d08-60923a7d784a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:20:19.796708 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851a762-8d91-4580-9d08-60923a7d784a service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:20:19.809027 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4542/9017] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:20:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:20:29.346255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=12 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:20:29.803296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=15 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:21:47.913561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24ec28-6f03-4bd7-a314-65a639a6fd6b service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:21:47.923796 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24ec28-6f03-4bd7-a314-65a639a6fd6b service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:21:47.928898 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2b7de-c9fc-4534-9b15-3ba5a6cd84a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:21:47.929974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2b7de-c9fc-4534-9b15-3ba5a6cd84a9 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:21:47.930113 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2b7de-c9fc-4534-9b15-3ba5a6cd84a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:21:47.930335 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2b7de-c9fc-4534-9b15-3ba5a6cd84a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:21:47.940128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2b7de-c9fc-4534-9b15-3ba5a6cd84a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:21:47.942651 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2b7de-c9fc-4534-9b15-3ba5a6cd84a9 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:21:47.950101 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4476/9018] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:21:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:21:48.273297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851a762-8d91-4580-9d08-60923a7d784a service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:21:48.282823 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851a762-8d91-4580-9d08-60923a7d784a service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:21:48.286923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a568f-5b1b-40f2-842d-6498505247bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:21:48.291067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a568f-5b1b-40f2-842d-6498505247bb service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:21:48.291067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a568f-5b1b-40f2-842d-6498505247bb service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:21:48.291067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a568f-5b1b-40f2-842d-6498505247bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:21:48.298855 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a568f-5b1b-40f2-842d-6498505247bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:21:48.300310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a568f-5b1b-40f2-842d-6498505247bb service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:21:48.311787 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4543/9019] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:21:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:21:49.492509 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2b7de-c9fc-4534-9b15-3ba5a6cd84a9 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:21:49.501259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2b7de-c9fc-4534-9b15-3ba5a6cd84a9 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:21:49.505834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd2553-229b-4176-888f-3a70868e3c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:21:49.506481 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd2553-229b-4176-888f-3a70868e3c12 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:21:49.506768 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd2553-229b-4176-888f-3a70868e3c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:21:49.507070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd2553-229b-4176-888f-3a70868e3c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:21:49.518362 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd2553-229b-4176-888f-3a70868e3c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:21:49.519858 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd2553-229b-4176-888f-3a70868e3c12 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:21:49.531901 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4477/9020] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:21:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:21:55.323284 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a568f-5b1b-40f2-842d-6498505247bb service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:21:55.334963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a568f-5b1b-40f2-842d-6498505247bb service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:21:55.340542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7fd15-456d-4fd6-b24b-2761fab98e52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:21:55.344949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7fd15-456d-4fd6-b24b-2761fab98e52 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:21:55.344949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7fd15-456d-4fd6-b24b-2761fab98e52 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:21:55.344949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7fd15-456d-4fd6-b24b-2761fab98e52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:21:55.351119 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7fd15-456d-4fd6-b24b-2761fab98e52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:21:55.353718 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7fd15-456d-4fd6-b24b-2761fab98e52 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:21:55.364196 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4544/9021] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:21:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:21:59.526807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=12 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:22:03.878179 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ae6c4-dc4a-44de-a262-f5b8784ba387 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:22:03.878870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ae6c4-dc4a-44de-a262-f5b8784ba387 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:22:03.878870 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ae6c4-dc4a-44de-a262-f5b8784ba387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:22:03.896934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f33ae6c4-dc4a-44de-a262-f5b8784ba387 None None] MFA Rules not processed for user `4b8c7ad3cc6240c096c2c7cf31d8f74f`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:22:03.898159 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f33ae6c4-dc4a-44de-a262-f5b8784ba387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:22:03.905892 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4478/9022] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:22:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:22:05.359809 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=12 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:22:13.892248 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:23:03.816152 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7fd15-456d-4fd6-b24b-2761fab98e52 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:03.902190 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7fd15-456d-4fd6-b24b-2761fab98e52 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:03.906927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f30cfe-0aca-49d4-9bb3-d5fc893dc664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:03.907813 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f30cfe-0aca-49d4-9bb3-d5fc893dc664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:03.908098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f30cfe-0aca-49d4-9bb3-d5fc893dc664 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:03.908373 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f30cfe-0aca-49d4-9bb3-d5fc893dc664 admin admin] PATH_INFO: `/v3/users/4b8c7ad3cc6240c096c2c7cf31d8f74f` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:03.909555 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f30cfe-0aca-49d4-9bb3-d5fc893dc664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b8c7ad3cc6240c096c2c7cf31d8f74f)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:03.911511 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f30cfe-0aca-49d4-9bb3-d5fc893dc664 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:04.134305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-95f30cfe-0aca-49d4-9bb3-d5fc893dc664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b8c7ad3cc6240c096c2c7cf31d8f74f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:23:04.141526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-95f30cfe-0aca-49d4-9bb3-d5fc893dc664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b8c7ad3cc6240c096c2c7cf31d8f74f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:23:04.198918 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-95f30cfe-0aca-49d4-9bb3-d5fc893dc664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b8c7ad3cc6240c096c2c7cf31d8f74f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:23:04.199570 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-95f30cfe-0aca-49d4-9bb3-d5fc893dc664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b8c7ad3cc6240c096c2c7cf31d8f74f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:23:04.211720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-95f30cfe-0aca-49d4-9bb3-d5fc893dc664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b8c7ad3cc6240c096c2c7cf31d8f74f'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:23:04.217777 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4545/9023] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 22:23:03 2022] DELETE /identity/v3/users/4b8c7ad3cc6240c096c2c7cf31d8f74f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:23:04.222580 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34d6b6-fbc9-46ac-b7fa-c35bb9f0701c None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:04.223123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34d6b6-fbc9-46ac-b7fa-c35bb9f0701c None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:04.223253 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34d6b6-fbc9-46ac-b7fa-c35bb9f0701c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:04.261837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-ce34d6b6-fbc9-46ac-b7fa-c35bb9f0701c None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:23:04.263087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ce34d6b6-fbc9-46ac-b7fa-c35bb9f0701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:23:04.322100 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4479/9024] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 22:23:04.336786 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f30cfe-0aca-49d4-9bb3-d5fc893dc664 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:04.338358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-95f30cfe-0aca-49d4-9bb3-d5fc893dc664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:23:04.398427 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f30cfe-0aca-49d4-9bb3-d5fc893dc664 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:04.402036 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82303c3-8ac3-402c-ad26-6ddbd388f0c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:04.402681 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82303c3-8ac3-402c-ad26-6ddbd388f0c9 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:04.402968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82303c3-8ac3-402c-ad26-6ddbd388f0c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:04.403282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82303c3-8ac3-402c-ad26-6ddbd388f0c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:04.412648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82303c3-8ac3-402c-ad26-6ddbd388f0c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:04.414080 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82303c3-8ac3-402c-ad26-6ddbd388f0c9 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:04.424232 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4546/9025] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:23:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 22:23:04.686538 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34d6b6-fbc9-46ac-b7fa-c35bb9f0701c None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:04.688124 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ce34d6b6-fbc9-46ac-b7fa-c35bb9f0701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:23:04.700975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34d6b6-fbc9-46ac-b7fa-c35bb9f0701c None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:04.705981 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072dabb-fbf3-459c-855b-ba7671e8c8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:04.706853 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072dabb-fbf3-459c-855b-ba7671e8c8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:04.707182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072dabb-fbf3-459c-855b-ba7671e8c8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:04.707456 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072dabb-fbf3-459c-855b-ba7671e8c8ca admin admin] PATH_INFO: `/v3/projects/a45a8ce6687c427d8f76e4205a076a93` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:04.708664 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072dabb-fbf3-459c-855b-ba7671e8c8ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45a8ce6687c427d8f76e4205a076a93)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:04.710592 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072dabb-fbf3-459c-855b-ba7671e8c8ca admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:04.803830 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8072dabb-fbf3-459c-855b-ba7671e8c8ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45a8ce6687c427d8f76e4205a076a93', 'request_id': 'req-8072dabb-fbf3-459c-855b-ba7671e8c8ca'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:23:04.809292 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8072dabb-fbf3-459c-855b-ba7671e8c8ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45a8ce6687c427d8f76e4205a076a93', 'request_id': 'req-8072dabb-fbf3-459c-855b-ba7671e8c8ca'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:23:04.815506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8072dabb-fbf3-459c-855b-ba7671e8c8ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45a8ce6687c427d8f76e4205a076a93', 'request_id': 'req-8072dabb-fbf3-459c-855b-ba7671e8c8ca'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:23:04.883001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8072dabb-fbf3-459c-855b-ba7671e8c8ca admin admin] The token cache is being invalidate because project a45a8ce6687c427d8f76e4205a076a93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 22:23:04.883319 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8072dabb-fbf3-459c-855b-ba7671e8c8ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:23:04.883945 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-8072dabb-fbf3-459c-855b-ba7671e8c8ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:23:04.885510 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4480/9026] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 22:23:04 2022] DELETE /identity/v3/projects/a45a8ce6687c427d8f76e4205a076a93 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:23:04.890225 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82303c3-8ac3-402c-ad26-6ddbd388f0c9 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:04.896749 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:23:04.900216 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82303c3-8ac3-402c-ad26-6ddbd388f0c9 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:04.959226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4b15f-c98e-453d-b593-054663150a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:04.960013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4b15f-c98e-453d-b593-054663150a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:04.960292 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4b15f-c98e-453d-b593-054663150a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:04.960592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4b15f-c98e-453d-b593-054663150a38 admin admin] PATH_INFO: `/v3/users/fc376aa1d00a4db889c32f2989d75fa5` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:04.961777 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4b15f-c98e-453d-b593-054663150a38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc376aa1d00a4db889c32f2989d75fa5)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:04.963858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4b15f-c98e-453d-b593-054663150a38 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:05.156612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e3b4b15f-c98e-453d-b593-054663150a38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc376aa1d00a4db889c32f2989d75fa5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:23:05.163758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e3b4b15f-c98e-453d-b593-054663150a38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc376aa1d00a4db889c32f2989d75fa5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:23:05.231691 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e3b4b15f-c98e-453d-b593-054663150a38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc376aa1d00a4db889c32f2989d75fa5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:23:05.232242 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e3b4b15f-c98e-453d-b593-054663150a38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc376aa1d00a4db889c32f2989d75fa5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:23:05.246704 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-e3b4b15f-c98e-453d-b593-054663150a38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc376aa1d00a4db889c32f2989d75fa5'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:23:05.254253 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4547/9027] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 22:23:04 2022] DELETE /identity/v3/users/fc376aa1d00a4db889c32f2989d75fa5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:23:05.686655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072dabb-fbf3-459c-855b-ba7671e8c8ca admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:05.688975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8072dabb-fbf3-459c-855b-ba7671e8c8ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:23:05.702328 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072dabb-fbf3-459c-855b-ba7671e8c8ca admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:05.760573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2461f2-d6fd-4aaf-a89b-04d1c1655a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:05.761339 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2461f2-d6fd-4aaf-a89b-04d1c1655a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:05.761624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2461f2-d6fd-4aaf-a89b-04d1c1655a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:05.761900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2461f2-d6fd-4aaf-a89b-04d1c1655a49 admin admin] PATH_INFO: `/v3/projects/0381aafd4c354dffb9380df5fce38059` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:05.763104 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2461f2-d6fd-4aaf-a89b-04d1c1655a49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0381aafd4c354dffb9380df5fce38059)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:05.765000 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2461f2-d6fd-4aaf-a89b-04d1c1655a49 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:05.772941 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:23:05.865823 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc2461f2-d6fd-4aaf-a89b-04d1c1655a49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0381aafd4c354dffb9380df5fce38059', 'request_id': 'req-dc2461f2-d6fd-4aaf-a89b-04d1c1655a49'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:23:05.871600 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc2461f2-d6fd-4aaf-a89b-04d1c1655a49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0381aafd4c354dffb9380df5fce38059', 'request_id': 'req-dc2461f2-d6fd-4aaf-a89b-04d1c1655a49'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:23:05.878618 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc2461f2-d6fd-4aaf-a89b-04d1c1655a49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0381aafd4c354dffb9380df5fce38059', 'request_id': 'req-dc2461f2-d6fd-4aaf-a89b-04d1c1655a49'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:23:05.974735 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc2461f2-d6fd-4aaf-a89b-04d1c1655a49 admin admin] The token cache is being invalidate because project 0381aafd4c354dffb9380df5fce38059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 22:23:05.975051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc2461f2-d6fd-4aaf-a89b-04d1c1655a49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:23:05.975688 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc2461f2-d6fd-4aaf-a89b-04d1c1655a49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:23:05.977278 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4481/9028] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 22:23:05 2022] DELETE /identity/v3/projects/0381aafd4c354dffb9380df5fce38059 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:23:05.982757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe213349-8199-45de-a223-4e39d7276aff None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:05.983277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe213349-8199-45de-a223-4e39d7276aff None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:05.983389 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe213349-8199-45de-a223-4e39d7276aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:06.022207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-fe213349-8199-45de-a223-4e39d7276aff None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:23:06.023374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-fe213349-8199-45de-a223-4e39d7276aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:23:06.084936 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4548/9029] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:23:06.094249 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892bc26-243e-4325-a74e-e08e352af1af None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:06.094526 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892bc26-243e-4325-a74e-e08e352af1af None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:06.094806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892bc26-243e-4325-a74e-e08e352af1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:06.113995 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-d892bc26-243e-4325-a74e-e08e352af1af None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:23:06.115262 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-d892bc26-243e-4325-a74e-e08e352af1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:23:06.123461 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4482/9030] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:23:06.128735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe213349-8199-45de-a223-4e39d7276aff None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:06.138517 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe213349-8199-45de-a223-4e39d7276aff None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:06.143183 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1afeac-4541-42d7-b9f3-84a24d8879b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:06.143829 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1afeac-4541-42d7-b9f3-84a24d8879b5 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:06.144126 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1afeac-4541-42d7-b9f3-84a24d8879b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:06.144378 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1afeac-4541-42d7-b9f3-84a24d8879b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:06.145091 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1afeac-4541-42d7-b9f3-84a24d8879b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 22:23:06.145498 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1afeac-4541-42d7-b9f3-84a24d8879b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:06.147107 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1afeac-4541-42d7-b9f3-84a24d8879b5 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:06.149497 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:23:06.160463 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4549/9031] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 22:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 22:23:06.165061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892bc26-243e-4325-a74e-e08e352af1af None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:06.176070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892bc26-243e-4325-a74e-e08e352af1af None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:06.181247 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82ab20-0ffe-4a1f-bfbb-a4923d97ced0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:06.183767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82ab20-0ffe-4a1f-bfbb-a4923d97ced0 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:06.183767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82ab20-0ffe-4a1f-bfbb-a4923d97ced0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:06.183767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82ab20-0ffe-4a1f-bfbb-a4923d97ced0 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:06.183767 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82ab20-0ffe-4a1f-bfbb-a4923d97ced0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:06.185206 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82ab20-0ffe-4a1f-bfbb-a4923d97ced0 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:06.314660 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4483/9032] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 22:23:06 2022] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 22:23:06.318746 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1afeac-4541-42d7-b9f3-84a24d8879b5 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:06.329977 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1afeac-4541-42d7-b9f3-84a24d8879b5 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:06.387450 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7777448-946a-47b8-962c-3521b3741515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:06.388118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7777448-946a-47b8-962c-3521b3741515 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:06.388400 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7777448-946a-47b8-962c-3521b3741515 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:06.388701 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7777448-946a-47b8-962c-3521b3741515 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:06.389412 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7777448-946a-47b8-962c-3521b3741515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:06.392627 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7777448-946a-47b8-962c-3521b3741515 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:06.502206 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4550/9033] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 22:23:06 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 22:23:06.506376 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82ab20-0ffe-4a1f-bfbb-a4923d97ced0 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:06.517978 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82ab20-0ffe-4a1f-bfbb-a4923d97ced0 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:06.522786 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fbab1-e166-47ae-a9f6-a9439d24ce45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:06.523577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fbab1-e166-47ae-a9f6-a9439d24ce45 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:06.523843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fbab1-e166-47ae-a9f6-a9439d24ce45 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:06.524120 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fbab1-e166-47ae-a9f6-a9439d24ce45 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:06.524966 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fbab1-e166-47ae-a9f6-a9439d24ce45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:06.526462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fbab1-e166-47ae-a9f6-a9439d24ce45 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:06.540823 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4484/9034] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 22:23:06.546213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7777448-946a-47b8-962c-3521b3741515 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:06.561271 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7777448-946a-47b8-962c-3521b3741515 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:06.567176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b10d4c-1c92-488c-bdfa-0c2ca1dd5691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:06.567757 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b10d4c-1c92-488c-bdfa-0c2ca1dd5691 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:06.568040 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b10d4c-1c92-488c-bdfa-0c2ca1dd5691 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:06.568315 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b10d4c-1c92-488c-bdfa-0c2ca1dd5691 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:06.569029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b10d4c-1c92-488c-bdfa-0c2ca1dd5691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:06.570635 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b10d4c-1c92-488c-bdfa-0c2ca1dd5691 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:06.583222 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4551/9035] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 22:23:06.588554 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fbab1-e166-47ae-a9f6-a9439d24ce45 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:06.599959 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fbab1-e166-47ae-a9f6-a9439d24ce45 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:06.605024 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15cc5e-f19d-4f7e-8a9b-c2d70b78867d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:06.608075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15cc5e-f19d-4f7e-8a9b-c2d70b78867d admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:06.608075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15cc5e-f19d-4f7e-8a9b-c2d70b78867d admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:06.608075 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15cc5e-f19d-4f7e-8a9b-c2d70b78867d admin admin] PATH_INFO: `/v3/projects/f1d60fe3fdc841998824b803809f9e49/users/45b6f8ac55464fc99331221b6c67a85d/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:06.623200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15cc5e-f19d-4f7e-8a9b-c2d70b78867d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d60fe3fdc841998824b803809f9e49, user_id=45b6f8ac55464fc99331221b6c67a85d, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:06.626459 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15cc5e-f19d-4f7e-8a9b-c2d70b78867d admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:06.685185 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4485/9036] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 22:23:06 2022] PUT /identity/v3/projects/f1d60fe3fdc841998824b803809f9e49/users/45b6f8ac55464fc99331221b6c67a85d/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 22:23:06.692380 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06474c-eb7c-4605-a528-31bc514294ed None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:06.692670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06474c-eb7c-4605-a528-31bc514294ed None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:06.692949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06474c-eb7c-4605-a528-31bc514294ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:06.714208 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-ad06474c-eb7c-4605-a528-31bc514294ed None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:23:06.716087 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-ad06474c-eb7c-4605-a528-31bc514294ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:23:06.783236 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4552/9037] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:23:06.792983 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15cc5e-f19d-4f7e-8a9b-c2d70b78867d admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:06.794845 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-5b15cc5e-f19d-4f7e-8a9b-c2d70b78867d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:23:06.854951 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15cc5e-f19d-4f7e-8a9b-c2d70b78867d admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:06.861270 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265919aa-b5d8-42e6-bb9e-150fc988cbb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:06.861919 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265919aa-b5d8-42e6-bb9e-150fc988cbb4 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:06.862205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265919aa-b5d8-42e6-bb9e-150fc988cbb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:06.862486 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265919aa-b5d8-42e6-bb9e-150fc988cbb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:06.874245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265919aa-b5d8-42e6-bb9e-150fc988cbb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:06.876371 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265919aa-b5d8-42e6-bb9e-150fc988cbb4 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:06.888422 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4486/9038] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:23:11.914457 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb7693-6584-4180-bc27-2a2dcebd8a14 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:11.919424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb7693-6584-4180-bc27-2a2dcebd8a14 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:11.919424 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb7693-6584-4180-bc27-2a2dcebd8a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:11.950210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-75fb7693-6584-4180-bc27-2a2dcebd8a14 None None] MFA Rules not processed for user `45b6f8ac55464fc99331221b6c67a85d`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:23:11.950210 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-75fb7693-6584-4180-bc27-2a2dcebd8a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:23:12.024500 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4553/9039] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:23:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:23:12.029784 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265919aa-b5d8-42e6-bb9e-150fc988cbb4 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:12.041365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265919aa-b5d8-42e6-bb9e-150fc988cbb4 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:12.047321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1b151-f7b9-4e9c-b7ed-0064f6011f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:12.048434 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1b151-f7b9-4e9c-b7ed-0064f6011f3b admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:12.048975 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1b151-f7b9-4e9c-b7ed-0064f6011f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:12.049474 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1b151-f7b9-4e9c-b7ed-0064f6011f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:12.050383 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1b151-f7b9-4e9c-b7ed-0064f6011f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:12.052806 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1b151-f7b9-4e9c-b7ed-0064f6011f3b admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:12.166615 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4487/9040] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 22:23:12 2022] POST /identity/v3/projects => generated 369 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 22:23:12.170837 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb7693-6584-4180-bc27-2a2dcebd8a14 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:12.178983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:23:12.189398 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb7693-6584-4180-bc27-2a2dcebd8a14 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:12.243310 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991b879-e40b-4af2-adb8-a32d321bf5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:12.244108 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991b879-e40b-4af2-adb8-a32d321bf5fd admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:12.244478 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991b879-e40b-4af2-adb8-a32d321bf5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:12.244803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991b879-e40b-4af2-adb8-a32d321bf5fd admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:12.245561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991b879-e40b-4af2-adb8-a32d321bf5fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:12.247613 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991b879-e40b-4af2-adb8-a32d321bf5fd admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:12.352489 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4554/9041] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 22:23:12 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 22:23:12.354077 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1b151-f7b9-4e9c-b7ed-0064f6011f3b admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:12.366424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1b151-f7b9-4e9c-b7ed-0064f6011f3b admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:12.367632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:23:12.373068 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a2e86-b259-436a-9abb-24f24efd7e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:12.373835 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a2e86-b259-436a-9abb-24f24efd7e64 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:12.374414 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a2e86-b259-436a-9abb-24f24efd7e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:12.374540 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a2e86-b259-436a-9abb-24f24efd7e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:12.375370 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a2e86-b259-436a-9abb-24f24efd7e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:12.377198 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a2e86-b259-436a-9abb-24f24efd7e64 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:12.388734 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4488/9042] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 22:23:12.393171 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991b879-e40b-4af2-adb8-a32d321bf5fd admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:12.404252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991b879-e40b-4af2-adb8-a32d321bf5fd admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:12.410421 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ee98a-c69d-4f5b-8102-1e18931e1e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:12.411464 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ee98a-c69d-4f5b-8102-1e18931e1e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:12.411835 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ee98a-c69d-4f5b-8102-1e18931e1e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:12.412320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ee98a-c69d-4f5b-8102-1e18931e1e01 admin admin] PATH_INFO: `/v3/projects/ea3d9cae80624109b42effd3b65356e0/users/18c11df48bc44350968910c5d4d04670/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:12.430368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ee98a-c69d-4f5b-8102-1e18931e1e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea3d9cae80624109b42effd3b65356e0, user_id=18c11df48bc44350968910c5d4d04670, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:12.433297 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ee98a-c69d-4f5b-8102-1e18931e1e01 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:12.545522 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4555/9043] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 22:23:12 2022] PUT /identity/v3/projects/ea3d9cae80624109b42effd3b65356e0/users/18c11df48bc44350968910c5d4d04670/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:23:12.549658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a2e86-b259-436a-9abb-24f24efd7e64 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:12.560837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a2e86-b259-436a-9abb-24f24efd7e64 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:12.623751 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421288ab-0f49-4490-b8ba-f5bf2ce4d7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:12.624574 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421288ab-0f49-4490-b8ba-f5bf2ce4d7ec admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:12.624722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421288ab-0f49-4490-b8ba-f5bf2ce4d7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:12.625279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421288ab-0f49-4490-b8ba-f5bf2ce4d7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:12.626067 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421288ab-0f49-4490-b8ba-f5bf2ce4d7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:12.627713 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421288ab-0f49-4490-b8ba-f5bf2ce4d7ec admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:12.639092 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4489/9044] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 22:23:12.643940 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ee98a-c69d-4f5b-8102-1e18931e1e01 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:12.655182 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ee98a-c69d-4f5b-8102-1e18931e1e01 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:12.660967 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed15ba-fe8f-4a3a-a78f-a10939775980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:12.668075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed15ba-fe8f-4a3a-a78f-a10939775980 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:12.668075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed15ba-fe8f-4a3a-a78f-a10939775980 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:12.668075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed15ba-fe8f-4a3a-a78f-a10939775980 admin admin] PATH_INFO: `/v3/projects/ea3d9cae80624109b42effd3b65356e0/users/18c11df48bc44350968910c5d4d04670/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:12.668075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed15ba-fe8f-4a3a-a78f-a10939775980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea3d9cae80624109b42effd3b65356e0, user_id=18c11df48bc44350968910c5d4d04670, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:12.668075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed15ba-fe8f-4a3a-a78f-a10939775980 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:12.678100 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4556/9045] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 22:23:12 2022] PUT /identity/v3/projects/ea3d9cae80624109b42effd3b65356e0/users/18c11df48bc44350968910c5d4d04670/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:23:18.554635 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23b0e7-3134-496f-95fb-08bf499f05cf None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:18.555201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23b0e7-3134-496f-95fb-08bf499f05cf None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:18.555201 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23b0e7-3134-496f-95fb-08bf499f05cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:18.601990 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7a23b0e7-3134-496f-95fb-08bf499f05cf None None] MFA Rules not processed for user `18c11df48bc44350968910c5d4d04670`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:23:18.603561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7a23b0e7-3134-496f-95fb-08bf499f05cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:23:18.706495 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4490/9046] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:23:18 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:23:18.716352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed15ba-fe8f-4a3a-a78f-a10939775980 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:18.718926 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-8eed15ba-fe8f-4a3a-a78f-a10939775980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:23:18.822611 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed15ba-fe8f-4a3a-a78f-a10939775980 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:18.830927 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0f121-7388-40c7-8507-85bbb009b9d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:18.831862 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0f121-7388-40c7-8507-85bbb009b9d7 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:18.832176 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0f121-7388-40c7-8507-85bbb009b9d7 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:18.832554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0f121-7388-40c7-8507-85bbb009b9d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:18.879723 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:23:18.895197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0f121-7388-40c7-8507-85bbb009b9d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:18.896999 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0f121-7388-40c7-8507-85bbb009b9d7 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:18.908884 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4557/9047] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:23:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:23:21.458992 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de156d5-068f-4e75-b580-d8292786a9ac None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:21.459564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de156d5-068f-4e75-b580-d8292786a9ac None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:21.459564 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de156d5-068f-4e75-b580-d8292786a9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:21.478673 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7de156d5-068f-4e75-b580-d8292786a9ac None None] MFA Rules not processed for user `45b6f8ac55464fc99331221b6c67a85d`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:23:21.479969 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7de156d5-068f-4e75-b580-d8292786a9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:23:21.490209 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4491/9048] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:23:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 22:23:26.088023 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0f121-7388-40c7-8507-85bbb009b9d7 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:26.104233 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0f121-7388-40c7-8507-85bbb009b9d7 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:26.110922 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e28452-6da1-4224-83dd-397a1fefcc22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:26.111645 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e28452-6da1-4224-83dd-397a1fefcc22 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:26.111943 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e28452-6da1-4224-83dd-397a1fefcc22 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:26.112211 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e28452-6da1-4224-83dd-397a1fefcc22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:26.114110 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-d5e28452-6da1-4224-83dd-397a1fefcc22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:23:26.128140 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e28452-6da1-4224-83dd-397a1fefcc22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:26.129781 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e28452-6da1-4224-83dd-397a1fefcc22 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:26.141745 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4558/9049] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:23:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 22:23:31.472782 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=69 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:23:34.071289 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de156d5-068f-4e75-b580-d8292786a9ac None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:34.125743 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de156d5-068f-4e75-b580-d8292786a9ac None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:34.129642 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d37ca-0b8c-4576-93c0-c8b9566417a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:34.130280 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d37ca-0b8c-4576-93c0-c8b9566417a7 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:34.130561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d37ca-0b8c-4576-93c0-c8b9566417a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:34.130837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d37ca-0b8c-4576-93c0-c8b9566417a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:34.139956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d37ca-0b8c-4576-93c0-c8b9566417a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:34.141490 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d37ca-0b8c-4576-93c0-c8b9566417a7 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:34.150942 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4492/9050] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:23:34 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:23:36.136604 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=14 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:23:36.351531 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e28452-6da1-4224-83dd-397a1fefcc22 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:36.363086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e28452-6da1-4224-83dd-397a1fefcc22 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:36.368658 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb41ade-2d12-4f98-83a3-0f596ad89ad9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:36.369300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb41ade-2d12-4f98-83a3-0f596ad89ad9 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:36.369581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb41ade-2d12-4f98-83a3-0f596ad89ad9 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:36.369858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb41ade-2d12-4f98-83a3-0f596ad89ad9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:36.371732 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6bb41ade-2d12-4f98-83a3-0f596ad89ad9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:23:36.384682 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb41ade-2d12-4f98-83a3-0f596ad89ad9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:36.386276 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb41ade-2d12-4f98-83a3-0f596ad89ad9 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:36.398469 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4559/9051] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:23:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:23:44.146785 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=26 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:23:46.393415 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:23:56.310093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d37ca-0b8c-4576-93c0-c8b9566417a7 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:23:56.311641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-ad9d37ca-0b8c-4576-93c0-c8b9566417a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:23:56.385453 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d37ca-0b8c-4576-93c0-c8b9566417a7 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:23:56.390487 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd25e27-a6fd-4bfc-b946-61b70d146f71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:23:56.391165 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd25e27-a6fd-4bfc-b946-61b70d146f71 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:23:56.391452 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd25e27-a6fd-4bfc-b946-61b70d146f71 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:23:56.392259 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd25e27-a6fd-4bfc-b946-61b70d146f71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:23:56.394110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-3dd25e27-a6fd-4bfc-b946-61b70d146f71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:23:56.405396 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd25e27-a6fd-4bfc-b946-61b70d146f71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:23:56.406956 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd25e27-a6fd-4bfc-b946-61b70d146f71 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:23:56.417350 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4493/9052] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:23:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:24:06.413237 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=35 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:25:01.221640 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb41ade-2d12-4f98-83a3-0f596ad89ad9 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:25:01.223103 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6bb41ade-2d12-4f98-83a3-0f596ad89ad9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:25:01.295358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb41ade-2d12-4f98-83a3-0f596ad89ad9 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:25:01.300554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4baba-9474-438b-86bb-a42dda4cf247 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:25:01.301197 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4baba-9474-438b-86bb-a42dda4cf247 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:25:01.301482 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4baba-9474-438b-86bb-a42dda4cf247 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:25:01.301761 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4baba-9474-438b-86bb-a42dda4cf247 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:25:01.303974 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-25a4baba-9474-438b-86bb-a42dda4cf247 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:25:01.315320 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4baba-9474-438b-86bb-a42dda4cf247 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:25:01.316895 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4baba-9474-438b-86bb-a42dda4cf247 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:25:01.327331 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4560/9053] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:25:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:25:11.323186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=32 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:25:44.236648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98c681-712f-4e4e-8674-96528914ea0e None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:25:44.243952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98c681-712f-4e4e-8674-96528914ea0e None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:25:44.243952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98c681-712f-4e4e-8674-96528914ea0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:25:44.263102 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4baba-9474-438b-86bb-a42dda4cf247 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:25:44.265277 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-25a4baba-9474-438b-86bb-a42dda4cf247 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:25:44.291495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4b98c681-712f-4e4e-8674-96528914ea0e None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:25:44.292722 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4b98c681-712f-4e4e-8674-96528914ea0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:25:44.296469 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4baba-9474-438b-86bb-a42dda4cf247 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:25:44.302625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f5aae-6779-445c-9033-a74551fa55e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:25:44.303548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f5aae-6779-445c-9033-a74551fa55e0 service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:25:44.303833 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f5aae-6779-445c-9033-a74551fa55e0 service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:25:44.304111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f5aae-6779-445c-9033-a74551fa55e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:25:44.306569 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6b5f5aae-6779-445c-9033-a74551fa55e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:25:44.319659 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f5aae-6779-445c-9033-a74551fa55e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:25:44.326422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f5aae-6779-445c-9033-a74551fa55e0 service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:25:44.336712 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4561/9054] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:25:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:25:44.375290 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4494/9055] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 22:25:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 22:25:44.496815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f5aae-6779-445c-9033-a74551fa55e0 service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:25:44.496951 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-6b5f5aae-6779-445c-9033-a74551fa55e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:25:44.591477 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f5aae-6779-445c-9033-a74551fa55e0 service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:25:44.596581 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594d79d-448c-47d2-bf4b-ae40a2fc43a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:25:44.597162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594d79d-448c-47d2-bf4b-ae40a2fc43a9 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:25:44.597442 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594d79d-448c-47d2-bf4b-ae40a2fc43a9 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:25:44.597713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594d79d-448c-47d2-bf4b-ae40a2fc43a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:25:44.606054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594d79d-448c-47d2-bf4b-ae40a2fc43a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:25:44.607664 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594d79d-448c-47d2-bf4b-ae40a2fc43a9 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:25:44.615655 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4562/9056] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 22:25:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 22:25:54.370386 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=40 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:25:54.612909 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=51 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:25:57.690686 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98c681-712f-4e4e-8674-96528914ea0e None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:25:57.710479 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98c681-712f-4e4e-8674-96528914ea0e None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:25:57.714807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ed97d-8cda-4426-9296-db2cd9aeac77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:25:57.715515 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ed97d-8cda-4426-9296-db2cd9aeac77 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:25:57.715798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ed97d-8cda-4426-9296-db2cd9aeac77 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:25:57.716076 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ed97d-8cda-4426-9296-db2cd9aeac77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:25:57.717831 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f42ed97d-8cda-4426-9296-db2cd9aeac77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:25:57.741378 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ed97d-8cda-4426-9296-db2cd9aeac77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:25:57.743527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ed97d-8cda-4426-9296-db2cd9aeac77 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:25:57.753944 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4495/9057] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:25:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:25:57.993889 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd7d6d-904c-4ad5-85c4-0f8b796a7db2 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:25:57.994990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd7d6d-904c-4ad5-85c4-0f8b796a7db2 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:25:57.994990 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd7d6d-904c-4ad5-85c4-0f8b796a7db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:25:58.014192 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-87cd7d6d-904c-4ad5-85c4-0f8b796a7db2 None None] MFA Rules not processed for user `d5f515bfe2094b41afe82b4bc57e4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:25:58.015533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-87cd7d6d-904c-4ad5-85c4-0f8b796a7db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:25:58.024897 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4563/9058] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Jul 16 22:25:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:25:58.036755 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ed97d-8cda-4426-9296-db2cd9aeac77 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:25:58.038240 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f42ed97d-8cda-4426-9296-db2cd9aeac77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:25:58.120641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ed97d-8cda-4426-9296-db2cd9aeac77 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:25:58.124752 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355a245-74c2-4c9d-ad5d-d99ffa6a6728 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:25:58.125399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355a245-74c2-4c9d-ad5d-d99ffa6a6728 service glance] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:25:58.125684 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355a245-74c2-4c9d-ad5d-d99ffa6a6728 service glance] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:25:58.125964 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355a245-74c2-4c9d-ad5d-d99ffa6a6728 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:25:58.137042 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355a245-74c2-4c9d-ad5d-d99ffa6a6728 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:25:58.138589 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355a245-74c2-4c9d-ad5d-d99ffa6a6728 service glance] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:25:58.149508 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4496/9059] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:25:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:25:58.359438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd7d6d-904c-4ad5-85c4-0f8b796a7db2 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:25:58.368905 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd7d6d-904c-4ad5-85c4-0f8b796a7db2 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:25:58.373214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745f04d-7f75-4cbc-adfd-6699846e4834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:25:58.373851 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745f04d-7f75-4cbc-adfd-6699846e4834 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:25:58.374133 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745f04d-7f75-4cbc-adfd-6699846e4834 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:25:58.374408 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745f04d-7f75-4cbc-adfd-6699846e4834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:25:58.376257 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2745f04d-7f75-4cbc-adfd-6699846e4834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:25:58.387139 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745f04d-7f75-4cbc-adfd-6699846e4834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:25:58.388591 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745f04d-7f75-4cbc-adfd-6699846e4834 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:25:58.396789 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4564/9060] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:25:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:25:58.474265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355a245-74c2-4c9d-ad5d-d99ffa6a6728 service glance] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:25:58.475690 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8355a245-74c2-4c9d-ad5d-d99ffa6a6728 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:25:58.488327 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355a245-74c2-4c9d-ad5d-d99ffa6a6728 service glance] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:25:58.491904 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00420fbe-440e-4101-869f-0f20f2ba06ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:25:58.492539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00420fbe-440e-4101-869f-0f20f2ba06ac service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:25:58.492819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00420fbe-440e-4101-869f-0f20f2ba06ac service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:25:58.493093 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00420fbe-440e-4101-869f-0f20f2ba06ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:25:58.495648 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-00420fbe-440e-4101-869f-0f20f2ba06ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:25:58.508748 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00420fbe-440e-4101-869f-0f20f2ba06ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:25:58.510166 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00420fbe-440e-4101-869f-0f20f2ba06ac service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:25:58.521224 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4497/9061] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:25:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:25:58.582815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745f04d-7f75-4cbc-adfd-6699846e4834 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:25:58.595081 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745f04d-7f75-4cbc-adfd-6699846e4834 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:25:58.600052 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de73f5-9748-4432-92f9-e4dff1da0470 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:25:58.600684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de73f5-9748-4432-92f9-e4dff1da0470 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:25:58.600968 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de73f5-9748-4432-92f9-e4dff1da0470 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:25:58.601246 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de73f5-9748-4432-92f9-e4dff1da0470 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:25:58.602988 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-46de73f5-9748-4432-92f9-e4dff1da0470 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:25:58.615509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de73f5-9748-4432-92f9-e4dff1da0470 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:25:58.617096 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de73f5-9748-4432-92f9-e4dff1da0470 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:25:58.628126 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4565/9062] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:25:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:26:00.486061 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8ad60-705e-4074-b5f3-c4d9c43d5673 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:26:00.486647 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8ad60-705e-4074-b5f3-c4d9c43d5673 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:26:00.487074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8ad60-705e-4074-b5f3-c4d9c43d5673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:26:00.505569 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-2fe8ad60-705e-4074-b5f3-c4d9c43d5673 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:26:00.506793 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2fe8ad60-705e-4074-b5f3-c4d9c43d5673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:26:00.515304 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4498/9063] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 22:26:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 22:26:00.527725 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de73f5-9748-4432-92f9-e4dff1da0470 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:26:00.540966 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de73f5-9748-4432-92f9-e4dff1da0470 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:26:00.546252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18d81f-9713-42a6-acea-7522f048199f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:26:00.548554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18d81f-9713-42a6-acea-7522f048199f service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:26:00.548554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18d81f-9713-42a6-acea-7522f048199f service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:26:00.548554 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18d81f-9713-42a6-acea-7522f048199f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:26:00.556566 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18d81f-9713-42a6-acea-7522f048199f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:26:00.558213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18d81f-9713-42a6-acea-7522f048199f service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:26:00.567037 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4566/9064] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 22:26:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 22:26:10.499840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=59 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:26:10.564106 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=21 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:26:15.709156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff34a12-06c9-4ed0-a45a-c354011aa584 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:26:15.709640 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff34a12-06c9-4ed0-a45a-c354011aa584 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:26:15.709756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff34a12-06c9-4ed0-a45a-c354011aa584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:26:15.729502 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-4ff34a12-06c9-4ed0-a45a-c354011aa584 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:26:15.730706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4ff34a12-06c9-4ed0-a45a-c354011aa584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:26:15.739220 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4499/9065] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 22:26:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:26:15.753250 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18d81f-9713-42a6-acea-7522f048199f service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:26:15.764694 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18d81f-9713-42a6-acea-7522f048199f service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:26:15.770004 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b2e89-2744-4aa9-9132-93df62fe8d84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:26:15.770726 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b2e89-2744-4aa9-9132-93df62fe8d84 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:26:15.771025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b2e89-2744-4aa9-9132-93df62fe8d84 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:26:15.771312 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b2e89-2744-4aa9-9132-93df62fe8d84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:26:15.780521 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b2e89-2744-4aa9-9132-93df62fe8d84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:26:15.782624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b2e89-2744-4aa9-9132-93df62fe8d84 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:26:15.791444 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4567/9066] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 22:26:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 22:26:25.722934 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:26:25.787874 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:27:02.089301 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff34a12-06c9-4ed0-a45a-c354011aa584 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:27:02.099055 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff34a12-06c9-4ed0-a45a-c354011aa584 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:27:02.102637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ace52-f3c7-44d9-b510-2a16fb6bec92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:27:02.103318 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ace52-f3c7-44d9-b510-2a16fb6bec92 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:27:02.103606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ace52-f3c7-44d9-b510-2a16fb6bec92 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:27:02.103887 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ace52-f3c7-44d9-b510-2a16fb6bec92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:27:02.105675 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f53ace52-f3c7-44d9-b510-2a16fb6bec92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:27:02.115365 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ace52-f3c7-44d9-b510-2a16fb6bec92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:27:02.116840 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ace52-f3c7-44d9-b510-2a16fb6bec92 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:27:02.124569 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4500/9067] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:27:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:27:12.121226 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:27:30.413962 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b2e89-2744-4aa9-9132-93df62fe8d84 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:27:30.423411 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b2e89-2744-4aa9-9132-93df62fe8d84 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:27:30.427662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28615a-accc-4de2-86b7-dde13748f4e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:27:30.428294 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28615a-accc-4de2-86b7-dde13748f4e7 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:27:30.428575 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28615a-accc-4de2-86b7-dde13748f4e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:27:30.428849 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28615a-accc-4de2-86b7-dde13748f4e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:27:30.430890 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2a28615a-accc-4de2-86b7-dde13748f4e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:27:30.446563 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28615a-accc-4de2-86b7-dde13748f4e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:27:30.448045 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28615a-accc-4de2-86b7-dde13748f4e7 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:27:30.459418 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4568/9068] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:27:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:27:31.649566 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ace52-f3c7-44d9-b510-2a16fb6bec92 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:27:31.658375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ace52-f3c7-44d9-b510-2a16fb6bec92 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:27:31.662979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b266c-d2a0-4f60-9ecc-fdb3f83aa3be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:27:31.663658 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b266c-d2a0-4f60-9ecc-fdb3f83aa3be service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:27:31.664049 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b266c-d2a0-4f60-9ecc-fdb3f83aa3be service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:27:31.664363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b266c-d2a0-4f60-9ecc-fdb3f83aa3be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:27:31.666224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-695b266c-d2a0-4f60-9ecc-fdb3f83aa3be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:27:31.681634 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b266c-d2a0-4f60-9ecc-fdb3f83aa3be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:27:31.683109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b266c-d2a0-4f60-9ecc-fdb3f83aa3be service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:27:31.696249 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4501/9069] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:27:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:27:37.371143 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1c98c-ea55-4608-acd0-65aef411d42d None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:27:37.372273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1c98c-ea55-4608-acd0-65aef411d42d None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:27:37.372273 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1c98c-ea55-4608-acd0-65aef411d42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:27:37.389460 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a5c1c98c-ea55-4608-acd0-65aef411d42d None None] MFA Rules not processed for user `45b6f8ac55464fc99331221b6c67a85d`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:27:37.394830 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a5c1c98c-ea55-4608-acd0-65aef411d42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:27:37.398278 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4569/9070] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:27:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:27:41.599630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b266c-d2a0-4f60-9ecc-fdb3f83aa3be service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:27:41.608273 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b266c-d2a0-4f60-9ecc-fdb3f83aa3be service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:27:41.612003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c91223-0d6f-4f6c-85f4-279e06f1e827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:27:41.612637 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c91223-0d6f-4f6c-85f4-279e06f1e827 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:27:41.612923 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c91223-0d6f-4f6c-85f4-279e06f1e827 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:27:41.613200 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c91223-0d6f-4f6c-85f4-279e06f1e827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:27:41.615096 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-96c91223-0d6f-4f6c-85f4-279e06f1e827 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:27:41.624473 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c91223-0d6f-4f6c-85f4-279e06f1e827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:27:41.625889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c91223-0d6f-4f6c-85f4-279e06f1e827 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:27:41.634342 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4502/9071] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:27:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:27:42.262453 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1c98c-ea55-4608-acd0-65aef411d42d None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:27:42.274703 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1c98c-ea55-4608-acd0-65aef411d42d None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:27:42.279841 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7a7fa-85c7-4dbb-a7f7-981e98413239 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:27:42.280491 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7a7fa-85c7-4dbb-a7f7-981e98413239 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:27:42.280767 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7a7fa-85c7-4dbb-a7f7-981e98413239 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:27:42.281038 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7a7fa-85c7-4dbb-a7f7-981e98413239 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:27:42.282883 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-58c7a7fa-85c7-4dbb-a7f7-981e98413239 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:27:42.295428 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7a7fa-85c7-4dbb-a7f7-981e98413239 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:27:42.297075 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7a7fa-85c7-4dbb-a7f7-981e98413239 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:27:42.308834 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4570/9072] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:27:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:27:45.000156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c91223-0d6f-4f6c-85f4-279e06f1e827 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:27:45.010424 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c91223-0d6f-4f6c-85f4-279e06f1e827 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:27:45.014801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e07e1e-b059-41c1-9592-466f9c61a5bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:27:45.015590 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e07e1e-b059-41c1-9592-466f9c61a5bf service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:27:45.015932 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e07e1e-b059-41c1-9592-466f9c61a5bf service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:27:45.016279 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e07e1e-b059-41c1-9592-466f9c61a5bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:27:45.018539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c5e07e1e-b059-41c1-9592-466f9c61a5bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:27:45.030298 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e07e1e-b059-41c1-9592-466f9c61a5bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:27:45.031910 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e07e1e-b059-41c1-9592-466f9c61a5bf service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:27:45.040765 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4503/9073] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:27:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:27:52.303764 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=15 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:27:55.036889 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=18 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:29:04.325598 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7a7fa-85c7-4dbb-a7f7-981e98413239 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:29:04.336728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7a7fa-85c7-4dbb-a7f7-981e98413239 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:29:04.342230 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7100cd-a34b-47a8-8bff-3e2476079dc8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:29:04.342864 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7100cd-a34b-47a8-8bff-3e2476079dc8 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:29:04.343178 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7100cd-a34b-47a8-8bff-3e2476079dc8 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:29:04.343452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7100cd-a34b-47a8-8bff-3e2476079dc8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:29:04.352610 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7100cd-a34b-47a8-8bff-3e2476079dc8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:29:04.354303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7100cd-a34b-47a8-8bff-3e2476079dc8 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:29:04.365060 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4571/9074] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:29:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:29:14.359923 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=6 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:30:07.237525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e07e1e-b059-41c1-9592-466f9c61a5bf service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:30:07.249979 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e07e1e-b059-41c1-9592-466f9c61a5bf service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:30:07.255214 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bcff1-d1c7-4756-9bf8-fdc32e888bfd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:30:07.255892 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bcff1-d1c7-4756-9bf8-fdc32e888bfd service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:30:07.256173 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bcff1-d1c7-4756-9bf8-fdc32e888bfd service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:30:07.256454 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bcff1-d1c7-4756-9bf8-fdc32e888bfd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:30:07.265091 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bcff1-d1c7-4756-9bf8-fdc32e888bfd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:30:07.269726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bcff1-d1c7-4756-9bf8-fdc32e888bfd service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:30:07.276793 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4504/9075] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:30:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:30:17.272399 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:31:27.497858 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7100cd-a34b-47a8-8bff-3e2476079dc8 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:31:27.517282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7100cd-a34b-47a8-8bff-3e2476079dc8 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:31:27.523118 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685ea66-9040-4652-85c5-7f7b9ddb55ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:31:27.523750 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685ea66-9040-4652-85c5-7f7b9ddb55ec service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:27.524031 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685ea66-9040-4652-85c5-7f7b9ddb55ec service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:27.524303 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685ea66-9040-4652-85c5-7f7b9ddb55ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:27.532282 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685ea66-9040-4652-85c5-7f7b9ddb55ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:31:27.533789 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685ea66-9040-4652-85c5-7f7b9ddb55ec service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:31:27.543355 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4572/9076] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:31:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 22:31:29.488001 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bcff1-d1c7-4756-9bf8-fdc32e888bfd service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:31:29.501527 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bcff1-d1c7-4756-9bf8-fdc32e888bfd service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:31:29.507926 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa276c-5574-4e58-86df-b607b2fd0be7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:31:29.509052 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa276c-5574-4e58-86df-b607b2fd0be7 service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:29.509403 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa276c-5574-4e58-86df-b607b2fd0be7 service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:29.509756 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa276c-5574-4e58-86df-b607b2fd0be7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:29.520523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa276c-5574-4e58-86df-b607b2fd0be7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:31:29.523135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa276c-5574-4e58-86df-b607b2fd0be7 service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:31:29.535522 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4505/9077] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:31:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:31:34.890933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685ea66-9040-4652-85c5-7f7b9ddb55ec service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:31:34.901263 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685ea66-9040-4652-85c5-7f7b9ddb55ec service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:31:34.904876 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb34b1-9120-4256-8134-e5e225e9ffdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:31:34.905508 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb34b1-9120-4256-8134-e5e225e9ffdc service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:34.905790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb34b1-9120-4256-8134-e5e225e9ffdc service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:34.906067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb34b1-9120-4256-8134-e5e225e9ffdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:34.966483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb34b1-9120-4256-8134-e5e225e9ffdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:31:34.967948 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb34b1-9120-4256-8134-e5e225e9ffdc service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:31:34.978846 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4573/9078] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:31:38.886277 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa276c-5574-4e58-86df-b607b2fd0be7 service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:31:38.899765 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa276c-5574-4e58-86df-b607b2fd0be7 service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:31:38.905307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69d877-00f6-4468-9285-515e888b372b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:31:38.906222 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69d877-00f6-4468-9285-515e888b372b service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:38.906706 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69d877-00f6-4468-9285-515e888b372b service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:38.906991 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69d877-00f6-4468-9285-515e888b372b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:38.908826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-dc69d877-00f6-4468-9285-515e888b372b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:31:38.937153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69d877-00f6-4468-9285-515e888b372b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:31:38.938792 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69d877-00f6-4468-9285-515e888b372b service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:31:38.951583 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4506/9079] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:31:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:31:42.495670 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb34b1-9120-4256-8134-e5e225e9ffdc service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:31:42.506379 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb34b1-9120-4256-8134-e5e225e9ffdc service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:31:42.512582 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6f75e-4496-4982-88a9-3d3c1a05bf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:31:42.513471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6f75e-4496-4982-88a9-3d3c1a05bf47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:42.513748 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6f75e-4496-4982-88a9-3d3c1a05bf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:42.514016 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6f75e-4496-4982-88a9-3d3c1a05bf47 admin admin] PATH_INFO: `/v3/users/45b6f8ac55464fc99331221b6c67a85d` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:42.515268 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6f75e-4496-4982-88a9-3d3c1a05bf47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45b6f8ac55464fc99331221b6c67a85d)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:31:42.517252 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6f75e-4496-4982-88a9-3d3c1a05bf47 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:31:42.712046 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f7f6f75e-4496-4982-88a9-3d3c1a05bf47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45b6f8ac55464fc99331221b6c67a85d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:31:42.719456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f7f6f75e-4496-4982-88a9-3d3c1a05bf47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45b6f8ac55464fc99331221b6c67a85d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:31:42.778203 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f7f6f75e-4496-4982-88a9-3d3c1a05bf47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45b6f8ac55464fc99331221b6c67a85d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:31:42.778770 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f7f6f75e-4496-4982-88a9-3d3c1a05bf47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45b6f8ac55464fc99331221b6c67a85d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:31:42.791705 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-f7f6f75e-4496-4982-88a9-3d3c1a05bf47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45b6f8ac55464fc99331221b6c67a85d'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:31:42.797638 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4574/9080] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 22:31:42 2022] DELETE /identity/v3/users/45b6f8ac55464fc99331221b6c67a85d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:31:43.057213 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69d877-00f6-4468-9285-515e888b372b service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:31:43.068544 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69d877-00f6-4468-9285-515e888b372b service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:31:43.126809 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d071a-9d8d-49c2-9e49-854c6674fcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:31:43.127759 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d071a-9d8d-49c2-9e49-854c6674fcc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:43.128047 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d071a-9d8d-49c2-9e49-854c6674fcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:43.128351 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d071a-9d8d-49c2-9e49-854c6674fcc5 admin admin] PATH_INFO: `/v3/projects/f1d60fe3fdc841998824b803809f9e49` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:43.129577 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d071a-9d8d-49c2-9e49-854c6674fcc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1d60fe3fdc841998824b803809f9e49)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:31:43.131531 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d071a-9d8d-49c2-9e49-854c6674fcc5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:31:43.266321 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc0d071a-9d8d-49c2-9e49-854c6674fcc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1d60fe3fdc841998824b803809f9e49', 'request_id': 'req-dc0d071a-9d8d-49c2-9e49-854c6674fcc5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:31:43.271900 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc0d071a-9d8d-49c2-9e49-854c6674fcc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1d60fe3fdc841998824b803809f9e49', 'request_id': 'req-dc0d071a-9d8d-49c2-9e49-854c6674fcc5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:31:43.278019 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc0d071a-9d8d-49c2-9e49-854c6674fcc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1d60fe3fdc841998824b803809f9e49', 'request_id': 'req-dc0d071a-9d8d-49c2-9e49-854c6674fcc5'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:31:43.351084 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc0d071a-9d8d-49c2-9e49-854c6674fcc5 admin admin] The token cache is being invalidate because project f1d60fe3fdc841998824b803809f9e49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 22:31:43.351380 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc0d071a-9d8d-49c2-9e49-854c6674fcc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:31:43.352013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-dc0d071a-9d8d-49c2-9e49-854c6674fcc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:31:43.354205 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4507/9081] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 22:31:43 2022] DELETE /identity/v3/projects/f1d60fe3fdc841998824b803809f9e49 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:31:43.358232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6f75e-4496-4982-88a9-3d3c1a05bf47 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:31:43.359637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-f7f6f75e-4496-4982-88a9-3d3c1a05bf47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:31:43.373840 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6f75e-4496-4982-88a9-3d3c1a05bf47 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:31:43.417815 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:31:43.430500 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f298b-1e78-4c07-8764-7f01c635a01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:31:43.431803 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f298b-1e78-4c07-8764-7f01c635a01a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:43.432085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f298b-1e78-4c07-8764-7f01c635a01a admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:43.432357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f298b-1e78-4c07-8764-7f01c635a01a admin admin] PATH_INFO: `/v3/users/18c11df48bc44350968910c5d4d04670` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:43.433549 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f298b-1e78-4c07-8764-7f01c635a01a admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c11df48bc44350968910c5d4d04670)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:31:43.435579 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f298b-1e78-4c07-8764-7f01c635a01a admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:31:43.637213 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-175f298b-1e78-4c07-8764-7f01c635a01a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c11df48bc44350968910c5d4d04670'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:31:43.644010 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-175f298b-1e78-4c07-8764-7f01c635a01a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c11df48bc44350968910c5d4d04670'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:31:43.721042 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-175f298b-1e78-4c07-8764-7f01c635a01a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c11df48bc44350968910c5d4d04670'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:31:43.721666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-175f298b-1e78-4c07-8764-7f01c635a01a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c11df48bc44350968910c5d4d04670'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:31:43.734542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-175f298b-1e78-4c07-8764-7f01c635a01a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c11df48bc44350968910c5d4d04670'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:31:43.740607 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4575/9082] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 22:31:43 2022] DELETE /identity/v3/users/18c11df48bc44350968910c5d4d04670 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:31:44.028110 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d071a-9d8d-49c2-9e49-854c6674fcc5 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:31:44.029641 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-dc0d071a-9d8d-49c2-9e49-854c6674fcc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:31:44.043828 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d071a-9d8d-49c2-9e49-854c6674fcc5 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:31:44.094282 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:31:44.103032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0f1d6-354d-458f-b478-895ee0ee5d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:31:44.103952 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0f1d6-354d-458f-b478-895ee0ee5d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:44.104234 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0f1d6-354d-458f-b478-895ee0ee5d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:44.104506 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0f1d6-354d-458f-b478-895ee0ee5d08 admin admin] PATH_INFO: `/v3/projects/ea3d9cae80624109b42effd3b65356e0` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:44.105682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0f1d6-354d-458f-b478-895ee0ee5d08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea3d9cae80624109b42effd3b65356e0)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:31:44.107624 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0f1d6-354d-458f-b478-895ee0ee5d08 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:31:44.244363 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b1c0f1d6-354d-458f-b478-895ee0ee5d08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea3d9cae80624109b42effd3b65356e0', 'request_id': 'req-b1c0f1d6-354d-458f-b478-895ee0ee5d08'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:31:44.249701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b1c0f1d6-354d-458f-b478-895ee0ee5d08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea3d9cae80624109b42effd3b65356e0', 'request_id': 'req-b1c0f1d6-354d-458f-b478-895ee0ee5d08'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:31:44.255895 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b1c0f1d6-354d-458f-b478-895ee0ee5d08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea3d9cae80624109b42effd3b65356e0', 'request_id': 'req-b1c0f1d6-354d-458f-b478-895ee0ee5d08'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:31:44.333732 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b1c0f1d6-354d-458f-b478-895ee0ee5d08 admin admin] The token cache is being invalidate because project ea3d9cae80624109b42effd3b65356e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 22:31:44.334016 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b1c0f1d6-354d-458f-b478-895ee0ee5d08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:31:44.334638 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-b1c0f1d6-354d-458f-b478-895ee0ee5d08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:31:44.336264 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4508/9083] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 22:31:44 2022] DELETE /identity/v3/projects/ea3d9cae80624109b42effd3b65356e0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:31:44.341429 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c64c7-2ab6-4d1a-a40f-fd9ab61ab121 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:44.341820 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c64c7-2ab6-4d1a-a40f-fd9ab61ab121 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:44.342170 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c64c7-2ab6-4d1a-a40f-fd9ab61ab121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:44.370473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-9f8c64c7-2ab6-4d1a-a40f-fd9ab61ab121 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:31:44.371715 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-9f8c64c7-2ab6-4d1a-a40f-fd9ab61ab121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:31:44.431689 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4576/9084] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:31:44.439202 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f62ec-536b-445e-b0fe-fa81903aea10 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:44.439495 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f62ec-536b-445e-b0fe-fa81903aea10 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:44.439772 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f62ec-536b-445e-b0fe-fa81903aea10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:44.458433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-537f62ec-536b-445e-b0fe-fa81903aea10 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:31:44.459668 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-537f62ec-536b-445e-b0fe-fa81903aea10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:31:44.467695 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4509/9085] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:31:44.471884 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c64c7-2ab6-4d1a-a40f-fd9ab61ab121 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:31:44.482111 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c64c7-2ab6-4d1a-a40f-fd9ab61ab121 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:31:44.486665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1398df-de6f-472e-abc4-a02d8abbdeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:31:44.487344 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1398df-de6f-472e-abc4-a02d8abbdeee admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:44.487624 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1398df-de6f-472e-abc4-a02d8abbdeee admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:44.487896 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1398df-de6f-472e-abc4-a02d8abbdeee admin admin] PATH_INFO: `/v3/domains` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:44.488609 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1398df-de6f-472e-abc4-a02d8abbdeee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98196) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 16 22:31:44.488935 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1398df-de6f-472e-abc4-a02d8abbdeee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:31:44.490513 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1398df-de6f-472e-abc4-a02d8abbdeee admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:31:44.502889 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4577/9086] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Jul 16 22:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 16 22:31:44.507094 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f62ec-536b-445e-b0fe-fa81903aea10 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:31:44.516432 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f62ec-536b-445e-b0fe-fa81903aea10 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:31:44.525283 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580b9f5-6698-4557-aac3-020535f06302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:31:44.525787 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580b9f5-6698-4557-aac3-020535f06302 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:44.526069 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580b9f5-6698-4557-aac3-020535f06302 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:44.526344 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580b9f5-6698-4557-aac3-020535f06302 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:44.527080 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580b9f5-6698-4557-aac3-020535f06302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:31:44.528988 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580b9f5-6698-4557-aac3-020535f06302 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:31:44.621900 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4510/9087] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 22:31:44 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 22:31:44.625991 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1398df-de6f-472e-abc4-a02d8abbdeee admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:31:44.636364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1398df-de6f-472e-abc4-a02d8abbdeee admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:31:44.677358 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:31:44.692634 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685df2d-9adc-46db-89bf-eaa7fe5f3f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:31:44.693340 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685df2d-9adc-46db-89bf-eaa7fe5f3f18 admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:44.693622 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685df2d-9adc-46db-89bf-eaa7fe5f3f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:44.693897 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685df2d-9adc-46db-89bf-eaa7fe5f3f18 admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:44.694614 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685df2d-9adc-46db-89bf-eaa7fe5f3f18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:31:44.696792 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685df2d-9adc-46db-89bf-eaa7fe5f3f18 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:31:44.814335 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4578/9088] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 22:31:44 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 22:31:44.818416 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580b9f5-6698-4557-aac3-020535f06302 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:31:44.828989 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580b9f5-6698-4557-aac3-020535f06302 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:31:44.833890 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b135a6-187e-491b-bf64-6f17e33e5531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:31:44.834557 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b135a6-187e-491b-bf64-6f17e33e5531 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:44.834841 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b135a6-187e-491b-bf64-6f17e33e5531 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:44.835156 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b135a6-187e-491b-bf64-6f17e33e5531 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:44.835881 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b135a6-187e-491b-bf64-6f17e33e5531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:31:44.837700 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b135a6-187e-491b-bf64-6f17e33e5531 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:31:44.848559 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4511/9089] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 22:31:44.853461 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685df2d-9adc-46db-89bf-eaa7fe5f3f18 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:31:44.863899 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685df2d-9adc-46db-89bf-eaa7fe5f3f18 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:31:44.869319 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7df36e-d1a6-4785-9892-808f3af6d522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:31:44.869980 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7df36e-d1a6-4785-9892-808f3af6d522 admin admin] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:44.870253 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7df36e-d1a6-4785-9892-808f3af6d522 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:44.870519 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7df36e-d1a6-4785-9892-808f3af6d522 admin admin] PATH_INFO: `/v3/roles` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:44.871265 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7df36e-d1a6-4785-9892-808f3af6d522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:31:44.872906 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7df36e-d1a6-4785-9892-808f3af6d522 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:31:44.883322 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4579/9090] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 22:31:44.887749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b135a6-187e-491b-bf64-6f17e33e5531 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:31:44.897863 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b135a6-187e-491b-bf64-6f17e33e5531 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:31:44.903364 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b4e36-0d60-4940-abcf-238edd9e5bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:31:44.904242 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b4e36-0d60-4940-abcf-238edd9e5bba admin admin] REQUEST_METHOD: `PUT` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:44.904525 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b4e36-0d60-4940-abcf-238edd9e5bba admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:44.904805 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b4e36-0d60-4940-abcf-238edd9e5bba admin admin] PATH_INFO: `/v3/projects/4490e1139a4046228fe39fbdc7973d20/users/77a17d04ccb1477cafd82ca23fd65328/roles/c352110df5bc449b9134928abd20c032` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:44.920208 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b4e36-0d60-4940-abcf-238edd9e5bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4490e1139a4046228fe39fbdc7973d20, user_id=77a17d04ccb1477cafd82ca23fd65328, role_id=c352110df5bc449b9134928abd20c032)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:31:44.922962 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b4e36-0d60-4940-abcf-238edd9e5bba admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:31:45.020490 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4512/9091] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 22:31:44 2022] PUT /identity/v3/projects/4490e1139a4046228fe39fbdc7973d20/users/77a17d04ccb1477cafd82ca23fd65328/roles/c352110df5bc449b9134928abd20c032 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:31:45.026259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326e6c9-e951-4f08-9020-aaf0402906e1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:45.026548 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326e6c9-e951-4f08-9020-aaf0402906e1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:45.026825 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326e6c9-e951-4f08-9020-aaf0402906e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:45.045445 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0326e6c9-e951-4f08-9020-aaf0402906e1 None None] MFA Rules not processed for user `d6cd66b16dc14b84918d5f636a683873`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:31:45.046679 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0326e6c9-e951-4f08-9020-aaf0402906e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:31:45.108405 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4580/9092] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:31:45.118197 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b4e36-0d60-4940-abcf-238edd9e5bba admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:31:45.119954 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-503b4e36-0d60-4940-abcf-238edd9e5bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:31:45.180621 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b4e36-0d60-4940-abcf-238edd9e5bba admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:31:45.184547 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38baf5e7-e69b-4bd1-ba67-d99a3efa4313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:31:45.186199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38baf5e7-e69b-4bd1-ba67-d99a3efa4313 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:45.186199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38baf5e7-e69b-4bd1-ba67-d99a3efa4313 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:45.186199 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38baf5e7-e69b-4bd1-ba67-d99a3efa4313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:45.195229 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38baf5e7-e69b-4bd1-ba67-d99a3efa4313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:31:45.196701 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38baf5e7-e69b-4bd1-ba67-d99a3efa4313 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:31:45.206725 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4513/9093] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:31:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:31:50.656473 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a0041-3e74-40b1-bece-426a0094a606 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:50.657013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a0041-3e74-40b1-bece-426a0094a606 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:50.657013 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a0041-3e74-40b1-bece-426a0094a606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:50.687352 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-b82a0041-3e74-40b1-bece-426a0094a606 None None] MFA Rules not processed for user `77a17d04ccb1477cafd82ca23fd65328`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:31:50.688697 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-b82a0041-3e74-40b1-bece-426a0094a606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:31:50.762453 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4581/9094] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:31:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:31:50.766987 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38baf5e7-e69b-4bd1-ba67-d99a3efa4313 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:31:50.777539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38baf5e7-e69b-4bd1-ba67-d99a3efa4313 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:31:50.782281 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d57984-7a38-418b-a2ed-7006a42cb333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:31:50.782939 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d57984-7a38-418b-a2ed-7006a42cb333 admin admin] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:50.783256 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d57984-7a38-418b-a2ed-7006a42cb333 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:50.783536 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d57984-7a38-418b-a2ed-7006a42cb333 admin admin] PATH_INFO: `/v3/projects` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:50.784235 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d57984-7a38-418b-a2ed-7006a42cb333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:31:50.786164 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d57984-7a38-418b-a2ed-7006a42cb333 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:31:50.896558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:31:50.904152 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4514/9095] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Jul 16 22:31:50 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 16 22:31:50.908451 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a0041-3e74-40b1-bece-426a0094a606 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:31:50.920882 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a0041-3e74-40b1-bece-426a0094a606 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:31:50.976011 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:31:50.986410 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea854bd-032f-4477-908d-61b597829f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:31:50.987229 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea854bd-032f-4477-908d-61b597829f9c admin admin] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:50.987583 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea854bd-032f-4477-908d-61b597829f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:50.987933 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea854bd-032f-4477-908d-61b597829f9c admin admin] PATH_INFO: `/v3/users` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:50.988700 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea854bd-032f-4477-908d-61b597829f9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:31:50.990976 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea854bd-032f-4477-908d-61b597829f9c admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:31:51.140810 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4582/9096] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Jul 16 22:31:50 2022] POST /identity/v3/users => generated 294 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 16 22:31:51.144936 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d57984-7a38-418b-a2ed-7006a42cb333 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:31:51.156643 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d57984-7a38-418b-a2ed-7006a42cb333 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:31:51.161244 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b537ab-4b0f-4a89-a5bd-26d335e04121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:31:51.162824 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b537ab-4b0f-4a89-a5bd-26d335e04121 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:51.166908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b537ab-4b0f-4a89-a5bd-26d335e04121 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:51.166908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b537ab-4b0f-4a89-a5bd-26d335e04121 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:51.166908 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b537ab-4b0f-4a89-a5bd-26d335e04121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:31:51.168255 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b537ab-4b0f-4a89-a5bd-26d335e04121 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:31:51.179499 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4515/9097] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 22:31:51.184332 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea854bd-032f-4477-908d-61b597829f9c admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:31:51.194964 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea854bd-032f-4477-908d-61b597829f9c admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:31:51.199928 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c190c2-34a0-4bec-99db-e34ce991d844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:31:51.201463 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c190c2-34a0-4bec-99db-e34ce991d844 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:51.201676 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c190c2-34a0-4bec-99db-e34ce991d844 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:51.201954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c190c2-34a0-4bec-99db-e34ce991d844 admin admin] PATH_INFO: `/v3/projects/f0faf3012754453086d0950ecfe8604e/users/a4ae9199279243af8f9719b8ee21fd0c/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:51.225098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c190c2-34a0-4bec-99db-e34ce991d844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0faf3012754453086d0950ecfe8604e, user_id=a4ae9199279243af8f9719b8ee21fd0c, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:31:51.228796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c190c2-34a0-4bec-99db-e34ce991d844 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:31:51.300790 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4583/9098] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 22:31:51 2022] PUT /identity/v3/projects/f0faf3012754453086d0950ecfe8604e/users/a4ae9199279243af8f9719b8ee21fd0c/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 16 22:31:51.305224 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b537ab-4b0f-4a89-a5bd-26d335e04121 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:31:51.315715 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b537ab-4b0f-4a89-a5bd-26d335e04121 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:31:51.374375 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f9d4b-76bb-47f2-a441-6945ed739df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:31:51.374960 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f9d4b-76bb-47f2-a441-6945ed739df5 admin admin] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:51.375274 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f9d4b-76bb-47f2-a441-6945ed739df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:51.375549 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f9d4b-76bb-47f2-a441-6945ed739df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:51.376263 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f9d4b-76bb-47f2-a441-6945ed739df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:31:51.377848 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f9d4b-76bb-47f2-a441-6945ed739df5 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:31:51.387539 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4516/9099] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Jul 16 22:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 16 22:31:51.391953 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c190c2-34a0-4bec-99db-e34ce991d844 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:31:51.402665 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c190c2-34a0-4bec-99db-e34ce991d844 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:31:51.407481 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd97087-6e20-4d1f-b0e7-cbc75f8359f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:31:51.408361 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd97087-6e20-4d1f-b0e7-cbc75f8359f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:51.408642 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd97087-6e20-4d1f-b0e7-cbc75f8359f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:51.408916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd97087-6e20-4d1f-b0e7-cbc75f8359f2 admin admin] PATH_INFO: `/v3/projects/f0faf3012754453086d0950ecfe8604e/users/a4ae9199279243af8f9719b8ee21fd0c/roles/bd33b827674a4d4db30c164cab416056` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:51.410949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd97087-6e20-4d1f-b0e7-cbc75f8359f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0faf3012754453086d0950ecfe8604e, user_id=a4ae9199279243af8f9719b8ee21fd0c, role_id=bd33b827674a4d4db30c164cab416056)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:31:51.413684 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd97087-6e20-4d1f-b0e7-cbc75f8359f2 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:31:51.425341 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4584/9100] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Jul 16 22:31:51 2022] PUT /identity/v3/projects/f0faf3012754453086d0950ecfe8604e/users/a4ae9199279243af8f9719b8ee21fd0c/roles/bd33b827674a4d4db30c164cab416056 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:31:57.432804 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59b78d-9552-4bde-8699-ef5c215920a7 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:57.434777 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59b78d-9552-4bde-8699-ef5c215920a7 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:57.435070 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59b78d-9552-4bde-8699-ef5c215920a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:57.471046 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-8c59b78d-9552-4bde-8699-ef5c215920a7 None None] MFA Rules not processed for user `a4ae9199279243af8f9719b8ee21fd0c`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:31:57.472746 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8c59b78d-9552-4bde-8699-ef5c215920a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:31:57.543324 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4517/9101] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:31:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:31:57.560175 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd97087-6e20-4d1f-b0e7-cbc75f8359f2 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:31:57.561944 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-2cd97087-6e20-4d1f-b0e7-cbc75f8359f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:31:57.637249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd97087-6e20-4d1f-b0e7-cbc75f8359f2 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:31:57.642853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be6d87-b7b0-4b34-8636-92e41846657e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:31:57.643542 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be6d87-b7b0-4b34-8636-92e41846657e service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:31:57.643826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be6d87-b7b0-4b34-8636-92e41846657e service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:31:57.644104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be6d87-b7b0-4b34-8636-92e41846657e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:31:57.702070 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be6d87-b7b0-4b34-8636-92e41846657e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:31:57.703954 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be6d87-b7b0-4b34-8636-92e41846657e service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:31:57.714153 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4585/9102] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:31:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:32:00.319059 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726b906-6a96-42e7-8dab-e1e39daefeaf None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:32:00.319606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726b906-6a96-42e7-8dab-e1e39daefeaf None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:32:00.319606 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726b906-6a96-42e7-8dab-e1e39daefeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:32:00.340307 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-f726b906-6a96-42e7-8dab-e1e39daefeaf None None] MFA Rules not processed for user `77a17d04ccb1477cafd82ca23fd65328`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:32:00.345435 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f726b906-6a96-42e7-8dab-e1e39daefeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:32:00.349074 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4518/9103] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:32:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:32:00.684965 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be6d87-b7b0-4b34-8636-92e41846657e service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:32:00.686368 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-23be6d87-b7b0-4b34-8636-92e41846657e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:32:00.732561 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:32:00.743471 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be6d87-b7b0-4b34-8636-92e41846657e service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:32:00.748374 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186447af-66eb-4033-b292-7866955132f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:32:00.749085 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186447af-66eb-4033-b292-7866955132f3 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:32:00.749364 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186447af-66eb-4033-b292-7866955132f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:32:00.749637 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186447af-66eb-4033-b292-7866955132f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:32:00.751526 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-186447af-66eb-4033-b292-7866955132f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:32:00.761913 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186447af-66eb-4033-b292-7866955132f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:32:00.763375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186447af-66eb-4033-b292-7866955132f3 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:32:00.771282 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4586/9104] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:32:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:32:01.257850 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726b906-6a96-42e7-8dab-e1e39daefeaf None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:32:01.259426 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-f726b906-6a96-42e7-8dab-e1e39daefeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:32:01.343632 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726b906-6a96-42e7-8dab-e1e39daefeaf None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:32:01.348749 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeebdee-d7e2-412e-817a-d4325d728e78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:32:01.349413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeebdee-d7e2-412e-817a-d4325d728e78 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:32:01.349697 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeebdee-d7e2-412e-817a-d4325d728e78 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:32:01.349982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeebdee-d7e2-412e-817a-d4325d728e78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:32:01.351814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-8aeebdee-d7e2-412e-817a-d4325d728e78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:32:01.360928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=100 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:32:01.365151 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeebdee-d7e2-412e-817a-d4325d728e78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:32:01.369924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeebdee-d7e2-412e-817a-d4325d728e78 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:32:01.378409 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4519/9105] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:32:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:32:04.279123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186447af-66eb-4033-b292-7866955132f3 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:32:04.288026 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186447af-66eb-4033-b292-7866955132f3 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:32:04.291724 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6768d9-150f-4847-9872-837155f79208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:32:04.292406 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6768d9-150f-4847-9872-837155f79208 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:32:04.292824 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6768d9-150f-4847-9872-837155f79208 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:32:04.293117 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6768d9-150f-4847-9872-837155f79208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:32:04.294875 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1f6768d9-150f-4847-9872-837155f79208 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:32:04.304826 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6768d9-150f-4847-9872-837155f79208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:32:04.306249 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6768d9-150f-4847-9872-837155f79208 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:32:04.315499 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4587/9106] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:32:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:32:10.471421 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeebdee-d7e2-412e-817a-d4325d728e78 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:32:10.484333 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeebdee-d7e2-412e-817a-d4325d728e78 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:32:10.490126 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e288d5d-e88a-4208-8132-0b8bcdebff5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:32:10.491233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e288d5d-e88a-4208-8132-0b8bcdebff5c service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:32:10.491233 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e288d5d-e88a-4208-8132-0b8bcdebff5c service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:32:10.491441 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e288d5d-e88a-4208-8132-0b8bcdebff5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:32:10.493153 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9e288d5d-e88a-4208-8132-0b8bcdebff5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:32:10.506726 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e288d5d-e88a-4208-8132-0b8bcdebff5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:32:10.508462 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e288d5d-e88a-4208-8132-0b8bcdebff5c service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:32:10.519565 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4520/9107] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:32:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:32:13.129369 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6768d9-150f-4847-9872-837155f79208 service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:32:13.139311 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6768d9-150f-4847-9872-837155f79208 service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:32:13.143163 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b718f5-ade8-4e4d-9f72-769741c8c96b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:32:13.143808 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b718f5-ade8-4e4d-9f72-769741c8c96b service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:32:13.144092 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b718f5-ade8-4e4d-9f72-769741c8c96b service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:32:13.144370 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b718f5-ade8-4e4d-9f72-769741c8c96b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:32:13.154568 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b718f5-ade8-4e4d-9f72-769741c8c96b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:32:13.156067 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b718f5-ade8-4e4d-9f72-769741c8c96b service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:32:13.165792 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4588/9108] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:32:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:32:15.439119 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e288d5d-e88a-4208-8132-0b8bcdebff5c service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:32:15.440573 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-9e288d5d-e88a-4208-8132-0b8bcdebff5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:32:15.455193 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e288d5d-e88a-4208-8132-0b8bcdebff5c service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:32:15.462862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458f603-ae95-4718-ba65-5127e44068dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:32:15.462862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458f603-ae95-4718-ba65-5127e44068dc service nova] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:32:15.462862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458f603-ae95-4718-ba65-5127e44068dc service nova] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:32:15.462862 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458f603-ae95-4718-ba65-5127e44068dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:32:15.463709 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2458f603-ae95-4718-ba65-5127e44068dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:32:15.476693 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458f603-ae95-4718-ba65-5127e44068dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:32:15.478284 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458f603-ae95-4718-ba65-5127e44068dc service nova] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:32:15.489711 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4521/9109] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:32:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:32:23.161504 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=19 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:32:25.485041 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=15 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:34:08.353047 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b718f5-ade8-4e4d-9f72-769741c8c96b service neutron] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:34:08.364663 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b718f5-ade8-4e4d-9f72-769741c8c96b service neutron] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:34:08.371910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02991bc9-188d-4883-a66a-c46a7d1aaf6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:34:08.371910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02991bc9-188d-4883-a66a-c46a7d1aaf6d service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:34:08.371910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02991bc9-188d-4883-a66a-c46a7d1aaf6d service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:34:08.371910 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02991bc9-188d-4883-a66a-c46a7d1aaf6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:34:08.373086 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-02991bc9-188d-4883-a66a-c46a7d1aaf6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:34:08.385618 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02991bc9-188d-4883-a66a-c46a7d1aaf6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:34:08.387240 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02991bc9-188d-4883-a66a-c46a7d1aaf6d service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:34:08.398089 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4589/9110] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:34:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:34:10.613137 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458f603-ae95-4718-ba65-5127e44068dc service nova] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:34:10.614555 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-2458f603-ae95-4718-ba65-5127e44068dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:34:10.669924 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458f603-ae95-4718-ba65-5127e44068dc service nova] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:34:10.674480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73471064-a60a-4078-92f7-8e7bbb6e98db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ec461b4719448597c99fd9368fa740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:34:10.675157 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73471064-a60a-4078-92f7-8e7bbb6e98db service glance] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:34:10.675444 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73471064-a60a-4078-92f7-8e7bbb6e98db service glance] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:34:10.675725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73471064-a60a-4078-92f7-8e7bbb6e98db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:34:10.677480 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-73471064-a60a-4078-92f7-8e7bbb6e98db service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:34:10.702864 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73471064-a60a-4078-92f7-8e7bbb6e98db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:34:10.704295 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73471064-a60a-4078-92f7-8e7bbb6e98db service glance] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:34:10.715525 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4522/9111] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:34:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:34:15.418666 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ab444-8729-42b6-9154-84f6dbdcd96f None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:34:15.419123 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ab444-8729-42b6-9154-84f6dbdcd96f None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:34:15.419258 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ab444-8729-42b6-9154-84f6dbdcd96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:34:15.450963 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-0f0ab444-8729-42b6-9154-84f6dbdcd96f None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:34:15.452207 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-0f0ab444-8729-42b6-9154-84f6dbdcd96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:34:15.506966 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4590/9112] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 22:34:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:34:15.639149 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73471064-a60a-4078-92f7-8e7bbb6e98db service glance] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:34:15.640560 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-73471064-a60a-4078-92f7-8e7bbb6e98db service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:34:15.709174 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73471064-a60a-4078-92f7-8e7bbb6e98db service glance] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:34:15.714182 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e409c-87cc-4eea-889b-04c2d1e6e182 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:34:15.714819 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e409c-87cc-4eea-889b-04c2d1e6e182 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:34:15.715138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e409c-87cc-4eea-889b-04c2d1e6e182 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:34:15.715419 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e409c-87cc-4eea-889b-04c2d1e6e182 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:34:15.724008 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e409c-87cc-4eea-889b-04c2d1e6e182 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:34:15.725558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e409c-87cc-4eea-889b-04c2d1e6e182 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:34:15.733749 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4523/9113] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 22:34:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 22:34:25.499509 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=35 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:34:25.730471 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=63 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:34:25.821422 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abe6ec-0fa0-4182-a474-1f6f6047a619 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:34:25.821737 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abe6ec-0fa0-4182-a474-1f6f6047a619 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:34:25.821996 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abe6ec-0fa0-4182-a474-1f6f6047a619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:34:25.840186 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-43abe6ec-0fa0-4182-a474-1f6f6047a619 None None] MFA Rules not processed for user `77a17d04ccb1477cafd82ca23fd65328`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:34:25.841375 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-43abe6ec-0fa0-4182-a474-1f6f6047a619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:34:25.849038 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4591/9114] 10.222.0.16 () {58 vars in 957 bytes} [Sat Jul 16 22:34:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:34:26.163698 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e409c-87cc-4eea-889b-04c2d1e6e182 service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:34:26.172950 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e409c-87cc-4eea-889b-04c2d1e6e182 service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:34:26.176825 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd9103-7842-49a8-8f0d-733bb9c84e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:34:26.177449 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd9103-7842-49a8-8f0d-733bb9c84e68 service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:34:26.177728 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd9103-7842-49a8-8f0d-733bb9c84e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:34:26.178003 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd9103-7842-49a8-8f0d-733bb9c84e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:34:26.180006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-c9cd9103-7842-49a8-8f0d-733bb9c84e68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:34:26.189245 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd9103-7842-49a8-8f0d-733bb9c84e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:34:26.191516 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd9103-7842-49a8-8f0d-733bb9c84e68 service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:34:26.199506 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4524/9115] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:34:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:34:26.594893 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abe6ec-0fa0-4182-a474-1f6f6047a619 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:34:26.602655 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd9103-7842-49a8-8f0d-733bb9c84e68 service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:34:26.607259 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abe6ec-0fa0-4182-a474-1f6f6047a619 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:34:26.611342 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd9103-7842-49a8-8f0d-733bb9c84e68 service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:34:26.612794 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2125278-f996-494a-bad2-e3b95a7545db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:34:26.613438 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2125278-f996-494a-bad2-e3b95a7545db service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:34:26.613713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2125278-f996-494a-bad2-e3b95a7545db service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:34:26.613983 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2125278-f996-494a-bad2-e3b95a7545db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:34:26.615728 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-e2125278-f996-494a-bad2-e3b95a7545db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:34:26.616101 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d97c50-ec7f-4d6c-b9dd-73a0b371e95d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:34:26.616814 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d97c50-ec7f-4d6c-b9dd-73a0b371e95d service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:34:26.617217 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d97c50-ec7f-4d6c-b9dd-73a0b371e95d service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:34:26.617501 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d97c50-ec7f-4d6c-b9dd-73a0b371e95d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:34:26.619275 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-79d97c50-ec7f-4d6c-b9dd-73a0b371e95d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:34:26.627396 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2125278-f996-494a-bad2-e3b95a7545db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:34:26.629712 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2125278-f996-494a-bad2-e3b95a7545db service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:34:26.634718 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d97c50-ec7f-4d6c-b9dd-73a0b371e95d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:34:26.636128 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d97c50-ec7f-4d6c-b9dd-73a0b371e95d service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:34:26.639913 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4592/9116] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:34:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:34:26.647585 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4525/9117] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:34:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:34:29.164430 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849ca63-10e2-4768-86bd-4832478e3ed4 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:34:29.164916 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849ca63-10e2-4768-86bd-4832478e3ed4 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:34:29.165054 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849ca63-10e2-4768-86bd-4832478e3ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:34:29.183687 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-5849ca63-10e2-4768-86bd-4832478e3ed4 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:34:29.184879 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-5849ca63-10e2-4768-86bd-4832478e3ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:34:29.192845 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4593/9118] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 22:34:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:34:29.205138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d97c50-ec7f-4d6c-b9dd-73a0b371e95d service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:34:29.218032 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d97c50-ec7f-4d6c-b9dd-73a0b371e95d service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:34:29.223523 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dac27a-9ab4-4db5-b87b-851ed23c2eba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:34:29.224205 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dac27a-9ab4-4db5-b87b-851ed23c2eba service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:34:29.224489 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dac27a-9ab4-4db5-b87b-851ed23c2eba service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:34:29.224764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dac27a-9ab4-4db5-b87b-851ed23c2eba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:34:29.233508 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dac27a-9ab4-4db5-b87b-851ed23c2eba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:34:29.235138 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dac27a-9ab4-4db5-b87b-851ed23c2eba service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:34:29.243689 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4526/9119] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 22:34:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 22:34:33.989231 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849ca63-10e2-4768-86bd-4832478e3ed4 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:34:34.000098 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849ca63-10e2-4768-86bd-4832478e3ed4 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:34:34.003713 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94507d4b-2dbe-4479-ac7a-c6168e5fa537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:34:34.004384 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94507d4b-2dbe-4479-ac7a-c6168e5fa537 service neutron] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:34:34.004662 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94507d4b-2dbe-4479-ac7a-c6168e5fa537 service neutron] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:34:34.004934 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94507d4b-2dbe-4479-ac7a-c6168e5fa537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:34:34.007625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-94507d4b-2dbe-4479-ac7a-c6168e5fa537 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:34:34.017306 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94507d4b-2dbe-4479-ac7a-c6168e5fa537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:34:34.018720 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94507d4b-2dbe-4479-ac7a-c6168e5fa537 service neutron] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:34:34.026578 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4594/9120] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:34:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:34:39.240734 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=18 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:34:44.023174 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=18 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:35:10.176123 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dac27a-9ab4-4db5-b87b-851ed23c2eba service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:35:10.177512 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-33dac27a-9ab4-4db5-b87b-851ed23c2eba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:35:10.265682 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dac27a-9ab4-4db5-b87b-851ed23c2eba service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:35:10.270859 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb548f-420a-4eaa-97df-e77447999735 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:35:10.271529 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb548f-420a-4eaa-97df-e77447999735 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:35:10.271812 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb548f-420a-4eaa-97df-e77447999735 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:35:10.272087 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb548f-420a-4eaa-97df-e77447999735 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:35:10.273826 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-aabb548f-420a-4eaa-97df-e77447999735 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:35:10.285764 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb548f-420a-4eaa-97df-e77447999735 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:35:10.287433 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb548f-420a-4eaa-97df-e77447999735 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:35:10.297803 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4527/9121] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:35:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:35:20.293769 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=32 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:36:21.676440 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8371f74-f5c6-4ed1-8aaf-58e304134fd1 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:36:21.676984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8371f74-f5c6-4ed1-8aaf-58e304134fd1 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:36:21.676984 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8371f74-f5c6-4ed1-8aaf-58e304134fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:36:21.731730 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-a8371f74-f5c6-4ed1-8aaf-58e304134fd1 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:36:21.733941 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a8371f74-f5c6-4ed1-8aaf-58e304134fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:36:21.751651 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4595/9122] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Jul 16 22:36:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 16 22:36:21.791267 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb548f-420a-4eaa-97df-e77447999735 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:36:21.812539 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb548f-420a-4eaa-97df-e77447999735 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:36:21.817491 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ba33c-f885-4c32-a3ef-a0d5cb203a93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:36:21.818125 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ba33c-f885-4c32-a3ef-a0d5cb203a93 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:36:21.818404 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ba33c-f885-4c32-a3ef-a0d5cb203a93 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:36:21.818679 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ba33c-f885-4c32-a3ef-a0d5cb203a93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:36:21.827418 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ba33c-f885-4c32-a3ef-a0d5cb203a93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:36:21.828996 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ba33c-f885-4c32-a3ef-a0d5cb203a93 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:36:21.837203 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4528/9123] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 22:36:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 22:36:31.747716 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=18 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:36:31.833948 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=10 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:36:32.611790 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e7068-3070-440b-bb27-4bcaedc38545 None None] REQUEST_METHOD: `POST` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:36:32.612083 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e7068-3070-440b-bb27-4bcaedc38545 None None] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:36:32.612365 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e7068-3070-440b-bb27-4bcaedc38545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:36:32.629869 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.auth.core [None req-807e7068-3070-440b-bb27-4bcaedc38545 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98196) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:36:32.631116 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-807e7068-3070-440b-bb27-4bcaedc38545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:36:32.638279 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4596/9124] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 22:36:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:36:32.650928 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ba33c-f885-4c32-a3ef-a0d5cb203a93 service swift] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:36:32.662139 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ba33c-f885-4c32-a3ef-a0d5cb203a93 service swift] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:36:32.667135 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28d6dc-16b2-4f52-b484-34017460c5d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:36:32.667771 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28d6dc-16b2-4f52-b484-34017460c5d4 service swift] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:36:32.668051 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28d6dc-16b2-4f52-b484-34017460c5d4 service swift] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:36:32.668325 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28d6dc-16b2-4f52-b484-34017460c5d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:36:32.676258 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28d6dc-16b2-4f52-b484-34017460c5d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:36:32.678079 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28d6dc-16b2-4f52-b484-34017460c5d4 service swift] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:36:32.686052 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4529/9125] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 22:36:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 22:36:34.666735 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e7068-3070-440b-bb27-4bcaedc38545 None None] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:36:34.710904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e7068-3070-440b-bb27-4bcaedc38545 None None] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:36:34.718901 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0483b-4e25-46ac-a7a5-06ffb1759cbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f515bfe2094b41afe82b4bc57e4b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:36:34.719690 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0483b-4e25-46ac-a7a5-06ffb1759cbf service nova] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:36:34.720022 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0483b-4e25-46ac-a7a5-06ffb1759cbf service nova] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:36:34.720300 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0483b-4e25-46ac-a7a5-06ffb1759cbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:36:34.722543 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-68b0483b-4e25-46ac-a7a5-06ffb1759cbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:36:34.736388 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0483b-4e25-46ac-a7a5-06ffb1759cbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:36:34.738371 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0483b-4e25-46ac-a7a5-06ffb1759cbf service nova] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:36:34.751919 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4597/9126] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:36:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:36:38.612837 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db579ce-53b5-4bea-a7ac-35ad31e82754 None None] REQUEST_METHOD: `POST` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:36:38.625708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db579ce-53b5-4bea-a7ac-35ad31e82754 None None] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:36:38.625708 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db579ce-53b5-4bea-a7ac-35ad31e82754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:36:38.631616 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.auth.core [None req-7db579ce-53b5-4bea-a7ac-35ad31e82754 None None] MFA Rules not processed for user `2b154ad257954b53a13730b4a9f60570`. Rule list: `[]` (Enabled: `True`). {{(pid=98195) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 16 22:36:38.632869 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-7db579ce-53b5-4bea-a7ac-35ad31e82754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:36:38.640306 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4530/9127] 10.222.0.16 () {58 vars in 967 bytes} [Sat Jul 16 22:36:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 16 22:36:38.653226 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0483b-4e25-46ac-a7a5-06ffb1759cbf service nova] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:36:38.665241 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0483b-4e25-46ac-a7a5-06ffb1759cbf service nova] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:36:38.670219 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e03ceb-ae67-40e9-9ae0-36294ddd32c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a66df01ea414b34a8842488b145974f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:36:38.670853 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e03ceb-ae67-40e9-9ae0-36294ddd32c9 service swift] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:36:38.671261 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e03ceb-ae67-40e9-9ae0-36294ddd32c9 service swift] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:36:38.671547 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e03ceb-ae67-40e9-9ae0-36294ddd32c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:36:38.680162 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e03ceb-ae67-40e9-9ae0-36294ddd32c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:36:38.681736 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e03ceb-ae67-40e9-9ae0-36294ddd32c9 service swift] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:36:38.690254 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4598/9128] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Jul 16 22:36:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 16 22:36:46.813838 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db579ce-53b5-4bea-a7ac-35ad31e82754 None None] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:36:46.835834 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db579ce-53b5-4bea-a7ac-35ad31e82754 None None] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:36:46.839619 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c27ee5-9c9a-4696-ac2e-3de62ce7d5fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd858f3e6ba4523b056bbdc2af427b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:36:46.840330 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c27ee5-9c9a-4696-ac2e-3de62ce7d5fc service neutron] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:36:46.840681 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c27ee5-9c9a-4696-ac2e-3de62ce7d5fc service neutron] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:36:46.841023 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c27ee5-9c9a-4696-ac2e-3de62ce7d5fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:36:46.915074 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c27ee5-9c9a-4696-ac2e-3de62ce7d5fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:36:46.916511 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c27ee5-9c9a-4696-ac2e-3de62ce7d5fc service neutron] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:36:46.936182 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4531/9129] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:36:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 16 22:36:48.686648 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=19 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:36:48.860357 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e03ceb-ae67-40e9-9ae0-36294ddd32c9 service swift] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:36:48.882449 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e03ceb-ae67-40e9-9ae0-36294ddd32c9 service swift] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:36:48.893456 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44d83e-b912-4ec0-9307-a7f090bb176a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:36:48.897104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44d83e-b912-4ec0-9307-a7f090bb176a service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:36:48.897104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44d83e-b912-4ec0-9307-a7f090bb176a service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:36:48.897104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44d83e-b912-4ec0-9307-a7f090bb176a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:36:48.897104 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-3e44d83e-b912-4ec0-9307-a7f090bb176a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:36:48.909636 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44d83e-b912-4ec0-9307-a7f090bb176a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:36:48.911552 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44d83e-b912-4ec0-9307-a7f090bb176a service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:36:48.922755 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4599/9130] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:36:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:36:52.701442 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c27ee5-9c9a-4696-ac2e-3de62ce7d5fc service neutron] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:36:52.712875 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c27ee5-9c9a-4696-ac2e-3de62ce7d5fc service neutron] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:36:52.717872 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18402875-56db-4ec4-a147-de7461715298 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:36:52.718517 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18402875-56db-4ec4-a147-de7461715298 service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:36:52.718802 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18402875-56db-4ec4-a147-de7461715298 service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:36:52.719109 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18402875-56db-4ec4-a147-de7461715298 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:36:52.721013 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-18402875-56db-4ec4-a147-de7461715298 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:36:52.733264 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18402875-56db-4ec4-a147-de7461715298 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:36:52.735561 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18402875-56db-4ec4-a147-de7461715298 service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:36:52.746232 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4532/9131] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:36:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:36:52.838796 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44d83e-b912-4ec0-9307-a7f090bb176a service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:36:52.850533 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44d83e-b912-4ec0-9307-a7f090bb176a service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:36:52.856435 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb7ca5-8996-4769-9bf3-aa7d583a42e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:36:52.857305 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb7ca5-8996-4769-9bf3-aa7d583a42e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:36:52.857587 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb7ca5-8996-4769-9bf3-aa7d583a42e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:36:52.857863 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb7ca5-8996-4769-9bf3-aa7d583a42e6 admin admin] PATH_INFO: `/v3/users/77a17d04ccb1477cafd82ca23fd65328` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:36:52.859114 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb7ca5-8996-4769-9bf3-aa7d583a42e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77a17d04ccb1477cafd82ca23fd65328)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:36:52.861088 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb7ca5-8996-4769-9bf3-aa7d583a42e6 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:36:53.040956 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a0cb7ca5-8996-4769-9bf3-aa7d583a42e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77a17d04ccb1477cafd82ca23fd65328'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:36:53.048592 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a0cb7ca5-8996-4769-9bf3-aa7d583a42e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77a17d04ccb1477cafd82ca23fd65328'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:36:53.113612 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a0cb7ca5-8996-4769-9bf3-aa7d583a42e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77a17d04ccb1477cafd82ca23fd65328'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:36:53.114264 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a0cb7ca5-8996-4769-9bf3-aa7d583a42e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77a17d04ccb1477cafd82ca23fd65328'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:36:53.128007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-a0cb7ca5-8996-4769-9bf3-aa7d583a42e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77a17d04ccb1477cafd82ca23fd65328'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:36:53.135570 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4600/9132] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 22:36:52 2022] DELETE /identity/v3/users/77a17d04ccb1477cafd82ca23fd65328 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:36:53.503798 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18402875-56db-4ec4-a147-de7461715298 service placement] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:36:53.514757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18402875-56db-4ec4-a147-de7461715298 service placement] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:36:53.574725 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdea5c1-3a38-4f2a-b630-5482d2c03985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:36:53.575608 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdea5c1-3a38-4f2a-b630-5482d2c03985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:36:53.575894 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdea5c1-3a38-4f2a-b630-5482d2c03985 admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:36:53.576168 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdea5c1-3a38-4f2a-b630-5482d2c03985 admin admin] PATH_INFO: `/v3/projects/4490e1139a4046228fe39fbdc7973d20` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:36:53.577349 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdea5c1-3a38-4f2a-b630-5482d2c03985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4490e1139a4046228fe39fbdc7973d20)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:36:53.579303 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdea5c1-3a38-4f2a-b630-5482d2c03985 admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:36:53.669006 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:36:53.678558 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bfdea5c1-3a38-4f2a-b630-5482d2c03985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4490e1139a4046228fe39fbdc7973d20', 'request_id': 'req-bfdea5c1-3a38-4f2a-b630-5482d2c03985'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:36:53.683852 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bfdea5c1-3a38-4f2a-b630-5482d2c03985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4490e1139a4046228fe39fbdc7973d20', 'request_id': 'req-bfdea5c1-3a38-4f2a-b630-5482d2c03985'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:36:53.689807 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bfdea5c1-3a38-4f2a-b630-5482d2c03985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4490e1139a4046228fe39fbdc7973d20', 'request_id': 'req-bfdea5c1-3a38-4f2a-b630-5482d2c03985'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:36:53.776974 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bfdea5c1-3a38-4f2a-b630-5482d2c03985 admin admin] The token cache is being invalidate because project 4490e1139a4046228fe39fbdc7973d20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 22:36:53.777630 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bfdea5c1-3a38-4f2a-b630-5482d2c03985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:36:53.777820 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-bfdea5c1-3a38-4f2a-b630-5482d2c03985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:36:53.779492 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4533/9133] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 22:36:53 2022] DELETE /identity/v3/projects/4490e1139a4046228fe39fbdc7973d20 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:36:53.783490 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb7ca5-8996-4769-9bf3-aa7d583a42e6 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:36:53.785738 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-a0cb7ca5-8996-4769-9bf3-aa7d583a42e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:36:53.798685 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb7ca5-8996-4769-9bf3-aa7d583a42e6 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:36:53.856638 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f620d9a-d42a-437f-9e95-b7e99e052117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:36:53.857505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f620d9a-d42a-437f-9e95-b7e99e052117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:36:53.857785 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f620d9a-d42a-437f-9e95-b7e99e052117 admin admin] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:36:53.858059 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f620d9a-d42a-437f-9e95-b7e99e052117 admin admin] PATH_INFO: `/v3/users/a4ae9199279243af8f9719b8ee21fd0c` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:36:53.859335 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f620d9a-d42a-437f-9e95-b7e99e052117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4ae9199279243af8f9719b8ee21fd0c)` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:36:53.861331 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f620d9a-d42a-437f-9e95-b7e99e052117 admin admin] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:36:54.058596 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f620d9a-d42a-437f-9e95-b7e99e052117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ae9199279243af8f9719b8ee21fd0c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:36:54.066467 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f620d9a-d42a-437f-9e95-b7e99e052117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ae9199279243af8f9719b8ee21fd0c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:36:54.070196 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:36:54.135949 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f620d9a-d42a-437f-9e95-b7e99e052117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ae9199279243af8f9719b8ee21fd0c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:36:54.136571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f620d9a-d42a-437f-9e95-b7e99e052117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ae9199279243af8f9719b8ee21fd0c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:36:54.150002 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.notifications [None req-1f620d9a-d42a-437f-9e95-b7e99e052117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ae9199279243af8f9719b8ee21fd0c'} {{(pid=98196) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:36:54.156050 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4601/9134] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Jul 16 22:36:53 2022] DELETE /identity/v3/users/a4ae9199279243af8f9719b8ee21fd0c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:36:54.401524 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdea5c1-3a38-4f2a-b630-5482d2c03985 admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:36:54.403147 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-bfdea5c1-3a38-4f2a-b630-5482d2c03985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:36:54.418757 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdea5c1-3a38-4f2a-b630-5482d2c03985 admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:36:54.475849 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a51848-054c-4db8-877e-5bdded7b10fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cd66b16dc14b84918d5f636a683873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455f5961d0804544b3b78f843a889637', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:36:54.476714 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a51848-054c-4db8-877e-5bdded7b10fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:36:54.476982 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a51848-054c-4db8-877e-5bdded7b10fc admin admin] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:36:54.477257 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a51848-054c-4db8-877e-5bdded7b10fc admin admin] PATH_INFO: `/v3/projects/f0faf3012754453086d0950ecfe8604e` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:36:54.478439 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a51848-054c-4db8-877e-5bdded7b10fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0faf3012754453086d0950ecfe8604e)` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:36:54.480565 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a51848-054c-4db8-877e-5bdded7b10fc admin admin] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:36:54.583278 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-04a51848-054c-4db8-877e-5bdded7b10fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0faf3012754453086d0950ecfe8604e', 'request_id': 'req-04a51848-054c-4db8-877e-5bdded7b10fc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:36:54.588800 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-04a51848-054c-4db8-877e-5bdded7b10fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0faf3012754453086d0950ecfe8604e', 'request_id': 'req-04a51848-054c-4db8-877e-5bdded7b10fc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:36:54.594871 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-04a51848-054c-4db8-877e-5bdded7b10fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0faf3012754453086d0950ecfe8604e', 'request_id': 'req-04a51848-054c-4db8-877e-5bdded7b10fc'} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:36:54.661579 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-04a51848-054c-4db8-877e-5bdded7b10fc admin admin] The token cache is being invalidate because project f0faf3012754453086d0950ecfe8604e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98195) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 16 22:36:54.661797 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-04a51848-054c-4db8-877e-5bdded7b10fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:36:54.662413 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.notifications [None req-04a51848-054c-4db8-877e-5bdded7b10fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98195) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 16 22:36:54.664077 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4534/9135] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Jul 16 22:36:54 2022] DELETE /identity/v3/projects/f0faf3012754453086d0950ecfe8604e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 16 22:37:04.204844 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=8,keystone:DELETE=2 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:37:04.658801 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=67,keystone:DELETE=11,keystone:INSERT=2 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:39:12.330025 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f620d9a-d42a-437f-9e95-b7e99e052117 admin admin] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:39:12.331505 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-1f620d9a-d42a-437f-9e95-b7e99e052117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:39:12.400625 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f620d9a-d42a-437f-9e95-b7e99e052117 admin admin] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:39:12.461296 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34617877-46f1-43ff-9ea0-183904870b01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:39:12.461950 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34617877-46f1-43ff-9ea0-183904870b01 service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:39:12.462232 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34617877-46f1-43ff-9ea0-183904870b01 service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:39:12.462506 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34617877-46f1-43ff-9ea0-183904870b01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:39:12.464324 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-34617877-46f1-43ff-9ea0-183904870b01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:39:12.475904 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34617877-46f1-43ff-9ea0-183904870b01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:39:12.477483 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34617877-46f1-43ff-9ea0-183904870b01 service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:39:12.487973 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4602/9136] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:39:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:39:22.483286 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=58 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:40:11.153250 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a51848-054c-4db8-877e-5bdded7b10fc admin admin] Authenticating user token {{(pid=98195) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:40:11.154685 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-04a51848-054c-4db8-877e-5bdded7b10fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:40:11.169843 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a51848-054c-4db8-877e-5bdded7b10fc admin admin] Validating token access rules against request {{(pid=98195) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:40:11.175265 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572f7e9-f9ba-4529-91dd-e9faef803b2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98195) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:40:11.176161 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572f7e9-f9ba-4529-91dd-e9faef803b2c service placement] REQUEST_METHOD: `GET` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:40:11.176443 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572f7e9-f9ba-4529-91dd-e9faef803b2c service placement] SCRIPT_NAME: `/identity` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:40:11.176717 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572f7e9-f9ba-4529-91dd-e9faef803b2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98195) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:40:11.178500 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.fernet_utils [None req-4572f7e9-f9ba-4529-91dd-e9faef803b2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98195) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:40:11.190925 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572f7e9-f9ba-4529-91dd-e9faef803b2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:40:11.192537 ncdv-master-1 devstack@keystone.service[98195]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572f7e9-f9ba-4529-91dd-e9faef803b2c service placement] RBAC: Authorization granted {{(pid=98195) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:40:11.202633 ncdv-master-1 devstack@keystone.service[98195]: [pid: 98195|app: 0|req: 4535/9137] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:40:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:40:21.198239 ncdv-master-1 devstack@keystone.service[98195]: DEBUG dbcounter [-] [98195] Writing DB stats keystone:SELECT=6 {{(pid=98195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 22:44:18.336571 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34617877-46f1-43ff-9ea0-183904870b01 service placement] Authenticating user token {{(pid=98196) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 16 22:44:18.338007 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.fernet_utils [None req-34617877-46f1-43ff-9ea0-183904870b01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98196) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 16 22:44:18.372214 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34617877-46f1-43ff-9ea0-183904870b01 service placement] Validating token access rules against request {{(pid=98196) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 16 22:44:18.377248 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f906d-8ef5-4a4d-a569-71a4ff79083f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2054690a99c843aaaf19d8193510fec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98196) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 16 22:44:18.377880 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f906d-8ef5-4a4d-a569-71a4ff79083f service placement] REQUEST_METHOD: `GET` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 16 22:44:18.378160 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f906d-8ef5-4a4d-a569-71a4ff79083f service placement] SCRIPT_NAME: `/identity` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 16 22:44:18.378434 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f906d-8ef5-4a4d-a569-71a4ff79083f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98196) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 16 22:44:18.387452 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f906d-8ef5-4a4d-a569-71a4ff79083f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 16 22:44:18.389029 ncdv-master-1 devstack@keystone.service[98196]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f906d-8ef5-4a4d-a569-71a4ff79083f service placement] RBAC: Authorization granted {{(pid=98196) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 16 22:44:18.399329 ncdv-master-1 devstack@keystone.service[98196]: [pid: 98196|app: 0|req: 4603/9138] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Jul 16 22:44:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 16 22:44:28.394758 ncdv-master-1 devstack@keystone.service[98196]: DEBUG dbcounter [-] [98196] Writing DB stats keystone:SELECT=11 {{(pid=98196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}